2024-09-22T08:03:45.597 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-22T08:03:45.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-22T08:03:45.706 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915040 branch: wip-skoduri-cloud-restore description: rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} email: null first_in_suite: false job_id: '7915040' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-skoduri-cloud-restore ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 lockdep: true osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 lockdep: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: 8852379c050c686f4605f33f0129009b2029ca9d ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8852379c050c686f4605f33f0129009b2029ca9d openssl_keys: rgw.client.0: ca: root client: client.0 embed-key: true root: client: client.0 cn: teuthology install: - client.0 key-type: rsa:4096 rgw: client.0: ssl certificate: rgw.client.0 compression type: random ec-data-pool: false frontend: beast storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 s3 main: RGW11111111111111111 s3 tenant: RGW33333333333333333 force-branch: ceph-master storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-skoduri-cloud-restore sha1: 8852379c050c686f4605f33f0129009b2029ca9d owner: scheduled_soumyakoduri@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b sha1: 8852379c050c686f4605f33f0129009b2029ca9d sleep_before_teardown: 0 suite: rgw suite_branch: wip-skoduri-cloud-restore suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_8852379c050c686f4605f33f0129009b2029ca9d/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 8852379c050c686f4605f33f0129009b2029ca9d targets: smithi038.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPqRwOZxd4MuOF09PB7zzi/NWPGs5RsptCjfHQvpbkpCbZtpqaIxpZJuLiG0Xol9CBOY1NVUNoOeqLOUGRMSy2g= smithi042.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAreu318Z7fzSMGkOGhUubzeQJ9JzlHdpUVKD5VbpajMwwoZ302elfKg71HGbsQHfYdTGBLQzNV1jH0YeF6Zl4k= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-22_06:37:27 tube: smithi user: soumyakoduri verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-22T08:03:45.707 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_8852379c050c686f4605f33f0129009b2029ca9d/qa; will attempt to use it 2024-09-22T08:03:45.707 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_8852379c050c686f4605f33f0129009b2029ca9d/qa/tasks 2024-09-22T08:03:45.707 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-22T08:03:45.709 INFO:teuthology.task.internal:Checking packages... 2024-09-22T08:03:45.730 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8852379c050c686f4605f33f0129009b2029ca9d' 2024-09-22T08:03:45.730 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-22T08:03:45.730 INFO:teuthology.packaging:ref: None 2024-09-22T08:03:45.730 INFO:teuthology.packaging:tag: None 2024-09-22T08:03:45.730 INFO:teuthology.packaging:branch: wip-skoduri-cloud-restore 2024-09-22T08:03:45.730 INFO:teuthology.packaging:sha1: 8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:03:45.730 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-skoduri-cloud-restore 2024-09-22T08:03:45.870 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5106.g8852379c 2024-09-22T08:03:45.873 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-22T08:03:45.880 INFO:teuthology.task.internal:no buildpackages task found 2024-09-22T08:03:45.880 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-22T08:03:45.889 INFO:teuthology.task.internal:Saving configuration 2024-09-22T08:03:45.908 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-22T08:03:45.917 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-22T08:03:45.942 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi038.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915040', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-22 07:59:07.999440', 'locked_by': 'scheduled_soumyakoduri@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPqRwOZxd4MuOF09PB7zzi/NWPGs5RsptCjfHQvpbkpCbZtpqaIxpZJuLiG0Xol9CBOY1NVUNoOeqLOUGRMSy2g='} 2024-09-22T08:03:45.966 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi042.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915040', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-22 07:59:08.001055', 'locked_by': 'scheduled_soumyakoduri@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAreu318Z7fzSMGkOGhUubzeQJ9JzlHdpUVKD5VbpajMwwoZ302elfKg71HGbsQHfYdTGBLQzNV1jH0YeF6Zl4k='} 2024-09-22T08:03:45.966 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-22T08:03:45.973 INFO:teuthology.task.internal:roles: ubuntu@smithi038.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-22T08:03:45.974 INFO:teuthology.task.internal:roles: ubuntu@smithi042.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-22T08:03:45.974 INFO:teuthology.run_tasks:Running task console_log... 2024-09-22T08:03:46.033 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7effd6ebb640>, signals=[15]) 2024-09-22T08:03:46.033 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-22T08:03:46.039 INFO:teuthology.task.internal:Opening connections... 2024-09-22T08:03:46.039 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi038.front.sepia.ceph.com 2024-09-22T08:03:46.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:03:46.137 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi042.front.sepia.ceph.com 2024-09-22T08:03:46.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:03:46.213 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-22T08:03:46.220 DEBUG:teuthology.orchestra.run.smithi038:> uname -m 2024-09-22T08:03:46.237 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64 2024-09-22T08:03:46.237 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2024-09-22T08:03:46.294 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="CentOS Stream" 2024-09-22T08:03:46.295 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="9" 2024-09-22T08:03:46.295 INFO:teuthology.orchestra.run.smithi038.stdout:ID="centos" 2024-09-22T08:03:46.295 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="rhel fedora" 2024-09-22T08:03:46.295 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="9" 2024-09-22T08:03:46.295 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el9" 2024-09-22T08:03:46.295 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-22T08:03:46.295 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2024-09-22T08:03:46.295 INFO:teuthology.orchestra.run.smithi038.stdout:LOGO="fedora-logo-icon" 2024-09-22T08:03:46.295 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-22T08:03:46.295 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://centos.org/" 2024-09-22T08:03:46.295 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-22T08:03:46.295 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-22T08:03:46.296 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-22T08:03:46.296 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2024-09-22T08:03:46.320 DEBUG:teuthology.orchestra.run.smithi042:> uname -m 2024-09-22T08:03:46.339 INFO:teuthology.orchestra.run.smithi042.stdout:x86_64 2024-09-22T08:03:46.339 DEBUG:teuthology.orchestra.run.smithi042:> cat /etc/os-release 2024-09-22T08:03:46.396 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="CentOS Stream" 2024-09-22T08:03:46.396 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="9" 2024-09-22T08:03:46.396 INFO:teuthology.orchestra.run.smithi042.stdout:ID="centos" 2024-09-22T08:03:46.396 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE="rhel fedora" 2024-09-22T08:03:46.397 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="9" 2024-09-22T08:03:46.397 INFO:teuthology.orchestra.run.smithi042.stdout:PLATFORM_ID="platform:el9" 2024-09-22T08:03:46.397 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-22T08:03:46.397 INFO:teuthology.orchestra.run.smithi042.stdout:ANSI_COLOR="0;31" 2024-09-22T08:03:46.397 INFO:teuthology.orchestra.run.smithi042.stdout:LOGO="fedora-logo-icon" 2024-09-22T08:03:46.397 INFO:teuthology.orchestra.run.smithi042.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-22T08:03:46.397 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://centos.org/" 2024-09-22T08:03:46.397 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-22T08:03:46.397 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-22T08:03:46.397 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-22T08:03:46.397 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2024-09-22T08:03:46.420 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-22T08:03:46.429 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-22T08:03:46.437 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-22T08:03:46.437 DEBUG:teuthology.orchestra.run.smithi038:> test '!' -e /home/ubuntu/cephtest 2024-09-22T08:03:46.440 DEBUG:teuthology.orchestra.run.smithi042:> test '!' -e /home/ubuntu/cephtest 2024-09-22T08:03:46.456 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-22T08:03:46.463 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-22T08:03:46.463 DEBUG:teuthology.orchestra.run.smithi038:> test -z $(ls -A /var/lib/ceph) 2024-09-22T08:03:46.497 DEBUG:teuthology.orchestra.run.smithi042:> test -z $(ls -A /var/lib/ceph) 2024-09-22T08:03:46.526 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-22T08:03:46.581 INFO:teuthology.run_tasks:Running task kernel... 2024-09-22T08:03:46.595 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-09-22T08:03:46.595 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-09-22T08:03:46.595 DEBUG:teuthology.orchestra.run.smithi038:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-22T08:03:46.596 DEBUG:teuthology.orchestra.run.smithi042:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-22T08:03:46.612 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:03:46.613 DEBUG:teuthology.orchestra.run.smithi038:> uname -r 2024-09-22T08:03:46.614 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:03:46.614 DEBUG:teuthology.orchestra.run.smithi042:> uname -r 2024-09-22T08:03:46.670 INFO:teuthology.orchestra.run.smithi038.stdout:5.14.0-503.el9.x86_64 2024-09-22T08:03:46.671 INFO:teuthology.task.kernel:Running kernel on smithi038: 5.14.0-503.el9.x86_64 2024-09-22T08:03:46.671 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum install -y kernel 2024-09-22T08:03:46.672 INFO:teuthology.orchestra.run.smithi042.stdout:5.14.0-503.el9.x86_64 2024-09-22T08:03:46.672 INFO:teuthology.task.kernel:Running kernel on smithi042: 5.14.0-503.el9.x86_64 2024-09-22T08:03:46.672 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum install -y kernel 2024-09-22T08:03:49.232 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.3 MB 00:00 2024-09-22T08:03:50.242 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.3 MB 00:01 2024-09-22T08:03:52.135 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - AppStream 27 MB/s | 20 MB 00:00 2024-09-22T08:03:56.257 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - AppStream 3.4 MB/s | 20 MB 00:05 2024-09-22T08:03:57.744 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - CRB 4.0 MB/s | 6.5 MB 00:01 2024-09-22T08:03:59.278 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - Extras packages 70 kB/s | 19 kB 00:00 2024-09-22T08:04:00.057 INFO:teuthology.orchestra.run.smithi042.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-22T08:04:01.674 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 6.5 MB 00:01 2024-09-22T08:04:03.350 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 19 kB 00:00 2024-09-22T08:04:04.188 INFO:teuthology.orchestra.run.smithi038.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-22T08:04:05.563 INFO:teuthology.orchestra.run.smithi042.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-22T08:04:07.528 INFO:teuthology.orchestra.run.smithi042.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-22T08:04:07.529 INFO:teuthology.orchestra.run.smithi042.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-22T08:04:07.626 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-09-22T08:04:07.637 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-22T08:04:07.637 INFO:teuthology.orchestra.run.smithi042.stdout: Package Architecture Version Repository Size 2024-09-22T08:04:07.637 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-22T08:04:07.637 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-09-22T08:04:07.637 INFO:teuthology.orchestra.run.smithi042.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-22T08:04:07.637 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-09-22T08:04:07.637 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-22T08:04:07.637 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-22T08:04:07.637 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-22T08:04:07.637 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:04:07.637 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-09-22T08:04:07.638 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-22T08:04:07.638 INFO:teuthology.orchestra.run.smithi042.stdout:Install 4 Packages 2024-09-22T08:04:07.638 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:04:07.638 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 79 M 2024-09-22T08:04:07.638 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 126 M 2024-09-22T08:04:07.638 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-09-22T08:04:07.765 INFO:teuthology.orchestra.run.smithi042.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 447 kB/s | 36 kB 00:00 2024-09-22T08:04:08.132 INFO:teuthology.orchestra.run.smithi042.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 35 MB/s | 16 MB 00:00 2024-09-22T08:04:09.415 INFO:teuthology.orchestra.run.smithi042.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 20 MB/s | 35 MB 00:01 2024-09-22T08:04:10.002 INFO:teuthology.orchestra.run.smithi038.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-22T08:04:10.590 INFO:teuthology.orchestra.run.smithi042.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 10 MB/s | 29 MB 00:02 2024-09-22T08:04:10.591 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:04:10.591 INFO:teuthology.orchestra.run.smithi042.stdout:Total 27 MB/s | 79 MB 00:02 2024-09-22T08:04:11.296 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-09-22T08:04:11.702 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-09-22T08:04:11.703 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-09-22T08:04:11.992 INFO:teuthology.orchestra.run.smithi038.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-22T08:04:11.992 INFO:teuthology.orchestra.run.smithi038.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-22T08:04:12.086 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-22T08:04:12.093 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-22T08:04:12.093 INFO:teuthology.orchestra.run.smithi038.stdout: Package Architecture Version Repository Size 2024-09-22T08:04:12.093 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-22T08:04:12.093 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-09-22T08:04:12.094 INFO:teuthology.orchestra.run.smithi038.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-22T08:04:12.094 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2024-09-22T08:04:12.094 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-22T08:04:12.094 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-22T08:04:12.094 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-22T08:04:12.094 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:04:12.094 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-09-22T08:04:12.094 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-22T08:04:12.095 INFO:teuthology.orchestra.run.smithi038.stdout:Install 4 Packages 2024-09-22T08:04:12.095 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:04:12.095 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 79 M 2024-09-22T08:04:12.095 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 126 M 2024-09-22T08:04:12.095 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-09-22T08:04:12.212 INFO:teuthology.orchestra.run.smithi038.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 381 kB/s | 36 kB 00:00 2024-09-22T08:04:12.454 INFO:teuthology.orchestra.run.smithi038.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 47 MB/s | 16 MB 00:00 2024-09-22T08:04:12.709 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-09-22T08:04:12.710 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-09-22T08:04:12.879 INFO:teuthology.orchestra.run.smithi038.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 45 MB/s | 35 MB 00:00 2024-09-22T08:04:13.155 INFO:teuthology.orchestra.run.smithi038.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 30 MB/s | 29 MB 00:00 2024-09-22T08:04:13.155 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:04:13.155 INFO:teuthology.orchestra.run.smithi038.stdout:Total 74 MB/s | 79 MB 00:01 2024-09-22T08:04:13.862 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-09-22T08:04:14.281 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-09-22T08:04:14.282 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-09-22T08:04:15.249 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-09-22T08:04:15.249 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-09-22T08:04:15.269 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-09-22T08:04:15.946 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-22T08:04:16.044 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T08:04:17.807 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-09-22T08:04:18.495 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-22T08:04:18.583 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T08:04:18.828 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T08:04:18.955 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T08:04:21.353 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T08:04:21.477 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T08:04:24.084 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T08:04:24.131 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:04:26.606 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T08:04:26.645 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:04:29.271 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:04:31.793 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:05:08.686 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:05:08.731 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:05:09.019 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:05:09.019 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-22T08:05:09.019 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T08:05:09.019 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T08:05:09.850 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:05:09.850 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:05:09.851 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-09-22T08:05:09.851 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-22T08:05:09.851 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-22T08:05:09.851 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-22T08:05:09.851 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-22T08:05:09.851 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:05:09.851 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-09-22T08:05:10.186 DEBUG:teuthology.orchestra.run.smithi042:> rpm -q kernel | sort -rV | head -n 1 2024-09-22T08:05:10.312 INFO:teuthology.orchestra.run.smithi042.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-22T08:05:10.312 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-22T08:05:10.312 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-22T08:05:10.313 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-22T08:05:10.313 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-22T08:05:10.313 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-22T08:05:10.313 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi042.front.sepia.ceph.com, path=None, version=distro) 2024-09-22T08:05:10.313 DEBUG:teuthology.orchestra.run.smithi042:> rpm -q kernel | sort -rV | head -n 1 2024-09-22T08:05:10.373 INFO:teuthology.orchestra.run.smithi042.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-22T08:05:10.374 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-22T08:05:10.374 DEBUG:teuthology.orchestra.run.smithi042:> sudo rpm -qi grub2-tools 2024-09-22T08:05:10.412 INFO:teuthology.orchestra.run.smithi042.stdout:Name : grub2-tools 2024-09-22T08:05:10.412 INFO:teuthology.orchestra.run.smithi042.stdout:Epoch : 1 2024-09-22T08:05:10.412 INFO:teuthology.orchestra.run.smithi042.stdout:Version : 2.06 2024-09-22T08:05:10.412 INFO:teuthology.orchestra.run.smithi042.stdout:Release : 82.el9 2024-09-22T08:05:10.412 INFO:teuthology.orchestra.run.smithi042.stdout:Architecture: x86_64 2024-09-22T08:05:10.412 INFO:teuthology.orchestra.run.smithi042.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-22T08:05:10.413 INFO:teuthology.orchestra.run.smithi042.stdout:Group : Unspecified 2024-09-22T08:05:10.413 INFO:teuthology.orchestra.run.smithi042.stdout:Size : 8274670 2024-09-22T08:05:10.413 INFO:teuthology.orchestra.run.smithi042.stdout:License : GPLv3+ 2024-09-22T08:05:10.413 INFO:teuthology.orchestra.run.smithi042.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-22T08:05:10.413 INFO:teuthology.orchestra.run.smithi042.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-22T08:05:10.413 INFO:teuthology.orchestra.run.smithi042.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-22T08:05:10.414 INFO:teuthology.orchestra.run.smithi042.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-22T08:05:10.414 INFO:teuthology.orchestra.run.smithi042.stdout:Packager : builder@centos.org 2024-09-22T08:05:10.414 INFO:teuthology.orchestra.run.smithi042.stdout:Vendor : CentOS 2024-09-22T08:05:10.414 INFO:teuthology.orchestra.run.smithi042.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-22T08:05:10.414 INFO:teuthology.orchestra.run.smithi042.stdout:Summary : Support tools for GRUB. 2024-09-22T08:05:10.414 INFO:teuthology.orchestra.run.smithi042.stdout:Description : 2024-09-22T08:05:10.415 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:05:10.415 INFO:teuthology.orchestra.run.smithi042.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-22T08:05:10.415 INFO:teuthology.orchestra.run.smithi042.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-22T08:05:10.415 INFO:teuthology.orchestra.run.smithi042.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-22T08:05:10.415 INFO:teuthology.orchestra.run.smithi042.stdout:hardware devices. 2024-09-22T08:05:10.415 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:05:10.415 INFO:teuthology.orchestra.run.smithi042.stdout:This subpackage provides tools for support of all platforms. 2024-09-22T08:05:10.417 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-22T08:05:10.417 INFO:teuthology.task.kernel:Updating grub on smithi042 to boot 5.14.0-508.el9.x86_64 2024-09-22T08:05:10.417 DEBUG:teuthology.orchestra.run.smithi042:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-22T08:05:10.776 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:05:10.817 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:05:11.092 INFO:teuthology.orchestra.run.smithi042.stderr:Generating grub configuration file ... 2024-09-22T08:05:11.241 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:05:11.242 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-22T08:05:11.242 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T08:05:11.242 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T08:05:12.096 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:05:12.096 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:05:12.096 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-09-22T08:05:12.096 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-22T08:05:12.096 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-22T08:05:12.096 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-22T08:05:12.096 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-22T08:05:12.096 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:05:12.097 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-22T08:05:12.430 INFO:teuthology.orchestra.run.smithi042.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-22T08:05:12.437 DEBUG:teuthology.orchestra.run.smithi038:> rpm -q kernel | sort -rV | head -n 1 2024-09-22T08:05:12.466 INFO:teuthology.orchestra.run.smithi042.stderr:done 2024-09-22T08:05:12.468 DEBUG:teuthology.orchestra.run.smithi042:> mktemp 2024-09-22T08:05:12.483 INFO:teuthology.orchestra.run.smithi042.stdout:/tmp/tmp.meQD90A934 2024-09-22T08:05:12.483 DEBUG:teuthology.orchestra.run.smithi042:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.meQD90A934 2024-09-22T08:05:12.520 INFO:teuthology.orchestra.run.smithi038.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-22T08:05:12.521 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-22T08:05:12.521 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-22T08:05:12.521 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-22T08:05:12.521 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-22T08:05:12.521 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-22T08:05:12.521 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi038.front.sepia.ceph.com, path=None, version=distro) 2024-09-22T08:05:12.521 DEBUG:teuthology.orchestra.run.smithi038:> rpm -q kernel | sort -rV | head -n 1 2024-09-22T08:05:12.549 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0666 /tmp/tmp.meQD90A934 2024-09-22T08:05:12.579 INFO:teuthology.orchestra.run.smithi038.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-22T08:05:12.580 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-22T08:05:12.580 DEBUG:teuthology.orchestra.run.smithi038:> sudo rpm -qi grub2-tools 2024-09-22T08:05:12.619 INFO:teuthology.orchestra.run.smithi038.stdout:Name : grub2-tools 2024-09-22T08:05:12.619 INFO:teuthology.orchestra.run.smithi038.stdout:Epoch : 1 2024-09-22T08:05:12.619 INFO:teuthology.orchestra.run.smithi038.stdout:Version : 2.06 2024-09-22T08:05:12.619 INFO:teuthology.orchestra.run.smithi038.stdout:Release : 82.el9 2024-09-22T08:05:12.619 INFO:teuthology.orchestra.run.smithi038.stdout:Architecture: x86_64 2024-09-22T08:05:12.619 INFO:teuthology.orchestra.run.smithi038.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-22T08:05:12.619 INFO:teuthology.orchestra.run.smithi038.stdout:Group : Unspecified 2024-09-22T08:05:12.619 INFO:teuthology.orchestra.run.smithi038.stdout:Size : 8274670 2024-09-22T08:05:12.620 INFO:teuthology.orchestra.run.smithi038.stdout:License : GPLv3+ 2024-09-22T08:05:12.620 INFO:teuthology.orchestra.run.smithi038.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-22T08:05:12.620 INFO:teuthology.orchestra.run.smithi038.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-22T08:05:12.620 INFO:teuthology.orchestra.run.smithi038.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-22T08:05:12.620 INFO:teuthology.orchestra.run.smithi038.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-22T08:05:12.620 INFO:teuthology.orchestra.run.smithi038.stdout:Packager : builder@centos.org 2024-09-22T08:05:12.620 INFO:teuthology.orchestra.run.smithi038.stdout:Vendor : CentOS 2024-09-22T08:05:12.620 INFO:teuthology.orchestra.run.smithi038.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-22T08:05:12.620 INFO:teuthology.orchestra.run.smithi038.stdout:Summary : Support tools for GRUB. 2024-09-22T08:05:12.620 INFO:teuthology.orchestra.run.smithi038.stdout:Description : 2024-09-22T08:05:12.620 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:05:12.620 INFO:teuthology.orchestra.run.smithi038.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-22T08:05:12.620 INFO:teuthology.orchestra.run.smithi038.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-22T08:05:12.620 INFO:teuthology.orchestra.run.smithi038.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-22T08:05:12.621 INFO:teuthology.orchestra.run.smithi038.stdout:hardware devices. 2024-09-22T08:05:12.621 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:05:12.621 INFO:teuthology.orchestra.run.smithi038.stdout:This subpackage provides tools for support of all platforms. 2024-09-22T08:05:12.621 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-22T08:05:12.621 INFO:teuthology.task.kernel:Updating grub on smithi038 to boot 5.14.0-508.el9.x86_64 2024-09-22T08:05:12.622 DEBUG:teuthology.orchestra.run.smithi038:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-22T08:05:12.697 DEBUG:teuthology.orchestra.remote:smithi042:/tmp/tmp.meQD90A934 is 6KB 2024-09-22T08:05:12.745 DEBUG:teuthology.orchestra.run.smithi042:> rm -fr /tmp/tmp.meQD90A934 2024-09-22T08:05:12.760 DEBUG:teuthology.orchestra.run.smithi042:> sudo /bin/ls /boot/loader/entries || true 2024-09-22T08:05:12.823 INFO:teuthology.orchestra.run.smithi042.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-22T08:05:12.823 INFO:teuthology.orchestra.run.smithi042.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-22T08:05:12.823 INFO:teuthology.orchestra.run.smithi042.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-22T08:05:12.823 INFO:teuthology.orchestra.run.smithi042.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-22T08:05:12.824 DEBUG:teuthology.orchestra.run.smithi042:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-22T08:05:12.983 DEBUG:teuthology.orchestra.run.smithi042:> sudo shutdown -r now 2024-09-22T08:05:13.312 INFO:teuthology.orchestra.run.smithi038.stderr:Generating grub configuration file ... 2024-09-22T08:05:14.624 INFO:teuthology.orchestra.run.smithi038.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-22T08:05:14.651 INFO:teuthology.orchestra.run.smithi038.stderr:done 2024-09-22T08:05:14.653 DEBUG:teuthology.orchestra.run.smithi038:> mktemp 2024-09-22T08:05:14.671 INFO:teuthology.orchestra.run.smithi038.stdout:/tmp/tmp.970ycRVhum 2024-09-22T08:05:14.671 DEBUG:teuthology.orchestra.run.smithi038:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.970ycRVhum 2024-09-22T08:05:14.737 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 0666 /tmp/tmp.970ycRVhum 2024-09-22T08:05:14.881 DEBUG:teuthology.orchestra.remote:smithi038:/tmp/tmp.970ycRVhum is 6KB 2024-09-22T08:05:14.930 DEBUG:teuthology.orchestra.run.smithi038:> rm -fr /tmp/tmp.970ycRVhum 2024-09-22T08:05:14.945 DEBUG:teuthology.orchestra.run.smithi038:> sudo /bin/ls /boot/loader/entries || true 2024-09-22T08:05:15.010 INFO:teuthology.orchestra.run.smithi038.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-22T08:05:15.010 INFO:teuthology.orchestra.run.smithi038.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-22T08:05:15.010 INFO:teuthology.orchestra.run.smithi038.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-22T08:05:15.010 INFO:teuthology.orchestra.run.smithi038.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-22T08:05:15.011 DEBUG:teuthology.orchestra.run.smithi038:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-22T08:05:15.164 DEBUG:teuthology.orchestra.run.smithi038:> sudo shutdown -r now 2024-09-22T08:05:43.010 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-22T08:05:43.011 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-22T08:05:43.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:05:45.168 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-22T08:05:45.168 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-22T08:05:45.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:06:01.455 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.42 2024-09-22T08:06:03.506 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.38 2024-09-22T08:06:10.459 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-22T08:06:10.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:06:12.510 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-22T08:06:12.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:07:10.519 DEBUG:teuthology.orchestra.remote:timed out 2024-09-22T08:07:12.514 DEBUG:teuthology.orchestra.remote:timed out 2024-09-22T08:07:22.526 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-22T08:07:22.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:07:22.883 DEBUG:teuthology.orchestra.run.smithi042:> true 2024-09-22T08:07:23.228 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-22T08:07:23.228 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-508.el9.x86_64"... 2024-09-22T08:07:23.229 DEBUG:teuthology.orchestra.run.smithi042:> uname -r 2024-09-22T08:07:23.245 INFO:teuthology.orchestra.run.smithi042.stdout:5.14.0-508.el9.x86_64 2024-09-22T08:07:23.245 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-22T08:07:23.245 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-22T08:07:23.245 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-22T08:07:24.246 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-22T08:07:24.246 DEBUG:teuthology.orchestra.run.smithi042:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-22T08:07:24.322 INFO:teuthology.orchestra.run.smithi042.stdout:ttyS1 2024-09-22T08:07:24.342 DEBUG:teuthology.parallel:result is None 2024-09-22T08:07:24.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-22T08:07:24.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:07:24.898 DEBUG:teuthology.orchestra.run.smithi038:> true 2024-09-22T08:07:25.249 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-22T08:07:25.249 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-22T08:07:25.249 DEBUG:teuthology.orchestra.run.smithi038:> uname -r 2024-09-22T08:07:25.266 INFO:teuthology.orchestra.run.smithi038.stdout:5.14.0-508.el9.x86_64 2024-09-22T08:07:25.266 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-22T08:07:25.266 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-22T08:07:25.266 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-22T08:07:26.267 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-22T08:07:26.267 DEBUG:teuthology.orchestra.run.smithi038:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-22T08:07:26.343 INFO:teuthology.orchestra.run.smithi038.stdout:ttyS1 2024-09-22T08:07:26.361 DEBUG:teuthology.parallel:result is None 2024-09-22T08:07:26.362 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-22T08:07:26.368 INFO:teuthology.task.internal:Creating test directory... 2024-09-22T08:07:26.368 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-22T08:07:26.371 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-22T08:07:26.391 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-22T08:07:26.397 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-22T08:07:26.404 INFO:teuthology.task.internal:Creating archive directory... 2024-09-22T08:07:26.404 DEBUG:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-22T08:07:26.433 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-22T08:07:26.462 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-22T08:07:26.469 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-22T08:07:26.469 DEBUG:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-22T08:07:26.495 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-22T08:07:26.529 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-22T08:07:26.535 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-22T08:07:26.541 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-22T08:07:26.547 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-22T08:07:26.549 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-22T08:07:26.561 INFO:teuthology.task.internal:Configuring sudo... 2024-09-22T08:07:26.561 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-22T08:07:26.585 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-22T08:07:26.619 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-22T08:07:26.628 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-22T08:07:26.628 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-22T08:07:26.656 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-22T08:07:26.677 DEBUG:teuthology.orchestra.run.smithi038:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-22T08:07:26.756 DEBUG:teuthology.orchestra.run.smithi038:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-22T08:07:26.802 DEBUG:teuthology.orchestra.run.smithi038:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-22T08:07:26.888 DEBUG:teuthology.orchestra.run.smithi038:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-22T08:07:26.931 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-22T08:07:26.931 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-22T08:07:26.998 DEBUG:teuthology.orchestra.run.smithi042:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-22T08:07:27.044 DEBUG:teuthology.orchestra.run.smithi042:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-22T08:07:27.096 DEBUG:teuthology.orchestra.run.smithi042:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-22T08:07:27.183 DEBUG:teuthology.orchestra.run.smithi042:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-22T08:07:27.226 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-22T08:07:27.227 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-22T08:07:27.295 DEBUG:teuthology.orchestra.run.smithi038:> sudo service rsyslog restart 2024-09-22T08:07:27.297 DEBUG:teuthology.orchestra.run.smithi042:> sudo service rsyslog restart 2024-09-22T08:07:27.346 INFO:teuthology.orchestra.run.smithi038.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-22T08:07:27.390 INFO:teuthology.orchestra.run.smithi042.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-22T08:07:27.738 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-22T08:07:27.745 INFO:teuthology.task.internal:Starting timer... 2024-09-22T08:07:27.745 INFO:teuthology.run_tasks:Running task pcp... 2024-09-22T08:07:27.755 INFO:teuthology.run_tasks:Running task selinux... 2024-09-22T08:07:27.764 DEBUG:teuthology.orchestra.run.smithi038:> sudo service auditd rotate 2024-09-22T08:07:27.835 INFO:teuthology.orchestra.run.smithi038.stdout:Rotating logs: 2024-09-22T08:07:27.837 DEBUG:teuthology.orchestra.run.smithi042:> sudo service auditd rotate 2024-09-22T08:07:27.890 INFO:teuthology.orchestra.run.smithi042.stdout:Rotating logs: 2024-09-22T08:07:27.892 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-22T08:07:27.892 DEBUG:teuthology.orchestra.run.smithi038:> /usr/sbin/getenforce 2024-09-22T08:07:27.918 INFO:teuthology.orchestra.run.smithi038.stdout:Permissive 2024-09-22T08:07:27.918 DEBUG:teuthology.orchestra.run.smithi042:> /usr/sbin/getenforce 2024-09-22T08:07:27.948 INFO:teuthology.orchestra.run.smithi042.stdout:Permissive 2024-09-22T08:07:27.948 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi038.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi042.front.sepia.ceph.com': 'permissive'} 2024-09-22T08:07:27.948 DEBUG:teuthology.orchestra.run.smithi038:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-22T08:07:27.987 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:07:27.987 DEBUG:teuthology.orchestra.run.smithi042:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-22T08:07:28.018 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:07:28.018 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-22T08:07:28.018 DEBUG:teuthology.orchestra.run.smithi038:> sudo /usr/sbin/setenforce permissive 2024-09-22T08:07:28.065 DEBUG:teuthology.orchestra.run.smithi042:> sudo /usr/sbin/setenforce permissive 2024-09-22T08:07:28.104 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-22T08:07:28.113 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-22T08:07:28.116 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-22T08:07:28.224 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-22T08:07:28.237 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-22T08:07:28.238 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi038.front.sepia.ceph.com,smithi042.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-22T08:11:29.226 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi038.front.sepia.ceph.com'), Remote(name='ubuntu@smithi042.front.sepia.ceph.com')] 2024-09-22T08:11:29.227 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-22T08:11:29.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:11:29.306 DEBUG:teuthology.orchestra.run.smithi038:> true 2024-09-22T08:11:29.383 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-22T08:11:29.384 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-22T08:11:29.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:11:29.460 DEBUG:teuthology.orchestra.run.smithi042:> true 2024-09-22T08:11:29.539 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-22T08:11:29.539 INFO:teuthology.run_tasks:Running task clock... 2024-09-22T08:11:29.549 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-22T08:11:29.550 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-22T08:11:29.550 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-22T08:11:29.553 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-22T08:11:29.553 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-22T08:11:29.582 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-22T08:11:29.598 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-22T08:11:29.611 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-22T08:11:29.624 INFO:teuthology.orchestra.run.smithi038.stderr:sudo: ntpd: command not found 2024-09-22T08:11:29.628 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-22T08:11:29.636 INFO:teuthology.orchestra.run.smithi038.stdout:506 Cannot talk to daemon 2024-09-22T08:11:29.651 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-22T08:11:29.654 INFO:teuthology.orchestra.run.smithi042.stderr:sudo: ntpd: command not found 2024-09-22T08:11:29.666 INFO:teuthology.orchestra.run.smithi042.stdout:506 Cannot talk to daemon 2024-09-22T08:11:29.667 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-22T08:11:29.682 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-22T08:11:29.696 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-22T08:11:29.729 INFO:teuthology.orchestra.run.smithi038.stderr:bash: line 1: ntpq: command not found 2024-09-22T08:11:29.733 INFO:teuthology.orchestra.run.smithi038.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-22T08:11:29.733 INFO:teuthology.orchestra.run.smithi038.stdout:=============================================================================== 2024-09-22T08:11:29.733 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:11:29.733 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:11:29.733 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:11:29.734 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:11:29.753 INFO:teuthology.orchestra.run.smithi042.stderr:bash: line 1: ntpq: command not found 2024-09-22T08:11:29.756 INFO:teuthology.orchestra.run.smithi042.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-22T08:11:29.756 INFO:teuthology.orchestra.run.smithi042.stdout:=============================================================================== 2024-09-22T08:11:29.756 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:11:29.757 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:11:29.757 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:11:29.757 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:11:29.758 INFO:teuthology.run_tasks:Running task install... 2024-09-22T08:11:29.765 DEBUG:teuthology.task.install:project ceph 2024-09-22T08:11:29.765 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d'}} 2024-09-22T08:11:29.766 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d'} 2024-09-22T08:11:29.766 INFO:teuthology.task.install:Using flavor: default 2024-09-22T08:11:29.771 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-22T08:11:29.771 INFO:teuthology.task.install:extra packages: [] 2024-09-22T08:11:29.771 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d', 'tag': None, 'wait_for_package': False} 2024-09-22T08:11:29.772 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:11:29.773 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d', 'tag': None, 'wait_for_package': False} 2024-09-22T08:11:29.773 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:11:29.920 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-skoduri-cloud-restore/8852379c050c686f4605f33f0129009b2029ca9d/centos/9/flavors/default/ 2024-09-22T08:11:29.920 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5106.g8852379c 2024-09-22T08:11:29.923 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-skoduri-cloud-restore/8852379c050c686f4605f33f0129009b2029ca9d/centos/9/flavors/default/ 2024-09-22T08:11:29.924 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5106.g8852379c 2024-09-22T08:11:30.030 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-skoduri-cloud-restore/8852379c050c686f4605f33f0129009b2029ca9d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-skoduri-cloud-restore/8852379c050c686f4605f33f0129009b2029ca9d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-skoduri-cloud-restore/8852379c050c686f4605f33f0129009b2029ca9d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-22T08:11:30.030 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-22T08:11:30.030 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-22T08:11:30.034 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-skoduri-cloud-restore/8852379c050c686f4605f33f0129009b2029ca9d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-skoduri-cloud-restore/8852379c050c686f4605f33f0129009b2029ca9d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-skoduri-cloud-restore/8852379c050c686f4605f33f0129009b2029ca9d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-22T08:11:30.034 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-22T08:11:30.034 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-22T08:11:30.057 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-22T08:11:30.058 DEBUG:teuthology.orchestra.run.smithi042:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8852379c050c686f4605f33f0129009b2029ca9d/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-22T08:11:30.060 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-22T08:11:30.061 DEBUG:teuthology.orchestra.run.smithi038:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8852379c050c686f4605f33f0129009b2029ca9d/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-22T08:11:30.125 DEBUG:teuthology.orchestra.run.smithi042:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-22T08:11:30.127 DEBUG:teuthology.orchestra.run.smithi038:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-22T08:11:30.202 DEBUG:teuthology.orchestra.run.smithi042:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-22T08:11:30.204 DEBUG:teuthology.orchestra.run.smithi038:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-22T08:11:30.267 INFO:teuthology.orchestra.run.smithi042.stdout:check_obsoletes = 1 2024-09-22T08:11:30.269 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum clean all 2024-09-22T08:11:30.269 INFO:teuthology.orchestra.run.smithi038.stdout:check_obsoletes = 1 2024-09-22T08:11:30.271 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum clean all 2024-09-22T08:11:30.501 INFO:teuthology.orchestra.run.smithi038.stdout:45 files removed 2024-09-22T08:11:30.514 INFO:teuthology.orchestra.run.smithi042.stdout:45 files removed 2024-09-22T08:11:30.528 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-22T08:11:30.541 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-22T08:11:31.098 INFO:teuthology.orchestra.run.smithi038.stdout:ceph packages for x86_64 310 kB/s | 84 kB 00:00 2024-09-22T08:11:31.099 INFO:teuthology.orchestra.run.smithi042.stdout:ceph packages for x86_64 325 kB/s | 84 kB 00:00 2024-09-22T08:11:31.383 INFO:teuthology.orchestra.run.smithi042.stdout:ceph noarch packages 101 kB/s | 24 kB 00:00 2024-09-22T08:11:31.424 INFO:teuthology.orchestra.run.smithi038.stdout:ceph noarch packages 87 kB/s | 24 kB 00:00 2024-09-22T08:11:31.642 INFO:teuthology.orchestra.run.smithi042.stdout:ceph source packages 8.8 kB/s | 1.9 kB 00:00 2024-09-22T08:11:31.716 INFO:teuthology.orchestra.run.smithi038.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-22T08:11:32.233 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.3 MB 00:00 2024-09-22T08:11:32.286 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.3 MB 00:00 2024-09-22T08:11:34.201 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-22T08:11:38.151 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - AppStream 4.3 MB/s | 20 MB 00:04 2024-09-22T08:11:38.978 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - CRB 7.5 MB/s | 6.5 MB 00:00 2024-09-22T08:11:40.695 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 19 kB 00:00 2024-09-22T08:11:41.632 INFO:teuthology.orchestra.run.smithi042.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-22T08:11:42.543 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-22T08:11:44.294 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 19 kB 00:00 2024-09-22T08:11:45.415 INFO:teuthology.orchestra.run.smithi038.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-22T08:11:47.305 INFO:teuthology.orchestra.run.smithi042.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-22T08:11:49.591 INFO:teuthology.orchestra.run.smithi042.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-22T08:11:49.592 INFO:teuthology.orchestra.run.smithi042.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-22T08:11:49.688 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-09-22T08:11:49.710 INFO:teuthology.orchestra.run.smithi042.stdout:====================================================================================================== 2024-09-22T08:11:49.710 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-09-22T08:11:49.711 INFO:teuthology.orchestra.run.smithi042.stdout:====================================================================================================== 2024-09-22T08:11:49.711 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-09-22T08:11:49.711 INFO:teuthology.orchestra.run.smithi042.stdout: ceph x86_64 2:19.3.0-5106.g8852379c.el9 ceph 6.6 k 2024-09-22T08:11:49.711 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-base x86_64 2:19.3.0-5106.g8852379c.el9 ceph 5.5 M 2024-09-22T08:11:49.711 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-fuse x86_64 2:19.3.0-5106.g8852379c.el9 ceph 900 k 2024-09-22T08:11:49.711 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5106.g8852379c.el9 ceph 145 k 2024-09-22T08:11:49.711 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr x86_64 2:19.3.0-5106.g8852379c.el9 ceph 1.5 M 2024-09-22T08:11:49.711 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 154 k 2024-09-22T08:11:49.711 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 14 M 2024-09-22T08:11:49.711 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 7.4 M 2024-09-22T08:11:49.711 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-rook noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 49 k 2024-09-22T08:11:49.711 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-radosgw x86_64 2:19.3.0-5106.g8852379c.el9 ceph 11 M 2024-09-22T08:11:49.711 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-test x86_64 2:19.3.0-5106.g8852379c.el9 ceph 46 M 2024-09-22T08:11:49.712 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-volume noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 285 k 2024-09-22T08:11:49.712 INFO:teuthology.orchestra.run.smithi042.stdout: cephadm noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 784 k 2024-09-22T08:11:49.712 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs-devel x86_64 2:19.3.0-5106.g8852379c.el9 ceph 32 k 2024-09-22T08:11:49.712 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs2 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 755 k 2024-09-22T08:11:49.712 INFO:teuthology.orchestra.run.smithi042.stdout: librados-devel x86_64 2:19.3.0-5106.g8852379c.el9 ceph 127 k 2024-09-22T08:11:49.712 INFO:teuthology.orchestra.run.smithi042.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-22T08:11:49.712 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cephfs x86_64 2:19.3.0-5106.g8852379c.el9 ceph 162 k 2024-09-22T08:11:49.712 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rados x86_64 2:19.3.0-5106.g8852379c.el9 ceph 320 k 2024-09-22T08:11:49.712 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rbd x86_64 2:19.3.0-5106.g8852379c.el9 ceph 307 k 2024-09-22T08:11:49.712 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rgw x86_64 2:19.3.0-5106.g8852379c.el9 ceph 99 k 2024-09-22T08:11:49.712 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-fuse x86_64 2:19.3.0-5106.g8852379c.el9 ceph 85 k 2024-09-22T08:11:49.712 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-mirror x86_64 2:19.3.0-5106.g8852379c.el9 ceph 3.2 M 2024-09-22T08:11:49.712 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-nbd x86_64 2:19.3.0-5106.g8852379c.el9 ceph 170 k 2024-09-22T08:11:49.712 INFO:teuthology.orchestra.run.smithi042.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-22T08:11:49.713 INFO:teuthology.orchestra.run.smithi042.stdout:Upgrading: 2024-09-22T08:11:49.713 INFO:teuthology.orchestra.run.smithi042.stdout: librados2 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 3.5 M 2024-09-22T08:11:49.713 INFO:teuthology.orchestra.run.smithi042.stdout: librbd1 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 3.2 M 2024-09-22T08:11:49.713 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-09-22T08:11:49.713 INFO:teuthology.orchestra.run.smithi042.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-22T08:11:49.713 INFO:teuthology.orchestra.run.smithi042.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-22T08:11:49.713 INFO:teuthology.orchestra.run.smithi042.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-22T08:11:49.713 INFO:teuthology.orchestra.run.smithi042.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-22T08:11:49.713 INFO:teuthology.orchestra.run.smithi042.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-22T08:11:49.713 INFO:teuthology.orchestra.run.smithi042.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-22T08:11:49.713 INFO:teuthology.orchestra.run.smithi042.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-22T08:11:49.713 INFO:teuthology.orchestra.run.smithi042.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-22T08:11:49.713 INFO:teuthology.orchestra.run.smithi042.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-22T08:11:49.713 INFO:teuthology.orchestra.run.smithi042.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-22T08:11:49.714 INFO:teuthology.orchestra.run.smithi042.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-22T08:11:49.714 INFO:teuthology.orchestra.run.smithi042.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-22T08:11:49.714 INFO:teuthology.orchestra.run.smithi042.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-22T08:11:49.714 INFO:teuthology.orchestra.run.smithi042.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-22T08:11:49.714 INFO:teuthology.orchestra.run.smithi042.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-22T08:11:49.714 INFO:teuthology.orchestra.run.smithi042.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-22T08:11:49.714 INFO:teuthology.orchestra.run.smithi042.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-22T08:11:49.714 INFO:teuthology.orchestra.run.smithi042.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-22T08:11:49.714 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-common x86_64 2:19.3.0-5106.g8852379c.el9 ceph 22 M 2024-09-22T08:11:49.714 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 34 k 2024-09-22T08:11:49.714 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mds x86_64 2:19.3.0-5106.g8852379c.el9 ceph 2.4 M 2024-09-22T08:11:49.714 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 292 k 2024-09-22T08:11:49.714 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mon x86_64 2:19.3.0-5106.g8852379c.el9 ceph 4.8 M 2024-09-22T08:11:49.715 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-osd x86_64 2:19.3.0-5106.g8852379c.el9 ceph 17 M 2024-09-22T08:11:49.715 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 16 k 2024-09-22T08:11:49.715 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-selinux x86_64 2:19.3.0-5106.g8852379c.el9 ceph 25 k 2024-09-22T08:11:49.715 INFO:teuthology.orchestra.run.smithi042.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-22T08:11:49.715 INFO:teuthology.orchestra.run.smithi042.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-22T08:11:49.715 INFO:teuthology.orchestra.run.smithi042.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-22T08:11:49.715 INFO:teuthology.orchestra.run.smithi042.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-22T08:11:49.715 INFO:teuthology.orchestra.run.smithi042.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-22T08:11:49.715 INFO:teuthology.orchestra.run.smithi042.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-22T08:11:49.715 INFO:teuthology.orchestra.run.smithi042.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-22T08:11:49.715 INFO:teuthology.orchestra.run.smithi042.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-22T08:11:49.715 INFO:teuthology.orchestra.run.smithi042.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-22T08:11:49.716 INFO:teuthology.orchestra.run.smithi042.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-22T08:11:49.716 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-22T08:11:49.716 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-22T08:11:49.716 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-22T08:11:49.716 INFO:teuthology.orchestra.run.smithi042.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-22T08:11:49.716 INFO:teuthology.orchestra.run.smithi042.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-22T08:11:49.716 INFO:teuthology.orchestra.run.smithi042.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-22T08:11:49.716 INFO:teuthology.orchestra.run.smithi042.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-22T08:11:49.716 INFO:teuthology.orchestra.run.smithi042.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-22T08:11:49.716 INFO:teuthology.orchestra.run.smithi042.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-22T08:11:49.716 INFO:teuthology.orchestra.run.smithi042.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-22T08:11:49.716 INFO:teuthology.orchestra.run.smithi042.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-22T08:11:49.716 INFO:teuthology.orchestra.run.smithi042.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-22T08:11:49.716 INFO:teuthology.orchestra.run.smithi042.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-22T08:11:49.716 INFO:teuthology.orchestra.run.smithi042.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-22T08:11:49.717 INFO:teuthology.orchestra.run.smithi042.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-22T08:11:49.717 INFO:teuthology.orchestra.run.smithi042.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-22T08:11:49.717 INFO:teuthology.orchestra.run.smithi042.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-22T08:11:49.717 INFO:teuthology.orchestra.run.smithi042.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-22T08:11:49.717 INFO:teuthology.orchestra.run.smithi042.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-22T08:11:49.717 INFO:teuthology.orchestra.run.smithi042.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-22T08:11:49.717 INFO:teuthology.orchestra.run.smithi042.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-22T08:11:49.717 INFO:teuthology.orchestra.run.smithi042.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-22T08:11:49.717 INFO:teuthology.orchestra.run.smithi042.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-22T08:11:49.717 INFO:teuthology.orchestra.run.smithi042.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-22T08:11:49.717 INFO:teuthology.orchestra.run.smithi042.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-22T08:11:49.717 INFO:teuthology.orchestra.run.smithi042.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-22T08:11:49.717 INFO:teuthology.orchestra.run.smithi042.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-22T08:11:49.717 INFO:teuthology.orchestra.run.smithi042.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-22T08:11:49.718 INFO:teuthology.orchestra.run.smithi042.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-22T08:11:49.718 INFO:teuthology.orchestra.run.smithi042.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-22T08:11:49.718 INFO:teuthology.orchestra.run.smithi042.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-22T08:11:49.718 INFO:teuthology.orchestra.run.smithi042.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-22T08:11:49.718 INFO:teuthology.orchestra.run.smithi042.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-22T08:11:49.718 INFO:teuthology.orchestra.run.smithi042.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-22T08:11:49.718 INFO:teuthology.orchestra.run.smithi042.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-22T08:11:49.718 INFO:teuthology.orchestra.run.smithi042.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-22T08:11:49.718 INFO:teuthology.orchestra.run.smithi042.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-22T08:11:49.718 INFO:teuthology.orchestra.run.smithi042.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-22T08:11:49.718 INFO:teuthology.orchestra.run.smithi042.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-22T08:11:49.718 INFO:teuthology.orchestra.run.smithi042.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-22T08:11:49.718 INFO:teuthology.orchestra.run.smithi042.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-22T08:11:49.718 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-22T08:11:49.719 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-22T08:11:49.719 INFO:teuthology.orchestra.run.smithi042.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-22T08:11:49.719 INFO:teuthology.orchestra.run.smithi042.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-22T08:11:49.719 INFO:teuthology.orchestra.run.smithi042.stdout: libcephsqlite x86_64 2:19.3.0-5106.g8852379c.el9 ceph 161 k 2024-09-22T08:11:49.719 INFO:teuthology.orchestra.run.smithi042.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-22T08:11:49.719 INFO:teuthology.orchestra.run.smithi042.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-22T08:11:49.719 INFO:teuthology.orchestra.run.smithi042.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-22T08:11:49.719 INFO:teuthology.orchestra.run.smithi042.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-22T08:11:49.719 INFO:teuthology.orchestra.run.smithi042.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-22T08:11:49.719 INFO:teuthology.orchestra.run.smithi042.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-22T08:11:49.719 INFO:teuthology.orchestra.run.smithi042.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-22T08:11:49.719 INFO:teuthology.orchestra.run.smithi042.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-22T08:11:49.719 INFO:teuthology.orchestra.run.smithi042.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-22T08:11:49.719 INFO:teuthology.orchestra.run.smithi042.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-22T08:11:49.720 INFO:teuthology.orchestra.run.smithi042.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-22T08:11:49.720 INFO:teuthology.orchestra.run.smithi042.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-22T08:11:49.720 INFO:teuthology.orchestra.run.smithi042.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-22T08:11:49.720 INFO:teuthology.orchestra.run.smithi042.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-22T08:11:49.720 INFO:teuthology.orchestra.run.smithi042.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-22T08:11:49.720 INFO:teuthology.orchestra.run.smithi042.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-22T08:11:49.720 INFO:teuthology.orchestra.run.smithi042.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-22T08:11:49.720 INFO:teuthology.orchestra.run.smithi042.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-22T08:11:49.720 INFO:teuthology.orchestra.run.smithi042.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-22T08:11:49.720 INFO:teuthology.orchestra.run.smithi042.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-22T08:11:49.720 INFO:teuthology.orchestra.run.smithi042.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-22T08:11:49.720 INFO:teuthology.orchestra.run.smithi042.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-22T08:11:49.720 INFO:teuthology.orchestra.run.smithi042.stdout: libradosstriper1 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 508 k 2024-09-22T08:11:49.720 INFO:teuthology.orchestra.run.smithi042.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-22T08:11:49.720 INFO:teuthology.orchestra.run.smithi042.stdout: librgw2 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 5.5 M 2024-09-22T08:11:49.721 INFO:teuthology.orchestra.run.smithi042.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-22T08:11:49.721 INFO:teuthology.orchestra.run.smithi042.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-22T08:11:49.721 INFO:teuthology.orchestra.run.smithi042.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-22T08:11:49.721 INFO:teuthology.orchestra.run.smithi042.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-22T08:11:49.721 INFO:teuthology.orchestra.run.smithi042.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-22T08:11:49.721 INFO:teuthology.orchestra.run.smithi042.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-22T08:11:49.721 INFO:teuthology.orchestra.run.smithi042.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-22T08:11:49.721 INFO:teuthology.orchestra.run.smithi042.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-22T08:11:49.721 INFO:teuthology.orchestra.run.smithi042.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-22T08:11:49.721 INFO:teuthology.orchestra.run.smithi042.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-22T08:11:49.721 INFO:teuthology.orchestra.run.smithi042.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-22T08:11:49.721 INFO:teuthology.orchestra.run.smithi042.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-22T08:11:49.722 INFO:teuthology.orchestra.run.smithi042.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-22T08:11:49.722 INFO:teuthology.orchestra.run.smithi042.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-22T08:11:49.722 INFO:teuthology.orchestra.run.smithi042.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-22T08:11:49.722 INFO:teuthology.orchestra.run.smithi042.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-22T08:11:49.722 INFO:teuthology.orchestra.run.smithi042.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-22T08:11:49.722 INFO:teuthology.orchestra.run.smithi042.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-22T08:11:49.722 INFO:teuthology.orchestra.run.smithi042.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-22T08:11:49.722 INFO:teuthology.orchestra.run.smithi042.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-22T08:11:49.722 INFO:teuthology.orchestra.run.smithi042.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-22T08:11:49.722 INFO:teuthology.orchestra.run.smithi042.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-22T08:11:49.722 INFO:teuthology.orchestra.run.smithi042.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-22T08:11:49.722 INFO:teuthology.orchestra.run.smithi042.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-22T08:11:49.722 INFO:teuthology.orchestra.run.smithi042.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-22T08:11:49.722 INFO:teuthology.orchestra.run.smithi042.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-22T08:11:49.723 INFO:teuthology.orchestra.run.smithi042.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-22T08:11:49.723 INFO:teuthology.orchestra.run.smithi042.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-22T08:11:49.723 INFO:teuthology.orchestra.run.smithi042.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-22T08:11:49.723 INFO:teuthology.orchestra.run.smithi042.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-22T08:11:49.723 INFO:teuthology.orchestra.run.smithi042.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-22T08:11:49.723 INFO:teuthology.orchestra.run.smithi042.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-22T08:11:49.723 INFO:teuthology.orchestra.run.smithi042.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-22T08:11:49.723 INFO:teuthology.orchestra.run.smithi042.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-22T08:11:49.723 INFO:teuthology.orchestra.run.smithi042.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-22T08:11:49.723 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-22T08:11:49.723 INFO:teuthology.orchestra.run.smithi042.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-22T08:11:49.723 INFO:teuthology.orchestra.run.smithi042.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-22T08:11:49.723 INFO:teuthology.orchestra.run.smithi042.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-22T08:11:49.723 INFO:teuthology.orchestra.run.smithi042.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-22T08:11:49.724 INFO:teuthology.orchestra.run.smithi042.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-22T08:11:49.724 INFO:teuthology.orchestra.run.smithi042.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-22T08:11:49.724 INFO:teuthology.orchestra.run.smithi042.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-22T08:11:49.724 INFO:teuthology.orchestra.run.smithi042.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-22T08:11:49.724 INFO:teuthology.orchestra.run.smithi042.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-22T08:11:49.724 INFO:teuthology.orchestra.run.smithi042.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-22T08:11:49.724 INFO:teuthology.orchestra.run.smithi042.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-22T08:11:49.724 INFO:teuthology.orchestra.run.smithi042.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-22T08:11:49.724 INFO:teuthology.orchestra.run.smithi042.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-22T08:11:49.724 INFO:teuthology.orchestra.run.smithi042.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-22T08:11:49.724 INFO:teuthology.orchestra.run.smithi042.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-22T08:11:49.724 INFO:teuthology.orchestra.run.smithi042.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-22T08:11:49.724 INFO:teuthology.orchestra.run.smithi042.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-22T08:11:49.724 INFO:teuthology.orchestra.run.smithi042.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-22T08:11:49.724 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-22T08:11:49.725 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-22T08:11:49.725 INFO:teuthology.orchestra.run.smithi042.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-22T08:11:49.725 INFO:teuthology.orchestra.run.smithi042.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-22T08:11:49.725 INFO:teuthology.orchestra.run.smithi042.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-22T08:11:49.725 INFO:teuthology.orchestra.run.smithi042.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-22T08:11:49.725 INFO:teuthology.orchestra.run.smithi042.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-22T08:11:49.725 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-22T08:11:49.725 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-argparse x86_64 2:19.3.0-5106.g8852379c.el9 ceph 45 k 2024-09-22T08:11:49.725 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-common x86_64 2:19.3.0-5106.g8852379c.el9 ceph 148 k 2024-09-22T08:11:49.725 INFO:teuthology.orchestra.run.smithi042.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-22T08:11:49.725 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-22T08:11:49.725 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-22T08:11:49.725 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-22T08:11:49.725 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-22T08:11:49.726 INFO:teuthology.orchestra.run.smithi042.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-22T08:11:49.726 INFO:teuthology.orchestra.run.smithi042.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-22T08:11:49.726 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-22T08:11:49.726 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-22T08:11:49.726 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-22T08:11:49.726 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-22T08:11:49.726 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-22T08:11:49.726 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-22T08:11:49.726 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-22T08:11:49.726 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-22T08:11:49.726 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-22T08:11:49.726 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-22T08:11:49.726 INFO:teuthology.orchestra.run.smithi042.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-22T08:11:49.726 INFO:teuthology.orchestra.run.smithi042.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-22T08:11:49.727 INFO:teuthology.orchestra.run.smithi042.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-22T08:11:49.727 INFO:teuthology.orchestra.run.smithi042.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-22T08:11:49.727 INFO:teuthology.orchestra.run.smithi042.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-22T08:11:49.727 INFO:teuthology.orchestra.run.smithi042.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-22T08:11:49.727 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-22T08:11:49.727 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-22T08:11:49.727 INFO:teuthology.orchestra.run.smithi042.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-22T08:11:49.727 INFO:teuthology.orchestra.run.smithi042.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-22T08:11:49.727 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-22T08:11:49.727 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-22T08:11:49.727 INFO:teuthology.orchestra.run.smithi042.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-22T08:11:49.727 INFO:teuthology.orchestra.run.smithi042.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-22T08:11:49.727 INFO:teuthology.orchestra.run.smithi042.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-22T08:11:49.727 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-22T08:11:49.728 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-22T08:11:49.728 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-22T08:11:49.728 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-22T08:11:49.728 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-22T08:11:49.728 INFO:teuthology.orchestra.run.smithi042.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-22T08:11:49.728 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-22T08:11:49.728 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-22T08:11:49.728 INFO:teuthology.orchestra.run.smithi042.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-22T08:11:49.728 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-22T08:11:49.728 INFO:teuthology.orchestra.run.smithi042.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-22T08:11:49.728 INFO:teuthology.orchestra.run.smithi042.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-22T08:11:49.728 INFO:teuthology.orchestra.run.smithi042.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-22T08:11:49.728 INFO:teuthology.orchestra.run.smithi042.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-22T08:11:49.729 INFO:teuthology.orchestra.run.smithi042.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-22T08:11:49.729 INFO:teuthology.orchestra.run.smithi042.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-22T08:11:49.729 INFO:teuthology.orchestra.run.smithi042.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-22T08:11:49.729 INFO:teuthology.orchestra.run.smithi042.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-22T08:11:49.729 INFO:teuthology.orchestra.run.smithi042.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-22T08:11:49.729 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-22T08:11:49.729 INFO:teuthology.orchestra.run.smithi042.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-22T08:11:49.729 INFO:teuthology.orchestra.run.smithi042.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-22T08:11:49.729 INFO:teuthology.orchestra.run.smithi042.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-22T08:11:49.729 INFO:teuthology.orchestra.run.smithi042.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-22T08:11:49.729 INFO:teuthology.orchestra.run.smithi042.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-22T08:11:49.729 INFO:teuthology.orchestra.run.smithi042.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-22T08:11:49.729 INFO:teuthology.orchestra.run.smithi042.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-22T08:11:49.729 INFO:teuthology.orchestra.run.smithi042.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-22T08:11:49.729 INFO:teuthology.orchestra.run.smithi042.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-22T08:11:49.730 INFO:teuthology.orchestra.run.smithi042.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-22T08:11:49.730 INFO:teuthology.orchestra.run.smithi042.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-22T08:11:49.730 INFO:teuthology.orchestra.run.smithi042.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-22T08:11:49.730 INFO:teuthology.orchestra.run.smithi042.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-22T08:11:49.730 INFO:teuthology.orchestra.run.smithi042.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-22T08:11:49.730 INFO:teuthology.orchestra.run.smithi042.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-22T08:11:49.730 INFO:teuthology.orchestra.run.smithi042.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-22T08:11:49.730 INFO:teuthology.orchestra.run.smithi042.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-22T08:11:49.730 INFO:teuthology.orchestra.run.smithi042.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-22T08:11:49.730 INFO:teuthology.orchestra.run.smithi042.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-22T08:11:49.730 INFO:teuthology.orchestra.run.smithi042.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-22T08:11:49.730 INFO:teuthology.orchestra.run.smithi042.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-22T08:11:49.730 INFO:teuthology.orchestra.run.smithi042.stdout:Installing weak dependencies: 2024-09-22T08:11:49.730 INFO:teuthology.orchestra.run.smithi042.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-22T08:11:49.731 INFO:teuthology.orchestra.run.smithi042.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-22T08:11:49.731 INFO:teuthology.orchestra.run.smithi042.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-22T08:11:49.731 INFO:teuthology.orchestra.run.smithi042.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-22T08:11:49.731 INFO:teuthology.orchestra.run.smithi042.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-22T08:11:49.731 INFO:teuthology.orchestra.run.smithi042.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-22T08:11:49.731 INFO:teuthology.orchestra.run.smithi042.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-22T08:11:49.731 INFO:teuthology.orchestra.run.smithi042.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-22T08:11:49.731 INFO:teuthology.orchestra.run.smithi042.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-22T08:11:49.731 INFO:teuthology.orchestra.run.smithi042.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-22T08:11:49.731 INFO:teuthology.orchestra.run.smithi042.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-22T08:11:49.731 INFO:teuthology.orchestra.run.smithi042.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-22T08:11:49.731 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-22T08:11:49.731 INFO:teuthology.orchestra.run.smithi042.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-22T08:11:49.731 INFO:teuthology.orchestra.run.smithi042.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-22T08:11:49.732 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:11:49.732 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-09-22T08:11:49.732 INFO:teuthology.orchestra.run.smithi042.stdout:====================================================================================================== 2024-09-22T08:11:49.732 INFO:teuthology.orchestra.run.smithi042.stdout:Install 284 Packages 2024-09-22T08:11:49.732 INFO:teuthology.orchestra.run.smithi042.stdout:Upgrade 2 Packages 2024-09-22T08:11:49.732 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:11:49.732 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 322 M 2024-09-22T08:11:49.732 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-09-22T08:11:50.040 INFO:teuthology.orchestra.run.smithi042.stdout:(1/286): ceph-19.3.0-5106.g8852379c.el9.x86_64. 53 kB/s | 6.6 kB 00:00 2024-09-22T08:11:50.307 INFO:teuthology.orchestra.run.smithi042.stdout:(2/286): ceph-fuse-19.3.0-5106.g8852379c.el9.x8 3.3 MB/s | 900 kB 00:00 2024-09-22T08:11:50.399 INFO:teuthology.orchestra.run.smithi042.stdout:(3/286): ceph-immutable-object-cache-19.3.0-510 1.5 MB/s | 145 kB 00:00 2024-09-22T08:11:50.474 INFO:teuthology.orchestra.run.smithi042.stdout:(4/286): ceph-base-19.3.0-5106.g8852379c.el9.x8 9.9 MB/s | 5.5 MB 00:00 2024-09-22T08:11:50.566 INFO:teuthology.orchestra.run.smithi042.stdout:(5/286): ceph-mgr-19.3.0-5106.g8852379c.el9.x86 17 MB/s | 1.5 MB 00:00 2024-09-22T08:11:50.733 INFO:teuthology.orchestra.run.smithi042.stdout:(6/286): ceph-mds-19.3.0-5106.g8852379c.el9.x86 7.1 MB/s | 2.4 MB 00:00 2024-09-22T08:11:50.850 INFO:teuthology.orchestra.run.smithi042.stdout:(7/286): ceph-mon-19.3.0-5106.g8852379c.el9.x86 17 MB/s | 4.8 MB 00:00 2024-09-22T08:11:51.067 INFO:teuthology.orchestra.run.smithi042.stdout:(8/286): ceph-common-19.3.0-5106.g8852379c.el9. 19 MB/s | 22 MB 00:01 2024-09-22T08:11:51.126 INFO:teuthology.orchestra.run.smithi042.stdout:(9/286): ceph-selinux-19.3.0-5106.g8852379c.el9 432 kB/s | 25 kB 00:00 2024-09-22T08:11:51.212 INFO:teuthology.orchestra.run.smithi038.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-22T08:11:51.476 INFO:teuthology.orchestra.run.smithi042.stdout:(10/286): ceph-radosgw-19.3.0-5106.g8852379c.el 17 MB/s | 11 MB 00:00 2024-09-22T08:11:51.526 INFO:teuthology.orchestra.run.smithi042.stdout:(11/286): libcephfs-devel-19.3.0-5106.g8852379c 640 kB/s | 32 kB 00:00 2024-09-22T08:11:51.618 INFO:teuthology.orchestra.run.smithi042.stdout:(12/286): libcephfs2-19.3.0-5106.g8852379c.el9. 8.1 MB/s | 755 kB 00:00 2024-09-22T08:11:51.685 INFO:teuthology.orchestra.run.smithi042.stdout:(13/286): libcephsqlite-19.3.0-5106.g8852379c.e 2.4 MB/s | 161 kB 00:00 2024-09-22T08:11:51.760 INFO:teuthology.orchestra.run.smithi042.stdout:(14/286): librados-devel-19.3.0-5106.g8852379c. 1.7 MB/s | 127 kB 00:00 2024-09-22T08:11:51.836 INFO:teuthology.orchestra.run.smithi042.stdout:(15/286): libradosstriper1-19.3.0-5106.g8852379 6.6 MB/s | 508 kB 00:00 2024-09-22T08:11:52.019 INFO:teuthology.orchestra.run.smithi042.stdout:(16/286): ceph-osd-19.3.0-5106.g8852379c.el9.x8 13 MB/s | 17 MB 00:01 2024-09-22T08:11:52.070 INFO:teuthology.orchestra.run.smithi042.stdout:(17/286): python3-ceph-argparse-19.3.0-5106.g88 911 kB/s | 45 kB 00:00 2024-09-22T08:11:52.187 INFO:teuthology.orchestra.run.smithi042.stdout:(18/286): librgw2-19.3.0-5106.g8852379c.el9.x86 16 MB/s | 5.5 MB 00:00 2024-09-22T08:11:52.212 INFO:teuthology.orchestra.run.smithi042.stdout:(19/286): python3-ceph-common-19.3.0-5106.g8852 1.0 MB/s | 148 kB 00:00 2024-09-22T08:11:52.237 INFO:teuthology.orchestra.run.smithi042.stdout:(20/286): python3-cephfs-19.3.0-5106.g8852379c. 3.2 MB/s | 162 kB 00:00 2024-09-22T08:11:52.262 INFO:teuthology.orchestra.run.smithi042.stdout:(21/286): python3-rados-19.3.0-5106.g8852379c.e 6.2 MB/s | 320 kB 00:00 2024-09-22T08:11:52.288 INFO:teuthology.orchestra.run.smithi042.stdout:(22/286): python3-rbd-19.3.0-5106.g8852379c.el9 6.0 MB/s | 307 kB 00:00 2024-09-22T08:11:52.313 INFO:teuthology.orchestra.run.smithi042.stdout:(23/286): python3-rgw-19.3.0-5106.g8852379c.el9 1.9 MB/s | 99 kB 00:00 2024-09-22T08:11:52.338 INFO:teuthology.orchestra.run.smithi042.stdout:(24/286): rbd-fuse-19.3.0-5106.g8852379c.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-22T08:11:52.389 INFO:teuthology.orchestra.run.smithi042.stdout:(25/286): rbd-nbd-19.3.0-5106.g8852379c.el9.x86 3.3 MB/s | 170 kB 00:00 2024-09-22T08:11:52.455 INFO:teuthology.orchestra.run.smithi042.stdout:(26/286): ceph-grafana-dashboards-19.3.0-5106.g 514 kB/s | 34 kB 00:00 2024-09-22T08:11:52.539 INFO:teuthology.orchestra.run.smithi042.stdout:(27/286): rbd-mirror-19.3.0-5106.g8852379c.el9. 14 MB/s | 3.2 MB 00:00 2024-09-22T08:11:52.564 INFO:teuthology.orchestra.run.smithi042.stdout:(28/286): ceph-mgr-cephadm-19.3.0-5106.g8852379 1.4 MB/s | 154 kB 00:00 2024-09-22T08:11:53.298 INFO:teuthology.orchestra.run.smithi042.stdout:(29/286): ceph-test-19.3.0-5106.g8852379c.el9.x 21 MB/s | 46 MB 00:02 2024-09-22T08:11:53.407 INFO:teuthology.orchestra.run.smithi042.stdout:(30/286): ceph-mgr-diskprediction-local-19.3.0- 8.8 MB/s | 7.4 MB 00:00 2024-09-22T08:11:53.432 INFO:teuthology.orchestra.run.smithi042.stdout:(31/286): ceph-mgr-modules-core-19.3.0-5106.g88 2.1 MB/s | 292 kB 00:00 2024-09-22T08:11:53.485 INFO:teuthology.orchestra.run.smithi042.stdout:(32/286): ceph-mgr-rook-19.3.0-5106.g8852379c.e 637 kB/s | 49 kB 00:00 2024-09-22T08:11:53.508 INFO:teuthology.orchestra.run.smithi042.stdout:(33/286): ceph-prometheus-alerts-19.3.0-5106.g8 218 kB/s | 16 kB 00:00 2024-09-22T08:11:53.524 INFO:teuthology.orchestra.run.smithi038.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-22T08:11:53.525 INFO:teuthology.orchestra.run.smithi038.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-22T08:11:53.542 INFO:teuthology.orchestra.run.smithi042.stdout:(34/286): ceph-volume-19.3.0-5106.g8852379c.el9 4.9 MB/s | 285 kB 00:00 2024-09-22T08:11:53.600 INFO:teuthology.orchestra.run.smithi042.stdout:(35/286): cephadm-19.3.0-5106.g8852379c.el9.noa 8.3 MB/s | 784 kB 00:00 2024-09-22T08:11:53.625 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-22T08:11:53.647 INFO:teuthology.orchestra.run.smithi038.stdout:====================================================================================================== 2024-09-22T08:11:53.647 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2024-09-22T08:11:53.647 INFO:teuthology.orchestra.run.smithi038.stdout:====================================================================================================== 2024-09-22T08:11:53.647 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-09-22T08:11:53.647 INFO:teuthology.orchestra.run.smithi038.stdout: ceph x86_64 2:19.3.0-5106.g8852379c.el9 ceph 6.6 k 2024-09-22T08:11:53.647 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-base x86_64 2:19.3.0-5106.g8852379c.el9 ceph 5.5 M 2024-09-22T08:11:53.647 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-fuse x86_64 2:19.3.0-5106.g8852379c.el9 ceph 900 k 2024-09-22T08:11:53.647 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5106.g8852379c.el9 ceph 145 k 2024-09-22T08:11:53.647 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr x86_64 2:19.3.0-5106.g8852379c.el9 ceph 1.5 M 2024-09-22T08:11:53.648 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 154 k 2024-09-22T08:11:53.648 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 14 M 2024-09-22T08:11:53.648 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 7.4 M 2024-09-22T08:11:53.648 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-rook noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 49 k 2024-09-22T08:11:53.648 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-radosgw x86_64 2:19.3.0-5106.g8852379c.el9 ceph 11 M 2024-09-22T08:11:53.648 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-test x86_64 2:19.3.0-5106.g8852379c.el9 ceph 46 M 2024-09-22T08:11:53.648 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-volume noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 285 k 2024-09-22T08:11:53.648 INFO:teuthology.orchestra.run.smithi038.stdout: cephadm noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 784 k 2024-09-22T08:11:53.648 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs-devel x86_64 2:19.3.0-5106.g8852379c.el9 ceph 32 k 2024-09-22T08:11:53.648 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs2 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 755 k 2024-09-22T08:11:53.648 INFO:teuthology.orchestra.run.smithi038.stdout: librados-devel x86_64 2:19.3.0-5106.g8852379c.el9 ceph 127 k 2024-09-22T08:11:53.648 INFO:teuthology.orchestra.run.smithi038.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-22T08:11:53.648 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cephfs x86_64 2:19.3.0-5106.g8852379c.el9 ceph 162 k 2024-09-22T08:11:53.648 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rados x86_64 2:19.3.0-5106.g8852379c.el9 ceph 320 k 2024-09-22T08:11:53.649 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rbd x86_64 2:19.3.0-5106.g8852379c.el9 ceph 307 k 2024-09-22T08:11:53.649 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rgw x86_64 2:19.3.0-5106.g8852379c.el9 ceph 99 k 2024-09-22T08:11:53.649 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-fuse x86_64 2:19.3.0-5106.g8852379c.el9 ceph 85 k 2024-09-22T08:11:53.649 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-mirror x86_64 2:19.3.0-5106.g8852379c.el9 ceph 3.2 M 2024-09-22T08:11:53.649 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-nbd x86_64 2:19.3.0-5106.g8852379c.el9 ceph 170 k 2024-09-22T08:11:53.649 INFO:teuthology.orchestra.run.smithi038.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-22T08:11:53.649 INFO:teuthology.orchestra.run.smithi038.stdout:Upgrading: 2024-09-22T08:11:53.649 INFO:teuthology.orchestra.run.smithi038.stdout: librados2 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 3.5 M 2024-09-22T08:11:53.649 INFO:teuthology.orchestra.run.smithi038.stdout: librbd1 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 3.2 M 2024-09-22T08:11:53.649 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2024-09-22T08:11:53.649 INFO:teuthology.orchestra.run.smithi038.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-22T08:11:53.649 INFO:teuthology.orchestra.run.smithi038.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-22T08:11:53.650 INFO:teuthology.orchestra.run.smithi038.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-22T08:11:53.650 INFO:teuthology.orchestra.run.smithi038.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-22T08:11:53.650 INFO:teuthology.orchestra.run.smithi038.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-22T08:11:53.650 INFO:teuthology.orchestra.run.smithi038.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-22T08:11:53.650 INFO:teuthology.orchestra.run.smithi038.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-22T08:11:53.650 INFO:teuthology.orchestra.run.smithi038.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-22T08:11:53.650 INFO:teuthology.orchestra.run.smithi038.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-22T08:11:53.650 INFO:teuthology.orchestra.run.smithi038.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-22T08:11:53.650 INFO:teuthology.orchestra.run.smithi038.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-22T08:11:53.650 INFO:teuthology.orchestra.run.smithi038.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-22T08:11:53.650 INFO:teuthology.orchestra.run.smithi038.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-22T08:11:53.650 INFO:teuthology.orchestra.run.smithi038.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-22T08:11:53.650 INFO:teuthology.orchestra.run.smithi038.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-22T08:11:53.651 INFO:teuthology.orchestra.run.smithi038.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-22T08:11:53.651 INFO:teuthology.orchestra.run.smithi038.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-22T08:11:53.651 INFO:teuthology.orchestra.run.smithi038.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-22T08:11:53.651 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-common x86_64 2:19.3.0-5106.g8852379c.el9 ceph 22 M 2024-09-22T08:11:53.651 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 34 k 2024-09-22T08:11:53.651 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mds x86_64 2:19.3.0-5106.g8852379c.el9 ceph 2.4 M 2024-09-22T08:11:53.651 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 292 k 2024-09-22T08:11:53.651 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mon x86_64 2:19.3.0-5106.g8852379c.el9 ceph 4.8 M 2024-09-22T08:11:53.651 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-osd x86_64 2:19.3.0-5106.g8852379c.el9 ceph 17 M 2024-09-22T08:11:53.651 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 16 k 2024-09-22T08:11:53.651 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-selinux x86_64 2:19.3.0-5106.g8852379c.el9 ceph 25 k 2024-09-22T08:11:53.651 INFO:teuthology.orchestra.run.smithi038.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-22T08:11:53.651 INFO:teuthology.orchestra.run.smithi038.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-22T08:11:53.652 INFO:teuthology.orchestra.run.smithi038.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-22T08:11:53.652 INFO:teuthology.orchestra.run.smithi038.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-22T08:11:53.652 INFO:teuthology.orchestra.run.smithi038.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-22T08:11:53.652 INFO:teuthology.orchestra.run.smithi038.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-22T08:11:53.652 INFO:teuthology.orchestra.run.smithi038.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-22T08:11:53.652 INFO:teuthology.orchestra.run.smithi038.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-22T08:11:53.652 INFO:teuthology.orchestra.run.smithi038.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-22T08:11:53.652 INFO:teuthology.orchestra.run.smithi038.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-22T08:11:53.652 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-22T08:11:53.652 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-22T08:11:53.652 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-22T08:11:53.652 INFO:teuthology.orchestra.run.smithi038.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-22T08:11:53.652 INFO:teuthology.orchestra.run.smithi038.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-22T08:11:53.652 INFO:teuthology.orchestra.run.smithi038.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-22T08:11:53.652 INFO:teuthology.orchestra.run.smithi038.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-22T08:11:53.653 INFO:teuthology.orchestra.run.smithi038.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-22T08:11:53.653 INFO:teuthology.orchestra.run.smithi038.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-22T08:11:53.653 INFO:teuthology.orchestra.run.smithi038.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-22T08:11:53.653 INFO:teuthology.orchestra.run.smithi038.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-22T08:11:53.653 INFO:teuthology.orchestra.run.smithi038.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-22T08:11:53.653 INFO:teuthology.orchestra.run.smithi038.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-22T08:11:53.653 INFO:teuthology.orchestra.run.smithi038.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-22T08:11:53.653 INFO:teuthology.orchestra.run.smithi038.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-22T08:11:53.653 INFO:teuthology.orchestra.run.smithi038.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-22T08:11:53.653 INFO:teuthology.orchestra.run.smithi038.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-22T08:11:53.653 INFO:teuthology.orchestra.run.smithi038.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-22T08:11:53.653 INFO:teuthology.orchestra.run.smithi038.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-22T08:11:53.654 INFO:teuthology.orchestra.run.smithi038.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-22T08:11:53.654 INFO:teuthology.orchestra.run.smithi038.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-22T08:11:53.654 INFO:teuthology.orchestra.run.smithi038.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-22T08:11:53.654 INFO:teuthology.orchestra.run.smithi038.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-22T08:11:53.654 INFO:teuthology.orchestra.run.smithi038.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-22T08:11:53.654 INFO:teuthology.orchestra.run.smithi038.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-22T08:11:53.654 INFO:teuthology.orchestra.run.smithi038.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-22T08:11:53.654 INFO:teuthology.orchestra.run.smithi038.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-22T08:11:53.654 INFO:teuthology.orchestra.run.smithi038.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-22T08:11:53.654 INFO:teuthology.orchestra.run.smithi038.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-22T08:11:53.654 INFO:teuthology.orchestra.run.smithi038.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-22T08:11:53.654 INFO:teuthology.orchestra.run.smithi038.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-22T08:11:53.654 INFO:teuthology.orchestra.run.smithi038.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-22T08:11:53.655 INFO:teuthology.orchestra.run.smithi038.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-22T08:11:53.655 INFO:teuthology.orchestra.run.smithi038.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-22T08:11:53.655 INFO:teuthology.orchestra.run.smithi038.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-22T08:11:53.655 INFO:teuthology.orchestra.run.smithi038.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-22T08:11:53.655 INFO:teuthology.orchestra.run.smithi038.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-22T08:11:53.655 INFO:teuthology.orchestra.run.smithi038.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-22T08:11:53.655 INFO:teuthology.orchestra.run.smithi038.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-22T08:11:53.655 INFO:teuthology.orchestra.run.smithi038.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-22T08:11:53.655 INFO:teuthology.orchestra.run.smithi038.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-22T08:11:53.655 INFO:teuthology.orchestra.run.smithi038.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-22T08:11:53.655 INFO:teuthology.orchestra.run.smithi038.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-22T08:11:53.655 INFO:teuthology.orchestra.run.smithi038.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-22T08:11:53.655 INFO:teuthology.orchestra.run.smithi038.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-22T08:11:53.655 INFO:teuthology.orchestra.run.smithi038.stdout: libcephsqlite x86_64 2:19.3.0-5106.g8852379c.el9 ceph 161 k 2024-09-22T08:11:53.655 INFO:teuthology.orchestra.run.smithi038.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-22T08:11:53.656 INFO:teuthology.orchestra.run.smithi038.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-22T08:11:53.656 INFO:teuthology.orchestra.run.smithi038.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-22T08:11:53.656 INFO:teuthology.orchestra.run.smithi038.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-22T08:11:53.656 INFO:teuthology.orchestra.run.smithi038.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-22T08:11:53.656 INFO:teuthology.orchestra.run.smithi038.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-22T08:11:53.656 INFO:teuthology.orchestra.run.smithi038.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-22T08:11:53.656 INFO:teuthology.orchestra.run.smithi038.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-22T08:11:53.656 INFO:teuthology.orchestra.run.smithi038.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-22T08:11:53.656 INFO:teuthology.orchestra.run.smithi038.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-22T08:11:53.656 INFO:teuthology.orchestra.run.smithi038.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-22T08:11:53.656 INFO:teuthology.orchestra.run.smithi038.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-22T08:11:53.656 INFO:teuthology.orchestra.run.smithi038.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-22T08:11:53.656 INFO:teuthology.orchestra.run.smithi038.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-22T08:11:53.656 INFO:teuthology.orchestra.run.smithi038.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-22T08:11:53.657 INFO:teuthology.orchestra.run.smithi038.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-22T08:11:53.657 INFO:teuthology.orchestra.run.smithi038.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-22T08:11:53.657 INFO:teuthology.orchestra.run.smithi038.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-22T08:11:53.657 INFO:teuthology.orchestra.run.smithi038.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-22T08:11:53.657 INFO:teuthology.orchestra.run.smithi038.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-22T08:11:53.657 INFO:teuthology.orchestra.run.smithi038.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-22T08:11:53.657 INFO:teuthology.orchestra.run.smithi038.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-22T08:11:53.657 INFO:teuthology.orchestra.run.smithi038.stdout: libradosstriper1 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 508 k 2024-09-22T08:11:53.657 INFO:teuthology.orchestra.run.smithi038.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-22T08:11:53.657 INFO:teuthology.orchestra.run.smithi038.stdout: librgw2 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 5.5 M 2024-09-22T08:11:53.657 INFO:teuthology.orchestra.run.smithi038.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-22T08:11:53.657 INFO:teuthology.orchestra.run.smithi038.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-22T08:11:53.657 INFO:teuthology.orchestra.run.smithi038.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-22T08:11:53.657 INFO:teuthology.orchestra.run.smithi038.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-22T08:11:53.658 INFO:teuthology.orchestra.run.smithi038.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-22T08:11:53.658 INFO:teuthology.orchestra.run.smithi038.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-22T08:11:53.658 INFO:teuthology.orchestra.run.smithi038.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-22T08:11:53.658 INFO:teuthology.orchestra.run.smithi038.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-22T08:11:53.658 INFO:teuthology.orchestra.run.smithi038.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-22T08:11:53.658 INFO:teuthology.orchestra.run.smithi038.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-22T08:11:53.658 INFO:teuthology.orchestra.run.smithi038.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-22T08:11:53.658 INFO:teuthology.orchestra.run.smithi038.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-22T08:11:53.658 INFO:teuthology.orchestra.run.smithi038.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-22T08:11:53.658 INFO:teuthology.orchestra.run.smithi038.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-22T08:11:53.658 INFO:teuthology.orchestra.run.smithi038.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-22T08:11:53.658 INFO:teuthology.orchestra.run.smithi038.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-22T08:11:53.658 INFO:teuthology.orchestra.run.smithi038.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-22T08:11:53.659 INFO:teuthology.orchestra.run.smithi038.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-22T08:11:53.659 INFO:teuthology.orchestra.run.smithi038.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-22T08:11:53.659 INFO:teuthology.orchestra.run.smithi038.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-22T08:11:53.659 INFO:teuthology.orchestra.run.smithi038.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-22T08:11:53.659 INFO:teuthology.orchestra.run.smithi038.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-22T08:11:53.659 INFO:teuthology.orchestra.run.smithi038.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-22T08:11:53.659 INFO:teuthology.orchestra.run.smithi038.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-22T08:11:53.659 INFO:teuthology.orchestra.run.smithi038.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-22T08:11:53.659 INFO:teuthology.orchestra.run.smithi038.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-22T08:11:53.659 INFO:teuthology.orchestra.run.smithi038.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-22T08:11:53.659 INFO:teuthology.orchestra.run.smithi038.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-22T08:11:53.659 INFO:teuthology.orchestra.run.smithi038.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-22T08:11:53.660 INFO:teuthology.orchestra.run.smithi038.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-22T08:11:53.660 INFO:teuthology.orchestra.run.smithi038.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-22T08:11:53.660 INFO:teuthology.orchestra.run.smithi038.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-22T08:11:53.660 INFO:teuthology.orchestra.run.smithi038.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-22T08:11:53.660 INFO:teuthology.orchestra.run.smithi038.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-22T08:11:53.660 INFO:teuthology.orchestra.run.smithi038.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-22T08:11:53.660 INFO:teuthology.orchestra.run.smithi038.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-22T08:11:53.660 INFO:teuthology.orchestra.run.smithi038.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-22T08:11:53.660 INFO:teuthology.orchestra.run.smithi038.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-22T08:11:53.660 INFO:teuthology.orchestra.run.smithi038.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-22T08:11:53.660 INFO:teuthology.orchestra.run.smithi038.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-22T08:11:53.660 INFO:teuthology.orchestra.run.smithi038.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-22T08:11:53.660 INFO:teuthology.orchestra.run.smithi038.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-22T08:11:53.661 INFO:teuthology.orchestra.run.smithi038.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-22T08:11:53.661 INFO:teuthology.orchestra.run.smithi038.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-22T08:11:53.661 INFO:teuthology.orchestra.run.smithi038.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-22T08:11:53.661 INFO:teuthology.orchestra.run.smithi038.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-22T08:11:53.661 INFO:teuthology.orchestra.run.smithi038.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-22T08:11:53.661 INFO:teuthology.orchestra.run.smithi038.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-22T08:11:53.661 INFO:teuthology.orchestra.run.smithi038.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-22T08:11:53.661 INFO:teuthology.orchestra.run.smithi038.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-22T08:11:53.661 INFO:teuthology.orchestra.run.smithi038.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-22T08:11:53.661 INFO:teuthology.orchestra.run.smithi038.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-22T08:11:53.661 INFO:teuthology.orchestra.run.smithi038.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-22T08:11:53.661 INFO:teuthology.orchestra.run.smithi038.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-22T08:11:53.661 INFO:teuthology.orchestra.run.smithi038.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-22T08:11:53.661 INFO:teuthology.orchestra.run.smithi038.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-22T08:11:53.662 INFO:teuthology.orchestra.run.smithi038.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-22T08:11:53.662 INFO:teuthology.orchestra.run.smithi038.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-22T08:11:53.662 INFO:teuthology.orchestra.run.smithi038.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-22T08:11:53.662 INFO:teuthology.orchestra.run.smithi038.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-22T08:11:53.662 INFO:teuthology.orchestra.run.smithi038.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-22T08:11:53.662 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-22T08:11:53.662 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-argparse x86_64 2:19.3.0-5106.g8852379c.el9 ceph 45 k 2024-09-22T08:11:53.662 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-common x86_64 2:19.3.0-5106.g8852379c.el9 ceph 148 k 2024-09-22T08:11:53.662 INFO:teuthology.orchestra.run.smithi038.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-22T08:11:53.662 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-22T08:11:53.662 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-22T08:11:53.662 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-22T08:11:53.662 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-22T08:11:53.662 INFO:teuthology.orchestra.run.smithi038.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-22T08:11:53.663 INFO:teuthology.orchestra.run.smithi038.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-22T08:11:53.663 INFO:teuthology.orchestra.run.smithi038.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-22T08:11:53.663 INFO:teuthology.orchestra.run.smithi038.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-22T08:11:53.663 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-22T08:11:53.663 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-22T08:11:53.663 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-22T08:11:53.663 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-22T08:11:53.663 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-22T08:11:53.663 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-22T08:11:53.663 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-22T08:11:53.663 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-22T08:11:53.663 INFO:teuthology.orchestra.run.smithi038.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-22T08:11:53.663 INFO:teuthology.orchestra.run.smithi038.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-22T08:11:53.664 INFO:teuthology.orchestra.run.smithi038.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-22T08:11:53.664 INFO:teuthology.orchestra.run.smithi038.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-22T08:11:53.664 INFO:teuthology.orchestra.run.smithi038.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-22T08:11:53.664 INFO:teuthology.orchestra.run.smithi038.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-22T08:11:53.664 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-22T08:11:53.664 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-22T08:11:53.664 INFO:teuthology.orchestra.run.smithi038.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-22T08:11:53.664 INFO:teuthology.orchestra.run.smithi038.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-22T08:11:53.664 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-22T08:11:53.664 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-22T08:11:53.664 INFO:teuthology.orchestra.run.smithi038.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-22T08:11:53.664 INFO:teuthology.orchestra.run.smithi038.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-22T08:11:53.664 INFO:teuthology.orchestra.run.smithi038.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-22T08:11:53.664 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-22T08:11:53.665 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-22T08:11:53.665 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-22T08:11:53.665 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-22T08:11:53.665 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-22T08:11:53.665 INFO:teuthology.orchestra.run.smithi038.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-22T08:11:53.665 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-22T08:11:53.665 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-22T08:11:53.665 INFO:teuthology.orchestra.run.smithi038.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-22T08:11:53.665 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-22T08:11:53.665 INFO:teuthology.orchestra.run.smithi038.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-22T08:11:53.665 INFO:teuthology.orchestra.run.smithi038.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-22T08:11:53.665 INFO:teuthology.orchestra.run.smithi038.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-22T08:11:53.665 INFO:teuthology.orchestra.run.smithi038.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-22T08:11:53.665 INFO:teuthology.orchestra.run.smithi038.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-22T08:11:53.666 INFO:teuthology.orchestra.run.smithi038.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-22T08:11:53.666 INFO:teuthology.orchestra.run.smithi038.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-22T08:11:53.666 INFO:teuthology.orchestra.run.smithi038.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-22T08:11:53.666 INFO:teuthology.orchestra.run.smithi038.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-22T08:11:53.666 INFO:teuthology.orchestra.run.smithi038.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-22T08:11:53.666 INFO:teuthology.orchestra.run.smithi038.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-22T08:11:53.666 INFO:teuthology.orchestra.run.smithi038.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-22T08:11:53.666 INFO:teuthology.orchestra.run.smithi038.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-22T08:11:53.666 INFO:teuthology.orchestra.run.smithi038.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-22T08:11:53.666 INFO:teuthology.orchestra.run.smithi038.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-22T08:11:53.666 INFO:teuthology.orchestra.run.smithi038.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-22T08:11:53.666 INFO:teuthology.orchestra.run.smithi038.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-22T08:11:53.667 INFO:teuthology.orchestra.run.smithi038.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-22T08:11:53.667 INFO:teuthology.orchestra.run.smithi038.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-22T08:11:53.667 INFO:teuthology.orchestra.run.smithi038.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-22T08:11:53.667 INFO:teuthology.orchestra.run.smithi038.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-22T08:11:53.667 INFO:teuthology.orchestra.run.smithi038.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-22T08:11:53.667 INFO:teuthology.orchestra.run.smithi038.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-22T08:11:53.667 INFO:teuthology.orchestra.run.smithi038.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-22T08:11:53.667 INFO:teuthology.orchestra.run.smithi038.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-22T08:11:53.667 INFO:teuthology.orchestra.run.smithi038.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-22T08:11:53.667 INFO:teuthology.orchestra.run.smithi038.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-22T08:11:53.667 INFO:teuthology.orchestra.run.smithi038.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-22T08:11:53.667 INFO:teuthology.orchestra.run.smithi038.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-22T08:11:53.667 INFO:teuthology.orchestra.run.smithi038.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-22T08:11:53.667 INFO:teuthology.orchestra.run.smithi038.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-22T08:11:53.668 INFO:teuthology.orchestra.run.smithi038.stdout:Installing weak dependencies: 2024-09-22T08:11:53.668 INFO:teuthology.orchestra.run.smithi038.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-22T08:11:53.668 INFO:teuthology.orchestra.run.smithi038.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-22T08:11:53.668 INFO:teuthology.orchestra.run.smithi038.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-22T08:11:53.668 INFO:teuthology.orchestra.run.smithi038.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-22T08:11:53.668 INFO:teuthology.orchestra.run.smithi038.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-22T08:11:53.668 INFO:teuthology.orchestra.run.smithi038.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-22T08:11:53.668 INFO:teuthology.orchestra.run.smithi038.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-22T08:11:53.668 INFO:teuthology.orchestra.run.smithi038.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-22T08:11:53.668 INFO:teuthology.orchestra.run.smithi038.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-22T08:11:53.668 INFO:teuthology.orchestra.run.smithi038.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-22T08:11:53.668 INFO:teuthology.orchestra.run.smithi038.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-22T08:11:53.668 INFO:teuthology.orchestra.run.smithi038.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-22T08:11:53.668 INFO:teuthology.orchestra.run.smithi038.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-22T08:11:53.669 INFO:teuthology.orchestra.run.smithi038.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-22T08:11:53.669 INFO:teuthology.orchestra.run.smithi038.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-22T08:11:53.669 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:11:53.669 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-09-22T08:11:53.669 INFO:teuthology.orchestra.run.smithi038.stdout:====================================================================================================== 2024-09-22T08:11:53.669 INFO:teuthology.orchestra.run.smithi038.stdout:Install 284 Packages 2024-09-22T08:11:53.669 INFO:teuthology.orchestra.run.smithi038.stdout:Upgrade 2 Packages 2024-09-22T08:11:53.669 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:11:53.669 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 322 M 2024-09-22T08:11:53.670 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-09-22T08:11:53.901 INFO:teuthology.orchestra.run.smithi042.stdout:(36/286): ceph-mgr-dashboard-19.3.0-5106.g88523 10 MB/s | 14 MB 00:01 2024-09-22T08:11:54.064 INFO:teuthology.orchestra.run.smithi038.stdout:(1/286): ceph-19.3.0-5106.g8852379c.el9.x86_64. 48 kB/s | 6.6 kB 00:00 2024-09-22T08:11:54.381 INFO:teuthology.orchestra.run.smithi038.stdout:(2/286): ceph-base-19.3.0-5106.g8852379c.el9.x8 12 MB/s | 5.5 MB 00:00 2024-09-22T08:11:54.417 INFO:teuthology.orchestra.run.smithi042.stdout:(37/286): bluez-libs-5.56-6.el9.x86_64.rpm 104 kB/s | 85 kB 00:00 2024-09-22T08:11:54.422 INFO:teuthology.orchestra.run.smithi038.stdout:(3/286): ceph-fuse-19.3.0-5106.g8852379c.el9.x8 2.5 MB/s | 900 kB 00:00 2024-09-22T08:11:54.448 INFO:teuthology.orchestra.run.smithi038.stdout:(4/286): ceph-immutable-object-cache-19.3.0-510 2.1 MB/s | 145 kB 00:00 2024-09-22T08:11:54.493 INFO:teuthology.orchestra.run.smithi042.stdout:(38/286): bubblewrap-0.4.1-7.el9.x86_64.rpm 85 kB/s | 49 kB 00:00 2024-09-22T08:11:54.526 INFO:teuthology.orchestra.run.smithi042.stdout:(39/286): ModemManager-glib-1.20.2-1.el9.x86_64 341 kB/s | 335 kB 00:00 2024-09-22T08:11:54.540 INFO:teuthology.orchestra.run.smithi038.stdout:(5/286): ceph-mgr-19.3.0-5106.g8852379c.el9.x86 17 MB/s | 1.5 MB 00:00 2024-09-22T08:11:54.790 INFO:teuthology.orchestra.run.smithi038.stdout:(6/286): ceph-mds-19.3.0-5106.g8852379c.el9.x86 6.5 MB/s | 2.4 MB 00:00 2024-09-22T08:11:54.924 INFO:teuthology.orchestra.run.smithi038.stdout:(7/286): ceph-mon-19.3.0-5106.g8852379c.el9.x86 12 MB/s | 4.8 MB 00:00 2024-09-22T08:11:55.185 INFO:teuthology.orchestra.run.smithi042.stdout:(40/286): cups-libs-2.3.3op2-30.el9.x86_64.rpm 342 kB/s | 262 kB 00:00 2024-09-22T08:11:55.227 INFO:teuthology.orchestra.run.smithi042.stdout:(41/286): fuse-2.9.9-16.el9.x86_64.rpm 109 kB/s | 80 kB 00:00 2024-09-22T08:11:55.257 INFO:teuthology.orchestra.run.smithi038.stdout:(8/286): ceph-common-19.3.0-5106.g8852379c.el9. 16 MB/s | 22 MB 00:01 2024-09-22T08:11:55.308 INFO:teuthology.orchestra.run.smithi038.stdout:(9/286): ceph-selinux-19.3.0-5106.g8852379c.el9 506 kB/s | 25 kB 00:00 2024-09-22T08:11:55.419 INFO:teuthology.orchestra.run.smithi042.stdout:(42/286): libgfortran-11.5.0-2.el9.x86_64.rpm 898 kB/s | 801 kB 00:00 2024-09-22T08:11:55.658 INFO:teuthology.orchestra.run.smithi038.stdout:(10/286): ceph-radosgw-19.3.0-5106.g8852379c.el 15 MB/s | 11 MB 00:00 2024-09-22T08:11:55.708 INFO:teuthology.orchestra.run.smithi038.stdout:(11/286): libcephfs-devel-19.3.0-5106.g8852379c 639 kB/s | 32 kB 00:00 2024-09-22T08:11:55.752 INFO:teuthology.orchestra.run.smithi042.stdout:(43/286): libpciaccess-0.16-7.el9.x86_64.rpm 47 kB/s | 27 kB 00:00 2024-09-22T08:11:55.800 INFO:teuthology.orchestra.run.smithi038.stdout:(12/286): libcephfs2-19.3.0-5106.g8852379c.el9. 8.0 MB/s | 755 kB 00:00 2024-09-22T08:11:55.975 INFO:teuthology.orchestra.run.smithi038.stdout:(13/286): ceph-osd-19.3.0-5106.g8852379c.el9.x8 14 MB/s | 17 MB 00:01 2024-09-22T08:11:56.000 INFO:teuthology.orchestra.run.smithi038.stdout:(14/286): libcephsqlite-19.3.0-5106.g8852379c.e 806 kB/s | 161 kB 00:00 2024-09-22T08:11:56.002 INFO:teuthology.orchestra.run.smithi042.stdout:(44/286): libquadmath-11.5.0-2.el9.x86_64.rpm 246 kB/s | 191 kB 00:00 2024-09-22T08:11:56.026 INFO:teuthology.orchestra.run.smithi038.stdout:(15/286): librados-devel-19.3.0-5106.g8852379c. 2.5 MB/s | 127 kB 00:00 2024-09-22T08:11:56.059 INFO:teuthology.orchestra.run.smithi038.stdout:(16/286): libradosstriper1-19.3.0-5106.g8852379 8.5 MB/s | 508 kB 00:00 2024-09-22T08:11:56.078 INFO:teuthology.orchestra.run.smithi042.stdout:(45/286): lksctp-tools-1.0.19-2.el9.x86_64.rpm 145 kB/s | 94 kB 00:00 2024-09-22T08:11:56.118 INFO:teuthology.orchestra.run.smithi038.stdout:(17/286): python3-ceph-argparse-19.3.0-5106.g88 772 kB/s | 45 kB 00:00 2024-09-22T08:11:56.201 INFO:teuthology.orchestra.run.smithi038.stdout:(18/286): python3-ceph-common-19.3.0-5106.g8852 1.7 MB/s | 148 kB 00:00 2024-09-22T08:11:56.285 INFO:teuthology.orchestra.run.smithi038.stdout:(19/286): librgw2-19.3.0-5106.g8852379c.el9.x86 21 MB/s | 5.5 MB 00:00 2024-09-22T08:11:56.319 INFO:teuthology.orchestra.run.smithi038.stdout:(20/286): python3-cephfs-19.3.0-5106.g8852379c. 1.4 MB/s | 162 kB 00:00 2024-09-22T08:11:56.344 INFO:teuthology.orchestra.run.smithi038.stdout:(21/286): python3-rados-19.3.0-5106.g8852379c.e 5.3 MB/s | 320 kB 00:00 2024-09-22T08:11:56.369 INFO:teuthology.orchestra.run.smithi038.stdout:(22/286): python3-rbd-19.3.0-5106.g8852379c.el9 6.0 MB/s | 307 kB 00:00 2024-09-22T08:11:56.394 INFO:teuthology.orchestra.run.smithi038.stdout:(23/286): python3-rgw-19.3.0-5106.g8852379c.el9 1.9 MB/s | 99 kB 00:00 2024-09-22T08:11:56.428 INFO:teuthology.orchestra.run.smithi038.stdout:(24/286): rbd-fuse-19.3.0-5106.g8852379c.el9.x8 1.4 MB/s | 85 kB 00:00 2024-09-22T08:11:56.487 INFO:teuthology.orchestra.run.smithi038.stdout:(25/286): rbd-nbd-19.3.0-5106.g8852379c.el9.x86 2.9 MB/s | 170 kB 00:00 2024-09-22T08:11:56.562 INFO:teuthology.orchestra.run.smithi038.stdout:(26/286): rbd-mirror-19.3.0-5106.g8852379c.el9. 19 MB/s | 3.2 MB 00:00 2024-09-22T08:11:56.587 INFO:teuthology.orchestra.run.smithi038.stdout:(27/286): ceph-grafana-dashboards-19.3.0-5106.g 341 kB/s | 34 kB 00:00 2024-09-22T08:11:56.603 INFO:teuthology.orchestra.run.smithi042.stdout:(46/286): python3-cffi-1.14.5-5.el9.x86_64.rpm 298 kB/s | 253 kB 00:00 2024-09-22T08:11:56.613 INFO:teuthology.orchestra.run.smithi038.stdout:(28/286): ceph-mgr-cephadm-19.3.0-5106.g8852379 3.0 MB/s | 154 kB 00:00 2024-09-22T08:11:56.762 INFO:teuthology.orchestra.run.smithi042.stdout:(47/286): python3-ply-3.11-14.el9.noarch.rpm 156 kB/s | 106 kB 00:00 2024-09-22T08:11:56.954 INFO:teuthology.orchestra.run.smithi042.stdout:(48/286): python3-cryptography-36.0.1-4.el9.x86 1.3 MB/s | 1.2 MB 00:00 2024-09-22T08:11:56.988 INFO:teuthology.orchestra.run.smithi038.stdout:(29/286): ceph-mgr-diskprediction-local-19.3.0- 20 MB/s | 7.4 MB 00:00 2024-09-22T08:11:57.055 INFO:teuthology.orchestra.run.smithi038.stdout:(30/286): ceph-mgr-modules-core-19.3.0-5106.g88 4.3 MB/s | 292 kB 00:00 2024-09-22T08:11:57.139 INFO:teuthology.orchestra.run.smithi038.stdout:(31/286): ceph-mgr-rook-19.3.0-5106.g8852379c.e 594 kB/s | 49 kB 00:00 2024-09-22T08:11:57.214 INFO:teuthology.orchestra.run.smithi038.stdout:(32/286): ceph-prometheus-alerts-19.3.0-5106.g8 219 kB/s | 16 kB 00:00 2024-09-22T08:11:57.312 INFO:teuthology.orchestra.run.smithi042.stdout:(49/286): python3-pycparser-2.20-6.el9.noarch.r 191 kB/s | 135 kB 00:00 2024-09-22T08:11:57.512 INFO:teuthology.orchestra.run.smithi042.stdout:(50/286): adwaita-cursor-theme-40.1.1-3.el9.noa 3.2 MB/s | 650 kB 00:00 2024-09-22T08:11:57.554 INFO:teuthology.orchestra.run.smithi042.stdout:(51/286): python3-requests-2.25.1-8.el9.noarch. 158 kB/s | 125 kB 00:00 2024-09-22T08:11:57.656 INFO:teuthology.orchestra.run.smithi038.stdout:(33/286): ceph-test-19.3.0-5106.g8852379c.el9.x 19 MB/s | 46 MB 00:02 2024-09-22T08:11:57.681 INFO:teuthology.orchestra.run.smithi038.stdout:(34/286): ceph-volume-19.3.0-5106.g8852379c.el9 610 kB/s | 285 kB 00:00 2024-09-22T08:11:57.723 INFO:teuthology.orchestra.run.smithi038.stdout:(35/286): cephadm-19.3.0-5106.g8852379c.el9.noa 12 MB/s | 784 kB 00:00 2024-09-22T08:11:57.788 INFO:teuthology.orchestra.run.smithi042.stdout:(52/286): adwaita-icon-theme-40.1.1-3.el9.noarc 43 MB/s | 12 MB 00:00 2024-09-22T08:11:57.813 INFO:teuthology.orchestra.run.smithi042.stdout:(53/286): python3-urllib3-1.26.5-6.el9.noarch.r 250 kB/s | 215 kB 00:00 2024-09-22T08:11:57.838 INFO:teuthology.orchestra.run.smithi042.stdout:(54/286): apache-commons-cli-1.4-17.el9.noarch. 1.4 MB/s | 71 kB 00:00 2024-09-22T08:11:57.874 INFO:teuthology.orchestra.run.smithi038.stdout:(36/286): ceph-mgr-dashboard-19.3.0-5106.g88523 11 MB/s | 14 MB 00:01 2024-09-22T08:11:57.905 INFO:teuthology.orchestra.run.smithi042.stdout:(55/286): apache-commons-io-2.8.0-8.el9.noarch. 4.2 MB/s | 283 kB 00:00 2024-09-22T08:11:57.931 INFO:teuthology.orchestra.run.smithi042.stdout:(56/286): alsa-lib-1.2.12-1.el9.x86_64.rpm 1.4 MB/s | 523 kB 00:00 2024-09-22T08:11:57.956 INFO:teuthology.orchestra.run.smithi042.stdout:(57/286): apache-commons-lang3-3.12.0-6.el9.noa 11 MB/s | 559 kB 00:00 2024-09-22T08:11:58.006 INFO:teuthology.orchestra.run.smithi042.stdout:(58/286): apache-commons-codec-1.15-7.el9.noarc 1.5 MB/s | 302 kB 00:00 2024-09-22T08:11:58.031 INFO:teuthology.orchestra.run.smithi042.stdout:(59/286): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 864 kB/s | 87 kB 00:00 2024-09-22T08:11:58.057 INFO:teuthology.orchestra.run.smithi042.stdout:(60/286): atinject-1.0.3-6.el9.noarch.rpm 463 kB/s | 23 kB 00:00 2024-09-22T08:11:58.090 INFO:teuthology.orchestra.run.smithi042.stdout:(61/286): at-spi2-core-2.40.3-1.el9.x86_64.rpm 1.4 MB/s | 195 kB 00:00 2024-09-22T08:11:58.115 INFO:teuthology.orchestra.run.smithi042.stdout:(62/286): avahi-glib-0.8-21.el9.x86_64.rpm 254 kB/s | 15 kB 00:00 2024-09-22T08:11:58.141 INFO:teuthology.orchestra.run.smithi042.stdout:(63/286): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-09-22T08:11:58.167 INFO:teuthology.orchestra.run.smithi042.stdout:(64/286): cdi-api-2.0.2-6.el9.noarch.rpm 1.0 MB/s | 53 kB 00:00 2024-09-22T08:11:58.192 INFO:teuthology.orchestra.run.smithi042.stdout:(65/286): atk-2.36.0-5.el9.x86_64.rpm 1.8 MB/s | 292 kB 00:00 2024-09-22T08:11:58.217 INFO:teuthology.orchestra.run.smithi042.stdout:(66/286): composefs-libs-1.0.5-1.el9.x86_64.rpm 1.2 MB/s | 61 kB 00:00 2024-09-22T08:11:58.242 INFO:teuthology.orchestra.run.smithi042.stdout:(67/286): copy-jdk-configs-4.0-3.el9.noarch.rpm 562 kB/s | 28 kB 00:00 2024-09-22T08:11:58.249 INFO:teuthology.orchestra.run.smithi038.stdout:(37/286): bluez-libs-5.56-6.el9.x86_64.rpm 161 kB/s | 85 kB 00:00 2024-09-22T08:11:58.267 INFO:teuthology.orchestra.run.smithi042.stdout:(68/286): colord-libs-1.4.5-4.el9.x86_64.rpm 1.8 MB/s | 229 kB 00:00 2024-09-22T08:11:58.274 INFO:teuthology.orchestra.run.smithi038.stdout:(38/286): bubblewrap-0.4.1-7.el9.x86_64.rpm 123 kB/s | 49 kB 00:00 2024-09-22T08:11:58.293 INFO:teuthology.orchestra.run.smithi042.stdout:(69/286): dconf-0.40.0-6.el9.x86_64.rpm 1.5 MB/s | 113 kB 00:00 2024-09-22T08:11:58.335 INFO:teuthology.orchestra.run.smithi042.stdout:(70/286): exiv2-0.27.5-2.el9.x86_64.rpm 14 MB/s | 980 kB 00:00 2024-09-22T08:11:58.377 INFO:teuthology.orchestra.run.smithi042.stdout:(71/286): exempi-2.6.0-0.2.20211007gite23c213.e 3.8 MB/s | 525 kB 00:00 2024-09-22T08:11:58.411 INFO:teuthology.orchestra.run.smithi042.stdout:(72/286): exiv2-libs-0.27.5-2.el9.x86_64.rpm 6.5 MB/s | 781 kB 00:00 2024-09-22T08:11:58.416 INFO:teuthology.orchestra.run.smithi038.stdout:(39/286): ModemManager-glib-1.20.2-1.el9.x86_64 456 kB/s | 335 kB 00:00 2024-09-22T08:11:58.436 INFO:teuthology.orchestra.run.smithi042.stdout:(73/286): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 3.2 MB/s | 325 kB 00:00 2024-09-22T08:11:58.469 INFO:teuthology.orchestra.run.smithi042.stdout:(74/286): flac-libs-1.3.3-12.el9.x86_64.rpm 2.3 MB/s | 218 kB 00:00 2024-09-22T08:11:58.474 INFO:teuthology.orchestra.run.smithi038.stdout:(40/286): fuse-2.9.9-16.el9.x86_64.rpm 399 kB/s | 80 kB 00:00 2024-09-22T08:11:58.494 INFO:teuthology.orchestra.run.smithi042.stdout:(75/286): flatpak-selinux-1.12.9-1.el9.noarch.r 368 kB/s | 22 kB 00:00 2024-09-22T08:11:58.520 INFO:teuthology.orchestra.run.smithi042.stdout:(76/286): flatpak-session-helper-1.12.9-1.el9.x 1.4 MB/s | 73 kB 00:00 2024-09-22T08:11:58.541 INFO:teuthology.orchestra.run.smithi038.stdout:(41/286): cups-libs-2.3.3op2-30.el9.x86_64.rpm 896 kB/s | 262 kB 00:00 2024-09-22T08:11:58.545 INFO:teuthology.orchestra.run.smithi042.stdout:(77/286): flexiblas-3.0.4-8.el9.x86_64.rpm 652 kB/s | 33 kB 00:00 2024-09-22T08:11:58.575 INFO:teuthology.orchestra.run.smithi038.stdout:(42/286): libpciaccess-0.16-7.el9.x86_64.rpm 268 kB/s | 27 kB 00:00 2024-09-22T08:11:58.587 INFO:teuthology.orchestra.run.smithi042.stdout:(78/286): flatpak-1.12.9-1.el9.x86_64.rpm 9.8 MB/s | 1.7 MB 00:00 2024-09-22T08:11:58.612 INFO:teuthology.orchestra.run.smithi042.stdout:(79/286): flexiblas-openblas-openmp-3.0.4-8.el9 272 kB/s | 18 kB 00:00 2024-09-22T08:11:58.638 INFO:teuthology.orchestra.run.smithi042.stdout:(80/286): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 1.7 MB/s | 89 kB 00:00 2024-09-22T08:11:58.663 INFO:teuthology.orchestra.run.smithi042.stdout:(81/286): geoclue2-2.6.0-7.el9.x86_64.rpm 2.4 MB/s | 124 kB 00:00 2024-09-22T08:11:58.667 INFO:teuthology.orchestra.run.smithi038.stdout:(43/286): libquadmath-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-09-22T08:11:58.688 INFO:teuthology.orchestra.run.smithi042.stdout:(82/286): giflib-5.2.1-9.el9.x86_64.rpm 966 kB/s | 49 kB 00:00 2024-09-22T08:11:58.692 INFO:teuthology.orchestra.run.smithi038.stdout:(44/286): lksctp-tools-1.0.19-2.el9.x86_64.rpm 804 kB/s | 94 kB 00:00 2024-09-22T08:11:58.713 INFO:teuthology.orchestra.run.smithi042.stdout:(83/286): google-guice-4.2.3-9.el9.noarch.rpm 9.3 MB/s | 473 kB 00:00 2024-09-22T08:11:58.734 INFO:teuthology.orchestra.run.smithi038.stdout:(45/286): libgfortran-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 801 kB 00:00 2024-09-22T08:11:58.739 INFO:teuthology.orchestra.run.smithi042.stdout:(84/286): graphene-1.10.6-2.el9.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2024-09-22T08:11:58.764 INFO:teuthology.orchestra.run.smithi042.stdout:(85/286): gsm-1.0.19-6.el9.x86_64.rpm 677 kB/s | 34 kB 00:00 2024-09-22T08:11:58.784 INFO:teuthology.orchestra.run.smithi038.stdout:(46/286): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-09-22T08:11:58.814 INFO:teuthology.orchestra.run.smithi042.stdout:(86/286): gstreamer1-1.22.1-2.el9.x86_64.rpm 19 MB/s | 1.4 MB 00:00 2024-09-22T08:11:58.843 INFO:teuthology.orchestra.run.smithi038.stdout:(47/286): python3-ply-3.11-14.el9.noarch.rpm 980 kB/s | 106 kB 00:00 2024-09-22T08:11:58.873 INFO:teuthology.orchestra.run.smithi042.stdout:(87/286): gstreamer1-plugins-base-1.22.1-2.el9. 21 MB/s | 2.2 MB 00:00 2024-09-22T08:11:58.898 INFO:teuthology.orchestra.run.smithi042.stdout:(88/286): gtk-update-icon-cache-3.24.31-5.el9.x 397 kB/s | 33 kB 00:00 2024-09-22T08:11:58.919 INFO:teuthology.orchestra.run.smithi038.stdout:(48/286): python3-pycparser-2.20-6.el9.noarch.r 1.0 MB/s | 135 kB 00:00 2024-09-22T08:11:58.952 INFO:teuthology.orchestra.run.smithi038.stdout:(49/286): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-09-22T08:11:58.957 INFO:teuthology.orchestra.run.smithi042.stdout:(89/286): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.8 MB/s | 3.0 MB 00:00 2024-09-22T08:11:59.007 INFO:teuthology.orchestra.run.smithi042.stdout:(90/286): guava-30.1-6.el9.noarch.rpm 21 MB/s | 2.3 MB 00:00 2024-09-22T08:11:59.036 INFO:teuthology.orchestra.run.smithi038.stdout:(50/286): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-09-22T08:11:59.049 INFO:teuthology.orchestra.run.smithi042.stdout:(91/286): hicolor-icon-theme-0.17-13.el9.noarch 2.3 MB/s | 219 kB 00:00 2024-09-22T08:11:59.092 INFO:teuthology.orchestra.run.smithi042.stdout:(92/286): httpcomponents-client-4.5.13-3.el9.no 7.7 MB/s | 657 kB 00:00 2024-09-22T08:11:59.167 INFO:teuthology.orchestra.run.smithi042.stdout:(93/286): gtk3-3.24.31-5.el9.x86_64.rpm 17 MB/s | 4.9 MB 00:00 2024-09-22T08:11:59.169 INFO:teuthology.orchestra.run.smithi038.stdout:(51/286): python3-cryptography-36.0.1-4.el9.x86 2.6 MB/s | 1.2 MB 00:00 2024-09-22T08:11:59.200 INFO:teuthology.orchestra.run.smithi042.stdout:(94/286): httpcomponents-core-4.4.13-7.el9.noar 4.1 MB/s | 632 kB 00:00 2024-09-22T08:11:59.203 INFO:teuthology.orchestra.run.smithi038.stdout:(52/286): adwaita-cursor-theme-40.1.1-3.el9.noa 2.5 MB/s | 650 kB 00:00 2024-09-22T08:11:59.226 INFO:teuthology.orchestra.run.smithi042.stdout:(95/286): jakarta-annotations-1.3.5-13.el9.noar 772 kB/s | 45 kB 00:00 2024-09-22T08:11:59.253 INFO:teuthology.orchestra.run.smithi038.stdout:(53/286): apache-commons-cli-1.4-17.el9.noarch. 1.4 MB/s | 71 kB 00:00 2024-09-22T08:11:59.259 INFO:teuthology.orchestra.run.smithi042.stdout:(96/286): jansi-2.3.3-6.el9.x86_64.rpm 1.8 MB/s | 110 kB 00:00 2024-09-22T08:11:59.293 INFO:teuthology.orchestra.run.smithi042.stdout:(97/286): java-11-openjdk-11.0.20.1.1-2.el9.x86 6.0 MB/s | 413 kB 00:00 2024-09-22T08:11:59.312 INFO:teuthology.orchestra.run.smithi038.stdout:(54/286): apache-commons-codec-1.15-7.el9.noarc 5.1 MB/s | 302 kB 00:00 2024-09-22T08:11:59.351 INFO:teuthology.orchestra.run.smithi042.stdout:(98/286): iso-codes-4.6.0-3.el9.noarch.rpm 14 MB/s | 3.5 MB 00:00 2024-09-22T08:11:59.370 INFO:teuthology.orchestra.run.smithi038.stdout:(55/286): apache-commons-io-2.8.0-8.el9.noarch. 4.8 MB/s | 283 kB 00:00 2024-09-22T08:11:59.393 INFO:teuthology.orchestra.run.smithi042.stdout:(99/286): javapackages-filesystem-6.0.0-4.el9.n 313 kB/s | 13 kB 00:00 2024-09-22T08:11:59.435 INFO:teuthology.orchestra.run.smithi042.stdout:(100/286): jbigkit-libs-2.1-23.el9.x86_64.rpm 1.2 MB/s | 53 kB 00:00 2024-09-22T08:11:59.446 INFO:teuthology.orchestra.run.smithi038.stdout:(56/286): alsa-lib-1.2.12-1.el9.x86_64.rpm 1.9 MB/s | 523 kB 00:00 2024-09-22T08:11:59.477 INFO:teuthology.orchestra.run.smithi042.stdout:(101/286): jcl-over-slf4j-1.7.30-13.el9.noarch. 579 kB/s | 24 kB 00:00 2024-09-22T08:11:59.479 INFO:teuthology.orchestra.run.smithi038.stdout:(57/286): apache-commons-lang3-3.12.0-6.el9.noa 5.0 MB/s | 559 kB 00:00 2024-09-22T08:11:59.505 INFO:teuthology.orchestra.run.smithi038.stdout:(58/286): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.5 MB/s | 87 kB 00:00 2024-09-22T08:11:59.536 INFO:teuthology.orchestra.run.smithi042.stdout:(102/286): jsoup-1.13.1-10.el9.noarch.rpm 6.3 MB/s | 377 kB 00:00 2024-09-22T08:11:59.538 INFO:teuthology.orchestra.run.smithi038.stdout:(59/286): at-spi2-core-2.40.3-1.el9.x86_64.rpm 3.3 MB/s | 195 kB 00:00 2024-09-22T08:11:59.564 INFO:teuthology.orchestra.run.smithi038.stdout:(60/286): atinject-1.0.3-6.el9.noarch.rpm 396 kB/s | 23 kB 00:00 2024-09-22T08:11:59.577 INFO:teuthology.orchestra.run.smithi042.stdout:(103/286): jsr-305-3.0.2-6.el9.noarch.rpm 860 kB/s | 35 kB 00:00 2024-09-22T08:11:59.606 INFO:teuthology.orchestra.run.smithi038.stdout:(61/286): atk-2.36.0-5.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-09-22T08:11:59.631 INFO:teuthology.orchestra.run.smithi038.stdout:(62/286): avahi-glib-0.8-21.el9.x86_64.rpm 223 kB/s | 15 kB 00:00 2024-09-22T08:11:59.653 INFO:teuthology.orchestra.run.smithi042.stdout:(104/286): java-11-openjdk-devel-11.0.20.1.1-2. 8.4 MB/s | 3.3 MB 00:00 2024-09-22T08:11:59.665 INFO:teuthology.orchestra.run.smithi038.stdout:(63/286): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-09-22T08:11:59.678 INFO:teuthology.orchestra.run.smithi042.stdout:(105/286): lcms2-2.12-3.el9.x86_64.rpm 1.6 MB/s | 168 kB 00:00 2024-09-22T08:11:59.690 INFO:teuthology.orchestra.run.smithi038.stdout:(64/286): cdi-api-2.0.2-6.el9.noarch.rpm 909 kB/s | 53 kB 00:00 2024-09-22T08:11:59.703 INFO:teuthology.orchestra.run.smithi042.stdout:(106/286): libX11-xcb-1.7.0-9.el9.x86_64.rpm 221 kB/s | 11 kB 00:00 2024-09-22T08:11:59.724 INFO:teuthology.orchestra.run.smithi038.stdout:(65/286): colord-libs-1.4.5-4.el9.x86_64.rpm 3.8 MB/s | 229 kB 00:00 2024-09-22T08:11:59.729 INFO:teuthology.orchestra.run.smithi042.stdout:(107/286): libXcomposite-0.4.5-7.el9.x86_64.rpm 482 kB/s | 24 kB 00:00 2024-09-22T08:11:59.749 INFO:teuthology.orchestra.run.smithi038.stdout:(66/286): composefs-libs-1.0.5-1.el9.x86_64.rpm 1.0 MB/s | 61 kB 00:00 2024-09-22T08:11:59.754 INFO:teuthology.orchestra.run.smithi042.stdout:(108/286): libXcursor-1.2.0-7.el9.x86_64.rpm 610 kB/s | 31 kB 00:00 2024-09-22T08:11:59.779 INFO:teuthology.orchestra.run.smithi042.stdout:(109/286): libXdamage-1.1.5-7.el9.x86_64.rpm 454 kB/s | 23 kB 00:00 2024-09-22T08:11:59.782 INFO:teuthology.orchestra.run.smithi038.stdout:(67/286): copy-jdk-configs-4.0-3.el9.noarch.rpm 484 kB/s | 28 kB 00:00 2024-09-22T08:11:59.804 INFO:teuthology.orchestra.run.smithi042.stdout:(110/286): libXfixes-5.0.3-16.el9.x86_64.rpm 394 kB/s | 20 kB 00:00 2024-09-22T08:11:59.808 INFO:teuthology.orchestra.run.smithi038.stdout:(68/286): dconf-0.40.0-6.el9.x86_64.rpm 1.9 MB/s | 113 kB 00:00 2024-09-22T08:11:59.830 INFO:teuthology.orchestra.run.smithi042.stdout:(111/286): libXi-1.7.10-8.el9.x86_64.rpm 790 kB/s | 40 kB 00:00 2024-09-22T08:11:59.850 INFO:teuthology.orchestra.run.smithi038.stdout:(69/286): exempi-2.6.0-0.2.20211007gite23c213.e 7.7 MB/s | 525 kB 00:00 2024-09-22T08:11:59.855 INFO:teuthology.orchestra.run.smithi042.stdout:(112/286): libXinerama-1.1.4-10.el9.x86_64.rpm 299 kB/s | 15 kB 00:00 2024-09-22T08:11:59.880 INFO:teuthology.orchestra.run.smithi042.stdout:(113/286): libXrandr-1.5.2-8.el9.x86_64.rpm 566 kB/s | 28 kB 00:00 2024-09-22T08:11:59.906 INFO:teuthology.orchestra.run.smithi042.stdout:(114/286): libXtst-1.2.3-16.el9.x86_64.rpm 428 kB/s | 21 kB 00:00 2024-09-22T08:11:59.931 INFO:teuthology.orchestra.run.smithi042.stdout:(115/286): libXv-1.0.11-16.el9.x86_64.rpm 380 kB/s | 19 kB 00:00 2024-09-22T08:11:59.957 INFO:teuthology.orchestra.run.smithi042.stdout:(116/286): libXxf86vm-1.1.4-18.el9.x86_64.rpm 375 kB/s | 19 kB 00:00 2024-09-22T08:11:59.975 INFO:teuthology.orchestra.run.smithi038.stdout:(70/286): adwaita-icon-theme-40.1.1-3.el9.noarc 13 MB/s | 12 MB 00:00 2024-09-22T08:11:59.990 INFO:teuthology.orchestra.run.smithi042.stdout:(117/286): libasyncns-0.8-22.el9.x86_64.rpm 519 kB/s | 30 kB 00:00 2024-09-22T08:12:00.015 INFO:teuthology.orchestra.run.smithi042.stdout:(118/286): libcanberra-0.30-27.el9.x86_64.rpm 1.4 MB/s | 86 kB 00:00 2024-09-22T08:12:00.017 INFO:teuthology.orchestra.run.smithi038.stdout:(71/286): exiv2-0.27.5-2.el9.x86_64.rpm 4.6 MB/s | 980 kB 00:00 2024-09-22T08:12:00.041 INFO:teuthology.orchestra.run.smithi042.stdout:(119/286): libcanberra-gtk3-0.30-27.el9.x86_64. 634 kB/s | 32 kB 00:00 2024-09-22T08:12:00.042 INFO:teuthology.orchestra.run.smithi038.stdout:(72/286): exiv2-libs-0.27.5-2.el9.x86_64.rpm 4.0 MB/s | 781 kB 00:00 2024-09-22T08:12:00.066 INFO:teuthology.orchestra.run.smithi042.stdout:(120/286): libdrm-2.4.121-1.el9.x86_64.rpm 3.1 MB/s | 161 kB 00:00 2024-09-22T08:12:00.067 INFO:teuthology.orchestra.run.smithi038.stdout:(73/286): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 3.5 MB/s | 325 kB 00:00 2024-09-22T08:12:00.109 INFO:teuthology.orchestra.run.smithi038.stdout:(74/286): flac-libs-1.3.3-12.el9.x86_64.rpm 2.3 MB/s | 218 kB 00:00 2024-09-22T08:12:00.117 INFO:teuthology.orchestra.run.smithi042.stdout:(121/286): libepoxy-1.5.5-4.el9.x86_64.rpm 3.1 MB/s | 241 kB 00:00 2024-09-22T08:12:00.135 INFO:teuthology.orchestra.run.smithi038.stdout:(75/286): flatpak-selinux-1.12.9-1.el9.noarch.r 323 kB/s | 22 kB 00:00 2024-09-22T08:12:00.150 INFO:teuthology.orchestra.run.smithi042.stdout:(122/286): libexif-0.6.22-6.el9.x86_64.rpm 5.1 MB/s | 435 kB 00:00 2024-09-22T08:12:00.160 INFO:teuthology.orchestra.run.smithi038.stdout:(76/286): flatpak-session-helper-1.12.9-1.el9.x 1.4 MB/s | 73 kB 00:00 2024-09-22T08:12:00.175 INFO:teuthology.orchestra.run.smithi042.stdout:(123/286): libfontenc-1.1.3-17.el9.x86_64.rpm 531 kB/s | 31 kB 00:00 2024-09-22T08:12:00.177 INFO:teuthology.orchestra.run.smithi038.stdout:(77/286): flexiblas-3.0.4-8.el9.x86_64.rpm 779 kB/s | 33 kB 00:00 2024-09-22T08:12:00.201 INFO:teuthology.orchestra.run.smithi042.stdout:(124/286): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2024-09-22T08:12:00.234 INFO:teuthology.orchestra.run.smithi042.stdout:(125/286): libglvnd-1.3.4-1.el9.x86_64.rpm 2.3 MB/s | 135 kB 00:00 2024-09-22T08:12:00.244 INFO:teuthology.orchestra.run.smithi038.stdout:(78/286): flatpak-1.12.9-1.el9.x86_64.rpm 8.5 MB/s | 1.7 MB 00:00 2024-09-22T08:12:00.260 INFO:teuthology.orchestra.run.smithi042.stdout:(126/286): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 625 kB/s | 37 kB 00:00 2024-09-22T08:12:00.269 INFO:teuthology.orchestra.run.smithi038.stdout:(79/286): flexiblas-openblas-openmp-3.0.4-8.el9 198 kB/s | 18 kB 00:00 2024-09-22T08:12:00.293 INFO:teuthology.orchestra.run.smithi042.stdout:(127/286): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 2.4 MB/s | 142 kB 00:00 2024-09-22T08:12:00.303 INFO:teuthology.orchestra.run.smithi038.stdout:(80/286): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 1.5 MB/s | 89 kB 00:00 2024-09-22T08:12:00.318 INFO:teuthology.orchestra.run.smithi042.stdout:(128/286): libgsf-1.14.47-5.el9.x86_64.rpm 4.3 MB/s | 256 kB 00:00 2024-09-22T08:12:00.328 INFO:teuthology.orchestra.run.smithi038.stdout:(81/286): geoclue2-2.6.0-7.el9.x86_64.rpm 2.1 MB/s | 124 kB 00:00 2024-09-22T08:12:00.344 INFO:teuthology.orchestra.run.smithi042.stdout:(129/286): libgxps-0.3.2-3.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-09-22T08:12:00.353 INFO:teuthology.orchestra.run.smithi038.stdout:(82/286): giflib-5.2.1-9.el9.x86_64.rpm 966 kB/s | 49 kB 00:00 2024-09-22T08:12:00.369 INFO:teuthology.orchestra.run.smithi042.stdout:(130/286): libiptcdata-1.0.5-10.el9.x86_64.rpm 1.2 MB/s | 61 kB 00:00 2024-09-22T08:12:00.387 INFO:teuthology.orchestra.run.smithi038.stdout:(83/286): google-guice-4.2.3-9.el9.noarch.rpm 7.9 MB/s | 473 kB 00:00 2024-09-22T08:12:00.395 INFO:teuthology.orchestra.run.smithi042.stdout:(131/286): libldac-2.0.2.3-10.el9.x86_64.rpm 824 kB/s | 41 kB 00:00 2024-09-22T08:12:00.412 INFO:teuthology.orchestra.run.smithi038.stdout:(84/286): graphene-1.10.6-2.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-22T08:12:00.420 INFO:teuthology.orchestra.run.smithi042.stdout:(132/286): libnbd-1.20.2-2.el9.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2024-09-22T08:12:00.445 INFO:teuthology.orchestra.run.smithi042.stdout:(133/286): libnotify-0.7.9-8.el9.x86_64.rpm 871 kB/s | 44 kB 00:00 2024-09-22T08:12:00.463 INFO:teuthology.orchestra.run.smithi038.stdout:(85/286): flexiblas-netlib-3.0.4-8.el9.x86_64.r 9.9 MB/s | 3.0 MB 00:00 2024-09-22T08:12:00.471 INFO:teuthology.orchestra.run.smithi042.stdout:(134/286): libogg-1.3.4-6.el9.x86_64.rpm 667 kB/s | 34 kB 00:00 2024-09-22T08:12:00.488 INFO:teuthology.orchestra.run.smithi038.stdout:(86/286): gsm-1.0.19-6.el9.x86_64.rpm 338 kB/s | 34 kB 00:00 2024-09-22T08:12:00.513 INFO:teuthology.orchestra.run.smithi042.stdout:(135/286): libosinfo-1.10.0-1.el9.x86_64.rpm 4.7 MB/s | 319 kB 00:00 2024-09-22T08:12:00.538 INFO:teuthology.orchestra.run.smithi042.stdout:(136/286): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-09-22T08:12:00.538 INFO:teuthology.orchestra.run.smithi038.stdout:(87/286): gtk-update-icon-cache-3.24.31-5.el9.x 663 kB/s | 33 kB 00:00 2024-09-22T08:12:00.563 INFO:teuthology.orchestra.run.smithi042.stdout:(137/286): librabbitmq-0.11.0-7.el9.x86_64.rpm 905 kB/s | 45 kB 00:00 2024-09-22T08:12:00.580 INFO:teuthology.orchestra.run.smithi038.stdout:(88/286): gstreamer1-1.22.1-2.el9.x86_64.rpm 8.5 MB/s | 1.4 MB 00:00 2024-09-22T08:12:00.597 INFO:teuthology.orchestra.run.smithi042.stdout:(138/286): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-22T08:12:00.622 INFO:teuthology.orchestra.run.smithi042.stdout:(139/286): libsbc-1.4-9.el9.x86_64.rpm 766 kB/s | 45 kB 00:00 2024-09-22T08:12:00.656 INFO:teuthology.orchestra.run.smithi042.stdout:(140/286): libsndfile-1.0.31-8.el9.x86_64.rpm 3.4 MB/s | 206 kB 00:00 2024-09-22T08:12:00.672 INFO:teuthology.orchestra.run.smithi038.stdout:(89/286): gstreamer1-plugins-base-1.22.1-2.el9. 11 MB/s | 2.2 MB 00:00 2024-09-22T08:12:00.681 INFO:teuthology.orchestra.run.smithi042.stdout:(141/286): libtheora-1.1.1-31.el9.x86_64.rpm 2.7 MB/s | 164 kB 00:00 2024-09-22T08:12:00.706 INFO:teuthology.orchestra.run.smithi042.stdout:(142/286): libtiff-4.4.0-13.el9.x86_64.rpm 3.9 MB/s | 198 kB 00:00 2024-09-22T08:12:00.732 INFO:teuthology.orchestra.run.smithi042.stdout:(143/286): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 711 kB/s | 36 kB 00:00 2024-09-22T08:12:00.747 INFO:teuthology.orchestra.run.smithi038.stdout:(90/286): hicolor-icon-theme-0.17-13.el9.noarch 2.9 MB/s | 219 kB 00:00 2024-09-22T08:12:00.757 INFO:teuthology.orchestra.run.smithi042.stdout:(144/286): libtracker-sparql-3.1.2-3.el9.x86_64 6.3 MB/s | 324 kB 00:00 2024-09-22T08:12:00.791 INFO:teuthology.orchestra.run.smithi042.stdout:(145/286): libvisual-0.4.0-34.el9.x86_64.rpm 2.4 MB/s | 144 kB 00:00 2024-09-22T08:12:00.816 INFO:teuthology.orchestra.run.smithi042.stdout:(146/286): libvorbis-1.3.7-5.el9.x86_64.rpm 3.2 MB/s | 193 kB 00:00 2024-09-22T08:12:00.841 INFO:teuthology.orchestra.run.smithi042.stdout:(147/286): libwayland-client-1.21.0-1.el9.x86_6 664 kB/s | 33 kB 00:00 2024-09-22T08:12:00.848 INFO:teuthology.orchestra.run.smithi038.stdout:(91/286): gtk3-3.24.31-5.el9.x86_64.rpm 16 MB/s | 4.9 MB 00:00 2024-09-22T08:12:00.867 INFO:teuthology.orchestra.run.smithi042.stdout:(148/286): libwayland-cursor-1.21.0-1.el9.x86_6 384 kB/s | 19 kB 00:00 2024-09-22T08:12:00.906 INFO:teuthology.orchestra.run.smithi038.stdout:(92/286): guava-30.1-6.el9.noarch.rpm 7.1 MB/s | 2.3 MB 00:00 2024-09-22T08:12:00.922 INFO:teuthology.orchestra.run.smithi042.stdout:(149/286): libwayland-egl-1.21.0-1.el9.x86_64.r 160 kB/s | 13 kB 00:00 2024-09-22T08:12:00.942 INFO:teuthology.orchestra.run.smithi042.stdout:(150/286): libwayland-server-1.21.0-1.el9.x86_6 555 kB/s | 42 kB 00:00 2024-09-22T08:12:00.948 INFO:teuthology.orchestra.run.smithi038.stdout:(93/286): httpcomponents-core-4.4.13-7.el9.noar 6.2 MB/s | 632 kB 00:00 2024-09-22T08:12:00.967 INFO:teuthology.orchestra.run.smithi042.stdout:(151/286): libwebp-1.2.0-8.el9.x86_64.rpm 6.0 MB/s | 277 kB 00:00 2024-09-22T08:12:00.982 INFO:teuthology.orchestra.run.smithi038.stdout:(94/286): httpcomponents-client-4.5.13-3.el9.no 2.7 MB/s | 657 kB 00:00 2024-09-22T08:12:01.001 INFO:teuthology.orchestra.run.smithi042.stdout:(152/286): libxkbcommon-1.0.3-4.el9.x86_64.rpm 2.2 MB/s | 133 kB 00:00 2024-09-22T08:12:01.007 INFO:teuthology.orchestra.run.smithi038.stdout:(95/286): jakarta-annotations-1.3.5-13.el9.noar 770 kB/s | 45 kB 00:00 2024-09-22T08:12:01.026 INFO:teuthology.orchestra.run.smithi042.stdout:(153/286): libxshmfence-1.3-10.el9.x86_64.rpm 215 kB/s | 13 kB 00:00 2024-09-22T08:12:01.041 INFO:teuthology.orchestra.run.smithi038.stdout:(96/286): jansi-2.3.3-6.el9.x86_64.rpm 1.8 MB/s | 110 kB 00:00 2024-09-22T08:12:01.060 INFO:teuthology.orchestra.run.smithi042.stdout:(154/286): low-memory-monitor-2.1-4.el9.x86_64. 613 kB/s | 36 kB 00:00 2024-09-22T08:12:01.066 INFO:teuthology.orchestra.run.smithi038.stdout:(97/286): java-11-openjdk-11.0.20.1.1-2.el9.x86 6.9 MB/s | 413 kB 00:00 2024-09-22T08:12:01.085 INFO:teuthology.orchestra.run.smithi042.stdout:(155/286): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-22T08:12:01.133 INFO:teuthology.orchestra.run.smithi038.stdout:(98/286): iso-codes-4.6.0-3.el9.noarch.rpm 16 MB/s | 3.5 MB 00:00 2024-09-22T08:12:01.192 INFO:teuthology.orchestra.run.smithi038.stdout:(99/286): javapackages-filesystem-6.0.0-4.el9.n 224 kB/s | 13 kB 00:00 2024-09-22T08:12:01.284 INFO:teuthology.orchestra.run.smithi038.stdout:(100/286): java-11-openjdk-devel-11.0.20.1.1-2. 14 MB/s | 3.3 MB 00:00 2024-09-22T08:12:01.309 INFO:teuthology.orchestra.run.smithi038.stdout:(101/286): jbigkit-libs-2.1-23.el9.x86_64.rpm 453 kB/s | 53 kB 00:00 2024-09-22T08:12:01.334 INFO:teuthology.orchestra.run.smithi038.stdout:(102/286): jcl-over-slf4j-1.7.30-13.el9.noarch. 479 kB/s | 24 kB 00:00 2024-09-22T08:12:01.376 INFO:teuthology.orchestra.run.smithi038.stdout:(103/286): jsoup-1.13.1-10.el9.noarch.rpm 5.5 MB/s | 377 kB 00:00 2024-09-22T08:12:01.401 INFO:teuthology.orchestra.run.smithi038.stdout:(104/286): jsr-305-3.0.2-6.el9.noarch.rpm 531 kB/s | 35 kB 00:00 2024-09-22T08:12:01.435 INFO:teuthology.orchestra.run.smithi038.stdout:(105/286): lcms2-2.12-3.el9.x86_64.rpm 2.8 MB/s | 168 kB 00:00 2024-09-22T08:12:01.444 INFO:teuthology.orchestra.run.smithi042.stdout:(156/286): java-11-openjdk-headless-11.0.20.1.1 18 MB/s | 39 MB 00:02 2024-09-22T08:12:01.452 INFO:teuthology.orchestra.run.smithi038.stdout:(106/286): libX11-xcb-1.7.0-9.el9.x86_64.rpm 220 kB/s | 11 kB 00:00 2024-09-22T08:12:01.469 INFO:teuthology.orchestra.run.smithi042.stdout:(157/286): lua-5.4.4-4.el9.x86_64.rpm 461 kB/s | 188 kB 00:00 2024-09-22T08:12:01.486 INFO:teuthology.orchestra.run.smithi038.stdout:(107/286): libXcomposite-0.4.5-7.el9.x86_64.rpm 481 kB/s | 24 kB 00:00 2024-09-22T08:12:01.494 INFO:teuthology.orchestra.run.smithi042.stdout:(158/286): maven-3.6.3-15.el9.noarch.rpm 355 kB/s | 18 kB 00:00 2024-09-22T08:12:01.511 INFO:teuthology.orchestra.run.smithi038.stdout:(108/286): libXcursor-1.2.0-7.el9.x86_64.rpm 524 kB/s | 31 kB 00:00 2024-09-22T08:12:01.520 INFO:teuthology.orchestra.run.smithi042.stdout:(159/286): lua-posix-35.0-8.el9.x86_64.rpm 348 kB/s | 151 kB 00:00 2024-09-22T08:12:01.545 INFO:teuthology.orchestra.run.smithi038.stdout:(109/286): libXdamage-1.1.5-7.el9.x86_64.rpm 392 kB/s | 23 kB 00:00 2024-09-22T08:12:01.545 INFO:teuthology.orchestra.run.smithi042.stdout:(160/286): maven-openjdk11-3.6.3-15.el9.noarch. 179 kB/s | 9.0 kB 00:00 2024-09-22T08:12:01.561 INFO:teuthology.orchestra.run.smithi038.stdout:(110/286): libXfixes-5.0.3-16.el9.x86_64.rpm 394 kB/s | 20 kB 00:00 2024-09-22T08:12:01.579 INFO:teuthology.orchestra.run.smithi042.stdout:(161/286): maven-resolver-1.6.1-10.el9.noarch.r 8.7 MB/s | 517 kB 00:00 2024-09-22T08:12:01.595 INFO:teuthology.orchestra.run.smithi038.stdout:(111/286): libXi-1.7.10-8.el9.x86_64.rpm 788 kB/s | 40 kB 00:00 2024-09-22T08:12:01.604 INFO:teuthology.orchestra.run.smithi042.stdout:(162/286): maven-shared-utils-3.3.4-3.el9.noarc 2.5 MB/s | 151 kB 00:00 2024-09-22T08:12:01.612 INFO:teuthology.orchestra.run.smithi038.stdout:(112/286): libXinerama-1.1.4-10.el9.x86_64.rpm 299 kB/s | 15 kB 00:00 2024-09-22T08:12:01.638 INFO:teuthology.orchestra.run.smithi042.stdout:(163/286): maven-wagon-3.4.2-7.el9.noarch.rpm 1.9 MB/s | 112 kB 00:00 2024-09-22T08:12:01.645 INFO:teuthology.orchestra.run.smithi038.stdout:(113/286): libXrandr-1.5.2-8.el9.x86_64.rpm 566 kB/s | 28 kB 00:00 2024-09-22T08:12:01.671 INFO:teuthology.orchestra.run.smithi038.stdout:(114/286): libXtst-1.2.3-16.el9.x86_64.rpm 367 kB/s | 21 kB 00:00 2024-09-22T08:12:01.680 INFO:teuthology.orchestra.run.smithi042.stdout:(164/286): maven-lib-3.6.3-15.el9.noarch.rpm 7.1 MB/s | 1.5 MB 00:00 2024-09-22T08:12:01.696 INFO:teuthology.orchestra.run.smithi038.stdout:(115/286): libXv-1.0.11-16.el9.x86_64.rpm 379 kB/s | 19 kB 00:00 2024-09-22T08:12:01.697 INFO:teuthology.orchestra.run.smithi042.stdout:(165/286): mesa-filesystem-24.1.2-3.el9.x86_64. 190 kB/s | 11 kB 00:00 2024-09-22T08:12:01.713 INFO:teuthology.orchestra.run.smithi038.stdout:(116/286): libXxf86vm-1.1.4-18.el9.x86_64.rpm 444 kB/s | 19 kB 00:00 2024-09-22T08:12:01.731 INFO:teuthology.orchestra.run.smithi042.stdout:(166/286): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 2.7 MB/s | 139 kB 00:00 2024-09-22T08:12:01.755 INFO:teuthology.orchestra.run.smithi038.stdout:(117/286): libasyncns-0.8-22.el9.x86_64.rpm 520 kB/s | 30 kB 00:00 2024-09-22T08:12:01.764 INFO:teuthology.orchestra.run.smithi042.stdout:(167/286): mesa-libGL-24.1.2-3.el9.x86_64.rpm 2.5 MB/s | 171 kB 00:00 2024-09-22T08:12:01.781 INFO:teuthology.orchestra.run.smithi038.stdout:(118/286): libcanberra-0.30-27.el9.x86_64.rpm 1.3 MB/s | 86 kB 00:00 2024-09-22T08:12:01.790 INFO:teuthology.orchestra.run.smithi042.stdout:(168/286): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 620 kB/s | 36 kB 00:00 2024-09-22T08:12:01.814 INFO:teuthology.orchestra.run.smithi038.stdout:(119/286): libcanberra-gtk3-0.30-27.el9.x86_64. 543 kB/s | 32 kB 00:00 2024-09-22T08:12:01.815 INFO:teuthology.orchestra.run.smithi042.stdout:(169/286): mesa-libglapi-24.1.2-3.el9.x86_64.rp 913 kB/s | 46 kB 00:00 2024-09-22T08:12:01.840 INFO:teuthology.orchestra.run.smithi038.stdout:(120/286): libdrm-2.4.121-1.el9.x86_64.rpm 2.7 MB/s | 161 kB 00:00 2024-09-22T08:12:01.840 INFO:teuthology.orchestra.run.smithi042.stdout:(170/286): mkfontscale-1.2.1-3.el9.x86_64.rpm 643 kB/s | 32 kB 00:00 2024-09-22T08:12:01.865 INFO:teuthology.orchestra.run.smithi042.stdout:(171/286): openblas-0.3.26-2.el9.x86_64.rpm 771 kB/s | 38 kB 00:00 2024-09-22T08:12:01.881 INFO:teuthology.orchestra.run.smithi038.stdout:(121/286): libepoxy-1.5.5-4.el9.x86_64.rpm 3.5 MB/s | 241 kB 00:00 2024-09-22T08:12:01.915 INFO:teuthology.orchestra.run.smithi038.stdout:(122/286): libexif-0.6.22-6.el9.x86_64.rpm 5.7 MB/s | 435 kB 00:00 2024-09-22T08:12:01.924 INFO:teuthology.orchestra.run.smithi042.stdout:(172/286): openjpeg2-2.4.0-7.el9.x86_64.rpm 2.7 MB/s | 163 kB 00:00 2024-09-22T08:12:01.940 INFO:teuthology.orchestra.run.smithi038.stdout:(123/286): libfontenc-1.1.3-17.el9.x86_64.rpm 530 kB/s | 31 kB 00:00 2024-09-22T08:12:01.974 INFO:teuthology.orchestra.run.smithi038.stdout:(124/286): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.4 MB/s | 83 kB 00:00 2024-09-22T08:12:01.999 INFO:teuthology.orchestra.run.smithi038.stdout:(125/286): libglvnd-1.3.4-1.el9.x86_64.rpm 2.3 MB/s | 135 kB 00:00 2024-09-22T08:12:02.008 INFO:teuthology.orchestra.run.smithi042.stdout:(173/286): openblas-openmp-0.3.26-2.el9.x86_64. 30 MB/s | 4.9 MB 00:00 2024-09-22T08:12:02.033 INFO:teuthology.orchestra.run.smithi038.stdout:(126/286): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 629 kB/s | 37 kB 00:00 2024-09-22T08:12:02.033 INFO:teuthology.orchestra.run.smithi042.stdout:(174/286): opus-1.3.1-10.el9.x86_64.rpm 1.8 MB/s | 200 kB 00:00 2024-09-22T08:12:02.058 INFO:teuthology.orchestra.run.smithi038.stdout:(127/286): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 2.4 MB/s | 142 kB 00:00 2024-09-22T08:12:02.059 INFO:teuthology.orchestra.run.smithi042.stdout:(175/286): orc-0.4.31-8.el9.x86_64.rpm 3.6 MB/s | 183 kB 00:00 2024-09-22T08:12:02.100 INFO:teuthology.orchestra.run.smithi038.stdout:(128/286): libgsf-1.14.47-5.el9.x86_64.rpm 3.7 MB/s | 256 kB 00:00 2024-09-22T08:12:02.125 INFO:teuthology.orchestra.run.smithi038.stdout:(129/286): libgxps-0.3.2-3.el9.x86_64.rpm 1.2 MB/s | 79 kB 00:00 2024-09-22T08:12:02.151 INFO:teuthology.orchestra.run.smithi038.stdout:(130/286): libiptcdata-1.0.5-10.el9.x86_64.rpm 1.2 MB/s | 61 kB 00:00 2024-09-22T08:12:02.159 INFO:teuthology.orchestra.run.smithi042.stdout:(176/286): mesa-dri-drivers-24.1.2-3.el9.x86_64 16 MB/s | 8.8 MB 00:00 2024-09-22T08:12:02.176 INFO:teuthology.orchestra.run.smithi038.stdout:(131/286): libldac-2.0.2.3-10.el9.x86_64.rpm 822 kB/s | 41 kB 00:00 2024-09-22T08:12:02.184 INFO:teuthology.orchestra.run.smithi042.stdout:(177/286): osinfo-db-tools-1.10.0-1.el9.x86_64. 588 kB/s | 74 kB 00:00 2024-09-22T08:12:02.209 INFO:teuthology.orchestra.run.smithi042.stdout:(178/286): osinfo-db-20240701-2.el9.noarch.rpm 3.0 MB/s | 531 kB 00:00 2024-09-22T08:12:02.210 INFO:teuthology.orchestra.run.smithi038.stdout:(132/286): libnbd-1.20.2-2.el9.x86_64.rpm 2.8 MB/s | 171 kB 00:00 2024-09-22T08:12:02.235 INFO:teuthology.orchestra.run.smithi038.stdout:(133/286): libnotify-0.7.9-8.el9.x86_64.rpm 744 kB/s | 44 kB 00:00 2024-09-22T08:12:02.243 INFO:teuthology.orchestra.run.smithi042.stdout:(179/286): ostree-libs-2024.7-2.el9.x86_64.rpm 5.5 MB/s | 468 kB 00:00 2024-09-22T08:12:02.268 INFO:teuthology.orchestra.run.smithi038.stdout:(134/286): libogg-1.3.4-6.el9.x86_64.rpm 575 kB/s | 34 kB 00:00 2024-09-22T08:12:02.269 INFO:teuthology.orchestra.run.smithi042.stdout:(180/286): pipewire-1.0.1-1.el9.x86_64.rpm 1.8 MB/s | 107 kB 00:00 2024-09-22T08:12:02.294 INFO:teuthology.orchestra.run.smithi042.stdout:(181/286): p11-kit-server-0.25.3-2.el9.x86_64.r 2.2 MB/s | 246 kB 00:00 2024-09-22T08:12:02.294 INFO:teuthology.orchestra.run.smithi038.stdout:(135/286): libosinfo-1.10.0-1.el9.x86_64.rpm 5.3 MB/s | 319 kB 00:00 2024-09-22T08:12:02.319 INFO:teuthology.orchestra.run.smithi042.stdout:(182/286): pipewire-jack-audio-connection-kit-1 182 kB/s | 9.1 kB 00:00 2024-09-22T08:12:02.327 INFO:teuthology.orchestra.run.smithi038.stdout:(136/286): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-22T08:12:02.344 INFO:teuthology.orchestra.run.smithi042.stdout:(183/286): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 569 kB/s | 57 kB 00:00 2024-09-22T08:12:02.353 INFO:teuthology.orchestra.run.smithi038.stdout:(137/286): librabbitmq-0.11.0-7.el9.x86_64.rpm 771 kB/s | 45 kB 00:00 2024-09-22T08:12:02.378 INFO:teuthology.orchestra.run.smithi042.stdout:(184/286): pipewire-jack-audio-connection-kit-l 1.6 MB/s | 135 kB 00:00 2024-09-22T08:12:02.395 INFO:teuthology.orchestra.run.smithi038.stdout:(138/286): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-09-22T08:12:02.411 INFO:teuthology.orchestra.run.smithi042.stdout:(185/286): pipewire-pulseaudio-1.0.1-1.el9.x86_ 2.8 MB/s | 192 kB 00:00 2024-09-22T08:12:02.420 INFO:teuthology.orchestra.run.smithi038.stdout:(139/286): libsbc-1.4-9.el9.x86_64.rpm 671 kB/s | 45 kB 00:00 2024-09-22T08:12:02.436 INFO:teuthology.orchestra.run.smithi042.stdout:(186/286): plexus-cipher-1.7-27.el9.noarch.rpm 442 kB/s | 26 kB 00:00 2024-09-22T08:12:02.462 INFO:teuthology.orchestra.run.smithi042.stdout:(187/286): plexus-classworlds-2.6.0-11.el9.noar 1.2 MB/s | 60 kB 00:00 2024-09-22T08:12:02.488 INFO:teuthology.orchestra.run.smithi042.stdout:(188/286): plexus-containers-component-annotati 366 kB/s | 18 kB 00:00 2024-09-22T08:12:02.513 INFO:teuthology.orchestra.run.smithi042.stdout:(189/286): plexus-interpolation-1.26-11.el9.noa 1.6 MB/s | 80 kB 00:00 2024-09-22T08:12:02.538 INFO:teuthology.orchestra.run.smithi042.stdout:(190/286): plexus-sec-dispatcher-1.4-37.el9.noa 668 kB/s | 34 kB 00:00 2024-09-22T08:12:02.563 INFO:teuthology.orchestra.run.smithi042.stdout:(191/286): plexus-utils-3.3.0-10.el9.noarch.rpm 4.9 MB/s | 254 kB 00:00 2024-09-22T08:12:02.605 INFO:teuthology.orchestra.run.smithi042.stdout:(192/286): poppler-21.01.0-21.el9.x86_64.rpm 16 MB/s | 1.1 MB 00:00 2024-09-22T08:12:02.647 INFO:teuthology.orchestra.run.smithi042.stdout:(193/286): pipewire-libs-1.0.1-1.el9.x86_64.rpm 5.9 MB/s | 1.9 MB 00:00 2024-09-22T08:12:02.672 INFO:teuthology.orchestra.run.smithi042.stdout:(194/286): poppler-glib-21.01.0-21.el9.x86_64.r 2.2 MB/s | 152 kB 00:00 2024-09-22T08:12:02.714 INFO:teuthology.orchestra.run.smithi042.stdout:(195/286): poppler-data-0.4.9-9.el9.noarch.rpm 12 MB/s | 1.9 MB 00:00 2024-09-22T08:12:02.739 INFO:teuthology.orchestra.run.smithi042.stdout:(196/286): publicsuffix-list-20210518-3.el9.noa 1.2 MB/s | 83 kB 00:00 2024-09-22T08:12:02.781 INFO:teuthology.orchestra.run.smithi042.stdout:(197/286): protobuf-3.14.0-13.el9.x86_64.rpm 7.5 MB/s | 1.0 MB 00:00 2024-09-22T08:12:02.804 INFO:teuthology.orchestra.run.smithi038.stdout:(140/286): java-11-openjdk-headless-11.0.20.1.1 22 MB/s | 39 MB 00:01 2024-09-22T08:12:02.815 INFO:teuthology.orchestra.run.smithi042.stdout:(198/286): pulseaudio-libs-15.0-2.el9.x86_64.rp 6.6 MB/s | 679 kB 00:00 2024-09-22T08:12:02.829 INFO:teuthology.orchestra.run.smithi038.stdout:(141/286): libtheora-1.1.1-31.el9.x86_64.rpm 401 kB/s | 164 kB 00:00 2024-09-22T08:12:02.840 INFO:teuthology.orchestra.run.smithi042.stdout:(199/286): python3-devel-3.9.19-8.el9.x86_64.rp 4.1 MB/s | 245 kB 00:00 2024-09-22T08:12:02.863 INFO:teuthology.orchestra.run.smithi038.stdout:(142/286): libsndfile-1.0.31-8.el9.x86_64.rpm 442 kB/s | 206 kB 00:00 2024-09-22T08:12:02.865 INFO:teuthology.orchestra.run.smithi042.stdout:(200/286): python3-jinja2-2.11.3-6.el9.noarch.r 4.8 MB/s | 248 kB 00:00 2024-09-22T08:12:02.882 INFO:teuthology.orchestra.run.smithi042.stdout:(201/286): python3-jsonpatch-1.21-16.el9.noarch 614 kB/s | 26 kB 00:00 2024-09-22T08:12:02.888 INFO:teuthology.orchestra.run.smithi038.stdout:(143/286): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 606 kB/s | 36 kB 00:00 2024-09-22T08:12:02.899 INFO:teuthology.orchestra.run.smithi042.stdout:(202/286): python3-jsonpointer-2.0-4.el9.noarch 574 kB/s | 19 kB 00:00 2024-09-22T08:12:02.914 INFO:teuthology.orchestra.run.smithi038.stdout:(144/286): libtiff-4.4.0-13.el9.x86_64.rpm 1.8 MB/s | 198 kB 00:00 2024-09-22T08:12:02.939 INFO:teuthology.orchestra.run.smithi038.stdout:(145/286): libtracker-sparql-3.1.2-3.el9.x86_64 4.2 MB/s | 324 kB 00:00 2024-09-22T08:12:02.941 INFO:teuthology.orchestra.run.smithi042.stdout:(203/286): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-22T08:12:02.958 INFO:teuthology.orchestra.run.smithi042.stdout:(204/286): python3-markupsafe-1.1.1-12.el9.x86_ 593 kB/s | 35 kB 00:00 2024-09-22T08:12:02.964 INFO:teuthology.orchestra.run.smithi038.stdout:(146/286): libvisual-0.4.0-34.el9.x86_64.rpm 1.9 MB/s | 144 kB 00:00 2024-09-22T08:12:02.997 INFO:teuthology.orchestra.run.smithi038.stdout:(147/286): libvorbis-1.3.7-5.el9.x86_64.rpm 2.3 MB/s | 193 kB 00:00 2024-09-22T08:12:03.014 INFO:teuthology.orchestra.run.smithi038.stdout:(148/286): libwayland-cursor-1.21.0-1.el9.x86_6 388 kB/s | 19 kB 00:00 2024-09-22T08:12:03.040 INFO:teuthology.orchestra.run.smithi038.stdout:(149/286): libwayland-client-1.21.0-1.el9.x86_6 331 kB/s | 33 kB 00:00 2024-09-22T08:12:03.042 INFO:teuthology.orchestra.run.smithi042.stdout:(205/286): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 6.0 MB 00:00 2024-09-22T08:12:03.057 INFO:teuthology.orchestra.run.smithi038.stdout:(150/286): libwayland-egl-1.21.0-1.el9.x86_64.r 218 kB/s | 13 kB 00:00 2024-09-22T08:12:03.067 INFO:teuthology.orchestra.run.smithi042.stdout:(206/286): python3-numpy-f2py-1.20.1-5.el9.x86_ 2.3 MB/s | 250 kB 00:00 2024-09-22T08:12:03.073 INFO:teuthology.orchestra.run.smithi038.stdout:(151/286): libwayland-server-1.21.0-1.el9.x86_6 710 kB/s | 42 kB 00:00 2024-09-22T08:12:03.093 INFO:teuthology.orchestra.run.smithi042.stdout:(207/286): python3-oauthlib-3.1.1-5.el9.noarch. 4.3 MB/s | 222 kB 00:00 2024-09-22T08:12:03.099 INFO:teuthology.orchestra.run.smithi038.stdout:(152/286): libwebp-1.2.0-8.el9.x86_64.rpm 4.6 MB/s | 277 kB 00:00 2024-09-22T08:12:03.118 INFO:teuthology.orchestra.run.smithi042.stdout:(208/286): python3-packaging-20.9-5.el9.noarch. 1.5 MB/s | 77 kB 00:00 2024-09-22T08:12:03.124 INFO:teuthology.orchestra.run.smithi038.stdout:(153/286): libxkbcommon-1.0.3-4.el9.x86_64.rpm 1.9 MB/s | 133 kB 00:00 2024-09-22T08:12:03.149 INFO:teuthology.orchestra.run.smithi038.stdout:(154/286): libxshmfence-1.3-10.el9.x86_64.rpm 167 kB/s | 13 kB 00:00 2024-09-22T08:12:03.152 INFO:teuthology.orchestra.run.smithi042.stdout:(209/286): python3-prettytable-0.7.2-27.el9.noa 720 kB/s | 42 kB 00:00 2024-09-22T08:12:03.177 INFO:teuthology.orchestra.run.smithi042.stdout:(210/286): python3-protobuf-3.14.0-13.el9.noarc 4.5 MB/s | 269 kB 00:00 2024-09-22T08:12:03.183 INFO:teuthology.orchestra.run.smithi038.stdout:(155/286): low-memory-monitor-2.1-4.el9.x86_64. 427 kB/s | 36 kB 00:00 2024-09-22T08:12:03.202 INFO:teuthology.orchestra.run.smithi042.stdout:(211/286): python3-pyasn1-0.4.8-6.el9.noarch.rp 3.1 MB/s | 159 kB 00:00 2024-09-22T08:12:03.208 INFO:teuthology.orchestra.run.smithi038.stdout:(156/286): lua-5.4.4-4.el9.x86_64.rpm 3.2 MB/s | 188 kB 00:00 2024-09-22T08:12:03.227 INFO:teuthology.orchestra.run.smithi042.stdout:(212/286): python3-pyasn1-modules-0.4.8-6.el9.n 5.4 MB/s | 279 kB 00:00 2024-09-22T08:12:03.242 INFO:teuthology.orchestra.run.smithi038.stdout:(157/286): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-22T08:12:03.244 INFO:teuthology.orchestra.run.smithi042.stdout:(213/286): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-22T08:12:03.261 INFO:teuthology.orchestra.run.smithi042.stdout:(214/286): python3-requests-oauthlib-1.3.0-12.e 1.6 MB/s | 54 kB 00:00 2024-09-22T08:12:03.267 INFO:teuthology.orchestra.run.smithi038.stdout:(158/286): maven-3.6.3-15.el9.noarch.rpm 302 kB/s | 18 kB 00:00 2024-09-22T08:12:03.292 INFO:teuthology.orchestra.run.smithi038.stdout:(159/286): lua-posix-35.0-8.el9.x86_64.rpm 1.4 MB/s | 151 kB 00:00 2024-09-22T08:12:03.317 INFO:teuthology.orchestra.run.smithi038.stdout:(160/286): maven-openjdk11-3.6.3-15.el9.noarch. 179 kB/s | 9.0 kB 00:00 2024-09-22T08:12:03.345 INFO:teuthology.orchestra.run.smithi042.stdout:(215/286): python3-numpy-1.20.1-5.el9.x86_64.rp 13 MB/s | 5.1 MB 00:00 2024-09-22T08:12:03.359 INFO:teuthology.orchestra.run.smithi038.stdout:(161/286): maven-resolver-1.6.1-10.el9.noarch.r 7.6 MB/s | 517 kB 00:00 2024-09-22T08:12:03.362 INFO:teuthology.orchestra.run.smithi042.stdout:(216/286): python3-toml-0.10.2-6.el9.noarch.rpm 416 kB/s | 42 kB 00:00 2024-09-22T08:12:03.402 INFO:teuthology.orchestra.run.smithi038.stdout:(162/286): maven-lib-3.6.3-15.el9.noarch.rpm 9.3 MB/s | 1.5 MB 00:00 2024-09-22T08:12:03.404 INFO:teuthology.orchestra.run.smithi042.stdout:(217/286): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-22T08:12:03.420 INFO:teuthology.orchestra.run.smithi042.stdout:(218/286): qatlib-service-24.02.0-1.el9.x86_64. 612 kB/s | 36 kB 00:00 2024-09-22T08:12:03.427 INFO:teuthology.orchestra.run.smithi038.stdout:(163/286): maven-shared-utils-3.3.4-3.el9.noarc 1.4 MB/s | 151 kB 00:00 2024-09-22T08:12:03.446 INFO:teuthology.orchestra.run.smithi042.stdout:(219/286): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-22T08:12:03.498 INFO:teuthology.orchestra.run.smithi038.stdout:(164/286): maven-wagon-3.4.2-7.el9.noarch.rpm 1.1 MB/s | 112 kB 00:00 2024-09-22T08:12:03.498 INFO:teuthology.orchestra.run.smithi042.stdout:(220/286): rtkit-0.11-29.el9.x86_64.rpm 1.3 MB/s | 56 kB 00:00 2024-09-22T08:12:03.505 INFO:teuthology.orchestra.run.smithi042.stdout:(221/286): slf4j-1.7.30-13.el9.noarch.rpm 1.6 MB/s | 69 kB 00:00 2024-09-22T08:12:03.530 INFO:teuthology.orchestra.run.smithi042.stdout:(222/286): sisu-0.3.4-10.el9.noarch.rpm 5.9 MB/s | 510 kB 00:00 2024-09-22T08:12:03.536 INFO:teuthology.orchestra.run.smithi038.stdout:(165/286): mesa-filesystem-24.1.2-3.el9.x86_64. 150 kB/s | 11 kB 00:00 2024-09-22T08:12:03.555 INFO:teuthology.orchestra.run.smithi042.stdout:(223/286): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-22T08:12:03.586 INFO:teuthology.orchestra.run.smithi038.stdout:(166/286): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 1.1 MB/s | 139 kB 00:00 2024-09-22T08:12:03.606 INFO:teuthology.orchestra.run.smithi042.stdout:(224/286): sound-theme-freedesktop-0.8-17.el9.n 5.0 MB/s | 383 kB 00:00 2024-09-22T08:12:03.612 INFO:teuthology.orchestra.run.smithi038.stdout:(167/286): mesa-libGL-24.1.2-3.el9.x86_64.rpm 2.2 MB/s | 171 kB 00:00 2024-09-22T08:12:03.631 INFO:teuthology.orchestra.run.smithi042.stdout:(225/286): totem-pl-parser-3.26.6-2.el9.x86_64. 2.0 MB/s | 152 kB 00:00 2024-09-22T08:12:03.637 INFO:teuthology.orchestra.run.smithi038.stdout:(168/286): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 721 kB/s | 36 kB 00:00 2024-09-22T08:12:03.662 INFO:teuthology.orchestra.run.smithi038.stdout:(169/286): mesa-libglapi-24.1.2-3.el9.x86_64.rp 911 kB/s | 46 kB 00:00 2024-09-22T08:12:03.687 INFO:teuthology.orchestra.run.smithi038.stdout:(170/286): mkfontscale-1.2.1-3.el9.x86_64.rpm 642 kB/s | 32 kB 00:00 2024-09-22T08:12:03.713 INFO:teuthology.orchestra.run.smithi038.stdout:(171/286): openblas-0.3.26-2.el9.x86_64.rpm 768 kB/s | 38 kB 00:00 2024-09-22T08:12:03.772 INFO:teuthology.orchestra.run.smithi038.stdout:(172/286): openjpeg2-2.4.0-7.el9.x86_64.rpm 2.7 MB/s | 163 kB 00:00 2024-09-22T08:12:03.798 INFO:teuthology.orchestra.run.smithi042.stdout:(226/286): python3-scipy-1.6.2-8.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-09-22T08:12:03.823 INFO:teuthology.orchestra.run.smithi042.stdout:(227/286): tracker-3.1.2-3.el9.x86_64.rpm 2.5 MB/s | 555 kB 00:00 2024-09-22T08:12:03.849 INFO:teuthology.orchestra.run.smithi042.stdout:(228/286): ttmkfdir-3.0.9-65.el9.x86_64.rpm 1.0 MB/s | 53 kB 00:00 2024-09-22T08:12:03.872 INFO:teuthology.orchestra.run.smithi038.stdout:(173/286): mesa-dri-drivers-24.1.2-3.el9.x86_64 19 MB/s | 8.8 MB 00:00 2024-09-22T08:12:03.891 INFO:teuthology.orchestra.run.smithi042.stdout:(229/286): tracker-miners-3.1.2-4.el9.x86_64.rp 3.6 MB/s | 944 kB 00:00 2024-09-22T08:12:03.897 INFO:teuthology.orchestra.run.smithi038.stdout:(174/286): opus-1.3.1-10.el9.x86_64.rpm 1.6 MB/s | 200 kB 00:00 2024-09-22T08:12:03.916 INFO:teuthology.orchestra.run.smithi042.stdout:(230/286): tzdata-java-2024a-2.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-09-22T08:12:03.931 INFO:teuthology.orchestra.run.smithi038.stdout:(175/286): orc-0.4.31-8.el9.x86_64.rpm 3.1 MB/s | 183 kB 00:00 2024-09-22T08:12:03.941 INFO:teuthology.orchestra.run.smithi042.stdout:(231/286): upower-0.99.11-11.el9.x86_64.rpm 1.8 MB/s | 173 kB 00:00 2024-09-22T08:12:03.966 INFO:teuthology.orchestra.run.smithi042.stdout:(232/286): wireplumber-0.4.14-1.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-09-22T08:12:03.973 INFO:teuthology.orchestra.run.smithi038.stdout:(176/286): osinfo-db-20240701-2.el9.noarch.rpm 6.9 MB/s | 531 kB 00:00 2024-09-22T08:12:03.998 INFO:teuthology.orchestra.run.smithi038.stdout:(177/286): osinfo-db-tools-1.10.0-1.el9.x86_64. 1.1 MB/s | 74 kB 00:00 2024-09-22T08:12:04.000 INFO:teuthology.orchestra.run.smithi042.stdout:(233/286): webrtc-audio-processing-0.3.1-8.el9. 2.7 MB/s | 306 kB 00:00 2024-09-22T08:12:04.025 INFO:teuthology.orchestra.run.smithi042.stdout:(234/286): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 726 kB/s | 42 kB 00:00 2024-09-22T08:12:04.050 INFO:teuthology.orchestra.run.smithi042.stdout:(235/286): wireplumber-libs-0.4.14-1.el9.x86_64 3.2 MB/s | 358 kB 00:00 2024-09-22T08:12:04.074 INFO:teuthology.orchestra.run.smithi038.stdout:(178/286): openblas-openmp-0.3.26-2.el9.x86_64. 13 MB/s | 4.9 MB 00:00 2024-09-22T08:12:04.076 INFO:teuthology.orchestra.run.smithi042.stdout:(236/286): xdg-desktop-portal-1.12.6-1.el9.x86_ 5.0 MB/s | 385 kB 00:00 2024-09-22T08:12:04.099 INFO:teuthology.orchestra.run.smithi038.stdout:(179/286): ostree-libs-2024.7-2.el9.x86_64.rpm 3.6 MB/s | 468 kB 00:00 2024-09-22T08:12:04.101 INFO:teuthology.orchestra.run.smithi042.stdout:(237/286): xdg-desktop-portal-gtk-1.12.0-3.el9. 1.7 MB/s | 134 kB 00:00 2024-09-22T08:12:04.124 INFO:teuthology.orchestra.run.smithi038.stdout:(180/286): p11-kit-server-0.25.3-2.el9.x86_64.r 1.9 MB/s | 246 kB 00:00 2024-09-22T08:12:04.127 INFO:teuthology.orchestra.run.smithi042.stdout:(238/286): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-22T08:12:04.149 INFO:teuthology.orchestra.run.smithi038.stdout:(181/286): pipewire-1.0.1-1.el9.x86_64.rpm 1.4 MB/s | 107 kB 00:00 2024-09-22T08:12:04.169 INFO:teuthology.orchestra.run.smithi042.stdout:(239/286): xorg-x11-fonts-Type1-7.5-33.el9.noar 7.3 MB/s | 505 kB 00:00 2024-09-22T08:12:04.174 INFO:teuthology.orchestra.run.smithi038.stdout:(182/286): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 758 kB/s | 57 kB 00:00 2024-09-22T08:12:04.194 INFO:teuthology.orchestra.run.smithi042.stdout:(240/286): xkeyboard-config-2.33-2.el9.noarch.r 5.9 MB/s | 859 kB 00:00 2024-09-22T08:12:04.200 INFO:teuthology.orchestra.run.smithi038.stdout:(183/286): pipewire-jack-audio-connection-kit-1 121 kB/s | 9.1 kB 00:00 2024-09-22T08:12:04.225 INFO:teuthology.orchestra.run.smithi038.stdout:(184/286): pipewire-jack-audio-connection-kit-l 1.7 MB/s | 135 kB 00:00 2024-09-22T08:12:04.252 INFO:teuthology.orchestra.run.smithi042.stdout:(241/286): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-22T08:12:04.259 INFO:teuthology.orchestra.run.smithi038.stdout:(185/286): pipewire-pulseaudio-1.0.1-1.el9.x86_ 3.2 MB/s | 192 kB 00:00 2024-09-22T08:12:04.278 INFO:teuthology.orchestra.run.smithi042.stdout:(242/286): gperftools-libs-2.9.1-3.el9.x86_64.r 12 MB/s | 308 kB 00:00 2024-09-22T08:12:04.284 INFO:teuthology.orchestra.run.smithi038.stdout:(186/286): plexus-cipher-1.7-27.el9.noarch.rpm 440 kB/s | 26 kB 00:00 2024-09-22T08:12:04.303 INFO:teuthology.orchestra.run.smithi042.stdout:(243/286): grpc-data-1.46.7-10.el9.noarch.rpm 781 kB/s | 19 kB 00:00 2024-09-22T08:12:04.309 INFO:teuthology.orchestra.run.smithi038.stdout:(187/286): plexus-classworlds-2.6.0-11.el9.noar 1.2 MB/s | 60 kB 00:00 2024-09-22T08:12:04.351 INFO:teuthology.orchestra.run.smithi038.stdout:(188/286): pipewire-libs-1.0.1-1.el9.x86_64.rpm 11 MB/s | 1.9 MB 00:00 2024-09-22T08:12:04.377 INFO:teuthology.orchestra.run.smithi038.stdout:(189/286): plexus-containers-component-annotati 199 kB/s | 18 kB 00:00 2024-09-22T08:12:04.402 INFO:teuthology.orchestra.run.smithi038.stdout:(190/286): plexus-interpolation-1.26-11.el9.noa 865 kB/s | 80 kB 00:00 2024-09-22T08:12:04.411 INFO:teuthology.orchestra.run.smithi042.stdout:(244/286): libarrow-9.0.0-11.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-09-22T08:12:04.427 INFO:teuthology.orchestra.run.smithi038.stdout:(191/286): plexus-sec-dispatcher-1.4-37.el9.noa 445 kB/s | 34 kB 00:00 2024-09-22T08:12:04.437 INFO:teuthology.orchestra.run.smithi042.stdout:(245/286): lua-devel-5.4.4-4.el9.x86_64.rpm 72 kB/s | 22 kB 00:00 2024-09-22T08:12:04.452 INFO:teuthology.orchestra.run.smithi038.stdout:(192/286): plexus-utils-3.3.0-10.el9.noarch.rpm 3.3 MB/s | 254 kB 00:00 2024-09-22T08:12:04.462 INFO:teuthology.orchestra.run.smithi042.stdout:(246/286): libarrow-doc-9.0.0-11.el9.noarch.rpm 517 kB/s | 26 kB 00:00 2024-09-22T08:12:04.494 INFO:teuthology.orchestra.run.smithi038.stdout:(193/286): poppler-21.01.0-21.el9.x86_64.rpm 12 MB/s | 1.1 MB 00:00 2024-09-22T08:12:04.496 INFO:teuthology.orchestra.run.smithi042.stdout:(247/286): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-22T08:12:04.519 INFO:teuthology.orchestra.run.smithi038.stdout:(194/286): poppler-glib-21.01.0-21.el9.x86_64.r 2.2 MB/s | 152 kB 00:00 2024-09-22T08:12:04.521 INFO:teuthology.orchestra.run.smithi042.stdout:(248/286): luarocks-3.9.2-5.el9.noarch.rpm 6.5 MB/s | 151 kB 00:00 2024-09-22T08:12:04.546 INFO:teuthology.orchestra.run.smithi042.stdout:(249/286): liboath-2.6.7-2.el9.x86_64.rpm 445 kB/s | 49 kB 00:00 2024-09-22T08:12:04.570 INFO:teuthology.orchestra.run.smithi038.stdout:(195/286): poppler-data-0.4.9-9.el9.noarch.rpm 13 MB/s | 1.9 MB 00:00 2024-09-22T08:12:04.588 INFO:teuthology.orchestra.run.smithi042.stdout:(250/286): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-22T08:12:04.595 INFO:teuthology.orchestra.run.smithi038.stdout:(196/286): publicsuffix-list-20210518-3.el9.noa 1.1 MB/s | 83 kB 00:00 2024-09-22T08:12:04.614 INFO:teuthology.orchestra.run.smithi042.stdout:(251/286): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-22T08:12:04.629 INFO:teuthology.orchestra.run.smithi038.stdout:(197/286): protobuf-3.14.0-13.el9.x86_64.rpm 7.5 MB/s | 1.0 MB 00:00 2024-09-22T08:12:04.639 INFO:teuthology.orchestra.run.smithi042.stdout:(252/286): python3-asyncssh-2.13.2-5.el9.noarch 5.8 MB/s | 548 kB 00:00 2024-09-22T08:12:04.664 INFO:teuthology.orchestra.run.smithi042.stdout:(253/286): python3-cachetools-4.2.4-1.el9.noarc 642 kB/s | 32 kB 00:00 2024-09-22T08:12:04.670 INFO:teuthology.orchestra.run.smithi038.stdout:(198/286): pulseaudio-libs-15.0-2.el9.x86_64.rp 6.6 MB/s | 679 kB 00:00 2024-09-22T08:12:04.689 INFO:teuthology.orchestra.run.smithi042.stdout:(254/286): python3-certifi-2023.05.07-4.el9.noa 282 kB/s | 14 kB 00:00 2024-09-22T08:12:04.696 INFO:teuthology.orchestra.run.smithi038.stdout:(199/286): python3-devel-3.9.19-8.el9.x86_64.rp 3.6 MB/s | 245 kB 00:00 2024-09-22T08:12:04.715 INFO:teuthology.orchestra.run.smithi042.stdout:(255/286): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-22T08:12:04.730 INFO:teuthology.orchestra.run.smithi038.stdout:(200/286): python3-jinja2-2.11.3-6.el9.noarch.r 4.1 MB/s | 248 kB 00:00 2024-09-22T08:12:04.755 INFO:teuthology.orchestra.run.smithi038.stdout:(201/286): python3-jsonpatch-1.21-16.el9.noarch 438 kB/s | 26 kB 00:00 2024-09-22T08:12:04.773 INFO:teuthology.orchestra.run.smithi042.stdout:(256/286): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-22T08:12:04.780 INFO:teuthology.orchestra.run.smithi038.stdout:(202/286): python3-jsonpointer-2.0-4.el9.noarch 382 kB/s | 19 kB 00:00 2024-09-22T08:12:04.798 INFO:teuthology.orchestra.run.smithi042.stdout:(257/286): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-09-22T08:12:04.814 INFO:teuthology.orchestra.run.smithi038.stdout:(203/286): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-22T08:12:04.832 INFO:teuthology.orchestra.run.smithi042.stdout:(258/286): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-22T08:12:04.839 INFO:teuthology.orchestra.run.smithi038.stdout:(204/286): python3-markupsafe-1.1.1-12.el9.x86_ 594 kB/s | 35 kB 00:00 2024-09-22T08:12:04.857 INFO:teuthology.orchestra.run.smithi042.stdout:(259/286): python3-jaraco-8.2.1-3.el9.noarch.rp 432 kB/s | 11 kB 00:00 2024-09-22T08:12:04.883 INFO:teuthology.orchestra.run.smithi042.stdout:(260/286): python3-jaraco-classes-3.2.1-5.el9.n 705 kB/s | 18 kB 00:00 2024-09-22T08:12:04.908 INFO:teuthology.orchestra.run.smithi042.stdout:(261/286): python3-jaraco-collections-3.0.0-8.e 934 kB/s | 23 kB 00:00 2024-09-22T08:12:04.923 INFO:teuthology.orchestra.run.smithi038.stdout:(205/286): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 6.0 MB 00:00 2024-09-22T08:12:04.933 INFO:teuthology.orchestra.run.smithi042.stdout:(262/286): python3-jaraco-functools-3.5.0-2.el9 778 kB/s | 19 kB 00:00 2024-09-22T08:12:04.948 INFO:teuthology.orchestra.run.smithi038.stdout:(206/286): python3-numpy-f2py-1.20.1-5.el9.x86_ 2.2 MB/s | 250 kB 00:00 2024-09-22T08:12:04.958 INFO:teuthology.orchestra.run.smithi042.stdout:(263/286): python3-jaraco-text-3.2.0-6.el9.noar 786 kB/s | 20 kB 00:00 2024-09-22T08:12:04.982 INFO:teuthology.orchestra.run.smithi038.stdout:(207/286): python3-oauthlib-3.1.1-5.el9.noarch. 3.7 MB/s | 222 kB 00:00 2024-09-22T08:12:05.009 INFO:teuthology.orchestra.run.smithi042.stdout:(264/286): python3-grpcio-1.46.7-10.el9.x86_64. 8.7 MB/s | 2.0 MB 00:00 2024-09-22T08:12:05.015 INFO:teuthology.orchestra.run.smithi038.stdout:(208/286): python3-packaging-20.9-5.el9.noarch. 1.1 MB/s | 77 kB 00:00 2024-09-22T08:12:05.034 INFO:teuthology.orchestra.run.smithi042.stdout:(265/286): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-22T08:12:05.041 INFO:teuthology.orchestra.run.smithi038.stdout:(209/286): python3-prettytable-0.7.2-27.el9.noa 721 kB/s | 42 kB 00:00 2024-09-22T08:12:05.059 INFO:teuthology.orchestra.run.smithi042.stdout:(266/286): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-22T08:12:05.074 INFO:teuthology.orchestra.run.smithi038.stdout:(210/286): python3-protobuf-3.14.0-13.el9.noarc 4.5 MB/s | 269 kB 00:00 2024-09-22T08:12:05.076 INFO:teuthology.orchestra.run.smithi042.stdout:(267/286): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-09-22T08:12:05.100 INFO:teuthology.orchestra.run.smithi038.stdout:(211/286): python3-pyasn1-0.4.8-6.el9.noarch.rp 2.6 MB/s | 159 kB 00:00 2024-09-22T08:12:05.110 INFO:teuthology.orchestra.run.smithi042.stdout:(268/286): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-09-22T08:12:05.133 INFO:teuthology.orchestra.run.smithi038.stdout:(212/286): python3-pyasn1-modules-0.4.8-6.el9.n 4.7 MB/s | 279 kB 00:00 2024-09-22T08:12:05.144 INFO:teuthology.orchestra.run.smithi042.stdout:(269/286): protobuf-compiler-3.14.0-13.el9.x86_ 886 kB/s | 863 kB 00:00 2024-09-22T08:12:05.150 INFO:teuthology.orchestra.run.smithi038.stdout:(213/286): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-22T08:12:05.161 INFO:teuthology.orchestra.run.smithi042.stdout:(270/286): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-09-22T08:12:05.194 INFO:teuthology.orchestra.run.smithi042.stdout:(271/286): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-09-22T08:12:05.217 INFO:teuthology.orchestra.run.smithi038.stdout:(214/286): python3-numpy-1.20.1-5.el9.x86_64.rp 13 MB/s | 5.1 MB 00:00 2024-09-22T08:12:05.219 INFO:teuthology.orchestra.run.smithi042.stdout:(272/286): python3-repoze-lru-0.7-16.el9.noarch 620 kB/s | 31 kB 00:00 2024-09-22T08:12:05.234 INFO:teuthology.orchestra.run.smithi038.stdout:(215/286): python3-requests-oauthlib-1.3.0-12.e 534 kB/s | 54 kB 00:00 2024-09-22T08:12:05.245 INFO:teuthology.orchestra.run.smithi042.stdout:(273/286): python3-pyOpenSSL-21.0.0-1.el9.noarc 894 kB/s | 90 kB 00:00 2024-09-22T08:12:05.268 INFO:teuthology.orchestra.run.smithi038.stdout:(216/286): python3-toml-0.10.2-6.el9.noarch.rpm 830 kB/s | 42 kB 00:00 2024-09-22T08:12:05.270 INFO:teuthology.orchestra.run.smithi042.stdout:(274/286): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-22T08:12:05.295 INFO:teuthology.orchestra.run.smithi042.stdout:(275/286): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-22T08:12:05.301 INFO:teuthology.orchestra.run.smithi038.stdout:(217/286): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-22T08:12:05.318 INFO:teuthology.orchestra.run.smithi038.stdout:(218/286): qatlib-service-24.02.0-1.el9.x86_64. 713 kB/s | 36 kB 00:00 2024-09-22T08:12:05.320 INFO:teuthology.orchestra.run.smithi042.stdout:(276/286): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-22T08:12:05.346 INFO:teuthology.orchestra.run.smithi042.stdout:(277/286): python3-typing-extensions-4.12.2-2.e 987 kB/s | 74 kB 00:00 2024-09-22T08:12:05.351 INFO:teuthology.orchestra.run.smithi038.stdout:(219/286): qatzip-libs-1.2.0-1.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-22T08:12:05.369 INFO:teuthology.orchestra.run.smithi038.stdout:(220/286): rtkit-0.11-29.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2024-09-22T08:12:05.371 INFO:teuthology.orchestra.run.smithi042.stdout:(278/286): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-22T08:12:05.396 INFO:teuthology.orchestra.run.smithi042.stdout:(279/286): python3-zc-lockfile-2.0-10.el9.noarc 806 kB/s | 20 kB 00:00 2024-09-22T08:12:05.419 INFO:teuthology.orchestra.run.smithi038.stdout:(221/286): sisu-0.3.4-10.el9.noarch.rpm 7.4 MB/s | 510 kB 00:00 2024-09-22T08:12:05.422 INFO:teuthology.orchestra.run.smithi042.stdout:(280/286): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-22T08:12:05.444 INFO:teuthology.orchestra.run.smithi038.stdout:(222/286): slf4j-1.7.30-13.el9.noarch.rpm 914 kB/s | 69 kB 00:00 2024-09-22T08:12:05.447 INFO:teuthology.orchestra.run.smithi042.stdout:(281/286): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-22T08:12:05.472 INFO:teuthology.orchestra.run.smithi042.stdout:(282/286): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-22T08:12:05.478 INFO:teuthology.orchestra.run.smithi038.stdout:(223/286): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-22T08:12:05.497 INFO:teuthology.orchestra.run.smithi042.stdout:(283/286): s3cmd-2.4.0-1.el9.noarch.rpm 2.7 MB/s | 206 kB 00:00 2024-09-22T08:12:05.512 INFO:teuthology.orchestra.run.smithi038.stdout:(224/286): sound-theme-freedesktop-0.8-17.el9.n 5.6 MB/s | 383 kB 00:00 2024-09-22T08:12:05.537 INFO:teuthology.orchestra.run.smithi038.stdout:(225/286): totem-pl-parser-3.26.6-2.el9.x86_64. 2.5 MB/s | 152 kB 00:00 2024-09-22T08:12:05.548 INFO:teuthology.orchestra.run.smithi042.stdout:(284/286): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-22T08:12:05.579 INFO:teuthology.orchestra.run.smithi038.stdout:(226/286): tracker-3.1.2-3.el9.x86_64.rpm 8.1 MB/s | 555 kB 00:00 2024-09-22T08:12:05.612 INFO:teuthology.orchestra.run.smithi038.stdout:(227/286): tracker-miners-3.1.2-4.el9.x86_64.rp 12 MB/s | 944 kB 00:00 2024-09-22T08:12:05.638 INFO:teuthology.orchestra.run.smithi038.stdout:(228/286): ttmkfdir-3.0.9-65.el9.x86_64.rpm 911 kB/s | 53 kB 00:00 2024-09-22T08:12:05.671 INFO:teuthology.orchestra.run.smithi038.stdout:(229/286): tzdata-java-2024a-2.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2024-09-22T08:12:05.697 INFO:teuthology.orchestra.run.smithi038.stdout:(230/286): upower-0.99.11-11.el9.x86_64.rpm 2.9 MB/s | 173 kB 00:00 2024-09-22T08:12:05.730 INFO:teuthology.orchestra.run.smithi038.stdout:(231/286): webrtc-audio-processing-0.3.1-8.el9. 5.1 MB/s | 306 kB 00:00 2024-09-22T08:12:05.748 INFO:teuthology.orchestra.run.smithi042.stdout:(285/286): librbd1-19.3.0-5106.g8852379c.el9.x8 13 MB/s | 3.2 MB 00:00 2024-09-22T08:12:05.755 INFO:teuthology.orchestra.run.smithi038.stdout:(232/286): wireplumber-0.4.14-1.el9.x86_64.rpm 1.6 MB/s | 96 kB 00:00 2024-09-22T08:12:05.807 INFO:teuthology.orchestra.run.smithi042.stdout:(286/286): librados2-19.3.0-5106.g8852379c.el9. 10 MB/s | 3.5 MB 00:00 2024-09-22T08:12:05.814 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:12:05.814 INFO:teuthology.orchestra.run.smithi042.stdout:Total 20 MB/s | 322 MB 00:16 2024-09-22T08:12:05.915 INFO:teuthology.orchestra.run.smithi038.stdout:(233/286): python3-scipy-1.6.2-8.el9.x86_64.rpm 21 MB/s | 16 MB 00:00 2024-09-22T08:12:05.940 INFO:teuthology.orchestra.run.smithi038.stdout:(234/286): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 230 kB/s | 42 kB 00:00 2024-09-22T08:12:05.973 INFO:teuthology.orchestra.run.smithi038.stdout:(235/286): wireplumber-libs-0.4.14-1.el9.x86_64 1.4 MB/s | 358 kB 00:00 2024-09-22T08:12:05.999 INFO:teuthology.orchestra.run.smithi038.stdout:(236/286): xdg-desktop-portal-gtk-1.12.0-3.el9. 2.2 MB/s | 134 kB 00:00 2024-09-22T08:12:06.024 INFO:teuthology.orchestra.run.smithi038.stdout:(237/286): xdg-desktop-portal-1.12.6-1.el9.x86_ 3.5 MB/s | 385 kB 00:00 2024-09-22T08:12:06.049 INFO:teuthology.orchestra.run.smithi038.stdout:(238/286): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-22T08:12:06.133 INFO:teuthology.orchestra.run.smithi038.stdout:(239/286): xkeyboard-config-2.33-2.el9.noarch.r 5.3 MB/s | 859 kB 00:00 2024-09-22T08:12:06.158 INFO:teuthology.orchestra.run.smithi038.stdout:(240/286): xorg-x11-fonts-Type1-7.5-33.el9.noar 3.7 MB/s | 505 kB 00:00 2024-09-22T08:12:06.209 INFO:teuthology.orchestra.run.smithi038.stdout:(241/286): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-22T08:12:06.234 INFO:teuthology.orchestra.run.smithi038.stdout:(242/286): gperftools-libs-2.9.1-3.el9.x86_64.r 12 MB/s | 308 kB 00:00 2024-09-22T08:12:06.261 INFO:teuthology.orchestra.run.smithi038.stdout:(243/286): grpc-data-1.46.7-10.el9.noarch.rpm 780 kB/s | 19 kB 00:00 2024-09-22T08:12:06.376 INFO:teuthology.orchestra.run.smithi038.stdout:(244/286): libarrow-9.0.0-11.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-22T08:12:06.401 INFO:teuthology.orchestra.run.smithi038.stdout:(245/286): lua-devel-5.4.4-4.el9.x86_64.rpm 63 kB/s | 22 kB 00:00 2024-09-22T08:12:06.427 INFO:teuthology.orchestra.run.smithi038.stdout:(246/286): libarrow-doc-9.0.0-11.el9.noarch.rpm 519 kB/s | 26 kB 00:00 2024-09-22T08:12:06.460 INFO:teuthology.orchestra.run.smithi038.stdout:(247/286): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-22T08:12:06.485 INFO:teuthology.orchestra.run.smithi038.stdout:(248/286): luarocks-3.9.2-5.el9.noarch.rpm 6.4 MB/s | 151 kB 00:00 2024-09-22T08:12:06.511 INFO:teuthology.orchestra.run.smithi038.stdout:(249/286): liboath-2.6.7-2.el9.x86_64.rpm 445 kB/s | 49 kB 00:00 2024-09-22T08:12:06.553 INFO:teuthology.orchestra.run.smithi038.stdout:(250/286): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-22T08:12:06.569 INFO:teuthology.orchestra.run.smithi038.stdout:(251/286): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-22T08:12:06.587 INFO:teuthology.orchestra.run.smithi038.stdout:(252/286): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-22T08:12:06.604 INFO:teuthology.orchestra.run.smithi038.stdout:(253/286): python3-certifi-2023.05.07-4.el9.noa 857 kB/s | 14 kB 00:00 2024-09-22T08:12:06.629 INFO:teuthology.orchestra.run.smithi038.stdout:(254/286): python3-asyncssh-2.13.2-5.el9.noarch 4.5 MB/s | 548 kB 00:00 2024-09-22T08:12:06.654 INFO:teuthology.orchestra.run.smithi038.stdout:(255/286): python3-cheroot-8.6.0-4.el9.noarch.r 3.4 MB/s | 172 kB 00:00 2024-09-22T08:12:06.679 INFO:teuthology.orchestra.run.smithi038.stdout:(256/286): python3-google-auth-2.34.0-1.el9.noa 8.6 MB/s | 220 kB 00:00 2024-09-22T08:12:06.713 INFO:teuthology.orchestra.run.smithi038.stdout:(257/286): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-09-22T08:12:06.746 INFO:teuthology.orchestra.run.smithi038.stdout:(258/286): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-22T08:12:06.772 INFO:teuthology.orchestra.run.smithi038.stdout:(259/286): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-09-22T08:12:06.797 INFO:teuthology.orchestra.run.smithi038.stdout:(260/286): python3-jaraco-classes-3.2.1-5.el9.n 706 kB/s | 18 kB 00:00 2024-09-22T08:12:06.822 INFO:teuthology.orchestra.run.smithi038.stdout:(261/286): python3-jaraco-collections-3.0.0-8.e 929 kB/s | 23 kB 00:00 2024-09-22T08:12:06.847 INFO:teuthology.orchestra.run.smithi038.stdout:(262/286): python3-jaraco-functools-3.5.0-2.el9 787 kB/s | 19 kB 00:00 2024-09-22T08:12:06.873 INFO:teuthology.orchestra.run.smithi038.stdout:(263/286): python3-jaraco-text-3.2.0-6.el9.noar 779 kB/s | 20 kB 00:00 2024-09-22T08:12:06.915 INFO:teuthology.orchestra.run.smithi038.stdout:(264/286): python3-grpcio-1.46.7-10.el9.x86_64. 8.7 MB/s | 2.0 MB 00:00 2024-09-22T08:12:06.941 INFO:teuthology.orchestra.run.smithi038.stdout:(265/286): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-22T08:12:06.966 INFO:teuthology.orchestra.run.smithi038.stdout:(266/286): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-22T08:12:06.991 INFO:teuthology.orchestra.run.smithi038.stdout:(267/286): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-22T08:12:07.025 INFO:teuthology.orchestra.run.smithi038.stdout:(268/286): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-09-22T08:12:07.050 INFO:teuthology.orchestra.run.smithi038.stdout:(269/286): python3-pecan-1.4.2-3.el9.noarch.rpm 4.6 MB/s | 272 kB 00:00 2024-09-22T08:12:07.075 INFO:teuthology.orchestra.run.smithi038.stdout:(270/286): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-09-22T08:12:07.100 INFO:teuthology.orchestra.run.smithi038.stdout:(271/286): protobuf-compiler-3.14.0-13.el9.x86_ 893 kB/s | 863 kB 00:00 2024-09-22T08:12:07.126 INFO:teuthology.orchestra.run.smithi038.stdout:(272/286): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-22T08:12:07.159 INFO:teuthology.orchestra.run.smithi038.stdout:(273/286): python3-pyOpenSSL-21.0.0-1.el9.noarc 823 kB/s | 90 kB 00:00 2024-09-22T08:12:07.185 INFO:teuthology.orchestra.run.smithi038.stdout:(274/286): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-22T08:12:07.210 INFO:teuthology.orchestra.run.smithi038.stdout:(275/286): python3-tempora-5.0.0-2.el9.noarch.r 743 kB/s | 36 kB 00:00 2024-09-22T08:12:07.235 INFO:teuthology.orchestra.run.smithi038.stdout:(276/286): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-22T08:12:07.260 INFO:teuthology.orchestra.run.smithi038.stdout:(277/286): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-22T08:12:07.286 INFO:teuthology.orchestra.run.smithi038.stdout:(278/286): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-22T08:12:07.311 INFO:teuthology.orchestra.run.smithi038.stdout:(279/286): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-22T08:12:07.345 INFO:teuthology.orchestra.run.smithi038.stdout:(280/286): python3-zc-lockfile-2.0-10.el9.noarc 341 kB/s | 20 kB 00:00 2024-09-22T08:12:07.370 INFO:teuthology.orchestra.run.smithi038.stdout:(281/286): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-22T08:12:07.395 INFO:teuthology.orchestra.run.smithi038.stdout:(282/286): s3cmd-2.4.0-1.el9.noarch.rpm 4.0 MB/s | 206 kB 00:00 2024-09-22T08:12:07.420 INFO:teuthology.orchestra.run.smithi038.stdout:(283/286): python3-werkzeug-2.0.3-3.el9.1.noarc 2.6 MB/s | 427 kB 00:00 2024-09-22T08:12:07.471 INFO:teuthology.orchestra.run.smithi038.stdout:(284/286): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-22T08:12:07.654 INFO:teuthology.orchestra.run.smithi038.stdout:(285/286): librados2-19.3.0-5106.g8852379c.el9. 13 MB/s | 3.5 MB 00:00 2024-09-22T08:12:07.713 INFO:teuthology.orchestra.run.smithi038.stdout:(286/286): librbd1-19.3.0-5106.g8852379c.el9.x8 11 MB/s | 3.2 MB 00:00 2024-09-22T08:12:07.718 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:12:07.719 INFO:teuthology.orchestra.run.smithi038.stdout:Total 23 MB/s | 322 MB 00:14 2024-09-22T08:12:08.983 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-09-22T08:12:09.185 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-09-22T08:12:09.185 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-09-22T08:12:10.993 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-09-22T08:12:11.196 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-09-22T08:12:11.197 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-09-22T08:12:12.542 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-09-22T08:12:12.542 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-09-22T08:12:14.560 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-09-22T08:12:14.560 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-09-22T08:12:23.152 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-22T08:12:23.336 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-22T08:12:23.500 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-09-22T08:12:23.566 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/288 2024-09-22T08:12:23.594 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/288 2024-09-22T08:12:23.672 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/288 2024-09-22T08:12:23.721 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/288 2024-09-22T08:12:23.781 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/288 2024-09-22T08:12:23.830 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/288 2024-09-22T08:12:23.855 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/288 2024-09-22T08:12:23.902 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/288 2024-09-22T08:12:24.292 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/288 2024-09-22T08:12:24.398 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : librados2-2:19.3.0-5106.g8852379c.el9.x86_64 10/288 2024-09-22T08:12:24.540 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librados2-2:19.3.0-5106.g8852379c.el9.x86_64 10/288 2024-09-22T08:12:24.574 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 11/288 2024-09-22T08:12:24.667 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 11/288 2024-09-22T08:12:24.695 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rados-2:19.3.0-5106.g8852379c.el9.x86_64 12/288 2024-09-22T08:12:24.740 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/288 2024-09-22T08:12:24.771 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/288 2024-09-22T08:12:24.796 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/288 2024-09-22T08:12:24.823 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/288 2024-09-22T08:12:24.863 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/288 2024-09-22T08:12:24.895 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/288 2024-09-22T08:12:24.922 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 19/288 2024-09-22T08:12:24.950 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 20/288 2024-09-22T08:12:25.039 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-22T08:12:25.106 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lcms2-2.12-3.el9.x86_64 21/288 2024-09-22T08:12:25.218 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-22T08:12:25.240 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 22/288 2024-09-22T08:12:25.282 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : atk-2.36.0-5.el9.x86_64 23/288 2024-09-22T08:12:25.319 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 24/288 2024-09-22T08:12:25.355 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephsqlite-2:19.3.0-5106.g8852379c.el9.x86_64 25/288 2024-09-22T08:12:25.383 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-09-22T08:12:25.458 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5106.g8852379c.el9.x86_64 25/288 2024-09-22T08:12:25.461 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/288 2024-09-22T08:12:25.489 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libradosstriper1-2:19.3.0-5106.g8852379c.el9.x86 26/288 2024-09-22T08:12:25.500 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/288 2024-09-22T08:12:25.555 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5106.g8852379c.el9.x86 26/288 2024-09-22T08:12:25.580 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 27/288 2024-09-22T08:12:25.611 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-22T08:12:25.634 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-22T08:12:25.686 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/288 2024-09-22T08:12:25.780 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-22T08:12:25.800 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/288 2024-09-22T08:12:25.811 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-22T08:12:25.855 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/288 2024-09-22T08:12:25.895 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/288 2024-09-22T08:12:25.928 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/288 2024-09-22T08:12:25.932 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : re2-1:20211101-20.el9.x86_64 30/288 2024-09-22T08:12:25.983 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 31/288 2024-09-22T08:12:25.987 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/288 2024-09-22T08:12:26.019 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : liboath-2.6.7-2.el9.x86_64 32/288 2024-09-22T08:12:26.096 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/288 2024-09-22T08:12:26.146 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/288 2024-09-22T08:12:26.194 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-packaging-20.9-5.el9.noarch 35/288 2024-09-22T08:12:26.245 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 36/288 2024-09-22T08:12:26.269 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 37/288 2024-09-22T08:12:26.296 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 38/288 2024-09-22T08:12:26.321 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 39/288 2024-09-22T08:12:26.347 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 40/288 2024-09-22T08:12:26.353 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/288 2024-09-22T08:12:26.375 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 41/288 2024-09-22T08:12:26.408 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 42/288 2024-09-22T08:12:26.432 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 43/288 2024-09-22T08:12:26.477 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 44/288 2024-09-22T08:12:26.478 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : librados2-2:19.3.0-5106.g8852379c.el9.x86_64 10/288 2024-09-22T08:12:26.505 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : dconf-0.40.0-6.el9.x86_64 45/288 2024-09-22T08:12:26.575 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 45/288 2024-09-22T08:12:26.621 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librados2-2:19.3.0-5106.g8852379c.el9.x86_64 10/288 2024-09-22T08:12:26.633 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 46/288 2024-09-22T08:12:26.655 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 11/288 2024-09-22T08:12:26.670 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 47/288 2024-09-22T08:12:26.714 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 48/288 2024-09-22T08:12:26.747 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 11/288 2024-09-22T08:12:26.758 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 49/288 2024-09-22T08:12:26.776 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rados-2:19.3.0-5106.g8852379c.el9.x86_64 12/288 2024-09-22T08:12:26.790 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : fuse-2.9.9-16.el9.x86_64 50/288 2024-09-22T08:12:26.818 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/288 2024-09-22T08:12:26.851 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/288 2024-09-22T08:12:26.878 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/288 2024-09-22T08:12:26.883 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 51/288 2024-09-22T08:12:26.903 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/288 2024-09-22T08:12:26.917 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ceph-common-2:19.3.0-5106.g8852379c.el9. 52/288 2024-09-22T08:12:26.944 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/288 2024-09-22T08:12:26.961 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ceph-argparse-2:19.3.0-5106.g8852379c.el 53/288 2024-09-22T08:12:26.984 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/288 2024-09-22T08:12:27.003 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cephfs-2:19.3.0-5106.g8852379c.el9.x86_6 54/288 2024-09-22T08:12:27.011 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 19/288 2024-09-22T08:12:27.040 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 20/288 2024-09-22T08:12:27.082 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 55/288 2024-09-22T08:12:27.210 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : lcms2-2.12-3.el9.x86_64 21/288 2024-09-22T08:12:27.247 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 56/288 2024-09-22T08:12:27.316 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 57/288 2024-09-22T08:12:27.343 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 22/288 2024-09-22T08:12:27.379 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : atk-2.36.0-5.el9.x86_64 23/288 2024-09-22T08:12:27.416 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 24/288 2024-09-22T08:12:27.443 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcephsqlite-2:19.3.0-5106.g8852379c.el9.x86_64 25/288 2024-09-22T08:12:27.556 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5106.g8852379c.el9.x86_64 25/288 2024-09-22T08:12:27.590 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libradosstriper1-2:19.3.0-5106.g8852379c.el9.x86 26/288 2024-09-22T08:12:27.653 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5106.g8852379c.el9.x86 26/288 2024-09-22T08:12:27.694 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 27/288 2024-09-22T08:12:27.725 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-22T08:12:27.746 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-22T08:12:27.887 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rsa-4.9-2.el9.noarch 58/288 2024-09-22T08:12:27.945 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-22T08:12:27.983 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-22T08:12:27.989 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 59/288 2024-09-22T08:12:28.031 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 60/288 2024-09-22T08:12:28.094 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : re2-1:20211101-20.el9.x86_64 30/288 2024-09-22T08:12:28.103 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 61/288 2024-09-22T08:12:28.131 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 31/288 2024-09-22T08:12:28.144 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 62/288 2024-09-22T08:12:28.167 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : liboath-2.6.7-2.el9.x86_64 32/288 2024-09-22T08:12:28.180 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 63/288 2024-09-22T08:12:28.210 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 64/288 2024-09-22T08:12:28.244 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/288 2024-09-22T08:12:28.284 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 65/288 2024-09-22T08:12:28.295 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/288 2024-09-22T08:12:28.321 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : luarocks-3.9.2-5.el9.noarch 66/288 2024-09-22T08:12:28.334 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-packaging-20.9-5.el9.noarch 35/288 2024-09-22T08:12:28.354 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 67/288 2024-09-22T08:12:28.385 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 36/288 2024-09-22T08:12:28.398 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 68/288 2024-09-22T08:12:28.417 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 37/288 2024-09-22T08:12:28.436 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librados-devel-2:19.3.0-5106.g8852379c.el9.x86_6 69/288 2024-09-22T08:12:28.444 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 38/288 2024-09-22T08:12:28.468 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 70/288 2024-09-22T08:12:28.469 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 39/288 2024-09-22T08:12:28.495 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 40/288 2024-09-22T08:12:28.500 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 71/288 2024-09-22T08:12:28.523 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 41/288 2024-09-22T08:12:28.543 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 72/288 2024-09-22T08:12:28.555 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 42/288 2024-09-22T08:12:28.580 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 43/288 2024-09-22T08:12:28.602 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 73/288 2024-09-22T08:12:28.628 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 44/288 2024-09-22T08:12:28.635 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 74/288 2024-09-22T08:12:28.653 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : dconf-0.40.0-6.el9.x86_64 45/288 2024-09-22T08:12:28.672 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 75/288 2024-09-22T08:12:28.730 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 45/288 2024-09-22T08:12:28.770 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 76/288 2024-09-22T08:12:28.790 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 46/288 2024-09-22T08:12:28.827 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 47/288 2024-09-22T08:12:28.839 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 77/288 2024-09-22T08:12:28.879 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 48/288 2024-09-22T08:12:28.915 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 78/288 2024-09-22T08:12:28.915 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 49/288 2024-09-22T08:12:28.947 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : fuse-2.9.9-16.el9.x86_64 50/288 2024-09-22T08:12:28.958 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 79/288 2024-09-22T08:12:28.994 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 80/288 2024-09-22T08:12:29.033 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 51/288 2024-09-22T08:12:29.043 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 81/288 2024-09-22T08:12:29.074 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-ceph-common-2:19.3.0-5106.g8852379c.el9. 52/288 2024-09-22T08:12:29.096 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 82/288 2024-09-22T08:12:29.118 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-ceph-argparse-2:19.3.0-5106.g8852379c.el 53/288 2024-09-22T08:12:29.140 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 83/288 2024-09-22T08:12:29.169 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cephfs-2:19.3.0-5106.g8852379c.el9.x86_6 54/288 2024-09-22T08:12:29.249 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 55/288 2024-09-22T08:12:29.294 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 84/288 2024-09-22T08:12:29.341 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 85/288 2024-09-22T08:12:29.391 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 86/288 2024-09-22T08:12:29.408 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 56/288 2024-09-22T08:12:29.466 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 57/288 2024-09-22T08:12:29.500 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 87/288 2024-09-22T08:12:29.533 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 88/288 2024-09-22T08:12:29.573 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 89/288 2024-09-22T08:12:29.614 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 90/288 2024-09-22T08:12:29.638 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 91/288 2024-09-22T08:12:29.724 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 92/288 2024-09-22T08:12:29.864 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 93/288 2024-09-22T08:12:29.908 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 94/288 2024-09-22T08:12:30.056 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rsa-4.9-2.el9.noarch 58/288 2024-09-22T08:12:30.123 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 95/288 2024-09-22T08:12:30.157 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 59/288 2024-09-22T08:12:30.167 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 96/288 2024-09-22T08:12:30.197 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 60/288 2024-09-22T08:12:30.198 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 97/288 2024-09-22T08:12:30.246 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 98/288 2024-09-22T08:12:30.270 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 61/288 2024-09-22T08:12:30.287 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 99/288 2024-09-22T08:12:30.315 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : upower-0.99.11-11.el9.x86_64 100/288 2024-09-22T08:12:30.319 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 62/288 2024-09-22T08:12:30.329 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 100/288 2024-09-22T08:12:30.329 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-22T08:12:30.329 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:12:30.356 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 63/288 2024-09-22T08:12:30.385 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 64/288 2024-09-22T08:12:30.463 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 65/288 2024-09-22T08:12:30.495 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : luarocks-3.9.2-5.el9.noarch 66/288 2024-09-22T08:12:30.528 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : tzdata-java-2024a-2.el9.noarch 101/288 2024-09-22T08:12:30.529 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 67/288 2024-09-22T08:12:30.589 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 68/288 2024-09-22T08:12:30.606 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 102/288 2024-09-22T08:12:30.636 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librados-devel-2:19.3.0-5106.g8852379c.el9.x86_6 69/288 2024-09-22T08:12:30.664 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 103/288 2024-09-22T08:12:30.668 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 70/288 2024-09-22T08:12:30.688 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-22T08:12:30.701 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 71/288 2024-09-22T08:12:30.713 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-22T08:12:30.740 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 105/288 2024-09-22T08:12:30.742 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 72/288 2024-09-22T08:12:30.802 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 73/288 2024-09-22T08:12:30.836 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 74/288 2024-09-22T08:12:30.873 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 75/288 2024-09-22T08:12:30.971 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 76/288 2024-09-22T08:12:31.039 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 77/288 2024-09-22T08:12:31.114 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 78/288 2024-09-22T08:12:31.150 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 79/288 2024-09-22T08:12:31.182 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-22T08:12:31.211 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 80/288 2024-09-22T08:12:31.218 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rtkit-0.11-29.el9.x86_64 106/288 2024-09-22T08:12:31.233 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-22T08:12:31.233 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-22T08:12:31.233 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:12:31.260 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 81/288 2024-09-22T08:12:31.275 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 107/288 2024-09-22T08:12:31.304 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 82/288 2024-09-22T08:12:31.309 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 108/288 2024-09-22T08:12:31.343 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 109/288 2024-09-22T08:12:31.346 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 83/288 2024-09-22T08:12:31.385 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 110/288 2024-09-22T08:12:31.419 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 111/288 2024-09-22T08:12:31.505 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 84/288 2024-09-22T08:12:31.512 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 112/288 2024-09-22T08:12:31.546 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 85/288 2024-09-22T08:12:31.559 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 113/288 2024-09-22T08:12:31.589 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 86/288 2024-09-22T08:12:31.606 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 114/288 2024-09-22T08:12:31.701 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 87/288 2024-09-22T08:12:31.733 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 115/288 2024-09-22T08:12:31.738 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 88/288 2024-09-22T08:12:31.778 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 89/288 2024-09-22T08:12:31.792 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 116/288 2024-09-22T08:12:31.820 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 90/288 2024-09-22T08:12:31.853 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 91/288 2024-09-22T08:12:31.941 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 92/288 2024-09-22T08:12:32.081 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 93/288 2024-09-22T08:12:32.129 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 94/288 2024-09-22T08:12:32.359 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 95/288 2024-09-22T08:12:32.407 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 96/288 2024-09-22T08:12:32.446 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 97/288 2024-09-22T08:12:32.476 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 98/288 2024-09-22T08:12:32.518 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 99/288 2024-09-22T08:12:32.545 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : upower-0.99.11-11.el9.x86_64 100/288 2024-09-22T08:12:32.560 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 100/288 2024-09-22T08:12:32.561 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-22T08:12:32.561 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:12:32.583 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 117/288 2024-09-22T08:12:32.637 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 118/288 2024-09-22T08:12:32.671 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 119/288 2024-09-22T08:12:32.767 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : tzdata-java-2024a-2.el9.noarch 101/288 2024-09-22T08:12:32.779 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 120/288 2024-09-22T08:12:32.825 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 121/288 2024-09-22T08:12:32.851 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 102/288 2024-09-22T08:12:32.904 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 103/288 2024-09-22T08:12:32.927 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-22T08:12:32.954 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-22T08:12:32.978 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 105/288 2024-09-22T08:12:33.023 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 122/288 2024-09-22T08:12:33.069 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 123/288 2024-09-22T08:12:33.115 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 124/288 2024-09-22T08:12:33.666 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 125/288 2024-09-22T08:12:33.737 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : osinfo-db-20240701-2.el9.noarch 126/288 2024-09-22T08:12:33.772 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 127/288 2024-09-22T08:12:33.792 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-22T08:12:33.806 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : orc-0.4.31-8.el9.x86_64 128/288 2024-09-22T08:12:33.824 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rtkit-0.11-29.el9.x86_64 106/288 2024-09-22T08:12:33.839 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-22T08:12:33.839 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-22T08:12:33.839 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:12:33.848 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 129/288 2024-09-22T08:12:33.881 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 107/288 2024-09-22T08:12:33.916 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 108/288 2024-09-22T08:12:33.949 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 109/288 2024-09-22T08:12:34.001 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 110/288 2024-09-22T08:12:34.042 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 111/288 2024-09-22T08:12:34.047 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openblas-0.3.26-2.el9.x86_64 130/288 2024-09-22T08:12:34.087 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 131/288 2024-09-22T08:12:34.139 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 112/288 2024-09-22T08:12:34.167 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 132/288 2024-09-22T08:12:34.191 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 113/288 2024-09-22T08:12:34.386 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 114/288 2024-09-22T08:12:34.386 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 115/288 2024-09-22T08:12:34.406 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 116/288 2024-09-22T08:12:34.886 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 133/288 2024-09-22T08:12:35.000 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 134/288 2024-09-22T08:12:35.214 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 117/288 2024-09-22T08:12:35.259 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 118/288 2024-09-22T08:12:35.293 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 119/288 2024-09-22T08:12:35.400 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 120/288 2024-09-22T08:12:35.445 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 121/288 2024-09-22T08:12:35.650 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 122/288 2024-09-22T08:12:35.690 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 123/288 2024-09-22T08:12:35.738 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 124/288 2024-09-22T08:12:36.315 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 125/288 2024-09-22T08:12:36.351 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 135/288 2024-09-22T08:12:36.384 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : osinfo-db-20240701-2.el9.noarch 126/288 2024-09-22T08:12:36.419 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 127/288 2024-09-22T08:12:36.423 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 136/288 2024-09-22T08:12:36.453 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : orc-0.4.31-8.el9.x86_64 128/288 2024-09-22T08:12:36.475 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 137/288 2024-09-22T08:12:36.486 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 129/288 2024-09-22T08:12:36.508 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lua-posix-35.0-8.el9.x86_64 138/288 2024-09-22T08:12:36.536 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 139/288 2024-09-22T08:12:36.565 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-22T08:12:36.577 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-22T08:12:36.577 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-22T08:12:36.578 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:12:36.633 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 141/288 2024-09-22T08:12:36.669 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 142/288 2024-09-22T08:12:36.687 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : openblas-0.3.26-2.el9.x86_64 130/288 2024-09-22T08:12:36.706 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libsbc-1.4-9.el9.x86_64 143/288 2024-09-22T08:12:36.717 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 131/288 2024-09-22T08:12:36.805 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 132/288 2024-09-22T08:12:37.045 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 144/288 2024-09-22T08:12:37.094 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 145/288 2024-09-22T08:12:37.195 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 145/288 2024-09-22T08:12:37.226 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rbd-2:19.3.0-5106.g8852379c.el9.x86_64 146/288 2024-09-22T08:12:37.258 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 147/288 2024-09-22T08:12:37.287 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 148/288 2024-09-22T08:12:37.350 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 149/288 2024-09-22T08:12:37.386 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 150/288 2024-09-22T08:12:37.412 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 151/288 2024-09-22T08:12:37.451 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 152/288 2024-09-22T08:12:37.476 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-22T08:12:37.527 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 133/288 2024-09-22T08:12:37.657 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 134/288 2024-09-22T08:12:37.776 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-22T08:12:37.811 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libexif-0.6.22-6.el9.x86_64 154/288 2024-09-22T08:12:37.840 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 155/288 2024-09-22T08:12:37.873 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libasyncns-0.8-22.el9.x86_64 156/288 2024-09-22T08:12:37.899 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 157/288 2024-09-22T08:12:37.924 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libXv-1.0.11-16.el9.x86_64 158/288 2024-09-22T08:12:37.950 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 159/288 2024-09-22T08:12:37.978 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 160/288 2024-09-22T08:12:38.014 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 161/288 2024-09-22T08:12:38.063 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 162/288 2024-09-22T08:12:38.098 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 163/288 2024-09-22T08:12:38.146 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 164/288 2024-09-22T08:12:38.181 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : poppler-21.01.0-21.el9.x86_64 165/288 2024-09-22T08:12:38.656 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 166/288 2024-09-22T08:12:38.798 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 167/288 2024-09-22T08:12:38.863 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 168/288 2024-09-22T08:12:38.888 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 169/288 2024-09-22T08:12:38.916 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : gsm-1.0.19-6.el9.x86_64 170/288 2024-09-22T08:12:38.987 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 171/288 2024-09-22T08:12:39.035 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 172/288 2024-09-22T08:12:39.041 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 135/288 2024-09-22T08:12:39.064 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcanberra-0.30-27.el9.x86_64 173/288 2024-09-22T08:12:39.084 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 173/288 2024-09-22T08:12:39.110 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : graphene-1.10.6-2.el9.x86_64 174/288 2024-09-22T08:12:39.128 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 136/288 2024-09-22T08:12:39.137 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : giflib-5.2.1-9.el9.x86_64 175/288 2024-09-22T08:12:39.181 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 137/288 2024-09-22T08:12:39.184 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 176/288 2024-09-22T08:12:39.208 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-22T08:12:39.222 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : lua-posix-35.0-8.el9.x86_64 138/288 2024-09-22T08:12:39.251 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 139/288 2024-09-22T08:12:39.278 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-22T08:12:39.291 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-22T08:12:39.291 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-22T08:12:39.291 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:12:39.337 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 141/288 2024-09-22T08:12:39.374 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 142/288 2024-09-22T08:12:39.403 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libsbc-1.4-9.el9.x86_64 143/288 2024-09-22T08:12:39.742 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 144/288 2024-09-22T08:12:39.782 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 145/288 2024-09-22T08:12:39.883 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 145/288 2024-09-22T08:12:39.915 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rbd-2:19.3.0-5106.g8852379c.el9.x86_64 146/288 2024-09-22T08:12:39.946 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 147/288 2024-09-22T08:12:39.976 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 148/288 2024-09-22T08:12:40.043 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 149/288 2024-09-22T08:12:40.083 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 150/288 2024-09-22T08:12:40.117 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 151/288 2024-09-22T08:12:40.156 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 152/288 2024-09-22T08:12:40.181 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-22T08:12:40.509 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-22T08:12:40.567 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libexif-0.6.22-6.el9.x86_64 154/288 2024-09-22T08:12:40.595 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 155/288 2024-09-22T08:12:40.620 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libasyncns-0.8-22.el9.x86_64 156/288 2024-09-22T08:12:40.646 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 157/288 2024-09-22T08:12:40.671 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libXv-1.0.11-16.el9.x86_64 158/288 2024-09-22T08:12:40.696 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 159/288 2024-09-22T08:12:40.725 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 160/288 2024-09-22T08:12:40.761 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 161/288 2024-09-22T08:12:40.808 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 162/288 2024-09-22T08:12:40.853 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 163/288 2024-09-22T08:12:40.910 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 164/288 2024-09-22T08:12:40.944 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : poppler-21.01.0-21.el9.x86_64 165/288 2024-09-22T08:12:41.449 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 166/288 2024-09-22T08:12:41.599 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 167/288 2024-09-22T08:12:41.660 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 168/288 2024-09-22T08:12:41.693 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 169/288 2024-09-22T08:12:41.722 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : gsm-1.0.19-6.el9.x86_64 170/288 2024-09-22T08:12:41.801 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 171/288 2024-09-22T08:12:41.854 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 172/288 2024-09-22T08:12:41.886 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcanberra-0.30-27.el9.x86_64 173/288 2024-09-22T08:12:41.907 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 173/288 2024-09-22T08:12:41.940 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : graphene-1.10.6-2.el9.x86_64 174/288 2024-09-22T08:12:41.967 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : giflib-5.2.1-9.el9.x86_64 175/288 2024-09-22T08:12:42.002 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 176/288 2024-09-22T08:12:42.030 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-22T08:12:50.915 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-22T08:12:50.959 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 178/288 2024-09-22T08:12:50.995 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 179/288 2024-09-22T08:12:51.037 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 180/288 2024-09-22T08:12:51.095 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 181/288 2024-09-22T08:12:51.131 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 182/288 2024-09-22T08:12:51.649 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 183/288 2024-09-22T08:12:51.684 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librgw2-2:19.3.0-5106.g8852379c.el9.x86_64 184/288 2024-09-22T08:12:51.765 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librgw2-2:19.3.0-5106.g8852379c.el9.x86_64 184/288 2024-09-22T08:12:51.803 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rgw-2:19.3.0-5106.g8852379c.el9.x86_64 185/288 2024-09-22T08:12:53.956 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-22T08:12:54.006 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 178/288 2024-09-22T08:12:54.042 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 179/288 2024-09-22T08:12:54.083 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 180/288 2024-09-22T08:12:54.134 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 181/288 2024-09-22T08:12:54.186 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 182/288 2024-09-22T08:12:54.340 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 186/288 2024-09-22T08:12:54.386 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 186/288 2024-09-22T08:12:54.732 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 183/288 2024-09-22T08:12:54.757 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librgw2-2:19.3.0-5106.g8852379c.el9.x86_64 184/288 2024-09-22T08:12:54.840 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librgw2-2:19.3.0-5106.g8852379c.el9.x86_64 184/288 2024-09-22T08:12:54.867 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rgw-2:19.3.0-5106.g8852379c.el9.x86_64 185/288 2024-09-22T08:12:54.969 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 186/288 2024-09-22T08:12:55.015 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 187/288 2024-09-22T08:12:55.107 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 187/288 2024-09-22T08:12:55.107 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-22T08:12:55.107 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-22T08:12:55.107 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:12:55.141 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-selinux-2:19.3.0-5106.g8852379c.el9.x86_64 188/288 2024-09-22T08:12:57.354 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 186/288 2024-09-22T08:12:57.408 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 186/288 2024-09-22T08:12:58.001 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 186/288 2024-09-22T08:12:58.045 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 187/288 2024-09-22T08:12:58.150 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 187/288 2024-09-22T08:12:58.150 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-22T08:12:58.150 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-22T08:12:58.150 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:12:58.179 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-selinux-2:19.3.0-5106.g8852379c.el9.x86_64 188/288 2024-09-22T08:13:04.986 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5106.g8852379c.el9.x86_64 188/288 2024-09-22T08:13:04.986 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /sys 2024-09-22T08:13:04.986 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /proc 2024-09-22T08:13:04.986 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /mnt 2024-09-22T08:13:04.986 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /var/tmp 2024-09-22T08:13:04.986 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /home 2024-09-22T08:13:04.986 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /root 2024-09-22T08:13:04.986 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /tmp 2024-09-22T08:13:04.986 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:05.165 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-volume-2:19.3.0-5106.g8852379c.el9.noarch 189/288 2024-09-22T08:13:05.181 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-volume-2:19.3.0-5106.g8852379c.el9.noarch 189/288 2024-09-22T08:13:05.181 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:13:05.181 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-22T08:13:05.182 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:06.732 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-osd-2:19.3.0-5106.g8852379c.el9.x86_64 190/288 2024-09-22T08:13:06.761 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-osd-2:19.3.0-5106.g8852379c.el9.x86_64 190/288 2024-09-22T08:13:06.761 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:13:06.761 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-22T08:13:06.761 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-22T08:13:06.761 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-22T08:13:06.761 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:06.999 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mds-2:19.3.0-5106.g8852379c.el9.x86_64 191/288 2024-09-22T08:13:07.024 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mds-2:19.3.0-5106.g8852379c.el9.x86_64 191/288 2024-09-22T08:13:07.024 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:13:07.024 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-22T08:13:07.024 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-22T08:13:07.024 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-22T08:13:07.024 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:07.492 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mon-2:19.3.0-5106.g8852379c.el9.x86_64 192/288 2024-09-22T08:13:07.516 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mon-2:19.3.0-5106.g8852379c.el9.x86_64 192/288 2024-09-22T08:13:07.517 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:13:07.517 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-22T08:13:07.517 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-22T08:13:07.517 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-22T08:13:07.517 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:07.622 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 193/288 2024-09-22T08:13:07.992 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5106.g8852379c.el9.x86_64 188/288 2024-09-22T08:13:07.992 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /sys 2024-09-22T08:13:07.992 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /proc 2024-09-22T08:13:07.992 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /mnt 2024-09-22T08:13:07.992 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /var/tmp 2024-09-22T08:13:07.992 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /home 2024-09-22T08:13:07.992 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /root 2024-09-22T08:13:07.993 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /tmp 2024-09-22T08:13:07.993 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:08.178 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-volume-2:19.3.0-5106.g8852379c.el9.noarch 189/288 2024-09-22T08:13:08.194 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-volume-2:19.3.0-5106.g8852379c.el9.noarch 189/288 2024-09-22T08:13:08.194 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:13:08.194 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-22T08:13:08.195 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:09.745 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-osd-2:19.3.0-5106.g8852379c.el9.x86_64 190/288 2024-09-22T08:13:09.774 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-osd-2:19.3.0-5106.g8852379c.el9.x86_64 190/288 2024-09-22T08:13:09.774 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:13:09.774 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-22T08:13:09.774 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-22T08:13:09.774 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-22T08:13:09.774 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:10.005 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mds-2:19.3.0-5106.g8852379c.el9.x86_64 191/288 2024-09-22T08:13:10.029 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mds-2:19.3.0-5106.g8852379c.el9.x86_64 191/288 2024-09-22T08:13:10.029 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:13:10.029 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-22T08:13:10.029 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-22T08:13:10.030 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-22T08:13:10.030 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:10.505 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mon-2:19.3.0-5106.g8852379c.el9.x86_64 192/288 2024-09-22T08:13:10.530 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mon-2:19.3.0-5106.g8852379c.el9.x86_64 192/288 2024-09-22T08:13:10.530 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:13:10.530 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-22T08:13:10.530 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-22T08:13:10.530 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-22T08:13:10.530 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:10.635 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 193/288 2024-09-22T08:13:10.724 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 194/288 2024-09-22T08:13:10.827 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 195/288 2024-09-22T08:13:10.886 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ply-3.11-14.el9.noarch 196/288 2024-09-22T08:13:10.957 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 197/288 2024-09-22T08:13:11.154 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 198/288 2024-09-22T08:13:11.205 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 199/288 2024-09-22T08:13:11.294 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 200/288 2024-09-22T08:13:11.394 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 201/288 2024-09-22T08:13:11.536 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 202/288 2024-09-22T08:13:11.580 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 203/288 2024-09-22T08:13:11.623 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 204/288 2024-09-22T08:13:12.537 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 205/288 2024-09-22T08:13:12.586 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-22T08:13:12.963 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-22T08:13:13.009 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 207/288 2024-09-22T08:13:13.040 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : slf4j-1.7.30-13.el9.noarch 208/288 2024-09-22T08:13:13.067 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : atinject-1.0.3-6.el9.noarch 209/288 2024-09-22T08:13:13.103 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 210/288 2024-09-22T08:13:13.140 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 211/288 2024-09-22T08:13:13.175 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 212/288 2024-09-22T08:13:13.201 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 213/288 2024-09-22T08:13:13.235 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 214/288 2024-09-22T08:13:13.260 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 215/288 2024-09-22T08:13:13.286 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 216/288 2024-09-22T08:13:13.312 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 217/288 2024-09-22T08:13:13.339 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 218/288 2024-09-22T08:13:13.369 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 219/288 2024-09-22T08:13:13.397 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 220/288 2024-09-22T08:13:13.440 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 221/288 2024-09-22T08:13:13.476 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 222/288 2024-09-22T08:13:13.507 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 223/288 2024-09-22T08:13:13.541 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 224/288 2024-09-22T08:13:13.575 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : jansi-2.3.3-6.el9.x86_64 225/288 2024-09-22T08:13:13.612 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : jsoup-1.13.1-10.el9.noarch 226/288 2024-09-22T08:13:13.651 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 227/288 2024-09-22T08:13:13.694 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 228/288 2024-09-22T08:13:13.724 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 194/288 2024-09-22T08:13:13.738 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 229/288 2024-09-22T08:13:13.769 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : guava-30.1-6.el9.noarch 230/288 2024-09-22T08:13:13.801 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : google-guice-4.2.3-9.el9.noarch 231/288 2024-09-22T08:13:13.831 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 195/288 2024-09-22T08:13:13.856 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 232/288 2024-09-22T08:13:13.894 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 233/288 2024-09-22T08:13:13.900 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-ply-3.11-14.el9.noarch 196/288 2024-09-22T08:13:13.925 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 234/288 2024-09-22T08:13:13.954 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 235/288 2024-09-22T08:13:13.970 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 197/288 2024-09-22T08:13:13.979 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 236/288 2024-09-22T08:13:14.162 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 237/288 2024-09-22T08:13:14.170 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 198/288 2024-09-22T08:13:14.196 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 238/288 2024-09-22T08:13:14.223 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 239/288 2024-09-22T08:13:14.243 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 199/288 2024-09-22T08:13:14.250 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 240/288 2024-09-22T08:13:14.291 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 241/288 2024-09-22T08:13:14.325 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 200/288 2024-09-22T08:13:14.423 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 201/288 2024-09-22T08:13:14.427 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 242/288 2024-09-22T08:13:14.493 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 243/288 2024-09-22T08:13:14.563 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 244/288 2024-09-22T08:13:14.574 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 202/288 2024-09-22T08:13:14.597 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : tracker-3.1.2-3.el9.x86_64 245/288 2024-09-22T08:13:14.633 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 203/288 2024-09-22T08:13:14.684 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 204/288 2024-09-22T08:13:14.718 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 245/288 2024-09-22T08:13:14.761 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-22T08:13:14.785 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-22T08:13:14.814 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 247/288 2024-09-22T08:13:14.837 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 248/288 2024-09-22T08:13:15.280 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-22T08:13:15.308 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-22T08:13:15.325 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-22T08:13:15.325 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-22T08:13:15.325 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:15.562 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 250/288 2024-09-22T08:13:15.608 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 205/288 2024-09-22T08:13:15.632 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 251/288 2024-09-22T08:13:15.667 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-22T08:13:15.676 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 252/288 2024-09-22T08:13:15.712 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 253/288 2024-09-22T08:13:15.737 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 254/288 2024-09-22T08:13:16.050 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-22T08:13:16.091 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 207/288 2024-09-22T08:13:16.122 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : slf4j-1.7.30-13.el9.noarch 208/288 2024-09-22T08:13:16.150 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : atinject-1.0.3-6.el9.noarch 209/288 2024-09-22T08:13:16.171 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-22T08:13:16.185 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 210/288 2024-09-22T08:13:16.199 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-22T08:13:16.216 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-22T08:13:16.222 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 211/288 2024-09-22T08:13:16.258 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 212/288 2024-09-22T08:13:16.283 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 213/288 2024-09-22T08:13:16.309 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 214/288 2024-09-22T08:13:16.334 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 215/288 2024-09-22T08:13:16.360 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 216/288 2024-09-22T08:13:16.386 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 217/288 2024-09-22T08:13:16.413 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 218/288 2024-09-22T08:13:16.443 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 219/288 2024-09-22T08:13:16.471 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 220/288 2024-09-22T08:13:16.515 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 221/288 2024-09-22T08:13:16.550 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 222/288 2024-09-22T08:13:16.581 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 223/288 2024-09-22T08:13:16.616 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 224/288 2024-09-22T08:13:16.650 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : jansi-2.3.3-6.el9.x86_64 225/288 2024-09-22T08:13:16.687 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : jsoup-1.13.1-10.el9.noarch 226/288 2024-09-22T08:13:16.734 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 227/288 2024-09-22T08:13:16.739 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-22T08:13:16.794 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 228/288 2024-09-22T08:13:16.832 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-22T08:13:16.838 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 229/288 2024-09-22T08:13:16.869 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : guava-30.1-6.el9.noarch 230/288 2024-09-22T08:13:16.882 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-22T08:13:16.900 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : google-guice-4.2.3-9.el9.noarch 231/288 2024-09-22T08:13:16.911 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-22T08:13:16.957 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 232/288 2024-09-22T08:13:16.986 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 233/288 2024-09-22T08:13:17.017 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 234/288 2024-09-22T08:13:17.045 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 235/288 2024-09-22T08:13:17.071 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 236/288 2024-09-22T08:13:17.122 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 258/288 2024-09-22T08:13:17.182 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 259/288 2024-09-22T08:13:17.217 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-22T08:13:17.239 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-22T08:13:17.247 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 237/288 2024-09-22T08:13:17.275 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-22T08:13:17.279 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 238/288 2024-09-22T08:13:17.307 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 239/288 2024-09-22T08:13:17.334 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 240/288 2024-09-22T08:13:17.346 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-22T08:13:17.366 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 241/288 2024-09-22T08:13:17.386 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-22T08:13:17.397 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-22T08:13:17.428 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : maven-1:3.6.3-15.el9.noarch 263/288 2024-09-22T08:13:17.447 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 263/288 2024-09-22T08:13:17.471 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 264/288 2024-09-22T08:13:17.490 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 242/288 2024-09-22T08:13:17.559 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 243/288 2024-09-22T08:13:17.638 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 244/288 2024-09-22T08:13:17.679 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : tracker-3.1.2-3.el9.x86_64 245/288 2024-09-22T08:13:17.797 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 245/288 2024-09-22T08:13:17.835 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-22T08:13:17.843 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: cephadm-2:19.3.0-5106.g8852379c.el9.noarch 265/288 2024-09-22T08:13:17.851 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-22T08:13:17.868 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephadm-2:19.3.0-5106.g8852379c.el9.noarch 265/288 2024-09-22T08:13:17.880 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 247/288 2024-09-22T08:13:17.902 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5106.g8852379c.e 266/288 2024-09-22T08:13:17.902 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 248/288 2024-09-22T08:13:17.980 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5106.g8852379c. 267/288 2024-09-22T08:13:18.010 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5106.g8852379c.el9.noa 268/288 2024-09-22T08:13:18.294 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-22T08:13:18.324 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-22T08:13:18.341 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-22T08:13:18.341 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-22T08:13:18.341 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:18.586 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 250/288 2024-09-22T08:13:18.657 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 251/288 2024-09-22T08:13:18.700 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 252/288 2024-09-22T08:13:18.736 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 253/288 2024-09-22T08:13:18.769 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 254/288 2024-09-22T08:13:19.220 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-22T08:13:19.249 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-22T08:13:19.266 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-22T08:13:19.823 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-22T08:13:19.915 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-22T08:13:19.950 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-22T08:13:19.978 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-22T08:13:20.184 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 258/288 2024-09-22T08:13:20.246 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 259/288 2024-09-22T08:13:20.275 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-22T08:13:20.297 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-22T08:13:20.326 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-22T08:13:20.398 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-22T08:13:20.436 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-22T08:13:20.447 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-22T08:13:20.478 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : maven-1:3.6.3-15.el9.noarch 263/288 2024-09-22T08:13:20.499 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 263/288 2024-09-22T08:13:20.529 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 264/288 2024-09-22T08:13:20.985 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: cephadm-2:19.3.0-5106.g8852379c.el9.noarch 265/288 2024-09-22T08:13:21.009 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : cephadm-2:19.3.0-5106.g8852379c.el9.noarch 265/288 2024-09-22T08:13:21.044 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5106.g8852379c.e 266/288 2024-09-22T08:13:21.114 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5106.g8852379c. 267/288 2024-09-22T08:13:21.150 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5106.g8852379c.el9.noa 268/288 2024-09-22T08:13:21.413 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5106.g8852379c.el9.noa 268/288 2024-09-22T08:13:21.474 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5106.g8852379c.el9.n 269/288 2024-09-22T08:13:22.486 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5106.g8852379c.el9.n 269/288 2024-09-22T08:13:22.516 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5106.g885 270/288 2024-09-22T08:13:22.638 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5106.g885 270/288 2024-09-22T08:13:22.802 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5106.g8852379c.el 271/288 2024-09-22T08:13:22.827 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 272/288 2024-09-22T08:13:22.852 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 272/288 2024-09-22T08:13:22.852 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:13:22.852 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-22T08:13:22.852 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-22T08:13:22.852 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-22T08:13:22.852 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:22.902 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-rook-2:19.3.0-5106.g8852379c.el9.noarch 273/288 2024-09-22T08:13:22.914 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5106.g8852379c.el9.noarch 273/288 2024-09-22T08:13:22.937 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-2:19.3.0-5106.g8852379c.el9.x86_64 274/288 2024-09-22T08:13:22.966 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 275/288 2024-09-22T08:13:23.016 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 276/288 2024-09-22T08:13:23.055 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-22T08:13:23.071 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-22T08:13:23.071 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-22T08:13:23.071 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:24.098 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-radosgw-2:19.3.0-5106.g8852379c.el9.x86_64 278/288 2024-09-22T08:13:24.125 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5106.g8852379c.el9.x86_64 278/288 2024-09-22T08:13:24.126 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:13:24.126 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-22T08:13:24.126 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-22T08:13:24.126 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-22T08:13:24.126 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:24.166 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5106.g88523 279/288 2024-09-22T08:13:24.193 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5106.g88523 279/288 2024-09-22T08:13:24.193 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:13:24.193 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-22T08:13:24.193 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:24.526 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-mirror-2:19.3.0-5106.g8852379c.el9.x86_64 280/288 2024-09-22T08:13:24.552 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5106.g8852379c.el9.x86_64 280/288 2024-09-22T08:13:24.552 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:13:24.552 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-22T08:13:24.552 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-22T08:13:24.552 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-22T08:13:24.552 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:24.575 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5106.g8852379c.el9.noa 268/288 2024-09-22T08:13:24.632 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5106.g8852379c.el9.n 269/288 2024-09-22T08:13:25.649 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5106.g8852379c.el9.n 269/288 2024-09-22T08:13:25.682 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5106.g885 270/288 2024-09-22T08:13:25.808 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5106.g885 270/288 2024-09-22T08:13:25.977 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5106.g8852379c.el 271/288 2024-09-22T08:13:26.001 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 272/288 2024-09-22T08:13:26.026 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 272/288 2024-09-22T08:13:26.026 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:13:26.026 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-22T08:13:26.027 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-22T08:13:26.027 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-22T08:13:26.027 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:26.077 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-rook-2:19.3.0-5106.g8852379c.el9.noarch 273/288 2024-09-22T08:13:26.089 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5106.g8852379c.el9.noarch 273/288 2024-09-22T08:13:26.111 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-2:19.3.0-5106.g8852379c.el9.x86_64 274/288 2024-09-22T08:13:26.140 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 275/288 2024-09-22T08:13:26.190 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 276/288 2024-09-22T08:13:26.229 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-22T08:13:26.245 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-22T08:13:26.246 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-22T08:13:26.246 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:27.255 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-radosgw-2:19.3.0-5106.g8852379c.el9.x86_64 278/288 2024-09-22T08:13:27.280 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5106.g8852379c.el9.x86_64 278/288 2024-09-22T08:13:27.281 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:13:27.281 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-22T08:13:27.281 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-22T08:13:27.281 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-22T08:13:27.281 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:27.331 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5106.g88523 279/288 2024-09-22T08:13:27.355 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5106.g88523 279/288 2024-09-22T08:13:27.355 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:13:27.355 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-22T08:13:27.356 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:27.681 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-mirror-2:19.3.0-5106.g8852379c.el9.x86_64 280/288 2024-09-22T08:13:27.706 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5106.g8852379c.el9.x86_64 280/288 2024-09-22T08:13:27.707 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:13:27.707 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-22T08:13:27.707 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-22T08:13:27.707 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-22T08:13:27.707 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:29.089 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-test-2:19.3.0-5106.g8852379c.el9.x86_64 281/288 2024-09-22T08:13:29.131 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 282/288 2024-09-22T08:13:29.162 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-nbd-2:19.3.0-5106.g8852379c.el9.x86_64 283/288 2024-09-22T08:13:29.270 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephfs-devel-2:19.3.0-5106.g8852379c.el9.x86_ 284/288 2024-09-22T08:13:29.331 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 285/288 2024-09-22T08:13:29.361 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 286/288 2024-09-22T08:13:29.361 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-22T08:13:29.495 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-22T08:13:29.495 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-22T08:13:29.603 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-22T08:13:29.622 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 288/288 2024-09-22T08:13:29.628 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 288/288 2024-09-22T08:13:29.637 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 288/288 2024-09-22T08:13:29.647 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 288/288 2024-09-22T08:13:29.648 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-22T08:13:29.648 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-22T08:13:29.648 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:29.725 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-22T08:13:29.799 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-22T08:13:32.289 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-test-2:19.3.0-5106.g8852379c.el9.x86_64 281/288 2024-09-22T08:13:32.330 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 282/288 2024-09-22T08:13:32.361 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-nbd-2:19.3.0-5106.g8852379c.el9.x86_64 283/288 2024-09-22T08:13:32.469 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcephfs-devel-2:19.3.0-5106.g8852379c.el9.x86_ 284/288 2024-09-22T08:13:32.531 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 285/288 2024-09-22T08:13:32.569 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 286/288 2024-09-22T08:13:32.569 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-22T08:13:32.670 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-22T08:13:32.670 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-22T08:13:32.752 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-22T08:13:32.775 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 288/288 2024-09-22T08:13:32.782 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 288/288 2024-09-22T08:13:32.792 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 288/288 2024-09-22T08:13:32.803 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 288/288 2024-09-22T08:13:32.803 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-22T08:13:32.803 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-22T08:13:32.803 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:32.868 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-22T08:13:32.941 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-22T08:13:39.942 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-22T08:13:39.942 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-2:19.3.0-5106.g8852379c.el9.x86_64 1/288 2024-09-22T08:13:39.942 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 2/288 2024-09-22T08:13:39.942 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 3/288 2024-09-22T08:13:39.942 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 4/288 2024-09-22T08:13:39.942 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5106.g88523 5/288 2024-09-22T08:13:39.942 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mds-2:19.3.0-5106.g8852379c.el9.x86_64 6/288 2024-09-22T08:13:39.942 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 7/288 2024-09-22T08:13:39.942 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mon-2:19.3.0-5106.g8852379c.el9.x86_64 8/288 2024-09-22T08:13:39.942 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-osd-2:19.3.0-5106.g8852379c.el9.x86_64 9/288 2024-09-22T08:13:39.943 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-radosgw-2:19.3.0-5106.g8852379c.el9.x86_64 10/288 2024-09-22T08:13:39.943 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-selinux-2:19.3.0-5106.g8852379c.el9.x86_64 11/288 2024-09-22T08:13:39.943 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-test-2:19.3.0-5106.g8852379c.el9.x86_64 12/288 2024-09-22T08:13:39.943 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephfs-devel-2:19.3.0-5106.g8852379c.el9.x86_ 13/288 2024-09-22T08:13:39.943 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 14/288 2024-09-22T08:13:39.943 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephsqlite-2:19.3.0-5106.g8852379c.el9.x86_64 15/288 2024-09-22T08:13:39.943 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados-devel-2:19.3.0-5106.g8852379c.el9.x86_6 16/288 2024-09-22T08:13:39.943 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libradosstriper1-2:19.3.0-5106.g8852379c.el9.x86 17/288 2024-09-22T08:13:39.943 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librgw2-2:19.3.0-5106.g8852379c.el9.x86_64 18/288 2024-09-22T08:13:39.943 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5106.g8852379c.el 19/288 2024-09-22T08:13:39.943 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ceph-common-2:19.3.0-5106.g8852379c.el9. 20/288 2024-09-22T08:13:39.944 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cephfs-2:19.3.0-5106.g8852379c.el9.x86_6 21/288 2024-09-22T08:13:39.944 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rados-2:19.3.0-5106.g8852379c.el9.x86_64 22/288 2024-09-22T08:13:39.944 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rbd-2:19.3.0-5106.g8852379c.el9.x86_64 23/288 2024-09-22T08:13:39.944 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rgw-2:19.3.0-5106.g8852379c.el9.x86_64 24/288 2024-09-22T08:13:39.944 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 25/288 2024-09-22T08:13:39.944 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-mirror-2:19.3.0-5106.g8852379c.el9.x86_64 26/288 2024-09-22T08:13:39.944 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-nbd-2:19.3.0-5106.g8852379c.el9.x86_64 27/288 2024-09-22T08:13:39.944 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5106.g8852379c. 28/288 2024-09-22T08:13:39.944 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5106.g8852379c.el9.noa 29/288 2024-09-22T08:13:39.944 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5106.g8852379c.el9.n 30/288 2024-09-22T08:13:39.944 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5106.g885 31/288 2024-09-22T08:13:39.944 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5106.g8852379c.el 32/288 2024-09-22T08:13:39.945 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5106.g8852379c.el9.noarch 33/288 2024-09-22T08:13:39.945 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5106.g8852379c.e 34/288 2024-09-22T08:13:39.945 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-volume-2:19.3.0-5106.g8852379c.el9.noarch 35/288 2024-09-22T08:13:39.945 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephadm-2:19.3.0-5106.g8852379c.el9.noarch 36/288 2024-09-22T08:13:39.945 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/288 2024-09-22T08:13:39.945 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/288 2024-09-22T08:13:39.945 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/288 2024-09-22T08:13:39.945 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/288 2024-09-22T08:13:39.945 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/288 2024-09-22T08:13:39.945 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/288 2024-09-22T08:13:39.945 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/288 2024-09-22T08:13:39.945 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/288 2024-09-22T08:13:39.946 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/288 2024-09-22T08:13:39.946 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/288 2024-09-22T08:13:39.946 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/288 2024-09-22T08:13:39.946 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/288 2024-09-22T08:13:39.946 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/288 2024-09-22T08:13:39.946 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/288 2024-09-22T08:13:39.946 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/288 2024-09-22T08:13:39.946 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/288 2024-09-22T08:13:39.946 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/288 2024-09-22T08:13:39.946 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/288 2024-09-22T08:13:39.946 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/288 2024-09-22T08:13:39.946 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/288 2024-09-22T08:13:39.947 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/288 2024-09-22T08:13:39.947 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/288 2024-09-22T08:13:39.947 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/288 2024-09-22T08:13:39.947 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/288 2024-09-22T08:13:39.947 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/288 2024-09-22T08:13:39.947 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/288 2024-09-22T08:13:39.947 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/288 2024-09-22T08:13:39.947 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/288 2024-09-22T08:13:39.947 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/288 2024-09-22T08:13:39.947 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/288 2024-09-22T08:13:39.947 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/288 2024-09-22T08:13:39.947 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/288 2024-09-22T08:13:39.948 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/288 2024-09-22T08:13:39.948 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/288 2024-09-22T08:13:39.948 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/288 2024-09-22T08:13:39.948 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/288 2024-09-22T08:13:39.948 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/288 2024-09-22T08:13:39.948 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/288 2024-09-22T08:13:39.948 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/288 2024-09-22T08:13:39.948 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/288 2024-09-22T08:13:39.948 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/288 2024-09-22T08:13:39.948 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/288 2024-09-22T08:13:39.948 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/288 2024-09-22T08:13:39.949 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/288 2024-09-22T08:13:39.949 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/288 2024-09-22T08:13:39.949 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/288 2024-09-22T08:13:39.949 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/288 2024-09-22T08:13:39.949 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/288 2024-09-22T08:13:39.949 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/288 2024-09-22T08:13:39.949 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/288 2024-09-22T08:13:39.949 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/288 2024-09-22T08:13:39.949 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/288 2024-09-22T08:13:39.949 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/288 2024-09-22T08:13:39.949 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/288 2024-09-22T08:13:39.949 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : guava-30.1-6.el9.noarch 91/288 2024-09-22T08:13:39.950 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/288 2024-09-22T08:13:39.950 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/288 2024-09-22T08:13:39.950 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/288 2024-09-22T08:13:39.950 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/288 2024-09-22T08:13:39.950 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/288 2024-09-22T08:13:39.950 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/288 2024-09-22T08:13:39.950 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/288 2024-09-22T08:13:39.950 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/288 2024-09-22T08:13:39.950 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/288 2024-09-22T08:13:39.950 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/288 2024-09-22T08:13:39.950 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/288 2024-09-22T08:13:39.950 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/288 2024-09-22T08:13:39.951 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/288 2024-09-22T08:13:39.951 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/288 2024-09-22T08:13:39.951 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/288 2024-09-22T08:13:39.951 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/288 2024-09-22T08:13:39.951 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/288 2024-09-22T08:13:39.951 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/288 2024-09-22T08:13:39.951 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/288 2024-09-22T08:13:39.951 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/288 2024-09-22T08:13:39.951 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/288 2024-09-22T08:13:39.951 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/288 2024-09-22T08:13:39.951 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/288 2024-09-22T08:13:39.951 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/288 2024-09-22T08:13:39.951 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/288 2024-09-22T08:13:39.952 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/288 2024-09-22T08:13:39.952 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/288 2024-09-22T08:13:39.952 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/288 2024-09-22T08:13:39.952 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/288 2024-09-22T08:13:39.952 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/288 2024-09-22T08:13:39.952 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/288 2024-09-22T08:13:39.952 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/288 2024-09-22T08:13:39.952 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/288 2024-09-22T08:13:39.952 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/288 2024-09-22T08:13:39.952 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/288 2024-09-22T08:13:39.952 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/288 2024-09-22T08:13:39.952 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/288 2024-09-22T08:13:39.952 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/288 2024-09-22T08:13:39.953 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/288 2024-09-22T08:13:39.953 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/288 2024-09-22T08:13:39.953 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/288 2024-09-22T08:13:39.953 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 133/288 2024-09-22T08:13:39.953 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 134/288 2024-09-22T08:13:39.953 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 135/288 2024-09-22T08:13:39.953 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 136/288 2024-09-22T08:13:39.953 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 137/288 2024-09-22T08:13:39.953 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 138/288 2024-09-22T08:13:39.953 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 139/288 2024-09-22T08:13:39.953 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libsbc-1.4-9.el9.x86_64 140/288 2024-09-22T08:13:39.953 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 141/288 2024-09-22T08:13:39.954 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 142/288 2024-09-22T08:13:39.954 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 143/288 2024-09-22T08:13:39.954 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 144/288 2024-09-22T08:13:39.954 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 145/288 2024-09-22T08:13:39.954 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 146/288 2024-09-22T08:13:39.954 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 147/288 2024-09-22T08:13:39.954 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 148/288 2024-09-22T08:13:39.954 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 149/288 2024-09-22T08:13:39.954 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 150/288 2024-09-22T08:13:39.954 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 151/288 2024-09-22T08:13:39.954 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 152/288 2024-09-22T08:13:39.954 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 153/288 2024-09-22T08:13:39.955 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 154/288 2024-09-22T08:13:39.955 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 155/288 2024-09-22T08:13:39.955 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 156/288 2024-09-22T08:13:39.955 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lua-5.4.4-4.el9.x86_64 157/288 2024-09-22T08:13:39.955 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 158/288 2024-09-22T08:13:39.955 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 159/288 2024-09-22T08:13:39.955 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 160/288 2024-09-22T08:13:39.955 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 161/288 2024-09-22T08:13:39.955 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 162/288 2024-09-22T08:13:39.955 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 163/288 2024-09-22T08:13:39.955 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 164/288 2024-09-22T08:13:39.955 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 165/288 2024-09-22T08:13:39.955 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 166/288 2024-09-22T08:13:39.956 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 167/288 2024-09-22T08:13:39.956 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 168/288 2024-09-22T08:13:39.956 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 169/288 2024-09-22T08:13:39.956 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 170/288 2024-09-22T08:13:39.956 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 171/288 2024-09-22T08:13:39.956 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 172/288 2024-09-22T08:13:39.956 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 173/288 2024-09-22T08:13:39.956 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 174/288 2024-09-22T08:13:39.956 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : opus-1.3.1-10.el9.x86_64 175/288 2024-09-22T08:13:39.956 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : orc-0.4.31-8.el9.x86_64 176/288 2024-09-22T08:13:39.956 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 177/288 2024-09-22T08:13:39.956 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 178/288 2024-09-22T08:13:39.956 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 179/288 2024-09-22T08:13:39.957 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 180/288 2024-09-22T08:13:39.957 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 181/288 2024-09-22T08:13:39.957 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 182/288 2024-09-22T08:13:39.957 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 183/288 2024-09-22T08:13:39.957 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 184/288 2024-09-22T08:13:39.957 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 185/288 2024-09-22T08:13:39.957 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 186/288 2024-09-22T08:13:39.957 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 187/288 2024-09-22T08:13:39.957 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 188/288 2024-09-22T08:13:39.957 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 189/288 2024-09-22T08:13:39.957 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 190/288 2024-09-22T08:13:39.957 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 191/288 2024-09-22T08:13:39.958 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 192/288 2024-09-22T08:13:39.958 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 193/288 2024-09-22T08:13:39.958 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 194/288 2024-09-22T08:13:39.958 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 195/288 2024-09-22T08:13:39.958 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 196/288 2024-09-22T08:13:39.958 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 197/288 2024-09-22T08:13:39.958 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 198/288 2024-09-22T08:13:39.958 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 199/288 2024-09-22T08:13:39.958 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 200/288 2024-09-22T08:13:39.958 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 201/288 2024-09-22T08:13:39.959 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 202/288 2024-09-22T08:13:39.959 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 203/288 2024-09-22T08:13:39.959 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 204/288 2024-09-22T08:13:39.959 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 205/288 2024-09-22T08:13:39.959 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 206/288 2024-09-22T08:13:39.959 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 207/288 2024-09-22T08:13:39.959 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 208/288 2024-09-22T08:13:39.959 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 209/288 2024-09-22T08:13:39.959 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 210/288 2024-09-22T08:13:39.959 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 211/288 2024-09-22T08:13:39.959 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 212/288 2024-09-22T08:13:39.960 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 213/288 2024-09-22T08:13:39.960 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 214/288 2024-09-22T08:13:39.960 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 215/288 2024-09-22T08:13:39.960 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 216/288 2024-09-22T08:13:39.960 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 217/288 2024-09-22T08:13:39.960 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 218/288 2024-09-22T08:13:39.960 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 219/288 2024-09-22T08:13:39.960 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 220/288 2024-09-22T08:13:39.960 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rtkit-0.11-29.el9.x86_64 221/288 2024-09-22T08:13:39.960 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 222/288 2024-09-22T08:13:39.960 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 223/288 2024-09-22T08:13:39.961 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 224/288 2024-09-22T08:13:39.961 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 225/288 2024-09-22T08:13:39.961 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 226/288 2024-09-22T08:13:39.961 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 227/288 2024-09-22T08:13:39.961 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 228/288 2024-09-22T08:13:39.961 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 229/288 2024-09-22T08:13:39.961 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 230/288 2024-09-22T08:13:39.961 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : upower-0.99.11-11.el9.x86_64 231/288 2024-09-22T08:13:39.961 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 232/288 2024-09-22T08:13:39.961 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 233/288 2024-09-22T08:13:39.961 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 234/288 2024-09-22T08:13:39.961 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 235/288 2024-09-22T08:13:39.962 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 236/288 2024-09-22T08:13:39.962 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 237/288 2024-09-22T08:13:39.962 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 238/288 2024-09-22T08:13:39.962 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 239/288 2024-09-22T08:13:39.962 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 240/288 2024-09-22T08:13:39.962 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 241/288 2024-09-22T08:13:39.962 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 242/288 2024-09-22T08:13:39.962 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 243/288 2024-09-22T08:13:39.962 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 244/288 2024-09-22T08:13:39.962 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 245/288 2024-09-22T08:13:39.962 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 246/288 2024-09-22T08:13:39.962 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 247/288 2024-09-22T08:13:39.963 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 248/288 2024-09-22T08:13:39.963 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 249/288 2024-09-22T08:13:39.963 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 250/288 2024-09-22T08:13:39.963 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 251/288 2024-09-22T08:13:39.963 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 252/288 2024-09-22T08:13:39.963 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 253/288 2024-09-22T08:13:39.963 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 254/288 2024-09-22T08:13:39.963 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 255/288 2024-09-22T08:13:39.963 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 256/288 2024-09-22T08:13:39.963 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 257/288 2024-09-22T08:13:39.963 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 258/288 2024-09-22T08:13:39.964 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 259/288 2024-09-22T08:13:39.964 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 260/288 2024-09-22T08:13:39.964 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 261/288 2024-09-22T08:13:39.964 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 262/288 2024-09-22T08:13:39.964 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 263/288 2024-09-22T08:13:39.964 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 264/288 2024-09-22T08:13:39.964 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 265/288 2024-09-22T08:13:39.964 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 266/288 2024-09-22T08:13:39.964 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 267/288 2024-09-22T08:13:39.964 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 268/288 2024-09-22T08:13:39.964 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 269/288 2024-09-22T08:13:39.965 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 270/288 2024-09-22T08:13:39.965 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 271/288 2024-09-22T08:13:39.965 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 272/288 2024-09-22T08:13:39.965 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 273/288 2024-09-22T08:13:39.965 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 274/288 2024-09-22T08:13:39.965 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 275/288 2024-09-22T08:13:39.965 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 276/288 2024-09-22T08:13:39.965 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 277/288 2024-09-22T08:13:39.965 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 278/288 2024-09-22T08:13:39.965 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 279/288 2024-09-22T08:13:39.965 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 280/288 2024-09-22T08:13:39.965 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 281/288 2024-09-22T08:13:39.966 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : re2-1:20211101-20.el9.x86_64 282/288 2024-09-22T08:13:39.966 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 283/288 2024-09-22T08:13:39.966 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 284/288 2024-09-22T08:13:39.966 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados2-2:19.3.0-5106.g8852379c.el9.x86_64 285/288 2024-09-22T08:13:39.966 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 286/288 2024-09-22T08:13:39.966 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 287/288 2024-09-22T08:13:43.022 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-22T08:13:43.022 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-2:19.3.0-5106.g8852379c.el9.x86_64 1/288 2024-09-22T08:13:43.022 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 2/288 2024-09-22T08:13:43.022 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 3/288 2024-09-22T08:13:43.023 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 4/288 2024-09-22T08:13:43.023 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5106.g88523 5/288 2024-09-22T08:13:43.023 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mds-2:19.3.0-5106.g8852379c.el9.x86_64 6/288 2024-09-22T08:13:43.023 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 7/288 2024-09-22T08:13:43.023 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mon-2:19.3.0-5106.g8852379c.el9.x86_64 8/288 2024-09-22T08:13:43.023 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-osd-2:19.3.0-5106.g8852379c.el9.x86_64 9/288 2024-09-22T08:13:43.023 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-radosgw-2:19.3.0-5106.g8852379c.el9.x86_64 10/288 2024-09-22T08:13:43.023 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-selinux-2:19.3.0-5106.g8852379c.el9.x86_64 11/288 2024-09-22T08:13:43.023 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-test-2:19.3.0-5106.g8852379c.el9.x86_64 12/288 2024-09-22T08:13:43.023 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcephfs-devel-2:19.3.0-5106.g8852379c.el9.x86_ 13/288 2024-09-22T08:13:43.023 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 14/288 2024-09-22T08:13:43.023 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcephsqlite-2:19.3.0-5106.g8852379c.el9.x86_64 15/288 2024-09-22T08:13:43.023 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados-devel-2:19.3.0-5106.g8852379c.el9.x86_6 16/288 2024-09-22T08:13:43.023 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libradosstriper1-2:19.3.0-5106.g8852379c.el9.x86 17/288 2024-09-22T08:13:43.024 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librgw2-2:19.3.0-5106.g8852379c.el9.x86_64 18/288 2024-09-22T08:13:43.024 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5106.g8852379c.el 19/288 2024-09-22T08:13:43.024 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-ceph-common-2:19.3.0-5106.g8852379c.el9. 20/288 2024-09-22T08:13:43.024 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cephfs-2:19.3.0-5106.g8852379c.el9.x86_6 21/288 2024-09-22T08:13:43.024 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rados-2:19.3.0-5106.g8852379c.el9.x86_64 22/288 2024-09-22T08:13:43.024 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rbd-2:19.3.0-5106.g8852379c.el9.x86_64 23/288 2024-09-22T08:13:43.025 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rgw-2:19.3.0-5106.g8852379c.el9.x86_64 24/288 2024-09-22T08:13:43.026 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 25/288 2024-09-22T08:13:43.026 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-mirror-2:19.3.0-5106.g8852379c.el9.x86_64 26/288 2024-09-22T08:13:43.026 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-nbd-2:19.3.0-5106.g8852379c.el9.x86_64 27/288 2024-09-22T08:13:43.026 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5106.g8852379c. 28/288 2024-09-22T08:13:43.026 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5106.g8852379c.el9.noa 29/288 2024-09-22T08:13:43.046 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5106.g8852379c.el9.n 30/288 2024-09-22T08:13:43.046 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5106.g885 31/288 2024-09-22T08:13:43.046 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5106.g8852379c.el 32/288 2024-09-22T08:13:43.046 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5106.g8852379c.el9.noarch 33/288 2024-09-22T08:13:43.046 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5106.g8852379c.e 34/288 2024-09-22T08:13:43.046 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-volume-2:19.3.0-5106.g8852379c.el9.noarch 35/288 2024-09-22T08:13:43.046 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : cephadm-2:19.3.0-5106.g8852379c.el9.noarch 36/288 2024-09-22T08:13:43.046 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/288 2024-09-22T08:13:43.046 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/288 2024-09-22T08:13:43.047 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/288 2024-09-22T08:13:43.047 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/288 2024-09-22T08:13:43.047 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/288 2024-09-22T08:13:43.047 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/288 2024-09-22T08:13:43.047 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/288 2024-09-22T08:13:43.047 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/288 2024-09-22T08:13:43.047 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/288 2024-09-22T08:13:43.047 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/288 2024-09-22T08:13:43.047 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/288 2024-09-22T08:13:43.047 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/288 2024-09-22T08:13:43.047 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/288 2024-09-22T08:13:43.047 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/288 2024-09-22T08:13:43.047 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/288 2024-09-22T08:13:43.048 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/288 2024-09-22T08:13:43.048 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/288 2024-09-22T08:13:43.048 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/288 2024-09-22T08:13:43.048 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/288 2024-09-22T08:13:43.048 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/288 2024-09-22T08:13:43.048 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/288 2024-09-22T08:13:43.048 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/288 2024-09-22T08:13:43.048 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/288 2024-09-22T08:13:43.048 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/288 2024-09-22T08:13:43.048 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/288 2024-09-22T08:13:43.048 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/288 2024-09-22T08:13:43.048 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/288 2024-09-22T08:13:43.048 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/288 2024-09-22T08:13:43.048 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/288 2024-09-22T08:13:43.048 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/288 2024-09-22T08:13:43.049 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/288 2024-09-22T08:13:43.049 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/288 2024-09-22T08:13:43.049 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/288 2024-09-22T08:13:43.049 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/288 2024-09-22T08:13:43.049 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/288 2024-09-22T08:13:43.049 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/288 2024-09-22T08:13:43.049 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/288 2024-09-22T08:13:43.049 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/288 2024-09-22T08:13:43.049 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/288 2024-09-22T08:13:43.049 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/288 2024-09-22T08:13:43.049 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/288 2024-09-22T08:13:43.049 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/288 2024-09-22T08:13:43.049 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/288 2024-09-22T08:13:43.050 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/288 2024-09-22T08:13:43.050 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/288 2024-09-22T08:13:43.050 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/288 2024-09-22T08:13:43.050 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/288 2024-09-22T08:13:43.050 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/288 2024-09-22T08:13:43.050 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/288 2024-09-22T08:13:43.050 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/288 2024-09-22T08:13:43.050 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/288 2024-09-22T08:13:43.050 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/288 2024-09-22T08:13:43.050 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/288 2024-09-22T08:13:43.050 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/288 2024-09-22T08:13:43.050 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : guava-30.1-6.el9.noarch 91/288 2024-09-22T08:13:43.050 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/288 2024-09-22T08:13:43.050 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/288 2024-09-22T08:13:43.050 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/288 2024-09-22T08:13:43.051 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/288 2024-09-22T08:13:43.051 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/288 2024-09-22T08:13:43.051 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/288 2024-09-22T08:13:43.051 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/288 2024-09-22T08:13:43.051 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/288 2024-09-22T08:13:43.051 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/288 2024-09-22T08:13:43.051 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/288 2024-09-22T08:13:43.051 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/288 2024-09-22T08:13:43.051 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/288 2024-09-22T08:13:43.051 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/288 2024-09-22T08:13:43.051 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/288 2024-09-22T08:13:43.051 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/288 2024-09-22T08:13:43.051 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/288 2024-09-22T08:13:43.052 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/288 2024-09-22T08:13:43.052 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/288 2024-09-22T08:13:43.052 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/288 2024-09-22T08:13:43.052 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/288 2024-09-22T08:13:43.052 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/288 2024-09-22T08:13:43.052 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/288 2024-09-22T08:13:43.052 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/288 2024-09-22T08:13:43.052 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/288 2024-09-22T08:13:43.052 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/288 2024-09-22T08:13:43.052 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/288 2024-09-22T08:13:43.052 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/288 2024-09-22T08:13:43.052 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/288 2024-09-22T08:13:43.052 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/288 2024-09-22T08:13:43.052 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/288 2024-09-22T08:13:43.052 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/288 2024-09-22T08:13:43.053 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/288 2024-09-22T08:13:43.053 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/288 2024-09-22T08:13:43.053 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/288 2024-09-22T08:13:43.053 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/288 2024-09-22T08:13:43.053 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/288 2024-09-22T08:13:43.053 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/288 2024-09-22T08:13:43.053 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/288 2024-09-22T08:13:43.053 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/288 2024-09-22T08:13:43.053 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/288 2024-09-22T08:13:43.053 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/288 2024-09-22T08:13:43.053 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 133/288 2024-09-22T08:13:43.053 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 134/288 2024-09-22T08:13:43.053 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 135/288 2024-09-22T08:13:43.053 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 136/288 2024-09-22T08:13:43.054 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 137/288 2024-09-22T08:13:43.054 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 138/288 2024-09-22T08:13:43.054 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 139/288 2024-09-22T08:13:43.054 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libsbc-1.4-9.el9.x86_64 140/288 2024-09-22T08:13:43.054 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 141/288 2024-09-22T08:13:43.054 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 142/288 2024-09-22T08:13:43.054 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 143/288 2024-09-22T08:13:43.054 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 144/288 2024-09-22T08:13:43.054 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 145/288 2024-09-22T08:13:43.054 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 146/288 2024-09-22T08:13:43.054 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 147/288 2024-09-22T08:13:43.054 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 148/288 2024-09-22T08:13:43.054 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 149/288 2024-09-22T08:13:43.054 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 150/288 2024-09-22T08:13:43.055 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 151/288 2024-09-22T08:13:43.055 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 152/288 2024-09-22T08:13:43.055 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 153/288 2024-09-22T08:13:43.055 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 154/288 2024-09-22T08:13:43.055 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 155/288 2024-09-22T08:13:43.055 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 156/288 2024-09-22T08:13:43.055 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : lua-5.4.4-4.el9.x86_64 157/288 2024-09-22T08:13:43.055 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 158/288 2024-09-22T08:13:43.055 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 159/288 2024-09-22T08:13:43.055 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 160/288 2024-09-22T08:13:43.055 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 161/288 2024-09-22T08:13:43.055 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 162/288 2024-09-22T08:13:43.055 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 163/288 2024-09-22T08:13:43.055 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 164/288 2024-09-22T08:13:43.055 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 165/288 2024-09-22T08:13:43.056 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 166/288 2024-09-22T08:13:43.056 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 167/288 2024-09-22T08:13:43.056 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 168/288 2024-09-22T08:13:43.056 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 169/288 2024-09-22T08:13:43.056 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 170/288 2024-09-22T08:13:43.056 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 171/288 2024-09-22T08:13:43.056 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 172/288 2024-09-22T08:13:43.056 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 173/288 2024-09-22T08:13:43.056 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 174/288 2024-09-22T08:13:43.056 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : opus-1.3.1-10.el9.x86_64 175/288 2024-09-22T08:13:43.056 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : orc-0.4.31-8.el9.x86_64 176/288 2024-09-22T08:13:43.056 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 177/288 2024-09-22T08:13:43.056 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 178/288 2024-09-22T08:13:43.057 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 179/288 2024-09-22T08:13:43.057 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 180/288 2024-09-22T08:13:43.057 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 181/288 2024-09-22T08:13:43.057 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 182/288 2024-09-22T08:13:43.057 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 183/288 2024-09-22T08:13:43.057 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 184/288 2024-09-22T08:13:43.057 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 185/288 2024-09-22T08:13:43.057 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 186/288 2024-09-22T08:13:43.057 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 187/288 2024-09-22T08:13:43.057 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 188/288 2024-09-22T08:13:43.057 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 189/288 2024-09-22T08:13:43.057 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 190/288 2024-09-22T08:13:43.057 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 191/288 2024-09-22T08:13:43.057 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 192/288 2024-09-22T08:13:43.057 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 193/288 2024-09-22T08:13:43.057 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 194/288 2024-09-22T08:13:43.058 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 195/288 2024-09-22T08:13:43.058 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 196/288 2024-09-22T08:13:43.058 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 197/288 2024-09-22T08:13:43.058 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 198/288 2024-09-22T08:13:43.058 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 199/288 2024-09-22T08:13:43.058 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 200/288 2024-09-22T08:13:43.058 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 201/288 2024-09-22T08:13:43.058 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 202/288 2024-09-22T08:13:43.058 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 203/288 2024-09-22T08:13:43.058 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 204/288 2024-09-22T08:13:43.058 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 205/288 2024-09-22T08:13:43.058 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 206/288 2024-09-22T08:13:43.058 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 207/288 2024-09-22T08:13:43.058 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 208/288 2024-09-22T08:13:43.058 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 209/288 2024-09-22T08:13:43.059 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 210/288 2024-09-22T08:13:43.059 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 211/288 2024-09-22T08:13:43.059 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 212/288 2024-09-22T08:13:43.059 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 213/288 2024-09-22T08:13:43.059 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 214/288 2024-09-22T08:13:43.059 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 215/288 2024-09-22T08:13:43.059 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 216/288 2024-09-22T08:13:43.059 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 217/288 2024-09-22T08:13:43.059 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 218/288 2024-09-22T08:13:43.059 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 219/288 2024-09-22T08:13:43.059 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 220/288 2024-09-22T08:13:43.059 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rtkit-0.11-29.el9.x86_64 221/288 2024-09-22T08:13:43.059 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 222/288 2024-09-22T08:13:43.059 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 223/288 2024-09-22T08:13:43.059 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 224/288 2024-09-22T08:13:43.060 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 225/288 2024-09-22T08:13:43.060 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 226/288 2024-09-22T08:13:43.060 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 227/288 2024-09-22T08:13:43.060 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 228/288 2024-09-22T08:13:43.060 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 229/288 2024-09-22T08:13:43.060 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 230/288 2024-09-22T08:13:43.060 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : upower-0.99.11-11.el9.x86_64 231/288 2024-09-22T08:13:43.060 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 232/288 2024-09-22T08:13:43.060 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 233/288 2024-09-22T08:13:43.060 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 234/288 2024-09-22T08:13:43.060 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 235/288 2024-09-22T08:13:43.060 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 236/288 2024-09-22T08:13:43.060 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 237/288 2024-09-22T08:13:43.061 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 238/288 2024-09-22T08:13:43.061 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 239/288 2024-09-22T08:13:43.061 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 240/288 2024-09-22T08:13:43.061 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 241/288 2024-09-22T08:13:43.061 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 242/288 2024-09-22T08:13:43.061 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 243/288 2024-09-22T08:13:43.061 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 244/288 2024-09-22T08:13:43.061 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 245/288 2024-09-22T08:13:43.061 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 246/288 2024-09-22T08:13:43.061 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 247/288 2024-09-22T08:13:43.061 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 248/288 2024-09-22T08:13:43.061 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 249/288 2024-09-22T08:13:43.061 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 250/288 2024-09-22T08:13:43.061 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 251/288 2024-09-22T08:13:43.062 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 252/288 2024-09-22T08:13:43.062 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 253/288 2024-09-22T08:13:43.062 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 254/288 2024-09-22T08:13:43.062 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 255/288 2024-09-22T08:13:43.062 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 256/288 2024-09-22T08:13:43.062 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 257/288 2024-09-22T08:13:43.062 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 258/288 2024-09-22T08:13:43.062 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 259/288 2024-09-22T08:13:43.062 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 260/288 2024-09-22T08:13:43.062 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 261/288 2024-09-22T08:13:43.062 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 262/288 2024-09-22T08:13:43.062 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 263/288 2024-09-22T08:13:43.063 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 264/288 2024-09-22T08:13:43.063 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 265/288 2024-09-22T08:13:43.063 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 266/288 2024-09-22T08:13:43.063 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 267/288 2024-09-22T08:13:43.063 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 268/288 2024-09-22T08:13:43.063 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 269/288 2024-09-22T08:13:43.063 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 270/288 2024-09-22T08:13:43.063 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 271/288 2024-09-22T08:13:43.063 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 272/288 2024-09-22T08:13:43.063 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 273/288 2024-09-22T08:13:43.063 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 274/288 2024-09-22T08:13:43.063 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 275/288 2024-09-22T08:13:43.063 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 276/288 2024-09-22T08:13:43.063 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 277/288 2024-09-22T08:13:43.063 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 278/288 2024-09-22T08:13:43.064 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 279/288 2024-09-22T08:13:43.064 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 280/288 2024-09-22T08:13:43.064 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 281/288 2024-09-22T08:13:43.064 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : re2-1:20211101-20.el9.x86_64 282/288 2024-09-22T08:13:43.064 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 283/288 2024-09-22T08:13:43.064 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 284/288 2024-09-22T08:13:43.064 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados2-2:19.3.0-5106.g8852379c.el9.x86_64 285/288 2024-09-22T08:13:43.064 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 286/288 2024-09-22T08:13:43.064 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 287/288 2024-09-22T08:13:43.452 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 288/288 2024-09-22T08:13:43.452 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:43.453 INFO:teuthology.orchestra.run.smithi042.stdout:Upgraded: 2024-09-22T08:13:43.453 INFO:teuthology.orchestra.run.smithi042.stdout: librados2-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:43.453 INFO:teuthology.orchestra.run.smithi042.stdout: librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:43.453 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-09-22T08:13:43.453 INFO:teuthology.orchestra.run.smithi042.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-22T08:13:43.453 INFO:teuthology.orchestra.run.smithi042.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-22T08:13:43.453 INFO:teuthology.orchestra.run.smithi042.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-22T08:13:43.453 INFO:teuthology.orchestra.run.smithi042.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-22T08:13:43.453 INFO:teuthology.orchestra.run.smithi042.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-22T08:13:43.453 INFO:teuthology.orchestra.run.smithi042.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-22T08:13:43.453 INFO:teuthology.orchestra.run.smithi042.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-22T08:13:43.453 INFO:teuthology.orchestra.run.smithi042.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-22T08:13:43.453 INFO:teuthology.orchestra.run.smithi042.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-22T08:13:43.453 INFO:teuthology.orchestra.run.smithi042.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-22T08:13:43.453 INFO:teuthology.orchestra.run.smithi042.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-22T08:13:43.454 INFO:teuthology.orchestra.run.smithi042.stdout: atinject-1.0.3-6.el9.noarch 2024-09-22T08:13:43.454 INFO:teuthology.orchestra.run.smithi042.stdout: atk-2.36.0-5.el9.x86_64 2024-09-22T08:13:43.454 INFO:teuthology.orchestra.run.smithi042.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-22T08:13:43.454 INFO:teuthology.orchestra.run.smithi042.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-22T08:13:43.454 INFO:teuthology.orchestra.run.smithi042.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-22T08:13:43.454 INFO:teuthology.orchestra.run.smithi042.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-22T08:13:43.454 INFO:teuthology.orchestra.run.smithi042.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-22T08:13:43.454 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:43.454 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:43.454 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:43.454 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:43.454 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-grafana-dashboards-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:13:43.454 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-immutable-object-cache-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:43.454 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mds-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:43.455 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:43.455 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-cephadm-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:13:43.455 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-dashboard-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:13:43.455 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:13:43.455 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-modules-core-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:13:43.455 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-rook-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:13:43.455 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mon-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:43.455 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-osd-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:43.455 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-prometheus-alerts-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:13:43.455 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-radosgw-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:43.455 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-selinux-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:43.455 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-test-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:43.455 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-volume-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:13:43.456 INFO:teuthology.orchestra.run.smithi042.stdout: cephadm-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:13:43.456 INFO:teuthology.orchestra.run.smithi042.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-22T08:13:43.456 INFO:teuthology.orchestra.run.smithi042.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-22T08:13:43.456 INFO:teuthology.orchestra.run.smithi042.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-22T08:13:43.456 INFO:teuthology.orchestra.run.smithi042.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-22T08:13:43.456 INFO:teuthology.orchestra.run.smithi042.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-22T08:13:43.456 INFO:teuthology.orchestra.run.smithi042.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-22T08:13:43.456 INFO:teuthology.orchestra.run.smithi042.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-22T08:13:43.456 INFO:teuthology.orchestra.run.smithi042.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-22T08:13:43.456 INFO:teuthology.orchestra.run.smithi042.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-22T08:13:43.456 INFO:teuthology.orchestra.run.smithi042.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-22T08:13:43.456 INFO:teuthology.orchestra.run.smithi042.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-22T08:13:43.456 INFO:teuthology.orchestra.run.smithi042.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-22T08:13:43.456 INFO:teuthology.orchestra.run.smithi042.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-22T08:13:43.456 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-22T08:13:43.457 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-22T08:13:43.457 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-22T08:13:43.457 INFO:teuthology.orchestra.run.smithi042.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-22T08:13:43.457 INFO:teuthology.orchestra.run.smithi042.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-22T08:13:43.457 INFO:teuthology.orchestra.run.smithi042.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-22T08:13:43.457 INFO:teuthology.orchestra.run.smithi042.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-22T08:13:43.457 INFO:teuthology.orchestra.run.smithi042.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-22T08:13:43.457 INFO:teuthology.orchestra.run.smithi042.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-22T08:13:43.457 INFO:teuthology.orchestra.run.smithi042.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-22T08:13:43.457 INFO:teuthology.orchestra.run.smithi042.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-22T08:13:43.457 INFO:teuthology.orchestra.run.smithi042.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-22T08:13:43.457 INFO:teuthology.orchestra.run.smithi042.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-22T08:13:43.457 INFO:teuthology.orchestra.run.smithi042.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-22T08:13:43.458 INFO:teuthology.orchestra.run.smithi042.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-22T08:13:43.458 INFO:teuthology.orchestra.run.smithi042.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-22T08:13:43.458 INFO:teuthology.orchestra.run.smithi042.stdout: guava-30.1-6.el9.noarch 2024-09-22T08:13:43.458 INFO:teuthology.orchestra.run.smithi042.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-22T08:13:43.458 INFO:teuthology.orchestra.run.smithi042.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-22T08:13:43.458 INFO:teuthology.orchestra.run.smithi042.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-22T08:13:43.458 INFO:teuthology.orchestra.run.smithi042.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-22T08:13:43.458 INFO:teuthology.orchestra.run.smithi042.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-22T08:13:43.458 INFO:teuthology.orchestra.run.smithi042.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-22T08:13:43.458 INFO:teuthology.orchestra.run.smithi042.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-22T08:13:43.458 INFO:teuthology.orchestra.run.smithi042.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-22T08:13:43.458 INFO:teuthology.orchestra.run.smithi042.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-22T08:13:43.458 INFO:teuthology.orchestra.run.smithi042.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-22T08:13:43.458 INFO:teuthology.orchestra.run.smithi042.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-22T08:13:43.459 INFO:teuthology.orchestra.run.smithi042.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-22T08:13:43.459 INFO:teuthology.orchestra.run.smithi042.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-22T08:13:43.459 INFO:teuthology.orchestra.run.smithi042.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-22T08:13:43.459 INFO:teuthology.orchestra.run.smithi042.stdout: lcms2-2.12-3.el9.x86_64 2024-09-22T08:13:43.459 INFO:teuthology.orchestra.run.smithi042.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-22T08:13:43.459 INFO:teuthology.orchestra.run.smithi042.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-22T08:13:43.459 INFO:teuthology.orchestra.run.smithi042.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-22T08:13:43.459 INFO:teuthology.orchestra.run.smithi042.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-22T08:13:43.459 INFO:teuthology.orchestra.run.smithi042.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-22T08:13:43.459 INFO:teuthology.orchestra.run.smithi042.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-22T08:13:43.459 INFO:teuthology.orchestra.run.smithi042.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-22T08:13:43.459 INFO:teuthology.orchestra.run.smithi042.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-22T08:13:43.459 INFO:teuthology.orchestra.run.smithi042.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-22T08:13:43.459 INFO:teuthology.orchestra.run.smithi042.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-22T08:13:43.459 INFO:teuthology.orchestra.run.smithi042.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-22T08:13:43.460 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-22T08:13:43.460 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-22T08:13:43.460 INFO:teuthology.orchestra.run.smithi042.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-22T08:13:43.460 INFO:teuthology.orchestra.run.smithi042.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-22T08:13:43.460 INFO:teuthology.orchestra.run.smithi042.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-22T08:13:43.460 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs-devel-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:43.460 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:43.460 INFO:teuthology.orchestra.run.smithi042.stdout: libcephsqlite-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:43.460 INFO:teuthology.orchestra.run.smithi042.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-22T08:13:43.460 INFO:teuthology.orchestra.run.smithi042.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-22T08:13:43.460 INFO:teuthology.orchestra.run.smithi042.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-22T08:13:43.460 INFO:teuthology.orchestra.run.smithi042.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-22T08:13:43.460 INFO:teuthology.orchestra.run.smithi042.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-22T08:13:43.460 INFO:teuthology.orchestra.run.smithi042.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-22T08:13:43.461 INFO:teuthology.orchestra.run.smithi042.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-22T08:13:43.461 INFO:teuthology.orchestra.run.smithi042.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-22T08:13:43.461 INFO:teuthology.orchestra.run.smithi042.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-22T08:13:43.461 INFO:teuthology.orchestra.run.smithi042.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-22T08:13:43.461 INFO:teuthology.orchestra.run.smithi042.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-22T08:13:43.461 INFO:teuthology.orchestra.run.smithi042.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-22T08:13:43.461 INFO:teuthology.orchestra.run.smithi042.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-22T08:13:43.461 INFO:teuthology.orchestra.run.smithi042.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-22T08:13:43.461 INFO:teuthology.orchestra.run.smithi042.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-22T08:13:43.461 INFO:teuthology.orchestra.run.smithi042.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-22T08:13:43.461 INFO:teuthology.orchestra.run.smithi042.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-22T08:13:43.461 INFO:teuthology.orchestra.run.smithi042.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-22T08:13:43.461 INFO:teuthology.orchestra.run.smithi042.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-22T08:13:43.461 INFO:teuthology.orchestra.run.smithi042.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-22T08:13:43.461 INFO:teuthology.orchestra.run.smithi042.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-22T08:13:43.461 INFO:teuthology.orchestra.run.smithi042.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-22T08:13:43.462 INFO:teuthology.orchestra.run.smithi042.stdout: librados-devel-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:43.462 INFO:teuthology.orchestra.run.smithi042.stdout: libradosstriper1-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:43.462 INFO:teuthology.orchestra.run.smithi042.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-22T08:13:43.462 INFO:teuthology.orchestra.run.smithi042.stdout: librgw2-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:43.462 INFO:teuthology.orchestra.run.smithi042.stdout: libsbc-1.4-9.el9.x86_64 2024-09-22T08:13:43.462 INFO:teuthology.orchestra.run.smithi042.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-22T08:13:43.462 INFO:teuthology.orchestra.run.smithi042.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-22T08:13:43.462 INFO:teuthology.orchestra.run.smithi042.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-22T08:13:43.462 INFO:teuthology.orchestra.run.smithi042.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-22T08:13:43.462 INFO:teuthology.orchestra.run.smithi042.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-22T08:13:43.462 INFO:teuthology.orchestra.run.smithi042.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-22T08:13:43.462 INFO:teuthology.orchestra.run.smithi042.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-22T08:13:43.462 INFO:teuthology.orchestra.run.smithi042.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-22T08:13:43.462 INFO:teuthology.orchestra.run.smithi042.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-22T08:13:43.462 INFO:teuthology.orchestra.run.smithi042.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-22T08:13:43.463 INFO:teuthology.orchestra.run.smithi042.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-22T08:13:43.463 INFO:teuthology.orchestra.run.smithi042.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-22T08:13:43.463 INFO:teuthology.orchestra.run.smithi042.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-22T08:13:43.463 INFO:teuthology.orchestra.run.smithi042.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-22T08:13:43.463 INFO:teuthology.orchestra.run.smithi042.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-22T08:13:43.463 INFO:teuthology.orchestra.run.smithi042.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-22T08:13:43.463 INFO:teuthology.orchestra.run.smithi042.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-22T08:13:43.463 INFO:teuthology.orchestra.run.smithi042.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-22T08:13:43.463 INFO:teuthology.orchestra.run.smithi042.stdout: lua-5.4.4-4.el9.x86_64 2024-09-22T08:13:43.463 INFO:teuthology.orchestra.run.smithi042.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-22T08:13:43.463 INFO:teuthology.orchestra.run.smithi042.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-22T08:13:43.463 INFO:teuthology.orchestra.run.smithi042.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-22T08:13:43.463 INFO:teuthology.orchestra.run.smithi042.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-22T08:13:43.464 INFO:teuthology.orchestra.run.smithi042.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-22T08:13:43.464 INFO:teuthology.orchestra.run.smithi042.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-22T08:13:43.464 INFO:teuthology.orchestra.run.smithi042.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-22T08:13:43.464 INFO:teuthology.orchestra.run.smithi042.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-22T08:13:43.464 INFO:teuthology.orchestra.run.smithi042.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-22T08:13:43.464 INFO:teuthology.orchestra.run.smithi042.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-22T08:13:43.464 INFO:teuthology.orchestra.run.smithi042.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-22T08:13:43.464 INFO:teuthology.orchestra.run.smithi042.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-22T08:13:43.464 INFO:teuthology.orchestra.run.smithi042.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-22T08:13:43.464 INFO:teuthology.orchestra.run.smithi042.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-22T08:13:43.464 INFO:teuthology.orchestra.run.smithi042.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-22T08:13:43.464 INFO:teuthology.orchestra.run.smithi042.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-22T08:13:43.464 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-22T08:13:43.464 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-22T08:13:43.464 INFO:teuthology.orchestra.run.smithi042.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-22T08:13:43.465 INFO:teuthology.orchestra.run.smithi042.stdout: opus-1.3.1-10.el9.x86_64 2024-09-22T08:13:43.465 INFO:teuthology.orchestra.run.smithi042.stdout: orc-0.4.31-8.el9.x86_64 2024-09-22T08:13:43.465 INFO:teuthology.orchestra.run.smithi042.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-22T08:13:43.465 INFO:teuthology.orchestra.run.smithi042.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-22T08:13:43.465 INFO:teuthology.orchestra.run.smithi042.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-22T08:13:43.465 INFO:teuthology.orchestra.run.smithi042.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-22T08:13:43.465 INFO:teuthology.orchestra.run.smithi042.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-22T08:13:43.465 INFO:teuthology.orchestra.run.smithi042.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-22T08:13:43.465 INFO:teuthology.orchestra.run.smithi042.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-22T08:13:43.465 INFO:teuthology.orchestra.run.smithi042.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-22T08:13:43.465 INFO:teuthology.orchestra.run.smithi042.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-22T08:13:43.465 INFO:teuthology.orchestra.run.smithi042.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-22T08:13:43.465 INFO:teuthology.orchestra.run.smithi042.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-22T08:13:43.465 INFO:teuthology.orchestra.run.smithi042.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-22T08:13:43.465 INFO:teuthology.orchestra.run.smithi042.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-22T08:13:43.466 INFO:teuthology.orchestra.run.smithi042.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-22T08:13:43.466 INFO:teuthology.orchestra.run.smithi042.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-22T08:13:43.466 INFO:teuthology.orchestra.run.smithi042.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-22T08:13:43.466 INFO:teuthology.orchestra.run.smithi042.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-22T08:13:43.466 INFO:teuthology.orchestra.run.smithi042.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-22T08:13:43.466 INFO:teuthology.orchestra.run.smithi042.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-22T08:13:43.466 INFO:teuthology.orchestra.run.smithi042.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-22T08:13:43.466 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-22T08:13:43.466 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-22T08:13:43.466 INFO:teuthology.orchestra.run.smithi042.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-22T08:13:43.466 INFO:teuthology.orchestra.run.smithi042.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-22T08:13:43.466 INFO:teuthology.orchestra.run.smithi042.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-22T08:13:43.466 INFO:teuthology.orchestra.run.smithi042.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-22T08:13:43.466 INFO:teuthology.orchestra.run.smithi042.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-22T08:13:43.467 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-22T08:13:43.467 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-argparse-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:43.467 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:43.467 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cephfs-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:43.467 INFO:teuthology.orchestra.run.smithi042.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-22T08:13:43.467 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-22T08:13:43.467 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-22T08:13:43.467 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-22T08:13:43.467 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-22T08:13:43.467 INFO:teuthology.orchestra.run.smithi042.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-22T08:13:43.467 INFO:teuthology.orchestra.run.smithi042.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-22T08:13:43.467 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-22T08:13:43.467 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-22T08:13:43.467 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-22T08:13:43.468 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-22T08:13:43.468 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-22T08:13:43.468 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-22T08:13:43.468 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-22T08:13:43.468 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-22T08:13:43.468 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-22T08:13:43.468 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-22T08:13:43.468 INFO:teuthology.orchestra.run.smithi042.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-22T08:13:43.468 INFO:teuthology.orchestra.run.smithi042.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-22T08:13:43.468 INFO:teuthology.orchestra.run.smithi042.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-22T08:13:43.468 INFO:teuthology.orchestra.run.smithi042.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-22T08:13:43.468 INFO:teuthology.orchestra.run.smithi042.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-22T08:13:43.468 INFO:teuthology.orchestra.run.smithi042.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-22T08:13:43.468 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-22T08:13:43.469 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-22T08:13:43.469 INFO:teuthology.orchestra.run.smithi042.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-22T08:13:43.469 INFO:teuthology.orchestra.run.smithi042.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-22T08:13:43.469 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-22T08:13:43.469 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ply-3.11-14.el9.noarch 2024-09-22T08:13:43.469 INFO:teuthology.orchestra.run.smithi042.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-22T08:13:43.469 INFO:teuthology.orchestra.run.smithi042.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-22T08:13:43.469 INFO:teuthology.orchestra.run.smithi042.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-22T08:13:43.469 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-22T08:13:43.469 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-22T08:13:43.469 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-22T08:13:43.469 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-22T08:13:43.469 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-22T08:13:43.469 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rados-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:43.469 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rbd-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:43.470 INFO:teuthology.orchestra.run.smithi042.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-22T08:13:43.470 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-22T08:13:43.470 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-22T08:13:43.470 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rgw-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:43.470 INFO:teuthology.orchestra.run.smithi042.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-22T08:13:43.470 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-22T08:13:43.470 INFO:teuthology.orchestra.run.smithi042.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-22T08:13:43.470 INFO:teuthology.orchestra.run.smithi042.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-22T08:13:43.470 INFO:teuthology.orchestra.run.smithi042.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-22T08:13:43.470 INFO:teuthology.orchestra.run.smithi042.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-22T08:13:43.470 INFO:teuthology.orchestra.run.smithi042.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-22T08:13:43.470 INFO:teuthology.orchestra.run.smithi042.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-22T08:13:43.470 INFO:teuthology.orchestra.run.smithi042.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-22T08:13:43.470 INFO:teuthology.orchestra.run.smithi042.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-22T08:13:43.470 INFO:teuthology.orchestra.run.smithi042.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-22T08:13:43.471 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-22T08:13:43.471 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-22T08:13:43.471 INFO:teuthology.orchestra.run.smithi042.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-22T08:13:43.471 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:43.471 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-mirror-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:43.471 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-nbd-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:43.471 INFO:teuthology.orchestra.run.smithi042.stdout: re2-1:20211101-20.el9.x86_64 2024-09-22T08:13:43.471 INFO:teuthology.orchestra.run.smithi042.stdout: rtkit-0.11-29.el9.x86_64 2024-09-22T08:13:43.471 INFO:teuthology.orchestra.run.smithi042.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-22T08:13:43.471 INFO:teuthology.orchestra.run.smithi042.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-22T08:13:43.471 INFO:teuthology.orchestra.run.smithi042.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-22T08:13:43.471 INFO:teuthology.orchestra.run.smithi042.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-22T08:13:43.471 INFO:teuthology.orchestra.run.smithi042.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-22T08:13:43.471 INFO:teuthology.orchestra.run.smithi042.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-22T08:13:43.472 INFO:teuthology.orchestra.run.smithi042.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-22T08:13:43.472 INFO:teuthology.orchestra.run.smithi042.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-22T08:13:43.472 INFO:teuthology.orchestra.run.smithi042.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-22T08:13:43.472 INFO:teuthology.orchestra.run.smithi042.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-22T08:13:43.472 INFO:teuthology.orchestra.run.smithi042.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-22T08:13:43.472 INFO:teuthology.orchestra.run.smithi042.stdout: upower-0.99.11-11.el9.x86_64 2024-09-22T08:13:43.472 INFO:teuthology.orchestra.run.smithi042.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-22T08:13:43.472 INFO:teuthology.orchestra.run.smithi042.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-22T08:13:43.472 INFO:teuthology.orchestra.run.smithi042.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-22T08:13:43.472 INFO:teuthology.orchestra.run.smithi042.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-22T08:13:43.472 INFO:teuthology.orchestra.run.smithi042.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-22T08:13:43.472 INFO:teuthology.orchestra.run.smithi042.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-22T08:13:43.472 INFO:teuthology.orchestra.run.smithi042.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-22T08:13:43.472 INFO:teuthology.orchestra.run.smithi042.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-22T08:13:43.473 INFO:teuthology.orchestra.run.smithi042.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-22T08:13:43.473 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:43.473 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-09-22T08:13:44.005 DEBUG:teuthology.parallel:result is None 2024-09-22T08:13:46.493 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 288/288 2024-09-22T08:13:46.493 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:46.493 INFO:teuthology.orchestra.run.smithi038.stdout:Upgraded: 2024-09-22T08:13:46.493 INFO:teuthology.orchestra.run.smithi038.stdout: librados2-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:46.494 INFO:teuthology.orchestra.run.smithi038.stdout: librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:46.494 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-09-22T08:13:46.494 INFO:teuthology.orchestra.run.smithi038.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-22T08:13:46.494 INFO:teuthology.orchestra.run.smithi038.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-22T08:13:46.494 INFO:teuthology.orchestra.run.smithi038.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-22T08:13:46.494 INFO:teuthology.orchestra.run.smithi038.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-22T08:13:46.494 INFO:teuthology.orchestra.run.smithi038.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-22T08:13:46.494 INFO:teuthology.orchestra.run.smithi038.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-22T08:13:46.494 INFO:teuthology.orchestra.run.smithi038.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-22T08:13:46.494 INFO:teuthology.orchestra.run.smithi038.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-22T08:13:46.494 INFO:teuthology.orchestra.run.smithi038.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-22T08:13:46.494 INFO:teuthology.orchestra.run.smithi038.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-22T08:13:46.495 INFO:teuthology.orchestra.run.smithi038.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-22T08:13:46.495 INFO:teuthology.orchestra.run.smithi038.stdout: atinject-1.0.3-6.el9.noarch 2024-09-22T08:13:46.495 INFO:teuthology.orchestra.run.smithi038.stdout: atk-2.36.0-5.el9.x86_64 2024-09-22T08:13:46.495 INFO:teuthology.orchestra.run.smithi038.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-22T08:13:46.495 INFO:teuthology.orchestra.run.smithi038.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-22T08:13:46.495 INFO:teuthology.orchestra.run.smithi038.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-22T08:13:46.495 INFO:teuthology.orchestra.run.smithi038.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-22T08:13:46.495 INFO:teuthology.orchestra.run.smithi038.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-22T08:13:46.495 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:46.495 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:46.495 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:46.495 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:46.495 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-grafana-dashboards-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:13:46.495 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-immutable-object-cache-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:46.496 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mds-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:46.496 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:46.496 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-cephadm-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:13:46.496 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-dashboard-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:13:46.496 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:13:46.496 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-modules-core-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:13:46.496 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-rook-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:13:46.496 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mon-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:46.496 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-osd-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:46.496 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-prometheus-alerts-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:13:46.496 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-radosgw-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:46.496 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-selinux-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:46.496 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-test-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:46.496 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-volume-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:13:46.497 INFO:teuthology.orchestra.run.smithi038.stdout: cephadm-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:13:46.497 INFO:teuthology.orchestra.run.smithi038.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-22T08:13:46.497 INFO:teuthology.orchestra.run.smithi038.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-22T08:13:46.497 INFO:teuthology.orchestra.run.smithi038.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-22T08:13:46.497 INFO:teuthology.orchestra.run.smithi038.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-22T08:13:46.497 INFO:teuthology.orchestra.run.smithi038.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-22T08:13:46.497 INFO:teuthology.orchestra.run.smithi038.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-22T08:13:46.497 INFO:teuthology.orchestra.run.smithi038.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-22T08:13:46.497 INFO:teuthology.orchestra.run.smithi038.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-22T08:13:46.497 INFO:teuthology.orchestra.run.smithi038.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-22T08:13:46.497 INFO:teuthology.orchestra.run.smithi038.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-22T08:13:46.497 INFO:teuthology.orchestra.run.smithi038.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-22T08:13:46.497 INFO:teuthology.orchestra.run.smithi038.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-22T08:13:46.497 INFO:teuthology.orchestra.run.smithi038.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-22T08:13:46.498 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-22T08:13:46.498 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-22T08:13:46.498 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-22T08:13:46.498 INFO:teuthology.orchestra.run.smithi038.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-22T08:13:46.498 INFO:teuthology.orchestra.run.smithi038.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-22T08:13:46.498 INFO:teuthology.orchestra.run.smithi038.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-22T08:13:46.498 INFO:teuthology.orchestra.run.smithi038.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-22T08:13:46.498 INFO:teuthology.orchestra.run.smithi038.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-22T08:13:46.498 INFO:teuthology.orchestra.run.smithi038.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-22T08:13:46.498 INFO:teuthology.orchestra.run.smithi038.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-22T08:13:46.498 INFO:teuthology.orchestra.run.smithi038.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-22T08:13:46.498 INFO:teuthology.orchestra.run.smithi038.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-22T08:13:46.498 INFO:teuthology.orchestra.run.smithi038.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-22T08:13:46.499 INFO:teuthology.orchestra.run.smithi038.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-22T08:13:46.499 INFO:teuthology.orchestra.run.smithi038.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-22T08:13:46.499 INFO:teuthology.orchestra.run.smithi038.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-22T08:13:46.499 INFO:teuthology.orchestra.run.smithi038.stdout: guava-30.1-6.el9.noarch 2024-09-22T08:13:46.499 INFO:teuthology.orchestra.run.smithi038.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-22T08:13:46.499 INFO:teuthology.orchestra.run.smithi038.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-22T08:13:46.499 INFO:teuthology.orchestra.run.smithi038.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-22T08:13:46.499 INFO:teuthology.orchestra.run.smithi038.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-22T08:13:46.499 INFO:teuthology.orchestra.run.smithi038.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-22T08:13:46.499 INFO:teuthology.orchestra.run.smithi038.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-22T08:13:46.499 INFO:teuthology.orchestra.run.smithi038.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-22T08:13:46.499 INFO:teuthology.orchestra.run.smithi038.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-22T08:13:46.499 INFO:teuthology.orchestra.run.smithi038.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-22T08:13:46.499 INFO:teuthology.orchestra.run.smithi038.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-22T08:13:46.499 INFO:teuthology.orchestra.run.smithi038.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-22T08:13:46.500 INFO:teuthology.orchestra.run.smithi038.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-22T08:13:46.500 INFO:teuthology.orchestra.run.smithi038.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-22T08:13:46.500 INFO:teuthology.orchestra.run.smithi038.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-22T08:13:46.500 INFO:teuthology.orchestra.run.smithi038.stdout: lcms2-2.12-3.el9.x86_64 2024-09-22T08:13:46.500 INFO:teuthology.orchestra.run.smithi038.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-22T08:13:46.500 INFO:teuthology.orchestra.run.smithi038.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-22T08:13:46.500 INFO:teuthology.orchestra.run.smithi038.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-22T08:13:46.500 INFO:teuthology.orchestra.run.smithi038.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-22T08:13:46.500 INFO:teuthology.orchestra.run.smithi038.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-22T08:13:46.500 INFO:teuthology.orchestra.run.smithi038.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-22T08:13:46.500 INFO:teuthology.orchestra.run.smithi038.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-22T08:13:46.500 INFO:teuthology.orchestra.run.smithi038.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-22T08:13:46.500 INFO:teuthology.orchestra.run.smithi038.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-22T08:13:46.500 INFO:teuthology.orchestra.run.smithi038.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-22T08:13:46.500 INFO:teuthology.orchestra.run.smithi038.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-22T08:13:46.501 INFO:teuthology.orchestra.run.smithi038.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-22T08:13:46.501 INFO:teuthology.orchestra.run.smithi038.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-22T08:13:46.501 INFO:teuthology.orchestra.run.smithi038.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-22T08:13:46.501 INFO:teuthology.orchestra.run.smithi038.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-22T08:13:46.501 INFO:teuthology.orchestra.run.smithi038.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-22T08:13:46.501 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs-devel-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:46.501 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:46.501 INFO:teuthology.orchestra.run.smithi038.stdout: libcephsqlite-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:46.501 INFO:teuthology.orchestra.run.smithi038.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-22T08:13:46.501 INFO:teuthology.orchestra.run.smithi038.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-22T08:13:46.501 INFO:teuthology.orchestra.run.smithi038.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-22T08:13:46.501 INFO:teuthology.orchestra.run.smithi038.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-22T08:13:46.501 INFO:teuthology.orchestra.run.smithi038.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-22T08:13:46.501 INFO:teuthology.orchestra.run.smithi038.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-22T08:13:46.502 INFO:teuthology.orchestra.run.smithi038.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-22T08:13:46.502 INFO:teuthology.orchestra.run.smithi038.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-22T08:13:46.502 INFO:teuthology.orchestra.run.smithi038.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-22T08:13:46.502 INFO:teuthology.orchestra.run.smithi038.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-22T08:13:46.502 INFO:teuthology.orchestra.run.smithi038.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-22T08:13:46.502 INFO:teuthology.orchestra.run.smithi038.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-22T08:13:46.502 INFO:teuthology.orchestra.run.smithi038.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-22T08:13:46.502 INFO:teuthology.orchestra.run.smithi038.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-22T08:13:46.502 INFO:teuthology.orchestra.run.smithi038.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-22T08:13:46.502 INFO:teuthology.orchestra.run.smithi038.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-22T08:13:46.502 INFO:teuthology.orchestra.run.smithi038.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-22T08:13:46.502 INFO:teuthology.orchestra.run.smithi038.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-22T08:13:46.502 INFO:teuthology.orchestra.run.smithi038.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-22T08:13:46.502 INFO:teuthology.orchestra.run.smithi038.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-22T08:13:46.503 INFO:teuthology.orchestra.run.smithi038.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-22T08:13:46.503 INFO:teuthology.orchestra.run.smithi038.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-22T08:13:46.503 INFO:teuthology.orchestra.run.smithi038.stdout: librados-devel-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:46.503 INFO:teuthology.orchestra.run.smithi038.stdout: libradosstriper1-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:46.503 INFO:teuthology.orchestra.run.smithi038.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-22T08:13:46.503 INFO:teuthology.orchestra.run.smithi038.stdout: librgw2-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:46.503 INFO:teuthology.orchestra.run.smithi038.stdout: libsbc-1.4-9.el9.x86_64 2024-09-22T08:13:46.503 INFO:teuthology.orchestra.run.smithi038.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-22T08:13:46.503 INFO:teuthology.orchestra.run.smithi038.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-22T08:13:46.503 INFO:teuthology.orchestra.run.smithi038.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-22T08:13:46.503 INFO:teuthology.orchestra.run.smithi038.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-22T08:13:46.503 INFO:teuthology.orchestra.run.smithi038.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-22T08:13:46.503 INFO:teuthology.orchestra.run.smithi038.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-22T08:13:46.503 INFO:teuthology.orchestra.run.smithi038.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-22T08:13:46.504 INFO:teuthology.orchestra.run.smithi038.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-22T08:13:46.504 INFO:teuthology.orchestra.run.smithi038.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-22T08:13:46.504 INFO:teuthology.orchestra.run.smithi038.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-22T08:13:46.504 INFO:teuthology.orchestra.run.smithi038.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-22T08:13:46.504 INFO:teuthology.orchestra.run.smithi038.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-22T08:13:46.504 INFO:teuthology.orchestra.run.smithi038.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-22T08:13:46.504 INFO:teuthology.orchestra.run.smithi038.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-22T08:13:46.504 INFO:teuthology.orchestra.run.smithi038.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-22T08:13:46.504 INFO:teuthology.orchestra.run.smithi038.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-22T08:13:46.504 INFO:teuthology.orchestra.run.smithi038.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-22T08:13:46.504 INFO:teuthology.orchestra.run.smithi038.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-22T08:13:46.504 INFO:teuthology.orchestra.run.smithi038.stdout: lua-5.4.4-4.el9.x86_64 2024-09-22T08:13:46.504 INFO:teuthology.orchestra.run.smithi038.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-22T08:13:46.504 INFO:teuthology.orchestra.run.smithi038.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-22T08:13:46.505 INFO:teuthology.orchestra.run.smithi038.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-22T08:13:46.505 INFO:teuthology.orchestra.run.smithi038.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-22T08:13:46.505 INFO:teuthology.orchestra.run.smithi038.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-22T08:13:46.505 INFO:teuthology.orchestra.run.smithi038.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-22T08:13:46.505 INFO:teuthology.orchestra.run.smithi038.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-22T08:13:46.505 INFO:teuthology.orchestra.run.smithi038.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-22T08:13:46.505 INFO:teuthology.orchestra.run.smithi038.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-22T08:13:46.505 INFO:teuthology.orchestra.run.smithi038.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-22T08:13:46.505 INFO:teuthology.orchestra.run.smithi038.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-22T08:13:46.505 INFO:teuthology.orchestra.run.smithi038.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-22T08:13:46.505 INFO:teuthology.orchestra.run.smithi038.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-22T08:13:46.505 INFO:teuthology.orchestra.run.smithi038.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-22T08:13:46.505 INFO:teuthology.orchestra.run.smithi038.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-22T08:13:46.505 INFO:teuthology.orchestra.run.smithi038.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-22T08:13:46.506 INFO:teuthology.orchestra.run.smithi038.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-22T08:13:46.506 INFO:teuthology.orchestra.run.smithi038.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-22T08:13:46.506 INFO:teuthology.orchestra.run.smithi038.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-22T08:13:46.506 INFO:teuthology.orchestra.run.smithi038.stdout: opus-1.3.1-10.el9.x86_64 2024-09-22T08:13:46.506 INFO:teuthology.orchestra.run.smithi038.stdout: orc-0.4.31-8.el9.x86_64 2024-09-22T08:13:46.506 INFO:teuthology.orchestra.run.smithi038.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-22T08:13:46.506 INFO:teuthology.orchestra.run.smithi038.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-22T08:13:46.506 INFO:teuthology.orchestra.run.smithi038.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-22T08:13:46.506 INFO:teuthology.orchestra.run.smithi038.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-22T08:13:46.506 INFO:teuthology.orchestra.run.smithi038.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-22T08:13:46.506 INFO:teuthology.orchestra.run.smithi038.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-22T08:13:46.506 INFO:teuthology.orchestra.run.smithi038.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-22T08:13:46.506 INFO:teuthology.orchestra.run.smithi038.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-22T08:13:46.506 INFO:teuthology.orchestra.run.smithi038.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-22T08:13:46.507 INFO:teuthology.orchestra.run.smithi038.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-22T08:13:46.507 INFO:teuthology.orchestra.run.smithi038.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-22T08:13:46.507 INFO:teuthology.orchestra.run.smithi038.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-22T08:13:46.507 INFO:teuthology.orchestra.run.smithi038.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-22T08:13:46.507 INFO:teuthology.orchestra.run.smithi038.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-22T08:13:46.507 INFO:teuthology.orchestra.run.smithi038.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-22T08:13:46.507 INFO:teuthology.orchestra.run.smithi038.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-22T08:13:46.507 INFO:teuthology.orchestra.run.smithi038.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-22T08:13:46.507 INFO:teuthology.orchestra.run.smithi038.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-22T08:13:46.507 INFO:teuthology.orchestra.run.smithi038.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-22T08:13:46.507 INFO:teuthology.orchestra.run.smithi038.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-22T08:13:46.507 INFO:teuthology.orchestra.run.smithi038.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-22T08:13:46.507 INFO:teuthology.orchestra.run.smithi038.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-22T08:13:46.507 INFO:teuthology.orchestra.run.smithi038.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-22T08:13:46.508 INFO:teuthology.orchestra.run.smithi038.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-22T08:13:46.508 INFO:teuthology.orchestra.run.smithi038.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-22T08:13:46.508 INFO:teuthology.orchestra.run.smithi038.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-22T08:13:46.508 INFO:teuthology.orchestra.run.smithi038.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-22T08:13:46.508 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-22T08:13:46.508 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-argparse-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:46.508 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:46.508 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cephfs-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:46.508 INFO:teuthology.orchestra.run.smithi038.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-22T08:13:46.508 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-22T08:13:46.508 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-22T08:13:46.508 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-22T08:13:46.508 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-22T08:13:46.508 INFO:teuthology.orchestra.run.smithi038.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-22T08:13:46.509 INFO:teuthology.orchestra.run.smithi038.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-22T08:13:46.509 INFO:teuthology.orchestra.run.smithi038.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-22T08:13:46.509 INFO:teuthology.orchestra.run.smithi038.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-22T08:13:46.509 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-22T08:13:46.509 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-22T08:13:46.509 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-22T08:13:46.509 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-22T08:13:46.509 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-22T08:13:46.509 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-22T08:13:46.509 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-22T08:13:46.509 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-22T08:13:46.509 INFO:teuthology.orchestra.run.smithi038.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-22T08:13:46.509 INFO:teuthology.orchestra.run.smithi038.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-22T08:13:46.510 INFO:teuthology.orchestra.run.smithi038.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-22T08:13:46.510 INFO:teuthology.orchestra.run.smithi038.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-22T08:13:46.510 INFO:teuthology.orchestra.run.smithi038.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-22T08:13:46.510 INFO:teuthology.orchestra.run.smithi038.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-22T08:13:46.510 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-22T08:13:46.510 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-22T08:13:46.510 INFO:teuthology.orchestra.run.smithi038.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-22T08:13:46.510 INFO:teuthology.orchestra.run.smithi038.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-22T08:13:46.510 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-22T08:13:46.510 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ply-3.11-14.el9.noarch 2024-09-22T08:13:46.510 INFO:teuthology.orchestra.run.smithi038.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-22T08:13:46.510 INFO:teuthology.orchestra.run.smithi038.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-22T08:13:46.510 INFO:teuthology.orchestra.run.smithi038.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-22T08:13:46.510 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-22T08:13:46.511 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-22T08:13:46.511 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-22T08:13:46.511 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-22T08:13:46.511 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-22T08:13:46.511 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rados-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:46.511 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rbd-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:46.511 INFO:teuthology.orchestra.run.smithi038.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-22T08:13:46.511 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-22T08:13:46.511 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-22T08:13:46.511 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rgw-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:46.511 INFO:teuthology.orchestra.run.smithi038.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-22T08:13:46.511 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-22T08:13:46.511 INFO:teuthology.orchestra.run.smithi038.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-22T08:13:46.511 INFO:teuthology.orchestra.run.smithi038.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-22T08:13:46.511 INFO:teuthology.orchestra.run.smithi038.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-22T08:13:46.511 INFO:teuthology.orchestra.run.smithi038.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-22T08:13:46.512 INFO:teuthology.orchestra.run.smithi038.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-22T08:13:46.512 INFO:teuthology.orchestra.run.smithi038.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-22T08:13:46.512 INFO:teuthology.orchestra.run.smithi038.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-22T08:13:46.512 INFO:teuthology.orchestra.run.smithi038.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-22T08:13:46.512 INFO:teuthology.orchestra.run.smithi038.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-22T08:13:46.512 INFO:teuthology.orchestra.run.smithi038.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-22T08:13:46.512 INFO:teuthology.orchestra.run.smithi038.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-22T08:13:46.512 INFO:teuthology.orchestra.run.smithi038.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-22T08:13:46.512 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:46.512 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-mirror-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:46.512 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-nbd-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:13:46.512 INFO:teuthology.orchestra.run.smithi038.stdout: re2-1:20211101-20.el9.x86_64 2024-09-22T08:13:46.512 INFO:teuthology.orchestra.run.smithi038.stdout: rtkit-0.11-29.el9.x86_64 2024-09-22T08:13:46.512 INFO:teuthology.orchestra.run.smithi038.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-22T08:13:46.513 INFO:teuthology.orchestra.run.smithi038.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-22T08:13:46.513 INFO:teuthology.orchestra.run.smithi038.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-22T08:13:46.513 INFO:teuthology.orchestra.run.smithi038.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-22T08:13:46.513 INFO:teuthology.orchestra.run.smithi038.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-22T08:13:46.513 INFO:teuthology.orchestra.run.smithi038.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-22T08:13:46.513 INFO:teuthology.orchestra.run.smithi038.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-22T08:13:46.513 INFO:teuthology.orchestra.run.smithi038.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-22T08:13:46.513 INFO:teuthology.orchestra.run.smithi038.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-22T08:13:46.513 INFO:teuthology.orchestra.run.smithi038.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-22T08:13:46.513 INFO:teuthology.orchestra.run.smithi038.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-22T08:13:46.513 INFO:teuthology.orchestra.run.smithi038.stdout: upower-0.99.11-11.el9.x86_64 2024-09-22T08:13:46.514 INFO:teuthology.orchestra.run.smithi038.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-22T08:13:46.514 INFO:teuthology.orchestra.run.smithi038.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-22T08:13:46.514 INFO:teuthology.orchestra.run.smithi038.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-22T08:13:46.514 INFO:teuthology.orchestra.run.smithi038.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-22T08:13:46.514 INFO:teuthology.orchestra.run.smithi038.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-22T08:13:46.514 INFO:teuthology.orchestra.run.smithi038.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-22T08:13:46.514 INFO:teuthology.orchestra.run.smithi038.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-22T08:13:46.514 INFO:teuthology.orchestra.run.smithi038.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-22T08:13:46.514 INFO:teuthology.orchestra.run.smithi038.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-22T08:13:46.515 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:46.515 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-22T08:13:46.927 DEBUG:teuthology.parallel:result is None 2024-09-22T08:13:46.927 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:13:47.066 DEBUG:teuthology.orchestra.run.smithi038:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-22T08:13:47.134 INFO:teuthology.orchestra.run.smithi038.stdout:19.3.0-5106.g8852379c.el9 2024-09-22T08:13:47.134 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5106.g8852379c.el9 2024-09-22T08:13:47.134 INFO:teuthology.task.install:The correct ceph version 19.3.0-5106.g8852379c is installed. 2024-09-22T08:13:47.136 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:13:47.267 DEBUG:teuthology.orchestra.run.smithi042:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-22T08:13:47.350 INFO:teuthology.orchestra.run.smithi042.stdout:19.3.0-5106.g8852379c.el9 2024-09-22T08:13:47.350 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5106.g8852379c.el9 2024-09-22T08:13:47.350 INFO:teuthology.task.install:The correct ceph version 19.3.0-5106.g8852379c is installed. 2024-09-22T08:13:47.352 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-22T08:13:47.352 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-22T08:13:47.352 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-22T08:13:47.395 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-22T08:13:47.395 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-22T08:13:47.442 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-22T08:13:47.442 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-22T08:13:47.442 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/daemon-helper 2024-09-22T08:13:47.482 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-22T08:13:47.562 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-22T08:13:47.562 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/daemon-helper 2024-09-22T08:13:47.606 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-22T08:13:47.688 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-22T08:13:47.688 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-22T08:13:47.689 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-22T08:13:47.728 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-22T08:13:47.808 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-22T08:13:47.808 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-22T08:13:47.849 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-22T08:13:47.929 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-22T08:13:47.930 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-22T08:13:47.930 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/stdin-killer 2024-09-22T08:13:47.969 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-22T08:13:48.048 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-22T08:13:48.049 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/stdin-killer 2024-09-22T08:13:48.089 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-22T08:13:48.168 INFO:teuthology.run_tasks:Running task ceph... 2024-09-22T08:13:48.241 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-22T08:13:48.241 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 777 /var/log/ceph 2024-09-22T08:13:48.244 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 777 /var/log/ceph 2024-09-22T08:13:48.282 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-22T08:13:48.282 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-22T08:13:48.323 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-22T08:13:48.363 INFO:tasks.ceph:Creating extra log directories... 2024-09-22T08:13:48.363 DEBUG:teuthology.orchestra.run.smithi038:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-22T08:13:48.403 DEBUG:teuthology.orchestra.run.smithi042:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-22T08:13:48.452 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-22T08:13:48.452 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-22T08:13:48.452 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915040', 'branch': 'wip-skoduri-cloud-restore', 'description': 'rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep}', 'email': None, 'first_in_suite': False, 'job_id': '7915040', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-skoduri-cloud-restore'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d'}}, 'openssl_keys': {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}}, 'rgw': {'client.0': {'ssl certificate': 'rgw.client.0'}, 'compression type': 'random', 'ec-data-pool': False, 'frontend': 'beast', 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-skoduri-cloud-restore', 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d'}}, 'owner': 'scheduled_soumyakoduri@teuthology', 'priority': 100, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-skoduri-cloud-restore', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_8852379c050c686f4605f33f0129009b2029ca9d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '8852379c050c686f4605f33f0129009b2029ca9d', 'targets': {'smithi038.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPqRwOZxd4MuOF09PB7zzi/NWPGs5RsptCjfHQvpbkpCbZtpqaIxpZJuLiG0Xol9CBOY1NVUNoOeqLOUGRMSy2g=', 'smithi042.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAreu318Z7fzSMGkOGhUubzeQJ9JzlHdpUVKD5VbpajMwwoZ302elfKg71HGbsQHfYdTGBLQzNV1jH0YeF6Zl4k='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-22_06:37:27', 'tube': 'smithi', 'user': 'soumyakoduri', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2902'} 2024-09-22T08:13:48.453 DEBUG:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-22T08:13:48.482 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-22T08:13:48.511 DEBUG:teuthology.orchestra.run.smithi038:> sudo install -d -m0777 -- /var/run/ceph 2024-09-22T08:13:48.552 DEBUG:teuthology.orchestra.run.smithi042:> sudo install -d -m0777 -- /var/run/ceph 2024-09-22T08:13:48.591 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-22T08:13:48.591 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/scratch_devs of=/dev/stdout 2024-09-22T08:13:48.658 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-22T08:13:48.658 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_1 2024-09-22T08:13:48.728 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-22T08:13:48.728 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T08:13:48.728 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-22T08:13:48.728 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T08:13:48.728 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T08:13:48.728 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2024-09-22 08:13:33.935087064 +0000 2024-09-22T08:13:48.728 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2024-09-22 08:10:59.653891400 +0000 2024-09-22T08:13:48.729 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2024-09-22 08:10:59.653891400 +0000 2024-09-22T08:13:48.729 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: 2024-09-22 08:10:59.653891400 +0000 2024-09-22T08:13:48.729 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-22T08:13:48.807 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2024-09-22T08:13:48.807 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2024-09-22T08:13:48.807 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000371351 s, 1.4 MB/s 2024-09-22T08:13:48.809 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-22T08:13:48.879 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_2 2024-09-22T08:13:48.950 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-22T08:13:48.950 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T08:13:48.950 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-22T08:13:48.950 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T08:13:48.950 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T08:13:48.950 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2024-09-22 08:13:33.935087064 +0000 2024-09-22T08:13:48.950 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2024-09-22 08:11:00.005885309 +0000 2024-09-22T08:13:48.950 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2024-09-22 08:11:00.005885309 +0000 2024-09-22T08:13:48.950 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: 2024-09-22 08:11:00.005885309 +0000 2024-09-22T08:13:48.950 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-22T08:13:49.028 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2024-09-22T08:13:49.028 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2024-09-22T08:13:49.028 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000283023 s, 1.8 MB/s 2024-09-22T08:13:49.029 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-22T08:13:49.100 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_3 2024-09-22T08:13:49.170 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-22T08:13:49.171 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T08:13:49.171 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-22T08:13:49.171 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T08:13:49.171 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T08:13:49.171 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2024-09-22 08:13:33.936087046 +0000 2024-09-22T08:13:49.171 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2024-09-22 08:11:00.334879616 +0000 2024-09-22T08:13:49.171 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2024-09-22 08:11:00.334879616 +0000 2024-09-22T08:13:49.171 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: 2024-09-22 08:11:00.334879616 +0000 2024-09-22T08:13:49.171 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-22T08:13:49.248 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2024-09-22T08:13:49.248 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2024-09-22T08:13:49.248 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000491966 s, 1.0 MB/s 2024-09-22T08:13:49.250 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-22T08:13:49.320 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_4 2024-09-22T08:13:49.388 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-22T08:13:49.389 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T08:13:49.389 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-22T08:13:49.389 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T08:13:49.389 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T08:13:49.389 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2024-09-22 08:13:33.936087046 +0000 2024-09-22T08:13:49.389 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2024-09-22 08:11:00.672873768 +0000 2024-09-22T08:13:49.389 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2024-09-22 08:11:00.672873768 +0000 2024-09-22T08:13:49.389 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: 2024-09-22 08:11:00.672873768 +0000 2024-09-22T08:13:49.389 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-22T08:13:49.466 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2024-09-22T08:13:49.466 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2024-09-22T08:13:49.467 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000512185 s, 1000 kB/s 2024-09-22T08:13:49.468 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-22T08:13:49.537 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-22T08:13:49.538 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-22T08:13:49.538 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/scratch_devs of=/dev/stdout 2024-09-22T08:13:49.574 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-22T08:13:49.575 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_1 2024-09-22T08:13:49.649 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-22T08:13:49.649 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T08:13:49.649 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 660 Links: 1 2024-09-22T08:13:49.649 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T08:13:49.650 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T08:13:49.650 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-09-22 08:13:30.817258891 +0000 2024-09-22T08:13:49.650 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-09-22 08:11:11.141282467 +0000 2024-09-22T08:13:49.650 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-09-22 08:11:11.141282467 +0000 2024-09-22T08:13:49.650 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-09-22 08:11:11.141282467 +0000 2024-09-22T08:13:49.650 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-22T08:13:49.731 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-22T08:13:49.731 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-22T08:13:49.731 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 9.8993e-05 s, 5.2 MB/s 2024-09-22T08:13:49.732 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-22T08:13:49.806 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_2 2024-09-22T08:13:49.878 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-22T08:13:49.878 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T08:13:49.878 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 681 Links: 1 2024-09-22T08:13:49.878 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T08:13:49.878 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T08:13:49.878 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-09-22 08:13:30.817258891 +0000 2024-09-22T08:13:49.878 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-09-22 08:11:11.469280159 +0000 2024-09-22T08:13:49.878 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-09-22 08:11:11.469280159 +0000 2024-09-22T08:13:49.878 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-09-22 08:11:11.469280159 +0000 2024-09-22T08:13:49.878 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-22T08:13:49.957 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-22T08:13:49.957 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-22T08:13:49.957 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000103671 s, 4.9 MB/s 2024-09-22T08:13:49.959 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-22T08:13:50.030 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_3 2024-09-22T08:13:50.100 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-22T08:13:50.100 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T08:13:50.100 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 700 Links: 1 2024-09-22T08:13:50.100 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T08:13:50.100 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T08:13:50.100 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-09-22 08:13:30.818258884 +0000 2024-09-22T08:13:50.100 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-09-22 08:11:11.795277865 +0000 2024-09-22T08:13:50.100 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-09-22 08:11:11.795277865 +0000 2024-09-22T08:13:50.100 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-09-22 08:11:11.795277865 +0000 2024-09-22T08:13:50.101 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-22T08:13:50.178 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-22T08:13:50.178 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-22T08:13:50.178 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000101669 s, 5.0 MB/s 2024-09-22T08:13:50.179 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-22T08:13:50.249 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_4 2024-09-22T08:13:50.319 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-22T08:13:50.319 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T08:13:50.319 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 716 Links: 1 2024-09-22T08:13:50.319 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T08:13:50.319 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T08:13:50.320 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-09-22 08:13:30.818258884 +0000 2024-09-22T08:13:50.320 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-09-22 08:11:12.109275655 +0000 2024-09-22T08:13:50.320 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-09-22 08:11:12.109275655 +0000 2024-09-22T08:13:50.320 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-09-22 08:11:12.109275655 +0000 2024-09-22T08:13:50.320 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-22T08:13:50.397 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-22T08:13:50.397 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-22T08:13:50.397 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000101635 s, 5.0 MB/s 2024-09-22T08:13:50.398 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-22T08:13:50.468 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-22T08:13:50.468 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi038.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi042.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-22T08:13:50.468 INFO:tasks.ceph:Generating config... 2024-09-22T08:13:50.469 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-22T08:13:50.470 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-22T08:13:50.470 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-22T08:13:50.470 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-22T08:13:50.470 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-22T08:13:50.470 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-22T08:13:50.470 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-22T08:13:50.470 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-22T08:13:50.470 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-22T08:13:50.470 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-22T08:13:50.470 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-22T08:13:50.470 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-22T08:13:50.470 INFO:tasks.ceph:[client] setuser = ceph 2024-09-22T08:13:50.470 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-22T08:13:50.470 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-22T08:13:50.470 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-22T08:13:50.471 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-22T08:13:50.471 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-22T08:13:50.471 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-22T08:13:50.471 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-22T08:13:50.471 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-22T08:13:50.471 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-22T08:13:50.471 INFO:tasks.ceph:[mon] lockdep = True 2024-09-22T08:13:50.471 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-22T08:13:50.471 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-22T08:13:50.471 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-22T08:13:50.471 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-22T08:13:50.471 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-22T08:13:50.471 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-22T08:13:50.471 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-22T08:13:50.471 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-22T08:13:50.472 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-22T08:13:50.472 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-22T08:13:50.472 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-22T08:13:50.472 INFO:tasks.ceph:[osd] lockdep = True 2024-09-22T08:13:50.472 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-22T08:13:50.472 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-22T08:13:50.472 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-22T08:13:50.472 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-22T08:13:50.472 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-22T08:13:50.472 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-22T08:13:50.472 INFO:tasks.ceph:Setting up mon.a... 2024-09-22T08:13:50.472 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-22T08:13:50.550 INFO:teuthology.orchestra.run.smithi038.stdout:creating /etc/ceph/ceph.keyring 2024-09-22T08:13:50.553 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-22T08:13:50.615 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-22T08:13:50.655 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.38'), ('mon.c', '[v2:172.21.15.38:3301,v1:172.21.15.38:6790]'), ('mon.b', '172.21.15.42')] 2024-09-22T08:13:50.656 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.38,[v2:172.21.15.38:3301,v1:172.21.15.38:6790],172.21.15.42', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'lockdep': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-22T08:13:50.657 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-22T08:13:50.657 DEBUG:teuthology.orchestra.run.smithi038:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-22T08:13:50.726 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.38 --addv c '[v2:172.21.15.38:3301,v1:172.21.15.38:6790]' --add b 172.21.15.42 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:13:50.828 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:13:50.829 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:13:50.830 INFO:teuthology.orchestra.run.smithi038.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:13:50.830 INFO:teuthology.orchestra.run.smithi038.stdout:monmaptool: generated fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:13:50.830 INFO:teuthology.orchestra.run.smithi038.stdout:setting min_mon_release = quincy 2024-09-22T08:13:50.830 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 0 2024-09-22T08:13:50.830 INFO:teuthology.orchestra.run.smithi038.stdout:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:13:50.830 INFO:teuthology.orchestra.run.smithi038.stdout:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:13:50.830 INFO:teuthology.orchestra.run.smithi038.stdout:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:13:50.830 INFO:teuthology.orchestra.run.smithi038.stdout:min_mon_release 17 (quincy) 2024-09-22T08:13:50.830 INFO:teuthology.orchestra.run.smithi038.stdout:election_strategy: 1 2024-09-22T08:13:50.830 INFO:teuthology.orchestra.run.smithi038.stdout:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:13:50.831 INFO:teuthology.orchestra.run.smithi038.stdout:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:13:50.831 INFO:teuthology.orchestra.run.smithi038.stdout:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:13:50.831 INFO:teuthology.orchestra.run.smithi038.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-22T08:13:50.832 DEBUG:teuthology.orchestra.run.smithi038:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-22T08:13:50.861 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f... 2024-09-22T08:13:50.862 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-22T08:13:50.903 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-22T08:13:50.959 INFO:teuthology.orchestra.run.smithi038.stdout:[global] 2024-09-22T08:13:50.959 INFO:teuthology.orchestra.run.smithi038.stdout: chdir = "" 2024-09-22T08:13:50.959 INFO:teuthology.orchestra.run.smithi038.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-22T08:13:50.959 INFO:teuthology.orchestra.run.smithi038.stdout: auth supported = cephx 2024-09-22T08:13:50.960 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:50.960 INFO:teuthology.orchestra.run.smithi038.stdout: filestore xattr use omap = true 2024-09-22T08:13:50.960 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:50.960 INFO:teuthology.orchestra.run.smithi038.stdout: mon clock drift allowed = 1.000 2024-09-22T08:13:50.960 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:50.960 INFO:teuthology.orchestra.run.smithi038.stdout: osd crush chooseleaf type = 0 2024-09-22T08:13:50.960 INFO:teuthology.orchestra.run.smithi038.stdout: auth debug = true 2024-09-22T08:13:50.960 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:50.960 INFO:teuthology.orchestra.run.smithi038.stdout: ms die on old message = true 2024-09-22T08:13:50.960 INFO:teuthology.orchestra.run.smithi038.stdout: ms die on bug = true 2024-09-22T08:13:50.960 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:50.960 INFO:teuthology.orchestra.run.smithi038.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-22T08:13:50.960 INFO:teuthology.orchestra.run.smithi038.stdout: mon pg warn max object skew = 0 2024-09-22T08:13:50.960 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:50.961 INFO:teuthology.orchestra.run.smithi038.stdout: # disable pg_autoscaler by default for new pools 2024-09-22T08:13:50.961 INFO:teuthology.orchestra.run.smithi038.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-22T08:13:50.961 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:50.961 INFO:teuthology.orchestra.run.smithi038.stdout: osd pool default size = 2 2024-09-22T08:13:50.961 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:50.961 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd allow primary affinity = true 2024-09-22T08:13:50.961 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd allow pg remap = true 2024-09-22T08:13:50.961 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on legacy crush tunables = false 2024-09-22T08:13:50.961 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on crush straw calc version zero = false 2024-09-22T08:13:50.961 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on no sortbitwise = false 2024-09-22T08:13:50.961 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on osd down out interval zero = false 2024-09-22T08:13:50.961 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on too few osds = false 2024-09-22T08:13:50.961 INFO:teuthology.orchestra.run.smithi038.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-22T08:13:50.961 INFO:teuthology.orchestra.run.smithi038.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-22T08:13:50.961 INFO:teuthology.orchestra.run.smithi038.stdout: mon_allow_pool_size_one = true 2024-09-22T08:13:50.962 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:50.962 INFO:teuthology.orchestra.run.smithi038.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-22T08:13:50.962 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:50.962 INFO:teuthology.orchestra.run.smithi038.stdout: osd default data pool replay window = 5 2024-09-22T08:13:50.962 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:50.962 INFO:teuthology.orchestra.run.smithi038.stdout: mon allow pool delete = true 2024-09-22T08:13:50.962 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:50.962 INFO:teuthology.orchestra.run.smithi038.stdout: mon cluster log file level = debug 2024-09-22T08:13:50.962 INFO:teuthology.orchestra.run.smithi038.stdout: debug asserts on shutdown = true 2024-09-22T08:13:50.962 INFO:teuthology.orchestra.run.smithi038.stdout: mon health detail to clog = false 2024-09-22T08:13:50.962 INFO:teuthology.orchestra.run.smithi038.stdout: mon host = "172.21.15.38,[v2:172.21.15.38:3301,v1:172.21.15.38:6790],172.21.15.42" 2024-09-22T08:13:50.962 INFO:teuthology.orchestra.run.smithi038.stdout: mon client directed command retry = 5 2024-09-22T08:13:50.962 INFO:teuthology.orchestra.run.smithi038.stdout: ms inject socket failures = 5000 2024-09-22T08:13:50.962 INFO:teuthology.orchestra.run.smithi038.stdout: osd_max_pg_log_entries = 10 2024-09-22T08:13:50.963 INFO:teuthology.orchestra.run.smithi038.stdout: osd_min_pg_log_entries = 10 2024-09-22T08:13:50.963 INFO:teuthology.orchestra.run.smithi038.stdout: fsid = a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:13:50.963 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:50.963 INFO:teuthology.orchestra.run.smithi038.stdout:[osd] 2024-09-22T08:13:50.963 INFO:teuthology.orchestra.run.smithi038.stdout: osd journal size = 100 2024-09-22T08:13:50.963 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:50.963 INFO:teuthology.orchestra.run.smithi038.stdout: osd scrub load threshold = 5.0 2024-09-22T08:13:50.963 INFO:teuthology.orchestra.run.smithi038.stdout: osd scrub max interval = 600 2024-09-22T08:13:50.963 INFO:teuthology.orchestra.run.smithi038.stdout: osd mclock profile = high_recovery_ops 2024-09-22T08:13:50.963 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:50.963 INFO:teuthology.orchestra.run.smithi038.stdout: osd recover clone overlap = true 2024-09-22T08:13:50.963 INFO:teuthology.orchestra.run.smithi038.stdout: osd recovery max chunk = 1048576 2024-09-22T08:13:50.963 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:50.963 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug shutdown = true 2024-09-22T08:13:50.963 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug op order = true 2024-09-22T08:13:50.964 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug verify stray on activate = true 2024-09-22T08:13:50.964 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug trim objects = true 2024-09-22T08:13:50.964 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:50.964 INFO:teuthology.orchestra.run.smithi038.stdout: osd open classes on start = true 2024-09-22T08:13:50.964 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug pg log writeout = true 2024-09-22T08:13:50.964 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:50.964 INFO:teuthology.orchestra.run.smithi038.stdout: osd deep scrub update digest min age = 30 2024-09-22T08:13:50.964 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:50.964 INFO:teuthology.orchestra.run.smithi038.stdout: osd map max advance = 10 2024-09-22T08:13:50.964 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:50.964 INFO:teuthology.orchestra.run.smithi038.stdout: journal zero on create = true 2024-09-22T08:13:50.964 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:50.964 INFO:teuthology.orchestra.run.smithi038.stdout: filestore ondisk finisher threads = 3 2024-09-22T08:13:50.964 INFO:teuthology.orchestra.run.smithi038.stdout: filestore apply finisher threads = 3 2024-09-22T08:13:50.964 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:50.965 INFO:teuthology.orchestra.run.smithi038.stdout: bdev debug aio = true 2024-09-22T08:13:50.965 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug misdirected ops = true 2024-09-22T08:13:50.965 INFO:teuthology.orchestra.run.smithi038.stdout: bdev async discard = True 2024-09-22T08:13:50.965 INFO:teuthology.orchestra.run.smithi038.stdout: bdev enable discard = True 2024-09-22T08:13:50.965 INFO:teuthology.orchestra.run.smithi038.stdout: bluestore allocator = bitmap 2024-09-22T08:13:50.965 INFO:teuthology.orchestra.run.smithi038.stdout: bluestore block size = 96636764160 2024-09-22T08:13:50.965 INFO:teuthology.orchestra.run.smithi038.stdout: bluestore fsck on mount = True 2024-09-22T08:13:50.965 INFO:teuthology.orchestra.run.smithi038.stdout: debug bluefs = 1/20 2024-09-22T08:13:50.965 INFO:teuthology.orchestra.run.smithi038.stdout: debug bluestore = 1/20 2024-09-22T08:13:50.965 INFO:teuthology.orchestra.run.smithi038.stdout: debug ms = 1 2024-09-22T08:13:50.965 INFO:teuthology.orchestra.run.smithi038.stdout: debug objclass = 20 2024-09-22T08:13:50.965 INFO:teuthology.orchestra.run.smithi038.stdout: debug osd = 20 2024-09-22T08:13:50.965 INFO:teuthology.orchestra.run.smithi038.stdout: debug rocksdb = 4/10 2024-09-22T08:13:50.965 INFO:teuthology.orchestra.run.smithi038.stdout: lockdep = True 2024-09-22T08:13:50.965 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd backfillfull_ratio = 0.85 2024-09-22T08:13:50.966 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd full ratio = 0.9 2024-09-22T08:13:50.966 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd nearfull ratio = 0.8 2024-09-22T08:13:50.966 INFO:teuthology.orchestra.run.smithi038.stdout: osd failsafe full ratio = 0.95 2024-09-22T08:13:50.966 INFO:teuthology.orchestra.run.smithi038.stdout: osd objectstore = bluestore 2024-09-22T08:13:50.966 INFO:teuthology.orchestra.run.smithi038.stdout: osd shutdown pgref assert = True 2024-09-22T08:13:50.966 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:50.966 INFO:teuthology.orchestra.run.smithi038.stdout:[mgr] 2024-09-22T08:13:50.966 INFO:teuthology.orchestra.run.smithi038.stdout: debug ms = 1 2024-09-22T08:13:50.966 INFO:teuthology.orchestra.run.smithi038.stdout: debug mgr = 20 2024-09-22T08:13:50.966 INFO:teuthology.orchestra.run.smithi038.stdout: debug mon = 20 2024-09-22T08:13:50.966 INFO:teuthology.orchestra.run.smithi038.stdout: debug auth = 20 2024-09-22T08:13:50.966 INFO:teuthology.orchestra.run.smithi038.stdout: mon reweight min pgs per osd = 4 2024-09-22T08:13:50.966 INFO:teuthology.orchestra.run.smithi038.stdout: mon reweight min bytes per osd = 10 2024-09-22T08:13:50.966 INFO:teuthology.orchestra.run.smithi038.stdout: mgr/telemetry/nag = false 2024-09-22T08:13:50.966 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:50.967 INFO:teuthology.orchestra.run.smithi038.stdout:[mon] 2024-09-22T08:13:50.967 INFO:teuthology.orchestra.run.smithi038.stdout: debug ms = 1 2024-09-22T08:13:50.967 INFO:teuthology.orchestra.run.smithi038.stdout: debug mon = 20 2024-09-22T08:13:50.967 INFO:teuthology.orchestra.run.smithi038.stdout: debug paxos = 20 2024-09-22T08:13:50.967 INFO:teuthology.orchestra.run.smithi038.stdout: debug auth = 20 2024-09-22T08:13:50.967 INFO:teuthology.orchestra.run.smithi038.stdout: mon data avail warn = 5 2024-09-22T08:13:50.967 INFO:teuthology.orchestra.run.smithi038.stdout: mon mgr mkfs grace = 240 2024-09-22T08:13:50.967 INFO:teuthology.orchestra.run.smithi038.stdout: mon reweight min pgs per osd = 4 2024-09-22T08:13:50.967 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd reporter subtree level = osd 2024-09-22T08:13:50.967 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd prime pg temp = true 2024-09-22T08:13:50.967 INFO:teuthology.orchestra.run.smithi038.stdout: mon reweight min bytes per osd = 10 2024-09-22T08:13:50.967 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:50.967 INFO:teuthology.orchestra.run.smithi038.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-22T08:13:50.967 INFO:teuthology.orchestra.run.smithi038.stdout: auth mon ticket ttl = 660 # 11m 2024-09-22T08:13:50.967 INFO:teuthology.orchestra.run.smithi038.stdout: auth service ticket ttl = 240 # 4m 2024-09-22T08:13:50.968 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:50.968 INFO:teuthology.orchestra.run.smithi038.stdout: # don't complain about insecure global_id in the test suite 2024-09-22T08:13:50.968 INFO:teuthology.orchestra.run.smithi038.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-22T08:13:50.968 INFO:teuthology.orchestra.run.smithi038.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-22T08:13:50.968 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:50.968 INFO:teuthology.orchestra.run.smithi038.stdout: # 1m isn't quite enough 2024-09-22T08:13:50.968 INFO:teuthology.orchestra.run.smithi038.stdout: mon_down_mkfs_grace = 2m 2024-09-22T08:13:50.968 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:50.968 INFO:teuthology.orchestra.run.smithi038.stdout: mon_warn_on_filestore_osds = false 2024-09-22T08:13:50.968 INFO:teuthology.orchestra.run.smithi038.stdout: lockdep = True 2024-09-22T08:13:50.968 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:13:50.968 INFO:teuthology.orchestra.run.smithi038.stdout:[client] 2024-09-22T08:13:50.968 INFO:teuthology.orchestra.run.smithi038.stdout: rgw cache enabled = true 2024-09-22T08:13:50.968 INFO:teuthology.orchestra.run.smithi038.stdout: rgw enable ops log = true 2024-09-22T08:13:50.969 INFO:teuthology.orchestra.run.smithi038.stdout: rgw enable usage log = true 2024-09-22T08:13:50.969 INFO:teuthology.orchestra.run.smithi038.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-22T08:13:50.969 INFO:teuthology.orchestra.run.smithi038.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-22T08:13:50.969 INFO:teuthology.orchestra.run.smithi038.stdout: debug rgw = 20 2024-09-22T08:13:50.969 INFO:teuthology.orchestra.run.smithi038.stdout: debug rgw notification = 20 2024-09-22T08:13:50.969 INFO:teuthology.orchestra.run.smithi038.stdout: rgw bucket counters cache = True 2024-09-22T08:13:50.969 INFO:teuthology.orchestra.run.smithi038.stdout: rgw crypt require ssl = False 2024-09-22T08:13:50.969 INFO:teuthology.orchestra.run.smithi038.stdout: rgw crypt s3 kms backend = testing 2024-09-22T08:13:50.987 INFO:teuthology.orchestra.run.smithi038.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-22T08:13:50.988 INFO:teuthology.orchestra.run.smithi038.stdout: rgw reshard progress judge interval = 10 2024-09-22T08:13:50.988 INFO:teuthology.orchestra.run.smithi038.stdout: rgw s3 auth use sts = True 2024-09-22T08:13:50.988 INFO:teuthology.orchestra.run.smithi038.stdout: rgw sts key = abcdefghijklmnop 2024-09-22T08:13:50.988 INFO:teuthology.orchestra.run.smithi038.stdout: rgw torrent flag = True 2024-09-22T08:13:50.988 INFO:teuthology.orchestra.run.smithi038.stdout: rgw user counters cache = True 2024-09-22T08:13:50.988 INFO:teuthology.orchestra.run.smithi038.stdout: setgroup = ceph 2024-09-22T08:13:50.988 INFO:teuthology.orchestra.run.smithi038.stdout: setuser = ceph 2024-09-22T08:13:50.988 INFO:teuthology.orchestra.run.smithi038.stdout:[mon.a] 2024-09-22T08:13:50.988 INFO:teuthology.orchestra.run.smithi038.stdout:[mon.c] 2024-09-22T08:13:50.988 INFO:teuthology.orchestra.run.smithi038.stdout:[mon.b] 2024-09-22T08:13:50.990 INFO:teuthology.orchestra.run.smithi042.stdout:[global] 2024-09-22T08:13:50.990 INFO:teuthology.orchestra.run.smithi042.stdout: chdir = "" 2024-09-22T08:13:50.990 INFO:teuthology.orchestra.run.smithi042.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-22T08:13:50.990 INFO:teuthology.orchestra.run.smithi042.stdout: auth supported = cephx 2024-09-22T08:13:50.990 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:50.990 INFO:teuthology.orchestra.run.smithi042.stdout: filestore xattr use omap = true 2024-09-22T08:13:50.990 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:50.990 INFO:teuthology.orchestra.run.smithi042.stdout: mon clock drift allowed = 1.000 2024-09-22T08:13:50.990 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:50.990 INFO:teuthology.orchestra.run.smithi042.stdout: osd crush chooseleaf type = 0 2024-09-22T08:13:50.990 INFO:teuthology.orchestra.run.smithi042.stdout: auth debug = true 2024-09-22T08:13:50.990 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:50.991 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on old message = true 2024-09-22T08:13:50.991 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on bug = true 2024-09-22T08:13:50.991 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:50.991 INFO:teuthology.orchestra.run.smithi042.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-22T08:13:50.991 INFO:teuthology.orchestra.run.smithi042.stdout: mon pg warn max object skew = 0 2024-09-22T08:13:50.991 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:50.991 INFO:teuthology.orchestra.run.smithi042.stdout: # disable pg_autoscaler by default for new pools 2024-09-22T08:13:50.991 INFO:teuthology.orchestra.run.smithi042.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-22T08:13:50.991 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:50.991 INFO:teuthology.orchestra.run.smithi042.stdout: osd pool default size = 2 2024-09-22T08:13:50.991 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:50.991 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd allow primary affinity = true 2024-09-22T08:13:50.991 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd allow pg remap = true 2024-09-22T08:13:50.991 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on legacy crush tunables = false 2024-09-22T08:13:50.992 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on crush straw calc version zero = false 2024-09-22T08:13:50.992 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on no sortbitwise = false 2024-09-22T08:13:50.992 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on osd down out interval zero = false 2024-09-22T08:13:50.992 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on too few osds = false 2024-09-22T08:13:50.992 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-22T08:13:50.992 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-22T08:13:50.992 INFO:teuthology.orchestra.run.smithi042.stdout: mon_allow_pool_size_one = true 2024-09-22T08:13:50.992 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:50.992 INFO:teuthology.orchestra.run.smithi042.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-22T08:13:50.992 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:50.992 INFO:teuthology.orchestra.run.smithi042.stdout: osd default data pool replay window = 5 2024-09-22T08:13:50.992 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:50.992 INFO:teuthology.orchestra.run.smithi042.stdout: mon allow pool delete = true 2024-09-22T08:13:50.992 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:50.992 INFO:teuthology.orchestra.run.smithi042.stdout: mon cluster log file level = debug 2024-09-22T08:13:50.993 INFO:teuthology.orchestra.run.smithi042.stdout: debug asserts on shutdown = true 2024-09-22T08:13:50.993 INFO:teuthology.orchestra.run.smithi042.stdout: mon health detail to clog = false 2024-09-22T08:13:50.993 INFO:teuthology.orchestra.run.smithi042.stdout: mon host = "172.21.15.38,[v2:172.21.15.38:3301,v1:172.21.15.38:6790],172.21.15.42" 2024-09-22T08:13:50.993 INFO:teuthology.orchestra.run.smithi042.stdout: mon client directed command retry = 5 2024-09-22T08:13:50.993 INFO:teuthology.orchestra.run.smithi042.stdout: ms inject socket failures = 5000 2024-09-22T08:13:50.993 INFO:teuthology.orchestra.run.smithi042.stdout: osd_max_pg_log_entries = 10 2024-09-22T08:13:50.993 INFO:teuthology.orchestra.run.smithi042.stdout: osd_min_pg_log_entries = 10 2024-09-22T08:13:50.993 INFO:teuthology.orchestra.run.smithi042.stdout: fsid = a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:13:50.993 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:50.993 INFO:teuthology.orchestra.run.smithi042.stdout:[osd] 2024-09-22T08:13:50.993 INFO:teuthology.orchestra.run.smithi042.stdout: osd journal size = 100 2024-09-22T08:13:50.993 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:50.993 INFO:teuthology.orchestra.run.smithi042.stdout: osd scrub load threshold = 5.0 2024-09-22T08:13:50.993 INFO:teuthology.orchestra.run.smithi042.stdout: osd scrub max interval = 600 2024-09-22T08:13:50.994 INFO:teuthology.orchestra.run.smithi042.stdout: osd mclock profile = high_recovery_ops 2024-09-22T08:13:50.994 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:50.994 INFO:teuthology.orchestra.run.smithi042.stdout: osd recover clone overlap = true 2024-09-22T08:13:50.994 INFO:teuthology.orchestra.run.smithi042.stdout: osd recovery max chunk = 1048576 2024-09-22T08:13:50.994 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:50.994 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug shutdown = true 2024-09-22T08:13:50.994 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug op order = true 2024-09-22T08:13:50.994 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug verify stray on activate = true 2024-09-22T08:13:50.994 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug trim objects = true 2024-09-22T08:13:50.994 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:50.994 INFO:teuthology.orchestra.run.smithi042.stdout: osd open classes on start = true 2024-09-22T08:13:50.994 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug pg log writeout = true 2024-09-22T08:13:50.994 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:50.994 INFO:teuthology.orchestra.run.smithi042.stdout: osd deep scrub update digest min age = 30 2024-09-22T08:13:50.994 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:50.995 INFO:teuthology.orchestra.run.smithi042.stdout: osd map max advance = 10 2024-09-22T08:13:50.995 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:50.995 INFO:teuthology.orchestra.run.smithi042.stdout: journal zero on create = true 2024-09-22T08:13:50.995 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:50.995 INFO:teuthology.orchestra.run.smithi042.stdout: filestore ondisk finisher threads = 3 2024-09-22T08:13:50.995 INFO:teuthology.orchestra.run.smithi042.stdout: filestore apply finisher threads = 3 2024-09-22T08:13:50.995 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:50.995 INFO:teuthology.orchestra.run.smithi042.stdout: bdev debug aio = true 2024-09-22T08:13:50.995 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug misdirected ops = true 2024-09-22T08:13:50.995 INFO:teuthology.orchestra.run.smithi042.stdout: bdev async discard = True 2024-09-22T08:13:50.995 INFO:teuthology.orchestra.run.smithi042.stdout: bdev enable discard = True 2024-09-22T08:13:50.995 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore allocator = bitmap 2024-09-22T08:13:50.995 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore block size = 96636764160 2024-09-22T08:13:50.995 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore fsck on mount = True 2024-09-22T08:13:50.995 INFO:teuthology.orchestra.run.smithi042.stdout: debug bluefs = 1/20 2024-09-22T08:13:50.996 INFO:teuthology.orchestra.run.smithi042.stdout: debug bluestore = 1/20 2024-09-22T08:13:50.996 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-09-22T08:13:50.996 INFO:teuthology.orchestra.run.smithi042.stdout: debug objclass = 20 2024-09-22T08:13:50.996 INFO:teuthology.orchestra.run.smithi042.stdout: debug osd = 20 2024-09-22T08:13:50.996 INFO:teuthology.orchestra.run.smithi042.stdout: debug rocksdb = 4/10 2024-09-22T08:13:50.996 INFO:teuthology.orchestra.run.smithi042.stdout: lockdep = True 2024-09-22T08:13:50.996 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd backfillfull_ratio = 0.85 2024-09-22T08:13:50.996 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd full ratio = 0.9 2024-09-22T08:13:50.996 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd nearfull ratio = 0.8 2024-09-22T08:13:50.996 INFO:teuthology.orchestra.run.smithi042.stdout: osd failsafe full ratio = 0.95 2024-09-22T08:13:50.996 INFO:teuthology.orchestra.run.smithi042.stdout: osd objectstore = bluestore 2024-09-22T08:13:50.996 INFO:teuthology.orchestra.run.smithi042.stdout: osd shutdown pgref assert = True 2024-09-22T08:13:50.996 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:50.996 INFO:teuthology.orchestra.run.smithi042.stdout:[mgr] 2024-09-22T08:13:50.997 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-09-22T08:13:50.997 INFO:teuthology.orchestra.run.smithi042.stdout: debug mgr = 20 2024-09-22T08:13:50.997 INFO:teuthology.orchestra.run.smithi042.stdout: debug mon = 20 2024-09-22T08:13:50.997 INFO:teuthology.orchestra.run.smithi042.stdout: debug auth = 20 2024-09-22T08:13:50.997 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min pgs per osd = 4 2024-09-22T08:13:50.997 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min bytes per osd = 10 2024-09-22T08:13:50.997 INFO:teuthology.orchestra.run.smithi042.stdout: mgr/telemetry/nag = false 2024-09-22T08:13:50.997 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:50.997 INFO:teuthology.orchestra.run.smithi042.stdout:[mon] 2024-09-22T08:13:50.997 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-09-22T08:13:50.997 INFO:teuthology.orchestra.run.smithi042.stdout: debug mon = 20 2024-09-22T08:13:50.997 INFO:teuthology.orchestra.run.smithi042.stdout: debug paxos = 20 2024-09-22T08:13:50.997 INFO:teuthology.orchestra.run.smithi042.stdout: debug auth = 20 2024-09-22T08:13:50.997 INFO:teuthology.orchestra.run.smithi042.stdout: mon data avail warn = 5 2024-09-22T08:13:50.997 INFO:teuthology.orchestra.run.smithi042.stdout: mon mgr mkfs grace = 240 2024-09-22T08:13:50.997 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min pgs per osd = 4 2024-09-22T08:13:50.998 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd reporter subtree level = osd 2024-09-22T08:13:50.998 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd prime pg temp = true 2024-09-22T08:13:50.998 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min bytes per osd = 10 2024-09-22T08:13:50.998 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:50.998 INFO:teuthology.orchestra.run.smithi042.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-22T08:13:50.998 INFO:teuthology.orchestra.run.smithi042.stdout: auth mon ticket ttl = 660 # 11m 2024-09-22T08:13:50.998 INFO:teuthology.orchestra.run.smithi042.stdout: auth service ticket ttl = 240 # 4m 2024-09-22T08:13:50.998 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:50.998 INFO:teuthology.orchestra.run.smithi042.stdout: # don't complain about insecure global_id in the test suite 2024-09-22T08:13:50.998 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-22T08:13:50.998 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-22T08:13:50.998 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:50.998 INFO:teuthology.orchestra.run.smithi042.stdout: # 1m isn't quite enough 2024-09-22T08:13:50.998 INFO:teuthology.orchestra.run.smithi042.stdout: mon_down_mkfs_grace = 2m 2024-09-22T08:13:50.999 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:50.999 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_filestore_osds = false 2024-09-22T08:13:50.999 INFO:teuthology.orchestra.run.smithi042.stdout: lockdep = True 2024-09-22T08:13:50.999 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-22T08:13:50.999 INFO:teuthology.orchestra.run.smithi042.stdout:[client] 2024-09-22T08:13:50.999 INFO:teuthology.orchestra.run.smithi042.stdout: rgw cache enabled = true 2024-09-22T08:13:50.999 INFO:teuthology.orchestra.run.smithi042.stdout: rgw enable ops log = true 2024-09-22T08:13:50.999 INFO:teuthology.orchestra.run.smithi042.stdout: rgw enable usage log = true 2024-09-22T08:13:50.999 INFO:teuthology.orchestra.run.smithi042.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-22T08:13:50.999 INFO:teuthology.orchestra.run.smithi042.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-22T08:13:50.999 INFO:teuthology.orchestra.run.smithi042.stdout: debug rgw = 20 2024-09-22T08:13:50.999 INFO:teuthology.orchestra.run.smithi042.stdout: debug rgw notification = 20 2024-09-22T08:13:50.999 INFO:teuthology.orchestra.run.smithi042.stdout: rgw bucket counters cache = True 2024-09-22T08:13:50.999 INFO:teuthology.orchestra.run.smithi042.stdout: rgw crypt require ssl = False 2024-09-22T08:13:50.999 INFO:teuthology.orchestra.run.smithi042.stdout: rgw crypt s3 kms backend = testing 2024-09-22T08:13:51.000 INFO:teuthology.orchestra.run.smithi042.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-22T08:13:51.000 INFO:teuthology.orchestra.run.smithi042.stdout: rgw reshard progress judge interval = 10 2024-09-22T08:13:51.000 INFO:teuthology.orchestra.run.smithi042.stdout: rgw s3 auth use sts = True 2024-09-22T08:13:51.000 INFO:teuthology.orchestra.run.smithi042.stdout: rgw sts key = abcdefghijklmnop 2024-09-22T08:13:51.000 INFO:teuthology.orchestra.run.smithi042.stdout: rgw torrent flag = True 2024-09-22T08:13:51.000 INFO:teuthology.orchestra.run.smithi042.stdout: rgw user counters cache = True 2024-09-22T08:13:51.000 INFO:teuthology.orchestra.run.smithi042.stdout: setgroup = ceph 2024-09-22T08:13:51.000 INFO:teuthology.orchestra.run.smithi042.stdout: setuser = ceph 2024-09-22T08:13:51.000 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.a] 2024-09-22T08:13:51.000 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.c] 2024-09-22T08:13:51.000 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.b] 2024-09-22T08:13:51.000 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-22T08:13:51.001 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-22T08:13:51.100 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-22T08:13:51.100 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-22T08:13:51.101 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-22T08:13:51.130 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-22T08:13:51.130 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-22T08:13:51.199 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi038.front.sepia.ceph.com 2024-09-22T08:13:51.200 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-22T08:13:51.200 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-22T08:13:51.200 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-22T08:13:51.289 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-22T08:13:51.289 DEBUG:teuthology.orchestra.run.smithi038:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:13:51.359 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi042.front.sepia.ceph.com 2024-09-22T08:13:51.359 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-22T08:13:51.359 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-22T08:13:51.359 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-22T08:13:51.412 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-22T08:13:51.412 DEBUG:teuthology.orchestra.run.smithi042:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:13:51.483 INFO:tasks.ceph:Setting up mon nodes... 2024-09-22T08:13:51.483 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-22T08:13:51.483 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-22T08:13:51.551 INFO:teuthology.orchestra.run.smithi038.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-22T08:13:51.554 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-22T08:13:51.631 INFO:teuthology.orchestra.run.smithi042.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-22T08:13:51.634 INFO:tasks.ceph:Setting up mds nodes... 2024-09-22T08:13:51.634 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-22T08:13:51.634 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-22T08:13:51.690 INFO:teuthology.orchestra.run.smithi038.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-22T08:13:51.703 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-22T08:13:51.760 INFO:teuthology.orchestra.run.smithi042.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-22T08:13:51.773 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-22T08:13:51.773 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi038.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi042.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-22T08:13:51.773 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-22T08:13:51.814 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-22T08:13:51.814 INFO:tasks.ceph:role: osd.0 2024-09-22T08:13:51.814 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi038.front.sepia.ceph.com 2024-09-22T08:13:51.814 DEBUG:teuthology.orchestra.run.smithi038:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-22T08:13:51.921 INFO:teuthology.orchestra.run.smithi038.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T08:13:51.921 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T08:13:51.921 INFO:teuthology.orchestra.run.smithi038.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T08:13:51.922 INFO:teuthology.orchestra.run.smithi038.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T08:13:51.922 INFO:teuthology.orchestra.run.smithi038.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T08:13:51.922 INFO:teuthology.orchestra.run.smithi038.stdout: = sunit=0 swidth=0 blks 2024-09-22T08:13:51.922 INFO:teuthology.orchestra.run.smithi038.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T08:13:51.922 INFO:teuthology.orchestra.run.smithi038.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T08:13:51.922 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T08:13:51.922 INFO:teuthology.orchestra.run.smithi038.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T08:13:53.238 INFO:teuthology.orchestra.run.smithi038.stdout:Discarding blocks...Done. 2024-09-22T08:13:53.240 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi038.front.sepia.ceph.com -o noatime 2024-09-22T08:13:53.241 DEBUG:teuthology.orchestra.run.smithi038:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-22T08:13:53.293 DEBUG:teuthology.orchestra.run.smithi038:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-22T08:13:53.341 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-22T08:13:53.382 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-22T08:13:53.383 INFO:tasks.ceph:role: osd.1 2024-09-22T08:13:53.383 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi038.front.sepia.ceph.com 2024-09-22T08:13:53.383 DEBUG:teuthology.orchestra.run.smithi038:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-22T08:13:53.490 INFO:teuthology.orchestra.run.smithi038.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T08:13:53.490 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T08:13:53.491 INFO:teuthology.orchestra.run.smithi038.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T08:13:53.491 INFO:teuthology.orchestra.run.smithi038.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T08:13:53.491 INFO:teuthology.orchestra.run.smithi038.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T08:13:53.491 INFO:teuthology.orchestra.run.smithi038.stdout: = sunit=0 swidth=0 blks 2024-09-22T08:13:53.491 INFO:teuthology.orchestra.run.smithi038.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T08:13:53.491 INFO:teuthology.orchestra.run.smithi038.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T08:13:53.491 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T08:13:53.491 INFO:teuthology.orchestra.run.smithi038.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T08:13:54.807 INFO:teuthology.orchestra.run.smithi038.stdout:Discarding blocks...Done. 2024-09-22T08:13:54.809 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi038.front.sepia.ceph.com -o noatime 2024-09-22T08:13:54.809 DEBUG:teuthology.orchestra.run.smithi038:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-22T08:13:54.857 DEBUG:teuthology.orchestra.run.smithi038:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-22T08:13:54.903 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-22T08:13:54.942 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-22T08:13:54.943 INFO:tasks.ceph:role: osd.2 2024-09-22T08:13:54.943 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi038.front.sepia.ceph.com 2024-09-22T08:13:54.943 DEBUG:teuthology.orchestra.run.smithi038:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-22T08:13:55.051 INFO:teuthology.orchestra.run.smithi038.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T08:13:55.051 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T08:13:55.051 INFO:teuthology.orchestra.run.smithi038.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T08:13:55.051 INFO:teuthology.orchestra.run.smithi038.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T08:13:55.051 INFO:teuthology.orchestra.run.smithi038.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T08:13:55.051 INFO:teuthology.orchestra.run.smithi038.stdout: = sunit=0 swidth=0 blks 2024-09-22T08:13:55.051 INFO:teuthology.orchestra.run.smithi038.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T08:13:55.051 INFO:teuthology.orchestra.run.smithi038.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T08:13:55.052 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T08:13:55.052 INFO:teuthology.orchestra.run.smithi038.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T08:13:56.402 INFO:teuthology.orchestra.run.smithi038.stdout:Discarding blocks...Done. 2024-09-22T08:13:56.404 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi038.front.sepia.ceph.com -o noatime 2024-09-22T08:13:56.404 DEBUG:teuthology.orchestra.run.smithi038:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-22T08:13:56.452 DEBUG:teuthology.orchestra.run.smithi038:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-22T08:13:56.496 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-22T08:13:56.535 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-22T08:13:56.535 INFO:tasks.ceph:role: osd.3 2024-09-22T08:13:56.535 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi038.front.sepia.ceph.com 2024-09-22T08:13:56.536 DEBUG:teuthology.orchestra.run.smithi038:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-22T08:13:56.643 INFO:teuthology.orchestra.run.smithi038.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T08:13:56.644 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T08:13:56.644 INFO:teuthology.orchestra.run.smithi038.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T08:13:56.644 INFO:teuthology.orchestra.run.smithi038.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T08:13:56.644 INFO:teuthology.orchestra.run.smithi038.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T08:13:56.644 INFO:teuthology.orchestra.run.smithi038.stdout: = sunit=0 swidth=0 blks 2024-09-22T08:13:56.644 INFO:teuthology.orchestra.run.smithi038.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T08:13:56.644 INFO:teuthology.orchestra.run.smithi038.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T08:13:56.644 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T08:13:56.644 INFO:teuthology.orchestra.run.smithi038.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T08:13:57.964 INFO:teuthology.orchestra.run.smithi038.stdout:Discarding blocks...Done. 2024-09-22T08:13:57.966 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi038.front.sepia.ceph.com -o noatime 2024-09-22T08:13:57.966 DEBUG:teuthology.orchestra.run.smithi038:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-22T08:13:58.020 DEBUG:teuthology.orchestra.run.smithi038:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-22T08:13:58.067 DEBUG:teuthology.orchestra.run.smithi038:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:13:58.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:13:58.142+0000 7f5b193fd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-22T08:13:58.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:13:58.142+0000 7f5b193fd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-22T08:13:58.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:13:58.142+0000 7f5b193fd640 -1 bdev(0x55bc0ff17800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-22T08:13:58.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:13:58.143+0000 7f5b193fd640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-22T08:14:01.313 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-22T08:14:01.362 DEBUG:teuthology.orchestra.run.smithi038:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:14:01.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:14:01.427+0000 7f2f98832640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-22T08:14:01.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:14:01.427+0000 7f2f98832640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-22T08:14:01.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:14:01.427+0000 7f2f98832640 -1 bdev(0x563dd7501800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-22T08:14:01.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:14:01.427+0000 7f2f98832640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-22T08:14:04.594 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-22T08:14:04.641 DEBUG:teuthology.orchestra.run.smithi038:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:14:04.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:14:04.704+0000 7f2bce69c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-22T08:14:04.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:14:04.705+0000 7f2bce69c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-22T08:14:04.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:14:04.705+0000 7f2bce69c640 -1 bdev(0x55aa2e141800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-22T08:14:04.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:14:04.705+0000 7f2bce69c640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-22T08:14:07.890 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-22T08:14:07.936 DEBUG:teuthology.orchestra.run.smithi038:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:14:08.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:14:07.999+0000 7f1d0b943640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-22T08:14:08.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:14:07.999+0000 7f1d0b943640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-22T08:14:08.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:14:07.999+0000 7f1d0b943640 -1 bdev(0x55b71b559800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-22T08:14:08.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:14:08.000+0000 7f1d0b943640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-22T08:14:11.671 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-22T08:14:11.717 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-22T08:14:11.764 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-22T08:14:11.764 INFO:tasks.ceph:role: osd.4 2024-09-22T08:14:11.764 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi042.front.sepia.ceph.com 2024-09-22T08:14:11.764 DEBUG:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-22T08:14:11.808 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T08:14:11.808 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T08:14:11.808 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T08:14:11.808 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T08:14:11.808 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T08:14:11.808 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2024-09-22T08:14:11.808 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T08:14:11.808 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T08:14:11.808 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T08:14:11.808 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T08:14:11.841 INFO:teuthology.orchestra.run.smithi042.stdout:Discarding blocks...Done. 2024-09-22T08:14:11.843 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2024-09-22T08:14:11.843 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-22T08:14:11.928 DEBUG:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-22T08:14:11.972 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-22T08:14:12.011 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-22T08:14:12.011 INFO:tasks.ceph:role: osd.5 2024-09-22T08:14:12.011 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi042.front.sepia.ceph.com 2024-09-22T08:14:12.011 DEBUG:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-22T08:14:12.091 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T08:14:12.091 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T08:14:12.091 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T08:14:12.091 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T08:14:12.091 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T08:14:12.091 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2024-09-22T08:14:12.091 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T08:14:12.091 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T08:14:12.091 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T08:14:12.091 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T08:14:12.123 INFO:teuthology.orchestra.run.smithi042.stdout:Discarding blocks...Done. 2024-09-22T08:14:12.125 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2024-09-22T08:14:12.125 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-22T08:14:12.209 DEBUG:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-22T08:14:12.295 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-22T08:14:12.334 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-22T08:14:12.334 INFO:tasks.ceph:role: osd.6 2024-09-22T08:14:12.334 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi042.front.sepia.ceph.com 2024-09-22T08:14:12.334 DEBUG:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-22T08:14:12.413 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T08:14:12.413 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T08:14:12.413 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T08:14:12.413 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T08:14:12.413 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T08:14:12.413 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2024-09-22T08:14:12.413 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T08:14:12.413 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T08:14:12.414 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T08:14:12.414 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T08:14:12.445 INFO:teuthology.orchestra.run.smithi042.stdout:Discarding blocks...Done. 2024-09-22T08:14:12.447 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2024-09-22T08:14:12.447 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-22T08:14:12.531 DEBUG:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-22T08:14:12.616 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-22T08:14:12.656 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-22T08:14:12.656 INFO:tasks.ceph:role: osd.7 2024-09-22T08:14:12.656 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi042.front.sepia.ceph.com 2024-09-22T08:14:12.656 DEBUG:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-22T08:14:12.736 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T08:14:12.736 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T08:14:12.736 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T08:14:12.736 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T08:14:12.736 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T08:14:12.736 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2024-09-22T08:14:12.736 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T08:14:12.736 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T08:14:12.736 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T08:14:12.736 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T08:14:12.768 INFO:teuthology.orchestra.run.smithi042.stdout:Discarding blocks...Done. 2024-09-22T08:14:12.770 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2024-09-22T08:14:12.770 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-22T08:14:12.854 DEBUG:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-22T08:14:12.940 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:14:13.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-22T08:14:13.056+0000 7ff520e1a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-22T08:14:13.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-22T08:14:13.056+0000 7ff520e1a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-22T08:14:13.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-22T08:14:13.056+0000 7ff520e1a640 -1 bdev(0x5609db9a1800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-22T08:14:13.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-22T08:14:13.057+0000 7ff520e1a640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-22T08:14:16.459 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-22T08:14:16.506 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:14:16.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-22T08:14:16.570+0000 7f39e8958640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-22T08:14:16.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-22T08:14:16.570+0000 7f39e8958640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-22T08:14:16.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-22T08:14:16.570+0000 7f39e8958640 -1 bdev(0x55817dfe7800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-22T08:14:16.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-22T08:14:16.570+0000 7f39e8958640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-22T08:14:19.479 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-22T08:14:19.526 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:14:19.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-22T08:14:19.590+0000 7fc112eda640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-22T08:14:19.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-22T08:14:19.590+0000 7fc112eda640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-22T08:14:19.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-22T08:14:19.590+0000 7fc112eda640 -1 bdev(0x560d58ead800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-22T08:14:19.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-22T08:14:19.591+0000 7fc112eda640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-22T08:14:22.510 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-22T08:14:22.556 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:14:22.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-22T08:14:22.619+0000 7fcfabc0d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-22T08:14:22.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-22T08:14:22.619+0000 7fcfabc0d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-22T08:14:22.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-22T08:14:22.619+0000 7fcfabc0d640 -1 bdev(0x55e2cbeeb800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-22T08:14:22.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-22T08:14:22.619+0000 7fcfabc0d640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-22T08:14:26.278 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-22T08:14:26.325 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-22T08:14:26.325 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-22T08:14:26.325 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-22T08:14:26.372 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-22T08:14:26.372 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-22T08:14:26.456 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-22T08:14:26.456 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-22T08:14:26.537 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-22T08:14:26.537 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-22T08:14:26.616 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-22T08:14:26.617 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-22T08:14:26.696 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-22T08:14:26.697 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-22T08:14:26.744 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-22T08:14:26.745 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-22T08:14:26.827 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-22T08:14:26.827 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-22T08:14:26.908 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-22T08:14:26.908 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-22T08:14:26.988 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-22T08:14:26.988 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-22T08:14:27.068 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-22T08:14:27.068 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-22T08:14:27.100 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-22T08:14:27.100 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-22T08:14:27.138 INFO:tasks.ceph:Adding keys to all mons... 2024-09-22T08:14:27.138 DEBUG:teuthology.orchestra.run.smithi038:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-22T08:14:27.143 DEBUG:teuthology.orchestra.run.smithi042:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-22T08:14:27.181 INFO:teuthology.orchestra.run.smithi038.stdout:[mgr.y] 2024-09-22T08:14:27.181 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQC/0e9mxpLeIBAA4xnhemDlSpoplxNbarpufw== 2024-09-22T08:14:27.181 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.0] 2024-09-22T08:14:27.181 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQDG0e9mITeLCBAAn4cAllpre/GkVQM7nJ/pDQ== 2024-09-22T08:14:27.182 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.1] 2024-09-22T08:14:27.182 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQDJ0e9mPVuEGRAA50neSHs+iSWz0671dPNsrw== 2024-09-22T08:14:27.182 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.2] 2024-09-22T08:14:27.182 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQDM0e9mBjANKhAAhlL7ZFVjSLH7HRhb5PAMtg== 2024-09-22T08:14:27.182 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.3] 2024-09-22T08:14:27.182 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQDQ0e9mIQMGABAA6Ulk5L2f0JJ7Qpsbu0flAw== 2024-09-22T08:14:27.182 INFO:teuthology.orchestra.run.smithi038.stdout:[mgr.x] 2024-09-22T08:14:27.182 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQC/0e9mrB6mJRAATN+spIrubffeHMFIdjjRjg== 2024-09-22T08:14:27.182 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.4] 2024-09-22T08:14:27.182 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQDV0e9miVp3AxAAGhIrIFP0YWRac+/K6GAV7Q== 2024-09-22T08:14:27.182 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.5] 2024-09-22T08:14:27.182 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQDY0e9mRRYRIhAAHwvY9gyFkOHxyxib9vd6UQ== 2024-09-22T08:14:27.182 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.6] 2024-09-22T08:14:27.183 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQDb0e9mYPNKIxAAqI0Axbtsh0j6g4ulXqgYEA== 2024-09-22T08:14:27.183 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.7] 2024-09-22T08:14:27.183 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQDe0e9mi0cDJRAACs8bEfFTzWzqloKAg/M8aw== 2024-09-22T08:14:27.183 INFO:teuthology.orchestra.run.smithi038.stdout:[client.0] 2024-09-22T08:14:27.183 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQC/0e9m3GkpKRAACiV6ToT8l2fgIZ4nWsLT6A== 2024-09-22T08:14:27.183 INFO:teuthology.orchestra.run.smithi038.stdout:[client.1] 2024-09-22T08:14:27.183 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQC/0e9mxXRRLRAAVkK6hz7pNJVAx7+5SCC0ZQ== 2024-09-22T08:14:27.216 INFO:teuthology.orchestra.run.smithi042.stdout:[mgr.y] 2024-09-22T08:14:27.217 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQC/0e9mxpLeIBAA4xnhemDlSpoplxNbarpufw== 2024-09-22T08:14:27.217 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.0] 2024-09-22T08:14:27.217 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDG0e9mITeLCBAAn4cAllpre/GkVQM7nJ/pDQ== 2024-09-22T08:14:27.217 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.1] 2024-09-22T08:14:27.217 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDJ0e9mPVuEGRAA50neSHs+iSWz0671dPNsrw== 2024-09-22T08:14:27.217 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.2] 2024-09-22T08:14:27.217 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDM0e9mBjANKhAAhlL7ZFVjSLH7HRhb5PAMtg== 2024-09-22T08:14:27.217 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.3] 2024-09-22T08:14:27.217 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDQ0e9mIQMGABAA6Ulk5L2f0JJ7Qpsbu0flAw== 2024-09-22T08:14:27.217 INFO:teuthology.orchestra.run.smithi042.stdout:[mgr.x] 2024-09-22T08:14:27.217 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQC/0e9mrB6mJRAATN+spIrubffeHMFIdjjRjg== 2024-09-22T08:14:27.217 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.4] 2024-09-22T08:14:27.217 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDV0e9miVp3AxAAGhIrIFP0YWRac+/K6GAV7Q== 2024-09-22T08:14:27.218 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.5] 2024-09-22T08:14:27.218 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDY0e9mRRYRIhAAHwvY9gyFkOHxyxib9vd6UQ== 2024-09-22T08:14:27.218 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.6] 2024-09-22T08:14:27.218 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDb0e9mYPNKIxAAqI0Axbtsh0j6g4ulXqgYEA== 2024-09-22T08:14:27.218 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.7] 2024-09-22T08:14:27.218 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDe0e9mi0cDJRAACs8bEfFTzWzqloKAg/M8aw== 2024-09-22T08:14:27.218 INFO:teuthology.orchestra.run.smithi042.stdout:[client.0] 2024-09-22T08:14:27.218 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQC/0e9m3GkpKRAACiV6ToT8l2fgIZ4nWsLT6A== 2024-09-22T08:14:27.218 INFO:teuthology.orchestra.run.smithi042.stdout:[client.1] 2024-09-22T08:14:27.218 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQC/0e9mxXRRLRAAVkK6hz7pNJVAx7+5SCC0ZQ== 2024-09-22T08:14:27.219 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-22T08:14:27.226 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-22T08:14:27.326 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:14:27.329 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:14:27.396 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:14:27.398 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:14:27.465 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:14:27.467 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:14:27.535 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:14:27.537 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:14:27.603 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-22T08:14:27.605 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-22T08:14:27.671 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:14:27.673 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:14:27.739 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:14:27.741 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:14:27.808 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:14:27.810 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:14:27.876 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:14:27.879 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:14:27.945 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-22T08:14:27.948 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-22T08:14:28.017 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-22T08:14:28.019 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-22T08:14:28.088 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-22T08:14:28.088 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-22T08:14:28.127 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-22T08:14:28.249 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-22T08:14:28.288 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-22T08:14:28.367 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-22T08:14:28.492 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-22T08:14:28.531 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-22T08:14:28.573 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-22T08:14:28.686 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-22T08:14:28.725 DEBUG:teuthology.orchestra.run.smithi038:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:14:28.727 DEBUG:teuthology.orchestra.run.smithi042:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:14:28.794 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-22T08:14:28.794 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-22T08:14:28.794 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-22T08:14:28.797 INFO:tasks.ceph.mon.a:Started 2024-09-22T08:14:28.797 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-22T08:14:28.797 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-22T08:14:28.799 INFO:tasks.ceph.mon.c:Started 2024-09-22T08:14:28.799 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-22T08:14:28.799 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-22T08:14:28.836 INFO:tasks.ceph.mon.b:Started 2024-09-22T08:14:28.836 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-22T08:14:28.837 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-22T08:14:28.837 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-22T08:14:28.839 INFO:tasks.ceph.mgr.y:Started 2024-09-22T08:14:28.839 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-22T08:14:28.839 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-22T08:14:28.841 INFO:tasks.ceph.mgr.x:Started 2024-09-22T08:14:28.841 DEBUG:tasks.ceph:set 0 configs 2024-09-22T08:14:28.841 INFO:tasks.ceph:Setting crush tunables to default 2024-09-22T08:14:28.841 DEBUG:teuthology.orchestra.run.smithi038:> sudo ceph --cluster ceph osd crush tunables default 2024-09-22T08:14:35.128 INFO:teuthology.orchestra.run.smithi038.stderr:adjusted tunables profile to default 2024-09-22T08:14:35.140 INFO:tasks.ceph:check_enable_crimson: False 2024-09-22T08:14:35.140 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-22T08:14:35.140 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-22T08:14:35.140 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-22T08:14:35.181 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-22T08:14:35.181 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-22T08:14:35.261 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-22T08:14:35.261 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-22T08:14:35.341 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-22T08:14:35.341 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-22T08:14:35.421 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-22T08:14:35.421 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-22T08:14:35.462 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-22T08:14:35.462 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-22T08:14:35.542 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-22T08:14:35.542 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-22T08:14:35.623 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-22T08:14:35.623 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-22T08:14:35.703 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd new 0e925403-23d1-4b76-8c8e-5782ecc00c76 0 2024-09-22T08:14:35.945 INFO:teuthology.orchestra.run.smithi042.stdout:0 2024-09-22T08:14:35.956 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd new e385e001-2edb-4915-9721-5f41f7f59cba 1 2024-09-22T08:14:36.160 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-09-22T08:14:36.171 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd new d679834b-edf5-4271-894e-75cc07af0a5c 2 2024-09-22T08:14:36.370 INFO:teuthology.orchestra.run.smithi042.stdout:2 2024-09-22T08:14:36.381 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd new 20730742-284b-4749-b55c-42b108fa4601 3 2024-09-22T08:14:36.584 INFO:teuthology.orchestra.run.smithi042.stdout:3 2024-09-22T08:14:36.595 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd new f69a0cda-2c26-4bd3-a2b0-42343e8bbf4f 4 2024-09-22T08:14:36.808 INFO:teuthology.orchestra.run.smithi042.stdout:4 2024-09-22T08:14:36.819 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd new 81a144c6-eae2-48fe-8113-7f5920197be9 5 2024-09-22T08:14:37.023 INFO:teuthology.orchestra.run.smithi042.stdout:5 2024-09-22T08:14:37.034 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd new 041e0082-acb7-46ce-adc1-4ffba52bf5db 6 2024-09-22T08:14:37.234 INFO:teuthology.orchestra.run.smithi042.stdout:6 2024-09-22T08:14:37.245 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd new 30e812ad-f0df-4b22-808d-dd0caea9983b 7 2024-09-22T08:14:37.453 INFO:teuthology.orchestra.run.smithi042.stdout:7 2024-09-22T08:14:37.464 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-22T08:14:37.465 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-22T08:14:37.467 INFO:tasks.ceph.osd.0:Started 2024-09-22T08:14:37.467 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-22T08:14:37.467 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-22T08:14:37.469 INFO:tasks.ceph.osd.1:Started 2024-09-22T08:14:37.469 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-22T08:14:37.469 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-22T08:14:37.471 INFO:tasks.ceph.osd.2:Started 2024-09-22T08:14:37.471 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-22T08:14:37.472 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-22T08:14:37.474 INFO:tasks.ceph.osd.3:Started 2024-09-22T08:14:37.474 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-22T08:14:37.474 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-22T08:14:37.476 INFO:tasks.ceph.osd.4:Started 2024-09-22T08:14:37.476 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-22T08:14:37.476 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-22T08:14:37.478 INFO:tasks.ceph.osd.5:Started 2024-09-22T08:14:37.478 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-22T08:14:37.479 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-22T08:14:37.481 INFO:tasks.ceph.osd.6:Started 2024-09-22T08:14:37.481 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-22T08:14:37.481 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-22T08:14:37.483 INFO:tasks.ceph.osd.7:Started 2024-09-22T08:14:37.483 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T08:14:37.699 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:14:37.699 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":10,"fsid":"a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f","created":"2024-09-22T08:14:34.158414+0000","modified":"2024-09-22T08:14:37.441829+0000","last_up_change":"0.000000","last_in_change":"2024-09-22T08:14:37.441829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0e925403-23d1-4b76-8c8e-5782ecc00c76","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e385e001-2edb-4915-9721-5f41f7f59cba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d679834b-edf5-4271-894e-75cc07af0a5c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"20730742-284b-4749-b55c-42b108fa4601","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f69a0cda-2c26-4bd3-a2b0-42343e8bbf4f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"81a144c6-eae2-48fe-8113-7f5920197be9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"041e0082-acb7-46ce-adc1-4ffba52bf5db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"30e812ad-f0df-4b22-808d-dd0caea9983b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T08:14:37.710 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-22T08:14:37.711 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-22T08:14:38.516 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-22T08:14:38.702 INFO:teuthology.misc.health.smithi038.stdout: 2024-09-22T08:14:38.702 INFO:teuthology.misc.health.smithi038.stdout:{"epoch":10,"fsid":"a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f","created":"2024-09-22T08:14:34.158414+0000","modified":"2024-09-22T08:14:37.441829+0000","last_up_change":"0.000000","last_in_change":"2024-09-22T08:14:37.441829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0e925403-23d1-4b76-8c8e-5782ecc00c76","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e385e001-2edb-4915-9721-5f41f7f59cba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d679834b-edf5-4271-894e-75cc07af0a5c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"20730742-284b-4749-b55c-42b108fa4601","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f69a0cda-2c26-4bd3-a2b0-42343e8bbf4f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"81a144c6-eae2-48fe-8113-7f5920197be9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"041e0082-acb7-46ce-adc1-4ffba52bf5db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"30e812ad-f0df-4b22-808d-dd0caea9983b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T08:14:38.712 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-22T08:14:38.729 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-09-22T08:14:38.727+0000 7fd18de0d640 -1 Falling back to public interface 2024-09-22T08:14:38.933 INFO:tasks.ceph.osd.6.smithi042.stderr:2024-09-22T08:14:38.931+0000 7f705b80d640 -1 Falling back to public interface 2024-09-22T08:14:38.973 INFO:tasks.ceph.osd.5.smithi042.stderr:2024-09-22T08:14:38.971+0000 7f89b2e0c640 -1 Falling back to public interface 2024-09-22T08:14:39.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2024-09-22T08:14:39.202+0000 7f8ab2611640 -1 Falling back to public interface 2024-09-22T08:14:39.228 INFO:tasks.ceph.osd.4.smithi042.stderr:2024-09-22T08:14:39.226+0000 7fd27381a640 -1 Falling back to public interface 2024-09-22T08:14:39.465 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-09-22T08:14:39.464+0000 7f2004619640 -1 Falling back to public interface 2024-09-22T08:14:39.475 INFO:tasks.ceph.osd.0.smithi038.stderr:2024-09-22T08:14:39.473+0000 7f5619016640 -1 Falling back to public interface 2024-09-22T08:14:39.484 INFO:tasks.ceph.osd.7.smithi042.stderr:2024-09-22T08:14:39.482+0000 7f29f0030640 -1 Falling back to public interface 2024-09-22T08:14:39.651 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-09-22T08:14:39.649+0000 7fb6dbb3a640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-22T08:14:39.653 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-09-22T08:14:39.652+0000 7fb6dbb3a640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-22T08:14:42.683 INFO:tasks.ceph.osd.6.smithi042.stderr:2024-09-22T08:14:42.681+0000 7f705b80d640 -1 osd.6 0 log_to_monitors true 2024-09-22T08:14:42.775 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-09-22T08:14:42.773+0000 7fd18de0d640 -1 osd.2 0 log_to_monitors true 2024-09-22T08:14:42.778 INFO:tasks.ceph.osd.5.smithi042.stderr:2024-09-22T08:14:42.777+0000 7f89b2e0c640 -1 osd.5 0 log_to_monitors true 2024-09-22T08:14:43.044 INFO:tasks.ceph.osd.4.smithi042.stderr:2024-09-22T08:14:43.043+0000 7fd27381a640 -1 osd.4 0 log_to_monitors true 2024-09-22T08:14:43.287 INFO:tasks.ceph.osd.1.smithi038.stderr:2024-09-22T08:14:43.286+0000 7f8ab2611640 -1 osd.1 0 log_to_monitors true 2024-09-22T08:14:43.571 INFO:tasks.ceph.osd.7.smithi042.stderr:2024-09-22T08:14:43.569+0000 7f29f0030640 -1 osd.7 0 log_to_monitors true 2024-09-22T08:14:43.761 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-09-22T08:14:43.759+0000 7f2004619640 -1 osd.3 0 log_to_monitors true 2024-09-22T08:14:43.795 INFO:tasks.ceph.osd.0.smithi038.stderr:2024-09-22T08:14:43.793+0000 7f5619016640 -1 osd.0 0 log_to_monitors true 2024-09-22T08:14:45.154 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-09-22T08:14:45.152+0000 7fd189734640 -1 osd.2 0 waiting for initial osdmap 2024-09-22T08:14:45.166 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-09-22T08:14:45.166+0000 7fd181553640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-22T08:14:45.424 INFO:tasks.ceph.osd.4.smithi042.stderr:2024-09-22T08:14:45.423+0000 7fd26f9fc640 -1 osd.4 0 waiting for initial osdmap 2024-09-22T08:14:45.438 INFO:tasks.ceph.osd.4.smithi042.stderr:2024-09-22T08:14:45.437+0000 7fd267007640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-22T08:14:45.455 INFO:tasks.ceph.osd.6.smithi042.stderr:2024-09-22T08:14:45.454+0000 7f7057236640 -1 osd.6 0 waiting for initial osdmap 2024-09-22T08:14:45.465 INFO:tasks.ceph.osd.6.smithi042.stderr:2024-09-22T08:14:45.464+0000 7f704f055640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-22T08:14:45.472 INFO:tasks.ceph.osd.5.smithi042.stderr:2024-09-22T08:14:45.470+0000 7f89ae723640 -1 osd.5 0 waiting for initial osdmap 2024-09-22T08:14:45.486 INFO:tasks.ceph.osd.5.smithi042.stderr:2024-09-22T08:14:45.485+0000 7f89a6542640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-22T08:14:45.518 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-22T08:14:45.901 INFO:teuthology.misc.health.smithi038.stdout: 2024-09-22T08:14:45.901 INFO:teuthology.misc.health.smithi038.stdout:{"epoch":13,"fsid":"a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f","created":"2024-09-22T08:14:34.158414+0000","modified":"2024-09-22T08:14:45.195210+0000","last_up_change":"2024-09-22T08:14:45.195210+0000","last_in_change":"2024-09-22T08:14:37.441829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0e925403-23d1-4b76-8c8e-5782ecc00c76","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e385e001-2edb-4915-9721-5f41f7f59cba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d679834b-edf5-4271-894e-75cc07af0a5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":703968303},{"type":"v1","addr":"172.21.15.38:6801","nonce":703968303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":703968303},{"type":"v1","addr":"172.21.15.38:6803","nonce":703968303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":703968303},{"type":"v1","addr":"172.21.15.38:6807","nonce":703968303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":703968303},{"type":"v1","addr":"172.21.15.38:6805","nonce":703968303}]},"public_addr":"172.21.15.38:6801/703968303","cluster_addr":"172.21.15.38:6803/703968303","heartbeat_back_addr":"172.21.15.38:6807/703968303","heartbeat_front_addr":"172.21.15.38:6805/703968303","state":["exists","up"]},{"osd":3,"uuid":"20730742-284b-4749-b55c-42b108fa4601","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f69a0cda-2c26-4bd3-a2b0-42343e8bbf4f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"81a144c6-eae2-48fe-8113-7f5920197be9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"041e0082-acb7-46ce-adc1-4ffba52bf5db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"30e812ad-f0df-4b22-808d-dd0caea9983b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T08:14:45.912 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-22T08:14:46.080 INFO:tasks.ceph.osd.7.smithi042.stderr:2024-09-22T08:14:46.078+0000 7f29eb577640 -1 osd.7 0 waiting for initial osdmap 2024-09-22T08:14:46.095 INFO:tasks.ceph.osd.7.smithi042.stderr:2024-09-22T08:14:46.094+0000 7f29e3396640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-22T08:14:47.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2024-09-22T08:14:47.099+0000 7f8aae737640 -1 osd.1 0 waiting for initial osdmap 2024-09-22T08:14:47.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2024-09-22T08:14:47.121+0000 7f8aa5d42640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-22T08:14:47.127 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-09-22T08:14:47.126+0000 7f2000721640 -1 osd.3 0 waiting for initial osdmap 2024-09-22T08:14:47.130 INFO:tasks.ceph.osd.0.smithi038.stderr:2024-09-22T08:14:47.130+0000 7f5614a5a640 -1 osd.0 0 waiting for initial osdmap 2024-09-22T08:14:47.135 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-09-22T08:14:47.135+0000 7f1ff7d2c640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-22T08:14:47.147 INFO:tasks.ceph.osd.0.smithi038.stderr:2024-09-22T08:14:47.147+0000 7f560c879640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-22T08:14:52.719 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-22T08:14:53.042 INFO:teuthology.misc.health.smithi038.stdout: 2024-09-22T08:14:53.042 INFO:teuthology.misc.health.smithi038.stdout:{"epoch":17,"fsid":"a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f","created":"2024-09-22T08:14:34.158414+0000","modified":"2024-09-22T08:14:49.485484+0000","last_up_change":"2024-09-22T08:14:47.452169+0000","last_in_change":"2024-09-22T08:14:37.441829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-22T08:14:46.663444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e925403-23d1-4b76-8c8e-5782ecc00c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":2964048893},{"type":"v1","addr":"172.21.15.38:6825","nonce":2964048893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":2964048893},{"type":"v1","addr":"172.21.15.38:6827","nonce":2964048893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":2964048893},{"type":"v1","addr":"172.21.15.38:6831","nonce":2964048893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":2964048893},{"type":"v1","addr":"172.21.15.38:6829","nonce":2964048893}]},"public_addr":"172.21.15.38:6825/2964048893","cluster_addr":"172.21.15.38:6827/2964048893","heartbeat_back_addr":"172.21.15.38:6831/2964048893","heartbeat_front_addr":"172.21.15.38:6829/2964048893","state":["exists","up"]},{"osd":1,"uuid":"e385e001-2edb-4915-9721-5f41f7f59cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1856522357},{"type":"v1","addr":"172.21.15.38:6809","nonce":1856522357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1856522357},{"type":"v1","addr":"172.21.15.38:6811","nonce":1856522357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1856522357},{"type":"v1","addr":"172.21.15.38:6815","nonce":1856522357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1856522357},{"type":"v1","addr":"172.21.15.38:6813","nonce":1856522357}]},"public_addr":"172.21.15.38:6809/1856522357","cluster_addr":"172.21.15.38:6811/1856522357","heartbeat_back_addr":"172.21.15.38:6815/1856522357","heartbeat_front_addr":"172.21.15.38:6813/1856522357","state":["exists","up"]},{"osd":2,"uuid":"d679834b-edf5-4271-894e-75cc07af0a5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":703968303},{"type":"v1","addr":"172.21.15.38:6801","nonce":703968303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":703968303},{"type":"v1","addr":"172.21.15.38:6803","nonce":703968303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":703968303},{"type":"v1","addr":"172.21.15.38:6807","nonce":703968303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":703968303},{"type":"v1","addr":"172.21.15.38:6805","nonce":703968303}]},"public_addr":"172.21.15.38:6801/703968303","cluster_addr":"172.21.15.38:6803/703968303","heartbeat_back_addr":"172.21.15.38:6807/703968303","heartbeat_front_addr":"172.21.15.38:6805/703968303","state":["exists","up"]},{"osd":3,"uuid":"20730742-284b-4749-b55c-42b108fa4601","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":852564455},{"type":"v1","addr":"172.21.15.38:6817","nonce":852564455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":852564455},{"type":"v1","addr":"172.21.15.38:6819","nonce":852564455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":852564455},{"type":"v1","addr":"172.21.15.38:6823","nonce":852564455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":852564455},{"type":"v1","addr":"172.21.15.38:6821","nonce":852564455}]},"public_addr":"172.21.15.38:6817/852564455","cluster_addr":"172.21.15.38:6819/852564455","heartbeat_back_addr":"172.21.15.38:6823/852564455","heartbeat_front_addr":"172.21.15.38:6821/852564455","state":["exists","up"]},{"osd":4,"uuid":"f69a0cda-2c26-4bd3-a2b0-42343e8bbf4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":951985313},{"type":"v1","addr":"172.21.15.42:6819","nonce":951985313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":951985313},{"type":"v1","addr":"172.21.15.42:6821","nonce":951985313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":951985313},{"type":"v1","addr":"172.21.15.42:6825","nonce":951985313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":951985313},{"type":"v1","addr":"172.21.15.42:6823","nonce":951985313}]},"public_addr":"172.21.15.42:6819/951985313","cluster_addr":"172.21.15.42:6821/951985313","heartbeat_back_addr":"172.21.15.42:6825/951985313","heartbeat_front_addr":"172.21.15.42:6823/951985313","state":["exists","up"]},{"osd":5,"uuid":"81a144c6-eae2-48fe-8113-7f5920197be9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":1033356835},{"type":"v1","addr":"172.21.15.42:6811","nonce":1033356835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":1033356835},{"type":"v1","addr":"172.21.15.42:6813","nonce":1033356835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":1033356835},{"type":"v1","addr":"172.21.15.42:6817","nonce":1033356835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":1033356835},{"type":"v1","addr":"172.21.15.42:6815","nonce":1033356835}]},"public_addr":"172.21.15.42:6811/1033356835","cluster_addr":"172.21.15.42:6813/1033356835","heartbeat_back_addr":"172.21.15.42:6817/1033356835","heartbeat_front_addr":"172.21.15.42:6815/1033356835","state":["exists","up"]},{"osd":6,"uuid":"041e0082-acb7-46ce-adc1-4ffba52bf5db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2532764980},{"type":"v1","addr":"172.21.15.42:6803","nonce":2532764980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2532764980},{"type":"v1","addr":"172.21.15.42:6805","nonce":2532764980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2532764980},{"type":"v1","addr":"172.21.15.42:6809","nonce":2532764980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2532764980},{"type":"v1","addr":"172.21.15.42:6807","nonce":2532764980}]},"public_addr":"172.21.15.42:6803/2532764980","cluster_addr":"172.21.15.42:6805/2532764980","heartbeat_back_addr":"172.21.15.42:6809/2532764980","heartbeat_front_addr":"172.21.15.42:6807/2532764980","state":["exists","up"]},{"osd":7,"uuid":"30e812ad-f0df-4b22-808d-dd0caea9983b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1437467409},{"type":"v1","addr":"172.21.15.42:6827","nonce":1437467409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":1437467409},{"type":"v1","addr":"172.21.15.42:6829","nonce":1437467409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1437467409},{"type":"v1","addr":"172.21.15.42:6833","nonce":1437467409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":1437467409},{"type":"v1","addr":"172.21.15.42:6831","nonce":1437467409}]},"public_addr":"172.21.15.42:6827/1437467409","cluster_addr":"172.21.15.42:6829/1437467409","heartbeat_back_addr":"172.21.15.42:6833/1437467409","heartbeat_front_addr":"172.21.15.42:6831/1437467409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:14:44.809004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:14:44.323165+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:14:43.821347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:14:44.760911+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:14:44.042922+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:14:43.773491+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:14:43.707930+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:14:44.567066+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T08:14:53.053 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-22T08:14:53.054 INFO:tasks.ceph:Creating RBD pool 2024-09-22T08:14:53.054 DEBUG:teuthology.orchestra.run.smithi038:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-22T08:14:53.709 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'rbd' created 2024-09-22T08:14:53.723 DEBUG:teuthology.orchestra.run.smithi038:> rbd --cluster ceph pool init rbd 2024-09-22T08:14:53.787 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:14:53.787 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:14:56.736 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-22T08:14:56.737 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-22T08:14:56.737 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-22T08:14:57.067 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:14:57.080 INFO:teuthology.orchestra.run.smithi038.stdout:[{"version":9,"timestamp":"2024-09-22T08:14:47.132381+0000","name":"","changes":[{"name":"osd.0/osd_mclock_max_capacity_iops_ssd","new_value":"5083.890023"}]}] 2024-09-22T08:14:57.080 INFO:tasks.ceph_manager:config epoch is 9 2024-09-22T08:14:57.080 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-22T08:14:57.080 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-22T08:14:57.080 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-22T08:14:57.448 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:14:57.459 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":413048707},{"type":"v1","addr":"172.21.15.42:6801","nonce":413048707}]},"active_addr":"172.21.15.42:6801/413048707","active_change":"2024-09-22T08:14:38.637380+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.42:0","nonce":3103490996}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.42:0","nonce":4192146595}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.42:0","nonce":268192181}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.42:0","nonce":3781038509}]}]} 2024-09-22T08:14:57.463 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-22T08:14:57.463 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-22T08:14:57.463 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T08:14:57.783 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:14:57.783 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":21,"fsid":"a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f","created":"2024-09-22T08:14:34.158414+0000","modified":"2024-09-22T08:14:56.709248+0000","last_up_change":"2024-09-22T08:14:47.452169+0000","last_in_change":"2024-09-22T08:14:37.441829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-22T08:14:46.663444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-22T08:14:53.369744+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e925403-23d1-4b76-8c8e-5782ecc00c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":2964048893},{"type":"v1","addr":"172.21.15.38:6825","nonce":2964048893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":2964048893},{"type":"v1","addr":"172.21.15.38:6827","nonce":2964048893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":2964048893},{"type":"v1","addr":"172.21.15.38:6831","nonce":2964048893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":2964048893},{"type":"v1","addr":"172.21.15.38:6829","nonce":2964048893}]},"public_addr":"172.21.15.38:6825/2964048893","cluster_addr":"172.21.15.38:6827/2964048893","heartbeat_back_addr":"172.21.15.38:6831/2964048893","heartbeat_front_addr":"172.21.15.38:6829/2964048893","state":["exists","up"]},{"osd":1,"uuid":"e385e001-2edb-4915-9721-5f41f7f59cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1856522357},{"type":"v1","addr":"172.21.15.38:6809","nonce":1856522357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1856522357},{"type":"v1","addr":"172.21.15.38:6811","nonce":1856522357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1856522357},{"type":"v1","addr":"172.21.15.38:6815","nonce":1856522357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1856522357},{"type":"v1","addr":"172.21.15.38:6813","nonce":1856522357}]},"public_addr":"172.21.15.38:6809/1856522357","cluster_addr":"172.21.15.38:6811/1856522357","heartbeat_back_addr":"172.21.15.38:6815/1856522357","heartbeat_front_addr":"172.21.15.38:6813/1856522357","state":["exists","up"]},{"osd":2,"uuid":"d679834b-edf5-4271-894e-75cc07af0a5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":703968303},{"type":"v1","addr":"172.21.15.38:6801","nonce":703968303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":703968303},{"type":"v1","addr":"172.21.15.38:6803","nonce":703968303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":703968303},{"type":"v1","addr":"172.21.15.38:6807","nonce":703968303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":703968303},{"type":"v1","addr":"172.21.15.38:6805","nonce":703968303}]},"public_addr":"172.21.15.38:6801/703968303","cluster_addr":"172.21.15.38:6803/703968303","heartbeat_back_addr":"172.21.15.38:6807/703968303","heartbeat_front_addr":"172.21.15.38:6805/703968303","state":["exists","up"]},{"osd":3,"uuid":"20730742-284b-4749-b55c-42b108fa4601","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":852564455},{"type":"v1","addr":"172.21.15.38:6817","nonce":852564455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":852564455},{"type":"v1","addr":"172.21.15.38:6819","nonce":852564455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":852564455},{"type":"v1","addr":"172.21.15.38:6823","nonce":852564455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":852564455},{"type":"v1","addr":"172.21.15.38:6821","nonce":852564455}]},"public_addr":"172.21.15.38:6817/852564455","cluster_addr":"172.21.15.38:6819/852564455","heartbeat_back_addr":"172.21.15.38:6823/852564455","heartbeat_front_addr":"172.21.15.38:6821/852564455","state":["exists","up"]},{"osd":4,"uuid":"f69a0cda-2c26-4bd3-a2b0-42343e8bbf4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":951985313},{"type":"v1","addr":"172.21.15.42:6819","nonce":951985313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":951985313},{"type":"v1","addr":"172.21.15.42:6821","nonce":951985313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":951985313},{"type":"v1","addr":"172.21.15.42:6825","nonce":951985313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":951985313},{"type":"v1","addr":"172.21.15.42:6823","nonce":951985313}]},"public_addr":"172.21.15.42:6819/951985313","cluster_addr":"172.21.15.42:6821/951985313","heartbeat_back_addr":"172.21.15.42:6825/951985313","heartbeat_front_addr":"172.21.15.42:6823/951985313","state":["exists","up"]},{"osd":5,"uuid":"81a144c6-eae2-48fe-8113-7f5920197be9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":1033356835},{"type":"v1","addr":"172.21.15.42:6811","nonce":1033356835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":1033356835},{"type":"v1","addr":"172.21.15.42:6813","nonce":1033356835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":1033356835},{"type":"v1","addr":"172.21.15.42:6817","nonce":1033356835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":1033356835},{"type":"v1","addr":"172.21.15.42:6815","nonce":1033356835}]},"public_addr":"172.21.15.42:6811/1033356835","cluster_addr":"172.21.15.42:6813/1033356835","heartbeat_back_addr":"172.21.15.42:6817/1033356835","heartbeat_front_addr":"172.21.15.42:6815/1033356835","state":["exists","up"]},{"osd":6,"uuid":"041e0082-acb7-46ce-adc1-4ffba52bf5db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2532764980},{"type":"v1","addr":"172.21.15.42:6803","nonce":2532764980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2532764980},{"type":"v1","addr":"172.21.15.42:6805","nonce":2532764980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2532764980},{"type":"v1","addr":"172.21.15.42:6809","nonce":2532764980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2532764980},{"type":"v1","addr":"172.21.15.42:6807","nonce":2532764980}]},"public_addr":"172.21.15.42:6803/2532764980","cluster_addr":"172.21.15.42:6805/2532764980","heartbeat_back_addr":"172.21.15.42:6809/2532764980","heartbeat_front_addr":"172.21.15.42:6807/2532764980","state":["exists","up"]},{"osd":7,"uuid":"30e812ad-f0df-4b22-808d-dd0caea9983b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1437467409},{"type":"v1","addr":"172.21.15.42:6827","nonce":1437467409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":1437467409},{"type":"v1","addr":"172.21.15.42:6829","nonce":1437467409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1437467409},{"type":"v1","addr":"172.21.15.42:6833","nonce":1437467409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":1437467409},{"type":"v1","addr":"172.21.15.42:6831","nonce":1437467409}]},"public_addr":"172.21.15.42:6827/1437467409","cluster_addr":"172.21.15.42:6829/1437467409","heartbeat_back_addr":"172.21.15.42:6833/1437467409","heartbeat_front_addr":"172.21.15.42:6831/1437467409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:14:44.809004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:14:44.323165+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:14:43.821347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:14:44.760911+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:14:44.042922+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:14:43.773491+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:14:43.707930+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:14:44.567066+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T08:14:57.796 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-22T08:14:57.796 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T08:14:58.114 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:14:58.115 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":21,"fsid":"a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f","created":"2024-09-22T08:14:34.158414+0000","modified":"2024-09-22T08:14:56.709248+0000","last_up_change":"2024-09-22T08:14:47.452169+0000","last_in_change":"2024-09-22T08:14:37.441829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-22T08:14:46.663444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-22T08:14:53.369744+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e925403-23d1-4b76-8c8e-5782ecc00c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":2964048893},{"type":"v1","addr":"172.21.15.38:6825","nonce":2964048893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":2964048893},{"type":"v1","addr":"172.21.15.38:6827","nonce":2964048893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":2964048893},{"type":"v1","addr":"172.21.15.38:6831","nonce":2964048893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":2964048893},{"type":"v1","addr":"172.21.15.38:6829","nonce":2964048893}]},"public_addr":"172.21.15.38:6825/2964048893","cluster_addr":"172.21.15.38:6827/2964048893","heartbeat_back_addr":"172.21.15.38:6831/2964048893","heartbeat_front_addr":"172.21.15.38:6829/2964048893","state":["exists","up"]},{"osd":1,"uuid":"e385e001-2edb-4915-9721-5f41f7f59cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1856522357},{"type":"v1","addr":"172.21.15.38:6809","nonce":1856522357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1856522357},{"type":"v1","addr":"172.21.15.38:6811","nonce":1856522357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1856522357},{"type":"v1","addr":"172.21.15.38:6815","nonce":1856522357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1856522357},{"type":"v1","addr":"172.21.15.38:6813","nonce":1856522357}]},"public_addr":"172.21.15.38:6809/1856522357","cluster_addr":"172.21.15.38:6811/1856522357","heartbeat_back_addr":"172.21.15.38:6815/1856522357","heartbeat_front_addr":"172.21.15.38:6813/1856522357","state":["exists","up"]},{"osd":2,"uuid":"d679834b-edf5-4271-894e-75cc07af0a5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":703968303},{"type":"v1","addr":"172.21.15.38:6801","nonce":703968303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":703968303},{"type":"v1","addr":"172.21.15.38:6803","nonce":703968303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":703968303},{"type":"v1","addr":"172.21.15.38:6807","nonce":703968303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":703968303},{"type":"v1","addr":"172.21.15.38:6805","nonce":703968303}]},"public_addr":"172.21.15.38:6801/703968303","cluster_addr":"172.21.15.38:6803/703968303","heartbeat_back_addr":"172.21.15.38:6807/703968303","heartbeat_front_addr":"172.21.15.38:6805/703968303","state":["exists","up"]},{"osd":3,"uuid":"20730742-284b-4749-b55c-42b108fa4601","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":852564455},{"type":"v1","addr":"172.21.15.38:6817","nonce":852564455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":852564455},{"type":"v1","addr":"172.21.15.38:6819","nonce":852564455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":852564455},{"type":"v1","addr":"172.21.15.38:6823","nonce":852564455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":852564455},{"type":"v1","addr":"172.21.15.38:6821","nonce":852564455}]},"public_addr":"172.21.15.38:6817/852564455","cluster_addr":"172.21.15.38:6819/852564455","heartbeat_back_addr":"172.21.15.38:6823/852564455","heartbeat_front_addr":"172.21.15.38:6821/852564455","state":["exists","up"]},{"osd":4,"uuid":"f69a0cda-2c26-4bd3-a2b0-42343e8bbf4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":951985313},{"type":"v1","addr":"172.21.15.42:6819","nonce":951985313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":951985313},{"type":"v1","addr":"172.21.15.42:6821","nonce":951985313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":951985313},{"type":"v1","addr":"172.21.15.42:6825","nonce":951985313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":951985313},{"type":"v1","addr":"172.21.15.42:6823","nonce":951985313}]},"public_addr":"172.21.15.42:6819/951985313","cluster_addr":"172.21.15.42:6821/951985313","heartbeat_back_addr":"172.21.15.42:6825/951985313","heartbeat_front_addr":"172.21.15.42:6823/951985313","state":["exists","up"]},{"osd":5,"uuid":"81a144c6-eae2-48fe-8113-7f5920197be9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":1033356835},{"type":"v1","addr":"172.21.15.42:6811","nonce":1033356835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":1033356835},{"type":"v1","addr":"172.21.15.42:6813","nonce":1033356835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":1033356835},{"type":"v1","addr":"172.21.15.42:6817","nonce":1033356835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":1033356835},{"type":"v1","addr":"172.21.15.42:6815","nonce":1033356835}]},"public_addr":"172.21.15.42:6811/1033356835","cluster_addr":"172.21.15.42:6813/1033356835","heartbeat_back_addr":"172.21.15.42:6817/1033356835","heartbeat_front_addr":"172.21.15.42:6815/1033356835","state":["exists","up"]},{"osd":6,"uuid":"041e0082-acb7-46ce-adc1-4ffba52bf5db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2532764980},{"type":"v1","addr":"172.21.15.42:6803","nonce":2532764980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2532764980},{"type":"v1","addr":"172.21.15.42:6805","nonce":2532764980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2532764980},{"type":"v1","addr":"172.21.15.42:6809","nonce":2532764980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2532764980},{"type":"v1","addr":"172.21.15.42:6807","nonce":2532764980}]},"public_addr":"172.21.15.42:6803/2532764980","cluster_addr":"172.21.15.42:6805/2532764980","heartbeat_back_addr":"172.21.15.42:6809/2532764980","heartbeat_front_addr":"172.21.15.42:6807/2532764980","state":["exists","up"]},{"osd":7,"uuid":"30e812ad-f0df-4b22-808d-dd0caea9983b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1437467409},{"type":"v1","addr":"172.21.15.42:6827","nonce":1437467409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":1437467409},{"type":"v1","addr":"172.21.15.42:6829","nonce":1437467409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1437467409},{"type":"v1","addr":"172.21.15.42:6833","nonce":1437467409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":1437467409},{"type":"v1","addr":"172.21.15.42:6831","nonce":1437467409}]},"public_addr":"172.21.15.42:6827/1437467409","cluster_addr":"172.21.15.42:6829/1437467409","heartbeat_back_addr":"172.21.15.42:6833/1437467409","heartbeat_front_addr":"172.21.15.42:6831/1437467409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:14:44.809004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:14:44.323165+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:14:43.821347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:14:44.760911+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:14:44.042922+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:14:43.773491+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:14:43.707930+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:14:44.567066+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T08:14:58.128 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-22T08:14:58.129 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-22T08:14:58.129 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-22T08:14:58.129 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-22T08:14:58.130 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-22T08:14:58.130 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-22T08:14:58.130 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-22T08:14:58.131 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-22T08:14:58.398 INFO:teuthology.orchestra.run.smithi038.stdout:64424509446 2024-09-22T08:14:58.398 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-22T08:14:58.407 INFO:teuthology.orchestra.run.smithi038.stdout:55834574852 2024-09-22T08:14:58.408 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-22T08:14:58.410 INFO:teuthology.orchestra.run.smithi038.stdout:60129542149 2024-09-22T08:14:58.410 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-22T08:14:58.411 INFO:teuthology.orchestra.run.smithi038.stdout:64424509446 2024-09-22T08:14:58.411 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-22T08:14:58.412 INFO:teuthology.orchestra.run.smithi038.stdout:64424509446 2024-09-22T08:14:58.413 INFO:teuthology.orchestra.run.smithi038.stdout:60129542150 2024-09-22T08:14:58.413 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-22T08:14:58.413 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-22T08:14:58.414 INFO:teuthology.orchestra.run.smithi038.stdout:60129542150 2024-09-22T08:14:58.415 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-22T08:14:58.415 INFO:teuthology.orchestra.run.smithi038.stdout:60129542150 2024-09-22T08:14:58.416 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-22T08:14:59.023 INFO:teuthology.orchestra.run.smithi038.stdout:64424509446 2024-09-22T08:14:59.043 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.1 2024-09-22T08:14:59.043 DEBUG:teuthology.parallel:result is None 2024-09-22T08:14:59.058 INFO:teuthology.orchestra.run.smithi038.stdout:55834574852 2024-09-22T08:14:59.077 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.2 2024-09-22T08:14:59.077 DEBUG:teuthology.parallel:result is None 2024-09-22T08:14:59.084 INFO:teuthology.orchestra.run.smithi038.stdout:64424509446 2024-09-22T08:14:59.091 INFO:teuthology.orchestra.run.smithi038.stdout:60129542149 2024-09-22T08:14:59.098 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.0 2024-09-22T08:14:59.098 DEBUG:teuthology.parallel:result is None 2024-09-22T08:14:59.105 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.6 2024-09-22T08:14:59.106 DEBUG:teuthology.parallel:result is None 2024-09-22T08:14:59.109 INFO:teuthology.orchestra.run.smithi038.stdout:60129542150 2024-09-22T08:14:59.117 INFO:teuthology.orchestra.run.smithi038.stdout:64424509446 2024-09-22T08:14:59.122 INFO:teuthology.orchestra.run.smithi038.stdout:60129542150 2024-09-22T08:14:59.124 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.5 2024-09-22T08:14:59.124 DEBUG:teuthology.parallel:result is None 2024-09-22T08:14:59.132 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.3 2024-09-22T08:14:59.132 DEBUG:teuthology.parallel:result is None 2024-09-22T08:14:59.133 INFO:teuthology.orchestra.run.smithi038.stdout:60129542150 2024-09-22T08:14:59.137 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.4 2024-09-22T08:14:59.137 DEBUG:teuthology.parallel:result is None 2024-09-22T08:14:59.146 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.7 2024-09-22T08:14:59.146 DEBUG:teuthology.parallel:result is None 2024-09-22T08:14:59.146 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-22T08:14:59.146 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T08:14:59.501 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:14:59.501 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-09-22T08:14:59.513 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-22T08:14:58.911060+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256500,"kb_used_data":2800,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754718220,"statfs":{"total":773094113280,"available":772831457280,"internally_reserved":0,"allocated":2867200,"data_stored":1752046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":259575345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.263428"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:14:56.730085+0000","last_change":"2024-09-22T08:14:56.730085+0000","last_active":"2024-09-22T08:14:56.730085+0000","last_peered":"2024-09-22T08:14:56.730085+0000","last_clean":"2024-09-22T08:14:56.730085+0000","last_became_active":"2024-09-22T08:14:55.585485+0000","last_became_peered":"2024-09-22T08:14:55.585485+0000","last_unstale":"2024-09-22T08:14:56.730085+0000","last_undegraded":"2024-09-22T08:14:56.730085+0000","last_fullsized":"2024-09-22T08:14:56.730085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:42:52.718426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012642249999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:14:56.713315+0000","last_change":"2024-09-22T08:14:56.713315+0000","last_active":"2024-09-22T08:14:56.713315+0000","last_peered":"2024-09-22T08:14:56.713315+0000","last_clean":"2024-09-22T08:14:56.713315+0000","last_became_active":"2024-09-22T08:14:55.585607+0000","last_became_peered":"2024-09-22T08:14:55.585607+0000","last_unstale":"2024-09-22T08:14:56.713315+0000","last_undegraded":"2024-09-22T08:14:56.713315+0000","last_fullsized":"2024-09-22T08:14:56.713315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:00:51.872643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049298099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:14:56.729377+0000","last_change":"2024-09-22T08:14:56.729377+0000","last_active":"2024-09-22T08:14:56.729377+0000","last_peered":"2024-09-22T08:14:56.729377+0000","last_clean":"2024-09-22T08:14:56.729377+0000","last_became_active":"2024-09-22T08:14:54.727321+0000","last_became_peered":"2024-09-22T08:14:54.727321+0000","last_unstale":"2024-09-22T08:14:56.729377+0000","last_undegraded":"2024-09-22T08:14:56.729377+0000","last_fullsized":"2024-09-22T08:14:56.729377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:21:23.198586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058148900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:14:56.801946+0000","last_change":"2024-09-22T08:14:56.801946+0000","last_active":"2024-09-22T08:14:56.801946+0000","last_peered":"2024-09-22T08:14:56.801946+0000","last_clean":"2024-09-22T08:14:56.801946+0000","last_became_active":"2024-09-22T08:14:55.585738+0000","last_became_peered":"2024-09-22T08:14:55.585738+0000","last_unstale":"2024-09-22T08:14:56.801946+0000","last_undegraded":"2024-09-22T08:14:56.801946+0000","last_fullsized":"2024-09-22T08:14:56.801946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:33:45.401549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053802500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:14:56.730778+0000","last_change":"2024-09-22T08:14:56.729819+0000","last_active":"2024-09-22T08:14:56.730778+0000","last_peered":"2024-09-22T08:14:56.730778+0000","last_clean":"2024-09-22T08:14:56.730778+0000","last_became_active":"2024-09-22T08:14:55.586088+0000","last_became_peered":"2024-09-22T08:14:55.586088+0000","last_unstale":"2024-09-22T08:14:56.730778+0000","last_undegraded":"2024-09-22T08:14:56.730778+0000","last_fullsized":"2024-09-22T08:14:56.730778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:11:26.177736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010233219999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:14:56.717627+0000","last_change":"2024-09-22T08:14:56.717627+0000","last_active":"2024-09-22T08:14:56.717627+0000","last_peered":"2024-09-22T08:14:56.717627+0000","last_clean":"2024-09-22T08:14:56.717627+0000","last_became_active":"2024-09-22T08:14:54.718660+0000","last_became_peered":"2024-09-22T08:14:54.718660+0000","last_unstale":"2024-09-22T08:14:56.717627+0000","last_undegraded":"2024-09-22T08:14:56.717627+0000","last_fullsized":"2024-09-22T08:14:56.717627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:04:54.693455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042448600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:14:56.729334+0000","last_change":"2024-09-22T08:14:56.729334+0000","last_active":"2024-09-22T08:14:56.729334+0000","last_peered":"2024-09-22T08:14:56.729334+0000","last_clean":"2024-09-22T08:14:56.729334+0000","last_became_active":"2024-09-22T08:14:54.726875+0000","last_became_peered":"2024-09-22T08:14:54.726875+0000","last_unstale":"2024-09-22T08:14:56.729334+0000","last_undegraded":"2024-09-22T08:14:56.729334+0000","last_fullsized":"2024-09-22T08:14:56.729334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:39:49.545065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000558433,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:14:56.729851+0000","last_change":"2024-09-22T08:14:56.729851+0000","last_active":"2024-09-22T08:14:56.729851+0000","last_peered":"2024-09-22T08:14:56.729851+0000","last_clean":"2024-09-22T08:14:56.729851+0000","last_became_active":"2024-09-22T08:14:54.727501+0000","last_became_peered":"2024-09-22T08:14:54.727501+0000","last_unstale":"2024-09-22T08:14:56.729851+0000","last_undegraded":"2024-09-22T08:14:56.729851+0000","last_fullsized":"2024-09-22T08:14:56.729851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:23:47.178939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001065632,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:14:57.254969+0000","last_change":"2024-09-22T08:14:48.585279+0000","last_active":"2024-09-22T08:14:57.254969+0000","last_peered":"2024-09-22T08:14:57.254969+0000","last_clean":"2024-09-22T08:14:57.254969+0000","last_became_active":"2024-09-22T08:14:48.584210+0000","last_became_peered":"2024-09-22T08:14:48.584210+0000","last_unstale":"2024-09-22T08:14:57.254969+0000","last_undegraded":"2024-09-22T08:14:57.254969+0000","last_fullsized":"2024-09-22T08:14:57.254969+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:47.452169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:47.452169+0000","last_clean_scrub_stamp":"2024-09-22T08:14:47.452169+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:40:54.190577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":212992,"data_stored":71428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":802816,"data_stored":661777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":208896,"data_stored":71409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35560,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336280,"statfs":{"total":96636764160,"available":96600350720,"internally_reserved":0,"allocated":208896,"data_stored":71409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":212992,"data_stored":71428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":802816,"data_stored":661777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":208896,"data_stored":71409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":208896,"data_stored":71409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T08:14:59.514 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T08:14:59.826 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:14:59.827 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-09-22T08:14:59.839 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-22T08:14:58.911060+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256500,"kb_used_data":2800,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754718220,"statfs":{"total":773094113280,"available":772831457280,"internally_reserved":0,"allocated":2867200,"data_stored":1752046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":259575345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.263428"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:14:56.730085+0000","last_change":"2024-09-22T08:14:56.730085+0000","last_active":"2024-09-22T08:14:56.730085+0000","last_peered":"2024-09-22T08:14:56.730085+0000","last_clean":"2024-09-22T08:14:56.730085+0000","last_became_active":"2024-09-22T08:14:55.585485+0000","last_became_peered":"2024-09-22T08:14:55.585485+0000","last_unstale":"2024-09-22T08:14:56.730085+0000","last_undegraded":"2024-09-22T08:14:56.730085+0000","last_fullsized":"2024-09-22T08:14:56.730085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:42:52.718426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012642249999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:14:56.713315+0000","last_change":"2024-09-22T08:14:56.713315+0000","last_active":"2024-09-22T08:14:56.713315+0000","last_peered":"2024-09-22T08:14:56.713315+0000","last_clean":"2024-09-22T08:14:56.713315+0000","last_became_active":"2024-09-22T08:14:55.585607+0000","last_became_peered":"2024-09-22T08:14:55.585607+0000","last_unstale":"2024-09-22T08:14:56.713315+0000","last_undegraded":"2024-09-22T08:14:56.713315+0000","last_fullsized":"2024-09-22T08:14:56.713315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:00:51.872643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049298099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:14:56.729377+0000","last_change":"2024-09-22T08:14:56.729377+0000","last_active":"2024-09-22T08:14:56.729377+0000","last_peered":"2024-09-22T08:14:56.729377+0000","last_clean":"2024-09-22T08:14:56.729377+0000","last_became_active":"2024-09-22T08:14:54.727321+0000","last_became_peered":"2024-09-22T08:14:54.727321+0000","last_unstale":"2024-09-22T08:14:56.729377+0000","last_undegraded":"2024-09-22T08:14:56.729377+0000","last_fullsized":"2024-09-22T08:14:56.729377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:21:23.198586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058148900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:14:56.801946+0000","last_change":"2024-09-22T08:14:56.801946+0000","last_active":"2024-09-22T08:14:56.801946+0000","last_peered":"2024-09-22T08:14:56.801946+0000","last_clean":"2024-09-22T08:14:56.801946+0000","last_became_active":"2024-09-22T08:14:55.585738+0000","last_became_peered":"2024-09-22T08:14:55.585738+0000","last_unstale":"2024-09-22T08:14:56.801946+0000","last_undegraded":"2024-09-22T08:14:56.801946+0000","last_fullsized":"2024-09-22T08:14:56.801946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:33:45.401549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053802500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:14:56.730778+0000","last_change":"2024-09-22T08:14:56.729819+0000","last_active":"2024-09-22T08:14:56.730778+0000","last_peered":"2024-09-22T08:14:56.730778+0000","last_clean":"2024-09-22T08:14:56.730778+0000","last_became_active":"2024-09-22T08:14:55.586088+0000","last_became_peered":"2024-09-22T08:14:55.586088+0000","last_unstale":"2024-09-22T08:14:56.730778+0000","last_undegraded":"2024-09-22T08:14:56.730778+0000","last_fullsized":"2024-09-22T08:14:56.730778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:11:26.177736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010233219999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:14:56.717627+0000","last_change":"2024-09-22T08:14:56.717627+0000","last_active":"2024-09-22T08:14:56.717627+0000","last_peered":"2024-09-22T08:14:56.717627+0000","last_clean":"2024-09-22T08:14:56.717627+0000","last_became_active":"2024-09-22T08:14:54.718660+0000","last_became_peered":"2024-09-22T08:14:54.718660+0000","last_unstale":"2024-09-22T08:14:56.717627+0000","last_undegraded":"2024-09-22T08:14:56.717627+0000","last_fullsized":"2024-09-22T08:14:56.717627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:04:54.693455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042448600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:14:56.729334+0000","last_change":"2024-09-22T08:14:56.729334+0000","last_active":"2024-09-22T08:14:56.729334+0000","last_peered":"2024-09-22T08:14:56.729334+0000","last_clean":"2024-09-22T08:14:56.729334+0000","last_became_active":"2024-09-22T08:14:54.726875+0000","last_became_peered":"2024-09-22T08:14:54.726875+0000","last_unstale":"2024-09-22T08:14:56.729334+0000","last_undegraded":"2024-09-22T08:14:56.729334+0000","last_fullsized":"2024-09-22T08:14:56.729334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:39:49.545065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000558433,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:14:56.729851+0000","last_change":"2024-09-22T08:14:56.729851+0000","last_active":"2024-09-22T08:14:56.729851+0000","last_peered":"2024-09-22T08:14:56.729851+0000","last_clean":"2024-09-22T08:14:56.729851+0000","last_became_active":"2024-09-22T08:14:54.727501+0000","last_became_peered":"2024-09-22T08:14:54.727501+0000","last_unstale":"2024-09-22T08:14:56.729851+0000","last_undegraded":"2024-09-22T08:14:56.729851+0000","last_fullsized":"2024-09-22T08:14:56.729851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:23:47.178939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001065632,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:14:57.254969+0000","last_change":"2024-09-22T08:14:48.585279+0000","last_active":"2024-09-22T08:14:57.254969+0000","last_peered":"2024-09-22T08:14:57.254969+0000","last_clean":"2024-09-22T08:14:57.254969+0000","last_became_active":"2024-09-22T08:14:48.584210+0000","last_became_peered":"2024-09-22T08:14:48.584210+0000","last_unstale":"2024-09-22T08:14:57.254969+0000","last_undegraded":"2024-09-22T08:14:57.254969+0000","last_fullsized":"2024-09-22T08:14:57.254969+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:47.452169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:47.452169+0000","last_clean_scrub_stamp":"2024-09-22T08:14:47.452169+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:40:54.190577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":212992,"data_stored":71428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":802816,"data_stored":661777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":208896,"data_stored":71409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35560,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336280,"statfs":{"total":96636764160,"available":96600350720,"internally_reserved":0,"allocated":208896,"data_stored":71409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":212992,"data_stored":71428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":802816,"data_stored":661777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":208896,"data_stored":71409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":208896,"data_stored":71409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T08:14:59.840 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-22T08:14:59.840 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-22T08:14:59.840 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-22T08:14:59.840 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-22T08:15:00.195 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:15:00.195 INFO:teuthology.orchestra.run.smithi038.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-22T08:15:00.208 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-22T08:15:00.208 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-22T08:15:00.219 DEBUG:teuthology.task:Applying overrides for task openssl_keys: {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}} 2024-09-22T08:15:00.219 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-22T08:15:00.248 DEBUG:teuthology.orchestra.run.smithi038:> openssl req -x509 -nodes -newkey rsa:4096 -keyout /home/ubuntu/cephtest/ca/root.key -days 365 -out /home/ubuntu/cephtest/ca/root.crt -subj /CN=teuthology 2024-09-22T08:15:00.543 INFO:teuthology.orchestra.run.smithi038.stderr:..+.....+......+..........+.....+....+.........+......+......+++++++++++++++++++++++++++++++++++++++++++++*.........+...+...............+...+.......+...........+.+...+..+.+............+...+..+...+.......+..+...+.......+...+...+++++++++++++++++++++++++++++++++++++++++++++*..+...+..+.+..+.+.....+..........+......+...........+....+...+..................+.....+...............+.......+...........+...............+...................+...+...............+...+...........+.+..+.+...........+...+...+...............+.......+...+.........+...........+...................+...+........+.............+........................+......+.....+.+.........+...............+..+...+....+.....+......+++++ 2024-09-22T08:15:01.415 INFO:teuthology.orchestra.run.smithi038.stderr:.+.+.....+++++++++++++++++++++++++++++++++++++++++++++*..+.........+......+.+.........+........+......+..........+..+....+...+......+.....+...............+.+...+..+.+.....+.......+..+......+...+.........+.+...............+.........+......+..+...+......+.+..+......+.....................+...+......+......+...............+.+..+.......+...+.....+.+.....+.+......+.....+..........+..+.............+..+.+......+...+...+.....+....+.....+....+..+...........................+.+.....+++++++++++++++++++++++++++++++++++++++++++++*.....+...................+......+.........+..............+.......+.....+...+.+......+.........+..................+......+.................+....+......+.....+............+.+..............+.......+.....+...+...+.......+...............+......+.....................+......+.....+....+........+............+....+......+......+..+.............+...+.........+.....+.+...........+....+..+...+.+...........+...+.+.....+..........+......+..+......+....+.....+......+....+..+...............+.+..+...+.......+..+.........+....+......+..+.........+..........+........+...+.........+......+....+...+..................+............+......+.....+.......+...+.........+...+..................+..+...+.........+............+.+........+.......+.........+...+........+...+.........+..........+...+..+.+......+...........+...............+....+...+...+...+.....+......+....+..+....+...+..+...+.+..+.......+.....+.+............+...............+...+...........+......+....+.........+..+...+................+..................+.....+.............+..............+......+.......+..+.............+..+.........+................+...........+.......+...........+....+.....+.+.....+......+.........+......+.+.....+.......+........+...+.........+.......+.....+.............+...........+.......+..+......+......+.+..............+..........+......+...+..+.............+..+.......+.....+.+.........+...........+.+......+.........+.....+................+...............+........+......+.+.........+...+..+...................+..+..........+.........+..................+...+....................+.......+............+.....+...+.+.................+....+......+..+.+.....+.......+...+...........+...+...+...+.+.........+.................+.......+........+....+......+...+..+....+...+..+...+......+.+...............+...+..+.+..+..........+...........+......+.+..+..........+.....+......+....+............+......+...............+...+.................+....+.....+.+.................+...+....+.........+++++ 2024-09-22T08:15:01.439 INFO:teuthology.orchestra.run.smithi038.stderr:----- 2024-09-22T08:15:01.448 DEBUG:teuthology.orchestra.run.smithi038:> sudo cp /home/ubuntu/cephtest/ca/root.crt /usr/share/pki/ca-trust-source/anchors/root.crt 2024-09-22T08:15:01.488 DEBUG:teuthology.orchestra.run.smithi038:> sudo update-ca-trust 2024-09-22T08:15:02.613 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-22T08:15:02.642 DEBUG:teuthology.orchestra.run.smithi038:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.0.key -out /home/ubuntu/cephtest/ca/rgw.client.0.csr -subj /CN=smithi038.front.sepia.ceph.com 2024-09-22T08:15:02.743 INFO:teuthology.orchestra.run.smithi038.stderr:...+............+.......+.........+......+......+.....+....+++++++++++++++++++++++++++++++++++++++*..+...+.........+..................+........+.+.....+.+++++++++++++++++++++++++++++++++++++++*.......+.................+.+...+..+.........+..........+...+........+....+........+.+...........+....+.....++++++ 2024-09-22T08:15:02.743 INFO:teuthology.orchestra.run.smithi038.stderr:..+.....+.......+..+....+..+......................+++++++++++++++++++++++++++++++++++++++*........+...........+++++++++++++++++++++++++++++++++++++++*.+..+......+.......+...........+....+...+..+.+..............+.+...........+.........+.+.......................+.+.................+....+......+..+.+..+....+......++++++ 2024-09-22T08:15:02.743 INFO:teuthology.orchestra.run.smithi038.stderr:----- 2024-09-22T08:15:02.744 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-22T08:15:02.744 DEBUG:teuthology.orchestra.run.smithi038:> dd of=/home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-22T08:15:02.813 DEBUG:teuthology.orchestra.run.smithi038:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.0.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.0.crt -days 365 -sha256 -extfile /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-22T08:15:02.892 INFO:teuthology.orchestra.run.smithi038.stderr:Certificate request self-signature ok 2024-09-22T08:15:02.892 INFO:teuthology.orchestra.run.smithi038.stderr:subject=CN=smithi038.front.sepia.ceph.com 2024-09-22T08:15:02.902 DEBUG:teuthology.orchestra.run.smithi038:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.csr /home/ubuntu/cephtest/ca/root.srl /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-22T08:15:02.971 DEBUG:teuthology.orchestra.run.smithi038:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-22T08:15:03.043 INFO:teuthology.orchestra.run.smithi038.stdout:/home/ubuntu/cephtest/ca/rgw.client.0.crt: OK 2024-09-22T08:15:03.044 DEBUG:teuthology.orchestra.run.smithi038:> cat /home/ubuntu/cephtest/ca/rgw.client.0.key >> /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-22T08:15:03.113 INFO:teuthology.run_tasks:Running task rgw... 2024-09-22T08:15:03.128 DEBUG:tasks.rgw:config is {'client.0': {'ssl certificate': 'rgw.client.0'}} 2024-09-22T08:15:03.128 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-22T08:15:03.128 INFO:tasks.rgw:Creating data pools 2024-09-22T08:15:03.129 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-22T08:15:03.129 DEBUG:teuthology.orchestra.run.smithi038:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-09-22T08:15:03.934 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'default.rgw.buckets.data' created 2024-09-22T08:15:03.958 DEBUG:teuthology.orchestra.run.smithi038:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-22T08:15:04.944 INFO:teuthology.orchestra.run.smithi038.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-22T08:15:04.983 DEBUG:teuthology.orchestra.run.smithi038:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-22T08:15:05.942 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'default.rgw.buckets.index' created 2024-09-22T08:15:05.964 DEBUG:teuthology.orchestra.run.smithi038:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-22T08:15:06.955 INFO:teuthology.orchestra.run.smithi038.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-22T08:15:06.988 DEBUG:tasks.rgw:Pools created 2024-09-22T08:15:06.988 INFO:tasks.rgw:Configuring compression type = random 2024-09-22T08:15:06.989 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-22T08:15:06.989 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-22T08:15:06.989 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-22T08:15:07.087 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:15:07.087 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:15:09.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:09.010+0000 7f5514877640 0 -- >> [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] conn(0x56378e8fff20 msgr2=0x56378e900320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2024-09-22T08:15:09.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:09.014+0000 7f551832f800 20 rados->read ofs=0 len=0 2024-09-22T08:15:09.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:09.015+0000 7f5514076640 0 -- 172.21.15.38:0/2690415672 >> [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] conn(0x7f53e0077570 msgr2=0x7f53e0079a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:15:09.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:09.016+0000 7f551832f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:15:09.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:09.016+0000 7f551832f800 20 realm 2024-09-22T08:15:09.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:09.016+0000 7f551832f800 20 rados->read ofs=0 len=0 2024-09-22T08:15:09.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:09.016+0000 7f551832f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:15:09.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:09.016+0000 7f551832f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:15:09.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:09.016+0000 7f551832f800 20 rados->read ofs=0 len=0 2024-09-22T08:15:09.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:09.017+0000 7f551832f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:15:09.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:09.017+0000 7f551832f800 20 rados->read ofs=0 len=0 2024-09-22T08:15:09.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:09.017+0000 7f551832f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:15:09.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:09.017+0000 7f551832f800 20 rados->read ofs=0 len=0 2024-09-22T08:15:09.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:09.018+0000 7f551832f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:15:09.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:09.018+0000 7f551832f800 20 searching for the correct realm 2024-09-22T08:15:09.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:09.030+0000 7f551832f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:15:09.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:09.030+0000 7f551832f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:15:09.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:09.030+0000 7f551832f800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:15:09.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:09.030+0000 7f551832f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:15:09.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:09.030+0000 7f551832f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:15:09.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:09.030+0000 7f551832f800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:15:09.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:09.030+0000 7f551832f800 20 rados->read ofs=0 len=0 2024-09-22T08:15:09.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:09.030+0000 7f551832f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:15:09.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:09.030+0000 7f551832f800 20 rados->read ofs=0 len=0 2024-09-22T08:15:09.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:09.030+0000 7f551832f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:15:09.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:09.030+0000 7f551832f800 20 rados->read ofs=0 len=0 2024-09-22T08:15:09.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:09.031+0000 7f551832f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:15:09.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:09.031+0000 7f551832f800 20 zone default found 2024-09-22T08:15:09.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:09.031+0000 7f551832f800 4 Realm: () 2024-09-22T08:15:09.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:09.031+0000 7f551832f800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:15:09.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:09.031+0000 7f551832f800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:15:09.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:09.031+0000 7f551832f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:15:09.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:09.031+0000 7f551832f800 20 zonegroup default 2024-09-22T08:15:09.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:09.031+0000 7f551832f800 20 rados->read ofs=0 len=0 2024-09-22T08:15:09.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:09.031+0000 7f551832f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:15:09.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:09.031+0000 7f551832f800 20 rados->read ofs=0 len=0 2024-09-22T08:15:10.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:10.986+0000 7f551832f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:15:10.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:10.986+0000 7f551832f800 20 rados->read ofs=0 len=0 2024-09-22T08:15:10.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:10.988+0000 7f551832f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:15:10.989 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:10.988+0000 7f551832f800 20 started sync module instance, tier type = 2024-09-22T08:15:10.989 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:10.988+0000 7f551832f800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:15:13.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.041+0000 7f551832f800 20 add_watcher() i=0 2024-09-22T08:15:13.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.041+0000 7f551832f800 20 add_watcher() i=1 2024-09-22T08:15:13.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.041+0000 7f551832f800 20 add_watcher() i=2 2024-09-22T08:15:13.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.041+0000 7f551832f800 20 add_watcher() i=3 2024-09-22T08:15:13.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.041+0000 7f551832f800 20 add_watcher() i=4 2024-09-22T08:15:13.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.041+0000 7f551832f800 20 add_watcher() i=5 2024-09-22T08:15:13.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.041+0000 7f551832f800 20 add_watcher() i=6 2024-09-22T08:15:13.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.042+0000 7f551832f800 20 add_watcher() i=7 2024-09-22T08:15:13.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.042+0000 7f551832f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:15:13.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.042+0000 7f551832f800 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-22T08:15:13.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.042+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-22T08:15:13.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.042+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.042+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-22T08:15:13.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.042+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-22T08:15:13.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.042+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.043+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-22T08:15:13.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.043+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-22T08:15:13.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.043+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.043+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-22T08:15:13.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.043+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-22T08:15:13.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.043+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.043+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-22T08:15:13.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.043+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-22T08:15:13.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.043+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.044+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-22T08:15:13.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.044+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-22T08:15:13.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.044+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.044+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-22T08:15:13.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.044+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-22T08:15:13.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.044+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.044+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-22T08:15:13.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.044+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-22T08:15:13.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.044+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.045+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-22T08:15:13.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.045+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-22T08:15:13.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.045+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.045+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-22T08:15:13.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.045+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-22T08:15:13.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.045+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.045+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-22T08:15:13.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.045+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-22T08:15:13.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.045+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.045+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-22T08:15:13.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.045+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-22T08:15:13.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.045+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.046+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-22T08:15:13.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.046+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-22T08:15:13.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.046+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.046+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-22T08:15:13.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.046+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-22T08:15:13.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.046+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.046+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-22T08:15:13.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.046+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-22T08:15:13.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.046+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.046+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-22T08:15:13.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.046+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-22T08:15:13.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.046+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.047+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-22T08:15:13.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.047+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-22T08:15:13.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.047+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.047+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-22T08:15:13.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.047+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-22T08:15:13.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.047+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.047+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-22T08:15:13.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.047+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-22T08:15:13.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.047+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.047+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-22T08:15:13.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.047+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-22T08:15:13.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.047+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.048+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-22T08:15:13.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.048+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-22T08:15:13.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.048+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.048+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-22T08:15:13.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.048+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-22T08:15:13.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.048+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.048+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-22T08:15:13.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.048+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-22T08:15:13.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.048+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.048+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-22T08:15:13.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.048+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-22T08:15:13.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.048+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.049+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-22T08:15:13.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.049+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-22T08:15:13.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.049+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.049+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-22T08:15:13.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.049+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-22T08:15:13.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.049+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.049+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-22T08:15:13.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.049+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-22T08:15:13.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.049+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.049+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-22T08:15:13.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.049+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-22T08:15:13.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.049+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.050+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-22T08:15:13.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.050+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-22T08:15:13.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.050+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.050+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-22T08:15:13.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.050+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-22T08:15:13.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.050+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.050+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-22T08:15:13.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.050+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-22T08:15:13.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.050+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.050+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-22T08:15:13.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.050+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-22T08:15:13.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.050+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.051+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-22T08:15:13.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.051+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-22T08:15:13.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.051+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.051+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-22T08:15:13.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.051+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-22T08:15:13.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.051+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.051+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-22T08:15:13.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.051+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-22T08:15:13.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.051+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.051+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-22T08:15:13.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.051+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-22T08:15:13.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.051+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.052+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-22T08:15:13.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.052+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-22T08:15:13.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.052+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.052+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-22T08:15:13.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.052+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-22T08:15:13.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.052+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.052+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-22T08:15:13.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.052+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-22T08:15:13.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.052+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.052+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-22T08:15:13.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.052+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-22T08:15:13.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.052+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.053+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-22T08:15:13.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.053+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-22T08:15:13.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.053+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.053+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-22T08:15:13.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.053+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-22T08:15:13.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.053+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.053+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-22T08:15:13.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.053+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-22T08:15:13.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.053+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.054+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-22T08:15:13.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.054+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-22T08:15:13.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.054+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.054+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-22T08:15:13.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.054+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-22T08:15:13.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.054+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.054+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-22T08:15:13.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.054+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-22T08:15:13.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.054+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.054+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-22T08:15:13.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.055+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-22T08:15:13.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.055+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.055+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-22T08:15:13.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.055+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-22T08:15:13.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.055+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.055+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-22T08:15:13.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.055+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-22T08:15:13.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.055+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.056+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-22T08:15:13.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.056+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-22T08:15:13.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.056+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.056+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-22T08:15:13.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.056+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-22T08:15:13.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.056+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.056+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-22T08:15:13.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.056+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-22T08:15:13.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.056+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.056+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-22T08:15:13.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.056+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-22T08:15:13.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.056+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.057+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-22T08:15:13.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.057+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-22T08:15:13.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.057+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.057+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-22T08:15:13.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.057+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-22T08:15:13.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.057+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.057+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-22T08:15:13.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.057+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-22T08:15:13.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.057+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.057+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-22T08:15:13.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.057+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-22T08:15:13.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.057+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.058+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-22T08:15:13.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.058+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-22T08:15:13.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.058+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.058+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-22T08:15:13.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.058+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-22T08:15:13.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.058+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.058+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-22T08:15:13.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.058+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-22T08:15:13.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.058+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.058+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-22T08:15:13.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.058+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-22T08:15:13.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.058+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.059+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-22T08:15:13.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.059+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-22T08:15:13.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.059+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.059+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-22T08:15:13.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.059+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-22T08:15:13.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.059+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.059+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-22T08:15:13.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.059+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-22T08:15:13.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.059+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.060+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-22T08:15:13.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.060+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-22T08:15:13.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.060+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.060+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-22T08:15:13.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.060+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-22T08:15:13.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.060+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.060+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-22T08:15:13.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.060+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-22T08:15:13.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.060+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.061+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-22T08:15:13.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.061+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-22T08:15:13.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.061+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.061+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-22T08:15:13.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.061+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-22T08:15:13.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.061+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.061+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-22T08:15:13.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.061+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-22T08:15:13.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.061+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.061+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-22T08:15:13.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.061+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-22T08:15:13.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.061+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.062+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-22T08:15:13.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.062+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-22T08:15:13.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.062+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.062+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-22T08:15:13.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.062+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-22T08:15:13.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.062+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.062+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-22T08:15:13.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.063+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-22T08:15:13.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.063+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.063+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-22T08:15:13.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.063+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-22T08:15:13.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.063+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.063+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-22T08:15:13.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.063+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-22T08:15:13.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.063+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.063+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-22T08:15:13.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.063+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-22T08:15:13.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.063+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.063+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-22T08:15:13.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.063+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-22T08:15:13.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.063+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.064+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-22T08:15:13.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.064+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-22T08:15:13.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.064+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.064+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-22T08:15:13.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.064+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-22T08:15:13.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.064+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.064+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-22T08:15:13.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.064+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-22T08:15:13.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.064+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.065+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-22T08:15:13.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.065+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-22T08:15:13.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.065+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.065+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-22T08:15:13.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.065+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-22T08:15:13.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.065+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.065+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-22T08:15:13.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.065+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-22T08:15:13.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.065+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.065+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-22T08:15:13.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.065+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-22T08:15:13.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.065+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.066+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-22T08:15:13.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.066+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-22T08:15:13.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.066+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.066+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-22T08:15:13.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.066+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-22T08:15:13.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.066+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.066+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-22T08:15:13.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.066+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-22T08:15:13.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.066+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.066+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-22T08:15:13.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.066+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-22T08:15:13.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.066+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.067+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-22T08:15:13.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.067+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-22T08:15:13.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.067+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.067+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-22T08:15:13.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.067+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-22T08:15:13.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.067+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.067+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-22T08:15:13.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.067+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-22T08:15:13.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.067+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.067+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-22T08:15:13.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.067+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-22T08:15:13.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.067+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.068+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-22T08:15:13.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.068+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-22T08:15:13.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.068+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.068+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-22T08:15:13.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.068+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-22T08:15:13.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.068+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.068+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-22T08:15:13.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.068+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-22T08:15:13.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.068+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.068+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-22T08:15:13.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.068+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-22T08:15:13.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.068+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.069+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-22T08:15:13.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.069+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-22T08:15:13.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.069+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.069+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-22T08:15:13.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.069+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-22T08:15:13.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.069+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.069+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-22T08:15:13.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.069+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-22T08:15:13.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.069+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.070+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-22T08:15:13.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.070+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-22T08:15:13.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.070+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.070+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-22T08:15:13.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.070+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-22T08:15:13.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.070+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.070+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-22T08:15:13.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.070+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-22T08:15:13.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.070+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.070+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-22T08:15:13.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.070+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-22T08:15:13.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.070+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.070+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-22T08:15:13.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.071+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-22T08:15:13.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.071+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.071+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-22T08:15:13.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.071+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-22T08:15:13.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.071+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.071+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-22T08:15:13.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.071+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-22T08:15:13.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.071+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.071+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-22T08:15:13.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.071+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-22T08:15:13.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.071+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.072+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-22T08:15:13.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.072+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-22T08:15:13.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.072+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.072+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-22T08:15:13.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.072+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-22T08:15:13.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.072+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.072+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-22T08:15:13.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.072+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-22T08:15:13.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.072+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.072+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-22T08:15:13.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.072+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-22T08:15:13.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.072+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.073+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-22T08:15:13.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.073+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-22T08:15:13.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.073+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.073+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-22T08:15:13.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.073+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-22T08:15:13.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.073+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.073+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-22T08:15:13.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.073+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-22T08:15:13.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.073+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.073+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-22T08:15:13.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.073+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-22T08:15:13.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.073+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.074+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-22T08:15:13.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.074+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-22T08:15:13.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.074+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.074+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-22T08:15:13.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.074+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-22T08:15:13.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.074+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.074+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-22T08:15:13.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.074+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-22T08:15:13.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.074+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.074+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-22T08:15:13.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.074+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-22T08:15:13.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.074+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.075+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-22T08:15:13.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.075+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-22T08:15:13.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.075+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.075+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-22T08:15:13.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.075+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-22T08:15:13.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.075+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.075+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-22T08:15:13.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.075+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-22T08:15:13.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.075+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.075+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-22T08:15:13.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.075+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-22T08:15:13.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.075+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.076+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-22T08:15:13.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.076+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-22T08:15:13.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.076+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.076+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-22T08:15:13.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.076+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-22T08:15:13.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.076+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.076+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-22T08:15:13.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.076+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-22T08:15:13.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.076+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.076+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-22T08:15:13.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.076+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-22T08:15:13.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.076+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.077+0000 7f551832f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-22T08:15:13.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.077+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-22T08:15:13.107 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.078+0000 7f551832f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:15:13.107 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.085+0000 7f53c67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:15:13.107 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.086+0000 7f551832f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:15:13.107 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:13.086+0000 7f551832f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:15:16.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.013+0000 7f551832f800 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-22T08:15:16.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.013+0000 7f551832f800 5 note: GC not initialized 2024-09-22T08:15:16.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.014+0000 7f53c57e2640 20 reqs_thread_entry: start 2024-09-22T08:15:16.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.014+0000 7f551832f800 20 init_complete bucket index max shards: 11 2024-09-22T08:15:16.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.014+0000 7f551832f800 20 Filter name: none 2024-09-22T08:15:16.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.014+0000 7f5326ffd640 20 reqs_thread_entry: start 2024-09-22T08:15:16.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.044+0000 7f53c67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:15:16.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.046+0000 7f551832f800 20 remove_watcher() i=0 2024-09-22T08:15:16.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.046+0000 7f551832f800 2 removed watcher, disabling cache 2024-09-22T08:15:16.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.048+0000 7f551832f800 20 remove_watcher() i=1 2024-09-22T08:15:16.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.049+0000 7f551832f800 20 remove_watcher() i=2 2024-09-22T08:15:16.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.050+0000 7f551832f800 20 remove_watcher() i=3 2024-09-22T08:15:16.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.052+0000 7f551832f800 20 remove_watcher() i=4 2024-09-22T08:15:16.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.053+0000 7f551832f800 20 remove_watcher() i=5 2024-09-22T08:15:16.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.054+0000 7f551832f800 20 remove_watcher() i=6 2024-09-22T08:15:16.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.056+0000 7f551832f800 20 remove_watcher() i=7 2024-09-22T08:15:16.079 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-22T08:15:16.079 DEBUG:tasks.util.rgw: json result: [] 2024-09-22T08:15:16.080 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-22T08:15:16.080 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-22T08:15:16.080 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-22T08:15:16.148 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:15:16.148 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:15:16.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.176+0000 7f8801a0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:15:16.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.176+0000 7f8801a0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:15:16.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.181+0000 7f8645ffb640 20 reqs_thread_entry: start 2024-09-22T08:15:16.198 INFO:teuthology.orchestra.run.smithi038.stdout:{"id":"c62f9d7b-f6b6-404a-90de-de5607499115","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-22T08:15:16.198 DEBUG:tasks.util.rgw: json result: {'id': 'c62f9d7b-f6b6-404a-90de-de5607499115', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-22T08:15:16.198 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-22T08:15:16.198 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-22T08:15:16.198 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-22T08:15:16.255 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:15:16.256 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:15:16.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.290+0000 7f7785719800 20 rados->read ofs=0 len=0 2024-09-22T08:15:16.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.292+0000 7f7785719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:15:16.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.292+0000 7f7785719800 20 realm 2024-09-22T08:15:16.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.292+0000 7f7785719800 20 rados->read ofs=0 len=0 2024-09-22T08:15:16.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.293+0000 7f7785719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:15:16.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.293+0000 7f7785719800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:15:16.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.293+0000 7f7785719800 20 rados->read ofs=0 len=0 2024-09-22T08:15:16.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.293+0000 7f7785719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:15:16.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.293+0000 7f7785719800 20 rados->read ofs=0 len=0 2024-09-22T08:15:16.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.294+0000 7f7785719800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:15:16.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.294+0000 7f7785719800 20 rados->read ofs=0 len=0 2024-09-22T08:15:16.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.294+0000 7f7785719800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-22T08:15:16.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.294+0000 7f7785719800 20 searching for the correct realm 2024-09-22T08:15:16.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.297+0000 7f7782a09640 0 -- 172.21.15.38:0/2767315894 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f776c0d5030 msgr2=0x7f776c057040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:15:16.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.300+0000 7f7782a09640 0 -- 172.21.15.38:0/2767315894 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f7774019410 msgr2=0x7f7774019890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:15:16.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.507+0000 7f7785719800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:15:16.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.507+0000 7f7785719800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:15:16.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.507+0000 7f7785719800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:15:16.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.507+0000 7f7785719800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:15:16.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.507+0000 7f7785719800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:15:16.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.507+0000 7f7785719800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:15:16.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.507+0000 7f7785719800 20 rados->read ofs=0 len=0 2024-09-22T08:15:16.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.508+0000 7f7785719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:15:16.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.508+0000 7f7785719800 20 rados->read ofs=0 len=0 2024-09-22T08:15:16.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.508+0000 7f7785719800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:15:16.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.508+0000 7f7785719800 20 rados->read ofs=0 len=0 2024-09-22T08:15:16.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.509+0000 7f7785719800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:15:16.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.509+0000 7f7785719800 20 zone default found 2024-09-22T08:15:16.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.509+0000 7f7785719800 4 Realm: () 2024-09-22T08:15:16.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.509+0000 7f7785719800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:15:16.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.509+0000 7f7785719800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:15:16.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.509+0000 7f7785719800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:15:16.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.509+0000 7f7785719800 20 zonegroup default 2024-09-22T08:15:16.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.509+0000 7f7785719800 20 rados->read ofs=0 len=0 2024-09-22T08:15:16.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.509+0000 7f7785719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:15:16.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.509+0000 7f7785719800 20 rados->read ofs=0 len=0 2024-09-22T08:15:16.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.509+0000 7f7785719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:15:16.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.509+0000 7f7785719800 20 rados->read ofs=0 len=0 2024-09-22T08:15:16.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.510+0000 7f7785719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:15:16.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.510+0000 7f7785719800 20 started sync module instance, tier type = 2024-09-22T08:15:16.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.510+0000 7f7785719800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:15:16.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.521+0000 7f7785719800 20 add_watcher() i=0 2024-09-22T08:15:16.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.521+0000 7f7785719800 20 add_watcher() i=1 2024-09-22T08:15:16.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.521+0000 7f7785719800 20 add_watcher() i=2 2024-09-22T08:15:16.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.521+0000 7f7785719800 20 add_watcher() i=3 2024-09-22T08:15:16.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.521+0000 7f7785719800 20 add_watcher() i=4 2024-09-22T08:15:16.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.521+0000 7f7785719800 20 add_watcher() i=5 2024-09-22T08:15:16.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.521+0000 7f7785719800 20 add_watcher() i=6 2024-09-22T08:15:16.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.522+0000 7f7785719800 20 add_watcher() i=7 2024-09-22T08:15:16.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.522+0000 7f7785719800 2 all 8 watchers are set, enabling cache 2024-09-22T08:15:16.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.524+0000 7f7639fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:15:16.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.524+0000 7f7785719800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:15:16.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.524+0000 7f7785719800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:15:16.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.524+0000 7f7785719800 5 note: GC not initialized 2024-09-22T08:15:16.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.524+0000 7f7638fe1640 20 reqs_thread_entry: start 2024-09-22T08:15:16.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.524+0000 7f7785719800 20 init_complete bucket index max shards: 11 2024-09-22T08:15:16.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.525+0000 7f7785719800 20 Filter name: none 2024-09-22T08:15:16.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.525+0000 7f75b27fc640 20 reqs_thread_entry: start 2024-09-22T08:15:16.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.535+0000 7f7639fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:15:16.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.537+0000 7f7785719800 20 remove_watcher() i=0 2024-09-22T08:15:16.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.537+0000 7f7785719800 2 removed watcher, disabling cache 2024-09-22T08:15:16.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.538+0000 7f7785719800 20 remove_watcher() i=1 2024-09-22T08:15:16.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.540+0000 7f7785719800 20 remove_watcher() i=2 2024-09-22T08:15:16.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.541+0000 7f7785719800 20 remove_watcher() i=3 2024-09-22T08:15:16.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.542+0000 7f7785719800 20 remove_watcher() i=4 2024-09-22T08:15:16.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.543+0000 7f7785719800 20 remove_watcher() i=5 2024-09-22T08:15:16.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.545+0000 7f7785719800 20 remove_watcher() i=6 2024-09-22T08:15:16.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.546+0000 7f7785719800 20 remove_watcher() i=7 2024-09-22T08:15:16.558 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-22T08:15:16.558 DEBUG:tasks.util.rgw: json result: [] 2024-09-22T08:15:16.558 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-22T08:15:16.558 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-22T08:15:16.558 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-22T08:15:16.559 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-22T08:15:16.622 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:15:16.622 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:15:16.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.648+0000 7f2afc724800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:15:16.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.648+0000 7f2afc724800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:15:16.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.653+0000 7f293e7fc640 20 reqs_thread_entry: start 2024-09-22T08:15:16.669 INFO:teuthology.orchestra.run.smithi038.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-22T08:15:16.669 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-22T08:15:16.669 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-22T08:15:16.669 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-22T08:15:16.669 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-22T08:15:16.738 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:15:16.738 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:15:16.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.764+0000 7f6cbb13a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:15:16.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.764+0000 7f6cbb13a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:15:16.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.768+0000 7f6b74ff9640 20 reqs_thread_entry: start 2024-09-22T08:15:16.787 INFO:teuthology.orchestra.run.smithi038.stdout:{"id":"c62f9d7b-f6b6-404a-90de-de5607499115","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-22T08:15:16.787 DEBUG:tasks.util.rgw: json result: {'id': 'c62f9d7b-f6b6-404a-90de-de5607499115', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-22T08:15:16.787 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-22T08:15:16.787 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-22T08:15:16.787 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-22T08:15:16.788 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-22T08:15:16.851 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:15:16.851 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:15:16.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.877+0000 7f5ca4740800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:15:16.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.877+0000 7f5ca4740800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:15:16.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.881+0000 7f5b1e7fc640 20 reqs_thread_entry: start 2024-09-22T08:15:16.898 INFO:teuthology.orchestra.run.smithi038.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-22T08:15:16.898 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-22T08:15:16.898 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-22T08:15:16.898 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-22T08:15:16.898 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-22T08:15:16.963 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:15:16.964 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:15:16.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.991+0000 7f85b280e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:15:16.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.991+0000 7f85b280e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:15:16.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:15:16.996+0000 7f83e3fff640 20 reqs_thread_entry: start 2024-09-22T08:15:17.014 INFO:teuthology.orchestra.run.smithi038.stdout:{"id":"c62f9d7b-f6b6-404a-90de-de5607499115","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-22T08:15:17.014 DEBUG:tasks.util.rgw: json result: {'id': 'c62f9d7b-f6b6-404a-90de-de5607499115', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-22T08:15:17.014 INFO:tasks.rgw:Starting rgw... 2024-09-22T08:15:17.014 INFO:tasks.rgw:rgw client.0 config is {'ssl certificate': 'rgw.client.0'} 2024-09-22T08:15:17.014 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-22T08:15:17.014 DEBUG:teuthology.orchestra.run.smithi038:> sudo echo -n https://smithi038.front.sepia.ceph.com:443 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-22T08:15:17.056 INFO:teuthology.orchestra.run.smithi038.stdout:https://smithi038.front.sepia.ceph.com:443 2024-09-22T08:15:17.056 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-22T08:15:17.135 DEBUG:teuthology.orchestra.run.smithi038:> sudo keytool -import -alias smithi038.front.sepia.ceph.com -keystore $(readlink -e $(dirname $(readlink -e $(which keytool)))/../lib/security/cacerts) -file /home/ubuntu/cephtest/ca/rgw.client.0.crt -storepass changeit 2024-09-22T08:15:17.349 INFO:teuthology.orchestra.run.smithi038.stderr:Warning: use -cacerts option to access cacerts keystore 2024-09-22T08:15:17.485 INFO:teuthology.orchestra.run.smithi038.stderr:Certificate was added to keystore 2024-09-22T08:15:17.507 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-22T08:15:17.508 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-22T08:15:17.510 INFO:tasks.rgw.client.0:Started 2024-09-22T08:15:17.510 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on https://smithi038.front.sepia.ceph.com:443/ 2024-09-22T08:15:17.510 DEBUG:teuthology.orchestra.run.smithi038:> curl https://smithi038.front.sepia.ceph.com:443/ 2024-09-22T08:15:17.551 INFO:teuthology.orchestra.run.smithi038.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-22T08:15:17.551 INFO:teuthology.orchestra.run.smithi038.stderr: Dload Upload Total Spent Left Speed 2024-09-22T08:15:17.553 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-22T08:15:17.553 INFO:teuthology.orchestra.run.smithi038.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-22T08:15:17.553 INFO:teuthology.orchestra.run.smithi038.stderr:curl: (7) Failed to connect to smithi038.front.sepia.ceph.com port 443: Connection refused 2024-09-22T08:15:18.157 INFO:tasks.rgw.client.0.smithi038.stdout:2024-09-22T08:15:18.156+0000 7f03f3ed8880 -1 ssl_private_key was not found: rgw/cert//default.key 2024-09-22T08:15:18.554 DEBUG:teuthology.orchestra.run.smithi038:> curl https://smithi038.front.sepia.ceph.com:443/ 2024-09-22T08:15:18.588 INFO:teuthology.orchestra.run.smithi038.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-22T08:15:18.588 INFO:teuthology.orchestra.run.smithi038.stderr: Dload Upload Total Spent Left Speed 2024-09-22T08:15:18.640 INFO:teuthology.orchestra.run.smithi038.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 3596 0 --:--:-- --:--:-- --:--:-- 3596 2024-09-22T08:15:18.641 INFO:teuthology.orchestra.run.smithi038.stdout:anonymous 2024-09-22T08:15:18.641 INFO:teuthology.run_tasks:Running task tox... 2024-09-22T08:15:18.652 INFO:tasks.tox:Deploying tox from pip... 2024-09-22T08:15:18.652 DEBUG:teuthology.orchestra.run.smithi038:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-22T08:15:21.080 DEBUG:teuthology.orchestra.run.smithi038:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-22T08:15:21.627 INFO:teuthology.orchestra.run.smithi038.stdout:Collecting tox==3.15.0 2024-09-22T08:15:21.688 INFO:teuthology.orchestra.run.smithi038.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-22T08:15:22.019 INFO:teuthology.orchestra.run.smithi038.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-22T08:15:22.033 INFO:teuthology.orchestra.run.smithi038.stdout: Downloading virtualenv-20.26.5-py3-none-any.whl (6.0 MB) 2024-09-22T08:15:22.265 INFO:teuthology.orchestra.run.smithi038.stdout:Collecting six<2,>=1.14.0 2024-09-22T08:15:22.279 INFO:teuthology.orchestra.run.smithi038.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-22T08:15:22.370 INFO:teuthology.orchestra.run.smithi038.stdout:Collecting pluggy<1,>=0.12.0 2024-09-22T08:15:22.384 INFO:teuthology.orchestra.run.smithi038.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-22T08:15:22.487 INFO:teuthology.orchestra.run.smithi038.stdout:Collecting packaging>=14 2024-09-22T08:15:22.500 INFO:teuthology.orchestra.run.smithi038.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-22T08:15:22.612 INFO:teuthology.orchestra.run.smithi038.stdout:Collecting filelock<4,>=3.0.0 2024-09-22T08:15:22.626 INFO:teuthology.orchestra.run.smithi038.stdout: Downloading filelock-3.16.1-py3-none-any.whl (16 kB) 2024-09-22T08:15:22.729 INFO:teuthology.orchestra.run.smithi038.stdout:Collecting py<2,>=1.4.17 2024-09-22T08:15:22.745 INFO:teuthology.orchestra.run.smithi038.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-22T08:15:22.827 INFO:teuthology.orchestra.run.smithi038.stdout:Collecting toml>=0.9.4 2024-09-22T08:15:22.841 INFO:teuthology.orchestra.run.smithi038.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-22T08:15:22.965 INFO:teuthology.orchestra.run.smithi038.stdout:Collecting distlib<1,>=0.3.7 2024-09-22T08:15:22.980 INFO:teuthology.orchestra.run.smithi038.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-22T08:15:23.101 INFO:teuthology.orchestra.run.smithi038.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-22T08:15:23.115 INFO:teuthology.orchestra.run.smithi038.stdout: Downloading platformdirs-4.3.6-py3-none-any.whl (18 kB) 2024-09-22T08:15:23.231 INFO:teuthology.orchestra.run.smithi038.stdout:Installing collected packages: platformdirs, filelock, distlib, virtualenv, toml, six, py, pluggy, packaging, tox 2024-09-22T08:15:24.082 INFO:teuthology.orchestra.run.smithi038.stdout:Successfully installed distlib-0.3.8 filelock-3.16.1 packaging-24.1 platformdirs-4.3.6 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.5 2024-09-22T08:15:24.287 INFO:teuthology.orchestra.run.smithi038.stderr:WARNING: You are using pip version 21.3.1; however, version 24.2 is available. 2024-09-22T08:15:24.287 INFO:teuthology.orchestra.run.smithi038.stderr:You should consider upgrading via the '/home/ubuntu/cephtest/tox-venv/bin/python3 -m pip install --upgrade pip' command. 2024-09-22T08:15:24.348 INFO:teuthology.run_tasks:Running task workunit... 2024-09-22T08:15:24.360 INFO:tasks.workunit:Pulling workunits from ref 8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:15:24.361 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-22T08:15:24.361 DEBUG:teuthology.orchestra.run.smithi038:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-22T08:15:24.390 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:15:24.390 INFO:teuthology.orchestra.run.smithi038.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-22T08:15:24.390 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-22T08:15:24.460 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-22T08:15:24.460 DEBUG:teuthology.orchestra.run.smithi038:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-22T08:15:24.529 INFO:tasks.workunit:timeout=3h 2024-09-22T08:15:24.529 INFO:tasks.workunit:cleanup=True 2024-09-22T08:15:24.529 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:15:24.598 INFO:tasks.workunit.client.0.smithi038.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-22T08:16:27.425 INFO:tasks.workunit.client.0.smithi038.stderr:Updating files: 92% (11746/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-22T08:16:28.141 INFO:tasks.workunit.client.0.smithi038.stderr:Note: switching to '8852379c050c686f4605f33f0129009b2029ca9d'. 2024-09-22T08:16:28.141 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:16:28.142 INFO:tasks.workunit.client.0.smithi038.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-22T08:16:28.142 INFO:tasks.workunit.client.0.smithi038.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-22T08:16:28.142 INFO:tasks.workunit.client.0.smithi038.stderr:state without impacting any branches by switching back to a branch. 2024-09-22T08:16:28.142 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:16:28.142 INFO:tasks.workunit.client.0.smithi038.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-22T08:16:28.142 INFO:tasks.workunit.client.0.smithi038.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-22T08:16:28.142 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:16:28.142 INFO:tasks.workunit.client.0.smithi038.stderr: git switch -c 2024-09-22T08:16:28.142 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:16:28.142 INFO:tasks.workunit.client.0.smithi038.stderr:Or undo this operation with: 2024-09-22T08:16:28.142 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:16:28.142 INFO:tasks.workunit.client.0.smithi038.stderr: git switch - 2024-09-22T08:16:28.143 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:16:28.143 INFO:tasks.workunit.client.0.smithi038.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-22T08:16:28.143 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:16:28.143 INFO:tasks.workunit.client.0.smithi038.stderr:HEAD is now at 8852379c050 rgw/cloud-restore: Fixed storage class update while listing objects. 2024-09-22T08:16:28.146 DEBUG:teuthology.orchestra.run.smithi038:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-22T08:16:28.226 INFO:tasks.workunit.client.0.smithi038.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-22T08:16:28.228 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-22T08:16:28.228 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-22T08:16:28.822 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-22T08:16:28.886 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-22T08:16:28.927 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-22T08:16:28.928 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-22T08:16:28.928 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-22T08:16:28.968 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-22T08:16:28.972 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-22T08:16:28.972 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-22T08:16:29.042 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-22T08:16:29.043 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-22T08:16:29.044 DEBUG:teuthology.orchestra.run.smithi038:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-22T08:16:29.117 INFO:tasks.workunit.client.0.smithi038.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-22T08:16:29.117 INFO:tasks.workunit.client.0.smithi038.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-22T08:16:29.117 INFO:tasks.workunit.client.0.smithi038.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-22T08:16:31.502 INFO:tasks.workunit.client.0.smithi038.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-22T08:16:31.502 INFO:tasks.workunit.client.0.smithi038.stderr:++ deactivate nondestructive 2024-09-22T08:16:31.502 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -n '' ']' 2024-09-22T08:16:31.502 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -n '' ']' 2024-09-22T08:16:31.502 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-22T08:16:31.502 INFO:tasks.workunit.client.0.smithi038.stderr:++ hash -r 2024-09-22T08:16:31.502 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -n '' ']' 2024-09-22T08:16:31.503 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset VIRTUAL_ENV 2024-09-22T08:16:31.503 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-22T08:16:31.503 INFO:tasks.workunit.client.0.smithi038.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-22T08:16:31.503 INFO:tasks.workunit.client.0.smithi038.stderr:++ export VIRTUAL_ENV 2024-09-22T08:16:31.504 INFO:tasks.workunit.client.0.smithi038.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-22T08:16:31.504 INFO:tasks.workunit.client.0.smithi038.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-22T08:16:31.504 INFO:tasks.workunit.client.0.smithi038.stderr:++ export PATH 2024-09-22T08:16:31.504 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -n '' ']' 2024-09-22T08:16:31.505 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-09-22T08:16:31.505 INFO:tasks.workunit.client.0.smithi038.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-22T08:16:31.505 INFO:tasks.workunit.client.0.smithi038.stderr:++ PS1='(rgw) ' 2024-09-22T08:16:31.505 INFO:tasks.workunit.client.0.smithi038.stderr:++ export PS1 2024-09-22T08:16:31.505 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-22T08:16:31.505 INFO:tasks.workunit.client.0.smithi038.stderr:++ hash -r 2024-09-22T08:16:31.505 INFO:tasks.workunit.client.0.smithi038.stderr:+ pip install pip --upgrade 2024-09-22T08:16:31.740 INFO:tasks.workunit.client.0.smithi038.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-22T08:16:31.924 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting pip 2024-09-22T08:16:31.973 INFO:tasks.workunit.client.0.smithi038.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-22T08:16:32.129 INFO:tasks.workunit.client.0.smithi038.stdout:Installing collected packages: pip 2024-09-22T08:16:32.129 INFO:tasks.workunit.client.0.smithi038.stdout: Attempting uninstall: pip 2024-09-22T08:16:32.129 INFO:tasks.workunit.client.0.smithi038.stdout: Found existing installation: pip 21.3.1 2024-09-22T08:16:32.296 INFO:tasks.workunit.client.0.smithi038.stdout: Uninstalling pip-21.3.1: 2024-09-22T08:16:32.301 INFO:tasks.workunit.client.0.smithi038.stdout: Successfully uninstalled pip-21.3.1 2024-09-22T08:16:33.080 INFO:tasks.workunit.client.0.smithi038.stdout:Successfully installed pip-24.2 2024-09-22T08:16:33.315 INFO:tasks.workunit.client.0.smithi038.stderr:+ pip install boto3 2024-09-22T08:16:34.218 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting boto3 2024-09-22T08:16:34.259 INFO:tasks.workunit.client.0.smithi038.stdout: Downloading boto3-1.35.24-py3-none-any.whl.metadata (6.6 kB) 2024-09-22T08:16:34.934 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting botocore<1.36.0,>=1.35.24 (from boto3) 2024-09-22T08:16:34.947 INFO:tasks.workunit.client.0.smithi038.stdout: Downloading botocore-1.35.24-py3-none-any.whl.metadata (5.7 kB) 2024-09-22T08:16:35.069 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-22T08:16:35.082 INFO:tasks.workunit.client.0.smithi038.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-22T08:16:35.209 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-22T08:16:35.223 INFO:tasks.workunit.client.0.smithi038.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-22T08:16:35.368 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.24->boto3) 2024-09-22T08:16:35.382 INFO:tasks.workunit.client.0.smithi038.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-22T08:16:35.548 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.24->boto3) 2024-09-22T08:16:35.562 INFO:tasks.workunit.client.0.smithi038.stdout: Downloading urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-22T08:16:35.817 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.24->boto3) 2024-09-22T08:16:35.831 INFO:tasks.workunit.client.0.smithi038.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-22T08:16:35.878 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading boto3-1.35.24-py3-none-any.whl (139 kB) 2024-09-22T08:16:35.951 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading botocore-1.35.24-py3-none-any.whl (12.6 MB) 2024-09-22T08:16:36.149 INFO:tasks.workunit.client.0.smithi038.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.6/12.6 MB 67.0 MB/s eta 0:00:00 2024-09-22T08:16:36.162 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-22T08:16:36.227 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-22T08:16:36.302 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-22T08:16:36.361 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-22T08:16:36.428 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-22T08:16:36.560 INFO:tasks.workunit.client.0.smithi038.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-22T08:16:37.638 INFO:tasks.workunit.client.0.smithi038.stdout:Successfully installed boto3-1.35.24 botocore-1.35.24 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-22T08:16:37.758 INFO:tasks.workunit.client.0.smithi038.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-22T08:16:37.897 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-22T08:16:37.935 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:16:37.935 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:16:37.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:37.975+0000 7fc4743af800 20 rados->read ofs=0 len=0 2024-09-22T08:16:37.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:37.977+0000 7fc4743af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:37.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:37.977+0000 7fc4743af800 20 realm 2024-09-22T08:16:37.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:37.977+0000 7fc4743af800 20 rados->read ofs=0 len=0 2024-09-22T08:16:37.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:37.977+0000 7fc4743af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:37.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:37.977+0000 7fc4743af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:16:37.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:37.977+0000 7fc4743af800 20 rados->read ofs=0 len=0 2024-09-22T08:16:37.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:37.977+0000 7fc4743af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:37.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:37.977+0000 7fc4743af800 20 rados->read ofs=0 len=0 2024-09-22T08:16:37.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:37.978+0000 7fc4743af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:37.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:37.978+0000 7fc4743af800 20 rados->read ofs=0 len=0 2024-09-22T08:16:37.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:37.979+0000 7fc4743af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:16:37.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:37.979+0000 7fc4743af800 20 searching for the correct realm 2024-09-22T08:16:37.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:37.979+0000 7fc471e99640 0 -- 172.21.15.38:0/3843665220 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x55eaa01e73d0 msgr2=0x55eaa01e9890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:16:37.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:37.984+0000 7fc471e99640 0 -- 172.21.15.38:0/3843665220 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x55eaa01dab00 msgr2=0x55eaa01dcfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:16:37.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:37.992+0000 7fc4743af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:16:37.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:37.992+0000 7fc4743af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:16:37.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:37.992+0000 7fc4743af800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:16:37.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:37.992+0000 7fc4743af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:16:37.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:37.992+0000 7fc4743af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:16:37.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:37.992+0000 7fc4743af800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:16:37.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:37.992+0000 7fc4743af800 20 rados->read ofs=0 len=0 2024-09-22T08:16:37.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:37.992+0000 7fc4743af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:37.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:37.992+0000 7fc4743af800 20 rados->read ofs=0 len=0 2024-09-22T08:16:37.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:37.992+0000 7fc4743af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:37.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:37.992+0000 7fc4743af800 20 rados->read ofs=0 len=0 2024-09-22T08:16:37.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:37.993+0000 7fc4743af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:16:37.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:37.993+0000 7fc4743af800 20 zone default found 2024-09-22T08:16:37.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:37.993+0000 7fc4743af800 4 Realm: () 2024-09-22T08:16:37.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:37.993+0000 7fc4743af800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:16:37.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:37.993+0000 7fc4743af800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:16:37.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:37.993+0000 7fc4743af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:16:37.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:37.993+0000 7fc4743af800 20 zonegroup default 2024-09-22T08:16:37.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:37.993+0000 7fc4743af800 20 rados->read ofs=0 len=0 2024-09-22T08:16:37.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:37.993+0000 7fc4743af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:37.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:37.993+0000 7fc4743af800 20 rados->read ofs=0 len=0 2024-09-22T08:16:37.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:37.993+0000 7fc4743af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:37.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:37.993+0000 7fc4743af800 20 rados->read ofs=0 len=0 2024-09-22T08:16:37.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:37.994+0000 7fc4743af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:37.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:37.994+0000 7fc4743af800 20 started sync module instance, tier type = 2024-09-22T08:16:37.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:37.994+0000 7fc4743af800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:16:38.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.005+0000 7fc4743af800 20 add_watcher() i=0 2024-09-22T08:16:38.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.005+0000 7fc4743af800 20 add_watcher() i=1 2024-09-22T08:16:38.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.005+0000 7fc4743af800 20 add_watcher() i=2 2024-09-22T08:16:38.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.005+0000 7fc4743af800 20 add_watcher() i=3 2024-09-22T08:16:38.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.005+0000 7fc4743af800 20 add_watcher() i=4 2024-09-22T08:16:38.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.005+0000 7fc4743af800 20 add_watcher() i=5 2024-09-22T08:16:38.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.005+0000 7fc4743af800 20 add_watcher() i=6 2024-09-22T08:16:38.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.007+0000 7fc4743af800 20 add_watcher() i=7 2024-09-22T08:16:38.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.007+0000 7fc4743af800 2 all 8 watchers are set, enabling cache 2024-09-22T08:16:38.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.009+0000 7fc3237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:38.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.009+0000 7fc4743af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:16:38.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.009+0000 7fc4743af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:16:38.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.009+0000 7fc4743af800 5 note: GC not initialized 2024-09-22T08:16:38.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.009+0000 7fc3227fc640 20 reqs_thread_entry: start 2024-09-22T08:16:38.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.009+0000 7fc4743af800 20 init_complete bucket index max shards: 11 2024-09-22T08:16:38.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.009+0000 7fc4743af800 20 Filter name: none 2024-09-22T08:16:38.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.009+0000 7fc293fff640 20 reqs_thread_entry: start 2024-09-22T08:16:38.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.010+0000 7fc4743af800 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-22T08:16:38.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.010+0000 7fc4743af800 20 rados->read ofs=0 len=0 2024-09-22T08:16:38.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.010+0000 7fc4743af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:38.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.010+0000 7fc4743af800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-22T08:16:38.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.010+0000 7fc4743af800 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-22T08:16:38.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.010+0000 7fc4743af800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-22T08:16:38.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.010+0000 7fc4743af800 20 rados->read ofs=0 len=0 2024-09-22T08:16:38.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.010+0000 7fc4743af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:38.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.010+0000 7fc4743af800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-22T08:16:38.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.010+0000 7fc4743af800 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-22T08:16:38.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.010+0000 7fc4743af800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-22T08:16:38.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.010+0000 7fc4743af800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-22T08:16:38.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.013+0000 7fc4743af800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-22T08:16:38.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.013+0000 7fc4743af800 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-22T08:16:38.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.013+0000 7fc4743af800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-22T08:16:38.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.014+0000 7fc3557fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789952 cookie 94466197014064 notifier 4493 bl.length()=593 2024-09-22T08:16:38.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.014+0000 7fc3557fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-22T08:16:38.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.014+0000 7fc3557fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-22T08:16:38.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.016+0000 7fc4743af800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-22T08:16:38.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.016+0000 7fc4743af800 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-22T08:16:38.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.016+0000 7fc4743af800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-22T08:16:38.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.016+0000 7fc354ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789952 cookie 94466197013008 notifier 4493 bl.length()=186 2024-09-22T08:16:38.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.016+0000 7fc354ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-22T08:16:38.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.016+0000 7fc354ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-22T08:16:38.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.017+0000 7fc3237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:38.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.020+0000 7fc4743af800 20 remove_watcher() i=0 2024-09-22T08:16:38.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.020+0000 7fc4743af800 2 removed watcher, disabling cache 2024-09-22T08:16:38.022 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.021+0000 7fc4743af800 20 remove_watcher() i=1 2024-09-22T08:16:38.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.022+0000 7fc4743af800 20 remove_watcher() i=2 2024-09-22T08:16:38.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.023+0000 7fc4743af800 20 remove_watcher() i=3 2024-09-22T08:16:38.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.025+0000 7fc4743af800 20 remove_watcher() i=4 2024-09-22T08:16:38.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.026+0000 7fc4743af800 20 remove_watcher() i=5 2024-09-22T08:16:38.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.027+0000 7fc4743af800 20 remove_watcher() i=6 2024-09-22T08:16:38.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.028+0000 7fc4743af800 20 remove_watcher() i=7 2024-09-22T08:16:38.193 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:38.193 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:38.238 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:38.238 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:38.284 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:38.284 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:38.301 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:38.301 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:38.311 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:38.311 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:38.314 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:38.315 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:38.321 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:38.321 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:38.324 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:38.324 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:38.329 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:38.329 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:38.342 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:38.342 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:38.346 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:38.346 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:38.358 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:38.358 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:38.362 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:38.362 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:38.374 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:38.374 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:38.377 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:38.377 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:38.390 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:38.390 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:38.393 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: recalculated bucket check stats are correct 2024-09-22T08:16:38.393 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:16:38.395 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-22T08:16:38.425 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:16:38.425 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:16:38.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.463+0000 7f054eb2e800 20 rados->read ofs=0 len=0 2024-09-22T08:16:38.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.465+0000 7f054eb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:38.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.465+0000 7f054eb2e800 20 realm 2024-09-22T08:16:38.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.465+0000 7f054eb2e800 20 rados->read ofs=0 len=0 2024-09-22T08:16:38.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.465+0000 7f054eb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:38.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.465+0000 7f054eb2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:16:38.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.465+0000 7f054eb2e800 20 rados->read ofs=0 len=0 2024-09-22T08:16:38.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.465+0000 7f054eb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:38.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.465+0000 7f054eb2e800 20 rados->read ofs=0 len=0 2024-09-22T08:16:38.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.466+0000 7f054eb2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:38.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.466+0000 7f054eb2e800 20 rados->read ofs=0 len=0 2024-09-22T08:16:38.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.466+0000 7f054eb2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:16:38.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.467+0000 7f054eb2e800 20 searching for the correct realm 2024-09-22T08:16:38.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.470+0000 7f054b0de640 0 -- 172.21.15.38:0/2735383655 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7f053c07bc20 msgr2=0x7f053c0604f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:16:38.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.674+0000 7f054a8dd640 0 -- 172.21.15.38:0/2735383655 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x55ca02d96c80 msgr2=0x55ca02d99110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:16:38.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.679+0000 7f054eb2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:16:38.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.679+0000 7f054eb2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:16:38.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.679+0000 7f054eb2e800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:16:38.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.679+0000 7f054eb2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:16:38.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.679+0000 7f054eb2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:16:38.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.679+0000 7f054eb2e800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:16:38.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.679+0000 7f054eb2e800 20 rados->read ofs=0 len=0 2024-09-22T08:16:38.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.679+0000 7f054eb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:38.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.679+0000 7f054eb2e800 20 rados->read ofs=0 len=0 2024-09-22T08:16:38.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.680+0000 7f054eb2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:38.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.680+0000 7f054eb2e800 20 rados->read ofs=0 len=0 2024-09-22T08:16:38.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.680+0000 7f054eb2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:16:38.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.680+0000 7f054eb2e800 20 zone default found 2024-09-22T08:16:38.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.680+0000 7f054eb2e800 4 Realm: () 2024-09-22T08:16:38.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.680+0000 7f054eb2e800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:16:38.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.680+0000 7f054eb2e800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:16:38.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.680+0000 7f054eb2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:16:38.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.680+0000 7f054eb2e800 20 zonegroup default 2024-09-22T08:16:38.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.680+0000 7f054eb2e800 20 rados->read ofs=0 len=0 2024-09-22T08:16:38.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.681+0000 7f054eb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:38.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.681+0000 7f054eb2e800 20 rados->read ofs=0 len=0 2024-09-22T08:16:38.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.681+0000 7f054eb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:38.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.681+0000 7f054eb2e800 20 rados->read ofs=0 len=0 2024-09-22T08:16:38.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.681+0000 7f054eb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:38.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.681+0000 7f054eb2e800 20 started sync module instance, tier type = 2024-09-22T08:16:38.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.681+0000 7f054eb2e800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:16:38.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.692+0000 7f054eb2e800 20 add_watcher() i=0 2024-09-22T08:16:38.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.692+0000 7f054eb2e800 20 add_watcher() i=1 2024-09-22T08:16:38.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.692+0000 7f054eb2e800 20 add_watcher() i=2 2024-09-22T08:16:38.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.692+0000 7f054eb2e800 20 add_watcher() i=3 2024-09-22T08:16:38.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.692+0000 7f054eb2e800 20 add_watcher() i=4 2024-09-22T08:16:38.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.692+0000 7f054eb2e800 20 add_watcher() i=5 2024-09-22T08:16:38.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.692+0000 7f054eb2e800 20 add_watcher() i=6 2024-09-22T08:16:38.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.694+0000 7f054eb2e800 20 add_watcher() i=7 2024-09-22T08:16:38.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.694+0000 7f054eb2e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:16:38.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.695+0000 7f04017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:38.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.695+0000 7f054eb2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:16:38.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.695+0000 7f054eb2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:16:38.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.695+0000 7f054eb2e800 5 note: GC not initialized 2024-09-22T08:16:38.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.696+0000 7f037bfff640 20 reqs_thread_entry: start 2024-09-22T08:16:38.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.696+0000 7f054eb2e800 20 init_complete bucket index max shards: 11 2024-09-22T08:16:38.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.696+0000 7f054eb2e800 20 Filter name: none 2024-09-22T08:16:38.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.696+0000 7f0379ffb640 20 reqs_thread_entry: start 2024-09-22T08:16:38.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.696+0000 7f054eb2e800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-22T08:16:38.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.696+0000 7f054eb2e800 20 rados->read ofs=0 len=0 2024-09-22T08:16:38.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.696+0000 7f054eb2e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:16:38.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.696+0000 7f054eb2e800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-22T08:16:38.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.696+0000 7f054eb2e800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-22T08:16:38.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.696+0000 7f054eb2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.1 : miss 2024-09-22T08:16:38.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.696+0000 7f054eb2e800 20 rados->read ofs=0 len=0 2024-09-22T08:16:38.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.697+0000 7f054eb2e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:16:38.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.697+0000 7f054eb2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.1 info.flags=0x17 2024-09-22T08:16:38.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.697+0000 7f054eb2e800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.1 to cache LRU end 2024-09-22T08:16:38.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.697+0000 7f054eb2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:16:38.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.697+0000 7f054eb2e800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-22T08:16:38.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.697+0000 7f054eb2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.1 2024-09-22T08:16:38.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.697+0000 7f054eb2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.0 2024-09-22T08:16:38.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.698+0000 7f054eb2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.1 2024-09-22T08:16:38.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.698+0000 7f054eb2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.2 2024-09-22T08:16:38.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.699+0000 7f054eb2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.3 2024-09-22T08:16:38.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.700+0000 7f054eb2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.4 2024-09-22T08:16:38.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.700+0000 7f054eb2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.5 2024-09-22T08:16:38.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.700+0000 7f054eb2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.6 2024-09-22T08:16:38.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.701+0000 7f054eb2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.7 2024-09-22T08:16:38.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.701+0000 7f054eb2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.8 2024-09-22T08:16:38.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.702+0000 7f054eb2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.9 2024-09-22T08:16:38.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.702+0000 7f054eb2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.10 2024-09-22T08:16:38.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.713+0000 7f04017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:38.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.714+0000 7f054eb2e800 20 remove_watcher() i=0 2024-09-22T08:16:38.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.714+0000 7f054eb2e800 2 removed watcher, disabling cache 2024-09-22T08:16:38.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.719+0000 7f054eb2e800 20 remove_watcher() i=1 2024-09-22T08:16:38.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.719+0000 7f054eb2e800 20 remove_watcher() i=2 2024-09-22T08:16:38.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.720+0000 7f054eb2e800 20 remove_watcher() i=3 2024-09-22T08:16:38.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.726+0000 7f054eb2e800 20 remove_watcher() i=4 2024-09-22T08:16:38.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.726+0000 7f054eb2e800 20 remove_watcher() i=5 2024-09-22T08:16:38.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.728+0000 7f054eb2e800 20 remove_watcher() i=6 2024-09-22T08:16:38.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.729+0000 7f054eb2e800 20 remove_watcher() i=7 2024-09-22T08:16:38.743 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-22T08:16:38.772 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:16:38.772 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:16:38.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.810+0000 7f62c1146800 20 rados->read ofs=0 len=0 2024-09-22T08:16:38.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.812+0000 7f62c1146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:38.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.812+0000 7f62c1146800 20 realm 2024-09-22T08:16:38.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.812+0000 7f62c1146800 20 rados->read ofs=0 len=0 2024-09-22T08:16:38.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.812+0000 7f62c1146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:38.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.812+0000 7f62c1146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:16:38.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.812+0000 7f62c1146800 20 rados->read ofs=0 len=0 2024-09-22T08:16:38.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.812+0000 7f62c1146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:38.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.812+0000 7f62c1146800 20 rados->read ofs=0 len=0 2024-09-22T08:16:38.815 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.813+0000 7f62c1146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:38.815 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.813+0000 7f62c1146800 20 rados->read ofs=0 len=0 2024-09-22T08:16:38.815 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.814+0000 7f62c1146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:16:38.815 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.814+0000 7f62c1146800 20 searching for the correct realm 2024-09-22T08:16:38.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:38.816+0000 7f62bf431640 0 -- 172.21.15.38:0/710484924 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7f62b0033040 msgr2=0x7f62b0018450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:16:39.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.021+0000 7f62be42f640 0 -- 172.21.15.38:0/710484924 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f62b0018070 msgr2=0x7f62b0008920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:16:39.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.026+0000 7f62c1146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:16:39.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.026+0000 7f62c1146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:16:39.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.026+0000 7f62c1146800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:16:39.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.026+0000 7f62c1146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:16:39.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.026+0000 7f62c1146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:16:39.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.026+0000 7f62c1146800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:16:39.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.026+0000 7f62c1146800 20 rados->read ofs=0 len=0 2024-09-22T08:16:39.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.026+0000 7f62c1146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:39.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.026+0000 7f62c1146800 20 rados->read ofs=0 len=0 2024-09-22T08:16:39.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.026+0000 7f62c1146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:39.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.026+0000 7f62c1146800 20 rados->read ofs=0 len=0 2024-09-22T08:16:39.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.027+0000 7f62c1146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:16:39.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.027+0000 7f62c1146800 20 zone default found 2024-09-22T08:16:39.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.027+0000 7f62c1146800 4 Realm: () 2024-09-22T08:16:39.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.027+0000 7f62c1146800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:16:39.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.027+0000 7f62c1146800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:16:39.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.027+0000 7f62c1146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:16:39.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.027+0000 7f62c1146800 20 zonegroup default 2024-09-22T08:16:39.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.027+0000 7f62c1146800 20 rados->read ofs=0 len=0 2024-09-22T08:16:39.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.027+0000 7f62c1146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:39.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.027+0000 7f62c1146800 20 rados->read ofs=0 len=0 2024-09-22T08:16:39.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.028+0000 7f62c1146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:39.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.028+0000 7f62c1146800 20 rados->read ofs=0 len=0 2024-09-22T08:16:39.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.028+0000 7f62c1146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:39.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.028+0000 7f62c1146800 20 started sync module instance, tier type = 2024-09-22T08:16:39.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.028+0000 7f62c1146800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:16:39.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.041+0000 7f62c1146800 20 add_watcher() i=0 2024-09-22T08:16:39.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.041+0000 7f62c1146800 20 add_watcher() i=1 2024-09-22T08:16:39.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.041+0000 7f62c1146800 20 add_watcher() i=2 2024-09-22T08:16:39.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.041+0000 7f62c1146800 20 add_watcher() i=3 2024-09-22T08:16:39.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.041+0000 7f62c1146800 20 add_watcher() i=4 2024-09-22T08:16:39.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.041+0000 7f62c1146800 20 add_watcher() i=5 2024-09-22T08:16:39.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.041+0000 7f62c1146800 20 add_watcher() i=6 2024-09-22T08:16:39.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.043+0000 7f62c1146800 20 add_watcher() i=7 2024-09-22T08:16:39.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.043+0000 7f62c1146800 2 all 8 watchers are set, enabling cache 2024-09-22T08:16:39.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.044+0000 7f61757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:39.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.045+0000 7f62c1146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:16:39.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.045+0000 7f62c1146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:16:39.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.045+0000 7f62c1146800 5 note: GC not initialized 2024-09-22T08:16:39.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.045+0000 7f60effff640 20 reqs_thread_entry: start 2024-09-22T08:16:39.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.045+0000 7f62c1146800 20 init_complete bucket index max shards: 11 2024-09-22T08:16:39.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.045+0000 7f62c1146800 20 Filter name: none 2024-09-22T08:16:39.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.045+0000 7f60edffb640 20 reqs_thread_entry: start 2024-09-22T08:16:39.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.045+0000 7f62c1146800 20 rados->read ofs=0 len=0 2024-09-22T08:16:39.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.046+0000 7f62c1146800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:16:39.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.046+0000 7f62c1146800 20 rados->read ofs=0 len=0 2024-09-22T08:16:39.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.046+0000 7f62c1146800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:16:39.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.046+0000 7f62c1146800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:16:39.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.046+0000 7f62c1146800 20 rados->read ofs=0 len=0 2024-09-22T08:16:39.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.047+0000 7f62c1146800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:16:39.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.047+0000 7f62c1146800 20 rados->read ofs=0 len=0 2024-09-22T08:16:39.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.047+0000 7f62c1146800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:16:39.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.047+0000 7f62c1146800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:16:39.051 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.049+0000 7f61757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:39.053 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.052+0000 7f62c1146800 20 remove_watcher() i=0 2024-09-22T08:16:39.053 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.052+0000 7f62c1146800 2 removed watcher, disabling cache 2024-09-22T08:16:39.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.053+0000 7f62c1146800 20 remove_watcher() i=1 2024-09-22T08:16:39.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.054+0000 7f62c1146800 20 remove_watcher() i=2 2024-09-22T08:16:39.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.055+0000 7f62c1146800 20 remove_watcher() i=3 2024-09-22T08:16:39.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.056+0000 7f62c1146800 20 remove_watcher() i=4 2024-09-22T08:16:39.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.057+0000 7f62c1146800 20 remove_watcher() i=5 2024-09-22T08:16:39.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.060+0000 7f62c1146800 20 remove_watcher() i=6 2024-09-22T08:16:39.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.060+0000 7f62c1146800 20 remove_watcher() i=7 2024-09-22T08:16:39.073 INFO:tasks.workunit.client.0.smithi038.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 85, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-22T08:16:39.073 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-22T08:16:39.073 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:16:39.074 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-22T08:16:39.108 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:16:39.108 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:16:39.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.146+0000 7f193bf2c800 20 rados->read ofs=0 len=0 2024-09-22T08:16:39.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.147+0000 7f193bf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:39.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.148+0000 7f193bf2c800 20 realm 2024-09-22T08:16:39.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.148+0000 7f193bf2c800 20 rados->read ofs=0 len=0 2024-09-22T08:16:39.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.148+0000 7f193bf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:39.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.148+0000 7f193bf2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:16:39.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.148+0000 7f193bf2c800 20 rados->read ofs=0 len=0 2024-09-22T08:16:39.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.148+0000 7f193bf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:39.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.148+0000 7f193bf2c800 20 rados->read ofs=0 len=0 2024-09-22T08:16:39.151 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.149+0000 7f193bf2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:39.151 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.149+0000 7f193bf2c800 20 rados->read ofs=0 len=0 2024-09-22T08:16:39.151 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.149+0000 7f193bf2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:16:39.151 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.149+0000 7f193bf2c800 20 searching for the correct realm 2024-09-22T08:16:39.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.152+0000 7f193744e640 0 -- 172.21.15.38:0/2010441819 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f192c01f070 msgr2=0x7f192c068a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:16:39.157 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.155+0000 7f193744e640 0 -- 172.21.15.38:0/2010441819 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f192803a3c0 msgr2=0x7f1928042f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:16:39.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.362+0000 7f193bf2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:16:39.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.362+0000 7f193bf2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:16:39.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.362+0000 7f193bf2c800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:16:39.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.362+0000 7f193bf2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:16:39.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.362+0000 7f193bf2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:16:39.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.362+0000 7f193bf2c800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:16:39.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.362+0000 7f193bf2c800 20 rados->read ofs=0 len=0 2024-09-22T08:16:39.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.362+0000 7f193bf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:39.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.362+0000 7f193bf2c800 20 rados->read ofs=0 len=0 2024-09-22T08:16:39.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.363+0000 7f193bf2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:39.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.363+0000 7f193bf2c800 20 rados->read ofs=0 len=0 2024-09-22T08:16:39.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.363+0000 7f193bf2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:16:39.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.363+0000 7f193bf2c800 20 zone default found 2024-09-22T08:16:39.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.363+0000 7f193bf2c800 4 Realm: () 2024-09-22T08:16:39.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.363+0000 7f193bf2c800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:16:39.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.363+0000 7f193bf2c800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:16:39.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.363+0000 7f193bf2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:16:39.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.363+0000 7f193bf2c800 20 zonegroup default 2024-09-22T08:16:39.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.363+0000 7f193bf2c800 20 rados->read ofs=0 len=0 2024-09-22T08:16:39.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.363+0000 7f193bf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:39.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.363+0000 7f193bf2c800 20 rados->read ofs=0 len=0 2024-09-22T08:16:39.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.364+0000 7f193bf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:39.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.364+0000 7f193bf2c800 20 rados->read ofs=0 len=0 2024-09-22T08:16:39.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.364+0000 7f193bf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:39.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.364+0000 7f193bf2c800 20 started sync module instance, tier type = 2024-09-22T08:16:39.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.364+0000 7f193bf2c800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:16:39.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.375+0000 7f193bf2c800 20 add_watcher() i=0 2024-09-22T08:16:39.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.375+0000 7f193bf2c800 20 add_watcher() i=1 2024-09-22T08:16:39.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.375+0000 7f193bf2c800 20 add_watcher() i=2 2024-09-22T08:16:39.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.375+0000 7f193bf2c800 20 add_watcher() i=3 2024-09-22T08:16:39.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.375+0000 7f193bf2c800 20 add_watcher() i=4 2024-09-22T08:16:39.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.375+0000 7f193bf2c800 20 add_watcher() i=5 2024-09-22T08:16:39.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.375+0000 7f193bf2c800 20 add_watcher() i=6 2024-09-22T08:16:39.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.377+0000 7f193bf2c800 20 add_watcher() i=7 2024-09-22T08:16:39.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.377+0000 7f193bf2c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:16:39.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.378+0000 7f17edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:39.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.378+0000 7f193bf2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:16:39.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.378+0000 7f193bf2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:16:39.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.378+0000 7f193bf2c800 5 note: GC not initialized 2024-09-22T08:16:39.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.379+0000 7f17ecfe1640 20 reqs_thread_entry: start 2024-09-22T08:16:39.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.379+0000 7f193bf2c800 20 init_complete bucket index max shards: 11 2024-09-22T08:16:39.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.379+0000 7f193bf2c800 20 Filter name: none 2024-09-22T08:16:39.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.379+0000 7f17667fc640 20 reqs_thread_entry: start 2024-09-22T08:16:39.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.379+0000 7f193bf2c800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-22T08:16:39.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.379+0000 7f193bf2c800 20 rados->read ofs=0 len=0 2024-09-22T08:16:39.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.379+0000 7f193bf2c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:16:39.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.379+0000 7f193bf2c800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-22T08:16:39.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.379+0000 7f193bf2c800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-22T08:16:39.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.379+0000 7f193bf2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.1 : miss 2024-09-22T08:16:39.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.379+0000 7f193bf2c800 20 rados->read ofs=0 len=0 2024-09-22T08:16:39.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.380+0000 7f193bf2c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:16:39.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.380+0000 7f193bf2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.1 info.flags=0x17 2024-09-22T08:16:39.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.380+0000 7f193bf2c800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.1 to cache LRU end 2024-09-22T08:16:39.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.380+0000 7f193bf2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:16:39.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.380+0000 7f193bf2c800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-22T08:16:39.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.380+0000 7f193bf2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.1 2024-09-22T08:16:39.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.380+0000 7f193bf2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.0 2024-09-22T08:16:39.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.381+0000 7f193bf2c800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-22T08:16:39.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.381+0000 7f193bf2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.1 2024-09-22T08:16:39.384 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.381+0000 7f193bf2c800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-22T08:16:39.384 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.381+0000 7f193bf2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.2 2024-09-22T08:16:39.384 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.382+0000 7f193bf2c800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-22T08:16:39.384 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.382+0000 7f193bf2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.3 2024-09-22T08:16:39.384 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.382+0000 7f193bf2c800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-22T08:16:39.384 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.382+0000 7f193bf2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.4 2024-09-22T08:16:39.384 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.383+0000 7f193bf2c800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-22T08:16:39.384 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.383+0000 7f193bf2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.5 2024-09-22T08:16:39.385 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.383+0000 7f193bf2c800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-22T08:16:39.385 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.383+0000 7f193bf2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.6 2024-09-22T08:16:39.385 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.384+0000 7f193bf2c800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-22T08:16:39.385 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.384+0000 7f193bf2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.7 2024-09-22T08:16:39.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.384+0000 7f193bf2c800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-22T08:16:39.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.384+0000 7f193bf2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.8 2024-09-22T08:16:39.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.384+0000 7f193bf2c800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-22T08:16:39.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.384+0000 7f193bf2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.9 2024-09-22T08:16:39.387 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.385+0000 7f193bf2c800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-22T08:16:39.387 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.385+0000 7f193bf2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.10 2024-09-22T08:16:39.387 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.385+0000 7f193bf2c800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-22T08:16:39.387 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.385+0000 7f193bf2c800 1 NOTICE: finished all shards (0 entries found) 2024-09-22T08:16:39.388 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.386+0000 7f17edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:39.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.389+0000 7f193bf2c800 20 remove_watcher() i=0 2024-09-22T08:16:39.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.389+0000 7f193bf2c800 2 removed watcher, disabling cache 2024-09-22T08:16:39.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.390+0000 7f193bf2c800 20 remove_watcher() i=1 2024-09-22T08:16:39.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.391+0000 7f193bf2c800 20 remove_watcher() i=2 2024-09-22T08:16:39.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.392+0000 7f193bf2c800 20 remove_watcher() i=3 2024-09-22T08:16:39.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.394+0000 7f193bf2c800 20 remove_watcher() i=4 2024-09-22T08:16:39.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.395+0000 7f193bf2c800 20 remove_watcher() i=5 2024-09-22T08:16:39.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.396+0000 7f193bf2c800 20 remove_watcher() i=6 2024-09-22T08:16:39.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:39.397+0000 7f193bf2c800 20 remove_watcher() i=7 2024-09-22T08:16:39.412 INFO:tasks.workunit.client.0.smithi038.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-22T08:16:39.831 INFO:tasks.workunit.client.0.smithi038.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-22T08:16:41.251 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:41.252 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:41.301 INFO:tasks.workunit.client.0.smithi038.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-22T08:16:41.303 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-22T08:16:41.339 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:16:41.339 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:16:41.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.385+0000 7f524a21d800 20 rados->read ofs=0 len=0 2024-09-22T08:16:41.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.387+0000 7f524a21d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:41.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.387+0000 7f524a21d800 20 realm 2024-09-22T08:16:41.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.387+0000 7f524a21d800 20 rados->read ofs=0 len=0 2024-09-22T08:16:41.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.387+0000 7f524a21d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:41.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.387+0000 7f524a21d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:16:41.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.387+0000 7f524a21d800 20 rados->read ofs=0 len=0 2024-09-22T08:16:41.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.387+0000 7f524a21d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:41.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.387+0000 7f524a21d800 20 rados->read ofs=0 len=0 2024-09-22T08:16:41.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.388+0000 7f524a21d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:41.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.388+0000 7f524a21d800 20 rados->read ofs=0 len=0 2024-09-22T08:16:41.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.389+0000 7f524a21d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:16:41.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.389+0000 7f524a21d800 20 searching for the correct realm 2024-09-22T08:16:41.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.392+0000 7f52451ea640 0 -- 172.21.15.38:0/3929023599 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f523c01e920 msgr2=0x7f523c046410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:16:41.599 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.599+0000 7f52451ea640 0 -- 172.21.15.38:0/3929023599 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f52380ae5b0 msgr2=0x7f52380d0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:16:41.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.808+0000 7f524a21d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:16:41.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.808+0000 7f524a21d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:16:41.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.808+0000 7f524a21d800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:16:41.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.808+0000 7f524a21d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:16:41.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.808+0000 7f524a21d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:16:41.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.808+0000 7f524a21d800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:16:41.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.808+0000 7f524a21d800 20 rados->read ofs=0 len=0 2024-09-22T08:16:41.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.808+0000 7f524a21d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:41.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.808+0000 7f524a21d800 20 rados->read ofs=0 len=0 2024-09-22T08:16:41.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.809+0000 7f524a21d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:41.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.809+0000 7f524a21d800 20 rados->read ofs=0 len=0 2024-09-22T08:16:41.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.809+0000 7f524a21d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:16:41.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.809+0000 7f524a21d800 20 zone default found 2024-09-22T08:16:41.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.809+0000 7f524a21d800 4 Realm: () 2024-09-22T08:16:41.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.809+0000 7f524a21d800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:16:41.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.809+0000 7f524a21d800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:16:41.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.809+0000 7f524a21d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:16:41.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.809+0000 7f524a21d800 20 zonegroup default 2024-09-22T08:16:41.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.809+0000 7f524a21d800 20 rados->read ofs=0 len=0 2024-09-22T08:16:41.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.810+0000 7f524a21d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:41.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.810+0000 7f524a21d800 20 rados->read ofs=0 len=0 2024-09-22T08:16:41.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.810+0000 7f524a21d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:41.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.810+0000 7f524a21d800 20 rados->read ofs=0 len=0 2024-09-22T08:16:41.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.811+0000 7f524a21d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:41.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.811+0000 7f524a21d800 20 started sync module instance, tier type = 2024-09-22T08:16:41.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.811+0000 7f524a21d800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:16:41.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.823+0000 7f524a21d800 20 add_watcher() i=0 2024-09-22T08:16:41.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.823+0000 7f524a21d800 20 add_watcher() i=1 2024-09-22T08:16:41.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.823+0000 7f524a21d800 20 add_watcher() i=2 2024-09-22T08:16:41.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.823+0000 7f524a21d800 20 add_watcher() i=3 2024-09-22T08:16:41.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.823+0000 7f524a21d800 20 add_watcher() i=4 2024-09-22T08:16:41.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.823+0000 7f524a21d800 20 add_watcher() i=5 2024-09-22T08:16:41.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.823+0000 7f524a21d800 20 add_watcher() i=6 2024-09-22T08:16:41.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.824+0000 7f524a21d800 20 add_watcher() i=7 2024-09-22T08:16:41.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.824+0000 7f524a21d800 2 all 8 watchers are set, enabling cache 2024-09-22T08:16:41.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.827+0000 7f50f77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:41.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.827+0000 7f524a21d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:16:41.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.827+0000 7f524a21d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:16:41.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.827+0000 7f524a21d800 5 note: GC not initialized 2024-09-22T08:16:41.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.827+0000 7f50f67fc640 20 reqs_thread_entry: start 2024-09-22T08:16:41.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.827+0000 7f524a21d800 20 init_complete bucket index max shards: 11 2024-09-22T08:16:41.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.827+0000 7f524a21d800 20 Filter name: none 2024-09-22T08:16:41.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.828+0000 7f5067fff640 20 reqs_thread_entry: start 2024-09-22T08:16:41.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.828+0000 7f524a21d800 20 rados->read ofs=0 len=0 2024-09-22T08:16:41.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.828+0000 7f524a21d800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:16:41.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.828+0000 7f524a21d800 20 rados->read ofs=0 len=0 2024-09-22T08:16:41.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.829+0000 7f524a21d800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:16:41.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.829+0000 7f524a21d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:16:41.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.829+0000 7f524a21d800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-22T08:16:41.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.829+0000 7f524a21d800 20 INFO: main: starting shard=0 2024-09-22T08:16:41.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.829+0000 7f524a21d800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.0 2024-09-22T08:16:41.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.830+0000 7f524a21d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:41.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.830+0000 7f524a21d800 20 INFO: main: starting shard=1 2024-09-22T08:16:41.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.830+0000 7f524a21d800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.1 2024-09-22T08:16:41.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.830+0000 7f524a21d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:41.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.830+0000 7f524a21d800 20 INFO: main: starting shard=2 2024-09-22T08:16:41.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.830+0000 7f524a21d800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.2 2024-09-22T08:16:41.832 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.831+0000 7f524a21d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:41.832 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.831+0000 7f524a21d800 20 INFO: main: starting shard=3 2024-09-22T08:16:41.832 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.831+0000 7f524a21d800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.3 2024-09-22T08:16:41.832 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.832+0000 7f524a21d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:41.832 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.832+0000 7f524a21d800 20 INFO: main: starting shard=4 2024-09-22T08:16:41.833 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.832+0000 7f524a21d800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.4 2024-09-22T08:16:41.833 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.832+0000 7f524a21d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:41.833 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.832+0000 7f524a21d800 20 INFO: main: starting shard=5 2024-09-22T08:16:41.833 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.832+0000 7f524a21d800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.5 2024-09-22T08:16:41.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.833+0000 7f524a21d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:41.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.833+0000 7f524a21d800 20 INFO: main: starting shard=6 2024-09-22T08:16:41.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.833+0000 7f524a21d800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.6 2024-09-22T08:16:41.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.834+0000 7f524a21d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:41.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.834+0000 7f524a21d800 20 INFO: main: starting shard=7 2024-09-22T08:16:41.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.834+0000 7f524a21d800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.7 2024-09-22T08:16:41.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.834+0000 7f524a21d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:41.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.834+0000 7f524a21d800 20 INFO: main: starting shard=8 2024-09-22T08:16:41.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.834+0000 7f524a21d800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.8 2024-09-22T08:16:41.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.835+0000 7f524a21d800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-22T08:16:41.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.835+0000 7f524a21d800 20 INFO: main: starting shard=9 2024-09-22T08:16:41.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.835+0000 7f524a21d800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.9 2024-09-22T08:16:41.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.835+0000 7f524a21d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:41.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.835+0000 7f524a21d800 20 INFO: main: starting shard=10 2024-09-22T08:16:41.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.835+0000 7f524a21d800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.10 2024-09-22T08:16:41.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.836+0000 7f524a21d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:41.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.836+0000 7f524a21d800 20 INFO: main: done 2024-09-22T08:16:41.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.837+0000 7f50f77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:41.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.840+0000 7f524a21d800 20 remove_watcher() i=0 2024-09-22T08:16:41.841 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.840+0000 7f524a21d800 2 removed watcher, disabling cache 2024-09-22T08:16:41.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.841+0000 7f524a21d800 20 remove_watcher() i=1 2024-09-22T08:16:41.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.842+0000 7f524a21d800 20 remove_watcher() i=2 2024-09-22T08:16:41.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.846+0000 7f524a21d800 20 remove_watcher() i=3 2024-09-22T08:16:41.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.848+0000 7f524a21d800 20 remove_watcher() i=4 2024-09-22T08:16:41.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.849+0000 7f524a21d800 20 remove_watcher() i=5 2024-09-22T08:16:41.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.851+0000 7f524a21d800 20 remove_watcher() i=6 2024-09-22T08:16:41.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:41.852+0000 7f524a21d800 20 remove_watcher() i=7 2024-09-22T08:16:41.869 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:41.869 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:41.873 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:41.873 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:41.922 INFO:tasks.workunit.client.0.smithi038.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-22T08:16:41.923 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-22T08:16:41.959 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:16:41.959 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:16:42.002 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.001+0000 7f2724a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:16:42.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.003+0000 7f2724a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:42.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.003+0000 7f2724a0f800 20 realm 2024-09-22T08:16:42.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.003+0000 7f2724a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:16:42.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.003+0000 7f2724a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:42.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.003+0000 7f2724a0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:16:42.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.003+0000 7f2724a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:16:42.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.004+0000 7f2724a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:42.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.004+0000 7f2724a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:16:42.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.004+0000 7f2724a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:42.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.004+0000 7f2724a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:16:42.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.005+0000 7f2724a0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:16:42.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.005+0000 7f2724a0f800 20 searching for the correct realm 2024-09-22T08:16:42.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.007+0000 7f2721cff640 0 -- 172.21.15.38:0/1810672051 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f270c017070 msgr2=0x7f270c0603b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:16:42.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.213+0000 7f2721cff640 0 -- 172.21.15.38:0/1810672051 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f27140b7330 msgr2=0x7f27140b6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:16:42.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.421+0000 7f2724a0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:16:42.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.421+0000 7f2724a0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:16:42.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.421+0000 7f2724a0f800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:16:42.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.421+0000 7f2724a0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:16:42.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.421+0000 7f2724a0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:16:42.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.421+0000 7f2724a0f800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:16:42.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.421+0000 7f2724a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:16:42.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.422+0000 7f2724a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:42.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.422+0000 7f2724a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:16:42.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.422+0000 7f2724a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:42.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.422+0000 7f2724a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:16:42.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.423+0000 7f2724a0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:16:42.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.423+0000 7f2724a0f800 20 zone default found 2024-09-22T08:16:42.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.423+0000 7f2724a0f800 4 Realm: () 2024-09-22T08:16:42.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.423+0000 7f2724a0f800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:16:42.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.423+0000 7f2724a0f800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:16:42.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.423+0000 7f2724a0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:16:42.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.423+0000 7f2724a0f800 20 zonegroup default 2024-09-22T08:16:42.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.423+0000 7f2724a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:16:42.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.423+0000 7f2724a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:42.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.423+0000 7f2724a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:16:42.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.424+0000 7f2724a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:42.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.424+0000 7f2724a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:16:42.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.424+0000 7f2724a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:42.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.424+0000 7f2724a0f800 20 started sync module instance, tier type = 2024-09-22T08:16:42.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.424+0000 7f2724a0f800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:16:42.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.437+0000 7f2724a0f800 20 add_watcher() i=0 2024-09-22T08:16:42.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.437+0000 7f2724a0f800 20 add_watcher() i=1 2024-09-22T08:16:42.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.437+0000 7f2724a0f800 20 add_watcher() i=2 2024-09-22T08:16:42.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.437+0000 7f2724a0f800 20 add_watcher() i=3 2024-09-22T08:16:42.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.437+0000 7f2724a0f800 20 add_watcher() i=4 2024-09-22T08:16:42.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.437+0000 7f2724a0f800 20 add_watcher() i=5 2024-09-22T08:16:42.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.437+0000 7f2724a0f800 20 add_watcher() i=6 2024-09-22T08:16:42.439 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.438+0000 7f2724a0f800 20 add_watcher() i=7 2024-09-22T08:16:42.439 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.438+0000 7f2724a0f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:16:42.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.440+0000 7f25d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:42.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.440+0000 7f2724a0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:16:42.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.440+0000 7f2724a0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:16:42.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.441+0000 7f2724a0f800 5 note: GC not initialized 2024-09-22T08:16:42.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.441+0000 7f25537fe640 20 reqs_thread_entry: start 2024-09-22T08:16:42.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.441+0000 7f2724a0f800 20 init_complete bucket index max shards: 11 2024-09-22T08:16:42.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.441+0000 7f2724a0f800 20 Filter name: none 2024-09-22T08:16:42.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.441+0000 7f25517fa640 20 reqs_thread_entry: start 2024-09-22T08:16:42.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.441+0000 7f2724a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:16:42.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.442+0000 7f2724a0f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:16:42.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.442+0000 7f2724a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:16:42.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.442+0000 7f2724a0f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:16:42.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.442+0000 7f2724a0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:16:42.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.442+0000 7f2724a0f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-22T08:16:42.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.442+0000 7f2724a0f800 20 INFO: main: starting shard=0 2024-09-22T08:16:42.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.442+0000 7f2724a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.0 2024-09-22T08:16:42.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.443+0000 7f2724a0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:42.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.443+0000 7f2724a0f800 20 INFO: main: starting shard=1 2024-09-22T08:16:42.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.443+0000 7f2724a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.1 2024-09-22T08:16:42.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.443+0000 7f2724a0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:42.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.443+0000 7f2724a0f800 20 INFO: main: starting shard=2 2024-09-22T08:16:42.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.443+0000 7f2724a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.2 2024-09-22T08:16:42.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.444+0000 7f2724a0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:42.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.444+0000 7f2724a0f800 20 INFO: main: starting shard=3 2024-09-22T08:16:42.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.444+0000 7f2724a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.3 2024-09-22T08:16:42.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.445+0000 7f2724a0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:42.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.445+0000 7f2724a0f800 20 INFO: main: starting shard=4 2024-09-22T08:16:42.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.445+0000 7f2724a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.4 2024-09-22T08:16:42.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.445+0000 7f2724a0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:42.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.445+0000 7f2724a0f800 20 INFO: main: starting shard=5 2024-09-22T08:16:42.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.445+0000 7f2724a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.5 2024-09-22T08:16:42.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.446+0000 7f2724a0f800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-22T08:16:42.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.446+0000 7f2724a0f800 20 INFO: main: starting shard=6 2024-09-22T08:16:42.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.446+0000 7f2724a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.6 2024-09-22T08:16:42.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.447+0000 7f2724a0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:42.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.447+0000 7f2724a0f800 20 INFO: main: starting shard=7 2024-09-22T08:16:42.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.447+0000 7f2724a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.7 2024-09-22T08:16:42.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.447+0000 7f2724a0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:42.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.447+0000 7f2724a0f800 20 INFO: main: starting shard=8 2024-09-22T08:16:42.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.447+0000 7f2724a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.8 2024-09-22T08:16:42.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.448+0000 7f2724a0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:42.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.448+0000 7f2724a0f800 20 INFO: main: starting shard=9 2024-09-22T08:16:42.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.448+0000 7f2724a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.9 2024-09-22T08:16:42.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.448+0000 7f2724a0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:42.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.448+0000 7f2724a0f800 20 INFO: main: starting shard=10 2024-09-22T08:16:42.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.448+0000 7f2724a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.10 2024-09-22T08:16:42.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.449+0000 7f2724a0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:42.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.449+0000 7f2724a0f800 20 INFO: main: done 2024-09-22T08:16:42.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.450+0000 7f25d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:42.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.453+0000 7f2724a0f800 20 remove_watcher() i=0 2024-09-22T08:16:42.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.453+0000 7f2724a0f800 2 removed watcher, disabling cache 2024-09-22T08:16:42.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.455+0000 7f2724a0f800 20 remove_watcher() i=1 2024-09-22T08:16:42.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.456+0000 7f2724a0f800 20 remove_watcher() i=2 2024-09-22T08:16:42.458 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.457+0000 7f2724a0f800 20 remove_watcher() i=3 2024-09-22T08:16:42.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.459+0000 7f2724a0f800 20 remove_watcher() i=4 2024-09-22T08:16:42.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.460+0000 7f2724a0f800 20 remove_watcher() i=5 2024-09-22T08:16:42.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.461+0000 7f2724a0f800 20 remove_watcher() i=6 2024-09-22T08:16:42.463 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.463+0000 7f2724a0f800 20 remove_watcher() i=7 2024-09-22T08:16:42.478 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:42.478 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:42.483 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:42.483 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:42.531 INFO:tasks.workunit.client.0.smithi038.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-22T08:16:42.533 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-22T08:16:42.566 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:16:42.566 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:16:42.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.606+0000 7f8066a20800 20 rados->read ofs=0 len=0 2024-09-22T08:16:42.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.608+0000 7f8066a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:42.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.608+0000 7f8066a20800 20 realm 2024-09-22T08:16:42.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.608+0000 7f8066a20800 20 rados->read ofs=0 len=0 2024-09-22T08:16:42.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.609+0000 7f8066a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:42.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.609+0000 7f8066a20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:16:42.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.609+0000 7f8066a20800 20 rados->read ofs=0 len=0 2024-09-22T08:16:42.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.609+0000 7f8066a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:42.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.609+0000 7f8066a20800 20 rados->read ofs=0 len=0 2024-09-22T08:16:42.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.610+0000 7f8066a20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:42.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.610+0000 7f8066a20800 20 rados->read ofs=0 len=0 2024-09-22T08:16:42.611 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.610+0000 7f8066a20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:16:42.611 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.610+0000 7f8066a20800 20 searching for the correct realm 2024-09-22T08:16:42.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.613+0000 7f8063d10640 0 -- 172.21.15.38:0/3785793380 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f80580b2c20 msgr2=0x7f80580c3460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:16:42.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.617+0000 7f8063d10640 0 -- 172.21.15.38:0/3785793380 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f805406a980 msgr2=0x7f805406a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:16:42.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.824+0000 7f8066a20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:16:42.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.824+0000 7f8066a20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:16:42.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.824+0000 7f8066a20800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:16:42.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.824+0000 7f8066a20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:16:42.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.824+0000 7f8066a20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:16:42.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.824+0000 7f8066a20800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:16:42.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.824+0000 7f8066a20800 20 rados->read ofs=0 len=0 2024-09-22T08:16:42.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.825+0000 7f8066a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:42.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.825+0000 7f8066a20800 20 rados->read ofs=0 len=0 2024-09-22T08:16:42.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.825+0000 7f8066a20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:42.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.825+0000 7f8066a20800 20 rados->read ofs=0 len=0 2024-09-22T08:16:42.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.825+0000 7f8066a20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:16:42.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.825+0000 7f8066a20800 20 zone default found 2024-09-22T08:16:42.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.825+0000 7f8066a20800 4 Realm: () 2024-09-22T08:16:42.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.825+0000 7f8066a20800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:16:42.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.825+0000 7f8066a20800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:16:42.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.825+0000 7f8066a20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:16:42.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.825+0000 7f8066a20800 20 zonegroup default 2024-09-22T08:16:42.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.825+0000 7f8066a20800 20 rados->read ofs=0 len=0 2024-09-22T08:16:42.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.826+0000 7f8066a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:42.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.826+0000 7f8066a20800 20 rados->read ofs=0 len=0 2024-09-22T08:16:42.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.826+0000 7f8066a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:42.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.826+0000 7f8066a20800 20 rados->read ofs=0 len=0 2024-09-22T08:16:42.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.827+0000 7f8066a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:42.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.827+0000 7f8066a20800 20 started sync module instance, tier type = 2024-09-22T08:16:42.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.827+0000 7f8066a20800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:16:42.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.839+0000 7f8066a20800 20 add_watcher() i=0 2024-09-22T08:16:42.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.839+0000 7f8066a20800 20 add_watcher() i=1 2024-09-22T08:16:42.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.839+0000 7f8066a20800 20 add_watcher() i=2 2024-09-22T08:16:42.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.839+0000 7f8066a20800 20 add_watcher() i=3 2024-09-22T08:16:42.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.839+0000 7f8066a20800 20 add_watcher() i=4 2024-09-22T08:16:42.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.839+0000 7f8066a20800 20 add_watcher() i=5 2024-09-22T08:16:42.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.839+0000 7f8066a20800 20 add_watcher() i=6 2024-09-22T08:16:42.841 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.840+0000 7f8066a20800 20 add_watcher() i=7 2024-09-22T08:16:42.841 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.840+0000 7f8066a20800 2 all 8 watchers are set, enabling cache 2024-09-22T08:16:42.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.842+0000 7f7f1afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:42.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.843+0000 7f8066a20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:16:42.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.843+0000 7f8066a20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:16:42.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.843+0000 7f8066a20800 5 note: GC not initialized 2024-09-22T08:16:42.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.843+0000 7f7f19fdb640 20 reqs_thread_entry: start 2024-09-22T08:16:42.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.843+0000 7f8066a20800 20 init_complete bucket index max shards: 11 2024-09-22T08:16:42.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.843+0000 7f8066a20800 20 Filter name: none 2024-09-22T08:16:42.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.843+0000 7f7e8b7fe640 20 reqs_thread_entry: start 2024-09-22T08:16:42.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.843+0000 7f8066a20800 20 rados->read ofs=0 len=0 2024-09-22T08:16:42.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.844+0000 7f8066a20800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:16:42.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.844+0000 7f8066a20800 20 rados->read ofs=0 len=0 2024-09-22T08:16:42.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.844+0000 7f8066a20800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:16:42.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.844+0000 7f8066a20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:16:42.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.844+0000 7f8066a20800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-22T08:16:42.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.844+0000 7f8066a20800 20 INFO: main: starting shard=0 2024-09-22T08:16:42.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.844+0000 7f8066a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.0 2024-09-22T08:16:42.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.845+0000 7f8066a20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:42.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.845+0000 7f8066a20800 20 INFO: main: starting shard=1 2024-09-22T08:16:42.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.845+0000 7f8066a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.1 2024-09-22T08:16:42.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.845+0000 7f8066a20800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-22T08:16:42.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.845+0000 7f8066a20800 20 INFO: main: starting shard=2 2024-09-22T08:16:42.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.845+0000 7f8066a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.2 2024-09-22T08:16:42.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.846+0000 7f8066a20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:42.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.846+0000 7f8066a20800 20 INFO: main: starting shard=3 2024-09-22T08:16:42.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.846+0000 7f8066a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.3 2024-09-22T08:16:42.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.847+0000 7f8066a20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:42.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.847+0000 7f8066a20800 20 INFO: main: starting shard=4 2024-09-22T08:16:42.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.847+0000 7f8066a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.4 2024-09-22T08:16:42.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.847+0000 7f8066a20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:42.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.847+0000 7f8066a20800 20 INFO: main: starting shard=5 2024-09-22T08:16:42.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.847+0000 7f8066a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.5 2024-09-22T08:16:42.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.848+0000 7f8066a20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:42.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.848+0000 7f8066a20800 20 INFO: main: starting shard=6 2024-09-22T08:16:42.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.848+0000 7f8066a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.6 2024-09-22T08:16:42.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.848+0000 7f8066a20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:42.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.848+0000 7f8066a20800 20 INFO: main: starting shard=7 2024-09-22T08:16:42.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.848+0000 7f8066a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.7 2024-09-22T08:16:42.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.849+0000 7f8066a20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:42.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.849+0000 7f8066a20800 20 INFO: main: starting shard=8 2024-09-22T08:16:42.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.849+0000 7f8066a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.8 2024-09-22T08:16:42.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.849+0000 7f8066a20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:42.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.849+0000 7f8066a20800 20 INFO: main: starting shard=9 2024-09-22T08:16:42.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.849+0000 7f8066a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.9 2024-09-22T08:16:42.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.850+0000 7f8066a20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:42.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.850+0000 7f8066a20800 20 INFO: main: starting shard=10 2024-09-22T08:16:42.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.850+0000 7f8066a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.10 2024-09-22T08:16:42.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.850+0000 7f8066a20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:42.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.850+0000 7f8066a20800 20 INFO: main: done 2024-09-22T08:16:42.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.851+0000 7f7f1afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:42.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.854+0000 7f8066a20800 20 remove_watcher() i=0 2024-09-22T08:16:42.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.854+0000 7f8066a20800 2 removed watcher, disabling cache 2024-09-22T08:16:42.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.855+0000 7f8066a20800 20 remove_watcher() i=1 2024-09-22T08:16:42.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.856+0000 7f8066a20800 20 remove_watcher() i=2 2024-09-22T08:16:42.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.857+0000 7f8066a20800 20 remove_watcher() i=3 2024-09-22T08:16:42.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.859+0000 7f8066a20800 20 remove_watcher() i=4 2024-09-22T08:16:42.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.860+0000 7f8066a20800 20 remove_watcher() i=5 2024-09-22T08:16:42.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.862+0000 7f8066a20800 20 remove_watcher() i=6 2024-09-22T08:16:42.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:42.863+0000 7f8066a20800 20 remove_watcher() i=7 2024-09-22T08:16:42.878 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:42.878 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:42.882 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:42.882 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:42.930 INFO:tasks.workunit.client.0.smithi038.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-22T08:16:42.931 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-22T08:16:42.963 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:16:42.963 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:16:43.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.005+0000 7f3281926800 20 rados->read ofs=0 len=0 2024-09-22T08:16:43.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.007+0000 7f3281926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:43.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.007+0000 7f3281926800 20 realm 2024-09-22T08:16:43.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.007+0000 7f3281926800 20 rados->read ofs=0 len=0 2024-09-22T08:16:43.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.007+0000 7f3281926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:43.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.007+0000 7f3281926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:16:43.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.007+0000 7f3281926800 20 rados->read ofs=0 len=0 2024-09-22T08:16:43.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.008+0000 7f3281926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:43.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.008+0000 7f3281926800 20 rados->read ofs=0 len=0 2024-09-22T08:16:43.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.008+0000 7f3281926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:43.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.008+0000 7f3281926800 20 rados->read ofs=0 len=0 2024-09-22T08:16:43.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.009+0000 7f3281926800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:16:43.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.009+0000 7f3281926800 20 searching for the correct realm 2024-09-22T08:16:43.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.011+0000 7f327cdd8640 0 -- 172.21.15.38:0/3597223540 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f327407b040 msgr2=0x7f3274088990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:16:43.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.015+0000 7f327cdd8640 0 -- 172.21.15.38:0/3597223540 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f3270096d50 msgr2=0x7f327009dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:16:43.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.222+0000 7f3281926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:16:43.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.222+0000 7f3281926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:16:43.224 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.222+0000 7f3281926800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:16:43.224 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.222+0000 7f3281926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:16:43.224 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.222+0000 7f3281926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:16:43.224 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.222+0000 7f3281926800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:16:43.224 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.222+0000 7f3281926800 20 rados->read ofs=0 len=0 2024-09-22T08:16:43.224 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.223+0000 7f3281926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:43.224 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.223+0000 7f3281926800 20 rados->read ofs=0 len=0 2024-09-22T08:16:43.224 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.223+0000 7f3281926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:43.224 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.223+0000 7f3281926800 20 rados->read ofs=0 len=0 2024-09-22T08:16:43.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.223+0000 7f3281926800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:16:43.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.223+0000 7f3281926800 20 zone default found 2024-09-22T08:16:43.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.223+0000 7f3281926800 4 Realm: () 2024-09-22T08:16:43.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.223+0000 7f3281926800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:16:43.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.223+0000 7f3281926800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:16:43.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.223+0000 7f3281926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:16:43.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.223+0000 7f3281926800 20 zonegroup default 2024-09-22T08:16:43.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.223+0000 7f3281926800 20 rados->read ofs=0 len=0 2024-09-22T08:16:43.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.224+0000 7f3281926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:43.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.224+0000 7f3281926800 20 rados->read ofs=0 len=0 2024-09-22T08:16:43.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.224+0000 7f3281926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:43.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.224+0000 7f3281926800 20 rados->read ofs=0 len=0 2024-09-22T08:16:43.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.224+0000 7f3281926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:43.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.224+0000 7f3281926800 20 started sync module instance, tier type = 2024-09-22T08:16:43.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.224+0000 7f3281926800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:16:43.237 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.237+0000 7f3281926800 20 add_watcher() i=0 2024-09-22T08:16:43.237 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.237+0000 7f3281926800 20 add_watcher() i=1 2024-09-22T08:16:43.238 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.237+0000 7f3281926800 20 add_watcher() i=2 2024-09-22T08:16:43.238 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.237+0000 7f3281926800 20 add_watcher() i=3 2024-09-22T08:16:43.238 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.237+0000 7f3281926800 20 add_watcher() i=4 2024-09-22T08:16:43.238 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.237+0000 7f3281926800 20 add_watcher() i=5 2024-09-22T08:16:43.238 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.237+0000 7f3281926800 20 add_watcher() i=6 2024-09-22T08:16:43.239 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.238+0000 7f3281926800 20 add_watcher() i=7 2024-09-22T08:16:43.239 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.238+0000 7f3281926800 2 all 8 watchers are set, enabling cache 2024-09-22T08:16:43.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.240+0000 7f31337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:43.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.241+0000 7f3281926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:16:43.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.241+0000 7f3281926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:16:43.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.241+0000 7f3281926800 5 note: GC not initialized 2024-09-22T08:16:43.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.241+0000 7f31327e4640 20 reqs_thread_entry: start 2024-09-22T08:16:43.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.241+0000 7f3281926800 20 init_complete bucket index max shards: 11 2024-09-22T08:16:43.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.241+0000 7f3281926800 20 Filter name: none 2024-09-22T08:16:43.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.241+0000 7f30a3fff640 20 reqs_thread_entry: start 2024-09-22T08:16:43.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.241+0000 7f3281926800 20 rados->read ofs=0 len=0 2024-09-22T08:16:43.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.242+0000 7f3281926800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:16:43.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.242+0000 7f3281926800 20 rados->read ofs=0 len=0 2024-09-22T08:16:43.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.242+0000 7f3281926800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:16:43.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.242+0000 7f3281926800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:16:43.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.242+0000 7f3281926800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-22T08:16:43.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.242+0000 7f3281926800 20 INFO: main: starting shard=0 2024-09-22T08:16:43.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.242+0000 7f3281926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.0 2024-09-22T08:16:43.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.243+0000 7f3281926800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:43.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.243+0000 7f3281926800 20 INFO: main: starting shard=1 2024-09-22T08:16:43.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.243+0000 7f3281926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.1 2024-09-22T08:16:43.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.243+0000 7f3281926800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:43.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.243+0000 7f3281926800 20 INFO: main: starting shard=2 2024-09-22T08:16:43.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.243+0000 7f3281926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.2 2024-09-22T08:16:43.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.244+0000 7f3281926800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:43.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.244+0000 7f3281926800 20 INFO: main: starting shard=3 2024-09-22T08:16:43.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.244+0000 7f3281926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.3 2024-09-22T08:16:43.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.245+0000 7f3281926800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:43.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.245+0000 7f3281926800 20 INFO: main: starting shard=4 2024-09-22T08:16:43.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.245+0000 7f3281926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.4 2024-09-22T08:16:43.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.245+0000 7f3281926800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:43.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.245+0000 7f3281926800 20 INFO: main: starting shard=5 2024-09-22T08:16:43.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.245+0000 7f3281926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.5 2024-09-22T08:16:43.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.245+0000 7f3281926800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:43.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.245+0000 7f3281926800 20 INFO: main: starting shard=6 2024-09-22T08:16:43.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.245+0000 7f3281926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.6 2024-09-22T08:16:43.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.246+0000 7f3281926800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:43.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.246+0000 7f3281926800 20 INFO: main: starting shard=7 2024-09-22T08:16:43.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.246+0000 7f3281926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.7 2024-09-22T08:16:43.248 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.246+0000 7f3281926800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:43.248 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.246+0000 7f3281926800 20 INFO: main: starting shard=8 2024-09-22T08:16:43.248 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.246+0000 7f3281926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.8 2024-09-22T08:16:43.248 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.247+0000 7f3281926800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:43.248 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.247+0000 7f3281926800 20 INFO: main: starting shard=9 2024-09-22T08:16:43.248 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.247+0000 7f3281926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.9 2024-09-22T08:16:43.249 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.247+0000 7f3281926800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:43.249 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.247+0000 7f3281926800 20 INFO: main: starting shard=10 2024-09-22T08:16:43.249 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.247+0000 7f3281926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.10 2024-09-22T08:16:43.249 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.248+0000 7f3281926800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-22T08:16:43.249 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.248+0000 7f3281926800 20 INFO: main: done 2024-09-22T08:16:43.249 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.249+0000 7f31337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:43.252 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.252+0000 7f3281926800 20 remove_watcher() i=0 2024-09-22T08:16:43.252 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.252+0000 7f3281926800 2 removed watcher, disabling cache 2024-09-22T08:16:43.253 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.253+0000 7f3281926800 20 remove_watcher() i=1 2024-09-22T08:16:43.254 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.254+0000 7f3281926800 20 remove_watcher() i=2 2024-09-22T08:16:43.256 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.255+0000 7f3281926800 20 remove_watcher() i=3 2024-09-22T08:16:43.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.257+0000 7f3281926800 20 remove_watcher() i=4 2024-09-22T08:16:43.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.258+0000 7f3281926800 20 remove_watcher() i=5 2024-09-22T08:16:43.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.260+0000 7f3281926800 20 remove_watcher() i=6 2024-09-22T08:16:43.261 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:43.261+0000 7f3281926800 20 remove_watcher() i=7 2024-09-22T08:16:43.275 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:43.275 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:43.279 INFO:tasks.workunit.client.0.smithi038.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-22T08:16:43.691 INFO:tasks.workunit.client.0.smithi038.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-22T08:16:44.100 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-22T08:16:44.100 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:16:44.102 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-22T08:16:44.135 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:16:44.135 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:16:44.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.175+0000 7f39a4f26800 20 rados->read ofs=0 len=0 2024-09-22T08:16:44.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.177+0000 7f39a4f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:44.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.177+0000 7f39a4f26800 20 realm 2024-09-22T08:16:44.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.177+0000 7f39a4f26800 20 rados->read ofs=0 len=0 2024-09-22T08:16:44.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.177+0000 7f39a4f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:44.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.177+0000 7f39a4f26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:16:44.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.177+0000 7f39a4f26800 20 rados->read ofs=0 len=0 2024-09-22T08:16:44.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.177+0000 7f39a4f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:44.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.177+0000 7f39a4f26800 20 rados->read ofs=0 len=0 2024-09-22T08:16:44.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.178+0000 7f39a4f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:44.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.178+0000 7f39a4f26800 20 rados->read ofs=0 len=0 2024-09-22T08:16:44.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.179+0000 7f39a4f26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:16:44.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.179+0000 7f39a4f26800 20 searching for the correct realm 2024-09-22T08:16:44.183 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.183+0000 7f39a13da640 0 -- 172.21.15.38:0/3718449369 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7f3990064940 msgr2=0x7f3990081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:16:44.387 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.386+0000 7f39a03d8640 0 -- 172.21.15.38:0/3718449369 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f39900633d0 msgr2=0x7f3990063830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:16:44.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.392+0000 7f39a4f26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:16:44.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.392+0000 7f39a4f26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:16:44.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.392+0000 7f39a4f26800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:16:44.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.392+0000 7f39a4f26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:16:44.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.392+0000 7f39a4f26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:16:44.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.392+0000 7f39a4f26800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:16:44.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.392+0000 7f39a4f26800 20 rados->read ofs=0 len=0 2024-09-22T08:16:44.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.392+0000 7f39a4f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:44.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.392+0000 7f39a4f26800 20 rados->read ofs=0 len=0 2024-09-22T08:16:44.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.393+0000 7f39a4f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:44.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.393+0000 7f39a4f26800 20 rados->read ofs=0 len=0 2024-09-22T08:16:44.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.393+0000 7f39a4f26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:16:44.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.393+0000 7f39a4f26800 20 zone default found 2024-09-22T08:16:44.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.393+0000 7f39a4f26800 4 Realm: () 2024-09-22T08:16:44.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.393+0000 7f39a4f26800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:16:44.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.393+0000 7f39a4f26800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:16:44.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.393+0000 7f39a4f26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:16:44.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.393+0000 7f39a4f26800 20 zonegroup default 2024-09-22T08:16:44.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.393+0000 7f39a4f26800 20 rados->read ofs=0 len=0 2024-09-22T08:16:44.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.394+0000 7f39a4f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:44.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.394+0000 7f39a4f26800 20 rados->read ofs=0 len=0 2024-09-22T08:16:44.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.394+0000 7f39a4f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:44.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.394+0000 7f39a4f26800 20 rados->read ofs=0 len=0 2024-09-22T08:16:44.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.394+0000 7f39a4f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:44.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.394+0000 7f39a4f26800 20 started sync module instance, tier type = 2024-09-22T08:16:44.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.394+0000 7f39a4f26800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:16:44.407 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.407+0000 7f39a4f26800 20 add_watcher() i=0 2024-09-22T08:16:44.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.407+0000 7f39a4f26800 20 add_watcher() i=1 2024-09-22T08:16:44.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.407+0000 7f39a4f26800 20 add_watcher() i=2 2024-09-22T08:16:44.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.407+0000 7f39a4f26800 20 add_watcher() i=3 2024-09-22T08:16:44.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.407+0000 7f39a4f26800 20 add_watcher() i=4 2024-09-22T08:16:44.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.407+0000 7f39a4f26800 20 add_watcher() i=5 2024-09-22T08:16:44.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.407+0000 7f39a4f26800 20 add_watcher() i=6 2024-09-22T08:16:44.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.408+0000 7f39a4f26800 20 add_watcher() i=7 2024-09-22T08:16:44.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.408+0000 7f39a4f26800 2 all 8 watchers are set, enabling cache 2024-09-22T08:16:44.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.410+0000 7f3856fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:44.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.411+0000 7f39a4f26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:16:44.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.411+0000 7f39a4f26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:16:44.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.411+0000 7f39a4f26800 5 note: GC not initialized 2024-09-22T08:16:44.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.411+0000 7f3855fe3640 20 reqs_thread_entry: start 2024-09-22T08:16:44.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.411+0000 7f39a4f26800 20 init_complete bucket index max shards: 11 2024-09-22T08:16:44.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.411+0000 7f39a4f26800 20 Filter name: none 2024-09-22T08:16:44.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.411+0000 7f37c77fe640 20 reqs_thread_entry: start 2024-09-22T08:16:44.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.411+0000 7f39a4f26800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-22T08:16:44.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.411+0000 7f39a4f26800 20 rados->read ofs=0 len=0 2024-09-22T08:16:44.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.412+0000 7f39a4f26800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:16:44.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.412+0000 7f39a4f26800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-22T08:16:44.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.412+0000 7f39a4f26800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-22T08:16:44.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.412+0000 7f39a4f26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.1 : miss 2024-09-22T08:16:44.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.412+0000 7f39a4f26800 20 rados->read ofs=0 len=0 2024-09-22T08:16:44.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.412+0000 7f39a4f26800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:16:44.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.412+0000 7f39a4f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.1 info.flags=0x17 2024-09-22T08:16:44.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.412+0000 7f39a4f26800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.1 to cache LRU end 2024-09-22T08:16:44.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.412+0000 7f39a4f26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:16:44.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.412+0000 7f39a4f26800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-22T08:16:44.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.412+0000 7f39a4f26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.1 2024-09-22T08:16:44.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.412+0000 7f39a4f26800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.0 2024-09-22T08:16:44.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.413+0000 7f39a4f26800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-22T08:16:44.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.413+0000 7f39a4f26800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.1 2024-09-22T08:16:44.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.414+0000 7f39a4f26800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.2 2024-09-22T08:16:44.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.414+0000 7f39a4f26800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-22T08:16:44.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.414+0000 7f39a4f26800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.3 2024-09-22T08:16:44.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.415+0000 7f39a4f26800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-22T08:16:44.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.415+0000 7f39a4f26800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.4 2024-09-22T08:16:44.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.415+0000 7f39a4f26800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-22T08:16:44.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.415+0000 7f39a4f26800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.5 2024-09-22T08:16:44.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.416+0000 7f39a4f26800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.6 2024-09-22T08:16:44.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.417+0000 7f39a4f26800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-22T08:16:44.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.417+0000 7f39a4f26800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.7 2024-09-22T08:16:44.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.417+0000 7f39a4f26800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-22T08:16:44.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.417+0000 7f39a4f26800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.8 2024-09-22T08:16:44.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.418+0000 7f39a4f26800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.9 2024-09-22T08:16:44.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.418+0000 7f39a4f26800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-22T08:16:44.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.418+0000 7f39a4f26800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.10 2024-09-22T08:16:44.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.418+0000 7f39a4f26800 1 NOTICE: finished shard 1 (1 entries found) 2024-09-22T08:16:44.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.418+0000 7f39a4f26800 1 NOTICE: finished shard 5 (1 entries found) 2024-09-22T08:16:44.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.418+0000 7f39a4f26800 1 NOTICE: finished shard 8 (1 entries found) 2024-09-22T08:16:44.420 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.419+0000 7f39a4f26800 1 NOTICE: finished shard 10 (1 entries found) 2024-09-22T08:16:44.420 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.419+0000 7f39a4f26800 1 NOTICE: finished all shards (4 entries found) 2024-09-22T08:16:44.420 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.420+0000 7f3856fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:44.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.422+0000 7f39a4f26800 20 remove_watcher() i=0 2024-09-22T08:16:44.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.422+0000 7f39a4f26800 2 removed watcher, disabling cache 2024-09-22T08:16:44.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.424+0000 7f39a4f26800 20 remove_watcher() i=1 2024-09-22T08:16:44.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.425+0000 7f39a4f26800 20 remove_watcher() i=2 2024-09-22T08:16:44.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.426+0000 7f39a4f26800 20 remove_watcher() i=3 2024-09-22T08:16:44.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.428+0000 7f39a4f26800 20 remove_watcher() i=4 2024-09-22T08:16:44.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.429+0000 7f39a4f26800 20 remove_watcher() i=5 2024-09-22T08:16:44.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.430+0000 7f39a4f26800 20 remove_watcher() i=6 2024-09-22T08:16:44.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.432+0000 7f39a4f26800 20 remove_watcher() i=7 2024-09-22T08:16:44.443 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: unlinked entries are not listable 2024-09-22T08:16:44.443 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:16:44.446 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:44.447 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:44.451 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-22T08:16:44.451 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:16:44.454 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:44.454 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:44.497 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:44.497 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:44.540 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-22T08:16:44.540 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:16:44.541 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-22T08:16:44.577 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:16:44.577 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:16:44.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.616+0000 7fcc91a20800 20 rados->read ofs=0 len=0 2024-09-22T08:16:44.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.618+0000 7fcc91a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:44.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.618+0000 7fcc91a20800 20 realm 2024-09-22T08:16:44.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.618+0000 7fcc91a20800 20 rados->read ofs=0 len=0 2024-09-22T08:16:44.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.618+0000 7fcc91a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:44.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.618+0000 7fcc91a20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:16:44.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.618+0000 7fcc91a20800 20 rados->read ofs=0 len=0 2024-09-22T08:16:44.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.618+0000 7fcc91a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:44.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.618+0000 7fcc91a20800 20 rados->read ofs=0 len=0 2024-09-22T08:16:44.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.619+0000 7fcc91a20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:44.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.619+0000 7fcc91a20800 20 rados->read ofs=0 len=0 2024-09-22T08:16:44.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.620+0000 7fcc91a20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:16:44.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.620+0000 7fcc91a20800 20 searching for the correct realm 2024-09-22T08:16:44.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.622+0000 7fcc87fff640 0 -- 172.21.15.38:0/1370769 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7fcc78072040 msgr2=0x7fcc78068360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:16:44.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.626+0000 7fcc87fff640 0 -- 172.21.15.38:0/1370769 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fcc8007b8d0 msgr2=0x7fcc800832d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:16:44.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.834+0000 7fcc91a20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:16:44.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.834+0000 7fcc91a20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:16:44.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.834+0000 7fcc91a20800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:16:44.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.834+0000 7fcc91a20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:16:44.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.834+0000 7fcc91a20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:16:44.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.834+0000 7fcc91a20800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:16:44.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.834+0000 7fcc91a20800 20 rados->read ofs=0 len=0 2024-09-22T08:16:44.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.834+0000 7fcc91a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:44.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.834+0000 7fcc91a20800 20 rados->read ofs=0 len=0 2024-09-22T08:16:44.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.834+0000 7fcc91a20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:44.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.834+0000 7fcc91a20800 20 rados->read ofs=0 len=0 2024-09-22T08:16:44.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.835+0000 7fcc91a20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:16:44.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.835+0000 7fcc91a20800 20 zone default found 2024-09-22T08:16:44.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.835+0000 7fcc91a20800 4 Realm: () 2024-09-22T08:16:44.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.835+0000 7fcc91a20800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:16:44.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.835+0000 7fcc91a20800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:16:44.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.835+0000 7fcc91a20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:16:44.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.835+0000 7fcc91a20800 20 zonegroup default 2024-09-22T08:16:44.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.835+0000 7fcc91a20800 20 rados->read ofs=0 len=0 2024-09-22T08:16:44.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.835+0000 7fcc91a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:44.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.835+0000 7fcc91a20800 20 rados->read ofs=0 len=0 2024-09-22T08:16:44.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.836+0000 7fcc91a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:44.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.836+0000 7fcc91a20800 20 rados->read ofs=0 len=0 2024-09-22T08:16:44.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.836+0000 7fcc91a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:44.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.836+0000 7fcc91a20800 20 started sync module instance, tier type = 2024-09-22T08:16:44.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.836+0000 7fcc91a20800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:16:44.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.848+0000 7fcc91a20800 20 add_watcher() i=0 2024-09-22T08:16:44.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.848+0000 7fcc91a20800 20 add_watcher() i=1 2024-09-22T08:16:44.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.848+0000 7fcc91a20800 20 add_watcher() i=2 2024-09-22T08:16:44.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.848+0000 7fcc91a20800 20 add_watcher() i=3 2024-09-22T08:16:44.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.848+0000 7fcc91a20800 20 add_watcher() i=4 2024-09-22T08:16:44.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.848+0000 7fcc91a20800 20 add_watcher() i=5 2024-09-22T08:16:44.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.848+0000 7fcc91a20800 20 add_watcher() i=6 2024-09-22T08:16:44.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.849+0000 7fcc91a20800 20 add_watcher() i=7 2024-09-22T08:16:44.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.849+0000 7fcc91a20800 2 all 8 watchers are set, enabling cache 2024-09-22T08:16:44.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.852+0000 7fcb45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:44.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.852+0000 7fcc91a20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:16:44.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.852+0000 7fcc91a20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:16:44.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.852+0000 7fcc91a20800 5 note: GC not initialized 2024-09-22T08:16:44.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.852+0000 7fcb44fe1640 20 reqs_thread_entry: start 2024-09-22T08:16:44.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.852+0000 7fcc91a20800 20 init_complete bucket index max shards: 11 2024-09-22T08:16:44.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.852+0000 7fcc91a20800 20 Filter name: none 2024-09-22T08:16:44.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.852+0000 7fcabe7fc640 20 reqs_thread_entry: start 2024-09-22T08:16:44.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.853+0000 7fcc91a20800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-22T08:16:44.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.853+0000 7fcc91a20800 20 rados->read ofs=0 len=0 2024-09-22T08:16:44.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.853+0000 7fcc91a20800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:16:44.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.853+0000 7fcc91a20800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-22T08:16:44.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.853+0000 7fcc91a20800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-22T08:16:44.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.853+0000 7fcc91a20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.1 : miss 2024-09-22T08:16:44.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.853+0000 7fcc91a20800 20 rados->read ofs=0 len=0 2024-09-22T08:16:44.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.854+0000 7fcc91a20800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:16:44.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.854+0000 7fcc91a20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.1 info.flags=0x17 2024-09-22T08:16:44.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.854+0000 7fcc91a20800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.1 to cache LRU end 2024-09-22T08:16:44.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.854+0000 7fcc91a20800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:16:44.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.854+0000 7fcc91a20800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-22T08:16:44.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.854+0000 7fcc91a20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.1 2024-09-22T08:16:44.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.854+0000 7fcc91a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.0 2024-09-22T08:16:44.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.855+0000 7fcc91a20800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-22T08:16:44.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.855+0000 7fcc91a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.1 2024-09-22T08:16:44.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.855+0000 7fcc91a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.2 2024-09-22T08:16:44.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.856+0000 7fcc91a20800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-22T08:16:44.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.856+0000 7fcc91a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.3 2024-09-22T08:16:44.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.856+0000 7fcc91a20800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-22T08:16:44.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.856+0000 7fcc91a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.4 2024-09-22T08:16:44.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.857+0000 7fcc91a20800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-22T08:16:44.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.857+0000 7fcc91a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.5 2024-09-22T08:16:44.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.857+0000 7fcc91a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.6 2024-09-22T08:16:44.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.858+0000 7fcc91a20800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-22T08:16:44.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.858+0000 7fcc91a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.7 2024-09-22T08:16:44.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.858+0000 7fcc91a20800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-22T08:16:44.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.858+0000 7fcc91a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.8 2024-09-22T08:16:44.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.859+0000 7fcc91a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.9 2024-09-22T08:16:44.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.859+0000 7fcc91a20800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-22T08:16:44.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.859+0000 7fcc91a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.10 2024-09-22T08:16:44.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.860+0000 7fcc91a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.1 2024-09-22T08:16:44.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.860+0000 7fcc91a20800 20 get_obj_state: octx=0x55eabe1880f0 obj=check-bucket:e state=0x55eabe457088 s->prefetch_data=0 2024-09-22T08:16:44.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.860+0000 7fcc91a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.5 2024-09-22T08:16:44.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.861+0000 7fcc91a20800 20 get_obj_state: octx=0x55eabe1afee0 obj=check-bucket:d state=0x55eabe456408 s->prefetch_data=0 2024-09-22T08:16:44.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.861+0000 7fcc91a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.8 2024-09-22T08:16:44.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.861+0000 7fcc91a20800 20 get_obj_state: octx=0x55eabe4560e0 obj=check-bucket:c state=0x55eabe454948 s->prefetch_data=0 2024-09-22T08:16:44.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.861+0000 7fcc91a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.10 2024-09-22T08:16:44.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.861+0000 7fcc91a20800 20 get_obj_state: octx=0x55eabe4f3060 obj=check-bucket:f state=0x55eabe4f4838 s->prefetch_data=0 2024-09-22T08:16:44.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.861+0000 7fcc91a20800 20 get_obj_state: setting s->obj_tag to kxlw6muxcfccb0kpisv9g1bsl03226ou 2024-09-22T08:16:44.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.861+0000 7fcc91a20800 20 get_obj_state_impl: setting s->olh_tag to 2lq2k9j1sg9djd4uw96txvc3m64f2p5r 2024-09-22T08:16:44.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.861+0000 7fcc91a20800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2lq2k9j1sg9djd4uw96txvc3m64f2p5r 2024-09-22T08:16:44.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.861+0000 7fcc91a20800 20 get_obj_state: setting s->obj_tag to v800i2so81t382e59h5040unqgp50s4n 2024-09-22T08:16:44.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.861+0000 7fcc91a20800 20 get_obj_state_impl: setting s->olh_tag to if2ouetvy5lvjzgg1oaloh6b005mqncl 2024-09-22T08:16:44.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.861+0000 7fcc91a20800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=if2ouetvy5lvjzgg1oaloh6b005mqncl 2024-09-22T08:16:44.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.861+0000 7fcc91a20800 20 get_obj_state: setting s->obj_tag to nrrulhyrprefra6g9os83rvt295crdqt 2024-09-22T08:16:44.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.861+0000 7fcc91a20800 20 get_obj_state_impl: setting s->olh_tag to kr1gf0upvrgua5t943rqoro47vvbaem4 2024-09-22T08:16:44.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.862+0000 7fcc91a20800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=kr1gf0upvrgua5t943rqoro47vvbaem4 2024-09-22T08:16:44.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.862+0000 7fcc91a20800 20 get_obj_state: setting s->obj_tag to 63l3ce3tfeqqfn7m5mxd17y3vkbpbzz7 2024-09-22T08:16:44.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.862+0000 7fcc91a20800 20 get_obj_state_impl: setting s->olh_tag to vzg89x2gr9vb1t1ehtoes2f0jfcjx3bf 2024-09-22T08:16:44.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.862+0000 7fcc91a20800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=vzg89x2gr9vb1t1ehtoes2f0jfcjx3bf 2024-09-22T08:16:44.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.863+0000 7fcc91a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.5 2024-09-22T08:16:44.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.863+0000 7fcc91a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.8 2024-09-22T08:16:44.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.863+0000 7fcc91a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.1 2024-09-22T08:16:44.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.863+0000 7fcc91a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.10 2024-09-22T08:16:44.865 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.864+0000 7fcc91a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.5 2024-09-22T08:16:44.865 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.865+0000 7fcc91a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.8 2024-09-22T08:16:44.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.865+0000 7fcc91a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.1 2024-09-22T08:16:44.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.865+0000 7fcc91a20800 20 olh_log_entry: epoch=3 op=3 key=d[GQg3.adyeQ-ABBvuhSmAcuq8kwGriRD] 2024-09-22T08:16:44.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.865+0000 7fcc91a20800 20 get_obj_state: octx=0x55eabe1afee0 obj=check-bucket:_:GQg3.adyeQ-ABBvuhSmAcuq8kwGriRD_d state=0x55eabe50b1a8 s->prefetch_data=0 2024-09-22T08:16:44.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.865+0000 7fcc91a20800 20 olh_log_entry: epoch=3 op=3 key=c[Tb1t13fBDgK4XFrkHze.hRNIcVYdRAe] 2024-09-22T08:16:44.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.865+0000 7fcc91a20800 20 get_obj_state: octx=0x55eabe4560e0 obj=check-bucket:_:Tb1t13fBDgK4XFrkHze.hRNIcVYdRAe_c state=0x55eabe510d68 s->prefetch_data=0 2024-09-22T08:16:44.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.865+0000 7fcc91a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.10 2024-09-22T08:16:44.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.865+0000 7fcc91a20800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-22T08:16:44.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.866+0000 7fcc91a20800 20 olh_log_entry: epoch=2 op=3 key=e[tGy1dpTGAtj5pw7cr8tJpsjBMSvkMVy] 2024-09-22T08:16:44.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.866+0000 7fcc91a20800 20 get_obj_state: octx=0x55eabe1880f0 obj=check-bucket:_:tGy1dpTGAtj5pw7cr8tJpsjBMSvkMVy_e state=0x55eabe513fb8 s->prefetch_data=0 2024-09-22T08:16:44.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.866+0000 7fcc91a20800 10 manifest: total_size = 22 2024-09-22T08:16:44.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.866+0000 7fcc91a20800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.5894351836520286504 2024-09-22T08:16:44.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.866+0000 7fcc91a20800 20 get_obj_state: octx=0x55eabe1afee0 obj=check-bucket:_:GQg3.adyeQ-ABBvuhSmAcuq8kwGriRD_d state=0x55eabe50b1a8 s->prefetch_data=0 2024-09-22T08:16:44.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.866+0000 7fcc91a20800 20 prepare_atomic_modification: state is not atomic. state=0x55eabe50b1a8 2024-09-22T08:16:44.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.866+0000 7fcc91a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.5 2024-09-22T08:16:44.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.866+0000 7fcc91a20800 10 manifest: total_size = 11 2024-09-22T08:16:44.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.866+0000 7fcc91a20800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.11357713872087426947 2024-09-22T08:16:44.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.866+0000 7fcc91a20800 20 get_obj_state: octx=0x55eabe4560e0 obj=check-bucket:_:Tb1t13fBDgK4XFrkHze.hRNIcVYdRAe_c state=0x55eabe510d68 s->prefetch_data=0 2024-09-22T08:16:44.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.866+0000 7fcc91a20800 20 prepare_atomic_modification: state is not atomic. state=0x55eabe510d68 2024-09-22T08:16:44.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.866+0000 7fcc91a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.8 2024-09-22T08:16:44.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.866+0000 7fcc91a20800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-22T08:16:44.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.866+0000 7fcc91a20800 20 olh_log_entry: epoch=2 op=3 key=f[.IFuVdU0JjOT0-qMz7QjAjXhPHLPXzC] 2024-09-22T08:16:44.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.866+0000 7fcc91a20800 20 get_obj_state: octx=0x55eabe4f3060 obj=check-bucket:_:.IFuVdU0JjOT0-qMz7QjAjXhPHLPXzC_f state=0x55eabe525aa8 s->prefetch_data=0 2024-09-22T08:16:44.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.866+0000 7fcc91a20800 10 manifest: total_size = 9 2024-09-22T08:16:44.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.866+0000 7fcc91a20800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.816868075655079207 2024-09-22T08:16:44.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.866+0000 7fcc91a20800 20 get_obj_state: octx=0x55eabe1880f0 obj=check-bucket:_:tGy1dpTGAtj5pw7cr8tJpsjBMSvkMVy_e state=0x55eabe513fb8 s->prefetch_data=0 2024-09-22T08:16:44.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.866+0000 7fcc91a20800 20 prepare_atomic_modification: state is not atomic. state=0x55eabe513fb8 2024-09-22T08:16:44.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.866+0000 7fcc91a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.1 2024-09-22T08:16:44.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.866+0000 7fcc91a20800 10 manifest: total_size = 11 2024-09-22T08:16:44.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.866+0000 7fcc91a20800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.313485072346663418 2024-09-22T08:16:44.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.866+0000 7fcc91a20800 20 get_obj_state: octx=0x55eabe4f3060 obj=check-bucket:_:.IFuVdU0JjOT0-qMz7QjAjXhPHLPXzC_f state=0x55eabe525aa8 s->prefetch_data=0 2024-09-22T08:16:44.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.866+0000 7fcc91a20800 20 prepare_atomic_modification: state is not atomic. state=0x55eabe525aa8 2024-09-22T08:16:44.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.866+0000 7fcc91a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.10 2024-09-22T08:16:44.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.871+0000 7fcc91a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.8 2024-09-22T08:16:44.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.871+0000 7fcc91a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.8 2024-09-22T08:16:44.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.871+0000 7fcc91a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.5 2024-09-22T08:16:44.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.871+0000 7fcc91a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.5 2024-09-22T08:16:44.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.871+0000 7fcb727fc640 20 handle_completion(): completion ok for obj=c[Tb1t13fBDgK4XFrkHze.hRNIcVYdRAe] 2024-09-22T08:16:44.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.871+0000 7fcb72ffd640 20 handle_completion(): completion ok for obj=e[tGy1dpTGAtj5pw7cr8tJpsjBMSvkMVy] 2024-09-22T08:16:44.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.871+0000 7fcc91a20800 20 get_obj_state: octx=0x55eabe1880f0 obj=check-bucket:e state=0x55eabe457088 s->prefetch_data=0 2024-09-22T08:16:44.873 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.871+0000 7fcb72ffd640 20 handle_completion(): completion ok for obj=d[GQg3.adyeQ-ABBvuhSmAcuq8kwGriRD] 2024-09-22T08:16:44.873 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.871+0000 7fcc91a20800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2lq2k9j1sg9djd4uw96txvc3m64f2p5r 2024-09-22T08:16:44.873 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.871+0000 7fcb727fc640 20 handle_completion(): completion ok for obj=f[.IFuVdU0JjOT0-qMz7QjAjXhPHLPXzC] 2024-09-22T08:16:44.873 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.872+0000 7fcc91a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.8 2024-09-22T08:16:44.873 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.872+0000 7fcc91a20800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-22T08:16:44.874 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.873+0000 7fcc91a20800 20 get_obj_state: octx=0x55eabe4f3060 obj=check-bucket:f state=0x55eabe4f4838 s->prefetch_data=0 2024-09-22T08:16:44.874 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.873+0000 7fcc91a20800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=vzg89x2gr9vb1t1ehtoes2f0jfcjx3bf 2024-09-22T08:16:44.874 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.873+0000 7fcc91a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.5 2024-09-22T08:16:44.874 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.873+0000 7fcc91a20800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-22T08:16:44.874 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.874+0000 7fcc91a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.1 2024-09-22T08:16:44.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.875+0000 7fcc91a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.1 2024-09-22T08:16:44.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.875+0000 7fcc91a20800 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-22T08:16:44.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.875+0000 7fcc91a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.10 2024-09-22T08:16:44.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.877+0000 7fcc91a20800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.10 2024-09-22T08:16:44.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.877+0000 7fcc91a20800 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-22T08:16:44.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.877+0000 7fcc91a20800 1 NOTICE: finished all shards (4 entries removed) 2024-09-22T08:16:44.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.878+0000 7fcb45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:44.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.881+0000 7fcc91a20800 20 remove_watcher() i=0 2024-09-22T08:16:44.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.881+0000 7fcc91a20800 2 removed watcher, disabling cache 2024-09-22T08:16:44.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.882+0000 7fcc91a20800 20 remove_watcher() i=1 2024-09-22T08:16:44.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.883+0000 7fcc91a20800 20 remove_watcher() i=2 2024-09-22T08:16:44.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.884+0000 7fcc91a20800 20 remove_watcher() i=3 2024-09-22T08:16:44.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.885+0000 7fcc91a20800 20 remove_watcher() i=4 2024-09-22T08:16:44.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.886+0000 7fcc91a20800 20 remove_watcher() i=5 2024-09-22T08:16:44.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.888+0000 7fcc91a20800 20 remove_watcher() i=6 2024-09-22T08:16:44.889 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:44.889+0000 7fcc91a20800 20 remove_watcher() i=7 2024-09-22T08:16:44.903 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:44.903 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:44.906 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:44.906 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:44.908 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:44.908 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:44.910 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:44.911 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:44.912 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-22T08:16:44.912 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:16:44.913 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:44.913 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:44.958 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:44.958 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:44.961 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:44.961 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:44.964 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:44.964 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:44.967 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:44.967 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:44.969 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-22T08:16:44.969 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:16:44.971 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-22T08:16:45.005 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:16:45.005 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:16:45.045 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.044+0000 7ff84e746800 20 rados->read ofs=0 len=0 2024-09-22T08:16:45.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.046+0000 7ff84e746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:45.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.046+0000 7ff84e746800 20 realm 2024-09-22T08:16:45.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.046+0000 7ff84e746800 20 rados->read ofs=0 len=0 2024-09-22T08:16:45.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.046+0000 7ff84e746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:45.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.046+0000 7ff84e746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:16:45.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.046+0000 7ff84e746800 20 rados->read ofs=0 len=0 2024-09-22T08:16:45.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.047+0000 7ff84e746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:45.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.047+0000 7ff84e746800 20 rados->read ofs=0 len=0 2024-09-22T08:16:45.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.047+0000 7ff84e746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:45.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.047+0000 7ff84e746800 20 rados->read ofs=0 len=0 2024-09-22T08:16:45.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.048+0000 7ff84e746800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:16:45.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.048+0000 7ff84e746800 20 searching for the correct realm 2024-09-22T08:16:45.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.049+0000 7ff84c237640 0 -- 172.21.15.38:0/1429529681 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x565238774340 msgr2=0x565238776800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:16:45.053 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.052+0000 7ff84c237640 0 -- 172.21.15.38:0/1429529681 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x565238767b50 msgr2=0x565238769f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:16:45.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.059+0000 7ff84e746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:16:45.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.059+0000 7ff84e746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:16:45.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.059+0000 7ff84e746800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:16:45.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.059+0000 7ff84e746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:16:45.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.059+0000 7ff84e746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:16:45.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.059+0000 7ff84e746800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:16:45.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.059+0000 7ff84e746800 20 rados->read ofs=0 len=0 2024-09-22T08:16:45.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.060+0000 7ff84e746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:45.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.060+0000 7ff84e746800 20 rados->read ofs=0 len=0 2024-09-22T08:16:45.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.060+0000 7ff84e746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:45.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.060+0000 7ff84e746800 20 rados->read ofs=0 len=0 2024-09-22T08:16:45.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.060+0000 7ff84e746800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:16:45.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.060+0000 7ff84e746800 20 zone default found 2024-09-22T08:16:45.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.060+0000 7ff84e746800 4 Realm: () 2024-09-22T08:16:45.064 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.060+0000 7ff84e746800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:16:45.064 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.060+0000 7ff84e746800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:16:45.064 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.060+0000 7ff84e746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:16:45.064 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.060+0000 7ff84e746800 20 zonegroup default 2024-09-22T08:16:45.064 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.060+0000 7ff84e746800 20 rados->read ofs=0 len=0 2024-09-22T08:16:45.064 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.060+0000 7ff84e746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:45.064 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.060+0000 7ff84e746800 20 rados->read ofs=0 len=0 2024-09-22T08:16:45.064 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.061+0000 7ff84e746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:45.064 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.061+0000 7ff84e746800 20 rados->read ofs=0 len=0 2024-09-22T08:16:45.064 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.061+0000 7ff84e746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:45.064 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.061+0000 7ff84e746800 20 started sync module instance, tier type = 2024-09-22T08:16:45.064 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.061+0000 7ff84e746800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:16:45.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.078+0000 7ff84e746800 20 add_watcher() i=0 2024-09-22T08:16:45.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.078+0000 7ff84e746800 20 add_watcher() i=1 2024-09-22T08:16:45.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.078+0000 7ff84e746800 20 add_watcher() i=2 2024-09-22T08:16:45.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.078+0000 7ff84e746800 20 add_watcher() i=3 2024-09-22T08:16:45.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.078+0000 7ff84e746800 20 add_watcher() i=4 2024-09-22T08:16:45.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.078+0000 7ff84e746800 20 add_watcher() i=5 2024-09-22T08:16:45.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.078+0000 7ff84e746800 20 add_watcher() i=6 2024-09-22T08:16:45.080 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.079+0000 7ff84e746800 20 add_watcher() i=7 2024-09-22T08:16:45.080 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.079+0000 7ff84e746800 2 all 8 watchers are set, enabling cache 2024-09-22T08:16:45.082 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.081+0000 7ff702fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:45.082 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.081+0000 7ff84e746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:16:45.083 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.081+0000 7ff84e746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:16:45.083 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.081+0000 7ff84e746800 5 note: GC not initialized 2024-09-22T08:16:45.083 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.082+0000 7ff701fdb640 20 reqs_thread_entry: start 2024-09-22T08:16:45.083 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.082+0000 7ff84e746800 20 init_complete bucket index max shards: 11 2024-09-22T08:16:45.083 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.082+0000 7ff84e746800 20 Filter name: none 2024-09-22T08:16:45.083 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.082+0000 7ff6737fe640 20 reqs_thread_entry: start 2024-09-22T08:16:45.083 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.082+0000 7ff84e746800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-22T08:16:45.083 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.082+0000 7ff84e746800 20 rados->read ofs=0 len=0 2024-09-22T08:16:45.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.082+0000 7ff84e746800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:16:45.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.082+0000 7ff84e746800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-22T08:16:45.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.082+0000 7ff84e746800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-22T08:16:45.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.082+0000 7ff84e746800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.1 : miss 2024-09-22T08:16:45.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.082+0000 7ff84e746800 20 rados->read ofs=0 len=0 2024-09-22T08:16:45.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.083+0000 7ff84e746800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:16:45.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.083+0000 7ff84e746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.1 info.flags=0x17 2024-09-22T08:16:45.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.083+0000 7ff84e746800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.1 to cache LRU end 2024-09-22T08:16:45.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.083+0000 7ff84e746800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:16:45.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.083+0000 7ff84e746800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-22T08:16:45.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.083+0000 7ff84e746800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.1 2024-09-22T08:16:45.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.083+0000 7ff84e746800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.0 2024-09-22T08:16:45.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.083+0000 7ff84e746800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-22T08:16:45.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.083+0000 7ff84e746800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.1 2024-09-22T08:16:45.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.084+0000 7ff84e746800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-22T08:16:45.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.084+0000 7ff84e746800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.2 2024-09-22T08:16:45.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.084+0000 7ff84e746800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-22T08:16:45.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.084+0000 7ff84e746800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.3 2024-09-22T08:16:45.086 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.085+0000 7ff84e746800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-22T08:16:45.086 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.085+0000 7ff84e746800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.4 2024-09-22T08:16:45.086 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.086+0000 7ff84e746800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-22T08:16:45.086 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.086+0000 7ff84e746800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.5 2024-09-22T08:16:45.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.086+0000 7ff84e746800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-22T08:16:45.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.086+0000 7ff84e746800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.6 2024-09-22T08:16:45.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.087+0000 7ff84e746800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-22T08:16:45.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.087+0000 7ff84e746800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.7 2024-09-22T08:16:45.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.087+0000 7ff84e746800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-22T08:16:45.088 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.087+0000 7ff84e746800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.8 2024-09-22T08:16:45.088 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.087+0000 7ff84e746800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-22T08:16:45.088 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.087+0000 7ff84e746800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.9 2024-09-22T08:16:45.088 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.088+0000 7ff84e746800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-22T08:16:45.088 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.088+0000 7ff84e746800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.10 2024-09-22T08:16:45.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.088+0000 7ff84e746800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-22T08:16:45.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.088+0000 7ff84e746800 1 NOTICE: finished all shards (0 entries found) 2024-09-22T08:16:45.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.089+0000 7ff702fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:45.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.091+0000 7ff84e746800 20 remove_watcher() i=0 2024-09-22T08:16:45.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.091+0000 7ff84e746800 2 removed watcher, disabling cache 2024-09-22T08:16:45.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.093+0000 7ff84e746800 20 remove_watcher() i=1 2024-09-22T08:16:45.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.093+0000 7ff84e746800 20 remove_watcher() i=2 2024-09-22T08:16:45.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.095+0000 7ff84e746800 20 remove_watcher() i=3 2024-09-22T08:16:45.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.096+0000 7ff84e746800 20 remove_watcher() i=4 2024-09-22T08:16:45.098 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.097+0000 7ff84e746800 20 remove_watcher() i=5 2024-09-22T08:16:45.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.098+0000 7ff84e746800 20 remove_watcher() i=6 2024-09-22T08:16:45.100 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.099+0000 7ff84e746800 20 remove_watcher() i=7 2024-09-22T08:16:45.115 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:45.115 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:45.127 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:45.127 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:45.139 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-22T08:16:45.170 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:16:45.170 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:16:45.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.209+0000 7ff55a73b800 20 rados->read ofs=0 len=0 2024-09-22T08:16:45.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.211+0000 7ff55a73b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:45.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.211+0000 7ff55a73b800 20 realm 2024-09-22T08:16:45.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.211+0000 7ff55a73b800 20 rados->read ofs=0 len=0 2024-09-22T08:16:45.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.211+0000 7ff55a73b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:45.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.211+0000 7ff55a73b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:16:45.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.211+0000 7ff55a73b800 20 rados->read ofs=0 len=0 2024-09-22T08:16:45.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.211+0000 7ff55a73b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:45.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.211+0000 7ff55a73b800 20 rados->read ofs=0 len=0 2024-09-22T08:16:45.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.212+0000 7ff55a73b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:45.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.212+0000 7ff55a73b800 20 rados->read ofs=0 len=0 2024-09-22T08:16:45.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.213+0000 7ff55a73b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:16:45.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.213+0000 7ff55a73b800 20 searching for the correct realm 2024-09-22T08:16:45.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.215+0000 7ff555c24640 0 -- 172.21.15.38:0/4021538752 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7ff540035070 msgr2=0x7ff5400188d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:16:45.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.219+0000 7ff555c24640 0 -- 172.21.15.38:0/4021538752 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7ff548073400 msgr2=0x7ff548094040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:16:45.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.426+0000 7ff55a73b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:16:45.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.426+0000 7ff55a73b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:16:45.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.426+0000 7ff55a73b800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:16:45.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.426+0000 7ff55a73b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:16:45.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.426+0000 7ff55a73b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:16:45.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.426+0000 7ff55a73b800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:16:45.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.426+0000 7ff55a73b800 20 rados->read ofs=0 len=0 2024-09-22T08:16:45.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.426+0000 7ff55a73b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:45.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.426+0000 7ff55a73b800 20 rados->read ofs=0 len=0 2024-09-22T08:16:45.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.427+0000 7ff55a73b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:45.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.427+0000 7ff55a73b800 20 rados->read ofs=0 len=0 2024-09-22T08:16:45.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.427+0000 7ff55a73b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:16:45.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.427+0000 7ff55a73b800 20 zone default found 2024-09-22T08:16:45.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.427+0000 7ff55a73b800 4 Realm: () 2024-09-22T08:16:45.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.427+0000 7ff55a73b800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:16:45.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.427+0000 7ff55a73b800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:16:45.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.427+0000 7ff55a73b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:16:45.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.427+0000 7ff55a73b800 20 zonegroup default 2024-09-22T08:16:45.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.427+0000 7ff55a73b800 20 rados->read ofs=0 len=0 2024-09-22T08:16:45.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.427+0000 7ff55a73b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:45.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.427+0000 7ff55a73b800 20 rados->read ofs=0 len=0 2024-09-22T08:16:45.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.428+0000 7ff55a73b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:45.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.428+0000 7ff55a73b800 20 rados->read ofs=0 len=0 2024-09-22T08:16:45.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.428+0000 7ff55a73b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:45.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.428+0000 7ff55a73b800 20 started sync module instance, tier type = 2024-09-22T08:16:45.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.428+0000 7ff55a73b800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:16:45.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.446+0000 7ff55a73b800 20 add_watcher() i=0 2024-09-22T08:16:45.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.446+0000 7ff55a73b800 20 add_watcher() i=1 2024-09-22T08:16:45.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.446+0000 7ff55a73b800 20 add_watcher() i=2 2024-09-22T08:16:45.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.446+0000 7ff55a73b800 20 add_watcher() i=3 2024-09-22T08:16:45.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.446+0000 7ff55a73b800 20 add_watcher() i=4 2024-09-22T08:16:45.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.446+0000 7ff55a73b800 20 add_watcher() i=5 2024-09-22T08:16:45.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.446+0000 7ff55a73b800 20 add_watcher() i=6 2024-09-22T08:16:45.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.447+0000 7ff55a73b800 20 add_watcher() i=7 2024-09-22T08:16:45.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.447+0000 7ff55a73b800 2 all 8 watchers are set, enabling cache 2024-09-22T08:16:45.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.449+0000 7ff40cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:45.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.449+0000 7ff55a73b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:16:45.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.449+0000 7ff55a73b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:16:45.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.449+0000 7ff55a73b800 5 note: GC not initialized 2024-09-22T08:16:45.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.450+0000 7ff3877fe640 20 reqs_thread_entry: start 2024-09-22T08:16:45.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.450+0000 7ff55a73b800 20 init_complete bucket index max shards: 11 2024-09-22T08:16:45.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.450+0000 7ff55a73b800 20 Filter name: none 2024-09-22T08:16:45.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.450+0000 7ff3857fa640 20 reqs_thread_entry: start 2024-09-22T08:16:45.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.450+0000 7ff55a73b800 20 rados->read ofs=0 len=0 2024-09-22T08:16:45.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.450+0000 7ff55a73b800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:16:45.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.450+0000 7ff55a73b800 20 rados->read ofs=0 len=0 2024-09-22T08:16:45.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.451+0000 7ff55a73b800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:16:45.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.451+0000 7ff55a73b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:16:45.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.451+0000 7ff55a73b800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-22T08:16:45.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.451+0000 7ff55a73b800 20 INFO: main: starting shard=0 2024-09-22T08:16:45.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.451+0000 7ff55a73b800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.0 2024-09-22T08:16:45.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.452+0000 7ff55a73b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:45.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.452+0000 7ff55a73b800 20 INFO: main: starting shard=1 2024-09-22T08:16:45.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.452+0000 7ff55a73b800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.1 2024-09-22T08:16:45.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.452+0000 7ff55a73b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:45.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.452+0000 7ff55a73b800 20 INFO: main: starting shard=2 2024-09-22T08:16:45.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.452+0000 7ff55a73b800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.2 2024-09-22T08:16:45.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.452+0000 7ff55a73b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:45.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.452+0000 7ff55a73b800 20 INFO: main: starting shard=3 2024-09-22T08:16:45.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.452+0000 7ff55a73b800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.3 2024-09-22T08:16:45.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.453+0000 7ff55a73b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:45.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.453+0000 7ff55a73b800 20 INFO: main: starting shard=4 2024-09-22T08:16:45.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.453+0000 7ff55a73b800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.4 2024-09-22T08:16:45.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.454+0000 7ff55a73b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:45.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.454+0000 7ff55a73b800 20 INFO: main: starting shard=5 2024-09-22T08:16:45.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.454+0000 7ff55a73b800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.5 2024-09-22T08:16:45.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.454+0000 7ff55a73b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:45.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.454+0000 7ff55a73b800 20 INFO: main: starting shard=6 2024-09-22T08:16:45.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.454+0000 7ff55a73b800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.6 2024-09-22T08:16:45.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.455+0000 7ff55a73b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:45.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.455+0000 7ff55a73b800 20 INFO: main: starting shard=7 2024-09-22T08:16:45.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.455+0000 7ff55a73b800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.7 2024-09-22T08:16:45.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.455+0000 7ff55a73b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:45.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.455+0000 7ff55a73b800 20 INFO: main: starting shard=8 2024-09-22T08:16:45.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.455+0000 7ff55a73b800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.8 2024-09-22T08:16:45.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.455+0000 7ff55a73b800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-22T08:16:45.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.455+0000 7ff55a73b800 20 INFO: main: starting shard=9 2024-09-22T08:16:45.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.455+0000 7ff55a73b800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.9 2024-09-22T08:16:45.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.456+0000 7ff55a73b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:45.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.456+0000 7ff55a73b800 20 INFO: main: starting shard=10 2024-09-22T08:16:45.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.456+0000 7ff55a73b800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.10 2024-09-22T08:16:45.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.456+0000 7ff55a73b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:45.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.456+0000 7ff55a73b800 20 INFO: main: done 2024-09-22T08:16:45.458 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.457+0000 7ff40cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:45.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.459+0000 7ff55a73b800 20 remove_watcher() i=0 2024-09-22T08:16:45.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.459+0000 7ff55a73b800 2 removed watcher, disabling cache 2024-09-22T08:16:45.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.463+0000 7ff55a73b800 20 remove_watcher() i=1 2024-09-22T08:16:45.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.464+0000 7ff55a73b800 20 remove_watcher() i=2 2024-09-22T08:16:45.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.465+0000 7ff55a73b800 20 remove_watcher() i=3 2024-09-22T08:16:45.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.466+0000 7ff55a73b800 20 remove_watcher() i=4 2024-09-22T08:16:45.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.468+0000 7ff55a73b800 20 remove_watcher() i=5 2024-09-22T08:16:45.469 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.469+0000 7ff55a73b800 20 remove_watcher() i=6 2024-09-22T08:16:45.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.470+0000 7ff55a73b800 20 remove_watcher() i=7 2024-09-22T08:16:45.484 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-22T08:16:45.515 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:16:45.515 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:16:45.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.553+0000 7f0bb5d2e800 20 rados->read ofs=0 len=0 2024-09-22T08:16:45.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.555+0000 7f0bb5d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:45.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.555+0000 7f0bb5d2e800 20 realm 2024-09-22T08:16:45.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.555+0000 7f0bb5d2e800 20 rados->read ofs=0 len=0 2024-09-22T08:16:45.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.555+0000 7f0bb5d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:45.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.555+0000 7f0bb5d2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:16:45.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.555+0000 7f0bb5d2e800 20 rados->read ofs=0 len=0 2024-09-22T08:16:45.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.555+0000 7f0bb5d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:45.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.555+0000 7f0bb5d2e800 20 rados->read ofs=0 len=0 2024-09-22T08:16:45.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.556+0000 7f0bb5d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:45.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.556+0000 7f0bb5d2e800 20 rados->read ofs=0 len=0 2024-09-22T08:16:45.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.758+0000 7f0bb5d2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:16:45.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.758+0000 7f0bb5d2e800 20 searching for the correct realm 2024-09-22T08:16:45.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.760+0000 7f0bb116a640 0 -- 172.21.15.38:0/778824640 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f0ba8089bd0 msgr2=0x7f0ba806c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:16:45.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:45.965+0000 7f0bb116a640 0 -- 172.21.15.38:0/778824640 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f0ba40b6740 msgr2=0x7f0ba40cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:16:46.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.174+0000 7f0bb5d2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:16:46.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.174+0000 7f0bb5d2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:16:46.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.174+0000 7f0bb5d2e800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:16:46.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.174+0000 7f0bb5d2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:16:46.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.174+0000 7f0bb5d2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:16:46.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.174+0000 7f0bb5d2e800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:16:46.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.174+0000 7f0bb5d2e800 20 rados->read ofs=0 len=0 2024-09-22T08:16:46.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.174+0000 7f0bb5d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:46.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.174+0000 7f0bb5d2e800 20 rados->read ofs=0 len=0 2024-09-22T08:16:46.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.175+0000 7f0bb5d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:46.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.175+0000 7f0bb5d2e800 20 rados->read ofs=0 len=0 2024-09-22T08:16:46.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.175+0000 7f0bb5d2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:16:46.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.175+0000 7f0bb5d2e800 20 zone default found 2024-09-22T08:16:46.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.175+0000 7f0bb5d2e800 4 Realm: () 2024-09-22T08:16:46.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.175+0000 7f0bb5d2e800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:16:46.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.175+0000 7f0bb5d2e800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:16:46.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.175+0000 7f0bb5d2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:16:46.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.175+0000 7f0bb5d2e800 20 zonegroup default 2024-09-22T08:16:46.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.175+0000 7f0bb5d2e800 20 rados->read ofs=0 len=0 2024-09-22T08:16:46.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.176+0000 7f0bb5d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:46.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.176+0000 7f0bb5d2e800 20 rados->read ofs=0 len=0 2024-09-22T08:16:46.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.176+0000 7f0bb5d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:46.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.176+0000 7f0bb5d2e800 20 rados->read ofs=0 len=0 2024-09-22T08:16:46.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.176+0000 7f0bb5d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:46.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.176+0000 7f0bb5d2e800 20 started sync module instance, tier type = 2024-09-22T08:16:46.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.176+0000 7f0bb5d2e800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:16:46.192 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.192+0000 7f0bb5d2e800 20 add_watcher() i=0 2024-09-22T08:16:46.192 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.192+0000 7f0bb5d2e800 20 add_watcher() i=1 2024-09-22T08:16:46.192 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.192+0000 7f0bb5d2e800 20 add_watcher() i=2 2024-09-22T08:16:46.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.192+0000 7f0bb5d2e800 20 add_watcher() i=3 2024-09-22T08:16:46.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.192+0000 7f0bb5d2e800 20 add_watcher() i=4 2024-09-22T08:16:46.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.192+0000 7f0bb5d2e800 20 add_watcher() i=5 2024-09-22T08:16:46.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.192+0000 7f0bb5d2e800 20 add_watcher() i=6 2024-09-22T08:16:46.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.193+0000 7f0bb5d2e800 20 add_watcher() i=7 2024-09-22T08:16:46.194 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.193+0000 7f0bb5d2e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:16:46.195 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.195+0000 7f0a637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:46.196 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.195+0000 7f0bb5d2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:16:46.196 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.195+0000 7f0bb5d2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:16:46.196 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.195+0000 7f0bb5d2e800 5 note: GC not initialized 2024-09-22T08:16:46.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.196+0000 7f0a627fc640 20 reqs_thread_entry: start 2024-09-22T08:16:46.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.196+0000 7f0bb5d2e800 20 init_complete bucket index max shards: 11 2024-09-22T08:16:46.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.196+0000 7f0bb5d2e800 20 Filter name: none 2024-09-22T08:16:46.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.196+0000 7f09d3fff640 20 reqs_thread_entry: start 2024-09-22T08:16:46.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.196+0000 7f0bb5d2e800 20 rados->read ofs=0 len=0 2024-09-22T08:16:46.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.197+0000 7f0bb5d2e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:16:46.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.197+0000 7f0bb5d2e800 20 rados->read ofs=0 len=0 2024-09-22T08:16:46.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.197+0000 7f0bb5d2e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:16:46.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.197+0000 7f0bb5d2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:16:46.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.197+0000 7f0bb5d2e800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-22T08:16:46.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.197+0000 7f0bb5d2e800 20 INFO: main: starting shard=0 2024-09-22T08:16:46.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.197+0000 7f0bb5d2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.0 2024-09-22T08:16:46.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.198+0000 7f0bb5d2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:46.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.198+0000 7f0bb5d2e800 20 INFO: main: starting shard=1 2024-09-22T08:16:46.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.198+0000 7f0bb5d2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.1 2024-09-22T08:16:46.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.199+0000 7f0bb5d2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:46.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.199+0000 7f0bb5d2e800 20 INFO: main: starting shard=2 2024-09-22T08:16:46.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.199+0000 7f0bb5d2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.2 2024-09-22T08:16:46.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.199+0000 7f0bb5d2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:46.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.199+0000 7f0bb5d2e800 20 INFO: main: starting shard=3 2024-09-22T08:16:46.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.199+0000 7f0bb5d2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.3 2024-09-22T08:16:46.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.200+0000 7f0bb5d2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:46.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.200+0000 7f0bb5d2e800 20 INFO: main: starting shard=4 2024-09-22T08:16:46.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.200+0000 7f0bb5d2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.4 2024-09-22T08:16:46.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.200+0000 7f0bb5d2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:46.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.200+0000 7f0bb5d2e800 20 INFO: main: starting shard=5 2024-09-22T08:16:46.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.200+0000 7f0bb5d2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.5 2024-09-22T08:16:46.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.201+0000 7f0bb5d2e800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-22T08:16:46.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.201+0000 7f0bb5d2e800 20 INFO: main: starting shard=6 2024-09-22T08:16:46.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.201+0000 7f0bb5d2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.6 2024-09-22T08:16:46.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.201+0000 7f0bb5d2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:46.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.201+0000 7f0bb5d2e800 20 INFO: main: starting shard=7 2024-09-22T08:16:46.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.201+0000 7f0bb5d2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.7 2024-09-22T08:16:46.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.202+0000 7f0bb5d2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:46.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.202+0000 7f0bb5d2e800 20 INFO: main: starting shard=8 2024-09-22T08:16:46.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.202+0000 7f0bb5d2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.8 2024-09-22T08:16:46.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.203+0000 7f0bb5d2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:46.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.203+0000 7f0bb5d2e800 20 INFO: main: starting shard=9 2024-09-22T08:16:46.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.203+0000 7f0bb5d2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.9 2024-09-22T08:16:46.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.203+0000 7f0bb5d2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:46.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.203+0000 7f0bb5d2e800 20 INFO: main: starting shard=10 2024-09-22T08:16:46.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.203+0000 7f0bb5d2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.10 2024-09-22T08:16:46.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.204+0000 7f0bb5d2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:46.205 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.204+0000 7f0bb5d2e800 20 INFO: main: done 2024-09-22T08:16:46.205 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.205+0000 7f0a637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:46.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.207+0000 7f0bb5d2e800 20 remove_watcher() i=0 2024-09-22T08:16:46.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.207+0000 7f0bb5d2e800 2 removed watcher, disabling cache 2024-09-22T08:16:46.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.209+0000 7f0bb5d2e800 20 remove_watcher() i=1 2024-09-22T08:16:46.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.210+0000 7f0bb5d2e800 20 remove_watcher() i=2 2024-09-22T08:16:46.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.211+0000 7f0bb5d2e800 20 remove_watcher() i=3 2024-09-22T08:16:46.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.213+0000 7f0bb5d2e800 20 remove_watcher() i=4 2024-09-22T08:16:46.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.214+0000 7f0bb5d2e800 20 remove_watcher() i=5 2024-09-22T08:16:46.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.215+0000 7f0bb5d2e800 20 remove_watcher() i=6 2024-09-22T08:16:46.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.217+0000 7f0bb5d2e800 20 remove_watcher() i=7 2024-09-22T08:16:46.230 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-22T08:16:46.230 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:16:46.232 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-22T08:16:46.265 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:16:46.265 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:16:46.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.306+0000 7f9f60946800 20 rados->read ofs=0 len=0 2024-09-22T08:16:46.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.308+0000 7f9f60946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:46.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.308+0000 7f9f60946800 20 realm 2024-09-22T08:16:46.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.308+0000 7f9f60946800 20 rados->read ofs=0 len=0 2024-09-22T08:16:46.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.308+0000 7f9f60946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:46.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.308+0000 7f9f60946800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:16:46.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.308+0000 7f9f60946800 20 rados->read ofs=0 len=0 2024-09-22T08:16:46.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.308+0000 7f9f60946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:46.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.308+0000 7f9f60946800 20 rados->read ofs=0 len=0 2024-09-22T08:16:46.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.309+0000 7f9f60946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:46.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.309+0000 7f9f60946800 20 rados->read ofs=0 len=0 2024-09-22T08:16:46.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.310+0000 7f9f60946800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:16:46.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.310+0000 7f9f60946800 20 searching for the correct realm 2024-09-22T08:16:46.313 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.312+0000 7f9f55c36640 0 -- 172.21.15.38:0/1370312607 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f9f480ae020 msgr2=0x7f9f480dd0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:16:46.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.518+0000 7f9f55c36640 0 -- 172.21.15.38:0/1370312607 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f9f5006dbd0 msgr2=0x7f9f500a7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:16:46.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.727+0000 7f9f60946800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:16:46.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.727+0000 7f9f60946800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:16:46.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.727+0000 7f9f60946800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:16:46.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.727+0000 7f9f60946800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:16:46.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.727+0000 7f9f60946800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:16:46.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.727+0000 7f9f60946800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:16:46.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.727+0000 7f9f60946800 20 rados->read ofs=0 len=0 2024-09-22T08:16:46.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.727+0000 7f9f60946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:46.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.728+0000 7f9f60946800 20 rados->read ofs=0 len=0 2024-09-22T08:16:46.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.728+0000 7f9f60946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:46.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.728+0000 7f9f60946800 20 rados->read ofs=0 len=0 2024-09-22T08:16:46.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.728+0000 7f9f60946800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:16:46.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.729+0000 7f9f60946800 20 zone default found 2024-09-22T08:16:46.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.729+0000 7f9f60946800 4 Realm: () 2024-09-22T08:16:46.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.729+0000 7f9f60946800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:16:46.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.729+0000 7f9f60946800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:16:46.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.729+0000 7f9f60946800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:16:46.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.729+0000 7f9f60946800 20 zonegroup default 2024-09-22T08:16:46.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.729+0000 7f9f60946800 20 rados->read ofs=0 len=0 2024-09-22T08:16:46.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.729+0000 7f9f60946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:46.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.729+0000 7f9f60946800 20 rados->read ofs=0 len=0 2024-09-22T08:16:46.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.729+0000 7f9f60946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:46.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.729+0000 7f9f60946800 20 rados->read ofs=0 len=0 2024-09-22T08:16:46.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.730+0000 7f9f60946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:46.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.730+0000 7f9f60946800 20 started sync module instance, tier type = 2024-09-22T08:16:46.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.730+0000 7f9f60946800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:16:46.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.742+0000 7f9f60946800 20 add_watcher() i=0 2024-09-22T08:16:46.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.742+0000 7f9f60946800 20 add_watcher() i=1 2024-09-22T08:16:46.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.742+0000 7f9f60946800 20 add_watcher() i=2 2024-09-22T08:16:46.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.742+0000 7f9f60946800 20 add_watcher() i=3 2024-09-22T08:16:46.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.742+0000 7f9f60946800 20 add_watcher() i=4 2024-09-22T08:16:46.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.742+0000 7f9f60946800 20 add_watcher() i=5 2024-09-22T08:16:46.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.742+0000 7f9f60946800 20 add_watcher() i=6 2024-09-22T08:16:46.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.743+0000 7f9f60946800 20 add_watcher() i=7 2024-09-22T08:16:46.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.743+0000 7f9f60946800 2 all 8 watchers are set, enabling cache 2024-09-22T08:16:46.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.745+0000 7f9e14fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:46.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.745+0000 7f9f60946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:16:46.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.745+0000 7f9f60946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:16:46.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.746+0000 7f9f60946800 5 note: GC not initialized 2024-09-22T08:16:46.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.746+0000 7f9d8f7fe640 20 reqs_thread_entry: start 2024-09-22T08:16:46.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.746+0000 7f9f60946800 20 init_complete bucket index max shards: 11 2024-09-22T08:16:46.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.746+0000 7f9f60946800 20 Filter name: none 2024-09-22T08:16:46.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.746+0000 7f9d8d7fa640 20 reqs_thread_entry: start 2024-09-22T08:16:46.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.746+0000 7f9f60946800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-22T08:16:46.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.746+0000 7f9f60946800 20 rados->read ofs=0 len=0 2024-09-22T08:16:46.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.747+0000 7f9f60946800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:16:46.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.747+0000 7f9f60946800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-22T08:16:46.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.747+0000 7f9f60946800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-22T08:16:46.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.747+0000 7f9f60946800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.1 : miss 2024-09-22T08:16:46.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.747+0000 7f9f60946800 20 rados->read ofs=0 len=0 2024-09-22T08:16:46.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.747+0000 7f9f60946800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:16:46.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.747+0000 7f9f60946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.1 info.flags=0x17 2024-09-22T08:16:46.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.747+0000 7f9f60946800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.1 to cache LRU end 2024-09-22T08:16:46.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.747+0000 7f9f60946800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:16:46.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.747+0000 7f9f60946800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-22T08:16:46.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.747+0000 7f9f60946800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.1 2024-09-22T08:16:46.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.748+0000 7f9f60946800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.0 2024-09-22T08:16:46.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.748+0000 7f9f60946800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-22T08:16:46.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.748+0000 7f9f60946800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.1 2024-09-22T08:16:46.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.749+0000 7f9f60946800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-22T08:16:46.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.749+0000 7f9f60946800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.2 2024-09-22T08:16:46.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.749+0000 7f9f60946800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-22T08:16:46.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.749+0000 7f9f60946800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.3 2024-09-22T08:16:46.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.750+0000 7f9f60946800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-22T08:16:46.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.750+0000 7f9f60946800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.4 2024-09-22T08:16:46.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.750+0000 7f9f60946800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-22T08:16:46.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.750+0000 7f9f60946800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.5 2024-09-22T08:16:46.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.751+0000 7f9f60946800 1 NOTICE: finished shard 5 (1 entries found) 2024-09-22T08:16:46.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.751+0000 7f9f60946800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.6 2024-09-22T08:16:46.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.752+0000 7f9f60946800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-22T08:16:46.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.752+0000 7f9f60946800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.7 2024-09-22T08:16:46.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.752+0000 7f9f60946800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-22T08:16:46.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.752+0000 7f9f60946800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.8 2024-09-22T08:16:46.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.753+0000 7f9f60946800 1 NOTICE: finished shard 8 (1 entries found) 2024-09-22T08:16:46.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.753+0000 7f9f60946800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.9 2024-09-22T08:16:46.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.753+0000 7f9f60946800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-22T08:16:46.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.753+0000 7f9f60946800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.10 2024-09-22T08:16:46.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.754+0000 7f9f60946800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-22T08:16:46.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.754+0000 7f9f60946800 1 NOTICE: finished all shards (2 entries found) 2024-09-22T08:16:46.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.755+0000 7f9e14fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:46.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.758+0000 7f9f60946800 20 remove_watcher() i=0 2024-09-22T08:16:46.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.758+0000 7f9f60946800 2 removed watcher, disabling cache 2024-09-22T08:16:46.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.759+0000 7f9f60946800 20 remove_watcher() i=1 2024-09-22T08:16:46.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.760+0000 7f9f60946800 20 remove_watcher() i=2 2024-09-22T08:16:46.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.761+0000 7f9f60946800 20 remove_watcher() i=3 2024-09-22T08:16:46.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.763+0000 7f9f60946800 20 remove_watcher() i=4 2024-09-22T08:16:46.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.764+0000 7f9f60946800 20 remove_watcher() i=5 2024-09-22T08:16:46.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.765+0000 7f9f60946800 20 remove_watcher() i=6 2024-09-22T08:16:46.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.766+0000 7f9f60946800 20 remove_watcher() i=7 2024-09-22T08:16:46.780 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-22T08:16:46.780 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:16:46.782 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-22T08:16:46.818 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:16:46.818 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:16:46.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.860+0000 7fdf0822f800 20 rados->read ofs=0 len=0 2024-09-22T08:16:46.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.861+0000 7fdf0822f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:46.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.861+0000 7fdf0822f800 20 realm 2024-09-22T08:16:46.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.861+0000 7fdf0822f800 20 rados->read ofs=0 len=0 2024-09-22T08:16:46.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.861+0000 7fdf0822f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:46.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.861+0000 7fdf0822f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:16:46.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.861+0000 7fdf0822f800 20 rados->read ofs=0 len=0 2024-09-22T08:16:46.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.862+0000 7fdf0822f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:46.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.862+0000 7fdf0822f800 20 rados->read ofs=0 len=0 2024-09-22T08:16:46.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.862+0000 7fdf0822f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:46.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.862+0000 7fdf0822f800 20 rados->read ofs=0 len=0 2024-09-22T08:16:46.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.863+0000 7fdf0822f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:16:46.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.863+0000 7fdf0822f800 20 searching for the correct realm 2024-09-22T08:16:46.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.865+0000 7fdf02dcb640 0 -- 172.21.15.38:0/1708093246 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7fdef8027070 msgr2=0x7fdef8062b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:16:46.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:46.869+0000 7fdf02dcb640 0 -- 172.21.15.38:0/1708093246 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fdef4070960 msgr2=0x7fdef4098400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:16:47.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.076+0000 7fdf0822f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:16:47.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.076+0000 7fdf0822f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:16:47.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.076+0000 7fdf0822f800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:16:47.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.076+0000 7fdf0822f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:16:47.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.076+0000 7fdf0822f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:16:47.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.076+0000 7fdf0822f800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:16:47.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.076+0000 7fdf0822f800 20 rados->read ofs=0 len=0 2024-09-22T08:16:47.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.076+0000 7fdf0822f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:47.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.076+0000 7fdf0822f800 20 rados->read ofs=0 len=0 2024-09-22T08:16:47.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.077+0000 7fdf0822f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:47.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.077+0000 7fdf0822f800 20 rados->read ofs=0 len=0 2024-09-22T08:16:47.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.077+0000 7fdf0822f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:16:47.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.077+0000 7fdf0822f800 20 zone default found 2024-09-22T08:16:47.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.077+0000 7fdf0822f800 4 Realm: () 2024-09-22T08:16:47.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.077+0000 7fdf0822f800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:16:47.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.077+0000 7fdf0822f800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:16:47.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.077+0000 7fdf0822f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:16:47.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.077+0000 7fdf0822f800 20 zonegroup default 2024-09-22T08:16:47.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.077+0000 7fdf0822f800 20 rados->read ofs=0 len=0 2024-09-22T08:16:47.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.078+0000 7fdf0822f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:47.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.078+0000 7fdf0822f800 20 rados->read ofs=0 len=0 2024-09-22T08:16:47.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.078+0000 7fdf0822f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:47.080 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.078+0000 7fdf0822f800 20 rados->read ofs=0 len=0 2024-09-22T08:16:47.080 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.078+0000 7fdf0822f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:47.080 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.078+0000 7fdf0822f800 20 started sync module instance, tier type = 2024-09-22T08:16:47.080 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.078+0000 7fdf0822f800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:16:47.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.096+0000 7fdf0822f800 20 add_watcher() i=0 2024-09-22T08:16:47.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.096+0000 7fdf0822f800 20 add_watcher() i=1 2024-09-22T08:16:47.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.096+0000 7fdf0822f800 20 add_watcher() i=2 2024-09-22T08:16:47.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.096+0000 7fdf0822f800 20 add_watcher() i=3 2024-09-22T08:16:47.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.096+0000 7fdf0822f800 20 add_watcher() i=4 2024-09-22T08:16:47.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.096+0000 7fdf0822f800 20 add_watcher() i=5 2024-09-22T08:16:47.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.096+0000 7fdf0822f800 20 add_watcher() i=6 2024-09-22T08:16:47.098 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.097+0000 7fdf0822f800 20 add_watcher() i=7 2024-09-22T08:16:47.098 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.097+0000 7fdf0822f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:16:47.103 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.100+0000 7fddb9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:47.103 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.100+0000 7fdf0822f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:16:47.103 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.100+0000 7fdf0822f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:16:47.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.100+0000 7fdf0822f800 5 note: GC not initialized 2024-09-22T08:16:47.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.100+0000 7fddb8fe1640 20 reqs_thread_entry: start 2024-09-22T08:16:47.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.100+0000 7fdf0822f800 20 init_complete bucket index max shards: 11 2024-09-22T08:16:47.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.100+0000 7fdf0822f800 20 Filter name: none 2024-09-22T08:16:47.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.101+0000 7fdd327fc640 20 reqs_thread_entry: start 2024-09-22T08:16:47.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.101+0000 7fdf0822f800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-22T08:16:47.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.101+0000 7fdf0822f800 20 rados->read ofs=0 len=0 2024-09-22T08:16:47.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.101+0000 7fdf0822f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:16:47.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.101+0000 7fdf0822f800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-22T08:16:47.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.101+0000 7fdf0822f800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-22T08:16:47.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.101+0000 7fdf0822f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.1 : miss 2024-09-22T08:16:47.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.101+0000 7fdf0822f800 20 rados->read ofs=0 len=0 2024-09-22T08:16:47.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.101+0000 7fdf0822f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:16:47.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.101+0000 7fdf0822f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.1 info.flags=0x17 2024-09-22T08:16:47.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.101+0000 7fdf0822f800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.1 to cache LRU end 2024-09-22T08:16:47.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.101+0000 7fdf0822f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:16:47.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.101+0000 7fdf0822f800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-22T08:16:47.105 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.101+0000 7fdf0822f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.1 2024-09-22T08:16:47.105 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.102+0000 7fdf0822f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.0 2024-09-22T08:16:47.105 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.102+0000 7fdf0822f800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-22T08:16:47.105 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.102+0000 7fdf0822f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.1 2024-09-22T08:16:47.105 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.103+0000 7fdf0822f800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-22T08:16:47.105 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.103+0000 7fdf0822f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.2 2024-09-22T08:16:47.106 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.103+0000 7fdf0822f800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-22T08:16:47.106 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.103+0000 7fdf0822f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.3 2024-09-22T08:16:47.106 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.104+0000 7fdf0822f800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-22T08:16:47.106 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.104+0000 7fdf0822f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.4 2024-09-22T08:16:47.106 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.104+0000 7fdf0822f800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-22T08:16:47.106 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.104+0000 7fdf0822f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.5 2024-09-22T08:16:47.106 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.105+0000 7fdf0822f800 20 get_obj_state: octx=0x55b5dba240f0 obj=check-bucket:d state=0x55b5dbcf2748 s->prefetch_data=0 2024-09-22T08:16:47.106 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.105+0000 7fdf0822f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.6 2024-09-22T08:16:47.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.105+0000 7fdf0822f800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-22T08:16:47.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.105+0000 7fdf0822f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.7 2024-09-22T08:16:47.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.106+0000 7fdf0822f800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-22T08:16:47.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.106+0000 7fdf0822f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.8 2024-09-22T08:16:47.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.106+0000 7fdf0822f800 20 get_obj_state: octx=0x55b5dba4bee0 obj=check-bucket:c state=0x55b5dbcf32b8 s->prefetch_data=0 2024-09-22T08:16:47.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.106+0000 7fdf0822f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.9 2024-09-22T08:16:47.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.107+0000 7fdf0822f800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-22T08:16:47.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.107+0000 7fdf0822f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.10 2024-09-22T08:16:47.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.107+0000 7fdf0822f800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-22T08:16:47.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.107+0000 7fdf0822f800 20 get_obj_state: setting s->obj_tag to v800i2so81t382e59h5040unqgp50s4n 2024-09-22T08:16:47.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.107+0000 7fdf0822f800 20 get_obj_state_impl: setting s->olh_tag to if2ouetvy5lvjzgg1oaloh6b005mqncl 2024-09-22T08:16:47.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.107+0000 7fdf0822f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.5 2024-09-22T08:16:47.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.107+0000 7fdf0822f800 20 get_obj_state: setting s->obj_tag to nrrulhyrprefra6g9os83rvt295crdqt 2024-09-22T08:16:47.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.107+0000 7fdf0822f800 20 get_obj_state_impl: setting s->olh_tag to kr1gf0upvrgua5t943rqoro47vvbaem4 2024-09-22T08:16:47.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.107+0000 7fdf0822f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.8 2024-09-22T08:16:47.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.108+0000 7fdf0822f800 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-22T08:16:47.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.108+0000 7fdf0822f800 20 olh_log_entry: epoch=4 op=3 key=c[UcbscyPLymjdfehfUEBGter3zwiHzG6] 2024-09-22T08:16:47.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.108+0000 7fdf0822f800 20 get_obj_state: octx=0x55b5dbd4c2b0 obj=check-bucket:_:UcbscyPLymjdfehfUEBGter3zwiHzG6_c state=0x55b5dbd50d38 s->prefetch_data=0 2024-09-22T08:16:47.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.108+0000 7fdf0822f800 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-22T08:16:47.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.108+0000 7fdf0822f800 20 olh_log_entry: epoch=4 op=3 key=d[wl8U4kw0uLXnfx09ECVg-0rqWq-RDUV] 2024-09-22T08:16:47.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.108+0000 7fdf0822f800 20 get_obj_state: octx=0x55b5dbd2c2b0 obj=check-bucket:_:wl8U4kw0uLXnfx09ECVg-0rqWq-RDUV_d state=0x55b5dbd5a1f8 s->prefetch_data=0 2024-09-22T08:16:47.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.110+0000 7fdf0822f800 20 get_obj_state: octx=0x55b5dbd2c2b0 obj=check-bucket:d state=0x55b5dbd5a1f8 s->prefetch_data=0 2024-09-22T08:16:47.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.110+0000 7fdf0822f800 20 get_obj_state: octx=0x55b5dbd4c2b0 obj=check-bucket:c state=0x55b5dbd56df8 s->prefetch_data=0 2024-09-22T08:16:47.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.110+0000 7fdf0822f800 20 get_obj_state: setting s->obj_tag to nrrulhyrprefra6g9os83rvt295crdqt 2024-09-22T08:16:47.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.110+0000 7fdf0822f800 20 get_obj_state_impl: setting s->olh_tag to kr1gf0upvrgua5t943rqoro47vvbaem4 2024-09-22T08:16:47.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.110+0000 7fdf0822f800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=kr1gf0upvrgua5t943rqoro47vvbaem4 2024-09-22T08:16:47.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.110+0000 7fdf0822f800 20 get_obj_state: setting s->obj_tag to v800i2so81t382e59h5040unqgp50s4n 2024-09-22T08:16:47.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.110+0000 7fdf0822f800 20 get_obj_state_impl: setting s->olh_tag to if2ouetvy5lvjzgg1oaloh6b005mqncl 2024-09-22T08:16:47.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.110+0000 7fdf0822f800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=if2ouetvy5lvjzgg1oaloh6b005mqncl 2024-09-22T08:16:47.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.113+0000 7fdf0822f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.8 2024-09-22T08:16:47.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.114+0000 7fdf0822f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.5 2024-09-22T08:16:47.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.114+0000 7fdf0822f800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-22T08:16:47.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.115+0000 7fdf0822f800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-22T08:16:47.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.115+0000 7fdf0822f800 1 NOTICE: finished all shards (2 entries removed) 2024-09-22T08:16:47.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.116+0000 7fddb9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:47.119 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.119+0000 7fdf0822f800 20 remove_watcher() i=0 2024-09-22T08:16:47.119 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.119+0000 7fdf0822f800 2 removed watcher, disabling cache 2024-09-22T08:16:47.120 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.120+0000 7fdf0822f800 20 remove_watcher() i=1 2024-09-22T08:16:47.122 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.121+0000 7fdf0822f800 20 remove_watcher() i=2 2024-09-22T08:16:47.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.122+0000 7fdf0822f800 20 remove_watcher() i=3 2024-09-22T08:16:47.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.123+0000 7fdf0822f800 20 remove_watcher() i=4 2024-09-22T08:16:47.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.125+0000 7fdf0822f800 20 remove_watcher() i=5 2024-09-22T08:16:47.126 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.126+0000 7fdf0822f800 20 remove_watcher() i=6 2024-09-22T08:16:47.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.127+0000 7fdf0822f800 20 remove_watcher() i=7 2024-09-22T08:16:47.141 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-22T08:16:47.173 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:16:47.173 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:16:47.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.212+0000 7f3fed736800 20 rados->read ofs=0 len=0 2024-09-22T08:16:47.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.215+0000 7f3fed736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:47.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.215+0000 7f3fed736800 20 realm 2024-09-22T08:16:47.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.215+0000 7f3fed736800 20 rados->read ofs=0 len=0 2024-09-22T08:16:47.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.215+0000 7f3fed736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:47.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.215+0000 7f3fed736800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:16:47.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.215+0000 7f3fed736800 20 rados->read ofs=0 len=0 2024-09-22T08:16:47.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.215+0000 7f3fed736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:47.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.215+0000 7f3fed736800 20 rados->read ofs=0 len=0 2024-09-22T08:16:47.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.216+0000 7f3fed736800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:47.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.216+0000 7f3fed736800 20 rados->read ofs=0 len=0 2024-09-22T08:16:47.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.217+0000 7f3fed736800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:16:47.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.217+0000 7f3fed736800 20 searching for the correct realm 2024-09-22T08:16:47.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.219+0000 7f3fe8cb6640 0 -- 172.21.15.38:0/2249734215 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f3fe0043070 msgr2=0x7f3fe0043960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:16:47.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.424+0000 7f3fe8cb6640 0 -- 172.21.15.38:0/2249734215 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f3fdc072c00 msgr2=0x7f3fdc0725d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:16:47.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.631+0000 7f3fed736800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:16:47.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.631+0000 7f3fed736800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:16:47.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.631+0000 7f3fed736800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:16:47.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.631+0000 7f3fed736800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:16:47.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.631+0000 7f3fed736800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:16:47.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.631+0000 7f3fed736800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:16:47.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.631+0000 7f3fed736800 20 rados->read ofs=0 len=0 2024-09-22T08:16:47.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.631+0000 7f3fed736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:47.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.631+0000 7f3fed736800 20 rados->read ofs=0 len=0 2024-09-22T08:16:47.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.632+0000 7f3fed736800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:47.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.632+0000 7f3fed736800 20 rados->read ofs=0 len=0 2024-09-22T08:16:47.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.632+0000 7f3fed736800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:16:47.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.632+0000 7f3fed736800 20 zone default found 2024-09-22T08:16:47.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.632+0000 7f3fed736800 4 Realm: () 2024-09-22T08:16:47.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.632+0000 7f3fed736800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:16:47.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.632+0000 7f3fed736800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:16:47.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.632+0000 7f3fed736800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:16:47.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.632+0000 7f3fed736800 20 zonegroup default 2024-09-22T08:16:47.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.632+0000 7f3fed736800 20 rados->read ofs=0 len=0 2024-09-22T08:16:47.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.632+0000 7f3fed736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:47.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.632+0000 7f3fed736800 20 rados->read ofs=0 len=0 2024-09-22T08:16:47.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.633+0000 7f3fed736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:47.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.633+0000 7f3fed736800 20 rados->read ofs=0 len=0 2024-09-22T08:16:47.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.633+0000 7f3fed736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:47.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.633+0000 7f3fed736800 20 started sync module instance, tier type = 2024-09-22T08:16:47.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.633+0000 7f3fed736800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:16:47.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.645+0000 7f3fed736800 20 add_watcher() i=0 2024-09-22T08:16:47.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.645+0000 7f3fed736800 20 add_watcher() i=1 2024-09-22T08:16:47.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.645+0000 7f3fed736800 20 add_watcher() i=2 2024-09-22T08:16:47.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.645+0000 7f3fed736800 20 add_watcher() i=3 2024-09-22T08:16:47.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.645+0000 7f3fed736800 20 add_watcher() i=4 2024-09-22T08:16:47.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.645+0000 7f3fed736800 20 add_watcher() i=5 2024-09-22T08:16:47.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.645+0000 7f3fed736800 20 add_watcher() i=6 2024-09-22T08:16:47.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.646+0000 7f3fed736800 20 add_watcher() i=7 2024-09-22T08:16:47.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.646+0000 7f3fed736800 2 all 8 watchers are set, enabling cache 2024-09-22T08:16:47.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.648+0000 7f3e9f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:47.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.648+0000 7f3fed736800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:16:47.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.648+0000 7f3fed736800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:16:47.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.648+0000 7f3fed736800 5 note: GC not initialized 2024-09-22T08:16:47.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.649+0000 7f3e9e7e4640 20 reqs_thread_entry: start 2024-09-22T08:16:47.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.649+0000 7f3fed736800 20 init_complete bucket index max shards: 11 2024-09-22T08:16:47.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.649+0000 7f3fed736800 20 Filter name: none 2024-09-22T08:16:47.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.649+0000 7f3e0ffff640 20 reqs_thread_entry: start 2024-09-22T08:16:47.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.649+0000 7f3fed736800 20 rados->read ofs=0 len=0 2024-09-22T08:16:47.651 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.649+0000 7f3fed736800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:16:47.651 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.650+0000 7f3fed736800 20 rados->read ofs=0 len=0 2024-09-22T08:16:47.651 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.650+0000 7f3fed736800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:16:47.651 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.650+0000 7f3fed736800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:16:47.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.650+0000 7f3fed736800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-22T08:16:47.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.650+0000 7f3fed736800 20 INFO: main: starting shard=0 2024-09-22T08:16:47.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.650+0000 7f3fed736800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.0 2024-09-22T08:16:47.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.651+0000 7f3fed736800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:47.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.651+0000 7f3fed736800 20 INFO: main: starting shard=1 2024-09-22T08:16:47.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.651+0000 7f3fed736800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.1 2024-09-22T08:16:47.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.651+0000 7f3fed736800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:47.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.651+0000 7f3fed736800 20 INFO: main: starting shard=2 2024-09-22T08:16:47.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.651+0000 7f3fed736800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.2 2024-09-22T08:16:47.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.652+0000 7f3fed736800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:47.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.652+0000 7f3fed736800 20 INFO: main: starting shard=3 2024-09-22T08:16:47.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.652+0000 7f3fed736800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.3 2024-09-22T08:16:47.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.652+0000 7f3fed736800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:47.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.652+0000 7f3fed736800 20 INFO: main: starting shard=4 2024-09-22T08:16:47.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.652+0000 7f3fed736800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.4 2024-09-22T08:16:47.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.653+0000 7f3fed736800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:47.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.653+0000 7f3fed736800 20 INFO: main: starting shard=5 2024-09-22T08:16:47.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.653+0000 7f3fed736800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.5 2024-09-22T08:16:47.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.653+0000 7f3fed736800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:47.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.653+0000 7f3fed736800 20 INFO: main: starting shard=6 2024-09-22T08:16:47.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.653+0000 7f3fed736800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.6 2024-09-22T08:16:47.655 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.654+0000 7f3fed736800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:47.655 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.654+0000 7f3fed736800 20 INFO: main: starting shard=7 2024-09-22T08:16:47.655 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.654+0000 7f3fed736800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.7 2024-09-22T08:16:47.655 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.654+0000 7f3fed736800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:47.655 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.654+0000 7f3fed736800 20 INFO: main: starting shard=8 2024-09-22T08:16:47.655 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.654+0000 7f3fed736800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.8 2024-09-22T08:16:47.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.655+0000 7f3fed736800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:47.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.655+0000 7f3fed736800 20 INFO: main: starting shard=9 2024-09-22T08:16:47.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.655+0000 7f3fed736800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.9 2024-09-22T08:16:47.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.655+0000 7f3fed736800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:47.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.655+0000 7f3fed736800 20 INFO: main: starting shard=10 2024-09-22T08:16:47.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.655+0000 7f3fed736800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.10 2024-09-22T08:16:47.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.656+0000 7f3fed736800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:47.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.656+0000 7f3fed736800 20 INFO: main: done 2024-09-22T08:16:47.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.657+0000 7f3e9f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:47.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.659+0000 7f3fed736800 20 remove_watcher() i=0 2024-09-22T08:16:47.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.659+0000 7f3fed736800 2 removed watcher, disabling cache 2024-09-22T08:16:47.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.660+0000 7f3fed736800 20 remove_watcher() i=1 2024-09-22T08:16:47.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.661+0000 7f3fed736800 20 remove_watcher() i=2 2024-09-22T08:16:47.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.663+0000 7f3fed736800 20 remove_watcher() i=3 2024-09-22T08:16:47.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.664+0000 7f3fed736800 20 remove_watcher() i=4 2024-09-22T08:16:47.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.665+0000 7f3fed736800 20 remove_watcher() i=5 2024-09-22T08:16:47.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.666+0000 7f3fed736800 20 remove_watcher() i=6 2024-09-22T08:16:47.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.668+0000 7f3fed736800 20 remove_watcher() i=7 2024-09-22T08:16:47.682 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-22T08:16:47.714 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:16:47.714 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:16:47.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.752+0000 7f683072c800 20 rados->read ofs=0 len=0 2024-09-22T08:16:47.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.754+0000 7f683072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:47.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.754+0000 7f683072c800 20 realm 2024-09-22T08:16:47.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.754+0000 7f683072c800 20 rados->read ofs=0 len=0 2024-09-22T08:16:47.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.754+0000 7f683072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:47.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.754+0000 7f683072c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:16:47.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.754+0000 7f683072c800 20 rados->read ofs=0 len=0 2024-09-22T08:16:47.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.755+0000 7f683072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:47.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.755+0000 7f683072c800 20 rados->read ofs=0 len=0 2024-09-22T08:16:47.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.755+0000 7f683072c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:47.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.755+0000 7f683072c800 20 rados->read ofs=0 len=0 2024-09-22T08:16:47.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.756+0000 7f683072c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:16:47.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.756+0000 7f683072c800 20 searching for the correct realm 2024-09-22T08:16:47.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.759+0000 7f682ccdb640 0 -- 172.21.15.38:0/1862734824 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7f681c037040 msgr2=0x7f681c037930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:16:47.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.965+0000 7f682c4da640 0 -- 172.21.15.38:0/1862734824 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x55f9a7b45fd0 msgr2=0x55f9a7b48420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:16:47.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.970+0000 7f683072c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:16:47.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.970+0000 7f683072c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:16:47.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.970+0000 7f683072c800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:16:47.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.970+0000 7f683072c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:16:47.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.970+0000 7f683072c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:16:47.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.970+0000 7f683072c800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:16:47.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.970+0000 7f683072c800 20 rados->read ofs=0 len=0 2024-09-22T08:16:47.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.970+0000 7f683072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:47.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.970+0000 7f683072c800 20 rados->read ofs=0 len=0 2024-09-22T08:16:47.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.971+0000 7f683072c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:47.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.971+0000 7f683072c800 20 rados->read ofs=0 len=0 2024-09-22T08:16:47.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.971+0000 7f683072c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:16:47.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.971+0000 7f683072c800 20 zone default found 2024-09-22T08:16:47.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.971+0000 7f683072c800 4 Realm: () 2024-09-22T08:16:47.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.971+0000 7f683072c800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:16:47.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.971+0000 7f683072c800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:16:47.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.971+0000 7f683072c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:16:47.973 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.971+0000 7f683072c800 20 zonegroup default 2024-09-22T08:16:47.973 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.971+0000 7f683072c800 20 rados->read ofs=0 len=0 2024-09-22T08:16:47.973 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.972+0000 7f683072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:47.973 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.972+0000 7f683072c800 20 rados->read ofs=0 len=0 2024-09-22T08:16:47.973 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.972+0000 7f683072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:47.973 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.972+0000 7f683072c800 20 rados->read ofs=0 len=0 2024-09-22T08:16:47.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.972+0000 7f683072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:47.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.972+0000 7f683072c800 20 started sync module instance, tier type = 2024-09-22T08:16:47.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.972+0000 7f683072c800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:16:47.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.985+0000 7f683072c800 20 add_watcher() i=0 2024-09-22T08:16:47.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.985+0000 7f683072c800 20 add_watcher() i=1 2024-09-22T08:16:47.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.985+0000 7f683072c800 20 add_watcher() i=2 2024-09-22T08:16:47.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.985+0000 7f683072c800 20 add_watcher() i=3 2024-09-22T08:16:47.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.985+0000 7f683072c800 20 add_watcher() i=4 2024-09-22T08:16:47.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.985+0000 7f683072c800 20 add_watcher() i=5 2024-09-22T08:16:47.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.985+0000 7f683072c800 20 add_watcher() i=6 2024-09-22T08:16:47.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.986+0000 7f683072c800 20 add_watcher() i=7 2024-09-22T08:16:47.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.986+0000 7f683072c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:16:47.989 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.988+0000 7f66e2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:47.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.989+0000 7f683072c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:16:47.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.989+0000 7f683072c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:16:47.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.989+0000 7f683072c800 5 note: GC not initialized 2024-09-22T08:16:47.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.989+0000 7f66e1fdb640 20 reqs_thread_entry: start 2024-09-22T08:16:47.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.989+0000 7f683072c800 20 init_complete bucket index max shards: 11 2024-09-22T08:16:47.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.989+0000 7f683072c800 20 Filter name: none 2024-09-22T08:16:47.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.989+0000 7f66537fe640 20 reqs_thread_entry: start 2024-09-22T08:16:47.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.989+0000 7f683072c800 20 rados->read ofs=0 len=0 2024-09-22T08:16:47.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.990+0000 7f683072c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:16:47.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.990+0000 7f683072c800 20 rados->read ofs=0 len=0 2024-09-22T08:16:47.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.990+0000 7f683072c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:16:47.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.990+0000 7f683072c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:16:47.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.990+0000 7f683072c800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-22T08:16:47.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.990+0000 7f683072c800 20 INFO: main: starting shard=0 2024-09-22T08:16:47.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.990+0000 7f683072c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.0 2024-09-22T08:16:47.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.991+0000 7f683072c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:47.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.991+0000 7f683072c800 20 INFO: main: starting shard=1 2024-09-22T08:16:47.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.991+0000 7f683072c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.1 2024-09-22T08:16:47.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.992+0000 7f683072c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:47.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.992+0000 7f683072c800 20 INFO: main: starting shard=2 2024-09-22T08:16:47.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.992+0000 7f683072c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.2 2024-09-22T08:16:47.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.992+0000 7f683072c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:47.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.992+0000 7f683072c800 20 INFO: main: starting shard=3 2024-09-22T08:16:47.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.992+0000 7f683072c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.3 2024-09-22T08:16:47.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.993+0000 7f683072c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:47.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.993+0000 7f683072c800 20 INFO: main: starting shard=4 2024-09-22T08:16:47.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.993+0000 7f683072c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.4 2024-09-22T08:16:47.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.993+0000 7f683072c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:47.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.993+0000 7f683072c800 20 INFO: main: starting shard=5 2024-09-22T08:16:47.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.993+0000 7f683072c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.5 2024-09-22T08:16:47.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.994+0000 7f683072c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:47.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.994+0000 7f683072c800 20 INFO: main: starting shard=6 2024-09-22T08:16:47.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.994+0000 7f683072c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.6 2024-09-22T08:16:47.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.994+0000 7f683072c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:47.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.994+0000 7f683072c800 20 INFO: main: starting shard=7 2024-09-22T08:16:47.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.994+0000 7f683072c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.7 2024-09-22T08:16:47.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.995+0000 7f683072c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:47.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.995+0000 7f683072c800 20 INFO: main: starting shard=8 2024-09-22T08:16:47.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.995+0000 7f683072c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.8 2024-09-22T08:16:47.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.995+0000 7f683072c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:47.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.995+0000 7f683072c800 20 INFO: main: starting shard=9 2024-09-22T08:16:47.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.995+0000 7f683072c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.9 2024-09-22T08:16:47.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.995+0000 7f683072c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:47.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.995+0000 7f683072c800 20 INFO: main: starting shard=10 2024-09-22T08:16:47.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.995+0000 7f683072c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.10 2024-09-22T08:16:47.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.996+0000 7f683072c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:47.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.996+0000 7f683072c800 20 INFO: main: done 2024-09-22T08:16:47.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.997+0000 7f66e2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:48.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.999+0000 7f683072c800 20 remove_watcher() i=0 2024-09-22T08:16:48.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:47.999+0000 7f683072c800 2 removed watcher, disabling cache 2024-09-22T08:16:48.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.001+0000 7f683072c800 20 remove_watcher() i=1 2024-09-22T08:16:48.002 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.002+0000 7f683072c800 20 remove_watcher() i=2 2024-09-22T08:16:48.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.003+0000 7f683072c800 20 remove_watcher() i=3 2024-09-22T08:16:48.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.004+0000 7f683072c800 20 remove_watcher() i=4 2024-09-22T08:16:48.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.005+0000 7f683072c800 20 remove_watcher() i=5 2024-09-22T08:16:48.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.007+0000 7f683072c800 20 remove_watcher() i=6 2024-09-22T08:16:48.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.008+0000 7f683072c800 20 remove_watcher() i=7 2024-09-22T08:16:48.020 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-22T08:16:48.020 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:16:48.022 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-22T08:16:48.053 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:16:48.053 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:16:48.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.092+0000 7fe095813800 20 rados->read ofs=0 len=0 2024-09-22T08:16:48.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.094+0000 7fe095813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:48.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.094+0000 7fe095813800 20 realm 2024-09-22T08:16:48.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.094+0000 7fe095813800 20 rados->read ofs=0 len=0 2024-09-22T08:16:48.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.094+0000 7fe095813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:48.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.094+0000 7fe095813800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:16:48.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.094+0000 7fe095813800 20 rados->read ofs=0 len=0 2024-09-22T08:16:48.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.094+0000 7fe095813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:48.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.094+0000 7fe095813800 20 rados->read ofs=0 len=0 2024-09-22T08:16:48.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.095+0000 7fe095813800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:48.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.095+0000 7fe095813800 20 rados->read ofs=0 len=0 2024-09-22T08:16:48.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.096+0000 7fe095813800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:16:48.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.096+0000 7fe095813800 20 searching for the correct realm 2024-09-22T08:16:48.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.098+0000 7fe090791640 0 -- 172.21.15.38:0/1225594416 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7fe084017040 msgr2=0x7fe084060dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:16:48.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.304+0000 7fe090791640 0 -- 172.21.15.38:0/1225594416 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fe08007a000 msgr2=0x7fe0800799d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:16:48.513 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.512+0000 7fe095813800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:16:48.513 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.512+0000 7fe095813800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:16:48.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.512+0000 7fe095813800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:16:48.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.512+0000 7fe095813800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:16:48.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.512+0000 7fe095813800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:16:48.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.512+0000 7fe095813800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:16:48.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.512+0000 7fe095813800 20 rados->read ofs=0 len=0 2024-09-22T08:16:48.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.513+0000 7fe095813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:48.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.513+0000 7fe095813800 20 rados->read ofs=0 len=0 2024-09-22T08:16:48.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.513+0000 7fe095813800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:48.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.513+0000 7fe095813800 20 rados->read ofs=0 len=0 2024-09-22T08:16:48.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.514+0000 7fe095813800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:16:48.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.514+0000 7fe095813800 20 zone default found 2024-09-22T08:16:48.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.514+0000 7fe095813800 4 Realm: () 2024-09-22T08:16:48.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.514+0000 7fe095813800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:16:48.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.514+0000 7fe095813800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:16:48.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.514+0000 7fe095813800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:16:48.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.514+0000 7fe095813800 20 zonegroup default 2024-09-22T08:16:48.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.514+0000 7fe095813800 20 rados->read ofs=0 len=0 2024-09-22T08:16:48.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.514+0000 7fe095813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:48.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.514+0000 7fe095813800 20 rados->read ofs=0 len=0 2024-09-22T08:16:48.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.514+0000 7fe095813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:48.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.514+0000 7fe095813800 20 rados->read ofs=0 len=0 2024-09-22T08:16:48.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.515+0000 7fe095813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:48.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.515+0000 7fe095813800 20 started sync module instance, tier type = 2024-09-22T08:16:48.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.515+0000 7fe095813800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:16:48.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.528+0000 7fe095813800 20 add_watcher() i=0 2024-09-22T08:16:48.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.528+0000 7fe095813800 20 add_watcher() i=1 2024-09-22T08:16:48.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.528+0000 7fe095813800 20 add_watcher() i=2 2024-09-22T08:16:48.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.528+0000 7fe095813800 20 add_watcher() i=3 2024-09-22T08:16:48.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.528+0000 7fe095813800 20 add_watcher() i=4 2024-09-22T08:16:48.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.528+0000 7fe095813800 20 add_watcher() i=5 2024-09-22T08:16:48.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.528+0000 7fe095813800 20 add_watcher() i=6 2024-09-22T08:16:48.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.530+0000 7fe095813800 20 add_watcher() i=7 2024-09-22T08:16:48.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.530+0000 7fe095813800 2 all 8 watchers are set, enabling cache 2024-09-22T08:16:48.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.531+0000 7fdf46fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:48.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.532+0000 7fe095813800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:16:48.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.532+0000 7fe095813800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:16:48.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.532+0000 7fe095813800 5 note: GC not initialized 2024-09-22T08:16:48.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.532+0000 7fdf45fe3640 20 reqs_thread_entry: start 2024-09-22T08:16:48.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.532+0000 7fe095813800 20 init_complete bucket index max shards: 11 2024-09-22T08:16:48.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.532+0000 7fe095813800 20 Filter name: none 2024-09-22T08:16:48.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.532+0000 7fdeb77fe640 20 reqs_thread_entry: start 2024-09-22T08:16:48.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.532+0000 7fe095813800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-22T08:16:48.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.532+0000 7fe095813800 20 rados->read ofs=0 len=0 2024-09-22T08:16:48.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.533+0000 7fe095813800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:16:48.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.533+0000 7fe095813800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-22T08:16:48.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.533+0000 7fe095813800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-22T08:16:48.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.533+0000 7fe095813800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.1 : miss 2024-09-22T08:16:48.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.533+0000 7fe095813800 20 rados->read ofs=0 len=0 2024-09-22T08:16:48.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.533+0000 7fe095813800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:16:48.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.533+0000 7fe095813800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.1 info.flags=0x17 2024-09-22T08:16:48.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.533+0000 7fe095813800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.1 to cache LRU end 2024-09-22T08:16:48.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.533+0000 7fe095813800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:16:48.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.533+0000 7fe095813800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-22T08:16:48.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.534+0000 7fe095813800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.1 2024-09-22T08:16:48.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.534+0000 7fe095813800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.0 2024-09-22T08:16:48.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.534+0000 7fe095813800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-22T08:16:48.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.534+0000 7fe095813800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.1 2024-09-22T08:16:48.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.535+0000 7fe095813800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-22T08:16:48.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.535+0000 7fe095813800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.2 2024-09-22T08:16:48.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.536+0000 7fe095813800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-22T08:16:48.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.536+0000 7fe095813800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.3 2024-09-22T08:16:48.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.536+0000 7fe095813800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-22T08:16:48.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.536+0000 7fe095813800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.4 2024-09-22T08:16:48.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.537+0000 7fe095813800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-22T08:16:48.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.537+0000 7fe095813800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.5 2024-09-22T08:16:48.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.537+0000 7fe095813800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-22T08:16:48.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.537+0000 7fe095813800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.6 2024-09-22T08:16:48.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.538+0000 7fe095813800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-22T08:16:48.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.538+0000 7fe095813800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.7 2024-09-22T08:16:48.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.538+0000 7fe095813800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-22T08:16:48.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.538+0000 7fe095813800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.8 2024-09-22T08:16:48.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.539+0000 7fe095813800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-22T08:16:48.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.539+0000 7fe095813800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.9 2024-09-22T08:16:48.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.539+0000 7fe095813800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-22T08:16:48.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.539+0000 7fe095813800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.10 2024-09-22T08:16:48.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.539+0000 7fe095813800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-22T08:16:48.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.539+0000 7fe095813800 1 NOTICE: finished all shards (0 entries found) 2024-09-22T08:16:48.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.540+0000 7fdf46fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:48.544 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.543+0000 7fe095813800 20 remove_watcher() i=0 2024-09-22T08:16:48.544 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.543+0000 7fe095813800 2 removed watcher, disabling cache 2024-09-22T08:16:48.545 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.544+0000 7fe095813800 20 remove_watcher() i=1 2024-09-22T08:16:48.546 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.546+0000 7fe095813800 20 remove_watcher() i=2 2024-09-22T08:16:48.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.547+0000 7fe095813800 20 remove_watcher() i=3 2024-09-22T08:16:48.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.548+0000 7fe095813800 20 remove_watcher() i=4 2024-09-22T08:16:48.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.550+0000 7fe095813800 20 remove_watcher() i=5 2024-09-22T08:16:48.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.551+0000 7fe095813800 20 remove_watcher() i=6 2024-09-22T08:16:48.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:48.552+0000 7fe095813800 20 remove_watcher() i=7 2024-09-22T08:16:48.565 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-22T08:16:48.565 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:16:48.568 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:48.568 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:48.572 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:48.572 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:48.574 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:48.574 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:48.619 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-22T08:16:48.619 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:16:48.620 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:48.620 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:48.665 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:48.665 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:48.708 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:48.708 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:48.722 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:48.722 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:48.725 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:48.725 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:48.739 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:48.739 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:48.742 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:48.742 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:48.755 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:48.755 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:48.758 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:48.758 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:48.770 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:48.770 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:48.774 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:48.774 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:48.786 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:48.786 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:48.789 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:48.789 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:48.801 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:48.801 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:48.805 INFO:tasks.workunit.client.0.smithi038.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-22T08:16:49.224 INFO:tasks.workunit.client.0.smithi038.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-22T08:16:50.651 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:50.651 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:50.700 INFO:tasks.workunit.client.0.smithi038.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-22T08:16:50.702 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-22T08:16:50.738 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:16:50.738 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:16:50.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:50.784+0000 7ff882498800 20 rados->read ofs=0 len=0 2024-09-22T08:16:50.787 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:50.786+0000 7ff882498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:50.787 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:50.786+0000 7ff882498800 20 realm 2024-09-22T08:16:50.787 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:50.786+0000 7ff882498800 20 rados->read ofs=0 len=0 2024-09-22T08:16:50.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:50.787+0000 7ff882498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:50.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:50.787+0000 7ff882498800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:16:50.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:50.787+0000 7ff882498800 20 rados->read ofs=0 len=0 2024-09-22T08:16:50.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:50.787+0000 7ff882498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:50.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:50.787+0000 7ff882498800 20 rados->read ofs=0 len=0 2024-09-22T08:16:50.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:50.788+0000 7ff882498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:50.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:50.788+0000 7ff882498800 20 rados->read ofs=0 len=0 2024-09-22T08:16:50.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:50.788+0000 7ff882498800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:16:50.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:50.788+0000 7ff882498800 20 searching for the correct realm 2024-09-22T08:16:50.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:50.789+0000 7ff87ff82640 0 -- 172.21.15.38:0/154032096 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x55946268df80 msgr2=0x559462690440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:16:50.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:50.996+0000 7ff87ff82640 0 -- 172.21.15.38:0/154032096 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x559462681780 msgr2=0x559462683bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:16:51.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.004+0000 7ff882498800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:16:51.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.004+0000 7ff882498800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:16:51.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.004+0000 7ff882498800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:16:51.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.004+0000 7ff882498800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:16:51.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.004+0000 7ff882498800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:16:51.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.004+0000 7ff882498800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:16:51.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.004+0000 7ff882498800 20 rados->read ofs=0 len=0 2024-09-22T08:16:51.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.004+0000 7ff882498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:51.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.004+0000 7ff882498800 20 rados->read ofs=0 len=0 2024-09-22T08:16:51.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.005+0000 7ff882498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:51.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.005+0000 7ff882498800 20 rados->read ofs=0 len=0 2024-09-22T08:16:51.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.005+0000 7ff882498800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:16:51.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.005+0000 7ff882498800 20 zone default found 2024-09-22T08:16:51.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.005+0000 7ff882498800 4 Realm: () 2024-09-22T08:16:51.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.005+0000 7ff882498800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:16:51.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.005+0000 7ff882498800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:16:51.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.005+0000 7ff882498800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:16:51.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.005+0000 7ff882498800 20 zonegroup default 2024-09-22T08:16:51.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.005+0000 7ff882498800 20 rados->read ofs=0 len=0 2024-09-22T08:16:51.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.005+0000 7ff882498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:51.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.006+0000 7ff882498800 20 rados->read ofs=0 len=0 2024-09-22T08:16:51.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.006+0000 7ff882498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:51.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.006+0000 7ff882498800 20 rados->read ofs=0 len=0 2024-09-22T08:16:51.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.006+0000 7ff882498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:51.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.006+0000 7ff882498800 20 started sync module instance, tier type = 2024-09-22T08:16:51.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.006+0000 7ff882498800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:16:51.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.018+0000 7ff882498800 20 add_watcher() i=0 2024-09-22T08:16:51.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.018+0000 7ff882498800 20 add_watcher() i=1 2024-09-22T08:16:51.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.018+0000 7ff882498800 20 add_watcher() i=2 2024-09-22T08:16:51.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.018+0000 7ff882498800 20 add_watcher() i=3 2024-09-22T08:16:51.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.018+0000 7ff882498800 20 add_watcher() i=4 2024-09-22T08:16:51.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.018+0000 7ff882498800 20 add_watcher() i=5 2024-09-22T08:16:51.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.018+0000 7ff882498800 20 add_watcher() i=6 2024-09-22T08:16:51.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.019+0000 7ff882498800 20 add_watcher() i=7 2024-09-22T08:16:51.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.019+0000 7ff882498800 2 all 8 watchers are set, enabling cache 2024-09-22T08:16:51.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.021+0000 7ff735fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:51.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.022+0000 7ff882498800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:16:51.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.022+0000 7ff882498800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:16:51.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.022+0000 7ff882498800 5 note: GC not initialized 2024-09-22T08:16:51.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.022+0000 7ff734fe1640 20 reqs_thread_entry: start 2024-09-22T08:16:51.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.022+0000 7ff882498800 20 init_complete bucket index max shards: 11 2024-09-22T08:16:51.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.022+0000 7ff882498800 20 Filter name: none 2024-09-22T08:16:51.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.022+0000 7ff6ae7fc640 20 reqs_thread_entry: start 2024-09-22T08:16:51.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.022+0000 7ff882498800 20 rados->read ofs=0 len=0 2024-09-22T08:16:51.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.023+0000 7ff882498800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:16:51.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.023+0000 7ff882498800 20 rados->read ofs=0 len=0 2024-09-22T08:16:51.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.023+0000 7ff882498800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:16:51.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.023+0000 7ff882498800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:16:51.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.023+0000 7ff882498800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-22T08:16:51.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.023+0000 7ff882498800 20 INFO: main: starting shard=0 2024-09-22T08:16:51.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.023+0000 7ff882498800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.0 2024-09-22T08:16:51.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.024+0000 7ff882498800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:51.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.024+0000 7ff882498800 20 INFO: main: starting shard=1 2024-09-22T08:16:51.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.024+0000 7ff882498800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.1 2024-09-22T08:16:51.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.024+0000 7ff882498800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:51.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.024+0000 7ff882498800 20 INFO: main: starting shard=2 2024-09-22T08:16:51.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.024+0000 7ff882498800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.2 2024-09-22T08:16:51.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.025+0000 7ff882498800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:51.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.025+0000 7ff882498800 20 INFO: main: starting shard=3 2024-09-22T08:16:51.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.025+0000 7ff882498800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.3 2024-09-22T08:16:51.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.026+0000 7ff882498800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:51.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.026+0000 7ff882498800 20 INFO: main: starting shard=4 2024-09-22T08:16:51.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.026+0000 7ff882498800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.4 2024-09-22T08:16:51.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.026+0000 7ff882498800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:51.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.026+0000 7ff882498800 20 INFO: main: starting shard=5 2024-09-22T08:16:51.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.026+0000 7ff882498800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.5 2024-09-22T08:16:51.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.027+0000 7ff882498800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:51.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.027+0000 7ff882498800 20 INFO: main: starting shard=6 2024-09-22T08:16:51.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.027+0000 7ff882498800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.6 2024-09-22T08:16:51.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.027+0000 7ff882498800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:51.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.027+0000 7ff882498800 20 INFO: main: starting shard=7 2024-09-22T08:16:51.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.027+0000 7ff882498800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.7 2024-09-22T08:16:51.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.028+0000 7ff882498800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:51.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.028+0000 7ff882498800 20 INFO: main: starting shard=8 2024-09-22T08:16:51.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.028+0000 7ff882498800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.8 2024-09-22T08:16:51.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.029+0000 7ff882498800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-22T08:16:51.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.029+0000 7ff882498800 20 INFO: main: starting shard=9 2024-09-22T08:16:51.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.029+0000 7ff882498800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.9 2024-09-22T08:16:51.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.029+0000 7ff882498800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:51.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.029+0000 7ff882498800 20 INFO: main: starting shard=10 2024-09-22T08:16:51.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.029+0000 7ff882498800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.10 2024-09-22T08:16:51.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.030+0000 7ff882498800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:51.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.030+0000 7ff882498800 20 INFO: main: done 2024-09-22T08:16:51.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.031+0000 7ff735fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:51.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.034+0000 7ff882498800 20 remove_watcher() i=0 2024-09-22T08:16:51.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.034+0000 7ff882498800 2 removed watcher, disabling cache 2024-09-22T08:16:51.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.035+0000 7ff882498800 20 remove_watcher() i=1 2024-09-22T08:16:51.037 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.036+0000 7ff882498800 20 remove_watcher() i=2 2024-09-22T08:16:51.039 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.038+0000 7ff882498800 20 remove_watcher() i=3 2024-09-22T08:16:51.040 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.040+0000 7ff882498800 20 remove_watcher() i=4 2024-09-22T08:16:51.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.041+0000 7ff882498800 20 remove_watcher() i=5 2024-09-22T08:16:51.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.043+0000 7ff882498800 20 remove_watcher() i=6 2024-09-22T08:16:51.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.044+0000 7ff882498800 20 remove_watcher() i=7 2024-09-22T08:16:51.059 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:51.059 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:51.063 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:51.063 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:51.111 INFO:tasks.workunit.client.0.smithi038.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-22T08:16:51.112 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-22T08:16:51.144 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:16:51.145 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:16:51.185 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.184+0000 7f0440011800 20 rados->read ofs=0 len=0 2024-09-22T08:16:51.187 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.186+0000 7f0440011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:51.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.186+0000 7f0440011800 20 realm 2024-09-22T08:16:51.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.186+0000 7f0440011800 20 rados->read ofs=0 len=0 2024-09-22T08:16:51.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.187+0000 7f0440011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:51.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.187+0000 7f0440011800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:16:51.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.187+0000 7f0440011800 20 rados->read ofs=0 len=0 2024-09-22T08:16:51.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.187+0000 7f0440011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:51.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.187+0000 7f0440011800 20 rados->read ofs=0 len=0 2024-09-22T08:16:51.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.187+0000 7f0440011800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:51.189 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.187+0000 7f0440011800 20 rados->read ofs=0 len=0 2024-09-22T08:16:51.189 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.188+0000 7f0440011800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:16:51.189 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.188+0000 7f0440011800 20 searching for the correct realm 2024-09-22T08:16:51.191 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.190+0000 7f043af21640 0 -- 172.21.15.38:0/114393918 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f042400e070 msgr2=0x7f042406a590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:16:51.195 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.194+0000 7f043af21640 0 -- 172.21.15.38:0/114393918 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f042c049040 msgr2=0x7f042c049420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:16:51.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.402+0000 7f0440011800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:16:51.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.402+0000 7f0440011800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:16:51.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.402+0000 7f0440011800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:16:51.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.402+0000 7f0440011800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:16:51.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.402+0000 7f0440011800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:16:51.404 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.402+0000 7f0440011800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:16:51.404 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.402+0000 7f0440011800 20 rados->read ofs=0 len=0 2024-09-22T08:16:51.404 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.402+0000 7f0440011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:51.404 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.402+0000 7f0440011800 20 rados->read ofs=0 len=0 2024-09-22T08:16:51.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.403+0000 7f0440011800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:51.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.403+0000 7f0440011800 20 rados->read ofs=0 len=0 2024-09-22T08:16:51.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.403+0000 7f0440011800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:16:51.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.403+0000 7f0440011800 20 zone default found 2024-09-22T08:16:51.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.403+0000 7f0440011800 4 Realm: () 2024-09-22T08:16:51.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.403+0000 7f0440011800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:16:51.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.403+0000 7f0440011800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:16:51.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.403+0000 7f0440011800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:16:51.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.403+0000 7f0440011800 20 zonegroup default 2024-09-22T08:16:51.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.403+0000 7f0440011800 20 rados->read ofs=0 len=0 2024-09-22T08:16:51.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.404+0000 7f0440011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:51.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.404+0000 7f0440011800 20 rados->read ofs=0 len=0 2024-09-22T08:16:51.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.404+0000 7f0440011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:51.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.404+0000 7f0440011800 20 rados->read ofs=0 len=0 2024-09-22T08:16:51.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.404+0000 7f0440011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:51.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.404+0000 7f0440011800 20 started sync module instance, tier type = 2024-09-22T08:16:51.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.404+0000 7f0440011800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:16:51.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.416+0000 7f0440011800 20 add_watcher() i=0 2024-09-22T08:16:51.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.416+0000 7f0440011800 20 add_watcher() i=1 2024-09-22T08:16:51.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.416+0000 7f0440011800 20 add_watcher() i=2 2024-09-22T08:16:51.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.416+0000 7f0440011800 20 add_watcher() i=3 2024-09-22T08:16:51.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.416+0000 7f0440011800 20 add_watcher() i=4 2024-09-22T08:16:51.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.418+0000 7f0440011800 20 add_watcher() i=5 2024-09-22T08:16:51.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.418+0000 7f0440011800 20 add_watcher() i=6 2024-09-22T08:16:51.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.418+0000 7f0440011800 20 add_watcher() i=7 2024-09-22T08:16:51.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.418+0000 7f0440011800 2 all 8 watchers are set, enabling cache 2024-09-22T08:16:51.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.420+0000 7f02f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:51.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.420+0000 7f0440011800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:16:51.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.420+0000 7f0440011800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:16:51.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.420+0000 7f0440011800 5 note: GC not initialized 2024-09-22T08:16:51.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.420+0000 7f02f0fe1640 20 reqs_thread_entry: start 2024-09-22T08:16:51.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.420+0000 7f0440011800 20 init_complete bucket index max shards: 11 2024-09-22T08:16:51.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.420+0000 7f0440011800 20 Filter name: none 2024-09-22T08:16:51.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.421+0000 7f026a7fc640 20 reqs_thread_entry: start 2024-09-22T08:16:51.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.421+0000 7f0440011800 20 rados->read ofs=0 len=0 2024-09-22T08:16:51.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.421+0000 7f0440011800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:16:51.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.421+0000 7f0440011800 20 rados->read ofs=0 len=0 2024-09-22T08:16:51.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.421+0000 7f0440011800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:16:51.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.422+0000 7f0440011800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:16:51.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.422+0000 7f0440011800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-22T08:16:51.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.422+0000 7f0440011800 20 INFO: main: starting shard=0 2024-09-22T08:16:51.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.422+0000 7f0440011800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.0 2024-09-22T08:16:51.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.422+0000 7f0440011800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:51.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.422+0000 7f0440011800 20 INFO: main: starting shard=1 2024-09-22T08:16:51.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.422+0000 7f0440011800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.1 2024-09-22T08:16:51.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.423+0000 7f0440011800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:51.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.423+0000 7f0440011800 20 INFO: main: starting shard=2 2024-09-22T08:16:51.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.423+0000 7f0440011800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.2 2024-09-22T08:16:51.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.424+0000 7f0440011800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:51.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.424+0000 7f0440011800 20 INFO: main: starting shard=3 2024-09-22T08:16:51.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.424+0000 7f0440011800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.3 2024-09-22T08:16:51.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.424+0000 7f0440011800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:51.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.424+0000 7f0440011800 20 INFO: main: starting shard=4 2024-09-22T08:16:51.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.424+0000 7f0440011800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.4 2024-09-22T08:16:51.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.425+0000 7f0440011800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:51.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.425+0000 7f0440011800 20 INFO: main: starting shard=5 2024-09-22T08:16:51.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.425+0000 7f0440011800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.5 2024-09-22T08:16:51.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.426+0000 7f0440011800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-22T08:16:51.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.426+0000 7f0440011800 20 INFO: main: starting shard=6 2024-09-22T08:16:51.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.426+0000 7f0440011800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.6 2024-09-22T08:16:51.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.426+0000 7f0440011800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:51.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.426+0000 7f0440011800 20 INFO: main: starting shard=7 2024-09-22T08:16:51.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.426+0000 7f0440011800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.7 2024-09-22T08:16:51.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.427+0000 7f0440011800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:51.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.427+0000 7f0440011800 20 INFO: main: starting shard=8 2024-09-22T08:16:51.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.427+0000 7f0440011800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.8 2024-09-22T08:16:51.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.427+0000 7f0440011800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:51.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.427+0000 7f0440011800 20 INFO: main: starting shard=9 2024-09-22T08:16:51.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.427+0000 7f0440011800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.9 2024-09-22T08:16:51.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.428+0000 7f0440011800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:51.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.428+0000 7f0440011800 20 INFO: main: starting shard=10 2024-09-22T08:16:51.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.428+0000 7f0440011800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.10 2024-09-22T08:16:51.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.428+0000 7f0440011800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:51.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.428+0000 7f0440011800 20 INFO: main: done 2024-09-22T08:16:51.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.429+0000 7f02f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:51.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.432+0000 7f0440011800 20 remove_watcher() i=0 2024-09-22T08:16:51.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.432+0000 7f0440011800 2 removed watcher, disabling cache 2024-09-22T08:16:51.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.433+0000 7f0440011800 20 remove_watcher() i=1 2024-09-22T08:16:51.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.434+0000 7f0440011800 20 remove_watcher() i=2 2024-09-22T08:16:51.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.435+0000 7f0440011800 20 remove_watcher() i=3 2024-09-22T08:16:51.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.436+0000 7f0440011800 20 remove_watcher() i=4 2024-09-22T08:16:51.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.437+0000 7f0440011800 20 remove_watcher() i=5 2024-09-22T08:16:51.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.439+0000 7f0440011800 20 remove_watcher() i=6 2024-09-22T08:16:51.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.440+0000 7f0440011800 20 remove_watcher() i=7 2024-09-22T08:16:51.454 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:51.454 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:51.458 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:51.458 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:51.461 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:51.461 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:51.508 INFO:tasks.workunit.client.0.smithi038.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-22T08:16:51.509 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-22T08:16:51.542 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:16:51.543 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:16:51.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.581+0000 7f2f02132800 20 rados->read ofs=0 len=0 2024-09-22T08:16:51.585 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.583+0000 7f2f02132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:51.585 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.583+0000 7f2f02132800 20 realm 2024-09-22T08:16:51.585 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.583+0000 7f2f02132800 20 rados->read ofs=0 len=0 2024-09-22T08:16:51.585 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.584+0000 7f2f02132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:51.585 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.584+0000 7f2f02132800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:16:51.585 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.584+0000 7f2f02132800 20 rados->read ofs=0 len=0 2024-09-22T08:16:51.585 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.584+0000 7f2f02132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:51.585 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.584+0000 7f2f02132800 20 rados->read ofs=0 len=0 2024-09-22T08:16:51.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.584+0000 7f2f02132800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:51.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.584+0000 7f2f02132800 20 rados->read ofs=0 len=0 2024-09-22T08:16:51.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.585+0000 7f2f02132800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:16:51.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.585+0000 7f2f02132800 20 searching for the correct realm 2024-09-22T08:16:51.590 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.587+0000 7f2efd5bb640 0 -- 172.21.15.38:0/1817605611 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f2ee80badf0 msgr2=0x7f2ee80c7a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:16:51.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.591+0000 7f2efd5bb640 0 -- 172.21.15.38:0/1817605611 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f2ef003ab60 msgr2=0x7f2ef0097170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:16:51.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.799+0000 7f2f02132800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:16:51.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.799+0000 7f2f02132800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:16:51.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.799+0000 7f2f02132800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:16:51.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.799+0000 7f2f02132800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:16:51.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.799+0000 7f2f02132800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:16:51.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.799+0000 7f2f02132800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:16:51.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.799+0000 7f2f02132800 20 rados->read ofs=0 len=0 2024-09-22T08:16:51.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.799+0000 7f2f02132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:51.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.799+0000 7f2f02132800 20 rados->read ofs=0 len=0 2024-09-22T08:16:51.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.799+0000 7f2f02132800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:51.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.799+0000 7f2f02132800 20 rados->read ofs=0 len=0 2024-09-22T08:16:51.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.800+0000 7f2f02132800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:16:51.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.800+0000 7f2f02132800 20 zone default found 2024-09-22T08:16:51.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.800+0000 7f2f02132800 4 Realm: () 2024-09-22T08:16:51.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.800+0000 7f2f02132800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:16:51.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.800+0000 7f2f02132800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:16:51.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.800+0000 7f2f02132800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:16:51.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.800+0000 7f2f02132800 20 zonegroup default 2024-09-22T08:16:51.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.800+0000 7f2f02132800 20 rados->read ofs=0 len=0 2024-09-22T08:16:51.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.800+0000 7f2f02132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:51.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.800+0000 7f2f02132800 20 rados->read ofs=0 len=0 2024-09-22T08:16:51.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.801+0000 7f2f02132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:51.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.801+0000 7f2f02132800 20 rados->read ofs=0 len=0 2024-09-22T08:16:51.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.801+0000 7f2f02132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:51.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.801+0000 7f2f02132800 20 started sync module instance, tier type = 2024-09-22T08:16:51.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.801+0000 7f2f02132800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:16:51.816 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.816+0000 7f2f02132800 20 add_watcher() i=0 2024-09-22T08:16:51.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.816+0000 7f2f02132800 20 add_watcher() i=1 2024-09-22T08:16:51.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.816+0000 7f2f02132800 20 add_watcher() i=2 2024-09-22T08:16:51.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.816+0000 7f2f02132800 20 add_watcher() i=3 2024-09-22T08:16:51.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.816+0000 7f2f02132800 20 add_watcher() i=4 2024-09-22T08:16:51.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.816+0000 7f2f02132800 20 add_watcher() i=5 2024-09-22T08:16:51.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.816+0000 7f2f02132800 20 add_watcher() i=6 2024-09-22T08:16:51.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.817+0000 7f2f02132800 20 add_watcher() i=7 2024-09-22T08:16:51.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.817+0000 7f2f02132800 2 all 8 watchers are set, enabling cache 2024-09-22T08:16:51.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.819+0000 7f2daf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:51.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.819+0000 7f2f02132800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:16:51.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.819+0000 7f2f02132800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:16:51.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.819+0000 7f2f02132800 5 note: GC not initialized 2024-09-22T08:16:51.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.820+0000 7f2dae7fc640 20 reqs_thread_entry: start 2024-09-22T08:16:51.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.820+0000 7f2f02132800 20 init_complete bucket index max shards: 11 2024-09-22T08:16:51.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.820+0000 7f2f02132800 20 Filter name: none 2024-09-22T08:16:51.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.820+0000 7f2d1ffff640 20 reqs_thread_entry: start 2024-09-22T08:16:51.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.820+0000 7f2f02132800 20 rados->read ofs=0 len=0 2024-09-22T08:16:51.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.820+0000 7f2f02132800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:16:51.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.820+0000 7f2f02132800 20 rados->read ofs=0 len=0 2024-09-22T08:16:51.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.821+0000 7f2f02132800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:16:51.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.821+0000 7f2f02132800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:16:51.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.821+0000 7f2f02132800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-22T08:16:51.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.821+0000 7f2f02132800 20 INFO: main: starting shard=0 2024-09-22T08:16:51.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.821+0000 7f2f02132800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.0 2024-09-22T08:16:51.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.822+0000 7f2f02132800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:51.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.822+0000 7f2f02132800 20 INFO: main: starting shard=1 2024-09-22T08:16:51.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.822+0000 7f2f02132800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.1 2024-09-22T08:16:51.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.822+0000 7f2f02132800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-22T08:16:51.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.823+0000 7f2f02132800 20 INFO: main: starting shard=2 2024-09-22T08:16:51.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.823+0000 7f2f02132800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.2 2024-09-22T08:16:51.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.823+0000 7f2f02132800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:51.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.823+0000 7f2f02132800 20 INFO: main: starting shard=3 2024-09-22T08:16:51.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.823+0000 7f2f02132800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.3 2024-09-22T08:16:51.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.824+0000 7f2f02132800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:51.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.824+0000 7f2f02132800 20 INFO: main: starting shard=4 2024-09-22T08:16:51.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.824+0000 7f2f02132800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.4 2024-09-22T08:16:51.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.824+0000 7f2f02132800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:51.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.824+0000 7f2f02132800 20 INFO: main: starting shard=5 2024-09-22T08:16:51.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.824+0000 7f2f02132800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.5 2024-09-22T08:16:51.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.825+0000 7f2f02132800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:51.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.825+0000 7f2f02132800 20 INFO: main: starting shard=6 2024-09-22T08:16:51.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.825+0000 7f2f02132800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.6 2024-09-22T08:16:51.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.825+0000 7f2f02132800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:51.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.825+0000 7f2f02132800 20 INFO: main: starting shard=7 2024-09-22T08:16:51.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.825+0000 7f2f02132800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.7 2024-09-22T08:16:51.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.826+0000 7f2f02132800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:51.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.826+0000 7f2f02132800 20 INFO: main: starting shard=8 2024-09-22T08:16:51.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.826+0000 7f2f02132800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.8 2024-09-22T08:16:51.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.826+0000 7f2f02132800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:51.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.826+0000 7f2f02132800 20 INFO: main: starting shard=9 2024-09-22T08:16:51.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.826+0000 7f2f02132800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.9 2024-09-22T08:16:51.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.827+0000 7f2f02132800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:51.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.827+0000 7f2f02132800 20 INFO: main: starting shard=10 2024-09-22T08:16:51.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.827+0000 7f2f02132800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.10 2024-09-22T08:16:51.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.827+0000 7f2f02132800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:51.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.827+0000 7f2f02132800 20 INFO: main: done 2024-09-22T08:16:51.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.828+0000 7f2daf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:51.832 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.831+0000 7f2f02132800 20 remove_watcher() i=0 2024-09-22T08:16:51.832 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.831+0000 7f2f02132800 2 removed watcher, disabling cache 2024-09-22T08:16:51.833 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.832+0000 7f2f02132800 20 remove_watcher() i=1 2024-09-22T08:16:51.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.833+0000 7f2f02132800 20 remove_watcher() i=2 2024-09-22T08:16:51.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.834+0000 7f2f02132800 20 remove_watcher() i=3 2024-09-22T08:16:51.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.835+0000 7f2f02132800 20 remove_watcher() i=4 2024-09-22T08:16:51.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.837+0000 7f2f02132800 20 remove_watcher() i=5 2024-09-22T08:16:51.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.838+0000 7f2f02132800 20 remove_watcher() i=6 2024-09-22T08:16:51.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.839+0000 7f2f02132800 20 remove_watcher() i=7 2024-09-22T08:16:51.853 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:51.854 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:51.858 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:51.858 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:51.905 INFO:tasks.workunit.client.0.smithi038.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-22T08:16:51.906 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-22T08:16:51.940 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:16:51.940 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:16:51.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.978+0000 7fcff0340800 20 rados->read ofs=0 len=0 2024-09-22T08:16:51.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.980+0000 7fcff0340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:51.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.980+0000 7fcff0340800 20 realm 2024-09-22T08:16:51.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.980+0000 7fcff0340800 20 rados->read ofs=0 len=0 2024-09-22T08:16:51.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.980+0000 7fcff0340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:51.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.980+0000 7fcff0340800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:16:51.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.980+0000 7fcff0340800 20 rados->read ofs=0 len=0 2024-09-22T08:16:51.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.980+0000 7fcff0340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:51.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.980+0000 7fcff0340800 20 rados->read ofs=0 len=0 2024-09-22T08:16:51.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.981+0000 7fcff0340800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:51.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.981+0000 7fcff0340800 20 rados->read ofs=0 len=0 2024-09-22T08:16:51.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.982+0000 7fcff0340800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:16:51.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.982+0000 7fcff0340800 20 searching for the correct realm 2024-09-22T08:16:51.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:51.985+0000 7fcfec8c1640 0 -- 172.21.15.38:0/3232025925 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7fcfdc070c20 msgr2=0x7fcfdc064960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:16:52.191 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.191+0000 7fcfec0c0640 0 -- 172.21.15.38:0/3232025925 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x561bb6b07bf0 msgr2=0x561bb6b09fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:16:52.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.196+0000 7fcff0340800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:16:52.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.196+0000 7fcff0340800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:16:52.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.196+0000 7fcff0340800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:16:52.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.196+0000 7fcff0340800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:16:52.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.196+0000 7fcff0340800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:16:52.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.196+0000 7fcff0340800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:16:52.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.196+0000 7fcff0340800 20 rados->read ofs=0 len=0 2024-09-22T08:16:52.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.196+0000 7fcff0340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:52.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.196+0000 7fcff0340800 20 rados->read ofs=0 len=0 2024-09-22T08:16:52.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.196+0000 7fcff0340800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:52.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.196+0000 7fcff0340800 20 rados->read ofs=0 len=0 2024-09-22T08:16:52.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.197+0000 7fcff0340800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:16:52.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.197+0000 7fcff0340800 20 zone default found 2024-09-22T08:16:52.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.197+0000 7fcff0340800 4 Realm: () 2024-09-22T08:16:52.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.197+0000 7fcff0340800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:16:52.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.197+0000 7fcff0340800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:16:52.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.197+0000 7fcff0340800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:16:52.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.197+0000 7fcff0340800 20 zonegroup default 2024-09-22T08:16:52.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.197+0000 7fcff0340800 20 rados->read ofs=0 len=0 2024-09-22T08:16:52.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.197+0000 7fcff0340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:52.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.197+0000 7fcff0340800 20 rados->read ofs=0 len=0 2024-09-22T08:16:52.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.197+0000 7fcff0340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:52.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.197+0000 7fcff0340800 20 rados->read ofs=0 len=0 2024-09-22T08:16:52.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.198+0000 7fcff0340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:52.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.198+0000 7fcff0340800 20 started sync module instance, tier type = 2024-09-22T08:16:52.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.198+0000 7fcff0340800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:16:52.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.209+0000 7fcff0340800 20 add_watcher() i=0 2024-09-22T08:16:52.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.209+0000 7fcff0340800 20 add_watcher() i=1 2024-09-22T08:16:52.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.209+0000 7fcff0340800 20 add_watcher() i=2 2024-09-22T08:16:52.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.209+0000 7fcff0340800 20 add_watcher() i=3 2024-09-22T08:16:52.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.209+0000 7fcff0340800 20 add_watcher() i=4 2024-09-22T08:16:52.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.209+0000 7fcff0340800 20 add_watcher() i=5 2024-09-22T08:16:52.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.209+0000 7fcff0340800 20 add_watcher() i=6 2024-09-22T08:16:52.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.211+0000 7fcff0340800 20 add_watcher() i=7 2024-09-22T08:16:52.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.211+0000 7fcff0340800 2 all 8 watchers are set, enabling cache 2024-09-22T08:16:52.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.213+0000 7fcea2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:52.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.213+0000 7fcff0340800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:16:52.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.213+0000 7fcff0340800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:16:52.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.213+0000 7fcff0340800 5 note: GC not initialized 2024-09-22T08:16:52.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.213+0000 7fcea1fdb640 20 reqs_thread_entry: start 2024-09-22T08:16:52.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.213+0000 7fcff0340800 20 init_complete bucket index max shards: 11 2024-09-22T08:16:52.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.213+0000 7fcff0340800 20 Filter name: none 2024-09-22T08:16:52.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.213+0000 7fce137fe640 20 reqs_thread_entry: start 2024-09-22T08:16:52.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.213+0000 7fcff0340800 20 rados->read ofs=0 len=0 2024-09-22T08:16:52.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.214+0000 7fcff0340800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:16:52.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.214+0000 7fcff0340800 20 rados->read ofs=0 len=0 2024-09-22T08:16:52.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.214+0000 7fcff0340800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:16:52.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.214+0000 7fcff0340800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:16:52.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.214+0000 7fcff0340800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-22T08:16:52.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.214+0000 7fcff0340800 20 INFO: main: starting shard=0 2024-09-22T08:16:52.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.214+0000 7fcff0340800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.0 2024-09-22T08:16:52.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.215+0000 7fcff0340800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:52.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.215+0000 7fcff0340800 20 INFO: main: starting shard=1 2024-09-22T08:16:52.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.215+0000 7fcff0340800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.1 2024-09-22T08:16:52.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.216+0000 7fcff0340800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:52.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.216+0000 7fcff0340800 20 INFO: main: starting shard=2 2024-09-22T08:16:52.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.216+0000 7fcff0340800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.2 2024-09-22T08:16:52.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.216+0000 7fcff0340800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:52.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.216+0000 7fcff0340800 20 INFO: main: starting shard=3 2024-09-22T08:16:52.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.216+0000 7fcff0340800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.3 2024-09-22T08:16:52.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.217+0000 7fcff0340800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:52.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.217+0000 7fcff0340800 20 INFO: main: starting shard=4 2024-09-22T08:16:52.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.217+0000 7fcff0340800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.4 2024-09-22T08:16:52.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.217+0000 7fcff0340800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:52.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.217+0000 7fcff0340800 20 INFO: main: starting shard=5 2024-09-22T08:16:52.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.217+0000 7fcff0340800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.5 2024-09-22T08:16:52.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.218+0000 7fcff0340800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:52.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.218+0000 7fcff0340800 20 INFO: main: starting shard=6 2024-09-22T08:16:52.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.218+0000 7fcff0340800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.6 2024-09-22T08:16:52.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.218+0000 7fcff0340800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:52.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.218+0000 7fcff0340800 20 INFO: main: starting shard=7 2024-09-22T08:16:52.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.218+0000 7fcff0340800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.7 2024-09-22T08:16:52.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.219+0000 7fcff0340800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:52.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.219+0000 7fcff0340800 20 INFO: main: starting shard=8 2024-09-22T08:16:52.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.219+0000 7fcff0340800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.8 2024-09-22T08:16:52.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.219+0000 7fcff0340800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:52.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.219+0000 7fcff0340800 20 INFO: main: starting shard=9 2024-09-22T08:16:52.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.219+0000 7fcff0340800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.9 2024-09-22T08:16:52.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.219+0000 7fcff0340800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:16:52.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.219+0000 7fcff0340800 20 INFO: main: starting shard=10 2024-09-22T08:16:52.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.219+0000 7fcff0340800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.10 2024-09-22T08:16:52.221 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.220+0000 7fcff0340800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-22T08:16:52.221 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.220+0000 7fcff0340800 20 INFO: main: done 2024-09-22T08:16:52.221 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.221+0000 7fcea2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:52.224 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.223+0000 7fcff0340800 20 remove_watcher() i=0 2024-09-22T08:16:52.224 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.223+0000 7fcff0340800 2 removed watcher, disabling cache 2024-09-22T08:16:52.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.224+0000 7fcff0340800 20 remove_watcher() i=1 2024-09-22T08:16:52.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.226+0000 7fcff0340800 20 remove_watcher() i=2 2024-09-22T08:16:52.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.227+0000 7fcff0340800 20 remove_watcher() i=3 2024-09-22T08:16:52.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.228+0000 7fcff0340800 20 remove_watcher() i=4 2024-09-22T08:16:52.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.229+0000 7fcff0340800 20 remove_watcher() i=5 2024-09-22T08:16:52.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.230+0000 7fcff0340800 20 remove_watcher() i=6 2024-09-22T08:16:52.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:52.232+0000 7fcff0340800 20 remove_watcher() i=7 2024-09-22T08:16:52.246 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:52.246 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:52.250 INFO:tasks.workunit.client.0.smithi038.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-22T08:16:52.673 INFO:tasks.workunit.client.0.smithi038.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-22T08:16:53.088 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-22T08:16:53.118 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:16:53.118 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:16:53.160 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.159+0000 7fbd99536800 20 rados->read ofs=0 len=0 2024-09-22T08:16:53.162 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.161+0000 7fbd99536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:53.162 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.161+0000 7fbd99536800 20 realm 2024-09-22T08:16:53.162 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.161+0000 7fbd99536800 20 rados->read ofs=0 len=0 2024-09-22T08:16:53.162 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.161+0000 7fbd99536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:53.162 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.161+0000 7fbd99536800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:16:53.162 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.161+0000 7fbd99536800 20 rados->read ofs=0 len=0 2024-09-22T08:16:53.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.161+0000 7fbd99536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:53.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.161+0000 7fbd99536800 20 rados->read ofs=0 len=0 2024-09-22T08:16:53.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.162+0000 7fbd99536800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:53.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.162+0000 7fbd99536800 20 rados->read ofs=0 len=0 2024-09-22T08:16:53.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.163+0000 7fbd99536800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:16:53.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.163+0000 7fbd99536800 20 searching for the correct realm 2024-09-22T08:16:53.167 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.166+0000 7fbd95ab8640 0 -- 172.21.15.38:0/436880645 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7fbd880632b0 msgr2=0x7fbd88061d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:16:53.373 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.372+0000 7fbd952b7640 0 -- 172.21.15.38:0/436880645 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x5589b2f5b4c0 msgr2=0x5589b2f5d8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:16:53.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.377+0000 7fbd99536800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:16:53.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.377+0000 7fbd99536800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:16:53.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.377+0000 7fbd99536800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:16:53.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.377+0000 7fbd99536800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:16:53.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.377+0000 7fbd99536800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:16:53.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.377+0000 7fbd99536800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:16:53.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.377+0000 7fbd99536800 20 rados->read ofs=0 len=0 2024-09-22T08:16:53.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.377+0000 7fbd99536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:53.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.377+0000 7fbd99536800 20 rados->read ofs=0 len=0 2024-09-22T08:16:53.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.378+0000 7fbd99536800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:53.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.378+0000 7fbd99536800 20 rados->read ofs=0 len=0 2024-09-22T08:16:53.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.378+0000 7fbd99536800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:16:53.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.378+0000 7fbd99536800 20 zone default found 2024-09-22T08:16:53.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.378+0000 7fbd99536800 4 Realm: () 2024-09-22T08:16:53.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.378+0000 7fbd99536800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:16:53.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.378+0000 7fbd99536800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:16:53.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.378+0000 7fbd99536800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:16:53.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.378+0000 7fbd99536800 20 zonegroup default 2024-09-22T08:16:53.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.378+0000 7fbd99536800 20 rados->read ofs=0 len=0 2024-09-22T08:16:53.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.378+0000 7fbd99536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:53.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.379+0000 7fbd99536800 20 rados->read ofs=0 len=0 2024-09-22T08:16:53.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.379+0000 7fbd99536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:53.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.379+0000 7fbd99536800 20 rados->read ofs=0 len=0 2024-09-22T08:16:53.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.379+0000 7fbd99536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:53.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.379+0000 7fbd99536800 20 started sync module instance, tier type = 2024-09-22T08:16:53.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.379+0000 7fbd99536800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:16:53.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.390+0000 7fbd99536800 20 add_watcher() i=0 2024-09-22T08:16:53.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.390+0000 7fbd99536800 20 add_watcher() i=1 2024-09-22T08:16:53.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.390+0000 7fbd99536800 20 add_watcher() i=2 2024-09-22T08:16:53.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.390+0000 7fbd99536800 20 add_watcher() i=3 2024-09-22T08:16:53.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.390+0000 7fbd99536800 20 add_watcher() i=4 2024-09-22T08:16:53.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.390+0000 7fbd99536800 20 add_watcher() i=5 2024-09-22T08:16:53.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.390+0000 7fbd99536800 20 add_watcher() i=6 2024-09-22T08:16:53.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.391+0000 7fbd99536800 20 add_watcher() i=7 2024-09-22T08:16:53.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.391+0000 7fbd99536800 2 all 8 watchers are set, enabling cache 2024-09-22T08:16:53.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.393+0000 7fbc4b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:53.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.394+0000 7fbd99536800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:16:53.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.394+0000 7fbd99536800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:16:53.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.394+0000 7fbd99536800 5 note: GC not initialized 2024-09-22T08:16:53.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.394+0000 7fbc4a7e4640 20 reqs_thread_entry: start 2024-09-22T08:16:53.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.394+0000 7fbd99536800 20 init_complete bucket index max shards: 11 2024-09-22T08:16:53.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.394+0000 7fbd99536800 20 Filter name: none 2024-09-22T08:16:53.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.394+0000 7fbbbbfff640 20 reqs_thread_entry: start 2024-09-22T08:16:53.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.394+0000 7fbd99536800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-22T08:16:53.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.394+0000 7fbd99536800 20 rados->read ofs=0 len=0 2024-09-22T08:16:53.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.395+0000 7fbd99536800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:16:53.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.395+0000 7fbd99536800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-22T08:16:53.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.395+0000 7fbd99536800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-22T08:16:53.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.395+0000 7fbd99536800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.1 : miss 2024-09-22T08:16:53.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.395+0000 7fbd99536800 20 rados->read ofs=0 len=0 2024-09-22T08:16:53.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.395+0000 7fbd99536800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:16:53.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.395+0000 7fbd99536800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.1 info.flags=0x17 2024-09-22T08:16:53.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.395+0000 7fbd99536800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.1 to cache LRU end 2024-09-22T08:16:53.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.395+0000 7fbd99536800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:16:53.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.395+0000 7fbd99536800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-22T08:16:53.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.395+0000 7fbd99536800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.1 2024-09-22T08:16:53.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.396+0000 7fbd99536800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.0 2024-09-22T08:16:53.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.397+0000 7fbd99536800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.1 2024-09-22T08:16:53.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.397+0000 7fbd99536800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.2 2024-09-22T08:16:53.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.398+0000 7fbd99536800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.3 2024-09-22T08:16:53.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.399+0000 7fbd99536800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.4 2024-09-22T08:16:53.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.399+0000 7fbd99536800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.5 2024-09-22T08:16:53.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.400+0000 7fbd99536800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.6 2024-09-22T08:16:53.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.400+0000 7fbd99536800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.7 2024-09-22T08:16:53.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.401+0000 7fbd99536800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.8 2024-09-22T08:16:53.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.401+0000 7fbd99536800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.9 2024-09-22T08:16:53.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.402+0000 7fbd99536800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.10 2024-09-22T08:16:53.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.408+0000 7fbc4b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:53.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.411+0000 7fbd99536800 20 remove_watcher() i=0 2024-09-22T08:16:53.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.411+0000 7fbd99536800 2 removed watcher, disabling cache 2024-09-22T08:16:53.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.412+0000 7fbd99536800 20 remove_watcher() i=1 2024-09-22T08:16:53.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.413+0000 7fbd99536800 20 remove_watcher() i=2 2024-09-22T08:16:53.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.414+0000 7fbd99536800 20 remove_watcher() i=3 2024-09-22T08:16:53.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.415+0000 7fbd99536800 20 remove_watcher() i=4 2024-09-22T08:16:53.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.417+0000 7fbd99536800 20 remove_watcher() i=5 2024-09-22T08:16:53.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.418+0000 7fbd99536800 20 remove_watcher() i=6 2024-09-22T08:16:53.420 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.419+0000 7fbd99536800 20 remove_watcher() i=7 2024-09-22T08:16:53.433 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-22T08:16:53.469 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:16:53.469 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:16:53.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.508+0000 7fa8add25800 20 rados->read ofs=0 len=0 2024-09-22T08:16:53.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.510+0000 7fa8add25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:53.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.510+0000 7fa8add25800 20 realm 2024-09-22T08:16:53.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.510+0000 7fa8add25800 20 rados->read ofs=0 len=0 2024-09-22T08:16:53.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.511+0000 7fa8add25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:53.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.511+0000 7fa8add25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:16:53.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.511+0000 7fa8add25800 20 rados->read ofs=0 len=0 2024-09-22T08:16:53.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.511+0000 7fa8add25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:53.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.511+0000 7fa8add25800 20 rados->read ofs=0 len=0 2024-09-22T08:16:53.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.512+0000 7fa8add25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:53.513 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.512+0000 7fa8add25800 20 rados->read ofs=0 len=0 2024-09-22T08:16:53.513 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.512+0000 7fa8add25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:16:53.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.512+0000 7fa8add25800 20 searching for the correct realm 2024-09-22T08:16:53.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.513+0000 7fa8a99b5640 0 -- 172.21.15.38:0/3863740204 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x55a1c23cec80 msgr2=0x55a1c23d1140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:16:53.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.720+0000 7fa8aa1b6640 0 -- 172.21.15.38:0/3863740204 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x55a1c23c24b0 msgr2=0x55a1c23c4970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:16:53.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.728+0000 7fa8add25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:16:53.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.728+0000 7fa8add25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:16:53.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.728+0000 7fa8add25800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:16:53.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.728+0000 7fa8add25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:16:53.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.728+0000 7fa8add25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:16:53.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.728+0000 7fa8add25800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:16:53.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.728+0000 7fa8add25800 20 rados->read ofs=0 len=0 2024-09-22T08:16:53.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.728+0000 7fa8add25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:53.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.728+0000 7fa8add25800 20 rados->read ofs=0 len=0 2024-09-22T08:16:53.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.729+0000 7fa8add25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:53.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.729+0000 7fa8add25800 20 rados->read ofs=0 len=0 2024-09-22T08:16:53.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.729+0000 7fa8add25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:16:53.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.729+0000 7fa8add25800 20 zone default found 2024-09-22T08:16:53.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.729+0000 7fa8add25800 4 Realm: () 2024-09-22T08:16:53.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.729+0000 7fa8add25800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:16:53.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.729+0000 7fa8add25800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:16:53.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.729+0000 7fa8add25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:16:53.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.729+0000 7fa8add25800 20 zonegroup default 2024-09-22T08:16:53.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.729+0000 7fa8add25800 20 rados->read ofs=0 len=0 2024-09-22T08:16:53.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.729+0000 7fa8add25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:53.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.729+0000 7fa8add25800 20 rados->read ofs=0 len=0 2024-09-22T08:16:53.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.730+0000 7fa8add25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:53.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.730+0000 7fa8add25800 20 rados->read ofs=0 len=0 2024-09-22T08:16:53.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.730+0000 7fa8add25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:53.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.730+0000 7fa8add25800 20 started sync module instance, tier type = 2024-09-22T08:16:53.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.730+0000 7fa8add25800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:16:53.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.741+0000 7fa8add25800 20 add_watcher() i=0 2024-09-22T08:16:53.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.741+0000 7fa8add25800 20 add_watcher() i=1 2024-09-22T08:16:53.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.741+0000 7fa8add25800 20 add_watcher() i=2 2024-09-22T08:16:53.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.741+0000 7fa8add25800 20 add_watcher() i=3 2024-09-22T08:16:53.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.741+0000 7fa8add25800 20 add_watcher() i=4 2024-09-22T08:16:53.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.741+0000 7fa8add25800 20 add_watcher() i=5 2024-09-22T08:16:53.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.741+0000 7fa8add25800 20 add_watcher() i=6 2024-09-22T08:16:53.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.742+0000 7fa8add25800 20 add_watcher() i=7 2024-09-22T08:16:53.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.742+0000 7fa8add25800 2 all 8 watchers are set, enabling cache 2024-09-22T08:16:53.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.745+0000 7fa75b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:53.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.745+0000 7fa8add25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:16:53.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.745+0000 7fa8add25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:16:53.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.745+0000 7fa8add25800 5 note: GC not initialized 2024-09-22T08:16:53.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.745+0000 7fa75a7fc640 20 reqs_thread_entry: start 2024-09-22T08:16:53.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.745+0000 7fa8add25800 20 init_complete bucket index max shards: 11 2024-09-22T08:16:53.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.746+0000 7fa8add25800 20 Filter name: none 2024-09-22T08:16:53.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.746+0000 7fa6cbfff640 20 reqs_thread_entry: start 2024-09-22T08:16:53.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.746+0000 7fa8add25800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-22T08:16:53.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.746+0000 7fa8add25800 20 rados->read ofs=0 len=0 2024-09-22T08:16:53.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.746+0000 7fa8add25800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:16:53.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.746+0000 7fa8add25800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-22T08:16:53.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.746+0000 7fa8add25800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-22T08:16:53.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.746+0000 7fa8add25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.1 : miss 2024-09-22T08:16:53.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.746+0000 7fa8add25800 20 rados->read ofs=0 len=0 2024-09-22T08:16:53.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.747+0000 7fa8add25800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:16:53.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.747+0000 7fa8add25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.1 info.flags=0x17 2024-09-22T08:16:53.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.747+0000 7fa8add25800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.1 to cache LRU end 2024-09-22T08:16:53.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.747+0000 7fa8add25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:16:53.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.747+0000 7fa8add25800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-22T08:16:53.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.747+0000 7fa8add25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.1 2024-09-22T08:16:53.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.747+0000 7fa8add25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.0 2024-09-22T08:16:53.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.748+0000 7fa8add25800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-22T08:16:53.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.748+0000 7fa8add25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.1 2024-09-22T08:16:53.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.748+0000 7fa8add25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.2 2024-09-22T08:16:53.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.749+0000 7fa8add25800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-22T08:16:53.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.749+0000 7fa8add25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.3 2024-09-22T08:16:53.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.749+0000 7fa8add25800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-22T08:16:53.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.749+0000 7fa8add25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.4 2024-09-22T08:16:53.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.750+0000 7fa8add25800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-22T08:16:53.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.750+0000 7fa8add25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.5 2024-09-22T08:16:53.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.750+0000 7fa8add25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.6 2024-09-22T08:16:53.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.751+0000 7fa8add25800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-22T08:16:53.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.751+0000 7fa8add25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.7 2024-09-22T08:16:53.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.751+0000 7fa8add25800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-22T08:16:53.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.751+0000 7fa8add25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.8 2024-09-22T08:16:53.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.752+0000 7fa8add25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.9 2024-09-22T08:16:53.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.752+0000 7fa8add25800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-22T08:16:53.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.752+0000 7fa8add25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.10 2024-09-22T08:16:53.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.753+0000 7fa8add25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.1 2024-09-22T08:16:53.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.753+0000 7fa8add25800 20 get_obj_state: octx=0x55a1c21350f0 obj=check-bucket:e state=0x55a1c24025c8 s->prefetch_data=0 2024-09-22T08:16:53.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.753+0000 7fa8add25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.5 2024-09-22T08:16:53.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.754+0000 7fa8add25800 20 get_obj_state: octx=0x55a1c215cee0 obj=check-bucket:d state=0x55a1c23ff728 s->prefetch_data=0 2024-09-22T08:16:53.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.754+0000 7fa8add25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.8 2024-09-22T08:16:53.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.754+0000 7fa8add25800 20 get_obj_state: octx=0x55a1c2400490 obj=check-bucket:c state=0x55a1c23fc858 s->prefetch_data=0 2024-09-22T08:16:53.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.754+0000 7fa8add25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.10 2024-09-22T08:16:53.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.754+0000 7fa8add25800 20 get_obj_state: octx=0x55a1c23fd5c0 obj=check-bucket:f state=0x55a1c249ec68 s->prefetch_data=0 2024-09-22T08:16:53.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.754+0000 7fa8add25800 20 get_obj_state: setting s->obj_tag to tmtffo6mwdm2ahq1i0li6b09160ixnfa 2024-09-22T08:16:53.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.754+0000 7fa8add25800 20 get_obj_state_impl: setting s->olh_tag to zrxshtkwi5k1o74m4ds6lvmm3qvho16u 2024-09-22T08:16:53.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.755+0000 7fa8add25800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=zrxshtkwi5k1o74m4ds6lvmm3qvho16u 2024-09-22T08:16:53.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.755+0000 7fa8add25800 20 get_obj_state: setting s->obj_tag to xk48b9ctayz0b2fdevusahc5ztxnrgfg 2024-09-22T08:16:53.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.755+0000 7fa8add25800 20 get_obj_state_impl: setting s->olh_tag to wbbpod2t3vyisbgiw12hfkshuwdzwza0 2024-09-22T08:16:53.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.755+0000 7fa8add25800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=wbbpod2t3vyisbgiw12hfkshuwdzwza0 2024-09-22T08:16:53.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.755+0000 7fa8add25800 20 get_obj_state: setting s->obj_tag to iaekemiqa2tlu5ozb41f8exfploabzw3 2024-09-22T08:16:53.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.755+0000 7fa8add25800 20 get_obj_state_impl: setting s->olh_tag to 7m9gavq57s7p4eaf68552o5xob6qe1cg 2024-09-22T08:16:53.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.755+0000 7fa8add25800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7m9gavq57s7p4eaf68552o5xob6qe1cg 2024-09-22T08:16:53.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.755+0000 7fa8add25800 20 get_obj_state: setting s->obj_tag to b16kk14ihutstmty432k5ffx706ny5re 2024-09-22T08:16:53.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.755+0000 7fa8add25800 20 get_obj_state_impl: setting s->olh_tag to jbrhaghqiy6oa3sn77xsvemlakr7ksur 2024-09-22T08:16:53.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.755+0000 7fa8add25800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=jbrhaghqiy6oa3sn77xsvemlakr7ksur 2024-09-22T08:16:53.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.756+0000 7fa8add25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.5 2024-09-22T08:16:53.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.756+0000 7fa8add25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.1 2024-09-22T08:16:53.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.756+0000 7fa8add25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.8 2024-09-22T08:16:53.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.757+0000 7fa8add25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.10 2024-09-22T08:16:53.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.758+0000 7fa8add25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.5 2024-09-22T08:16:53.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.758+0000 7fa8add25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.1 2024-09-22T08:16:53.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.758+0000 7fa8add25800 20 olh_log_entry: epoch=3 op=3 key=d[wfhqh9yW29BkseJi7uCCLJfHEmSBuyT] 2024-09-22T08:16:53.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.758+0000 7fa8add25800 20 get_obj_state: octx=0x55a1c215cee0 obj=check-bucket:_:wfhqh9yW29BkseJi7uCCLJfHEmSBuyT_d state=0x55a1c24a5a08 s->prefetch_data=0 2024-09-22T08:16:53.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.758+0000 7fa8add25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.8 2024-09-22T08:16:53.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.758+0000 7fa8add25800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-22T08:16:53.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.758+0000 7fa8add25800 20 olh_log_entry: epoch=2 op=3 key=e[GohL912-tjAr3lO8QUMRkL8XkOs07N2] 2024-09-22T08:16:53.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.758+0000 7fa8add25800 20 get_obj_state: octx=0x55a1c21350f0 obj=check-bucket:_:GohL912-tjAr3lO8QUMRkL8XkOs07N2_e state=0x55a1c24bb6e8 s->prefetch_data=0 2024-09-22T08:16:53.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.758+0000 7fa8add25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.10 2024-09-22T08:16:53.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.758+0000 7fa8add25800 20 olh_log_entry: epoch=3 op=3 key=c[hKacOdZL8pCJkCDAEPnN70oswBHP4Xz] 2024-09-22T08:16:53.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.758+0000 7fa8add25800 20 get_obj_state: octx=0x55a1c2400490 obj=check-bucket:_:hKacOdZL8pCJkCDAEPnN70oswBHP4Xz_c state=0x55a1c24b4558 s->prefetch_data=0 2024-09-22T08:16:53.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.758+0000 7fa8add25800 10 manifest: total_size = 9 2024-09-22T08:16:53.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.758+0000 7fa8add25800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.5138525862092870454 2024-09-22T08:16:53.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.758+0000 7fa8add25800 20 get_obj_state: octx=0x55a1c215cee0 obj=check-bucket:_:wfhqh9yW29BkseJi7uCCLJfHEmSBuyT_d state=0x55a1c24a5a08 s->prefetch_data=0 2024-09-22T08:16:53.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.758+0000 7fa8add25800 20 prepare_atomic_modification: state is not atomic. state=0x55a1c24a5a08 2024-09-22T08:16:53.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.758+0000 7fa8add25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.5 2024-09-22T08:16:53.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.759+0000 7fa8add25800 10 manifest: total_size = 22 2024-09-22T08:16:53.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.759+0000 7fa8add25800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.16990941958684509829 2024-09-22T08:16:53.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.759+0000 7fa8add25800 20 get_obj_state: octx=0x55a1c21350f0 obj=check-bucket:_:GohL912-tjAr3lO8QUMRkL8XkOs07N2_e state=0x55a1c24bb6e8 s->prefetch_data=0 2024-09-22T08:16:53.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.759+0000 7fa8add25800 20 prepare_atomic_modification: state is not atomic. state=0x55a1c24bb6e8 2024-09-22T08:16:53.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.759+0000 7fa8add25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.1 2024-09-22T08:16:53.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.759+0000 7fa8add25800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-22T08:16:53.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.759+0000 7fa8add25800 20 olh_log_entry: epoch=2 op=3 key=f[hGZ6Mio6lEAYtGjrGsPI36Mjg.4Y3Hz] 2024-09-22T08:16:53.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.759+0000 7fa8add25800 20 get_obj_state: octx=0x55a1c23fd5c0 obj=check-bucket:_:hGZ6Mio6lEAYtGjrGsPI36Mjg.4Y3Hz_f state=0x55a1c24cf258 s->prefetch_data=0 2024-09-22T08:16:53.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.759+0000 7fa8add25800 10 manifest: total_size = 22 2024-09-22T08:16:53.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.759+0000 7fa8add25800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.12998446418811328730 2024-09-22T08:16:53.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.759+0000 7fa8add25800 20 get_obj_state: octx=0x55a1c2400490 obj=check-bucket:_:hKacOdZL8pCJkCDAEPnN70oswBHP4Xz_c state=0x55a1c24b4558 s->prefetch_data=0 2024-09-22T08:16:53.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.759+0000 7fa8add25800 20 prepare_atomic_modification: state is not atomic. state=0x55a1c24b4558 2024-09-22T08:16:53.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.759+0000 7fa8add25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.8 2024-09-22T08:16:53.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.759+0000 7fa8add25800 10 manifest: total_size = 22 2024-09-22T08:16:53.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.759+0000 7fa8add25800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.1761842542041108364 2024-09-22T08:16:53.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.759+0000 7fa8add25800 20 get_obj_state: octx=0x55a1c23fd5c0 obj=check-bucket:_:hGZ6Mio6lEAYtGjrGsPI36Mjg.4Y3Hz_f state=0x55a1c24cf258 s->prefetch_data=0 2024-09-22T08:16:53.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.759+0000 7fa8add25800 20 prepare_atomic_modification: state is not atomic. state=0x55a1c24cf258 2024-09-22T08:16:53.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.759+0000 7fa8add25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.10 2024-09-22T08:16:53.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.763+0000 7fa78cff9640 20 handle_completion(): completion ok for obj=d[wfhqh9yW29BkseJi7uCCLJfHEmSBuyT] 2024-09-22T08:16:53.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.763+0000 7fa78cff9640 20 handle_completion(): completion ok for obj=e[GohL912-tjAr3lO8QUMRkL8XkOs07N2] 2024-09-22T08:16:53.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.764+0000 7fa8add25800 20 get_obj_state: octx=0x55a1c21350f0 obj=check-bucket:e state=0x55a1c24025c8 s->prefetch_data=0 2024-09-22T08:16:53.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.764+0000 7fa8add25800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=zrxshtkwi5k1o74m4ds6lvmm3qvho16u 2024-09-22T08:16:53.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.764+0000 7fa8add25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.5 2024-09-22T08:16:53.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.764+0000 7fa8add25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.5 2024-09-22T08:16:53.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.764+0000 7fa78cff9640 20 handle_completion(): completion ok for obj=f[hGZ6Mio6lEAYtGjrGsPI36Mjg.4Y3Hz] 2024-09-22T08:16:53.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.764+0000 7fa8add25800 20 get_obj_state: octx=0x55a1c23fd5c0 obj=check-bucket:f state=0x55a1c249ec68 s->prefetch_data=0 2024-09-22T08:16:53.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.764+0000 7fa8add25800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=jbrhaghqiy6oa3sn77xsvemlakr7ksur 2024-09-22T08:16:53.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.764+0000 7fa78d7fa640 20 handle_completion(): completion ok for obj=c[hKacOdZL8pCJkCDAEPnN70oswBHP4Xz] 2024-09-22T08:16:53.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.764+0000 7fa8add25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.8 2024-09-22T08:16:53.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.764+0000 7fa8add25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.8 2024-09-22T08:16:53.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.765+0000 7fa8add25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.5 2024-09-22T08:16:53.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.765+0000 7fa8add25800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-22T08:16:53.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.766+0000 7fa8add25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.8 2024-09-22T08:16:53.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.766+0000 7fa8add25800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-22T08:16:53.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.768+0000 7fa8add25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.1 2024-09-22T08:16:53.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.768+0000 7fa8add25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.10 2024-09-22T08:16:53.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.769+0000 7fa8add25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.1 2024-09-22T08:16:53.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.769+0000 7fa8add25800 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-22T08:16:53.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.769+0000 7fa8add25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.1.10 2024-09-22T08:16:53.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.769+0000 7fa8add25800 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-22T08:16:53.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.769+0000 7fa8add25800 1 NOTICE: finished all shards (4 entries removed) 2024-09-22T08:16:53.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.770+0000 7fa75b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:53.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.773+0000 7fa8add25800 20 remove_watcher() i=0 2024-09-22T08:16:53.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.773+0000 7fa8add25800 2 removed watcher, disabling cache 2024-09-22T08:16:53.774 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.774+0000 7fa8add25800 20 remove_watcher() i=1 2024-09-22T08:16:53.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.775+0000 7fa8add25800 20 remove_watcher() i=2 2024-09-22T08:16:53.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.776+0000 7fa8add25800 20 remove_watcher() i=3 2024-09-22T08:16:53.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.777+0000 7fa8add25800 20 remove_watcher() i=4 2024-09-22T08:16:53.779 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.778+0000 7fa8add25800 20 remove_watcher() i=5 2024-09-22T08:16:53.780 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.780+0000 7fa8add25800 20 remove_watcher() i=6 2024-09-22T08:16:53.781 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.781+0000 7fa8add25800 20 remove_watcher() i=7 2024-09-22T08:16:53.795 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:53.795 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:53.800 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:53.801 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:53.845 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-22T08:16:53.873 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:16:53.874 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:16:53.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.912+0000 7f6076d19800 20 rados->read ofs=0 len=0 2024-09-22T08:16:53.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.914+0000 7f6076d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:53.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.914+0000 7f6076d19800 20 realm 2024-09-22T08:16:53.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.914+0000 7f6076d19800 20 rados->read ofs=0 len=0 2024-09-22T08:16:53.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.914+0000 7f6076d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:53.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.914+0000 7f6076d19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:16:53.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.914+0000 7f6076d19800 20 rados->read ofs=0 len=0 2024-09-22T08:16:53.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.915+0000 7f6076d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:53.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.915+0000 7f6076d19800 20 rados->read ofs=0 len=0 2024-09-22T08:16:53.917 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.915+0000 7f6076d19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:53.917 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.915+0000 7f6076d19800 20 rados->read ofs=0 len=0 2024-09-22T08:16:53.917 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.916+0000 7f6076d19800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:16:53.917 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.916+0000 7f6076d19800 20 searching for the correct realm 2024-09-22T08:16:53.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.919+0000 7f607480a640 0 -- 172.21.15.38:0/3114744788 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x5590f72ee490 msgr2=0x5590f72f0950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:16:53.923 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:53.922+0000 7f6074009640 0 -- 172.21.15.38:0/3114744788 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f60640bb320 msgr2=0x7f60640ae040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:16:54.131 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.130+0000 7f6076d19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:16:54.132 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.130+0000 7f6076d19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:16:54.132 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.130+0000 7f6076d19800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:16:54.132 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.130+0000 7f6076d19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:16:54.132 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.130+0000 7f6076d19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:16:54.132 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.130+0000 7f6076d19800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:16:54.132 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.130+0000 7f6076d19800 20 rados->read ofs=0 len=0 2024-09-22T08:16:54.132 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.130+0000 7f6076d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:54.132 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.130+0000 7f6076d19800 20 rados->read ofs=0 len=0 2024-09-22T08:16:54.132 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.131+0000 7f6076d19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:16:54.132 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.131+0000 7f6076d19800 20 rados->read ofs=0 len=0 2024-09-22T08:16:54.133 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.131+0000 7f6076d19800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:16:54.133 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.131+0000 7f6076d19800 20 zone default found 2024-09-22T08:16:54.133 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.131+0000 7f6076d19800 4 Realm: () 2024-09-22T08:16:54.133 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.131+0000 7f6076d19800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:16:54.133 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.131+0000 7f6076d19800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:16:54.133 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.131+0000 7f6076d19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:16:54.134 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.131+0000 7f6076d19800 20 zonegroup default 2024-09-22T08:16:54.134 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.131+0000 7f6076d19800 20 rados->read ofs=0 len=0 2024-09-22T08:16:54.134 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.132+0000 7f6076d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:54.134 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.132+0000 7f6076d19800 20 rados->read ofs=0 len=0 2024-09-22T08:16:54.134 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.132+0000 7f6076d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:54.134 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.132+0000 7f6076d19800 20 rados->read ofs=0 len=0 2024-09-22T08:16:54.134 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.132+0000 7f6076d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:16:54.134 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.132+0000 7f6076d19800 20 started sync module instance, tier type = 2024-09-22T08:16:54.134 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.132+0000 7f6076d19800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:16:54.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.143+0000 7f6076d19800 20 add_watcher() i=0 2024-09-22T08:16:54.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.143+0000 7f6076d19800 20 add_watcher() i=1 2024-09-22T08:16:54.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.143+0000 7f6076d19800 20 add_watcher() i=2 2024-09-22T08:16:54.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.143+0000 7f6076d19800 20 add_watcher() i=3 2024-09-22T08:16:54.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.143+0000 7f6076d19800 20 add_watcher() i=4 2024-09-22T08:16:54.145 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.144+0000 7f6076d19800 20 add_watcher() i=5 2024-09-22T08:16:54.145 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.144+0000 7f6076d19800 20 add_watcher() i=6 2024-09-22T08:16:54.145 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.145+0000 7f6076d19800 20 add_watcher() i=7 2024-09-22T08:16:54.145 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.145+0000 7f6076d19800 2 all 8 watchers are set, enabling cache 2024-09-22T08:16:54.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.146+0000 7f5f2afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:54.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.147+0000 7f6076d19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:16:54.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.147+0000 7f6076d19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:16:54.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.147+0000 7f6076d19800 5 note: GC not initialized 2024-09-22T08:16:54.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.147+0000 7f5f29fe3640 20 reqs_thread_entry: start 2024-09-22T08:16:54.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.147+0000 7f6076d19800 20 init_complete bucket index max shards: 11 2024-09-22T08:16:54.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.147+0000 7f6076d19800 20 Filter name: none 2024-09-22T08:16:54.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.147+0000 7f5e9b7fe640 20 reqs_thread_entry: start 2024-09-22T08:16:54.149 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.147+0000 7f6076d19800 20 rados->read ofs=0 len=0 2024-09-22T08:16:54.149 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.148+0000 7f6076d19800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:16:54.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.148+0000 7f6076d19800 20 rados->read ofs=0 len=0 2024-09-22T08:16:54.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.148+0000 7f6076d19800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:16:54.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.148+0000 7f6076d19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:16:54.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.148+0000 7f6076d19800 20 rados->read ofs=0 len=0 2024-09-22T08:16:54.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.149+0000 7f6076d19800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:16:54.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.149+0000 7f6076d19800 20 rados->read ofs=0 len=0 2024-09-22T08:16:54.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.149+0000 7f6076d19800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:16:54.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.149+0000 7f6076d19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:16:54.151 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.151+0000 7f5f2afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:16:54.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.153+0000 7f6076d19800 20 remove_watcher() i=0 2024-09-22T08:16:54.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.153+0000 7f6076d19800 2 removed watcher, disabling cache 2024-09-22T08:16:54.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.155+0000 7f6076d19800 20 remove_watcher() i=1 2024-09-22T08:16:54.156 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.156+0000 7f6076d19800 20 remove_watcher() i=2 2024-09-22T08:16:54.157 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.157+0000 7f6076d19800 20 remove_watcher() i=3 2024-09-22T08:16:54.159 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.158+0000 7f6076d19800 20 remove_watcher() i=4 2024-09-22T08:16:54.160 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.159+0000 7f6076d19800 20 remove_watcher() i=5 2024-09-22T08:16:54.161 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.161+0000 7f6076d19800 20 remove_watcher() i=6 2024-09-22T08:16:54.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:16:54.162+0000 7f6076d19800 20 remove_watcher() i=7 2024-09-22T08:16:54.174 INFO:tasks.workunit.client.0.smithi038.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-22T08:16:54.174 INFO:tasks.workunit.client.0.smithi038.stderr:Deleting bucket check-bucket 2024-09-22T08:16:54.176 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:54.176 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:54.180 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:16:54.180 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:16:54.213 INFO:tasks.workunit.client.0.smithi038.stderr:Completed bucket check tests 2024-09-22T08:16:54.213 INFO:tasks.workunit.client.0.smithi038.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-22T08:16:54.213 INFO:tasks.workunit.client.0.smithi038.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-22T08:16:54.213 INFO:tasks.workunit.client.0.smithi038.stdout:connected to https://localhost:443 2024-09-22T08:16:54.275 INFO:tasks.workunit.client.0.smithi038.stderr:+ deactivate 2024-09-22T08:16:54.276 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-22T08:16:54.276 INFO:tasks.workunit.client.0.smithi038.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-22T08:16:54.276 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-09-22T08:16:54.276 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-22T08:16:54.276 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -n '' ']' 2024-09-22T08:16:54.276 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-22T08:16:54.276 INFO:tasks.workunit.client.0.smithi038.stderr:+ hash -r 2024-09-22T08:16:54.276 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -n '' ']' 2024-09-22T08:16:54.276 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset VIRTUAL_ENV 2024-09-22T08:16:54.276 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-22T08:16:54.276 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset -f deactivate 2024-09-22T08:16:54.276 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo OK. 2024-09-22T08:16:54.277 INFO:tasks.workunit.client.0.smithi038.stdout:OK. 2024-09-22T08:16:54.278 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:16:54.278 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:16:54.358 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-22T08:16:54.358 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-22T08:16:54.739 DEBUG:teuthology.parallel:result is None 2024-09-22T08:16:54.739 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T08:16:54.779 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T08:16:54.779 DEBUG:teuthology.orchestra.run.smithi038:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-22T08:16:54.861 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T08:16:54.862 INFO:teuthology.run_tasks:Running task workunit... 2024-09-22T08:16:54.897 INFO:tasks.workunit:Pulling workunits from ref 8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:16:54.897 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-22T08:16:54.897 DEBUG:teuthology.orchestra.run.smithi038:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-22T08:16:54.931 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:16:54.931 INFO:teuthology.orchestra.run.smithi038.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-22T08:16:54.931 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-22T08:16:55.002 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-22T08:16:55.002 DEBUG:teuthology.orchestra.run.smithi038:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-22T08:16:55.071 INFO:tasks.workunit:timeout=3h 2024-09-22T08:16:55.071 INFO:tasks.workunit:cleanup=True 2024-09-22T08:16:55.072 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:16:55.142 INFO:tasks.workunit.client.0.smithi038.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-22T08:17:57.569 INFO:tasks.workunit.client.0.smithi038.stderr:Updating files: 92% (11698/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-22T08:17:58.350 INFO:tasks.workunit.client.0.smithi038.stderr:Note: switching to '8852379c050c686f4605f33f0129009b2029ca9d'. 2024-09-22T08:17:58.350 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:17:58.350 INFO:tasks.workunit.client.0.smithi038.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-22T08:17:58.350 INFO:tasks.workunit.client.0.smithi038.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-22T08:17:58.350 INFO:tasks.workunit.client.0.smithi038.stderr:state without impacting any branches by switching back to a branch. 2024-09-22T08:17:58.350 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:17:58.350 INFO:tasks.workunit.client.0.smithi038.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-22T08:17:58.350 INFO:tasks.workunit.client.0.smithi038.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-22T08:17:58.350 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:17:58.350 INFO:tasks.workunit.client.0.smithi038.stderr: git switch -c 2024-09-22T08:17:58.350 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:17:58.350 INFO:tasks.workunit.client.0.smithi038.stderr:Or undo this operation with: 2024-09-22T08:17:58.351 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:17:58.351 INFO:tasks.workunit.client.0.smithi038.stderr: git switch - 2024-09-22T08:17:58.351 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:17:58.351 INFO:tasks.workunit.client.0.smithi038.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-22T08:17:58.351 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:17:58.351 INFO:tasks.workunit.client.0.smithi038.stderr:HEAD is now at 8852379c050 rgw/cloud-restore: Fixed storage class update while listing objects. 2024-09-22T08:17:58.355 DEBUG:teuthology.orchestra.run.smithi038:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-22T08:17:58.424 INFO:tasks.workunit.client.0.smithi038.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-22T08:17:58.426 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-22T08:17:58.426 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-22T08:17:58.477 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-22T08:17:58.527 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-22T08:17:58.568 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-22T08:17:58.570 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-22T08:17:58.570 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-22T08:17:58.610 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-22T08:17:58.613 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-22T08:17:58.613 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-22T08:17:58.683 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-22T08:17:58.684 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-22T08:17:58.684 DEBUG:teuthology.orchestra.run.smithi038:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-22T08:17:58.768 INFO:tasks.workunit.client.0.smithi038.stdout:Running main() from gmock_main.cc 2024-09-22T08:17:58.768 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-22T08:17:58.768 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-22T08:17:58.768 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 11 tests from ClsLock 2024-09-22T08:17:58.768 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-22T08:17:59.956 INFO:tasks.workunit.client.0.smithi038.stdout:lock: mylock 2024-09-22T08:17:59.956 INFO:tasks.workunit.client.0.smithi038.stdout: lock_type: exclusive 2024-09-22T08:17:59.956 INFO:tasks.workunit.client.0.smithi038.stdout: tag: 2024-09-22T08:17:59.956 INFO:tasks.workunit.client.0.smithi038.stdout: lockers: 2024-09-22T08:17:59.957 INFO:tasks.workunit.client.0.smithi038.stdout: client.5103 expiration=2024-09-22T08:19:59.952835+0000 addr=v1:172.21.15.38:0/4262521140 cookie= 2024-09-22T08:17:59.960 INFO:tasks.workunit.client.0.smithi038.stdout:lock: mylock 2024-09-22T08:17:59.961 INFO:tasks.workunit.client.0.smithi038.stdout: lock_type: shared 2024-09-22T08:17:59.961 INFO:tasks.workunit.client.0.smithi038.stdout: tag: 2024-09-22T08:17:59.961 INFO:tasks.workunit.client.0.smithi038.stdout: lockers: 2024-09-22T08:17:59.961 INFO:tasks.workunit.client.0.smithi038.stdout: client.5103 expiration=2024-09-22T08:19:59.959746+0000 addr=v1:172.21.15.38:0/4262521140 cookie= 2024-09-22T08:17:59.961 INFO:tasks.workunit.client.0.smithi038.stdout: client.5109 expiration=0.000000 addr=v1:172.21.15.38:0/4272394365 cookie= 2024-09-22T08:17:59.962 INFO:tasks.workunit.client.0.smithi038.stdout:lock: mylock 2024-09-22T08:17:59.962 INFO:tasks.workunit.client.0.smithi038.stdout: lock_type: shared 2024-09-22T08:17:59.962 INFO:tasks.workunit.client.0.smithi038.stdout: tag: 2024-09-22T08:17:59.962 INFO:tasks.workunit.client.0.smithi038.stdout: lockers: 2024-09-22T08:17:59.962 INFO:tasks.workunit.client.0.smithi038.stdout: client.5109 expiration=0.000000 addr=v1:172.21.15.38:0/4272394365 cookie= 2024-09-22T08:18:00.936 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] ClsLock.TestMultiLocking (2168 ms) 2024-09-22T08:18:00.937 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] ClsLock.TestMeta 2024-09-22T08:18:03.198 INFO:tasks.workunit.client.0.smithi038.stdout:lock: mylock 2024-09-22T08:18:03.198 INFO:tasks.workunit.client.0.smithi038.stdout: lock_type: shared 2024-09-22T08:18:03.198 INFO:tasks.workunit.client.0.smithi038.stdout: tag: 2024-09-22T08:18:03.198 INFO:tasks.workunit.client.0.smithi038.stdout: lockers: 2024-09-22T08:18:03.198 INFO:tasks.workunit.client.0.smithi038.stdout: client.5121 expiration=0.000000 addr=v1:172.21.15.38:0/855326390 cookie= 2024-09-22T08:18:03.202 INFO:tasks.workunit.client.0.smithi038.stdout:lock: mylock 2024-09-22T08:18:03.202 INFO:tasks.workunit.client.0.smithi038.stdout: lock_type: exclusive 2024-09-22T08:18:03.202 INFO:tasks.workunit.client.0.smithi038.stdout: tag: new_tag 2024-09-22T08:18:03.202 INFO:tasks.workunit.client.0.smithi038.stdout: lockers: 2024-09-22T08:18:03.202 INFO:tasks.workunit.client.0.smithi038.stdout: client.5115 expiration=0.000000 addr=v1:172.21.15.38:0/911751112 cookie= 2024-09-22T08:18:03.960 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] ClsLock.TestMeta (3024 ms) 2024-09-22T08:18:03.961 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] ClsLock.TestCookie 2024-09-22T08:18:06.002 INFO:tasks.workunit.client.0.smithi038.stdout:lock: mylock 2024-09-22T08:18:06.002 INFO:tasks.workunit.client.0.smithi038.stdout: lock_type: exclusive 2024-09-22T08:18:06.002 INFO:tasks.workunit.client.0.smithi038.stdout: tag: 2024-09-22T08:18:06.002 INFO:tasks.workunit.client.0.smithi038.stdout: lockers: 2024-09-22T08:18:06.005 INFO:tasks.workunit.client.0.smithi038.stdout:lock: mylock 2024-09-22T08:18:06.005 INFO:tasks.workunit.client.0.smithi038.stdout: lock_type: shared 2024-09-22T08:18:06.005 INFO:tasks.workunit.client.0.smithi038.stdout: tag: 2024-09-22T08:18:06.005 INFO:tasks.workunit.client.0.smithi038.stdout: lockers: 2024-09-22T08:18:06.005 INFO:tasks.workunit.client.0.smithi038.stdout: client.5127 expiration=0.000000 addr=v1:172.21.15.38:0/2801493227 cookie= 2024-09-22T08:18:06.005 INFO:tasks.workunit.client.0.smithi038.stdout: client.5127 expiration=0.000000 addr=v1:172.21.15.38:0/2801493227 cookie=new cookie 2024-09-22T08:18:06.996 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] ClsLock.TestCookie (3036 ms) 2024-09-22T08:18:06.996 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-22T08:18:10.024 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] ClsLock.TestMultipleLocks (3028 ms) 2024-09-22T08:18:10.024 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-22T08:18:18.081 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] ClsLock.TestLockDuration (8057 ms) 2024-09-22T08:18:18.081 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-22T08:18:21.116 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] ClsLock.TestAssertLocked (3035 ms) 2024-09-22T08:18:21.116 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-22T08:18:24.153 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] ClsLock.TestSetCookie (3037 ms) 2024-09-22T08:18:24.153 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] ClsLock.TestRenew 2024-09-22T08:18:44.862 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] ClsLock.TestRenew (20709 ms) 2024-09-22T08:18:44.862 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-22T08:18:50.967 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (6105 ms) 2024-09-22T08:18:50.967 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-22T08:18:58.083 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (7116 ms) 2024-09-22T08:18:58.083 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-22T08:19:06.172 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8089 ms) 2024-09-22T08:19:06.172 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 11 tests from ClsLock (67404 ms total) 2024-09-22T08:19:06.172 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-22T08:19:06.172 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-22T08:19:06.172 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 11 tests from 1 test suite ran. (67404 ms total) 2024-09-22T08:19:06.172 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 11 tests. 2024-09-22T08:19:06.175 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:19:06.175 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:19:06.222 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-22T08:19:06.223 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-22T08:19:06.224 DEBUG:teuthology.orchestra.run.smithi038:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-22T08:19:06.273 INFO:tasks.workunit.client.0.smithi038.stdout:Running main() from gmock_main.cc 2024-09-22T08:19:06.273 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-22T08:19:06.273 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-22T08:19:06.273 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 4 tests from cls_log 2024-09-22T08:19:06.273 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-22T08:19:09.224 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_log.test_log_add_same_time (2951 ms) 2024-09-22T08:19:09.224 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-22T08:19:12.258 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_log.test_log_add_different_time (3033 ms) 2024-09-22T08:19:12.258 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_log.trim_by_time 2024-09-22T08:19:15.310 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_log.trim_by_time (3053 ms) 2024-09-22T08:19:15.311 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-22T08:19:18.319 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_log.trim_by_marker (3009 ms) 2024-09-22T08:19:18.319 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 4 tests from cls_log (12046 ms total) 2024-09-22T08:19:18.319 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-22T08:19:18.319 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-22T08:19:18.319 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 4 tests from 1 test suite ran. (12046 ms total) 2024-09-22T08:19:18.319 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 4 tests. 2024-09-22T08:19:18.321 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:19:18.321 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:19:18.368 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-22T08:19:18.369 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-22T08:19:18.369 DEBUG:teuthology.orchestra.run.smithi038:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-22T08:19:18.417 INFO:tasks.workunit.client.0.smithi038.stdout:Running main() from gmock_main.cc 2024-09-22T08:19:18.417 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-22T08:19:18.417 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-22T08:19:18.418 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 10 tests from cls_refcount 2024-09-22T08:19:18.418 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-22T08:19:21.382 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_refcount.test_implicit (2964 ms) 2024-09-22T08:19:21.383 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-22T08:19:24.430 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3048 ms) 2024-09-22T08:19:24.430 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-22T08:19:33.488 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_refcount.test_put_snap (9058 ms) 2024-09-22T08:19:33.488 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-22T08:19:36.539 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_refcount.test_explicit (3051 ms) 2024-09-22T08:19:36.539 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_refcount.set 2024-09-22T08:19:39.607 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_refcount.set (3068 ms) 2024-09-22T08:19:39.607 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-22T08:19:46.640 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_refcount.test_implicit_ec (7033 ms) 2024-09-22T08:19:46.640 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-22T08:19:53.732 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7092 ms) 2024-09-22T08:19:53.732 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-22T08:20:05.840 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_refcount.test_put_snap_ec (12108 ms) 2024-09-22T08:20:05.841 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-22T08:20:12.897 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_refcount.test_explicit_ec (7057 ms) 2024-09-22T08:20:12.897 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_refcount.set_ec 2024-09-22T08:20:19.926 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_refcount.set_ec (7029 ms) 2024-09-22T08:20:19.926 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 10 tests from cls_refcount (61508 ms total) 2024-09-22T08:20:19.927 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-22T08:20:19.927 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-22T08:20:19.927 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 10 tests from 1 test suite ran. (61508 ms total) 2024-09-22T08:20:19.927 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 10 tests. 2024-09-22T08:20:19.930 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:20:19.930 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:20:19.976 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-22T08:20:19.977 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-22T08:20:19.977 DEBUG:teuthology.orchestra.run.smithi038:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-22T08:20:20.025 INFO:tasks.workunit.client.0.smithi038.stdout:Running main() from gmock_main.cc 2024-09-22T08:20:20.025 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-22T08:20:20.025 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-22T08:20:20.025 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 19 tests from cls_rgw 2024-09-22T08:20:21.975 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw.index_basic 2024-09-22T08:20:22.019 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw.index_basic (44 ms) 2024-09-22T08:20:22.019 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-22T08:20:22.050 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (31 ms) 2024-09-22T08:20:22.050 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-22T08:20:22.095 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw.index_remove_object (45 ms) 2024-09-22T08:20:22.096 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-22T08:20:23.555 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw.index_suggest (1460 ms) 2024-09-22T08:20:23.555 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-22T08:20:23.564 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw.index_suggest_complete (9 ms) 2024-09-22T08:20:23.564 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw.index_list 2024-09-22T08:20:23.595 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw.index_list (31 ms) 2024-09-22T08:20:23.595 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-22T08:20:47.386 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw.index_list_delimited (23790 ms) 2024-09-22T08:20:47.386 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw.bi_list 2024-09-22T08:20:47.478 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw.bi_list (92 ms) 2024-09-22T08:20:47.478 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw.gc_set 2024-09-22T08:20:47.489 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw.gc_set (12 ms) 2024-09-22T08:20:47.489 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw.gc_list 2024-09-22T08:20:47.502 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw.gc_list (12 ms) 2024-09-22T08:20:47.502 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-22T08:20:55.164 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw.gc_defer (7661 ms) 2024-09-22T08:20:55.164 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-22T08:20:55.248 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw.usage_basic (85 ms) 2024-09-22T08:20:55.248 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-22T08:20:55.253 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw.usage_clear_no_obj (5 ms) 2024-09-22T08:20:55.253 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-22T08:20:55.350 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw.usage_clear (97 ms) 2024-09-22T08:20:55.350 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-22T08:20:55.403 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw.bi_log_trim (54 ms) 2024-09-22T08:20:55.403 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-22T08:20:55.416 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw.index_racing_removes (12 ms) 2024-09-22T08:20:55.416 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-22T08:20:55.433 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw.reshardlog_list (17 ms) 2024-09-22T08:20:55.433 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-22T08:20:55.444 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw.reshardlog_num (11 ms) 2024-09-22T08:20:55.444 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw.bi_put_entries 2024-09-22T08:20:55.465 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw.bi_put_entries (21 ms) 2024-09-22T08:20:56.161 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 19 tests from cls_rgw (33490 ms total) 2024-09-22T08:20:56.161 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-22T08:20:56.162 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-22T08:20:56.162 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 19 tests from 1 test suite ran. (36136 ms total) 2024-09-22T08:20:56.162 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 19 tests. 2024-09-22T08:20:56.164 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:20:56.164 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:20:56.213 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-22T08:20:56.214 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-22T08:20:56.215 DEBUG:teuthology.orchestra.run.smithi038:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-22T08:20:56.263 INFO:tasks.workunit.client.0.smithi038.stdout:Running main() from gmock_main.cc 2024-09-22T08:20:56.263 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-22T08:20:56.263 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-22T08:20:56.263 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-22T08:20:56.263 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw_gc.init 2024-09-22T08:20:58.200 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw_gc.init (1937 ms) 2024-09-22T08:20:58.200 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-22T08:20:58.225 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (25 ms) 2024-09-22T08:20:58.225 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-22T08:20:58.225 INFO:tasks.workunit.client.0.smithi038.stderr:[ ] list info tag = chain-0 2024-09-22T08:20:58.234 INFO:tasks.workunit.client.0.smithi038.stderr:[ ] next_marker is: = 0/4263 2024-09-22T08:20:58.234 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (10 ms) 2024-09-22T08:20:58.235 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-22T08:20:58.245 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (10 ms) 2024-09-22T08:20:58.245 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-22T08:20:58.253 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (8 ms) 2024-09-22T08:20:58.254 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-22T08:20:58.262 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (9 ms) 2024-09-22T08:20:58.262 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-22T08:20:58.271 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (9 ms) 2024-09-22T08:20:58.271 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-22T08:20:58.279 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (8 ms) 2024-09-22T08:20:58.279 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-22T08:20:59.205 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw_gc.finalize (926 ms) 2024-09-22T08:20:59.205 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 9 tests from cls_rgw_gc (2942 ms total) 2024-09-22T08:20:59.205 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-22T08:20:59.205 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-22T08:20:59.205 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 9 tests from 1 test suite ran. (2942 ms total) 2024-09-22T08:20:59.205 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 9 tests. 2024-09-22T08:20:59.208 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:20:59.209 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:20:59.259 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-22T08:20:59.260 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-22T08:20:59.260 DEBUG:teuthology.orchestra.run.smithi038:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-22T08:20:59.315 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:20:59.315 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:20:59.315 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 1 test from 1 test suite. 2024-09-22T08:20:59.316 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-22T08:21:01.262 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 1 test from cls_rgw_stats 2024-09-22T08:21:01.262 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-22T08:21:01.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.272+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=7DIJ2H2YUBPR type=del size=3418450 2024-09-22T08:21:01.276 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.276+0000 7fe6c9c31780 1 > prepared part key=_multipart_W9L87PTJEIOA.2~G2TO2CI0QOQS.0 size=1002405 2024-09-22T08:21:01.276 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.276+0000 7fe6c9c31780 1 > prepared multipart upload key=W9L87PTJEIOA upload=G2TO2CI0QOQS tag=2BGEJ5WVHIJP type=write size=2050981 2024-09-22T08:21:01.278 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.277+0000 7fe6c9c31780 1 > prepared operation key=ZFL9N44PBQX4 tag=8L48OTEI3VEL type=del size=2169018 2024-09-22T08:21:01.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.279+0000 7fe6c9c31780 1 > prepared operation key=TJTB67QBLZH5 tag=CH0BMBEI1CLJ type=del size=3672974 2024-09-22T08:21:01.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.282+0000 7fe6c9c31780 1 > prepared part key=_multipart_R7UWMW913DJQ.2~6AGNBONFQU2A.0 size=721928 2024-09-22T08:21:01.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.282+0000 7fe6c9c31780 1 > prepared multipart upload key=R7UWMW913DJQ upload=6AGNBONFQU2A tag=92Q83IJIOOL9 type=write size=1770504 2024-09-22T08:21:01.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.283+0000 7fe6c9c31780 1 > prepared operation key=0PNK2ZW6IJM1 tag=ZF8RYVF276L0 type=write size=864611 2024-09-22T08:21:01.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.285+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=TNXYU6NDJJEI type=del size=308985 2024-09-22T08:21:01.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.289+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~DQ8W9MES4U27.0 size=1048576 2024-09-22T08:21:01.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.290+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~DQ8W9MES4U27.1 size=1048576 2024-09-22T08:21:01.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.292+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~DQ8W9MES4U27.2 size=70210 2024-09-22T08:21:01.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.292+0000 7fe6c9c31780 1 > prepared multipart upload key=VP1MP4IC9A7T upload=DQ8W9MES4U27 tag=B9A1IRPOS1YK type=write size=3215938 2024-09-22T08:21:01.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.293+0000 7fe6c9c31780 1 > prepared operation key=ZFL9N44PBQX4 tag=IDXJ99QPPRGR type=del size=2971772 2024-09-22T08:21:01.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.295+0000 7fe6c9c31780 1 > prepared operation key=JT5AB8VLMEFD tag=5U2ZNXWLDXX0 type=del size=2618878 2024-09-22T08:21:01.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.298+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~SE5HIWTYMWX7.0 size=1048576 2024-09-22T08:21:01.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.299+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~SE5HIWTYMWX7.1 size=1048576 2024-09-22T08:21:01.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.301+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~SE5HIWTYMWX7.2 size=93365 2024-09-22T08:21:01.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.301+0000 7fe6c9c31780 1 > prepared multipart upload key=ILW34WLX48WN upload=SE5HIWTYMWX7 tag=EZCQDYZID3GR type=write size=3239093 2024-09-22T08:21:01.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.303+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~3ADFJ7YH99C2.0 size=1048576 2024-09-22T08:21:01.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.305+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~3ADFJ7YH99C2.1 size=232013 2024-09-22T08:21:01.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.305+0000 7fe6c9c31780 1 > prepared multipart upload key=T2W6RXP9UGHH upload=3ADFJ7YH99C2 tag=8ROBMQZK9SXY type=write size=2329165 2024-09-22T08:21:01.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.306+0000 7fe6c9c31780 1 > prepared operation key=GEWQUFB9K35E tag=G112CVR0F7NF type=del size=3547212 2024-09-22T08:21:01.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.308+0000 7fe6c9c31780 1 > prepared operation key=LA6ZRVULGQ0H tag=KKUUDVO6MFZJ type=del size=3902105 2024-09-22T08:21:01.312 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.311+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~L3YPSQ9EZ0I4.0 size=1048576 2024-09-22T08:21:01.313 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.312+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~L3YPSQ9EZ0I4.1 size=1048576 2024-09-22T08:21:01.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.314+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~L3YPSQ9EZ0I4.2 size=99624 2024-09-22T08:21:01.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.314+0000 7fe6c9c31780 1 > prepared multipart upload key=0TWY0NNZZ7NN upload=L3YPSQ9EZ0I4 tag=5NUOY6IZ9YLK type=write size=3245352 2024-09-22T08:21:01.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.317+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~815AF4EHMCRS.0 size=1048576 2024-09-22T08:21:01.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.318+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~815AF4EHMCRS.1 size=975246 2024-09-22T08:21:01.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.318+0000 7fe6c9c31780 1 > prepared multipart upload key=9FCSIF1WKBDJ upload=815AF4EHMCRS tag=M6YCO0OG2N81 type=write size=3072398 2024-09-22T08:21:01.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.320+0000 7fe6c9c31780 1 < completed delete operation key=6BKB91YV3FMW tag=7DIJ2H2YUBPR type=del 2024-09-22T08:21:01.323 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.323+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~SG1VGA2H0KEC.0 size=1048576 2024-09-22T08:21:01.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.324+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~SG1VGA2H0KEC.1 size=1048576 2024-09-22T08:21:01.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.325+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~SG1VGA2H0KEC.2 size=351078 2024-09-22T08:21:01.326 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.325+0000 7fe6c9c31780 1 > prepared multipart upload key=XJP26CCPYDI7 upload=SG1VGA2H0KEC tag=42FVLG7AW5MM type=write size=3496806 2024-09-22T08:21:01.327 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.327+0000 7fe6c9c31780 1 < completed part key=_multipart_W9L87PTJEIOA.2~G2TO2CI0QOQS.0 size=1002405 2024-09-22T08:21:01.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.330+0000 7fe6c9c31780 1 < completed multipart upload key=W9L87PTJEIOA upload=G2TO2CI0QOQS tag=2BGEJ5WVHIJP type=write size=2050981 2024-09-22T08:21:01.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.333+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~9HPZN2FV7DDJ.0 size=102598 2024-09-22T08:21:01.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.333+0000 7fe6c9c31780 1 > prepared multipart upload key=VP1MP4IC9A7T upload=9HPZN2FV7DDJ tag=2PAR9WOHLUXX type=write size=1151174 2024-09-22T08:21:01.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.334+0000 7fe6c9c31780 1 < completed delete operation key=ZFL9N44PBQX4 tag=8L48OTEI3VEL type=del 2024-09-22T08:21:01.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.338+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~BZHUWN2B9NWL.0 size=1048576 2024-09-22T08:21:01.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.339+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~BZHUWN2B9NWL.1 size=1048576 2024-09-22T08:21:01.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.340+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~BZHUWN2B9NWL.2 size=634931 2024-09-22T08:21:01.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.340+0000 7fe6c9c31780 1 > prepared multipart upload key=OX1LY7URY7IV upload=BZHUWN2B9NWL tag=7DGJM11H59FH type=write size=3780659 2024-09-22T08:21:01.342 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.342+0000 7fe6c9c31780 1 < completed delete operation key=TJTB67QBLZH5 tag=CH0BMBEI1CLJ type=del 2024-09-22T08:21:01.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.344+0000 7fe6c9c31780 1 > prepared operation key=VP1MP4IC9A7T tag=SQFLOV9XKNW8 type=del size=1561094 2024-09-22T08:21:01.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.345+0000 7fe6c9c31780 1 < completed part key=_multipart_R7UWMW913DJQ.2~6AGNBONFQU2A.0 size=721928 2024-09-22T08:21:01.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.348+0000 7fe6c9c31780 1 < completed multipart upload key=R7UWMW913DJQ upload=6AGNBONFQU2A tag=92Q83IJIOOL9 type=write size=1770504 2024-09-22T08:21:01.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.350+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=IPMSH5XN2S94 type=del size=1899200 2024-09-22T08:21:01.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.351+0000 7fe6c9c31780 1 < completed write operation key=0PNK2ZW6IJM1 tag=ZF8RYVF276L0 type=write size=864611 2024-09-22T08:21:01.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.355+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~P8ZLOZV7L1UR.0 size=564918 2024-09-22T08:21:01.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.355+0000 7fe6c9c31780 1 > prepared multipart upload key=DC7VLQWZ3TD1 upload=P8ZLOZV7L1UR tag=Q687G5QJR7UE type=write size=1613494 2024-09-22T08:21:01.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.356+0000 7fe6c9c31780 1 < completed delete operation key=9AZWQ9E58QS6 tag=TNXYU6NDJJEI type=del 2024-09-22T08:21:01.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.360+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~5IJOD01V6CWP.0 size=1048576 2024-09-22T08:21:01.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.360+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~5IJOD01V6CWP.1 size=788120 2024-09-22T08:21:01.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.360+0000 7fe6c9c31780 1 > prepared multipart upload key=D85LJGGU3Z6F upload=5IJOD01V6CWP tag=SKHC16ZRFW0Q type=write size=2885272 2024-09-22T08:21:01.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.362+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~DQ8W9MES4U27.0 size=1048576 2024-09-22T08:21:01.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.364+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~DQ8W9MES4U27.1 size=1048576 2024-09-22T08:21:01.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.365+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~DQ8W9MES4U27.2 size=70210 2024-09-22T08:21:01.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.367+0000 7fe6c9c31780 1 < completed multipart upload key=VP1MP4IC9A7T upload=DQ8W9MES4U27 tag=B9A1IRPOS1YK type=write size=3215938 2024-09-22T08:21:01.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.369+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=OXFJ7EMRYSP9 type=write size=539063 2024-09-22T08:21:01.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.370+0000 7fe6c9c31780 1 < completed delete operation key=ZFL9N44PBQX4 tag=IDXJ99QPPRGR type=del 2024-09-22T08:21:01.372 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.371+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=LCKHH73JELYC type=del size=1375198 2024-09-22T08:21:01.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.374+0000 7fe6c9c31780 1 < completed delete operation key=JT5AB8VLMEFD tag=5U2ZNXWLDXX0 type=del 2024-09-22T08:21:01.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.375+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=C0RCDHXSAMGS type=write size=239900 2024-09-22T08:21:01.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.376+0000 7fe6c9c31780 1 < completed part key=_multipart_ILW34WLX48WN.2~SE5HIWTYMWX7.0 size=1048576 2024-09-22T08:21:01.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.378+0000 7fe6c9c31780 1 < completed part key=_multipart_ILW34WLX48WN.2~SE5HIWTYMWX7.1 size=1048576 2024-09-22T08:21:01.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.379+0000 7fe6c9c31780 1 < completed part key=_multipart_ILW34WLX48WN.2~SE5HIWTYMWX7.2 size=93365 2024-09-22T08:21:01.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.382+0000 7fe6c9c31780 1 < completed multipart upload key=ILW34WLX48WN upload=SE5HIWTYMWX7 tag=EZCQDYZID3GR type=write size=3239093 2024-09-22T08:21:01.385 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.384+0000 7fe6c9c31780 1 > prepared part key=_multipart_ZFL9N44PBQX4.2~9DOP02NHKMT0.0 size=1031573 2024-09-22T08:21:01.385 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.384+0000 7fe6c9c31780 1 > prepared multipart upload key=ZFL9N44PBQX4 upload=9DOP02NHKMT0 tag=CHI2OU2VKLJY type=write size=2080149 2024-09-22T08:21:01.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.385+0000 7fe6c9c31780 1 < canceled part key=_multipart_T2W6RXP9UGHH.2~3ADFJ7YH99C2.0 size=1048576 2024-09-22T08:21:01.387 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.386+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~3ADFJ7YH99C2.1 size=232013 2024-09-22T08:21:01.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.389+0000 7fe6c9c31780 1 < canceled multipart upload key=T2W6RXP9UGHH upload=3ADFJ7YH99C2 tag=8ROBMQZK9SXY type=write size=2329165 2024-09-22T08:21:01.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.392+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~3PL9KI6NYTKN.0 size=1048576 2024-09-22T08:21:01.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.392+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~3PL9KI6NYTKN.1 size=923116 2024-09-22T08:21:01.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.392+0000 7fe6c9c31780 1 > prepared multipart upload key=VP1MP4IC9A7T upload=3PL9KI6NYTKN tag=T9LJYHOX8FAY type=write size=3020268 2024-09-22T08:21:01.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.394+0000 7fe6c9c31780 1 < completed delete operation key=GEWQUFB9K35E tag=G112CVR0F7NF type=del 2024-09-22T08:21:01.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.396+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~IBDDF7XTSN8T.0 size=1048576 2024-09-22T08:21:01.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.398+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~IBDDF7XTSN8T.1 size=1048576 2024-09-22T08:21:01.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.399+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~IBDDF7XTSN8T.2 size=106278 2024-09-22T08:21:01.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.399+0000 7fe6c9c31780 1 > prepared multipart upload key=OX1LY7URY7IV upload=IBDDF7XTSN8T tag=PLX3X0OTUDO0 type=write size=3252006 2024-09-22T08:21:01.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.401+0000 7fe6c9c31780 1 < completed delete operation key=LA6ZRVULGQ0H tag=KKUUDVO6MFZJ type=del 2024-09-22T08:21:01.404 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.403+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~2MTSXQKIS1Q8.0 size=1048576 2024-09-22T08:21:01.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.404+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~2MTSXQKIS1Q8.1 size=1048576 2024-09-22T08:21:01.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.406+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~2MTSXQKIS1Q8.2 size=139567 2024-09-22T08:21:01.407 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.406+0000 7fe6c9c31780 1 > prepared multipart upload key=FY40JTHLT0KU upload=2MTSXQKIS1Q8 tag=WAOF61LHH0ME type=write size=3285295 2024-09-22T08:21:01.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.407+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~L3YPSQ9EZ0I4.0 size=1048576 2024-09-22T08:21:01.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.408+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~L3YPSQ9EZ0I4.1 size=1048576 2024-09-22T08:21:01.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.408+0000 7fe6c9c31780 1 < canceled part key=_multipart_0TWY0NNZZ7NN.2~L3YPSQ9EZ0I4.2 size=99624 2024-09-22T08:21:01.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.412+0000 7fe6c9c31780 1 < canceled multipart upload key=0TWY0NNZZ7NN upload=L3YPSQ9EZ0I4 tag=5NUOY6IZ9YLK type=write size=3245352 2024-09-22T08:21:01.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.412+0000 7fe6c9c31780 1 > prepared operation key=VP1MP4IC9A7T tag=BURIHXSIHHAJ type=del size=1993998 2024-09-22T08:21:01.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.414+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~815AF4EHMCRS.0 size=1048576 2024-09-22T08:21:01.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.415+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~815AF4EHMCRS.1 size=975246 2024-09-22T08:21:01.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.418+0000 7fe6c9c31780 1 < completed multipart upload key=9FCSIF1WKBDJ upload=815AF4EHMCRS tag=M6YCO0OG2N81 type=write size=3072398 2024-09-22T08:21:01.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.421+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~DJZKHR0E1OAI.0 size=1048576 2024-09-22T08:21:01.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.422+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~DJZKHR0E1OAI.1 size=1048576 2024-09-22T08:21:01.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.423+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~DJZKHR0E1OAI.2 size=81982 2024-09-22T08:21:01.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.423+0000 7fe6c9c31780 1 > prepared multipart upload key=D85LJGGU3Z6F upload=DJZKHR0E1OAI tag=RO0P4QFLRMA9 type=write size=3227710 2024-09-22T08:21:01.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.425+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~SG1VGA2H0KEC.0 size=1048576 2024-09-22T08:21:01.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.426+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~SG1VGA2H0KEC.1 size=1048576 2024-09-22T08:21:01.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.427+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~SG1VGA2H0KEC.2 size=351078 2024-09-22T08:21:01.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.430+0000 7fe6c9c31780 1 < completed multipart upload key=XJP26CCPYDI7 upload=SG1VGA2H0KEC tag=42FVLG7AW5MM type=write size=3496806 2024-09-22T08:21:01.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.432+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=LT7DEVWXKKBS type=del size=1351306 2024-09-22T08:21:01.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.433+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~9HPZN2FV7DDJ.0 size=102598 2024-09-22T08:21:01.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.436+0000 7fe6c9c31780 1 < completed multipart upload key=VP1MP4IC9A7T upload=9HPZN2FV7DDJ tag=2PAR9WOHLUXX type=write size=1151174 2024-09-22T08:21:01.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.437+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=DPX0DOBWD0DV type=write size=704873 2024-09-22T08:21:01.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.439+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~BZHUWN2B9NWL.0 size=1048576 2024-09-22T08:21:01.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.440+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~BZHUWN2B9NWL.1 size=1048576 2024-09-22T08:21:01.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.441+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~BZHUWN2B9NWL.2 size=634931 2024-09-22T08:21:01.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.444+0000 7fe6c9c31780 1 < completed multipart upload key=OX1LY7URY7IV upload=BZHUWN2B9NWL tag=7DGJM11H59FH type=write size=3780659 2024-09-22T08:21:01.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.445+0000 7fe6c9c31780 1 > prepared operation key=FY40JTHLT0KU tag=RJ6XDZOWI2W2 type=del size=1723475 2024-09-22T08:21:01.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.447+0000 7fe6c9c31780 1 < completed delete operation key=VP1MP4IC9A7T tag=SQFLOV9XKNW8 type=del 2024-09-22T08:21:01.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.449+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~MAZQJX8C1K0X.0 size=1048576 2024-09-22T08:21:01.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.451+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~MAZQJX8C1K0X.1 size=1048576 2024-09-22T08:21:01.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.452+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~MAZQJX8C1K0X.2 size=788632 2024-09-22T08:21:01.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.452+0000 7fe6c9c31780 1 > prepared multipart upload key=FY40JTHLT0KU upload=MAZQJX8C1K0X tag=C4ELL6LK9HFR type=write size=3934360 2024-09-22T08:21:01.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.453+0000 7fe6c9c31780 1 < completed delete operation key=76HZ3LZGVT9J tag=IPMSH5XN2S94 type=del 2024-09-22T08:21:01.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.456+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~7W3784TMAYRY.0 size=1048576 2024-09-22T08:21:01.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.457+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~7W3784TMAYRY.1 size=1048576 2024-09-22T08:21:01.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.458+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~7W3784TMAYRY.2 size=965899 2024-09-22T08:21:01.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.458+0000 7fe6c9c31780 1 > prepared multipart upload key=TYVQ39KUV2V9 upload=7W3784TMAYRY tag=EN13AR9IN28K type=write size=4111627 2024-09-22T08:21:01.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.459+0000 7fe6c9c31780 1 < completed part key=_multipart_DC7VLQWZ3TD1.2~P8ZLOZV7L1UR.0 size=564918 2024-09-22T08:21:01.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.462+0000 7fe6c9c31780 1 < completed multipart upload key=DC7VLQWZ3TD1 upload=P8ZLOZV7L1UR tag=Q687G5QJR7UE type=write size=1613494 2024-09-22T08:21:01.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.464+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=FBXW3WIPA1CR type=write size=537490 2024-09-22T08:21:01.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.465+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~5IJOD01V6CWP.0 size=1048576 2024-09-22T08:21:01.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.466+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~5IJOD01V6CWP.1 size=788120 2024-09-22T08:21:01.469 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.469+0000 7fe6c9c31780 1 < completed multipart upload key=D85LJGGU3Z6F upload=5IJOD01V6CWP tag=SKHC16ZRFW0Q type=write size=2885272 2024-09-22T08:21:01.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.470+0000 7fe6c9c31780 1 > prepared operation key=D85LJGGU3Z6F tag=82USBILAOVUL type=del size=3619957 2024-09-22T08:21:01.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.473+0000 7fe6c9c31780 1 < suggested remove operation key=ILW34WLX48WN tag=OXFJ7EMRYSP9 type=write 2024-09-22T08:21:01.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.474+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=C0YUC8LW0FB5 type=del size=1587107 2024-09-22T08:21:01.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.477+0000 7fe6c9c31780 1 < suggested remove operation key=CTK01Y0CV1NC tag=LCKHH73JELYC type=del 2024-09-22T08:21:01.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.478+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=MU0M6RJA3FYP type=del size=3350384 2024-09-22T08:21:01.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.481+0000 7fe6c9c31780 1 < suggested update operation key=6BKB91YV3FMW tag=C0RCDHXSAMGS type=write size=239900 2024-09-22T08:21:01.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.484+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~6ACU3H4ZNNES.0 size=1048576 2024-09-22T08:21:01.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.485+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~6ACU3H4ZNNES.1 size=1048576 2024-09-22T08:21:01.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.486+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~6ACU3H4ZNNES.2 size=609355 2024-09-22T08:21:01.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.486+0000 7fe6c9c31780 1 > prepared multipart upload key=2B5QRUMTVE7U upload=6ACU3H4ZNNES tag=YR2FEBGVZHCM type=write size=3755083 2024-09-22T08:21:01.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.487+0000 7fe6c9c31780 1 < completed part key=_multipart_ZFL9N44PBQX4.2~9DOP02NHKMT0.0 size=1031573 2024-09-22T08:21:01.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.489+0000 7fe6c9c31780 1 < completed multipart upload key=ZFL9N44PBQX4 upload=9DOP02NHKMT0 tag=CHI2OU2VKLJY type=write size=2080149 2024-09-22T08:21:01.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.492+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~I7QWMP8KWAC8.0 size=1048576 2024-09-22T08:21:01.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.493+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~I7QWMP8KWAC8.1 size=1048576 2024-09-22T08:21:01.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.494+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~I7QWMP8KWAC8.2 size=552731 2024-09-22T08:21:01.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.494+0000 7fe6c9c31780 1 > prepared multipart upload key=D85LJGGU3Z6F upload=I7QWMP8KWAC8 tag=K31O1AQPVOT5 type=write size=3698459 2024-09-22T08:21:01.496 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.495+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~3PL9KI6NYTKN.0 size=1048576 2024-09-22T08:21:01.497 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.496+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~3PL9KI6NYTKN.1 size=923116 2024-09-22T08:21:01.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.499+0000 7fe6c9c31780 1 < completed multipart upload key=VP1MP4IC9A7T upload=3PL9KI6NYTKN tag=T9LJYHOX8FAY type=write size=3020268 2024-09-22T08:21:01.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.501+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~UOG4961ZJZTD.0 size=360801 2024-09-22T08:21:01.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.501+0000 7fe6c9c31780 1 > prepared multipart upload key=2B5QRUMTVE7U upload=UOG4961ZJZTD tag=5KC556I18Q5T type=write size=1409377 2024-09-22T08:21:01.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.502+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~IBDDF7XTSN8T.0 size=1048576 2024-09-22T08:21:01.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.504+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~IBDDF7XTSN8T.1 size=1048576 2024-09-22T08:21:01.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.505+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~IBDDF7XTSN8T.2 size=106278 2024-09-22T08:21:01.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.507+0000 7fe6c9c31780 1 < completed multipart upload key=OX1LY7URY7IV upload=IBDDF7XTSN8T tag=PLX3X0OTUDO0 type=write size=3252006 2024-09-22T08:21:01.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.510+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~1DMHGZ6E4RZ5.0 size=1048576 2024-09-22T08:21:01.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.511+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~1DMHGZ6E4RZ5.1 size=1048576 2024-09-22T08:21:01.513 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.512+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~1DMHGZ6E4RZ5.2 size=537641 2024-09-22T08:21:01.513 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.512+0000 7fe6c9c31780 1 > prepared multipart upload key=9FCSIF1WKBDJ upload=1DMHGZ6E4RZ5 tag=1O8VYEG5WLKY type=write size=3683369 2024-09-22T08:21:01.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.514+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~2MTSXQKIS1Q8.0 size=1048576 2024-09-22T08:21:01.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.515+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~2MTSXQKIS1Q8.1 size=1048576 2024-09-22T08:21:01.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.515+0000 7fe6c9c31780 1 < canceled part key=_multipart_FY40JTHLT0KU.2~2MTSXQKIS1Q8.2 size=139567 2024-09-22T08:21:01.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.517+0000 7fe6c9c31780 1 < canceled multipart upload key=FY40JTHLT0KU upload=2MTSXQKIS1Q8 tag=WAOF61LHH0ME type=write size=3285295 2024-09-22T08:21:01.521 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.519+0000 7fe6c9c31780 1 > prepared operation key=LA6ZRVULGQ0H tag=QHP0741ZYY3X type=write size=297349 2024-09-22T08:21:01.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.521+0000 7fe6c9c31780 1 < suggested update operation key=VP1MP4IC9A7T tag=BURIHXSIHHAJ type=del size=1993998 2024-09-22T08:21:01.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.525+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~DROXQ43G9KV5.0 size=1048576 2024-09-22T08:21:01.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.527+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~DROXQ43G9KV5.1 size=1048576 2024-09-22T08:21:01.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.529+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~DROXQ43G9KV5.2 size=936783 2024-09-22T08:21:01.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.529+0000 7fe6c9c31780 1 > prepared multipart upload key=JT5AB8VLMEFD upload=DROXQ43G9KV5 tag=16DFOEUBJQ2B type=write size=4082511 2024-09-22T08:21:01.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.529+0000 7fe6c9c31780 1 < canceled part key=_multipart_D85LJGGU3Z6F.2~DJZKHR0E1OAI.0 size=1048576 2024-09-22T08:21:01.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.530+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~DJZKHR0E1OAI.1 size=1048576 2024-09-22T08:21:01.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.532+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~DJZKHR0E1OAI.2 size=81982 2024-09-22T08:21:01.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.534+0000 7fe6c9c31780 1 < canceled multipart upload key=D85LJGGU3Z6F upload=DJZKHR0E1OAI tag=RO0P4QFLRMA9 type=write size=3227710 2024-09-22T08:21:01.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.536+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=XS7GSGPIDHRS type=del size=2814618 2024-09-22T08:21:01.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.537+0000 7fe6c9c31780 -1 < failed to complete operation key=CTK01Y0CV1NC tag=LT7DEVWXKKBS type=del size=1351306: (22) Invalid argument 2024-09-22T08:21:01.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.539+0000 7fe6c9c31780 1 > prepared operation key=4KRJ7DTE3KDV tag=C4LJTW2U18ZG type=del size=3539827 2024-09-22T08:21:01.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.540+0000 7fe6c9c31780 1 < completed write operation key=9AZWQ9E58QS6 tag=DPX0DOBWD0DV type=write size=704873 2024-09-22T08:21:01.542 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.542+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=B2W2MZKEE7O4 type=write size=530929 2024-09-22T08:21:01.544 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.543+0000 7fe6c9c31780 1 < completed delete operation key=FY40JTHLT0KU tag=RJ6XDZOWI2W2 type=del 2024-09-22T08:21:01.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.546+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~ES0F7W3WLJ75.0 size=697869 2024-09-22T08:21:01.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.546+0000 7fe6c9c31780 1 > prepared multipart upload key=T2W6RXP9UGHH upload=ES0F7W3WLJ75 tag=6Y1GHQJVEY2X type=write size=1746445 2024-09-22T08:21:01.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.548+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~MAZQJX8C1K0X.0 size=1048576 2024-09-22T08:21:01.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.549+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~MAZQJX8C1K0X.1 size=1048576 2024-09-22T08:21:01.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.550+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~MAZQJX8C1K0X.2 size=788632 2024-09-22T08:21:01.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.552+0000 7fe6c9c31780 1 < completed multipart upload key=FY40JTHLT0KU upload=MAZQJX8C1K0X tag=C4ELL6LK9HFR type=write size=3934360 2024-09-22T08:21:01.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.556+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~L33XJ9H9U1DJ.0 size=1048576 2024-09-22T08:21:01.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.557+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~L33XJ9H9U1DJ.1 size=763432 2024-09-22T08:21:01.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.557+0000 7fe6c9c31780 1 > prepared multipart upload key=XJP26CCPYDI7 upload=L33XJ9H9U1DJ tag=5DTK6IF0H73V type=write size=2860584 2024-09-22T08:21:01.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.559+0000 7fe6c9c31780 1 < completed part key=_multipart_TYVQ39KUV2V9.2~7W3784TMAYRY.0 size=1048576 2024-09-22T08:21:01.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.559+0000 7fe6c9c31780 1 < canceled part key=_multipart_TYVQ39KUV2V9.2~7W3784TMAYRY.1 size=1048576 2024-09-22T08:21:01.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.559+0000 7fe6c9c31780 1 < completed part key=_multipart_TYVQ39KUV2V9.2~7W3784TMAYRY.2 size=965899 2024-09-22T08:21:01.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.562+0000 7fe6c9c31780 1 < canceled multipart upload key=TYVQ39KUV2V9 upload=7W3784TMAYRY tag=EN13AR9IN28K type=write size=4111627 2024-09-22T08:21:01.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.564+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=3FR8040JV3GM type=del size=3115718 2024-09-22T08:21:01.566 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.566+0000 7fe6c9c31780 1 < completed write operation key=R7UWMW913DJQ tag=FBXW3WIPA1CR type=write size=537490 2024-09-22T08:21:01.569 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.568+0000 7fe6c9c31780 1 > prepared part key=_multipart_W9L87PTJEIOA.2~FJP8J4ZG3O31.0 size=1048576 2024-09-22T08:21:01.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.570+0000 7fe6c9c31780 1 > prepared part key=_multipart_W9L87PTJEIOA.2~FJP8J4ZG3O31.1 size=1048576 2024-09-22T08:21:01.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.571+0000 7fe6c9c31780 1 > prepared part key=_multipart_W9L87PTJEIOA.2~FJP8J4ZG3O31.2 size=596314 2024-09-22T08:21:01.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.571+0000 7fe6c9c31780 1 > prepared multipart upload key=W9L87PTJEIOA upload=FJP8J4ZG3O31 tag=R3XSYAOTOMHM type=write size=3742042 2024-09-22T08:21:01.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.572+0000 7fe6c9c31780 1 < completed delete operation key=D85LJGGU3Z6F tag=82USBILAOVUL type=del 2024-09-22T08:21:01.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.574+0000 7fe6c9c31780 1 > prepared operation key=ZFL9N44PBQX4 tag=CI9BHFCZ00OS type=del size=5153 2024-09-22T08:21:01.576 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.575+0000 7fe6c9c31780 1 < completed delete operation key=7446WN19QFV0 tag=C0YUC8LW0FB5 type=del 2024-09-22T08:21:01.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.577+0000 7fe6c9c31780 1 > prepared operation key=LA6ZRVULGQ0H tag=PIZZ2X0AK5FQ type=write size=602471 2024-09-22T08:21:01.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.578+0000 7fe6c9c31780 1 < completed delete operation key=9AZWQ9E58QS6 tag=MU0M6RJA3FYP type=del 2024-09-22T08:21:01.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.581+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~PYQBIT59S06L.0 size=1048576 2024-09-22T08:21:01.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.582+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~PYQBIT59S06L.1 size=1048576 2024-09-22T08:21:01.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.583+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~PYQBIT59S06L.2 size=863902 2024-09-22T08:21:01.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.583+0000 7fe6c9c31780 1 > prepared multipart upload key=FY40JTHLT0KU upload=PYQBIT59S06L tag=GXGLA47PZSQD type=write size=4009630 2024-09-22T08:21:01.585 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.584+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~6ACU3H4ZNNES.0 size=1048576 2024-09-22T08:21:01.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.585+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~6ACU3H4ZNNES.1 size=1048576 2024-09-22T08:21:01.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.587+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~6ACU3H4ZNNES.2 size=609355 2024-09-22T08:21:01.590 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.589+0000 7fe6c9c31780 1 < completed multipart upload key=2B5QRUMTVE7U upload=6ACU3H4ZNNES tag=YR2FEBGVZHCM type=write size=3755083 2024-09-22T08:21:01.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.591+0000 7fe6c9c31780 1 > prepared operation key=TYVQ39KUV2V9 tag=OTIATRQEOJ2U type=del size=3151478 2024-09-22T08:21:01.593 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.592+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~I7QWMP8KWAC8.0 size=1048576 2024-09-22T08:21:01.594 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.593+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~I7QWMP8KWAC8.1 size=1048576 2024-09-22T08:21:01.595 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.594+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~I7QWMP8KWAC8.2 size=552731 2024-09-22T08:21:01.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.597+0000 7fe6c9c31780 1 < completed multipart upload key=D85LJGGU3Z6F upload=I7QWMP8KWAC8 tag=K31O1AQPVOT5 type=write size=3698459 2024-09-22T08:21:01.599 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.598+0000 7fe6c9c31780 1 > prepared operation key=OX1LY7URY7IV tag=R4A2UA6DD528 type=del size=1198035 2024-09-22T08:21:01.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.600+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~UOG4961ZJZTD.0 size=360801 2024-09-22T08:21:01.603 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.602+0000 7fe6c9c31780 1 < completed multipart upload key=2B5QRUMTVE7U upload=UOG4961ZJZTD tag=5KC556I18Q5T type=write size=1409377 2024-09-22T08:21:01.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.605+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~KWMA4JN0UTLW.0 size=1048576 2024-09-22T08:21:01.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.606+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~KWMA4JN0UTLW.1 size=38053 2024-09-22T08:21:01.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.606+0000 7fe6c9c31780 1 > prepared multipart upload key=T2W6RXP9UGHH upload=KWMA4JN0UTLW tag=CK68ES9U3YM9 type=write size=2135205 2024-09-22T08:21:01.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.607+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~1DMHGZ6E4RZ5.0 size=1048576 2024-09-22T08:21:01.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.608+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~1DMHGZ6E4RZ5.1 size=1048576 2024-09-22T08:21:01.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.610+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~1DMHGZ6E4RZ5.2 size=537641 2024-09-22T08:21:01.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.612+0000 7fe6c9c31780 1 < completed multipart upload key=9FCSIF1WKBDJ upload=1DMHGZ6E4RZ5 tag=1O8VYEG5WLKY type=write size=3683369 2024-09-22T08:21:01.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.613+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=0EYAQPPIPROI type=del size=3709963 2024-09-22T08:21:01.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.617+0000 7fe6c9c31780 1 < suggested update operation key=LA6ZRVULGQ0H tag=QHP0741ZYY3X type=write size=297349 2024-09-22T08:21:01.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.619+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~XYWE148ZBKHH.0 size=1048576 2024-09-22T08:21:01.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.620+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~XYWE148ZBKHH.1 size=1048576 2024-09-22T08:21:01.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.622+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~XYWE148ZBKHH.2 size=902018 2024-09-22T08:21:01.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.622+0000 7fe6c9c31780 1 > prepared multipart upload key=JT5AB8VLMEFD upload=XYWE148ZBKHH tag=FKA7K4V5EJV2 type=write size=4047746 2024-09-22T08:21:01.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.622+0000 7fe6c9c31780 1 < canceled part key=_multipart_JT5AB8VLMEFD.2~DROXQ43G9KV5.0 size=1048576 2024-09-22T08:21:01.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.623+0000 7fe6c9c31780 1 < completed part key=_multipart_JT5AB8VLMEFD.2~DROXQ43G9KV5.1 size=1048576 2024-09-22T08:21:01.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.624+0000 7fe6c9c31780 1 < completed part key=_multipart_JT5AB8VLMEFD.2~DROXQ43G9KV5.2 size=936783 2024-09-22T08:21:01.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.627+0000 7fe6c9c31780 1 < canceled multipart upload key=JT5AB8VLMEFD upload=DROXQ43G9KV5 tag=16DFOEUBJQ2B type=write size=4082511 2024-09-22T08:21:01.629 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.629+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~GV2SQBBBR3FO.0 size=353246 2024-09-22T08:21:01.629 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.629+0000 7fe6c9c31780 1 > prepared multipart upload key=TYVQ39KUV2V9 upload=GV2SQBBBR3FO tag=WZY5BXFLN7EH type=write size=1401822 2024-09-22T08:21:01.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.632+0000 7fe6c9c31780 1 < suggested remove operation key=9AZWQ9E58QS6 tag=XS7GSGPIDHRS type=del 2024-09-22T08:21:01.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.633+0000 7fe6c9c31780 1 > prepared operation key=4KRJ7DTE3KDV tag=1P95T9XJ2AKK type=del size=200654 2024-09-22T08:21:01.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.634+0000 7fe6c9c31780 1 < completed delete operation key=4KRJ7DTE3KDV tag=C4LJTW2U18ZG type=del 2024-09-22T08:21:01.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.637+0000 7fe6c9c31780 1 > prepared part key=_multipart_9AZWQ9E58QS6.2~94X38Y2FLOBE.0 size=34934 2024-09-22T08:21:01.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.637+0000 7fe6c9c31780 1 > prepared multipart upload key=9AZWQ9E58QS6 upload=94X38Y2FLOBE tag=TF40Z1C6TQ7Q type=write size=1083510 2024-09-22T08:21:01.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.640+0000 7fe6c9c31780 1 < suggested remove operation key=2B5QRUMTVE7U tag=B2W2MZKEE7O4 type=write 2024-09-22T08:21:01.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.642+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~S5XRC4IFGRRW.0 size=1048576 2024-09-22T08:21:01.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.643+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~S5XRC4IFGRRW.1 size=1048576 2024-09-22T08:21:01.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.644+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~S5XRC4IFGRRW.2 size=411816 2024-09-22T08:21:01.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.644+0000 7fe6c9c31780 1 > prepared multipart upload key=VP1MP4IC9A7T upload=S5XRC4IFGRRW tag=44Y4C396L4PC type=write size=3557544 2024-09-22T08:21:01.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.646+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~ES0F7W3WLJ75.0 size=697869 2024-09-22T08:21:01.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.648+0000 7fe6c9c31780 1 < completed multipart upload key=T2W6RXP9UGHH upload=ES0F7W3WLJ75 tag=6Y1GHQJVEY2X type=write size=1746445 2024-09-22T08:21:01.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.650+0000 7fe6c9c31780 1 > prepared operation key=VP1MP4IC9A7T tag=5JCAT8LSOPFH type=write size=500024 2024-09-22T08:21:01.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.651+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~L33XJ9H9U1DJ.0 size=1048576 2024-09-22T08:21:01.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.652+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~L33XJ9H9U1DJ.1 size=763432 2024-09-22T08:21:01.655 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.655+0000 7fe6c9c31780 1 < completed multipart upload key=XJP26CCPYDI7 upload=L33XJ9H9U1DJ tag=5DTK6IF0H73V type=write size=2860584 2024-09-22T08:21:01.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.658+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~IB7688LF3RSK.0 size=1048576 2024-09-22T08:21:01.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.659+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~IB7688LF3RSK.1 size=1048576 2024-09-22T08:21:01.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.659+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~IB7688LF3RSK.2 size=124856 2024-09-22T08:21:01.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.659+0000 7fe6c9c31780 1 > prepared multipart upload key=FY40JTHLT0KU upload=IB7688LF3RSK tag=1O61C2AAZJH2 type=write size=3270584 2024-09-22T08:21:01.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.661+0000 7fe6c9c31780 1 < completed delete operation key=TE10GB1F35X4 tag=3FR8040JV3GM type=del 2024-09-22T08:21:01.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.663+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=A1CQ36U7E5UK type=write size=616205 2024-09-22T08:21:01.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.664+0000 7fe6c9c31780 1 < completed part key=_multipart_W9L87PTJEIOA.2~FJP8J4ZG3O31.0 size=1048576 2024-09-22T08:21:01.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.666+0000 7fe6c9c31780 1 < completed part key=_multipart_W9L87PTJEIOA.2~FJP8J4ZG3O31.1 size=1048576 2024-09-22T08:21:01.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.668+0000 7fe6c9c31780 1 < completed part key=_multipart_W9L87PTJEIOA.2~FJP8J4ZG3O31.2 size=596314 2024-09-22T08:21:01.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.670+0000 7fe6c9c31780 1 < completed multipart upload key=W9L87PTJEIOA upload=FJP8J4ZG3O31 tag=R3XSYAOTOMHM type=write size=3742042 2024-09-22T08:21:01.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.673+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~4VZ5JKFQUXGL.0 size=1048576 2024-09-22T08:21:01.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.674+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~4VZ5JKFQUXGL.1 size=1048576 2024-09-22T08:21:01.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.675+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~4VZ5JKFQUXGL.2 size=253549 2024-09-22T08:21:01.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.675+0000 7fe6c9c31780 1 > prepared multipart upload key=TE10GB1F35X4 upload=4VZ5JKFQUXGL tag=YHIZAIY5P142 type=write size=3399277 2024-09-22T08:21:01.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.677+0000 7fe6c9c31780 1 < completed delete operation key=ZFL9N44PBQX4 tag=CI9BHFCZ00OS type=del 2024-09-22T08:21:01.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.678+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=DWRN71P9C0MQ type=del size=325668 2024-09-22T08:21:01.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.681+0000 7fe6c9c31780 -1 < failed to complete operation key=LA6ZRVULGQ0H tag=PIZZ2X0AK5FQ type=write size=602471: (22) Invalid argument 2024-09-22T08:21:01.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.685+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~5GR079H62NRV.0 size=1048576 2024-09-22T08:21:01.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.685+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~5GR079H62NRV.1 size=58334 2024-09-22T08:21:01.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.685+0000 7fe6c9c31780 1 > prepared multipart upload key=Z1CK5EDBK4AW upload=5GR079H62NRV tag=43WPD5KWRZGH type=write size=2155486 2024-09-22T08:21:01.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.688+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~PYQBIT59S06L.0 size=1048576 2024-09-22T08:21:01.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.688+0000 7fe6c9c31780 1 < canceled part key=_multipart_FY40JTHLT0KU.2~PYQBIT59S06L.1 size=1048576 2024-09-22T08:21:01.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.688+0000 7fe6c9c31780 1 < canceled part key=_multipart_FY40JTHLT0KU.2~PYQBIT59S06L.2 size=863902 2024-09-22T08:21:01.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.690+0000 7fe6c9c31780 1 < canceled multipart upload key=FY40JTHLT0KU upload=PYQBIT59S06L tag=GXGLA47PZSQD type=write size=4009630 2024-09-22T08:21:01.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.693+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~2J73MSKBRQSC.0 size=749251 2024-09-22T08:21:01.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.693+0000 7fe6c9c31780 1 > prepared multipart upload key=FY40JTHLT0KU upload=2J73MSKBRQSC tag=QFZPMW63E9M6 type=write size=1797827 2024-09-22T08:21:01.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.695+0000 7fe6c9c31780 1 < canceled operation key=TYVQ39KUV2V9 tag=OTIATRQEOJ2U type=del size=3151478 2024-09-22T08:21:01.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.696+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=0JI2330S5X4S type=del size=2410983 2024-09-22T08:21:01.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.699+0000 7fe6c9c31780 1 < suggested update operation key=OX1LY7URY7IV tag=R4A2UA6DD528 type=del size=1198035 2024-09-22T08:21:01.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.701+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=DIM1T72DAKXN type=del size=792942 2024-09-22T08:21:01.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.703+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~KWMA4JN0UTLW.0 size=1048576 2024-09-22T08:21:01.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.704+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~KWMA4JN0UTLW.1 size=38053 2024-09-22T08:21:01.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.706+0000 7fe6c9c31780 1 < completed multipart upload key=T2W6RXP9UGHH upload=KWMA4JN0UTLW tag=CK68ES9U3YM9 type=write size=2135205 2024-09-22T08:21:01.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.708+0000 7fe6c9c31780 1 > prepared operation key=FY40JTHLT0KU tag=244YRIYBTNQ0 type=write size=731671 2024-09-22T08:21:01.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.711+0000 7fe6c9c31780 1 < suggested update operation key=DC7VLQWZ3TD1 tag=0EYAQPPIPROI type=del size=3709963 2024-09-22T08:21:01.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.712+0000 7fe6c9c31780 1 > prepared operation key=OX1LY7URY7IV tag=DVCIY5OSYYIL type=del size=621779 2024-09-22T08:21:01.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.713+0000 7fe6c9c31780 1 < completed part key=_multipart_JT5AB8VLMEFD.2~XYWE148ZBKHH.0 size=1048576 2024-09-22T08:21:01.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.715+0000 7fe6c9c31780 1 < completed part key=_multipart_JT5AB8VLMEFD.2~XYWE148ZBKHH.1 size=1048576 2024-09-22T08:21:01.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.716+0000 7fe6c9c31780 1 < completed part key=_multipart_JT5AB8VLMEFD.2~XYWE148ZBKHH.2 size=902018 2024-09-22T08:21:01.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.718+0000 7fe6c9c31780 1 < completed multipart upload key=JT5AB8VLMEFD upload=XYWE148ZBKHH tag=FKA7K4V5EJV2 type=write size=4047746 2024-09-22T08:21:01.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.721+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~Q2ZY2AUO9I22.0 size=1048576 2024-09-22T08:21:01.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.722+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~Q2ZY2AUO9I22.1 size=1048576 2024-09-22T08:21:01.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.723+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~Q2ZY2AUO9I22.2 size=457628 2024-09-22T08:21:01.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.723+0000 7fe6c9c31780 1 > prepared multipart upload key=76HZ3LZGVT9J upload=Q2ZY2AUO9I22 tag=P1GXI3JTSXWT type=write size=3603356 2024-09-22T08:21:01.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.724+0000 7fe6c9c31780 1 < completed part key=_multipart_TYVQ39KUV2V9.2~GV2SQBBBR3FO.0 size=353246 2024-09-22T08:21:01.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.727+0000 7fe6c9c31780 1 < completed multipart upload key=TYVQ39KUV2V9 upload=GV2SQBBBR3FO tag=WZY5BXFLN7EH type=write size=1401822 2024-09-22T08:21:01.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.729+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~CZKC0ZXG2LC0.0 size=975155 2024-09-22T08:21:01.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.729+0000 7fe6c9c31780 1 > prepared multipart upload key=TYVQ39KUV2V9 upload=CZKC0ZXG2LC0 tag=9ZV8UWID145T type=write size=2023731 2024-09-22T08:21:01.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.731+0000 7fe6c9c31780 1 < completed delete operation key=4KRJ7DTE3KDV tag=1P95T9XJ2AKK type=del 2024-09-22T08:21:01.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.733+0000 7fe6c9c31780 1 > prepared part key=_multipart_ZFL9N44PBQX4.2~GJFXN0R6M6QQ.0 size=1048576 2024-09-22T08:21:01.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.735+0000 7fe6c9c31780 1 > prepared part key=_multipart_ZFL9N44PBQX4.2~GJFXN0R6M6QQ.1 size=1048576 2024-09-22T08:21:01.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.736+0000 7fe6c9c31780 1 > prepared part key=_multipart_ZFL9N44PBQX4.2~GJFXN0R6M6QQ.2 size=978340 2024-09-22T08:21:01.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.736+0000 7fe6c9c31780 1 > prepared multipart upload key=ZFL9N44PBQX4 upload=GJFXN0R6M6QQ tag=NIIT6EZO92SZ type=write size=4124068 2024-09-22T08:21:01.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.737+0000 7fe6c9c31780 1 < completed part key=_multipart_9AZWQ9E58QS6.2~94X38Y2FLOBE.0 size=34934 2024-09-22T08:21:01.741 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.740+0000 7fe6c9c31780 1 < completed multipart upload key=9AZWQ9E58QS6 upload=94X38Y2FLOBE tag=TF40Z1C6TQ7Q type=write size=1083510 2024-09-22T08:21:01.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.742+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=BW8P0EKCP2S0 type=del size=830450 2024-09-22T08:21:01.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.744+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~S5XRC4IFGRRW.0 size=1048576 2024-09-22T08:21:01.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.745+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~S5XRC4IFGRRW.1 size=1048576 2024-09-22T08:21:01.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.745+0000 7fe6c9c31780 1 < canceled part key=_multipart_VP1MP4IC9A7T.2~S5XRC4IFGRRW.2 size=411816 2024-09-22T08:21:01.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.747+0000 7fe6c9c31780 1 < canceled multipart upload key=VP1MP4IC9A7T upload=S5XRC4IFGRRW tag=44Y4C396L4PC type=write size=3557544 2024-09-22T08:21:01.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.750+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~R7FNH1Z74UCQ.0 size=551741 2024-09-22T08:21:01.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.750+0000 7fe6c9c31780 1 > prepared multipart upload key=0PNK2ZW6IJM1 upload=R7FNH1Z74UCQ tag=FHV0HS30DIQN type=write size=1600317 2024-09-22T08:21:01.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.753+0000 7fe6c9c31780 1 < suggested update operation key=VP1MP4IC9A7T tag=5JCAT8LSOPFH type=write size=500024 2024-09-22T08:21:01.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.756+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~S1NPIWYPSB2U.0 size=217627 2024-09-22T08:21:01.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.756+0000 7fe6c9c31780 1 > prepared multipart upload key=0PNK2ZW6IJM1 upload=S1NPIWYPSB2U tag=496JK4V0SFCJ type=write size=1266203 2024-09-22T08:21:01.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.757+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~IB7688LF3RSK.0 size=1048576 2024-09-22T08:21:01.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.758+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~IB7688LF3RSK.1 size=1048576 2024-09-22T08:21:01.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.759+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~IB7688LF3RSK.2 size=124856 2024-09-22T08:21:01.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.762+0000 7fe6c9c31780 1 < completed multipart upload key=FY40JTHLT0KU upload=IB7688LF3RSK tag=1O61C2AAZJH2 type=write size=3270584 2024-09-22T08:21:01.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.763+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=VZV6MMPY6BRK type=del size=1351778 2024-09-22T08:21:01.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.767+0000 7fe6c9c31780 1 < suggested update operation key=2B5QRUMTVE7U tag=A1CQ36U7E5UK type=write size=616205 2024-09-22T08:21:01.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.768+0000 7fe6c9c31780 1 > prepared operation key=FY40JTHLT0KU tag=3NM2KMMUMS2U type=del size=2245801 2024-09-22T08:21:01.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.770+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~4VZ5JKFQUXGL.0 size=1048576 2024-09-22T08:21:01.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.771+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~4VZ5JKFQUXGL.1 size=1048576 2024-09-22T08:21:01.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.771+0000 7fe6c9c31780 1 < canceled part key=_multipart_TE10GB1F35X4.2~4VZ5JKFQUXGL.2 size=253549 2024-09-22T08:21:01.774 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.773+0000 7fe6c9c31780 1 < canceled multipart upload key=TE10GB1F35X4 upload=4VZ5JKFQUXGL tag=YHIZAIY5P142 type=write size=3399277 2024-09-22T08:21:01.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.775+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=ML08E39AH99H type=del size=231075 2024-09-22T08:21:01.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.778+0000 7fe6c9c31780 1 < suggested update operation key=946H8F2AUPO2 tag=DWRN71P9C0MQ type=del size=325668 2024-09-22T08:21:01.780 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.779+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=FN5TPD00ZA82 type=del size=1466502 2024-09-22T08:21:01.781 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.781+0000 7fe6c9c31780 1 < completed part key=_multipart_Z1CK5EDBK4AW.2~5GR079H62NRV.0 size=1048576 2024-09-22T08:21:01.782 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.782+0000 7fe6c9c31780 1 < completed part key=_multipart_Z1CK5EDBK4AW.2~5GR079H62NRV.1 size=58334 2024-09-22T08:21:01.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.784+0000 7fe6c9c31780 1 < completed multipart upload key=Z1CK5EDBK4AW upload=5GR079H62NRV tag=43WPD5KWRZGH type=write size=2155486 2024-09-22T08:21:01.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.786+0000 7fe6c9c31780 1 > prepared operation key=O1UBUQXP50CN tag=5I37EI95016T type=del size=678088 2024-09-22T08:21:01.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.787+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~2J73MSKBRQSC.0 size=749251 2024-09-22T08:21:01.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.790+0000 7fe6c9c31780 1 < completed multipart upload key=FY40JTHLT0KU upload=2J73MSKBRQSC tag=QFZPMW63E9M6 type=write size=1797827 2024-09-22T08:21:01.793 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.792+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~KSRKWYO7KLT3.0 size=25199 2024-09-22T08:21:01.793 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.792+0000 7fe6c9c31780 1 > prepared multipart upload key=TE10GB1F35X4 upload=KSRKWYO7KLT3 tag=Q2S5AVZQKTJF type=write size=1073775 2024-09-22T08:21:01.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.794+0000 7fe6c9c31780 1 < completed delete operation key=ILW34WLX48WN tag=0JI2330S5X4S type=del 2024-09-22T08:21:01.796 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.795+0000 7fe6c9c31780 1 > prepared operation key=LA6ZRVULGQ0H tag=UDM1P5QUM8MB type=del size=3283911 2024-09-22T08:21:01.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.799+0000 7fe6c9c31780 1 < suggested remove operation key=946H8F2AUPO2 tag=DIM1T72DAKXN type=del 2024-09-22T08:21:01.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.801+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~G4HG9RJJGTK1.0 size=1048576 2024-09-22T08:21:01.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.803+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~G4HG9RJJGTK1.1 size=1048183 2024-09-22T08:21:01.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.803+0000 7fe6c9c31780 1 > prepared multipart upload key=76HZ3LZGVT9J upload=G4HG9RJJGTK1 tag=5DNCZR7S8157 type=write size=3145335 2024-09-22T08:21:01.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.804+0000 7fe6c9c31780 1 < canceled operation key=FY40JTHLT0KU tag=244YRIYBTNQ0 type=write size=731671 2024-09-22T08:21:01.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.806+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=QU3URWDLB19F type=del size=2735393 2024-09-22T08:21:01.808 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.807+0000 7fe6c9c31780 1 < completed delete operation key=OX1LY7URY7IV tag=DVCIY5OSYYIL type=del 2024-09-22T08:21:01.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.809+0000 7fe6c9c31780 1 > prepared operation key=Z1CK5EDBK4AW tag=DOUELE5BOJO4 type=write size=880479 2024-09-22T08:21:01.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.810+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~Q2ZY2AUO9I22.0 size=1048576 2024-09-22T08:21:01.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.811+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~Q2ZY2AUO9I22.1 size=1048576 2024-09-22T08:21:01.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.813+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~Q2ZY2AUO9I22.2 size=457628 2024-09-22T08:21:01.816 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.815+0000 7fe6c9c31780 1 < completed multipart upload key=76HZ3LZGVT9J upload=Q2ZY2AUO9I22 tag=P1GXI3JTSXWT type=write size=3603356 2024-09-22T08:21:01.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.817+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=SMBWEKHKRTLR type=write size=226901 2024-09-22T08:21:01.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.818+0000 7fe6c9c31780 1 < completed part key=_multipart_TYVQ39KUV2V9.2~CZKC0ZXG2LC0.0 size=975155 2024-09-22T08:21:01.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.821+0000 7fe6c9c31780 1 < completed multipart upload key=TYVQ39KUV2V9 upload=CZKC0ZXG2LC0 tag=9ZV8UWID145T type=write size=2023731 2024-09-22T08:21:01.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.822+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=7SR2YCPQR13E type=del size=542000 2024-09-22T08:21:01.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.824+0000 7fe6c9c31780 1 < completed part key=_multipart_ZFL9N44PBQX4.2~GJFXN0R6M6QQ.0 size=1048576 2024-09-22T08:21:01.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.825+0000 7fe6c9c31780 1 < completed part key=_multipart_ZFL9N44PBQX4.2~GJFXN0R6M6QQ.1 size=1048576 2024-09-22T08:21:01.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.826+0000 7fe6c9c31780 1 < completed part key=_multipart_ZFL9N44PBQX4.2~GJFXN0R6M6QQ.2 size=978340 2024-09-22T08:21:01.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.829+0000 7fe6c9c31780 1 < completed multipart upload key=ZFL9N44PBQX4 upload=GJFXN0R6M6QQ tag=NIIT6EZO92SZ type=write size=4124068 2024-09-22T08:21:01.832 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.831+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~TACL6W5IN0PU.0 size=1048576 2024-09-22T08:21:01.833 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.833+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~TACL6W5IN0PU.1 size=262791 2024-09-22T08:21:01.833 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.833+0000 7fe6c9c31780 1 > prepared multipart upload key=VP1MP4IC9A7T upload=TACL6W5IN0PU tag=A1WXPBY57DYZ type=write size=2359943 2024-09-22T08:21:01.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.834+0000 7fe6c9c31780 1 < canceled operation key=R7UWMW913DJQ tag=BW8P0EKCP2S0 type=del size=830450 2024-09-22T08:21:01.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.838+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~Z78OWPB0EJVP.0 size=18498 2024-09-22T08:21:01.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.838+0000 7fe6c9c31780 1 > prepared multipart upload key=0PNK2ZW6IJM1 upload=Z78OWPB0EJVP tag=9E8JYCR4JVWI type=write size=1067074 2024-09-22T08:21:01.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.839+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~R7FNH1Z74UCQ.0 size=551741 2024-09-22T08:21:01.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.842+0000 7fe6c9c31780 1 < completed multipart upload key=0PNK2ZW6IJM1 upload=R7FNH1Z74UCQ tag=FHV0HS30DIQN type=write size=1600317 2024-09-22T08:21:01.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.844+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~RLXWVO2L17HU.0 size=242460 2024-09-22T08:21:01.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.844+0000 7fe6c9c31780 1 > prepared multipart upload key=KZIY400KQ5NH upload=RLXWVO2L17HU tag=3K41CXH03MD3 type=write size=1291036 2024-09-22T08:21:01.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.846+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~S1NPIWYPSB2U.0 size=217627 2024-09-22T08:21:01.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.848+0000 7fe6c9c31780 1 < completed multipart upload key=0PNK2ZW6IJM1 upload=S1NPIWYPSB2U tag=496JK4V0SFCJ type=write size=1266203 2024-09-22T08:21:01.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.851+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~J61EY3Q5121H.0 size=1048576 2024-09-22T08:21:01.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.852+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~J61EY3Q5121H.1 size=368699 2024-09-22T08:21:01.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.852+0000 7fe6c9c31780 1 > prepared multipart upload key=FY40JTHLT0KU upload=J61EY3Q5121H tag=322OENG275KB type=write size=2465851 2024-09-22T08:21:01.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.853+0000 7fe6c9c31780 1 < completed delete operation key=9AZWQ9E58QS6 tag=VZV6MMPY6BRK type=del 2024-09-22T08:21:01.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.856+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~7J259M5PGQVB.0 size=943299 2024-09-22T08:21:01.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.856+0000 7fe6c9c31780 1 > prepared multipart upload key=TYVQ39KUV2V9 upload=7J259M5PGQVB tag=62O67LUOGC7K type=write size=1991875 2024-09-22T08:21:01.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.857+0000 7fe6c9c31780 1 < canceled operation key=FY40JTHLT0KU tag=3NM2KMMUMS2U type=del size=2245801 2024-09-22T08:21:01.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.859+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=0SF4YN9Z20I7 type=del size=4124148 2024-09-22T08:21:01.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.861+0000 7fe6c9c31780 1 < completed delete operation key=76HZ3LZGVT9J tag=ML08E39AH99H type=del 2024-09-22T08:21:01.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.861+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=68ZTFU06NXEQ type=del size=808370 2024-09-22T08:21:01.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.863+0000 7fe6c9c31780 1 < completed delete operation key=9AZWQ9E58QS6 tag=FN5TPD00ZA82 type=del 2024-09-22T08:21:01.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.865+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~NWUD1HQ2IWXN.0 size=1048576 2024-09-22T08:21:01.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.867+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~NWUD1HQ2IWXN.1 size=538842 2024-09-22T08:21:01.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.867+0000 7fe6c9c31780 1 > prepared multipart upload key=OX1LY7URY7IV upload=NWUD1HQ2IWXN tag=IWK8G32PTGJA type=write size=2635994 2024-09-22T08:21:01.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.868+0000 7fe6c9c31780 1 < canceled operation key=O1UBUQXP50CN tag=5I37EI95016T type=del size=678088 2024-09-22T08:21:01.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.870+0000 7fe6c9c31780 1 > prepared operation key=1HZ0NAJPXNW1 tag=13CKMEW5WUCD type=del size=1227492 2024-09-22T08:21:01.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.870+0000 7fe6c9c31780 1 < canceled part key=_multipart_TE10GB1F35X4.2~KSRKWYO7KLT3.0 size=25199 2024-09-22T08:21:01.873 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.872+0000 7fe6c9c31780 1 < canceled multipart upload key=TE10GB1F35X4 upload=KSRKWYO7KLT3 tag=Q2S5AVZQKTJF type=write size=1073775 2024-09-22T08:21:01.874 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.874+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=1CCRFFFEFU6R type=del size=2882427 2024-09-22T08:21:01.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.875+0000 7fe6c9c31780 1 < completed delete operation key=LA6ZRVULGQ0H tag=UDM1P5QUM8MB type=del 2024-09-22T08:21:01.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.876+0000 7fe6c9c31780 1 > prepared operation key=OX1LY7URY7IV tag=2XIIP9ZGWN54 type=del size=2953982 2024-09-22T08:21:01.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.878+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~G4HG9RJJGTK1.0 size=1048576 2024-09-22T08:21:01.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.879+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~G4HG9RJJGTK1.1 size=1048183 2024-09-22T08:21:01.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.881+0000 7fe6c9c31780 1 < completed multipart upload key=76HZ3LZGVT9J upload=G4HG9RJJGTK1 tag=5DNCZR7S8157 type=write size=3145335 2024-09-22T08:21:01.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.882+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=AUWXD78GV93E type=del size=151861 2024-09-22T08:21:01.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.884+0000 7fe6c9c31780 1 < completed delete operation key=0TWY0NNZZ7NN tag=QU3URWDLB19F type=del 2024-09-22T08:21:01.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.886+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~FA1ZQQJRY260.0 size=1048576 2024-09-22T08:21:01.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.888+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~FA1ZQQJRY260.1 size=1048576 2024-09-22T08:21:01.889 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.889+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~FA1ZQQJRY260.2 size=797389 2024-09-22T08:21:01.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.889+0000 7fe6c9c31780 1 > prepared multipart upload key=7446WN19QFV0 upload=FA1ZQQJRY260 tag=PJEE9715GR2K type=write size=3943117 2024-09-22T08:21:01.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.890+0000 7fe6c9c31780 1 < completed write operation key=Z1CK5EDBK4AW tag=DOUELE5BOJO4 type=write size=880479 2024-09-22T08:21:01.892 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.892+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=QJ2SBFGUUVIW type=del size=2092575 2024-09-22T08:21:01.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.893+0000 7fe6c9c31780 1 < completed write operation key=ILW34WLX48WN tag=SMBWEKHKRTLR type=write size=226901 2024-09-22T08:21:01.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.896+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~KW5SVYC44R7K.0 size=1048576 2024-09-22T08:21:01.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.897+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~KW5SVYC44R7K.1 size=1008120 2024-09-22T08:21:01.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.897+0000 7fe6c9c31780 1 > prepared multipart upload key=XJP26CCPYDI7 upload=KW5SVYC44R7K tag=34LXUDB98475 type=write size=3105272 2024-09-22T08:21:01.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.898+0000 7fe6c9c31780 1 < completed delete operation key=946H8F2AUPO2 tag=7SR2YCPQR13E type=del 2024-09-22T08:21:01.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.900+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=NPLA3H3XF6KK type=del size=1857535 2024-09-22T08:21:01.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.902+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~TACL6W5IN0PU.0 size=1048576 2024-09-22T08:21:01.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.902+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~TACL6W5IN0PU.1 size=262791 2024-09-22T08:21:01.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.905+0000 7fe6c9c31780 1 < completed multipart upload key=VP1MP4IC9A7T upload=TACL6W5IN0PU tag=A1WXPBY57DYZ type=write size=2359943 2024-09-22T08:21:01.908 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.908+0000 7fe6c9c31780 1 > prepared part key=_multipart_1HZ0NAJPXNW1.2~0UG73JFRIOHR.0 size=1048576 2024-09-22T08:21:01.909 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.909+0000 7fe6c9c31780 1 > prepared part key=_multipart_1HZ0NAJPXNW1.2~0UG73JFRIOHR.1 size=480547 2024-09-22T08:21:01.910 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.909+0000 7fe6c9c31780 1 > prepared multipart upload key=1HZ0NAJPXNW1 upload=0UG73JFRIOHR tag=1GLRXRDPMGSJ type=write size=2577699 2024-09-22T08:21:01.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.910+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~Z78OWPB0EJVP.0 size=18498 2024-09-22T08:21:01.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.913+0000 7fe6c9c31780 1 < completed multipart upload key=0PNK2ZW6IJM1 upload=Z78OWPB0EJVP tag=9E8JYCR4JVWI type=write size=1067074 2024-09-22T08:21:01.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.915+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~9T9H3MZOP8OO.0 size=318969 2024-09-22T08:21:01.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.915+0000 7fe6c9c31780 1 > prepared multipart upload key=0PNK2ZW6IJM1 upload=9T9H3MZOP8OO tag=71QC2OFMJYMO type=write size=1367545 2024-09-22T08:21:01.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.917+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~RLXWVO2L17HU.0 size=242460 2024-09-22T08:21:01.920 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.919+0000 7fe6c9c31780 1 < completed multipart upload key=KZIY400KQ5NH upload=RLXWVO2L17HU tag=3K41CXH03MD3 type=write size=1291036 2024-09-22T08:21:01.923 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.922+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~YNP23F6H0XVQ.0 size=377390 2024-09-22T08:21:01.923 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.922+0000 7fe6c9c31780 1 > prepared multipart upload key=CTK01Y0CV1NC upload=YNP23F6H0XVQ tag=AALH2GGD8J4D type=write size=1425966 2024-09-22T08:21:01.924 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.924+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~J61EY3Q5121H.0 size=1048576 2024-09-22T08:21:01.925 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.925+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~J61EY3Q5121H.1 size=368699 2024-09-22T08:21:01.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.927+0000 7fe6c9c31780 1 < completed multipart upload key=FY40JTHLT0KU upload=J61EY3Q5121H tag=322OENG275KB type=write size=2465851 2024-09-22T08:21:01.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.929+0000 7fe6c9c31780 1 > prepared operation key=LA6ZRVULGQ0H tag=KXRK611MVZHT type=write size=581479 2024-09-22T08:21:01.930 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.930+0000 7fe6c9c31780 1 < completed part key=_multipart_TYVQ39KUV2V9.2~7J259M5PGQVB.0 size=943299 2024-09-22T08:21:01.933 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.933+0000 7fe6c9c31780 1 < completed multipart upload key=TYVQ39KUV2V9 upload=7J259M5PGQVB tag=62O67LUOGC7K type=write size=1991875 2024-09-22T08:21:01.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.934+0000 7fe6c9c31780 1 > prepared operation key=9FCSIF1WKBDJ tag=DDSV23EZUBSC type=write size=774543 2024-09-22T08:21:01.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.935+0000 7fe6c9c31780 1 < completed delete operation key=6BKB91YV3FMW tag=0SF4YN9Z20I7 type=del 2024-09-22T08:21:01.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.937+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=R6C9DBWUF859 type=del size=1819730 2024-09-22T08:21:01.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.938+0000 7fe6c9c31780 1 < completed delete operation key=2B5QRUMTVE7U tag=68ZTFU06NXEQ type=del 2024-09-22T08:21:01.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.940+0000 7fe6c9c31780 1 > prepared operation key=0PNK2ZW6IJM1 tag=7XOZQNBGD7VD type=write size=327019 2024-09-22T08:21:01.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.942+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~NWUD1HQ2IWXN.0 size=1048576 2024-09-22T08:21:01.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.943+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~NWUD1HQ2IWXN.1 size=538842 2024-09-22T08:21:01.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.945+0000 7fe6c9c31780 1 < completed multipart upload key=OX1LY7URY7IV upload=NWUD1HQ2IWXN tag=IWK8G32PTGJA type=write size=2635994 2024-09-22T08:21:01.947 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.946+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=PATE2YT7WJOX type=del size=1303053 2024-09-22T08:21:01.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.950+0000 7fe6c9c31780 1 < suggested remove operation key=1HZ0NAJPXNW1 tag=13CKMEW5WUCD type=del 2024-09-22T08:21:01.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.951+0000 7fe6c9c31780 1 > prepared operation key=OX1LY7URY7IV tag=6QR18F8J516B type=write size=438956 2024-09-22T08:21:01.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.952+0000 7fe6c9c31780 1 < completed delete operation key=7446WN19QFV0 tag=1CCRFFFEFU6R type=del 2024-09-22T08:21:01.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.954+0000 7fe6c9c31780 1 > prepared operation key=OX1LY7URY7IV tag=NNLO2F37CLUN type=write size=80836 2024-09-22T08:21:01.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.957+0000 7fe6c9c31780 1 < suggested remove operation key=OX1LY7URY7IV tag=2XIIP9ZGWN54 type=del 2024-09-22T08:21:01.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.958+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=R52MBRB1MBI7 type=write size=308983 2024-09-22T08:21:01.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.960+0000 7fe6c9c31780 1 < completed delete operation key=T2W6RXP9UGHH tag=AUWXD78GV93E type=del 2024-09-22T08:21:01.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.963+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~IFD58K2OT83E.0 size=1048576 2024-09-22T08:21:01.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.964+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~IFD58K2OT83E.1 size=555400 2024-09-22T08:21:01.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.964+0000 7fe6c9c31780 1 > prepared multipart upload key=TE10GB1F35X4 upload=IFD58K2OT83E tag=GZO3U5ERFZWY type=write size=2652552 2024-09-22T08:21:01.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.965+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~FA1ZQQJRY260.0 size=1048576 2024-09-22T08:21:01.967 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.967+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~FA1ZQQJRY260.1 size=1048576 2024-09-22T08:21:01.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.968+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~FA1ZQQJRY260.2 size=797389 2024-09-22T08:21:01.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.972+0000 7fe6c9c31780 1 < completed multipart upload key=7446WN19QFV0 upload=FA1ZQQJRY260 tag=PJEE9715GR2K type=write size=3943117 2024-09-22T08:21:01.973 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.973+0000 7fe6c9c31780 1 > prepared operation key=ZFL9N44PBQX4 tag=NSAXITRPQ8H2 type=del size=313094 2024-09-22T08:21:01.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.976+0000 7fe6c9c31780 1 < suggested update operation key=76HZ3LZGVT9J tag=QJ2SBFGUUVIW type=del size=2092575 2024-09-22T08:21:01.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.977+0000 7fe6c9c31780 1 > prepared operation key=4KRJ7DTE3KDV tag=GWG0R1US9HFL type=del size=3067639 2024-09-22T08:21:01.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.979+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~KW5SVYC44R7K.0 size=1048576 2024-09-22T08:21:01.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.980+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~KW5SVYC44R7K.1 size=1008120 2024-09-22T08:21:01.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.983+0000 7fe6c9c31780 1 < completed multipart upload key=XJP26CCPYDI7 upload=KW5SVYC44R7K tag=34LXUDB98475 type=write size=3105272 2024-09-22T08:21:01.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.984+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=1DHUSYI6IPN3 type=del size=862807 2024-09-22T08:21:01.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.986+0000 7fe6c9c31780 1 < completed delete operation key=TE10GB1F35X4 tag=NPLA3H3XF6KK type=del 2024-09-22T08:21:01.989 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.988+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~J01N85NR797P.0 size=1048576 2024-09-22T08:21:01.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.989+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~J01N85NR797P.1 size=1048576 2024-09-22T08:21:01.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.991+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~J01N85NR797P.2 size=589358 2024-09-22T08:21:01.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.991+0000 7fe6c9c31780 1 > prepared multipart upload key=6BKB91YV3FMW upload=J01N85NR797P tag=QTYER8R1AWC0 type=write size=3735086 2024-09-22T08:21:01.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.992+0000 7fe6c9c31780 1 < completed part key=_multipart_1HZ0NAJPXNW1.2~0UG73JFRIOHR.0 size=1048576 2024-09-22T08:21:01.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.993+0000 7fe6c9c31780 1 < completed part key=_multipart_1HZ0NAJPXNW1.2~0UG73JFRIOHR.1 size=480547 2024-09-22T08:21:01.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.995+0000 7fe6c9c31780 1 < completed multipart upload key=1HZ0NAJPXNW1 upload=0UG73JFRIOHR tag=1GLRXRDPMGSJ type=write size=2577699 2024-09-22T08:21:01.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.997+0000 7fe6c9c31780 1 > prepared operation key=O1UBUQXP50CN tag=30RVGB989VF6 type=del size=3628702 2024-09-22T08:21:01.999 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:01.998+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~9T9H3MZOP8OO.0 size=318969 2024-09-22T08:21:02.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.001+0000 7fe6c9c31780 1 < completed multipart upload key=0PNK2ZW6IJM1 upload=9T9H3MZOP8OO tag=71QC2OFMJYMO type=write size=1367545 2024-09-22T08:21:02.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.003+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~E12CZEE8DNCL.0 size=356578 2024-09-22T08:21:02.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.003+0000 7fe6c9c31780 1 > prepared multipart upload key=DC7VLQWZ3TD1 upload=E12CZEE8DNCL tag=K51QYMB0M9VH type=write size=1405154 2024-09-22T08:21:02.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.005+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~YNP23F6H0XVQ.0 size=377390 2024-09-22T08:21:02.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.007+0000 7fe6c9c31780 1 < completed multipart upload key=CTK01Y0CV1NC upload=YNP23F6H0XVQ tag=AALH2GGD8J4D type=write size=1425966 2024-09-22T08:21:02.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.009+0000 7fe6c9c31780 1 > prepared operation key=TYVQ39KUV2V9 tag=X0CZAWMM8BD7 type=del size=3331633 2024-09-22T08:21:02.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.012+0000 7fe6c9c31780 1 < suggested update operation key=LA6ZRVULGQ0H tag=KXRK611MVZHT type=write size=581479 2024-09-22T08:21:02.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.015+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~Q8TGZQ1F8XW4.0 size=1034933 2024-09-22T08:21:02.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.015+0000 7fe6c9c31780 1 > prepared multipart upload key=CTK01Y0CV1NC upload=Q8TGZQ1F8XW4 tag=8T3W513PPNMX type=write size=2083509 2024-09-22T08:21:02.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.016+0000 7fe6c9c31780 1 < completed write operation key=9FCSIF1WKBDJ tag=DDSV23EZUBSC type=write size=774543 2024-09-22T08:21:02.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.018+0000 7fe6c9c31780 1 > prepared operation key=KZIY400KQ5NH tag=AZ0REBLU5FG3 type=del size=107511 2024-09-22T08:21:02.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.019+0000 7fe6c9c31780 1 < completed delete operation key=ILW34WLX48WN tag=R6C9DBWUF859 type=del 2024-09-22T08:21:02.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.021+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=N104BIJDKX4I type=del size=2182672 2024-09-22T08:21:02.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.024+0000 7fe6c9c31780 1 < suggested update operation key=0PNK2ZW6IJM1 tag=7XOZQNBGD7VD type=write size=327019 2024-09-22T08:21:02.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.025+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=TFPPOQTUMYJQ type=del size=1292104 2024-09-22T08:21:02.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.027+0000 7fe6c9c31780 1 < completed delete operation key=ILW34WLX48WN tag=PATE2YT7WJOX type=del 2024-09-22T08:21:02.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.029+0000 7fe6c9c31780 1 > prepared operation key=D85LJGGU3Z6F tag=GOXPXJN8XHC6 type=del size=4174039 2024-09-22T08:21:02.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.029+0000 7fe6c9c31780 -1 < no bi entry to suggest for operation key=OX1LY7URY7IV tag=6QR18F8J516B type=write size=438956: (2) No such file or directory 2024-09-22T08:21:02.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.032+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~UEYXV845NXB6.0 size=1048576 2024-09-22T08:21:02.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.033+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~UEYXV845NXB6.1 size=184668 2024-09-22T08:21:02.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.033+0000 7fe6c9c31780 1 > prepared multipart upload key=XJP26CCPYDI7 upload=UEYXV845NXB6 tag=CSLKTWZ9TFEO type=write size=2281820 2024-09-22T08:21:02.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.034+0000 7fe6c9c31780 -1 < failed to complete operation key=OX1LY7URY7IV tag=NNLO2F37CLUN type=write size=80836: (22) Invalid argument 2024-09-22T08:21:02.037 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.036+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=HVNOVPMEW9V4 type=write size=818680 2024-09-22T08:21:02.039 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.038+0000 7fe6c9c31780 1 < suggested update operation key=T2W6RXP9UGHH tag=R52MBRB1MBI7 type=write size=308983 2024-09-22T08:21:02.040 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.040+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=L9SJH1R402DT type=del size=2264415 2024-09-22T08:21:02.041 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.040+0000 7fe6c9c31780 1 < canceled part key=_multipart_TE10GB1F35X4.2~IFD58K2OT83E.0 size=1048576 2024-09-22T08:21:02.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.041+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~IFD58K2OT83E.1 size=555400 2024-09-22T08:21:02.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.044+0000 7fe6c9c31780 1 < canceled multipart upload key=TE10GB1F35X4 upload=IFD58K2OT83E tag=GZO3U5ERFZWY type=write size=2652552 2024-09-22T08:21:02.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.045+0000 7fe6c9c31780 1 > prepared operation key=XJP26CCPYDI7 tag=Q07T9KH4G08P type=write size=784265 2024-09-22T08:21:02.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.047+0000 7fe6c9c31780 1 < completed delete operation key=ZFL9N44PBQX4 tag=NSAXITRPQ8H2 type=del 2024-09-22T08:21:02.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.050+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~F2ULT2CIK50J.0 size=1048296 2024-09-22T08:21:02.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.050+0000 7fe6c9c31780 1 > prepared multipart upload key=LA6ZRVULGQ0H upload=F2ULT2CIK50J tag=9Q38FRBZZ9PR type=write size=2096872 2024-09-22T08:21:02.051 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.051+0000 7fe6c9c31780 1 < completed delete operation key=4KRJ7DTE3KDV tag=GWG0R1US9HFL type=del 2024-09-22T08:21:02.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.053+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~DNJ77CS1C2DI.0 size=1048576 2024-09-22T08:21:02.055 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.054+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~DNJ77CS1C2DI.1 size=1026449 2024-09-22T08:21:02.055 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.054+0000 7fe6c9c31780 1 > prepared multipart upload key=7446WN19QFV0 upload=DNJ77CS1C2DI tag=031W40CU4IZ2 type=write size=3123601 2024-09-22T08:21:02.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.057+0000 7fe6c9c31780 1 < suggested update operation key=R7UWMW913DJQ tag=1DHUSYI6IPN3 type=del size=862807 2024-09-22T08:21:02.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.059+0000 7fe6c9c31780 1 > prepared operation key=9FCSIF1WKBDJ tag=VLNBP28CF4O9 type=del size=3218326 2024-09-22T08:21:02.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.060+0000 7fe6c9c31780 1 < completed part key=_multipart_6BKB91YV3FMW.2~J01N85NR797P.0 size=1048576 2024-09-22T08:21:02.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.062+0000 7fe6c9c31780 1 < completed part key=_multipart_6BKB91YV3FMW.2~J01N85NR797P.1 size=1048576 2024-09-22T08:21:02.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.063+0000 7fe6c9c31780 1 < completed part key=_multipart_6BKB91YV3FMW.2~J01N85NR797P.2 size=589358 2024-09-22T08:21:02.066 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.065+0000 7fe6c9c31780 1 < completed multipart upload key=6BKB91YV3FMW upload=J01N85NR797P tag=QTYER8R1AWC0 type=write size=3735086 2024-09-22T08:21:02.067 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.067+0000 7fe6c9c31780 1 > prepared operation key=1HZ0NAJPXNW1 tag=4UQWXAPMJ7LN type=del size=623433 2024-09-22T08:21:02.070 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.069+0000 7fe6c9c31780 1 < suggested remove operation key=O1UBUQXP50CN tag=30RVGB989VF6 type=del 2024-09-22T08:21:02.073 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.072+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~1YCJVZ403TF3.0 size=1048576 2024-09-22T08:21:02.074 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.074+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~1YCJVZ403TF3.1 size=1048576 2024-09-22T08:21:02.075 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.074+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~1YCJVZ403TF3.2 size=737249 2024-09-22T08:21:02.075 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.074+0000 7fe6c9c31780 1 > prepared multipart upload key=9FCSIF1WKBDJ upload=1YCJVZ403TF3 tag=NIEL92JIA51I type=write size=3882977 2024-09-22T08:21:02.075 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.075+0000 7fe6c9c31780 1 < canceled part key=_multipart_DC7VLQWZ3TD1.2~E12CZEE8DNCL.0 size=356578 2024-09-22T08:21:02.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.077+0000 7fe6c9c31780 1 < canceled multipart upload key=DC7VLQWZ3TD1 upload=E12CZEE8DNCL tag=K51QYMB0M9VH type=write size=1405154 2024-09-22T08:21:02.080 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.079+0000 7fe6c9c31780 1 > prepared part key=_multipart_ZFL9N44PBQX4.2~68BAHCWMYKB2.0 size=1048576 2024-09-22T08:21:02.081 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.081+0000 7fe6c9c31780 1 > prepared part key=_multipart_ZFL9N44PBQX4.2~68BAHCWMYKB2.1 size=270126 2024-09-22T08:21:02.081 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.081+0000 7fe6c9c31780 1 > prepared multipart upload key=ZFL9N44PBQX4 upload=68BAHCWMYKB2 tag=CEMNW2EMM3SJ type=write size=2367278 2024-09-22T08:21:02.083 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.082+0000 7fe6c9c31780 1 < completed delete operation key=TYVQ39KUV2V9 tag=X0CZAWMM8BD7 type=del 2024-09-22T08:21:02.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.084+0000 7fe6c9c31780 1 > prepared operation key=4KRJ7DTE3KDV tag=49UYYZA8B0D9 type=write size=264244 2024-09-22T08:21:02.086 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.086+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~Q8TGZQ1F8XW4.0 size=1034933 2024-09-22T08:21:02.088 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.087+0000 7fe6c9c31780 1 < completed multipart upload key=CTK01Y0CV1NC upload=Q8TGZQ1F8XW4 tag=8T3W513PPNMX type=write size=2083509 2024-09-22T08:21:02.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.089+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=SZE6YNFL3LNM type=del size=3976979 2024-09-22T08:21:02.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.090+0000 7fe6c9c31780 1 < canceled operation key=KZIY400KQ5NH tag=AZ0REBLU5FG3 type=del size=107511 2024-09-22T08:21:02.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.092+0000 7fe6c9c31780 1 > prepared operation key=TYVQ39KUV2V9 tag=32HCAT8Z1W55 type=write size=931019 2024-09-22T08:21:02.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.093+0000 7fe6c9c31780 1 < completed delete operation key=7446WN19QFV0 tag=N104BIJDKX4I type=del 2024-09-22T08:21:02.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.095+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=5JAB9YX9V7BI type=del size=3953673 2024-09-22T08:21:02.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.096+0000 7fe6c9c31780 1 < completed delete operation key=0TWY0NNZZ7NN tag=TFPPOQTUMYJQ type=del 2024-09-22T08:21:02.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.099+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~WKPTGNPPS6V3.0 size=1048576 2024-09-22T08:21:02.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.100+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~WKPTGNPPS6V3.1 size=595800 2024-09-22T08:21:02.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.100+0000 7fe6c9c31780 1 > prepared multipart upload key=LA6ZRVULGQ0H upload=WKPTGNPPS6V3 tag=E6GPWEDAOSF9 type=write size=2692952 2024-09-22T08:21:02.102 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.102+0000 7fe6c9c31780 1 < completed delete operation key=D85LJGGU3Z6F tag=GOXPXJN8XHC6 type=del 2024-09-22T08:21:02.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.103+0000 7fe6c9c31780 1 > prepared operation key=D85LJGGU3Z6F tag=091BPIEVC91O type=del size=3697311 2024-09-22T08:21:02.105 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.104+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~UEYXV845NXB6.0 size=1048576 2024-09-22T08:21:02.106 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.106+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~UEYXV845NXB6.1 size=184668 2024-09-22T08:21:02.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.109+0000 7fe6c9c31780 1 < completed multipart upload key=XJP26CCPYDI7 upload=UEYXV845NXB6 tag=CSLKTWZ9TFEO type=write size=2281820 2024-09-22T08:21:02.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.111+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~DWSJCM6XUWVT.0 size=1048576 2024-09-22T08:21:02.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.112+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~DWSJCM6XUWVT.1 size=1013264 2024-09-22T08:21:02.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.112+0000 7fe6c9c31780 1 > prepared multipart upload key=JT5AB8VLMEFD upload=DWSJCM6XUWVT tag=49U1A6DT9QMH type=write size=3110416 2024-09-22T08:21:02.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.113+0000 7fe6c9c31780 1 < completed write operation key=6BKB91YV3FMW tag=HVNOVPMEW9V4 type=write size=818680 2024-09-22T08:21:02.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.116+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~A4D04QVRMS89.0 size=148118 2024-09-22T08:21:02.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.116+0000 7fe6c9c31780 1 > prepared multipart upload key=D85LJGGU3Z6F upload=A4D04QVRMS89 tag=JUFPUVOSVZYY type=write size=1196694 2024-09-22T08:21:02.118 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.117+0000 7fe6c9c31780 1 < completed delete operation key=7446WN19QFV0 tag=L9SJH1R402DT type=del 2024-09-22T08:21:02.121 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.121+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~7CHFWHID13HI.0 size=1048576 2024-09-22T08:21:02.122 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.122+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~7CHFWHID13HI.1 size=1048576 2024-09-22T08:21:02.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.122+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~7CHFWHID13HI.2 size=457437 2024-09-22T08:21:02.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.122+0000 7fe6c9c31780 1 > prepared multipart upload key=VP1MP4IC9A7T upload=7CHFWHID13HI tag=MITQJTYAKIUQ type=write size=3603165 2024-09-22T08:21:02.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.124+0000 7fe6c9c31780 1 < canceled operation key=XJP26CCPYDI7 tag=Q07T9KH4G08P type=write size=784265 2024-09-22T08:21:02.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.126+0000 7fe6c9c31780 1 > prepared part key=_multipart_ZFL9N44PBQX4.2~Q4F0WKZ1O5RA.0 size=286047 2024-09-22T08:21:02.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.126+0000 7fe6c9c31780 1 > prepared multipart upload key=ZFL9N44PBQX4 upload=Q4F0WKZ1O5RA tag=BWVUVTNVQQF6 type=write size=1334623 2024-09-22T08:21:02.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.128+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~F2ULT2CIK50J.0 size=1048296 2024-09-22T08:21:02.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.130+0000 7fe6c9c31780 1 < completed multipart upload key=LA6ZRVULGQ0H upload=F2ULT2CIK50J tag=9Q38FRBZZ9PR type=write size=2096872 2024-09-22T08:21:02.132 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.131+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=8KLCR7RAV1KR type=del size=3584614 2024-09-22T08:21:02.134 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.133+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~DNJ77CS1C2DI.0 size=1048576 2024-09-22T08:21:02.135 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.134+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~DNJ77CS1C2DI.1 size=1026449 2024-09-22T08:21:02.137 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.137+0000 7fe6c9c31780 1 < completed multipart upload key=7446WN19QFV0 upload=DNJ77CS1C2DI tag=031W40CU4IZ2 type=write size=3123601 2024-09-22T08:21:02.141 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.140+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~VABGA2NZXAN7.0 size=1048576 2024-09-22T08:21:02.142 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.142+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~VABGA2NZXAN7.1 size=862711 2024-09-22T08:21:02.142 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.142+0000 7fe6c9c31780 1 > prepared multipart upload key=KZIY400KQ5NH upload=VABGA2NZXAN7 tag=BSCOJEE7LYC2 type=write size=2959863 2024-09-22T08:21:02.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.143+0000 7fe6c9c31780 1 < completed delete operation key=9FCSIF1WKBDJ tag=VLNBP28CF4O9 type=del 2024-09-22T08:21:02.145 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.145+0000 7fe6c9c31780 1 > prepared operation key=9FCSIF1WKBDJ tag=IE89FM4B2O2F type=write size=611645 2024-09-22T08:21:02.149 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.148+0000 7fe6c9c31780 1 < suggested update operation key=1HZ0NAJPXNW1 tag=4UQWXAPMJ7LN type=del size=623433 2024-09-22T08:21:02.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.149+0000 7fe6c9c31780 1 > prepared operation key=4KRJ7DTE3KDV tag=ENTUREQT3P01 type=del size=590200 2024-09-22T08:21:02.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.151+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~1YCJVZ403TF3.0 size=1048576 2024-09-22T08:21:02.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.153+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~1YCJVZ403TF3.1 size=1048576 2024-09-22T08:21:02.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.154+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~1YCJVZ403TF3.2 size=737249 2024-09-22T08:21:02.157 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.157+0000 7fe6c9c31780 1 < completed multipart upload key=9FCSIF1WKBDJ upload=1YCJVZ403TF3 tag=NIEL92JIA51I type=write size=3882977 2024-09-22T08:21:02.159 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.158+0000 7fe6c9c31780 1 > prepared operation key=W9L87PTJEIOA tag=4GVVGB2M51JL type=del size=434405 2024-09-22T08:21:02.160 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.160+0000 7fe6c9c31780 1 < completed part key=_multipart_ZFL9N44PBQX4.2~68BAHCWMYKB2.0 size=1048576 2024-09-22T08:21:02.161 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.161+0000 7fe6c9c31780 1 < completed part key=_multipart_ZFL9N44PBQX4.2~68BAHCWMYKB2.1 size=270126 2024-09-22T08:21:02.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.163+0000 7fe6c9c31780 1 < completed multipart upload key=ZFL9N44PBQX4 upload=68BAHCWMYKB2 tag=CEMNW2EMM3SJ type=write size=2367278 2024-09-22T08:21:02.167 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.167+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~LN3H662A0HG3.0 size=1048576 2024-09-22T08:21:02.168 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.168+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~LN3H662A0HG3.1 size=664154 2024-09-22T08:21:02.168 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.168+0000 7fe6c9c31780 1 > prepared multipart upload key=0PNK2ZW6IJM1 upload=LN3H662A0HG3 tag=T67VG9BJ5465 type=write size=2761306 2024-09-22T08:21:02.172 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.172+0000 7fe6c9c31780 1 < suggested remove operation key=4KRJ7DTE3KDV tag=49UYYZA8B0D9 type=write 2024-09-22T08:21:02.173 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.173+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=VLG0VYCDNB7S type=del size=2456102 2024-09-22T08:21:02.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.175+0000 7fe6c9c31780 1 < completed delete operation key=7446WN19QFV0 tag=SZE6YNFL3LNM type=del 2024-09-22T08:21:02.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.176+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=YK0Q9PVCARIE type=write size=148224 2024-09-22T08:21:02.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.178+0000 7fe6c9c31780 1 < completed write operation key=TYVQ39KUV2V9 tag=32HCAT8Z1W55 type=write size=931019 2024-09-22T08:21:02.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.180+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=CZ59EEMDASPG type=del size=1701138 2024-09-22T08:21:02.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.181+0000 7fe6c9c31780 1 < completed delete operation key=2B5QRUMTVE7U tag=5JAB9YX9V7BI type=del 2024-09-22T08:21:02.185 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.185+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~CL3R2I21YNYN.0 size=1048576 2024-09-22T08:21:02.186 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.186+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~CL3R2I21YNYN.1 size=1048576 2024-09-22T08:21:02.187 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.187+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~CL3R2I21YNYN.2 size=675685 2024-09-22T08:21:02.187 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.187+0000 7fe6c9c31780 1 > prepared multipart upload key=O1UBUQXP50CN upload=CL3R2I21YNYN tag=WWVDSLVPAKK8 type=write size=3821413 2024-09-22T08:21:02.189 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.189+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~WKPTGNPPS6V3.0 size=1048576 2024-09-22T08:21:02.191 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.190+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~WKPTGNPPS6V3.1 size=595800 2024-09-22T08:21:02.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.192+0000 7fe6c9c31780 1 < completed multipart upload key=LA6ZRVULGQ0H upload=WKPTGNPPS6V3 tag=E6GPWEDAOSF9 type=write size=2692952 2024-09-22T08:21:02.194 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.194+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=FCOCHRNZUJU5 type=del size=3520001 2024-09-22T08:21:02.196 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.195+0000 7fe6c9c31780 1 < completed delete operation key=D85LJGGU3Z6F tag=091BPIEVC91O type=del 2024-09-22T08:21:02.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.198+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~V41X0WU0D19V.0 size=943216 2024-09-22T08:21:02.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.198+0000 7fe6c9c31780 1 > prepared multipart upload key=TYVQ39KUV2V9 upload=V41X0WU0D19V tag=K7VLF9D35XX8 type=write size=1991792 2024-09-22T08:21:02.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.199+0000 7fe6c9c31780 1 < completed part key=_multipart_JT5AB8VLMEFD.2~DWSJCM6XUWVT.0 size=1048576 2024-09-22T08:21:02.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.201+0000 7fe6c9c31780 1 < completed part key=_multipart_JT5AB8VLMEFD.2~DWSJCM6XUWVT.1 size=1013264 2024-09-22T08:21:02.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.203+0000 7fe6c9c31780 1 < completed multipart upload key=JT5AB8VLMEFD upload=DWSJCM6XUWVT tag=49U1A6DT9QMH type=write size=3110416 2024-09-22T08:21:02.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.206+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~MQ6OE7X0UD14.0 size=1048576 2024-09-22T08:21:02.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.207+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~MQ6OE7X0UD14.1 size=1048576 2024-09-22T08:21:02.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.208+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~MQ6OE7X0UD14.2 size=1037759 2024-09-22T08:21:02.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.208+0000 7fe6c9c31780 1 > prepared multipart upload key=O1UBUQXP50CN upload=MQ6OE7X0UD14 tag=EDVUL6N4K476 type=write size=4183487 2024-09-22T08:21:02.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.210+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~A4D04QVRMS89.0 size=148118 2024-09-22T08:21:02.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.212+0000 7fe6c9c31780 1 < completed multipart upload key=D85LJGGU3Z6F upload=A4D04QVRMS89 tag=JUFPUVOSVZYY type=write size=1196694 2024-09-22T08:21:02.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.213+0000 7fe6c9c31780 1 > prepared operation key=VP1MP4IC9A7T tag=N97FICBGM02P type=del size=3873495 2024-09-22T08:21:02.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.215+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~7CHFWHID13HI.0 size=1048576 2024-09-22T08:21:02.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.216+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~7CHFWHID13HI.1 size=1048576 2024-09-22T08:21:02.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.216+0000 7fe6c9c31780 1 < canceled part key=_multipart_VP1MP4IC9A7T.2~7CHFWHID13HI.2 size=457437 2024-09-22T08:21:02.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.218+0000 7fe6c9c31780 1 < canceled multipart upload key=VP1MP4IC9A7T upload=7CHFWHID13HI tag=MITQJTYAKIUQ type=write size=3603165 2024-09-22T08:21:02.221 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.220+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=BN7BHSHT2LUX type=del size=824253 2024-09-22T08:21:02.222 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.222+0000 7fe6c9c31780 1 < completed part key=_multipart_ZFL9N44PBQX4.2~Q4F0WKZ1O5RA.0 size=286047 2024-09-22T08:21:02.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.224+0000 7fe6c9c31780 1 < completed multipart upload key=ZFL9N44PBQX4 upload=Q4F0WKZ1O5RA tag=BWVUVTNVQQF6 type=write size=1334623 2024-09-22T08:21:02.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.227+0000 7fe6c9c31780 1 > prepared part key=_multipart_1HZ0NAJPXNW1.2~CHP01VCY6VSI.0 size=1048576 2024-09-22T08:21:02.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.228+0000 7fe6c9c31780 1 > prepared part key=_multipart_1HZ0NAJPXNW1.2~CHP01VCY6VSI.1 size=1048576 2024-09-22T08:21:02.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.229+0000 7fe6c9c31780 1 > prepared part key=_multipart_1HZ0NAJPXNW1.2~CHP01VCY6VSI.2 size=865184 2024-09-22T08:21:02.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.229+0000 7fe6c9c31780 1 > prepared multipart upload key=1HZ0NAJPXNW1 upload=CHP01VCY6VSI tag=U7YT6K8N7Z0N type=write size=4010912 2024-09-22T08:21:02.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.230+0000 7fe6c9c31780 1 < completed delete operation key=946H8F2AUPO2 tag=8KLCR7RAV1KR type=del 2024-09-22T08:21:02.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.233+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~Q2G35T9NI06H.0 size=421851 2024-09-22T08:21:02.234 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.233+0000 7fe6c9c31780 1 > prepared multipart upload key=7446WN19QFV0 upload=Q2G35T9NI06H tag=3I8MV4GWZWM9 type=write size=1470427 2024-09-22T08:21:02.235 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.234+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~VABGA2NZXAN7.0 size=1048576 2024-09-22T08:21:02.236 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.235+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~VABGA2NZXAN7.1 size=862711 2024-09-22T08:21:02.238 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.238+0000 7fe6c9c31780 1 < completed multipart upload key=KZIY400KQ5NH upload=VABGA2NZXAN7 tag=BSCOJEE7LYC2 type=write size=2959863 2024-09-22T08:21:02.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.241+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~XH436J11FZ2Q.0 size=967618 2024-09-22T08:21:02.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.241+0000 7fe6c9c31780 1 > prepared multipart upload key=XJP26CCPYDI7 upload=XH436J11FZ2Q tag=AEF0BKMSJ7YB type=write size=2016194 2024-09-22T08:21:02.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.242+0000 7fe6c9c31780 1 < completed write operation key=9FCSIF1WKBDJ tag=IE89FM4B2O2F type=write size=611645 2024-09-22T08:21:02.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.244+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=88FJNZYM8371 type=del size=2802925 2024-09-22T08:21:02.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.245+0000 7fe6c9c31780 -1 < failed to complete operation key=4KRJ7DTE3KDV tag=ENTUREQT3P01 type=del size=590200: (22) Invalid argument 2024-09-22T08:21:02.248 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.248+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=A52454X0C2WM type=del size=3708717 2024-09-22T08:21:02.251 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.251+0000 7fe6c9c31780 1 < suggested update operation key=W9L87PTJEIOA tag=4GVVGB2M51JL type=del size=434405 2024-09-22T08:21:02.253 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.252+0000 7fe6c9c31780 1 > prepared operation key=9FCSIF1WKBDJ tag=IAPTSTZ3IVNY type=del size=2731358 2024-09-22T08:21:02.255 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.254+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~LN3H662A0HG3.0 size=1048576 2024-09-22T08:21:02.256 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.255+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~LN3H662A0HG3.1 size=664154 2024-09-22T08:21:02.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.258+0000 7fe6c9c31780 1 < completed multipart upload key=0PNK2ZW6IJM1 upload=LN3H662A0HG3 tag=T67VG9BJ5465 type=write size=2761306 2024-09-22T08:21:02.261 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.261+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~LZ0JV337X48G.0 size=705186 2024-09-22T08:21:02.261 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.261+0000 7fe6c9c31780 1 > prepared multipart upload key=JT5AB8VLMEFD upload=LZ0JV337X48G tag=12J1899NPP3F type=write size=1753762 2024-09-22T08:21:02.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.262+0000 7fe6c9c31780 1 < completed delete operation key=R7UWMW913DJQ tag=VLG0VYCDNB7S type=del 2024-09-22T08:21:02.267 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.266+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~J31XX7VJ039N.0 size=1048576 2024-09-22T08:21:02.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.267+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~J31XX7VJ039N.1 size=1048576 2024-09-22T08:21:02.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.269+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~J31XX7VJ039N.2 size=253611 2024-09-22T08:21:02.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.269+0000 7fe6c9c31780 1 > prepared multipart upload key=0TWY0NNZZ7NN upload=J31XX7VJ039N tag=79TE13NP1RZR type=write size=3399339 2024-09-22T08:21:02.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.270+0000 7fe6c9c31780 1 < completed write operation key=R7UWMW913DJQ tag=YK0Q9PVCARIE type=write size=148224 2024-09-22T08:21:02.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.271+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=K9PRFK4RN38R type=del size=2431253 2024-09-22T08:21:02.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.274+0000 7fe6c9c31780 1 < suggested remove operation key=T2W6RXP9UGHH tag=CZ59EEMDASPG type=del 2024-09-22T08:21:02.276 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.275+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=VZJFGE9NDR9H type=del size=217398 2024-09-22T08:21:02.278 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.277+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~CL3R2I21YNYN.0 size=1048576 2024-09-22T08:21:02.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.278+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~CL3R2I21YNYN.1 size=1048576 2024-09-22T08:21:02.280 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.279+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~CL3R2I21YNYN.2 size=675685 2024-09-22T08:21:02.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.281+0000 7fe6c9c31780 1 < completed multipart upload key=O1UBUQXP50CN upload=CL3R2I21YNYN tag=WWVDSLVPAKK8 type=write size=3821413 2024-09-22T08:21:02.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.283+0000 7fe6c9c31780 1 > prepared operation key=O1UBUQXP50CN tag=I67EIKZAAQQR type=del size=3119484 2024-09-22T08:21:02.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.284+0000 7fe6c9c31780 1 < completed delete operation key=2B5QRUMTVE7U tag=FCOCHRNZUJU5 type=del 2024-09-22T08:21:02.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.285+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=L8UXOC0Q15P7 type=del size=2408535 2024-09-22T08:21:02.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.287+0000 7fe6c9c31780 1 < completed part key=_multipart_TYVQ39KUV2V9.2~V41X0WU0D19V.0 size=943216 2024-09-22T08:21:02.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.290+0000 7fe6c9c31780 1 < completed multipart upload key=TYVQ39KUV2V9 upload=V41X0WU0D19V tag=K7VLF9D35XX8 type=write size=1991792 2024-09-22T08:21:02.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.292+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~SIFK1EP1Q3EO.0 size=192072 2024-09-22T08:21:02.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.292+0000 7fe6c9c31780 1 > prepared multipart upload key=T2W6RXP9UGHH upload=SIFK1EP1Q3EO tag=2KB8HLV831EY type=write size=1240648 2024-09-22T08:21:02.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.293+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~MQ6OE7X0UD14.0 size=1048576 2024-09-22T08:21:02.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.294+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~MQ6OE7X0UD14.1 size=1048576 2024-09-22T08:21:02.296 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.296+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~MQ6OE7X0UD14.2 size=1037759 2024-09-22T08:21:02.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.298+0000 7fe6c9c31780 1 < completed multipart upload key=O1UBUQXP50CN upload=MQ6OE7X0UD14 tag=EDVUL6N4K476 type=write size=4183487 2024-09-22T08:21:02.302 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.302+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~EA04X2TZLJV4.0 size=1048576 2024-09-22T08:21:02.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.302+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~EA04X2TZLJV4.1 size=1002389 2024-09-22T08:21:02.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.302+0000 7fe6c9c31780 1 > prepared multipart upload key=TE10GB1F35X4 upload=EA04X2TZLJV4 tag=QLO91FCA8FKG type=write size=3099541 2024-09-22T08:21:02.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.304+0000 7fe6c9c31780 1 < completed delete operation key=VP1MP4IC9A7T tag=N97FICBGM02P type=del 2024-09-22T08:21:02.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.305+0000 7fe6c9c31780 1 > prepared operation key=W9L87PTJEIOA tag=PQI4J522ZUPF type=del size=144860 2024-09-22T08:21:02.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.307+0000 7fe6c9c31780 1 < completed delete operation key=6BKB91YV3FMW tag=BN7BHSHT2LUX type=del 2024-09-22T08:21:02.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.308+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=52RQTHFZEDE7 type=del size=319869 2024-09-22T08:21:02.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.310+0000 7fe6c9c31780 1 < completed part key=_multipart_1HZ0NAJPXNW1.2~CHP01VCY6VSI.0 size=1048576 2024-09-22T08:21:02.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.311+0000 7fe6c9c31780 1 < completed part key=_multipart_1HZ0NAJPXNW1.2~CHP01VCY6VSI.1 size=1048576 2024-09-22T08:21:02.313 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.312+0000 7fe6c9c31780 1 < completed part key=_multipart_1HZ0NAJPXNW1.2~CHP01VCY6VSI.2 size=865184 2024-09-22T08:21:02.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.314+0000 7fe6c9c31780 1 < completed multipart upload key=1HZ0NAJPXNW1 upload=CHP01VCY6VSI tag=U7YT6K8N7Z0N type=write size=4010912 2024-09-22T08:21:02.316 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.316+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=NHMPBGBUK0ZQ type=write size=735640 2024-09-22T08:21:02.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.316+0000 7fe6c9c31780 1 < canceled part key=_multipart_7446WN19QFV0.2~Q2G35T9NI06H.0 size=421851 2024-09-22T08:21:02.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.318+0000 7fe6c9c31780 1 < canceled multipart upload key=7446WN19QFV0 upload=Q2G35T9NI06H tag=3I8MV4GWZWM9 type=write size=1470427 2024-09-22T08:21:02.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.321+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~KOVRTGGZLXCY.0 size=1048576 2024-09-22T08:21:02.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.322+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~KOVRTGGZLXCY.1 size=1048576 2024-09-22T08:21:02.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.323+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~KOVRTGGZLXCY.2 size=139920 2024-09-22T08:21:02.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.323+0000 7fe6c9c31780 1 > prepared multipart upload key=0PNK2ZW6IJM1 upload=KOVRTGGZLXCY tag=11Y25E8L6YQQ type=write size=3285648 2024-09-22T08:21:02.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.324+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~XH436J11FZ2Q.0 size=967618 2024-09-22T08:21:02.328 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.327+0000 7fe6c9c31780 1 < completed multipart upload key=XJP26CCPYDI7 upload=XH436J11FZ2Q tag=AEF0BKMSJ7YB type=write size=2016194 2024-09-22T08:21:02.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.328+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=APOE1RME5N0I type=del size=2065491 2024-09-22T08:21:02.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.330+0000 7fe6c9c31780 1 < completed delete operation key=TE10GB1F35X4 tag=88FJNZYM8371 type=del 2024-09-22T08:21:02.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.331+0000 7fe6c9c31780 1 > prepared operation key=GEWQUFB9K35E tag=1RJEV9692NE1 type=del size=2447077 2024-09-22T08:21:02.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.333+0000 7fe6c9c31780 1 < completed delete operation key=0TWY0NNZZ7NN tag=A52454X0C2WM type=del 2024-09-22T08:21:02.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.334+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=4SJR0LG8QFTC type=del size=804639 2024-09-22T08:21:02.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.336+0000 7fe6c9c31780 1 < completed delete operation key=9FCSIF1WKBDJ tag=IAPTSTZ3IVNY type=del 2024-09-22T08:21:02.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.338+0000 7fe6c9c31780 1 > prepared operation key=JT5AB8VLMEFD tag=5OJ1ESCT87JL type=del size=3441842 2024-09-22T08:21:02.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.340+0000 7fe6c9c31780 1 < completed part key=_multipart_JT5AB8VLMEFD.2~LZ0JV337X48G.0 size=705186 2024-09-22T08:21:02.343 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.343+0000 7fe6c9c31780 1 < completed multipart upload key=JT5AB8VLMEFD upload=LZ0JV337X48G tag=12J1899NPP3F type=write size=1753762 2024-09-22T08:21:02.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.346+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~OP2I0V35XLYF.0 size=1048576 2024-09-22T08:21:02.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.347+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~OP2I0V35XLYF.1 size=265832 2024-09-22T08:21:02.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.347+0000 7fe6c9c31780 1 > prepared multipart upload key=4KRJ7DTE3KDV upload=OP2I0V35XLYF tag=7VI6EUU4PJFP type=write size=2362984 2024-09-22T08:21:02.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.348+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~J31XX7VJ039N.0 size=1048576 2024-09-22T08:21:02.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.350+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~J31XX7VJ039N.1 size=1048576 2024-09-22T08:21:02.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.351+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~J31XX7VJ039N.2 size=253611 2024-09-22T08:21:02.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.353+0000 7fe6c9c31780 1 < completed multipart upload key=0TWY0NNZZ7NN upload=J31XX7VJ039N tag=79TE13NP1RZR type=write size=3399339 2024-09-22T08:21:02.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.355+0000 7fe6c9c31780 1 > prepared operation key=1HZ0NAJPXNW1 tag=FX6SHT1N3M10 type=del size=4130577 2024-09-22T08:21:02.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.356+0000 7fe6c9c31780 1 < completed delete operation key=2B5QRUMTVE7U tag=K9PRFK4RN38R type=del 2024-09-22T08:21:02.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.358+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=ANDCM7V5SFVE type=write size=302591 2024-09-22T08:21:02.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.362+0000 7fe6c9c31780 1 < suggested update operation key=ILW34WLX48WN tag=VZJFGE9NDR9H type=del size=217398 2024-09-22T08:21:02.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.365+0000 7fe6c9c31780 1 > prepared part key=_multipart_9AZWQ9E58QS6.2~90GJHXPTMCNU.0 size=1048576 2024-09-22T08:21:02.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.366+0000 7fe6c9c31780 1 > prepared part key=_multipart_9AZWQ9E58QS6.2~90GJHXPTMCNU.1 size=1048576 2024-09-22T08:21:02.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.368+0000 7fe6c9c31780 1 > prepared part key=_multipart_9AZWQ9E58QS6.2~90GJHXPTMCNU.2 size=916909 2024-09-22T08:21:02.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.368+0000 7fe6c9c31780 1 > prepared multipart upload key=9AZWQ9E58QS6 upload=90GJHXPTMCNU tag=NIYUWF32CCW5 type=write size=4062637 2024-09-22T08:21:02.370 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.370+0000 7fe6c9c31780 1 < completed delete operation key=O1UBUQXP50CN tag=I67EIKZAAQQR type=del 2024-09-22T08:21:02.372 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.372+0000 7fe6c9c31780 1 > prepared part key=_multipart_9AZWQ9E58QS6.2~DXFIT9HBMJND.0 size=1048576 2024-09-22T08:21:02.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.374+0000 7fe6c9c31780 1 > prepared part key=_multipart_9AZWQ9E58QS6.2~DXFIT9HBMJND.1 size=1048576 2024-09-22T08:21:02.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.374+0000 7fe6c9c31780 1 > prepared part key=_multipart_9AZWQ9E58QS6.2~DXFIT9HBMJND.2 size=817292 2024-09-22T08:21:02.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.374+0000 7fe6c9c31780 1 > prepared multipart upload key=9AZWQ9E58QS6 upload=DXFIT9HBMJND tag=ZFJBPTKBG7XA type=write size=3963020 2024-09-22T08:21:02.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.378+0000 7fe6c9c31780 1 < suggested remove operation key=2B5QRUMTVE7U tag=L8UXOC0Q15P7 type=del 2024-09-22T08:21:02.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.380+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=SSQ2R2305G12 type=write size=14841 2024-09-22T08:21:02.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.381+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~SIFK1EP1Q3EO.0 size=192072 2024-09-22T08:21:02.385 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.384+0000 7fe6c9c31780 1 < completed multipart upload key=T2W6RXP9UGHH upload=SIFK1EP1Q3EO tag=2KB8HLV831EY type=write size=1240648 2024-09-22T08:21:02.388 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.388+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~7082O40QE990.0 size=1021836 2024-09-22T08:21:02.388 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.388+0000 7fe6c9c31780 1 > prepared multipart upload key=XJP26CCPYDI7 upload=7082O40QE990 tag=PXWJQ8LGSEU9 type=write size=2070412 2024-09-22T08:21:02.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.391+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~EA04X2TZLJV4.0 size=1048576 2024-09-22T08:21:02.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.392+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~EA04X2TZLJV4.1 size=1002389 2024-09-22T08:21:02.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.394+0000 7fe6c9c31780 1 < completed multipart upload key=TE10GB1F35X4 upload=EA04X2TZLJV4 tag=QLO91FCA8FKG type=write size=3099541 2024-09-22T08:21:02.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.397+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~F78RN52N9IJV.0 size=1048576 2024-09-22T08:21:02.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.398+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~F78RN52N9IJV.1 size=672332 2024-09-22T08:21:02.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.398+0000 7fe6c9c31780 1 > prepared multipart upload key=DC7VLQWZ3TD1 upload=F78RN52N9IJV tag=4EXLWOF5Y2GU type=write size=2769484 2024-09-22T08:21:02.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.400+0000 7fe6c9c31780 1 < completed delete operation key=W9L87PTJEIOA tag=PQI4J522ZUPF type=del 2024-09-22T08:21:02.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.401+0000 7fe6c9c31780 1 > prepared operation key=XJP26CCPYDI7 tag=PEZZAKQ8EIQ4 type=del size=1787694 2024-09-22T08:21:02.404 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.403+0000 7fe6c9c31780 1 < completed delete operation key=CTK01Y0CV1NC tag=52RQTHFZEDE7 type=del 2024-09-22T08:21:02.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.404+0000 7fe6c9c31780 1 > prepared operation key=0PNK2ZW6IJM1 tag=KZFGKE9A2P05 type=del size=2664580 2024-09-22T08:21:02.407 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.406+0000 7fe6c9c31780 -1 < failed to complete operation key=2B5QRUMTVE7U tag=NHMPBGBUK0ZQ type=write size=735640: (22) Invalid argument 2024-09-22T08:21:02.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.409+0000 7fe6c9c31780 1 > prepared part key=_multipart_TJTB67QBLZH5.2~QFGRKEIV7R6L.0 size=1048576 2024-09-22T08:21:02.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.410+0000 7fe6c9c31780 1 > prepared part key=_multipart_TJTB67QBLZH5.2~QFGRKEIV7R6L.1 size=1048576 2024-09-22T08:21:02.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.411+0000 7fe6c9c31780 1 > prepared part key=_multipart_TJTB67QBLZH5.2~QFGRKEIV7R6L.2 size=124234 2024-09-22T08:21:02.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.411+0000 7fe6c9c31780 1 > prepared multipart upload key=TJTB67QBLZH5 upload=QFGRKEIV7R6L tag=SOB7IEXKBXPC type=write size=3269962 2024-09-22T08:21:02.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.413+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~KOVRTGGZLXCY.0 size=1048576 2024-09-22T08:21:02.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.414+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~KOVRTGGZLXCY.1 size=1048576 2024-09-22T08:21:02.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.416+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~KOVRTGGZLXCY.2 size=139920 2024-09-22T08:21:02.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.418+0000 7fe6c9c31780 1 < completed multipart upload key=0PNK2ZW6IJM1 upload=KOVRTGGZLXCY tag=11Y25E8L6YQQ type=write size=3285648 2024-09-22T08:21:02.420 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.420+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=V1VII4D2E9SB type=del size=577050 2024-09-22T08:21:02.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.422+0000 7fe6c9c31780 1 < completed delete operation key=0TWY0NNZZ7NN tag=APOE1RME5N0I type=del 2024-09-22T08:21:02.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.424+0000 7fe6c9c31780 1 > prepared operation key=1HZ0NAJPXNW1 tag=23GR74T4AA0E type=write size=389250 2024-09-22T08:21:02.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.425+0000 7fe6c9c31780 1 < completed delete operation key=GEWQUFB9K35E tag=1RJEV9692NE1 type=del 2024-09-22T08:21:02.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.427+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=64QD4BND7ZZG type=del size=4171037 2024-09-22T08:21:02.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.430+0000 7fe6c9c31780 1 < suggested update operation key=CTK01Y0CV1NC tag=4SJR0LG8QFTC type=del size=804639 2024-09-22T08:21:02.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.432+0000 7fe6c9c31780 1 > prepared operation key=JT5AB8VLMEFD tag=J093I6Q9OUUK type=write size=501830 2024-09-22T08:21:02.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.433+0000 7fe6c9c31780 1 < completed delete operation key=JT5AB8VLMEFD tag=5OJ1ESCT87JL type=del 2024-09-22T08:21:02.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.436+0000 7fe6c9c31780 1 > prepared part key=_multipart_W9L87PTJEIOA.2~YGY3N2VXZ03L.0 size=313405 2024-09-22T08:21:02.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.436+0000 7fe6c9c31780 1 > prepared multipart upload key=W9L87PTJEIOA upload=YGY3N2VXZ03L tag=3M0SG47HPXGR type=write size=1361981 2024-09-22T08:21:02.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.438+0000 7fe6c9c31780 1 < completed part key=_multipart_4KRJ7DTE3KDV.2~OP2I0V35XLYF.0 size=1048576 2024-09-22T08:21:02.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.438+0000 7fe6c9c31780 1 < canceled part key=_multipart_4KRJ7DTE3KDV.2~OP2I0V35XLYF.1 size=265832 2024-09-22T08:21:02.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.441+0000 7fe6c9c31780 1 < canceled multipart upload key=4KRJ7DTE3KDV upload=OP2I0V35XLYF tag=7VI6EUU4PJFP type=write size=2362984 2024-09-22T08:21:02.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.443+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~4PKHIAI53QNL.0 size=1048576 2024-09-22T08:21:02.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.445+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~4PKHIAI53QNL.1 size=438545 2024-09-22T08:21:02.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.445+0000 7fe6c9c31780 1 > prepared multipart upload key=FY40JTHLT0KU upload=4PKHIAI53QNL tag=31A0XQH1NAZM type=write size=2535697 2024-09-22T08:21:02.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.446+0000 7fe6c9c31780 1 < completed delete operation key=1HZ0NAJPXNW1 tag=FX6SHT1N3M10 type=del 2024-09-22T08:21:02.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.448+0000 7fe6c9c31780 1 > prepared part key=_multipart_W9L87PTJEIOA.2~D7PZI0DIO7H4.0 size=1048576 2024-09-22T08:21:02.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.450+0000 7fe6c9c31780 1 > prepared part key=_multipart_W9L87PTJEIOA.2~D7PZI0DIO7H4.1 size=310670 2024-09-22T08:21:02.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.450+0000 7fe6c9c31780 1 > prepared multipart upload key=W9L87PTJEIOA upload=D7PZI0DIO7H4 tag=7JEBVR33HO7Q type=write size=2407822 2024-09-22T08:21:02.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.451+0000 7fe6c9c31780 -1 < failed to complete operation key=ILW34WLX48WN tag=ANDCM7V5SFVE type=write size=302591: (22) Invalid argument 2024-09-22T08:21:02.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.453+0000 7fe6c9c31780 1 > prepared operation key=ZFL9N44PBQX4 tag=4VOS99V833B1 type=del size=946233 2024-09-22T08:21:02.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.454+0000 7fe6c9c31780 1 < completed part key=_multipart_9AZWQ9E58QS6.2~90GJHXPTMCNU.0 size=1048576 2024-09-22T08:21:02.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.456+0000 7fe6c9c31780 1 < completed part key=_multipart_9AZWQ9E58QS6.2~90GJHXPTMCNU.1 size=1048576 2024-09-22T08:21:02.458 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.457+0000 7fe6c9c31780 1 < completed part key=_multipart_9AZWQ9E58QS6.2~90GJHXPTMCNU.2 size=916909 2024-09-22T08:21:02.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.459+0000 7fe6c9c31780 1 < completed multipart upload key=9AZWQ9E58QS6 upload=90GJHXPTMCNU tag=NIYUWF32CCW5 type=write size=4062637 2024-09-22T08:21:02.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.462+0000 7fe6c9c31780 1 > prepared part key=_multipart_1HZ0NAJPXNW1.2~LOI8RJTOLTY8.0 size=1048576 2024-09-22T08:21:02.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.463+0000 7fe6c9c31780 1 > prepared part key=_multipart_1HZ0NAJPXNW1.2~LOI8RJTOLTY8.1 size=1048576 2024-09-22T08:21:02.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.464+0000 7fe6c9c31780 1 > prepared part key=_multipart_1HZ0NAJPXNW1.2~LOI8RJTOLTY8.2 size=255834 2024-09-22T08:21:02.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.464+0000 7fe6c9c31780 1 > prepared multipart upload key=1HZ0NAJPXNW1 upload=LOI8RJTOLTY8 tag=X6FR65JTSVLY type=write size=3401562 2024-09-22T08:21:02.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.466+0000 7fe6c9c31780 1 < completed part key=_multipart_9AZWQ9E58QS6.2~DXFIT9HBMJND.0 size=1048576 2024-09-22T08:21:02.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.467+0000 7fe6c9c31780 1 < completed part key=_multipart_9AZWQ9E58QS6.2~DXFIT9HBMJND.1 size=1048576 2024-09-22T08:21:02.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.468+0000 7fe6c9c31780 1 < completed part key=_multipart_9AZWQ9E58QS6.2~DXFIT9HBMJND.2 size=817292 2024-09-22T08:21:02.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.471+0000 7fe6c9c31780 1 < completed multipart upload key=9AZWQ9E58QS6 upload=DXFIT9HBMJND tag=ZFJBPTKBG7XA type=write size=3963020 2024-09-22T08:21:02.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.473+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~SMZBUR57G8UG.0 size=1048576 2024-09-22T08:21:02.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.474+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~SMZBUR57G8UG.1 size=365911 2024-09-22T08:21:02.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.474+0000 7fe6c9c31780 1 > prepared multipart upload key=D85LJGGU3Z6F upload=SMZBUR57G8UG tag=PD19IFR47XYY type=write size=2463063 2024-09-22T08:21:02.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.476+0000 7fe6c9c31780 1 < completed write operation key=6BKB91YV3FMW tag=SSQ2R2305G12 type=write size=14841 2024-09-22T08:21:02.478 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.477+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=H6LKDLTJ83FO type=del size=2967468 2024-09-22T08:21:02.480 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.479+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~7082O40QE990.0 size=1021836 2024-09-22T08:21:02.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.482+0000 7fe6c9c31780 1 < completed multipart upload key=XJP26CCPYDI7 upload=7082O40QE990 tag=PXWJQ8LGSEU9 type=write size=2070412 2024-09-22T08:21:02.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.484+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=MFRT6R7YU1QN type=del size=3230674 2024-09-22T08:21:02.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.485+0000 7fe6c9c31780 1 < completed part key=_multipart_DC7VLQWZ3TD1.2~F78RN52N9IJV.0 size=1048576 2024-09-22T08:21:02.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.487+0000 7fe6c9c31780 1 < completed part key=_multipart_DC7VLQWZ3TD1.2~F78RN52N9IJV.1 size=672332 2024-09-22T08:21:02.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.490+0000 7fe6c9c31780 1 < completed multipart upload key=DC7VLQWZ3TD1 upload=F78RN52N9IJV tag=4EXLWOF5Y2GU type=write size=2769484 2024-09-22T08:21:02.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.493+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~WGU5A9COYTA0.0 size=1048576 2024-09-22T08:21:02.495 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.494+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~WGU5A9COYTA0.1 size=1048576 2024-09-22T08:21:02.496 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.496+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~WGU5A9COYTA0.2 size=886220 2024-09-22T08:21:02.496 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.496+0000 7fe6c9c31780 1 > prepared multipart upload key=946H8F2AUPO2 upload=WGU5A9COYTA0 tag=CJIX0CT9ZAZU type=write size=4031948 2024-09-22T08:21:02.497 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.497+0000 7fe6c9c31780 1 < completed delete operation key=XJP26CCPYDI7 tag=PEZZAKQ8EIQ4 type=del 2024-09-22T08:21:02.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.499+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=TKKX8HJYKF4E type=del size=359707 2024-09-22T08:21:02.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.500+0000 7fe6c9c31780 1 < completed delete operation key=0PNK2ZW6IJM1 tag=KZFGKE9A2P05 type=del 2024-09-22T08:21:02.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.504+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~GFP6PHR1V2HR.0 size=1048576 2024-09-22T08:21:02.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.504+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~GFP6PHR1V2HR.1 size=1048576 2024-09-22T08:21:02.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.506+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~GFP6PHR1V2HR.2 size=858140 2024-09-22T08:21:02.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.506+0000 7fe6c9c31780 1 > prepared multipart upload key=0TWY0NNZZ7NN upload=GFP6PHR1V2HR tag=OMQ10AXSX527 type=write size=4003868 2024-09-22T08:21:02.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.507+0000 7fe6c9c31780 1 < completed part key=_multipart_TJTB67QBLZH5.2~QFGRKEIV7R6L.0 size=1048576 2024-09-22T08:21:02.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.509+0000 7fe6c9c31780 1 < completed part key=_multipart_TJTB67QBLZH5.2~QFGRKEIV7R6L.1 size=1048576 2024-09-22T08:21:02.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.510+0000 7fe6c9c31780 1 < completed part key=_multipart_TJTB67QBLZH5.2~QFGRKEIV7R6L.2 size=124234 2024-09-22T08:21:02.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.513+0000 7fe6c9c31780 1 < completed multipart upload key=TJTB67QBLZH5 upload=QFGRKEIV7R6L tag=SOB7IEXKBXPC type=write size=3269962 2024-09-22T08:21:02.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.515+0000 7fe6c9c31780 1 > prepared operation key=OX1LY7URY7IV tag=9OU1EKF2Q6D1 type=del size=3956307 2024-09-22T08:21:02.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.517+0000 7fe6c9c31780 -1 < failed to complete operation key=CTK01Y0CV1NC tag=V1VII4D2E9SB type=del size=577050: (22) Invalid argument 2024-09-22T08:21:02.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.518+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=5IE0TVV5CHDJ type=write size=1027549 2024-09-22T08:21:02.521 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.520+0000 7fe6c9c31780 1 < completed write operation key=1HZ0NAJPXNW1 tag=23GR74T4AA0E type=write size=389250 2024-09-22T08:21:02.524 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.523+0000 7fe6c9c31780 1 > prepared part key=_multipart_ZFL9N44PBQX4.2~TZDHUMQM2U7Q.0 size=1048576 2024-09-22T08:21:02.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.525+0000 7fe6c9c31780 1 > prepared part key=_multipart_ZFL9N44PBQX4.2~TZDHUMQM2U7Q.1 size=106307 2024-09-22T08:21:02.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.525+0000 7fe6c9c31780 1 > prepared multipart upload key=ZFL9N44PBQX4 upload=TZDHUMQM2U7Q tag=P7JQD5C5PXBV type=write size=2203459 2024-09-22T08:21:02.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.528+0000 7fe6c9c31780 1 < suggested remove operation key=ILW34WLX48WN tag=64QD4BND7ZZG type=del 2024-09-22T08:21:02.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.529+0000 7fe6c9c31780 1 > prepared operation key=W9L87PTJEIOA tag=67D1OBTZEOUU type=del size=1115297 2024-09-22T08:21:02.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.531+0000 7fe6c9c31780 1 < completed write operation key=JT5AB8VLMEFD tag=J093I6Q9OUUK type=write size=501830 2024-09-22T08:21:02.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.533+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=8YL7A0F13AFJ type=del size=3418238 2024-09-22T08:21:02.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.535+0000 7fe6c9c31780 1 < completed part key=_multipart_W9L87PTJEIOA.2~YGY3N2VXZ03L.0 size=313405 2024-09-22T08:21:02.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.539+0000 7fe6c9c31780 1 < completed multipart upload key=W9L87PTJEIOA upload=YGY3N2VXZ03L tag=3M0SG47HPXGR type=write size=1361981 2024-09-22T08:21:02.542 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.542+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~L2TK2J3NVWWK.0 size=1048576 2024-09-22T08:21:02.543 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.542+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~L2TK2J3NVWWK.1 size=1048576 2024-09-22T08:21:02.544 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.544+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~L2TK2J3NVWWK.2 size=53733 2024-09-22T08:21:02.545 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.544+0000 7fe6c9c31780 1 > prepared multipart upload key=FY40JTHLT0KU upload=L2TK2J3NVWWK tag=1ZOIY48SFYEP type=write size=3199461 2024-09-22T08:21:02.546 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.545+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~4PKHIAI53QNL.0 size=1048576 2024-09-22T08:21:02.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.546+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~4PKHIAI53QNL.1 size=438545 2024-09-22T08:21:02.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.549+0000 7fe6c9c31780 1 < completed multipart upload key=FY40JTHLT0KU upload=4PKHIAI53QNL tag=31A0XQH1NAZM type=write size=2535697 2024-09-22T08:21:02.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.552+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~EH0HCBBMCPNJ.0 size=1010757 2024-09-22T08:21:02.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.552+0000 7fe6c9c31780 1 > prepared multipart upload key=D85LJGGU3Z6F upload=EH0HCBBMCPNJ tag=6PIPIL0ZTHD0 type=write size=2059333 2024-09-22T08:21:02.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.553+0000 7fe6c9c31780 1 < completed part key=_multipart_W9L87PTJEIOA.2~D7PZI0DIO7H4.0 size=1048576 2024-09-22T08:21:02.555 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.554+0000 7fe6c9c31780 1 < completed part key=_multipart_W9L87PTJEIOA.2~D7PZI0DIO7H4.1 size=310670 2024-09-22T08:21:02.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.557+0000 7fe6c9c31780 1 < completed multipart upload key=W9L87PTJEIOA upload=D7PZI0DIO7H4 tag=7JEBVR33HO7Q type=write size=2407822 2024-09-22T08:21:02.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.558+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=5IFOIHC2WK1Y type=del size=148796 2024-09-22T08:21:02.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.560+0000 7fe6c9c31780 1 < canceled operation key=ZFL9N44PBQX4 tag=4VOS99V833B1 type=del size=946233 2024-09-22T08:21:02.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.563+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~HV7FC09FX46E.0 size=1048576 2024-09-22T08:21:02.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.564+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~HV7FC09FX46E.1 size=483180 2024-09-22T08:21:02.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.564+0000 7fe6c9c31780 1 > prepared multipart upload key=CTK01Y0CV1NC upload=HV7FC09FX46E tag=JMJC3QOS76M3 type=write size=2580332 2024-09-22T08:21:02.566 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.566+0000 7fe6c9c31780 1 < completed part key=_multipart_1HZ0NAJPXNW1.2~LOI8RJTOLTY8.0 size=1048576 2024-09-22T08:21:02.567 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.567+0000 7fe6c9c31780 1 < completed part key=_multipart_1HZ0NAJPXNW1.2~LOI8RJTOLTY8.1 size=1048576 2024-09-22T08:21:02.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.568+0000 7fe6c9c31780 1 < completed part key=_multipart_1HZ0NAJPXNW1.2~LOI8RJTOLTY8.2 size=255834 2024-09-22T08:21:02.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.571+0000 7fe6c9c31780 1 < completed multipart upload key=1HZ0NAJPXNW1 upload=LOI8RJTOLTY8 tag=X6FR65JTSVLY type=write size=3401562 2024-09-22T08:21:02.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.572+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=418TXQGL9VB7 type=del size=584851 2024-09-22T08:21:02.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.574+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~SMZBUR57G8UG.0 size=1048576 2024-09-22T08:21:02.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.574+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~SMZBUR57G8UG.1 size=365911 2024-09-22T08:21:02.578 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.577+0000 7fe6c9c31780 1 < completed multipart upload key=D85LJGGU3Z6F upload=SMZBUR57G8UG tag=PD19IFR47XYY type=write size=2463063 2024-09-22T08:21:02.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.578+0000 7fe6c9c31780 1 > prepared operation key=Z1CK5EDBK4AW tag=5VNQ1CQYWPHX type=del size=1274474 2024-09-22T08:21:02.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.580+0000 7fe6c9c31780 1 < completed delete operation key=CTK01Y0CV1NC tag=H6LKDLTJ83FO type=del 2024-09-22T08:21:02.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.581+0000 7fe6c9c31780 1 > prepared operation key=W9L87PTJEIOA tag=QTPMYRBBVMOK type=del size=2336456 2024-09-22T08:21:02.585 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.585+0000 7fe6c9c31780 1 < suggested update operation key=9AZWQ9E58QS6 tag=MFRT6R7YU1QN type=del size=3230674 2024-09-22T08:21:02.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.586+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=PQP9TA1AUBX6 type=del size=1655139 2024-09-22T08:21:02.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.587+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~WGU5A9COYTA0.0 size=1048576 2024-09-22T08:21:02.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.589+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~WGU5A9COYTA0.1 size=1048576 2024-09-22T08:21:02.590 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.590+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~WGU5A9COYTA0.2 size=886220 2024-09-22T08:21:02.593 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.592+0000 7fe6c9c31780 1 < completed multipart upload key=946H8F2AUPO2 upload=WGU5A9COYTA0 tag=CJIX0CT9ZAZU type=write size=4031948 2024-09-22T08:21:02.596 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.595+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~V1Z347UPU7TR.0 size=1048576 2024-09-22T08:21:02.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.596+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~V1Z347UPU7TR.1 size=1048576 2024-09-22T08:21:02.598 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.598+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~V1Z347UPU7TR.2 size=125585 2024-09-22T08:21:02.598 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.598+0000 7fe6c9c31780 1 > prepared multipart upload key=O1UBUQXP50CN upload=V1Z347UPU7TR tag=GMUQWTAUD4WP type=write size=3271313 2024-09-22T08:21:02.599 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.599+0000 7fe6c9c31780 1 < completed delete operation key=76HZ3LZGVT9J tag=TKKX8HJYKF4E type=del 2024-09-22T08:21:02.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.600+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=HWPZJOV41LV6 type=del size=2959925 2024-09-22T08:21:02.602 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.602+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~GFP6PHR1V2HR.0 size=1048576 2024-09-22T08:21:02.603 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.603+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~GFP6PHR1V2HR.1 size=1048576 2024-09-22T08:21:02.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.604+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~GFP6PHR1V2HR.2 size=858140 2024-09-22T08:21:02.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.606+0000 7fe6c9c31780 1 < completed multipart upload key=0TWY0NNZZ7NN upload=GFP6PHR1V2HR tag=OMQ10AXSX527 type=write size=4003868 2024-09-22T08:21:02.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.608+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=SYCLK0MIKEM4 type=del size=627494 2024-09-22T08:21:02.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.610+0000 7fe6c9c31780 1 < completed delete operation key=OX1LY7URY7IV tag=9OU1EKF2Q6D1 type=del 2024-09-22T08:21:02.611 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.611+0000 7fe6c9c31780 1 > prepared operation key=TYVQ39KUV2V9 tag=5B3TBPURG0C1 type=del size=513178 2024-09-22T08:21:02.613 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.612+0000 7fe6c9c31780 1 < completed write operation key=6BKB91YV3FMW tag=5IE0TVV5CHDJ type=write size=1027549 2024-09-22T08:21:02.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.615+0000 7fe6c9c31780 1 > prepared part key=_multipart_TJTB67QBLZH5.2~BBZPSS73GJJ3.0 size=191665 2024-09-22T08:21:02.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.615+0000 7fe6c9c31780 1 > prepared multipart upload key=TJTB67QBLZH5 upload=BBZPSS73GJJ3 tag=94HHGGDSAIYE type=write size=1240241 2024-09-22T08:21:02.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.615+0000 7fe6c9c31780 1 < canceled part key=_multipart_ZFL9N44PBQX4.2~TZDHUMQM2U7Q.0 size=1048576 2024-09-22T08:21:02.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.616+0000 7fe6c9c31780 1 < completed part key=_multipart_ZFL9N44PBQX4.2~TZDHUMQM2U7Q.1 size=106307 2024-09-22T08:21:02.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.619+0000 7fe6c9c31780 1 < canceled multipart upload key=ZFL9N44PBQX4 upload=TZDHUMQM2U7Q tag=P7JQD5C5PXBV type=write size=2203459 2024-09-22T08:21:02.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.620+0000 7fe6c9c31780 1 > prepared operation key=Z1CK5EDBK4AW tag=LCKHE2QKZVVE type=del size=202073 2024-09-22T08:21:02.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.623+0000 7fe6c9c31780 1 < suggested update operation key=W9L87PTJEIOA tag=67D1OBTZEOUU type=del size=1115297 2024-09-22T08:21:02.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.625+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=WI30ITTF6P94 type=del size=896174 2024-09-22T08:21:02.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.626+0000 7fe6c9c31780 1 < canceled operation key=CTK01Y0CV1NC tag=8YL7A0F13AFJ type=del size=3418238 2024-09-22T08:21:02.628 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.628+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=U64AR8VS4L61 type=del size=3034935 2024-09-22T08:21:02.629 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.629+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~L2TK2J3NVWWK.0 size=1048576 2024-09-22T08:21:02.630 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.629+0000 7fe6c9c31780 1 < canceled part key=_multipart_FY40JTHLT0KU.2~L2TK2J3NVWWK.1 size=1048576 2024-09-22T08:21:02.631 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.630+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~L2TK2J3NVWWK.2 size=53733 2024-09-22T08:21:02.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.633+0000 7fe6c9c31780 1 < canceled multipart upload key=FY40JTHLT0KU upload=L2TK2J3NVWWK tag=1ZOIY48SFYEP type=write size=3199461 2024-09-22T08:21:02.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.634+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=XM09RVUE702N type=write size=512213 2024-09-22T08:21:02.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.636+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~EH0HCBBMCPNJ.0 size=1010757 2024-09-22T08:21:02.639 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.638+0000 7fe6c9c31780 1 < completed multipart upload key=D85LJGGU3Z6F upload=EH0HCBBMCPNJ tag=6PIPIL0ZTHD0 type=write size=2059333 2024-09-22T08:21:02.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.641+0000 7fe6c9c31780 1 > prepared part key=_multipart_9AZWQ9E58QS6.2~8FXOKZJGH62M.0 size=1048576 2024-09-22T08:21:02.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.642+0000 7fe6c9c31780 1 > prepared part key=_multipart_9AZWQ9E58QS6.2~8FXOKZJGH62M.1 size=1048576 2024-09-22T08:21:02.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.644+0000 7fe6c9c31780 1 > prepared part key=_multipart_9AZWQ9E58QS6.2~8FXOKZJGH62M.2 size=228428 2024-09-22T08:21:02.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.644+0000 7fe6c9c31780 1 > prepared multipart upload key=9AZWQ9E58QS6 upload=8FXOKZJGH62M tag=24PQH2MD21BG type=write size=3374156 2024-09-22T08:21:02.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.646+0000 7fe6c9c31780 1 < suggested update operation key=CTK01Y0CV1NC tag=5IFOIHC2WK1Y type=del size=148796 2024-09-22T08:21:02.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.648+0000 7fe6c9c31780 1 > prepared operation key=TJTB67QBLZH5 tag=BK4N1BES1XSF type=write size=1022143 2024-09-22T08:21:02.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.650+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~HV7FC09FX46E.0 size=1048576 2024-09-22T08:21:02.651 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.650+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~HV7FC09FX46E.1 size=483180 2024-09-22T08:21:02.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.653+0000 7fe6c9c31780 1 < completed multipart upload key=CTK01Y0CV1NC upload=HV7FC09FX46E tag=JMJC3QOS76M3 type=write size=2580332 2024-09-22T08:21:02.655 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.654+0000 7fe6c9c31780 1 > prepared operation key=D85LJGGU3Z6F tag=FATZ1HO1NET1 type=del size=534218 2024-09-22T08:21:02.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.656+0000 7fe6c9c31780 1 < completed delete operation key=ILW34WLX48WN tag=418TXQGL9VB7 type=del 2024-09-22T08:21:02.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.657+0000 7fe6c9c31780 1 > prepared operation key=ZFL9N44PBQX4 tag=9B290G01C49Q type=del size=1675026 2024-09-22T08:21:02.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.659+0000 7fe6c9c31780 1 < completed delete operation key=Z1CK5EDBK4AW tag=5VNQ1CQYWPHX type=del 2024-09-22T08:21:02.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.660+0000 7fe6c9c31780 1 > prepared operation key=VP1MP4IC9A7T tag=SG2NGCVK2QPK type=write size=575046 2024-09-22T08:21:02.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.662+0000 7fe6c9c31780 -1 < failed to complete operation key=W9L87PTJEIOA tag=QTPMYRBBVMOK type=del size=2336456: (22) Invalid argument 2024-09-22T08:21:02.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.664+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~Y3PJCYPZXQLH.0 size=925390 2024-09-22T08:21:02.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.664+0000 7fe6c9c31780 1 > prepared multipart upload key=9FCSIF1WKBDJ upload=Y3PJCYPZXQLH tag=JHIDFEIV9GM5 type=write size=1973966 2024-09-22T08:21:02.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.666+0000 7fe6c9c31780 1 < completed delete operation key=TE10GB1F35X4 tag=PQP9TA1AUBX6 type=del 2024-09-22T08:21:02.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.669+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~EEQU8OO7SL6T.0 size=1048576 2024-09-22T08:21:02.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.670+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~EEQU8OO7SL6T.1 size=1048576 2024-09-22T08:21:02.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.671+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~EEQU8OO7SL6T.2 size=38540 2024-09-22T08:21:02.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.671+0000 7fe6c9c31780 1 > prepared multipart upload key=0PNK2ZW6IJM1 upload=EEQU8OO7SL6T tag=ISBWLO5JKXG4 type=write size=3184268 2024-09-22T08:21:02.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.673+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~V1Z347UPU7TR.0 size=1048576 2024-09-22T08:21:02.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.674+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~V1Z347UPU7TR.1 size=1048576 2024-09-22T08:21:02.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.674+0000 7fe6c9c31780 1 < canceled part key=_multipart_O1UBUQXP50CN.2~V1Z347UPU7TR.2 size=125585 2024-09-22T08:21:02.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.677+0000 7fe6c9c31780 1 < canceled multipart upload key=O1UBUQXP50CN upload=V1Z347UPU7TR tag=GMUQWTAUD4WP type=write size=3271313 2024-09-22T08:21:02.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.678+0000 7fe6c9c31780 1 > prepared operation key=ZFL9N44PBQX4 tag=15OZQXW8B403 type=del size=2299739 2024-09-22T08:21:02.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.682+0000 7fe6c9c31780 1 < suggested remove operation key=CTK01Y0CV1NC tag=HWPZJOV41LV6 type=del 2024-09-22T08:21:02.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.684+0000 7fe6c9c31780 1 > prepared operation key=4KRJ7DTE3KDV tag=BX3LSL6CT5XH type=del size=3101497 2024-09-22T08:21:02.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.685+0000 7fe6c9c31780 1 < completed delete operation key=ILW34WLX48WN tag=SYCLK0MIKEM4 type=del 2024-09-22T08:21:02.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.688+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~DA93EWA137X5.0 size=1048576 2024-09-22T08:21:02.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.689+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~DA93EWA137X5.1 size=272016 2024-09-22T08:21:02.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.689+0000 7fe6c9c31780 1 > prepared multipart upload key=7446WN19QFV0 upload=DA93EWA137X5 tag=NALHLABU7416 type=write size=2369168 2024-09-22T08:21:02.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.690+0000 7fe6c9c31780 1 < completed delete operation key=TYVQ39KUV2V9 tag=5B3TBPURG0C1 type=del 2024-09-22T08:21:02.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.693+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~6J5716DTLG56.0 size=1048576 2024-09-22T08:21:02.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.694+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~6J5716DTLG56.1 size=1048576 2024-09-22T08:21:02.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.695+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~6J5716DTLG56.2 size=387802 2024-09-22T08:21:02.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.695+0000 7fe6c9c31780 1 > prepared multipart upload key=T2W6RXP9UGHH upload=6J5716DTLG56 tag=HD5E6O7C8GRH type=write size=3533530 2024-09-22T08:21:02.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.696+0000 7fe6c9c31780 1 < completed part key=_multipart_TJTB67QBLZH5.2~BBZPSS73GJJ3.0 size=191665 2024-09-22T08:21:02.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.699+0000 7fe6c9c31780 1 < completed multipart upload key=TJTB67QBLZH5 upload=BBZPSS73GJJ3 tag=94HHGGDSAIYE type=write size=1240241 2024-09-22T08:21:02.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.701+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~KCCE71JQ9NLP.0 size=922380 2024-09-22T08:21:02.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.701+0000 7fe6c9c31780 1 > prepared multipart upload key=9FCSIF1WKBDJ upload=KCCE71JQ9NLP tag=OGRDIHR820BN type=write size=1970956 2024-09-22T08:21:02.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.703+0000 7fe6c9c31780 1 < completed delete operation key=Z1CK5EDBK4AW tag=LCKHE2QKZVVE type=del 2024-09-22T08:21:02.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.706+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~NEK3449LO4LE.0 size=238746 2024-09-22T08:21:02.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.706+0000 7fe6c9c31780 1 > prepared multipart upload key=TYVQ39KUV2V9 upload=NEK3449LO4LE tag=CCWRQHNE0XRF type=write size=1287322 2024-09-22T08:21:02.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.707+0000 7fe6c9c31780 1 < completed delete operation key=T2W6RXP9UGHH tag=WI30ITTF6P94 type=del 2024-09-22T08:21:02.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.708+0000 7fe6c9c31780 1 > prepared operation key=TJTB67QBLZH5 tag=7737G0Q59P5Q type=del size=652960 2024-09-22T08:21:02.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.710+0000 7fe6c9c31780 1 < completed delete operation key=TE10GB1F35X4 tag=U64AR8VS4L61 type=del 2024-09-22T08:21:02.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.713+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~HA5D1WB3O89P.0 size=1048576 2024-09-22T08:21:02.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.714+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~HA5D1WB3O89P.1 size=1048576 2024-09-22T08:21:02.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.715+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~HA5D1WB3O89P.2 size=944322 2024-09-22T08:21:02.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.715+0000 7fe6c9c31780 1 > prepared multipart upload key=VP1MP4IC9A7T upload=HA5D1WB3O89P tag=VWFE52I2L4WE type=write size=4090050 2024-09-22T08:21:02.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.719+0000 7fe6c9c31780 1 < suggested remove operation key=6BKB91YV3FMW tag=XM09RVUE702N type=write 2024-09-22T08:21:02.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.721+0000 7fe6c9c31780 1 > prepared operation key=OX1LY7URY7IV tag=YSWJEGMQE9P4 type=del size=3665223 2024-09-22T08:21:02.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.722+0000 7fe6c9c31780 1 < completed part key=_multipart_9AZWQ9E58QS6.2~8FXOKZJGH62M.0 size=1048576 2024-09-22T08:21:02.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.724+0000 7fe6c9c31780 1 < completed part key=_multipart_9AZWQ9E58QS6.2~8FXOKZJGH62M.1 size=1048576 2024-09-22T08:21:02.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.725+0000 7fe6c9c31780 1 < completed part key=_multipart_9AZWQ9E58QS6.2~8FXOKZJGH62M.2 size=228428 2024-09-22T08:21:02.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.728+0000 7fe6c9c31780 1 < completed multipart upload key=9AZWQ9E58QS6 upload=8FXOKZJGH62M tag=24PQH2MD21BG type=write size=3374156 2024-09-22T08:21:02.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.730+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=E3PPKOMVKN4X type=del size=4010044 2024-09-22T08:21:02.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.732+0000 7fe6c9c31780 1 < suggested remove operation key=TJTB67QBLZH5 tag=BK4N1BES1XSF type=write 2024-09-22T08:21:02.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.733+0000 7fe6c9c31780 1 > prepared operation key=TYVQ39KUV2V9 tag=ON0NO2G2171B type=del size=4081618 2024-09-22T08:21:02.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.735+0000 7fe6c9c31780 1 < completed delete operation key=D85LJGGU3Z6F tag=FATZ1HO1NET1 type=del 2024-09-22T08:21:02.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.737+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~BMD0K4RNIWGO.0 size=224918 2024-09-22T08:21:02.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.737+0000 7fe6c9c31780 1 > prepared multipart upload key=OX1LY7URY7IV upload=BMD0K4RNIWGO tag=VV01XV9L48WH type=write size=1273494 2024-09-22T08:21:02.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.739+0000 7fe6c9c31780 1 < canceled operation key=ZFL9N44PBQX4 tag=9B290G01C49Q type=del size=1675026 2024-09-22T08:21:02.741 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.740+0000 7fe6c9c31780 1 > prepared operation key=0PNK2ZW6IJM1 tag=4COD0FB6C248 type=del size=4010827 2024-09-22T08:21:02.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.742+0000 7fe6c9c31780 1 < completed write operation key=VP1MP4IC9A7T tag=SG2NGCVK2QPK type=write size=575046 2024-09-22T08:21:02.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.743+0000 7fe6c9c31780 1 > prepared operation key=KZIY400KQ5NH tag=32WC9ET3HG1O type=del size=3576336 2024-09-22T08:21:02.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.745+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~Y3PJCYPZXQLH.0 size=925390 2024-09-22T08:21:02.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.747+0000 7fe6c9c31780 1 < completed multipart upload key=9FCSIF1WKBDJ upload=Y3PJCYPZXQLH tag=JHIDFEIV9GM5 type=write size=1973966 2024-09-22T08:21:02.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.748+0000 7fe6c9c31780 1 > prepared operation key=GEWQUFB9K35E tag=UY66XESWHDUJ type=del size=2573974 2024-09-22T08:21:02.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.749+0000 7fe6c9c31780 1 < canceled part key=_multipart_0PNK2ZW6IJM1.2~EEQU8OO7SL6T.0 size=1048576 2024-09-22T08:21:02.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.750+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~EEQU8OO7SL6T.1 size=1048576 2024-09-22T08:21:02.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.751+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~EEQU8OO7SL6T.2 size=38540 2024-09-22T08:21:02.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.753+0000 7fe6c9c31780 1 < canceled multipart upload key=0PNK2ZW6IJM1 upload=EEQU8OO7SL6T tag=ISBWLO5JKXG4 type=write size=3184268 2024-09-22T08:21:02.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.755+0000 7fe6c9c31780 1 > prepared operation key=D85LJGGU3Z6F tag=UR7TTHWRB2GJ type=del size=2976374 2024-09-22T08:21:02.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.756+0000 7fe6c9c31780 1 < completed delete operation key=ZFL9N44PBQX4 tag=15OZQXW8B403 type=del 2024-09-22T08:21:02.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.758+0000 7fe6c9c31780 1 > prepared operation key=W9L87PTJEIOA tag=6JZCEMEHNZFX type=write size=282198 2024-09-22T08:21:02.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.759+0000 7fe6c9c31780 1 < completed delete operation key=4KRJ7DTE3KDV tag=BX3LSL6CT5XH type=del 2024-09-22T08:21:02.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.763+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~NC85HQ0XEWFL.0 size=1048576 2024-09-22T08:21:02.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.764+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~NC85HQ0XEWFL.1 size=191472 2024-09-22T08:21:02.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.764+0000 7fe6c9c31780 1 > prepared multipart upload key=TE10GB1F35X4 upload=NC85HQ0XEWFL tag=ROQAP48R0K3J type=write size=2288624 2024-09-22T08:21:02.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.766+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~DA93EWA137X5.0 size=1048576 2024-09-22T08:21:02.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.767+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~DA93EWA137X5.1 size=272016 2024-09-22T08:21:02.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.770+0000 7fe6c9c31780 1 < completed multipart upload key=7446WN19QFV0 upload=DA93EWA137X5 tag=NALHLABU7416 type=write size=2369168 2024-09-22T08:21:02.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.771+0000 7fe6c9c31780 1 > prepared operation key=0PNK2ZW6IJM1 tag=93BSOC20F1UL type=del size=1896055 2024-09-22T08:21:02.774 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.773+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~6J5716DTLG56.0 size=1048576 2024-09-22T08:21:02.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.775+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~6J5716DTLG56.1 size=1048576 2024-09-22T08:21:02.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.776+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~6J5716DTLG56.2 size=387802 2024-09-22T08:21:02.779 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.778+0000 7fe6c9c31780 1 < completed multipart upload key=T2W6RXP9UGHH upload=6J5716DTLG56 tag=HD5E6O7C8GRH type=write size=3533530 2024-09-22T08:21:02.781 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.780+0000 7fe6c9c31780 1 > prepared operation key=VP1MP4IC9A7T tag=BYCTSNOC80JV type=write size=68863 2024-09-22T08:21:02.782 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.781+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~KCCE71JQ9NLP.0 size=922380 2024-09-22T08:21:02.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.784+0000 7fe6c9c31780 1 < completed multipart upload key=9FCSIF1WKBDJ upload=KCCE71JQ9NLP tag=OGRDIHR820BN type=write size=1970956 2024-09-22T08:21:02.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.787+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~UM89VUH7YMD6.0 size=1048576 2024-09-22T08:21:02.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.788+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~UM89VUH7YMD6.1 size=95433 2024-09-22T08:21:02.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.788+0000 7fe6c9c31780 1 > prepared multipart upload key=Z1CK5EDBK4AW upload=UM89VUH7YMD6 tag=J5FYHW9FSPL5 type=write size=2192585 2024-09-22T08:21:02.791 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.791+0000 7fe6c9c31780 1 < completed part key=_multipart_TYVQ39KUV2V9.2~NEK3449LO4LE.0 size=238746 2024-09-22T08:21:02.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.794+0000 7fe6c9c31780 1 < completed multipart upload key=TYVQ39KUV2V9 upload=NEK3449LO4LE tag=CCWRQHNE0XRF type=write size=1287322 2024-09-22T08:21:02.796 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.796+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=9K4LMCAJYJ4L type=write size=482774 2024-09-22T08:21:02.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.798+0000 7fe6c9c31780 -1 < failed to complete operation key=TJTB67QBLZH5 tag=7737G0Q59P5Q type=del size=652960: (22) Invalid argument 2024-09-22T08:21:02.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.800+0000 7fe6c9c31780 1 > prepared part key=_multipart_ZFL9N44PBQX4.2~LQDDIYMOUDSV.0 size=699316 2024-09-22T08:21:02.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.800+0000 7fe6c9c31780 1 > prepared multipart upload key=ZFL9N44PBQX4 upload=LQDDIYMOUDSV tag=OSNB95PSOFJL type=write size=1747892 2024-09-22T08:21:02.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.802+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~HA5D1WB3O89P.0 size=1048576 2024-09-22T08:21:02.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.803+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~HA5D1WB3O89P.1 size=1048576 2024-09-22T08:21:02.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.804+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~HA5D1WB3O89P.2 size=944322 2024-09-22T08:21:02.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.807+0000 7fe6c9c31780 1 < completed multipart upload key=VP1MP4IC9A7T upload=HA5D1WB3O89P tag=VWFE52I2L4WE type=write size=4090050 2024-09-22T08:21:02.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.808+0000 7fe6c9c31780 1 > prepared operation key=9FCSIF1WKBDJ tag=MHMOG9Y2PF66 type=del size=697165 2024-09-22T08:21:02.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.812+0000 7fe6c9c31780 1 < suggested update operation key=OX1LY7URY7IV tag=YSWJEGMQE9P4 type=del size=3665223 2024-09-22T08:21:02.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.814+0000 7fe6c9c31780 1 > prepared operation key=O1UBUQXP50CN tag=LZNVWYOHBPYA type=del size=940911 2024-09-22T08:21:02.816 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.816+0000 7fe6c9c31780 1 < completed delete operation key=T2W6RXP9UGHH tag=E3PPKOMVKN4X type=del 2024-09-22T08:21:02.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.818+0000 7fe6c9c31780 1 > prepared operation key=OX1LY7URY7IV tag=P7DUN2O4S8FO type=del size=742112 2024-09-22T08:21:02.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.819+0000 7fe6c9c31780 1 < completed delete operation key=TYVQ39KUV2V9 tag=ON0NO2G2171B type=del 2024-09-22T08:21:02.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.821+0000 7fe6c9c31780 1 > prepared operation key=4KRJ7DTE3KDV tag=P2TSEBOZT02Y type=del size=2628715 2024-09-22T08:21:02.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.822+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~BMD0K4RNIWGO.0 size=224918 2024-09-22T08:21:02.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.825+0000 7fe6c9c31780 1 < completed multipart upload key=OX1LY7URY7IV upload=BMD0K4RNIWGO tag=VV01XV9L48WH type=write size=1273494 2024-09-22T08:21:02.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.826+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=3LHXODV76QXG type=del size=2958113 2024-09-22T08:21:02.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.828+0000 7fe6c9c31780 1 < completed delete operation key=0PNK2ZW6IJM1 tag=4COD0FB6C248 type=del 2024-09-22T08:21:02.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.830+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=Q049UWGXLF2Q type=write size=1522 2024-09-22T08:21:02.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.830+0000 7fe6c9c31780 1 < canceled operation key=KZIY400KQ5NH tag=32WC9ET3HG1O type=del size=3576336 2024-09-22T08:21:02.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.833+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~XTKY4XM6GNRR.0 size=1048576 2024-09-22T08:21:02.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.834+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~XTKY4XM6GNRR.1 size=1048576 2024-09-22T08:21:02.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.835+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~XTKY4XM6GNRR.2 size=1006523 2024-09-22T08:21:02.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.835+0000 7fe6c9c31780 1 > prepared multipart upload key=2B5QRUMTVE7U upload=XTKY4XM6GNRR tag=2QFCAEUOARID type=write size=4152251 2024-09-22T08:21:02.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.837+0000 7fe6c9c31780 1 < completed delete operation key=GEWQUFB9K35E tag=UY66XESWHDUJ type=del 2024-09-22T08:21:02.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.838+0000 7fe6c9c31780 1 > prepared operation key=ZFL9N44PBQX4 tag=FSHCJ0DCBQQS type=write size=750066 2024-09-22T08:21:02.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.840+0000 7fe6c9c31780 1 < completed delete operation key=D85LJGGU3Z6F tag=UR7TTHWRB2GJ type=del 2024-09-22T08:21:02.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.841+0000 7fe6c9c31780 1 > prepared operation key=0PNK2ZW6IJM1 tag=DNE9P3Q85EPN type=del size=3208691 2024-09-22T08:21:02.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.843+0000 7fe6c9c31780 1 < completed write operation key=W9L87PTJEIOA tag=6JZCEMEHNZFX type=write size=282198 2024-09-22T08:21:02.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.845+0000 7fe6c9c31780 1 > prepared operation key=Z1CK5EDBK4AW tag=33RNSQZG09L5 type=write size=291124 2024-09-22T08:21:02.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.846+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~NC85HQ0XEWFL.0 size=1048576 2024-09-22T08:21:02.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.848+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~NC85HQ0XEWFL.1 size=191472 2024-09-22T08:21:02.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.850+0000 7fe6c9c31780 1 < completed multipart upload key=TE10GB1F35X4 upload=NC85HQ0XEWFL tag=ROQAP48R0K3J type=write size=2288624 2024-09-22T08:21:02.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.853+0000 7fe6c9c31780 1 > prepared part key=_multipart_TJTB67QBLZH5.2~M62D4OYW6LV0.0 size=310377 2024-09-22T08:21:02.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.853+0000 7fe6c9c31780 1 > prepared multipart upload key=TJTB67QBLZH5 upload=M62D4OYW6LV0 tag=ZB8CCNH4BZTW type=write size=1358953 2024-09-22T08:21:02.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.855+0000 7fe6c9c31780 1 < completed delete operation key=0PNK2ZW6IJM1 tag=93BSOC20F1UL type=del 2024-09-22T08:21:02.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.856+0000 7fe6c9c31780 1 > prepared operation key=XJP26CCPYDI7 tag=31DAL5GC7HYR type=write size=584089 2024-09-22T08:21:02.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.858+0000 7fe6c9c31780 1 < completed write operation key=VP1MP4IC9A7T tag=BYCTSNOC80JV type=write size=68863 2024-09-22T08:21:02.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.860+0000 7fe6c9c31780 1 > prepared operation key=KZIY400KQ5NH tag=EYIK3SGFU9XP type=del size=3446479 2024-09-22T08:21:02.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.862+0000 7fe6c9c31780 1 < completed part key=_multipart_Z1CK5EDBK4AW.2~UM89VUH7YMD6.0 size=1048576 2024-09-22T08:21:02.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.862+0000 7fe6c9c31780 1 < canceled part key=_multipart_Z1CK5EDBK4AW.2~UM89VUH7YMD6.1 size=95433 2024-09-22T08:21:02.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.863+0000 7fe6c9c31780 1 < canceled multipart upload key=Z1CK5EDBK4AW upload=UM89VUH7YMD6 tag=J5FYHW9FSPL5 type=write size=2192585 2024-09-22T08:21:02.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.865+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=0JGG9B5ESN0S type=del size=3120658 2024-09-22T08:21:02.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.866+0000 7fe6c9c31780 1 < completed write operation key=0TWY0NNZZ7NN tag=9K4LMCAJYJ4L type=write size=482774 2024-09-22T08:21:02.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.868+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=GRBXK3Z331XT type=del size=749794 2024-09-22T08:21:02.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.869+0000 7fe6c9c31780 1 < completed part key=_multipart_ZFL9N44PBQX4.2~LQDDIYMOUDSV.0 size=699316 2024-09-22T08:21:02.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.872+0000 7fe6c9c31780 1 < completed multipart upload key=ZFL9N44PBQX4 upload=LQDDIYMOUDSV tag=OSNB95PSOFJL type=write size=1747892 2024-09-22T08:21:02.874 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.873+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=5U4G9ARCOGQI type=del size=3618219 2024-09-22T08:21:02.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.876+0000 7fe6c9c31780 1 < suggested remove operation key=9FCSIF1WKBDJ tag=MHMOG9Y2PF66 type=del 2024-09-22T08:21:02.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.878+0000 7fe6c9c31780 1 > prepared operation key=XJP26CCPYDI7 tag=CIDUE7QY6A28 type=del size=2337604 2024-09-22T08:21:02.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.879+0000 7fe6c9c31780 1 < completed delete operation key=O1UBUQXP50CN tag=LZNVWYOHBPYA type=del 2024-09-22T08:21:02.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.882+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~VZSX76PA8INX.0 size=1024399 2024-09-22T08:21:02.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.882+0000 7fe6c9c31780 1 > prepared multipart upload key=FY40JTHLT0KU upload=VZSX76PA8INX tag=NS7U6PB4X3WP type=write size=2072975 2024-09-22T08:21:02.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.883+0000 7fe6c9c31780 1 < completed delete operation key=OX1LY7URY7IV tag=P7DUN2O4S8FO type=del 2024-09-22T08:21:02.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.884+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=G6B93BT28W6H type=del size=3529113 2024-09-22T08:21:02.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.886+0000 7fe6c9c31780 1 < completed delete operation key=4KRJ7DTE3KDV tag=P2TSEBOZT02Y type=del 2024-09-22T08:21:02.889 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.888+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~46H7BTAWW8YD.0 size=219950 2024-09-22T08:21:02.889 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.888+0000 7fe6c9c31780 1 > prepared multipart upload key=9FCSIF1WKBDJ upload=46H7BTAWW8YD tag=JAKOUQ1KSMYV type=write size=1268526 2024-09-22T08:21:02.892 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.892+0000 7fe6c9c31780 1 < suggested update operation key=R7UWMW913DJQ tag=3LHXODV76QXG type=del size=2958113 2024-09-22T08:21:02.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.893+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=L7ZDCLP0WHKI type=del size=2144953 2024-09-22T08:21:02.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.896+0000 7fe6c9c31780 1 < suggested remove operation key=2B5QRUMTVE7U tag=Q049UWGXLF2Q type=write 2024-09-22T08:21:02.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.898+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~PGCXGPZKKVS6.0 size=35406 2024-09-22T08:21:02.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.898+0000 7fe6c9c31780 1 > prepared multipart upload key=0PNK2ZW6IJM1 upload=PGCXGPZKKVS6 tag=X27ERMNZ7OAJ type=write size=1083982 2024-09-22T08:21:02.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.900+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~XTKY4XM6GNRR.0 size=1048576 2024-09-22T08:21:02.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.901+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~XTKY4XM6GNRR.1 size=1048576 2024-09-22T08:21:02.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.902+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~XTKY4XM6GNRR.2 size=1006523 2024-09-22T08:21:02.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.904+0000 7fe6c9c31780 1 < completed multipart upload key=2B5QRUMTVE7U upload=XTKY4XM6GNRR tag=2QFCAEUOARID type=write size=4152251 2024-09-22T08:21:02.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.905+0000 7fe6c9c31780 1 > prepared operation key=GEWQUFB9K35E tag=BVWQY5L03LTP type=del size=703471 2024-09-22T08:21:02.908 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.907+0000 7fe6c9c31780 1 < completed write operation key=ZFL9N44PBQX4 tag=FSHCJ0DCBQQS type=write size=750066 2024-09-22T08:21:02.909 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.908+0000 7fe6c9c31780 1 > prepared operation key=XJP26CCPYDI7 tag=AKM0TRGNK3G6 type=del size=3388737 2024-09-22T08:21:02.910 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.910+0000 7fe6c9c31780 1 < completed delete operation key=0PNK2ZW6IJM1 tag=DNE9P3Q85EPN type=del 2024-09-22T08:21:02.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.912+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~30D19KP93JJ6.0 size=1048576 2024-09-22T08:21:02.914 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.914+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~30D19KP93JJ6.1 size=1048576 2024-09-22T08:21:02.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.915+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~30D19KP93JJ6.2 size=586337 2024-09-22T08:21:02.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.915+0000 7fe6c9c31780 1 > prepared multipart upload key=CTK01Y0CV1NC upload=30D19KP93JJ6 tag=AJ0E4A5SMKIF type=write size=3732065 2024-09-22T08:21:02.917 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.916+0000 7fe6c9c31780 1 < completed write operation key=Z1CK5EDBK4AW tag=33RNSQZG09L5 type=write size=291124 2024-09-22T08:21:02.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.919+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~HJTF16YQ14VM.0 size=1048576 2024-09-22T08:21:02.920 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.920+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~HJTF16YQ14VM.1 size=642707 2024-09-22T08:21:02.921 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.920+0000 7fe6c9c31780 1 > prepared multipart upload key=0PNK2ZW6IJM1 upload=HJTF16YQ14VM tag=56IBS3L3164D type=write size=2739859 2024-09-22T08:21:02.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.921+0000 7fe6c9c31780 1 < completed part key=_multipart_TJTB67QBLZH5.2~M62D4OYW6LV0.0 size=310377 2024-09-22T08:21:02.924 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.924+0000 7fe6c9c31780 1 < completed multipart upload key=TJTB67QBLZH5 upload=M62D4OYW6LV0 tag=ZB8CCNH4BZTW type=write size=1358953 2024-09-22T08:21:02.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.926+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~X7NASXPZM7FS.0 size=1048576 2024-09-22T08:21:02.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.928+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~X7NASXPZM7FS.1 size=1048576 2024-09-22T08:21:02.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.929+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~X7NASXPZM7FS.2 size=989679 2024-09-22T08:21:02.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.929+0000 7fe6c9c31780 1 > prepared multipart upload key=4KRJ7DTE3KDV upload=X7NASXPZM7FS tag=CU3LEHDYUHY3 type=write size=4135407 2024-09-22T08:21:02.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.930+0000 7fe6c9c31780 1 < completed write operation key=XJP26CCPYDI7 tag=31DAL5GC7HYR type=write size=584089 2024-09-22T08:21:02.933 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.933+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~5LD9YQIH3UG7.0 size=1048576 2024-09-22T08:21:02.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.934+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~5LD9YQIH3UG7.1 size=1048576 2024-09-22T08:21:02.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.935+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~5LD9YQIH3UG7.2 size=88764 2024-09-22T08:21:02.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.935+0000 7fe6c9c31780 1 > prepared multipart upload key=7446WN19QFV0 upload=5LD9YQIH3UG7 tag=9U8GA8XSXZCT type=write size=3234492 2024-09-22T08:21:02.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.936+0000 7fe6c9c31780 1 < completed delete operation key=KZIY400KQ5NH tag=EYIK3SGFU9XP type=del 2024-09-22T08:21:02.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.938+0000 7fe6c9c31780 1 > prepared operation key=LA6ZRVULGQ0H tag=RLR0CJ49QK93 type=del size=366572 2024-09-22T08:21:02.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.940+0000 7fe6c9c31780 1 < canceled operation key=6BKB91YV3FMW tag=0JGG9B5ESN0S type=del size=3120658 2024-09-22T08:21:02.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.943+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~75V0HVCNL4VL.0 size=1048576 2024-09-22T08:21:02.945 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.944+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~75V0HVCNL4VL.1 size=1048576 2024-09-22T08:21:02.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.945+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~75V0HVCNL4VL.2 size=102177 2024-09-22T08:21:02.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.945+0000 7fe6c9c31780 1 > prepared multipart upload key=76HZ3LZGVT9J upload=75V0HVCNL4VL tag=Q2M2HAN99HEW type=write size=3247905 2024-09-22T08:21:02.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.949+0000 7fe6c9c31780 1 < suggested remove operation key=ILW34WLX48WN tag=GRBXK3Z331XT type=del 2024-09-22T08:21:02.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.950+0000 7fe6c9c31780 1 > prepared operation key=O1UBUQXP50CN tag=G92DVOKAYFMT type=del size=3254572 2024-09-22T08:21:02.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.952+0000 7fe6c9c31780 1 < completed delete operation key=DC7VLQWZ3TD1 tag=5U4G9ARCOGQI type=del 2024-09-22T08:21:02.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.954+0000 7fe6c9c31780 1 > prepared operation key=O1UBUQXP50CN tag=OS707HSKIWEM type=del size=2906735 2024-09-22T08:21:02.956 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.955+0000 7fe6c9c31780 1 < completed delete operation key=XJP26CCPYDI7 tag=CIDUE7QY6A28 type=del 2024-09-22T08:21:02.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.959+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~GQX6UUBSVZBG.0 size=753348 2024-09-22T08:21:02.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.959+0000 7fe6c9c31780 1 > prepared multipart upload key=OX1LY7URY7IV upload=GQX6UUBSVZBG tag=W3ECWUTM3U8N type=write size=1801924 2024-09-22T08:21:02.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.961+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~VZSX76PA8INX.0 size=1024399 2024-09-22T08:21:02.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.964+0000 7fe6c9c31780 1 < completed multipart upload key=FY40JTHLT0KU upload=VZSX76PA8INX tag=NS7U6PB4X3WP type=write size=2072975 2024-09-22T08:21:02.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.965+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=O5TT5Z8X23CE type=del size=544725 2024-09-22T08:21:02.968 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.968+0000 7fe6c9c31780 1 < completed delete operation key=0TWY0NNZZ7NN tag=G6B93BT28W6H type=del 2024-09-22T08:21:02.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.970+0000 7fe6c9c31780 1 > prepared operation key=1HZ0NAJPXNW1 tag=MDX5RW1X63VF type=del size=831416 2024-09-22T08:21:02.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.970+0000 7fe6c9c31780 1 < canceled part key=_multipart_9FCSIF1WKBDJ.2~46H7BTAWW8YD.0 size=219950 2024-09-22T08:21:02.973 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.973+0000 7fe6c9c31780 1 < canceled multipart upload key=9FCSIF1WKBDJ upload=46H7BTAWW8YD tag=JAKOUQ1KSMYV type=write size=1268526 2024-09-22T08:21:02.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.975+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~T4F2AEW57MJA.0 size=1048576 2024-09-22T08:21:02.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.976+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~T4F2AEW57MJA.1 size=948684 2024-09-22T08:21:02.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.976+0000 7fe6c9c31780 1 > prepared multipart upload key=O1UBUQXP50CN upload=T4F2AEW57MJA tag=5FZ0I7QBS2E2 type=write size=3045836 2024-09-22T08:21:02.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.980+0000 7fe6c9c31780 1 < suggested update operation key=9AZWQ9E58QS6 tag=L7ZDCLP0WHKI type=del size=2144953 2024-09-22T08:21:02.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.983+0000 7fe6c9c31780 1 > prepared part key=_multipart_TJTB67QBLZH5.2~A845CMN7KKYL.0 size=931774 2024-09-22T08:21:02.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.983+0000 7fe6c9c31780 1 > prepared multipart upload key=TJTB67QBLZH5 upload=A845CMN7KKYL tag=JTQJQ3EFQW5Z type=write size=1980350 2024-09-22T08:21:02.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.984+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~PGCXGPZKKVS6.0 size=35406 2024-09-22T08:21:02.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.987+0000 7fe6c9c31780 1 < completed multipart upload key=0PNK2ZW6IJM1 upload=PGCXGPZKKVS6 tag=X27ERMNZ7OAJ type=write size=1083982 2024-09-22T08:21:02.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.989+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~YKDTOMKWA4AI.0 size=1048576 2024-09-22T08:21:02.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.990+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~YKDTOMKWA4AI.1 size=654830 2024-09-22T08:21:02.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.990+0000 7fe6c9c31780 1 > prepared multipart upload key=GEWQUFB9K35E upload=YKDTOMKWA4AI tag=ZH28AW4XALHR type=write size=2751982 2024-09-22T08:21:02.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.992+0000 7fe6c9c31780 1 < completed delete operation key=GEWQUFB9K35E tag=BVWQY5L03LTP type=del 2024-09-22T08:21:02.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.995+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~KEO04WMOESZC.0 size=97810 2024-09-22T08:21:02.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.995+0000 7fe6c9c31780 1 > prepared multipart upload key=76HZ3LZGVT9J upload=KEO04WMOESZC tag=PWHCYZ4HNX7C type=write size=1146386 2024-09-22T08:21:02.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.996+0000 7fe6c9c31780 1 < completed delete operation key=XJP26CCPYDI7 tag=AKM0TRGNK3G6 type=del 2024-09-22T08:21:02.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.997+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=LZ321GFU4CV3 type=del size=2491382 2024-09-22T08:21:03.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:02.999+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~30D19KP93JJ6.0 size=1048576 2024-09-22T08:21:03.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.000+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~30D19KP93JJ6.1 size=1048576 2024-09-22T08:21:03.002 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.001+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~30D19KP93JJ6.2 size=586337 2024-09-22T08:21:03.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.004+0000 7fe6c9c31780 1 < completed multipart upload key=CTK01Y0CV1NC upload=30D19KP93JJ6 tag=AJ0E4A5SMKIF type=write size=3732065 2024-09-22T08:21:03.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.005+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=U4RY1EA7EOOR type=del size=369631 2024-09-22T08:21:03.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.007+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~HJTF16YQ14VM.0 size=1048576 2024-09-22T08:21:03.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.008+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~HJTF16YQ14VM.1 size=642707 2024-09-22T08:21:03.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.010+0000 7fe6c9c31780 1 < completed multipart upload key=0PNK2ZW6IJM1 upload=HJTF16YQ14VM tag=56IBS3L3164D type=write size=2739859 2024-09-22T08:21:03.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.012+0000 7fe6c9c31780 1 > prepared operation key=FY40JTHLT0KU tag=1FYVK4F6CMB4 type=del size=37862 2024-09-22T08:21:03.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.013+0000 7fe6c9c31780 1 < completed part key=_multipart_4KRJ7DTE3KDV.2~X7NASXPZM7FS.0 size=1048576 2024-09-22T08:21:03.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.014+0000 7fe6c9c31780 1 < completed part key=_multipart_4KRJ7DTE3KDV.2~X7NASXPZM7FS.1 size=1048576 2024-09-22T08:21:03.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.016+0000 7fe6c9c31780 1 < completed part key=_multipart_4KRJ7DTE3KDV.2~X7NASXPZM7FS.2 size=989679 2024-09-22T08:21:03.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.018+0000 7fe6c9c31780 1 < completed multipart upload key=4KRJ7DTE3KDV upload=X7NASXPZM7FS tag=CU3LEHDYUHY3 type=write size=4135407 2024-09-22T08:21:03.022 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.021+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~I3YRZ66SE1X8.0 size=1048576 2024-09-22T08:21:03.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.022+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~I3YRZ66SE1X8.1 size=255024 2024-09-22T08:21:03.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.022+0000 7fe6c9c31780 1 > prepared multipart upload key=4KRJ7DTE3KDV upload=I3YRZ66SE1X8 tag=85Z606BT423Q type=write size=2352176 2024-09-22T08:21:03.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.024+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~5LD9YQIH3UG7.0 size=1048576 2024-09-22T08:21:03.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.026+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~5LD9YQIH3UG7.1 size=1048576 2024-09-22T08:21:03.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.027+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~5LD9YQIH3UG7.2 size=88764 2024-09-22T08:21:03.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.029+0000 7fe6c9c31780 1 < completed multipart upload key=7446WN19QFV0 upload=5LD9YQIH3UG7 tag=9U8GA8XSXZCT type=write size=3234492 2024-09-22T08:21:03.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.031+0000 7fe6c9c31780 1 > prepared operation key=GEWQUFB9K35E tag=2EO40AN5VJ8S type=write size=944269 2024-09-22T08:21:03.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.032+0000 7fe6c9c31780 1 < completed delete operation key=LA6ZRVULGQ0H tag=RLR0CJ49QK93 type=del 2024-09-22T08:21:03.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.033+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=FVZIFWE2OND7 type=del size=2707413 2024-09-22T08:21:03.036 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.035+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~75V0HVCNL4VL.0 size=1048576 2024-09-22T08:21:03.036 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.035+0000 7fe6c9c31780 1 < canceled part key=_multipart_76HZ3LZGVT9J.2~75V0HVCNL4VL.1 size=1048576 2024-09-22T08:21:03.036 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.035+0000 7fe6c9c31780 1 < canceled part key=_multipart_76HZ3LZGVT9J.2~75V0HVCNL4VL.2 size=102177 2024-09-22T08:21:03.038 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.037+0000 7fe6c9c31780 1 < canceled multipart upload key=76HZ3LZGVT9J upload=75V0HVCNL4VL tag=Q2M2HAN99HEW type=write size=3247905 2024-09-22T08:21:03.039 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.038+0000 7fe6c9c31780 1 > prepared operation key=JT5AB8VLMEFD tag=FPO0V7TY6EKF type=del size=3350875 2024-09-22T08:21:03.040 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.040+0000 7fe6c9c31780 1 < canceled operation key=O1UBUQXP50CN tag=G92DVOKAYFMT type=del size=3254572 2024-09-22T08:21:03.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.043+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~3MKTX28VZRE5.0 size=1048576 2024-09-22T08:21:03.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.044+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~3MKTX28VZRE5.1 size=1048576 2024-09-22T08:21:03.045 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.045+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~3MKTX28VZRE5.2 size=623821 2024-09-22T08:21:03.045 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.045+0000 7fe6c9c31780 1 > prepared multipart upload key=0TWY0NNZZ7NN upload=3MKTX28VZRE5 tag=HLIOB4HL2IOK type=write size=3769549 2024-09-22T08:21:03.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.045+0000 7fe6c9c31780 1 < completed delete operation key=O1UBUQXP50CN tag=OS707HSKIWEM type=del 2024-09-22T08:21:03.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.047+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=4AI7ACB06C7R type=del size=2655820 2024-09-22T08:21:03.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.048+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~GQX6UUBSVZBG.0 size=753348 2024-09-22T08:21:03.051 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.051+0000 7fe6c9c31780 1 < completed multipart upload key=OX1LY7URY7IV upload=GQX6UUBSVZBG tag=W3ECWUTM3U8N type=write size=1801924 2024-09-22T08:21:03.053 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.052+0000 7fe6c9c31780 1 > prepared operation key=1HZ0NAJPXNW1 tag=16Q19SPPDBZ5 type=del size=3905237 2024-09-22T08:21:03.055 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.055+0000 7fe6c9c31780 1 < suggested update operation key=7446WN19QFV0 tag=O5TT5Z8X23CE type=del size=544725 2024-09-22T08:21:03.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.056+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=RYJ2FV9WO2WC type=del size=506474 2024-09-22T08:21:03.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.058+0000 7fe6c9c31780 1 < completed delete operation key=1HZ0NAJPXNW1 tag=MDX5RW1X63VF type=del 2024-09-22T08:21:03.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.059+0000 7fe6c9c31780 1 > prepared operation key=TYVQ39KUV2V9 tag=KWJUG6YV36Y6 type=write size=172535 2024-09-22T08:21:03.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.059+0000 7fe6c9c31780 1 < canceled part key=_multipart_O1UBUQXP50CN.2~T4F2AEW57MJA.0 size=1048576 2024-09-22T08:21:03.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.061+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~T4F2AEW57MJA.1 size=948684 2024-09-22T08:21:03.064 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.063+0000 7fe6c9c31780 1 < canceled multipart upload key=O1UBUQXP50CN upload=T4F2AEW57MJA tag=5FZ0I7QBS2E2 type=write size=3045836 2024-09-22T08:21:03.067 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.066+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~5RFF1WLVH1J5.0 size=1048576 2024-09-22T08:21:03.068 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.068+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~5RFF1WLVH1J5.1 size=1048576 2024-09-22T08:21:03.070 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.070+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~5RFF1WLVH1J5.2 size=255459 2024-09-22T08:21:03.070 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.070+0000 7fe6c9c31780 1 > prepared multipart upload key=O1UBUQXP50CN upload=5RFF1WLVH1J5 tag=7H46F216NEQY type=write size=3401187 2024-09-22T08:21:03.072 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.071+0000 7fe6c9c31780 1 < completed part key=_multipart_TJTB67QBLZH5.2~A845CMN7KKYL.0 size=931774 2024-09-22T08:21:03.074 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.074+0000 7fe6c9c31780 1 < completed multipart upload key=TJTB67QBLZH5 upload=A845CMN7KKYL tag=JTQJQ3EFQW5Z type=write size=1980350 2024-09-22T08:21:03.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.076+0000 7fe6c9c31780 1 > prepared operation key=KZIY400KQ5NH tag=PV5VPNY0PE4H type=write size=680270 2024-09-22T08:21:03.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.078+0000 7fe6c9c31780 1 < completed part key=_multipart_GEWQUFB9K35E.2~YKDTOMKWA4AI.0 size=1048576 2024-09-22T08:21:03.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.078+0000 7fe6c9c31780 1 < canceled part key=_multipart_GEWQUFB9K35E.2~YKDTOMKWA4AI.1 size=654830 2024-09-22T08:21:03.081 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.080+0000 7fe6c9c31780 1 < canceled multipart upload key=GEWQUFB9K35E upload=YKDTOMKWA4AI tag=ZH28AW4XALHR type=write size=2751982 2024-09-22T08:21:03.082 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.081+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=BC06776AYNHM type=del size=3807349 2024-09-22T08:21:03.083 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.083+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~KEO04WMOESZC.0 size=97810 2024-09-22T08:21:03.086 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.085+0000 7fe6c9c31780 1 < completed multipart upload key=76HZ3LZGVT9J upload=KEO04WMOESZC tag=PWHCYZ4HNX7C type=write size=1146386 2024-09-22T08:21:03.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.087+0000 7fe6c9c31780 1 > prepared operation key=TYVQ39KUV2V9 tag=T01S20F7LSVH type=del size=2280473 2024-09-22T08:21:03.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.089+0000 7fe6c9c31780 1 < suggested remove operation key=76HZ3LZGVT9J tag=LZ321GFU4CV3 type=del 2024-09-22T08:21:03.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.091+0000 7fe6c9c31780 1 > prepared operation key=Z1CK5EDBK4AW tag=XSH0FSYTIX3Q type=del size=2628807 2024-09-22T08:21:03.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.093+0000 7fe6c9c31780 1 < completed delete operation key=CTK01Y0CV1NC tag=U4RY1EA7EOOR type=del 2024-09-22T08:21:03.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.094+0000 7fe6c9c31780 1 > prepared operation key=XJP26CCPYDI7 tag=078K8I2HSO6A type=del size=2167632 2024-09-22T08:21:03.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.096+0000 7fe6c9c31780 1 < completed delete operation key=FY40JTHLT0KU tag=1FYVK4F6CMB4 type=del 2024-09-22T08:21:03.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.098+0000 7fe6c9c31780 1 > prepared operation key=ZFL9N44PBQX4 tag=M1HYQTN8T3WO type=del size=3620967 2024-09-22T08:21:03.100 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.100+0000 7fe6c9c31780 1 < completed part key=_multipart_4KRJ7DTE3KDV.2~I3YRZ66SE1X8.0 size=1048576 2024-09-22T08:21:03.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.101+0000 7fe6c9c31780 1 < completed part key=_multipart_4KRJ7DTE3KDV.2~I3YRZ66SE1X8.1 size=255024 2024-09-22T08:21:03.103 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.103+0000 7fe6c9c31780 1 < completed multipart upload key=4KRJ7DTE3KDV upload=I3YRZ66SE1X8 tag=85Z606BT423Q type=write size=2352176 2024-09-22T08:21:03.105 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.104+0000 7fe6c9c31780 1 > prepared operation key=Z1CK5EDBK4AW tag=ZS9YM8LJLDUN type=del size=1341723 2024-09-22T08:21:03.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.106+0000 7fe6c9c31780 1 < completed write operation key=GEWQUFB9K35E tag=2EO40AN5VJ8S type=write size=944269 2024-09-22T08:21:03.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.108+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=JSTALR52NSMV type=del size=3442300 2024-09-22T08:21:03.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.109+0000 7fe6c9c31780 1 < completed delete operation key=TE10GB1F35X4 tag=FVZIFWE2OND7 type=del 2024-09-22T08:21:03.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.111+0000 7fe6c9c31780 1 > prepared operation key=D85LJGGU3Z6F tag=6WSDAPI244E0 type=del size=3320489 2024-09-22T08:21:03.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.114+0000 7fe6c9c31780 1 < completed delete operation key=JT5AB8VLMEFD tag=FPO0V7TY6EKF type=del 2024-09-22T08:21:03.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.116+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~M2W7WZCNOYXS.0 size=450123 2024-09-22T08:21:03.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.116+0000 7fe6c9c31780 1 > prepared multipart upload key=OX1LY7URY7IV upload=M2W7WZCNOYXS tag=WBBIYGOQUT8K type=write size=1498699 2024-09-22T08:21:03.119 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.118+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~3MKTX28VZRE5.0 size=1048576 2024-09-22T08:21:03.120 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.119+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~3MKTX28VZRE5.1 size=1048576 2024-09-22T08:21:03.121 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.121+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~3MKTX28VZRE5.2 size=623821 2024-09-22T08:21:03.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.124+0000 7fe6c9c31780 1 < completed multipart upload key=0TWY0NNZZ7NN upload=3MKTX28VZRE5 tag=HLIOB4HL2IOK type=write size=3769549 2024-09-22T08:21:03.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.126+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~VTI1H2DB2ETU.0 size=380284 2024-09-22T08:21:03.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.126+0000 7fe6c9c31780 1 > prepared multipart upload key=CTK01Y0CV1NC upload=VTI1H2DB2ETU tag=YVHH212MR2FG type=write size=1428860 2024-09-22T08:21:03.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.128+0000 7fe6c9c31780 1 < completed delete operation key=946H8F2AUPO2 tag=4AI7ACB06C7R type=del 2024-09-22T08:21:03.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.129+0000 7fe6c9c31780 1 > prepared operation key=O1UBUQXP50CN tag=OVX2GYGG6K8U type=del size=2726122 2024-09-22T08:21:03.132 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.131+0000 7fe6c9c31780 1 < completed delete operation key=1HZ0NAJPXNW1 tag=16Q19SPPDBZ5 type=del 2024-09-22T08:21:03.134 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.134+0000 7fe6c9c31780 1 > prepared part key=_multipart_R7UWMW913DJQ.2~EL11USIR7B3E.0 size=1048576 2024-09-22T08:21:03.135 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.135+0000 7fe6c9c31780 1 > prepared part key=_multipart_R7UWMW913DJQ.2~EL11USIR7B3E.1 size=708898 2024-09-22T08:21:03.135 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.135+0000 7fe6c9c31780 1 > prepared multipart upload key=R7UWMW913DJQ upload=EL11USIR7B3E tag=VD3O8U2B8M8F type=write size=2806050 2024-09-22T08:21:03.138 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.138+0000 7fe6c9c31780 1 < suggested update operation key=CTK01Y0CV1NC tag=RYJ2FV9WO2WC type=del size=506474 2024-09-22T08:21:03.141 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.140+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~9NRGJVNMWQQL.0 size=687715 2024-09-22T08:21:03.141 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.140+0000 7fe6c9c31780 1 > prepared multipart upload key=D85LJGGU3Z6F upload=9NRGJVNMWQQL tag=Z2PAOK9KYZ74 type=write size=1736291 2024-09-22T08:21:03.142 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.141+0000 7fe6c9c31780 1 < completed write operation key=TYVQ39KUV2V9 tag=KWJUG6YV36Y6 type=write size=172535 2024-09-22T08:21:03.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.143+0000 7fe6c9c31780 1 > prepared operation key=TYVQ39KUV2V9 tag=ITBYYYVEZH9Y type=del size=3487370 2024-09-22T08:21:03.145 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.144+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~5RFF1WLVH1J5.0 size=1048576 2024-09-22T08:21:03.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.146+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~5RFF1WLVH1J5.1 size=1048576 2024-09-22T08:21:03.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.146+0000 7fe6c9c31780 1 < canceled part key=_multipart_O1UBUQXP50CN.2~5RFF1WLVH1J5.2 size=255459 2024-09-22T08:21:03.149 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.149+0000 7fe6c9c31780 1 < canceled multipart upload key=O1UBUQXP50CN upload=5RFF1WLVH1J5 tag=7H46F216NEQY type=write size=3401187 2024-09-22T08:21:03.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.149+0000 7fe6c9c31780 1 > prepared operation key=FY40JTHLT0KU tag=YP7A3F5LTBZC type=del size=2189179 2024-09-22T08:21:03.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.153+0000 7fe6c9c31780 1 < suggested update operation key=KZIY400KQ5NH tag=PV5VPNY0PE4H type=write size=680270 2024-09-22T08:21:03.156 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.155+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~IM79AM44Z56E.0 size=423065 2024-09-22T08:21:03.156 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.155+0000 7fe6c9c31780 1 > prepared multipart upload key=OX1LY7URY7IV upload=IM79AM44Z56E tag=PF9F75D9ACG9 type=write size=1471641 2024-09-22T08:21:03.157 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.157+0000 7fe6c9c31780 1 < completed delete operation key=2B5QRUMTVE7U tag=BC06776AYNHM type=del 2024-09-22T08:21:03.160 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.160+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~J0MMYVNU3ZVD.0 size=1048576 2024-09-22T08:21:03.161 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.161+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~J0MMYVNU3ZVD.1 size=1048576 2024-09-22T08:21:03.162 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.162+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~J0MMYVNU3ZVD.2 size=691843 2024-09-22T08:21:03.162 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.162+0000 7fe6c9c31780 1 > prepared multipart upload key=KZIY400KQ5NH upload=J0MMYVNU3ZVD tag=0LK386MYW6Z0 type=write size=3837571 2024-09-22T08:21:03.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.163+0000 7fe6c9c31780 1 < completed delete operation key=TYVQ39KUV2V9 tag=T01S20F7LSVH type=del 2024-09-22T08:21:03.166 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.166+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~M07XMPOOGF27.0 size=233681 2024-09-22T08:21:03.166 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.166+0000 7fe6c9c31780 1 > prepared multipart upload key=XJP26CCPYDI7 upload=M07XMPOOGF27 tag=QVMGSM0F8AOM type=write size=1282257 2024-09-22T08:21:03.168 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.167+0000 7fe6c9c31780 1 < canceled operation key=Z1CK5EDBK4AW tag=XSH0FSYTIX3Q type=del size=2628807 2024-09-22T08:21:03.169 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.169+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=TN3OV4U7LU62 type=del size=2893786 2024-09-22T08:21:03.171 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.170+0000 7fe6c9c31780 1 < canceled operation key=XJP26CCPYDI7 tag=078K8I2HSO6A type=del size=2167632 2024-09-22T08:21:03.173 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.172+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=85VHZW80INUS type=write size=615644 2024-09-22T08:21:03.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.175+0000 7fe6c9c31780 1 < suggested update operation key=ZFL9N44PBQX4 tag=M1HYQTN8T3WO type=del size=3620967 2024-09-22T08:21:03.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.177+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~O4FUI1B5B4H7.0 size=1048576 2024-09-22T08:21:03.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.178+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~O4FUI1B5B4H7.1 size=903591 2024-09-22T08:21:03.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.178+0000 7fe6c9c31780 1 > prepared multipart upload key=DC7VLQWZ3TD1 upload=O4FUI1B5B4H7 tag=NDPHEAX16T1B type=write size=3000743 2024-09-22T08:21:03.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.180+0000 7fe6c9c31780 1 < completed delete operation key=Z1CK5EDBK4AW tag=ZS9YM8LJLDUN type=del 2024-09-22T08:21:03.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.181+0000 7fe6c9c31780 1 > prepared operation key=TJTB67QBLZH5 tag=SD873345D0GH type=del size=2877600 2024-09-22T08:21:03.183 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.183+0000 7fe6c9c31780 1 < completed delete operation key=T2W6RXP9UGHH tag=JSTALR52NSMV type=del 2024-09-22T08:21:03.185 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.185+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=KEGNN9PDCN35 type=del size=3077721 2024-09-22T08:21:03.186 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.186+0000 7fe6c9c31780 1 < completed delete operation key=D85LJGGU3Z6F tag=6WSDAPI244E0 type=del 2024-09-22T08:21:03.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.187+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=270N28XK8PW2 type=write size=266957 2024-09-22T08:21:03.189 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.188+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~M2W7WZCNOYXS.0 size=450123 2024-09-22T08:21:03.192 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.191+0000 7fe6c9c31780 1 < completed multipart upload key=OX1LY7URY7IV upload=M2W7WZCNOYXS tag=WBBIYGOQUT8K type=write size=1498699 2024-09-22T08:21:03.194 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.194+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~LDL7XH5YT1JQ.0 size=981371 2024-09-22T08:21:03.194 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.194+0000 7fe6c9c31780 1 > prepared multipart upload key=Z1CK5EDBK4AW upload=LDL7XH5YT1JQ tag=1C41TSLQZ4CI type=write size=2029947 2024-09-22T08:21:03.195 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.195+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~VTI1H2DB2ETU.0 size=380284 2024-09-22T08:21:03.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.197+0000 7fe6c9c31780 1 < completed multipart upload key=CTK01Y0CV1NC upload=VTI1H2DB2ETU tag=YVHH212MR2FG type=write size=1428860 2024-09-22T08:21:03.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.200+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~SKHL9PXLHHB6.0 size=1048576 2024-09-22T08:21:03.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.201+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~SKHL9PXLHHB6.1 size=1048576 2024-09-22T08:21:03.205 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.204+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~SKHL9PXLHHB6.2 size=381330 2024-09-22T08:21:03.205 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.204+0000 7fe6c9c31780 1 > prepared multipart upload key=4KRJ7DTE3KDV upload=SKHL9PXLHHB6 tag=62RG5U1WZ7HK type=write size=3527058 2024-09-22T08:21:03.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.206+0000 7fe6c9c31780 1 < completed delete operation key=O1UBUQXP50CN tag=OVX2GYGG6K8U type=del 2024-09-22T08:21:03.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.207+0000 7fe6c9c31780 1 > prepared operation key=O1UBUQXP50CN tag=HJX9UKOEXFPT type=del size=2438140 2024-09-22T08:21:03.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.209+0000 7fe6c9c31780 1 < completed part key=_multipart_R7UWMW913DJQ.2~EL11USIR7B3E.0 size=1048576 2024-09-22T08:21:03.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.209+0000 7fe6c9c31780 1 < canceled part key=_multipart_R7UWMW913DJQ.2~EL11USIR7B3E.1 size=708898 2024-09-22T08:21:03.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.211+0000 7fe6c9c31780 1 < canceled multipart upload key=R7UWMW913DJQ upload=EL11USIR7B3E tag=VD3O8U2B8M8F type=write size=2806050 2024-09-22T08:21:03.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.213+0000 7fe6c9c31780 1 > prepared operation key=VP1MP4IC9A7T tag=LKHIPJPO0XTG type=del size=170719 2024-09-22T08:21:03.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.214+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~9NRGJVNMWQQL.0 size=687715 2024-09-22T08:21:03.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.217+0000 7fe6c9c31780 1 < completed multipart upload key=D85LJGGU3Z6F upload=9NRGJVNMWQQL tag=Z2PAOK9KYZ74 type=write size=1736291 2024-09-22T08:21:03.221 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.220+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~E02RDJT2CIYR.0 size=1048576 2024-09-22T08:21:03.222 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.221+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~E02RDJT2CIYR.1 size=723788 2024-09-22T08:21:03.222 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.221+0000 7fe6c9c31780 1 > prepared multipart upload key=XJP26CCPYDI7 upload=E02RDJT2CIYR tag=2FWS5J4OT6KR type=write size=2820940 2024-09-22T08:21:03.224 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.223+0000 7fe6c9c31780 1 < completed delete operation key=TYVQ39KUV2V9 tag=ITBYYYVEZH9Y type=del 2024-09-22T08:21:03.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.225+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~5JS97BL6LTVD.0 size=1048576 2024-09-22T08:21:03.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.226+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~5JS97BL6LTVD.1 size=1048576 2024-09-22T08:21:03.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.228+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~5JS97BL6LTVD.2 size=341171 2024-09-22T08:21:03.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.228+0000 7fe6c9c31780 1 > prepared multipart upload key=76HZ3LZGVT9J upload=5JS97BL6LTVD tag=1FJOF13ZA9UQ type=write size=3486899 2024-09-22T08:21:03.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.229+0000 7fe6c9c31780 1 < canceled operation key=FY40JTHLT0KU tag=YP7A3F5LTBZC type=del size=2189179 2024-09-22T08:21:03.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.231+0000 7fe6c9c31780 1 > prepared operation key=VP1MP4IC9A7T tag=1IQ4OZTUDQU6 type=del size=3331977 2024-09-22T08:21:03.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.232+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~IM79AM44Z56E.0 size=423065 2024-09-22T08:21:03.235 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.235+0000 7fe6c9c31780 1 < completed multipart upload key=OX1LY7URY7IV upload=IM79AM44Z56E tag=PF9F75D9ACG9 type=write size=1471641 2024-09-22T08:21:03.237 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.236+0000 7fe6c9c31780 1 > prepared operation key=Z1CK5EDBK4AW tag=QVGO9ULFCFXB type=del size=452494 2024-09-22T08:21:03.238 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.238+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~J0MMYVNU3ZVD.0 size=1048576 2024-09-22T08:21:03.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.240+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~J0MMYVNU3ZVD.1 size=1048576 2024-09-22T08:21:03.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.241+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~J0MMYVNU3ZVD.2 size=691843 2024-09-22T08:21:03.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.244+0000 7fe6c9c31780 1 < completed multipart upload key=KZIY400KQ5NH upload=J0MMYVNU3ZVD tag=0LK386MYW6Z0 type=write size=3837571 2024-09-22T08:21:03.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.245+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=1A5FV1D5G23H type=del size=1361853 2024-09-22T08:21:03.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.247+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~M07XMPOOGF27.0 size=233681 2024-09-22T08:21:03.249 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.249+0000 7fe6c9c31780 1 < completed multipart upload key=XJP26CCPYDI7 upload=M07XMPOOGF27 tag=QVMGSM0F8AOM type=write size=1282257 2024-09-22T08:21:03.251 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.250+0000 7fe6c9c31780 1 > prepared operation key=4KRJ7DTE3KDV tag=OGTYD48FY8TX type=write size=924815 2024-09-22T08:21:03.253 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.252+0000 7fe6c9c31780 1 < completed delete operation key=CTK01Y0CV1NC tag=TN3OV4U7LU62 type=del 2024-09-22T08:21:03.254 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.253+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=QJG5Y4EQ0BUS type=del size=2274110 2024-09-22T08:21:03.255 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.255+0000 7fe6c9c31780 1 < completed write operation key=7446WN19QFV0 tag=85VHZW80INUS type=write size=615644 2024-09-22T08:21:03.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.256+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=0GFZGW870M86 type=del size=3913375 2024-09-22T08:21:03.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.258+0000 7fe6c9c31780 1 < completed part key=_multipart_DC7VLQWZ3TD1.2~O4FUI1B5B4H7.0 size=1048576 2024-09-22T08:21:03.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.259+0000 7fe6c9c31780 1 < completed part key=_multipart_DC7VLQWZ3TD1.2~O4FUI1B5B4H7.1 size=903591 2024-09-22T08:21:03.262 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.261+0000 7fe6c9c31780 1 < completed multipart upload key=DC7VLQWZ3TD1 upload=O4FUI1B5B4H7 tag=NDPHEAX16T1B type=write size=3000743 2024-09-22T08:21:03.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.263+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~GZDUVMW29I1Q.0 size=1048576 2024-09-22T08:21:03.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.265+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~GZDUVMW29I1Q.1 size=1048576 2024-09-22T08:21:03.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.266+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~GZDUVMW29I1Q.2 size=11938 2024-09-22T08:21:03.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.266+0000 7fe6c9c31780 1 > prepared multipart upload key=TYVQ39KUV2V9 upload=GZDUVMW29I1Q tag=YW4JA5ZLTWX5 type=write size=3157666 2024-09-22T08:21:03.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.268+0000 7fe6c9c31780 1 < completed delete operation key=TJTB67QBLZH5 tag=SD873345D0GH type=del 2024-09-22T08:21:03.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.268+0000 7fe6c9c31780 1 > prepared operation key=OX1LY7URY7IV tag=GT5O30SHXW31 type=del size=835051 2024-09-22T08:21:03.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.270+0000 7fe6c9c31780 1 < completed delete operation key=9AZWQ9E58QS6 tag=KEGNN9PDCN35 type=del 2024-09-22T08:21:03.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.271+0000 7fe6c9c31780 1 > prepared operation key=TJTB67QBLZH5 tag=T0JJHZ4NZZ80 type=del size=1131524 2024-09-22T08:21:03.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.274+0000 7fe6c9c31780 1 < suggested remove operation key=76HZ3LZGVT9J tag=270N28XK8PW2 type=write 2024-09-22T08:21:03.276 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.276+0000 7fe6c9c31780 1 > prepared operation key=0PNK2ZW6IJM1 tag=JF7CYSXDMVJU type=del size=186122 2024-09-22T08:21:03.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.277+0000 7fe6c9c31780 1 < completed part key=_multipart_Z1CK5EDBK4AW.2~LDL7XH5YT1JQ.0 size=981371 2024-09-22T08:21:03.280 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.279+0000 7fe6c9c31780 1 < completed multipart upload key=Z1CK5EDBK4AW upload=LDL7XH5YT1JQ tag=1C41TSLQZ4CI type=write size=2029947 2024-09-22T08:21:03.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.281+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~BCNMB7O02LKI.0 size=1048576 2024-09-22T08:21:03.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.282+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~BCNMB7O02LKI.1 size=1048576 2024-09-22T08:21:03.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.284+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~BCNMB7O02LKI.2 size=1008063 2024-09-22T08:21:03.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.284+0000 7fe6c9c31780 1 > prepared multipart upload key=76HZ3LZGVT9J upload=BCNMB7O02LKI tag=3D864EHQSM4O type=write size=4153791 2024-09-22T08:21:03.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.285+0000 7fe6c9c31780 1 < completed part key=_multipart_4KRJ7DTE3KDV.2~SKHL9PXLHHB6.0 size=1048576 2024-09-22T08:21:03.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.286+0000 7fe6c9c31780 1 < completed part key=_multipart_4KRJ7DTE3KDV.2~SKHL9PXLHHB6.1 size=1048576 2024-09-22T08:21:03.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.287+0000 7fe6c9c31780 1 < completed part key=_multipart_4KRJ7DTE3KDV.2~SKHL9PXLHHB6.2 size=381330 2024-09-22T08:21:03.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.290+0000 7fe6c9c31780 1 < completed multipart upload key=4KRJ7DTE3KDV upload=SKHL9PXLHHB6 tag=62RG5U1WZ7HK type=write size=3527058 2024-09-22T08:21:03.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.291+0000 7fe6c9c31780 1 > prepared operation key=VP1MP4IC9A7T tag=A1T7BDMN43B0 type=del size=2246931 2024-09-22T08:21:03.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.293+0000 7fe6c9c31780 1 < canceled operation key=O1UBUQXP50CN tag=HJX9UKOEXFPT type=del size=2438140 2024-09-22T08:21:03.296 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.296+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~8Q33X5GH1NBC.0 size=830216 2024-09-22T08:21:03.297 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.296+0000 7fe6c9c31780 1 > prepared multipart upload key=XJP26CCPYDI7 upload=8Q33X5GH1NBC tag=O1TWTYZB0Y0V type=write size=1878792 2024-09-22T08:21:03.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.297+0000 7fe6c9c31780 1 < completed delete operation key=VP1MP4IC9A7T tag=LKHIPJPO0XTG type=del 2024-09-22T08:21:03.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.300+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~PAOWSXTU2NAQ.0 size=1048576 2024-09-22T08:21:03.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.301+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~PAOWSXTU2NAQ.1 size=1048576 2024-09-22T08:21:03.302 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.302+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~PAOWSXTU2NAQ.2 size=682516 2024-09-22T08:21:03.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.302+0000 7fe6c9c31780 1 > prepared multipart upload key=76HZ3LZGVT9J upload=PAOWSXTU2NAQ tag=UOWNV5J84VLE type=write size=3828244 2024-09-22T08:21:03.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.303+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~E02RDJT2CIYR.0 size=1048576 2024-09-22T08:21:03.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.304+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~E02RDJT2CIYR.1 size=723788 2024-09-22T08:21:03.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.307+0000 7fe6c9c31780 1 < completed multipart upload key=XJP26CCPYDI7 upload=E02RDJT2CIYR tag=2FWS5J4OT6KR type=write size=2820940 2024-09-22T08:21:03.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.310+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~OJB52BPEFI84.0 size=1048576 2024-09-22T08:21:03.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.311+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~OJB52BPEFI84.1 size=202946 2024-09-22T08:21:03.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.311+0000 7fe6c9c31780 1 > prepared multipart upload key=0TWY0NNZZ7NN upload=OJB52BPEFI84 tag=6PCANC1CZ16B type=write size=2300098 2024-09-22T08:21:03.313 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.312+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~5JS97BL6LTVD.0 size=1048576 2024-09-22T08:21:03.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.313+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~5JS97BL6LTVD.1 size=1048576 2024-09-22T08:21:03.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.315+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~5JS97BL6LTVD.2 size=341171 2024-09-22T08:21:03.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.318+0000 7fe6c9c31780 1 < completed multipart upload key=76HZ3LZGVT9J upload=5JS97BL6LTVD tag=1FJOF13ZA9UQ type=write size=3486899 2024-09-22T08:21:03.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.318+0000 7fe6c9c31780 1 > prepared operation key=KZIY400KQ5NH tag=YUDSTYJP030X type=del size=30390 2024-09-22T08:21:03.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.320+0000 7fe6c9c31780 1 < completed delete operation key=VP1MP4IC9A7T tag=1IQ4OZTUDQU6 type=del 2024-09-22T08:21:03.323 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.323+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~MT409SAORJF0.0 size=45416 2024-09-22T08:21:03.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.323+0000 7fe6c9c31780 1 > prepared multipart upload key=2B5QRUMTVE7U upload=MT409SAORJF0 tag=D2M9CH01VGP3 type=write size=1093992 2024-09-22T08:21:03.326 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.326+0000 7fe6c9c31780 1 < suggested update operation key=Z1CK5EDBK4AW tag=QVGO9ULFCFXB type=del size=452494 2024-09-22T08:21:03.328 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.328+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=TZUWXIANJM1D type=write size=913419 2024-09-22T08:21:03.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.329+0000 7fe6c9c31780 1 < canceled operation key=6BKB91YV3FMW tag=1A5FV1D5G23H type=del size=1361853 2024-09-22T08:21:03.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.331+0000 7fe6c9c31780 1 > prepared operation key=KZIY400KQ5NH tag=FU0BEEEZLUM0 type=del size=2659609 2024-09-22T08:21:03.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.332+0000 7fe6c9c31780 1 < completed write operation key=4KRJ7DTE3KDV tag=OGTYD48FY8TX type=write size=924815 2024-09-22T08:21:03.334 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.334+0000 7fe6c9c31780 1 > prepared operation key=GEWQUFB9K35E tag=OYRPN2FOEQ9N type=del size=1538307 2024-09-22T08:21:03.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.337+0000 7fe6c9c31780 1 < suggested update operation key=T2W6RXP9UGHH tag=QJG5Y4EQ0BUS type=del size=2274110 2024-09-22T08:21:03.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.340+0000 7fe6c9c31780 1 > prepared part key=_multipart_9AZWQ9E58QS6.2~IURX3WXV6KTR.0 size=1048576 2024-09-22T08:21:03.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.341+0000 7fe6c9c31780 1 > prepared part key=_multipart_9AZWQ9E58QS6.2~IURX3WXV6KTR.1 size=1048576 2024-09-22T08:21:03.342 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.342+0000 7fe6c9c31780 1 > prepared part key=_multipart_9AZWQ9E58QS6.2~IURX3WXV6KTR.2 size=546432 2024-09-22T08:21:03.342 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.342+0000 7fe6c9c31780 1 > prepared multipart upload key=9AZWQ9E58QS6 upload=IURX3WXV6KTR tag=DH38YJSB36FB type=write size=3692160 2024-09-22T08:21:03.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.343+0000 7fe6c9c31780 1 < completed delete operation key=6BKB91YV3FMW tag=0GFZGW870M86 type=del 2024-09-22T08:21:03.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.347+0000 7fe6c9c31780 1 > prepared part key=_multipart_R7UWMW913DJQ.2~Q4ZR3JG0L489.0 size=1048576 2024-09-22T08:21:03.348 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.348+0000 7fe6c9c31780 1 > prepared part key=_multipart_R7UWMW913DJQ.2~Q4ZR3JG0L489.1 size=1048576 2024-09-22T08:21:03.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.348+0000 7fe6c9c31780 1 > prepared part key=_multipart_R7UWMW913DJQ.2~Q4ZR3JG0L489.2 size=859660 2024-09-22T08:21:03.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.348+0000 7fe6c9c31780 1 > prepared multipart upload key=R7UWMW913DJQ upload=Q4ZR3JG0L489 tag=6V0WKP8E14I4 type=write size=4005388 2024-09-22T08:21:03.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.350+0000 7fe6c9c31780 1 < completed part key=_multipart_TYVQ39KUV2V9.2~GZDUVMW29I1Q.0 size=1048576 2024-09-22T08:21:03.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.351+0000 7fe6c9c31780 1 < completed part key=_multipart_TYVQ39KUV2V9.2~GZDUVMW29I1Q.1 size=1048576 2024-09-22T08:21:03.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.352+0000 7fe6c9c31780 1 < completed part key=_multipart_TYVQ39KUV2V9.2~GZDUVMW29I1Q.2 size=11938 2024-09-22T08:21:03.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.354+0000 7fe6c9c31780 1 < completed multipart upload key=TYVQ39KUV2V9 upload=GZDUVMW29I1Q tag=YW4JA5ZLTWX5 type=write size=3157666 2024-09-22T08:21:03.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.356+0000 7fe6c9c31780 1 > prepared operation key=TYVQ39KUV2V9 tag=NSP9RY2RU6CG type=del size=2959627 2024-09-22T08:21:03.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.357+0000 7fe6c9c31780 1 < completed delete operation key=OX1LY7URY7IV tag=GT5O30SHXW31 type=del 2024-09-22T08:21:03.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.359+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=2147JVW0NHP7 type=del size=3879019 2024-09-22T08:21:03.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.363+0000 7fe6c9c31780 1 < suggested remove operation key=TJTB67QBLZH5 tag=T0JJHZ4NZZ80 type=del 2024-09-22T08:21:03.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.366+0000 7fe6c9c31780 1 > prepared part key=_multipart_9AZWQ9E58QS6.2~6WF9ODU1IUYC.0 size=1048576 2024-09-22T08:21:03.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.367+0000 7fe6c9c31780 1 > prepared part key=_multipart_9AZWQ9E58QS6.2~6WF9ODU1IUYC.1 size=437203 2024-09-22T08:21:03.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.367+0000 7fe6c9c31780 1 > prepared multipart upload key=9AZWQ9E58QS6 upload=6WF9ODU1IUYC tag=GPP8KW3X0PB4 type=write size=2534355 2024-09-22T08:21:03.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.368+0000 7fe6c9c31780 1 < completed delete operation key=0PNK2ZW6IJM1 tag=JF7CYSXDMVJU type=del 2024-09-22T08:21:03.372 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.371+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~VA0XQ2AYNJJ2.0 size=1048576 2024-09-22T08:21:03.373 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.372+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~VA0XQ2AYNJJ2.1 size=164777 2024-09-22T08:21:03.373 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.372+0000 7fe6c9c31780 1 > prepared multipart upload key=GEWQUFB9K35E upload=VA0XQ2AYNJJ2 tag=ASEQ3TDCG9WJ type=write size=2261929 2024-09-22T08:21:03.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.373+0000 7fe6c9c31780 1 < canceled part key=_multipart_76HZ3LZGVT9J.2~BCNMB7O02LKI.0 size=1048576 2024-09-22T08:21:03.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.376+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~BCNMB7O02LKI.1 size=1048576 2024-09-22T08:21:03.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.377+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~BCNMB7O02LKI.2 size=1008063 2024-09-22T08:21:03.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.379+0000 7fe6c9c31780 1 < canceled multipart upload key=76HZ3LZGVT9J upload=BCNMB7O02LKI tag=3D864EHQSM4O type=write size=4153791 2024-09-22T08:21:03.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.382+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~NVYDLESM82JJ.0 size=1048576 2024-09-22T08:21:03.384 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.383+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~NVYDLESM82JJ.1 size=87830 2024-09-22T08:21:03.384 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.383+0000 7fe6c9c31780 1 > prepared multipart upload key=O1UBUQXP50CN upload=NVYDLESM82JJ tag=6E6W3KJC914V type=write size=2184982 2024-09-22T08:21:03.385 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.384+0000 7fe6c9c31780 1 < completed delete operation key=VP1MP4IC9A7T tag=A1T7BDMN43B0 type=del 2024-09-22T08:21:03.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.386+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=QMMOQKM3U29Z type=del size=661803 2024-09-22T08:21:03.388 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.387+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~8Q33X5GH1NBC.0 size=830216 2024-09-22T08:21:03.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.390+0000 7fe6c9c31780 1 < completed multipart upload key=XJP26CCPYDI7 upload=8Q33X5GH1NBC tag=O1TWTYZB0Y0V type=write size=1878792 2024-09-22T08:21:03.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.392+0000 7fe6c9c31780 1 > prepared operation key=TYVQ39KUV2V9 tag=Q56LQ2KCYGD0 type=write size=476327 2024-09-22T08:21:03.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.393+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~PAOWSXTU2NAQ.0 size=1048576 2024-09-22T08:21:03.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.395+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~PAOWSXTU2NAQ.1 size=1048576 2024-09-22T08:21:03.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.395+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~PAOWSXTU2NAQ.2 size=682516 2024-09-22T08:21:03.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.398+0000 7fe6c9c31780 1 < completed multipart upload key=76HZ3LZGVT9J upload=PAOWSXTU2NAQ tag=UOWNV5J84VLE type=write size=3828244 2024-09-22T08:21:03.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.399+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=HFXU4R9T3CM6 type=del size=2235907 2024-09-22T08:21:03.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.399+0000 7fe6c9c31780 1 < canceled part key=_multipart_0TWY0NNZZ7NN.2~OJB52BPEFI84.0 size=1048576 2024-09-22T08:21:03.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.399+0000 7fe6c9c31780 1 < canceled part key=_multipart_0TWY0NNZZ7NN.2~OJB52BPEFI84.1 size=202946 2024-09-22T08:21:03.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.403+0000 7fe6c9c31780 1 < canceled multipart upload key=0TWY0NNZZ7NN upload=OJB52BPEFI84 tag=6PCANC1CZ16B type=write size=2300098 2024-09-22T08:21:03.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.405+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~LK94GL9TH0V9.0 size=1048576 2024-09-22T08:21:03.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.406+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~LK94GL9TH0V9.1 size=1048576 2024-09-22T08:21:03.407 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.407+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~LK94GL9TH0V9.2 size=512980 2024-09-22T08:21:03.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.407+0000 7fe6c9c31780 1 > prepared multipart upload key=2B5QRUMTVE7U upload=LK94GL9TH0V9 tag=218AP7IZTI3N type=write size=3658708 2024-09-22T08:21:03.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.410+0000 7fe6c9c31780 1 < suggested update operation key=KZIY400KQ5NH tag=YUDSTYJP030X type=del size=30390 2024-09-22T08:21:03.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.411+0000 7fe6c9c31780 1 > prepared operation key=TJTB67QBLZH5 tag=YN3RPUOQZG18 type=del size=551679 2024-09-22T08:21:03.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.413+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~MT409SAORJF0.0 size=45416 2024-09-22T08:21:03.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.416+0000 7fe6c9c31780 1 < completed multipart upload key=2B5QRUMTVE7U upload=MT409SAORJF0 tag=D2M9CH01VGP3 type=write size=1093992 2024-09-22T08:21:03.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.419+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~IZ63Y1LNZ2L4.0 size=425906 2024-09-22T08:21:03.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.419+0000 7fe6c9c31780 1 > prepared multipart upload key=7446WN19QFV0 upload=IZ63Y1LNZ2L4 tag=C3HUNMBSDP0O type=write size=1474482 2024-09-22T08:21:03.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.420+0000 7fe6c9c31780 1 < completed write operation key=ILW34WLX48WN tag=TZUWXIANJM1D type=write size=913419 2024-09-22T08:21:03.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.424+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~ICASDFBG8704.0 size=95037 2024-09-22T08:21:03.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.424+0000 7fe6c9c31780 1 > prepared multipart upload key=6BKB91YV3FMW upload=ICASDFBG8704 tag=7OGLE8HTS2T8 type=write size=1143613 2024-09-22T08:21:03.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.425+0000 7fe6c9c31780 -1 < failed to complete operation key=KZIY400KQ5NH tag=FU0BEEEZLUM0 type=del size=2659609: (22) Invalid argument 2024-09-22T08:21:03.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.427+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=F6FO8GH7GH2L type=del size=167411 2024-09-22T08:21:03.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.429+0000 7fe6c9c31780 1 < completed delete operation key=GEWQUFB9K35E tag=OYRPN2FOEQ9N type=del 2024-09-22T08:21:03.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.430+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=JSU8A0QL18BO type=del size=791454 2024-09-22T08:21:03.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.432+0000 7fe6c9c31780 1 < completed part key=_multipart_9AZWQ9E58QS6.2~IURX3WXV6KTR.0 size=1048576 2024-09-22T08:21:03.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.433+0000 7fe6c9c31780 1 < completed part key=_multipart_9AZWQ9E58QS6.2~IURX3WXV6KTR.1 size=1048576 2024-09-22T08:21:03.435 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.435+0000 7fe6c9c31780 1 < completed part key=_multipart_9AZWQ9E58QS6.2~IURX3WXV6KTR.2 size=546432 2024-09-22T08:21:03.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.437+0000 7fe6c9c31780 1 < completed multipart upload key=9AZWQ9E58QS6 upload=IURX3WXV6KTR tag=DH38YJSB36FB type=write size=3692160 2024-09-22T08:21:03.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.440+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~T9BD801TL50C.0 size=468889 2024-09-22T08:21:03.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.440+0000 7fe6c9c31780 1 > prepared multipart upload key=DC7VLQWZ3TD1 upload=T9BD801TL50C tag=25E0E3LLWISI type=write size=1517465 2024-09-22T08:21:03.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.441+0000 7fe6c9c31780 1 < completed part key=_multipart_R7UWMW913DJQ.2~Q4ZR3JG0L489.0 size=1048576 2024-09-22T08:21:03.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.443+0000 7fe6c9c31780 1 < completed part key=_multipart_R7UWMW913DJQ.2~Q4ZR3JG0L489.1 size=1048576 2024-09-22T08:21:03.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.445+0000 7fe6c9c31780 1 < completed part key=_multipart_R7UWMW913DJQ.2~Q4ZR3JG0L489.2 size=859660 2024-09-22T08:21:03.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.447+0000 7fe6c9c31780 1 < completed multipart upload key=R7UWMW913DJQ upload=Q4ZR3JG0L489 tag=6V0WKP8E14I4 type=write size=4005388 2024-09-22T08:21:03.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.449+0000 7fe6c9c31780 1 > prepared operation key=1HZ0NAJPXNW1 tag=7N9QGRW29O34 type=del size=1848283 2024-09-22T08:21:03.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.450+0000 7fe6c9c31780 1 < completed delete operation key=TYVQ39KUV2V9 tag=NSP9RY2RU6CG type=del 2024-09-22T08:21:03.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.453+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~7LBWXOHO5XGD.0 size=594054 2024-09-22T08:21:03.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.453+0000 7fe6c9c31780 1 > prepared multipart upload key=TE10GB1F35X4 upload=7LBWXOHO5XGD tag=1O9RNB9UCZGZ type=write size=1642630 2024-09-22T08:21:03.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.455+0000 7fe6c9c31780 1 < completed delete operation key=DC7VLQWZ3TD1 tag=2147JVW0NHP7 type=del 2024-09-22T08:21:03.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.456+0000 7fe6c9c31780 1 > prepared operation key=TJTB67QBLZH5 tag=XWNP0ZK2S7VH type=del size=3640675 2024-09-22T08:21:03.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.457+0000 7fe6c9c31780 1 < canceled part key=_multipart_9AZWQ9E58QS6.2~6WF9ODU1IUYC.0 size=1048576 2024-09-22T08:21:03.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.458+0000 7fe6c9c31780 1 < completed part key=_multipart_9AZWQ9E58QS6.2~6WF9ODU1IUYC.1 size=437203 2024-09-22T08:21:03.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.460+0000 7fe6c9c31780 1 < canceled multipart upload key=9AZWQ9E58QS6 upload=6WF9ODU1IUYC tag=GPP8KW3X0PB4 type=write size=2534355 2024-09-22T08:21:03.463 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.463+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~832U8OIPDPD9.0 size=1048576 2024-09-22T08:21:03.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.464+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~832U8OIPDPD9.1 size=1048576 2024-09-22T08:21:03.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.465+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~832U8OIPDPD9.2 size=841031 2024-09-22T08:21:03.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.465+0000 7fe6c9c31780 1 > prepared multipart upload key=JT5AB8VLMEFD upload=832U8OIPDPD9 tag=PSFSN3LMH8WE type=write size=3986759 2024-09-22T08:21:03.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.466+0000 7fe6c9c31780 1 < completed part key=_multipart_GEWQUFB9K35E.2~VA0XQ2AYNJJ2.0 size=1048576 2024-09-22T08:21:03.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.468+0000 7fe6c9c31780 1 < completed part key=_multipart_GEWQUFB9K35E.2~VA0XQ2AYNJJ2.1 size=164777 2024-09-22T08:21:03.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.470+0000 7fe6c9c31780 1 < completed multipart upload key=GEWQUFB9K35E upload=VA0XQ2AYNJJ2 tag=ASEQ3TDCG9WJ type=write size=2261929 2024-09-22T08:21:03.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.471+0000 7fe6c9c31780 1 > prepared operation key=0PNK2ZW6IJM1 tag=GWT137FAJYO0 type=write size=698950 2024-09-22T08:21:03.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.473+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~NVYDLESM82JJ.0 size=1048576 2024-09-22T08:21:03.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.473+0000 7fe6c9c31780 1 < canceled part key=_multipart_O1UBUQXP50CN.2~NVYDLESM82JJ.1 size=87830 2024-09-22T08:21:03.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.475+0000 7fe6c9c31780 1 < canceled multipart upload key=O1UBUQXP50CN upload=NVYDLESM82JJ tag=6E6W3KJC914V type=write size=2184982 2024-09-22T08:21:03.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.476+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=YCHBGGD8TNV3 type=write size=129140 2024-09-22T08:21:03.478 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.478+0000 7fe6c9c31780 1 < completed delete operation key=TE10GB1F35X4 tag=QMMOQKM3U29Z type=del 2024-09-22T08:21:03.480 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.479+0000 7fe6c9c31780 1 > prepared operation key=OX1LY7URY7IV tag=HA8S14U9SPS6 type=del size=1377360 2024-09-22T08:21:03.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.481+0000 7fe6c9c31780 1 < completed write operation key=TYVQ39KUV2V9 tag=Q56LQ2KCYGD0 type=write size=476327 2024-09-22T08:21:03.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.483+0000 7fe6c9c31780 1 > prepared operation key=JT5AB8VLMEFD tag=ZR9LL9EG0SFG type=del size=2686242 2024-09-22T08:21:03.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.484+0000 7fe6c9c31780 1 < canceled operation key=9AZWQ9E58QS6 tag=HFXU4R9T3CM6 type=del size=2235907 2024-09-22T08:21:03.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.487+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~2DMDUAISDIC0.0 size=1048576 2024-09-22T08:21:03.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.488+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~2DMDUAISDIC0.1 size=1048576 2024-09-22T08:21:03.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.489+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~2DMDUAISDIC0.2 size=766932 2024-09-22T08:21:03.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.489+0000 7fe6c9c31780 1 > prepared multipart upload key=946H8F2AUPO2 upload=2DMDUAISDIC0 tag=2RR7O3I6P81H type=write size=3912660 2024-09-22T08:21:03.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.490+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~LK94GL9TH0V9.0 size=1048576 2024-09-22T08:21:03.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.491+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~LK94GL9TH0V9.1 size=1048576 2024-09-22T08:21:03.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.493+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~LK94GL9TH0V9.2 size=512980 2024-09-22T08:21:03.496 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.495+0000 7fe6c9c31780 1 < completed multipart upload key=2B5QRUMTVE7U upload=LK94GL9TH0V9 tag=218AP7IZTI3N type=write size=3658708 2024-09-22T08:21:03.498 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.497+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=09OUFBL4MPHI type=del size=1210475 2024-09-22T08:21:03.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.499+0000 7fe6c9c31780 1 < canceled operation key=TJTB67QBLZH5 tag=YN3RPUOQZG18 type=del size=551679 2024-09-22T08:21:03.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.503+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~632MNTBMM4V7.0 size=422982 2024-09-22T08:21:03.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.503+0000 7fe6c9c31780 1 > prepared multipart upload key=DC7VLQWZ3TD1 upload=632MNTBMM4V7 tag=5ME6RDGKMQI6 type=write size=1471558 2024-09-22T08:21:03.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.504+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~IZ63Y1LNZ2L4.0 size=425906 2024-09-22T08:21:03.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.507+0000 7fe6c9c31780 1 < completed multipart upload key=7446WN19QFV0 upload=IZ63Y1LNZ2L4 tag=C3HUNMBSDP0O type=write size=1474482 2024-09-22T08:21:03.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.509+0000 7fe6c9c31780 1 > prepared operation key=W9L87PTJEIOA tag=7NNBIFX55LBK type=del size=1912519 2024-09-22T08:21:03.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.511+0000 7fe6c9c31780 1 < completed part key=_multipart_6BKB91YV3FMW.2~ICASDFBG8704.0 size=95037 2024-09-22T08:21:03.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.514+0000 7fe6c9c31780 1 < completed multipart upload key=6BKB91YV3FMW upload=ICASDFBG8704 tag=7OGLE8HTS2T8 type=write size=1143613 2024-09-22T08:21:03.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.515+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=V8RQUTRBLEZT type=del size=3542453 2024-09-22T08:21:03.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.518+0000 7fe6c9c31780 1 < suggested remove operation key=DC7VLQWZ3TD1 tag=F6FO8GH7GH2L type=del 2024-09-22T08:21:03.520 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.520+0000 7fe6c9c31780 1 > prepared operation key=VP1MP4IC9A7T tag=URJ03MMMNT2M type=del size=3356639 2024-09-22T08:21:03.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.523+0000 7fe6c9c31780 1 < suggested update operation key=0TWY0NNZZ7NN tag=JSU8A0QL18BO type=del size=791454 2024-09-22T08:21:03.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.524+0000 7fe6c9c31780 1 > prepared operation key=LA6ZRVULGQ0H tag=VTZCLT8B8LUJ type=write size=135134 2024-09-22T08:21:03.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.526+0000 7fe6c9c31780 1 < completed part key=_multipart_DC7VLQWZ3TD1.2~T9BD801TL50C.0 size=468889 2024-09-22T08:21:03.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.528+0000 7fe6c9c31780 1 < completed multipart upload key=DC7VLQWZ3TD1 upload=T9BD801TL50C tag=25E0E3LLWISI type=write size=1517465 2024-09-22T08:21:03.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.530+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=0VKST1FII8KU type=del size=1537145 2024-09-22T08:21:03.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.531+0000 7fe6c9c31780 1 < completed delete operation key=1HZ0NAJPXNW1 tag=7N9QGRW29O34 type=del 2024-09-22T08:21:03.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.532+0000 7fe6c9c31780 1 > prepared operation key=9FCSIF1WKBDJ tag=ECIRI8RM4PHM type=del size=4178909 2024-09-22T08:21:03.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.534+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~7LBWXOHO5XGD.0 size=594054 2024-09-22T08:21:03.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.537+0000 7fe6c9c31780 1 < completed multipart upload key=TE10GB1F35X4 upload=7LBWXOHO5XGD tag=1O9RNB9UCZGZ type=write size=1642630 2024-09-22T08:21:03.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.538+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=8105FN1NHRE8 type=del size=1191884 2024-09-22T08:21:03.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.540+0000 7fe6c9c31780 1 < completed delete operation key=TJTB67QBLZH5 tag=XWNP0ZK2S7VH type=del 2024-09-22T08:21:03.542 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.541+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=AM1L3LLT68P0 type=del size=2178827 2024-09-22T08:21:03.543 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.543+0000 7fe6c9c31780 1 < completed part key=_multipart_JT5AB8VLMEFD.2~832U8OIPDPD9.0 size=1048576 2024-09-22T08:21:03.545 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.545+0000 7fe6c9c31780 1 < completed part key=_multipart_JT5AB8VLMEFD.2~832U8OIPDPD9.1 size=1048576 2024-09-22T08:21:03.546 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.546+0000 7fe6c9c31780 1 < completed part key=_multipart_JT5AB8VLMEFD.2~832U8OIPDPD9.2 size=841031 2024-09-22T08:21:03.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.548+0000 7fe6c9c31780 1 < completed multipart upload key=JT5AB8VLMEFD upload=832U8OIPDPD9 tag=PSFSN3LMH8WE type=write size=3986759 2024-09-22T08:21:03.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.550+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=0DTTXEZ1S5W3 type=del size=1204536 2024-09-22T08:21:03.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.553+0000 7fe6c9c31780 1 < suggested remove operation key=0PNK2ZW6IJM1 tag=GWT137FAJYO0 type=write 2024-09-22T08:21:03.555 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.554+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=HFCQWFG42V02 type=del size=3056571 2024-09-22T08:21:03.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.556+0000 7fe6c9c31780 1 < canceled operation key=CTK01Y0CV1NC tag=YCHBGGD8TNV3 type=write size=129140 2024-09-22T08:21:03.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.557+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=J5YLTXP170J5 type=del size=2698202 2024-09-22T08:21:03.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.559+0000 7fe6c9c31780 1 < completed delete operation key=OX1LY7URY7IV tag=HA8S14U9SPS6 type=del 2024-09-22T08:21:03.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.562+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~FR1P1UJE6JE7.0 size=1048576 2024-09-22T08:21:03.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.563+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~FR1P1UJE6JE7.1 size=1048576 2024-09-22T08:21:03.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.564+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~FR1P1UJE6JE7.2 size=844309 2024-09-22T08:21:03.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.564+0000 7fe6c9c31780 1 > prepared multipart upload key=ILW34WLX48WN upload=FR1P1UJE6JE7 tag=M89OC58CR4KE type=write size=3990037 2024-09-22T08:21:03.567 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.567+0000 7fe6c9c31780 1 < suggested remove operation key=JT5AB8VLMEFD tag=ZR9LL9EG0SFG type=del 2024-09-22T08:21:03.569 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.569+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=6Q1JNAW8U1TL type=write size=449742 2024-09-22T08:21:03.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.570+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~2DMDUAISDIC0.0 size=1048576 2024-09-22T08:21:03.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.571+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~2DMDUAISDIC0.1 size=1048576 2024-09-22T08:21:03.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.572+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~2DMDUAISDIC0.2 size=766932 2024-09-22T08:21:03.576 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.575+0000 7fe6c9c31780 1 < completed multipart upload key=946H8F2AUPO2 upload=2DMDUAISDIC0 tag=2RR7O3I6P81H type=write size=3912660 2024-09-22T08:21:03.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.577+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=8F7B2HF5YAP3 type=del size=3991177 2024-09-22T08:21:03.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.578+0000 7fe6c9c31780 1 < completed delete operation key=ILW34WLX48WN tag=09OUFBL4MPHI type=del 2024-09-22T08:21:03.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.581+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~I4J57178P55I.0 size=1048576 2024-09-22T08:21:03.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.582+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~I4J57178P55I.1 size=511153 2024-09-22T08:21:03.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.582+0000 7fe6c9c31780 1 > prepared multipart upload key=LA6ZRVULGQ0H upload=I4J57178P55I tag=J6RD203W4LZX type=write size=2608305 2024-09-22T08:21:03.584 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.584+0000 7fe6c9c31780 1 < completed part key=_multipart_DC7VLQWZ3TD1.2~632MNTBMM4V7.0 size=422982 2024-09-22T08:21:03.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.587+0000 7fe6c9c31780 1 < completed multipart upload key=DC7VLQWZ3TD1 upload=632MNTBMM4V7 tag=5ME6RDGKMQI6 type=write size=1471558 2024-09-22T08:21:03.590 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.589+0000 7fe6c9c31780 1 > prepared part key=_multipart_9AZWQ9E58QS6.2~4G3ZB49SS43K.0 size=1048576 2024-09-22T08:21:03.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.591+0000 7fe6c9c31780 1 > prepared part key=_multipart_9AZWQ9E58QS6.2~4G3ZB49SS43K.1 size=1048576 2024-09-22T08:21:03.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.592+0000 7fe6c9c31780 1 > prepared part key=_multipart_9AZWQ9E58QS6.2~4G3ZB49SS43K.2 size=93757 2024-09-22T08:21:03.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.592+0000 7fe6c9c31780 1 > prepared multipart upload key=9AZWQ9E58QS6 upload=4G3ZB49SS43K tag=RRW584PS3QM0 type=write size=3239485 2024-09-22T08:21:03.594 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.593+0000 7fe6c9c31780 1 < completed delete operation key=W9L87PTJEIOA tag=7NNBIFX55LBK type=del 2024-09-22T08:21:03.595 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.595+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=TK9PQS87Y9FX type=del size=4090972 2024-09-22T08:21:03.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.596+0000 7fe6c9c31780 1 < completed delete operation key=2B5QRUMTVE7U tag=V8RQUTRBLEZT type=del 2024-09-22T08:21:03.598 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.598+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=56CV6AOAX0QH type=write size=665879 2024-09-22T08:21:03.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.599+0000 7fe6c9c31780 1 < canceled operation key=VP1MP4IC9A7T tag=URJ03MMMNT2M type=del size=3356639 2024-09-22T08:21:03.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.601+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=I3DEMDDKSAZ1 type=write size=254518 2024-09-22T08:21:03.603 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.603+0000 7fe6c9c31780 1 < completed write operation key=LA6ZRVULGQ0H tag=VTZCLT8B8LUJ type=write size=135134 2024-09-22T08:21:03.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.604+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=J6Q4FEHH5O61 type=del size=2154333 2024-09-22T08:21:03.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.606+0000 7fe6c9c31780 1 < completed delete operation key=CTK01Y0CV1NC tag=0VKST1FII8KU type=del 2024-09-22T08:21:03.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.609+0000 7fe6c9c31780 1 > prepared part key=_multipart_W9L87PTJEIOA.2~7JYKQ2TUQ5NG.0 size=1048576 2024-09-22T08:21:03.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.610+0000 7fe6c9c31780 1 > prepared part key=_multipart_W9L87PTJEIOA.2~7JYKQ2TUQ5NG.1 size=1048576 2024-09-22T08:21:03.611 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.611+0000 7fe6c9c31780 1 > prepared part key=_multipart_W9L87PTJEIOA.2~7JYKQ2TUQ5NG.2 size=89727 2024-09-22T08:21:03.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.611+0000 7fe6c9c31780 1 > prepared multipart upload key=W9L87PTJEIOA upload=7JYKQ2TUQ5NG tag=U9NEE6OXVPHY type=write size=3235455 2024-09-22T08:21:03.613 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.613+0000 7fe6c9c31780 1 < completed delete operation key=9FCSIF1WKBDJ tag=ECIRI8RM4PHM type=del 2024-09-22T08:21:03.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.614+0000 7fe6c9c31780 1 > prepared operation key=XJP26CCPYDI7 tag=3U49WHW1X6WI type=del size=3809637 2024-09-22T08:21:03.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.616+0000 7fe6c9c31780 1 < completed delete operation key=DC7VLQWZ3TD1 tag=8105FN1NHRE8 type=del 2024-09-22T08:21:03.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.618+0000 7fe6c9c31780 1 > prepared part key=_multipart_1HZ0NAJPXNW1.2~42WISNWGCWBW.0 size=872091 2024-09-22T08:21:03.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.618+0000 7fe6c9c31780 1 > prepared multipart upload key=1HZ0NAJPXNW1 upload=42WISNWGCWBW tag=WCUSXL4XLG21 type=write size=1920667 2024-09-22T08:21:03.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.621+0000 7fe6c9c31780 1 < suggested remove operation key=TE10GB1F35X4 tag=AM1L3LLT68P0 type=del 2024-09-22T08:21:03.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.624+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~VQKHRFA9K6TR.0 size=1048576 2024-09-22T08:21:03.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.625+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~VQKHRFA9K6TR.1 size=1048576 2024-09-22T08:21:03.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.627+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~VQKHRFA9K6TR.2 size=357212 2024-09-22T08:21:03.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.627+0000 7fe6c9c31780 1 > prepared multipart upload key=946H8F2AUPO2 upload=VQKHRFA9K6TR tag=10A4XDMTEZ01 type=write size=3502940 2024-09-22T08:21:03.630 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.630+0000 7fe6c9c31780 1 < suggested remove operation key=946H8F2AUPO2 tag=0DTTXEZ1S5W3 type=del 2024-09-22T08:21:03.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.632+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~IP6WPF1M9B3Q.0 size=1048576 2024-09-22T08:21:03.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.633+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~IP6WPF1M9B3Q.1 size=1048576 2024-09-22T08:21:03.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.635+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~IP6WPF1M9B3Q.2 size=678386 2024-09-22T08:21:03.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.635+0000 7fe6c9c31780 1 > prepared multipart upload key=OX1LY7URY7IV upload=IP6WPF1M9B3Q tag=6JRS0O5E2G0K type=write size=3824114 2024-09-22T08:21:03.637 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.636+0000 7fe6c9c31780 1 < completed delete operation key=6BKB91YV3FMW tag=HFCQWFG42V02 type=del 2024-09-22T08:21:03.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.638+0000 7fe6c9c31780 1 > prepared operation key=9FCSIF1WKBDJ tag=QGUFJ0VEUW2V type=del size=774733 2024-09-22T08:21:03.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.639+0000 7fe6c9c31780 1 < completed delete operation key=9AZWQ9E58QS6 tag=J5YLTXP170J5 type=del 2024-09-22T08:21:03.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.642+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~G518G1HSUVL1.0 size=1048576 2024-09-22T08:21:03.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.643+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~G518G1HSUVL1.1 size=1048576 2024-09-22T08:21:03.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.644+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~G518G1HSUVL1.2 size=645651 2024-09-22T08:21:03.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.644+0000 7fe6c9c31780 1 > prepared multipart upload key=DC7VLQWZ3TD1 upload=G518G1HSUVL1 tag=GY0U91J08ZF4 type=write size=3791379 2024-09-22T08:21:03.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.645+0000 7fe6c9c31780 1 < completed part key=_multipart_ILW34WLX48WN.2~FR1P1UJE6JE7.0 size=1048576 2024-09-22T08:21:03.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.647+0000 7fe6c9c31780 1 < completed part key=_multipart_ILW34WLX48WN.2~FR1P1UJE6JE7.1 size=1048576 2024-09-22T08:21:03.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.647+0000 7fe6c9c31780 1 < canceled part key=_multipart_ILW34WLX48WN.2~FR1P1UJE6JE7.2 size=844309 2024-09-22T08:21:03.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.650+0000 7fe6c9c31780 1 < canceled multipart upload key=ILW34WLX48WN upload=FR1P1UJE6JE7 tag=M89OC58CR4KE type=write size=3990037 2024-09-22T08:21:03.651 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.650+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=8NB1N6UNRVRL type=del size=3911025 2024-09-22T08:21:03.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.651+0000 7fe6c9c31780 -1 < no bi entry to suggest for operation key=946H8F2AUPO2 tag=6Q1JNAW8U1TL type=write size=449742: (2) No such file or directory 2024-09-22T08:21:03.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.653+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=V06MRXXZBNVZ type=write size=759820 2024-09-22T08:21:03.655 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.654+0000 7fe6c9c31780 1 < completed delete operation key=R7UWMW913DJQ tag=8F7B2HF5YAP3 type=del 2024-09-22T08:21:03.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.657+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~BQIVZ6D8SOGO.0 size=1048576 2024-09-22T08:21:03.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.658+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~BQIVZ6D8SOGO.1 size=1048576 2024-09-22T08:21:03.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.660+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~BQIVZ6D8SOGO.2 size=1021257 2024-09-22T08:21:03.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.660+0000 7fe6c9c31780 1 > prepared multipart upload key=946H8F2AUPO2 upload=BQIVZ6D8SOGO tag=8CCAMQGA8WNY type=write size=4166985 2024-09-22T08:21:03.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.661+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~I4J57178P55I.0 size=1048576 2024-09-22T08:21:03.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.662+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~I4J57178P55I.1 size=511153 2024-09-22T08:21:03.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.665+0000 7fe6c9c31780 1 < completed multipart upload key=LA6ZRVULGQ0H upload=I4J57178P55I tag=J6RD203W4LZX type=write size=2608305 2024-09-22T08:21:03.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.666+0000 7fe6c9c31780 1 > prepared operation key=TJTB67QBLZH5 tag=ZOAG82BRGDN5 type=write size=205253 2024-09-22T08:21:03.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.668+0000 7fe6c9c31780 1 < completed part key=_multipart_9AZWQ9E58QS6.2~4G3ZB49SS43K.0 size=1048576 2024-09-22T08:21:03.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.668+0000 7fe6c9c31780 1 < canceled part key=_multipart_9AZWQ9E58QS6.2~4G3ZB49SS43K.1 size=1048576 2024-09-22T08:21:03.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.669+0000 7fe6c9c31780 1 < completed part key=_multipart_9AZWQ9E58QS6.2~4G3ZB49SS43K.2 size=93757 2024-09-22T08:21:03.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.672+0000 7fe6c9c31780 1 < canceled multipart upload key=9AZWQ9E58QS6 upload=4G3ZB49SS43K tag=RRW584PS3QM0 type=write size=3239485 2024-09-22T08:21:03.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.675+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~YE5SFJB02MGN.0 size=1048576 2024-09-22T08:21:03.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.675+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~YE5SFJB02MGN.1 size=1048576 2024-09-22T08:21:03.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.676+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~YE5SFJB02MGN.2 size=17643 2024-09-22T08:21:03.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.676+0000 7fe6c9c31780 1 > prepared multipart upload key=Z1CK5EDBK4AW upload=YE5SFJB02MGN tag=UOJS6SQKG3VE type=write size=3163371 2024-09-22T08:21:03.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.680+0000 7fe6c9c31780 1 < suggested update operation key=T2W6RXP9UGHH tag=TK9PQS87Y9FX type=del size=4090972 2024-09-22T08:21:03.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.681+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=TCMIV151H1YJ type=del size=1406422 2024-09-22T08:21:03.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.683+0000 7fe6c9c31780 1 < completed write operation key=7446WN19QFV0 tag=56CV6AOAX0QH type=write size=665879 2024-09-22T08:21:03.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.685+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~IVJA9JPCR3GD.0 size=1048576 2024-09-22T08:21:03.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.687+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~IVJA9JPCR3GD.1 size=1048576 2024-09-22T08:21:03.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.688+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~IVJA9JPCR3GD.2 size=157205 2024-09-22T08:21:03.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.688+0000 7fe6c9c31780 1 > prepared multipart upload key=XJP26CCPYDI7 upload=IVJA9JPCR3GD tag=YA2R0HPB0K1L type=write size=3302933 2024-09-22T08:21:03.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.689+0000 7fe6c9c31780 -1 < failed to complete operation key=946H8F2AUPO2 tag=I3DEMDDKSAZ1 type=write size=254518: (22) Invalid argument 2024-09-22T08:21:03.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.691+0000 7fe6c9c31780 1 > prepared operation key=TJTB67QBLZH5 tag=IRSQ09SVWVR9 type=write size=67236 2024-09-22T08:21:03.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.692+0000 7fe6c9c31780 1 < completed delete operation key=2B5QRUMTVE7U tag=J6Q4FEHH5O61 type=del 2024-09-22T08:21:03.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.695+0000 7fe6c9c31780 1 > prepared part key=_multipart_TJTB67QBLZH5.2~MR209MI1MJN1.0 size=642329 2024-09-22T08:21:03.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.695+0000 7fe6c9c31780 1 > prepared multipart upload key=TJTB67QBLZH5 upload=MR209MI1MJN1 tag=WJ7M48SLAWD5 type=write size=1690905 2024-09-22T08:21:03.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.696+0000 7fe6c9c31780 1 < completed part key=_multipart_W9L87PTJEIOA.2~7JYKQ2TUQ5NG.0 size=1048576 2024-09-22T08:21:03.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.698+0000 7fe6c9c31780 1 < completed part key=_multipart_W9L87PTJEIOA.2~7JYKQ2TUQ5NG.1 size=1048576 2024-09-22T08:21:03.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.698+0000 7fe6c9c31780 1 < canceled part key=_multipart_W9L87PTJEIOA.2~7JYKQ2TUQ5NG.2 size=89727 2024-09-22T08:21:03.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.700+0000 7fe6c9c31780 1 < canceled multipart upload key=W9L87PTJEIOA upload=7JYKQ2TUQ5NG tag=U9NEE6OXVPHY type=write size=3235455 2024-09-22T08:21:03.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.702+0000 7fe6c9c31780 1 > prepared operation key=TJTB67QBLZH5 tag=UIYVMOLPNYC8 type=write size=56763 2024-09-22T08:21:03.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.704+0000 7fe6c9c31780 1 < canceled operation key=XJP26CCPYDI7 tag=3U49WHW1X6WI type=del size=3809637 2024-09-22T08:21:03.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.706+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=W2TUPRD3SFCA type=write size=329099 2024-09-22T08:21:03.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.708+0000 7fe6c9c31780 1 < completed part key=_multipart_1HZ0NAJPXNW1.2~42WISNWGCWBW.0 size=872091 2024-09-22T08:21:03.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.710+0000 7fe6c9c31780 1 < completed multipart upload key=1HZ0NAJPXNW1 upload=42WISNWGCWBW tag=WCUSXL4XLG21 type=write size=1920667 2024-09-22T08:21:03.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.712+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~7KGMB1APC26J.0 size=81039 2024-09-22T08:21:03.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.712+0000 7fe6c9c31780 1 > prepared multipart upload key=6BKB91YV3FMW upload=7KGMB1APC26J tag=A1LIRL1SXRK5 type=write size=1129615 2024-09-22T08:21:03.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.714+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~VQKHRFA9K6TR.0 size=1048576 2024-09-22T08:21:03.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.715+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~VQKHRFA9K6TR.1 size=1048576 2024-09-22T08:21:03.717 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.716+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~VQKHRFA9K6TR.2 size=357212 2024-09-22T08:21:03.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.719+0000 7fe6c9c31780 1 < completed multipart upload key=946H8F2AUPO2 upload=VQKHRFA9K6TR tag=10A4XDMTEZ01 type=write size=3502940 2024-09-22T08:21:03.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.720+0000 7fe6c9c31780 1 > prepared operation key=4KRJ7DTE3KDV tag=I5A78W7NGBTO type=del size=1925641 2024-09-22T08:21:03.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.723+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~IP6WPF1M9B3Q.0 size=1048576 2024-09-22T08:21:03.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.724+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~IP6WPF1M9B3Q.1 size=1048576 2024-09-22T08:21:03.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.725+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~IP6WPF1M9B3Q.2 size=678386 2024-09-22T08:21:03.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.727+0000 7fe6c9c31780 1 < completed multipart upload key=OX1LY7URY7IV upload=IP6WPF1M9B3Q tag=6JRS0O5E2G0K type=write size=3824114 2024-09-22T08:21:03.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.728+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=ACTHBERBCD3O type=del size=2770701 2024-09-22T08:21:03.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.730+0000 7fe6c9c31780 1 < completed delete operation key=9FCSIF1WKBDJ tag=QGUFJ0VEUW2V type=del 2024-09-22T08:21:03.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.732+0000 7fe6c9c31780 1 > prepared operation key=XJP26CCPYDI7 tag=N6VVRE24G7LI type=del size=2192853 2024-09-22T08:21:03.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.734+0000 7fe6c9c31780 1 < completed part key=_multipart_DC7VLQWZ3TD1.2~G518G1HSUVL1.0 size=1048576 2024-09-22T08:21:03.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.735+0000 7fe6c9c31780 1 < completed part key=_multipart_DC7VLQWZ3TD1.2~G518G1HSUVL1.1 size=1048576 2024-09-22T08:21:03.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.736+0000 7fe6c9c31780 1 < completed part key=_multipart_DC7VLQWZ3TD1.2~G518G1HSUVL1.2 size=645651 2024-09-22T08:21:03.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.739+0000 7fe6c9c31780 1 < completed multipart upload key=DC7VLQWZ3TD1 upload=G518G1HSUVL1 tag=GY0U91J08ZF4 type=write size=3791379 2024-09-22T08:21:03.741 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.741+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=866NQL0CL2H0 type=del size=946667 2024-09-22T08:21:03.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.742+0000 7fe6c9c31780 1 < completed delete operation key=TE10GB1F35X4 tag=8NB1N6UNRVRL type=del 2024-09-22T08:21:03.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.744+0000 7fe6c9c31780 1 > prepared operation key=OX1LY7URY7IV tag=D132QNCWKSY8 type=del size=1980274 2024-09-22T08:21:03.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.745+0000 7fe6c9c31780 1 < completed write operation key=2B5QRUMTVE7U tag=V06MRXXZBNVZ type=write size=759820 2024-09-22T08:21:03.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.748+0000 7fe6c9c31780 1 > prepared part key=_multipart_1HZ0NAJPXNW1.2~FHQPHJAFRQVX.0 size=1048576 2024-09-22T08:21:03.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.749+0000 7fe6c9c31780 1 > prepared part key=_multipart_1HZ0NAJPXNW1.2~FHQPHJAFRQVX.1 size=236922 2024-09-22T08:21:03.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.749+0000 7fe6c9c31780 1 > prepared multipart upload key=1HZ0NAJPXNW1 upload=FHQPHJAFRQVX tag=TAI8JA07KW2I type=write size=2334074 2024-09-22T08:21:03.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.751+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~BQIVZ6D8SOGO.0 size=1048576 2024-09-22T08:21:03.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.752+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~BQIVZ6D8SOGO.1 size=1048576 2024-09-22T08:21:03.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.754+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~BQIVZ6D8SOGO.2 size=1021257 2024-09-22T08:21:03.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.756+0000 7fe6c9c31780 1 < completed multipart upload key=946H8F2AUPO2 upload=BQIVZ6D8SOGO tag=8CCAMQGA8WNY type=write size=4166985 2024-09-22T08:21:03.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.758+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~YVJP3SJT11BK.0 size=1048576 2024-09-22T08:21:03.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.760+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~YVJP3SJT11BK.1 size=1048576 2024-09-22T08:21:03.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.761+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~YVJP3SJT11BK.2 size=128083 2024-09-22T08:21:03.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.761+0000 7fe6c9c31780 1 > prepared multipart upload key=CTK01Y0CV1NC upload=YVJP3SJT11BK tag=95LU16CWGF8D type=write size=3273811 2024-09-22T08:21:03.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.762+0000 7fe6c9c31780 1 < completed write operation key=TJTB67QBLZH5 tag=ZOAG82BRGDN5 type=write size=205253 2024-09-22T08:21:03.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.766+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~982F4AYKTH18.0 size=1048576 2024-09-22T08:21:03.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.766+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~982F4AYKTH18.1 size=1048576 2024-09-22T08:21:03.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.767+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~982F4AYKTH18.2 size=756397 2024-09-22T08:21:03.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.767+0000 7fe6c9c31780 1 > prepared multipart upload key=VP1MP4IC9A7T upload=982F4AYKTH18 tag=VML3Z5KFQOY5 type=write size=3902125 2024-09-22T08:21:03.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.769+0000 7fe6c9c31780 1 < completed part key=_multipart_Z1CK5EDBK4AW.2~YE5SFJB02MGN.0 size=1048576 2024-09-22T08:21:03.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.770+0000 7fe6c9c31780 1 < completed part key=_multipart_Z1CK5EDBK4AW.2~YE5SFJB02MGN.1 size=1048576 2024-09-22T08:21:03.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.772+0000 7fe6c9c31780 1 < completed part key=_multipart_Z1CK5EDBK4AW.2~YE5SFJB02MGN.2 size=17643 2024-09-22T08:21:03.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.775+0000 7fe6c9c31780 1 < completed multipart upload key=Z1CK5EDBK4AW upload=YE5SFJB02MGN tag=UOJS6SQKG3VE type=write size=3163371 2024-09-22T08:21:03.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.776+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=T50N9CH3RYJH type=del size=644831 2024-09-22T08:21:03.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.777+0000 7fe6c9c31780 1 < completed delete operation key=CTK01Y0CV1NC tag=TCMIV151H1YJ type=del 2024-09-22T08:21:03.779 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.779+0000 7fe6c9c31780 1 > prepared operation key=JT5AB8VLMEFD tag=SIQJBBXC27F9 type=del size=607782 2024-09-22T08:21:03.781 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.780+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~IVJA9JPCR3GD.0 size=1048576 2024-09-22T08:21:03.782 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.781+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~IVJA9JPCR3GD.1 size=1048576 2024-09-22T08:21:03.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.783+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~IVJA9JPCR3GD.2 size=157205 2024-09-22T08:21:03.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.786+0000 7fe6c9c31780 1 < completed multipart upload key=XJP26CCPYDI7 upload=IVJA9JPCR3GD tag=YA2R0HPB0K1L type=write size=3302933 2024-09-22T08:21:03.787 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.787+0000 7fe6c9c31780 1 > prepared operation key=GEWQUFB9K35E tag=EIQ8NDS0Y97J type=write size=772979 2024-09-22T08:21:03.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.788+0000 7fe6c9c31780 1 < completed write operation key=TJTB67QBLZH5 tag=IRSQ09SVWVR9 type=write size=67236 2024-09-22T08:21:03.792 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.791+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~XUATRPF6P3EV.0 size=1048576 2024-09-22T08:21:03.793 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.792+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~XUATRPF6P3EV.1 size=1048576 2024-09-22T08:21:03.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.794+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~XUATRPF6P3EV.2 size=577268 2024-09-22T08:21:03.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.794+0000 7fe6c9c31780 1 > prepared multipart upload key=KZIY400KQ5NH upload=XUATRPF6P3EV tag=HX5W1MX026B3 type=write size=3722996 2024-09-22T08:21:03.796 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.795+0000 7fe6c9c31780 1 < completed part key=_multipart_TJTB67QBLZH5.2~MR209MI1MJN1.0 size=642329 2024-09-22T08:21:03.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.799+0000 7fe6c9c31780 1 < completed multipart upload key=TJTB67QBLZH5 upload=MR209MI1MJN1 tag=WJ7M48SLAWD5 type=write size=1690905 2024-09-22T08:21:03.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.800+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=ZDKV860ZFRMJ type=del size=1542286 2024-09-22T08:21:03.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.803+0000 7fe6c9c31780 1 < canceled operation key=TJTB67QBLZH5 tag=UIYVMOLPNYC8 type=write size=56763 2024-09-22T08:21:03.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.804+0000 7fe6c9c31780 1 > prepared operation key=9FCSIF1WKBDJ tag=ZZXX73PMZIAN type=del size=999722 2024-09-22T08:21:03.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.807+0000 7fe6c9c31780 1 < suggested update operation key=7446WN19QFV0 tag=W2TUPRD3SFCA type=write size=329099 2024-09-22T08:21:03.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.810+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~ODPK6EHA9ZPB.0 size=1048576 2024-09-22T08:21:03.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.811+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~ODPK6EHA9ZPB.1 size=539625 2024-09-22T08:21:03.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.811+0000 7fe6c9c31780 1 > prepared multipart upload key=0TWY0NNZZ7NN upload=ODPK6EHA9ZPB tag=5Q7MKC2M2PHT type=write size=2636777 2024-09-22T08:21:03.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.812+0000 7fe6c9c31780 1 < completed part key=_multipart_6BKB91YV3FMW.2~7KGMB1APC26J.0 size=81039 2024-09-22T08:21:03.815 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.815+0000 7fe6c9c31780 1 < completed multipart upload key=6BKB91YV3FMW upload=7KGMB1APC26J tag=A1LIRL1SXRK5 type=write size=1129615 2024-09-22T08:21:03.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.817+0000 7fe6c9c31780 1 > prepared part key=_multipart_ZFL9N44PBQX4.2~JGK6AZ2J52DT.0 size=83121 2024-09-22T08:21:03.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.817+0000 7fe6c9c31780 1 > prepared multipart upload key=ZFL9N44PBQX4 upload=JGK6AZ2J52DT tag=R748TVZXG6SN type=write size=1131697 2024-09-22T08:21:03.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.819+0000 7fe6c9c31780 1 < completed delete operation key=4KRJ7DTE3KDV tag=I5A78W7NGBTO type=del 2024-09-22T08:21:03.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.820+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=D4QOHWGVMFQV type=del size=3925585 2024-09-22T08:21:03.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.822+0000 7fe6c9c31780 1 < completed delete operation key=76HZ3LZGVT9J tag=ACTHBERBCD3O type=del 2024-09-22T08:21:03.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.823+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=KI3V6DVWHBAC type=del size=2833267 2024-09-22T08:21:03.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.825+0000 7fe6c9c31780 1 < canceled operation key=XJP26CCPYDI7 tag=N6VVRE24G7LI type=del size=2192853 2024-09-22T08:21:03.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.826+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=PP72YW3OKTOC type=del size=895907 2024-09-22T08:21:03.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.828+0000 7fe6c9c31780 1 < completed delete operation key=2B5QRUMTVE7U tag=866NQL0CL2H0 type=del 2024-09-22T08:21:03.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.830+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=AP4OYMP9B2UR type=del size=3423786 2024-09-22T08:21:03.832 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.831+0000 7fe6c9c31780 1 < completed delete operation key=OX1LY7URY7IV tag=D132QNCWKSY8 type=del 2024-09-22T08:21:03.833 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.833+0000 7fe6c9c31780 1 > prepared operation key=4KRJ7DTE3KDV tag=TDQWN1A1C7FX type=del size=3878382 2024-09-22T08:21:03.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.834+0000 7fe6c9c31780 1 < completed part key=_multipart_1HZ0NAJPXNW1.2~FHQPHJAFRQVX.0 size=1048576 2024-09-22T08:21:03.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.835+0000 7fe6c9c31780 1 < completed part key=_multipart_1HZ0NAJPXNW1.2~FHQPHJAFRQVX.1 size=236922 2024-09-22T08:21:03.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.838+0000 7fe6c9c31780 1 < completed multipart upload key=1HZ0NAJPXNW1 upload=FHQPHJAFRQVX tag=TAI8JA07KW2I type=write size=2334074 2024-09-22T08:21:03.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.839+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=U9R5NHG66D82 type=del size=4075251 2024-09-22T08:21:03.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.840+0000 7fe6c9c31780 1 < canceled part key=_multipart_CTK01Y0CV1NC.2~YVJP3SJT11BK.0 size=1048576 2024-09-22T08:21:03.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.840+0000 7fe6c9c31780 1 < canceled part key=_multipart_CTK01Y0CV1NC.2~YVJP3SJT11BK.1 size=1048576 2024-09-22T08:21:03.841 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.841+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~YVJP3SJT11BK.2 size=128083 2024-09-22T08:21:03.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.843+0000 7fe6c9c31780 1 < canceled multipart upload key=CTK01Y0CV1NC upload=YVJP3SJT11BK tag=95LU16CWGF8D type=write size=3273811 2024-09-22T08:21:03.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.845+0000 7fe6c9c31780 1 > prepared operation key=KZIY400KQ5NH tag=CVR595921HW0 type=del size=484320 2024-09-22T08:21:03.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.847+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~982F4AYKTH18.0 size=1048576 2024-09-22T08:21:03.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.848+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~982F4AYKTH18.1 size=1048576 2024-09-22T08:21:03.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.849+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~982F4AYKTH18.2 size=756397 2024-09-22T08:21:03.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.852+0000 7fe6c9c31780 1 < completed multipart upload key=VP1MP4IC9A7T upload=982F4AYKTH18 tag=VML3Z5KFQOY5 type=write size=3902125 2024-09-22T08:21:03.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.853+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=NRYSOYQFXFII type=write size=510670 2024-09-22T08:21:03.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.854+0000 7fe6c9c31780 1 < completed delete operation key=76HZ3LZGVT9J tag=T50N9CH3RYJH type=del 2024-09-22T08:21:03.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.857+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=PQTK0BR07030 type=del size=475065 2024-09-22T08:21:03.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.858+0000 7fe6c9c31780 1 < completed delete operation key=JT5AB8VLMEFD tag=SIQJBBXC27F9 type=del 2024-09-22T08:21:03.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.860+0000 7fe6c9c31780 1 > prepared operation key=O1UBUQXP50CN tag=FQSP3M3LMUMN type=del size=302352 2024-09-22T08:21:03.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.863+0000 7fe6c9c31780 1 < suggested update operation key=GEWQUFB9K35E tag=EIQ8NDS0Y97J type=write size=772979 2024-09-22T08:21:03.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.866+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~SPXZ22ICHXGG.0 size=553067 2024-09-22T08:21:03.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.866+0000 7fe6c9c31780 1 > prepared multipart upload key=9FCSIF1WKBDJ upload=SPXZ22ICHXGG tag=V2G378JF10G8 type=write size=1601643 2024-09-22T08:21:03.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.867+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~XUATRPF6P3EV.0 size=1048576 2024-09-22T08:21:03.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.868+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~XUATRPF6P3EV.1 size=1048576 2024-09-22T08:21:03.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.870+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~XUATRPF6P3EV.2 size=577268 2024-09-22T08:21:03.873 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.873+0000 7fe6c9c31780 1 < completed multipart upload key=KZIY400KQ5NH upload=XUATRPF6P3EV tag=HX5W1MX026B3 type=write size=3722996 2024-09-22T08:21:03.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.875+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~O2YFHMYKWF1T.0 size=583683 2024-09-22T08:21:03.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.875+0000 7fe6c9c31780 1 > prepared multipart upload key=7446WN19QFV0 upload=O2YFHMYKWF1T tag=CU843JX7D82Z type=write size=1632259 2024-09-22T08:21:03.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.877+0000 7fe6c9c31780 1 < completed delete operation key=TE10GB1F35X4 tag=ZDKV860ZFRMJ type=del 2024-09-22T08:21:03.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.880+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~F5TJ08DSX549.0 size=1048576 2024-09-22T08:21:03.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.881+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~F5TJ08DSX549.1 size=508540 2024-09-22T08:21:03.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.881+0000 7fe6c9c31780 1 > prepared multipart upload key=TE10GB1F35X4 upload=F5TJ08DSX549 tag=ZV8JTCGOD0K7 type=write size=2605692 2024-09-22T08:21:03.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.882+0000 7fe6c9c31780 1 < completed delete operation key=9FCSIF1WKBDJ tag=ZZXX73PMZIAN type=del 2024-09-22T08:21:03.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.885+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~QGQBL3ZZ8DKP.0 size=1048576 2024-09-22T08:21:03.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.887+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~QGQBL3ZZ8DKP.1 size=1048576 2024-09-22T08:21:03.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.887+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~QGQBL3ZZ8DKP.2 size=715913 2024-09-22T08:21:03.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.887+0000 7fe6c9c31780 1 > prepared multipart upload key=946H8F2AUPO2 upload=QGQBL3ZZ8DKP tag=77I1RIG8ARPP type=write size=3861641 2024-09-22T08:21:03.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.889+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~ODPK6EHA9ZPB.0 size=1048576 2024-09-22T08:21:03.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.890+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~ODPK6EHA9ZPB.1 size=539625 2024-09-22T08:21:03.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.893+0000 7fe6c9c31780 1 < completed multipart upload key=0TWY0NNZZ7NN upload=ODPK6EHA9ZPB tag=5Q7MKC2M2PHT type=write size=2636777 2024-09-22T08:21:03.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.896+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~WP9YF71096UN.0 size=1048576 2024-09-22T08:21:03.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.897+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~WP9YF71096UN.1 size=1048576 2024-09-22T08:21:03.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.899+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~WP9YF71096UN.2 size=470323 2024-09-22T08:21:03.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.899+0000 7fe6c9c31780 1 > prepared multipart upload key=2B5QRUMTVE7U upload=WP9YF71096UN tag=A4TX0KJ4UZE7 type=write size=3616051 2024-09-22T08:21:03.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.901+0000 7fe6c9c31780 1 < completed part key=_multipart_ZFL9N44PBQX4.2~JGK6AZ2J52DT.0 size=83121 2024-09-22T08:21:03.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.903+0000 7fe6c9c31780 1 < completed multipart upload key=ZFL9N44PBQX4 upload=JGK6AZ2J52DT tag=R748TVZXG6SN type=write size=1131697 2024-09-22T08:21:03.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.905+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=GQ1EAGYKU7T7 type=del size=2746393 2024-09-22T08:21:03.907 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.907+0000 7fe6c9c31780 1 < completed delete operation key=CTK01Y0CV1NC tag=D4QOHWGVMFQV type=del 2024-09-22T08:21:03.908 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.908+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=39LEHLJCI8P9 type=del size=2018629 2024-09-22T08:21:03.910 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.910+0000 7fe6c9c31780 1 < canceled operation key=CTK01Y0CV1NC tag=KI3V6DVWHBAC type=del size=2833267 2024-09-22T08:21:03.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.911+0000 7fe6c9c31780 1 > prepared operation key=JT5AB8VLMEFD tag=GOEO0XU09YML type=del size=365375 2024-09-22T08:21:03.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.914+0000 7fe6c9c31780 1 < suggested remove operation key=DC7VLQWZ3TD1 tag=PP72YW3OKTOC type=del 2024-09-22T08:21:03.917 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.917+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~UAIHBCAQ0W9R.0 size=1048576 2024-09-22T08:21:03.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.918+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~UAIHBCAQ0W9R.1 size=389579 2024-09-22T08:21:03.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.918+0000 7fe6c9c31780 1 > prepared multipart upload key=7446WN19QFV0 upload=UAIHBCAQ0W9R tag=59XSJ8ABZHN0 type=write size=2486731 2024-09-22T08:21:03.921 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.921+0000 7fe6c9c31780 1 < suggested update operation key=CTK01Y0CV1NC tag=AP4OYMP9B2UR type=del size=3423786 2024-09-22T08:21:03.923 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.922+0000 7fe6c9c31780 1 > prepared operation key=XJP26CCPYDI7 tag=7AUZKB8U35ZV type=write size=712923 2024-09-22T08:21:03.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.926+0000 7fe6c9c31780 1 < suggested update operation key=4KRJ7DTE3KDV tag=TDQWN1A1C7FX type=del size=3878382 2024-09-22T08:21:03.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.927+0000 7fe6c9c31780 1 > prepared operation key=FY40JTHLT0KU tag=1KYQ3BD7ZP3P type=del size=3745544 2024-09-22T08:21:03.930 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.929+0000 7fe6c9c31780 1 < completed delete operation key=76HZ3LZGVT9J tag=U9R5NHG66D82 type=del 2024-09-22T08:21:03.933 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.932+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~DVZVKASCNB6W.0 size=1048576 2024-09-22T08:21:03.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.934+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~DVZVKASCNB6W.1 size=1048576 2024-09-22T08:21:03.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.935+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~DVZVKASCNB6W.2 size=65863 2024-09-22T08:21:03.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.935+0000 7fe6c9c31780 1 > prepared multipart upload key=D85LJGGU3Z6F upload=DVZVKASCNB6W tag=RA9GVRG1TK0V type=write size=3211591 2024-09-22T08:21:03.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.936+0000 7fe6c9c31780 1 < canceled operation key=KZIY400KQ5NH tag=CVR595921HW0 type=del size=484320 2024-09-22T08:21:03.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.938+0000 7fe6c9c31780 1 > prepared operation key=D85LJGGU3Z6F tag=71OJM91KF8CP type=del size=2119858 2024-09-22T08:21:03.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.939+0000 7fe6c9c31780 1 < completed write operation key=9AZWQ9E58QS6 tag=NRYSOYQFXFII type=write size=510670 2024-09-22T08:21:03.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.941+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=3K27OFZODV9F type=del size=3880334 2024-09-22T08:21:03.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.943+0000 7fe6c9c31780 1 < completed delete operation key=T2W6RXP9UGHH tag=PQTK0BR07030 type=del 2024-09-22T08:21:03.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.946+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~9QRMWV0L3JF4.0 size=1048576 2024-09-22T08:21:03.948 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.947+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~9QRMWV0L3JF4.1 size=1048576 2024-09-22T08:21:03.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.948+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~9QRMWV0L3JF4.2 size=183065 2024-09-22T08:21:03.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.948+0000 7fe6c9c31780 1 > prepared multipart upload key=KZIY400KQ5NH upload=9QRMWV0L3JF4 tag=I0372A5IQAA3 type=write size=3328793 2024-09-22T08:21:03.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.950+0000 7fe6c9c31780 1 < completed delete operation key=O1UBUQXP50CN tag=FQSP3M3LMUMN type=del 2024-09-22T08:21:03.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.951+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=AZL4I8CAFEKU type=del size=109423 2024-09-22T08:21:03.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.953+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~SPXZ22ICHXGG.0 size=553067 2024-09-22T08:21:03.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.955+0000 7fe6c9c31780 1 < completed multipart upload key=9FCSIF1WKBDJ upload=SPXZ22ICHXGG tag=V2G378JF10G8 type=write size=1601643 2024-09-22T08:21:03.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.957+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~XQGYRMK04YGW.0 size=1048576 2024-09-22T08:21:03.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.958+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~XQGYRMK04YGW.1 size=1048576 2024-09-22T08:21:03.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.959+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~XQGYRMK04YGW.2 size=731581 2024-09-22T08:21:03.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.959+0000 7fe6c9c31780 1 > prepared multipart upload key=6BKB91YV3FMW upload=XQGYRMK04YGW tag=667SET8E7WTQ type=write size=3877309 2024-09-22T08:21:03.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.961+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~O2YFHMYKWF1T.0 size=583683 2024-09-22T08:21:03.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.963+0000 7fe6c9c31780 1 < completed multipart upload key=7446WN19QFV0 upload=O2YFHMYKWF1T tag=CU843JX7D82Z type=write size=1632259 2024-09-22T08:21:03.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.966+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~RGSDM3G9TI30.0 size=1048576 2024-09-22T08:21:03.968 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.967+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~RGSDM3G9TI30.1 size=451157 2024-09-22T08:21:03.968 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.967+0000 7fe6c9c31780 1 > prepared multipart upload key=2B5QRUMTVE7U upload=RGSDM3G9TI30 tag=ZML3OJ7CB4HZ type=write size=2548309 2024-09-22T08:21:03.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.969+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~F5TJ08DSX549.0 size=1048576 2024-09-22T08:21:03.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.970+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~F5TJ08DSX549.1 size=508540 2024-09-22T08:21:03.973 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.973+0000 7fe6c9c31780 1 < completed multipart upload key=TE10GB1F35X4 upload=F5TJ08DSX549 tag=ZV8JTCGOD0K7 type=write size=2605692 2024-09-22T08:21:03.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.975+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~4YNGJGC39UOK.0 size=705981 2024-09-22T08:21:03.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.975+0000 7fe6c9c31780 1 > prepared multipart upload key=TE10GB1F35X4 upload=4YNGJGC39UOK tag=OJP6CLIH4HJQ type=write size=1754557 2024-09-22T08:21:03.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.978+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~QGQBL3ZZ8DKP.0 size=1048576 2024-09-22T08:21:03.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.978+0000 7fe6c9c31780 1 < canceled part key=_multipart_946H8F2AUPO2.2~QGQBL3ZZ8DKP.1 size=1048576 2024-09-22T08:21:03.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.979+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~QGQBL3ZZ8DKP.2 size=715913 2024-09-22T08:21:03.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.981+0000 7fe6c9c31780 1 < canceled multipart upload key=946H8F2AUPO2 upload=QGQBL3ZZ8DKP tag=77I1RIG8ARPP type=write size=3861641 2024-09-22T08:21:03.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.984+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~67RKNV0WSJFH.0 size=1048576 2024-09-22T08:21:03.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.985+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~67RKNV0WSJFH.1 size=598604 2024-09-22T08:21:03.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.985+0000 7fe6c9c31780 1 > prepared multipart upload key=VP1MP4IC9A7T upload=67RKNV0WSJFH tag=41HLRZ3LGN2F type=write size=2695756 2024-09-22T08:21:03.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.985+0000 7fe6c9c31780 1 < canceled part key=_multipart_2B5QRUMTVE7U.2~WP9YF71096UN.0 size=1048576 2024-09-22T08:21:03.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.987+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~WP9YF71096UN.1 size=1048576 2024-09-22T08:21:03.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.988+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~WP9YF71096UN.2 size=470323 2024-09-22T08:21:03.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.990+0000 7fe6c9c31780 1 < canceled multipart upload key=2B5QRUMTVE7U upload=WP9YF71096UN tag=A4TX0KJ4UZE7 type=write size=3616051 2024-09-22T08:21:03.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.991+0000 7fe6c9c31780 1 > prepared operation key=W9L87PTJEIOA tag=H9790ND5EC6Z type=del size=4148851 2024-09-22T08:21:03.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.993+0000 7fe6c9c31780 1 < completed delete operation key=9AZWQ9E58QS6 tag=GQ1EAGYKU7T7 type=del 2024-09-22T08:21:03.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.995+0000 7fe6c9c31780 1 > prepared operation key=GEWQUFB9K35E tag=16O5TSL3C07E type=del size=1909970 2024-09-22T08:21:03.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.996+0000 7fe6c9c31780 1 < completed delete operation key=R7UWMW913DJQ tag=39LEHLJCI8P9 type=del 2024-09-22T08:21:03.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.998+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=POS7WXUXDM9H type=del size=3319719 2024-09-22T08:21:04.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:03.999+0000 7fe6c9c31780 1 < completed delete operation key=JT5AB8VLMEFD tag=GOEO0XU09YML type=del 2024-09-22T08:21:04.002 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.002+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~SPHQN20LM9TD.0 size=1048576 2024-09-22T08:21:04.003 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.003+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~SPHQN20LM9TD.1 size=1048576 2024-09-22T08:21:04.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.004+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~SPHQN20LM9TD.2 size=1041776 2024-09-22T08:21:04.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.004+0000 7fe6c9c31780 1 > prepared multipart upload key=FY40JTHLT0KU upload=SPHQN20LM9TD tag=J5F58BDBJQ3X type=write size=4187504 2024-09-22T08:21:04.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.005+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~UAIHBCAQ0W9R.0 size=1048576 2024-09-22T08:21:04.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.007+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~UAIHBCAQ0W9R.1 size=389579 2024-09-22T08:21:04.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.009+0000 7fe6c9c31780 1 < completed multipart upload key=7446WN19QFV0 upload=UAIHBCAQ0W9R tag=59XSJ8ABZHN0 type=write size=2486731 2024-09-22T08:21:04.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.011+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=T15GG0FPU5BT type=del size=2515798 2024-09-22T08:21:04.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.012+0000 7fe6c9c31780 1 < completed write operation key=XJP26CCPYDI7 tag=7AUZKB8U35ZV type=write size=712923 2024-09-22T08:21:04.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.014+0000 7fe6c9c31780 1 > prepared operation key=JT5AB8VLMEFD tag=QGZ56E2ZAZ8V type=del size=194532 2024-09-22T08:21:04.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.015+0000 7fe6c9c31780 1 < completed delete operation key=FY40JTHLT0KU tag=1KYQ3BD7ZP3P type=del 2024-09-22T08:21:04.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.017+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=BVLTHWW4L6PA type=del size=338474 2024-09-22T08:21:04.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.018+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~DVZVKASCNB6W.0 size=1048576 2024-09-22T08:21:04.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.019+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~DVZVKASCNB6W.1 size=1048576 2024-09-22T08:21:04.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.021+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~DVZVKASCNB6W.2 size=65863 2024-09-22T08:21:04.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.023+0000 7fe6c9c31780 1 < completed multipart upload key=D85LJGGU3Z6F upload=DVZVKASCNB6W tag=RA9GVRG1TK0V type=write size=3211591 2024-09-22T08:21:04.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.025+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=3ZWUWJYTTUEQ type=del size=2735579 2024-09-22T08:21:04.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.026+0000 7fe6c9c31780 1 < completed delete operation key=D85LJGGU3Z6F tag=71OJM91KF8CP type=del 2024-09-22T08:21:04.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.028+0000 7fe6c9c31780 1 > prepared operation key=0PNK2ZW6IJM1 tag=IQCX28IPO7RN type=del size=1236825 2024-09-22T08:21:04.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.029+0000 7fe6c9c31780 1 < completed delete operation key=TE10GB1F35X4 tag=3K27OFZODV9F type=del 2024-09-22T08:21:04.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.031+0000 7fe6c9c31780 1 > prepared operation key=9FCSIF1WKBDJ tag=SUETREQT2IT4 type=del size=1957860 2024-09-22T08:21:04.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.031+0000 7fe6c9c31780 1 < canceled part key=_multipart_KZIY400KQ5NH.2~9QRMWV0L3JF4.0 size=1048576 2024-09-22T08:21:04.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.032+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~9QRMWV0L3JF4.1 size=1048576 2024-09-22T08:21:04.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.033+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~9QRMWV0L3JF4.2 size=183065 2024-09-22T08:21:04.036 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.036+0000 7fe6c9c31780 1 < canceled multipart upload key=KZIY400KQ5NH upload=9QRMWV0L3JF4 tag=I0372A5IQAA3 type=write size=3328793 2024-09-22T08:21:04.038 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.037+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=LNKD3SKAF418 type=write size=743768 2024-09-22T08:21:04.039 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.040+0000 7fe6c9c31780 1 < completed delete operation key=CTK01Y0CV1NC tag=AZL4I8CAFEKU type=del 2024-09-22T08:21:04.041 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.040+0000 7fe6c9c31780 1 > prepared operation key=KZIY400KQ5NH tag=POMWSKEQ7KF6 type=del size=3058958 2024-09-22T08:21:04.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.042+0000 7fe6c9c31780 1 < completed part key=_multipart_6BKB91YV3FMW.2~XQGYRMK04YGW.0 size=1048576 2024-09-22T08:21:04.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.043+0000 7fe6c9c31780 1 < completed part key=_multipart_6BKB91YV3FMW.2~XQGYRMK04YGW.1 size=1048576 2024-09-22T08:21:04.045 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.044+0000 7fe6c9c31780 1 < completed part key=_multipart_6BKB91YV3FMW.2~XQGYRMK04YGW.2 size=731581 2024-09-22T08:21:04.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.047+0000 7fe6c9c31780 1 < completed multipart upload key=6BKB91YV3FMW upload=XQGYRMK04YGW tag=667SET8E7WTQ type=write size=3877309 2024-09-22T08:21:04.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.049+0000 7fe6c9c31780 1 > prepared part key=_multipart_TJTB67QBLZH5.2~SMGILUDAE1UZ.0 size=846072 2024-09-22T08:21:04.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.049+0000 7fe6c9c31780 1 > prepared multipart upload key=TJTB67QBLZH5 upload=SMGILUDAE1UZ tag=KX5TY9VEWAPR type=write size=1894648 2024-09-22T08:21:04.051 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.051+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~RGSDM3G9TI30.0 size=1048576 2024-09-22T08:21:04.053 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.052+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~RGSDM3G9TI30.1 size=451157 2024-09-22T08:21:04.055 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.055+0000 7fe6c9c31780 1 < completed multipart upload key=2B5QRUMTVE7U upload=RGSDM3G9TI30 tag=ZML3OJ7CB4HZ type=write size=2548309 2024-09-22T08:21:04.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.056+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=EG98DFWXL0OC type=del size=750500 2024-09-22T08:21:04.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.058+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~4YNGJGC39UOK.0 size=705981 2024-09-22T08:21:04.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.060+0000 7fe6c9c31780 1 < completed multipart upload key=TE10GB1F35X4 upload=4YNGJGC39UOK tag=OJP6CLIH4HJQ type=write size=1754557 2024-09-22T08:21:04.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.063+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~C0Q9W24IEDTT.0 size=795527 2024-09-22T08:21:04.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.063+0000 7fe6c9c31780 1 > prepared multipart upload key=2B5QRUMTVE7U upload=C0Q9W24IEDTT tag=EJ5661V46E6T type=write size=1844103 2024-09-22T08:21:04.064 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.063+0000 7fe6c9c31780 1 < canceled part key=_multipart_VP1MP4IC9A7T.2~67RKNV0WSJFH.0 size=1048576 2024-09-22T08:21:04.065 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.064+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~67RKNV0WSJFH.1 size=598604 2024-09-22T08:21:04.067 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.067+0000 7fe6c9c31780 1 < canceled multipart upload key=VP1MP4IC9A7T upload=67RKNV0WSJFH tag=41HLRZ3LGN2F type=write size=2695756 2024-09-22T08:21:04.070 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.069+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~RF6W004N6VUF.0 size=26064 2024-09-22T08:21:04.070 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.069+0000 7fe6c9c31780 1 > prepared multipart upload key=JT5AB8VLMEFD upload=RF6W004N6VUF tag=50DTEJ797122 type=write size=1074640 2024-09-22T08:21:04.071 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.071+0000 7fe6c9c31780 1 < completed delete operation key=W9L87PTJEIOA tag=H9790ND5EC6Z type=del 2024-09-22T08:21:04.073 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.072+0000 7fe6c9c31780 1 > prepared operation key=FY40JTHLT0KU tag=BV4FLGRTR46S type=del size=3651217 2024-09-22T08:21:04.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.075+0000 7fe6c9c31780 1 < suggested remove operation key=GEWQUFB9K35E tag=16O5TSL3C07E type=del 2024-09-22T08:21:04.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.077+0000 7fe6c9c31780 1 > prepared operation key=TJTB67QBLZH5 tag=NLEEZPDZU6Q8 type=write size=622923 2024-09-22T08:21:04.081 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.081+0000 7fe6c9c31780 1 < suggested remove operation key=0TWY0NNZZ7NN tag=POS7WXUXDM9H type=del 2024-09-22T08:21:04.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.083+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~Q91CI145ONM0.0 size=657090 2024-09-22T08:21:04.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.083+0000 7fe6c9c31780 1 > prepared multipart upload key=TE10GB1F35X4 upload=Q91CI145ONM0 tag=VB33DA16YFBA type=write size=1705666 2024-09-22T08:21:04.086 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.085+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~SPHQN20LM9TD.0 size=1048576 2024-09-22T08:21:04.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.086+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~SPHQN20LM9TD.1 size=1048576 2024-09-22T08:21:04.088 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.088+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~SPHQN20LM9TD.2 size=1041776 2024-09-22T08:21:04.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.091+0000 7fe6c9c31780 1 < completed multipart upload key=FY40JTHLT0KU upload=SPHQN20LM9TD tag=J5F58BDBJQ3X type=write size=4187504 2024-09-22T08:21:04.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.093+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~L69V4N8FOUT0.0 size=5311 2024-09-22T08:21:04.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.093+0000 7fe6c9c31780 1 > prepared multipart upload key=0PNK2ZW6IJM1 upload=L69V4N8FOUT0 tag=15X8MXU8G09A type=write size=1053887 2024-09-22T08:21:04.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.094+0000 7fe6c9c31780 1 < completed delete operation key=DC7VLQWZ3TD1 tag=T15GG0FPU5BT type=del 2024-09-22T08:21:04.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.096+0000 7fe6c9c31780 1 > prepared operation key=TJTB67QBLZH5 tag=QQSJ1EZWNZYI type=del size=1117263 2024-09-22T08:21:04.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.099+0000 7fe6c9c31780 1 < suggested remove operation key=JT5AB8VLMEFD tag=QGZ56E2ZAZ8V type=del 2024-09-22T08:21:04.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.101+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=WAED6OO72D5V type=del size=3661919 2024-09-22T08:21:04.102 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.101+0000 7fe6c9c31780 1 < canceled operation key=DC7VLQWZ3TD1 tag=BVLTHWW4L6PA type=del size=338474 2024-09-22T08:21:04.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.103+0000 7fe6c9c31780 1 > prepared operation key=JT5AB8VLMEFD tag=2SZCIX79QN0U type=del size=2767029 2024-09-22T08:21:04.106 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.106+0000 7fe6c9c31780 1 < suggested update operation key=7446WN19QFV0 tag=3ZWUWJYTTUEQ type=del size=2735579 2024-09-22T08:21:04.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.107+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=39UN42W1TTIN type=del size=3830120 2024-09-22T08:21:04.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.109+0000 7fe6c9c31780 1 < completed delete operation key=0PNK2ZW6IJM1 tag=IQCX28IPO7RN type=del 2024-09-22T08:21:04.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.110+0000 7fe6c9c31780 1 > prepared operation key=D85LJGGU3Z6F tag=XQEXOBMFTQ93 type=write size=265904 2024-09-22T08:21:04.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.112+0000 7fe6c9c31780 1 < completed delete operation key=9FCSIF1WKBDJ tag=SUETREQT2IT4 type=del 2024-09-22T08:21:04.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.114+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~11BK5FD78X62.0 size=1048576 2024-09-22T08:21:04.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.116+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~11BK5FD78X62.1 size=767467 2024-09-22T08:21:04.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.116+0000 7fe6c9c31780 1 > prepared multipart upload key=XJP26CCPYDI7 upload=11BK5FD78X62 tag=07AKTJ5JQ3PM type=write size=2864619 2024-09-22T08:21:04.118 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.117+0000 7fe6c9c31780 1 < completed write operation key=R7UWMW913DJQ tag=LNKD3SKAF418 type=write size=743768 2024-09-22T08:21:04.120 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.119+0000 7fe6c9c31780 1 > prepared operation key=O1UBUQXP50CN tag=4EQZ5ASRLM9G type=del size=1893592 2024-09-22T08:21:04.121 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.121+0000 7fe6c9c31780 1 < completed delete operation key=KZIY400KQ5NH tag=POMWSKEQ7KF6 type=del 2024-09-22T08:21:04.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.122+0000 7fe6c9c31780 1 > prepared operation key=OX1LY7URY7IV tag=IAYKQ6SOLCFB type=del size=2975455 2024-09-22T08:21:04.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.124+0000 7fe6c9c31780 1 < completed part key=_multipart_TJTB67QBLZH5.2~SMGILUDAE1UZ.0 size=846072 2024-09-22T08:21:04.126 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.126+0000 7fe6c9c31780 1 < completed multipart upload key=TJTB67QBLZH5 upload=SMGILUDAE1UZ tag=KX5TY9VEWAPR type=write size=1894648 2024-09-22T08:21:04.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.127+0000 7fe6c9c31780 1 > prepared operation key=XJP26CCPYDI7 tag=X4BFP87YNMMB type=write size=299115 2024-09-22T08:21:04.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.128+0000 7fe6c9c31780 -1 < no bi entry to suggest for operation key=0TWY0NNZZ7NN tag=EG98DFWXL0OC type=del size=750500: (2) No such file or directory 2024-09-22T08:21:04.131 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.131+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~PHP76S0VPCEF.0 size=981577 2024-09-22T08:21:04.131 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.131+0000 7fe6c9c31780 1 > prepared multipart upload key=2B5QRUMTVE7U upload=PHP76S0VPCEF tag=K9DEFJ97LOZ7 type=write size=2030153 2024-09-22T08:21:04.133 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.132+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~C0Q9W24IEDTT.0 size=795527 2024-09-22T08:21:04.135 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.135+0000 7fe6c9c31780 1 < completed multipart upload key=2B5QRUMTVE7U upload=C0Q9W24IEDTT tag=EJ5661V46E6T type=write size=1844103 2024-09-22T08:21:04.137 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.136+0000 7fe6c9c31780 1 > prepared operation key=TYVQ39KUV2V9 tag=RGG22G74SXCP type=write size=814851 2024-09-22T08:21:04.138 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.138+0000 7fe6c9c31780 1 < completed part key=_multipart_JT5AB8VLMEFD.2~RF6W004N6VUF.0 size=26064 2024-09-22T08:21:04.141 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.141+0000 7fe6c9c31780 1 < completed multipart upload key=JT5AB8VLMEFD upload=RF6W004N6VUF tag=50DTEJ797122 type=write size=1074640 2024-09-22T08:21:04.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.143+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=1JFSD0ZKC6X1 type=del size=2519258 2024-09-22T08:21:04.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.145+0000 7fe6c9c31780 1 < suggested remove operation key=FY40JTHLT0KU tag=BV4FLGRTR46S type=del 2024-09-22T08:21:04.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.147+0000 7fe6c9c31780 1 > prepared operation key=OX1LY7URY7IV tag=HVAQ4ARQY2YQ type=del size=3593202 2024-09-22T08:21:04.151 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.150+0000 7fe6c9c31780 1 < suggested remove operation key=TJTB67QBLZH5 tag=NLEEZPDZU6Q8 type=write 2024-09-22T08:21:04.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.152+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=GYYJ99LW5C77 type=del size=2721340 2024-09-22T08:21:04.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.154+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~Q91CI145ONM0.0 size=657090 2024-09-22T08:21:04.157 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.156+0000 7fe6c9c31780 1 < completed multipart upload key=TE10GB1F35X4 upload=Q91CI145ONM0 tag=VB33DA16YFBA type=write size=1705666 2024-09-22T08:21:04.158 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.157+0000 7fe6c9c31780 1 > prepared operation key=4KRJ7DTE3KDV tag=YOOPBTCMRTIC type=write size=611253 2024-09-22T08:21:04.160 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.159+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~L69V4N8FOUT0.0 size=5311 2024-09-22T08:21:04.162 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.162+0000 7fe6c9c31780 1 < completed multipart upload key=0PNK2ZW6IJM1 upload=L69V4N8FOUT0 tag=15X8MXU8G09A type=write size=1053887 2024-09-22T08:21:04.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.163+0000 7fe6c9c31780 1 > prepared operation key=OX1LY7URY7IV tag=B31WQLC411HQ type=del size=3475499 2024-09-22T08:21:04.165 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.165+0000 7fe6c9c31780 -1 < failed to complete operation key=TJTB67QBLZH5 tag=QQSJ1EZWNZYI type=del size=1117263: (22) Invalid argument 2024-09-22T08:21:04.168 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.168+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~ZJH60GS6P12X.0 size=715874 2024-09-22T08:21:04.168 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.168+0000 7fe6c9c31780 1 > prepared multipart upload key=6BKB91YV3FMW upload=ZJH60GS6P12X tag=PIJEE3OOTDCS type=write size=1764450 2024-09-22T08:21:04.170 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.169+0000 7fe6c9c31780 1 < completed delete operation key=76HZ3LZGVT9J tag=WAED6OO72D5V type=del 2024-09-22T08:21:04.172 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.171+0000 7fe6c9c31780 1 > prepared operation key=W9L87PTJEIOA tag=43T9S2UHXCRX type=write size=447810 2024-09-22T08:21:04.173 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.172+0000 7fe6c9c31780 1 < completed delete operation key=JT5AB8VLMEFD tag=2SZCIX79QN0U type=del 2024-09-22T08:21:04.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.175+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~R7UH3F86WMBK.0 size=1048576 2024-09-22T08:21:04.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.176+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~R7UH3F86WMBK.1 size=1048576 2024-09-22T08:21:04.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.177+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~R7UH3F86WMBK.2 size=606531 2024-09-22T08:21:04.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.177+0000 7fe6c9c31780 1 > prepared multipart upload key=DC7VLQWZ3TD1 upload=R7UH3F86WMBK tag=CJF521OE9K55 type=write size=3752259 2024-09-22T08:21:04.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.178+0000 7fe6c9c31780 1 < completed delete operation key=DC7VLQWZ3TD1 tag=39UN42W1TTIN type=del 2024-09-22T08:21:04.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.180+0000 7fe6c9c31780 1 > prepared operation key=1HZ0NAJPXNW1 tag=NRPNRXK5JE42 type=del size=3262438 2024-09-22T08:21:04.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.182+0000 7fe6c9c31780 1 < completed write operation key=D85LJGGU3Z6F tag=XQEXOBMFTQ93 type=write size=265904 2024-09-22T08:21:04.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.183+0000 7fe6c9c31780 1 > prepared operation key=0PNK2ZW6IJM1 tag=SGYP93CLO1WZ type=del size=3865226 2024-09-22T08:21:04.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.184+0000 7fe6c9c31780 1 < canceled part key=_multipart_XJP26CCPYDI7.2~11BK5FD78X62.0 size=1048576 2024-09-22T08:21:04.186 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.185+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~11BK5FD78X62.1 size=767467 2024-09-22T08:21:04.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.188+0000 7fe6c9c31780 1 < canceled multipart upload key=XJP26CCPYDI7 upload=11BK5FD78X62 tag=07AKTJ5JQ3PM type=write size=2864619 2024-09-22T08:21:04.190 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.189+0000 7fe6c9c31780 1 > prepared operation key=TJTB67QBLZH5 tag=ABZ6RC22EV0Z type=write size=841882 2024-09-22T08:21:04.191 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.191+0000 7fe6c9c31780 1 < completed delete operation key=O1UBUQXP50CN tag=4EQZ5ASRLM9G type=del 2024-09-22T08:21:04.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.193+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=ZYHXIEP5NAKU type=del size=2271277 2024-09-22T08:21:04.195 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.195+0000 7fe6c9c31780 1 < completed delete operation key=OX1LY7URY7IV tag=IAYKQ6SOLCFB type=del 2024-09-22T08:21:04.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.197+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~A2WT7XU0NTFX.0 size=342563 2024-09-22T08:21:04.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.197+0000 7fe6c9c31780 1 > prepared multipart upload key=7446WN19QFV0 upload=A2WT7XU0NTFX tag=BPKSM2JMR136 type=write size=1391139 2024-09-22T08:21:04.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.199+0000 7fe6c9c31780 1 < completed write operation key=XJP26CCPYDI7 tag=X4BFP87YNMMB type=write size=299115 2024-09-22T08:21:04.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.200+0000 7fe6c9c31780 1 > prepared operation key=W9L87PTJEIOA tag=R3KN75VO43IH type=del size=285262 2024-09-22T08:21:04.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.202+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~PHP76S0VPCEF.0 size=981577 2024-09-22T08:21:04.205 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.204+0000 7fe6c9c31780 1 < completed multipart upload key=2B5QRUMTVE7U upload=PHP76S0VPCEF tag=K9DEFJ97LOZ7 type=write size=2030153 2024-09-22T08:21:04.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.205+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=OZNEKCHKYVB2 type=del size=2956316 2024-09-22T08:21:04.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.209+0000 7fe6c9c31780 1 < suggested update operation key=TYVQ39KUV2V9 tag=RGG22G74SXCP type=write size=814851 2024-09-22T08:21:04.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.211+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~T6OMSO6JXDLV.0 size=206165 2024-09-22T08:21:04.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.211+0000 7fe6c9c31780 1 > prepared multipart upload key=0PNK2ZW6IJM1 upload=T6OMSO6JXDLV tag=ZU50W2D1JTWX type=write size=1254741 2024-09-22T08:21:04.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.213+0000 7fe6c9c31780 1 < canceled operation key=DC7VLQWZ3TD1 tag=1JFSD0ZKC6X1 type=del size=2519258 2024-09-22T08:21:04.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.215+0000 7fe6c9c31780 1 > prepared part key=_multipart_W9L87PTJEIOA.2~S69ZJ8CNTV9I.0 size=703744 2024-09-22T08:21:04.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.215+0000 7fe6c9c31780 1 > prepared multipart upload key=W9L87PTJEIOA upload=S69ZJ8CNTV9I tag=RPBS8LZE40J9 type=write size=1752320 2024-09-22T08:21:04.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.217+0000 7fe6c9c31780 1 < canceled operation key=OX1LY7URY7IV tag=HVAQ4ARQY2YQ type=del size=3593202 2024-09-22T08:21:04.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.218+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=KYZL95GMDHQS type=del size=4172764 2024-09-22T08:21:04.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.220+0000 7fe6c9c31780 1 < canceled operation key=TE10GB1F35X4 tag=GYYJ99LW5C77 type=del size=2721340 2024-09-22T08:21:04.222 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.221+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=5OL1NB50ZHS4 type=del size=589534 2024-09-22T08:21:04.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.223+0000 7fe6c9c31780 1 < completed write operation key=4KRJ7DTE3KDV tag=YOOPBTCMRTIC type=write size=611253 2024-09-22T08:21:04.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.225+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=YHSP0SC2UDID type=del size=473047 2024-09-22T08:21:04.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.227+0000 7fe6c9c31780 1 < completed delete operation key=OX1LY7URY7IV tag=B31WQLC411HQ type=del 2024-09-22T08:21:04.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.230+0000 7fe6c9c31780 1 > prepared part key=_multipart_R7UWMW913DJQ.2~CWHO2ATAFXEH.0 size=258998 2024-09-22T08:21:04.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.230+0000 7fe6c9c31780 1 > prepared multipart upload key=R7UWMW913DJQ upload=CWHO2ATAFXEH tag=1FKTCS92L5ZQ type=write size=1307574 2024-09-22T08:21:04.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.231+0000 7fe6c9c31780 1 < completed part key=_multipart_6BKB91YV3FMW.2~ZJH60GS6P12X.0 size=715874 2024-09-22T08:21:04.234 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.234+0000 7fe6c9c31780 1 < completed multipart upload key=6BKB91YV3FMW upload=ZJH60GS6P12X tag=PIJEE3OOTDCS type=write size=1764450 2024-09-22T08:21:04.236 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.235+0000 7fe6c9c31780 1 > prepared operation key=O1UBUQXP50CN tag=IHMLJ2X0MGN5 type=write size=65721 2024-09-22T08:21:04.237 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.236+0000 7fe6c9c31780 1 < completed write operation key=W9L87PTJEIOA tag=43T9S2UHXCRX type=write size=447810 2024-09-22T08:21:04.240 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.239+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~G3YXH645UPPL.0 size=1048576 2024-09-22T08:21:04.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.241+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~G3YXH645UPPL.1 size=482122 2024-09-22T08:21:04.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.241+0000 7fe6c9c31780 1 > prepared multipart upload key=JT5AB8VLMEFD upload=G3YXH645UPPL tag=9E5K6W8GX794 type=write size=2579274 2024-09-22T08:21:04.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.242+0000 7fe6c9c31780 1 < completed part key=_multipart_DC7VLQWZ3TD1.2~R7UH3F86WMBK.0 size=1048576 2024-09-22T08:21:04.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.244+0000 7fe6c9c31780 1 < completed part key=_multipart_DC7VLQWZ3TD1.2~R7UH3F86WMBK.1 size=1048576 2024-09-22T08:21:04.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.244+0000 7fe6c9c31780 1 < canceled part key=_multipart_DC7VLQWZ3TD1.2~R7UH3F86WMBK.2 size=606531 2024-09-22T08:21:04.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.246+0000 7fe6c9c31780 1 < canceled multipart upload key=DC7VLQWZ3TD1 upload=R7UH3F86WMBK tag=CJF521OE9K55 type=write size=3752259 2024-09-22T08:21:04.248 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.247+0000 7fe6c9c31780 1 > prepared operation key=ZFL9N44PBQX4 tag=KYAOTGS02C23 type=del size=1534420 2024-09-22T08:21:04.250 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.249+0000 7fe6c9c31780 1 < completed delete operation key=1HZ0NAJPXNW1 tag=NRPNRXK5JE42 type=del 2024-09-22T08:21:04.251 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.251+0000 7fe6c9c31780 1 > prepared operation key=9FCSIF1WKBDJ tag=H3S7U2239SXZ type=del size=3862279 2024-09-22T08:21:04.253 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.252+0000 7fe6c9c31780 1 < completed delete operation key=0PNK2ZW6IJM1 tag=SGYP93CLO1WZ type=del 2024-09-22T08:21:04.254 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.254+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=39739SDFZ4PI type=del size=3343879 2024-09-22T08:21:04.256 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.256+0000 7fe6c9c31780 1 < canceled operation key=TJTB67QBLZH5 tag=ABZ6RC22EV0Z type=write size=841882 2024-09-22T08:21:04.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.259+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~D1LWV9JNV6U4.0 size=19900 2024-09-22T08:21:04.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.259+0000 7fe6c9c31780 1 > prepared multipart upload key=O1UBUQXP50CN upload=D1LWV9JNV6U4 tag=ZRNKDPXS1L8U type=write size=1068476 2024-09-22T08:21:04.262 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.262+0000 7fe6c9c31780 1 < suggested update operation key=9AZWQ9E58QS6 tag=ZYHXIEP5NAKU type=del size=2271277 2024-09-22T08:21:04.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.263+0000 7fe6c9c31780 1 > prepared operation key=FY40JTHLT0KU tag=UWF1MQJAUFRN type=del size=3215131 2024-09-22T08:21:04.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.265+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~A2WT7XU0NTFX.0 size=342563 2024-09-22T08:21:04.267 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.267+0000 7fe6c9c31780 1 < completed multipart upload key=7446WN19QFV0 upload=A2WT7XU0NTFX tag=BPKSM2JMR136 type=write size=1391139 2024-09-22T08:21:04.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.268+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=2QXCTO0LAQ94 type=write size=534939 2024-09-22T08:21:04.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.270+0000 7fe6c9c31780 1 < completed delete operation key=W9L87PTJEIOA tag=R3KN75VO43IH type=del 2024-09-22T08:21:04.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.271+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=1W0WVT1GSINW type=del size=2158162 2024-09-22T08:21:04.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.273+0000 7fe6c9c31780 1 < canceled operation key=946H8F2AUPO2 tag=OZNEKCHKYVB2 type=del size=2956316 2024-09-22T08:21:04.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.274+0000 7fe6c9c31780 1 > prepared operation key=GEWQUFB9K35E tag=F26TMK0O2CRR type=write size=446034 2024-09-22T08:21:04.276 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.276+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~T6OMSO6JXDLV.0 size=206165 2024-09-22T08:21:04.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.278+0000 7fe6c9c31780 1 < completed multipart upload key=0PNK2ZW6IJM1 upload=T6OMSO6JXDLV tag=ZU50W2D1JTWX type=write size=1254741 2024-09-22T08:21:04.281 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.281+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~0M3Y5HQ31NOF.0 size=1048576 2024-09-22T08:21:04.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.282+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~0M3Y5HQ31NOF.1 size=1048576 2024-09-22T08:21:04.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.283+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~0M3Y5HQ31NOF.2 size=566778 2024-09-22T08:21:04.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.283+0000 7fe6c9c31780 1 > prepared multipart upload key=946H8F2AUPO2 upload=0M3Y5HQ31NOF tag=CKUVD071MO93 type=write size=3712506 2024-09-22T08:21:04.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.284+0000 7fe6c9c31780 1 < completed part key=_multipart_W9L87PTJEIOA.2~S69ZJ8CNTV9I.0 size=703744 2024-09-22T08:21:04.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.286+0000 7fe6c9c31780 1 < completed multipart upload key=W9L87PTJEIOA upload=S69ZJ8CNTV9I tag=RPBS8LZE40J9 type=write size=1752320 2024-09-22T08:21:04.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.288+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=RMH9WSRD0B25 type=del size=3148731 2024-09-22T08:21:04.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.289+0000 7fe6c9c31780 1 < completed delete operation key=6BKB91YV3FMW tag=KYZL95GMDHQS type=del 2024-09-22T08:21:04.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.292+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~Z2LUXEE65BQ5.0 size=1048576 2024-09-22T08:21:04.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.293+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~Z2LUXEE65BQ5.1 size=897061 2024-09-22T08:21:04.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.293+0000 7fe6c9c31780 1 > prepared multipart upload key=2B5QRUMTVE7U upload=Z2LUXEE65BQ5 tag=GJ6WH364HYYF type=write size=2994213 2024-09-22T08:21:04.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.295+0000 7fe6c9c31780 -1 < failed to complete operation key=9AZWQ9E58QS6 tag=5OL1NB50ZHS4 type=del size=589534: (22) Invalid argument 2024-09-22T08:21:04.297 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.297+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=I1WDTA1B4N4M type=del size=569649 2024-09-22T08:21:04.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.300+0000 7fe6c9c31780 1 < suggested update operation key=CTK01Y0CV1NC tag=YHSP0SC2UDID type=del size=473047 2024-09-22T08:21:04.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.302+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=BXH30TTH67DJ type=del size=4144378 2024-09-22T08:21:04.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.304+0000 7fe6c9c31780 1 < completed part key=_multipart_R7UWMW913DJQ.2~CWHO2ATAFXEH.0 size=258998 2024-09-22T08:21:04.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.307+0000 7fe6c9c31780 1 < completed multipart upload key=R7UWMW913DJQ upload=CWHO2ATAFXEH tag=1FKTCS92L5ZQ type=write size=1307574 2024-09-22T08:21:04.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.309+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=0H7395LSGR21 type=write size=972877 2024-09-22T08:21:04.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.311+0000 7fe6c9c31780 1 < completed write operation key=O1UBUQXP50CN tag=IHMLJ2X0MGN5 type=write size=65721 2024-09-22T08:21:04.313 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.312+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=PRFO5POQUAJK type=del size=151031 2024-09-22T08:21:04.313 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.313+0000 7fe6c9c31780 1 < canceled part key=_multipart_JT5AB8VLMEFD.2~G3YXH645UPPL.0 size=1048576 2024-09-22T08:21:04.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.314+0000 7fe6c9c31780 1 < completed part key=_multipart_JT5AB8VLMEFD.2~G3YXH645UPPL.1 size=482122 2024-09-22T08:21:04.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.318+0000 7fe6c9c31780 1 < canceled multipart upload key=JT5AB8VLMEFD upload=G3YXH645UPPL tag=9E5K6W8GX794 type=write size=2579274 2024-09-22T08:21:04.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.321+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~1TF0E0QSG854.0 size=1048576 2024-09-22T08:21:04.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.321+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~1TF0E0QSG854.1 size=1048576 2024-09-22T08:21:04.323 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.323+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~1TF0E0QSG854.2 size=721500 2024-09-22T08:21:04.323 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.323+0000 7fe6c9c31780 1 > prepared multipart upload key=6BKB91YV3FMW upload=1TF0E0QSG854 tag=A3EBMGCRX3OQ type=write size=3867228 2024-09-22T08:21:04.327 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.326+0000 7fe6c9c31780 1 < suggested update operation key=ZFL9N44PBQX4 tag=KYAOTGS02C23 type=del size=1534420 2024-09-22T08:21:04.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.329+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~SXRHJF4P73KP.0 size=1048576 2024-09-22T08:21:04.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.331+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~SXRHJF4P73KP.1 size=308742 2024-09-22T08:21:04.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.331+0000 7fe6c9c31780 1 > prepared multipart upload key=76HZ3LZGVT9J upload=SXRHJF4P73KP tag=TJASAWKIVK0L type=write size=2405894 2024-09-22T08:21:04.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.332+0000 7fe6c9c31780 1 < completed delete operation key=9FCSIF1WKBDJ tag=H3S7U2239SXZ type=del 2024-09-22T08:21:04.336 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.335+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~ZO12EX0ICF42.0 size=1048576 2024-09-22T08:21:04.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.337+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~ZO12EX0ICF42.1 size=536111 2024-09-22T08:21:04.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.337+0000 7fe6c9c31780 1 > prepared multipart upload key=O1UBUQXP50CN upload=ZO12EX0ICF42 tag=AOMHVIHVJKIB type=write size=2633263 2024-09-22T08:21:04.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.341+0000 7fe6c9c31780 1 < suggested update operation key=946H8F2AUPO2 tag=39739SDFZ4PI type=del size=3343879 2024-09-22T08:21:04.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.343+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~H9Q41SVNA0DP.0 size=66819 2024-09-22T08:21:04.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.343+0000 7fe6c9c31780 1 > prepared multipart upload key=DC7VLQWZ3TD1 upload=H9Q41SVNA0DP tag=FT1AHRM6XURC type=write size=1115395 2024-09-22T08:21:04.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.346+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~D1LWV9JNV6U4.0 size=19900 2024-09-22T08:21:04.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.349+0000 7fe6c9c31780 1 < completed multipart upload key=O1UBUQXP50CN upload=D1LWV9JNV6U4 tag=ZRNKDPXS1L8U type=write size=1068476 2024-09-22T08:21:04.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.350+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=15LO806VDV8J type=write size=108383 2024-09-22T08:21:04.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.352+0000 7fe6c9c31780 1 < completed delete operation key=FY40JTHLT0KU tag=UWF1MQJAUFRN type=del 2024-09-22T08:21:04.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.353+0000 7fe6c9c31780 1 > prepared operation key=JT5AB8VLMEFD tag=MHWU682UVYXP type=del size=104333 2024-09-22T08:21:04.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.358+0000 7fe6c9c31780 1 < suggested remove operation key=TE10GB1F35X4 tag=2QXCTO0LAQ94 type=write 2024-09-22T08:21:04.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.359+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=HBKVO8ERINYZ type=write size=588499 2024-09-22T08:21:04.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.361+0000 7fe6c9c31780 1 < completed delete operation key=76HZ3LZGVT9J tag=1W0WVT1GSINW type=del 2024-09-22T08:21:04.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.362+0000 7fe6c9c31780 1 > prepared operation key=TYVQ39KUV2V9 tag=5T1IXAV53QLH type=write size=965973 2024-09-22T08:21:04.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.367+0000 7fe6c9c31780 1 < suggested update operation key=GEWQUFB9K35E tag=F26TMK0O2CRR type=write size=446034 2024-09-22T08:21:04.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.368+0000 7fe6c9c31780 1 > prepared operation key=Z1CK5EDBK4AW tag=G77PS40VBDND type=del size=3200923 2024-09-22T08:21:04.370 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.370+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~0M3Y5HQ31NOF.0 size=1048576 2024-09-22T08:21:04.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.371+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~0M3Y5HQ31NOF.1 size=1048576 2024-09-22T08:21:04.372 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.372+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~0M3Y5HQ31NOF.2 size=566778 2024-09-22T08:21:04.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.374+0000 7fe6c9c31780 1 < completed multipart upload key=946H8F2AUPO2 upload=0M3Y5HQ31NOF tag=CKUVD071MO93 type=write size=3712506 2024-09-22T08:21:04.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.377+0000 7fe6c9c31780 1 > prepared operation key=JT5AB8VLMEFD tag=TJ8FUV6KCF45 type=del size=994735 2024-09-22T08:21:04.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.380+0000 7fe6c9c31780 1 < suggested remove operation key=7446WN19QFV0 tag=RMH9WSRD0B25 type=del 2024-09-22T08:21:04.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.381+0000 7fe6c9c31780 1 > prepared operation key=XJP26CCPYDI7 tag=KJS2YQRSJNG4 type=write size=789195 2024-09-22T08:21:04.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.383+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~Z2LUXEE65BQ5.0 size=1048576 2024-09-22T08:21:04.384 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.384+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~Z2LUXEE65BQ5.1 size=897061 2024-09-22T08:21:04.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.386+0000 7fe6c9c31780 1 < completed multipart upload key=2B5QRUMTVE7U upload=Z2LUXEE65BQ5 tag=GJ6WH364HYYF type=write size=2994213 2024-09-22T08:21:04.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.389+0000 7fe6c9c31780 1 > prepared part key=_multipart_9AZWQ9E58QS6.2~YDCZKRWMCHTT.0 size=1048576 2024-09-22T08:21:04.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.390+0000 7fe6c9c31780 1 > prepared part key=_multipart_9AZWQ9E58QS6.2~YDCZKRWMCHTT.1 size=1048576 2024-09-22T08:21:04.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.391+0000 7fe6c9c31780 1 > prepared part key=_multipart_9AZWQ9E58QS6.2~YDCZKRWMCHTT.2 size=764058 2024-09-22T08:21:04.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.391+0000 7fe6c9c31780 1 > prepared multipart upload key=9AZWQ9E58QS6 upload=YDCZKRWMCHTT tag=WG6FCTM90Y89 type=write size=3909786 2024-09-22T08:21:04.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.392+0000 7fe6c9c31780 1 < completed delete operation key=ILW34WLX48WN tag=I1WDTA1B4N4M type=del 2024-09-22T08:21:04.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.394+0000 7fe6c9c31780 1 > prepared operation key=9FCSIF1WKBDJ tag=CNS0YDWP2N24 type=del size=1929309 2024-09-22T08:21:04.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.395+0000 7fe6c9c31780 -1 < failed to complete operation key=946H8F2AUPO2 tag=BXH30TTH67DJ type=del size=4144378: (22) Invalid argument 2024-09-22T08:21:04.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.397+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=4TLVZ4MG3QAF type=del size=1945628 2024-09-22T08:21:04.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.399+0000 7fe6c9c31780 1 < canceled operation key=ILW34WLX48WN tag=0H7395LSGR21 type=write size=972877 2024-09-22T08:21:04.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.400+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=607EUM92KNEF type=del size=1434380 2024-09-22T08:21:04.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.402+0000 7fe6c9c31780 -1 < failed to complete operation key=946H8F2AUPO2 tag=PRFO5POQUAJK type=del size=151031: (22) Invalid argument 2024-09-22T08:21:04.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.404+0000 7fe6c9c31780 1 > prepared part key=_multipart_1HZ0NAJPXNW1.2~W9SCA9X3IHP9.0 size=1048576 2024-09-22T08:21:04.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.406+0000 7fe6c9c31780 1 > prepared part key=_multipart_1HZ0NAJPXNW1.2~W9SCA9X3IHP9.1 size=941818 2024-09-22T08:21:04.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.406+0000 7fe6c9c31780 1 > prepared multipart upload key=1HZ0NAJPXNW1 upload=W9SCA9X3IHP9 tag=AA2ESR003ZT0 type=write size=3038970 2024-09-22T08:21:04.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.407+0000 7fe6c9c31780 1 < completed part key=_multipart_6BKB91YV3FMW.2~1TF0E0QSG854.0 size=1048576 2024-09-22T08:21:04.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.409+0000 7fe6c9c31780 1 < completed part key=_multipart_6BKB91YV3FMW.2~1TF0E0QSG854.1 size=1048576 2024-09-22T08:21:04.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.410+0000 7fe6c9c31780 1 < completed part key=_multipart_6BKB91YV3FMW.2~1TF0E0QSG854.2 size=721500 2024-09-22T08:21:04.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.412+0000 7fe6c9c31780 1 < completed multipart upload key=6BKB91YV3FMW upload=1TF0E0QSG854 tag=A3EBMGCRX3OQ type=write size=3867228 2024-09-22T08:21:04.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.414+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=BMW1QH4TDZ90 type=del size=723899 2024-09-22T08:21:04.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.414+0000 7fe6c9c31780 1 < canceled part key=_multipart_76HZ3LZGVT9J.2~SXRHJF4P73KP.0 size=1048576 2024-09-22T08:21:04.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.414+0000 7fe6c9c31780 1 < canceled part key=_multipart_76HZ3LZGVT9J.2~SXRHJF4P73KP.1 size=308742 2024-09-22T08:21:04.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.417+0000 7fe6c9c31780 1 < canceled multipart upload key=76HZ3LZGVT9J upload=SXRHJF4P73KP tag=TJASAWKIVK0L type=write size=2405894 2024-09-22T08:21:04.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.418+0000 7fe6c9c31780 1 > prepared operation key=VP1MP4IC9A7T tag=MO6P30TWGEEB type=del size=3179118 2024-09-22T08:21:04.420 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.419+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~ZO12EX0ICF42.0 size=1048576 2024-09-22T08:21:04.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.421+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~ZO12EX0ICF42.1 size=536111 2024-09-22T08:21:04.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.424+0000 7fe6c9c31780 1 < completed multipart upload key=O1UBUQXP50CN upload=ZO12EX0ICF42 tag=AOMHVIHVJKIB type=write size=2633263 2024-09-22T08:21:04.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.426+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~YZS1TW9WFUZM.0 size=1048576 2024-09-22T08:21:04.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.427+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~YZS1TW9WFUZM.1 size=855860 2024-09-22T08:21:04.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.427+0000 7fe6c9c31780 1 > prepared multipart upload key=T2W6RXP9UGHH upload=YZS1TW9WFUZM tag=7MBV7SYARLMM type=write size=2953012 2024-09-22T08:21:04.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.428+0000 7fe6c9c31780 1 < completed part key=_multipart_DC7VLQWZ3TD1.2~H9Q41SVNA0DP.0 size=66819 2024-09-22T08:21:04.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.431+0000 7fe6c9c31780 1 < completed multipart upload key=DC7VLQWZ3TD1 upload=H9Q41SVNA0DP tag=FT1AHRM6XURC type=write size=1115395 2024-09-22T08:21:04.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.433+0000 7fe6c9c31780 1 > prepared operation key=9FCSIF1WKBDJ tag=3S48T2KJRJUT type=del size=3391370 2024-09-22T08:21:04.435 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.434+0000 7fe6c9c31780 1 < canceled operation key=T2W6RXP9UGHH tag=15LO806VDV8J type=write size=108383 2024-09-22T08:21:04.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.437+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~IUWSJY1BLCBE.0 size=1048576 2024-09-22T08:21:04.439 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.438+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~IUWSJY1BLCBE.1 size=1048576 2024-09-22T08:21:04.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.439+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~IUWSJY1BLCBE.2 size=431071 2024-09-22T08:21:04.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.439+0000 7fe6c9c31780 1 > prepared multipart upload key=DC7VLQWZ3TD1 upload=IUWSJY1BLCBE tag=IBZEDO8G4TV3 type=write size=3576799 2024-09-22T08:21:04.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.441+0000 7fe6c9c31780 1 < completed delete operation key=JT5AB8VLMEFD tag=MHWU682UVYXP type=del 2024-09-22T08:21:04.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.443+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~BVQUFVBPMGYX.0 size=1048576 2024-09-22T08:21:04.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.444+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~BVQUFVBPMGYX.1 size=1048576 2024-09-22T08:21:04.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.446+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~BVQUFVBPMGYX.2 size=554823 2024-09-22T08:21:04.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.446+0000 7fe6c9c31780 1 > prepared multipart upload key=Z1CK5EDBK4AW upload=BVQUFVBPMGYX tag=Y6FHBCXWT402 type=write size=3700551 2024-09-22T08:21:04.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.447+0000 7fe6c9c31780 1 < completed write operation key=DC7VLQWZ3TD1 tag=HBKVO8ERINYZ type=write size=588499 2024-09-22T08:21:04.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.449+0000 7fe6c9c31780 1 > prepared operation key=9FCSIF1WKBDJ tag=W541IL5QRGCR type=del size=1464845 2024-09-22T08:21:04.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.450+0000 7fe6c9c31780 1 < completed write operation key=TYVQ39KUV2V9 tag=5T1IXAV53QLH type=write size=965973 2024-09-22T08:21:04.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.452+0000 7fe6c9c31780 1 > prepared operation key=KZIY400KQ5NH tag=V8BQY48L9M0Y type=write size=368521 2024-09-22T08:21:04.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.454+0000 7fe6c9c31780 1 < completed delete operation key=Z1CK5EDBK4AW tag=G77PS40VBDND type=del 2024-09-22T08:21:04.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.456+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~BS07PON3KAXZ.0 size=1048576 2024-09-22T08:21:04.458 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.458+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~BS07PON3KAXZ.1 size=1048576 2024-09-22T08:21:04.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.459+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~BS07PON3KAXZ.2 size=156202 2024-09-22T08:21:04.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.459+0000 7fe6c9c31780 1 > prepared multipart upload key=4KRJ7DTE3KDV upload=BS07PON3KAXZ tag=6NC8N4XGJUSX type=write size=3301930 2024-09-22T08:21:04.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.460+0000 7fe6c9c31780 1 < completed delete operation key=JT5AB8VLMEFD tag=TJ8FUV6KCF45 type=del 2024-09-22T08:21:04.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.463+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~Y4C0YHV2M2PU.0 size=1048576 2024-09-22T08:21:04.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.464+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~Y4C0YHV2M2PU.1 size=380482 2024-09-22T08:21:04.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.464+0000 7fe6c9c31780 1 > prepared multipart upload key=946H8F2AUPO2 upload=Y4C0YHV2M2PU tag=1ZF0K3E1PR2D type=write size=2477634 2024-09-22T08:21:04.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.467+0000 7fe6c9c31780 1 < completed write operation key=XJP26CCPYDI7 tag=KJS2YQRSJNG4 type=write size=789195 2024-09-22T08:21:04.469 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.468+0000 7fe6c9c31780 1 > prepared operation key=TJTB67QBLZH5 tag=J43N62WGNB0H type=del size=1326484 2024-09-22T08:21:04.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.471+0000 7fe6c9c31780 1 < completed part key=_multipart_9AZWQ9E58QS6.2~YDCZKRWMCHTT.0 size=1048576 2024-09-22T08:21:04.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.472+0000 7fe6c9c31780 1 < completed part key=_multipart_9AZWQ9E58QS6.2~YDCZKRWMCHTT.1 size=1048576 2024-09-22T08:21:04.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.473+0000 7fe6c9c31780 1 < completed part key=_multipart_9AZWQ9E58QS6.2~YDCZKRWMCHTT.2 size=764058 2024-09-22T08:21:04.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.475+0000 7fe6c9c31780 1 < completed multipart upload key=9AZWQ9E58QS6 upload=YDCZKRWMCHTT tag=WG6FCTM90Y89 type=write size=3909786 2024-09-22T08:21:04.478 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.477+0000 7fe6c9c31780 1 > prepared part key=_multipart_TJTB67QBLZH5.2~LKBE9ET3AQ3O.0 size=958435 2024-09-22T08:21:04.478 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.477+0000 7fe6c9c31780 1 > prepared multipart upload key=TJTB67QBLZH5 upload=LKBE9ET3AQ3O tag=JNQUZI4TGEJK type=write size=2007011 2024-09-22T08:21:04.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.478+0000 7fe6c9c31780 1 < completed delete operation key=9FCSIF1WKBDJ tag=CNS0YDWP2N24 type=del 2024-09-22T08:21:04.480 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.480+0000 7fe6c9c31780 1 > prepared operation key=XJP26CCPYDI7 tag=3EFKFBAG6AAO type=write size=528933 2024-09-22T08:21:04.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.481+0000 7fe6c9c31780 1 < completed delete operation key=2B5QRUMTVE7U tag=4TLVZ4MG3QAF type=del 2024-09-22T08:21:04.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.483+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~PK9VL0HSSQO5.0 size=1048576 2024-09-22T08:21:04.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.485+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~PK9VL0HSSQO5.1 size=667661 2024-09-22T08:21:04.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.485+0000 7fe6c9c31780 1 > prepared multipart upload key=Z1CK5EDBK4AW upload=PK9VL0HSSQO5 tag=F6I3UMBLPSXT type=write size=2764813 2024-09-22T08:21:04.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.488+0000 7fe6c9c31780 1 < suggested remove operation key=7446WN19QFV0 tag=607EUM92KNEF type=del 2024-09-22T08:21:04.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.489+0000 7fe6c9c31780 1 > prepared operation key=0PNK2ZW6IJM1 tag=AFYJDZ9SZVAI type=del size=2075736 2024-09-22T08:21:04.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.491+0000 7fe6c9c31780 1 < completed part key=_multipart_1HZ0NAJPXNW1.2~W9SCA9X3IHP9.0 size=1048576 2024-09-22T08:21:04.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.492+0000 7fe6c9c31780 1 < completed part key=_multipart_1HZ0NAJPXNW1.2~W9SCA9X3IHP9.1 size=941818 2024-09-22T08:21:04.495 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.494+0000 7fe6c9c31780 1 < completed multipart upload key=1HZ0NAJPXNW1 upload=W9SCA9X3IHP9 tag=AA2ESR003ZT0 type=write size=3038970 2024-09-22T08:21:04.497 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.497+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~QY29HEJT3M2V.0 size=1048576 2024-09-22T08:21:04.498 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.498+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~QY29HEJT3M2V.1 size=100723 2024-09-22T08:21:04.498 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.498+0000 7fe6c9c31780 1 > prepared multipart upload key=FY40JTHLT0KU upload=QY29HEJT3M2V tag=ZXKOKILHSOD1 type=write size=2197875 2024-09-22T08:21:04.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.499+0000 7fe6c9c31780 -1 < failed to complete operation key=7446WN19QFV0 tag=BMW1QH4TDZ90 type=del size=723899: (22) Invalid argument 2024-09-22T08:21:04.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.502+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~MWQZANT5PF7G.0 size=1048576 2024-09-22T08:21:04.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.503+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~MWQZANT5PF7G.1 size=1048576 2024-09-22T08:21:04.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.504+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~MWQZANT5PF7G.2 size=117429 2024-09-22T08:21:04.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.504+0000 7fe6c9c31780 1 > prepared multipart upload key=O1UBUQXP50CN upload=MWQZANT5PF7G tag=S6AQM45QT9HY type=write size=3263157 2024-09-22T08:21:04.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.507+0000 7fe6c9c31780 1 < suggested remove operation key=VP1MP4IC9A7T tag=MO6P30TWGEEB type=del 2024-09-22T08:21:04.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.508+0000 7fe6c9c31780 1 > prepared operation key=TJTB67QBLZH5 tag=XSUIG3YUWB5V type=del size=252046 2024-09-22T08:21:04.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.510+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~YZS1TW9WFUZM.0 size=1048576 2024-09-22T08:21:04.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.511+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~YZS1TW9WFUZM.1 size=855860 2024-09-22T08:21:04.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.514+0000 7fe6c9c31780 1 < completed multipart upload key=T2W6RXP9UGHH upload=YZS1TW9WFUZM tag=7MBV7SYARLMM type=write size=2953012 2024-09-22T08:21:04.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.516+0000 7fe6c9c31780 1 > prepared operation key=TYVQ39KUV2V9 tag=Z3SPGYTARE50 type=del size=2724891 2024-09-22T08:21:04.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.517+0000 7fe6c9c31780 1 < completed delete operation key=9FCSIF1WKBDJ tag=3S48T2KJRJUT type=del 2024-09-22T08:21:04.521 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.521+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~17Y4E7QN2FMN.0 size=1048576 2024-09-22T08:21:04.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.521+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~17Y4E7QN2FMN.1 size=45733 2024-09-22T08:21:04.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.521+0000 7fe6c9c31780 1 > prepared multipart upload key=VP1MP4IC9A7T upload=17Y4E7QN2FMN tag=ROHYYEPY064F type=write size=2142885 2024-09-22T08:21:04.524 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.523+0000 7fe6c9c31780 1 < completed part key=_multipart_DC7VLQWZ3TD1.2~IUWSJY1BLCBE.0 size=1048576 2024-09-22T08:21:04.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.524+0000 7fe6c9c31780 1 < completed part key=_multipart_DC7VLQWZ3TD1.2~IUWSJY1BLCBE.1 size=1048576 2024-09-22T08:21:04.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.525+0000 7fe6c9c31780 1 < completed part key=_multipart_DC7VLQWZ3TD1.2~IUWSJY1BLCBE.2 size=431071 2024-09-22T08:21:04.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.528+0000 7fe6c9c31780 1 < completed multipart upload key=DC7VLQWZ3TD1 upload=IUWSJY1BLCBE tag=IBZEDO8G4TV3 type=write size=3576799 2024-09-22T08:21:04.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.530+0000 7fe6c9c31780 1 > prepared operation key=0PNK2ZW6IJM1 tag=IB8ROJS7E1SA type=del size=1969566 2024-09-22T08:21:04.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.531+0000 7fe6c9c31780 1 < completed part key=_multipart_Z1CK5EDBK4AW.2~BVQUFVBPMGYX.0 size=1048576 2024-09-22T08:21:04.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.533+0000 7fe6c9c31780 1 < completed part key=_multipart_Z1CK5EDBK4AW.2~BVQUFVBPMGYX.1 size=1048576 2024-09-22T08:21:04.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.533+0000 7fe6c9c31780 1 < canceled part key=_multipart_Z1CK5EDBK4AW.2~BVQUFVBPMGYX.2 size=554823 2024-09-22T08:21:04.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.535+0000 7fe6c9c31780 1 < canceled multipart upload key=Z1CK5EDBK4AW upload=BVQUFVBPMGYX tag=Y6FHBCXWT402 type=write size=3700551 2024-09-22T08:21:04.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.536+0000 7fe6c9c31780 1 > prepared operation key=OX1LY7URY7IV tag=JZ5S9P9NOBS9 type=del size=2716126 2024-09-22T08:21:04.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.538+0000 7fe6c9c31780 1 < completed delete operation key=9FCSIF1WKBDJ tag=W541IL5QRGCR type=del 2024-09-22T08:21:04.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.539+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=GU0B5T2RJFB1 type=del size=4095132 2024-09-22T08:21:04.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.540+0000 7fe6c9c31780 1 < completed write operation key=KZIY400KQ5NH tag=V8BQY48L9M0Y type=write size=368521 2024-09-22T08:21:04.544 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.543+0000 7fe6c9c31780 1 > prepared part key=_multipart_R7UWMW913DJQ.2~3WOQG9J1RI63.0 size=251848 2024-09-22T08:21:04.544 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.543+0000 7fe6c9c31780 1 > prepared multipart upload key=R7UWMW913DJQ upload=3WOQG9J1RI63 tag=L0K8CT61RNR5 type=write size=1300424 2024-09-22T08:21:04.545 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.544+0000 7fe6c9c31780 1 < completed part key=_multipart_4KRJ7DTE3KDV.2~BS07PON3KAXZ.0 size=1048576 2024-09-22T08:21:04.546 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.545+0000 7fe6c9c31780 1 < completed part key=_multipart_4KRJ7DTE3KDV.2~BS07PON3KAXZ.1 size=1048576 2024-09-22T08:21:04.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.546+0000 7fe6c9c31780 1 < completed part key=_multipart_4KRJ7DTE3KDV.2~BS07PON3KAXZ.2 size=156202 2024-09-22T08:21:04.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.549+0000 7fe6c9c31780 1 < completed multipart upload key=4KRJ7DTE3KDV upload=BS07PON3KAXZ tag=6NC8N4XGJUSX type=write size=3301930 2024-09-22T08:21:04.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.551+0000 7fe6c9c31780 1 > prepared operation key=Z1CK5EDBK4AW tag=KH6LXEBRRYJE type=del size=1565128 2024-09-22T08:21:04.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.552+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~Y4C0YHV2M2PU.0 size=1048576 2024-09-22T08:21:04.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.552+0000 7fe6c9c31780 1 < canceled part key=_multipart_946H8F2AUPO2.2~Y4C0YHV2M2PU.1 size=380482 2024-09-22T08:21:04.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.554+0000 7fe6c9c31780 1 < canceled multipart upload key=946H8F2AUPO2 upload=Y4C0YHV2M2PU tag=1ZF0K3E1PR2D type=write size=2477634 2024-09-22T08:21:04.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.555+0000 7fe6c9c31780 1 > prepared operation key=1HZ0NAJPXNW1 tag=FNRFNBZIIPZS type=del size=3581757 2024-09-22T08:21:04.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.556+0000 7fe6c9c31780 1 < completed delete operation key=TJTB67QBLZH5 tag=J43N62WGNB0H type=del 2024-09-22T08:21:04.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.558+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=J421W2DIYVA6 type=del size=3025016 2024-09-22T08:21:04.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.559+0000 7fe6c9c31780 1 < completed part key=_multipart_TJTB67QBLZH5.2~LKBE9ET3AQ3O.0 size=958435 2024-09-22T08:21:04.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.562+0000 7fe6c9c31780 1 < completed multipart upload key=TJTB67QBLZH5 upload=LKBE9ET3AQ3O tag=JNQUZI4TGEJK type=write size=2007011 2024-09-22T08:21:04.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.563+0000 7fe6c9c31780 1 > prepared operation key=JT5AB8VLMEFD tag=S2KY8GZOK2V9 type=del size=3705327 2024-09-22T08:21:04.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.564+0000 7fe6c9c31780 1 < completed write operation key=XJP26CCPYDI7 tag=3EFKFBAG6AAO type=write size=528933 2024-09-22T08:21:04.566 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.565+0000 7fe6c9c31780 1 > prepared operation key=JT5AB8VLMEFD tag=I7QOK1LRB6W6 type=del size=1469195 2024-09-22T08:21:04.567 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.567+0000 7fe6c9c31780 1 < completed part key=_multipart_Z1CK5EDBK4AW.2~PK9VL0HSSQO5.0 size=1048576 2024-09-22T08:21:04.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.568+0000 7fe6c9c31780 1 < completed part key=_multipart_Z1CK5EDBK4AW.2~PK9VL0HSSQO5.1 size=667661 2024-09-22T08:21:04.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.571+0000 7fe6c9c31780 1 < completed multipart upload key=Z1CK5EDBK4AW upload=PK9VL0HSSQO5 tag=F6I3UMBLPSXT type=write size=2764813 2024-09-22T08:21:04.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.573+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~WF10Y7IBQ7WD.0 size=1048576 2024-09-22T08:21:04.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.575+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~WF10Y7IBQ7WD.1 size=71332 2024-09-22T08:21:04.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.575+0000 7fe6c9c31780 1 > prepared multipart upload key=9FCSIF1WKBDJ upload=WF10Y7IBQ7WD tag=IE8ODNM1HV0O type=write size=2168484 2024-09-22T08:21:04.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.576+0000 7fe6c9c31780 1 < completed delete operation key=0PNK2ZW6IJM1 tag=AFYJDZ9SZVAI type=del 2024-09-22T08:21:04.578 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.578+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=2HARRF2H7EPO type=del size=3987852 2024-09-22T08:21:04.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.580+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~QY29HEJT3M2V.0 size=1048576 2024-09-22T08:21:04.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.580+0000 7fe6c9c31780 1 < canceled part key=_multipart_FY40JTHLT0KU.2~QY29HEJT3M2V.1 size=100723 2024-09-22T08:21:04.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.582+0000 7fe6c9c31780 1 < canceled multipart upload key=FY40JTHLT0KU upload=QY29HEJT3M2V tag=ZXKOKILHSOD1 type=write size=2197875 2024-09-22T08:21:04.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.586+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~O2MOHGFPY0K3.0 size=765852 2024-09-22T08:21:04.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.586+0000 7fe6c9c31780 1 > prepared multipart upload key=LA6ZRVULGQ0H upload=O2MOHGFPY0K3 tag=UO5QO1SL59PQ type=write size=1814428 2024-09-22T08:21:04.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.587+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~MWQZANT5PF7G.0 size=1048576 2024-09-22T08:21:04.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.588+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~MWQZANT5PF7G.1 size=1048576 2024-09-22T08:21:04.590 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.589+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~MWQZANT5PF7G.2 size=117429 2024-09-22T08:21:04.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.592+0000 7fe6c9c31780 1 < completed multipart upload key=O1UBUQXP50CN upload=MWQZANT5PF7G tag=S6AQM45QT9HY type=write size=3263157 2024-09-22T08:21:04.593 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.593+0000 7fe6c9c31780 1 > prepared operation key=TYVQ39KUV2V9 tag=XONRKBR62PAM type=write size=213579 2024-09-22T08:21:04.596 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.596+0000 7fe6c9c31780 1 < suggested update operation key=TJTB67QBLZH5 tag=XSUIG3YUWB5V type=del size=252046 2024-09-22T08:21:04.599 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.598+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~TWMR66L4ZS8L.0 size=1048576 2024-09-22T08:21:04.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.600+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~TWMR66L4ZS8L.1 size=1048576 2024-09-22T08:21:04.602 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.601+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~TWMR66L4ZS8L.2 size=750827 2024-09-22T08:21:04.602 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.601+0000 7fe6c9c31780 1 > prepared multipart upload key=GEWQUFB9K35E upload=TWMR66L4ZS8L tag=KII0Z9TP47CZ type=write size=3896555 2024-09-22T08:21:04.603 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.603+0000 7fe6c9c31780 1 < completed delete operation key=TYVQ39KUV2V9 tag=Z3SPGYTARE50 type=del 2024-09-22T08:21:04.604 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.604+0000 7fe6c9c31780 1 > prepared operation key=XJP26CCPYDI7 tag=GDZXNJK4B37L type=del size=1417579 2024-09-22T08:21:04.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.605+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~17Y4E7QN2FMN.0 size=1048576 2024-09-22T08:21:04.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.606+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~17Y4E7QN2FMN.1 size=45733 2024-09-22T08:21:04.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.609+0000 7fe6c9c31780 1 < completed multipart upload key=VP1MP4IC9A7T upload=17Y4E7QN2FMN tag=ROHYYEPY064F type=write size=2142885 2024-09-22T08:21:04.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.611+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~B1I37FE6KTY0.0 size=1048576 2024-09-22T08:21:04.613 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.612+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~B1I37FE6KTY0.1 size=1048576 2024-09-22T08:21:04.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.614+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~B1I37FE6KTY0.2 size=706545 2024-09-22T08:21:04.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.614+0000 7fe6c9c31780 1 > prepared multipart upload key=TYVQ39KUV2V9 upload=B1I37FE6KTY0 tag=BG6J8V4PKDM2 type=write size=3852273 2024-09-22T08:21:04.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.617+0000 7fe6c9c31780 1 < suggested remove operation key=0PNK2ZW6IJM1 tag=IB8ROJS7E1SA type=del 2024-09-22T08:21:04.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.620+0000 7fe6c9c31780 1 > prepared part key=_multipart_ZFL9N44PBQX4.2~W7P0K15QLO8Q.0 size=509610 2024-09-22T08:21:04.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.620+0000 7fe6c9c31780 1 > prepared multipart upload key=ZFL9N44PBQX4 upload=W7P0K15QLO8Q tag=WDS6OGAO8MRF type=write size=1558186 2024-09-22T08:21:04.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.622+0000 7fe6c9c31780 1 < completed delete operation key=OX1LY7URY7IV tag=JZ5S9P9NOBS9 type=del 2024-09-22T08:21:04.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.625+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~RN5CFB7556AY.0 size=1048576 2024-09-22T08:21:04.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.627+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~RN5CFB7556AY.1 size=251337 2024-09-22T08:21:04.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.627+0000 7fe6c9c31780 1 > prepared multipart upload key=ILW34WLX48WN upload=RN5CFB7556AY tag=924B7L95JIBQ type=write size=2348489 2024-09-22T08:21:04.630 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.630+0000 7fe6c9c31780 1 < suggested remove operation key=76HZ3LZGVT9J tag=GU0B5T2RJFB1 type=del 2024-09-22T08:21:04.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.633+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~HKS3ZHVEIB3D.0 size=1048576 2024-09-22T08:21:04.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.634+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~HKS3ZHVEIB3D.1 size=1048576 2024-09-22T08:21:04.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.635+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~HKS3ZHVEIB3D.2 size=527138 2024-09-22T08:21:04.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.635+0000 7fe6c9c31780 1 > prepared multipart upload key=0PNK2ZW6IJM1 upload=HKS3ZHVEIB3D tag=A3RI76M1I13T type=write size=3672866 2024-09-22T08:21:04.637 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.636+0000 7fe6c9c31780 1 < completed part key=_multipart_R7UWMW913DJQ.2~3WOQG9J1RI63.0 size=251848 2024-09-22T08:21:04.639 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.638+0000 7fe6c9c31780 1 < completed multipart upload key=R7UWMW913DJQ upload=3WOQG9J1RI63 tag=L0K8CT61RNR5 type=write size=1300424 2024-09-22T08:21:04.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.641+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=95OSZRI2MQAE type=write size=536189 2024-09-22T08:21:04.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.642+0000 7fe6c9c31780 1 < completed delete operation key=Z1CK5EDBK4AW tag=KH6LXEBRRYJE type=del 2024-09-22T08:21:04.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.644+0000 7fe6c9c31780 1 > prepared operation key=GEWQUFB9K35E tag=Y52Z2RFOWO3F type=write size=440008 2024-09-22T08:21:04.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.645+0000 7fe6c9c31780 1 < completed delete operation key=1HZ0NAJPXNW1 tag=FNRFNBZIIPZS type=del 2024-09-22T08:21:04.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.647+0000 7fe6c9c31780 1 > prepared operation key=TJTB67QBLZH5 tag=NMG1VWEC3YIW type=del size=310932 2024-09-22T08:21:04.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.649+0000 7fe6c9c31780 1 < completed delete operation key=TE10GB1F35X4 tag=J421W2DIYVA6 type=del 2024-09-22T08:21:04.651 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.650+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=RK80NODRYMIT type=write size=994901 2024-09-22T08:21:04.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.652+0000 7fe6c9c31780 1 < completed delete operation key=JT5AB8VLMEFD tag=S2KY8GZOK2V9 type=del 2024-09-22T08:21:04.655 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.655+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~JD4FV3KAK056.0 size=804454 2024-09-22T08:21:04.655 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.655+0000 7fe6c9c31780 1 > prepared multipart upload key=JT5AB8VLMEFD upload=JD4FV3KAK056 tag=XB38GJ8QK2KX type=write size=1853030 2024-09-22T08:21:04.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.656+0000 7fe6c9c31780 1 < completed delete operation key=JT5AB8VLMEFD tag=I7QOK1LRB6W6 type=del 2024-09-22T08:21:04.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.659+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~VL8LDA3ECUO5.0 size=4734 2024-09-22T08:21:04.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.659+0000 7fe6c9c31780 1 > prepared multipart upload key=LA6ZRVULGQ0H upload=VL8LDA3ECUO5 tag=WY3KM1SX3GQH type=write size=1053310 2024-09-22T08:21:04.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.660+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~WF10Y7IBQ7WD.0 size=1048576 2024-09-22T08:21:04.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.661+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~WF10Y7IBQ7WD.1 size=71332 2024-09-22T08:21:04.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.664+0000 7fe6c9c31780 1 < completed multipart upload key=9FCSIF1WKBDJ upload=WF10Y7IBQ7WD tag=IE8ODNM1HV0O type=write size=2168484 2024-09-22T08:21:04.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.665+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=F8MS3KWNXJ8B type=del size=218299 2024-09-22T08:21:04.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.667+0000 7fe6c9c31780 1 < canceled operation key=6BKB91YV3FMW tag=2HARRF2H7EPO type=del size=3987852 2024-09-22T08:21:04.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.668+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=YJJ4Y2DO5WV0 type=del size=3320662 2024-09-22T08:21:04.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.669+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~O2MOHGFPY0K3.0 size=765852 2024-09-22T08:21:04.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.672+0000 7fe6c9c31780 1 < completed multipart upload key=LA6ZRVULGQ0H upload=O2MOHGFPY0K3 tag=UO5QO1SL59PQ type=write size=1814428 2024-09-22T08:21:04.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.673+0000 7fe6c9c31780 1 > prepared operation key=OX1LY7URY7IV tag=X2N1TONMFOY6 type=del size=436414 2024-09-22T08:21:04.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.675+0000 7fe6c9c31780 1 < completed write operation key=TYVQ39KUV2V9 tag=XONRKBR62PAM type=write size=213579 2024-09-22T08:21:04.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.676+0000 7fe6c9c31780 1 > prepared operation key=JT5AB8VLMEFD tag=LKDLKYRKTY4W type=write size=254770 2024-09-22T08:21:04.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.677+0000 7fe6c9c31780 1 < completed part key=_multipart_GEWQUFB9K35E.2~TWMR66L4ZS8L.0 size=1048576 2024-09-22T08:21:04.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.679+0000 7fe6c9c31780 1 < completed part key=_multipart_GEWQUFB9K35E.2~TWMR66L4ZS8L.1 size=1048576 2024-09-22T08:21:04.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.679+0000 7fe6c9c31780 1 < canceled part key=_multipart_GEWQUFB9K35E.2~TWMR66L4ZS8L.2 size=750827 2024-09-22T08:21:04.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.681+0000 7fe6c9c31780 1 < canceled multipart upload key=GEWQUFB9K35E upload=TWMR66L4ZS8L tag=KII0Z9TP47CZ type=write size=3896555 2024-09-22T08:21:04.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.682+0000 7fe6c9c31780 1 > prepared operation key=O1UBUQXP50CN tag=1QICP56MV9M4 type=del size=2195708 2024-09-22T08:21:04.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.686+0000 7fe6c9c31780 1 < suggested remove operation key=XJP26CCPYDI7 tag=GDZXNJK4B37L type=del 2024-09-22T08:21:04.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.687+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=6D2DLT9TBVKQ type=del size=46542 2024-09-22T08:21:04.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.688+0000 7fe6c9c31780 1 < completed part key=_multipart_TYVQ39KUV2V9.2~B1I37FE6KTY0.0 size=1048576 2024-09-22T08:21:04.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.690+0000 7fe6c9c31780 1 < completed part key=_multipart_TYVQ39KUV2V9.2~B1I37FE6KTY0.1 size=1048576 2024-09-22T08:21:04.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.691+0000 7fe6c9c31780 1 < completed part key=_multipart_TYVQ39KUV2V9.2~B1I37FE6KTY0.2 size=706545 2024-09-22T08:21:04.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.694+0000 7fe6c9c31780 1 < completed multipart upload key=TYVQ39KUV2V9 upload=B1I37FE6KTY0 tag=BG6J8V4PKDM2 type=write size=3852273 2024-09-22T08:21:04.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.695+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=V180WUPUMZ74 type=write size=936524 2024-09-22T08:21:04.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.696+0000 7fe6c9c31780 1 < completed part key=_multipart_ZFL9N44PBQX4.2~W7P0K15QLO8Q.0 size=509610 2024-09-22T08:21:04.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.699+0000 7fe6c9c31780 1 < completed multipart upload key=ZFL9N44PBQX4 upload=W7P0K15QLO8Q tag=WDS6OGAO8MRF type=write size=1558186 2024-09-22T08:21:04.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.702+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~3XRTLAEETI73.0 size=1048576 2024-09-22T08:21:04.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.703+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~3XRTLAEETI73.1 size=413531 2024-09-22T08:21:04.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.703+0000 7fe6c9c31780 1 > prepared multipart upload key=VP1MP4IC9A7T upload=3XRTLAEETI73 tag=PHBCGRK2VE9L type=write size=2510683 2024-09-22T08:21:04.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.704+0000 7fe6c9c31780 1 < completed part key=_multipart_ILW34WLX48WN.2~RN5CFB7556AY.0 size=1048576 2024-09-22T08:21:04.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.705+0000 7fe6c9c31780 1 < completed part key=_multipart_ILW34WLX48WN.2~RN5CFB7556AY.1 size=251337 2024-09-22T08:21:04.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.708+0000 7fe6c9c31780 1 < completed multipart upload key=ILW34WLX48WN upload=RN5CFB7556AY tag=924B7L95JIBQ type=write size=2348489 2024-09-22T08:21:04.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.709+0000 7fe6c9c31780 1 > prepared operation key=OX1LY7URY7IV tag=J7H903VWP4XI type=write size=223436 2024-09-22T08:21:04.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.711+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~HKS3ZHVEIB3D.0 size=1048576 2024-09-22T08:21:04.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.712+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~HKS3ZHVEIB3D.1 size=1048576 2024-09-22T08:21:04.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.713+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~HKS3ZHVEIB3D.2 size=527138 2024-09-22T08:21:04.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.715+0000 7fe6c9c31780 1 < completed multipart upload key=0PNK2ZW6IJM1 upload=HKS3ZHVEIB3D tag=A3RI76M1I13T type=write size=3672866 2024-09-22T08:21:04.718 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.718+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~A886LHUE0BPR.0 size=1048576 2024-09-22T08:21:04.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.719+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~A886LHUE0BPR.1 size=1048576 2024-09-22T08:21:04.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.720+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~A886LHUE0BPR.2 size=755966 2024-09-22T08:21:04.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.720+0000 7fe6c9c31780 1 > prepared multipart upload key=946H8F2AUPO2 upload=A886LHUE0BPR tag=0J7QC9VO9ZGI type=write size=3901694 2024-09-22T08:21:04.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.722+0000 7fe6c9c31780 1 < completed write operation key=0TWY0NNZZ7NN tag=95OSZRI2MQAE type=write size=536189 2024-09-22T08:21:04.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.725+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~XLROGFQAJ24Q.0 size=1048576 2024-09-22T08:21:04.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.726+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~XLROGFQAJ24Q.1 size=1048576 2024-09-22T08:21:04.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.727+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~XLROGFQAJ24Q.2 size=412060 2024-09-22T08:21:04.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.727+0000 7fe6c9c31780 1 > prepared multipart upload key=TE10GB1F35X4 upload=XLROGFQAJ24Q tag=4GJRYZ65ID6G type=write size=3557788 2024-09-22T08:21:04.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.729+0000 7fe6c9c31780 1 < completed write operation key=GEWQUFB9K35E tag=Y52Z2RFOWO3F type=write size=440008 2024-09-22T08:21:04.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.730+0000 7fe6c9c31780 1 > prepared operation key=9FCSIF1WKBDJ tag=SZ316H7AIQ6O type=del size=34122 2024-09-22T08:21:04.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.732+0000 7fe6c9c31780 1 < completed delete operation key=TJTB67QBLZH5 tag=NMG1VWEC3YIW type=del 2024-09-22T08:21:04.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.734+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=056L2W8DXVJL type=del size=2029807 2024-09-22T08:21:04.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.736+0000 7fe6c9c31780 1 < completed write operation key=2B5QRUMTVE7U tag=RK80NODRYMIT type=write size=994901 2024-09-22T08:21:04.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.737+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=FPFT5ADI8HMB type=del size=3095253 2024-09-22T08:21:04.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.739+0000 7fe6c9c31780 1 < completed part key=_multipart_JT5AB8VLMEFD.2~JD4FV3KAK056.0 size=804454 2024-09-22T08:21:04.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.741+0000 7fe6c9c31780 1 < completed multipart upload key=JT5AB8VLMEFD upload=JD4FV3KAK056 tag=XB38GJ8QK2KX type=write size=1853030 2024-09-22T08:21:04.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.744+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~DJQRXHFG0ETR.0 size=1048576 2024-09-22T08:21:04.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.745+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~DJQRXHFG0ETR.1 size=1048576 2024-09-22T08:21:04.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.746+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~DJQRXHFG0ETR.2 size=746741 2024-09-22T08:21:04.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.746+0000 7fe6c9c31780 1 > prepared multipart upload key=76HZ3LZGVT9J upload=DJQRXHFG0ETR tag=ESVNW9ZN5DAG type=write size=3892469 2024-09-22T08:21:04.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.746+0000 7fe6c9c31780 1 < canceled part key=_multipart_LA6ZRVULGQ0H.2~VL8LDA3ECUO5.0 size=4734 2024-09-22T08:21:04.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.749+0000 7fe6c9c31780 1 < canceled multipart upload key=LA6ZRVULGQ0H upload=VL8LDA3ECUO5 tag=WY3KM1SX3GQH type=write size=1053310 2024-09-22T08:21:04.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.750+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=OHWSJBMWQ0XT type=del size=212384 2024-09-22T08:21:04.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.752+0000 7fe6c9c31780 1 < completed delete operation key=7446WN19QFV0 tag=F8MS3KWNXJ8B type=del 2024-09-22T08:21:04.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.754+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~OUAORP41ZZ3N.0 size=1048576 2024-09-22T08:21:04.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.755+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~OUAORP41ZZ3N.1 size=1048576 2024-09-22T08:21:04.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.757+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~OUAORP41ZZ3N.2 size=894145 2024-09-22T08:21:04.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.757+0000 7fe6c9c31780 1 > prepared multipart upload key=2B5QRUMTVE7U upload=OUAORP41ZZ3N tag=ROELM2QZ8HLQ type=write size=4039873 2024-09-22T08:21:04.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.758+0000 7fe6c9c31780 1 < completed delete operation key=R7UWMW913DJQ tag=YJJ4Y2DO5WV0 type=del 2024-09-22T08:21:04.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.761+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~TPMVKIUNGL0Y.0 size=525898 2024-09-22T08:21:04.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.761+0000 7fe6c9c31780 1 > prepared multipart upload key=2B5QRUMTVE7U upload=TPMVKIUNGL0Y tag=77D78QI1W82N type=write size=1574474 2024-09-22T08:21:04.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.762+0000 7fe6c9c31780 1 < completed delete operation key=OX1LY7URY7IV tag=X2N1TONMFOY6 type=del 2024-09-22T08:21:04.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.765+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~21OO8PTATFD4.0 size=1048576 2024-09-22T08:21:04.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.766+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~21OO8PTATFD4.1 size=834517 2024-09-22T08:21:04.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.766+0000 7fe6c9c31780 1 > prepared multipart upload key=76HZ3LZGVT9J upload=21OO8PTATFD4 tag=9FTU3PSROOML type=write size=2931669 2024-09-22T08:21:04.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.767+0000 7fe6c9c31780 1 < completed write operation key=JT5AB8VLMEFD tag=LKDLKYRKTY4W type=write size=254770 2024-09-22T08:21:04.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.769+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=2ZPIJ6VF42FI type=del size=573623 2024-09-22T08:21:04.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.770+0000 7fe6c9c31780 1 < canceled operation key=O1UBUQXP50CN tag=1QICP56MV9M4 type=del size=2195708 2024-09-22T08:21:04.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.772+0000 7fe6c9c31780 1 > prepared operation key=ZFL9N44PBQX4 tag=C32YM5IBPX3B type=del size=428013 2024-09-22T08:21:04.774 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.773+0000 7fe6c9c31780 1 < completed delete operation key=2B5QRUMTVE7U tag=6D2DLT9TBVKQ type=del 2024-09-22T08:21:04.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.775+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=0RWDC4ND7HV4 type=del size=3855215 2024-09-22T08:21:04.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.776+0000 7fe6c9c31780 1 < canceled operation key=ILW34WLX48WN tag=V180WUPUMZ74 type=write size=936524 2024-09-22T08:21:04.779 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.778+0000 7fe6c9c31780 1 > prepared operation key=VP1MP4IC9A7T tag=42RE3HCXAX1U type=del size=1586032 2024-09-22T08:21:04.780 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.780+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~3XRTLAEETI73.0 size=1048576 2024-09-22T08:21:04.781 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.781+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~3XRTLAEETI73.1 size=413531 2024-09-22T08:21:04.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.784+0000 7fe6c9c31780 1 < completed multipart upload key=VP1MP4IC9A7T upload=3XRTLAEETI73 tag=PHBCGRK2VE9L type=write size=2510683 2024-09-22T08:21:04.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.785+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=NY39Q6VUHXKS type=write size=283008 2024-09-22T08:21:04.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.788+0000 7fe6c9c31780 1 < completed write operation key=OX1LY7URY7IV tag=J7H903VWP4XI type=write size=223436 2024-09-22T08:21:04.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.792+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~H42YXUZBFGB3.0 size=1048576 2024-09-22T08:21:04.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.793+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~H42YXUZBFGB3.1 size=1048576 2024-09-22T08:21:04.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.793+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~H42YXUZBFGB3.2 size=647528 2024-09-22T08:21:04.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.793+0000 7fe6c9c31780 1 > prepared multipart upload key=TYVQ39KUV2V9 upload=H42YXUZBFGB3 tag=87PBX80AA2LQ type=write size=3793256 2024-09-22T08:21:04.796 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.795+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~A886LHUE0BPR.0 size=1048576 2024-09-22T08:21:04.796 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.796+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~A886LHUE0BPR.1 size=1048576 2024-09-22T08:21:04.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.798+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~A886LHUE0BPR.2 size=755966 2024-09-22T08:21:04.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.799+0000 7fe6c9c31780 1 < completed multipart upload key=946H8F2AUPO2 upload=A886LHUE0BPR tag=0J7QC9VO9ZGI type=write size=3901694 2024-09-22T08:21:04.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.801+0000 7fe6c9c31780 1 > prepared operation key=ZFL9N44PBQX4 tag=S36K2NOI5BK5 type=del size=521807 2024-09-22T08:21:04.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.803+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~XLROGFQAJ24Q.0 size=1048576 2024-09-22T08:21:04.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.804+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~XLROGFQAJ24Q.1 size=1048576 2024-09-22T08:21:04.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.805+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~XLROGFQAJ24Q.2 size=412060 2024-09-22T08:21:04.808 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.807+0000 7fe6c9c31780 1 < completed multipart upload key=TE10GB1F35X4 upload=XLROGFQAJ24Q tag=4GJRYZ65ID6G type=write size=3557788 2024-09-22T08:21:04.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.810+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~X1M2JO8GKW9V.0 size=1048576 2024-09-22T08:21:04.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.811+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~X1M2JO8GKW9V.1 size=954043 2024-09-22T08:21:04.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.811+0000 7fe6c9c31780 1 > prepared multipart upload key=T2W6RXP9UGHH upload=X1M2JO8GKW9V tag=A661HPTABU1P type=write size=3051195 2024-09-22T08:21:04.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.812+0000 7fe6c9c31780 1 < completed delete operation key=9FCSIF1WKBDJ tag=SZ316H7AIQ6O type=del 2024-09-22T08:21:04.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.814+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=IOIFLVZLGFSO type=write size=785445 2024-09-22T08:21:04.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.817+0000 7fe6c9c31780 1 < suggested remove operation key=DC7VLQWZ3TD1 tag=056L2W8DXVJL type=del 2024-09-22T08:21:04.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.818+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=K2GQ23XTJTAC type=del size=1613960 2024-09-22T08:21:04.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.819+0000 7fe6c9c31780 1 < completed delete operation key=9AZWQ9E58QS6 tag=FPFT5ADI8HMB type=del 2024-09-22T08:21:04.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.821+0000 7fe6c9c31780 1 > prepared operation key=9FCSIF1WKBDJ tag=F0BHJ568O06Y type=del size=2543489 2024-09-22T08:21:04.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.822+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~DJQRXHFG0ETR.0 size=1048576 2024-09-22T08:21:04.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.824+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~DJQRXHFG0ETR.1 size=1048576 2024-09-22T08:21:04.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.825+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~DJQRXHFG0ETR.2 size=746741 2024-09-22T08:21:04.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.828+0000 7fe6c9c31780 1 < completed multipart upload key=76HZ3LZGVT9J upload=DJQRXHFG0ETR tag=ESVNW9ZN5DAG type=write size=3892469 2024-09-22T08:21:04.832 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.832+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~SJRQ735MVLU3.0 size=1048576 2024-09-22T08:21:04.833 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.833+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~SJRQ735MVLU3.1 size=1048576 2024-09-22T08:21:04.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.834+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~SJRQ735MVLU3.2 size=923615 2024-09-22T08:21:04.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.834+0000 7fe6c9c31780 1 > prepared multipart upload key=76HZ3LZGVT9J upload=SJRQ735MVLU3 tag=LILHZ0UWNTS1 type=write size=4069343 2024-09-22T08:21:04.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.835+0000 7fe6c9c31780 1 < completed delete operation key=946H8F2AUPO2 tag=OHWSJBMWQ0XT type=del 2024-09-22T08:21:04.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.837+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=NA1XB2W1AX5R type=del size=2707511 2024-09-22T08:21:04.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.837+0000 7fe6c9c31780 1 < canceled part key=_multipart_2B5QRUMTVE7U.2~OUAORP41ZZ3N.0 size=1048576 2024-09-22T08:21:04.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.838+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~OUAORP41ZZ3N.1 size=1048576 2024-09-22T08:21:04.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.839+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~OUAORP41ZZ3N.2 size=894145 2024-09-22T08:21:04.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.842+0000 7fe6c9c31780 1 < canceled multipart upload key=2B5QRUMTVE7U upload=OUAORP41ZZ3N tag=ROELM2QZ8HLQ type=write size=4039873 2024-09-22T08:21:04.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.845+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~P85RFJ8UO4SL.0 size=436167 2024-09-22T08:21:04.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.845+0000 7fe6c9c31780 1 > prepared multipart upload key=VP1MP4IC9A7T upload=P85RFJ8UO4SL tag=LZSLI5LICG5G type=write size=1484743 2024-09-22T08:21:04.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.847+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~TPMVKIUNGL0Y.0 size=525898 2024-09-22T08:21:04.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.849+0000 7fe6c9c31780 1 < completed multipart upload key=2B5QRUMTVE7U upload=TPMVKIUNGL0Y tag=77D78QI1W82N type=write size=1574474 2024-09-22T08:21:04.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.850+0000 7fe6c9c31780 1 > prepared operation key=W9L87PTJEIOA tag=VDMPC00ARIO8 type=write size=648434 2024-09-22T08:21:04.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.852+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~21OO8PTATFD4.0 size=1048576 2024-09-22T08:21:04.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.853+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~21OO8PTATFD4.1 size=834517 2024-09-22T08:21:04.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.855+0000 7fe6c9c31780 1 < completed multipart upload key=76HZ3LZGVT9J upload=21OO8PTATFD4 tag=9FTU3PSROOML type=write size=2931669 2024-09-22T08:21:04.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.857+0000 7fe6c9c31780 1 > prepared operation key=O1UBUQXP50CN tag=HCTVVX61K4ZW type=write size=831002 2024-09-22T08:21:04.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.858+0000 7fe6c9c31780 1 < completed delete operation key=76HZ3LZGVT9J tag=2ZPIJ6VF42FI type=del 2024-09-22T08:21:04.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.860+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=4IFI2ETU580O type=del size=2608179 2024-09-22T08:21:04.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.861+0000 7fe6c9c31780 1 < completed delete operation key=ZFL9N44PBQX4 tag=C32YM5IBPX3B type=del 2024-09-22T08:21:04.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.864+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~SS9SZ2FP7SO2.0 size=1046234 2024-09-22T08:21:04.865 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.864+0000 7fe6c9c31780 1 > prepared multipart upload key=T2W6RXP9UGHH upload=SS9SZ2FP7SO2 tag=S7G63DNX3BGC type=write size=2094810 2024-09-22T08:21:04.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.865+0000 7fe6c9c31780 1 < completed delete operation key=76HZ3LZGVT9J tag=0RWDC4ND7HV4 type=del 2024-09-22T08:21:04.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.867+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=AIQWOUO4TH35 type=write size=203308 2024-09-22T08:21:04.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.868+0000 7fe6c9c31780 1 < canceled operation key=VP1MP4IC9A7T tag=42RE3HCXAX1U type=del size=1586032 2024-09-22T08:21:04.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.871+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~YKQKOW1R9ZJ8.0 size=671975 2024-09-22T08:21:04.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.871+0000 7fe6c9c31780 1 > prepared multipart upload key=0TWY0NNZZ7NN upload=YKQKOW1R9ZJ8 tag=GV108GTIYVMI type=write size=1720551 2024-09-22T08:21:04.873 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.872+0000 7fe6c9c31780 1 < completed write operation key=2B5QRUMTVE7U tag=NY39Q6VUHXKS type=write size=283008 2024-09-22T08:21:04.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.875+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=75PWVL80Y6W2 type=del size=1986798 2024-09-22T08:21:04.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.876+0000 7fe6c9c31780 1 < completed part key=_multipart_TYVQ39KUV2V9.2~H42YXUZBFGB3.0 size=1048576 2024-09-22T08:21:04.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.878+0000 7fe6c9c31780 1 < completed part key=_multipart_TYVQ39KUV2V9.2~H42YXUZBFGB3.1 size=1048576 2024-09-22T08:21:04.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.878+0000 7fe6c9c31780 1 < completed part key=_multipart_TYVQ39KUV2V9.2~H42YXUZBFGB3.2 size=647528 2024-09-22T08:21:04.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.881+0000 7fe6c9c31780 1 < completed multipart upload key=TYVQ39KUV2V9 upload=H42YXUZBFGB3 tag=87PBX80AA2LQ type=write size=3793256 2024-09-22T08:21:04.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.882+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=PNC5DPQE21ZP type=del size=719275 2024-09-22T08:21:04.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.884+0000 7fe6c9c31780 1 < completed delete operation key=ZFL9N44PBQX4 tag=S36K2NOI5BK5 type=del 2024-09-22T08:21:04.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.885+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=4G4Y0DSKALU0 type=del size=2026975 2024-09-22T08:21:04.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.887+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~X1M2JO8GKW9V.0 size=1048576 2024-09-22T08:21:04.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.888+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~X1M2JO8GKW9V.1 size=954043 2024-09-22T08:21:04.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.890+0000 7fe6c9c31780 1 < completed multipart upload key=T2W6RXP9UGHH upload=X1M2JO8GKW9V tag=A661HPTABU1P type=write size=3051195 2024-09-22T08:21:04.892 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.892+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=3UGSCPG4G9UB type=write size=342842 2024-09-22T08:21:04.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.895+0000 7fe6c9c31780 1 < suggested update operation key=TE10GB1F35X4 tag=IOIFLVZLGFSO type=write size=785445 2024-09-22T08:21:04.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.896+0000 7fe6c9c31780 1 > prepared operation key=GEWQUFB9K35E tag=5ZNP96C1ILXD type=del size=1681260 2024-09-22T08:21:04.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.898+0000 7fe6c9c31780 1 < completed delete operation key=0TWY0NNZZ7NN tag=K2GQ23XTJTAC type=del 2024-09-22T08:21:04.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.901+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~JYHVF079EYGO.0 size=1048576 2024-09-22T08:21:04.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.902+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~JYHVF079EYGO.1 size=1048576 2024-09-22T08:21:04.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.903+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~JYHVF079EYGO.2 size=3876 2024-09-22T08:21:04.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.903+0000 7fe6c9c31780 1 > prepared multipart upload key=CTK01Y0CV1NC upload=JYHVF079EYGO tag=5UB5H8NG7GLM type=write size=3149604 2024-09-22T08:21:04.907 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.906+0000 7fe6c9c31780 1 < suggested update operation key=9FCSIF1WKBDJ tag=F0BHJ568O06Y type=del size=2543489 2024-09-22T08:21:04.909 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.909+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~P050GB2L74B9.0 size=102754 2024-09-22T08:21:04.909 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.909+0000 7fe6c9c31780 1 > prepared multipart upload key=Z1CK5EDBK4AW upload=P050GB2L74B9 tag=IDHCO0ER0GAZ type=write size=1151330 2024-09-22T08:21:04.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.910+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~SJRQ735MVLU3.0 size=1048576 2024-09-22T08:21:04.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.911+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~SJRQ735MVLU3.1 size=1048576 2024-09-22T08:21:04.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.913+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~SJRQ735MVLU3.2 size=923615 2024-09-22T08:21:04.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.915+0000 7fe6c9c31780 1 < completed multipart upload key=76HZ3LZGVT9J upload=SJRQ735MVLU3 tag=LILHZ0UWNTS1 type=write size=4069343 2024-09-22T08:21:04.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.918+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~OFCHX5H4EPFL.0 size=370654 2024-09-22T08:21:04.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.918+0000 7fe6c9c31780 1 > prepared multipart upload key=CTK01Y0CV1NC upload=OFCHX5H4EPFL tag=ISC21PQEH1HK type=write size=1419230 2024-09-22T08:21:04.920 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.919+0000 7fe6c9c31780 1 < completed delete operation key=T2W6RXP9UGHH tag=NA1XB2W1AX5R type=del 2024-09-22T08:21:04.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.922+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~X60OUJ7Z14BQ.0 size=1048576 2024-09-22T08:21:04.923 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.923+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~X60OUJ7Z14BQ.1 size=1048576 2024-09-22T08:21:04.925 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.925+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~X60OUJ7Z14BQ.2 size=885623 2024-09-22T08:21:04.925 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.925+0000 7fe6c9c31780 1 > prepared multipart upload key=76HZ3LZGVT9J upload=X60OUJ7Z14BQ tag=Y97ZD6PR2GPN type=write size=4031351 2024-09-22T08:21:04.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.926+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~P85RFJ8UO4SL.0 size=436167 2024-09-22T08:21:04.930 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.930+0000 7fe6c9c31780 1 < completed multipart upload key=VP1MP4IC9A7T upload=P85RFJ8UO4SL tag=LZSLI5LICG5G type=write size=1484743 2024-09-22T08:21:04.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.931+0000 7fe6c9c31780 1 > prepared operation key=O1UBUQXP50CN tag=X0P8HBZ4KQXU type=del size=1478919 2024-09-22T08:21:04.933 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.932+0000 7fe6c9c31780 1 < completed write operation key=W9L87PTJEIOA tag=VDMPC00ARIO8 type=write size=648434 2024-09-22T08:21:04.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.934+0000 7fe6c9c31780 1 > prepared operation key=W9L87PTJEIOA tag=7ABLL5UPNVHA type=write size=507365 2024-09-22T08:21:04.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.935+0000 7fe6c9c31780 1 < canceled operation key=O1UBUQXP50CN tag=HCTVVX61K4ZW type=write size=831002 2024-09-22T08:21:04.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.937+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=6R701BUELS8X type=del size=268831 2024-09-22T08:21:04.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.940+0000 7fe6c9c31780 1 < suggested update operation key=CTK01Y0CV1NC tag=4IFI2ETU580O type=del size=2608179 2024-09-22T08:21:04.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.941+0000 7fe6c9c31780 1 > prepared operation key=TYVQ39KUV2V9 tag=7ELOQ6NL28UB type=write size=90057 2024-09-22T08:21:04.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.943+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~SS9SZ2FP7SO2.0 size=1046234 2024-09-22T08:21:04.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.946+0000 7fe6c9c31780 1 < completed multipart upload key=T2W6RXP9UGHH upload=SS9SZ2FP7SO2 tag=S7G63DNX3BGC type=write size=2094810 2024-09-22T08:21:04.948 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.947+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=GJGZTDT803K4 type=del size=2905728 2024-09-22T08:21:04.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.949+0000 7fe6c9c31780 1 < completed write operation key=7446WN19QFV0 tag=AIQWOUO4TH35 type=write size=203308 2024-09-22T08:21:04.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.951+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~IKLMQAOCXBQA.0 size=1048576 2024-09-22T08:21:04.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.953+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~IKLMQAOCXBQA.1 size=1048576 2024-09-22T08:21:04.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.954+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~IKLMQAOCXBQA.2 size=727422 2024-09-22T08:21:04.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.954+0000 7fe6c9c31780 1 > prepared multipart upload key=O1UBUQXP50CN upload=IKLMQAOCXBQA tag=N7GEFNZASI7S type=write size=3873150 2024-09-22T08:21:04.956 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.955+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~YKQKOW1R9ZJ8.0 size=671975 2024-09-22T08:21:04.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.957+0000 7fe6c9c31780 1 < completed multipart upload key=0TWY0NNZZ7NN upload=YKQKOW1R9ZJ8 tag=GV108GTIYVMI type=write size=1720551 2024-09-22T08:21:04.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.959+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=TO9IKWZDDJRM type=write size=946819 2024-09-22T08:21:04.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.961+0000 7fe6c9c31780 1 < completed delete operation key=2B5QRUMTVE7U tag=75PWVL80Y6W2 type=del 2024-09-22T08:21:04.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.963+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~1J46KF84EZ5L.0 size=1048576 2024-09-22T08:21:04.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.965+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~1J46KF84EZ5L.1 size=874772 2024-09-22T08:21:04.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.965+0000 7fe6c9c31780 1 > prepared multipart upload key=OX1LY7URY7IV upload=1J46KF84EZ5L tag=8Y88Y1R1QLKT type=write size=2971924 2024-09-22T08:21:04.967 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.966+0000 7fe6c9c31780 1 < completed delete operation key=R7UWMW913DJQ tag=PNC5DPQE21ZP type=del 2024-09-22T08:21:04.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.969+0000 7fe6c9c31780 1 > prepared part key=_multipart_W9L87PTJEIOA.2~1L0L8PBW9YO1.0 size=842289 2024-09-22T08:21:04.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.969+0000 7fe6c9c31780 1 > prepared multipart upload key=W9L87PTJEIOA upload=1L0L8PBW9YO1 tag=WE6F2L8AZM8X type=write size=1890865 2024-09-22T08:21:04.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.970+0000 7fe6c9c31780 1 < canceled operation key=76HZ3LZGVT9J tag=4G4Y0DSKALU0 type=del size=2026975 2024-09-22T08:21:04.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.972+0000 7fe6c9c31780 1 > prepared operation key=ZFL9N44PBQX4 tag=LSH5Q51FGLMJ type=del size=2990653 2024-09-22T08:21:04.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.973+0000 7fe6c9c31780 1 < completed write operation key=9AZWQ9E58QS6 tag=3UGSCPG4G9UB type=write size=342842 2024-09-22T08:21:04.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.976+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~MPJAXK6O2BEO.0 size=1048576 2024-09-22T08:21:04.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.977+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~MPJAXK6O2BEO.1 size=1048576 2024-09-22T08:21:04.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.978+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~MPJAXK6O2BEO.2 size=693101 2024-09-22T08:21:04.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.978+0000 7fe6c9c31780 1 > prepared multipart upload key=D85LJGGU3Z6F upload=MPJAXK6O2BEO tag=1I60GIE9FK30 type=write size=3838829 2024-09-22T08:21:04.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.980+0000 7fe6c9c31780 1 < completed delete operation key=GEWQUFB9K35E tag=5ZNP96C1ILXD type=del 2024-09-22T08:21:04.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.982+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~LRVDELALNIYG.0 size=1048576 2024-09-22T08:21:04.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.983+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~LRVDELALNIYG.1 size=92428 2024-09-22T08:21:04.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.983+0000 7fe6c9c31780 1 > prepared multipart upload key=76HZ3LZGVT9J upload=LRVDELALNIYG tag=C10JNKA51ZNC type=write size=2189580 2024-09-22T08:21:04.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.985+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~JYHVF079EYGO.0 size=1048576 2024-09-22T08:21:04.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.986+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~JYHVF079EYGO.1 size=1048576 2024-09-22T08:21:04.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.987+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~JYHVF079EYGO.2 size=3876 2024-09-22T08:21:04.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.989+0000 7fe6c9c31780 1 < completed multipart upload key=CTK01Y0CV1NC upload=JYHVF079EYGO tag=5UB5H8NG7GLM type=write size=3149604 2024-09-22T08:21:04.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.991+0000 7fe6c9c31780 1 > prepared operation key=Z1CK5EDBK4AW tag=0549YLAPO0RY type=del size=1989873 2024-09-22T08:21:04.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.991+0000 7fe6c9c31780 1 < canceled part key=_multipart_Z1CK5EDBK4AW.2~P050GB2L74B9.0 size=102754 2024-09-22T08:21:04.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.993+0000 7fe6c9c31780 1 < canceled multipart upload key=Z1CK5EDBK4AW upload=P050GB2L74B9 tag=IDHCO0ER0GAZ type=write size=1151330 2024-09-22T08:21:04.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.995+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=VMTVY4V0ZDQP type=del size=3321744 2024-09-22T08:21:04.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.996+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~OFCHX5H4EPFL.0 size=370654 2024-09-22T08:21:04.999 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:04.998+0000 7fe6c9c31780 1 < completed multipart upload key=CTK01Y0CV1NC upload=OFCHX5H4EPFL tag=ISC21PQEH1HK type=write size=1419230 2024-09-22T08:21:05.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.000+0000 7fe6c9c31780 1 > prepared operation key=VP1MP4IC9A7T tag=0GTFVBX10NV6 type=del size=3267286 2024-09-22T08:21:05.002 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.001+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~X60OUJ7Z14BQ.0 size=1048576 2024-09-22T08:21:05.002 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.001+0000 7fe6c9c31780 1 < canceled part key=_multipart_76HZ3LZGVT9J.2~X60OUJ7Z14BQ.1 size=1048576 2024-09-22T08:21:05.003 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.003+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~X60OUJ7Z14BQ.2 size=885623 2024-09-22T08:21:05.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.004+0000 7fe6c9c31780 1 < canceled multipart upload key=76HZ3LZGVT9J upload=X60OUJ7Z14BQ tag=Y97ZD6PR2GPN type=write size=4031351 2024-09-22T08:21:05.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.006+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=BAEQS6K0HOIF type=del size=360249 2024-09-22T08:21:05.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.008+0000 7fe6c9c31780 1 < completed delete operation key=O1UBUQXP50CN tag=X0P8HBZ4KQXU type=del 2024-09-22T08:21:05.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.011+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~380KKEMWUGW3.0 size=1048576 2024-09-22T08:21:05.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.012+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~380KKEMWUGW3.1 size=844345 2024-09-22T08:21:05.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.012+0000 7fe6c9c31780 1 > prepared multipart upload key=946H8F2AUPO2 upload=380KKEMWUGW3 tag=COWLP6K051IJ type=write size=2941497 2024-09-22T08:21:05.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.013+0000 7fe6c9c31780 1 < completed write operation key=W9L87PTJEIOA tag=7ABLL5UPNVHA type=write size=507365 2024-09-22T08:21:05.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.014+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=5L3AV4NNQUU0 type=del size=3074569 2024-09-22T08:21:05.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.016+0000 7fe6c9c31780 1 < canceled operation key=TE10GB1F35X4 tag=6R701BUELS8X type=del size=268831 2024-09-22T08:21:05.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.019+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~M7XORHX4834V.0 size=1048576 2024-09-22T08:21:05.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.020+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~M7XORHX4834V.1 size=189575 2024-09-22T08:21:05.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.020+0000 7fe6c9c31780 1 > prepared multipart upload key=FY40JTHLT0KU upload=M7XORHX4834V tag=7JWQ230TW7LT type=write size=2286727 2024-09-22T08:21:05.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.022+0000 7fe6c9c31780 1 < suggested remove operation key=TYVQ39KUV2V9 tag=7ELOQ6NL28UB type=write 2024-09-22T08:21:05.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.024+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=RC30Q1TR26T8 type=write size=43638 2024-09-22T08:21:05.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.025+0000 7fe6c9c31780 1 < completed delete operation key=6BKB91YV3FMW tag=GJGZTDT803K4 type=del 2024-09-22T08:21:05.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.028+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~73KQTIES7VEO.0 size=1048576 2024-09-22T08:21:05.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.029+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~73KQTIES7VEO.1 size=1048576 2024-09-22T08:21:05.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.030+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~73KQTIES7VEO.2 size=99812 2024-09-22T08:21:05.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.030+0000 7fe6c9c31780 1 > prepared multipart upload key=CTK01Y0CV1NC upload=73KQTIES7VEO tag=LJ2NQPCFGYWT type=write size=3245540 2024-09-22T08:21:05.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.031+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~IKLMQAOCXBQA.0 size=1048576 2024-09-22T08:21:05.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.032+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~IKLMQAOCXBQA.1 size=1048576 2024-09-22T08:21:05.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.033+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~IKLMQAOCXBQA.2 size=727422 2024-09-22T08:21:05.036 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.036+0000 7fe6c9c31780 1 < completed multipart upload key=O1UBUQXP50CN upload=IKLMQAOCXBQA tag=N7GEFNZASI7S type=write size=3873150 2024-09-22T08:21:05.039 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.038+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~FCR77FTAVMLT.0 size=1014251 2024-09-22T08:21:05.039 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.038+0000 7fe6c9c31780 1 > prepared multipart upload key=FY40JTHLT0KU upload=FCR77FTAVMLT tag=2IY8EP64KXS1 type=write size=2062827 2024-09-22T08:21:05.040 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.040+0000 7fe6c9c31780 1 < completed write operation key=CTK01Y0CV1NC tag=TO9IKWZDDJRM type=write size=946819 2024-09-22T08:21:05.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.041+0000 7fe6c9c31780 1 > prepared operation key=ZFL9N44PBQX4 tag=X0XS0W8031K4 type=del size=3447046 2024-09-22T08:21:05.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.043+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~1J46KF84EZ5L.0 size=1048576 2024-09-22T08:21:05.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.044+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~1J46KF84EZ5L.1 size=874772 2024-09-22T08:21:05.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.046+0000 7fe6c9c31780 1 < completed multipart upload key=OX1LY7URY7IV upload=1J46KF84EZ5L tag=8Y88Y1R1QLKT type=write size=2971924 2024-09-22T08:21:05.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.049+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~JYLTAARL1CT4.0 size=1048576 2024-09-22T08:21:05.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.050+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~JYLTAARL1CT4.1 size=411592 2024-09-22T08:21:05.051 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.050+0000 7fe6c9c31780 1 > prepared multipart upload key=0TWY0NNZZ7NN upload=JYLTAARL1CT4 tag=2JFMT3SR7FB0 type=write size=2508744 2024-09-22T08:21:05.052 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.051+0000 7fe6c9c31780 1 < completed part key=_multipart_W9L87PTJEIOA.2~1L0L8PBW9YO1.0 size=842289 2024-09-22T08:21:05.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.054+0000 7fe6c9c31780 1 < completed multipart upload key=W9L87PTJEIOA upload=1L0L8PBW9YO1 tag=WE6F2L8AZM8X type=write size=1890865 2024-09-22T08:21:05.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.056+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~2MTXND93VDPC.0 size=996251 2024-09-22T08:21:05.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.056+0000 7fe6c9c31780 1 > prepared multipart upload key=TE10GB1F35X4 upload=2MTXND93VDPC tag=RV24GOXUREXY type=write size=2044827 2024-09-22T08:21:05.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.058+0000 7fe6c9c31780 1 < completed delete operation key=ZFL9N44PBQX4 tag=LSH5Q51FGLMJ type=del 2024-09-22T08:21:05.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.061+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~JHUEONAU7SB1.0 size=421375 2024-09-22T08:21:05.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.061+0000 7fe6c9c31780 1 > prepared multipart upload key=TE10GB1F35X4 upload=JHUEONAU7SB1 tag=FUCYYCT9OPTF type=write size=1469951 2024-09-22T08:21:05.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.062+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~MPJAXK6O2BEO.0 size=1048576 2024-09-22T08:21:05.064 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.063+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~MPJAXK6O2BEO.1 size=1048576 2024-09-22T08:21:05.065 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.065+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~MPJAXK6O2BEO.2 size=693101 2024-09-22T08:21:05.068 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.067+0000 7fe6c9c31780 1 < completed multipart upload key=D85LJGGU3Z6F upload=MPJAXK6O2BEO tag=1I60GIE9FK30 type=write size=3838829 2024-09-22T08:21:05.069 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.068+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=QVMIEBT2XVAH type=del size=2741255 2024-09-22T08:21:05.069 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.069+0000 7fe6c9c31780 1 < canceled part key=_multipart_76HZ3LZGVT9J.2~LRVDELALNIYG.0 size=1048576 2024-09-22T08:21:05.070 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.070+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~LRVDELALNIYG.1 size=92428 2024-09-22T08:21:05.073 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.072+0000 7fe6c9c31780 1 < canceled multipart upload key=76HZ3LZGVT9J upload=LRVDELALNIYG tag=C10JNKA51ZNC type=write size=2189580 2024-09-22T08:21:05.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.075+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~8L26I7AZTA9R.0 size=796356 2024-09-22T08:21:05.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.075+0000 7fe6c9c31780 1 > prepared multipart upload key=6BKB91YV3FMW upload=8L26I7AZTA9R tag=87KUETOG5LTF type=write size=1844932 2024-09-22T08:21:05.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.076+0000 7fe6c9c31780 1 < completed delete operation key=Z1CK5EDBK4AW tag=0549YLAPO0RY type=del 2024-09-22T08:21:05.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.078+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=3B8VLD30BRNI type=write size=840854 2024-09-22T08:21:05.080 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.079+0000 7fe6c9c31780 1 < completed delete operation key=DC7VLQWZ3TD1 tag=VMTVY4V0ZDQP type=del 2024-09-22T08:21:05.081 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.080+0000 7fe6c9c31780 1 > prepared operation key=1HZ0NAJPXNW1 tag=74UGMPR8NCQ6 type=del size=1998281 2024-09-22T08:21:05.083 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.082+0000 7fe6c9c31780 1 < completed delete operation key=VP1MP4IC9A7T tag=0GTFVBX10NV6 type=del 2024-09-22T08:21:05.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.084+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=Y1WE9GNN78RE type=del size=2972069 2024-09-22T08:21:05.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.086+0000 7fe6c9c31780 1 < suggested update operation key=R7UWMW913DJQ tag=BAEQS6K0HOIF type=del size=360249 2024-09-22T08:21:05.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.089+0000 7fe6c9c31780 1 > prepared part key=_multipart_ZFL9N44PBQX4.2~2DLBXGNYYWZJ.0 size=1048576 2024-09-22T08:21:05.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.090+0000 7fe6c9c31780 1 > prepared part key=_multipart_ZFL9N44PBQX4.2~2DLBXGNYYWZJ.1 size=318895 2024-09-22T08:21:05.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.090+0000 7fe6c9c31780 1 > prepared multipart upload key=ZFL9N44PBQX4 upload=2DLBXGNYYWZJ tag=KHZGDPCMBDXV type=write size=2416047 2024-09-22T08:21:05.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.092+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~380KKEMWUGW3.0 size=1048576 2024-09-22T08:21:05.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.093+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~380KKEMWUGW3.1 size=844345 2024-09-22T08:21:05.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.095+0000 7fe6c9c31780 1 < completed multipart upload key=946H8F2AUPO2 upload=380KKEMWUGW3 tag=COWLP6K051IJ type=write size=2941497 2024-09-22T08:21:05.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.098+0000 7fe6c9c31780 1 > prepared part key=_multipart_R7UWMW913DJQ.2~H4K9WZE7DG1E.0 size=1048576 2024-09-22T08:21:05.100 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.099+0000 7fe6c9c31780 1 > prepared part key=_multipart_R7UWMW913DJQ.2~H4K9WZE7DG1E.1 size=1048576 2024-09-22T08:21:05.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.101+0000 7fe6c9c31780 1 > prepared part key=_multipart_R7UWMW913DJQ.2~H4K9WZE7DG1E.2 size=978583 2024-09-22T08:21:05.102 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.101+0000 7fe6c9c31780 1 > prepared multipart upload key=R7UWMW913DJQ upload=H4K9WZE7DG1E tag=05QQFVG6M1PP type=write size=4124311 2024-09-22T08:21:05.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.104+0000 7fe6c9c31780 1 < suggested remove operation key=7446WN19QFV0 tag=5L3AV4NNQUU0 type=del 2024-09-22T08:21:05.106 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.105+0000 7fe6c9c31780 1 > prepared operation key=VP1MP4IC9A7T tag=8P8YRH1DED82 type=del size=3584396 2024-09-22T08:21:05.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.107+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~M7XORHX4834V.0 size=1048576 2024-09-22T08:21:05.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.107+0000 7fe6c9c31780 1 < canceled part key=_multipart_FY40JTHLT0KU.2~M7XORHX4834V.1 size=189575 2024-09-22T08:21:05.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.110+0000 7fe6c9c31780 1 < canceled multipart upload key=FY40JTHLT0KU upload=M7XORHX4834V tag=7JWQ230TW7LT type=write size=2286727 2024-09-22T08:21:05.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.112+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~G1JTA0W58TNR.0 size=260435 2024-09-22T08:21:05.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.112+0000 7fe6c9c31780 1 > prepared multipart upload key=CTK01Y0CV1NC upload=G1JTA0W58TNR tag=ETA5J33D2670 type=write size=1309011 2024-09-22T08:21:05.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.113+0000 7fe6c9c31780 1 < canceled operation key=76HZ3LZGVT9J tag=RC30Q1TR26T8 type=write size=43638 2024-09-22T08:21:05.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.115+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=DVOTC5DOYCYS type=del size=2602619 2024-09-22T08:21:05.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.117+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~73KQTIES7VEO.0 size=1048576 2024-09-22T08:21:05.119 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.118+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~73KQTIES7VEO.1 size=1048576 2024-09-22T08:21:05.120 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.119+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~73KQTIES7VEO.2 size=99812 2024-09-22T08:21:05.122 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.122+0000 7fe6c9c31780 1 < completed multipart upload key=CTK01Y0CV1NC upload=73KQTIES7VEO tag=LJ2NQPCFGYWT type=write size=3245540 2024-09-22T08:21:05.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.123+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=C9CFN3VFYJ35 type=write size=363957 2024-09-22T08:21:05.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.125+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~FCR77FTAVMLT.0 size=1014251 2024-09-22T08:21:05.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.127+0000 7fe6c9c31780 1 < completed multipart upload key=FY40JTHLT0KU upload=FCR77FTAVMLT tag=2IY8EP64KXS1 type=write size=2062827 2024-09-22T08:21:05.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.130+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~3R16AAEPN9TX.0 size=275117 2024-09-22T08:21:05.131 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.130+0000 7fe6c9c31780 1 > prepared multipart upload key=KZIY400KQ5NH upload=3R16AAEPN9TX tag=D4AX4H14U6JP type=write size=1323693 2024-09-22T08:21:05.132 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.131+0000 7fe6c9c31780 1 < completed delete operation key=ZFL9N44PBQX4 tag=X0XS0W8031K4 type=del 2024-09-22T08:21:05.133 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.133+0000 7fe6c9c31780 1 > prepared operation key=XJP26CCPYDI7 tag=LISQ3SDDPFQQ type=write size=729971 2024-09-22T08:21:05.135 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.134+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~JYLTAARL1CT4.0 size=1048576 2024-09-22T08:21:05.136 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.136+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~JYLTAARL1CT4.1 size=411592 2024-09-22T08:21:05.138 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.138+0000 7fe6c9c31780 1 < completed multipart upload key=0TWY0NNZZ7NN upload=JYLTAARL1CT4 tag=2JFMT3SR7FB0 type=write size=2508744 2024-09-22T08:21:05.141 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.141+0000 7fe6c9c31780 1 > prepared part key=_multipart_1HZ0NAJPXNW1.2~34W53Z27CSQ2.0 size=1048576 2024-09-22T08:21:05.142 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.142+0000 7fe6c9c31780 1 > prepared part key=_multipart_1HZ0NAJPXNW1.2~34W53Z27CSQ2.1 size=372144 2024-09-22T08:21:05.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.142+0000 7fe6c9c31780 1 > prepared multipart upload key=1HZ0NAJPXNW1 upload=34W53Z27CSQ2 tag=PDYCFMEKTEU3 type=write size=2469296 2024-09-22T08:21:05.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.143+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~2MTXND93VDPC.0 size=996251 2024-09-22T08:21:05.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.146+0000 7fe6c9c31780 1 < completed multipart upload key=TE10GB1F35X4 upload=2MTXND93VDPC tag=RV24GOXUREXY type=write size=2044827 2024-09-22T08:21:05.149 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.149+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~1RU22FECK2IU.0 size=1048576 2024-09-22T08:21:05.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.150+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~1RU22FECK2IU.1 size=810509 2024-09-22T08:21:05.151 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.150+0000 7fe6c9c31780 1 > prepared multipart upload key=LA6ZRVULGQ0H upload=1RU22FECK2IU tag=PHE7P45VFJ9A type=write size=2907661 2024-09-22T08:21:05.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.152+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~JHUEONAU7SB1.0 size=421375 2024-09-22T08:21:05.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.154+0000 7fe6c9c31780 1 < completed multipart upload key=TE10GB1F35X4 upload=JHUEONAU7SB1 tag=FUCYYCT9OPTF type=write size=1469951 2024-09-22T08:21:05.157 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.156+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~3NV2LVBQ8EOB.0 size=1048576 2024-09-22T08:21:05.158 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.157+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~3NV2LVBQ8EOB.1 size=1048576 2024-09-22T08:21:05.159 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.159+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~3NV2LVBQ8EOB.2 size=533780 2024-09-22T08:21:05.159 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.159+0000 7fe6c9c31780 1 > prepared multipart upload key=0TWY0NNZZ7NN upload=3NV2LVBQ8EOB tag=NGWQ1ES50UO3 type=write size=3679508 2024-09-22T08:21:05.161 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.160+0000 7fe6c9c31780 -1 < failed to complete operation key=7446WN19QFV0 tag=QVMIEBT2XVAH type=del size=2741255: (22) Invalid argument 2024-09-22T08:21:05.162 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.162+0000 7fe6c9c31780 1 > prepared operation key=OX1LY7URY7IV tag=V7PAUC2306WX type=write size=1008447 2024-09-22T08:21:05.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.163+0000 7fe6c9c31780 1 < canceled part key=_multipart_6BKB91YV3FMW.2~8L26I7AZTA9R.0 size=796356 2024-09-22T08:21:05.166 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.165+0000 7fe6c9c31780 1 < canceled multipart upload key=6BKB91YV3FMW upload=8L26I7AZTA9R tag=87KUETOG5LTF type=write size=1844932 2024-09-22T08:21:05.169 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.168+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~Z9IF0YEZF5Z8.0 size=809584 2024-09-22T08:21:05.169 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.168+0000 7fe6c9c31780 1 > prepared multipart upload key=D85LJGGU3Z6F upload=Z9IF0YEZF5Z8 tag=9CBV6F145T69 type=write size=1858160 2024-09-22T08:21:05.169 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.169+0000 7fe6c9c31780 -1 < no bi entry to suggest for operation key=7446WN19QFV0 tag=3B8VLD30BRNI type=write size=840854: (2) No such file or directory 2024-09-22T08:21:05.171 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.171+0000 7fe6c9c31780 1 > prepared operation key=Z1CK5EDBK4AW tag=WRN777F9G6KH type=del size=847755 2024-09-22T08:21:05.173 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.172+0000 7fe6c9c31780 1 < completed delete operation key=1HZ0NAJPXNW1 tag=74UGMPR8NCQ6 type=del 2024-09-22T08:21:05.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.175+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~0I9USL7V5180.0 size=1048576 2024-09-22T08:21:05.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.176+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~0I9USL7V5180.1 size=1048576 2024-09-22T08:21:05.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.178+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~0I9USL7V5180.2 size=13547 2024-09-22T08:21:05.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.178+0000 7fe6c9c31780 1 > prepared multipart upload key=4KRJ7DTE3KDV upload=0I9USL7V5180 tag=FMU6T9L7ZUGK type=write size=3159275 2024-09-22T08:21:05.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.179+0000 7fe6c9c31780 -1 < failed to complete operation key=7446WN19QFV0 tag=Y1WE9GNN78RE type=del size=2972069: (22) Invalid argument 2024-09-22T08:21:05.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.181+0000 7fe6c9c31780 1 > prepared operation key=O1UBUQXP50CN tag=X5M61HQID244 type=del size=2651316 2024-09-22T08:21:05.183 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.183+0000 7fe6c9c31780 1 < completed part key=_multipart_ZFL9N44PBQX4.2~2DLBXGNYYWZJ.0 size=1048576 2024-09-22T08:21:05.185 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.184+0000 7fe6c9c31780 1 < completed part key=_multipart_ZFL9N44PBQX4.2~2DLBXGNYYWZJ.1 size=318895 2024-09-22T08:21:05.187 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.186+0000 7fe6c9c31780 1 < completed multipart upload key=ZFL9N44PBQX4 upload=2DLBXGNYYWZJ tag=KHZGDPCMBDXV type=write size=2416047 2024-09-22T08:21:05.189 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.188+0000 7fe6c9c31780 1 > prepared operation key=D85LJGGU3Z6F tag=SC7UM91O9RVE type=del size=2184202 2024-09-22T08:21:05.190 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.190+0000 7fe6c9c31780 1 < completed part key=_multipart_R7UWMW913DJQ.2~H4K9WZE7DG1E.0 size=1048576 2024-09-22T08:21:05.191 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.191+0000 7fe6c9c31780 1 < completed part key=_multipart_R7UWMW913DJQ.2~H4K9WZE7DG1E.1 size=1048576 2024-09-22T08:21:05.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.192+0000 7fe6c9c31780 1 < completed part key=_multipart_R7UWMW913DJQ.2~H4K9WZE7DG1E.2 size=978583 2024-09-22T08:21:05.195 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.194+0000 7fe6c9c31780 1 < completed multipart upload key=R7UWMW913DJQ upload=H4K9WZE7DG1E tag=05QQFVG6M1PP type=write size=4124311 2024-09-22T08:21:05.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.198+0000 7fe6c9c31780 1 > prepared operation key=0PNK2ZW6IJM1 tag=95LLEOTHOZR4 type=del size=3531037 2024-09-22T08:21:05.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.199+0000 7fe6c9c31780 1 < completed delete operation key=VP1MP4IC9A7T tag=8P8YRH1DED82 type=del 2024-09-22T08:21:05.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.201+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~CZ3WLX9K19UQ.0 size=1048576 2024-09-22T08:21:05.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.203+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~CZ3WLX9K19UQ.1 size=932302 2024-09-22T08:21:05.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.203+0000 7fe6c9c31780 1 > prepared multipart upload key=DC7VLQWZ3TD1 upload=CZ3WLX9K19UQ tag=R2PDB2GFSY44 type=write size=3029454 2024-09-22T08:21:05.205 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.205+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~G1JTA0W58TNR.0 size=260435 2024-09-22T08:21:05.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.207+0000 7fe6c9c31780 1 < completed multipart upload key=CTK01Y0CV1NC upload=G1JTA0W58TNR tag=ETA5J33D2670 type=write size=1309011 2024-09-22T08:21:05.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.209+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=MAWY9JNX5QCX type=del size=4063533 2024-09-22T08:21:05.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.211+0000 7fe6c9c31780 1 < suggested update operation key=2B5QRUMTVE7U tag=DVOTC5DOYCYS type=del size=2602619 2024-09-22T08:21:05.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.213+0000 7fe6c9c31780 1 > prepared operation key=ZFL9N44PBQX4 tag=VWVTZ3WOT45P type=write size=113873 2024-09-22T08:21:05.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.214+0000 7fe6c9c31780 1 < completed write operation key=9AZWQ9E58QS6 tag=C9CFN3VFYJ35 type=write size=363957 2024-09-22T08:21:05.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.215+0000 7fe6c9c31780 1 > prepared operation key=TYVQ39KUV2V9 tag=MP9629DCH3R7 type=del size=2560143 2024-09-22T08:21:05.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.217+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~3R16AAEPN9TX.0 size=275117 2024-09-22T08:21:05.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.219+0000 7fe6c9c31780 1 < completed multipart upload key=KZIY400KQ5NH upload=3R16AAEPN9TX tag=D4AX4H14U6JP type=write size=1323693 2024-09-22T08:21:05.222 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.222+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~U82910UH2S7H.0 size=1048576 2024-09-22T08:21:05.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.223+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~U82910UH2S7H.1 size=643396 2024-09-22T08:21:05.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.223+0000 7fe6c9c31780 1 > prepared multipart upload key=OX1LY7URY7IV upload=U82910UH2S7H tag=1P9FVDL039NR type=write size=2740548 2024-09-22T08:21:05.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.226+0000 7fe6c9c31780 1 < suggested remove operation key=XJP26CCPYDI7 tag=LISQ3SDDPFQQ type=write 2024-09-22T08:21:05.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.228+0000 7fe6c9c31780 1 > prepared operation key=9FCSIF1WKBDJ tag=DV4W79DP8G6U type=del size=989396 2024-09-22T08:21:05.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.228+0000 7fe6c9c31780 1 < completed part key=_multipart_1HZ0NAJPXNW1.2~34W53Z27CSQ2.0 size=1048576 2024-09-22T08:21:05.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.230+0000 7fe6c9c31780 1 < completed part key=_multipart_1HZ0NAJPXNW1.2~34W53Z27CSQ2.1 size=372144 2024-09-22T08:21:05.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.232+0000 7fe6c9c31780 1 < completed multipart upload key=1HZ0NAJPXNW1 upload=34W53Z27CSQ2 tag=PDYCFMEKTEU3 type=write size=2469296 2024-09-22T08:21:05.234 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.234+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=JF3IQ3TXH3UT type=write size=705064 2024-09-22T08:21:05.236 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.236+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~1RU22FECK2IU.0 size=1048576 2024-09-22T08:21:05.237 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.236+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~1RU22FECK2IU.1 size=810509 2024-09-22T08:21:05.239 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.239+0000 7fe6c9c31780 1 < completed multipart upload key=LA6ZRVULGQ0H upload=1RU22FECK2IU tag=PHE7P45VFJ9A type=write size=2907661 2024-09-22T08:21:05.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.240+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=36HYHOJM14RV type=del size=4143675 2024-09-22T08:21:05.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.242+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~3NV2LVBQ8EOB.0 size=1048576 2024-09-22T08:21:05.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.243+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~3NV2LVBQ8EOB.1 size=1048576 2024-09-22T08:21:05.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.244+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~3NV2LVBQ8EOB.2 size=533780 2024-09-22T08:21:05.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.246+0000 7fe6c9c31780 1 < completed multipart upload key=0TWY0NNZZ7NN upload=3NV2LVBQ8EOB tag=NGWQ1ES50UO3 type=write size=3679508 2024-09-22T08:21:05.248 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.247+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=EQALO17FU2JS type=del size=795831 2024-09-22T08:21:05.249 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.249+0000 7fe6c9c31780 1 < completed write operation key=OX1LY7URY7IV tag=V7PAUC2306WX type=write size=1008447 2024-09-22T08:21:05.251 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.251+0000 7fe6c9c31780 1 > prepared operation key=D85LJGGU3Z6F tag=1IILQ9IWRGTP type=del size=869339 2024-09-22T08:21:05.252 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.252+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~Z9IF0YEZF5Z8.0 size=809584 2024-09-22T08:21:05.255 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.254+0000 7fe6c9c31780 1 < completed multipart upload key=D85LJGGU3Z6F upload=Z9IF0YEZF5Z8 tag=9CBV6F145T69 type=write size=1858160 2024-09-22T08:21:05.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.257+0000 7fe6c9c31780 1 > prepared part key=_multipart_TJTB67QBLZH5.2~3TX702ADD01S.0 size=1048576 2024-09-22T08:21:05.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.258+0000 7fe6c9c31780 1 > prepared part key=_multipart_TJTB67QBLZH5.2~3TX702ADD01S.1 size=961493 2024-09-22T08:21:05.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.258+0000 7fe6c9c31780 1 > prepared multipart upload key=TJTB67QBLZH5 upload=3TX702ADD01S tag=998CNZ0DHAHI type=write size=3058645 2024-09-22T08:21:05.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.259+0000 7fe6c9c31780 1 < completed delete operation key=Z1CK5EDBK4AW tag=WRN777F9G6KH type=del 2024-09-22T08:21:05.261 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.260+0000 7fe6c9c31780 1 > prepared operation key=LA6ZRVULGQ0H tag=N90UKXBSJPUP type=write size=757193 2024-09-22T08:21:05.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.263+0000 7fe6c9c31780 1 < completed part key=_multipart_4KRJ7DTE3KDV.2~0I9USL7V5180.0 size=1048576 2024-09-22T08:21:05.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.264+0000 7fe6c9c31780 1 < completed part key=_multipart_4KRJ7DTE3KDV.2~0I9USL7V5180.1 size=1048576 2024-09-22T08:21:05.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.265+0000 7fe6c9c31780 1 < completed part key=_multipart_4KRJ7DTE3KDV.2~0I9USL7V5180.2 size=13547 2024-09-22T08:21:05.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.267+0000 7fe6c9c31780 1 < completed multipart upload key=4KRJ7DTE3KDV upload=0I9USL7V5180 tag=FMU6T9L7ZUGK type=write size=3159275 2024-09-22T08:21:05.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.270+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~3DQYBY4MR7Y7.0 size=1048576 2024-09-22T08:21:05.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.271+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~3DQYBY4MR7Y7.1 size=834217 2024-09-22T08:21:05.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.271+0000 7fe6c9c31780 1 > prepared multipart upload key=TE10GB1F35X4 upload=3DQYBY4MR7Y7 tag=T1039ISX5QHN type=write size=2931369 2024-09-22T08:21:05.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.272+0000 7fe6c9c31780 1 < completed delete operation key=O1UBUQXP50CN tag=X5M61HQID244 type=del 2024-09-22T08:21:05.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.274+0000 7fe6c9c31780 1 > prepared operation key=W9L87PTJEIOA tag=7X1YEDMKKOP2 type=del size=1725588 2024-09-22T08:21:05.276 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.275+0000 7fe6c9c31780 1 < canceled operation key=D85LJGGU3Z6F tag=SC7UM91O9RVE type=del size=2184202 2024-09-22T08:21:05.278 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.278+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~AKES1RJC6BO3.0 size=1048576 2024-09-22T08:21:05.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.279+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~AKES1RJC6BO3.1 size=342832 2024-09-22T08:21:05.280 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.279+0000 7fe6c9c31780 1 > prepared multipart upload key=VP1MP4IC9A7T upload=AKES1RJC6BO3 tag=1WD8INU0FHLA type=write size=2439984 2024-09-22T08:21:05.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.282+0000 7fe6c9c31780 1 < suggested update operation key=0PNK2ZW6IJM1 tag=95LLEOTHOZR4 type=del size=3531037 2024-09-22T08:21:05.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.284+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~A7B8HK1YJLSA.0 size=1048576 2024-09-22T08:21:05.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.285+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~A7B8HK1YJLSA.1 size=1048576 2024-09-22T08:21:05.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.286+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~A7B8HK1YJLSA.2 size=480782 2024-09-22T08:21:05.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.286+0000 7fe6c9c31780 1 > prepared multipart upload key=O1UBUQXP50CN upload=A7B8HK1YJLSA tag=WP6PDP7RA97A type=write size=3626510 2024-09-22T08:21:05.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.288+0000 7fe6c9c31780 1 < completed part key=_multipart_DC7VLQWZ3TD1.2~CZ3WLX9K19UQ.0 size=1048576 2024-09-22T08:21:05.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.289+0000 7fe6c9c31780 1 < completed part key=_multipart_DC7VLQWZ3TD1.2~CZ3WLX9K19UQ.1 size=932302 2024-09-22T08:21:05.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.291+0000 7fe6c9c31780 1 < completed multipart upload key=DC7VLQWZ3TD1 upload=CZ3WLX9K19UQ tag=R2PDB2GFSY44 type=write size=3029454 2024-09-22T08:21:05.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.293+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=26IZY65GGFPN type=del size=167325 2024-09-22T08:21:05.296 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.296+0000 7fe6c9c31780 1 < suggested update operation key=946H8F2AUPO2 tag=MAWY9JNX5QCX type=del size=4063533 2024-09-22T08:21:05.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.297+0000 7fe6c9c31780 1 > prepared operation key=XJP26CCPYDI7 tag=7EMS4YRI63HM type=write size=834211 2024-09-22T08:21:05.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.300+0000 7fe6c9c31780 1 < suggested remove operation key=ZFL9N44PBQX4 tag=VWVTZ3WOT45P type=write 2024-09-22T08:21:05.302 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.301+0000 7fe6c9c31780 1 > prepared operation key=9FCSIF1WKBDJ tag=SBDNK352VXQF type=del size=577276 2024-09-22T08:21:05.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.302+0000 7fe6c9c31780 1 < completed delete operation key=TYVQ39KUV2V9 tag=MP9629DCH3R7 type=del 2024-09-22T08:21:05.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.304+0000 7fe6c9c31780 1 > prepared operation key=W9L87PTJEIOA tag=34UJ0HB29LLR type=write size=135320 2024-09-22T08:21:05.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.305+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~U82910UH2S7H.0 size=1048576 2024-09-22T08:21:05.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.306+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~U82910UH2S7H.1 size=643396 2024-09-22T08:21:05.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.309+0000 7fe6c9c31780 1 < completed multipart upload key=OX1LY7URY7IV upload=U82910UH2S7H tag=1P9FVDL039NR type=write size=2740548 2024-09-22T08:21:05.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.310+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=TB585JU1LIXB type=del size=3490941 2024-09-22T08:21:05.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.313+0000 7fe6c9c31780 1 < suggested remove operation key=9FCSIF1WKBDJ tag=DV4W79DP8G6U type=del 2024-09-22T08:21:05.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.315+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=UFJO64IK5MJ9 type=del size=605764 2024-09-22T08:21:05.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.316+0000 7fe6c9c31780 1 < completed write operation key=76HZ3LZGVT9J tag=JF3IQ3TXH3UT type=write size=705064 2024-09-22T08:21:05.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.318+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=F576EVC0LRHZ type=del size=1373130 2024-09-22T08:21:05.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.319+0000 7fe6c9c31780 1 < completed delete operation key=9AZWQ9E58QS6 tag=36HYHOJM14RV type=del 2024-09-22T08:21:05.323 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.322+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~4C8AC8AFZ8XQ.0 size=704134 2024-09-22T08:21:05.323 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.322+0000 7fe6c9c31780 1 > prepared multipart upload key=CTK01Y0CV1NC upload=4C8AC8AFZ8XQ tag=AV1KII1KGHLU type=write size=1752710 2024-09-22T08:21:05.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.324+0000 7fe6c9c31780 1 < completed delete operation key=0TWY0NNZZ7NN tag=EQALO17FU2JS type=del 2024-09-22T08:21:05.327 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.327+0000 7fe6c9c31780 1 > prepared part key=_multipart_ZFL9N44PBQX4.2~BLNSAOLV19N0.0 size=251194 2024-09-22T08:21:05.327 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.327+0000 7fe6c9c31780 1 > prepared multipart upload key=ZFL9N44PBQX4 upload=BLNSAOLV19N0 tag=F91TOAL3OIN7 type=write size=1299770 2024-09-22T08:21:05.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.330+0000 7fe6c9c31780 1 < suggested update operation key=D85LJGGU3Z6F tag=1IILQ9IWRGTP type=del size=869339 2024-09-22T08:21:05.334 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.333+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~888WDBKX0A2P.0 size=863261 2024-09-22T08:21:05.334 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.333+0000 7fe6c9c31780 1 > prepared multipart upload key=JT5AB8VLMEFD upload=888WDBKX0A2P tag=MIME5UKQARSJ type=write size=1911837 2024-09-22T08:21:05.336 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.336+0000 7fe6c9c31780 1 < completed part key=_multipart_TJTB67QBLZH5.2~3TX702ADD01S.0 size=1048576 2024-09-22T08:21:05.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.336+0000 7fe6c9c31780 1 < completed part key=_multipart_TJTB67QBLZH5.2~3TX702ADD01S.1 size=961493 2024-09-22T08:21:05.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.339+0000 7fe6c9c31780 1 < completed multipart upload key=TJTB67QBLZH5 upload=3TX702ADD01S tag=998CNZ0DHAHI type=write size=3058645 2024-09-22T08:21:05.342 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.342+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~O1UQ0GICM6KW.0 size=796170 2024-09-22T08:21:05.342 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.342+0000 7fe6c9c31780 1 > prepared multipart upload key=D85LJGGU3Z6F upload=O1UQ0GICM6KW tag=MN7T81RXTQ0G type=write size=1844746 2024-09-22T08:21:05.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.343+0000 7fe6c9c31780 1 < completed write operation key=LA6ZRVULGQ0H tag=N90UKXBSJPUP type=write size=757193 2024-09-22T08:21:05.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.345+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=OPPOARPTDCIX type=del size=3099225 2024-09-22T08:21:05.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.346+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~3DQYBY4MR7Y7.0 size=1048576 2024-09-22T08:21:05.348 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.347+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~3DQYBY4MR7Y7.1 size=834217 2024-09-22T08:21:05.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.350+0000 7fe6c9c31780 1 < completed multipart upload key=TE10GB1F35X4 upload=3DQYBY4MR7Y7 tag=T1039ISX5QHN type=write size=2931369 2024-09-22T08:21:05.353 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.353+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~JI6XBWML53T8.0 size=1048576 2024-09-22T08:21:05.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.354+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~JI6XBWML53T8.1 size=95037 2024-09-22T08:21:05.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.354+0000 7fe6c9c31780 1 > prepared multipart upload key=0TWY0NNZZ7NN upload=JI6XBWML53T8 tag=ZLH91S0LDY05 type=write size=2192189 2024-09-22T08:21:05.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.357+0000 7fe6c9c31780 1 < suggested update operation key=W9L87PTJEIOA tag=7X1YEDMKKOP2 type=del size=1725588 2024-09-22T08:21:05.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.360+0000 7fe6c9c31780 1 > prepared part key=_multipart_W9L87PTJEIOA.2~4Z2JUMMJY2LM.0 size=933754 2024-09-22T08:21:05.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.360+0000 7fe6c9c31780 1 > prepared multipart upload key=W9L87PTJEIOA upload=4Z2JUMMJY2LM tag=N9XO1B3NOFXW type=write size=1982330 2024-09-22T08:21:05.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.362+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~AKES1RJC6BO3.0 size=1048576 2024-09-22T08:21:05.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.362+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~AKES1RJC6BO3.1 size=342832 2024-09-22T08:21:05.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.365+0000 7fe6c9c31780 1 < completed multipart upload key=VP1MP4IC9A7T upload=AKES1RJC6BO3 tag=1WD8INU0FHLA type=write size=2439984 2024-09-22T08:21:05.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.368+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~BGL60DFH6ZRB.0 size=1048576 2024-09-22T08:21:05.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.369+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~BGL60DFH6ZRB.1 size=1048576 2024-09-22T08:21:05.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.370+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~BGL60DFH6ZRB.2 size=107080 2024-09-22T08:21:05.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.370+0000 7fe6c9c31780 1 > prepared multipart upload key=7446WN19QFV0 upload=BGL60DFH6ZRB tag=01KTUWD9Q1M9 type=write size=3252808 2024-09-22T08:21:05.372 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.371+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~A7B8HK1YJLSA.0 size=1048576 2024-09-22T08:21:05.373 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.373+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~A7B8HK1YJLSA.1 size=1048576 2024-09-22T08:21:05.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.374+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~A7B8HK1YJLSA.2 size=480782 2024-09-22T08:21:05.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.376+0000 7fe6c9c31780 1 < completed multipart upload key=O1UBUQXP50CN upload=A7B8HK1YJLSA tag=WP6PDP7RA97A type=write size=3626510 2024-09-22T08:21:05.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.379+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~CO115WTVE65V.0 size=1048576 2024-09-22T08:21:05.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.380+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~CO115WTVE65V.1 size=745978 2024-09-22T08:21:05.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.380+0000 7fe6c9c31780 1 > prepared multipart upload key=TYVQ39KUV2V9 upload=CO115WTVE65V tag=SBQ82IS25PIG type=write size=2843130 2024-09-22T08:21:05.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.381+0000 7fe6c9c31780 1 < completed delete operation key=76HZ3LZGVT9J tag=26IZY65GGFPN type=del 2024-09-22T08:21:05.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.383+0000 7fe6c9c31780 1 > prepared operation key=Z1CK5EDBK4AW tag=E5DVI232USDX type=del size=2020234 2024-09-22T08:21:05.385 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.384+0000 7fe6c9c31780 1 < completed write operation key=XJP26CCPYDI7 tag=7EMS4YRI63HM type=write size=834211 2024-09-22T08:21:05.387 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.387+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=JQ9ULGADTDZ6 type=del size=3949875 2024-09-22T08:21:05.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.388+0000 7fe6c9c31780 -1 < failed to complete operation key=9FCSIF1WKBDJ tag=SBDNK352VXQF type=del size=577276: (22) Invalid argument 2024-09-22T08:21:05.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.391+0000 7fe6c9c31780 1 > prepared part key=_multipart_R7UWMW913DJQ.2~RITN1UD07QOO.0 size=1048576 2024-09-22T08:21:05.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.392+0000 7fe6c9c31780 1 > prepared part key=_multipart_R7UWMW913DJQ.2~RITN1UD07QOO.1 size=966477 2024-09-22T08:21:05.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.392+0000 7fe6c9c31780 1 > prepared multipart upload key=R7UWMW913DJQ upload=RITN1UD07QOO tag=ZYQ9A8197110 type=write size=3063629 2024-09-22T08:21:05.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.395+0000 7fe6c9c31780 1 < suggested remove operation key=W9L87PTJEIOA tag=34UJ0HB29LLR type=write 2024-09-22T08:21:05.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.396+0000 7fe6c9c31780 1 > prepared operation key=KZIY400KQ5NH tag=7JLVNF6L19W2 type=del size=1376830 2024-09-22T08:21:05.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.398+0000 7fe6c9c31780 1 < completed delete operation key=9AZWQ9E58QS6 tag=TB585JU1LIXB type=del 2024-09-22T08:21:05.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.400+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~R1Q8VOHODLPS.0 size=1048576 2024-09-22T08:21:05.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.402+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~R1Q8VOHODLPS.1 size=1048576 2024-09-22T08:21:05.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.403+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~R1Q8VOHODLPS.2 size=911042 2024-09-22T08:21:05.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.403+0000 7fe6c9c31780 1 > prepared multipart upload key=2B5QRUMTVE7U upload=R1Q8VOHODLPS tag=LA7HVW7BKVNO type=write size=4056770 2024-09-22T08:21:05.407 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.406+0000 7fe6c9c31780 1 < suggested update operation key=0TWY0NNZZ7NN tag=UFJO64IK5MJ9 type=del size=605764 2024-09-22T08:21:05.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.410+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~I81VHLVP7GZM.0 size=299988 2024-09-22T08:21:05.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.410+0000 7fe6c9c31780 1 > prepared multipart upload key=7446WN19QFV0 upload=I81VHLVP7GZM tag=MH60JRBAY2LE type=write size=1348564 2024-09-22T08:21:05.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.412+0000 7fe6c9c31780 1 < suggested remove operation key=6BKB91YV3FMW tag=F576EVC0LRHZ type=del 2024-09-22T08:21:05.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.414+0000 7fe6c9c31780 1 > prepared operation key=OX1LY7URY7IV tag=LNTZ4PP3R2QD type=del size=2343841 2024-09-22T08:21:05.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.415+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~4C8AC8AFZ8XQ.0 size=704134 2024-09-22T08:21:05.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.418+0000 7fe6c9c31780 1 < completed multipart upload key=CTK01Y0CV1NC upload=4C8AC8AFZ8XQ tag=AV1KII1KGHLU type=write size=1752710 2024-09-22T08:21:05.420 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.419+0000 7fe6c9c31780 1 > prepared operation key=TYVQ39KUV2V9 tag=M1QOORGY3TBU type=del size=2430000 2024-09-22T08:21:05.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.421+0000 7fe6c9c31780 1 < completed part key=_multipart_ZFL9N44PBQX4.2~BLNSAOLV19N0.0 size=251194 2024-09-22T08:21:05.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.424+0000 7fe6c9c31780 1 < completed multipart upload key=ZFL9N44PBQX4 upload=BLNSAOLV19N0 tag=F91TOAL3OIN7 type=write size=1299770 2024-09-22T08:21:05.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.427+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~199OM3TTO3EN.0 size=517816 2024-09-22T08:21:05.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.427+0000 7fe6c9c31780 1 > prepared multipart upload key=946H8F2AUPO2 upload=199OM3TTO3EN tag=JJILE4JWYDIQ type=write size=1566392 2024-09-22T08:21:05.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.429+0000 7fe6c9c31780 1 < completed part key=_multipart_JT5AB8VLMEFD.2~888WDBKX0A2P.0 size=863261 2024-09-22T08:21:05.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.431+0000 7fe6c9c31780 1 < completed multipart upload key=JT5AB8VLMEFD upload=888WDBKX0A2P tag=MIME5UKQARSJ type=write size=1911837 2024-09-22T08:21:05.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.433+0000 7fe6c9c31780 1 > prepared operation key=D85LJGGU3Z6F tag=N33K5EISF529 type=del size=1478870 2024-09-22T08:21:05.435 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.434+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~O1UQ0GICM6KW.0 size=796170 2024-09-22T08:21:05.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.438+0000 7fe6c9c31780 1 < completed multipart upload key=D85LJGGU3Z6F upload=O1UQ0GICM6KW tag=MN7T81RXTQ0G type=write size=1844746 2024-09-22T08:21:05.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.440+0000 7fe6c9c31780 1 > prepared operation key=4KRJ7DTE3KDV tag=TFL81JLZ0KIA type=write size=709184 2024-09-22T08:21:05.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.442+0000 7fe6c9c31780 1 < suggested remove operation key=R7UWMW913DJQ tag=OPPOARPTDCIX type=del 2024-09-22T08:21:05.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.446+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~P7W4LVWDG6MS.0 size=725437 2024-09-22T08:21:05.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.446+0000 7fe6c9c31780 1 > prepared multipart upload key=OX1LY7URY7IV upload=P7W4LVWDG6MS tag=Q3M9S7I05MD8 type=write size=1774013 2024-09-22T08:21:05.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.448+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~JI6XBWML53T8.0 size=1048576 2024-09-22T08:21:05.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.448+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~JI6XBWML53T8.1 size=95037 2024-09-22T08:21:05.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.452+0000 7fe6c9c31780 1 < completed multipart upload key=0TWY0NNZZ7NN upload=JI6XBWML53T8 tag=ZLH91S0LDY05 type=write size=2192189 2024-09-22T08:21:05.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.453+0000 7fe6c9c31780 1 > prepared operation key=OX1LY7URY7IV tag=GPOLQC8G97ZH type=del size=2705981 2024-09-22T08:21:05.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.455+0000 7fe6c9c31780 1 < completed part key=_multipart_W9L87PTJEIOA.2~4Z2JUMMJY2LM.0 size=933754 2024-09-22T08:21:05.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.457+0000 7fe6c9c31780 1 < completed multipart upload key=W9L87PTJEIOA upload=4Z2JUMMJY2LM tag=N9XO1B3NOFXW type=write size=1982330 2024-09-22T08:21:05.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.458+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=TT1ER7V27T8M type=del size=3339586 2024-09-22T08:21:05.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.460+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~BGL60DFH6ZRB.0 size=1048576 2024-09-22T08:21:05.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.461+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~BGL60DFH6ZRB.1 size=1048576 2024-09-22T08:21:05.463 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.462+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~BGL60DFH6ZRB.2 size=107080 2024-09-22T08:21:05.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.465+0000 7fe6c9c31780 1 < completed multipart upload key=7446WN19QFV0 upload=BGL60DFH6ZRB tag=01KTUWD9Q1M9 type=write size=3252808 2024-09-22T08:21:05.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.466+0000 7fe6c9c31780 1 > prepared operation key=LA6ZRVULGQ0H tag=FUU2VSNF42S2 type=del size=1712572 2024-09-22T08:21:05.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.466+0000 7fe6c9c31780 1 < canceled part key=_multipart_TYVQ39KUV2V9.2~CO115WTVE65V.0 size=1048576 2024-09-22T08:21:05.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.468+0000 7fe6c9c31780 1 < completed part key=_multipart_TYVQ39KUV2V9.2~CO115WTVE65V.1 size=745978 2024-09-22T08:21:05.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.470+0000 7fe6c9c31780 1 < canceled multipart upload key=TYVQ39KUV2V9 upload=CO115WTVE65V tag=SBQ82IS25PIG type=write size=2843130 2024-09-22T08:21:05.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.474+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~45FWWS3ZSA0H.0 size=1048576 2024-09-22T08:21:05.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.475+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~45FWWS3ZSA0H.1 size=710094 2024-09-22T08:21:05.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.475+0000 7fe6c9c31780 1 > prepared multipart upload key=CTK01Y0CV1NC upload=45FWWS3ZSA0H tag=KSWNG64K34X5 type=write size=2807246 2024-09-22T08:21:05.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.476+0000 7fe6c9c31780 1 < completed delete operation key=Z1CK5EDBK4AW tag=E5DVI232USDX type=del 2024-09-22T08:21:05.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.478+0000 7fe6c9c31780 1 > prepared operation key=O1UBUQXP50CN tag=OZ82XUJ2RPX0 type=del size=4097563 2024-09-22T08:21:05.481 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.481+0000 7fe6c9c31780 1 < suggested remove operation key=T2W6RXP9UGHH tag=JQ9ULGADTDZ6 type=del 2024-09-22T08:21:05.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.482+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=DOEULWBUVR5B type=del size=125764 2024-09-22T08:21:05.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.484+0000 7fe6c9c31780 1 < completed part key=_multipart_R7UWMW913DJQ.2~RITN1UD07QOO.0 size=1048576 2024-09-22T08:21:05.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.485+0000 7fe6c9c31780 1 < completed part key=_multipart_R7UWMW913DJQ.2~RITN1UD07QOO.1 size=966477 2024-09-22T08:21:05.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.487+0000 7fe6c9c31780 1 < completed multipart upload key=R7UWMW913DJQ upload=RITN1UD07QOO tag=ZYQ9A8197110 type=write size=3063629 2024-09-22T08:21:05.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.488+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=1D4RGQZ8DQ6L type=del size=2433792 2024-09-22T08:21:05.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.490+0000 7fe6c9c31780 1 < completed delete operation key=KZIY400KQ5NH tag=7JLVNF6L19W2 type=del 2024-09-22T08:21:05.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.491+0000 7fe6c9c31780 1 > prepared operation key=Z1CK5EDBK4AW tag=7CY5K0YO6HDF type=del size=1314215 2024-09-22T08:21:05.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.493+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~R1Q8VOHODLPS.0 size=1048576 2024-09-22T08:21:05.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.494+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~R1Q8VOHODLPS.1 size=1048576 2024-09-22T08:21:05.496 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.495+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~R1Q8VOHODLPS.2 size=911042 2024-09-22T08:21:05.498 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.497+0000 7fe6c9c31780 1 < completed multipart upload key=2B5QRUMTVE7U upload=R1Q8VOHODLPS tag=LA7HVW7BKVNO type=write size=4056770 2024-09-22T08:21:05.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.499+0000 7fe6c9c31780 1 > prepared operation key=FY40JTHLT0KU tag=8C1YM9JEQ11B type=del size=3564124 2024-09-22T08:21:05.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.500+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~I81VHLVP7GZM.0 size=299988 2024-09-22T08:21:05.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.503+0000 7fe6c9c31780 1 < completed multipart upload key=7446WN19QFV0 upload=I81VHLVP7GZM tag=MH60JRBAY2LE type=write size=1348564 2024-09-22T08:21:05.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.504+0000 7fe6c9c31780 1 > prepared operation key=TYVQ39KUV2V9 tag=T2NM326KZ0OC type=del size=594606 2024-09-22T08:21:05.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.507+0000 7fe6c9c31780 1 < completed delete operation key=OX1LY7URY7IV tag=LNTZ4PP3R2QD type=del 2024-09-22T08:21:05.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.508+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=JN378S5JEQ73 type=del size=3622352 2024-09-22T08:21:05.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.510+0000 7fe6c9c31780 1 < completed delete operation key=TYVQ39KUV2V9 tag=M1QOORGY3TBU type=del 2024-09-22T08:21:05.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.511+0000 7fe6c9c31780 1 > prepared operation key=JT5AB8VLMEFD tag=3Z0OD9YX9Y0E type=del size=706615 2024-09-22T08:21:05.513 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.512+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~199OM3TTO3EN.0 size=517816 2024-09-22T08:21:05.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.515+0000 7fe6c9c31780 1 < completed multipart upload key=946H8F2AUPO2 upload=199OM3TTO3EN tag=JJILE4JWYDIQ type=write size=1566392 2024-09-22T08:21:05.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.517+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~H9F0Z88LIPIL.0 size=1048576 2024-09-22T08:21:05.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.519+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~H9F0Z88LIPIL.1 size=65760 2024-09-22T08:21:05.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.519+0000 7fe6c9c31780 1 > prepared multipart upload key=7446WN19QFV0 upload=H9F0Z88LIPIL tag=MH9J4Z2Z3T1E type=write size=2162912 2024-09-22T08:21:05.520 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.520+0000 7fe6c9c31780 1 < canceled operation key=D85LJGGU3Z6F tag=N33K5EISF529 type=del size=1478870 2024-09-22T08:21:05.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.521+0000 7fe6c9c31780 1 > prepared operation key=FY40JTHLT0KU tag=DBCIKXW5L8Y0 type=del size=629467 2024-09-22T08:21:05.524 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.523+0000 7fe6c9c31780 1 < completed write operation key=4KRJ7DTE3KDV tag=TFL81JLZ0KIA type=write size=709184 2024-09-22T08:21:05.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.525+0000 7fe6c9c31780 1 > prepared operation key=XJP26CCPYDI7 tag=RLXSTBE3GCM0 type=del size=1754728 2024-09-22T08:21:05.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.526+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~P7W4LVWDG6MS.0 size=725437 2024-09-22T08:21:05.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.528+0000 7fe6c9c31780 1 < completed multipart upload key=OX1LY7URY7IV upload=P7W4LVWDG6MS tag=Q3M9S7I05MD8 type=write size=1774013 2024-09-22T08:21:05.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.530+0000 7fe6c9c31780 1 > prepared operation key=4KRJ7DTE3KDV tag=WPHXDKQ9BUSV type=del size=3172743 2024-09-22T08:21:05.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.531+0000 7fe6c9c31780 1 < completed delete operation key=OX1LY7URY7IV tag=GPOLQC8G97ZH type=del 2024-09-22T08:21:05.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.533+0000 7fe6c9c31780 1 > prepared operation key=4KRJ7DTE3KDV tag=KXZGWBK0LKOO type=del size=528826 2024-09-22T08:21:05.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.534+0000 7fe6c9c31780 1 < completed delete operation key=9AZWQ9E58QS6 tag=TT1ER7V27T8M type=del 2024-09-22T08:21:05.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.537+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~2X9HJL1Q5PGJ.0 size=938664 2024-09-22T08:21:05.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.537+0000 7fe6c9c31780 1 > prepared multipart upload key=LA6ZRVULGQ0H upload=2X9HJL1Q5PGJ tag=K9FORSQRX0QR type=write size=1987240 2024-09-22T08:21:05.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.538+0000 7fe6c9c31780 1 < completed delete operation key=LA6ZRVULGQ0H tag=FUU2VSNF42S2 type=del 2024-09-22T08:21:05.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.541+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~ZVT9NZCQNXIL.0 size=1048576 2024-09-22T08:21:05.543 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.542+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~ZVT9NZCQNXIL.1 size=910397 2024-09-22T08:21:05.543 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.542+0000 7fe6c9c31780 1 > prepared multipart upload key=JT5AB8VLMEFD upload=ZVT9NZCQNXIL tag=2MM4R0GDOI1W type=write size=3007549 2024-09-22T08:21:05.543 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.542+0000 7fe6c9c31780 1 < canceled part key=_multipart_CTK01Y0CV1NC.2~45FWWS3ZSA0H.0 size=1048576 2024-09-22T08:21:05.544 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.543+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~45FWWS3ZSA0H.1 size=710094 2024-09-22T08:21:05.546 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.546+0000 7fe6c9c31780 1 < canceled multipart upload key=CTK01Y0CV1NC upload=45FWWS3ZSA0H tag=KSWNG64K34X5 type=write size=2807246 2024-09-22T08:21:05.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.547+0000 7fe6c9c31780 1 > prepared operation key=O1UBUQXP50CN tag=3C2M9EK8GUD1 type=del size=3736258 2024-09-22T08:21:05.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.548+0000 7fe6c9c31780 1 < completed delete operation key=O1UBUQXP50CN tag=OZ82XUJ2RPX0 type=del 2024-09-22T08:21:05.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.551+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~F5NJ1DQTGX63.0 size=1048576 2024-09-22T08:21:05.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.553+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~F5NJ1DQTGX63.1 size=350446 2024-09-22T08:21:05.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.553+0000 7fe6c9c31780 1 > prepared multipart upload key=JT5AB8VLMEFD upload=F5NJ1DQTGX63 tag=GFY1KF6BBSS0 type=write size=2447598 2024-09-22T08:21:05.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.554+0000 7fe6c9c31780 1 < completed delete operation key=7446WN19QFV0 tag=DOEULWBUVR5B type=del 2024-09-22T08:21:05.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.555+0000 7fe6c9c31780 1 > prepared operation key=9FCSIF1WKBDJ tag=AU8JI44OL1LU type=del size=2177666 2024-09-22T08:21:05.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.557+0000 7fe6c9c31780 1 < canceled operation key=CTK01Y0CV1NC tag=1D4RGQZ8DQ6L type=del size=2433792 2024-09-22T08:21:05.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.560+0000 7fe6c9c31780 1 > prepared part key=_multipart_1HZ0NAJPXNW1.2~7FLI31H8OHRU.0 size=1048576 2024-09-22T08:21:05.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.561+0000 7fe6c9c31780 1 > prepared part key=_multipart_1HZ0NAJPXNW1.2~7FLI31H8OHRU.1 size=1032842 2024-09-22T08:21:05.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.561+0000 7fe6c9c31780 1 > prepared multipart upload key=1HZ0NAJPXNW1 upload=7FLI31H8OHRU tag=GTF4J918FL38 type=write size=3129994 2024-09-22T08:21:05.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.562+0000 7fe6c9c31780 1 < completed delete operation key=Z1CK5EDBK4AW tag=7CY5K0YO6HDF type=del 2024-09-22T08:21:05.566 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.565+0000 7fe6c9c31780 1 > prepared part key=_multipart_TJTB67QBLZH5.2~K6H921KOG6R9.0 size=1048576 2024-09-22T08:21:05.566 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.566+0000 7fe6c9c31780 1 > prepared part key=_multipart_TJTB67QBLZH5.2~K6H921KOG6R9.1 size=1048576 2024-09-22T08:21:05.567 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.567+0000 7fe6c9c31780 1 > prepared part key=_multipart_TJTB67QBLZH5.2~K6H921KOG6R9.2 size=593925 2024-09-22T08:21:05.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.567+0000 7fe6c9c31780 1 > prepared multipart upload key=TJTB67QBLZH5 upload=K6H921KOG6R9 tag=55VJAEFA7DJE type=write size=3739653 2024-09-22T08:21:05.569 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.568+0000 7fe6c9c31780 1 < completed delete operation key=FY40JTHLT0KU tag=8C1YM9JEQ11B type=del 2024-09-22T08:21:05.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.570+0000 7fe6c9c31780 1 > prepared operation key=XJP26CCPYDI7 tag=QMJZIADT35O5 type=del size=333566 2024-09-22T08:21:05.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.571+0000 7fe6c9c31780 1 < canceled operation key=TYVQ39KUV2V9 tag=T2NM326KZ0OC type=del size=594606 2024-09-22T08:21:05.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.574+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~X4CGWBC8AAZR.0 size=1048576 2024-09-22T08:21:05.576 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.575+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~X4CGWBC8AAZR.1 size=1048576 2024-09-22T08:21:05.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.576+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~X4CGWBC8AAZR.2 size=871104 2024-09-22T08:21:05.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.576+0000 7fe6c9c31780 1 > prepared multipart upload key=D85LJGGU3Z6F upload=X4CGWBC8AAZR tag=SIARWSX19VDF type=write size=4016832 2024-09-22T08:21:05.578 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.578+0000 7fe6c9c31780 1 < completed delete operation key=7446WN19QFV0 tag=JN378S5JEQ73 type=del 2024-09-22T08:21:05.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.579+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=734XRKS9BMTP type=write size=632716 2024-09-22T08:21:05.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.581+0000 7fe6c9c31780 1 < completed delete operation key=JT5AB8VLMEFD tag=3Z0OD9YX9Y0E type=del 2024-09-22T08:21:05.584 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.584+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~FL7FPG8ANS0J.0 size=1048576 2024-09-22T08:21:05.585 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.584+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~FL7FPG8ANS0J.1 size=454017 2024-09-22T08:21:05.585 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.584+0000 7fe6c9c31780 1 > prepared multipart upload key=76HZ3LZGVT9J upload=FL7FPG8ANS0J tag=KJKQN7K9XLXS type=write size=2551169 2024-09-22T08:21:05.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.586+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~H9F0Z88LIPIL.0 size=1048576 2024-09-22T08:21:05.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.588+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~H9F0Z88LIPIL.1 size=65760 2024-09-22T08:21:05.590 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.590+0000 7fe6c9c31780 1 < completed multipart upload key=7446WN19QFV0 upload=H9F0Z88LIPIL tag=MH9J4Z2Z3T1E type=write size=2162912 2024-09-22T08:21:05.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.591+0000 7fe6c9c31780 1 > prepared operation key=9FCSIF1WKBDJ tag=NPYZP1RUP8US type=del size=772965 2024-09-22T08:21:05.594 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.594+0000 7fe6c9c31780 1 < suggested remove operation key=FY40JTHLT0KU tag=DBCIKXW5L8Y0 type=del 2024-09-22T08:21:05.596 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.595+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=Y319M6MUY4B6 type=del size=2765967 2024-09-22T08:21:05.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.596+0000 7fe6c9c31780 1 < completed delete operation key=XJP26CCPYDI7 tag=RLXSTBE3GCM0 type=del 2024-09-22T08:21:05.598 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.598+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=DWJNOU6K3G0G type=del size=2480753 2024-09-22T08:21:05.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.601+0000 7fe6c9c31780 1 < suggested remove operation key=4KRJ7DTE3KDV tag=WPHXDKQ9BUSV type=del 2024-09-22T08:21:05.604 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.603+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~MGBC3JKHNAJ2.0 size=1048576 2024-09-22T08:21:05.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.604+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~MGBC3JKHNAJ2.1 size=852837 2024-09-22T08:21:05.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.604+0000 7fe6c9c31780 1 > prepared multipart upload key=FY40JTHLT0KU upload=MGBC3JKHNAJ2 tag=2EJWPTN02FHH type=write size=2949989 2024-09-22T08:21:05.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.605+0000 7fe6c9c31780 -1 < failed to complete operation key=4KRJ7DTE3KDV tag=KXZGWBK0LKOO type=del size=528826: (22) Invalid argument 2024-09-22T08:21:05.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.609+0000 7fe6c9c31780 1 > prepared part key=_multipart_TJTB67QBLZH5.2~C2ROBQJD2929.0 size=1048576 2024-09-22T08:21:05.611 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.611+0000 7fe6c9c31780 1 > prepared part key=_multipart_TJTB67QBLZH5.2~C2ROBQJD2929.1 size=1048576 2024-09-22T08:21:05.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.612+0000 7fe6c9c31780 1 > prepared part key=_multipart_TJTB67QBLZH5.2~C2ROBQJD2929.2 size=114031 2024-09-22T08:21:05.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.612+0000 7fe6c9c31780 1 > prepared multipart upload key=TJTB67QBLZH5 upload=C2ROBQJD2929 tag=LHSCKW90CE58 type=write size=3259759 2024-09-22T08:21:05.613 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.613+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~2X9HJL1Q5PGJ.0 size=938664 2024-09-22T08:21:05.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.615+0000 7fe6c9c31780 1 < completed multipart upload key=LA6ZRVULGQ0H upload=2X9HJL1Q5PGJ tag=K9FORSQRX0QR type=write size=1987240 2024-09-22T08:21:05.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.616+0000 7fe6c9c31780 1 > prepared operation key=LA6ZRVULGQ0H tag=KJOZZD2CA2BC type=del size=986230 2024-09-22T08:21:05.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.618+0000 7fe6c9c31780 1 < completed part key=_multipart_JT5AB8VLMEFD.2~ZVT9NZCQNXIL.0 size=1048576 2024-09-22T08:21:05.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.619+0000 7fe6c9c31780 1 < completed part key=_multipart_JT5AB8VLMEFD.2~ZVT9NZCQNXIL.1 size=910397 2024-09-22T08:21:05.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.621+0000 7fe6c9c31780 1 < completed multipart upload key=JT5AB8VLMEFD upload=ZVT9NZCQNXIL tag=2MM4R0GDOI1W type=write size=3007549 2024-09-22T08:21:05.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.622+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=JP27O3FTF1G1 type=write size=1034542 2024-09-22T08:21:05.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.624+0000 7fe6c9c31780 1 < completed delete operation key=O1UBUQXP50CN tag=3C2M9EK8GUD1 type=del 2024-09-22T08:21:05.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.626+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~RDV47V8NPN6K.0 size=1048576 2024-09-22T08:21:05.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.627+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~RDV47V8NPN6K.1 size=852389 2024-09-22T08:21:05.628 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.627+0000 7fe6c9c31780 1 > prepared multipart upload key=DC7VLQWZ3TD1 upload=RDV47V8NPN6K tag=446754Y3LTH7 type=write size=2949541 2024-09-22T08:21:05.628 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.627+0000 7fe6c9c31780 1 < canceled part key=_multipart_JT5AB8VLMEFD.2~F5NJ1DQTGX63.0 size=1048576 2024-09-22T08:21:05.629 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.628+0000 7fe6c9c31780 1 < completed part key=_multipart_JT5AB8VLMEFD.2~F5NJ1DQTGX63.1 size=350446 2024-09-22T08:21:05.631 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.630+0000 7fe6c9c31780 1 < canceled multipart upload key=JT5AB8VLMEFD upload=F5NJ1DQTGX63 tag=GFY1KF6BBSS0 type=write size=2447598 2024-09-22T08:21:05.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.632+0000 7fe6c9c31780 1 > prepared operation key=ZFL9N44PBQX4 tag=2MWSY1U9TZDG type=write size=44166 2024-09-22T08:21:05.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.633+0000 7fe6c9c31780 1 < completed delete operation key=9FCSIF1WKBDJ tag=AU8JI44OL1LU type=del 2024-09-22T08:21:05.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.635+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=YXTEHMTOAAYL type=del size=533011 2024-09-22T08:21:05.637 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.636+0000 7fe6c9c31780 1 < completed part key=_multipart_1HZ0NAJPXNW1.2~7FLI31H8OHRU.0 size=1048576 2024-09-22T08:21:05.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.637+0000 7fe6c9c31780 1 < completed part key=_multipart_1HZ0NAJPXNW1.2~7FLI31H8OHRU.1 size=1032842 2024-09-22T08:21:05.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.640+0000 7fe6c9c31780 1 < completed multipart upload key=1HZ0NAJPXNW1 upload=7FLI31H8OHRU tag=GTF4J918FL38 type=write size=3129994 2024-09-22T08:21:05.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.641+0000 7fe6c9c31780 1 > prepared operation key=KZIY400KQ5NH tag=ZZS74FJS4DKW type=del size=1023969 2024-09-22T08:21:05.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.643+0000 7fe6c9c31780 1 < completed part key=_multipart_TJTB67QBLZH5.2~K6H921KOG6R9.0 size=1048576 2024-09-22T08:21:05.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.644+0000 7fe6c9c31780 1 < completed part key=_multipart_TJTB67QBLZH5.2~K6H921KOG6R9.1 size=1048576 2024-09-22T08:21:05.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.645+0000 7fe6c9c31780 1 < completed part key=_multipart_TJTB67QBLZH5.2~K6H921KOG6R9.2 size=593925 2024-09-22T08:21:05.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.647+0000 7fe6c9c31780 1 < completed multipart upload key=TJTB67QBLZH5 upload=K6H921KOG6R9 tag=55VJAEFA7DJE type=write size=3739653 2024-09-22T08:21:05.651 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.650+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~VSOLPP85S35A.0 size=1048576 2024-09-22T08:21:05.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.651+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~VSOLPP85S35A.1 size=1048576 2024-09-22T08:21:05.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.653+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~VSOLPP85S35A.2 size=470597 2024-09-22T08:21:05.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.653+0000 7fe6c9c31780 1 > prepared multipart upload key=946H8F2AUPO2 upload=VSOLPP85S35A tag=YFEPK9OCXLMN type=write size=3616325 2024-09-22T08:21:05.655 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.654+0000 7fe6c9c31780 1 < completed delete operation key=XJP26CCPYDI7 tag=QMJZIADT35O5 type=del 2024-09-22T08:21:05.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.656+0000 7fe6c9c31780 1 > prepared operation key=D85LJGGU3Z6F tag=VT1FO52QMBVZ type=del size=4026412 2024-09-22T08:21:05.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.657+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~X4CGWBC8AAZR.0 size=1048576 2024-09-22T08:21:05.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.658+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~X4CGWBC8AAZR.1 size=1048576 2024-09-22T08:21:05.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.660+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~X4CGWBC8AAZR.2 size=871104 2024-09-22T08:21:05.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.662+0000 7fe6c9c31780 1 < completed multipart upload key=D85LJGGU3Z6F upload=X4CGWBC8AAZR tag=SIARWSX19VDF type=write size=4016832 2024-09-22T08:21:05.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.663+0000 7fe6c9c31780 1 > prepared operation key=JT5AB8VLMEFD tag=MWDWRWCHGWYW type=del size=1975763 2024-09-22T08:21:05.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.665+0000 7fe6c9c31780 1 < completed write operation key=76HZ3LZGVT9J tag=734XRKS9BMTP type=write size=632716 2024-09-22T08:21:05.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.667+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~F0KETJG3873I.0 size=1048576 2024-09-22T08:21:05.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.669+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~F0KETJG3873I.1 size=277300 2024-09-22T08:21:05.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.669+0000 7fe6c9c31780 1 > prepared multipart upload key=0TWY0NNZZ7NN upload=F0KETJG3873I tag=OPFF7TF1R3LI type=write size=2374452 2024-09-22T08:21:05.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.669+0000 7fe6c9c31780 1 < canceled part key=_multipart_76HZ3LZGVT9J.2~FL7FPG8ANS0J.0 size=1048576 2024-09-22T08:21:05.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.669+0000 7fe6c9c31780 1 < canceled part key=_multipart_76HZ3LZGVT9J.2~FL7FPG8ANS0J.1 size=454017 2024-09-22T08:21:05.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.671+0000 7fe6c9c31780 1 < canceled multipart upload key=76HZ3LZGVT9J upload=FL7FPG8ANS0J tag=KJKQN7K9XLXS type=write size=2551169 2024-09-22T08:21:05.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.673+0000 7fe6c9c31780 1 > prepared operation key=KZIY400KQ5NH tag=TUS6UD49ODJF type=del size=201713 2024-09-22T08:21:05.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.674+0000 7fe6c9c31780 1 < completed delete operation key=9FCSIF1WKBDJ tag=NPYZP1RUP8US type=del 2024-09-22T08:21:05.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.676+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=W063YPR0PVU5 type=del size=1620312 2024-09-22T08:21:05.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.677+0000 7fe6c9c31780 1 < canceled operation key=0TWY0NNZZ7NN tag=Y319M6MUY4B6 type=del size=2765967 2024-09-22T08:21:05.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.680+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~OH8Z9ESFUZW2.0 size=1048576 2024-09-22T08:21:05.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.681+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~OH8Z9ESFUZW2.1 size=1048576 2024-09-22T08:21:05.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.682+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~OH8Z9ESFUZW2.2 size=493483 2024-09-22T08:21:05.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.682+0000 7fe6c9c31780 1 > prepared multipart upload key=FY40JTHLT0KU upload=OH8Z9ESFUZW2 tag=VCAT5ZRC9L3F type=write size=3639211 2024-09-22T08:21:05.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.685+0000 7fe6c9c31780 1 < suggested remove operation key=946H8F2AUPO2 tag=DWJNOU6K3G0G type=del 2024-09-22T08:21:05.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.686+0000 7fe6c9c31780 1 > prepared operation key=D85LJGGU3Z6F tag=6UDRI1XIIGYK type=del size=3355671 2024-09-22T08:21:05.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.688+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~MGBC3JKHNAJ2.0 size=1048576 2024-09-22T08:21:05.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.688+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~MGBC3JKHNAJ2.1 size=852837 2024-09-22T08:21:05.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.691+0000 7fe6c9c31780 1 < completed multipart upload key=FY40JTHLT0KU upload=MGBC3JKHNAJ2 tag=2EJWPTN02FHH type=write size=2949989 2024-09-22T08:21:05.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.692+0000 7fe6c9c31780 1 > prepared operation key=W9L87PTJEIOA tag=82W04BAZNTF9 type=del size=163141 2024-09-22T08:21:05.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.694+0000 7fe6c9c31780 1 < completed part key=_multipart_TJTB67QBLZH5.2~C2ROBQJD2929.0 size=1048576 2024-09-22T08:21:05.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.695+0000 7fe6c9c31780 1 < completed part key=_multipart_TJTB67QBLZH5.2~C2ROBQJD2929.1 size=1048576 2024-09-22T08:21:05.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.696+0000 7fe6c9c31780 1 < completed part key=_multipart_TJTB67QBLZH5.2~C2ROBQJD2929.2 size=114031 2024-09-22T08:21:05.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.699+0000 7fe6c9c31780 1 < completed multipart upload key=TJTB67QBLZH5 upload=C2ROBQJD2929 tag=LHSCKW90CE58 type=write size=3259759 2024-09-22T08:21:05.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.701+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~27408EZIAEYG.0 size=1048576 2024-09-22T08:21:05.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.702+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~27408EZIAEYG.1 size=1048576 2024-09-22T08:21:05.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.703+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~27408EZIAEYG.2 size=240536 2024-09-22T08:21:05.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.703+0000 7fe6c9c31780 1 > prepared multipart upload key=2B5QRUMTVE7U upload=27408EZIAEYG tag=UROWJR3ZHQ0Z type=write size=3386264 2024-09-22T08:21:05.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.706+0000 7fe6c9c31780 1 < completed delete operation key=LA6ZRVULGQ0H tag=KJOZZD2CA2BC type=del 2024-09-22T08:21:05.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.706+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=U7SS4ZQ5RQJ0 type=del size=3863336 2024-09-22T08:21:05.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.708+0000 7fe6c9c31780 1 < completed write operation key=T2W6RXP9UGHH tag=JP27O3FTF1G1 type=write size=1034542 2024-09-22T08:21:05.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.710+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~1LTIO5B1LUHJ.0 size=1048576 2024-09-22T08:21:05.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.712+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~1LTIO5B1LUHJ.1 size=1048576 2024-09-22T08:21:05.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.713+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~1LTIO5B1LUHJ.2 size=84116 2024-09-22T08:21:05.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.713+0000 7fe6c9c31780 1 > prepared multipart upload key=FY40JTHLT0KU upload=1LTIO5B1LUHJ tag=YAS81DV4Y6OD type=write size=3229844 2024-09-22T08:21:05.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.713+0000 7fe6c9c31780 1 < canceled part key=_multipart_DC7VLQWZ3TD1.2~RDV47V8NPN6K.0 size=1048576 2024-09-22T08:21:05.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.714+0000 7fe6c9c31780 1 < completed part key=_multipart_DC7VLQWZ3TD1.2~RDV47V8NPN6K.1 size=852389 2024-09-22T08:21:05.717 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.716+0000 7fe6c9c31780 1 < canceled multipart upload key=DC7VLQWZ3TD1 upload=RDV47V8NPN6K tag=446754Y3LTH7 type=write size=2949541 2024-09-22T08:21:05.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.718+0000 7fe6c9c31780 1 > prepared operation key=O1UBUQXP50CN tag=JT0BPWEA281Z type=del size=2484991 2024-09-22T08:21:05.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.721+0000 7fe6c9c31780 1 < suggested update operation key=ZFL9N44PBQX4 tag=2MWSY1U9TZDG type=write size=44166 2024-09-22T08:21:05.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.722+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=MUJK4RQ5L90J type=del size=3091542 2024-09-22T08:21:05.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.724+0000 7fe6c9c31780 1 < completed delete operation key=6BKB91YV3FMW tag=YXTEHMTOAAYL type=del 2024-09-22T08:21:05.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.727+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~OMF2IBQ9B0BF.0 size=1048576 2024-09-22T08:21:05.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.727+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~OMF2IBQ9B0BF.1 size=1048576 2024-09-22T08:21:05.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.729+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~OMF2IBQ9B0BF.2 size=625362 2024-09-22T08:21:05.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.729+0000 7fe6c9c31780 1 > prepared multipart upload key=76HZ3LZGVT9J upload=OMF2IBQ9B0BF tag=ACN9J3HQZ4RI type=write size=3771090 2024-09-22T08:21:05.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.731+0000 7fe6c9c31780 1 < completed delete operation key=KZIY400KQ5NH tag=ZZS74FJS4DKW type=del 2024-09-22T08:21:05.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.733+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~AYWTED4CC0HJ.0 size=1048576 2024-09-22T08:21:05.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.734+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~AYWTED4CC0HJ.1 size=1048576 2024-09-22T08:21:05.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.736+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~AYWTED4CC0HJ.2 size=118434 2024-09-22T08:21:05.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.736+0000 7fe6c9c31780 1 > prepared multipart upload key=946H8F2AUPO2 upload=AYWTED4CC0HJ tag=DHBVZK0ZVKIJ type=write size=3264162 2024-09-22T08:21:05.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.737+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~VSOLPP85S35A.0 size=1048576 2024-09-22T08:21:05.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.739+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~VSOLPP85S35A.1 size=1048576 2024-09-22T08:21:05.741 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.741+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~VSOLPP85S35A.2 size=470597 2024-09-22T08:21:05.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.743+0000 7fe6c9c31780 1 < completed multipart upload key=946H8F2AUPO2 upload=VSOLPP85S35A tag=YFEPK9OCXLMN type=write size=3616325 2024-09-22T08:21:05.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.744+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=N2T8YDJJH61B type=del size=4162523 2024-09-22T08:21:05.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.746+0000 7fe6c9c31780 1 < canceled operation key=D85LJGGU3Z6F tag=VT1FO52QMBVZ type=del size=4026412 2024-09-22T08:21:05.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.747+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=U4HF2T7A36WN type=del size=281366 2024-09-22T08:21:05.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.751+0000 7fe6c9c31780 1 < suggested remove operation key=JT5AB8VLMEFD tag=MWDWRWCHGWYW type=del 2024-09-22T08:21:05.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.752+0000 7fe6c9c31780 1 > prepared operation key=LA6ZRVULGQ0H tag=99HZTKCK3A8P type=del size=3433233 2024-09-22T08:21:05.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.754+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~F0KETJG3873I.0 size=1048576 2024-09-22T08:21:05.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.755+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~F0KETJG3873I.1 size=277300 2024-09-22T08:21:05.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.758+0000 7fe6c9c31780 1 < completed multipart upload key=0TWY0NNZZ7NN upload=F0KETJG3873I tag=OPFF7TF1R3LI type=write size=2374452 2024-09-22T08:21:05.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.761+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~CN8XAAZ5C8XD.0 size=1048576 2024-09-22T08:21:05.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.762+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~CN8XAAZ5C8XD.1 size=517313 2024-09-22T08:21:05.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.762+0000 7fe6c9c31780 1 > prepared multipart upload key=Z1CK5EDBK4AW upload=CN8XAAZ5C8XD tag=VLE6DOYN5WG4 type=write size=2614465 2024-09-22T08:21:05.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.763+0000 7fe6c9c31780 1 < completed delete operation key=KZIY400KQ5NH tag=TUS6UD49ODJF type=del 2024-09-22T08:21:05.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.765+0000 7fe6c9c31780 1 > prepared operation key=0PNK2ZW6IJM1 tag=88DT3K0D4XFH type=del size=1203447 2024-09-22T08:21:05.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.766+0000 7fe6c9c31780 1 < completed delete operation key=DC7VLQWZ3TD1 tag=W063YPR0PVU5 type=del 2024-09-22T08:21:05.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.768+0000 7fe6c9c31780 1 > prepared operation key=GEWQUFB9K35E tag=35TQ54Y971VJ type=del size=3018890 2024-09-22T08:21:05.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.769+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~OH8Z9ESFUZW2.0 size=1048576 2024-09-22T08:21:05.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.771+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~OH8Z9ESFUZW2.1 size=1048576 2024-09-22T08:21:05.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.772+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~OH8Z9ESFUZW2.2 size=493483 2024-09-22T08:21:05.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.774+0000 7fe6c9c31780 1 < completed multipart upload key=FY40JTHLT0KU upload=OH8Z9ESFUZW2 tag=VCAT5ZRC9L3F type=write size=3639211 2024-09-22T08:21:05.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.776+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=HL8WCG3JBYT8 type=del size=1941968 2024-09-22T08:21:05.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.778+0000 7fe6c9c31780 1 < completed delete operation key=D85LJGGU3Z6F tag=6UDRI1XIIGYK type=del 2024-09-22T08:21:05.781 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.781+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~71F00HS4Z3RY.0 size=1048576 2024-09-22T08:21:05.782 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.782+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~71F00HS4Z3RY.1 size=1048576 2024-09-22T08:21:05.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.783+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~71F00HS4Z3RY.2 size=294050 2024-09-22T08:21:05.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.783+0000 7fe6c9c31780 1 > prepared multipart upload key=D85LJGGU3Z6F upload=71F00HS4Z3RY tag=518W928B86M4 type=write size=3439778 2024-09-22T08:21:05.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.784+0000 7fe6c9c31780 1 < completed delete operation key=W9L87PTJEIOA tag=82W04BAZNTF9 type=del 2024-09-22T08:21:05.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.787+0000 7fe6c9c31780 1 > prepared part key=_multipart_R7UWMW913DJQ.2~W1WPQW15NOZE.0 size=1048576 2024-09-22T08:21:05.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.788+0000 7fe6c9c31780 1 > prepared part key=_multipart_R7UWMW913DJQ.2~W1WPQW15NOZE.1 size=1048576 2024-09-22T08:21:05.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.789+0000 7fe6c9c31780 1 > prepared part key=_multipart_R7UWMW913DJQ.2~W1WPQW15NOZE.2 size=569789 2024-09-22T08:21:05.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.789+0000 7fe6c9c31780 1 > prepared multipart upload key=R7UWMW913DJQ upload=W1WPQW15NOZE tag=857HEGQXREFB type=write size=3715517 2024-09-22T08:21:05.791 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.791+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~27408EZIAEYG.0 size=1048576 2024-09-22T08:21:05.791 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.791+0000 7fe6c9c31780 1 < canceled part key=_multipart_2B5QRUMTVE7U.2~27408EZIAEYG.1 size=1048576 2024-09-22T08:21:05.792 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.792+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~27408EZIAEYG.2 size=240536 2024-09-22T08:21:05.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.795+0000 7fe6c9c31780 1 < canceled multipart upload key=2B5QRUMTVE7U upload=27408EZIAEYG tag=UROWJR3ZHQ0Z type=write size=3386264 2024-09-22T08:21:05.797 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.797+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~OPS326QB9JZI.0 size=1048576 2024-09-22T08:21:05.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.798+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~OPS326QB9JZI.1 size=1048576 2024-09-22T08:21:05.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.799+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~OPS326QB9JZI.2 size=361986 2024-09-22T08:21:05.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.799+0000 7fe6c9c31780 1 > prepared multipart upload key=O1UBUQXP50CN upload=OPS326QB9JZI tag=UUNORNQ8TX5L type=write size=3507714 2024-09-22T08:21:05.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.801+0000 7fe6c9c31780 1 < completed delete operation key=R7UWMW913DJQ tag=U7SS4ZQ5RQJ0 type=del 2024-09-22T08:21:05.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.805+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~2QSA08O2K5CF.0 size=361330 2024-09-22T08:21:05.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.805+0000 7fe6c9c31780 1 > prepared multipart upload key=TYVQ39KUV2V9 upload=2QSA08O2K5CF tag=Q5MYN9PJKQA5 type=write size=1409906 2024-09-22T08:21:05.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.806+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~1LTIO5B1LUHJ.0 size=1048576 2024-09-22T08:21:05.808 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.807+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~1LTIO5B1LUHJ.1 size=1048576 2024-09-22T08:21:05.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.808+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~1LTIO5B1LUHJ.2 size=84116 2024-09-22T08:21:05.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.811+0000 7fe6c9c31780 1 < completed multipart upload key=FY40JTHLT0KU upload=1LTIO5B1LUHJ tag=YAS81DV4Y6OD type=write size=3229844 2024-09-22T08:21:05.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.812+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=98AZMPIU9A5P type=del size=2686787 2024-09-22T08:21:05.816 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.815+0000 7fe6c9c31780 1 < suggested update operation key=O1UBUQXP50CN tag=JT0BPWEA281Z type=del size=2484991 2024-09-22T08:21:05.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.818+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~VZV3AW87PV8V.0 size=750698 2024-09-22T08:21:05.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.818+0000 7fe6c9c31780 1 > prepared multipart upload key=XJP26CCPYDI7 upload=VZV3AW87PV8V tag=JH5AGJZIDH2S type=write size=1799274 2024-09-22T08:21:05.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.819+0000 7fe6c9c31780 1 < completed delete operation key=T2W6RXP9UGHH tag=MUJK4RQ5L90J type=del 2024-09-22T08:21:05.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.823+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~VNJHF6DVYIQQ.0 size=1048576 2024-09-22T08:21:05.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.824+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~VNJHF6DVYIQQ.1 size=1048576 2024-09-22T08:21:05.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.825+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~VNJHF6DVYIQQ.2 size=840073 2024-09-22T08:21:05.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.825+0000 7fe6c9c31780 1 > prepared multipart upload key=JT5AB8VLMEFD upload=VNJHF6DVYIQQ tag=FTRR085TVQBS type=write size=3985801 2024-09-22T08:21:05.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.826+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~OMF2IBQ9B0BF.0 size=1048576 2024-09-22T08:21:05.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.828+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~OMF2IBQ9B0BF.1 size=1048576 2024-09-22T08:21:05.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.829+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~OMF2IBQ9B0BF.2 size=625362 2024-09-22T08:21:05.832 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.832+0000 7fe6c9c31780 1 < completed multipart upload key=76HZ3LZGVT9J upload=OMF2IBQ9B0BF tag=ACN9J3HQZ4RI type=write size=3771090 2024-09-22T08:21:05.833 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.833+0000 7fe6c9c31780 1 > prepared operation key=FY40JTHLT0KU tag=KGPV65CZP30Q type=del size=2648561 2024-09-22T08:21:05.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.834+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~AYWTED4CC0HJ.0 size=1048576 2024-09-22T08:21:05.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.836+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~AYWTED4CC0HJ.1 size=1048576 2024-09-22T08:21:05.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.837+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~AYWTED4CC0HJ.2 size=118434 2024-09-22T08:21:05.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.839+0000 7fe6c9c31780 1 < completed multipart upload key=946H8F2AUPO2 upload=AYWTED4CC0HJ tag=DHBVZK0ZVKIJ type=write size=3264162 2024-09-22T08:21:05.841 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.841+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=G0V94NUASZ8P type=del size=1368075 2024-09-22T08:21:05.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.843+0000 7fe6c9c31780 1 < completed delete operation key=946H8F2AUPO2 tag=N2T8YDJJH61B type=del 2024-09-22T08:21:05.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.846+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~GK6MTWRSS92D.0 size=842418 2024-09-22T08:21:05.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.846+0000 7fe6c9c31780 1 > prepared multipart upload key=GEWQUFB9K35E upload=GK6MTWRSS92D tag=P0BEYQOFAHRA type=write size=1890994 2024-09-22T08:21:05.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.848+0000 7fe6c9c31780 1 < completed delete operation key=7446WN19QFV0 tag=U4HF2T7A36WN type=del 2024-09-22T08:21:05.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.850+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=C7AE0ABRQ68L type=del size=1306769 2024-09-22T08:21:05.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.853+0000 7fe6c9c31780 1 < suggested update operation key=LA6ZRVULGQ0H tag=99HZTKCK3A8P type=del size=3433233 2024-09-22T08:21:05.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.855+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~3M6Y0ZO24HUN.0 size=745599 2024-09-22T08:21:05.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.855+0000 7fe6c9c31780 1 > prepared multipart upload key=0TWY0NNZZ7NN upload=3M6Y0ZO24HUN tag=5JY5IRZ1MX11 type=write size=1794175 2024-09-22T08:21:05.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.857+0000 7fe6c9c31780 1 < completed part key=_multipart_Z1CK5EDBK4AW.2~CN8XAAZ5C8XD.0 size=1048576 2024-09-22T08:21:05.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.858+0000 7fe6c9c31780 1 < completed part key=_multipart_Z1CK5EDBK4AW.2~CN8XAAZ5C8XD.1 size=517313 2024-09-22T08:21:05.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.861+0000 7fe6c9c31780 1 < completed multipart upload key=Z1CK5EDBK4AW upload=CN8XAAZ5C8XD tag=VLE6DOYN5WG4 type=write size=2614465 2024-09-22T08:21:05.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.864+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~55ZJXPBVTXPK.0 size=489455 2024-09-22T08:21:05.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.864+0000 7fe6c9c31780 1 > prepared multipart upload key=D85LJGGU3Z6F upload=55ZJXPBVTXPK tag=RI1J61DWZIXP type=write size=1538031 2024-09-22T08:21:05.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.866+0000 7fe6c9c31780 1 < canceled operation key=0PNK2ZW6IJM1 tag=88DT3K0D4XFH type=del size=1203447 2024-09-22T08:21:05.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.868+0000 7fe6c9c31780 1 > prepared part key=_multipart_W9L87PTJEIOA.2~WTEU1QNEUHAG.0 size=1048576 2024-09-22T08:21:05.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.869+0000 7fe6c9c31780 1 > prepared part key=_multipart_W9L87PTJEIOA.2~WTEU1QNEUHAG.1 size=556854 2024-09-22T08:21:05.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.869+0000 7fe6c9c31780 1 > prepared multipart upload key=W9L87PTJEIOA upload=WTEU1QNEUHAG tag=67BQ7CBHH443 type=write size=2654006 2024-09-22T08:21:05.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.870+0000 7fe6c9c31780 1 < canceled operation key=GEWQUFB9K35E tag=35TQ54Y971VJ type=del size=3018890 2024-09-22T08:21:05.873 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.873+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~HTOMSOWETI5W.0 size=1048576 2024-09-22T08:21:05.874 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.874+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~HTOMSOWETI5W.1 size=1048576 2024-09-22T08:21:05.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.875+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~HTOMSOWETI5W.2 size=305075 2024-09-22T08:21:05.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.875+0000 7fe6c9c31780 1 > prepared multipart upload key=TE10GB1F35X4 upload=HTOMSOWETI5W tag=FFR7QMEH0HZX type=write size=3450803 2024-09-22T08:21:05.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.877+0000 7fe6c9c31780 1 < completed delete operation key=6BKB91YV3FMW tag=HL8WCG3JBYT8 type=del 2024-09-22T08:21:05.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.879+0000 7fe6c9c31780 1 > prepared operation key=O1UBUQXP50CN tag=70ZPQK5WYKXT type=del size=3056801 2024-09-22T08:21:05.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.881+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~71F00HS4Z3RY.0 size=1048576 2024-09-22T08:21:05.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.882+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~71F00HS4Z3RY.1 size=1048576 2024-09-22T08:21:05.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.883+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~71F00HS4Z3RY.2 size=294050 2024-09-22T08:21:05.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.886+0000 7fe6c9c31780 1 < completed multipart upload key=D85LJGGU3Z6F upload=71F00HS4Z3RY tag=518W928B86M4 type=write size=3439778 2024-09-22T08:21:05.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.888+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~Z4BEVODPWR3J.0 size=1048576 2024-09-22T08:21:05.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.890+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~Z4BEVODPWR3J.1 size=468067 2024-09-22T08:21:05.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.890+0000 7fe6c9c31780 1 > prepared multipart upload key=GEWQUFB9K35E upload=Z4BEVODPWR3J tag=V0BHKRFI37PP type=write size=2565219 2024-09-22T08:21:05.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.890+0000 7fe6c9c31780 1 < canceled part key=_multipart_R7UWMW913DJQ.2~W1WPQW15NOZE.0 size=1048576 2024-09-22T08:21:05.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.890+0000 7fe6c9c31780 1 < completed part key=_multipart_R7UWMW913DJQ.2~W1WPQW15NOZE.1 size=1048576 2024-09-22T08:21:05.892 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.892+0000 7fe6c9c31780 1 < completed part key=_multipart_R7UWMW913DJQ.2~W1WPQW15NOZE.2 size=569789 2024-09-22T08:21:05.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.895+0000 7fe6c9c31780 1 < canceled multipart upload key=R7UWMW913DJQ upload=W1WPQW15NOZE tag=857HEGQXREFB type=write size=3715517 2024-09-22T08:21:05.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.896+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=FE3SDTPCSXKT type=write size=781468 2024-09-22T08:21:05.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.898+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~OPS326QB9JZI.0 size=1048576 2024-09-22T08:21:05.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.898+0000 7fe6c9c31780 1 < canceled part key=_multipart_O1UBUQXP50CN.2~OPS326QB9JZI.1 size=1048576 2024-09-22T08:21:05.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.898+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~OPS326QB9JZI.2 size=361986 2024-09-22T08:21:05.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.901+0000 7fe6c9c31780 1 < canceled multipart upload key=O1UBUQXP50CN upload=OPS326QB9JZI tag=UUNORNQ8TX5L type=write size=3507714 2024-09-22T08:21:05.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.904+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~9K48AIDS91ZV.0 size=384862 2024-09-22T08:21:05.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.904+0000 7fe6c9c31780 1 > prepared multipart upload key=DC7VLQWZ3TD1 upload=9K48AIDS91ZV tag=IYA8AXC2YTVN type=write size=1433438 2024-09-22T08:21:05.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.905+0000 7fe6c9c31780 1 < completed part key=_multipart_TYVQ39KUV2V9.2~2QSA08O2K5CF.0 size=361330 2024-09-22T08:21:05.908 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.908+0000 7fe6c9c31780 1 < completed multipart upload key=TYVQ39KUV2V9 upload=2QSA08O2K5CF tag=Q5MYN9PJKQA5 type=write size=1409906 2024-09-22T08:21:05.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.910+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~4Z1AECD9MHM1.0 size=1048576 2024-09-22T08:21:05.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.911+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~4Z1AECD9MHM1.1 size=618206 2024-09-22T08:21:05.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.911+0000 7fe6c9c31780 1 > prepared multipart upload key=OX1LY7URY7IV upload=4Z1AECD9MHM1 tag=NM7E1189PSG6 type=write size=2715358 2024-09-22T08:21:05.914 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.913+0000 7fe6c9c31780 1 < completed delete operation key=946H8F2AUPO2 tag=98AZMPIU9A5P type=del 2024-09-22T08:21:05.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.914+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=JN60HXNO0O1E type=del size=1644467 2024-09-22T08:21:05.917 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.916+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~VZV3AW87PV8V.0 size=750698 2024-09-22T08:21:05.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.919+0000 7fe6c9c31780 1 < completed multipart upload key=XJP26CCPYDI7 upload=VZV3AW87PV8V tag=JH5AGJZIDH2S type=write size=1799274 2024-09-22T08:21:05.921 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.920+0000 7fe6c9c31780 1 > prepared operation key=TYVQ39KUV2V9 tag=XNXKW0CNNC9N type=del size=2943699 2024-09-22T08:21:05.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.922+0000 7fe6c9c31780 1 < completed part key=_multipart_JT5AB8VLMEFD.2~VNJHF6DVYIQQ.0 size=1048576 2024-09-22T08:21:05.923 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.923+0000 7fe6c9c31780 1 < completed part key=_multipart_JT5AB8VLMEFD.2~VNJHF6DVYIQQ.1 size=1048576 2024-09-22T08:21:05.924 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.924+0000 7fe6c9c31780 1 < completed part key=_multipart_JT5AB8VLMEFD.2~VNJHF6DVYIQQ.2 size=840073 2024-09-22T08:21:05.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.926+0000 7fe6c9c31780 1 < completed multipart upload key=JT5AB8VLMEFD upload=VNJHF6DVYIQQ tag=FTRR085TVQBS type=write size=3985801 2024-09-22T08:21:05.930 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.929+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~PNPBO9V9P0UK.0 size=617324 2024-09-22T08:21:05.930 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.929+0000 7fe6c9c31780 1 > prepared multipart upload key=7446WN19QFV0 upload=PNPBO9V9P0UK tag=JIM0U5Z166YP type=write size=1665900 2024-09-22T08:21:05.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.930+0000 7fe6c9c31780 1 < completed delete operation key=FY40JTHLT0KU tag=KGPV65CZP30Q type=del 2024-09-22T08:21:05.932 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.932+0000 7fe6c9c31780 1 > prepared operation key=LA6ZRVULGQ0H tag=R9EU1UAZR42I type=del size=942484 2024-09-22T08:21:05.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.935+0000 7fe6c9c31780 1 < suggested remove operation key=9AZWQ9E58QS6 tag=G0V94NUASZ8P type=del 2024-09-22T08:21:05.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.936+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=Z88M6G4WLL8C type=del size=1148728 2024-09-22T08:21:05.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.936+0000 7fe6c9c31780 1 < canceled part key=_multipart_GEWQUFB9K35E.2~GK6MTWRSS92D.0 size=842418 2024-09-22T08:21:05.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.939+0000 7fe6c9c31780 1 < canceled multipart upload key=GEWQUFB9K35E upload=GK6MTWRSS92D tag=P0BEYQOFAHRA type=write size=1890994 2024-09-22T08:21:05.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.941+0000 7fe6c9c31780 1 > prepared operation key=ZFL9N44PBQX4 tag=KLHYKI7ELI6X type=del size=802535 2024-09-22T08:21:05.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.942+0000 7fe6c9c31780 1 < completed delete operation key=76HZ3LZGVT9J tag=C7AE0ABRQ68L type=del 2024-09-22T08:21:05.945 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.945+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~PM03WSNT7L7U.0 size=1048576 2024-09-22T08:21:05.947 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.946+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~PM03WSNT7L7U.1 size=1048576 2024-09-22T08:21:05.948 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.947+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~PM03WSNT7L7U.2 size=531015 2024-09-22T08:21:05.948 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.947+0000 7fe6c9c31780 1 > prepared multipart upload key=VP1MP4IC9A7T upload=PM03WSNT7L7U tag=SXTF7K4HUXJZ type=write size=3676743 2024-09-22T08:21:05.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.949+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~3M6Y0ZO24HUN.0 size=745599 2024-09-22T08:21:05.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.951+0000 7fe6c9c31780 1 < completed multipart upload key=0TWY0NNZZ7NN upload=3M6Y0ZO24HUN tag=5JY5IRZ1MX11 type=write size=1794175 2024-09-22T08:21:05.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.953+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=YYG3PO2X94LN type=del size=2186935 2024-09-22T08:21:05.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.955+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~55ZJXPBVTXPK.0 size=489455 2024-09-22T08:21:05.957 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.957+0000 7fe6c9c31780 1 < completed multipart upload key=D85LJGGU3Z6F upload=55ZJXPBVTXPK tag=RI1J61DWZIXP type=write size=1538031 2024-09-22T08:21:05.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.960+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~Q713628GRXBK.0 size=1048576 2024-09-22T08:21:05.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.961+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~Q713628GRXBK.1 size=701476 2024-09-22T08:21:05.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.961+0000 7fe6c9c31780 1 > prepared multipart upload key=TYVQ39KUV2V9 upload=Q713628GRXBK tag=SFDTQ18YVELS type=write size=2798628 2024-09-22T08:21:05.963 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.962+0000 7fe6c9c31780 1 < completed part key=_multipart_W9L87PTJEIOA.2~WTEU1QNEUHAG.0 size=1048576 2024-09-22T08:21:05.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.963+0000 7fe6c9c31780 1 < completed part key=_multipart_W9L87PTJEIOA.2~WTEU1QNEUHAG.1 size=556854 2024-09-22T08:21:05.967 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.967+0000 7fe6c9c31780 1 < completed multipart upload key=W9L87PTJEIOA upload=WTEU1QNEUHAG tag=67BQ7CBHH443 type=write size=2654006 2024-09-22T08:21:05.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.969+0000 7fe6c9c31780 1 > prepared operation key=FY40JTHLT0KU tag=27SS8A48428V type=del size=2150209 2024-09-22T08:21:05.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.971+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~HTOMSOWETI5W.0 size=1048576 2024-09-22T08:21:05.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.971+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~HTOMSOWETI5W.1 size=1048576 2024-09-22T08:21:05.973 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.973+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~HTOMSOWETI5W.2 size=305075 2024-09-22T08:21:05.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.975+0000 7fe6c9c31780 1 < completed multipart upload key=TE10GB1F35X4 upload=HTOMSOWETI5W tag=FFR7QMEH0HZX type=write size=3450803 2024-09-22T08:21:05.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.977+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=LFLGDOS27AZ9 type=del size=1792274 2024-09-22T08:21:05.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.978+0000 7fe6c9c31780 1 < completed delete operation key=O1UBUQXP50CN tag=70ZPQK5WYKXT type=del 2024-09-22T08:21:05.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.981+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~UMSZT2LCPL08.0 size=1048576 2024-09-22T08:21:05.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.982+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~UMSZT2LCPL08.1 size=1048576 2024-09-22T08:21:05.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.983+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~UMSZT2LCPL08.2 size=885971 2024-09-22T08:21:05.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.983+0000 7fe6c9c31780 1 > prepared multipart upload key=GEWQUFB9K35E upload=UMSZT2LCPL08 tag=SLJHUF114X3H type=write size=4031699 2024-09-22T08:21:05.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.985+0000 7fe6c9c31780 1 < completed part key=_multipart_GEWQUFB9K35E.2~Z4BEVODPWR3J.0 size=1048576 2024-09-22T08:21:05.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.987+0000 7fe6c9c31780 1 < completed part key=_multipart_GEWQUFB9K35E.2~Z4BEVODPWR3J.1 size=468067 2024-09-22T08:21:05.989 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.989+0000 7fe6c9c31780 1 < completed multipart upload key=GEWQUFB9K35E upload=Z4BEVODPWR3J tag=V0BHKRFI37PP type=write size=2565219 2024-09-22T08:21:05.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.990+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=KD3O0JAGDEVC type=del size=2974326 2024-09-22T08:21:05.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.994+0000 7fe6c9c31780 1 < suggested update operation key=ILW34WLX48WN tag=FE3SDTPCSXKT type=write size=781468 2024-09-22T08:21:05.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.997+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~V013ZSEH1O4K.0 size=1048576 2024-09-22T08:21:05.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.997+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~V013ZSEH1O4K.1 size=1048576 2024-09-22T08:21:05.999 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.999+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~V013ZSEH1O4K.2 size=670047 2024-09-22T08:21:06.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:05.999+0000 7fe6c9c31780 1 > prepared multipart upload key=DC7VLQWZ3TD1 upload=V013ZSEH1O4K tag=SMH4Q0VBE4A2 type=write size=3815775 2024-09-22T08:21:06.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.000+0000 7fe6c9c31780 1 < completed part key=_multipart_DC7VLQWZ3TD1.2~9K48AIDS91ZV.0 size=384862 2024-09-22T08:21:06.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.003+0000 7fe6c9c31780 1 < completed multipart upload key=DC7VLQWZ3TD1 upload=9K48AIDS91ZV tag=IYA8AXC2YTVN type=write size=1433438 2024-09-22T08:21:06.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.006+0000 7fe6c9c31780 1 > prepared operation key=XJP26CCPYDI7 tag=8NHBOKZ3H6AN type=del size=2755573 2024-09-22T08:21:06.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.007+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~4Z1AECD9MHM1.0 size=1048576 2024-09-22T08:21:06.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.008+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~4Z1AECD9MHM1.1 size=618206 2024-09-22T08:21:06.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.010+0000 7fe6c9c31780 1 < completed multipart upload key=OX1LY7URY7IV upload=4Z1AECD9MHM1 tag=NM7E1189PSG6 type=write size=2715358 2024-09-22T08:21:06.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.012+0000 7fe6c9c31780 1 > prepared operation key=W9L87PTJEIOA tag=GFE71W924WES type=del size=533031 2024-09-22T08:21:06.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.015+0000 7fe6c9c31780 1 < completed delete operation key=2B5QRUMTVE7U tag=JN60HXNO0O1E type=del 2024-09-22T08:21:06.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.016+0000 7fe6c9c31780 1 > prepared operation key=4KRJ7DTE3KDV tag=YUZLA36UNFX4 type=del size=4186236 2024-09-22T08:21:06.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.019+0000 7fe6c9c31780 1 < completed delete operation key=TYVQ39KUV2V9 tag=XNXKW0CNNC9N type=del 2024-09-22T08:21:06.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.020+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=QERKWHE01V74 type=del size=3140468 2024-09-22T08:21:06.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.022+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~PNPBO9V9P0UK.0 size=617324 2024-09-22T08:21:06.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.024+0000 7fe6c9c31780 1 < completed multipart upload key=7446WN19QFV0 upload=PNPBO9V9P0UK tag=JIM0U5Z166YP type=write size=1665900 2024-09-22T08:21:06.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.026+0000 7fe6c9c31780 1 > prepared operation key=D85LJGGU3Z6F tag=8H3VNXL2ANV3 type=del size=2644541 2024-09-22T08:21:06.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.028+0000 7fe6c9c31780 1 < suggested remove operation key=LA6ZRVULGQ0H tag=R9EU1UAZR42I type=del 2024-09-22T08:21:06.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.031+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~1A7WGUKEYHDW.0 size=1048576 2024-09-22T08:21:06.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.032+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~1A7WGUKEYHDW.1 size=736875 2024-09-22T08:21:06.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.032+0000 7fe6c9c31780 1 > prepared multipart upload key=CTK01Y0CV1NC upload=1A7WGUKEYHDW tag=Q1HEWMPODNRY type=write size=2834027 2024-09-22T08:21:06.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.034+0000 7fe6c9c31780 1 < canceled operation key=R7UWMW913DJQ tag=Z88M6G4WLL8C type=del size=1148728 2024-09-22T08:21:06.036 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.036+0000 7fe6c9c31780 1 > prepared operation key=W9L87PTJEIOA tag=M29G2SGNTMAE type=del size=1735713 2024-09-22T08:21:06.038 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.037+0000 7fe6c9c31780 1 < completed delete operation key=ZFL9N44PBQX4 tag=KLHYKI7ELI6X type=del 2024-09-22T08:21:06.040 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.039+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~TPKOWDHZU510.0 size=765235 2024-09-22T08:21:06.040 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.039+0000 7fe6c9c31780 1 > prepared multipart upload key=OX1LY7URY7IV upload=TPKOWDHZU510 tag=HQG84AZW12ON type=write size=1813811 2024-09-22T08:21:06.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.041+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~PM03WSNT7L7U.0 size=1048576 2024-09-22T08:21:06.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.042+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~PM03WSNT7L7U.1 size=1048576 2024-09-22T08:21:06.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.042+0000 7fe6c9c31780 1 < canceled part key=_multipart_VP1MP4IC9A7T.2~PM03WSNT7L7U.2 size=531015 2024-09-22T08:21:06.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.046+0000 7fe6c9c31780 1 < canceled multipart upload key=VP1MP4IC9A7T upload=PM03WSNT7L7U tag=SXTF7K4HUXJZ type=write size=3676743 2024-09-22T08:21:06.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.046+0000 7fe6c9c31780 1 > prepared operation key=KZIY400KQ5NH tag=YLEYNZQGR6W7 type=del size=1982752 2024-09-22T08:21:06.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.048+0000 7fe6c9c31780 1 < completed delete operation key=7446WN19QFV0 tag=YYG3PO2X94LN type=del 2024-09-22T08:21:06.051 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.051+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~I0CQU8KWNSQR.0 size=1048576 2024-09-22T08:21:06.053 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.052+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~I0CQU8KWNSQR.1 size=1023897 2024-09-22T08:21:06.053 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.052+0000 7fe6c9c31780 1 > prepared multipart upload key=4KRJ7DTE3KDV upload=I0CQU8KWNSQR tag=HBXT67IPM5QD type=write size=3121049 2024-09-22T08:21:06.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.053+0000 7fe6c9c31780 1 < completed part key=_multipart_TYVQ39KUV2V9.2~Q713628GRXBK.0 size=1048576 2024-09-22T08:21:06.055 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.054+0000 7fe6c9c31780 1 < completed part key=_multipart_TYVQ39KUV2V9.2~Q713628GRXBK.1 size=701476 2024-09-22T08:21:06.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.057+0000 7fe6c9c31780 1 < completed multipart upload key=TYVQ39KUV2V9 upload=Q713628GRXBK tag=SFDTQ18YVELS type=write size=2798628 2024-09-22T08:21:06.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.060+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~KWIGKCV372V2.0 size=801251 2024-09-22T08:21:06.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.060+0000 7fe6c9c31780 1 > prepared multipart upload key=TYVQ39KUV2V9 upload=KWIGKCV372V2 tag=NU39VEOMXWSA type=write size=1849827 2024-09-22T08:21:06.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.062+0000 7fe6c9c31780 1 < completed delete operation key=FY40JTHLT0KU tag=27SS8A48428V type=del 2024-09-22T08:21:06.065 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.064+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~N5OM208HOVFG.0 size=1048576 2024-09-22T08:21:06.066 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.065+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~N5OM208HOVFG.1 size=810551 2024-09-22T08:21:06.066 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.065+0000 7fe6c9c31780 1 > prepared multipart upload key=0PNK2ZW6IJM1 upload=N5OM208HOVFG tag=8P43B7I0C03N type=write size=2907703 2024-09-22T08:21:06.067 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.067+0000 7fe6c9c31780 1 < completed delete operation key=DC7VLQWZ3TD1 tag=LFLGDOS27AZ9 type=del 2024-09-22T08:21:06.070 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.069+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~EAAVPL5S4XXQ.0 size=1048576 2024-09-22T08:21:06.071 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.071+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~EAAVPL5S4XXQ.1 size=1048576 2024-09-22T08:21:06.072 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.072+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~EAAVPL5S4XXQ.2 size=470625 2024-09-22T08:21:06.072 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.072+0000 7fe6c9c31780 1 > prepared multipart upload key=FY40JTHLT0KU upload=EAAVPL5S4XXQ tag=XNDMHB1V0ABP type=write size=3616353 2024-09-22T08:21:06.074 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.073+0000 7fe6c9c31780 1 < completed part key=_multipart_GEWQUFB9K35E.2~UMSZT2LCPL08.0 size=1048576 2024-09-22T08:21:06.075 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.074+0000 7fe6c9c31780 1 < completed part key=_multipart_GEWQUFB9K35E.2~UMSZT2LCPL08.1 size=1048576 2024-09-22T08:21:06.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.076+0000 7fe6c9c31780 1 < completed part key=_multipart_GEWQUFB9K35E.2~UMSZT2LCPL08.2 size=885971 2024-09-22T08:21:06.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.077+0000 7fe6c9c31780 1 < completed multipart upload key=GEWQUFB9K35E upload=UMSZT2LCPL08 tag=SLJHUF114X3H type=write size=4031699 2024-09-22T08:21:06.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.079+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=Z1IJKRHQLWVS type=del size=490537 2024-09-22T08:21:06.081 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.080+0000 7fe6c9c31780 1 < completed delete operation key=9AZWQ9E58QS6 tag=KD3O0JAGDEVC type=del 2024-09-22T08:21:06.083 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.082+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~NEQHSSG5GVZR.0 size=594114 2024-09-22T08:21:06.083 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.082+0000 7fe6c9c31780 1 > prepared multipart upload key=LA6ZRVULGQ0H upload=NEQHSSG5GVZR tag=LCTFE9TMYDVL type=write size=1642690 2024-09-22T08:21:06.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.084+0000 7fe6c9c31780 1 < completed part key=_multipart_DC7VLQWZ3TD1.2~V013ZSEH1O4K.0 size=1048576 2024-09-22T08:21:06.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.084+0000 7fe6c9c31780 1 < canceled part key=_multipart_DC7VLQWZ3TD1.2~V013ZSEH1O4K.1 size=1048576 2024-09-22T08:21:06.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.085+0000 7fe6c9c31780 1 < completed part key=_multipart_DC7VLQWZ3TD1.2~V013ZSEH1O4K.2 size=670047 2024-09-22T08:21:06.088 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.087+0000 7fe6c9c31780 1 < canceled multipart upload key=DC7VLQWZ3TD1 upload=V013ZSEH1O4K tag=SMH4Q0VBE4A2 type=write size=3815775 2024-09-22T08:21:06.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.088+0000 7fe6c9c31780 1 > prepared operation key=Z1CK5EDBK4AW tag=W8SBTJ0UZSIP type=del size=2412500 2024-09-22T08:21:06.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.091+0000 7fe6c9c31780 1 < suggested remove operation key=XJP26CCPYDI7 tag=8NHBOKZ3H6AN type=del 2024-09-22T08:21:06.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.094+0000 7fe6c9c31780 1 > prepared operation key=XJP26CCPYDI7 tag=RM05G5ID6W1L type=del size=2512880 2024-09-22T08:21:06.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.094+0000 7fe6c9c31780 1 < completed delete operation key=W9L87PTJEIOA tag=GFE71W924WES type=del 2024-09-22T08:21:06.098 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.097+0000 7fe6c9c31780 1 > prepared part key=_multipart_TJTB67QBLZH5.2~Z9EAWQ1JX348.0 size=1048576 2024-09-22T08:21:06.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.099+0000 7fe6c9c31780 1 > prepared part key=_multipart_TJTB67QBLZH5.2~Z9EAWQ1JX348.1 size=18023 2024-09-22T08:21:06.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.099+0000 7fe6c9c31780 1 > prepared multipart upload key=TJTB67QBLZH5 upload=Z9EAWQ1JX348 tag=LCY2QHRPKR5C type=write size=2115175 2024-09-22T08:21:06.102 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.101+0000 7fe6c9c31780 1 < suggested update operation key=4KRJ7DTE3KDV tag=YUZLA36UNFX4 type=del size=4186236 2024-09-22T08:21:06.103 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.103+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=FCTLLLKDQ89T type=del size=181250 2024-09-22T08:21:06.105 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.104+0000 7fe6c9c31780 1 < completed delete operation key=T2W6RXP9UGHH tag=QERKWHE01V74 type=del 2024-09-22T08:21:06.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.107+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~Z4U0YXF83PVA.0 size=1048576 2024-09-22T08:21:06.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.108+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~Z4U0YXF83PVA.1 size=1048576 2024-09-22T08:21:06.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.109+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~Z4U0YXF83PVA.2 size=402557 2024-09-22T08:21:06.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.109+0000 7fe6c9c31780 1 > prepared multipart upload key=LA6ZRVULGQ0H upload=Z4U0YXF83PVA tag=EPVMYUBFI6KQ type=write size=3548285 2024-09-22T08:21:06.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.110+0000 7fe6c9c31780 1 < completed delete operation key=D85LJGGU3Z6F tag=8H3VNXL2ANV3 type=del 2024-09-22T08:21:06.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.113+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~QF8VPC4ETIFK.0 size=1048576 2024-09-22T08:21:06.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.114+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~QF8VPC4ETIFK.1 size=321005 2024-09-22T08:21:06.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.114+0000 7fe6c9c31780 1 > prepared multipart upload key=Z1CK5EDBK4AW upload=QF8VPC4ETIFK tag=ZFY25NJ861H5 type=write size=2418157 2024-09-22T08:21:06.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.115+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~1A7WGUKEYHDW.0 size=1048576 2024-09-22T08:21:06.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.117+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~1A7WGUKEYHDW.1 size=736875 2024-09-22T08:21:06.119 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.119+0000 7fe6c9c31780 1 < completed multipart upload key=CTK01Y0CV1NC upload=1A7WGUKEYHDW tag=Q1HEWMPODNRY type=write size=2834027 2024-09-22T08:21:06.121 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.120+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=FLRGONXQ35G9 type=write size=286259 2024-09-22T08:21:06.122 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.121+0000 7fe6c9c31780 1 < completed delete operation key=W9L87PTJEIOA tag=M29G2SGNTMAE type=del 2024-09-22T08:21:06.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.124+0000 7fe6c9c31780 1 > prepared part key=_multipart_W9L87PTJEIOA.2~ABKQSQ0YZO0B.0 size=1048576 2024-09-22T08:21:06.126 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.125+0000 7fe6c9c31780 1 > prepared part key=_multipart_W9L87PTJEIOA.2~ABKQSQ0YZO0B.1 size=550793 2024-09-22T08:21:06.126 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.125+0000 7fe6c9c31780 1 > prepared multipart upload key=W9L87PTJEIOA upload=ABKQSQ0YZO0B tag=0NYPRFH392V3 type=write size=2647945 2024-09-22T08:21:06.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.126+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~TPKOWDHZU510.0 size=765235 2024-09-22T08:21:06.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.129+0000 7fe6c9c31780 1 < completed multipart upload key=OX1LY7URY7IV upload=TPKOWDHZU510 tag=HQG84AZW12ON type=write size=1813811 2024-09-22T08:21:06.131 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.130+0000 7fe6c9c31780 1 > prepared operation key=VP1MP4IC9A7T tag=IYLULWO82UHW type=del size=3732830 2024-09-22T08:21:06.132 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.132+0000 7fe6c9c31780 1 < completed delete operation key=KZIY400KQ5NH tag=YLEYNZQGR6W7 type=del 2024-09-22T08:21:06.134 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.133+0000 7fe6c9c31780 1 > prepared operation key=VP1MP4IC9A7T tag=TJRD6PCW8ZUL type=del size=612958 2024-09-22T08:21:06.135 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.135+0000 7fe6c9c31780 1 < completed part key=_multipart_4KRJ7DTE3KDV.2~I0CQU8KWNSQR.0 size=1048576 2024-09-22T08:21:06.137 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.136+0000 7fe6c9c31780 1 < completed part key=_multipart_4KRJ7DTE3KDV.2~I0CQU8KWNSQR.1 size=1023897 2024-09-22T08:21:06.139 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.138+0000 7fe6c9c31780 1 < completed multipart upload key=4KRJ7DTE3KDV upload=I0CQU8KWNSQR tag=HBXT67IPM5QD type=write size=3121049 2024-09-22T08:21:06.140 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.140+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=0KGZN9CBNY5A type=del size=941044 2024-09-22T08:21:06.142 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.141+0000 7fe6c9c31780 1 < completed part key=_multipart_TYVQ39KUV2V9.2~KWIGKCV372V2.0 size=801251 2024-09-22T08:21:06.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.144+0000 7fe6c9c31780 1 < completed multipart upload key=TYVQ39KUV2V9 upload=KWIGKCV372V2 tag=NU39VEOMXWSA type=write size=1849827 2024-09-22T08:21:06.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.146+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=GBZQNG564DA4 type=write size=799376 2024-09-22T08:21:06.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.147+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~N5OM208HOVFG.0 size=1048576 2024-09-22T08:21:06.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.148+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~N5OM208HOVFG.1 size=810551 2024-09-22T08:21:06.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.152+0000 7fe6c9c31780 1 < completed multipart upload key=0PNK2ZW6IJM1 upload=N5OM208HOVFG tag=8P43B7I0C03N type=write size=2907703 2024-09-22T08:21:06.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.154+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~CWKMW29MREMM.0 size=1048576 2024-09-22T08:21:06.156 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.156+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~CWKMW29MREMM.1 size=1048576 2024-09-22T08:21:06.157 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.157+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~CWKMW29MREMM.2 size=873172 2024-09-22T08:21:06.157 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.157+0000 7fe6c9c31780 1 > prepared multipart upload key=ILW34WLX48WN upload=CWKMW29MREMM tag=A6DE9JZZOOA9 type=write size=4018900 2024-09-22T08:21:06.159 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.158+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~EAAVPL5S4XXQ.0 size=1048576 2024-09-22T08:21:06.160 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.159+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~EAAVPL5S4XXQ.1 size=1048576 2024-09-22T08:21:06.161 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.160+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~EAAVPL5S4XXQ.2 size=470625 2024-09-22T08:21:06.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.163+0000 7fe6c9c31780 1 < completed multipart upload key=FY40JTHLT0KU upload=EAAVPL5S4XXQ tag=XNDMHB1V0ABP type=write size=3616353 2024-09-22T08:21:06.165 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.164+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=KF9RQ0FDBF5A type=del size=2521290 2024-09-22T08:21:06.166 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.166+0000 7fe6c9c31780 1 < completed delete operation key=9AZWQ9E58QS6 tag=Z1IJKRHQLWVS type=del 2024-09-22T08:21:06.169 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.169+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~OTO9KNRI33L5.0 size=351178 2024-09-22T08:21:06.169 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.169+0000 7fe6c9c31780 1 > prepared multipart upload key=CTK01Y0CV1NC upload=OTO9KNRI33L5 tag=PU8QGG7N6AV2 type=write size=1399754 2024-09-22T08:21:06.169 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.169+0000 7fe6c9c31780 1 < canceled part key=_multipart_LA6ZRVULGQ0H.2~NEQHSSG5GVZR.0 size=594114 2024-09-22T08:21:06.171 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.171+0000 7fe6c9c31780 1 < canceled multipart upload key=LA6ZRVULGQ0H upload=NEQHSSG5GVZR tag=LCTFE9TMYDVL type=write size=1642690 2024-09-22T08:21:06.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.173+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~ZPKK9OB9FZ5Z.0 size=1048576 2024-09-22T08:21:06.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.175+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~ZPKK9OB9FZ5Z.1 size=1048576 2024-09-22T08:21:06.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.175+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~ZPKK9OB9FZ5Z.2 size=756732 2024-09-22T08:21:06.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.175+0000 7fe6c9c31780 1 > prepared multipart upload key=O1UBUQXP50CN upload=ZPKK9OB9FZ5Z tag=L12DK2G8WI1V type=write size=3902460 2024-09-22T08:21:06.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.177+0000 7fe6c9c31780 1 < canceled operation key=Z1CK5EDBK4AW tag=W8SBTJ0UZSIP type=del size=2412500 2024-09-22T08:21:06.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.178+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=JK8K7X2WFW7Z type=del size=180299 2024-09-22T08:21:06.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.180+0000 7fe6c9c31780 1 < canceled operation key=XJP26CCPYDI7 tag=RM05G5ID6W1L type=del size=2512880 2024-09-22T08:21:06.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.181+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=R8E3PN0SDI1K type=del size=1112399 2024-09-22T08:21:06.183 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.183+0000 7fe6c9c31780 1 < completed part key=_multipart_TJTB67QBLZH5.2~Z9EAWQ1JX348.0 size=1048576 2024-09-22T08:21:06.185 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.184+0000 7fe6c9c31780 1 < completed part key=_multipart_TJTB67QBLZH5.2~Z9EAWQ1JX348.1 size=18023 2024-09-22T08:21:06.187 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.186+0000 7fe6c9c31780 1 < completed multipart upload key=TJTB67QBLZH5 upload=Z9EAWQ1JX348 tag=LCY2QHRPKR5C type=write size=2115175 2024-09-22T08:21:06.189 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.189+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~IV0ABXYHZ1CM.0 size=1048576 2024-09-22T08:21:06.190 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.190+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~IV0ABXYHZ1CM.1 size=1048576 2024-09-22T08:21:06.191 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.191+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~IV0ABXYHZ1CM.2 size=430342 2024-09-22T08:21:06.191 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.191+0000 7fe6c9c31780 1 > prepared multipart upload key=D85LJGGU3Z6F upload=IV0ABXYHZ1CM tag=4O82LHO0F2HB type=write size=3576070 2024-09-22T08:21:06.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.192+0000 7fe6c9c31780 1 < completed delete operation key=2B5QRUMTVE7U tag=FCTLLLKDQ89T type=del 2024-09-22T08:21:06.195 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.195+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~61959RYK10JK.0 size=559944 2024-09-22T08:21:06.195 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.195+0000 7fe6c9c31780 1 > prepared multipart upload key=CTK01Y0CV1NC upload=61959RYK10JK tag=1RPR67RSKOD0 type=write size=1608520 2024-09-22T08:21:06.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.196+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~Z4U0YXF83PVA.0 size=1048576 2024-09-22T08:21:06.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.198+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~Z4U0YXF83PVA.1 size=1048576 2024-09-22T08:21:06.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.198+0000 7fe6c9c31780 1 < canceled part key=_multipart_LA6ZRVULGQ0H.2~Z4U0YXF83PVA.2 size=402557 2024-09-22T08:21:06.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.200+0000 7fe6c9c31780 1 < canceled multipart upload key=LA6ZRVULGQ0H upload=Z4U0YXF83PVA tag=EPVMYUBFI6KQ type=write size=3548285 2024-09-22T08:21:06.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.202+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=Y6JS8XMJBLFX type=del size=140808 2024-09-22T08:21:06.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.203+0000 7fe6c9c31780 1 < completed part key=_multipart_Z1CK5EDBK4AW.2~QF8VPC4ETIFK.0 size=1048576 2024-09-22T08:21:06.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.203+0000 7fe6c9c31780 1 < canceled part key=_multipart_Z1CK5EDBK4AW.2~QF8VPC4ETIFK.1 size=321005 2024-09-22T08:21:06.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.206+0000 7fe6c9c31780 1 < canceled multipart upload key=Z1CK5EDBK4AW upload=QF8VPC4ETIFK tag=ZFY25NJ861H5 type=write size=2418157 2024-09-22T08:21:06.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.207+0000 7fe6c9c31780 1 > prepared operation key=FY40JTHLT0KU tag=KOOIL1ECY17N type=del size=1839075 2024-09-22T08:21:06.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.208+0000 7fe6c9c31780 1 < completed write operation key=2B5QRUMTVE7U tag=FLRGONXQ35G9 type=write size=286259 2024-09-22T08:21:06.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.211+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~0FLEPZ8FAI15.0 size=536238 2024-09-22T08:21:06.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.211+0000 7fe6c9c31780 1 > prepared multipart upload key=2B5QRUMTVE7U upload=0FLEPZ8FAI15 tag=D11Z1D2HIJ3I type=write size=1584814 2024-09-22T08:21:06.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.212+0000 7fe6c9c31780 1 < completed part key=_multipart_W9L87PTJEIOA.2~ABKQSQ0YZO0B.0 size=1048576 2024-09-22T08:21:06.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.212+0000 7fe6c9c31780 1 < canceled part key=_multipart_W9L87PTJEIOA.2~ABKQSQ0YZO0B.1 size=550793 2024-09-22T08:21:06.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.215+0000 7fe6c9c31780 1 < canceled multipart upload key=W9L87PTJEIOA upload=ABKQSQ0YZO0B tag=0NYPRFH392V3 type=write size=2647945 2024-09-22T08:21:06.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.216+0000 7fe6c9c31780 1 > prepared operation key=FY40JTHLT0KU tag=D0NMDZG0MO6C type=del size=3140406 2024-09-22T08:21:06.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.218+0000 7fe6c9c31780 1 < completed delete operation key=VP1MP4IC9A7T tag=IYLULWO82UHW type=del 2024-09-22T08:21:06.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.219+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=YBP6EQD8DU5M type=del size=2648329 2024-09-22T08:21:06.221 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.220+0000 7fe6c9c31780 1 < completed delete operation key=VP1MP4IC9A7T tag=TJRD6PCW8ZUL type=del 2024-09-22T08:21:06.222 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.222+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=MPEIG70ZDI4Q type=write size=529037 2024-09-22T08:21:06.224 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.223+0000 7fe6c9c31780 1 < completed delete operation key=2B5QRUMTVE7U tag=0KGZN9CBNY5A type=del 2024-09-22T08:21:06.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.224+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=QSM9K8ZAYZDJ type=del size=1964929 2024-09-22T08:21:06.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.228+0000 7fe6c9c31780 1 < suggested remove operation key=ILW34WLX48WN tag=GBZQNG564DA4 type=write 2024-09-22T08:21:06.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.229+0000 7fe6c9c31780 1 > prepared operation key=1HZ0NAJPXNW1 tag=2RW5MTGI3OTI type=del size=812129 2024-09-22T08:21:06.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.230+0000 7fe6c9c31780 1 < completed part key=_multipart_ILW34WLX48WN.2~CWKMW29MREMM.0 size=1048576 2024-09-22T08:21:06.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.231+0000 7fe6c9c31780 1 < completed part key=_multipart_ILW34WLX48WN.2~CWKMW29MREMM.1 size=1048576 2024-09-22T08:21:06.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.232+0000 7fe6c9c31780 1 < completed part key=_multipart_ILW34WLX48WN.2~CWKMW29MREMM.2 size=873172 2024-09-22T08:21:06.236 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.235+0000 7fe6c9c31780 1 < completed multipart upload key=ILW34WLX48WN upload=CWKMW29MREMM tag=A6DE9JZZOOA9 type=write size=4018900 2024-09-22T08:21:06.237 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.236+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=PTB8Y7J2XWXS type=del size=1023135 2024-09-22T08:21:06.238 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.238+0000 7fe6c9c31780 1 < completed delete operation key=T2W6RXP9UGHH tag=KF9RQ0FDBF5A type=del 2024-09-22T08:21:06.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.240+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~Z7H15I000X06.0 size=1048576 2024-09-22T08:21:06.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.241+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~Z7H15I000X06.1 size=875651 2024-09-22T08:21:06.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.241+0000 7fe6c9c31780 1 > prepared multipart upload key=O1UBUQXP50CN upload=Z7H15I000X06 tag=Q1K30BZBIH2F type=write size=2972803 2024-09-22T08:21:06.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.242+0000 7fe6c9c31780 1 < canceled part key=_multipart_CTK01Y0CV1NC.2~OTO9KNRI33L5.0 size=351178 2024-09-22T08:21:06.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.244+0000 7fe6c9c31780 1 < canceled multipart upload key=CTK01Y0CV1NC upload=OTO9KNRI33L5 tag=PU8QGG7N6AV2 type=write size=1399754 2024-09-22T08:21:06.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.245+0000 7fe6c9c31780 1 > prepared operation key=JT5AB8VLMEFD tag=7RLCM4TVJ01X type=write size=946064 2024-09-22T08:21:06.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.247+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~ZPKK9OB9FZ5Z.0 size=1048576 2024-09-22T08:21:06.248 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.248+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~ZPKK9OB9FZ5Z.1 size=1048576 2024-09-22T08:21:06.249 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.249+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~ZPKK9OB9FZ5Z.2 size=756732 2024-09-22T08:21:06.252 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.252+0000 7fe6c9c31780 1 < completed multipart upload key=O1UBUQXP50CN upload=ZPKK9OB9FZ5Z tag=L12DK2G8WI1V type=write size=3902460 2024-09-22T08:21:06.254 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.254+0000 7fe6c9c31780 1 > prepared part key=_multipart_ZFL9N44PBQX4.2~QR76QAY8SX6C.0 size=293653 2024-09-22T08:21:06.254 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.254+0000 7fe6c9c31780 1 > prepared multipart upload key=ZFL9N44PBQX4 upload=QR76QAY8SX6C tag=5118QQ1HBRW0 type=write size=1342229 2024-09-22T08:21:06.256 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.255+0000 7fe6c9c31780 1 < completed delete operation key=CTK01Y0CV1NC tag=JK8K7X2WFW7Z type=del 2024-09-22T08:21:06.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.258+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~6DYMSO6WODNX.0 size=1048576 2024-09-22T08:21:06.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.259+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~6DYMSO6WODNX.1 size=75529 2024-09-22T08:21:06.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.259+0000 7fe6c9c31780 1 > prepared multipart upload key=76HZ3LZGVT9J upload=6DYMSO6WODNX tag=FQGBQES19JLE type=write size=2172681 2024-09-22T08:21:06.262 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.262+0000 7fe6c9c31780 1 < suggested update operation key=946H8F2AUPO2 tag=R8E3PN0SDI1K type=del size=1112399 2024-09-22T08:21:06.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.264+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~G5NPCCCQQU9E.0 size=1048576 2024-09-22T08:21:06.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.265+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~G5NPCCCQQU9E.1 size=337512 2024-09-22T08:21:06.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.265+0000 7fe6c9c31780 1 > prepared multipart upload key=CTK01Y0CV1NC upload=G5NPCCCQQU9E tag=HTAT76VEUFEW type=write size=2434664 2024-09-22T08:21:06.267 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.267+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~IV0ABXYHZ1CM.0 size=1048576 2024-09-22T08:21:06.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.268+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~IV0ABXYHZ1CM.1 size=1048576 2024-09-22T08:21:06.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.269+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~IV0ABXYHZ1CM.2 size=430342 2024-09-22T08:21:06.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.271+0000 7fe6c9c31780 1 < completed multipart upload key=D85LJGGU3Z6F upload=IV0ABXYHZ1CM tag=4O82LHO0F2HB type=write size=3576070 2024-09-22T08:21:06.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.274+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~0XV0O7CHQNOO.0 size=364820 2024-09-22T08:21:06.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.274+0000 7fe6c9c31780 1 > prepared multipart upload key=CTK01Y0CV1NC upload=0XV0O7CHQNOO tag=1Y6P5GLWLIOP type=write size=1413396 2024-09-22T08:21:06.276 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.275+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~61959RYK10JK.0 size=559944 2024-09-22T08:21:06.278 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.278+0000 7fe6c9c31780 1 < completed multipart upload key=CTK01Y0CV1NC upload=61959RYK10JK tag=1RPR67RSKOD0 type=write size=1608520 2024-09-22T08:21:06.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.282+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~7UUKFPS5HE5D.0 size=1048576 2024-09-22T08:21:06.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.283+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~7UUKFPS5HE5D.1 size=607991 2024-09-22T08:21:06.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.283+0000 7fe6c9c31780 1 > prepared multipart upload key=6BKB91YV3FMW upload=7UUKFPS5HE5D tag=W51Y4GYXMGCZ type=write size=2705143 2024-09-22T08:21:06.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.284+0000 7fe6c9c31780 1 < completed delete operation key=6BKB91YV3FMW tag=Y6JS8XMJBLFX type=del 2024-09-22T08:21:06.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.287+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~MF72IQDSAB9Y.0 size=1048576 2024-09-22T08:21:06.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.288+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~MF72IQDSAB9Y.1 size=1048576 2024-09-22T08:21:06.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.289+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~MF72IQDSAB9Y.2 size=883788 2024-09-22T08:21:06.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.289+0000 7fe6c9c31780 1 > prepared multipart upload key=76HZ3LZGVT9J upload=MF72IQDSAB9Y tag=N7NB5AEG89UH type=write size=4029516 2024-09-22T08:21:06.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.292+0000 7fe6c9c31780 1 < suggested update operation key=FY40JTHLT0KU tag=KOOIL1ECY17N type=del size=1839075 2024-09-22T08:21:06.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.294+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~CYUTKYVVMJOS.0 size=577718 2024-09-22T08:21:06.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.294+0000 7fe6c9c31780 1 > prepared multipart upload key=TE10GB1F35X4 upload=CYUTKYVVMJOS tag=KDZPKU35YMIT type=write size=1626294 2024-09-22T08:21:06.297 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.297+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~0FLEPZ8FAI15.0 size=536238 2024-09-22T08:21:06.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.298+0000 7fe6c9c31780 1 < completed multipart upload key=2B5QRUMTVE7U upload=0FLEPZ8FAI15 tag=D11Z1D2HIJ3I type=write size=1584814 2024-09-22T08:21:06.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.300+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=V2EA7AQIFNOS type=del size=2004796 2024-09-22T08:21:06.302 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.302+0000 7fe6c9c31780 -1 < failed to complete operation key=FY40JTHLT0KU tag=D0NMDZG0MO6C type=del size=3140406: (22) Invalid argument 2024-09-22T08:21:06.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.304+0000 7fe6c9c31780 1 > prepared operation key=4KRJ7DTE3KDV tag=YXJUTI5MMXCI type=del size=965511 2024-09-22T08:21:06.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.305+0000 7fe6c9c31780 1 < completed delete operation key=DC7VLQWZ3TD1 tag=YBP6EQD8DU5M type=del 2024-09-22T08:21:06.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.308+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~FZJXTCI22N3J.0 size=1048576 2024-09-22T08:21:06.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.309+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~FZJXTCI22N3J.1 size=1048576 2024-09-22T08:21:06.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.310+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~FZJXTCI22N3J.2 size=416627 2024-09-22T08:21:06.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.310+0000 7fe6c9c31780 1 > prepared multipart upload key=Z1CK5EDBK4AW upload=FZJXTCI22N3J tag=P242UCN1VY8D type=write size=3562355 2024-09-22T08:21:06.312 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.311+0000 7fe6c9c31780 1 < completed write operation key=TE10GB1F35X4 tag=MPEIG70ZDI4Q type=write size=529037 2024-09-22T08:21:06.313 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.313+0000 7fe6c9c31780 1 > prepared operation key=ZFL9N44PBQX4 tag=7ABM6291JII0 type=del size=1776389 2024-09-22T08:21:06.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.316+0000 7fe6c9c31780 1 < suggested remove operation key=DC7VLQWZ3TD1 tag=QSM9K8ZAYZDJ type=del 2024-09-22T08:21:06.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.318+0000 7fe6c9c31780 1 > prepared operation key=KZIY400KQ5NH tag=MQ02B5VSPWH6 type=del size=1878134 2024-09-22T08:21:06.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.321+0000 7fe6c9c31780 1 < suggested update operation key=1HZ0NAJPXNW1 tag=2RW5MTGI3OTI type=del size=812129 2024-09-22T08:21:06.323 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.323+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~7R8X8J6VB26Q.0 size=1048576 2024-09-22T08:21:06.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.324+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~7R8X8J6VB26Q.1 size=1048576 2024-09-22T08:21:06.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.325+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~7R8X8J6VB26Q.2 size=427118 2024-09-22T08:21:06.326 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.325+0000 7fe6c9c31780 1 > prepared multipart upload key=Z1CK5EDBK4AW upload=7R8X8J6VB26Q tag=3STZUL12YAPT type=write size=3572846 2024-09-22T08:21:06.327 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.326+0000 7fe6c9c31780 1 < completed delete operation key=R7UWMW913DJQ tag=PTB8Y7J2XWXS type=del 2024-09-22T08:21:06.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.328+0000 7fe6c9c31780 1 > prepared operation key=JT5AB8VLMEFD tag=7TAQI7PM08TI type=del size=4160579 2024-09-22T08:21:06.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.329+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~Z7H15I000X06.0 size=1048576 2024-09-22T08:21:06.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.331+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~Z7H15I000X06.1 size=875651 2024-09-22T08:21:06.334 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.333+0000 7fe6c9c31780 1 < completed multipart upload key=O1UBUQXP50CN upload=Z7H15I000X06 tag=Q1K30BZBIH2F type=write size=2972803 2024-09-22T08:21:06.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.335+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=RCLP2XNPG8N6 type=del size=2578892 2024-09-22T08:21:06.336 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.336+0000 7fe6c9c31780 1 < completed write operation key=JT5AB8VLMEFD tag=7RLCM4TVJ01X type=write size=946064 2024-09-22T08:21:06.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.337+0000 7fe6c9c31780 1 > prepared operation key=W9L87PTJEIOA tag=778YBWY8WQ83 type=del size=1302400 2024-09-22T08:21:06.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.339+0000 7fe6c9c31780 1 < completed part key=_multipart_ZFL9N44PBQX4.2~QR76QAY8SX6C.0 size=293653 2024-09-22T08:21:06.342 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.342+0000 7fe6c9c31780 1 < completed multipart upload key=ZFL9N44PBQX4 upload=QR76QAY8SX6C tag=5118QQ1HBRW0 type=write size=1342229 2024-09-22T08:21:06.343 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.342+0000 7fe6c9c31780 1 > prepared operation key=GEWQUFB9K35E tag=7LYAY1TADOOU type=del size=2433980 2024-09-22T08:21:06.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.344+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~6DYMSO6WODNX.0 size=1048576 2024-09-22T08:21:06.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.346+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~6DYMSO6WODNX.1 size=75529 2024-09-22T08:21:06.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.348+0000 7fe6c9c31780 1 < completed multipart upload key=76HZ3LZGVT9J upload=6DYMSO6WODNX tag=FQGBQES19JLE type=write size=2172681 2024-09-22T08:21:06.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.351+0000 7fe6c9c31780 1 > prepared part key=_multipart_TJTB67QBLZH5.2~XQ42KHVD812L.0 size=1048576 2024-09-22T08:21:06.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.352+0000 7fe6c9c31780 1 > prepared part key=_multipart_TJTB67QBLZH5.2~XQ42KHVD812L.1 size=731590 2024-09-22T08:21:06.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.352+0000 7fe6c9c31780 1 > prepared multipart upload key=TJTB67QBLZH5 upload=XQ42KHVD812L tag=Z32AW2EP8KY6 type=write size=2828742 2024-09-22T08:21:06.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.353+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~G5NPCCCQQU9E.0 size=1048576 2024-09-22T08:21:06.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.355+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~G5NPCCCQQU9E.1 size=337512 2024-09-22T08:21:06.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.357+0000 7fe6c9c31780 1 < completed multipart upload key=CTK01Y0CV1NC upload=G5NPCCCQQU9E tag=HTAT76VEUFEW type=write size=2434664 2024-09-22T08:21:06.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.358+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=LAQ7J0I6FXJK type=write size=612148 2024-09-22T08:21:06.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.360+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~0XV0O7CHQNOO.0 size=364820 2024-09-22T08:21:06.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.362+0000 7fe6c9c31780 1 < completed multipart upload key=CTK01Y0CV1NC upload=0XV0O7CHQNOO tag=1Y6P5GLWLIOP type=write size=1413396 2024-09-22T08:21:06.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.364+0000 7fe6c9c31780 1 > prepared operation key=VP1MP4IC9A7T tag=LGHKI2V29YI6 type=del size=1006714 2024-09-22T08:21:06.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.365+0000 7fe6c9c31780 1 < completed part key=_multipart_6BKB91YV3FMW.2~7UUKFPS5HE5D.0 size=1048576 2024-09-22T08:21:06.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.366+0000 7fe6c9c31780 1 < completed part key=_multipart_6BKB91YV3FMW.2~7UUKFPS5HE5D.1 size=607991 2024-09-22T08:21:06.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.369+0000 7fe6c9c31780 1 < completed multipart upload key=6BKB91YV3FMW upload=7UUKFPS5HE5D tag=W51Y4GYXMGCZ type=write size=2705143 2024-09-22T08:21:06.372 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.372+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~2X06FRF4AGW9.0 size=1048576 2024-09-22T08:21:06.373 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.372+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~2X06FRF4AGW9.1 size=913405 2024-09-22T08:21:06.373 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.372+0000 7fe6c9c31780 1 > prepared multipart upload key=GEWQUFB9K35E upload=2X06FRF4AGW9 tag=3OFO0YBZ5PSY type=write size=3010557 2024-09-22T08:21:06.373 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.373+0000 7fe6c9c31780 1 < canceled part key=_multipart_76HZ3LZGVT9J.2~MF72IQDSAB9Y.0 size=1048576 2024-09-22T08:21:06.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.374+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~MF72IQDSAB9Y.1 size=1048576 2024-09-22T08:21:06.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.375+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~MF72IQDSAB9Y.2 size=883788 2024-09-22T08:21:06.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.377+0000 7fe6c9c31780 1 < canceled multipart upload key=76HZ3LZGVT9J upload=MF72IQDSAB9Y tag=N7NB5AEG89UH type=write size=4029516 2024-09-22T08:21:06.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.380+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~4RIMJ2BO0HWT.0 size=1048576 2024-09-22T08:21:06.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.380+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~4RIMJ2BO0HWT.1 size=1048576 2024-09-22T08:21:06.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.382+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~4RIMJ2BO0HWT.2 size=482829 2024-09-22T08:21:06.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.382+0000 7fe6c9c31780 1 > prepared multipart upload key=0PNK2ZW6IJM1 upload=4RIMJ2BO0HWT tag=5E5QKTBPM8U4 type=write size=3628557 2024-09-22T08:21:06.384 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.383+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~CYUTKYVVMJOS.0 size=577718 2024-09-22T08:21:06.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.385+0000 7fe6c9c31780 1 < completed multipart upload key=TE10GB1F35X4 upload=CYUTKYVVMJOS tag=KDZPKU35YMIT type=write size=1626294 2024-09-22T08:21:06.388 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.387+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=RLDQV2P7WPEX type=del size=3406690 2024-09-22T08:21:06.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.389+0000 7fe6c9c31780 1 < suggested remove operation key=ILW34WLX48WN tag=V2EA7AQIFNOS type=del 2024-09-22T08:21:06.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.391+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=0A702XKQLEF1 type=del size=1274888 2024-09-22T08:21:06.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.393+0000 7fe6c9c31780 1 < completed delete operation key=4KRJ7DTE3KDV tag=YXJUTI5MMXCI type=del 2024-09-22T08:21:06.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.395+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=NORKCVSJ4O5H type=del size=3345327 2024-09-22T08:21:06.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.396+0000 7fe6c9c31780 1 < completed part key=_multipart_Z1CK5EDBK4AW.2~FZJXTCI22N3J.0 size=1048576 2024-09-22T08:21:06.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.398+0000 7fe6c9c31780 1 < completed part key=_multipart_Z1CK5EDBK4AW.2~FZJXTCI22N3J.1 size=1048576 2024-09-22T08:21:06.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.399+0000 7fe6c9c31780 1 < completed part key=_multipart_Z1CK5EDBK4AW.2~FZJXTCI22N3J.2 size=416627 2024-09-22T08:21:06.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.401+0000 7fe6c9c31780 1 < completed multipart upload key=Z1CK5EDBK4AW upload=FZJXTCI22N3J tag=P242UCN1VY8D type=write size=3562355 2024-09-22T08:21:06.404 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.404+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~J63KACBMPNPI.0 size=1048576 2024-09-22T08:21:06.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.405+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~J63KACBMPNPI.1 size=1048576 2024-09-22T08:21:06.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.406+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~J63KACBMPNPI.2 size=587963 2024-09-22T08:21:06.407 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.406+0000 7fe6c9c31780 1 > prepared multipart upload key=9FCSIF1WKBDJ upload=J63KACBMPNPI tag=09831ZHRP2W5 type=write size=3733691 2024-09-22T08:21:06.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.407+0000 7fe6c9c31780 1 < canceled operation key=ZFL9N44PBQX4 tag=7ABM6291JII0 type=del size=1776389 2024-09-22T08:21:06.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.409+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=1U3O1PGAUYP0 type=del size=3890926 2024-09-22T08:21:06.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.410+0000 7fe6c9c31780 1 < completed delete operation key=KZIY400KQ5NH tag=MQ02B5VSPWH6 type=del 2024-09-22T08:21:06.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.413+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~PRDU96L2SH32.0 size=1048576 2024-09-22T08:21:06.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.415+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~PRDU96L2SH32.1 size=303497 2024-09-22T08:21:06.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.415+0000 7fe6c9c31780 1 > prepared multipart upload key=0TWY0NNZZ7NN upload=PRDU96L2SH32 tag=BY7AYGXUX1P8 type=write size=2400649 2024-09-22T08:21:06.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.416+0000 7fe6c9c31780 1 < completed part key=_multipart_Z1CK5EDBK4AW.2~7R8X8J6VB26Q.0 size=1048576 2024-09-22T08:21:06.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.417+0000 7fe6c9c31780 1 < completed part key=_multipart_Z1CK5EDBK4AW.2~7R8X8J6VB26Q.1 size=1048576 2024-09-22T08:21:06.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.417+0000 7fe6c9c31780 1 < canceled part key=_multipart_Z1CK5EDBK4AW.2~7R8X8J6VB26Q.2 size=427118 2024-09-22T08:21:06.420 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.420+0000 7fe6c9c31780 1 < canceled multipart upload key=Z1CK5EDBK4AW upload=7R8X8J6VB26Q tag=3STZUL12YAPT type=write size=3572846 2024-09-22T08:21:06.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.421+0000 7fe6c9c31780 1 > prepared operation key=KZIY400KQ5NH tag=MGMZUUWR5HJC type=del size=578560 2024-09-22T08:21:06.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.422+0000 7fe6c9c31780 1 < completed delete operation key=JT5AB8VLMEFD tag=7TAQI7PM08TI type=del 2024-09-22T08:21:06.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.424+0000 7fe6c9c31780 1 > prepared operation key=TJTB67QBLZH5 tag=FEX8DE964D3G type=del size=2056138 2024-09-22T08:21:06.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.425+0000 7fe6c9c31780 1 < canceled operation key=76HZ3LZGVT9J tag=RCLP2XNPG8N6 type=del size=2578892 2024-09-22T08:21:06.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.428+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~4O86HZMGSFNV.0 size=1048576 2024-09-22T08:21:06.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.429+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~4O86HZMGSFNV.1 size=174449 2024-09-22T08:21:06.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.429+0000 7fe6c9c31780 1 > prepared multipart upload key=D85LJGGU3Z6F upload=4O86HZMGSFNV tag=MTN28NXO8061 type=write size=2271601 2024-09-22T08:21:06.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.430+0000 7fe6c9c31780 1 < completed delete operation key=W9L87PTJEIOA tag=778YBWY8WQ83 type=del 2024-09-22T08:21:06.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.432+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=CLHJR8B42ZVF type=write size=329979 2024-09-22T08:21:06.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.434+0000 7fe6c9c31780 1 < completed delete operation key=GEWQUFB9K35E tag=7LYAY1TADOOU type=del 2024-09-22T08:21:06.435 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.434+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=RA2IHRXDTYV4 type=del size=699982 2024-09-22T08:21:06.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.436+0000 7fe6c9c31780 1 < completed part key=_multipart_TJTB67QBLZH5.2~XQ42KHVD812L.0 size=1048576 2024-09-22T08:21:06.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.437+0000 7fe6c9c31780 1 < completed part key=_multipart_TJTB67QBLZH5.2~XQ42KHVD812L.1 size=731590 2024-09-22T08:21:06.439 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.439+0000 7fe6c9c31780 1 < completed multipart upload key=TJTB67QBLZH5 upload=XQ42KHVD812L tag=Z32AW2EP8KY6 type=write size=2828742 2024-09-22T08:21:06.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.440+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=X9L49TCDKIYD type=write size=793949 2024-09-22T08:21:06.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.443+0000 7fe6c9c31780 1 < suggested remove operation key=2B5QRUMTVE7U tag=LAQ7J0I6FXJK type=write 2024-09-22T08:21:06.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.444+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=S1B80YD9JOWY type=del size=2680484 2024-09-22T08:21:06.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.446+0000 7fe6c9c31780 1 < completed delete operation key=VP1MP4IC9A7T tag=LGHKI2V29YI6 type=del 2024-09-22T08:21:06.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.448+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~ZNT461BXPJWW.0 size=1048576 2024-09-22T08:21:06.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.449+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~ZNT461BXPJWW.1 size=1048576 2024-09-22T08:21:06.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.450+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~ZNT461BXPJWW.2 size=18394 2024-09-22T08:21:06.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.451+0000 7fe6c9c31780 1 > prepared multipart upload key=7446WN19QFV0 upload=ZNT461BXPJWW tag=FVWTU3UMN9FZ type=write size=3164122 2024-09-22T08:21:06.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.452+0000 7fe6c9c31780 1 < completed part key=_multipart_GEWQUFB9K35E.2~2X06FRF4AGW9.0 size=1048576 2024-09-22T08:21:06.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.452+0000 7fe6c9c31780 1 < canceled part key=_multipart_GEWQUFB9K35E.2~2X06FRF4AGW9.1 size=913405 2024-09-22T08:21:06.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.454+0000 7fe6c9c31780 1 < canceled multipart upload key=GEWQUFB9K35E upload=2X06FRF4AGW9 tag=3OFO0YBZ5PSY type=write size=3010557 2024-09-22T08:21:06.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.456+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=VWPL53WQH2F9 type=write size=962049 2024-09-22T08:21:06.458 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.457+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~4RIMJ2BO0HWT.0 size=1048576 2024-09-22T08:21:06.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.459+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~4RIMJ2BO0HWT.1 size=1048576 2024-09-22T08:21:06.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.460+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~4RIMJ2BO0HWT.2 size=482829 2024-09-22T08:21:06.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.461+0000 7fe6c9c31780 1 < completed multipart upload key=0PNK2ZW6IJM1 upload=4RIMJ2BO0HWT tag=5E5QKTBPM8U4 type=write size=3628557 2024-09-22T08:21:06.463 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.463+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=861IWJOF7NTH type=del size=2631496 2024-09-22T08:21:06.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.464+0000 7fe6c9c31780 1 < canceled operation key=9AZWQ9E58QS6 tag=RLDQV2P7WPEX type=del size=3406690 2024-09-22T08:21:06.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.466+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=L4JW1O5PB8X5 type=del size=2784323 2024-09-22T08:21:06.469 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.469+0000 7fe6c9c31780 1 < suggested remove operation key=TE10GB1F35X4 tag=0A702XKQLEF1 type=del 2024-09-22T08:21:06.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.470+0000 7fe6c9c31780 1 > prepared operation key=1HZ0NAJPXNW1 tag=CFHM86QZQ0U6 type=write size=664316 2024-09-22T08:21:06.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.471+0000 7fe6c9c31780 1 < completed delete operation key=7446WN19QFV0 tag=NORKCVSJ4O5H type=del 2024-09-22T08:21:06.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.473+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=DB0QEUA93E0M type=write size=110350 2024-09-22T08:21:06.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.474+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~J63KACBMPNPI.0 size=1048576 2024-09-22T08:21:06.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.474+0000 7fe6c9c31780 1 < canceled part key=_multipart_9FCSIF1WKBDJ.2~J63KACBMPNPI.1 size=1048576 2024-09-22T08:21:06.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.476+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~J63KACBMPNPI.2 size=587963 2024-09-22T08:21:06.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.478+0000 7fe6c9c31780 1 < canceled multipart upload key=9FCSIF1WKBDJ upload=J63KACBMPNPI tag=09831ZHRP2W5 type=write size=3733691 2024-09-22T08:21:06.481 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.481+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~GLRHI5ERWXF8.0 size=1048576 2024-09-22T08:21:06.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.482+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~GLRHI5ERWXF8.1 size=1048576 2024-09-22T08:21:06.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.483+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~GLRHI5ERWXF8.2 size=225018 2024-09-22T08:21:06.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.483+0000 7fe6c9c31780 1 > prepared multipart upload key=D85LJGGU3Z6F upload=GLRHI5ERWXF8 tag=146491YW0JU5 type=write size=3370746 2024-09-22T08:21:06.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.484+0000 7fe6c9c31780 1 < completed delete operation key=76HZ3LZGVT9J tag=1U3O1PGAUYP0 type=del 2024-09-22T08:21:06.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.486+0000 7fe6c9c31780 1 > prepared operation key=1HZ0NAJPXNW1 tag=QCNFDTZK2SDW type=del size=1128647 2024-09-22T08:21:06.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.488+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~PRDU96L2SH32.0 size=1048576 2024-09-22T08:21:06.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.489+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~PRDU96L2SH32.1 size=303497 2024-09-22T08:21:06.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.492+0000 7fe6c9c31780 1 < completed multipart upload key=0TWY0NNZZ7NN upload=PRDU96L2SH32 tag=BY7AYGXUX1P8 type=write size=2400649 2024-09-22T08:21:06.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.493+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=D2P5E15A081Y type=del size=2840127 2024-09-22T08:21:06.495 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.494+0000 7fe6c9c31780 1 < completed delete operation key=KZIY400KQ5NH tag=MGMZUUWR5HJC type=del 2024-09-22T08:21:06.497 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.497+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=1EAYKBMOQ6XG type=del size=1117228 2024-09-22T08:21:06.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.499+0000 7fe6c9c31780 1 < suggested update operation key=TJTB67QBLZH5 tag=FEX8DE964D3G type=del size=2056138 2024-09-22T08:21:06.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.500+0000 7fe6c9c31780 1 > prepared operation key=VP1MP4IC9A7T tag=OTJXAR5C9UE2 type=del size=2795461 2024-09-22T08:21:06.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.502+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~4O86HZMGSFNV.0 size=1048576 2024-09-22T08:21:06.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.502+0000 7fe6c9c31780 1 < canceled part key=_multipart_D85LJGGU3Z6F.2~4O86HZMGSFNV.1 size=174449 2024-09-22T08:21:06.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.505+0000 7fe6c9c31780 1 < canceled multipart upload key=D85LJGGU3Z6F upload=4O86HZMGSFNV tag=MTN28NXO8061 type=write size=2271601 2024-09-22T08:21:06.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.505+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=M17WT22SOF01 type=del size=2611499 2024-09-22T08:21:06.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.508+0000 7fe6c9c31780 1 < suggested update operation key=6BKB91YV3FMW tag=CLHJR8B42ZVF type=write size=329979 2024-09-22T08:21:06.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.511+0000 7fe6c9c31780 1 > prepared part key=_multipart_W9L87PTJEIOA.2~HBJVJR2FGU65.0 size=425543 2024-09-22T08:21:06.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.511+0000 7fe6c9c31780 1 > prepared multipart upload key=W9L87PTJEIOA upload=HBJVJR2FGU65 tag=XTHOQ2QC6CZ0 type=write size=1474119 2024-09-22T08:21:06.513 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.512+0000 7fe6c9c31780 1 < completed delete operation key=DC7VLQWZ3TD1 tag=RA2IHRXDTYV4 type=del 2024-09-22T08:21:06.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.516+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~UMLXK50UBX48.0 size=1048576 2024-09-22T08:21:06.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.516+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~UMLXK50UBX48.1 size=759673 2024-09-22T08:21:06.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.516+0000 7fe6c9c31780 1 > prepared multipart upload key=9FCSIF1WKBDJ upload=UMLXK50UBX48 tag=2Z6E0OADFVZ0 type=write size=2856825 2024-09-22T08:21:06.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.519+0000 7fe6c9c31780 1 < suggested remove operation key=ILW34WLX48WN tag=X9L49TCDKIYD type=write 2024-09-22T08:21:06.521 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.521+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=8A4L2V6J7RXI type=del size=2683736 2024-09-22T08:21:06.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.522+0000 7fe6c9c31780 1 < completed delete operation key=R7UWMW913DJQ tag=S1B80YD9JOWY type=del 2024-09-22T08:21:06.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.524+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~3NWE9YJQ4VBK.0 size=1048576 2024-09-22T08:21:06.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.526+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~3NWE9YJQ4VBK.1 size=1048576 2024-09-22T08:21:06.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.527+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~3NWE9YJQ4VBK.2 size=363057 2024-09-22T08:21:06.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.527+0000 7fe6c9c31780 1 > prepared multipart upload key=TE10GB1F35X4 upload=3NWE9YJQ4VBK tag=M0I7S64WMIQ7 type=write size=3508785 2024-09-22T08:21:06.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.528+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~ZNT461BXPJWW.0 size=1048576 2024-09-22T08:21:06.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.529+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~ZNT461BXPJWW.1 size=1048576 2024-09-22T08:21:06.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.531+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~ZNT461BXPJWW.2 size=18394 2024-09-22T08:21:06.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.534+0000 7fe6c9c31780 1 < completed multipart upload key=7446WN19QFV0 upload=ZNT461BXPJWW tag=FVWTU3UMN9FZ type=write size=3164122 2024-09-22T08:21:06.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.536+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~Q888NNNLLXR9.0 size=1048576 2024-09-22T08:21:06.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.537+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~Q888NNNLLXR9.1 size=39576 2024-09-22T08:21:06.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.537+0000 7fe6c9c31780 1 > prepared multipart upload key=6BKB91YV3FMW upload=Q888NNNLLXR9 tag=WKX1D9FUZ8SQ type=write size=2136728 2024-09-22T08:21:06.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.538+0000 7fe6c9c31780 -1 < failed to complete operation key=ILW34WLX48WN tag=VWPL53WQH2F9 type=write size=962049: (22) Invalid argument 2024-09-22T08:21:06.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.540+0000 7fe6c9c31780 1 > prepared operation key=GEWQUFB9K35E tag=WWYFFP2QVOOU type=write size=669704 2024-09-22T08:21:06.542 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.541+0000 7fe6c9c31780 -1 < failed to complete operation key=ILW34WLX48WN tag=861IWJOF7NTH type=del size=2631496: (22) Invalid argument 2024-09-22T08:21:06.546 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.542+0000 7fe6c9c31780 1 > prepared operation key=9FCSIF1WKBDJ tag=UBOSQ20OKQYM type=del size=1921777 2024-09-22T08:21:06.546 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.544+0000 7fe6c9c31780 1 < completed delete operation key=946H8F2AUPO2 tag=L4JW1O5PB8X5 type=del 2024-09-22T08:21:06.546 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.546+0000 7fe6c9c31780 1 > prepared operation key=O1UBUQXP50CN tag=N6BACIWEXQ73 type=write size=887450 2024-09-22T08:21:06.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.549+0000 7fe6c9c31780 1 < suggested update operation key=1HZ0NAJPXNW1 tag=CFHM86QZQ0U6 type=write size=664316 2024-09-22T08:21:06.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.552+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~KO1QAJLGT76O.0 size=1048576 2024-09-22T08:21:06.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.553+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~KO1QAJLGT76O.1 size=1048576 2024-09-22T08:21:06.555 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.554+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~KO1QAJLGT76O.2 size=450052 2024-09-22T08:21:06.555 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.554+0000 7fe6c9c31780 1 > prepared multipart upload key=9FCSIF1WKBDJ upload=KO1QAJLGT76O tag=QN9FNDFPYYWH type=write size=3595780 2024-09-22T08:21:06.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.556+0000 7fe6c9c31780 1 < completed write operation key=0TWY0NNZZ7NN tag=DB0QEUA93E0M type=write size=110350 2024-09-22T08:21:06.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.557+0000 7fe6c9c31780 1 > prepared operation key=O1UBUQXP50CN tag=HDRV409WHR8Z type=del size=2305354 2024-09-22T08:21:06.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.558+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~GLRHI5ERWXF8.0 size=1048576 2024-09-22T08:21:06.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.560+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~GLRHI5ERWXF8.1 size=1048576 2024-09-22T08:21:06.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.561+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~GLRHI5ERWXF8.2 size=225018 2024-09-22T08:21:06.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.564+0000 7fe6c9c31780 1 < completed multipart upload key=D85LJGGU3Z6F upload=GLRHI5ERWXF8 tag=146491YW0JU5 type=write size=3370746 2024-09-22T08:21:06.566 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.566+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~3BL2ISDNM77P.0 size=700757 2024-09-22T08:21:06.566 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.566+0000 7fe6c9c31780 1 > prepared multipart upload key=76HZ3LZGVT9J upload=3BL2ISDNM77P tag=I136523XV233 type=write size=1749333 2024-09-22T08:21:06.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.567+0000 7fe6c9c31780 -1 < failed to complete operation key=1HZ0NAJPXNW1 tag=QCNFDTZK2SDW type=del size=1128647: (22) Invalid argument 2024-09-22T08:21:06.569 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.568+0000 7fe6c9c31780 1 > prepared operation key=XJP26CCPYDI7 tag=I5QXWO7QLZ98 type=del size=3617211 2024-09-22T08:21:06.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.572+0000 7fe6c9c31780 1 < suggested remove operation key=9AZWQ9E58QS6 tag=D2P5E15A081Y type=del 2024-09-22T08:21:06.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.573+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=TU8C457FT0MD type=del size=514052 2024-09-22T08:21:06.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.574+0000 7fe6c9c31780 -1 < failed to complete operation key=9AZWQ9E58QS6 tag=1EAYKBMOQ6XG type=del size=1117228: (22) Invalid argument 2024-09-22T08:21:06.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.577+0000 7fe6c9c31780 1 > prepared operation key=1HZ0NAJPXNW1 tag=B76FUV1H4KSN type=del size=3288205 2024-09-22T08:21:06.578 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.578+0000 7fe6c9c31780 1 < completed delete operation key=VP1MP4IC9A7T tag=OTJXAR5C9UE2 type=del 2024-09-22T08:21:06.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.580+0000 7fe6c9c31780 1 > prepared operation key=LA6ZRVULGQ0H tag=PTNO0TR5DMUA type=del size=2163316 2024-09-22T08:21:06.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.581+0000 7fe6c9c31780 1 < completed delete operation key=0TWY0NNZZ7NN tag=M17WT22SOF01 type=del 2024-09-22T08:21:06.584 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.584+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~W972FHZWFEU9.0 size=860679 2024-09-22T08:21:06.584 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.584+0000 7fe6c9c31780 1 > prepared multipart upload key=GEWQUFB9K35E upload=W972FHZWFEU9 tag=07VG7L3ZQALU type=write size=1909255 2024-09-22T08:21:06.585 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.585+0000 7fe6c9c31780 1 < completed part key=_multipart_W9L87PTJEIOA.2~HBJVJR2FGU65.0 size=425543 2024-09-22T08:21:06.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.587+0000 7fe6c9c31780 1 < completed multipart upload key=W9L87PTJEIOA upload=HBJVJR2FGU65 tag=XTHOQ2QC6CZ0 type=write size=1474119 2024-09-22T08:21:06.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.589+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=MJ3Y4AB8Y9MR type=del size=1903039 2024-09-22T08:21:06.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.590+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~UMLXK50UBX48.0 size=1048576 2024-09-22T08:21:06.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.591+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~UMLXK50UBX48.1 size=759673 2024-09-22T08:21:06.594 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.593+0000 7fe6c9c31780 1 < completed multipart upload key=9FCSIF1WKBDJ upload=UMLXK50UBX48 tag=2Z6E0OADFVZ0 type=write size=2856825 2024-09-22T08:21:06.596 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.596+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~LUBRITK30SVR.0 size=1048576 2024-09-22T08:21:06.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.597+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~LUBRITK30SVR.1 size=337026 2024-09-22T08:21:06.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.597+0000 7fe6c9c31780 1 > prepared multipart upload key=0TWY0NNZZ7NN upload=LUBRITK30SVR tag=EKC3ZLMN57WA type=write size=2434178 2024-09-22T08:21:06.599 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.598+0000 7fe6c9c31780 1 < completed delete operation key=T2W6RXP9UGHH tag=8A4L2V6J7RXI type=del 2024-09-22T08:21:06.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.601+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~S6PGITVDYQ2C.0 size=1030352 2024-09-22T08:21:06.602 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.601+0000 7fe6c9c31780 1 > prepared multipart upload key=7446WN19QFV0 upload=S6PGITVDYQ2C tag=5MQYM1A2H4OZ type=write size=2078928 2024-09-22T08:21:06.603 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.603+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~3NWE9YJQ4VBK.0 size=1048576 2024-09-22T08:21:06.604 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.603+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~3NWE9YJQ4VBK.1 size=1048576 2024-09-22T08:21:06.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.605+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~3NWE9YJQ4VBK.2 size=363057 2024-09-22T08:21:06.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.608+0000 7fe6c9c31780 1 < completed multipart upload key=TE10GB1F35X4 upload=3NWE9YJQ4VBK tag=M0I7S64WMIQ7 type=write size=3508785 2024-09-22T08:21:06.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.608+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=V7INP6SO0EZ4 type=write size=383487 2024-09-22T08:21:06.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.610+0000 7fe6c9c31780 1 < completed part key=_multipart_6BKB91YV3FMW.2~Q888NNNLLXR9.0 size=1048576 2024-09-22T08:21:06.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.612+0000 7fe6c9c31780 1 < completed part key=_multipart_6BKB91YV3FMW.2~Q888NNNLLXR9.1 size=39576 2024-09-22T08:21:06.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.614+0000 7fe6c9c31780 1 < completed multipart upload key=6BKB91YV3FMW upload=Q888NNNLLXR9 tag=WKX1D9FUZ8SQ type=write size=2136728 2024-09-22T08:21:06.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.615+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=0KU3KRXJ9AM0 type=del size=3295845 2024-09-22T08:21:06.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.616+0000 7fe6c9c31780 1 < completed write operation key=GEWQUFB9K35E tag=WWYFFP2QVOOU type=write size=669704 2024-09-22T08:21:06.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.618+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=7UJ4K131CQE7 type=del size=2077479 2024-09-22T08:21:06.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.619+0000 7fe6c9c31780 1 < completed delete operation key=9FCSIF1WKBDJ tag=UBOSQ20OKQYM type=del 2024-09-22T08:21:06.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.620+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=69I0T0HBBWM6 type=del size=3809287 2024-09-22T08:21:06.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.622+0000 7fe6c9c31780 1 < completed write operation key=O1UBUQXP50CN tag=N6BACIWEXQ73 type=write size=887450 2024-09-22T08:21:06.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.624+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~TQGJES5M2KCN.0 size=1048576 2024-09-22T08:21:06.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.626+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~TQGJES5M2KCN.1 size=1048576 2024-09-22T08:21:06.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.627+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~TQGJES5M2KCN.2 size=336670 2024-09-22T08:21:06.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.627+0000 7fe6c9c31780 1 > prepared multipart upload key=0PNK2ZW6IJM1 upload=TQGJES5M2KCN tag=S5L04VP8XUI4 type=write size=3482398 2024-09-22T08:21:06.628 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.627+0000 7fe6c9c31780 1 < canceled part key=_multipart_9FCSIF1WKBDJ.2~KO1QAJLGT76O.0 size=1048576 2024-09-22T08:21:06.628 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.627+0000 7fe6c9c31780 1 < canceled part key=_multipart_9FCSIF1WKBDJ.2~KO1QAJLGT76O.1 size=1048576 2024-09-22T08:21:06.628 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.627+0000 7fe6c9c31780 1 < canceled part key=_multipart_9FCSIF1WKBDJ.2~KO1QAJLGT76O.2 size=450052 2024-09-22T08:21:06.630 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.630+0000 7fe6c9c31780 1 < canceled multipart upload key=9FCSIF1WKBDJ upload=KO1QAJLGT76O tag=QN9FNDFPYYWH type=write size=3595780 2024-09-22T08:21:06.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.632+0000 7fe6c9c31780 1 > prepared operation key=ZFL9N44PBQX4 tag=1OBYDUDM4K2B type=del size=1724204 2024-09-22T08:21:06.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.633+0000 7fe6c9c31780 1 < completed delete operation key=O1UBUQXP50CN tag=HDRV409WHR8Z type=del 2024-09-22T08:21:06.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.634+0000 7fe6c9c31780 1 > prepared operation key=4KRJ7DTE3KDV tag=LOMM0F65S79N type=del size=871201 2024-09-22T08:21:06.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.635+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~3BL2ISDNM77P.0 size=700757 2024-09-22T08:21:06.639 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.638+0000 7fe6c9c31780 1 < completed multipart upload key=76HZ3LZGVT9J upload=3BL2ISDNM77P tag=I136523XV233 type=write size=1749333 2024-09-22T08:21:06.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.640+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~3EV4M8R35H1N.0 size=1048576 2024-09-22T08:21:06.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.642+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~3EV4M8R35H1N.1 size=992406 2024-09-22T08:21:06.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.642+0000 7fe6c9c31780 1 > prepared multipart upload key=4KRJ7DTE3KDV upload=3EV4M8R35H1N tag=74FUBULPU4J4 type=write size=3089558 2024-09-22T08:21:06.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.643+0000 7fe6c9c31780 1 < completed delete operation key=XJP26CCPYDI7 tag=I5QXWO7QLZ98 type=del 2024-09-22T08:21:06.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.645+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~A2KU28ILX71R.0 size=863108 2024-09-22T08:21:06.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.645+0000 7fe6c9c31780 1 > prepared multipart upload key=VP1MP4IC9A7T upload=A2KU28ILX71R tag=1VR7WKHN2GYR type=write size=1911684 2024-09-22T08:21:06.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.648+0000 7fe6c9c31780 1 < completed delete operation key=76HZ3LZGVT9J tag=TU8C457FT0MD type=del 2024-09-22T08:21:06.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.649+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=Q5L0H92DQSO6 type=del size=1503612 2024-09-22T08:21:06.651 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.650+0000 7fe6c9c31780 1 < completed delete operation key=1HZ0NAJPXNW1 tag=B76FUV1H4KSN type=del 2024-09-22T08:21:06.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.653+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~AP7TSQNNMD3Y.0 size=1048576 2024-09-22T08:21:06.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.654+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~AP7TSQNNMD3Y.1 size=1048576 2024-09-22T08:21:06.655 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.655+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~AP7TSQNNMD3Y.2 size=887268 2024-09-22T08:21:06.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.655+0000 7fe6c9c31780 1 > prepared multipart upload key=TYVQ39KUV2V9 upload=AP7TSQNNMD3Y tag=Y4SAXF0WFWAM type=write size=4032996 2024-09-22T08:21:06.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.656+0000 7fe6c9c31780 1 < canceled operation key=LA6ZRVULGQ0H tag=PTNO0TR5DMUA type=del size=2163316 2024-09-22T08:21:06.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.659+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~M9FNKBTM9BGK.0 size=1048576 2024-09-22T08:21:06.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.660+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~M9FNKBTM9BGK.1 size=486519 2024-09-22T08:21:06.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.660+0000 7fe6c9c31780 1 > prepared multipart upload key=T2W6RXP9UGHH upload=M9FNKBTM9BGK tag=QCP2SVD3MTPK type=write size=2583671 2024-09-22T08:21:06.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.662+0000 7fe6c9c31780 1 < completed part key=_multipart_GEWQUFB9K35E.2~W972FHZWFEU9.0 size=860679 2024-09-22T08:21:06.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.665+0000 7fe6c9c31780 1 < completed multipart upload key=GEWQUFB9K35E upload=W972FHZWFEU9 tag=07VG7L3ZQALU type=write size=1909255 2024-09-22T08:21:06.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.668+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~ZUMZ5EHTP8U3.0 size=371716 2024-09-22T08:21:06.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.668+0000 7fe6c9c31780 1 > prepared multipart upload key=O1UBUQXP50CN upload=ZUMZ5EHTP8U3 tag=ZX1RMFM7KVMH type=write size=1420292 2024-09-22T08:21:06.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.670+0000 7fe6c9c31780 1 < suggested update operation key=7446WN19QFV0 tag=MJ3Y4AB8Y9MR type=del size=1903039 2024-09-22T08:21:06.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.672+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=B7SUKDIKNJX1 type=write size=573075 2024-09-22T08:21:06.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.673+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~LUBRITK30SVR.0 size=1048576 2024-09-22T08:21:06.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.675+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~LUBRITK30SVR.1 size=337026 2024-09-22T08:21:06.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.678+0000 7fe6c9c31780 1 < completed multipart upload key=0TWY0NNZZ7NN upload=LUBRITK30SVR tag=EKC3ZLMN57WA type=write size=2434178 2024-09-22T08:21:06.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.679+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~GG6950HA4BYA.0 size=1048576 2024-09-22T08:21:06.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.682+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~GG6950HA4BYA.1 size=1048576 2024-09-22T08:21:06.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.683+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~GG6950HA4BYA.2 size=197336 2024-09-22T08:21:06.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.683+0000 7fe6c9c31780 1 > prepared multipart upload key=7446WN19QFV0 upload=GG6950HA4BYA tag=ZH1JJTEYVL1M type=write size=3343064 2024-09-22T08:21:06.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.685+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~S6PGITVDYQ2C.0 size=1030352 2024-09-22T08:21:06.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.688+0000 7fe6c9c31780 1 < completed multipart upload key=7446WN19QFV0 upload=S6PGITVDYQ2C tag=5MQYM1A2H4OZ type=write size=2078928 2024-09-22T08:21:06.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.690+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~V4IHQYVBOJZC.0 size=694954 2024-09-22T08:21:06.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.690+0000 7fe6c9c31780 1 > prepared multipart upload key=XJP26CCPYDI7 upload=V4IHQYVBOJZC tag=DZWHWD65G70W type=write size=1743530 2024-09-22T08:21:06.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.691+0000 7fe6c9c31780 1 < completed write operation key=946H8F2AUPO2 tag=V7INP6SO0EZ4 type=write size=383487 2024-09-22T08:21:06.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.692+0000 7fe6c9c31780 1 > prepared operation key=O1UBUQXP50CN tag=SE2V9IE332B1 type=write size=569317 2024-09-22T08:21:06.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.694+0000 7fe6c9c31780 -1 < failed to complete operation key=7446WN19QFV0 tag=0KU3KRXJ9AM0 type=del size=3295845: (22) Invalid argument 2024-09-22T08:21:06.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.697+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~7YA8007O0S09.0 size=1048576 2024-09-22T08:21:06.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.697+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~7YA8007O0S09.1 size=960230 2024-09-22T08:21:06.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.697+0000 7fe6c9c31780 1 > prepared multipart upload key=9FCSIF1WKBDJ upload=7YA8007O0S09 tag=MO67ZN4H8ZVX type=write size=3057382 2024-09-22T08:21:06.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.699+0000 7fe6c9c31780 1 < completed delete operation key=946H8F2AUPO2 tag=7UJ4K131CQE7 type=del 2024-09-22T08:21:06.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.700+0000 7fe6c9c31780 1 > prepared operation key=Z1CK5EDBK4AW tag=ASWRDKEO0BSM type=del size=130097 2024-09-22T08:21:06.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.703+0000 7fe6c9c31780 1 < suggested remove operation key=2B5QRUMTVE7U tag=69I0T0HBBWM6 type=del 2024-09-22T08:21:06.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.705+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=UM2138P4F63Y type=del size=632696 2024-09-22T08:21:06.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.706+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~TQGJES5M2KCN.0 size=1048576 2024-09-22T08:21:06.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.707+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~TQGJES5M2KCN.1 size=1048576 2024-09-22T08:21:06.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.708+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~TQGJES5M2KCN.2 size=336670 2024-09-22T08:21:06.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.710+0000 7fe6c9c31780 1 < completed multipart upload key=0PNK2ZW6IJM1 upload=TQGJES5M2KCN tag=S5L04VP8XUI4 type=write size=3482398 2024-09-22T08:21:06.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.711+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=4YXQG2D1GZX5 type=del size=3192936 2024-09-22T08:21:06.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.713+0000 7fe6c9c31780 1 < completed delete operation key=ZFL9N44PBQX4 tag=1OBYDUDM4K2B type=del 2024-09-22T08:21:06.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.716+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~STK34H28LNYF.0 size=1048576 2024-09-22T08:21:06.717 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.716+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~STK34H28LNYF.1 size=654139 2024-09-22T08:21:06.717 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.716+0000 7fe6c9c31780 1 > prepared multipart upload key=Z1CK5EDBK4AW upload=STK34H28LNYF tag=1ZT711AXBYDP type=write size=2751291 2024-09-22T08:21:06.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.719+0000 7fe6c9c31780 1 < suggested update operation key=4KRJ7DTE3KDV tag=LOMM0F65S79N type=del size=871201 2024-09-22T08:21:06.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.722+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~AQ8VI0WHL2RA.0 size=885239 2024-09-22T08:21:06.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.722+0000 7fe6c9c31780 1 > prepared multipart upload key=T2W6RXP9UGHH upload=AQ8VI0WHL2RA tag=LB3BO5WE2JWD type=write size=1933815 2024-09-22T08:21:06.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.723+0000 7fe6c9c31780 1 < completed part key=_multipart_4KRJ7DTE3KDV.2~3EV4M8R35H1N.0 size=1048576 2024-09-22T08:21:06.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.724+0000 7fe6c9c31780 1 < completed part key=_multipart_4KRJ7DTE3KDV.2~3EV4M8R35H1N.1 size=992406 2024-09-22T08:21:06.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.727+0000 7fe6c9c31780 1 < completed multipart upload key=4KRJ7DTE3KDV upload=3EV4M8R35H1N tag=74FUBULPU4J4 type=write size=3089558 2024-09-22T08:21:06.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.729+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~RGWQHRGTL4NS.0 size=1048576 2024-09-22T08:21:06.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.731+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~RGWQHRGTL4NS.1 size=1048576 2024-09-22T08:21:06.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.732+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~RGWQHRGTL4NS.2 size=141632 2024-09-22T08:21:06.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.732+0000 7fe6c9c31780 1 > prepared multipart upload key=TE10GB1F35X4 upload=RGWQHRGTL4NS tag=PGULFW6W31HC type=write size=3287360 2024-09-22T08:21:06.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.732+0000 7fe6c9c31780 1 < canceled part key=_multipart_VP1MP4IC9A7T.2~A2KU28ILX71R.0 size=863108 2024-09-22T08:21:06.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.735+0000 7fe6c9c31780 1 < canceled multipart upload key=VP1MP4IC9A7T upload=A2KU28ILX71R tag=1VR7WKHN2GYR type=write size=1911684 2024-09-22T08:21:06.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.736+0000 7fe6c9c31780 1 > prepared operation key=GEWQUFB9K35E tag=B8TZ0306OFM2 type=del size=3367479 2024-09-22T08:21:06.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.738+0000 7fe6c9c31780 1 < completed delete operation key=CTK01Y0CV1NC tag=Q5L0H92DQSO6 type=del 2024-09-22T08:21:06.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.738+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=B0QHI1GI5N66 type=del size=3702085 2024-09-22T08:21:06.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.740+0000 7fe6c9c31780 1 < completed part key=_multipart_TYVQ39KUV2V9.2~AP7TSQNNMD3Y.0 size=1048576 2024-09-22T08:21:06.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.741+0000 7fe6c9c31780 1 < completed part key=_multipart_TYVQ39KUV2V9.2~AP7TSQNNMD3Y.1 size=1048576 2024-09-22T08:21:06.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.742+0000 7fe6c9c31780 1 < completed part key=_multipart_TYVQ39KUV2V9.2~AP7TSQNNMD3Y.2 size=887268 2024-09-22T08:21:06.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.745+0000 7fe6c9c31780 1 < completed multipart upload key=TYVQ39KUV2V9 upload=AP7TSQNNMD3Y tag=Y4SAXF0WFWAM type=write size=4032996 2024-09-22T08:21:06.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.746+0000 7fe6c9c31780 1 > prepared operation key=LA6ZRVULGQ0H tag=G0C4E7701VQP type=del size=369395 2024-09-22T08:21:06.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.747+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~M9FNKBTM9BGK.0 size=1048576 2024-09-22T08:21:06.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.749+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~M9FNKBTM9BGK.1 size=486519 2024-09-22T08:21:06.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.751+0000 7fe6c9c31780 1 < completed multipart upload key=T2W6RXP9UGHH upload=M9FNKBTM9BGK tag=QCP2SVD3MTPK type=write size=2583671 2024-09-22T08:21:06.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.752+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=G4UYWUT9383E type=del size=3370651 2024-09-22T08:21:06.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.754+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~ZUMZ5EHTP8U3.0 size=371716 2024-09-22T08:21:06.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.756+0000 7fe6c9c31780 1 < completed multipart upload key=O1UBUQXP50CN upload=ZUMZ5EHTP8U3 tag=ZX1RMFM7KVMH type=write size=1420292 2024-09-22T08:21:06.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.758+0000 7fe6c9c31780 1 > prepared operation key=XJP26CCPYDI7 tag=1L3CO21WQ0NI type=del size=3321618 2024-09-22T08:21:06.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.759+0000 7fe6c9c31780 1 < canceled operation key=9AZWQ9E58QS6 tag=B7SUKDIKNJX1 type=write size=573075 2024-09-22T08:21:06.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.762+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~ONOR0UAJXOG9.0 size=1048576 2024-09-22T08:21:06.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.763+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~ONOR0UAJXOG9.1 size=978137 2024-09-22T08:21:06.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.763+0000 7fe6c9c31780 1 > prepared multipart upload key=O1UBUQXP50CN upload=ONOR0UAJXOG9 tag=M517P5DY0EJH type=write size=3075289 2024-09-22T08:21:06.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.764+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~GG6950HA4BYA.0 size=1048576 2024-09-22T08:21:06.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.765+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~GG6950HA4BYA.1 size=1048576 2024-09-22T08:21:06.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.767+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~GG6950HA4BYA.2 size=197336 2024-09-22T08:21:06.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.769+0000 7fe6c9c31780 1 < completed multipart upload key=7446WN19QFV0 upload=GG6950HA4BYA tag=ZH1JJTEYVL1M type=write size=3343064 2024-09-22T08:21:06.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.770+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=IHYA6SEOMZZP type=write size=677076 2024-09-22T08:21:06.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.771+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~V4IHQYVBOJZC.0 size=694954 2024-09-22T08:21:06.774 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.774+0000 7fe6c9c31780 1 < completed multipart upload key=XJP26CCPYDI7 upload=V4IHQYVBOJZC tag=DZWHWD65G70W type=write size=1743530 2024-09-22T08:21:06.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.775+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=L1T7CTFTL9SZ type=del size=3131761 2024-09-22T08:21:06.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.776+0000 7fe6c9c31780 1 < completed write operation key=O1UBUQXP50CN tag=SE2V9IE332B1 type=write size=569317 2024-09-22T08:21:06.779 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.779+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~5LIF0SR03MBP.0 size=1048576 2024-09-22T08:21:06.780 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.780+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~5LIF0SR03MBP.1 size=99417 2024-09-22T08:21:06.781 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.780+0000 7fe6c9c31780 1 > prepared multipart upload key=GEWQUFB9K35E upload=5LIF0SR03MBP tag=2AS28V3XXA55 type=write size=2196569 2024-09-22T08:21:06.782 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.781+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~7YA8007O0S09.0 size=1048576 2024-09-22T08:21:06.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.782+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~7YA8007O0S09.1 size=960230 2024-09-22T08:21:06.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.785+0000 7fe6c9c31780 1 < completed multipart upload key=9FCSIF1WKBDJ upload=7YA8007O0S09 tag=MO67ZN4H8ZVX type=write size=3057382 2024-09-22T08:21:06.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.786+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=GUB7XHFBWE8Y type=del size=2346889 2024-09-22T08:21:06.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.787+0000 7fe6c9c31780 1 < completed delete operation key=Z1CK5EDBK4AW tag=ASWRDKEO0BSM type=del 2024-09-22T08:21:06.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.789+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=TEJV68W2QRU0 type=del size=2526572 2024-09-22T08:21:06.791 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.790+0000 7fe6c9c31780 1 < completed delete operation key=R7UWMW913DJQ tag=UM2138P4F63Y type=del 2024-09-22T08:21:06.792 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.792+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=MLVRIL9212Q2 type=del size=2877013 2024-09-22T08:21:06.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.793+0000 7fe6c9c31780 1 < completed delete operation key=6BKB91YV3FMW tag=4YXQG2D1GZX5 type=del 2024-09-22T08:21:06.796 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.796+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~28EUPRJ30QV5.0 size=1048576 2024-09-22T08:21:06.797 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.797+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~28EUPRJ30QV5.1 size=1048576 2024-09-22T08:21:06.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.798+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~28EUPRJ30QV5.2 size=107322 2024-09-22T08:21:06.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.798+0000 7fe6c9c31780 1 > prepared multipart upload key=0PNK2ZW6IJM1 upload=28EUPRJ30QV5 tag=7P3S8T0KNQ49 type=write size=3253050 2024-09-22T08:21:06.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.799+0000 7fe6c9c31780 1 < completed part key=_multipart_Z1CK5EDBK4AW.2~STK34H28LNYF.0 size=1048576 2024-09-22T08:21:06.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.800+0000 7fe6c9c31780 1 < completed part key=_multipart_Z1CK5EDBK4AW.2~STK34H28LNYF.1 size=654139 2024-09-22T08:21:06.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.803+0000 7fe6c9c31780 1 < completed multipart upload key=Z1CK5EDBK4AW upload=STK34H28LNYF tag=1ZT711AXBYDP type=write size=2751291 2024-09-22T08:21:06.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.805+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~FGGFF403WLO7.0 size=271955 2024-09-22T08:21:06.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.805+0000 7fe6c9c31780 1 > prepared multipart upload key=9FCSIF1WKBDJ upload=FGGFF403WLO7 tag=2SAMTO5TWFH5 type=write size=1320531 2024-09-22T08:21:06.808 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.808+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~AQ8VI0WHL2RA.0 size=885239 2024-09-22T08:21:06.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.811+0000 7fe6c9c31780 1 < completed multipart upload key=T2W6RXP9UGHH upload=AQ8VI0WHL2RA tag=LB3BO5WE2JWD type=write size=1933815 2024-09-22T08:21:06.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.813+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~MOKWCRO2UDED.0 size=1029229 2024-09-22T08:21:06.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.813+0000 7fe6c9c31780 1 > prepared multipart upload key=XJP26CCPYDI7 upload=MOKWCRO2UDED tag=RYKKBDY73XT1 type=write size=2077805 2024-09-22T08:21:06.815 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.815+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~RGWQHRGTL4NS.0 size=1048576 2024-09-22T08:21:06.816 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.816+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~RGWQHRGTL4NS.1 size=1048576 2024-09-22T08:21:06.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.817+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~RGWQHRGTL4NS.2 size=141632 2024-09-22T08:21:06.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.819+0000 7fe6c9c31780 1 < completed multipart upload key=TE10GB1F35X4 upload=RGWQHRGTL4NS tag=PGULFW6W31HC type=write size=3287360 2024-09-22T08:21:06.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.821+0000 7fe6c9c31780 1 > prepared operation key=0PNK2ZW6IJM1 tag=2ZH2XH16J3GZ type=del size=1465793 2024-09-22T08:21:06.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.824+0000 7fe6c9c31780 1 < suggested update operation key=GEWQUFB9K35E tag=B8TZ0306OFM2 type=del size=3367479 2024-09-22T08:21:06.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.826+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=R5ZVPSC91ZZZ type=del size=2213545 2024-09-22T08:21:06.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.827+0000 7fe6c9c31780 1 < completed delete operation key=TE10GB1F35X4 tag=B0QHI1GI5N66 type=del 2024-09-22T08:21:06.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.828+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=PR7ERR0RGKT4 type=del size=2307697 2024-09-22T08:21:06.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.831+0000 7fe6c9c31780 1 < suggested update operation key=LA6ZRVULGQ0H tag=G0C4E7701VQP type=del size=369395 2024-09-22T08:21:06.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.834+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~EIVKOPH3ZCE0.0 size=1048576 2024-09-22T08:21:06.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.835+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~EIVKOPH3ZCE0.1 size=888714 2024-09-22T08:21:06.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.835+0000 7fe6c9c31780 1 > prepared multipart upload key=9FCSIF1WKBDJ upload=EIVKOPH3ZCE0 tag=GEDPE1PU1CG4 type=write size=2985866 2024-09-22T08:21:06.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.838+0000 7fe6c9c31780 1 < suggested remove operation key=0TWY0NNZZ7NN tag=G4UYWUT9383E type=del 2024-09-22T08:21:06.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.839+0000 7fe6c9c31780 1 > prepared operation key=VP1MP4IC9A7T tag=63U8BG001UPP type=del size=4101466 2024-09-22T08:21:06.841 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.840+0000 7fe6c9c31780 1 < completed delete operation key=XJP26CCPYDI7 tag=1L3CO21WQ0NI type=del 2024-09-22T08:21:06.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.842+0000 7fe6c9c31780 1 > prepared operation key=KZIY400KQ5NH tag=RQL16PBRK7XU type=write size=992298 2024-09-22T08:21:06.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.843+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~ONOR0UAJXOG9.0 size=1048576 2024-09-22T08:21:06.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.844+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~ONOR0UAJXOG9.1 size=978137 2024-09-22T08:21:06.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.847+0000 7fe6c9c31780 1 < completed multipart upload key=O1UBUQXP50CN upload=ONOR0UAJXOG9 tag=M517P5DY0EJH type=write size=3075289 2024-09-22T08:21:06.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.849+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~FY6C8EIG2D8E.0 size=319382 2024-09-22T08:21:06.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.849+0000 7fe6c9c31780 1 > prepared multipart upload key=KZIY400KQ5NH upload=FY6C8EIG2D8E tag=28ECOR1T7I2P type=write size=1367958 2024-09-22T08:21:06.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.851+0000 7fe6c9c31780 1 < completed write operation key=R7UWMW913DJQ tag=IHYA6SEOMZZP type=write size=677076 2024-09-22T08:21:06.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.853+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=JVC4UEQXOS72 type=del size=2171358 2024-09-22T08:21:06.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.854+0000 7fe6c9c31780 1 < completed delete operation key=946H8F2AUPO2 tag=L1T7CTFTL9SZ type=del 2024-09-22T08:21:06.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.856+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~M9HLH0CI7DB1.0 size=1004130 2024-09-22T08:21:06.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.856+0000 7fe6c9c31780 1 > prepared multipart upload key=ILW34WLX48WN upload=M9HLH0CI7DB1 tag=W61FLCY8XJQB type=write size=2052706 2024-09-22T08:21:06.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.858+0000 7fe6c9c31780 1 < completed part key=_multipart_GEWQUFB9K35E.2~5LIF0SR03MBP.0 size=1048576 2024-09-22T08:21:06.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.859+0000 7fe6c9c31780 1 < completed part key=_multipart_GEWQUFB9K35E.2~5LIF0SR03MBP.1 size=99417 2024-09-22T08:21:06.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.862+0000 7fe6c9c31780 1 < completed multipart upload key=GEWQUFB9K35E upload=5LIF0SR03MBP tag=2AS28V3XXA55 type=write size=2196569 2024-09-22T08:21:06.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.863+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=LPWUBUPRXA8M type=del size=1487452 2024-09-22T08:21:06.865 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.865+0000 7fe6c9c31780 1 < completed delete operation key=R7UWMW913DJQ tag=GUB7XHFBWE8Y type=del 2024-09-22T08:21:06.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.867+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~S8H0A1ROZPBG.0 size=1048576 2024-09-22T08:21:06.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.869+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~S8H0A1ROZPBG.1 size=803347 2024-09-22T08:21:06.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.869+0000 7fe6c9c31780 1 > prepared multipart upload key=JT5AB8VLMEFD upload=S8H0A1ROZPBG tag=VUIMAAK0O9BR type=write size=2900499 2024-09-22T08:21:06.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.871+0000 7fe6c9c31780 1 < completed delete operation key=T2W6RXP9UGHH tag=TEJV68W2QRU0 type=del 2024-09-22T08:21:06.873 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.872+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=KMKFZ4E9PO1J type=del size=389956 2024-09-22T08:21:06.874 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.874+0000 7fe6c9c31780 1 < completed delete operation key=9AZWQ9E58QS6 tag=MLVRIL9212Q2 type=del 2024-09-22T08:21:06.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.875+0000 7fe6c9c31780 1 > prepared operation key=JT5AB8VLMEFD tag=QQHN4GJRTX1N type=del size=1122754 2024-09-22T08:21:06.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.876+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~28EUPRJ30QV5.0 size=1048576 2024-09-22T08:21:06.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.877+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~28EUPRJ30QV5.1 size=1048576 2024-09-22T08:21:06.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.879+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~28EUPRJ30QV5.2 size=107322 2024-09-22T08:21:06.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.881+0000 7fe6c9c31780 1 < completed multipart upload key=0PNK2ZW6IJM1 upload=28EUPRJ30QV5 tag=7P3S8T0KNQ49 type=write size=3253050 2024-09-22T08:21:06.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.883+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=CU5TRSTAL4N8 type=write size=537611 2024-09-22T08:21:06.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.883+0000 7fe6c9c31780 1 < canceled part key=_multipart_9FCSIF1WKBDJ.2~FGGFF403WLO7.0 size=271955 2024-09-22T08:21:06.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.885+0000 7fe6c9c31780 1 < canceled multipart upload key=9FCSIF1WKBDJ upload=FGGFF403WLO7 tag=2SAMTO5TWFH5 type=write size=1320531 2024-09-22T08:21:06.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.887+0000 7fe6c9c31780 1 > prepared operation key=9FCSIF1WKBDJ tag=J5KGQUMLZ20H type=del size=2774947 2024-09-22T08:21:06.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.888+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~MOKWCRO2UDED.0 size=1029229 2024-09-22T08:21:06.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.890+0000 7fe6c9c31780 1 < completed multipart upload key=XJP26CCPYDI7 upload=MOKWCRO2UDED tag=RYKKBDY73XT1 type=write size=2077805 2024-09-22T08:21:06.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.892+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~9MPDJ763X1Z6.0 size=1048576 2024-09-22T08:21:06.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.893+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~9MPDJ763X1Z6.1 size=1048576 2024-09-22T08:21:06.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.894+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~9MPDJ763X1Z6.2 size=166384 2024-09-22T08:21:06.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.894+0000 7fe6c9c31780 1 > prepared multipart upload key=T2W6RXP9UGHH upload=9MPDJ763X1Z6 tag=RGHP69T7YM5T type=write size=3312112 2024-09-22T08:21:06.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.896+0000 7fe6c9c31780 1 < canceled operation key=0PNK2ZW6IJM1 tag=2ZH2XH16J3GZ type=del size=1465793 2024-09-22T08:21:06.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.898+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~6WF2HKMR1703.0 size=1048576 2024-09-22T08:21:06.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.900+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~6WF2HKMR1703.1 size=54841 2024-09-22T08:21:06.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.900+0000 7fe6c9c31780 1 > prepared multipart upload key=0TWY0NNZZ7NN upload=6WF2HKMR1703 tag=8BI47EI7F9UN type=write size=2151993 2024-09-22T08:21:06.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.901+0000 7fe6c9c31780 -1 < failed to complete operation key=0TWY0NNZZ7NN tag=R5ZVPSC91ZZZ type=del size=2213545: (22) Invalid argument 2024-09-22T08:21:06.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.903+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~811GTQ31XE6V.0 size=1048576 2024-09-22T08:21:06.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.905+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~811GTQ31XE6V.1 size=1048576 2024-09-22T08:21:06.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.906+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~811GTQ31XE6V.2 size=334307 2024-09-22T08:21:06.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.906+0000 7fe6c9c31780 1 > prepared multipart upload key=D85LJGGU3Z6F upload=811GTQ31XE6V tag=13X2XCN4JP5V type=write size=3480035 2024-09-22T08:21:06.908 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.907+0000 7fe6c9c31780 1 < completed delete operation key=6BKB91YV3FMW tag=PR7ERR0RGKT4 type=del 2024-09-22T08:21:06.909 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.909+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=1LGLGYY3HR7T type=del size=364715 2024-09-22T08:21:06.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.910+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~EIVKOPH3ZCE0.0 size=1048576 2024-09-22T08:21:06.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.912+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~EIVKOPH3ZCE0.1 size=888714 2024-09-22T08:21:06.914 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.914+0000 7fe6c9c31780 1 < completed multipart upload key=9FCSIF1WKBDJ upload=EIVKOPH3ZCE0 tag=GEDPE1PU1CG4 type=write size=2985866 2024-09-22T08:21:06.917 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.917+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~FG11BTX0QW53.0 size=1048576 2024-09-22T08:21:06.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.918+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~FG11BTX0QW53.1 size=1048576 2024-09-22T08:21:06.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.918+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~FG11BTX0QW53.2 size=72023 2024-09-22T08:21:06.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.918+0000 7fe6c9c31780 1 > prepared multipart upload key=0TWY0NNZZ7NN upload=FG11BTX0QW53 tag=BNTY09HSHXPO type=write size=3217751 2024-09-22T08:21:06.920 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.920+0000 7fe6c9c31780 1 < completed delete operation key=VP1MP4IC9A7T tag=63U8BG001UPP type=del 2024-09-22T08:21:06.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.921+0000 7fe6c9c31780 1 > prepared operation key=VP1MP4IC9A7T tag=S9TA4FIWKI6Y type=del size=716974 2024-09-22T08:21:06.923 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.923+0000 7fe6c9c31780 1 < completed write operation key=KZIY400KQ5NH tag=RQL16PBRK7XU type=write size=992298 2024-09-22T08:21:06.925 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.924+0000 7fe6c9c31780 1 > prepared operation key=Z1CK5EDBK4AW tag=HA9D6IIW3G82 type=del size=2757999 2024-09-22T08:21:06.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.925+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~FY6C8EIG2D8E.0 size=319382 2024-09-22T08:21:06.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.928+0000 7fe6c9c31780 1 < completed multipart upload key=KZIY400KQ5NH upload=FY6C8EIG2D8E tag=28ECOR1T7I2P type=write size=1367958 2024-09-22T08:21:06.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.930+0000 7fe6c9c31780 1 > prepared part key=_multipart_R7UWMW913DJQ.2~OX9LOZM3ABUO.0 size=554384 2024-09-22T08:21:06.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.930+0000 7fe6c9c31780 1 > prepared multipart upload key=R7UWMW913DJQ upload=OX9LOZM3ABUO tag=34DSB6GJA7VZ type=write size=1602960 2024-09-22T08:21:06.932 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.931+0000 7fe6c9c31780 1 < completed delete operation key=CTK01Y0CV1NC tag=JVC4UEQXOS72 type=del 2024-09-22T08:21:06.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.934+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~HIFQP8U15LO2.0 size=1048576 2024-09-22T08:21:06.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.935+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~HIFQP8U15LO2.1 size=1048576 2024-09-22T08:21:06.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.936+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~HIFQP8U15LO2.2 size=946092 2024-09-22T08:21:06.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.936+0000 7fe6c9c31780 1 > prepared multipart upload key=0TWY0NNZZ7NN upload=HIFQP8U15LO2 tag=8L7YC3NTYJ13 type=write size=4091820 2024-09-22T08:21:06.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.937+0000 7fe6c9c31780 1 < completed part key=_multipart_ILW34WLX48WN.2~M9HLH0CI7DB1.0 size=1004130 2024-09-22T08:21:06.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.940+0000 7fe6c9c31780 1 < completed multipart upload key=ILW34WLX48WN upload=M9HLH0CI7DB1 tag=W61FLCY8XJQB type=write size=2052706 2024-09-22T08:21:06.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.942+0000 7fe6c9c31780 1 > prepared operation key=0PNK2ZW6IJM1 tag=AK7K1G1TFWA4 type=write size=276245 2024-09-22T08:21:06.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.943+0000 7fe6c9c31780 1 < completed delete operation key=76HZ3LZGVT9J tag=LPWUBUPRXA8M type=del 2024-09-22T08:21:06.945 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.945+0000 7fe6c9c31780 1 > prepared operation key=KZIY400KQ5NH tag=X1OT8DZF6R7I type=del size=1113006 2024-09-22T08:21:06.947 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.946+0000 7fe6c9c31780 1 < completed part key=_multipart_JT5AB8VLMEFD.2~S8H0A1ROZPBG.0 size=1048576 2024-09-22T08:21:06.948 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.947+0000 7fe6c9c31780 1 < completed part key=_multipart_JT5AB8VLMEFD.2~S8H0A1ROZPBG.1 size=803347 2024-09-22T08:21:06.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.949+0000 7fe6c9c31780 1 < completed multipart upload key=JT5AB8VLMEFD upload=S8H0A1ROZPBG tag=VUIMAAK0O9BR type=write size=2900499 2024-09-22T08:21:06.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.952+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~CNPKZ6DTV1R1.0 size=1048576 2024-09-22T08:21:06.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.953+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~CNPKZ6DTV1R1.1 size=597450 2024-09-22T08:21:06.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.953+0000 7fe6c9c31780 1 > prepared multipart upload key=GEWQUFB9K35E upload=CNPKZ6DTV1R1 tag=RCUTKA8G1MIA type=write size=2694602 2024-09-22T08:21:06.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.954+0000 7fe6c9c31780 1 < completed delete operation key=946H8F2AUPO2 tag=KMKFZ4E9PO1J type=del 2024-09-22T08:21:06.957 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.957+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~O2DJ9MZID2GZ.0 size=125604 2024-09-22T08:21:06.957 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.957+0000 7fe6c9c31780 1 > prepared multipart upload key=KZIY400KQ5NH upload=O2DJ9MZID2GZ tag=GDMKD5JFBUYC type=write size=1174180 2024-09-22T08:21:06.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.958+0000 7fe6c9c31780 1 < completed delete operation key=JT5AB8VLMEFD tag=QQHN4GJRTX1N type=del 2024-09-22T08:21:06.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.959+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=5RVGAD598KD5 type=write size=412445 2024-09-22T08:21:06.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.961+0000 7fe6c9c31780 1 < completed write operation key=ILW34WLX48WN tag=CU5TRSTAL4N8 type=write size=537611 2024-09-22T08:21:06.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.964+0000 7fe6c9c31780 1 > prepared part key=_multipart_TJTB67QBLZH5.2~105R1JZQLIS9.0 size=1048576 2024-09-22T08:21:06.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.964+0000 7fe6c9c31780 1 > prepared part key=_multipart_TJTB67QBLZH5.2~105R1JZQLIS9.1 size=511663 2024-09-22T08:21:06.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.964+0000 7fe6c9c31780 1 > prepared multipart upload key=TJTB67QBLZH5 upload=105R1JZQLIS9 tag=9BXBG2QNFXK0 type=write size=2608815 2024-09-22T08:21:06.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.966+0000 7fe6c9c31780 1 < completed delete operation key=9FCSIF1WKBDJ tag=J5KGQUMLZ20H type=del 2024-09-22T08:21:06.968 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.967+0000 7fe6c9c31780 1 > prepared operation key=0PNK2ZW6IJM1 tag=XWLYT5YYYZ34 type=del size=517226 2024-09-22T08:21:06.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.969+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~9MPDJ763X1Z6.0 size=1048576 2024-09-22T08:21:06.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.970+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~9MPDJ763X1Z6.1 size=1048576 2024-09-22T08:21:06.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.971+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~9MPDJ763X1Z6.2 size=166384 2024-09-22T08:21:06.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.973+0000 7fe6c9c31780 1 < completed multipart upload key=T2W6RXP9UGHH upload=9MPDJ763X1Z6 tag=RGHP69T7YM5T type=write size=3312112 2024-09-22T08:21:06.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.975+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=KGMNIJNPD523 type=del size=3803487 2024-09-22T08:21:06.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.976+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~6WF2HKMR1703.0 size=1048576 2024-09-22T08:21:06.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.978+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~6WF2HKMR1703.1 size=54841 2024-09-22T08:21:06.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.980+0000 7fe6c9c31780 1 < completed multipart upload key=0TWY0NNZZ7NN upload=6WF2HKMR1703 tag=8BI47EI7F9UN type=write size=2151993 2024-09-22T08:21:06.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.982+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~GONJBTJZZ15Y.0 size=1048576 2024-09-22T08:21:06.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.983+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~GONJBTJZZ15Y.1 size=916570 2024-09-22T08:21:06.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.983+0000 7fe6c9c31780 1 > prepared multipart upload key=TYVQ39KUV2V9 upload=GONJBTJZZ15Y tag=YAAB460PWWW1 type=write size=3013722 2024-09-22T08:21:06.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.985+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~811GTQ31XE6V.0 size=1048576 2024-09-22T08:21:06.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.986+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~811GTQ31XE6V.1 size=1048576 2024-09-22T08:21:06.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.987+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~811GTQ31XE6V.2 size=334307 2024-09-22T08:21:06.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.989+0000 7fe6c9c31780 1 < completed multipart upload key=D85LJGGU3Z6F upload=811GTQ31XE6V tag=13X2XCN4JP5V type=write size=3480035 2024-09-22T08:21:06.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.992+0000 7fe6c9c31780 1 > prepared part key=_multipart_W9L87PTJEIOA.2~KEAI0BUREBLJ.0 size=510830 2024-09-22T08:21:06.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.992+0000 7fe6c9c31780 1 > prepared multipart upload key=W9L87PTJEIOA upload=KEAI0BUREBLJ tag=9OPD0B9EB8C2 type=write size=1559406 2024-09-22T08:21:06.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.993+0000 7fe6c9c31780 1 < completed delete operation key=6BKB91YV3FMW tag=1LGLGYY3HR7T type=del 2024-09-22T08:21:06.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.995+0000 7fe6c9c31780 1 > prepared operation key=GEWQUFB9K35E tag=TPL17I2RRKDO type=del size=749957 2024-09-22T08:21:06.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.996+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~FG11BTX0QW53.0 size=1048576 2024-09-22T08:21:06.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.997+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~FG11BTX0QW53.1 size=1048576 2024-09-22T08:21:06.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:06.997+0000 7fe6c9c31780 1 < canceled part key=_multipart_0TWY0NNZZ7NN.2~FG11BTX0QW53.2 size=72023 2024-09-22T08:21:07.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.000+0000 7fe6c9c31780 1 < canceled multipart upload key=0TWY0NNZZ7NN upload=FG11BTX0QW53 tag=BNTY09HSHXPO type=write size=3217751 2024-09-22T08:21:07.002 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.001+0000 7fe6c9c31780 1 > prepared operation key=GEWQUFB9K35E tag=AF7J13BP04VZ type=del size=900445 2024-09-22T08:21:07.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.004+0000 7fe6c9c31780 1 < suggested update operation key=VP1MP4IC9A7T tag=S9TA4FIWKI6Y type=del size=716974 2024-09-22T08:21:07.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.007+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~LDBWUY8DMLTI.0 size=1048576 2024-09-22T08:21:07.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.008+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~LDBWUY8DMLTI.1 size=1048576 2024-09-22T08:21:07.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.009+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~LDBWUY8DMLTI.2 size=727632 2024-09-22T08:21:07.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.009+0000 7fe6c9c31780 1 > prepared multipart upload key=XJP26CCPYDI7 upload=LDBWUY8DMLTI tag=RKUKLL0NF1GA type=write size=3873360 2024-09-22T08:21:07.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.011+0000 7fe6c9c31780 1 < completed delete operation key=Z1CK5EDBK4AW tag=HA9D6IIW3G82 type=del 2024-09-22T08:21:07.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.014+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~373FWGM0VKHS.0 size=1048576 2024-09-22T08:21:07.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.015+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~373FWGM0VKHS.1 size=371410 2024-09-22T08:21:07.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.015+0000 7fe6c9c31780 1 > prepared multipart upload key=7446WN19QFV0 upload=373FWGM0VKHS tag=J1JWR6T2BBCX type=write size=2468562 2024-09-22T08:21:07.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.017+0000 7fe6c9c31780 1 < completed part key=_multipart_R7UWMW913DJQ.2~OX9LOZM3ABUO.0 size=554384 2024-09-22T08:21:07.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.019+0000 7fe6c9c31780 1 < completed multipart upload key=R7UWMW913DJQ upload=OX9LOZM3ABUO tag=34DSB6GJA7VZ type=write size=1602960 2024-09-22T08:21:07.022 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.022+0000 7fe6c9c31780 1 > prepared part key=_multipart_R7UWMW913DJQ.2~J5WTC22POB9Y.0 size=424815 2024-09-22T08:21:07.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.022+0000 7fe6c9c31780 1 > prepared multipart upload key=R7UWMW913DJQ upload=J5WTC22POB9Y tag=MP2EL1Y6Z10H type=write size=1473391 2024-09-22T08:21:07.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.023+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~HIFQP8U15LO2.0 size=1048576 2024-09-22T08:21:07.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.024+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~HIFQP8U15LO2.1 size=1048576 2024-09-22T08:21:07.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.025+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~HIFQP8U15LO2.2 size=946092 2024-09-22T08:21:07.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.028+0000 7fe6c9c31780 1 < completed multipart upload key=0TWY0NNZZ7NN upload=HIFQP8U15LO2 tag=8L7YC3NTYJ13 type=write size=4091820 2024-09-22T08:21:07.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.029+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=72LYZXEAZ2GB type=del size=1832631 2024-09-22T08:21:07.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.032+0000 7fe6c9c31780 1 < suggested update operation key=0PNK2ZW6IJM1 tag=AK7K1G1TFWA4 type=write size=276245 2024-09-22T08:21:07.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.034+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~33F3WAR88M6I.0 size=1048576 2024-09-22T08:21:07.038 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.035+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~33F3WAR88M6I.1 size=1048576 2024-09-22T08:21:07.038 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.037+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~33F3WAR88M6I.2 size=1040063 2024-09-22T08:21:07.038 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.037+0000 7fe6c9c31780 1 > prepared multipart upload key=KZIY400KQ5NH upload=33F3WAR88M6I tag=X3GWGTTREZ24 type=write size=4185791 2024-09-22T08:21:07.040 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.039+0000 7fe6c9c31780 1 < suggested update operation key=KZIY400KQ5NH tag=X1OT8DZF6R7I type=del size=1113006 2024-09-22T08:21:07.041 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.041+0000 7fe6c9c31780 1 > prepared operation key=GEWQUFB9K35E tag=L8JCU2F2I08E type=del size=96140 2024-09-22T08:21:07.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.042+0000 7fe6c9c31780 1 < completed part key=_multipart_GEWQUFB9K35E.2~CNPKZ6DTV1R1.0 size=1048576 2024-09-22T08:21:07.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.043+0000 7fe6c9c31780 1 < completed part key=_multipart_GEWQUFB9K35E.2~CNPKZ6DTV1R1.1 size=597450 2024-09-22T08:21:07.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.046+0000 7fe6c9c31780 1 < completed multipart upload key=GEWQUFB9K35E upload=CNPKZ6DTV1R1 tag=RCUTKA8G1MIA type=write size=2694602 2024-09-22T08:21:07.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.047+0000 7fe6c9c31780 1 > prepared operation key=9FCSIF1WKBDJ tag=LH1PGHXWY5NW type=del size=834714 2024-09-22T08:21:07.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.049+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~O2DJ9MZID2GZ.0 size=125604 2024-09-22T08:21:07.052 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.052+0000 7fe6c9c31780 1 < completed multipart upload key=KZIY400KQ5NH upload=O2DJ9MZID2GZ tag=GDMKD5JFBUYC type=write size=1174180 2024-09-22T08:21:07.055 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.054+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~HMK2QIE63KOD.0 size=1048576 2024-09-22T08:21:07.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.055+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~HMK2QIE63KOD.1 size=1048576 2024-09-22T08:21:07.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.056+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~HMK2QIE63KOD.2 size=1035956 2024-09-22T08:21:07.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.056+0000 7fe6c9c31780 1 > prepared multipart upload key=7446WN19QFV0 upload=HMK2QIE63KOD tag=JV8PYQETPP9R type=write size=4181684 2024-09-22T08:21:07.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.058+0000 7fe6c9c31780 1 < completed write operation key=0TWY0NNZZ7NN tag=5RVGAD598KD5 type=write size=412445 2024-09-22T08:21:07.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.059+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=7IKM16FBSECX type=del size=2680649 2024-09-22T08:21:07.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.061+0000 7fe6c9c31780 1 < completed part key=_multipart_TJTB67QBLZH5.2~105R1JZQLIS9.0 size=1048576 2024-09-22T08:21:07.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.061+0000 7fe6c9c31780 1 < canceled part key=_multipart_TJTB67QBLZH5.2~105R1JZQLIS9.1 size=511663 2024-09-22T08:21:07.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.063+0000 7fe6c9c31780 1 < canceled multipart upload key=TJTB67QBLZH5 upload=105R1JZQLIS9 tag=9BXBG2QNFXK0 type=write size=2608815 2024-09-22T08:21:07.066 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.065+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~3JZDLU48L3GJ.0 size=1048576 2024-09-22T08:21:07.067 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.067+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~3JZDLU48L3GJ.1 size=857825 2024-09-22T08:21:07.067 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.067+0000 7fe6c9c31780 1 > prepared multipart upload key=CTK01Y0CV1NC upload=3JZDLU48L3GJ tag=8GBEH6J1Z131 type=write size=2954977 2024-09-22T08:21:07.069 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.068+0000 7fe6c9c31780 -1 < failed to complete operation key=0PNK2ZW6IJM1 tag=XWLYT5YYYZ34 type=del size=517226: (22) Invalid argument 2024-09-22T08:21:07.073 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.073+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~P12T3P82CPJI.0 size=463349 2024-09-22T08:21:07.073 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.073+0000 7fe6c9c31780 1 > prepared multipart upload key=TE10GB1F35X4 upload=P12T3P82CPJI tag=V7AL43M6D7SA type=write size=1511925 2024-09-22T08:21:07.075 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.074+0000 7fe6c9c31780 1 < completed delete operation key=R7UWMW913DJQ tag=KGMNIJNPD523 type=del 2024-09-22T08:21:07.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.075+0000 7fe6c9c31780 1 > prepared operation key=ZFL9N44PBQX4 tag=7N4NPBMKSR85 type=del size=3088059 2024-09-22T08:21:07.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.077+0000 7fe6c9c31780 1 < completed part key=_multipart_TYVQ39KUV2V9.2~GONJBTJZZ15Y.0 size=1048576 2024-09-22T08:21:07.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.077+0000 7fe6c9c31780 1 < canceled part key=_multipart_TYVQ39KUV2V9.2~GONJBTJZZ15Y.1 size=916570 2024-09-22T08:21:07.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.079+0000 7fe6c9c31780 1 < canceled multipart upload key=TYVQ39KUV2V9 upload=GONJBTJZZ15Y tag=YAAB460PWWW1 type=write size=3013722 2024-09-22T08:21:07.081 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.080+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=B6FWML1XY949 type=write size=836432 2024-09-22T08:21:07.082 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.082+0000 7fe6c9c31780 1 < completed part key=_multipart_W9L87PTJEIOA.2~KEAI0BUREBLJ.0 size=510830 2024-09-22T08:21:07.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.084+0000 7fe6c9c31780 1 < completed multipart upload key=W9L87PTJEIOA upload=KEAI0BUREBLJ tag=9OPD0B9EB8C2 type=write size=1559406 2024-09-22T08:21:07.086 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.085+0000 7fe6c9c31780 1 > prepared operation key=FY40JTHLT0KU tag=FXDKBVX819U5 type=del size=1228531 2024-09-22T08:21:07.088 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.088+0000 7fe6c9c31780 1 < suggested remove operation key=GEWQUFB9K35E tag=TPL17I2RRKDO type=del 2024-09-22T08:21:07.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.090+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=HFA8F2J86F64 type=del size=1749938 2024-09-22T08:21:07.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.090+0000 7fe6c9c31780 -1 < failed to complete operation key=GEWQUFB9K35E tag=AF7J13BP04VZ type=del size=900445: (22) Invalid argument 2024-09-22T08:21:07.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.092+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=OAOZXMD38N7X type=del size=3062290 2024-09-22T08:21:07.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.093+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~LDBWUY8DMLTI.0 size=1048576 2024-09-22T08:21:07.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.095+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~LDBWUY8DMLTI.1 size=1048576 2024-09-22T08:21:07.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.096+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~LDBWUY8DMLTI.2 size=727632 2024-09-22T08:21:07.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.098+0000 7fe6c9c31780 1 < completed multipart upload key=XJP26CCPYDI7 upload=LDBWUY8DMLTI tag=RKUKLL0NF1GA type=write size=3873360 2024-09-22T08:21:07.100 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.100+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=286390UQE0LC type=del size=711468 2024-09-22T08:21:07.102 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.101+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~373FWGM0VKHS.0 size=1048576 2024-09-22T08:21:07.102 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.101+0000 7fe6c9c31780 1 < canceled part key=_multipart_7446WN19QFV0.2~373FWGM0VKHS.1 size=371410 2024-09-22T08:21:07.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.103+0000 7fe6c9c31780 1 < canceled multipart upload key=7446WN19QFV0 upload=373FWGM0VKHS tag=J1JWR6T2BBCX type=write size=2468562 2024-09-22T08:21:07.105 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.105+0000 7fe6c9c31780 1 > prepared operation key=XJP26CCPYDI7 tag=UZ8MZPENAM7X type=del size=2187331 2024-09-22T08:21:07.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.106+0000 7fe6c9c31780 1 < completed part key=_multipart_R7UWMW913DJQ.2~J5WTC22POB9Y.0 size=424815 2024-09-22T08:21:07.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.108+0000 7fe6c9c31780 1 < completed multipart upload key=R7UWMW913DJQ upload=J5WTC22POB9Y tag=MP2EL1Y6Z10H type=write size=1473391 2024-09-22T08:21:07.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.110+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=E1QQTD3VVA62 type=write size=34730 2024-09-22T08:21:07.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.111+0000 7fe6c9c31780 1 < completed delete operation key=76HZ3LZGVT9J tag=72LYZXEAZ2GB type=del 2024-09-22T08:21:07.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.113+0000 7fe6c9c31780 1 > prepared operation key=0PNK2ZW6IJM1 tag=I6ZB8FK2KHLE type=del size=1562368 2024-09-22T08:21:07.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.114+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~33F3WAR88M6I.0 size=1048576 2024-09-22T08:21:07.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.115+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~33F3WAR88M6I.1 size=1048576 2024-09-22T08:21:07.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.116+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~33F3WAR88M6I.2 size=1040063 2024-09-22T08:21:07.119 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.119+0000 7fe6c9c31780 1 < completed multipart upload key=KZIY400KQ5NH upload=33F3WAR88M6I tag=X3GWGTTREZ24 type=write size=4185791 2024-09-22T08:21:07.122 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.121+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~XV04X2IZ2S7K.0 size=752339 2024-09-22T08:21:07.122 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.121+0000 7fe6c9c31780 1 > prepared multipart upload key=D85LJGGU3Z6F upload=XV04X2IZ2S7K tag=DL3P0VREHETQ type=write size=1800915 2024-09-22T08:21:07.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.123+0000 7fe6c9c31780 -1 < failed to complete operation key=GEWQUFB9K35E tag=L8JCU2F2I08E type=del size=96140: (22) Invalid argument 2024-09-22T08:21:07.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.124+0000 7fe6c9c31780 1 > prepared operation key=D85LJGGU3Z6F tag=BMGLRDPCZLQT type=del size=2408517 2024-09-22T08:21:07.126 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.126+0000 7fe6c9c31780 1 < completed delete operation key=9FCSIF1WKBDJ tag=LH1PGHXWY5NW type=del 2024-09-22T08:21:07.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.127+0000 7fe6c9c31780 1 > prepared operation key=D85LJGGU3Z6F tag=PXKW7FLZC8UM type=del size=945311 2024-09-22T08:21:07.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.128+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~HMK2QIE63KOD.0 size=1048576 2024-09-22T08:21:07.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.130+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~HMK2QIE63KOD.1 size=1048576 2024-09-22T08:21:07.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.130+0000 7fe6c9c31780 1 < canceled part key=_multipart_7446WN19QFV0.2~HMK2QIE63KOD.2 size=1035956 2024-09-22T08:21:07.132 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.132+0000 7fe6c9c31780 1 < canceled multipart upload key=7446WN19QFV0 upload=HMK2QIE63KOD tag=JV8PYQETPP9R type=write size=4181684 2024-09-22T08:21:07.134 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.134+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=0NKGJSGXB7NU type=del size=3772558 2024-09-22T08:21:07.135 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.135+0000 7fe6c9c31780 1 < completed delete operation key=6BKB91YV3FMW tag=7IKM16FBSECX type=del 2024-09-22T08:21:07.138 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.139+0000 7fe6c9c31780 1 > prepared part key=_multipart_W9L87PTJEIOA.2~MFNOZL17GC5G.0 size=1048576 2024-09-22T08:21:07.140 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.139+0000 7fe6c9c31780 1 > prepared part key=_multipart_W9L87PTJEIOA.2~MFNOZL17GC5G.1 size=498144 2024-09-22T08:21:07.140 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.139+0000 7fe6c9c31780 1 > prepared multipart upload key=W9L87PTJEIOA upload=MFNOZL17GC5G tag=V703QF0T9UVQ type=write size=2595296 2024-09-22T08:21:07.141 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.140+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~3JZDLU48L3GJ.0 size=1048576 2024-09-22T08:21:07.142 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.142+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~3JZDLU48L3GJ.1 size=857825 2024-09-22T08:21:07.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.144+0000 7fe6c9c31780 1 < completed multipart upload key=CTK01Y0CV1NC upload=3JZDLU48L3GJ tag=8GBEH6J1Z131 type=write size=2954977 2024-09-22T08:21:07.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.146+0000 7fe6c9c31780 1 > prepared operation key=TYVQ39KUV2V9 tag=J8R9E84AI7VJ type=del size=2627118 2024-09-22T08:21:07.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.147+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~P12T3P82CPJI.0 size=463349 2024-09-22T08:21:07.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.150+0000 7fe6c9c31780 1 < completed multipart upload key=TE10GB1F35X4 upload=P12T3P82CPJI tag=V7AL43M6D7SA type=write size=1511925 2024-09-22T08:21:07.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.152+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~2DNOKPY7NFNK.0 size=1048576 2024-09-22T08:21:07.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.153+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~2DNOKPY7NFNK.1 size=277506 2024-09-22T08:21:07.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.153+0000 7fe6c9c31780 1 > prepared multipart upload key=O1UBUQXP50CN upload=2DNOKPY7NFNK tag=Z5VD4V249T6Z type=write size=2374658 2024-09-22T08:21:07.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.155+0000 7fe6c9c31780 1 < completed delete operation key=ZFL9N44PBQX4 tag=7N4NPBMKSR85 type=del 2024-09-22T08:21:07.157 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.156+0000 7fe6c9c31780 1 > prepared operation key=4KRJ7DTE3KDV tag=5OS30GRA4G8H type=del size=1782898 2024-09-22T08:21:07.159 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.159+0000 7fe6c9c31780 1 < suggested remove operation key=0TWY0NNZZ7NN tag=B6FWML1XY949 type=write 2024-09-22T08:21:07.161 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.160+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=V1ME9R29L8NN type=del size=1693892 2024-09-22T08:21:07.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.163+0000 7fe6c9c31780 1 < completed delete operation key=FY40JTHLT0KU tag=FXDKBVX819U5 type=del 2024-09-22T08:21:07.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.164+0000 7fe6c9c31780 1 > prepared operation key=ZFL9N44PBQX4 tag=B43Y67LNDN4L type=del size=618360 2024-09-22T08:21:07.166 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.165+0000 7fe6c9c31780 1 < completed delete operation key=9AZWQ9E58QS6 tag=HFA8F2J86F64 type=del 2024-09-22T08:21:07.168 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.168+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~OHS9RSNU3KLV.0 size=1048576 2024-09-22T08:21:07.170 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.169+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~OHS9RSNU3KLV.1 size=1048576 2024-09-22T08:21:07.171 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.170+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~OHS9RSNU3KLV.2 size=989682 2024-09-22T08:21:07.171 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.170+0000 7fe6c9c31780 1 > prepared multipart upload key=XJP26CCPYDI7 upload=OHS9RSNU3KLV tag=7HAULO7D457P type=write size=4135410 2024-09-22T08:21:07.172 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.172+0000 7fe6c9c31780 1 < completed delete operation key=ILW34WLX48WN tag=OAOZXMD38N7X type=del 2024-09-22T08:21:07.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.173+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=9FUDYQ0TW6WG type=write size=413793 2024-09-22T08:21:07.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.175+0000 7fe6c9c31780 1 < completed delete operation key=946H8F2AUPO2 tag=286390UQE0LC type=del 2024-09-22T08:21:07.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.177+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~985CHRNMP93T.0 size=1048576 2024-09-22T08:21:07.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.179+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~985CHRNMP93T.1 size=1048576 2024-09-22T08:21:07.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.180+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~985CHRNMP93T.2 size=349266 2024-09-22T08:21:07.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.180+0000 7fe6c9c31780 1 > prepared multipart upload key=VP1MP4IC9A7T upload=985CHRNMP93T tag=C2TB9ZAIYEKI type=write size=3494994 2024-09-22T08:21:07.183 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.182+0000 7fe6c9c31780 1 < completed delete operation key=XJP26CCPYDI7 tag=UZ8MZPENAM7X type=del 2024-09-22T08:21:07.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.184+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=GCC0ORVIT3YH type=write size=588580 2024-09-22T08:21:07.186 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.185+0000 7fe6c9c31780 1 < completed write operation key=7446WN19QFV0 tag=E1QQTD3VVA62 type=write size=34730 2024-09-22T08:21:07.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.187+0000 7fe6c9c31780 1 > prepared operation key=4KRJ7DTE3KDV tag=99V5O8ONZV81 type=write size=947823 2024-09-22T08:21:07.189 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.189+0000 7fe6c9c31780 1 < completed delete operation key=0PNK2ZW6IJM1 tag=I6ZB8FK2KHLE type=del 2024-09-22T08:21:07.191 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.190+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=W3PTOF49X0MX type=del size=978872 2024-09-22T08:21:07.192 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.192+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~XV04X2IZ2S7K.0 size=752339 2024-09-22T08:21:07.194 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.194+0000 7fe6c9c31780 1 < completed multipart upload key=D85LJGGU3Z6F upload=XV04X2IZ2S7K tag=DL3P0VREHETQ type=write size=1800915 2024-09-22T08:21:07.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.197+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~M0PJN9849BF7.0 size=1048576 2024-09-22T08:21:07.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.198+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~M0PJN9849BF7.1 size=556528 2024-09-22T08:21:07.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.198+0000 7fe6c9c31780 1 > prepared multipart upload key=CTK01Y0CV1NC upload=M0PJN9849BF7 tag=W9ZZJGKWOCI8 type=write size=2653680 2024-09-22T08:21:07.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.199+0000 7fe6c9c31780 1 < completed delete operation key=D85LJGGU3Z6F tag=BMGLRDPCZLQT type=del 2024-09-22T08:21:07.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.202+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~Y6ADAR4GB903.0 size=1048576 2024-09-22T08:21:07.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.203+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~Y6ADAR4GB903.1 size=1048576 2024-09-22T08:21:07.205 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.204+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~Y6ADAR4GB903.2 size=463708 2024-09-22T08:21:07.205 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.204+0000 7fe6c9c31780 1 > prepared multipart upload key=OX1LY7URY7IV upload=Y6ADAR4GB903 tag=2SUATJ5HUNC8 type=write size=3609436 2024-09-22T08:21:07.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.208+0000 7fe6c9c31780 1 < suggested update operation key=D85LJGGU3Z6F tag=PXKW7FLZC8UM type=del size=945311 2024-09-22T08:21:07.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.211+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~WO0Z8FRDBB37.0 size=109518 2024-09-22T08:21:07.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.211+0000 7fe6c9c31780 1 > prepared multipart upload key=9FCSIF1WKBDJ upload=WO0Z8FRDBB37 tag=6I9Z61ZMEI7Q type=write size=1158094 2024-09-22T08:21:07.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.212+0000 7fe6c9c31780 1 < completed delete operation key=CTK01Y0CV1NC tag=0NKGJSGXB7NU type=del 2024-09-22T08:21:07.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.214+0000 7fe6c9c31780 1 > prepared operation key=1HZ0NAJPXNW1 tag=6LM3MWMG5KWZ type=del size=349209 2024-09-22T08:21:07.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.216+0000 7fe6c9c31780 1 < completed part key=_multipart_W9L87PTJEIOA.2~MFNOZL17GC5G.0 size=1048576 2024-09-22T08:21:07.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.217+0000 7fe6c9c31780 1 < completed part key=_multipart_W9L87PTJEIOA.2~MFNOZL17GC5G.1 size=498144 2024-09-22T08:21:07.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.219+0000 7fe6c9c31780 1 < completed multipart upload key=W9L87PTJEIOA upload=MFNOZL17GC5G tag=V703QF0T9UVQ type=write size=2595296 2024-09-22T08:21:07.221 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.220+0000 7fe6c9c31780 1 > prepared operation key=ZFL9N44PBQX4 tag=AD7PK8XFML3V type=del size=1394669 2024-09-22T08:21:07.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.222+0000 7fe6c9c31780 1 < completed delete operation key=TYVQ39KUV2V9 tag=J8R9E84AI7VJ type=del 2024-09-22T08:21:07.224 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.223+0000 7fe6c9c31780 1 > prepared operation key=TJTB67QBLZH5 tag=CEKRSULRW924 type=del size=3810855 2024-09-22T08:21:07.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.225+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~2DNOKPY7NFNK.0 size=1048576 2024-09-22T08:21:07.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.225+0000 7fe6c9c31780 1 < canceled part key=_multipart_O1UBUQXP50CN.2~2DNOKPY7NFNK.1 size=277506 2024-09-22T08:21:07.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.228+0000 7fe6c9c31780 1 < canceled multipart upload key=O1UBUQXP50CN upload=2DNOKPY7NFNK tag=Z5VD4V249T6Z type=write size=2374658 2024-09-22T08:21:07.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.230+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~4SI4SKS7USAM.0 size=1048576 2024-09-22T08:21:07.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.231+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~4SI4SKS7USAM.1 size=108835 2024-09-22T08:21:07.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.231+0000 7fe6c9c31780 1 > prepared multipart upload key=GEWQUFB9K35E upload=4SI4SKS7USAM tag=U56KWRSHUESD type=write size=2205987 2024-09-22T08:21:07.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.232+0000 7fe6c9c31780 1 < completed delete operation key=4KRJ7DTE3KDV tag=5OS30GRA4G8H type=del 2024-09-22T08:21:07.235 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.234+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=49H2RKIPX7GC type=del size=2407337 2024-09-22T08:21:07.236 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.235+0000 7fe6c9c31780 1 < completed delete operation key=6BKB91YV3FMW tag=V1ME9R29L8NN type=del 2024-09-22T08:21:07.237 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.237+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=24H7U8QNQ95N type=write size=94081 2024-09-22T08:21:07.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.239+0000 7fe6c9c31780 1 < suggested remove operation key=ZFL9N44PBQX4 tag=B43Y67LNDN4L type=del 2024-09-22T08:21:07.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.242+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~1D99JQTK131O.0 size=1048576 2024-09-22T08:21:07.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.243+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~1D99JQTK131O.1 size=1048576 2024-09-22T08:21:07.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.244+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~1D99JQTK131O.2 size=121987 2024-09-22T08:21:07.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.244+0000 7fe6c9c31780 1 > prepared multipart upload key=7446WN19QFV0 upload=1D99JQTK131O tag=LFN1DA4S6VTW type=write size=3267715 2024-09-22T08:21:07.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.245+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~OHS9RSNU3KLV.0 size=1048576 2024-09-22T08:21:07.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.247+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~OHS9RSNU3KLV.1 size=1048576 2024-09-22T08:21:07.248 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.247+0000 7fe6c9c31780 1 < canceled part key=_multipart_XJP26CCPYDI7.2~OHS9RSNU3KLV.2 size=989682 2024-09-22T08:21:07.249 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.249+0000 7fe6c9c31780 1 < canceled multipart upload key=XJP26CCPYDI7 upload=OHS9RSNU3KLV tag=7HAULO7D457P type=write size=4135410 2024-09-22T08:21:07.252 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.251+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~4GD8SZQW4ZOL.0 size=1048576 2024-09-22T08:21:07.253 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.252+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~4GD8SZQW4ZOL.1 size=1048576 2024-09-22T08:21:07.254 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.254+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~4GD8SZQW4ZOL.2 size=819207 2024-09-22T08:21:07.255 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.254+0000 7fe6c9c31780 1 > prepared multipart upload key=Z1CK5EDBK4AW upload=4GD8SZQW4ZOL tag=942HTW7CWGXF type=write size=3964935 2024-09-22T08:21:07.256 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.255+0000 7fe6c9c31780 1 < completed write operation key=R7UWMW913DJQ tag=9FUDYQ0TW6WG type=write size=413793 2024-09-22T08:21:07.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.257+0000 7fe6c9c31780 1 > prepared operation key=W9L87PTJEIOA tag=H6MDQL8MGGGQ type=del size=1453344 2024-09-22T08:21:07.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.258+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~985CHRNMP93T.0 size=1048576 2024-09-22T08:21:07.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.259+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~985CHRNMP93T.1 size=1048576 2024-09-22T08:21:07.261 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.260+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~985CHRNMP93T.2 size=349266 2024-09-22T08:21:07.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.263+0000 7fe6c9c31780 1 < completed multipart upload key=VP1MP4IC9A7T upload=985CHRNMP93T tag=C2TB9ZAIYEKI type=write size=3494994 2024-09-22T08:21:07.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.264+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=4CWFDI156P08 type=del size=386234 2024-09-22T08:21:07.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.266+0000 7fe6c9c31780 1 < completed write operation key=9AZWQ9E58QS6 tag=GCC0ORVIT3YH type=write size=588580 2024-09-22T08:21:07.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.268+0000 7fe6c9c31780 1 > prepared operation key=FY40JTHLT0KU tag=3OGU49VC0RWN type=del size=355497 2024-09-22T08:21:07.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.269+0000 7fe6c9c31780 1 < completed write operation key=4KRJ7DTE3KDV tag=99V5O8ONZV81 type=write size=947823 2024-09-22T08:21:07.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.271+0000 7fe6c9c31780 1 > prepared operation key=OX1LY7URY7IV tag=130THU1Q1BSP type=del size=2834273 2024-09-22T08:21:07.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.272+0000 7fe6c9c31780 1 < canceled operation key=TE10GB1F35X4 tag=W3PTOF49X0MX type=del size=978872 2024-09-22T08:21:07.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.273+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=6PVOOELZZ16R type=write size=780187 2024-09-22T08:21:07.276 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.275+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~M0PJN9849BF7.0 size=1048576 2024-09-22T08:21:07.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.276+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~M0PJN9849BF7.1 size=556528 2024-09-22T08:21:07.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.279+0000 7fe6c9c31780 1 < completed multipart upload key=CTK01Y0CV1NC upload=M0PJN9849BF7 tag=W9ZZJGKWOCI8 type=write size=2653680 2024-09-22T08:21:07.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.281+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~I8P397RLCNAQ.0 size=1048576 2024-09-22T08:21:07.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.282+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~I8P397RLCNAQ.1 size=1048576 2024-09-22T08:21:07.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.284+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~I8P397RLCNAQ.2 size=471848 2024-09-22T08:21:07.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.284+0000 7fe6c9c31780 1 > prepared multipart upload key=ILW34WLX48WN upload=I8P397RLCNAQ tag=Y80N8KY3KJ1I type=write size=3617576 2024-09-22T08:21:07.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.285+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~Y6ADAR4GB903.0 size=1048576 2024-09-22T08:21:07.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.286+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~Y6ADAR4GB903.1 size=1048576 2024-09-22T08:21:07.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.287+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~Y6ADAR4GB903.2 size=463708 2024-09-22T08:21:07.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.290+0000 7fe6c9c31780 1 < completed multipart upload key=OX1LY7URY7IV upload=Y6ADAR4GB903 tag=2SUATJ5HUNC8 type=write size=3609436 2024-09-22T08:21:07.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.294+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~2CR6FIC9KEKK.0 size=901115 2024-09-22T08:21:07.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.294+0000 7fe6c9c31780 1 > prepared multipart upload key=76HZ3LZGVT9J upload=2CR6FIC9KEKK tag=6TMNB4NFFP0H type=write size=1949691 2024-09-22T08:21:07.296 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.295+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~WO0Z8FRDBB37.0 size=109518 2024-09-22T08:21:07.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.299+0000 7fe6c9c31780 1 < completed multipart upload key=9FCSIF1WKBDJ upload=WO0Z8FRDBB37 tag=6I9Z61ZMEI7Q type=write size=1158094 2024-09-22T08:21:07.302 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.301+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~4N5LI4Q2MEGP.0 size=880795 2024-09-22T08:21:07.302 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.301+0000 7fe6c9c31780 1 > prepared multipart upload key=LA6ZRVULGQ0H upload=4N5LI4Q2MEGP tag=CVWJY2QW7O9S type=write size=1929371 2024-09-22T08:21:07.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.303+0000 7fe6c9c31780 1 < canceled operation key=1HZ0NAJPXNW1 tag=6LM3MWMG5KWZ type=del size=349209 2024-09-22T08:21:07.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.304+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=SNQLPD63L5ZF type=del size=1083055 2024-09-22T08:21:07.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.305+0000 7fe6c9c31780 -1 < failed to complete operation key=ZFL9N44PBQX4 tag=AD7PK8XFML3V type=del size=1394669: (22) Invalid argument 2024-09-22T08:21:07.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.307+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=3B28BCOLF50W type=del size=2367999 2024-09-22T08:21:07.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.310+0000 7fe6c9c31780 1 < suggested remove operation key=TJTB67QBLZH5 tag=CEKRSULRW924 type=del 2024-09-22T08:21:07.313 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.312+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~ACBTHEPLCK4W.0 size=8503 2024-09-22T08:21:07.313 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.312+0000 7fe6c9c31780 1 > prepared multipart upload key=Z1CK5EDBK4AW upload=ACBTHEPLCK4W tag=C4Q0RUAU27A5 type=write size=1057079 2024-09-22T08:21:07.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.315+0000 7fe6c9c31780 1 < completed part key=_multipart_GEWQUFB9K35E.2~4SI4SKS7USAM.0 size=1048576 2024-09-22T08:21:07.316 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.316+0000 7fe6c9c31780 1 < completed part key=_multipart_GEWQUFB9K35E.2~4SI4SKS7USAM.1 size=108835 2024-09-22T08:21:07.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.317+0000 7fe6c9c31780 1 < completed multipart upload key=GEWQUFB9K35E upload=4SI4SKS7USAM tag=U56KWRSHUESD type=write size=2205987 2024-09-22T08:21:07.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.320+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~35SOVEH312VR.0 size=527269 2024-09-22T08:21:07.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.320+0000 7fe6c9c31780 1 > prepared multipart upload key=ILW34WLX48WN upload=35SOVEH312VR tag=30XVG1SH5IM2 type=write size=1575845 2024-09-22T08:21:07.323 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.323+0000 7fe6c9c31780 1 < suggested remove operation key=CTK01Y0CV1NC tag=49H2RKIPX7GC type=del 2024-09-22T08:21:07.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.324+0000 7fe6c9c31780 1 > prepared operation key=4KRJ7DTE3KDV tag=XE5RN4VQF6C6 type=del size=577229 2024-09-22T08:21:07.326 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.325+0000 7fe6c9c31780 1 < completed write operation key=TE10GB1F35X4 tag=24H7U8QNQ95N type=write size=94081 2024-09-22T08:21:07.327 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.327+0000 7fe6c9c31780 1 > prepared operation key=KZIY400KQ5NH tag=LIXXL02LBI2J type=del size=1932793 2024-09-22T08:21:07.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.328+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~1D99JQTK131O.0 size=1048576 2024-09-22T08:21:07.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.329+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~1D99JQTK131O.1 size=1048576 2024-09-22T08:21:07.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.330+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~1D99JQTK131O.2 size=121987 2024-09-22T08:21:07.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.333+0000 7fe6c9c31780 1 < completed multipart upload key=7446WN19QFV0 upload=1D99JQTK131O tag=LFN1DA4S6VTW type=write size=3267715 2024-09-22T08:21:07.336 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.335+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~3SL839VZMZGV.0 size=1048576 2024-09-22T08:21:07.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.336+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~3SL839VZMZGV.1 size=609430 2024-09-22T08:21:07.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.336+0000 7fe6c9c31780 1 > prepared multipart upload key=0TWY0NNZZ7NN upload=3SL839VZMZGV tag=Y3H15OWH8JZW type=write size=2706582 2024-09-22T08:21:07.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.338+0000 7fe6c9c31780 1 < completed part key=_multipart_Z1CK5EDBK4AW.2~4GD8SZQW4ZOL.0 size=1048576 2024-09-22T08:21:07.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.340+0000 7fe6c9c31780 1 < completed part key=_multipart_Z1CK5EDBK4AW.2~4GD8SZQW4ZOL.1 size=1048576 2024-09-22T08:21:07.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.341+0000 7fe6c9c31780 1 < completed part key=_multipart_Z1CK5EDBK4AW.2~4GD8SZQW4ZOL.2 size=819207 2024-09-22T08:21:07.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.345+0000 7fe6c9c31780 1 < completed multipart upload key=Z1CK5EDBK4AW upload=4GD8SZQW4ZOL tag=942HTW7CWGXF type=write size=3964935 2024-09-22T08:21:07.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.346+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=1TBK61TH4BOP type=del size=1207828 2024-09-22T08:21:07.348 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.347+0000 7fe6c9c31780 1 < completed delete operation key=W9L87PTJEIOA tag=H6MDQL8MGGGQ type=del 2024-09-22T08:21:07.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.349+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=RY3UE534N7DA type=del size=1714401 2024-09-22T08:21:07.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.351+0000 7fe6c9c31780 -1 < failed to complete operation key=CTK01Y0CV1NC tag=4CWFDI156P08 type=del size=386234: (22) Invalid argument 2024-09-22T08:21:07.353 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.352+0000 7fe6c9c31780 1 > prepared operation key=FY40JTHLT0KU tag=79WTMYJDC6WX type=del size=2797277 2024-09-22T08:21:07.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.354+0000 7fe6c9c31780 1 < canceled operation key=FY40JTHLT0KU tag=3OGU49VC0RWN type=del size=355497 2024-09-22T08:21:07.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.355+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=0W2QRIZ7ZT9X type=del size=3817376 2024-09-22T08:21:07.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.357+0000 7fe6c9c31780 1 < completed delete operation key=OX1LY7URY7IV tag=130THU1Q1BSP type=del 2024-09-22T08:21:07.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.358+0000 7fe6c9c31780 1 > prepared operation key=GEWQUFB9K35E tag=HC7L0KO2WNCE type=del size=3785846 2024-09-22T08:21:07.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.360+0000 7fe6c9c31780 1 < completed write operation key=ILW34WLX48WN tag=6PVOOELZZ16R type=write size=780187 2024-09-22T08:21:07.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.362+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~9P2M96U159AM.0 size=1048576 2024-09-22T08:21:07.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.364+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~9P2M96U159AM.1 size=1048576 2024-09-22T08:21:07.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.364+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~9P2M96U159AM.2 size=165972 2024-09-22T08:21:07.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.364+0000 7fe6c9c31780 1 > prepared multipart upload key=TE10GB1F35X4 upload=9P2M96U159AM tag=II6XF09WO1PO type=write size=3311700 2024-09-22T08:21:07.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.366+0000 7fe6c9c31780 1 < completed part key=_multipart_ILW34WLX48WN.2~I8P397RLCNAQ.0 size=1048576 2024-09-22T08:21:07.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.367+0000 7fe6c9c31780 1 < completed part key=_multipart_ILW34WLX48WN.2~I8P397RLCNAQ.1 size=1048576 2024-09-22T08:21:07.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.369+0000 7fe6c9c31780 1 < completed part key=_multipart_ILW34WLX48WN.2~I8P397RLCNAQ.2 size=471848 2024-09-22T08:21:07.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.371+0000 7fe6c9c31780 1 < completed multipart upload key=ILW34WLX48WN upload=I8P397RLCNAQ tag=Y80N8KY3KJ1I type=write size=3617576 2024-09-22T08:21:07.373 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.372+0000 7fe6c9c31780 1 > prepared operation key=XJP26CCPYDI7 tag=D7NRDU6DXMUG type=write size=981719 2024-09-22T08:21:07.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.374+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~2CR6FIC9KEKK.0 size=901115 2024-09-22T08:21:07.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.376+0000 7fe6c9c31780 1 < completed multipart upload key=76HZ3LZGVT9J upload=2CR6FIC9KEKK tag=6TMNB4NFFP0H type=write size=1949691 2024-09-22T08:21:07.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.378+0000 7fe6c9c31780 1 > prepared operation key=O1UBUQXP50CN tag=HUZZGTUJE9HG type=write size=983650 2024-09-22T08:21:07.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.379+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~4N5LI4Q2MEGP.0 size=880795 2024-09-22T08:21:07.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.381+0000 7fe6c9c31780 1 < completed multipart upload key=LA6ZRVULGQ0H upload=4N5LI4Q2MEGP tag=CVWJY2QW7O9S type=write size=1929371 2024-09-22T08:21:07.385 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.384+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~QNQ9V8J02HRE.0 size=1048576 2024-09-22T08:21:07.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.385+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~QNQ9V8J02HRE.1 size=349001 2024-09-22T08:21:07.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.385+0000 7fe6c9c31780 1 > prepared multipart upload key=7446WN19QFV0 upload=QNQ9V8J02HRE tag=CK2U9MVO3ONY type=write size=2446153 2024-09-22T08:21:07.387 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.387+0000 7fe6c9c31780 1 < completed delete operation key=946H8F2AUPO2 tag=SNQLPD63L5ZF type=del 2024-09-22T08:21:07.388 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.388+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=MCO2IADG461I type=del size=2611920 2024-09-22T08:21:07.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.390+0000 7fe6c9c31780 1 < completed delete operation key=946H8F2AUPO2 tag=3B28BCOLF50W type=del 2024-09-22T08:21:07.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.392+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~81J6YOMMLQFJ.0 size=1006215 2024-09-22T08:21:07.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.392+0000 7fe6c9c31780 1 > prepared multipart upload key=9FCSIF1WKBDJ upload=81J6YOMMLQFJ tag=7ULGX11CTXAN type=write size=2054791 2024-09-22T08:21:07.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.394+0000 7fe6c9c31780 1 < completed part key=_multipart_Z1CK5EDBK4AW.2~ACBTHEPLCK4W.0 size=8503 2024-09-22T08:21:07.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.396+0000 7fe6c9c31780 1 < completed multipart upload key=Z1CK5EDBK4AW upload=ACBTHEPLCK4W tag=C4Q0RUAU27A5 type=write size=1057079 2024-09-22T08:21:07.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.399+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~5B97TBFH9V7Z.0 size=913954 2024-09-22T08:21:07.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.399+0000 7fe6c9c31780 1 > prepared multipart upload key=4KRJ7DTE3KDV upload=5B97TBFH9V7Z tag=F0X1FKAQ7UTR type=write size=1962530 2024-09-22T08:21:07.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.400+0000 7fe6c9c31780 1 < completed part key=_multipart_ILW34WLX48WN.2~35SOVEH312VR.0 size=527269 2024-09-22T08:21:07.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.403+0000 7fe6c9c31780 1 < completed multipart upload key=ILW34WLX48WN upload=35SOVEH312VR tag=30XVG1SH5IM2 type=write size=1575845 2024-09-22T08:21:07.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.405+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~LZWU49AA1400.0 size=1048576 2024-09-22T08:21:07.407 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.407+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~LZWU49AA1400.1 size=508849 2024-09-22T08:21:07.407 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.407+0000 7fe6c9c31780 1 > prepared multipart upload key=FY40JTHLT0KU upload=LZWU49AA1400 tag=JLVEVL6OK7WD type=write size=2606001 2024-09-22T08:21:07.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.409+0000 7fe6c9c31780 1 < suggested update operation key=4KRJ7DTE3KDV tag=XE5RN4VQF6C6 type=del size=577229 2024-09-22T08:21:07.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.411+0000 7fe6c9c31780 1 > prepared part key=_multipart_ZFL9N44PBQX4.2~W8D4I8WWSMLJ.0 size=1048576 2024-09-22T08:21:07.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.413+0000 7fe6c9c31780 1 > prepared part key=_multipart_ZFL9N44PBQX4.2~W8D4I8WWSMLJ.1 size=591332 2024-09-22T08:21:07.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.413+0000 7fe6c9c31780 1 > prepared multipart upload key=ZFL9N44PBQX4 upload=W8D4I8WWSMLJ tag=KA9VTK705TIO type=write size=2688484 2024-09-22T08:21:07.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.414+0000 7fe6c9c31780 1 < completed delete operation key=KZIY400KQ5NH tag=LIXXL02LBI2J type=del 2024-09-22T08:21:07.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.417+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~TBEPPC5FFW98.0 size=1048576 2024-09-22T08:21:07.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.418+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~TBEPPC5FFW98.1 size=1048576 2024-09-22T08:21:07.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.419+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~TBEPPC5FFW98.2 size=944187 2024-09-22T08:21:07.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.419+0000 7fe6c9c31780 1 > prepared multipart upload key=D85LJGGU3Z6F upload=TBEPPC5FFW98 tag=LXSC5R3KZTN0 type=write size=4089915 2024-09-22T08:21:07.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.420+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~3SL839VZMZGV.0 size=1048576 2024-09-22T08:21:07.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.420+0000 7fe6c9c31780 1 < canceled part key=_multipart_0TWY0NNZZ7NN.2~3SL839VZMZGV.1 size=609430 2024-09-22T08:21:07.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.423+0000 7fe6c9c31780 1 < canceled multipart upload key=0TWY0NNZZ7NN upload=3SL839VZMZGV tag=Y3H15OWH8JZW type=write size=2706582 2024-09-22T08:21:07.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.424+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=ZVQR88V9JPT1 type=write size=748879 2024-09-22T08:21:07.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.425+0000 7fe6c9c31780 1 < completed delete operation key=DC7VLQWZ3TD1 tag=1TBK61TH4BOP type=del 2024-09-22T08:21:07.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.427+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=G64MPSB8VEJU type=write size=348905 2024-09-22T08:21:07.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.428+0000 7fe6c9c31780 1 < completed delete operation key=7446WN19QFV0 tag=RY3UE534N7DA type=del 2024-09-22T08:21:07.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.430+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=CLBWVJX4X70T type=del size=3659994 2024-09-22T08:21:07.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.431+0000 7fe6c9c31780 1 < completed delete operation key=FY40JTHLT0KU tag=79WTMYJDC6WX type=del 2024-09-22T08:21:07.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.434+0000 7fe6c9c31780 1 > prepared part key=_multipart_9AZWQ9E58QS6.2~QSIYDKZMT21X.0 size=1048576 2024-09-22T08:21:07.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.435+0000 7fe6c9c31780 1 > prepared part key=_multipart_9AZWQ9E58QS6.2~QSIYDKZMT21X.1 size=1048576 2024-09-22T08:21:07.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.436+0000 7fe6c9c31780 1 > prepared part key=_multipart_9AZWQ9E58QS6.2~QSIYDKZMT21X.2 size=890471 2024-09-22T08:21:07.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.436+0000 7fe6c9c31780 1 > prepared multipart upload key=9AZWQ9E58QS6 upload=QSIYDKZMT21X tag=RUZYOWXD8PI5 type=write size=4036199 2024-09-22T08:21:07.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.438+0000 7fe6c9c31780 1 < completed delete operation key=7446WN19QFV0 tag=0W2QRIZ7ZT9X type=del 2024-09-22T08:21:07.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.439+0000 7fe6c9c31780 1 > prepared operation key=W9L87PTJEIOA tag=VD7SVDXNEC2W type=write size=285874 2024-09-22T08:21:07.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.442+0000 7fe6c9c31780 1 < suggested remove operation key=GEWQUFB9K35E tag=HC7L0KO2WNCE type=del 2024-09-22T08:21:07.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.444+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=9UOU7ZLE97D2 type=del size=1951067 2024-09-22T08:21:07.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.445+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~9P2M96U159AM.0 size=1048576 2024-09-22T08:21:07.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.445+0000 7fe6c9c31780 1 < canceled part key=_multipart_TE10GB1F35X4.2~9P2M96U159AM.1 size=1048576 2024-09-22T08:21:07.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.447+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~9P2M96U159AM.2 size=165972 2024-09-22T08:21:07.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.449+0000 7fe6c9c31780 1 < canceled multipart upload key=TE10GB1F35X4 upload=9P2M96U159AM tag=II6XF09WO1PO type=write size=3311700 2024-09-22T08:21:07.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.450+0000 7fe6c9c31780 1 > prepared operation key=XJP26CCPYDI7 tag=IQ5LJLSFWYJ3 type=del size=3949120 2024-09-22T08:21:07.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.452+0000 7fe6c9c31780 1 < completed write operation key=XJP26CCPYDI7 tag=D7NRDU6DXMUG type=write size=981719 2024-09-22T08:21:07.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.453+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=U7094AMDF2MP type=write size=998778 2024-09-22T08:21:07.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.454+0000 7fe6c9c31780 1 < completed write operation key=O1UBUQXP50CN tag=HUZZGTUJE9HG type=write size=983650 2024-09-22T08:21:07.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.457+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~Z23V3GGN7EDQ.0 size=1048576 2024-09-22T08:21:07.458 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.458+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~Z23V3GGN7EDQ.1 size=1048576 2024-09-22T08:21:07.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.459+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~Z23V3GGN7EDQ.2 size=232204 2024-09-22T08:21:07.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.459+0000 7fe6c9c31780 1 > prepared multipart upload key=CTK01Y0CV1NC upload=Z23V3GGN7EDQ tag=4XBUW6WG8GAT type=write size=3377932 2024-09-22T08:21:07.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.460+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~QNQ9V8J02HRE.0 size=1048576 2024-09-22T08:21:07.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.461+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~QNQ9V8J02HRE.1 size=349001 2024-09-22T08:21:07.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.464+0000 7fe6c9c31780 1 < completed multipart upload key=7446WN19QFV0 upload=QNQ9V8J02HRE tag=CK2U9MVO3ONY type=write size=2446153 2024-09-22T08:21:07.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.465+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=CPS2ADSJ4U6A type=del size=1588013 2024-09-22T08:21:07.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.466+0000 7fe6c9c31780 1 < completed delete operation key=ILW34WLX48WN tag=MCO2IADG461I type=del 2024-09-22T08:21:07.469 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.469+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~B0OYTRBPAG09.0 size=1048576 2024-09-22T08:21:07.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.470+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~B0OYTRBPAG09.1 size=1048576 2024-09-22T08:21:07.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.471+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~B0OYTRBPAG09.2 size=253187 2024-09-22T08:21:07.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.471+0000 7fe6c9c31780 1 > prepared multipart upload key=FY40JTHLT0KU upload=B0OYTRBPAG09 tag=75WQLO7JVHQX type=write size=3398915 2024-09-22T08:21:07.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.472+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~81J6YOMMLQFJ.0 size=1006215 2024-09-22T08:21:07.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.477+0000 7fe6c9c31780 1 < completed multipart upload key=9FCSIF1WKBDJ upload=81J6YOMMLQFJ tag=7ULGX11CTXAN type=write size=2054791 2024-09-22T08:21:07.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.479+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~92L05ZX9E5FA.0 size=1048576 2024-09-22T08:21:07.480 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.480+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~92L05ZX9E5FA.1 size=199312 2024-09-22T08:21:07.481 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.480+0000 7fe6c9c31780 1 > prepared multipart upload key=ILW34WLX48WN upload=92L05ZX9E5FA tag=QYHZDKIPYGPX type=write size=2296464 2024-09-22T08:21:07.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.481+0000 7fe6c9c31780 1 < completed part key=_multipart_4KRJ7DTE3KDV.2~5B97TBFH9V7Z.0 size=913954 2024-09-22T08:21:07.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.484+0000 7fe6c9c31780 1 < completed multipart upload key=4KRJ7DTE3KDV upload=5B97TBFH9V7Z tag=F0X1FKAQ7UTR type=write size=1962530 2024-09-22T08:21:07.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.485+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=NCHQ1XYVHCG8 type=del size=3121223 2024-09-22T08:21:07.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.487+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~LZWU49AA1400.0 size=1048576 2024-09-22T08:21:07.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.488+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~LZWU49AA1400.1 size=508849 2024-09-22T08:21:07.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.490+0000 7fe6c9c31780 1 < completed multipart upload key=FY40JTHLT0KU upload=LZWU49AA1400 tag=JLVEVL6OK7WD type=write size=2606001 2024-09-22T08:21:07.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.492+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=CMLJL38G08SI type=del size=3206774 2024-09-22T08:21:07.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.494+0000 7fe6c9c31780 1 < completed part key=_multipart_ZFL9N44PBQX4.2~W8D4I8WWSMLJ.0 size=1048576 2024-09-22T08:21:07.495 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.495+0000 7fe6c9c31780 1 < completed part key=_multipart_ZFL9N44PBQX4.2~W8D4I8WWSMLJ.1 size=591332 2024-09-22T08:21:07.498 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.498+0000 7fe6c9c31780 1 < completed multipart upload key=ZFL9N44PBQX4 upload=W8D4I8WWSMLJ tag=KA9VTK705TIO type=write size=2688484 2024-09-22T08:21:07.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.499+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=CVHTPMVN6374 type=del size=937019 2024-09-22T08:21:07.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.501+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~TBEPPC5FFW98.0 size=1048576 2024-09-22T08:21:07.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.502+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~TBEPPC5FFW98.1 size=1048576 2024-09-22T08:21:07.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.503+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~TBEPPC5FFW98.2 size=944187 2024-09-22T08:21:07.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.506+0000 7fe6c9c31780 1 < completed multipart upload key=D85LJGGU3Z6F upload=TBEPPC5FFW98 tag=LXSC5R3KZTN0 type=write size=4089915 2024-09-22T08:21:07.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.509+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~RIGN5RCN2KNR.0 size=1048576 2024-09-22T08:21:07.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.511+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~RIGN5RCN2KNR.1 size=894416 2024-09-22T08:21:07.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.511+0000 7fe6c9c31780 1 > prepared multipart upload key=4KRJ7DTE3KDV upload=RIGN5RCN2KNR tag=TODYMC6ZAARP type=write size=2991568 2024-09-22T08:21:07.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.513+0000 7fe6c9c31780 1 < suggested update operation key=TE10GB1F35X4 tag=ZVQR88V9JPT1 type=write size=748879 2024-09-22T08:21:07.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.515+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=J5UCML1AG785 type=del size=1804981 2024-09-22T08:21:07.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.516+0000 7fe6c9c31780 -1 < failed to complete operation key=TE10GB1F35X4 tag=G64MPSB8VEJU type=write size=348905: (22) Invalid argument 2024-09-22T08:21:07.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.519+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~8Q3U9F0O5P46.0 size=1048576 2024-09-22T08:21:07.520 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.520+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~8Q3U9F0O5P46.1 size=260685 2024-09-22T08:21:07.520 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.520+0000 7fe6c9c31780 1 > prepared multipart upload key=946H8F2AUPO2 upload=8Q3U9F0O5P46 tag=322DUQWHECQZ type=write size=2357837 2024-09-22T08:21:07.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.521+0000 7fe6c9c31780 1 < completed delete operation key=0TWY0NNZZ7NN tag=CLBWVJX4X70T type=del 2024-09-22T08:21:07.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.523+0000 7fe6c9c31780 1 > prepared operation key=ZFL9N44PBQX4 tag=QYISZNE7X12G type=del size=3467392 2024-09-22T08:21:07.524 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.523+0000 7fe6c9c31780 1 < canceled part key=_multipart_9AZWQ9E58QS6.2~QSIYDKZMT21X.0 size=1048576 2024-09-22T08:21:07.524 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.523+0000 7fe6c9c31780 1 < canceled part key=_multipart_9AZWQ9E58QS6.2~QSIYDKZMT21X.1 size=1048576 2024-09-22T08:21:07.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.525+0000 7fe6c9c31780 1 < completed part key=_multipart_9AZWQ9E58QS6.2~QSIYDKZMT21X.2 size=890471 2024-09-22T08:21:07.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.526+0000 7fe6c9c31780 1 < canceled multipart upload key=9AZWQ9E58QS6 upload=QSIYDKZMT21X tag=RUZYOWXD8PI5 type=write size=4036199 2024-09-22T08:21:07.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.529+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~HBF6UEHDMC29.0 size=1048576 2024-09-22T08:21:07.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.530+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~HBF6UEHDMC29.1 size=460314 2024-09-22T08:21:07.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.530+0000 7fe6c9c31780 1 > prepared multipart upload key=6BKB91YV3FMW upload=HBF6UEHDMC29 tag=VQGS0AU1R21L type=write size=2557466 2024-09-22T08:21:07.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.532+0000 7fe6c9c31780 1 < canceled operation key=W9L87PTJEIOA tag=VD7SVDXNEC2W type=write size=285874 2024-09-22T08:21:07.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.535+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~46KKPXRM6ZCB.0 size=1048576 2024-09-22T08:21:07.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.537+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~46KKPXRM6ZCB.1 size=1039778 2024-09-22T08:21:07.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.537+0000 7fe6c9c31780 1 > prepared multipart upload key=2B5QRUMTVE7U upload=46KKPXRM6ZCB tag=IUN4PFUU7DJ3 type=write size=3136930 2024-09-22T08:21:07.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.538+0000 7fe6c9c31780 1 < completed delete operation key=76HZ3LZGVT9J tag=9UOU7ZLE97D2 type=del 2024-09-22T08:21:07.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.541+0000 7fe6c9c31780 1 > prepared operation key=Z1CK5EDBK4AW tag=321JV0Q62TUX type=write size=609951 2024-09-22T08:21:07.542 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.542+0000 7fe6c9c31780 1 < completed delete operation key=XJP26CCPYDI7 tag=IQ5LJLSFWYJ3 type=del 2024-09-22T08:21:07.544 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.544+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=QOXXK7ME4O9Q type=del size=2142221 2024-09-22T08:21:07.545 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.545+0000 7fe6c9c31780 1 < completed write operation key=CTK01Y0CV1NC tag=U7094AMDF2MP type=write size=998778 2024-09-22T08:21:07.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.546+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=KBAYENSIHU1R type=del size=3430769 2024-09-22T08:21:07.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.548+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~Z23V3GGN7EDQ.0 size=1048576 2024-09-22T08:21:07.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.549+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~Z23V3GGN7EDQ.1 size=1048576 2024-09-22T08:21:07.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.550+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~Z23V3GGN7EDQ.2 size=232204 2024-09-22T08:21:07.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.553+0000 7fe6c9c31780 1 < completed multipart upload key=CTK01Y0CV1NC upload=Z23V3GGN7EDQ tag=4XBUW6WG8GAT type=write size=3377932 2024-09-22T08:21:07.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.556+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~C2LFSQBSLJPX.0 size=1048576 2024-09-22T08:21:07.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.557+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~C2LFSQBSLJPX.1 size=1048576 2024-09-22T08:21:07.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.558+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~C2LFSQBSLJPX.2 size=418000 2024-09-22T08:21:07.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.558+0000 7fe6c9c31780 1 > prepared multipart upload key=4KRJ7DTE3KDV upload=C2LFSQBSLJPX tag=GG9NRL258STD type=write size=3563728 2024-09-22T08:21:07.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.560+0000 7fe6c9c31780 1 < completed delete operation key=DC7VLQWZ3TD1 tag=CPS2ADSJ4U6A type=del 2024-09-22T08:21:07.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.562+0000 7fe6c9c31780 1 > prepared operation key=O1UBUQXP50CN tag=QZ5T7APTAAOS type=del size=2154137 2024-09-22T08:21:07.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.563+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~B0OYTRBPAG09.0 size=1048576 2024-09-22T08:21:07.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.563+0000 7fe6c9c31780 1 < canceled part key=_multipart_FY40JTHLT0KU.2~B0OYTRBPAG09.1 size=1048576 2024-09-22T08:21:07.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.564+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~B0OYTRBPAG09.2 size=253187 2024-09-22T08:21:07.567 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.567+0000 7fe6c9c31780 1 < canceled multipart upload key=FY40JTHLT0KU upload=B0OYTRBPAG09 tag=75WQLO7JVHQX type=write size=3398915 2024-09-22T08:21:07.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.571+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~58FMHONJMI58.0 size=1048576 2024-09-22T08:21:07.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.571+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~58FMHONJMI58.1 size=1048576 2024-09-22T08:21:07.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.573+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~58FMHONJMI58.2 size=644545 2024-09-22T08:21:07.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.573+0000 7fe6c9c31780 1 > prepared multipart upload key=OX1LY7URY7IV upload=58FMHONJMI58 tag=MQHY3HGQKM01 type=write size=3790273 2024-09-22T08:21:07.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.575+0000 7fe6c9c31780 1 < completed part key=_multipart_ILW34WLX48WN.2~92L05ZX9E5FA.0 size=1048576 2024-09-22T08:21:07.576 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.577+0000 7fe6c9c31780 1 < completed part key=_multipart_ILW34WLX48WN.2~92L05ZX9E5FA.1 size=199312 2024-09-22T08:21:07.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.578+0000 7fe6c9c31780 1 < completed multipart upload key=ILW34WLX48WN upload=92L05ZX9E5FA tag=QYHZDKIPYGPX type=write size=2296464 2024-09-22T08:21:07.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.582+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~B5QDA34ABEZK.0 size=1048576 2024-09-22T08:21:07.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.583+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~B5QDA34ABEZK.1 size=1048576 2024-09-22T08:21:07.585 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.584+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~B5QDA34ABEZK.2 size=806330 2024-09-22T08:21:07.585 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.584+0000 7fe6c9c31780 1 > prepared multipart upload key=FY40JTHLT0KU upload=B5QDA34ABEZK tag=JBP91ES2L8HU type=write size=3952058 2024-09-22T08:21:07.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.586+0000 7fe6c9c31780 1 < completed delete operation key=R7UWMW913DJQ tag=NCHQ1XYVHCG8 type=del 2024-09-22T08:21:07.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.588+0000 7fe6c9c31780 1 > prepared operation key=OX1LY7URY7IV tag=E9PNUMQYUAAO type=del size=2794860 2024-09-22T08:21:07.590 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.590+0000 7fe6c9c31780 1 < completed delete operation key=R7UWMW913DJQ tag=CMLJL38G08SI type=del 2024-09-22T08:21:07.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.592+0000 7fe6c9c31780 1 > prepared operation key=KZIY400KQ5NH tag=YPVVPLFWMMD5 type=del size=2221908 2024-09-22T08:21:07.594 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.593+0000 7fe6c9c31780 1 < canceled operation key=ILW34WLX48WN tag=CVHTPMVN6374 type=del size=937019 2024-09-22T08:21:07.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.597+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~S6X9AIQZKA76.0 size=1048576 2024-09-22T08:21:07.598 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.597+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~S6X9AIQZKA76.1 size=907205 2024-09-22T08:21:07.598 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.597+0000 7fe6c9c31780 1 > prepared multipart upload key=CTK01Y0CV1NC upload=S6X9AIQZKA76 tag=4EWGXU212ZKC type=write size=3004357 2024-09-22T08:21:07.599 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.598+0000 7fe6c9c31780 1 < completed part key=_multipart_4KRJ7DTE3KDV.2~RIGN5RCN2KNR.0 size=1048576 2024-09-22T08:21:07.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.600+0000 7fe6c9c31780 1 < completed part key=_multipart_4KRJ7DTE3KDV.2~RIGN5RCN2KNR.1 size=894416 2024-09-22T08:21:07.602 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.602+0000 7fe6c9c31780 1 < completed multipart upload key=4KRJ7DTE3KDV upload=RIGN5RCN2KNR tag=TODYMC6ZAARP type=write size=2991568 2024-09-22T08:21:07.604 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.604+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=FHO2JDK6U5FO type=del size=3786708 2024-09-22T08:21:07.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.605+0000 7fe6c9c31780 1 < canceled operation key=6BKB91YV3FMW tag=J5UCML1AG785 type=del size=1804981 2024-09-22T08:21:07.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.608+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~1ZIEM8Y0L0MJ.0 size=1048576 2024-09-22T08:21:07.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.609+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~1ZIEM8Y0L0MJ.1 size=739302 2024-09-22T08:21:07.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.609+0000 7fe6c9c31780 1 > prepared multipart upload key=O1UBUQXP50CN upload=1ZIEM8Y0L0MJ tag=2ZT5D21AB76N type=write size=2836454 2024-09-22T08:21:07.611 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.611+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~8Q3U9F0O5P46.0 size=1048576 2024-09-22T08:21:07.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.612+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~8Q3U9F0O5P46.1 size=260685 2024-09-22T08:21:07.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.614+0000 7fe6c9c31780 1 < completed multipart upload key=946H8F2AUPO2 upload=8Q3U9F0O5P46 tag=322DUQWHECQZ type=write size=2357837 2024-09-22T08:21:07.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.616+0000 7fe6c9c31780 1 > prepared operation key=ZFL9N44PBQX4 tag=2I6UX2I0MDTX type=del size=1782741 2024-09-22T08:21:07.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.619+0000 7fe6c9c31780 1 < completed delete operation key=ZFL9N44PBQX4 tag=QYISZNE7X12G type=del 2024-09-22T08:21:07.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.621+0000 7fe6c9c31780 1 > prepared part key=_multipart_ZFL9N44PBQX4.2~6TP93XT4LYVS.0 size=157559 2024-09-22T08:21:07.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.621+0000 7fe6c9c31780 1 > prepared multipart upload key=ZFL9N44PBQX4 upload=6TP93XT4LYVS tag=7N3NHDZZTM3W type=write size=1206135 2024-09-22T08:21:07.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.623+0000 7fe6c9c31780 1 < completed part key=_multipart_6BKB91YV3FMW.2~HBF6UEHDMC29.0 size=1048576 2024-09-22T08:21:07.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.624+0000 7fe6c9c31780 1 < completed part key=_multipart_6BKB91YV3FMW.2~HBF6UEHDMC29.1 size=460314 2024-09-22T08:21:07.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.627+0000 7fe6c9c31780 1 < completed multipart upload key=6BKB91YV3FMW upload=HBF6UEHDMC29 tag=VQGS0AU1R21L type=write size=2557466 2024-09-22T08:21:07.631 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.631+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~ICNYF9SUB7G7.0 size=1048576 2024-09-22T08:21:07.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.632+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~ICNYF9SUB7G7.1 size=951659 2024-09-22T08:21:07.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.632+0000 7fe6c9c31780 1 > prepared multipart upload key=DC7VLQWZ3TD1 upload=ICNYF9SUB7G7 tag=EX29U2MOB2MB type=write size=3048811 2024-09-22T08:21:07.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.632+0000 7fe6c9c31780 1 < canceled part key=_multipart_2B5QRUMTVE7U.2~46KKPXRM6ZCB.0 size=1048576 2024-09-22T08:21:07.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.633+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~46KKPXRM6ZCB.1 size=1039778 2024-09-22T08:21:07.637 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.637+0000 7fe6c9c31780 1 < canceled multipart upload key=2B5QRUMTVE7U upload=46KKPXRM6ZCB tag=IUN4PFUU7DJ3 type=write size=3136930 2024-09-22T08:21:07.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.638+0000 7fe6c9c31780 1 > prepared operation key=W9L87PTJEIOA tag=02HFIXLSIJFL type=write size=255166 2024-09-22T08:21:07.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.640+0000 7fe6c9c31780 1 < completed write operation key=Z1CK5EDBK4AW tag=321JV0Q62TUX type=write size=609951 2024-09-22T08:21:07.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.641+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=BNASKHJA6GWZ type=del size=1298321 2024-09-22T08:21:07.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.643+0000 7fe6c9c31780 1 < completed delete operation key=T2W6RXP9UGHH tag=QOXXK7ME4O9Q type=del 2024-09-22T08:21:07.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.646+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~0ABC9TDJM21N.0 size=1048576 2024-09-22T08:21:07.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.647+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~0ABC9TDJM21N.1 size=1048576 2024-09-22T08:21:07.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.648+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~0ABC9TDJM21N.2 size=818660 2024-09-22T08:21:07.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.648+0000 7fe6c9c31780 1 > prepared multipart upload key=CTK01Y0CV1NC upload=0ABC9TDJM21N tag=M1CGA8WNED5J type=write size=3964388 2024-09-22T08:21:07.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.650+0000 7fe6c9c31780 1 < completed delete operation key=76HZ3LZGVT9J tag=KBAYENSIHU1R type=del 2024-09-22T08:21:07.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.651+0000 7fe6c9c31780 1 > prepared operation key=TYVQ39KUV2V9 tag=JYH5SWDAS70J type=write size=69649 2024-09-22T08:21:07.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.653+0000 7fe6c9c31780 1 < completed part key=_multipart_4KRJ7DTE3KDV.2~C2LFSQBSLJPX.0 size=1048576 2024-09-22T08:21:07.655 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.654+0000 7fe6c9c31780 1 < completed part key=_multipart_4KRJ7DTE3KDV.2~C2LFSQBSLJPX.1 size=1048576 2024-09-22T08:21:07.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.656+0000 7fe6c9c31780 1 < completed part key=_multipart_4KRJ7DTE3KDV.2~C2LFSQBSLJPX.2 size=418000 2024-09-22T08:21:07.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.659+0000 7fe6c9c31780 1 < completed multipart upload key=4KRJ7DTE3KDV upload=C2LFSQBSLJPX tag=GG9NRL258STD type=write size=3563728 2024-09-22T08:21:07.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.660+0000 7fe6c9c31780 1 > prepared operation key=Z1CK5EDBK4AW tag=WYP6OPKA2RZ3 type=write size=150819 2024-09-22T08:21:07.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.664+0000 7fe6c9c31780 1 < suggested update operation key=O1UBUQXP50CN tag=QZ5T7APTAAOS type=del size=2154137 2024-09-22T08:21:07.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.667+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~2LZUQWY3AKFY.0 size=1048576 2024-09-22T08:21:07.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.669+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~2LZUQWY3AKFY.1 size=1048576 2024-09-22T08:21:07.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.670+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~2LZUQWY3AKFY.2 size=707827 2024-09-22T08:21:07.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.670+0000 7fe6c9c31780 1 > prepared multipart upload key=LA6ZRVULGQ0H upload=2LZUQWY3AKFY tag=QXLMC60LOK4B type=write size=3853555 2024-09-22T08:21:07.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.672+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~58FMHONJMI58.0 size=1048576 2024-09-22T08:21:07.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.672+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~58FMHONJMI58.1 size=1048576 2024-09-22T08:21:07.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.672+0000 7fe6c9c31780 1 < canceled part key=_multipart_OX1LY7URY7IV.2~58FMHONJMI58.2 size=644545 2024-09-22T08:21:07.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.675+0000 7fe6c9c31780 1 < canceled multipart upload key=OX1LY7URY7IV upload=58FMHONJMI58 tag=MQHY3HGQKM01 type=write size=3790273 2024-09-22T08:21:07.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.676+0000 7fe6c9c31780 1 > prepared operation key=4KRJ7DTE3KDV tag=XO9M4R2GUB43 type=del size=969161 2024-09-22T08:21:07.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.678+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~B5QDA34ABEZK.0 size=1048576 2024-09-22T08:21:07.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.678+0000 7fe6c9c31780 1 < canceled part key=_multipart_FY40JTHLT0KU.2~B5QDA34ABEZK.1 size=1048576 2024-09-22T08:21:07.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.679+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~B5QDA34ABEZK.2 size=806330 2024-09-22T08:21:07.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.681+0000 7fe6c9c31780 1 < canceled multipart upload key=FY40JTHLT0KU upload=B5QDA34ABEZK tag=JBP91ES2L8HU type=write size=3952058 2024-09-22T08:21:07.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.683+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=4YQYMPTI0FLZ type=del size=2451369 2024-09-22T08:21:07.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.684+0000 7fe6c9c31780 1 < completed delete operation key=OX1LY7URY7IV tag=E9PNUMQYUAAO type=del 2024-09-22T08:21:07.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.687+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~07I1ELXFHTY0.0 size=1048576 2024-09-22T08:21:07.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.688+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~07I1ELXFHTY0.1 size=1048576 2024-09-22T08:21:07.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.689+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~07I1ELXFHTY0.2 size=546125 2024-09-22T08:21:07.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.689+0000 7fe6c9c31780 1 > prepared multipart upload key=9FCSIF1WKBDJ upload=07I1ELXFHTY0 tag=J0TCGV9PC6LH type=write size=3691853 2024-09-22T08:21:07.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.691+0000 7fe6c9c31780 1 < completed delete operation key=KZIY400KQ5NH tag=YPVVPLFWMMD5 type=del 2024-09-22T08:21:07.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.695+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~DPIUTX5JCIF7.0 size=1048576 2024-09-22T08:21:07.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.696+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~DPIUTX5JCIF7.1 size=726225 2024-09-22T08:21:07.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.696+0000 7fe6c9c31780 1 > prepared multipart upload key=Z1CK5EDBK4AW upload=DPIUTX5JCIF7 tag=C78AH6EJD4MW type=write size=2823377 2024-09-22T08:21:07.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.697+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~S6X9AIQZKA76.0 size=1048576 2024-09-22T08:21:07.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.699+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~S6X9AIQZKA76.1 size=907205 2024-09-22T08:21:07.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.701+0000 7fe6c9c31780 1 < completed multipart upload key=CTK01Y0CV1NC upload=S6X9AIQZKA76 tag=4EWGXU212ZKC type=write size=3004357 2024-09-22T08:21:07.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.703+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=SF0LTP2YSEMK type=del size=2763596 2024-09-22T08:21:07.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.704+0000 7fe6c9c31780 1 < completed delete operation key=0TWY0NNZZ7NN tag=FHO2JDK6U5FO type=del 2024-09-22T08:21:07.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.707+0000 7fe6c9c31780 1 > prepared operation key=Z1CK5EDBK4AW tag=FVF0ZC3V4P0F type=del size=691841 2024-09-22T08:21:07.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.708+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~1ZIEM8Y0L0MJ.0 size=1048576 2024-09-22T08:21:07.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.709+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~1ZIEM8Y0L0MJ.1 size=739302 2024-09-22T08:21:07.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.711+0000 7fe6c9c31780 1 < completed multipart upload key=O1UBUQXP50CN upload=1ZIEM8Y0L0MJ tag=2ZT5D21AB76N type=write size=2836454 2024-09-22T08:21:07.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.713+0000 7fe6c9c31780 1 > prepared operation key=4KRJ7DTE3KDV tag=ANJDSQ702LTK type=del size=3924872 2024-09-22T08:21:07.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.714+0000 7fe6c9c31780 1 < completed delete operation key=ZFL9N44PBQX4 tag=2I6UX2I0MDTX type=del 2024-09-22T08:21:07.718 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.717+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~LRUU2N6XGWDL.0 size=695395 2024-09-22T08:21:07.718 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.718+0000 7fe6c9c31780 1 > prepared multipart upload key=LA6ZRVULGQ0H upload=LRUU2N6XGWDL tag=HJD9ZOTYOGRN type=write size=1743971 2024-09-22T08:21:07.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.720+0000 7fe6c9c31780 1 < completed part key=_multipart_ZFL9N44PBQX4.2~6TP93XT4LYVS.0 size=157559 2024-09-22T08:21:07.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.722+0000 7fe6c9c31780 1 < completed multipart upload key=ZFL9N44PBQX4 upload=6TP93XT4LYVS tag=7N3NHDZZTM3W type=write size=1206135 2024-09-22T08:21:07.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.724+0000 7fe6c9c31780 1 > prepared operation key=4KRJ7DTE3KDV tag=G83ZUAEM4H6R type=del size=2661482 2024-09-22T08:21:07.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.725+0000 7fe6c9c31780 1 < completed part key=_multipart_DC7VLQWZ3TD1.2~ICNYF9SUB7G7.0 size=1048576 2024-09-22T08:21:07.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.726+0000 7fe6c9c31780 1 < completed part key=_multipart_DC7VLQWZ3TD1.2~ICNYF9SUB7G7.1 size=951659 2024-09-22T08:21:07.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.729+0000 7fe6c9c31780 1 < completed multipart upload key=DC7VLQWZ3TD1 upload=ICNYF9SUB7G7 tag=EX29U2MOB2MB type=write size=3048811 2024-09-22T08:21:07.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.730+0000 7fe6c9c31780 1 > prepared operation key=KZIY400KQ5NH tag=KIR93HCDO04R type=write size=245227 2024-09-22T08:21:07.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.732+0000 7fe6c9c31780 1 < completed write operation key=W9L87PTJEIOA tag=02HFIXLSIJFL type=write size=255166 2024-09-22T08:21:07.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.733+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=I05UZKRAKDPH type=del size=1062204 2024-09-22T08:21:07.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.735+0000 7fe6c9c31780 1 < canceled operation key=T2W6RXP9UGHH tag=BNASKHJA6GWZ type=del size=1298321 2024-09-22T08:21:07.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.738+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~BOSBLYE4006C.0 size=1048576 2024-09-22T08:21:07.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.739+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~BOSBLYE4006C.1 size=1006936 2024-09-22T08:21:07.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.739+0000 7fe6c9c31780 1 > prepared multipart upload key=LA6ZRVULGQ0H upload=BOSBLYE4006C tag=M85DS65XD6DN type=write size=3104088 2024-09-22T08:21:07.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.739+0000 7fe6c9c31780 1 < canceled part key=_multipart_CTK01Y0CV1NC.2~0ABC9TDJM21N.0 size=1048576 2024-09-22T08:21:07.741 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.740+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~0ABC9TDJM21N.1 size=1048576 2024-09-22T08:21:07.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.741+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~0ABC9TDJM21N.2 size=818660 2024-09-22T08:21:07.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.743+0000 7fe6c9c31780 1 < canceled multipart upload key=CTK01Y0CV1NC upload=0ABC9TDJM21N tag=M1CGA8WNED5J type=write size=3964388 2024-09-22T08:21:07.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.745+0000 7fe6c9c31780 1 > prepared operation key=LA6ZRVULGQ0H tag=29UKHO7VDEO9 type=del size=1801056 2024-09-22T08:21:07.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.746+0000 7fe6c9c31780 1 < completed write operation key=TYVQ39KUV2V9 tag=JYH5SWDAS70J type=write size=69649 2024-09-22T08:21:07.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.748+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=CMFRJF4EB7Q5 type=del size=503352 2024-09-22T08:21:07.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.749+0000 7fe6c9c31780 1 < canceled operation key=Z1CK5EDBK4AW tag=WYP6OPKA2RZ3 type=write size=150819 2024-09-22T08:21:07.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.752+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~GKNEYEPMPGSU.0 size=49302 2024-09-22T08:21:07.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.752+0000 7fe6c9c31780 1 > prepared multipart upload key=TYVQ39KUV2V9 upload=GKNEYEPMPGSU tag=S710S53O350F type=write size=1097878 2024-09-22T08:21:07.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.753+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~2LZUQWY3AKFY.0 size=1048576 2024-09-22T08:21:07.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.754+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~2LZUQWY3AKFY.1 size=1048576 2024-09-22T08:21:07.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.754+0000 7fe6c9c31780 1 < canceled part key=_multipart_LA6ZRVULGQ0H.2~2LZUQWY3AKFY.2 size=707827 2024-09-22T08:21:07.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.757+0000 7fe6c9c31780 1 < canceled multipart upload key=LA6ZRVULGQ0H upload=2LZUQWY3AKFY tag=QXLMC60LOK4B type=write size=3853555 2024-09-22T08:21:07.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.758+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=6CLJTZXNW0HS type=del size=990580 2024-09-22T08:21:07.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.760+0000 7fe6c9c31780 1 < completed delete operation key=4KRJ7DTE3KDV tag=XO9M4R2GUB43 type=del 2024-09-22T08:21:07.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.762+0000 7fe6c9c31780 1 > prepared operation key=JT5AB8VLMEFD tag=HJZ4GTCXWGES type=del size=2468977 2024-09-22T08:21:07.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.765+0000 7fe6c9c31780 1 < suggested update operation key=2B5QRUMTVE7U tag=4YQYMPTI0FLZ type=del size=2451369 2024-09-22T08:21:07.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.768+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~GU6ULZTV7L3H.0 size=1048576 2024-09-22T08:21:07.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.768+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~GU6ULZTV7L3H.1 size=582720 2024-09-22T08:21:07.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.768+0000 7fe6c9c31780 1 > prepared multipart upload key=Z1CK5EDBK4AW upload=GU6ULZTV7L3H tag=S8YVLGCQC7G4 type=write size=2679872 2024-09-22T08:21:07.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.770+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~07I1ELXFHTY0.0 size=1048576 2024-09-22T08:21:07.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.771+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~07I1ELXFHTY0.1 size=1048576 2024-09-22T08:21:07.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.772+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~07I1ELXFHTY0.2 size=546125 2024-09-22T08:21:07.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.775+0000 7fe6c9c31780 1 < completed multipart upload key=9FCSIF1WKBDJ upload=07I1ELXFHTY0 tag=J0TCGV9PC6LH type=write size=3691853 2024-09-22T08:21:07.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.777+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~E7EOHFWT1YKG.0 size=1048576 2024-09-22T08:21:07.779 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.778+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~E7EOHFWT1YKG.1 size=335545 2024-09-22T08:21:07.779 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.778+0000 7fe6c9c31780 1 > prepared multipart upload key=FY40JTHLT0KU upload=E7EOHFWT1YKG tag=A9G95X3V1GXF type=write size=2432697 2024-09-22T08:21:07.780 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.779+0000 7fe6c9c31780 1 < canceled part key=_multipart_Z1CK5EDBK4AW.2~DPIUTX5JCIF7.0 size=1048576 2024-09-22T08:21:07.780 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.780+0000 7fe6c9c31780 1 < completed part key=_multipart_Z1CK5EDBK4AW.2~DPIUTX5JCIF7.1 size=726225 2024-09-22T08:21:07.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.783+0000 7fe6c9c31780 1 < canceled multipart upload key=Z1CK5EDBK4AW upload=DPIUTX5JCIF7 tag=C78AH6EJD4MW type=write size=2823377 2024-09-22T08:21:07.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.784+0000 7fe6c9c31780 1 > prepared operation key=1HZ0NAJPXNW1 tag=2ET3WL2SYB83 type=del size=663463 2024-09-22T08:21:07.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.785+0000 7fe6c9c31780 1 < completed delete operation key=CTK01Y0CV1NC tag=SF0LTP2YSEMK type=del 2024-09-22T08:21:07.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.789+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~EMAE59J033R8.0 size=1048576 2024-09-22T08:21:07.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.789+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~EMAE59J033R8.1 size=1048576 2024-09-22T08:21:07.791 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.790+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~EMAE59J033R8.2 size=988035 2024-09-22T08:21:07.791 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.790+0000 7fe6c9c31780 1 > prepared multipart upload key=FY40JTHLT0KU upload=EMAE59J033R8 tag=V66624521JT1 type=write size=4133763 2024-09-22T08:21:07.793 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.792+0000 7fe6c9c31780 1 < canceled operation key=Z1CK5EDBK4AW tag=FVF0ZC3V4P0F type=del size=691841 2024-09-22T08:21:07.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.794+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=H0HU1Y1OFN7D type=del size=713496 2024-09-22T08:21:07.796 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.796+0000 7fe6c9c31780 1 < completed delete operation key=4KRJ7DTE3KDV tag=ANJDSQ702LTK type=del 2024-09-22T08:21:07.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.797+0000 7fe6c9c31780 1 > prepared operation key=FY40JTHLT0KU tag=PPXVXZX858Z6 type=del size=3677954 2024-09-22T08:21:07.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.798+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~LRUU2N6XGWDL.0 size=695395 2024-09-22T08:21:07.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.801+0000 7fe6c9c31780 1 < completed multipart upload key=LA6ZRVULGQ0H upload=LRUU2N6XGWDL tag=HJD9ZOTYOGRN type=write size=1743971 2024-09-22T08:21:07.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.803+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~81IROKRXM9P0.0 size=1048576 2024-09-22T08:21:07.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.805+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~81IROKRXM9P0.1 size=579526 2024-09-22T08:21:07.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.805+0000 7fe6c9c31780 1 > prepared multipart upload key=LA6ZRVULGQ0H upload=81IROKRXM9P0 tag=KLA91LKYC2G3 type=write size=2676678 2024-09-22T08:21:07.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.806+0000 7fe6c9c31780 1 < completed delete operation key=4KRJ7DTE3KDV tag=G83ZUAEM4H6R type=del 2024-09-22T08:21:07.808 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.808+0000 7fe6c9c31780 1 > prepared operation key=4KRJ7DTE3KDV tag=H8UEMW7U9J2W type=del size=971262 2024-09-22T08:21:07.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.809+0000 7fe6c9c31780 1 < completed write operation key=KZIY400KQ5NH tag=KIR93HCDO04R type=write size=245227 2024-09-22T08:21:07.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.811+0000 7fe6c9c31780 1 > prepared operation key=JT5AB8VLMEFD tag=3IQO5SB4QFDB type=del size=3061334 2024-09-22T08:21:07.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.814+0000 7fe6c9c31780 1 < suggested update operation key=CTK01Y0CV1NC tag=I05UZKRAKDPH type=del size=1062204 2024-09-22T08:21:07.816 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.815+0000 7fe6c9c31780 1 > prepared operation key=GEWQUFB9K35E tag=85I3IE061J0N type=del size=2188928 2024-09-22T08:21:07.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.817+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~BOSBLYE4006C.0 size=1048576 2024-09-22T08:21:07.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.818+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~BOSBLYE4006C.1 size=1006936 2024-09-22T08:21:07.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.820+0000 7fe6c9c31780 1 < completed multipart upload key=LA6ZRVULGQ0H upload=BOSBLYE4006C tag=M85DS65XD6DN type=write size=3104088 2024-09-22T08:21:07.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.822+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=DVYW955LDZCJ type=del size=2902091 2024-09-22T08:21:07.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.824+0000 7fe6c9c31780 1 < suggested remove operation key=LA6ZRVULGQ0H tag=29UKHO7VDEO9 type=del 2024-09-22T08:21:07.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.826+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=BPJHD722GJMX type=del size=362900 2024-09-22T08:21:07.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.827+0000 7fe6c9c31780 1 < completed delete operation key=DC7VLQWZ3TD1 tag=CMFRJF4EB7Q5 type=del 2024-09-22T08:21:07.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.830+0000 7fe6c9c31780 1 > prepared part key=_multipart_W9L87PTJEIOA.2~C8N5F18BIHLM.0 size=513031 2024-09-22T08:21:07.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.830+0000 7fe6c9c31780 1 > prepared multipart upload key=W9L87PTJEIOA upload=C8N5F18BIHLM tag=A9ZPFWD8CCBF type=write size=1561607 2024-09-22T08:21:07.832 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.831+0000 7fe6c9c31780 1 < completed part key=_multipart_TYVQ39KUV2V9.2~GKNEYEPMPGSU.0 size=49302 2024-09-22T08:21:07.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.834+0000 7fe6c9c31780 1 < completed multipart upload key=TYVQ39KUV2V9 upload=GKNEYEPMPGSU tag=S710S53O350F type=write size=1097878 2024-09-22T08:21:07.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.835+0000 7fe6c9c31780 1 > prepared operation key=XJP26CCPYDI7 tag=1VJ0UF795444 type=del size=1413609 2024-09-22T08:21:07.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.836+0000 7fe6c9c31780 1 < completed delete operation key=T2W6RXP9UGHH tag=6CLJTZXNW0HS type=del 2024-09-22T08:21:07.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.838+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=8PMLO238T85T type=del size=553296 2024-09-22T08:21:07.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.839+0000 7fe6c9c31780 1 < completed delete operation key=JT5AB8VLMEFD tag=HJZ4GTCXWGES type=del 2024-09-22T08:21:07.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.842+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~1X0MBQA35IM8.0 size=1048576 2024-09-22T08:21:07.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.843+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~1X0MBQA35IM8.1 size=1048576 2024-09-22T08:21:07.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.844+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~1X0MBQA35IM8.2 size=583465 2024-09-22T08:21:07.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.844+0000 7fe6c9c31780 1 > prepared multipart upload key=CTK01Y0CV1NC upload=1X0MBQA35IM8 tag=DQJNLPKGZWK7 type=write size=3729193 2024-09-22T08:21:07.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.845+0000 7fe6c9c31780 1 < canceled part key=_multipart_Z1CK5EDBK4AW.2~GU6ULZTV7L3H.0 size=1048576 2024-09-22T08:21:07.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.846+0000 7fe6c9c31780 1 < completed part key=_multipart_Z1CK5EDBK4AW.2~GU6ULZTV7L3H.1 size=582720 2024-09-22T08:21:07.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.848+0000 7fe6c9c31780 1 < canceled multipart upload key=Z1CK5EDBK4AW upload=GU6ULZTV7L3H tag=S8YVLGCQC7G4 type=write size=2679872 2024-09-22T08:21:07.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.849+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=UOQ1KEL7MR0L type=write size=868727 2024-09-22T08:21:07.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.851+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~E7EOHFWT1YKG.0 size=1048576 2024-09-22T08:21:07.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.852+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~E7EOHFWT1YKG.1 size=335545 2024-09-22T08:21:07.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.855+0000 7fe6c9c31780 1 < completed multipart upload key=FY40JTHLT0KU upload=E7EOHFWT1YKG tag=A9G95X3V1GXF type=write size=2432697 2024-09-22T08:21:07.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.856+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=FGHNSCZABMIC type=del size=1072417 2024-09-22T08:21:07.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.857+0000 7fe6c9c31780 1 < completed delete operation key=1HZ0NAJPXNW1 tag=2ET3WL2SYB83 type=del 2024-09-22T08:21:07.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.859+0000 7fe6c9c31780 1 > prepared operation key=GEWQUFB9K35E tag=A392456HWHQI type=del size=2854469 2024-09-22T08:21:07.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.861+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~EMAE59J033R8.0 size=1048576 2024-09-22T08:21:07.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.862+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~EMAE59J033R8.1 size=1048576 2024-09-22T08:21:07.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.863+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~EMAE59J033R8.2 size=988035 2024-09-22T08:21:07.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.866+0000 7fe6c9c31780 1 < completed multipart upload key=FY40JTHLT0KU upload=EMAE59J033R8 tag=V66624521JT1 type=write size=4133763 2024-09-22T08:21:07.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.868+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=7FQKB65459FP type=del size=2759406 2024-09-22T08:21:07.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.869+0000 7fe6c9c31780 1 < completed delete operation key=T2W6RXP9UGHH tag=H0HU1Y1OFN7D type=del 2024-09-22T08:21:07.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.871+0000 7fe6c9c31780 1 > prepared operation key=GEWQUFB9K35E tag=D6Z8XGAMHBG1 type=del size=1573000 2024-09-22T08:21:07.873 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.872+0000 7fe6c9c31780 1 < completed delete operation key=FY40JTHLT0KU tag=PPXVXZX858Z6 type=del 2024-09-22T08:21:07.874 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.874+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=REV5OLFAC0WY type=del size=3113904 2024-09-22T08:21:07.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.875+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~81IROKRXM9P0.0 size=1048576 2024-09-22T08:21:07.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.876+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~81IROKRXM9P0.1 size=579526 2024-09-22T08:21:07.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.879+0000 7fe6c9c31780 1 < completed multipart upload key=LA6ZRVULGQ0H upload=81IROKRXM9P0 tag=KLA91LKYC2G3 type=write size=2676678 2024-09-22T08:21:07.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.881+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~6BVUHO113I9V.0 size=1048576 2024-09-22T08:21:07.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.882+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~6BVUHO113I9V.1 size=1048576 2024-09-22T08:21:07.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.884+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~6BVUHO113I9V.2 size=792862 2024-09-22T08:21:07.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.884+0000 7fe6c9c31780 1 > prepared multipart upload key=TE10GB1F35X4 upload=6BVUHO113I9V tag=HYG1AMN0NZNZ type=write size=3938590 2024-09-22T08:21:07.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.886+0000 7fe6c9c31780 1 < completed delete operation key=4KRJ7DTE3KDV tag=H8UEMW7U9J2W type=del 2024-09-22T08:21:07.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.887+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=AJQ1LJ9INPPC type=del size=2234799 2024-09-22T08:21:07.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.889+0000 7fe6c9c31780 1 < completed delete operation key=JT5AB8VLMEFD tag=3IQO5SB4QFDB type=del 2024-09-22T08:21:07.892 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.892+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~Z8NJRMWNPFGJ.0 size=1048576 2024-09-22T08:21:07.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.893+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~Z8NJRMWNPFGJ.1 size=456848 2024-09-22T08:21:07.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.893+0000 7fe6c9c31780 1 > prepared multipart upload key=ILW34WLX48WN upload=Z8NJRMWNPFGJ tag=QMM29WR54WDP type=write size=2554000 2024-09-22T08:21:07.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.896+0000 7fe6c9c31780 1 < suggested update operation key=GEWQUFB9K35E tag=85I3IE061J0N type=del size=2188928 2024-09-22T08:21:07.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.898+0000 7fe6c9c31780 1 > prepared operation key=OX1LY7URY7IV tag=VQKO2M9I28ND type=del size=2753153 2024-09-22T08:21:07.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.901+0000 7fe6c9c31780 1 < completed delete operation key=TE10GB1F35X4 tag=DVYW955LDZCJ type=del 2024-09-22T08:21:07.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.904+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~17CXT7POKKON.0 size=1048576 2024-09-22T08:21:07.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.906+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~17CXT7POKKON.1 size=205298 2024-09-22T08:21:07.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.906+0000 7fe6c9c31780 1 > prepared multipart upload key=76HZ3LZGVT9J upload=17CXT7POKKON tag=3BBAXKRG2ZSQ type=write size=2302450 2024-09-22T08:21:07.909 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.909+0000 7fe6c9c31780 1 < suggested update operation key=9AZWQ9E58QS6 tag=BPJHD722GJMX type=del size=362900 2024-09-22T08:21:07.910 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.910+0000 7fe6c9c31780 1 > prepared operation key=GEWQUFB9K35E tag=M8R1JHYLF38M type=del size=2299372 2024-09-22T08:21:07.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.911+0000 7fe6c9c31780 1 < completed part key=_multipart_W9L87PTJEIOA.2~C8N5F18BIHLM.0 size=513031 2024-09-22T08:21:07.914 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.914+0000 7fe6c9c31780 1 < completed multipart upload key=W9L87PTJEIOA upload=C8N5F18BIHLM tag=A9ZPFWD8CCBF type=write size=1561607 2024-09-22T08:21:07.917 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.917+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~2DUV000ILRTP.0 size=1048576 2024-09-22T08:21:07.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.918+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~2DUV000ILRTP.1 size=97461 2024-09-22T08:21:07.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.918+0000 7fe6c9c31780 1 > prepared multipart upload key=CTK01Y0CV1NC upload=2DUV000ILRTP tag=XWBHSB2R7H9C type=write size=2194613 2024-09-22T08:21:07.920 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.919+0000 7fe6c9c31780 1 < completed delete operation key=XJP26CCPYDI7 tag=1VJ0UF795444 type=del 2024-09-22T08:21:07.921 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.921+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=708TRJ58AV0Z type=del size=658762 2024-09-22T08:21:07.923 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.922+0000 7fe6c9c31780 1 < completed delete operation key=2B5QRUMTVE7U tag=8PMLO238T85T type=del 2024-09-22T08:21:07.924 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.924+0000 7fe6c9c31780 1 > prepared operation key=O1UBUQXP50CN tag=OOOEW194LBDX type=del size=1159853 2024-09-22T08:21:07.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.926+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~1X0MBQA35IM8.0 size=1048576 2024-09-22T08:21:07.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.926+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~1X0MBQA35IM8.1 size=1048576 2024-09-22T08:21:07.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.927+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~1X0MBQA35IM8.2 size=583465 2024-09-22T08:21:07.930 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.930+0000 7fe6c9c31780 1 < completed multipart upload key=CTK01Y0CV1NC upload=1X0MBQA35IM8 tag=DQJNLPKGZWK7 type=write size=3729193 2024-09-22T08:21:07.932 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.932+0000 7fe6c9c31780 1 > prepared operation key=XJP26CCPYDI7 tag=0VBUE30IGQQS type=write size=342658 2024-09-22T08:21:07.933 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.933+0000 7fe6c9c31780 1 < completed write operation key=0TWY0NNZZ7NN tag=UOQ1KEL7MR0L type=write size=868727 2024-09-22T08:21:07.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.934+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=749PQ0HRWD7D type=del size=2978580 2024-09-22T08:21:07.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.937+0000 7fe6c9c31780 1 < suggested update operation key=CTK01Y0CV1NC tag=FGHNSCZABMIC type=del size=1072417 2024-09-22T08:21:07.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.939+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=CUO156FCN2QG type=del size=4077184 2024-09-22T08:21:07.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.940+0000 7fe6c9c31780 -1 < failed to complete operation key=GEWQUFB9K35E tag=A392456HWHQI type=del size=2854469: (22) Invalid argument 2024-09-22T08:21:07.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.943+0000 7fe6c9c31780 1 > prepared part key=_multipart_9AZWQ9E58QS6.2~Y2N9GJVW1ANZ.0 size=661078 2024-09-22T08:21:07.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.943+0000 7fe6c9c31780 1 > prepared multipart upload key=9AZWQ9E58QS6 upload=Y2N9GJVW1ANZ tag=3CXM6UW6OXXY type=write size=1709654 2024-09-22T08:21:07.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.946+0000 7fe6c9c31780 1 < completed delete operation key=76HZ3LZGVT9J tag=7FQKB65459FP type=del 2024-09-22T08:21:07.948 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.948+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~3COSEFCN5I8G.0 size=418397 2024-09-22T08:21:07.948 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.948+0000 7fe6c9c31780 1 > prepared multipart upload key=9FCSIF1WKBDJ upload=3COSEFCN5I8G tag=9DCSHVSGIN0J type=write size=1466973 2024-09-22T08:21:07.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.950+0000 7fe6c9c31780 -1 < failed to complete operation key=GEWQUFB9K35E tag=D6Z8XGAMHBG1 type=del size=1573000: (22) Invalid argument 2024-09-22T08:21:07.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.952+0000 7fe6c9c31780 1 > prepared part key=_multipart_9AZWQ9E58QS6.2~N9RFZ0PNCSR3.0 size=1048576 2024-09-22T08:21:07.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.953+0000 7fe6c9c31780 1 > prepared part key=_multipart_9AZWQ9E58QS6.2~N9RFZ0PNCSR3.1 size=1031527 2024-09-22T08:21:07.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.953+0000 7fe6c9c31780 1 > prepared multipart upload key=9AZWQ9E58QS6 upload=N9RFZ0PNCSR3 tag=RAOBTQWH9ZYP type=write size=3128679 2024-09-22T08:21:07.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.954+0000 7fe6c9c31780 1 < completed delete operation key=T2W6RXP9UGHH tag=REV5OLFAC0WY type=del 2024-09-22T08:21:07.956 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.956+0000 7fe6c9c31780 1 > prepared operation key=GEWQUFB9K35E tag=3BY0XO1X91FP type=del size=572364 2024-09-22T08:21:07.957 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.956+0000 7fe6c9c31780 1 < canceled part key=_multipart_TE10GB1F35X4.2~6BVUHO113I9V.0 size=1048576 2024-09-22T08:21:07.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.957+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~6BVUHO113I9V.1 size=1048576 2024-09-22T08:21:07.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.959+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~6BVUHO113I9V.2 size=792862 2024-09-22T08:21:07.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.962+0000 7fe6c9c31780 1 < canceled multipart upload key=TE10GB1F35X4 upload=6BVUHO113I9V tag=HYG1AMN0NZNZ type=write size=3938590 2024-09-22T08:21:07.963 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.963+0000 7fe6c9c31780 1 > prepared operation key=D85LJGGU3Z6F tag=F9BWF7O6YCML type=del size=90436 2024-09-22T08:21:07.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.964+0000 7fe6c9c31780 1 < completed delete operation key=6BKB91YV3FMW tag=AJQ1LJ9INPPC type=del 2024-09-22T08:21:07.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.966+0000 7fe6c9c31780 1 > prepared operation key=4KRJ7DTE3KDV tag=556103531CAU type=del size=269733 2024-09-22T08:21:07.968 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.967+0000 7fe6c9c31780 1 < completed part key=_multipart_ILW34WLX48WN.2~Z8NJRMWNPFGJ.0 size=1048576 2024-09-22T08:21:07.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.968+0000 7fe6c9c31780 1 < completed part key=_multipart_ILW34WLX48WN.2~Z8NJRMWNPFGJ.1 size=456848 2024-09-22T08:21:07.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.971+0000 7fe6c9c31780 1 < completed multipart upload key=ILW34WLX48WN upload=Z8NJRMWNPFGJ tag=QMM29WR54WDP type=write size=2554000 2024-09-22T08:21:07.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.974+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~HDOIVTSVO9ZH.0 size=1048576 2024-09-22T08:21:07.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.974+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~HDOIVTSVO9ZH.1 size=94231 2024-09-22T08:21:07.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.974+0000 7fe6c9c31780 1 > prepared multipart upload key=XJP26CCPYDI7 upload=HDOIVTSVO9ZH tag=QBM9WVOEJH2Y type=write size=2191383 2024-09-22T08:21:07.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.976+0000 7fe6c9c31780 1 < completed delete operation key=OX1LY7URY7IV tag=VQKO2M9I28ND type=del 2024-09-22T08:21:07.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.977+0000 7fe6c9c31780 1 > prepared operation key=TJTB67QBLZH5 tag=PWU5LARERK10 type=del size=3541199 2024-09-22T08:21:07.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.979+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~17CXT7POKKON.0 size=1048576 2024-09-22T08:21:07.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.980+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~17CXT7POKKON.1 size=205298 2024-09-22T08:21:07.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.982+0000 7fe6c9c31780 1 < completed multipart upload key=76HZ3LZGVT9J upload=17CXT7POKKON tag=3BBAXKRG2ZSQ type=write size=2302450 2024-09-22T08:21:07.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.984+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=6HAZQ9833IPL type=del size=2814383 2024-09-22T08:21:07.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.986+0000 7fe6c9c31780 1 < completed delete operation key=GEWQUFB9K35E tag=M8R1JHYLF38M type=del 2024-09-22T08:21:07.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.987+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=4GDGPVIHRHBZ type=del size=2270896 2024-09-22T08:21:07.989 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.988+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~2DUV000ILRTP.0 size=1048576 2024-09-22T08:21:07.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.989+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~2DUV000ILRTP.1 size=97461 2024-09-22T08:21:07.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.992+0000 7fe6c9c31780 1 < completed multipart upload key=CTK01Y0CV1NC upload=2DUV000ILRTP tag=XWBHSB2R7H9C type=write size=2194613 2024-09-22T08:21:07.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.993+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=41M9KSRZC8DG type=del size=1346826 2024-09-22T08:21:07.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.995+0000 7fe6c9c31780 1 < completed delete operation key=DC7VLQWZ3TD1 tag=708TRJ58AV0Z type=del 2024-09-22T08:21:07.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.997+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~W83UENEP2ZUR.0 size=1048576 2024-09-22T08:21:07.999 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:07.999+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~W83UENEP2ZUR.1 size=1048576 2024-09-22T08:21:08.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.000+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~W83UENEP2ZUR.2 size=807395 2024-09-22T08:21:08.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.000+0000 7fe6c9c31780 1 > prepared multipart upload key=LA6ZRVULGQ0H upload=W83UENEP2ZUR tag=DJKGFR0LGTI3 type=write size=3953123 2024-09-22T08:21:08.002 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.001+0000 7fe6c9c31780 1 < completed delete operation key=O1UBUQXP50CN tag=OOOEW194LBDX type=del 2024-09-22T08:21:08.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.005+0000 7fe6c9c31780 1 > prepared part key=_multipart_R7UWMW913DJQ.2~EM5G3JKG5WMI.0 size=1048576 2024-09-22T08:21:08.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.006+0000 7fe6c9c31780 1 > prepared part key=_multipart_R7UWMW913DJQ.2~EM5G3JKG5WMI.1 size=426811 2024-09-22T08:21:08.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.006+0000 7fe6c9c31780 1 > prepared multipart upload key=R7UWMW913DJQ upload=EM5G3JKG5WMI tag=2SPRX647AT0W type=write size=2523963 2024-09-22T08:21:08.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.007+0000 7fe6c9c31780 1 < canceled operation key=XJP26CCPYDI7 tag=0VBUE30IGQQS type=write size=342658 2024-09-22T08:21:08.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.009+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~OW54UM9AZNT6.0 size=1048576 2024-09-22T08:21:08.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.011+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~OW54UM9AZNT6.1 size=995944 2024-09-22T08:21:08.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.011+0000 7fe6c9c31780 1 > prepared multipart upload key=6BKB91YV3FMW upload=OW54UM9AZNT6 tag=9R3Q49NIKKYO type=write size=3093096 2024-09-22T08:21:08.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.014+0000 7fe6c9c31780 1 < suggested update operation key=R7UWMW913DJQ tag=749PQ0HRWD7D type=del size=2978580 2024-09-22T08:21:08.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.015+0000 7fe6c9c31780 1 > prepared operation key=LA6ZRVULGQ0H tag=IH1CI1USMN3B type=write size=500795 2024-09-22T08:21:08.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.017+0000 7fe6c9c31780 1 < completed delete operation key=6BKB91YV3FMW tag=CUO156FCN2QG type=del 2024-09-22T08:21:08.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.018+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=TA9LV0W15ONV type=write size=434734 2024-09-22T08:21:08.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.020+0000 7fe6c9c31780 1 < completed part key=_multipart_9AZWQ9E58QS6.2~Y2N9GJVW1ANZ.0 size=661078 2024-09-22T08:21:08.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.022+0000 7fe6c9c31780 1 < completed multipart upload key=9AZWQ9E58QS6 upload=Y2N9GJVW1ANZ tag=3CXM6UW6OXXY type=write size=1709654 2024-09-22T08:21:08.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.025+0000 7fe6c9c31780 1 > prepared part key=_multipart_R7UWMW913DJQ.2~Y9IF9OW3GV98.0 size=330951 2024-09-22T08:21:08.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.025+0000 7fe6c9c31780 1 > prepared multipart upload key=R7UWMW913DJQ upload=Y9IF9OW3GV98 tag=MA9CL8FK6VR0 type=write size=1379527 2024-09-22T08:21:08.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.027+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~3COSEFCN5I8G.0 size=418397 2024-09-22T08:21:08.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.029+0000 7fe6c9c31780 1 < completed multipart upload key=9FCSIF1WKBDJ upload=3COSEFCN5I8G tag=9DCSHVSGIN0J type=write size=1466973 2024-09-22T08:21:08.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.030+0000 7fe6c9c31780 1 > prepared operation key=FY40JTHLT0KU tag=79PXYVVNLMS4 type=del size=2932734 2024-09-22T08:21:08.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.032+0000 7fe6c9c31780 1 < completed part key=_multipart_9AZWQ9E58QS6.2~N9RFZ0PNCSR3.0 size=1048576 2024-09-22T08:21:08.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.034+0000 7fe6c9c31780 1 < completed part key=_multipart_9AZWQ9E58QS6.2~N9RFZ0PNCSR3.1 size=1031527 2024-09-22T08:21:08.036 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.036+0000 7fe6c9c31780 1 < completed multipart upload key=9AZWQ9E58QS6 upload=N9RFZ0PNCSR3 tag=RAOBTQWH9ZYP type=write size=3128679 2024-09-22T08:21:08.038 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.037+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=CQG98277GBTU type=del size=3099982 2024-09-22T08:21:08.040 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.040+0000 7fe6c9c31780 1 < completed delete operation key=GEWQUFB9K35E tag=3BY0XO1X91FP type=del 2024-09-22T08:21:08.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.041+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=HXAE5Z5E6ABC type=write size=662983 2024-09-22T08:21:08.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.043+0000 7fe6c9c31780 1 < completed delete operation key=D85LJGGU3Z6F tag=F9BWF7O6YCML type=del 2024-09-22T08:21:08.045 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.044+0000 7fe6c9c31780 1 > prepared operation key=TYVQ39KUV2V9 tag=RD2U9RMLL5PO type=del size=2154389 2024-09-22T08:21:08.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.046+0000 7fe6c9c31780 1 < completed delete operation key=4KRJ7DTE3KDV tag=556103531CAU type=del 2024-09-22T08:21:08.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.049+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~E646YQZDUHPQ.0 size=1048576 2024-09-22T08:21:08.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.050+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~E646YQZDUHPQ.1 size=1048576 2024-09-22T08:21:08.051 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.051+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~E646YQZDUHPQ.2 size=478256 2024-09-22T08:21:08.052 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.051+0000 7fe6c9c31780 1 > prepared multipart upload key=T2W6RXP9UGHH upload=E646YQZDUHPQ tag=T42CT5DJB3P5 type=write size=3623984 2024-09-22T08:21:08.053 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.052+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~HDOIVTSVO9ZH.0 size=1048576 2024-09-22T08:21:08.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.053+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~HDOIVTSVO9ZH.1 size=94231 2024-09-22T08:21:08.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.056+0000 7fe6c9c31780 1 < completed multipart upload key=XJP26CCPYDI7 upload=HDOIVTSVO9ZH tag=QBM9WVOEJH2Y type=write size=2191383 2024-09-22T08:21:08.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.058+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~U3RQ80CA1EW7.0 size=1048576 2024-09-22T08:21:08.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.060+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~U3RQ80CA1EW7.1 size=483357 2024-09-22T08:21:08.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.060+0000 7fe6c9c31780 1 > prepared multipart upload key=0PNK2ZW6IJM1 upload=U3RQ80CA1EW7 tag=5VZ8196U36OF type=write size=2580509 2024-09-22T08:21:08.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.063+0000 7fe6c9c31780 1 < suggested update operation key=TJTB67QBLZH5 tag=PWU5LARERK10 type=del size=3541199 2024-09-22T08:21:08.065 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.064+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=TFWVFXFFBS2A type=del size=1120355 2024-09-22T08:21:08.066 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.066+0000 7fe6c9c31780 1 < completed delete operation key=946H8F2AUPO2 tag=6HAZQ9833IPL type=del 2024-09-22T08:21:08.069 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.069+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~4GBTZ5TVY3PS.0 size=481341 2024-09-22T08:21:08.069 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.069+0000 7fe6c9c31780 1 > prepared multipart upload key=VP1MP4IC9A7T upload=4GBTZ5TVY3PS tag=HUETIHBMPW5D type=write size=1529917 2024-09-22T08:21:08.071 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.070+0000 7fe6c9c31780 1 < completed delete operation key=6BKB91YV3FMW tag=4GDGPVIHRHBZ type=del 2024-09-22T08:21:08.073 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.072+0000 7fe6c9c31780 1 > prepared operation key=XJP26CCPYDI7 tag=6IUZ95J0JJ76 type=del size=611982 2024-09-22T08:21:08.074 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.074+0000 7fe6c9c31780 1 < completed delete operation key=6BKB91YV3FMW tag=41M9KSRZC8DG type=del 2024-09-22T08:21:08.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.075+0000 7fe6c9c31780 1 > prepared operation key=Z1CK5EDBK4AW tag=KS3PJB5PYVV7 type=del size=2787156 2024-09-22T08:21:08.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.077+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~W83UENEP2ZUR.0 size=1048576 2024-09-22T08:21:08.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.079+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~W83UENEP2ZUR.1 size=1048576 2024-09-22T08:21:08.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.079+0000 7fe6c9c31780 1 < canceled part key=_multipart_LA6ZRVULGQ0H.2~W83UENEP2ZUR.2 size=807395 2024-09-22T08:21:08.082 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.081+0000 7fe6c9c31780 1 < canceled multipart upload key=LA6ZRVULGQ0H upload=W83UENEP2ZUR tag=DJKGFR0LGTI3 type=write size=3953123 2024-09-22T08:21:08.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.083+0000 7fe6c9c31780 1 > prepared operation key=GEWQUFB9K35E tag=0IXG07OUV3Q3 type=del size=3377501 2024-09-22T08:21:08.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.085+0000 7fe6c9c31780 1 < completed part key=_multipart_R7UWMW913DJQ.2~EM5G3JKG5WMI.0 size=1048576 2024-09-22T08:21:08.086 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.086+0000 7fe6c9c31780 1 < completed part key=_multipart_R7UWMW913DJQ.2~EM5G3JKG5WMI.1 size=426811 2024-09-22T08:21:08.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.088+0000 7fe6c9c31780 1 < completed multipart upload key=R7UWMW913DJQ upload=EM5G3JKG5WMI tag=2SPRX647AT0W type=write size=2523963 2024-09-22T08:21:08.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.090+0000 7fe6c9c31780 1 > prepared operation key=0PNK2ZW6IJM1 tag=QYKH5PPPD8PG type=del size=3062353 2024-09-22T08:21:08.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.092+0000 7fe6c9c31780 1 < completed part key=_multipart_6BKB91YV3FMW.2~OW54UM9AZNT6.0 size=1048576 2024-09-22T08:21:08.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.093+0000 7fe6c9c31780 1 < completed part key=_multipart_6BKB91YV3FMW.2~OW54UM9AZNT6.1 size=995944 2024-09-22T08:21:08.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.096+0000 7fe6c9c31780 1 < completed multipart upload key=6BKB91YV3FMW upload=OW54UM9AZNT6 tag=9R3Q49NIKKYO type=write size=3093096 2024-09-22T08:21:08.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.097+0000 7fe6c9c31780 1 > prepared operation key=Z1CK5EDBK4AW tag=J1Y9C55AZ56K type=del size=1388191 2024-09-22T08:21:08.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.098+0000 7fe6c9c31780 1 < completed write operation key=LA6ZRVULGQ0H tag=IH1CI1USMN3B type=write size=500795 2024-09-22T08:21:08.100 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.100+0000 7fe6c9c31780 1 > prepared operation key=JT5AB8VLMEFD tag=R6JIZU77G2G5 type=del size=1576353 2024-09-22T08:21:08.103 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.103+0000 7fe6c9c31780 1 < suggested remove operation key=T2W6RXP9UGHH tag=TA9LV0W15ONV type=write 2024-09-22T08:21:08.106 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.105+0000 7fe6c9c31780 1 > prepared part key=_multipart_TJTB67QBLZH5.2~UID8WI3I3NVD.0 size=457856 2024-09-22T08:21:08.106 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.105+0000 7fe6c9c31780 1 > prepared multipart upload key=TJTB67QBLZH5 upload=UID8WI3I3NVD tag=7HVJBF9H2L25 type=write size=1506432 2024-09-22T08:21:08.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.106+0000 7fe6c9c31780 1 < completed part key=_multipart_R7UWMW913DJQ.2~Y9IF9OW3GV98.0 size=330951 2024-09-22T08:21:08.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.109+0000 7fe6c9c31780 1 < completed multipart upload key=R7UWMW913DJQ upload=Y9IF9OW3GV98 tag=MA9CL8FK6VR0 type=write size=1379527 2024-09-22T08:21:08.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.110+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=6AL501DPR1CZ type=del size=2446191 2024-09-22T08:21:08.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.112+0000 7fe6c9c31780 1 < completed delete operation key=FY40JTHLT0KU tag=79PXYVVNLMS4 type=del 2024-09-22T08:21:08.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.114+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~TCL8JEJCZCE3.0 size=1048576 2024-09-22T08:21:08.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.116+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~TCL8JEJCZCE3.1 size=1048576 2024-09-22T08:21:08.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.117+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~TCL8JEJCZCE3.2 size=703775 2024-09-22T08:21:08.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.117+0000 7fe6c9c31780 1 > prepared multipart upload key=KZIY400KQ5NH upload=TCL8JEJCZCE3 tag=P102SHD00X9B type=write size=3849503 2024-09-22T08:21:08.120 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.119+0000 7fe6c9c31780 1 < suggested remove operation key=6BKB91YV3FMW tag=CQG98277GBTU type=del 2024-09-22T08:21:08.121 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.121+0000 7fe6c9c31780 1 > prepared operation key=GEWQUFB9K35E tag=PWAGLOJG07VB type=del size=1305226 2024-09-22T08:21:08.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.122+0000 7fe6c9c31780 1 < completed write operation key=7446WN19QFV0 tag=HXAE5Z5E6ABC type=write size=662983 2024-09-22T08:21:08.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.124+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=UZ9X9K16JS5U type=write size=606761 2024-09-22T08:21:08.126 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.125+0000 7fe6c9c31780 1 < completed delete operation key=TYVQ39KUV2V9 tag=RD2U9RMLL5PO type=del 2024-09-22T08:21:08.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.127+0000 7fe6c9c31780 1 > prepared operation key=D85LJGGU3Z6F tag=PJI0G8D5YH0E type=del size=3875120 2024-09-22T08:21:08.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.128+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~E646YQZDUHPQ.0 size=1048576 2024-09-22T08:21:08.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.129+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~E646YQZDUHPQ.1 size=1048576 2024-09-22T08:21:08.131 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.130+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~E646YQZDUHPQ.2 size=478256 2024-09-22T08:21:08.133 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.133+0000 7fe6c9c31780 1 < completed multipart upload key=T2W6RXP9UGHH upload=E646YQZDUHPQ tag=T42CT5DJB3P5 type=write size=3623984 2024-09-22T08:21:08.136 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.135+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~4OJFP501YDDK.0 size=1048576 2024-09-22T08:21:08.137 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.136+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~4OJFP501YDDK.1 size=1048576 2024-09-22T08:21:08.138 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.138+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~4OJFP501YDDK.2 size=930241 2024-09-22T08:21:08.139 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.138+0000 7fe6c9c31780 1 > prepared multipart upload key=O1UBUQXP50CN upload=4OJFP501YDDK tag=NGW5A4LS6XIK type=write size=4075969 2024-09-22T08:21:08.140 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.139+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~U3RQ80CA1EW7.0 size=1048576 2024-09-22T08:21:08.141 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.140+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~U3RQ80CA1EW7.1 size=483357 2024-09-22T08:21:08.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.144+0000 7fe6c9c31780 1 < completed multipart upload key=0PNK2ZW6IJM1 upload=U3RQ80CA1EW7 tag=5VZ8196U36OF type=write size=2580509 2024-09-22T08:21:08.145 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.145+0000 7fe6c9c31780 1 > prepared operation key=OX1LY7URY7IV tag=5A7HKNIDR60R type=write size=967464 2024-09-22T08:21:08.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.147+0000 7fe6c9c31780 1 < suggested update operation key=946H8F2AUPO2 tag=TFWVFXFFBS2A type=del size=1120355 2024-09-22T08:21:08.149 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.149+0000 7fe6c9c31780 1 > prepared operation key=LA6ZRVULGQ0H tag=N2IYMVONSHTH type=del size=3903437 2024-09-22T08:21:08.151 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.150+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~4GBTZ5TVY3PS.0 size=481341 2024-09-22T08:21:08.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.152+0000 7fe6c9c31780 1 < completed multipart upload key=VP1MP4IC9A7T upload=4GBTZ5TVY3PS tag=HUETIHBMPW5D type=write size=1529917 2024-09-22T08:21:08.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.154+0000 7fe6c9c31780 1 > prepared operation key=0PNK2ZW6IJM1 tag=VTR2N86C21PH type=del size=857166 2024-09-22T08:21:08.156 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.156+0000 7fe6c9c31780 1 < canceled operation key=XJP26CCPYDI7 tag=6IUZ95J0JJ76 type=del size=611982 2024-09-22T08:21:08.158 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.157+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=H705B1TV6QJ1 type=del size=491129 2024-09-22T08:21:08.161 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.161+0000 7fe6c9c31780 1 < suggested update operation key=Z1CK5EDBK4AW tag=KS3PJB5PYVV7 type=del size=2787156 2024-09-22T08:21:08.162 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.162+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=D2J538I2L1AT type=del size=3426281 2024-09-22T08:21:08.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.163+0000 7fe6c9c31780 1 < completed delete operation key=GEWQUFB9K35E tag=0IXG07OUV3Q3 type=del 2024-09-22T08:21:08.167 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.166+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~6IQ45VGEKOPG.0 size=1048576 2024-09-22T08:21:08.168 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.167+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~6IQ45VGEKOPG.1 size=1048576 2024-09-22T08:21:08.169 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.168+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~6IQ45VGEKOPG.2 size=266984 2024-09-22T08:21:08.169 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.168+0000 7fe6c9c31780 1 > prepared multipart upload key=0PNK2ZW6IJM1 upload=6IQ45VGEKOPG tag=8IFF8BRP2JJ2 type=write size=3412712 2024-09-22T08:21:08.170 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.170+0000 7fe6c9c31780 1 < completed delete operation key=0PNK2ZW6IJM1 tag=QYKH5PPPD8PG type=del 2024-09-22T08:21:08.173 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.173+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~A603ROXJTDH2.0 size=1048576 2024-09-22T08:21:08.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.174+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~A603ROXJTDH2.1 size=1048576 2024-09-22T08:21:08.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.175+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~A603ROXJTDH2.2 size=806168 2024-09-22T08:21:08.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.175+0000 7fe6c9c31780 1 > prepared multipart upload key=4KRJ7DTE3KDV upload=A603ROXJTDH2 tag=5RO4IMMN3ATI type=write size=3951896 2024-09-22T08:21:08.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.176+0000 7fe6c9c31780 -1 < failed to complete operation key=Z1CK5EDBK4AW tag=J1Y9C55AZ56K type=del size=1388191: (22) Invalid argument 2024-09-22T08:21:08.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.181+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~9XWT28ESS2MN.0 size=1048576 2024-09-22T08:21:08.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.182+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~9XWT28ESS2MN.1 size=797912 2024-09-22T08:21:08.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.182+0000 7fe6c9c31780 1 > prepared multipart upload key=VP1MP4IC9A7T upload=9XWT28ESS2MN tag=ZPU27RVY0QII type=write size=2895064 2024-09-22T08:21:08.185 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.184+0000 7fe6c9c31780 1 < suggested update operation key=JT5AB8VLMEFD tag=R6JIZU77G2G5 type=del size=1576353 2024-09-22T08:21:08.187 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.186+0000 7fe6c9c31780 1 > prepared operation key=ZFL9N44PBQX4 tag=EY1MSWH7D8GC type=del size=721584 2024-09-22T08:21:08.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.187+0000 7fe6c9c31780 1 < completed part key=_multipart_TJTB67QBLZH5.2~UID8WI3I3NVD.0 size=457856 2024-09-22T08:21:08.190 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.190+0000 7fe6c9c31780 1 < completed multipart upload key=TJTB67QBLZH5 upload=UID8WI3I3NVD tag=7HVJBF9H2L25 type=write size=1506432 2024-09-22T08:21:08.192 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.191+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=DK7NMK6TOTZM type=del size=941481 2024-09-22T08:21:08.196 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.195+0000 7fe6c9c31780 1 < suggested remove operation key=946H8F2AUPO2 tag=6AL501DPR1CZ type=del 2024-09-22T08:21:08.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.197+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=NUBMOV7L6TUD type=del size=4030553 2024-09-22T08:21:08.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.198+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~TCL8JEJCZCE3.0 size=1048576 2024-09-22T08:21:08.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.199+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~TCL8JEJCZCE3.1 size=1048576 2024-09-22T08:21:08.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.200+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~TCL8JEJCZCE3.2 size=703775 2024-09-22T08:21:08.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.203+0000 7fe6c9c31780 1 < completed multipart upload key=KZIY400KQ5NH upload=TCL8JEJCZCE3 tag=P102SHD00X9B type=write size=3849503 2024-09-22T08:21:08.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.205+0000 7fe6c9c31780 1 > prepared part key=_multipart_W9L87PTJEIOA.2~J21Q5NKDZR75.0 size=1048576 2024-09-22T08:21:08.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.206+0000 7fe6c9c31780 1 > prepared part key=_multipart_W9L87PTJEIOA.2~J21Q5NKDZR75.1 size=664329 2024-09-22T08:21:08.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.206+0000 7fe6c9c31780 1 > prepared multipart upload key=W9L87PTJEIOA upload=J21Q5NKDZR75 tag=NDXY78B32I2Y type=write size=2761481 2024-09-22T08:21:08.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.207+0000 7fe6c9c31780 1 < completed delete operation key=GEWQUFB9K35E tag=PWAGLOJG07VB type=del 2024-09-22T08:21:08.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.209+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=MXY1A55AX2KK type=write size=181076 2024-09-22T08:21:08.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.212+0000 7fe6c9c31780 1 < suggested update operation key=CTK01Y0CV1NC tag=UZ9X9K16JS5U type=write size=606761 2024-09-22T08:21:08.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.214+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~DK90UU0T956O.0 size=1048576 2024-09-22T08:21:08.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.216+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~DK90UU0T956O.1 size=1048576 2024-09-22T08:21:08.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.217+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~DK90UU0T956O.2 size=260475 2024-09-22T08:21:08.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.217+0000 7fe6c9c31780 1 > prepared multipart upload key=CTK01Y0CV1NC upload=DK90UU0T956O tag=GEN4I3S46S4Q type=write size=3406203 2024-09-22T08:21:08.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.218+0000 7fe6c9c31780 1 < completed delete operation key=D85LJGGU3Z6F tag=PJI0G8D5YH0E type=del 2024-09-22T08:21:08.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.220+0000 7fe6c9c31780 1 > prepared operation key=1HZ0NAJPXNW1 tag=9Y63X1O8HDHL type=del size=2590119 2024-09-22T08:21:08.222 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.221+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~4OJFP501YDDK.0 size=1048576 2024-09-22T08:21:08.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.222+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~4OJFP501YDDK.1 size=1048576 2024-09-22T08:21:08.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.222+0000 7fe6c9c31780 1 < canceled part key=_multipart_O1UBUQXP50CN.2~4OJFP501YDDK.2 size=930241 2024-09-22T08:21:08.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.225+0000 7fe6c9c31780 1 < canceled multipart upload key=O1UBUQXP50CN upload=4OJFP501YDDK tag=NGW5A4LS6XIK type=write size=4075969 2024-09-22T08:21:08.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.226+0000 7fe6c9c31780 1 > prepared operation key=JT5AB8VLMEFD tag=TG7QCNUHFB7R type=del size=1743164 2024-09-22T08:21:08.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.228+0000 7fe6c9c31780 1 < completed write operation key=OX1LY7URY7IV tag=5A7HKNIDR60R type=write size=967464 2024-09-22T08:21:08.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.231+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~ZUXYMF5SZ5O6.0 size=1048576 2024-09-22T08:21:08.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.232+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~ZUXYMF5SZ5O6.1 size=481323 2024-09-22T08:21:08.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.232+0000 7fe6c9c31780 1 > prepared multipart upload key=TE10GB1F35X4 upload=ZUXYMF5SZ5O6 tag=TA3LNEZM4Y43 type=write size=2578475 2024-09-22T08:21:08.234 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.233+0000 7fe6c9c31780 1 < canceled operation key=LA6ZRVULGQ0H tag=N2IYMVONSHTH type=del size=3903437 2024-09-22T08:21:08.236 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.236+0000 7fe6c9c31780 1 > prepared part key=_multipart_1HZ0NAJPXNW1.2~XL61Q325BQDX.0 size=1048576 2024-09-22T08:21:08.238 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.237+0000 7fe6c9c31780 1 > prepared part key=_multipart_1HZ0NAJPXNW1.2~XL61Q325BQDX.1 size=1048576 2024-09-22T08:21:08.239 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.238+0000 7fe6c9c31780 1 > prepared part key=_multipart_1HZ0NAJPXNW1.2~XL61Q325BQDX.2 size=156285 2024-09-22T08:21:08.239 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.238+0000 7fe6c9c31780 1 > prepared multipart upload key=1HZ0NAJPXNW1 upload=XL61Q325BQDX tag=MPWQUYI15HX0 type=write size=3302013 2024-09-22T08:21:08.240 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.239+0000 7fe6c9c31780 1 < completed delete operation key=0PNK2ZW6IJM1 tag=VTR2N86C21PH type=del 2024-09-22T08:21:08.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.242+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~OCIG3QR09IUB.0 size=417904 2024-09-22T08:21:08.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.242+0000 7fe6c9c31780 1 > prepared multipart upload key=76HZ3LZGVT9J upload=OCIG3QR09IUB tag=C7D9U31Y160R type=write size=1466480 2024-09-22T08:21:08.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.243+0000 7fe6c9c31780 1 < completed delete operation key=2B5QRUMTVE7U tag=H705B1TV6QJ1 type=del 2024-09-22T08:21:08.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.246+0000 7fe6c9c31780 1 > prepared part key=_multipart_TJTB67QBLZH5.2~VIZYQXF1Z244.0 size=1048576 2024-09-22T08:21:08.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.247+0000 7fe6c9c31780 1 > prepared part key=_multipart_TJTB67QBLZH5.2~VIZYQXF1Z244.1 size=1048576 2024-09-22T08:21:08.248 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.248+0000 7fe6c9c31780 1 > prepared part key=_multipart_TJTB67QBLZH5.2~VIZYQXF1Z244.2 size=22566 2024-09-22T08:21:08.249 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.248+0000 7fe6c9c31780 1 > prepared multipart upload key=TJTB67QBLZH5 upload=VIZYQXF1Z244 tag=6H3ZHMQIT610 type=write size=3168294 2024-09-22T08:21:08.250 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.249+0000 7fe6c9c31780 1 < completed delete operation key=2B5QRUMTVE7U tag=D2J538I2L1AT type=del 2024-09-22T08:21:08.252 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.252+0000 7fe6c9c31780 1 > prepared part key=_multipart_TJTB67QBLZH5.2~MK39M1JFLD0L.0 size=1048576 2024-09-22T08:21:08.253 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.253+0000 7fe6c9c31780 1 > prepared part key=_multipart_TJTB67QBLZH5.2~MK39M1JFLD0L.1 size=108176 2024-09-22T08:21:08.253 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.253+0000 7fe6c9c31780 1 > prepared multipart upload key=TJTB67QBLZH5 upload=MK39M1JFLD0L tag=89L672DZTMWS type=write size=2205328 2024-09-22T08:21:08.255 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.254+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~6IQ45VGEKOPG.0 size=1048576 2024-09-22T08:21:08.256 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.255+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~6IQ45VGEKOPG.1 size=1048576 2024-09-22T08:21:08.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.256+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~6IQ45VGEKOPG.2 size=266984 2024-09-22T08:21:08.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.258+0000 7fe6c9c31780 1 < completed multipart upload key=0PNK2ZW6IJM1 upload=6IQ45VGEKOPG tag=8IFF8BRP2JJ2 type=write size=3412712 2024-09-22T08:21:08.262 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.262+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~1X059RMBJ5MA.0 size=698729 2024-09-22T08:21:08.262 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.262+0000 7fe6c9c31780 1 > prepared multipart upload key=DC7VLQWZ3TD1 upload=1X059RMBJ5MA tag=A7EJMT02D4UO type=write size=1747305 2024-09-22T08:21:08.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.262+0000 7fe6c9c31780 1 < completed part key=_multipart_4KRJ7DTE3KDV.2~A603ROXJTDH2.0 size=1048576 2024-09-22T08:21:08.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.262+0000 7fe6c9c31780 1 < canceled part key=_multipart_4KRJ7DTE3KDV.2~A603ROXJTDH2.1 size=1048576 2024-09-22T08:21:08.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.262+0000 7fe6c9c31780 1 < canceled part key=_multipart_4KRJ7DTE3KDV.2~A603ROXJTDH2.2 size=806168 2024-09-22T08:21:08.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.265+0000 7fe6c9c31780 1 < canceled multipart upload key=4KRJ7DTE3KDV upload=A603ROXJTDH2 tag=5RO4IMMN3ATI type=write size=3951896 2024-09-22T08:21:08.267 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.266+0000 7fe6c9c31780 1 > prepared operation key=1HZ0NAJPXNW1 tag=265857ND1GEM type=del size=707541 2024-09-22T08:21:08.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.268+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~9XWT28ESS2MN.0 size=1048576 2024-09-22T08:21:08.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.269+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~9XWT28ESS2MN.1 size=797912 2024-09-22T08:21:08.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.271+0000 7fe6c9c31780 1 < completed multipart upload key=VP1MP4IC9A7T upload=9XWT28ESS2MN tag=ZPU27RVY0QII type=write size=2895064 2024-09-22T08:21:08.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.272+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=76Q72H5BR9K2 type=del size=2842142 2024-09-22T08:21:08.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.274+0000 7fe6c9c31780 1 < completed delete operation key=ZFL9N44PBQX4 tag=EY1MSWH7D8GC type=del 2024-09-22T08:21:08.276 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.275+0000 7fe6c9c31780 1 > prepared operation key=TJTB67QBLZH5 tag=803BN0X1V6F5 type=del size=2331505 2024-09-22T08:21:08.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.276+0000 7fe6c9c31780 1 < completed delete operation key=2B5QRUMTVE7U tag=DK7NMK6TOTZM type=del 2024-09-22T08:21:08.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.279+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~1ZAS3JONTXWO.0 size=1048576 2024-09-22T08:21:08.280 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.280+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~1ZAS3JONTXWO.1 size=386361 2024-09-22T08:21:08.281 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.280+0000 7fe6c9c31780 1 > prepared multipart upload key=6BKB91YV3FMW upload=1ZAS3JONTXWO tag=BW9ZERPZKRFE type=write size=2483513 2024-09-22T08:21:08.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.282+0000 7fe6c9c31780 1 < suggested remove operation key=ILW34WLX48WN tag=NUBMOV7L6TUD type=del 2024-09-22T08:21:08.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.285+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~CG25WO28D2VI.0 size=1048576 2024-09-22T08:21:08.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.286+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~CG25WO28D2VI.1 size=1048576 2024-09-22T08:21:08.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.288+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~CG25WO28D2VI.2 size=506098 2024-09-22T08:21:08.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.288+0000 7fe6c9c31780 1 > prepared multipart upload key=6BKB91YV3FMW upload=CG25WO28D2VI tag=U5O9H2F40LOO type=write size=3651826 2024-09-22T08:21:08.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.289+0000 7fe6c9c31780 1 < completed part key=_multipart_W9L87PTJEIOA.2~J21Q5NKDZR75.0 size=1048576 2024-09-22T08:21:08.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.290+0000 7fe6c9c31780 1 < completed part key=_multipart_W9L87PTJEIOA.2~J21Q5NKDZR75.1 size=664329 2024-09-22T08:21:08.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.292+0000 7fe6c9c31780 1 < completed multipart upload key=W9L87PTJEIOA upload=J21Q5NKDZR75 tag=NDXY78B32I2Y type=write size=2761481 2024-09-22T08:21:08.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.295+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~1K2LCZ6J2SVS.0 size=1048576 2024-09-22T08:21:08.296 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.296+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~1K2LCZ6J2SVS.1 size=1048576 2024-09-22T08:21:08.297 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.297+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~1K2LCZ6J2SVS.2 size=403962 2024-09-22T08:21:08.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.297+0000 7fe6c9c31780 1 > prepared multipart upload key=946H8F2AUPO2 upload=1K2LCZ6J2SVS tag=A22UMTE7SKYP type=write size=3549690 2024-09-22T08:21:08.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.300+0000 7fe6c9c31780 1 < suggested update operation key=7446WN19QFV0 tag=MXY1A55AX2KK type=write size=181076 2024-09-22T08:21:08.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.302+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~EMY2BUYDSKHG.0 size=980285 2024-09-22T08:21:08.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.302+0000 7fe6c9c31780 1 > prepared multipart upload key=Z1CK5EDBK4AW upload=EMY2BUYDSKHG tag=OOR4F84F85WH type=write size=2028861 2024-09-22T08:21:08.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.304+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~DK90UU0T956O.0 size=1048576 2024-09-22T08:21:08.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.305+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~DK90UU0T956O.1 size=1048576 2024-09-22T08:21:08.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.306+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~DK90UU0T956O.2 size=260475 2024-09-22T08:21:08.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.310+0000 7fe6c9c31780 1 < completed multipart upload key=CTK01Y0CV1NC upload=DK90UU0T956O tag=GEN4I3S46S4Q type=write size=3406203 2024-09-22T08:21:08.313 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.312+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~UNB8QQV9HI2P.0 size=1048576 2024-09-22T08:21:08.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.313+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~UNB8QQV9HI2P.1 size=1048576 2024-09-22T08:21:08.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.314+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~UNB8QQV9HI2P.2 size=527904 2024-09-22T08:21:08.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.314+0000 7fe6c9c31780 1 > prepared multipart upload key=ILW34WLX48WN upload=UNB8QQV9HI2P tag=3UJ4W38G352C type=write size=3673632 2024-09-22T08:21:08.316 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.316+0000 7fe6c9c31780 1 < completed delete operation key=1HZ0NAJPXNW1 tag=9Y63X1O8HDHL type=del 2024-09-22T08:21:08.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.319+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~RJNYXOCP5D4Q.0 size=150909 2024-09-22T08:21:08.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.319+0000 7fe6c9c31780 1 > prepared multipart upload key=XJP26CCPYDI7 upload=RJNYXOCP5D4Q tag=3YKEUYJB7YVD type=write size=1199485 2024-09-22T08:21:08.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.320+0000 7fe6c9c31780 1 < canceled operation key=JT5AB8VLMEFD tag=TG7QCNUHFB7R type=del size=1743164 2024-09-22T08:21:08.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.322+0000 7fe6c9c31780 1 > prepared operation key=GEWQUFB9K35E tag=P48D4UGKCCZ1 type=del size=2557258 2024-09-22T08:21:08.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.323+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~ZUXYMF5SZ5O6.0 size=1048576 2024-09-22T08:21:08.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.323+0000 7fe6c9c31780 1 < canceled part key=_multipart_TE10GB1F35X4.2~ZUXYMF5SZ5O6.1 size=481323 2024-09-22T08:21:08.326 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.326+0000 7fe6c9c31780 1 < canceled multipart upload key=TE10GB1F35X4 upload=ZUXYMF5SZ5O6 tag=TA3LNEZM4Y43 type=write size=2578475 2024-09-22T08:21:08.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.329+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~3CM1D2JM1UCH.0 size=487081 2024-09-22T08:21:08.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.329+0000 7fe6c9c31780 1 > prepared multipart upload key=DC7VLQWZ3TD1 upload=3CM1D2JM1UCH tag=2QTNLDF44WWS type=write size=1535657 2024-09-22T08:21:08.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.330+0000 7fe6c9c31780 1 < completed part key=_multipart_1HZ0NAJPXNW1.2~XL61Q325BQDX.0 size=1048576 2024-09-22T08:21:08.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.331+0000 7fe6c9c31780 1 < completed part key=_multipart_1HZ0NAJPXNW1.2~XL61Q325BQDX.1 size=1048576 2024-09-22T08:21:08.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.333+0000 7fe6c9c31780 1 < completed part key=_multipart_1HZ0NAJPXNW1.2~XL61Q325BQDX.2 size=156285 2024-09-22T08:21:08.336 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.335+0000 7fe6c9c31780 1 < completed multipart upload key=1HZ0NAJPXNW1 upload=XL61Q325BQDX tag=MPWQUYI15HX0 type=write size=3302013 2024-09-22T08:21:08.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.337+0000 7fe6c9c31780 1 > prepared operation key=VP1MP4IC9A7T tag=B8RM2ZMXG8HA type=del size=1335165 2024-09-22T08:21:08.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.339+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~OCIG3QR09IUB.0 size=417904 2024-09-22T08:21:08.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.341+0000 7fe6c9c31780 1 < completed multipart upload key=76HZ3LZGVT9J upload=OCIG3QR09IUB tag=C7D9U31Y160R type=write size=1466480 2024-09-22T08:21:08.343 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.342+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=3VK2MAJLY4GS type=del size=2625959 2024-09-22T08:21:08.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.344+0000 7fe6c9c31780 1 < completed part key=_multipart_TJTB67QBLZH5.2~VIZYQXF1Z244.0 size=1048576 2024-09-22T08:21:08.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.344+0000 7fe6c9c31780 1 < canceled part key=_multipart_TJTB67QBLZH5.2~VIZYQXF1Z244.1 size=1048576 2024-09-22T08:21:08.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.344+0000 7fe6c9c31780 1 < canceled part key=_multipart_TJTB67QBLZH5.2~VIZYQXF1Z244.2 size=22566 2024-09-22T08:21:08.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.346+0000 7fe6c9c31780 1 < canceled multipart upload key=TJTB67QBLZH5 upload=VIZYQXF1Z244 tag=6H3ZHMQIT610 type=write size=3168294 2024-09-22T08:21:08.348 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.348+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=EOGKEVFP4WBZ type=del size=875065 2024-09-22T08:21:08.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.349+0000 7fe6c9c31780 1 < completed part key=_multipart_TJTB67QBLZH5.2~MK39M1JFLD0L.0 size=1048576 2024-09-22T08:21:08.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.350+0000 7fe6c9c31780 1 < completed part key=_multipart_TJTB67QBLZH5.2~MK39M1JFLD0L.1 size=108176 2024-09-22T08:21:08.353 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.353+0000 7fe6c9c31780 1 < completed multipart upload key=TJTB67QBLZH5 upload=MK39M1JFLD0L tag=89L672DZTMWS type=write size=2205328 2024-09-22T08:21:08.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.355+0000 7fe6c9c31780 1 > prepared operation key=D85LJGGU3Z6F tag=H3VDF31VQ447 type=del size=1166277 2024-09-22T08:21:08.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.356+0000 7fe6c9c31780 1 < completed part key=_multipart_DC7VLQWZ3TD1.2~1X059RMBJ5MA.0 size=698729 2024-09-22T08:21:08.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.358+0000 7fe6c9c31780 1 < completed multipart upload key=DC7VLQWZ3TD1 upload=1X059RMBJ5MA tag=A7EJMT02D4UO type=write size=1747305 2024-09-22T08:21:08.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.360+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~753MTQMW47BJ.0 size=311433 2024-09-22T08:21:08.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.361+0000 7fe6c9c31780 1 > prepared multipart upload key=OX1LY7URY7IV upload=753MTQMW47BJ tag=M75GSB93PM79 type=write size=1360009 2024-09-22T08:21:08.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.362+0000 7fe6c9c31780 1 < canceled operation key=1HZ0NAJPXNW1 tag=265857ND1GEM type=del size=707541 2024-09-22T08:21:08.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.365+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~YWTDIUKJSJK5.0 size=144594 2024-09-22T08:21:08.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.365+0000 7fe6c9c31780 1 > prepared multipart upload key=2B5QRUMTVE7U upload=YWTDIUKJSJK5 tag=UDFS27JYB4CT type=write size=1193170 2024-09-22T08:21:08.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.366+0000 7fe6c9c31780 1 < completed delete operation key=R7UWMW913DJQ tag=76Q72H5BR9K2 type=del 2024-09-22T08:21:08.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.367+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=CB1CXMOOD5NR type=del size=1049384 2024-09-22T08:21:08.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.369+0000 7fe6c9c31780 1 < completed delete operation key=TJTB67QBLZH5 tag=803BN0X1V6F5 type=del 2024-09-22T08:21:08.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.371+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=XLU8LSA1O2VD type=del size=3897174 2024-09-22T08:21:08.372 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.372+0000 7fe6c9c31780 1 < completed part key=_multipart_6BKB91YV3FMW.2~1ZAS3JONTXWO.0 size=1048576 2024-09-22T08:21:08.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.373+0000 7fe6c9c31780 1 < completed part key=_multipart_6BKB91YV3FMW.2~1ZAS3JONTXWO.1 size=386361 2024-09-22T08:21:08.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.375+0000 7fe6c9c31780 1 < completed multipart upload key=6BKB91YV3FMW upload=1ZAS3JONTXWO tag=BW9ZERPZKRFE type=write size=2483513 2024-09-22T08:21:08.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.377+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=LM2GTF834YMZ type=del size=2552308 2024-09-22T08:21:08.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.378+0000 7fe6c9c31780 1 < completed part key=_multipart_6BKB91YV3FMW.2~CG25WO28D2VI.0 size=1048576 2024-09-22T08:21:08.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.380+0000 7fe6c9c31780 1 < completed part key=_multipart_6BKB91YV3FMW.2~CG25WO28D2VI.1 size=1048576 2024-09-22T08:21:08.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.381+0000 7fe6c9c31780 1 < completed part key=_multipart_6BKB91YV3FMW.2~CG25WO28D2VI.2 size=506098 2024-09-22T08:21:08.384 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.384+0000 7fe6c9c31780 1 < completed multipart upload key=6BKB91YV3FMW upload=CG25WO28D2VI tag=U5O9H2F40LOO type=write size=3651826 2024-09-22T08:21:08.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.385+0000 7fe6c9c31780 1 > prepared operation key=Z1CK5EDBK4AW tag=F6Q5AJL05SOH type=del size=4042512 2024-09-22T08:21:08.387 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.387+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~1K2LCZ6J2SVS.0 size=1048576 2024-09-22T08:21:08.387 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.387+0000 7fe6c9c31780 1 < canceled part key=_multipart_946H8F2AUPO2.2~1K2LCZ6J2SVS.1 size=1048576 2024-09-22T08:21:08.388 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.388+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~1K2LCZ6J2SVS.2 size=403962 2024-09-22T08:21:08.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.390+0000 7fe6c9c31780 1 < canceled multipart upload key=946H8F2AUPO2 upload=1K2LCZ6J2SVS tag=A22UMTE7SKYP type=write size=3549690 2024-09-22T08:21:08.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.392+0000 7fe6c9c31780 1 > prepared operation key=LA6ZRVULGQ0H tag=XXJUTC389E3Z type=del size=1455092 2024-09-22T08:21:08.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.393+0000 7fe6c9c31780 1 < completed part key=_multipart_Z1CK5EDBK4AW.2~EMY2BUYDSKHG.0 size=980285 2024-09-22T08:21:08.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.397+0000 7fe6c9c31780 1 < completed multipart upload key=Z1CK5EDBK4AW upload=EMY2BUYDSKHG tag=OOR4F84F85WH type=write size=2028861 2024-09-22T08:21:08.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.397+0000 7fe6c9c31780 1 > prepared operation key=JT5AB8VLMEFD tag=LGM5KBA131ZX type=del size=3840336 2024-09-22T08:21:08.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.399+0000 7fe6c9c31780 1 < completed part key=_multipart_ILW34WLX48WN.2~UNB8QQV9HI2P.0 size=1048576 2024-09-22T08:21:08.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.400+0000 7fe6c9c31780 1 < completed part key=_multipart_ILW34WLX48WN.2~UNB8QQV9HI2P.1 size=1048576 2024-09-22T08:21:08.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.401+0000 7fe6c9c31780 1 < completed part key=_multipart_ILW34WLX48WN.2~UNB8QQV9HI2P.2 size=527904 2024-09-22T08:21:08.404 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.404+0000 7fe6c9c31780 1 < completed multipart upload key=ILW34WLX48WN upload=UNB8QQV9HI2P tag=3UJ4W38G352C type=write size=3673632 2024-09-22T08:21:08.407 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.407+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~B8WD4UEEXRGZ.0 size=1048576 2024-09-22T08:21:08.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.408+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~B8WD4UEEXRGZ.1 size=1048576 2024-09-22T08:21:08.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.409+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~B8WD4UEEXRGZ.2 size=351487 2024-09-22T08:21:08.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.409+0000 7fe6c9c31780 1 > prepared multipart upload key=LA6ZRVULGQ0H upload=B8WD4UEEXRGZ tag=RZTBV3VXYC07 type=write size=3497215 2024-09-22T08:21:08.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.411+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~RJNYXOCP5D4Q.0 size=150909 2024-09-22T08:21:08.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.413+0000 7fe6c9c31780 1 < completed multipart upload key=XJP26CCPYDI7 upload=RJNYXOCP5D4Q tag=3YKEUYJB7YVD type=write size=1199485 2024-09-22T08:21:08.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.414+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=1QOA420T5I78 type=del size=924240 2024-09-22T08:21:08.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.417+0000 7fe6c9c31780 1 < suggested remove operation key=GEWQUFB9K35E tag=P48D4UGKCCZ1 type=del 2024-09-22T08:21:08.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.418+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=A2XM1ANQCWND type=del size=1093591 2024-09-22T08:21:08.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.421+0000 7fe6c9c31780 1 < completed part key=_multipart_DC7VLQWZ3TD1.2~3CM1D2JM1UCH.0 size=487081 2024-09-22T08:21:08.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.423+0000 7fe6c9c31780 1 < completed multipart upload key=DC7VLQWZ3TD1 upload=3CM1D2JM1UCH tag=2QTNLDF44WWS type=write size=1535657 2024-09-22T08:21:08.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.425+0000 7fe6c9c31780 1 > prepared part key=_multipart_ZFL9N44PBQX4.2~Q1ZFF18ASEGW.0 size=1048576 2024-09-22T08:21:08.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.426+0000 7fe6c9c31780 1 > prepared part key=_multipart_ZFL9N44PBQX4.2~Q1ZFF18ASEGW.1 size=370418 2024-09-22T08:21:08.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.427+0000 7fe6c9c31780 1 > prepared multipart upload key=ZFL9N44PBQX4 upload=Q1ZFF18ASEGW tag=TXX5CQS8YYZA type=write size=2467570 2024-09-22T08:21:08.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.428+0000 7fe6c9c31780 1 < completed delete operation key=VP1MP4IC9A7T tag=B8RM2ZMXG8HA type=del 2024-09-22T08:21:08.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.429+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=KIKW3KVWCIJK type=del size=872312 2024-09-22T08:21:08.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.431+0000 7fe6c9c31780 1 < completed delete operation key=CTK01Y0CV1NC tag=3VK2MAJLY4GS type=del 2024-09-22T08:21:08.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.434+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~T5K01LBHO04E.0 size=1048576 2024-09-22T08:21:08.435 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.435+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~T5K01LBHO04E.1 size=1048576 2024-09-22T08:21:08.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.436+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~T5K01LBHO04E.2 size=424307 2024-09-22T08:21:08.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.436+0000 7fe6c9c31780 1 > prepared multipart upload key=2B5QRUMTVE7U upload=T5K01LBHO04E tag=5UT2RVSIY3HV type=write size=3570035 2024-09-22T08:21:08.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.437+0000 7fe6c9c31780 1 < completed delete operation key=946H8F2AUPO2 tag=EOGKEVFP4WBZ type=del 2024-09-22T08:21:08.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.440+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~J05H7HDZ0D2K.0 size=1048576 2024-09-22T08:21:08.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.441+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~J05H7HDZ0D2K.1 size=1048576 2024-09-22T08:21:08.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.444+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~J05H7HDZ0D2K.2 size=587111 2024-09-22T08:21:08.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.444+0000 7fe6c9c31780 1 > prepared multipart upload key=GEWQUFB9K35E upload=J05H7HDZ0D2K tag=MVC1CSGIEFUA type=write size=3732839 2024-09-22T08:21:08.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.444+0000 7fe6c9c31780 1 < completed delete operation key=D85LJGGU3Z6F tag=H3VDF31VQ447 type=del 2024-09-22T08:21:08.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.447+0000 7fe6c9c31780 1 > prepared operation key=OX1LY7URY7IV tag=BZC7YMZD2J1O type=del size=3809648 2024-09-22T08:21:08.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.447+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~753MTQMW47BJ.0 size=311433 2024-09-22T08:21:08.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.450+0000 7fe6c9c31780 1 < completed multipart upload key=OX1LY7URY7IV upload=753MTQMW47BJ tag=M75GSB93PM79 type=write size=1360009 2024-09-22T08:21:08.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.452+0000 7fe6c9c31780 1 > prepared operation key=ZFL9N44PBQX4 tag=9XJFV8IPKDIY type=del size=3363391 2024-09-22T08:21:08.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.453+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~YWTDIUKJSJK5.0 size=144594 2024-09-22T08:21:08.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.456+0000 7fe6c9c31780 1 < completed multipart upload key=2B5QRUMTVE7U upload=YWTDIUKJSJK5 tag=UDFS27JYB4CT type=write size=1193170 2024-09-22T08:21:08.458 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.458+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=0845F1NY9XJ3 type=del size=2257504 2024-09-22T08:21:08.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.458+0000 7fe6c9c31780 1 < completed delete operation key=946H8F2AUPO2 tag=CB1CXMOOD5NR type=del 2024-09-22T08:21:08.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.462+0000 7fe6c9c31780 1 > prepared part key=_multipart_R7UWMW913DJQ.2~PFGNBDQZIMFV.0 size=1048576 2024-09-22T08:21:08.463 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.462+0000 7fe6c9c31780 1 > prepared part key=_multipart_R7UWMW913DJQ.2~PFGNBDQZIMFV.1 size=1048576 2024-09-22T08:21:08.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.464+0000 7fe6c9c31780 1 > prepared part key=_multipart_R7UWMW913DJQ.2~PFGNBDQZIMFV.2 size=346000 2024-09-22T08:21:08.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.464+0000 7fe6c9c31780 1 > prepared multipart upload key=R7UWMW913DJQ upload=PFGNBDQZIMFV tag=MBY98WMHMMW9 type=write size=3491728 2024-09-22T08:21:08.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.465+0000 7fe6c9c31780 1 < completed delete operation key=76HZ3LZGVT9J tag=XLU8LSA1O2VD type=del 2024-09-22T08:21:08.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.467+0000 7fe6c9c31780 1 > prepared operation key=OX1LY7URY7IV tag=D9RIHLXBJGTU type=del size=2476749 2024-09-22T08:21:08.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.470+0000 7fe6c9c31780 1 < suggested update operation key=TE10GB1F35X4 tag=LM2GTF834YMZ type=del size=2552308 2024-09-22T08:21:08.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.471+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=0DL2PG2EMJS4 type=del size=142778 2024-09-22T08:21:08.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.473+0000 7fe6c9c31780 1 < canceled operation key=Z1CK5EDBK4AW tag=F6Q5AJL05SOH type=del size=4042512 2024-09-22T08:21:08.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.474+0000 7fe6c9c31780 1 > prepared operation key=O1UBUQXP50CN tag=3HCI35LLO1NR type=del size=2333671 2024-09-22T08:21:08.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.476+0000 7fe6c9c31780 1 < completed delete operation key=LA6ZRVULGQ0H tag=XXJUTC389E3Z type=del 2024-09-22T08:21:08.478 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.477+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=K6PL0L389ASA type=write size=1012435 2024-09-22T08:21:08.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.479+0000 7fe6c9c31780 1 < canceled operation key=JT5AB8VLMEFD tag=LGM5KBA131ZX type=del size=3840336 2024-09-22T08:21:08.481 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.480+0000 7fe6c9c31780 1 > prepared operation key=Z1CK5EDBK4AW tag=00E6VEOKSYRL type=del size=273202 2024-09-22T08:21:08.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.482+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~B8WD4UEEXRGZ.0 size=1048576 2024-09-22T08:21:08.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.483+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~B8WD4UEEXRGZ.1 size=1048576 2024-09-22T08:21:08.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.483+0000 7fe6c9c31780 1 < canceled part key=_multipart_LA6ZRVULGQ0H.2~B8WD4UEEXRGZ.2 size=351487 2024-09-22T08:21:08.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.485+0000 7fe6c9c31780 1 < canceled multipart upload key=LA6ZRVULGQ0H upload=B8WD4UEEXRGZ tag=RZTBV3VXYC07 type=write size=3497215 2024-09-22T08:21:08.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.488+0000 7fe6c9c31780 1 > prepared part key=_multipart_W9L87PTJEIOA.2~T2GTTN408GOD.0 size=1048576 2024-09-22T08:21:08.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.489+0000 7fe6c9c31780 1 > prepared part key=_multipart_W9L87PTJEIOA.2~T2GTTN408GOD.1 size=1048576 2024-09-22T08:21:08.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.490+0000 7fe6c9c31780 1 > prepared part key=_multipart_W9L87PTJEIOA.2~T2GTTN408GOD.2 size=769252 2024-09-22T08:21:08.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.490+0000 7fe6c9c31780 1 > prepared multipart upload key=W9L87PTJEIOA upload=T2GTTN408GOD tag=9UGJ5O48KEGS type=write size=3914980 2024-09-22T08:21:08.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.492+0000 7fe6c9c31780 1 < canceled operation key=7446WN19QFV0 tag=1QOA420T5I78 type=del size=924240 2024-09-22T08:21:08.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.493+0000 7fe6c9c31780 1 > prepared operation key=KZIY400KQ5NH tag=BRTLT91ZZKPE type=del size=3061966 2024-09-22T08:21:08.495 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.494+0000 7fe6c9c31780 1 < completed delete operation key=2B5QRUMTVE7U tag=A2XM1ANQCWND type=del 2024-09-22T08:21:08.497 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.496+0000 7fe6c9c31780 1 > prepared operation key=ZFL9N44PBQX4 tag=KZ6XI2N27TZZ type=del size=2317639 2024-09-22T08:21:08.498 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.497+0000 7fe6c9c31780 1 < completed part key=_multipart_ZFL9N44PBQX4.2~Q1ZFF18ASEGW.0 size=1048576 2024-09-22T08:21:08.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.499+0000 7fe6c9c31780 1 < completed part key=_multipart_ZFL9N44PBQX4.2~Q1ZFF18ASEGW.1 size=370418 2024-09-22T08:21:08.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.501+0000 7fe6c9c31780 1 < completed multipart upload key=ZFL9N44PBQX4 upload=Q1ZFF18ASEGW tag=TXX5CQS8YYZA type=write size=2467570 2024-09-22T08:21:08.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.503+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=RLTNWBA3HFZH type=del size=3972277 2024-09-22T08:21:08.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.506+0000 7fe6c9c31780 1 < suggested remove operation key=T2W6RXP9UGHH tag=KIKW3KVWCIJK type=del 2024-09-22T08:21:08.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.507+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=02ZNTE80KOUH type=del size=2559283 2024-09-22T08:21:08.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.508+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~T5K01LBHO04E.0 size=1048576 2024-09-22T08:21:08.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.510+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~T5K01LBHO04E.1 size=1048576 2024-09-22T08:21:08.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.511+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~T5K01LBHO04E.2 size=424307 2024-09-22T08:21:08.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.514+0000 7fe6c9c31780 1 < completed multipart upload key=2B5QRUMTVE7U upload=T5K01LBHO04E tag=5UT2RVSIY3HV type=write size=3570035 2024-09-22T08:21:08.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.515+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=CPUOKAXVHX8C type=del size=691279 2024-09-22T08:21:08.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.516+0000 7fe6c9c31780 1 < completed part key=_multipart_GEWQUFB9K35E.2~J05H7HDZ0D2K.0 size=1048576 2024-09-22T08:21:08.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.517+0000 7fe6c9c31780 1 < completed part key=_multipart_GEWQUFB9K35E.2~J05H7HDZ0D2K.1 size=1048576 2024-09-22T08:21:08.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.518+0000 7fe6c9c31780 1 < completed part key=_multipart_GEWQUFB9K35E.2~J05H7HDZ0D2K.2 size=587111 2024-09-22T08:21:08.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.521+0000 7fe6c9c31780 1 < completed multipart upload key=GEWQUFB9K35E upload=J05H7HDZ0D2K tag=MVC1CSGIEFUA type=write size=3732839 2024-09-22T08:21:08.524 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.524+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~K65KUK2KBHN6.0 size=1048576 2024-09-22T08:21:08.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.525+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~K65KUK2KBHN6.1 size=329040 2024-09-22T08:21:08.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.525+0000 7fe6c9c31780 1 > prepared multipart upload key=7446WN19QFV0 upload=K65KUK2KBHN6 tag=NE6W229GIPVH type=write size=2426192 2024-09-22T08:21:08.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.527+0000 7fe6c9c31780 1 < canceled operation key=OX1LY7URY7IV tag=BZC7YMZD2J1O type=del size=3809648 2024-09-22T08:21:08.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.528+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=UQ0252BREKJY type=del size=2519650 2024-09-22T08:21:08.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.530+0000 7fe6c9c31780 1 < completed delete operation key=ZFL9N44PBQX4 tag=9XJFV8IPKDIY type=del 2024-09-22T08:21:08.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.533+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~R34GDJ4PCTXO.0 size=1048576 2024-09-22T08:21:08.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.534+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~R34GDJ4PCTXO.1 size=1048576 2024-09-22T08:21:08.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.536+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~R34GDJ4PCTXO.2 size=813976 2024-09-22T08:21:08.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.536+0000 7fe6c9c31780 1 > prepared multipart upload key=946H8F2AUPO2 upload=R34GDJ4PCTXO tag=REWSUVJBDEHK type=write size=3959704 2024-09-22T08:21:08.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.537+0000 7fe6c9c31780 1 < completed delete operation key=6BKB91YV3FMW tag=0845F1NY9XJ3 type=del 2024-09-22T08:21:08.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.538+0000 7fe6c9c31780 1 > prepared operation key=9FCSIF1WKBDJ tag=RH820S2NFFYX type=del size=3920734 2024-09-22T08:21:08.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.539+0000 7fe6c9c31780 1 < canceled part key=_multipart_R7UWMW913DJQ.2~PFGNBDQZIMFV.0 size=1048576 2024-09-22T08:21:08.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.540+0000 7fe6c9c31780 1 < completed part key=_multipart_R7UWMW913DJQ.2~PFGNBDQZIMFV.1 size=1048576 2024-09-22T08:21:08.542 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.541+0000 7fe6c9c31780 1 < completed part key=_multipart_R7UWMW913DJQ.2~PFGNBDQZIMFV.2 size=346000 2024-09-22T08:21:08.545 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.544+0000 7fe6c9c31780 1 < canceled multipart upload key=R7UWMW913DJQ upload=PFGNBDQZIMFV tag=MBY98WMHMMW9 type=write size=3491728 2024-09-22T08:21:08.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.547+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~3PNGVV3ZMWW7.0 size=1048576 2024-09-22T08:21:08.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.548+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~3PNGVV3ZMWW7.1 size=877923 2024-09-22T08:21:08.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.548+0000 7fe6c9c31780 1 > prepared multipart upload key=O1UBUQXP50CN upload=3PNGVV3ZMWW7 tag=CSVARPT5V565 type=write size=2975075 2024-09-22T08:21:08.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.551+0000 7fe6c9c31780 1 < suggested update operation key=OX1LY7URY7IV tag=D9RIHLXBJGTU type=del size=2476749 2024-09-22T08:21:08.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.554+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~Z6Z59EZ34JU8.0 size=1048576 2024-09-22T08:21:08.555 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.555+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~Z6Z59EZ34JU8.1 size=1048576 2024-09-22T08:21:08.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.557+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~Z6Z59EZ34JU8.2 size=224927 2024-09-22T08:21:08.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.557+0000 7fe6c9c31780 1 > prepared multipart upload key=0TWY0NNZZ7NN upload=Z6Z59EZ34JU8 tag=0U6RYDBT5R68 type=write size=3370655 2024-09-22T08:21:08.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.560+0000 7fe6c9c31780 1 < suggested update operation key=0TWY0NNZZ7NN tag=0DL2PG2EMJS4 type=del size=142778 2024-09-22T08:21:08.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.561+0000 7fe6c9c31780 1 > prepared operation key=VP1MP4IC9A7T tag=I071EZGJI1V8 type=del size=3125460 2024-09-22T08:21:08.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.562+0000 7fe6c9c31780 1 < completed delete operation key=O1UBUQXP50CN tag=3HCI35LLO1NR type=del 2024-09-22T08:21:08.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.564+0000 7fe6c9c31780 1 > prepared operation key=9FCSIF1WKBDJ tag=FBTC9NAH0YZ8 type=del size=3061968 2024-09-22T08:21:08.566 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.565+0000 7fe6c9c31780 -1 < failed to complete operation key=0TWY0NNZZ7NN tag=K6PL0L389ASA type=write size=1012435: (22) Invalid argument 2024-09-22T08:21:08.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.567+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=8E1NQ31DW6D8 type=write size=499767 2024-09-22T08:21:08.569 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.569+0000 7fe6c9c31780 1 < completed delete operation key=Z1CK5EDBK4AW tag=00E6VEOKSYRL type=del 2024-09-22T08:21:08.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.572+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~MWPL8N1R63HD.0 size=1048576 2024-09-22T08:21:08.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.573+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~MWPL8N1R63HD.1 size=1048576 2024-09-22T08:21:08.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.574+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~MWPL8N1R63HD.2 size=52002 2024-09-22T08:21:08.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.574+0000 7fe6c9c31780 1 > prepared multipart upload key=0PNK2ZW6IJM1 upload=MWPL8N1R63HD tag=CVQGNU79O9PH type=write size=3197730 2024-09-22T08:21:08.576 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.575+0000 7fe6c9c31780 1 < completed part key=_multipart_W9L87PTJEIOA.2~T2GTTN408GOD.0 size=1048576 2024-09-22T08:21:08.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.577+0000 7fe6c9c31780 1 < completed part key=_multipart_W9L87PTJEIOA.2~T2GTTN408GOD.1 size=1048576 2024-09-22T08:21:08.578 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.578+0000 7fe6c9c31780 1 < completed part key=_multipart_W9L87PTJEIOA.2~T2GTTN408GOD.2 size=769252 2024-09-22T08:21:08.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.580+0000 7fe6c9c31780 1 < completed multipart upload key=W9L87PTJEIOA upload=T2GTTN408GOD tag=9UGJ5O48KEGS type=write size=3914980 2024-09-22T08:21:08.585 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.584+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~C391OCALKEGN.0 size=1048576 2024-09-22T08:21:08.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.585+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~C391OCALKEGN.1 size=1048576 2024-09-22T08:21:08.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.587+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~C391OCALKEGN.2 size=702322 2024-09-22T08:21:08.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.587+0000 7fe6c9c31780 1 > prepared multipart upload key=TE10GB1F35X4 upload=C391OCALKEGN tag=XWEGFSPFF7HF type=write size=3848050 2024-09-22T08:21:08.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.589+0000 7fe6c9c31780 1 < completed delete operation key=KZIY400KQ5NH tag=BRTLT91ZZKPE type=del 2024-09-22T08:21:08.590 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.589+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=I0MNIYAED2K7 type=del size=1876177 2024-09-22T08:21:08.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.591+0000 7fe6c9c31780 1 < completed delete operation key=ZFL9N44PBQX4 tag=KZ6XI2N27TZZ type=del 2024-09-22T08:21:08.593 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.592+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=5XZZGOAO6F7P type=del size=2323343 2024-09-22T08:21:08.595 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.594+0000 7fe6c9c31780 1 < completed delete operation key=R7UWMW913DJQ tag=RLTNWBA3HFZH type=del 2024-09-22T08:21:08.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.597+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~4O4Q227I4FT9.0 size=1048576 2024-09-22T08:21:08.599 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.598+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~4O4Q227I4FT9.1 size=1048576 2024-09-22T08:21:08.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.599+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~4O4Q227I4FT9.2 size=1008928 2024-09-22T08:21:08.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.599+0000 7fe6c9c31780 1 > prepared multipart upload key=ILW34WLX48WN upload=4O4Q227I4FT9 tag=D4XUDNB3TVC2 type=write size=4154656 2024-09-22T08:21:08.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.600+0000 7fe6c9c31780 1 < completed delete operation key=T2W6RXP9UGHH tag=02ZNTE80KOUH type=del 2024-09-22T08:21:08.603 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.603+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~3EHRYIJLOZWW.0 size=475599 2024-09-22T08:21:08.603 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.603+0000 7fe6c9c31780 1 > prepared multipart upload key=76HZ3LZGVT9J upload=3EHRYIJLOZWW tag=8MO7AJ0T3A6U type=write size=1524175 2024-09-22T08:21:08.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.604+0000 7fe6c9c31780 1 < completed delete operation key=TE10GB1F35X4 tag=CPUOKAXVHX8C type=del 2024-09-22T08:21:08.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.606+0000 7fe6c9c31780 1 > prepared operation key=0PNK2ZW6IJM1 tag=JCCLCNGO59CR type=del size=2100534 2024-09-22T08:21:08.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.608+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~K65KUK2KBHN6.0 size=1048576 2024-09-22T08:21:08.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.609+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~K65KUK2KBHN6.1 size=329040 2024-09-22T08:21:08.611 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.611+0000 7fe6c9c31780 1 < completed multipart upload key=7446WN19QFV0 upload=K65KUK2KBHN6 tag=NE6W229GIPVH type=write size=2426192 2024-09-22T08:21:08.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.613+0000 7fe6c9c31780 1 > prepared part key=_multipart_9AZWQ9E58QS6.2~8CD1DAH94VU4.0 size=105681 2024-09-22T08:21:08.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.613+0000 7fe6c9c31780 1 > prepared multipart upload key=9AZWQ9E58QS6 upload=8CD1DAH94VU4 tag=74OX067OO1ZI type=write size=1154257 2024-09-22T08:21:08.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.617+0000 7fe6c9c31780 1 < suggested update operation key=946H8F2AUPO2 tag=UQ0252BREKJY type=del size=2519650 2024-09-22T08:21:08.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.619+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=RBQ5KQQ02ZZ3 type=del size=3419371 2024-09-22T08:21:08.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.619+0000 7fe6c9c31780 1 < canceled part key=_multipart_946H8F2AUPO2.2~R34GDJ4PCTXO.0 size=1048576 2024-09-22T08:21:08.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.620+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~R34GDJ4PCTXO.1 size=1048576 2024-09-22T08:21:08.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.620+0000 7fe6c9c31780 1 < canceled part key=_multipart_946H8F2AUPO2.2~R34GDJ4PCTXO.2 size=813976 2024-09-22T08:21:08.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.622+0000 7fe6c9c31780 1 < canceled multipart upload key=946H8F2AUPO2 upload=R34GDJ4PCTXO tag=REWSUVJBDEHK type=write size=3959704 2024-09-22T08:21:08.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.624+0000 7fe6c9c31780 1 > prepared operation key=VP1MP4IC9A7T tag=HWHNH3E3BN3V type=del size=4019518 2024-09-22T08:21:08.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.627+0000 7fe6c9c31780 1 < suggested update operation key=9FCSIF1WKBDJ tag=RH820S2NFFYX type=del size=3920734 2024-09-22T08:21:08.630 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.629+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~44V4WL4IA0KA.0 size=209205 2024-09-22T08:21:08.630 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.629+0000 7fe6c9c31780 1 > prepared multipart upload key=CTK01Y0CV1NC upload=44V4WL4IA0KA tag=I1QBMDK084AU type=write size=1257781 2024-09-22T08:21:08.631 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.631+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~3PNGVV3ZMWW7.0 size=1048576 2024-09-22T08:21:08.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.632+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~3PNGVV3ZMWW7.1 size=877923 2024-09-22T08:21:08.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.634+0000 7fe6c9c31780 1 < completed multipart upload key=O1UBUQXP50CN upload=3PNGVV3ZMWW7 tag=CSVARPT5V565 type=write size=2975075 2024-09-22T08:21:08.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.636+0000 7fe6c9c31780 1 > prepared operation key=TJTB67QBLZH5 tag=R9FLCX2R427O type=del size=2130673 2024-09-22T08:21:08.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.637+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~Z6Z59EZ34JU8.0 size=1048576 2024-09-22T08:21:08.639 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.638+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~Z6Z59EZ34JU8.1 size=1048576 2024-09-22T08:21:08.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.639+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~Z6Z59EZ34JU8.2 size=224927 2024-09-22T08:21:08.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.642+0000 7fe6c9c31780 1 < completed multipart upload key=0TWY0NNZZ7NN upload=Z6Z59EZ34JU8 tag=0U6RYDBT5R68 type=write size=3370655 2024-09-22T08:21:08.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.644+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~AX90KFLGX2A2.0 size=91232 2024-09-22T08:21:08.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.644+0000 7fe6c9c31780 1 > prepared multipart upload key=JT5AB8VLMEFD upload=AX90KFLGX2A2 tag=7IUFSQ0ZLN3G type=write size=1139808 2024-09-22T08:21:08.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.646+0000 7fe6c9c31780 1 < completed delete operation key=VP1MP4IC9A7T tag=I071EZGJI1V8 type=del 2024-09-22T08:21:08.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.647+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=A0GUI6EG7EU1 type=del size=633009 2024-09-22T08:21:08.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.649+0000 7fe6c9c31780 -1 < failed to complete operation key=9FCSIF1WKBDJ tag=FBTC9NAH0YZ8 type=del size=3061968: (22) Invalid argument 2024-09-22T08:21:08.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.651+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~W6GT0BX6M01Q.0 size=1048576 2024-09-22T08:21:08.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.652+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~W6GT0BX6M01Q.1 size=267548 2024-09-22T08:21:08.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.652+0000 7fe6c9c31780 1 > prepared multipart upload key=FY40JTHLT0KU upload=W6GT0BX6M01Q tag=P1WQKN6JDCXV type=write size=2364700 2024-09-22T08:21:08.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.654+0000 7fe6c9c31780 1 < canceled operation key=R7UWMW913DJQ tag=8E1NQ31DW6D8 type=write size=499767 2024-09-22T08:21:08.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.655+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=OM8ON8923MZX type=write size=420680 2024-09-22T08:21:08.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.656+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~MWPL8N1R63HD.0 size=1048576 2024-09-22T08:21:08.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.658+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~MWPL8N1R63HD.1 size=1048576 2024-09-22T08:21:08.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.659+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~MWPL8N1R63HD.2 size=52002 2024-09-22T08:21:08.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.661+0000 7fe6c9c31780 1 < completed multipart upload key=0PNK2ZW6IJM1 upload=MWPL8N1R63HD tag=CVQGNU79O9PH type=write size=3197730 2024-09-22T08:21:08.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.663+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=9LZJMK2VMD9N type=write size=938893 2024-09-22T08:21:08.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.664+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~C391OCALKEGN.0 size=1048576 2024-09-22T08:21:08.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.665+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~C391OCALKEGN.1 size=1048576 2024-09-22T08:21:08.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.667+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~C391OCALKEGN.2 size=702322 2024-09-22T08:21:08.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.669+0000 7fe6c9c31780 1 < completed multipart upload key=TE10GB1F35X4 upload=C391OCALKEGN tag=XWEGFSPFF7HF type=write size=3848050 2024-09-22T08:21:08.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.671+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~CE1JX5VRL06T.0 size=1048576 2024-09-22T08:21:08.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.673+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~CE1JX5VRL06T.1 size=1048576 2024-09-22T08:21:08.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.674+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~CE1JX5VRL06T.2 size=144608 2024-09-22T08:21:08.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.674+0000 7fe6c9c31780 1 > prepared multipart upload key=2B5QRUMTVE7U upload=CE1JX5VRL06T tag=G4UJJVHM741T type=write size=3290336 2024-09-22T08:21:08.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.675+0000 7fe6c9c31780 1 < completed delete operation key=ILW34WLX48WN tag=I0MNIYAED2K7 type=del 2024-09-22T08:21:08.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.678+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~WKW66NKOSYWB.0 size=1048576 2024-09-22T08:21:08.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.679+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~WKW66NKOSYWB.1 size=1048576 2024-09-22T08:21:08.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.680+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~WKW66NKOSYWB.2 size=95543 2024-09-22T08:21:08.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.680+0000 7fe6c9c31780 1 > prepared multipart upload key=GEWQUFB9K35E upload=WKW66NKOSYWB tag=YWVBN2CC011I type=write size=3241271 2024-09-22T08:21:08.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.682+0000 7fe6c9c31780 1 < completed delete operation key=0TWY0NNZZ7NN tag=5XZZGOAO6F7P type=del 2024-09-22T08:21:08.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.684+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~9OUCTRICZA0A.0 size=440345 2024-09-22T08:21:08.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.684+0000 7fe6c9c31780 1 > prepared multipart upload key=0TWY0NNZZ7NN upload=9OUCTRICZA0A tag=O070J283DUCW type=write size=1488921 2024-09-22T08:21:08.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.686+0000 7fe6c9c31780 1 < completed part key=_multipart_ILW34WLX48WN.2~4O4Q227I4FT9.0 size=1048576 2024-09-22T08:21:08.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.686+0000 7fe6c9c31780 1 < canceled part key=_multipart_ILW34WLX48WN.2~4O4Q227I4FT9.1 size=1048576 2024-09-22T08:21:08.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.687+0000 7fe6c9c31780 1 < completed part key=_multipart_ILW34WLX48WN.2~4O4Q227I4FT9.2 size=1008928 2024-09-22T08:21:08.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.689+0000 7fe6c9c31780 1 < canceled multipart upload key=ILW34WLX48WN upload=4O4Q227I4FT9 tag=D4XUDNB3TVC2 type=write size=4154656 2024-09-22T08:21:08.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.692+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~VZU9TITS1G4Q.0 size=1048576 2024-09-22T08:21:08.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.693+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~VZU9TITS1G4Q.1 size=227879 2024-09-22T08:21:08.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.693+0000 7fe6c9c31780 1 > prepared multipart upload key=ILW34WLX48WN upload=VZU9TITS1G4Q tag=LF7R9P4OUN4Z type=write size=2325031 2024-09-22T08:21:08.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.694+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~3EHRYIJLOZWW.0 size=475599 2024-09-22T08:21:08.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.697+0000 7fe6c9c31780 1 < completed multipart upload key=76HZ3LZGVT9J upload=3EHRYIJLOZWW tag=8MO7AJ0T3A6U type=write size=1524175 2024-09-22T08:21:08.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.699+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~EQ91RZ9JI7BS.0 size=1048576 2024-09-22T08:21:08.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.700+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~EQ91RZ9JI7BS.1 size=296599 2024-09-22T08:21:08.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.700+0000 7fe6c9c31780 1 > prepared multipart upload key=OX1LY7URY7IV upload=EQ91RZ9JI7BS tag=54ZY2VAS6VW6 type=write size=2393751 2024-09-22T08:21:08.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.703+0000 7fe6c9c31780 1 < suggested remove operation key=0PNK2ZW6IJM1 tag=JCCLCNGO59CR type=del 2024-09-22T08:21:08.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.704+0000 7fe6c9c31780 1 > prepared operation key=ZFL9N44PBQX4 tag=AVB0DTTLT2OX type=del size=795085 2024-09-22T08:21:08.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.706+0000 7fe6c9c31780 1 < completed part key=_multipart_9AZWQ9E58QS6.2~8CD1DAH94VU4.0 size=105681 2024-09-22T08:21:08.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.708+0000 7fe6c9c31780 1 < completed multipart upload key=9AZWQ9E58QS6 upload=8CD1DAH94VU4 tag=74OX067OO1ZI type=write size=1154257 2024-09-22T08:21:08.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.711+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~M27K0EYTED8R.0 size=1048576 2024-09-22T08:21:08.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.711+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~M27K0EYTED8R.1 size=694977 2024-09-22T08:21:08.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.711+0000 7fe6c9c31780 1 > prepared multipart upload key=7446WN19QFV0 upload=M27K0EYTED8R tag=BC66AV4MZFYA type=write size=2792129 2024-09-22T08:21:08.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.715+0000 7fe6c9c31780 1 < completed delete operation key=6BKB91YV3FMW tag=RBQ5KQQ02ZZ3 type=del 2024-09-22T08:21:08.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.716+0000 7fe6c9c31780 1 > prepared operation key=JT5AB8VLMEFD tag=7NUDQD77CYW2 type=del size=1103053 2024-09-22T08:21:08.718 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.717+0000 7fe6c9c31780 1 < completed delete operation key=VP1MP4IC9A7T tag=HWHNH3E3BN3V type=del 2024-09-22T08:21:08.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.719+0000 7fe6c9c31780 1 > prepared operation key=TYVQ39KUV2V9 tag=B6SCYB1O1UC9 type=write size=656544 2024-09-22T08:21:08.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.720+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~44V4WL4IA0KA.0 size=209205 2024-09-22T08:21:08.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.723+0000 7fe6c9c31780 1 < completed multipart upload key=CTK01Y0CV1NC upload=44V4WL4IA0KA tag=I1QBMDK084AU type=write size=1257781 2024-09-22T08:21:08.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.724+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=L19XCUN41AXI type=del size=1411125 2024-09-22T08:21:08.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.725+0000 7fe6c9c31780 1 < completed delete operation key=TJTB67QBLZH5 tag=R9FLCX2R427O type=del 2024-09-22T08:21:08.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.727+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=C6J0O4S1AUL9 type=del size=3634104 2024-09-22T08:21:08.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.728+0000 7fe6c9c31780 1 < completed part key=_multipart_JT5AB8VLMEFD.2~AX90KFLGX2A2.0 size=91232 2024-09-22T08:21:08.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.730+0000 7fe6c9c31780 1 < completed multipart upload key=JT5AB8VLMEFD upload=AX90KFLGX2A2 tag=7IUFSQ0ZLN3G type=write size=1139808 2024-09-22T08:21:08.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.733+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~8Z9V3N3ZAQOY.0 size=1048576 2024-09-22T08:21:08.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.734+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~8Z9V3N3ZAQOY.1 size=1048576 2024-09-22T08:21:08.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.735+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~8Z9V3N3ZAQOY.2 size=81098 2024-09-22T08:21:08.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.735+0000 7fe6c9c31780 1 > prepared multipart upload key=7446WN19QFV0 upload=8Z9V3N3ZAQOY tag=FZH5GNF0XWZX type=write size=3226826 2024-09-22T08:21:08.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.736+0000 7fe6c9c31780 1 < completed delete operation key=R7UWMW913DJQ tag=A0GUI6EG7EU1 type=del 2024-09-22T08:21:08.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.738+0000 7fe6c9c31780 1 > prepared operation key=GEWQUFB9K35E tag=0VE0RGFQ8318 type=del size=2622879 2024-09-22T08:21:08.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.739+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~W6GT0BX6M01Q.0 size=1048576 2024-09-22T08:21:08.741 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.741+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~W6GT0BX6M01Q.1 size=267548 2024-09-22T08:21:08.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.743+0000 7fe6c9c31780 1 < completed multipart upload key=FY40JTHLT0KU upload=W6GT0BX6M01Q tag=P1WQKN6JDCXV type=write size=2364700 2024-09-22T08:21:08.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.745+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~Q1RS9HVIF11U.0 size=651291 2024-09-22T08:21:08.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.745+0000 7fe6c9c31780 1 > prepared multipart upload key=0PNK2ZW6IJM1 upload=Q1RS9HVIF11U tag=6O233V8EVOIR type=write size=1699867 2024-09-22T08:21:08.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.748+0000 7fe6c9c31780 1 < suggested remove operation key=76HZ3LZGVT9J tag=OM8ON8923MZX type=write 2024-09-22T08:21:08.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.749+0000 7fe6c9c31780 1 > prepared operation key=0PNK2ZW6IJM1 tag=Q1LX74GWTRYO type=del size=3193381 2024-09-22T08:21:08.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.752+0000 7fe6c9c31780 1 < suggested remove operation key=TE10GB1F35X4 tag=9LZJMK2VMD9N type=write 2024-09-22T08:21:08.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.754+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~HTK791GJVSRR.0 size=1048576 2024-09-22T08:21:08.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.755+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~HTK791GJVSRR.1 size=506643 2024-09-22T08:21:08.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.755+0000 7fe6c9c31780 1 > prepared multipart upload key=76HZ3LZGVT9J upload=HTK791GJVSRR tag=A5C5DSUBQUK2 type=write size=2603795 2024-09-22T08:21:08.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.757+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~CE1JX5VRL06T.0 size=1048576 2024-09-22T08:21:08.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.757+0000 7fe6c9c31780 1 < canceled part key=_multipart_2B5QRUMTVE7U.2~CE1JX5VRL06T.1 size=1048576 2024-09-22T08:21:08.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.758+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~CE1JX5VRL06T.2 size=144608 2024-09-22T08:21:08.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.760+0000 7fe6c9c31780 1 < canceled multipart upload key=2B5QRUMTVE7U upload=CE1JX5VRL06T tag=G4UJJVHM741T type=write size=3290336 2024-09-22T08:21:08.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.762+0000 7fe6c9c31780 1 > prepared operation key=GEWQUFB9K35E tag=VX5VV6WB5W69 type=del size=4166386 2024-09-22T08:21:08.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.763+0000 7fe6c9c31780 1 < completed part key=_multipart_GEWQUFB9K35E.2~WKW66NKOSYWB.0 size=1048576 2024-09-22T08:21:08.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.764+0000 7fe6c9c31780 1 < completed part key=_multipart_GEWQUFB9K35E.2~WKW66NKOSYWB.1 size=1048576 2024-09-22T08:21:08.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.765+0000 7fe6c9c31780 1 < completed part key=_multipart_GEWQUFB9K35E.2~WKW66NKOSYWB.2 size=95543 2024-09-22T08:21:08.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.768+0000 7fe6c9c31780 1 < completed multipart upload key=GEWQUFB9K35E upload=WKW66NKOSYWB tag=YWVBN2CC011I type=write size=3241271 2024-09-22T08:21:08.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.769+0000 7fe6c9c31780 1 > prepared operation key=OX1LY7URY7IV tag=3JCOS62C0YV2 type=del size=1624200 2024-09-22T08:21:08.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.770+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~9OUCTRICZA0A.0 size=440345 2024-09-22T08:21:08.774 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.773+0000 7fe6c9c31780 1 < completed multipart upload key=0TWY0NNZZ7NN upload=9OUCTRICZA0A tag=O070J283DUCW type=write size=1488921 2024-09-22T08:21:08.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.774+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=S4QUJV6JQ6QA type=del size=2122647 2024-09-22T08:21:08.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.775+0000 7fe6c9c31780 1 < canceled part key=_multipart_ILW34WLX48WN.2~VZU9TITS1G4Q.0 size=1048576 2024-09-22T08:21:08.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.776+0000 7fe6c9c31780 1 < completed part key=_multipart_ILW34WLX48WN.2~VZU9TITS1G4Q.1 size=227879 2024-09-22T08:21:08.779 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.778+0000 7fe6c9c31780 1 < canceled multipart upload key=ILW34WLX48WN upload=VZU9TITS1G4Q tag=LF7R9P4OUN4Z type=write size=2325031 2024-09-22T08:21:08.781 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.781+0000 7fe6c9c31780 1 > prepared part key=_multipart_1HZ0NAJPXNW1.2~0MRU3MMNHTHX.0 size=1048576 2024-09-22T08:21:08.782 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.782+0000 7fe6c9c31780 1 > prepared part key=_multipart_1HZ0NAJPXNW1.2~0MRU3MMNHTHX.1 size=510305 2024-09-22T08:21:08.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.782+0000 7fe6c9c31780 1 > prepared multipart upload key=1HZ0NAJPXNW1 upload=0MRU3MMNHTHX tag=079XQJ1D19YB type=write size=2607457 2024-09-22T08:21:08.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.783+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~EQ91RZ9JI7BS.0 size=1048576 2024-09-22T08:21:08.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.785+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~EQ91RZ9JI7BS.1 size=296599 2024-09-22T08:21:08.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.787+0000 7fe6c9c31780 1 < completed multipart upload key=OX1LY7URY7IV upload=EQ91RZ9JI7BS tag=54ZY2VAS6VW6 type=write size=2393751 2024-09-22T08:21:08.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.788+0000 7fe6c9c31780 1 > prepared operation key=TJTB67QBLZH5 tag=RIGJD49CLAV7 type=del size=2251763 2024-09-22T08:21:08.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.790+0000 7fe6c9c31780 1 < completed delete operation key=ZFL9N44PBQX4 tag=AVB0DTTLT2OX type=del 2024-09-22T08:21:08.792 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.791+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=FK389T2TFE8T type=del size=2271671 2024-09-22T08:21:08.792 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.791+0000 7fe6c9c31780 1 < canceled part key=_multipart_7446WN19QFV0.2~M27K0EYTED8R.0 size=1048576 2024-09-22T08:21:08.793 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.793+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~M27K0EYTED8R.1 size=694977 2024-09-22T08:21:08.796 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.795+0000 7fe6c9c31780 1 < canceled multipart upload key=7446WN19QFV0 upload=M27K0EYTED8R tag=BC66AV4MZFYA type=write size=2792129 2024-09-22T08:21:08.797 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.796+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=XXUA2OSVQ68O type=del size=3064117 2024-09-22T08:21:08.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.800+0000 7fe6c9c31780 1 < suggested remove operation key=JT5AB8VLMEFD tag=7NUDQD77CYW2 type=del 2024-09-22T08:21:08.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.801+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=RPLSMKCTP60O type=write size=702611 2024-09-22T08:21:08.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.803+0000 7fe6c9c31780 1 < completed write operation key=TYVQ39KUV2V9 tag=B6SCYB1O1UC9 type=write size=656544 2024-09-22T08:21:08.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.804+0000 7fe6c9c31780 1 > prepared operation key=FY40JTHLT0KU tag=DX9W6W7TOMXM type=del size=4069451 2024-09-22T08:21:08.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.806+0000 7fe6c9c31780 1 < completed delete operation key=R7UWMW913DJQ tag=L19XCUN41AXI type=del 2024-09-22T08:21:08.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.809+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~67EP2E4W2LA6.0 size=1048576 2024-09-22T08:21:08.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.810+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~67EP2E4W2LA6.1 size=480961 2024-09-22T08:21:08.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.810+0000 7fe6c9c31780 1 > prepared multipart upload key=T2W6RXP9UGHH upload=67EP2E4W2LA6 tag=H48VL3KMTB0Q type=write size=2578113 2024-09-22T08:21:08.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.811+0000 7fe6c9c31780 1 < completed delete operation key=R7UWMW913DJQ tag=C6J0O4S1AUL9 type=del 2024-09-22T08:21:08.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.814+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~DFOTJIRKWCAK.0 size=1048576 2024-09-22T08:21:08.815 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.815+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~DFOTJIRKWCAK.1 size=1048576 2024-09-22T08:21:08.816 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.816+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~DFOTJIRKWCAK.2 size=551075 2024-09-22T08:21:08.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.816+0000 7fe6c9c31780 1 > prepared multipart upload key=D85LJGGU3Z6F upload=DFOTJIRKWCAK tag=CWA26RH2OT62 type=write size=3696803 2024-09-22T08:21:08.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.817+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~8Z9V3N3ZAQOY.0 size=1048576 2024-09-22T08:21:08.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.818+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~8Z9V3N3ZAQOY.1 size=1048576 2024-09-22T08:21:08.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.820+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~8Z9V3N3ZAQOY.2 size=81098 2024-09-22T08:21:08.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.822+0000 7fe6c9c31780 1 < completed multipart upload key=7446WN19QFV0 upload=8Z9V3N3ZAQOY tag=FZH5GNF0XWZX type=write size=3226826 2024-09-22T08:21:08.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.823+0000 7fe6c9c31780 1 > prepared operation key=D85LJGGU3Z6F tag=WXSHRZZ7FT2P type=del size=2759591 2024-09-22T08:21:08.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.826+0000 7fe6c9c31780 1 < completed delete operation key=GEWQUFB9K35E tag=0VE0RGFQ8318 type=del 2024-09-22T08:21:08.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.826+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=6RUASJIYR7BA type=del size=3824875 2024-09-22T08:21:08.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.828+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~Q1RS9HVIF11U.0 size=651291 2024-09-22T08:21:08.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.830+0000 7fe6c9c31780 1 < completed multipart upload key=0PNK2ZW6IJM1 upload=Q1RS9HVIF11U tag=6O233V8EVOIR type=write size=1699867 2024-09-22T08:21:08.832 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.832+0000 7fe6c9c31780 1 > prepared operation key=Z1CK5EDBK4AW tag=C3GW32NN9HW0 type=del size=4091107 2024-09-22T08:21:08.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.833+0000 7fe6c9c31780 1 < completed delete operation key=0PNK2ZW6IJM1 tag=Q1LX74GWTRYO type=del 2024-09-22T08:21:08.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.834+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=J17Z1NYJS807 type=del size=175509 2024-09-22T08:21:08.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.836+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~HTK791GJVSRR.0 size=1048576 2024-09-22T08:21:08.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.837+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~HTK791GJVSRR.1 size=506643 2024-09-22T08:21:08.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.839+0000 7fe6c9c31780 1 < completed multipart upload key=76HZ3LZGVT9J upload=HTK791GJVSRR tag=A5C5DSUBQUK2 type=write size=2603795 2024-09-22T08:21:08.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.842+0000 7fe6c9c31780 1 > prepared part key=_multipart_1HZ0NAJPXNW1.2~GV56CQVNJL7W.0 size=146248 2024-09-22T08:21:08.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.842+0000 7fe6c9c31780 1 > prepared multipart upload key=1HZ0NAJPXNW1 upload=GV56CQVNJL7W tag=A5LIU98YXTUI type=write size=1194824 2024-09-22T08:21:08.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.843+0000 7fe6c9c31780 1 < completed delete operation key=GEWQUFB9K35E tag=VX5VV6WB5W69 type=del 2024-09-22T08:21:08.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.846+0000 7fe6c9c31780 1 > prepared operation key=9FCSIF1WKBDJ tag=3V4QHDVJOQMW type=del size=3203606 2024-09-22T08:21:08.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.847+0000 7fe6c9c31780 1 < canceled operation key=OX1LY7URY7IV tag=3JCOS62C0YV2 type=del size=1624200 2024-09-22T08:21:08.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.849+0000 7fe6c9c31780 1 > prepared operation key=1HZ0NAJPXNW1 tag=I5G7B4S7Z8HU type=del size=3740854 2024-09-22T08:21:08.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.850+0000 7fe6c9c31780 1 < completed delete operation key=R7UWMW913DJQ tag=S4QUJV6JQ6QA type=del 2024-09-22T08:21:08.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.852+0000 7fe6c9c31780 1 > prepared operation key=O1UBUQXP50CN tag=HCQ6ZUS7LZLL type=del size=3996513 2024-09-22T08:21:08.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.854+0000 7fe6c9c31780 1 < completed part key=_multipart_1HZ0NAJPXNW1.2~0MRU3MMNHTHX.0 size=1048576 2024-09-22T08:21:08.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.856+0000 7fe6c9c31780 1 < completed part key=_multipart_1HZ0NAJPXNW1.2~0MRU3MMNHTHX.1 size=510305 2024-09-22T08:21:08.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.858+0000 7fe6c9c31780 1 < completed multipart upload key=1HZ0NAJPXNW1 upload=0MRU3MMNHTHX tag=079XQJ1D19YB type=write size=2607457 2024-09-22T08:21:08.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.861+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~D45AYYJ261UA.0 size=1048576 2024-09-22T08:21:08.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.862+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~D45AYYJ261UA.1 size=891453 2024-09-22T08:21:08.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.862+0000 7fe6c9c31780 1 > prepared multipart upload key=DC7VLQWZ3TD1 upload=D45AYYJ261UA tag=TADRP5HGN8V1 type=write size=2988605 2024-09-22T08:21:08.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.865+0000 7fe6c9c31780 1 < suggested remove operation key=TJTB67QBLZH5 tag=RIGJD49CLAV7 type=del 2024-09-22T08:21:08.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.867+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=BFSUMBCMVC1R type=write size=195842 2024-09-22T08:21:08.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.870+0000 7fe6c9c31780 1 < suggested remove operation key=946H8F2AUPO2 tag=FK389T2TFE8T type=del 2024-09-22T08:21:08.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.871+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=FI3OKDSKIXSM type=del size=1884565 2024-09-22T08:21:08.873 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.872+0000 7fe6c9c31780 1 < completed delete operation key=7446WN19QFV0 tag=XXUA2OSVQ68O type=del 2024-09-22T08:21:08.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.876+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~ZQYYZWEQ5UFU.0 size=608141 2024-09-22T08:21:08.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.876+0000 7fe6c9c31780 1 > prepared multipart upload key=GEWQUFB9K35E upload=ZQYYZWEQ5UFU tag=K247RED7A4ZR type=write size=1656717 2024-09-22T08:21:08.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.877+0000 7fe6c9c31780 1 < completed write operation key=76HZ3LZGVT9J tag=RPLSMKCTP60O type=write size=702611 2024-09-22T08:21:08.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.878+0000 7fe6c9c31780 1 > prepared operation key=1HZ0NAJPXNW1 tag=R1X5UYWHZH4P type=del size=847664 2024-09-22T08:21:08.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.880+0000 7fe6c9c31780 1 < canceled operation key=FY40JTHLT0KU tag=DX9W6W7TOMXM type=del size=4069451 2024-09-22T08:21:08.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.882+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~N1JB79PGX6UM.0 size=1017439 2024-09-22T08:21:08.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.882+0000 7fe6c9c31780 1 > prepared multipart upload key=KZIY400KQ5NH upload=N1JB79PGX6UM tag=EIDL7MDS51IJ type=write size=2066015 2024-09-22T08:21:08.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.884+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~67EP2E4W2LA6.0 size=1048576 2024-09-22T08:21:08.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.885+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~67EP2E4W2LA6.1 size=480961 2024-09-22T08:21:08.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.887+0000 7fe6c9c31780 1 < completed multipart upload key=T2W6RXP9UGHH upload=67EP2E4W2LA6 tag=H48VL3KMTB0Q type=write size=2578113 2024-09-22T08:21:08.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.889+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~8715J4Z8BPQM.0 size=1048576 2024-09-22T08:21:08.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.891+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~8715J4Z8BPQM.1 size=1048576 2024-09-22T08:21:08.892 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.892+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~8715J4Z8BPQM.2 size=569433 2024-09-22T08:21:08.892 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.892+0000 7fe6c9c31780 1 > prepared multipart upload key=OX1LY7URY7IV upload=8715J4Z8BPQM tag=GQDRE2M0OFZ4 type=write size=3715161 2024-09-22T08:21:08.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.893+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~DFOTJIRKWCAK.0 size=1048576 2024-09-22T08:21:08.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.895+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~DFOTJIRKWCAK.1 size=1048576 2024-09-22T08:21:08.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.895+0000 7fe6c9c31780 1 < canceled part key=_multipart_D85LJGGU3Z6F.2~DFOTJIRKWCAK.2 size=551075 2024-09-22T08:21:08.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.898+0000 7fe6c9c31780 1 < canceled multipart upload key=D85LJGGU3Z6F upload=DFOTJIRKWCAK tag=CWA26RH2OT62 type=write size=3696803 2024-09-22T08:21:08.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.900+0000 7fe6c9c31780 1 > prepared part key=_multipart_ZFL9N44PBQX4.2~1D8S0J2T1ND0.0 size=376009 2024-09-22T08:21:08.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.900+0000 7fe6c9c31780 1 > prepared multipart upload key=ZFL9N44PBQX4 upload=1D8S0J2T1ND0 tag=2T7VRKOIDWVI type=write size=1424585 2024-09-22T08:21:08.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.901+0000 7fe6c9c31780 1 < completed delete operation key=D85LJGGU3Z6F tag=WXSHRZZ7FT2P type=del 2024-09-22T08:21:08.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.903+0000 7fe6c9c31780 1 > prepared operation key=OX1LY7URY7IV tag=CUR2XYZV208T type=write size=787562 2024-09-22T08:21:08.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.904+0000 7fe6c9c31780 1 < completed delete operation key=9AZWQ9E58QS6 tag=6RUASJIYR7BA type=del 2024-09-22T08:21:08.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.906+0000 7fe6c9c31780 1 > prepared operation key=4KRJ7DTE3KDV tag=07MQUBPGF38Q type=del size=3222895 2024-09-22T08:21:08.909 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.908+0000 7fe6c9c31780 1 < suggested remove operation key=Z1CK5EDBK4AW tag=C3GW32NN9HW0 type=del 2024-09-22T08:21:08.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.912+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~CWYYB2WHH3EW.0 size=905051 2024-09-22T08:21:08.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.912+0000 7fe6c9c31780 1 > prepared multipart upload key=TYVQ39KUV2V9 upload=CWYYB2WHH3EW tag=R5GG0VK76OLH type=write size=1953627 2024-09-22T08:21:08.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.913+0000 7fe6c9c31780 1 < canceled operation key=0TWY0NNZZ7NN tag=J17Z1NYJS807 type=del size=175509 2024-09-22T08:21:08.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.915+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~XG6DDE0B138X.0 size=1048576 2024-09-22T08:21:08.917 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.916+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~XG6DDE0B138X.1 size=1048576 2024-09-22T08:21:08.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.918+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~XG6DDE0B138X.2 size=786522 2024-09-22T08:21:08.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.918+0000 7fe6c9c31780 1 > prepared multipart upload key=7446WN19QFV0 upload=XG6DDE0B138X tag=IMY6SKQQIW4O type=write size=3932250 2024-09-22T08:21:08.920 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.919+0000 7fe6c9c31780 1 < completed part key=_multipart_1HZ0NAJPXNW1.2~GV56CQVNJL7W.0 size=146248 2024-09-22T08:21:08.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.922+0000 7fe6c9c31780 1 < completed multipart upload key=1HZ0NAJPXNW1 upload=GV56CQVNJL7W tag=A5LIU98YXTUI type=write size=1194824 2024-09-22T08:21:08.923 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.923+0000 7fe6c9c31780 1 > prepared operation key=KZIY400KQ5NH tag=MLLNBN1YHK79 type=del size=3506455 2024-09-22T08:21:08.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.926+0000 7fe6c9c31780 1 < suggested remove operation key=9FCSIF1WKBDJ tag=3V4QHDVJOQMW type=del 2024-09-22T08:21:08.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.928+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~DNBZI2VZXQ3G.0 size=1048576 2024-09-22T08:21:08.930 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.929+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~DNBZI2VZXQ3G.1 size=836293 2024-09-22T08:21:08.930 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.929+0000 7fe6c9c31780 1 > prepared multipart upload key=OX1LY7URY7IV upload=DNBZI2VZXQ3G tag=3TIU61XQUJZH type=write size=2933445 2024-09-22T08:21:08.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.931+0000 7fe6c9c31780 1 < completed delete operation key=1HZ0NAJPXNW1 tag=I5G7B4S7Z8HU type=del 2024-09-22T08:21:08.933 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.932+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=4M3LAWRXQNH0 type=del size=2071397 2024-09-22T08:21:08.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.934+0000 7fe6c9c31780 1 < canceled operation key=O1UBUQXP50CN tag=HCQ6ZUS7LZLL type=del size=3996513 2024-09-22T08:21:08.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.937+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~FUWFCU4HQVSB.0 size=1048576 2024-09-22T08:21:08.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.938+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~FUWFCU4HQVSB.1 size=1048576 2024-09-22T08:21:08.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.940+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~FUWFCU4HQVSB.2 size=474767 2024-09-22T08:21:08.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.940+0000 7fe6c9c31780 1 > prepared multipart upload key=LA6ZRVULGQ0H upload=FUWFCU4HQVSB tag=Q94BISVW3CUX type=write size=3620495 2024-09-22T08:21:08.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.941+0000 7fe6c9c31780 1 < completed part key=_multipart_DC7VLQWZ3TD1.2~D45AYYJ261UA.0 size=1048576 2024-09-22T08:21:08.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.942+0000 7fe6c9c31780 1 < completed part key=_multipart_DC7VLQWZ3TD1.2~D45AYYJ261UA.1 size=891453 2024-09-22T08:21:08.945 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.945+0000 7fe6c9c31780 1 < completed multipart upload key=DC7VLQWZ3TD1 upload=D45AYYJ261UA tag=TADRP5HGN8V1 type=write size=2988605 2024-09-22T08:21:08.947 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.947+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~XEV5G1WFB0J6.0 size=1048576 2024-09-22T08:21:08.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.949+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~XEV5G1WFB0J6.1 size=1048576 2024-09-22T08:21:08.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.949+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~XEV5G1WFB0J6.2 size=41481 2024-09-22T08:21:08.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.949+0000 7fe6c9c31780 1 > prepared multipart upload key=OX1LY7URY7IV upload=XEV5G1WFB0J6 tag=UQMCLGLYAES6 type=write size=3187209 2024-09-22T08:21:08.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.951+0000 7fe6c9c31780 1 < completed write operation key=R7UWMW913DJQ tag=BFSUMBCMVC1R type=write size=195842 2024-09-22T08:21:08.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.954+0000 7fe6c9c31780 1 > prepared part key=_multipart_9AZWQ9E58QS6.2~9TWKHUKAL9S2.0 size=490939 2024-09-22T08:21:08.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.954+0000 7fe6c9c31780 1 > prepared multipart upload key=9AZWQ9E58QS6 upload=9TWKHUKAL9S2 tag=7YIRJC7ZNEJM type=write size=1539515 2024-09-22T08:21:08.956 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.955+0000 7fe6c9c31780 1 < completed delete operation key=0TWY0NNZZ7NN tag=FI3OKDSKIXSM type=del 2024-09-22T08:21:08.957 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.957+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=5QV0DBYOMWAV type=del size=3587111 2024-09-22T08:21:08.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.958+0000 7fe6c9c31780 1 < completed part key=_multipart_GEWQUFB9K35E.2~ZQYYZWEQ5UFU.0 size=608141 2024-09-22T08:21:08.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.961+0000 7fe6c9c31780 1 < completed multipart upload key=GEWQUFB9K35E upload=ZQYYZWEQ5UFU tag=K247RED7A4ZR type=write size=1656717 2024-09-22T08:21:08.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.964+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~F7PX5LPJ0NIV.0 size=458595 2024-09-22T08:21:08.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.964+0000 7fe6c9c31780 1 > prepared multipart upload key=KZIY400KQ5NH upload=F7PX5LPJ0NIV tag=7Q9BT4MWZ29W type=write size=1507171 2024-09-22T08:21:08.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.965+0000 7fe6c9c31780 1 < completed delete operation key=1HZ0NAJPXNW1 tag=R1X5UYWHZH4P type=del 2024-09-22T08:21:08.967 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.967+0000 7fe6c9c31780 1 > prepared operation key=TYVQ39KUV2V9 tag=FACC0EZ92IQ3 type=del size=3252688 2024-09-22T08:21:08.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.968+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~N1JB79PGX6UM.0 size=1017439 2024-09-22T08:21:08.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.970+0000 7fe6c9c31780 1 < completed multipart upload key=KZIY400KQ5NH upload=N1JB79PGX6UM tag=EIDL7MDS51IJ type=write size=2066015 2024-09-22T08:21:08.973 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.972+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=L9T400G3S82S type=write size=22327 2024-09-22T08:21:08.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.973+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~8715J4Z8BPQM.0 size=1048576 2024-09-22T08:21:08.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.975+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~8715J4Z8BPQM.1 size=1048576 2024-09-22T08:21:08.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.976+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~8715J4Z8BPQM.2 size=569433 2024-09-22T08:21:08.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.978+0000 7fe6c9c31780 1 < completed multipart upload key=OX1LY7URY7IV upload=8715J4Z8BPQM tag=GQDRE2M0OFZ4 type=write size=3715161 2024-09-22T08:21:08.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.981+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~HUX87F679I44.0 size=1048576 2024-09-22T08:21:08.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.984+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~HUX87F679I44.1 size=502235 2024-09-22T08:21:08.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.984+0000 7fe6c9c31780 1 > prepared multipart upload key=9FCSIF1WKBDJ upload=HUX87F679I44 tag=6LQJ4MZRI0L8 type=write size=2599387 2024-09-22T08:21:08.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.985+0000 7fe6c9c31780 1 < completed part key=_multipart_ZFL9N44PBQX4.2~1D8S0J2T1ND0.0 size=376009 2024-09-22T08:21:08.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.988+0000 7fe6c9c31780 1 < completed multipart upload key=ZFL9N44PBQX4 upload=1D8S0J2T1ND0 tag=2T7VRKOIDWVI type=write size=1424585 2024-09-22T08:21:08.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.989+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=13OERD9ENNSI type=del size=2490372 2024-09-22T08:21:08.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.991+0000 7fe6c9c31780 1 < completed write operation key=OX1LY7URY7IV tag=CUR2XYZV208T type=write size=787562 2024-09-22T08:21:08.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.992+0000 7fe6c9c31780 1 > prepared operation key=TJTB67QBLZH5 tag=L6F9VEDERQAK type=write size=609558 2024-09-22T08:21:08.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.994+0000 7fe6c9c31780 1 < completed delete operation key=4KRJ7DTE3KDV tag=07MQUBPGF38Q type=del 2024-09-22T08:21:08.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.995+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=MA7E81RK1HXW type=del size=157937 2024-09-22T08:21:08.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.997+0000 7fe6c9c31780 1 < completed part key=_multipart_TYVQ39KUV2V9.2~CWYYB2WHH3EW.0 size=905051 2024-09-22T08:21:09.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:08.999+0000 7fe6c9c31780 1 < completed multipart upload key=TYVQ39KUV2V9 upload=CWYYB2WHH3EW tag=R5GG0VK76OLH type=write size=1953627 2024-09-22T08:21:09.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.000+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=DFXYJO0D11L7 type=del size=1406131 2024-09-22T08:21:09.003 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.002+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~XG6DDE0B138X.0 size=1048576 2024-09-22T08:21:09.003 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.002+0000 7fe6c9c31780 1 < canceled part key=_multipart_7446WN19QFV0.2~XG6DDE0B138X.1 size=1048576 2024-09-22T08:21:09.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.003+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~XG6DDE0B138X.2 size=786522 2024-09-22T08:21:09.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.006+0000 7fe6c9c31780 1 < canceled multipart upload key=7446WN19QFV0 upload=XG6DDE0B138X tag=IMY6SKQQIW4O type=write size=3932250 2024-09-22T08:21:09.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.007+0000 7fe6c9c31780 1 > prepared operation key=JT5AB8VLMEFD tag=2QAS93HU1F5Y type=del size=253536 2024-09-22T08:21:09.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.009+0000 7fe6c9c31780 1 < completed delete operation key=KZIY400KQ5NH tag=MLLNBN1YHK79 type=del 2024-09-22T08:21:09.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.010+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=SN49F2G8MFBZ type=write size=495316 2024-09-22T08:21:09.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.012+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~DNBZI2VZXQ3G.0 size=1048576 2024-09-22T08:21:09.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.013+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~DNBZI2VZXQ3G.1 size=836293 2024-09-22T08:21:09.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.014+0000 7fe6c9c31780 1 < completed multipart upload key=OX1LY7URY7IV upload=DNBZI2VZXQ3G tag=3TIU61XQUJZH type=write size=2933445 2024-09-22T08:21:09.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.016+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=N6265PSFFI51 type=del size=3567046 2024-09-22T08:21:09.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.017+0000 7fe6c9c31780 1 < completed delete operation key=ILW34WLX48WN tag=4M3LAWRXQNH0 type=del 2024-09-22T08:21:09.022 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.020+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~F9GT1JQH4XUO.0 size=968600 2024-09-22T08:21:09.022 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.020+0000 7fe6c9c31780 1 > prepared multipart upload key=T2W6RXP9UGHH upload=F9GT1JQH4XUO tag=V4PAOZXE7JXZ type=write size=2017176 2024-09-22T08:21:09.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.022+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~FUWFCU4HQVSB.0 size=1048576 2024-09-22T08:21:09.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.023+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~FUWFCU4HQVSB.1 size=1048576 2024-09-22T08:21:09.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.024+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~FUWFCU4HQVSB.2 size=474767 2024-09-22T08:21:09.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.028+0000 7fe6c9c31780 1 < completed multipart upload key=LA6ZRVULGQ0H upload=FUWFCU4HQVSB tag=Q94BISVW3CUX type=write size=3620495 2024-09-22T08:21:09.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.030+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~21P3IIIUKMW7.0 size=1048576 2024-09-22T08:21:09.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.032+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~21P3IIIUKMW7.1 size=1048576 2024-09-22T08:21:09.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.033+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~21P3IIIUKMW7.2 size=511979 2024-09-22T08:21:09.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.033+0000 7fe6c9c31780 1 > prepared multipart upload key=XJP26CCPYDI7 upload=21P3IIIUKMW7 tag=3OBD64942F5Q type=write size=3657707 2024-09-22T08:21:09.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.034+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~XEV5G1WFB0J6.0 size=1048576 2024-09-22T08:21:09.037 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.035+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~XEV5G1WFB0J6.1 size=1048576 2024-09-22T08:21:09.038 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.036+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~XEV5G1WFB0J6.2 size=41481 2024-09-22T08:21:09.040 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.039+0000 7fe6c9c31780 1 < completed multipart upload key=OX1LY7URY7IV upload=XEV5G1WFB0J6 tag=UQMCLGLYAES6 type=write size=3187209 2024-09-22T08:21:09.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.042+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~WDIKUKGZOJQ8.0 size=1048576 2024-09-22T08:21:09.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.043+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~WDIKUKGZOJQ8.1 size=1048576 2024-09-22T08:21:09.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.044+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~WDIKUKGZOJQ8.2 size=339038 2024-09-22T08:21:09.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.044+0000 7fe6c9c31780 1 > prepared multipart upload key=Z1CK5EDBK4AW upload=WDIKUKGZOJQ8 tag=F0BKY5IXJD73 type=write size=3484766 2024-09-22T08:21:09.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.046+0000 7fe6c9c31780 1 < completed part key=_multipart_9AZWQ9E58QS6.2~9TWKHUKAL9S2.0 size=490939 2024-09-22T08:21:09.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.049+0000 7fe6c9c31780 1 < completed multipart upload key=9AZWQ9E58QS6 upload=9TWKHUKAL9S2 tag=7YIRJC7ZNEJM type=write size=1539515 2024-09-22T08:21:09.051 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.049+0000 7fe6c9c31780 1 > prepared operation key=LA6ZRVULGQ0H tag=DJPY0AR86UY1 type=del size=284763 2024-09-22T08:21:09.053 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.051+0000 7fe6c9c31780 1 < completed delete operation key=9AZWQ9E58QS6 tag=5QV0DBYOMWAV type=del 2024-09-22T08:21:09.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.053+0000 7fe6c9c31780 1 > prepared operation key=O1UBUQXP50CN tag=8YTYCQYB1PF7 type=del size=3324343 2024-09-22T08:21:09.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.054+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~F7PX5LPJ0NIV.0 size=458595 2024-09-22T08:21:09.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.058+0000 7fe6c9c31780 1 < completed multipart upload key=KZIY400KQ5NH upload=F7PX5LPJ0NIV tag=7Q9BT4MWZ29W type=write size=1507171 2024-09-22T08:21:09.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.058+0000 7fe6c9c31780 1 > prepared operation key=JT5AB8VLMEFD tag=KO7BG874GE3K type=del size=453748 2024-09-22T08:21:09.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.060+0000 7fe6c9c31780 1 < completed delete operation key=TYVQ39KUV2V9 tag=FACC0EZ92IQ3 type=del 2024-09-22T08:21:09.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.062+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=0OFHM2LGMM65 type=del size=1691890 2024-09-22T08:21:09.065 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.063+0000 7fe6c9c31780 1 < completed write operation key=946H8F2AUPO2 tag=L9T400G3S82S type=write size=22327 2024-09-22T08:21:09.068 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.066+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~E113QF70LZDN.0 size=1048576 2024-09-22T08:21:09.069 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.068+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~E113QF70LZDN.1 size=1048576 2024-09-22T08:21:09.071 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.069+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~E113QF70LZDN.2 size=115706 2024-09-22T08:21:09.071 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.069+0000 7fe6c9c31780 1 > prepared multipart upload key=FY40JTHLT0KU upload=E113QF70LZDN tag=CQPD5ZK0SLAT type=write size=3261434 2024-09-22T08:21:09.072 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.070+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~HUX87F679I44.0 size=1048576 2024-09-22T08:21:09.073 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.072+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~HUX87F679I44.1 size=502235 2024-09-22T08:21:09.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.075+0000 7fe6c9c31780 1 < completed multipart upload key=9FCSIF1WKBDJ upload=HUX87F679I44 tag=6LQJ4MZRI0L8 type=write size=2599387 2024-09-22T08:21:09.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.075+0000 7fe6c9c31780 1 > prepared operation key=ZFL9N44PBQX4 tag=SMHZTF3XCJ5B type=del size=4096959 2024-09-22T08:21:09.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.078+0000 7fe6c9c31780 1 < completed delete operation key=0TWY0NNZZ7NN tag=13OERD9ENNSI type=del 2024-09-22T08:21:09.080 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.079+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=W8IDJKUTPA7D type=del size=2482324 2024-09-22T08:21:09.082 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.080+0000 7fe6c9c31780 1 < completed write operation key=TJTB67QBLZH5 tag=L6F9VEDERQAK type=write size=609558 2024-09-22T08:21:09.083 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.082+0000 7fe6c9c31780 1 > prepared operation key=TYVQ39KUV2V9 tag=HS9DYQ72OG1J type=write size=458762 2024-09-22T08:21:09.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.083+0000 7fe6c9c31780 1 < completed delete operation key=TE10GB1F35X4 tag=MA7E81RK1HXW type=del 2024-09-22T08:21:09.086 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.085+0000 7fe6c9c31780 1 > prepared operation key=D85LJGGU3Z6F tag=J1VWRBCI6U8M type=del size=611968 2024-09-22T08:21:09.088 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.086+0000 7fe6c9c31780 1 < completed delete operation key=9AZWQ9E58QS6 tag=DFXYJO0D11L7 type=del 2024-09-22T08:21:09.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.088+0000 7fe6c9c31780 1 > prepared operation key=JT5AB8VLMEFD tag=9ZZRDEY52DGJ type=del size=1732306 2024-09-22T08:21:09.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.090+0000 7fe6c9c31780 1 < completed delete operation key=JT5AB8VLMEFD tag=2QAS93HU1F5Y type=del 2024-09-22T08:21:09.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.091+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=P7BODGVXTQGC type=del size=42468 2024-09-22T08:21:09.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.093+0000 7fe6c9c31780 1 < completed write operation key=CTK01Y0CV1NC tag=SN49F2G8MFBZ type=write size=495316 2024-09-22T08:21:09.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.095+0000 7fe6c9c31780 1 > prepared part key=_multipart_ZFL9N44PBQX4.2~UQPFFMD6N0PJ.0 size=887033 2024-09-22T08:21:09.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.095+0000 7fe6c9c31780 1 > prepared multipart upload key=ZFL9N44PBQX4 upload=UQPFFMD6N0PJ tag=2M1HXI46X7Q8 type=write size=1935609 2024-09-22T08:21:09.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.097+0000 7fe6c9c31780 1 < canceled operation key=946H8F2AUPO2 tag=N6265PSFFI51 type=del size=3567046 2024-09-22T08:21:09.100 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.098+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=EVF3PJQWPYLK type=del size=3149790 2024-09-22T08:21:09.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.100+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~F9GT1JQH4XUO.0 size=968600 2024-09-22T08:21:09.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.102+0000 7fe6c9c31780 1 < completed multipart upload key=T2W6RXP9UGHH upload=F9GT1JQH4XUO tag=V4PAOZXE7JXZ type=write size=2017176 2024-09-22T08:21:09.106 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.105+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~20DMDGKJI6S8.0 size=1048576 2024-09-22T08:21:09.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.106+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~20DMDGKJI6S8.1 size=395153 2024-09-22T08:21:09.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.106+0000 7fe6c9c31780 1 > prepared multipart upload key=O1UBUQXP50CN upload=20DMDGKJI6S8 tag=F6JTFORA3NV3 type=write size=2492305 2024-09-22T08:21:09.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.107+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~21P3IIIUKMW7.0 size=1048576 2024-09-22T08:21:09.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.109+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~21P3IIIUKMW7.1 size=1048576 2024-09-22T08:21:09.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.110+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~21P3IIIUKMW7.2 size=511979 2024-09-22T08:21:09.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.112+0000 7fe6c9c31780 1 < completed multipart upload key=XJP26CCPYDI7 upload=21P3IIIUKMW7 tag=3OBD64942F5Q type=write size=3657707 2024-09-22T08:21:09.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.114+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=3AQI1OW25A5O type=del size=392475 2024-09-22T08:21:09.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.116+0000 7fe6c9c31780 1 < completed part key=_multipart_Z1CK5EDBK4AW.2~WDIKUKGZOJQ8.0 size=1048576 2024-09-22T08:21:09.118 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.117+0000 7fe6c9c31780 1 < completed part key=_multipart_Z1CK5EDBK4AW.2~WDIKUKGZOJQ8.1 size=1048576 2024-09-22T08:21:09.118 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.117+0000 7fe6c9c31780 1 < canceled part key=_multipart_Z1CK5EDBK4AW.2~WDIKUKGZOJQ8.2 size=339038 2024-09-22T08:21:09.121 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.119+0000 7fe6c9c31780 1 < canceled multipart upload key=Z1CK5EDBK4AW upload=WDIKUKGZOJQ8 tag=F0BKY5IXJD73 type=write size=3484766 2024-09-22T08:21:09.122 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.121+0000 7fe6c9c31780 1 > prepared operation key=JT5AB8VLMEFD tag=3C4ULME6HKLV type=del size=2331827 2024-09-22T08:21:09.126 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.124+0000 7fe6c9c31780 1 < completed delete operation key=LA6ZRVULGQ0H tag=DJPY0AR86UY1 type=del 2024-09-22T08:21:09.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.127+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~GGC6UCNKAW9O.0 size=989247 2024-09-22T08:21:09.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.127+0000 7fe6c9c31780 1 > prepared multipart upload key=9FCSIF1WKBDJ upload=GGC6UCNKAW9O tag=9PKY2R5W2GGX type=write size=2037823 2024-09-22T08:21:09.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.128+0000 7fe6c9c31780 1 < completed delete operation key=O1UBUQXP50CN tag=8YTYCQYB1PF7 type=del 2024-09-22T08:21:09.131 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.130+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=4URVTKUMK0BH type=del size=1490305 2024-09-22T08:21:09.134 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.133+0000 7fe6c9c31780 1 < suggested update operation key=JT5AB8VLMEFD tag=KO7BG874GE3K type=del size=453748 2024-09-22T08:21:09.136 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.134+0000 7fe6c9c31780 1 > prepared operation key=TYVQ39KUV2V9 tag=IDUU3PBF6VHT type=write size=454723 2024-09-22T08:21:09.137 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.135+0000 7fe6c9c31780 1 < completed delete operation key=0TWY0NNZZ7NN tag=0OFHM2LGMM65 type=del 2024-09-22T08:21:09.140 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.138+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~I1E1VJ1H0NO5.0 size=197917 2024-09-22T08:21:09.140 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.138+0000 7fe6c9c31780 1 > prepared multipart upload key=TYVQ39KUV2V9 upload=I1E1VJ1H0NO5 tag=S4OREY7L0UMJ type=write size=1246493 2024-09-22T08:21:09.140 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.139+0000 7fe6c9c31780 1 < canceled part key=_multipart_FY40JTHLT0KU.2~E113QF70LZDN.0 size=1048576 2024-09-22T08:21:09.140 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.139+0000 7fe6c9c31780 1 < canceled part key=_multipart_FY40JTHLT0KU.2~E113QF70LZDN.1 size=1048576 2024-09-22T08:21:09.141 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.140+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~E113QF70LZDN.2 size=115706 2024-09-22T08:21:09.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.142+0000 7fe6c9c31780 1 < canceled multipart upload key=FY40JTHLT0KU upload=E113QF70LZDN tag=CQPD5ZK0SLAT type=write size=3261434 2024-09-22T08:21:09.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.145+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~7D4VANKGVMIG.0 size=922761 2024-09-22T08:21:09.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.145+0000 7fe6c9c31780 1 > prepared multipart upload key=DC7VLQWZ3TD1 upload=7D4VANKGVMIG tag=GJ9F5C3P46S5 type=write size=1971337 2024-09-22T08:21:09.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.147+0000 7fe6c9c31780 1 < completed delete operation key=ZFL9N44PBQX4 tag=SMHZTF3XCJ5B type=del 2024-09-22T08:21:09.149 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.148+0000 7fe6c9c31780 1 > prepared operation key=D85LJGGU3Z6F tag=UPAC0SS8YVLQ type=del size=2867593 2024-09-22T08:21:09.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.151+0000 7fe6c9c31780 1 < suggested remove operation key=DC7VLQWZ3TD1 tag=W8IDJKUTPA7D type=del 2024-09-22T08:21:09.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.153+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~OKRC9V3FI0E4.0 size=137771 2024-09-22T08:21:09.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.153+0000 7fe6c9c31780 1 > prepared multipart upload key=Z1CK5EDBK4AW upload=OKRC9V3FI0E4 tag=IJOJCCRNA2KR type=write size=1186347 2024-09-22T08:21:09.156 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.155+0000 7fe6c9c31780 1 < completed write operation key=TYVQ39KUV2V9 tag=HS9DYQ72OG1J type=write size=458762 2024-09-22T08:21:09.158 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.156+0000 7fe6c9c31780 1 > prepared operation key=TYVQ39KUV2V9 tag=XIDIFMGT2FKF type=write size=188314 2024-09-22T08:21:09.161 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.159+0000 7fe6c9c31780 1 < suggested update operation key=D85LJGGU3Z6F tag=J1VWRBCI6U8M type=del size=611968 2024-09-22T08:21:09.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.163+0000 7fe6c9c31780 1 > prepared part key=_multipart_ZFL9N44PBQX4.2~S3UOS6122V4Z.0 size=1048576 2024-09-22T08:21:09.165 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.164+0000 7fe6c9c31780 1 > prepared part key=_multipart_ZFL9N44PBQX4.2~S3UOS6122V4Z.1 size=1048576 2024-09-22T08:21:09.166 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.165+0000 7fe6c9c31780 1 > prepared part key=_multipart_ZFL9N44PBQX4.2~S3UOS6122V4Z.2 size=140993 2024-09-22T08:21:09.167 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.165+0000 7fe6c9c31780 1 > prepared multipart upload key=ZFL9N44PBQX4 upload=S3UOS6122V4Z tag=A22GPYK5RK4C type=write size=3286721 2024-09-22T08:21:09.168 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.166+0000 7fe6c9c31780 -1 < failed to complete operation key=JT5AB8VLMEFD tag=9ZZRDEY52DGJ type=del size=1732306: (22) Invalid argument 2024-09-22T08:21:09.171 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.169+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~P1I3TFQNR7K0.0 size=844776 2024-09-22T08:21:09.171 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.169+0000 7fe6c9c31780 1 > prepared multipart upload key=D85LJGGU3Z6F upload=P1I3TFQNR7K0 tag=A6THUP81ZII4 type=write size=1893352 2024-09-22T08:21:09.173 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.171+0000 7fe6c9c31780 1 < canceled operation key=76HZ3LZGVT9J tag=P7BODGVXTQGC type=del size=42468 2024-09-22T08:21:09.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.174+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=STIIYKS0V04T type=del size=3818376 2024-09-22T08:21:09.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.176+0000 7fe6c9c31780 1 < completed part key=_multipart_ZFL9N44PBQX4.2~UQPFFMD6N0PJ.0 size=887033 2024-09-22T08:21:09.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.178+0000 7fe6c9c31780 1 < completed multipart upload key=ZFL9N44PBQX4 upload=UQPFFMD6N0PJ tag=2M1HXI46X7Q8 type=write size=1935609 2024-09-22T08:21:09.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.181+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~SJY84JXT7VFZ.0 size=1048576 2024-09-22T08:21:09.183 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.182+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~SJY84JXT7VFZ.1 size=1048576 2024-09-22T08:21:09.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.183+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~SJY84JXT7VFZ.2 size=479206 2024-09-22T08:21:09.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.183+0000 7fe6c9c31780 1 > prepared multipart upload key=2B5QRUMTVE7U upload=SJY84JXT7VFZ tag=7R9ESA6J57LP type=write size=3624934 2024-09-22T08:21:09.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.186+0000 7fe6c9c31780 1 < suggested update operation key=CTK01Y0CV1NC tag=EVF3PJQWPYLK type=del size=3149790 2024-09-22T08:21:09.191 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.189+0000 7fe6c9c31780 1 > prepared part key=_multipart_1HZ0NAJPXNW1.2~QMBPS9VAOZDV.0 size=795417 2024-09-22T08:21:09.191 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.189+0000 7fe6c9c31780 1 > prepared multipart upload key=1HZ0NAJPXNW1 upload=QMBPS9VAOZDV tag=W18J98Y692L9 type=write size=1843993 2024-09-22T08:21:09.192 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.191+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~20DMDGKJI6S8.0 size=1048576 2024-09-22T08:21:09.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.192+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~20DMDGKJI6S8.1 size=395153 2024-09-22T08:21:09.196 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.194+0000 7fe6c9c31780 1 < completed multipart upload key=O1UBUQXP50CN upload=20DMDGKJI6S8 tag=F6JTFORA3NV3 type=write size=2492305 2024-09-22T08:21:09.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.197+0000 7fe6c9c31780 1 > prepared part key=_multipart_1HZ0NAJPXNW1.2~GZEFTA6WLCMR.0 size=1048576 2024-09-22T08:21:09.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.198+0000 7fe6c9c31780 1 > prepared part key=_multipart_1HZ0NAJPXNW1.2~GZEFTA6WLCMR.1 size=173750 2024-09-22T08:21:09.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.198+0000 7fe6c9c31780 1 > prepared multipart upload key=1HZ0NAJPXNW1 upload=GZEFTA6WLCMR tag=5ATVMZH6F6GG type=write size=2270902 2024-09-22T08:21:09.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.200+0000 7fe6c9c31780 -1 < failed to complete operation key=DC7VLQWZ3TD1 tag=3AQI1OW25A5O type=del size=392475: (22) Invalid argument 2024-09-22T08:21:09.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.202+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~IYCGXCSS979I.0 size=359397 2024-09-22T08:21:09.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.202+0000 7fe6c9c31780 1 > prepared multipart upload key=D85LJGGU3Z6F upload=IYCGXCSS979I tag=A7C8RSUNZ2R6 type=write size=1407973 2024-09-22T08:21:09.205 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.204+0000 7fe6c9c31780 -1 < failed to complete operation key=JT5AB8VLMEFD tag=3C4ULME6HKLV type=del size=2331827: (22) Invalid argument 2024-09-22T08:21:09.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.205+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=NAD2FG7P1L9N type=del size=3824213 2024-09-22T08:21:09.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.205+0000 7fe6c9c31780 1 < canceled part key=_multipart_9FCSIF1WKBDJ.2~GGC6UCNKAW9O.0 size=989247 2024-09-22T08:21:09.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.208+0000 7fe6c9c31780 1 < canceled multipart upload key=9FCSIF1WKBDJ upload=GGC6UCNKAW9O tag=9PKY2R5W2GGX type=write size=2037823 2024-09-22T08:21:09.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.209+0000 7fe6c9c31780 1 > prepared operation key=FY40JTHLT0KU tag=RS7BRMZS2GIQ type=del size=3293033 2024-09-22T08:21:09.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.212+0000 7fe6c9c31780 -1 < failed to complete operation key=DC7VLQWZ3TD1 tag=4URVTKUMK0BH type=del size=1490305: (22) Invalid argument 2024-09-22T08:21:09.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.212+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=U96SFZOTQY63 type=del size=2177211 2024-09-22T08:21:09.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.215+0000 7fe6c9c31780 1 < suggested remove operation key=TYVQ39KUV2V9 tag=IDUU3PBF6VHT type=write 2024-09-22T08:21:09.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.217+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=DVMUUHO9Y7EZ type=del size=3448621 2024-09-22T08:21:09.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.218+0000 7fe6c9c31780 1 < completed part key=_multipart_TYVQ39KUV2V9.2~I1E1VJ1H0NO5.0 size=197917 2024-09-22T08:21:09.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.222+0000 7fe6c9c31780 1 < completed multipart upload key=TYVQ39KUV2V9 upload=I1E1VJ1H0NO5 tag=S4OREY7L0UMJ type=write size=1246493 2024-09-22T08:21:09.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.225+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~UWOPJ990Y405.0 size=285607 2024-09-22T08:21:09.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.225+0000 7fe6c9c31780 1 > prepared multipart upload key=FY40JTHLT0KU upload=UWOPJ990Y405 tag=LDTXI172KJ2A type=write size=1334183 2024-09-22T08:21:09.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.226+0000 7fe6c9c31780 1 < completed part key=_multipart_DC7VLQWZ3TD1.2~7D4VANKGVMIG.0 size=922761 2024-09-22T08:21:09.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.229+0000 7fe6c9c31780 1 < completed multipart upload key=DC7VLQWZ3TD1 upload=7D4VANKGVMIG tag=GJ9F5C3P46S5 type=write size=1971337 2024-09-22T08:21:09.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.230+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=PHUABTZ0JT9E type=del size=2005652 2024-09-22T08:21:09.234 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.233+0000 7fe6c9c31780 1 < suggested update operation key=D85LJGGU3Z6F tag=UPAC0SS8YVLQ type=del size=2867593 2024-09-22T08:21:09.237 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.236+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~9Z5J1VQHWIYO.0 size=1048576 2024-09-22T08:21:09.238 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.236+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~9Z5J1VQHWIYO.1 size=872675 2024-09-22T08:21:09.238 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.236+0000 7fe6c9c31780 1 > prepared multipart upload key=946H8F2AUPO2 upload=9Z5J1VQHWIYO tag=CXJFPBWCG8HE type=write size=2969827 2024-09-22T08:21:09.239 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.238+0000 7fe6c9c31780 1 < completed part key=_multipart_Z1CK5EDBK4AW.2~OKRC9V3FI0E4.0 size=137771 2024-09-22T08:21:09.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.240+0000 7fe6c9c31780 1 < completed multipart upload key=Z1CK5EDBK4AW upload=OKRC9V3FI0E4 tag=IJOJCCRNA2KR type=write size=1186347 2024-09-22T08:21:09.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.241+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=J29WRFXER8G7 type=write size=213487 2024-09-22T08:21:09.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.243+0000 7fe6c9c31780 -1 < failed to complete operation key=TYVQ39KUV2V9 tag=XIDIFMGT2FKF type=write size=188314: (22) Invalid argument 2024-09-22T08:21:09.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.246+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~U7PWSUUX0AE7.0 size=1048576 2024-09-22T08:21:09.248 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.247+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~U7PWSUUX0AE7.1 size=568509 2024-09-22T08:21:09.248 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.247+0000 7fe6c9c31780 1 > prepared multipart upload key=4KRJ7DTE3KDV upload=U7PWSUUX0AE7 tag=Y5QUL6NBTZR7 type=write size=2665661 2024-09-22T08:21:09.250 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.248+0000 7fe6c9c31780 1 < completed part key=_multipart_ZFL9N44PBQX4.2~S3UOS6122V4Z.0 size=1048576 2024-09-22T08:21:09.250 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.248+0000 7fe6c9c31780 1 < canceled part key=_multipart_ZFL9N44PBQX4.2~S3UOS6122V4Z.1 size=1048576 2024-09-22T08:21:09.251 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.250+0000 7fe6c9c31780 1 < completed part key=_multipart_ZFL9N44PBQX4.2~S3UOS6122V4Z.2 size=140993 2024-09-22T08:21:09.254 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.252+0000 7fe6c9c31780 1 < canceled multipart upload key=ZFL9N44PBQX4 upload=S3UOS6122V4Z tag=A22GPYK5RK4C type=write size=3286721 2024-09-22T08:21:09.256 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.254+0000 7fe6c9c31780 1 > prepared operation key=4KRJ7DTE3KDV tag=30O3F1QRFRZT type=del size=3551545 2024-09-22T08:21:09.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.256+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~P1I3TFQNR7K0.0 size=844776 2024-09-22T08:21:09.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.258+0000 7fe6c9c31780 1 < completed multipart upload key=D85LJGGU3Z6F upload=P1I3TFQNR7K0 tag=A6THUP81ZII4 type=write size=1893352 2024-09-22T08:21:09.262 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.261+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~8CT7FWAV91SB.0 size=1048576 2024-09-22T08:21:09.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.262+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~8CT7FWAV91SB.1 size=1048576 2024-09-22T08:21:09.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.263+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~8CT7FWAV91SB.2 size=470917 2024-09-22T08:21:09.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.263+0000 7fe6c9c31780 1 > prepared multipart upload key=FY40JTHLT0KU upload=8CT7FWAV91SB tag=2WKFU2DS1I2Z type=write size=3616645 2024-09-22T08:21:09.267 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.266+0000 7fe6c9c31780 1 < completed delete operation key=946H8F2AUPO2 tag=STIIYKS0V04T type=del 2024-09-22T08:21:09.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.267+0000 7fe6c9c31780 1 > prepared operation key=VP1MP4IC9A7T tag=ZIUU5VZ3DTR1 type=del size=506883 2024-09-22T08:21:09.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.269+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~SJY84JXT7VFZ.0 size=1048576 2024-09-22T08:21:09.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.270+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~SJY84JXT7VFZ.1 size=1048576 2024-09-22T08:21:09.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.271+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~SJY84JXT7VFZ.2 size=479206 2024-09-22T08:21:09.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.273+0000 7fe6c9c31780 1 < completed multipart upload key=2B5QRUMTVE7U upload=SJY84JXT7VFZ tag=7R9ESA6J57LP type=write size=3624934 2024-09-22T08:21:09.276 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.274+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=A3FP9GP2OCFS type=del size=3598295 2024-09-22T08:21:09.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.276+0000 7fe6c9c31780 1 < completed part key=_multipart_1HZ0NAJPXNW1.2~QMBPS9VAOZDV.0 size=795417 2024-09-22T08:21:09.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.278+0000 7fe6c9c31780 1 < completed multipart upload key=1HZ0NAJPXNW1 upload=QMBPS9VAOZDV tag=W18J98Y692L9 type=write size=1843993 2024-09-22T08:21:09.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.280+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~5QO7E51810BQ.0 size=1048576 2024-09-22T08:21:09.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.281+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~5QO7E51810BQ.1 size=1048576 2024-09-22T08:21:09.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.283+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~5QO7E51810BQ.2 size=41758 2024-09-22T08:21:09.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.283+0000 7fe6c9c31780 1 > prepared multipart upload key=LA6ZRVULGQ0H upload=5QO7E51810BQ tag=QCHAH5XTJ6RQ type=write size=3187486 2024-09-22T08:21:09.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.284+0000 7fe6c9c31780 1 < completed part key=_multipart_1HZ0NAJPXNW1.2~GZEFTA6WLCMR.0 size=1048576 2024-09-22T08:21:09.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.285+0000 7fe6c9c31780 1 < completed part key=_multipart_1HZ0NAJPXNW1.2~GZEFTA6WLCMR.1 size=173750 2024-09-22T08:21:09.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.288+0000 7fe6c9c31780 1 < completed multipart upload key=1HZ0NAJPXNW1 upload=GZEFTA6WLCMR tag=5ATVMZH6F6GG type=write size=2270902 2024-09-22T08:21:09.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.289+0000 7fe6c9c31780 1 > prepared operation key=D85LJGGU3Z6F tag=0UBMFCLJ8F4K type=del size=3517607 2024-09-22T08:21:09.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.291+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~IYCGXCSS979I.0 size=359397 2024-09-22T08:21:09.296 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.295+0000 7fe6c9c31780 1 < completed multipart upload key=D85LJGGU3Z6F upload=IYCGXCSS979I tag=A7C8RSUNZ2R6 type=write size=1407973 2024-09-22T08:21:09.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.297+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~MXZUJG436WRI.0 size=1048576 2024-09-22T08:21:09.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.298+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~MXZUJG436WRI.1 size=559324 2024-09-22T08:21:09.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.298+0000 7fe6c9c31780 1 > prepared multipart upload key=KZIY400KQ5NH upload=MXZUJG436WRI tag=UUJBEU0KD6GT type=write size=2656476 2024-09-22T08:21:09.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.299+0000 7fe6c9c31780 1 < completed delete operation key=2B5QRUMTVE7U tag=NAD2FG7P1L9N type=del 2024-09-22T08:21:09.302 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.301+0000 7fe6c9c31780 1 > prepared operation key=LA6ZRVULGQ0H tag=PXWSJHB18HHC type=del size=3297920 2024-09-22T08:21:09.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.304+0000 7fe6c9c31780 1 < suggested remove operation key=FY40JTHLT0KU tag=RS7BRMZS2GIQ type=del 2024-09-22T08:21:09.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.305+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=JGYXB11PH9CA type=del size=1814227 2024-09-22T08:21:09.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.307+0000 7fe6c9c31780 1 < completed delete operation key=TE10GB1F35X4 tag=U96SFZOTQY63 type=del 2024-09-22T08:21:09.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.309+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~436N5TVEX8Q6.0 size=363548 2024-09-22T08:21:09.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.309+0000 7fe6c9c31780 1 > prepared multipart upload key=GEWQUFB9K35E upload=436N5TVEX8Q6 tag=UMCDIP20NUR4 type=write size=1412124 2024-09-22T08:21:09.312 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.311+0000 7fe6c9c31780 1 < completed delete operation key=R7UWMW913DJQ tag=DVMUUHO9Y7EZ type=del 2024-09-22T08:21:09.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.312+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=MRNQ6KJ4FM8F type=write size=401317 2024-09-22T08:21:09.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.314+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~UWOPJ990Y405.0 size=285607 2024-09-22T08:21:09.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.317+0000 7fe6c9c31780 1 < completed multipart upload key=FY40JTHLT0KU upload=UWOPJ990Y405 tag=LDTXI172KJ2A type=write size=1334183 2024-09-22T08:21:09.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.318+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=1BAEGA3QR08O type=write size=284214 2024-09-22T08:21:09.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.320+0000 7fe6c9c31780 1 < completed delete operation key=2B5QRUMTVE7U tag=PHUABTZ0JT9E type=del 2024-09-22T08:21:09.323 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.323+0000 7fe6c9c31780 1 > prepared operation key=OX1LY7URY7IV tag=ZNCPFWEY5XC2 type=del size=4171936 2024-09-22T08:21:09.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.324+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~9Z5J1VQHWIYO.0 size=1048576 2024-09-22T08:21:09.326 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.325+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~9Z5J1VQHWIYO.1 size=872675 2024-09-22T08:21:09.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.327+0000 7fe6c9c31780 1 < completed multipart upload key=946H8F2AUPO2 upload=9Z5J1VQHWIYO tag=CXJFPBWCG8HE type=write size=2969827 2024-09-22T08:21:09.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.330+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~P4RML4E4YSM9.0 size=1048576 2024-09-22T08:21:09.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.332+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~P4RML4E4YSM9.1 size=1048576 2024-09-22T08:21:09.334 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.333+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~P4RML4E4YSM9.2 size=651031 2024-09-22T08:21:09.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.333+0000 7fe6c9c31780 1 > prepared multipart upload key=CTK01Y0CV1NC upload=P4RML4E4YSM9 tag=EBCBWKKZA5N6 type=write size=3796759 2024-09-22T08:21:09.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.336+0000 7fe6c9c31780 1 < suggested remove operation key=6BKB91YV3FMW tag=J29WRFXER8G7 type=write 2024-09-22T08:21:09.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.338+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=CW47YF32GR30 type=del size=124439 2024-09-22T08:21:09.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.339+0000 7fe6c9c31780 1 < completed part key=_multipart_4KRJ7DTE3KDV.2~U7PWSUUX0AE7.0 size=1048576 2024-09-22T08:21:09.342 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.340+0000 7fe6c9c31780 1 < completed part key=_multipart_4KRJ7DTE3KDV.2~U7PWSUUX0AE7.1 size=568509 2024-09-22T08:21:09.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.343+0000 7fe6c9c31780 1 < completed multipart upload key=4KRJ7DTE3KDV upload=U7PWSUUX0AE7 tag=Y5QUL6NBTZR7 type=write size=2665661 2024-09-22T08:21:09.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.345+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~4E0TVYSOE2WX.0 size=1048576 2024-09-22T08:21:09.348 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.346+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~4E0TVYSOE2WX.1 size=1048576 2024-09-22T08:21:09.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.348+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~4E0TVYSOE2WX.2 size=476820 2024-09-22T08:21:09.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.348+0000 7fe6c9c31780 1 > prepared multipart upload key=T2W6RXP9UGHH upload=4E0TVYSOE2WX tag=2NM7FU8EEPYJ type=write size=3622548 2024-09-22T08:21:09.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.349+0000 7fe6c9c31780 1 < completed delete operation key=4KRJ7DTE3KDV tag=30O3F1QRFRZT type=del 2024-09-22T08:21:09.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.353+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~0QMQMB4MPLM2.0 size=1048576 2024-09-22T08:21:09.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.353+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~0QMQMB4MPLM2.1 size=156842 2024-09-22T08:21:09.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.353+0000 7fe6c9c31780 1 > prepared multipart upload key=ILW34WLX48WN upload=0QMQMB4MPLM2 tag=32BHHUKD9CZG type=write size=2253994 2024-09-22T08:21:09.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.355+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~8CT7FWAV91SB.0 size=1048576 2024-09-22T08:21:09.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.356+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~8CT7FWAV91SB.1 size=1048576 2024-09-22T08:21:09.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.357+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~8CT7FWAV91SB.2 size=470917 2024-09-22T08:21:09.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.360+0000 7fe6c9c31780 1 < completed multipart upload key=FY40JTHLT0KU upload=8CT7FWAV91SB tag=2WKFU2DS1I2Z type=write size=3616645 2024-09-22T08:21:09.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.363+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~WGXAU6P2XQ0B.0 size=364055 2024-09-22T08:21:09.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.363+0000 7fe6c9c31780 1 > prepared multipart upload key=FY40JTHLT0KU upload=WGXAU6P2XQ0B tag=VMZ1KLQTU1D8 type=write size=1412631 2024-09-22T08:21:09.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.365+0000 7fe6c9c31780 1 < completed delete operation key=VP1MP4IC9A7T tag=ZIUU5VZ3DTR1 type=del 2024-09-22T08:21:09.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.366+0000 7fe6c9c31780 1 > prepared operation key=LA6ZRVULGQ0H tag=EPRQ85025CNH type=del size=439782 2024-09-22T08:21:09.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.368+0000 7fe6c9c31780 1 < completed delete operation key=CTK01Y0CV1NC tag=A3FP9GP2OCFS type=del 2024-09-22T08:21:09.372 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.371+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~LI5S01K9NLYU.0 size=1048576 2024-09-22T08:21:09.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.372+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~LI5S01K9NLYU.1 size=301301 2024-09-22T08:21:09.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.372+0000 7fe6c9c31780 1 > prepared multipart upload key=VP1MP4IC9A7T upload=LI5S01K9NLYU tag=14PTX1PMCGJ8 type=write size=2398453 2024-09-22T08:21:09.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.372+0000 7fe6c9c31780 1 < canceled part key=_multipart_LA6ZRVULGQ0H.2~5QO7E51810BQ.0 size=1048576 2024-09-22T08:21:09.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.373+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~5QO7E51810BQ.1 size=1048576 2024-09-22T08:21:09.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.375+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~5QO7E51810BQ.2 size=41758 2024-09-22T08:21:09.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.378+0000 7fe6c9c31780 1 < canceled multipart upload key=LA6ZRVULGQ0H upload=5QO7E51810BQ tag=QCHAH5XTJ6RQ type=write size=3187486 2024-09-22T08:21:09.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.380+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~DOIUC6XVIZ0U.0 size=1048576 2024-09-22T08:21:09.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.382+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~DOIUC6XVIZ0U.1 size=287377 2024-09-22T08:21:09.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.382+0000 7fe6c9c31780 1 > prepared multipart upload key=946H8F2AUPO2 upload=DOIUC6XVIZ0U tag=EWXDAELDVA4R type=write size=2384529 2024-09-22T08:21:09.384 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.382+0000 7fe6c9c31780 1 < completed delete operation key=D85LJGGU3Z6F tag=0UBMFCLJ8F4K type=del 2024-09-22T08:21:09.385 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.384+0000 7fe6c9c31780 1 > prepared operation key=O1UBUQXP50CN tag=IC6X8D69NYOL type=write size=561367 2024-09-22T08:21:09.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.384+0000 7fe6c9c31780 1 < canceled part key=_multipart_KZIY400KQ5NH.2~MXZUJG436WRI.0 size=1048576 2024-09-22T08:21:09.387 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.385+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~MXZUJG436WRI.1 size=559324 2024-09-22T08:21:09.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.388+0000 7fe6c9c31780 1 < canceled multipart upload key=KZIY400KQ5NH upload=MXZUJG436WRI tag=UUJBEU0KD6GT type=write size=2656476 2024-09-22T08:21:09.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.391+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~TT5EGFB1MQOS.0 size=1048576 2024-09-22T08:21:09.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.392+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~TT5EGFB1MQOS.1 size=1048576 2024-09-22T08:21:09.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.393+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~TT5EGFB1MQOS.2 size=329099 2024-09-22T08:21:09.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.393+0000 7fe6c9c31780 1 > prepared multipart upload key=VP1MP4IC9A7T upload=TT5EGFB1MQOS tag=AWKFEK3HOY3C type=write size=3474827 2024-09-22T08:21:09.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.394+0000 7fe6c9c31780 1 < completed delete operation key=LA6ZRVULGQ0H tag=PXWSJHB18HHC type=del 2024-09-22T08:21:09.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.396+0000 7fe6c9c31780 1 > prepared operation key=D85LJGGU3Z6F tag=L2QO0WPE8K1X type=del size=2763149 2024-09-22T08:21:09.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.397+0000 7fe6c9c31780 1 < completed delete operation key=R7UWMW913DJQ tag=JGYXB11PH9CA type=del 2024-09-22T08:21:09.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.400+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~4PQINZI1TEXO.0 size=1048576 2024-09-22T08:21:09.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.401+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~4PQINZI1TEXO.1 size=1048576 2024-09-22T08:21:09.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.403+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~4PQINZI1TEXO.2 size=426311 2024-09-22T08:21:09.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.403+0000 7fe6c9c31780 1 > prepared multipart upload key=7446WN19QFV0 upload=4PQINZI1TEXO tag=HYD1O13C0EPM type=write size=3572039 2024-09-22T08:21:09.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.404+0000 7fe6c9c31780 1 < completed part key=_multipart_GEWQUFB9K35E.2~436N5TVEX8Q6.0 size=363548 2024-09-22T08:21:09.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.407+0000 7fe6c9c31780 1 < completed multipart upload key=GEWQUFB9K35E upload=436N5TVEX8Q6 tag=UMCDIP20NUR4 type=write size=1412124 2024-09-22T08:21:09.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.408+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=5EOOELIRJT95 type=write size=120854 2024-09-22T08:21:09.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.410+0000 7fe6c9c31780 1 < completed write operation key=2B5QRUMTVE7U tag=MRNQ6KJ4FM8F type=write size=401317 2024-09-22T08:21:09.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.411+0000 7fe6c9c31780 1 > prepared operation key=LA6ZRVULGQ0H tag=93X4IY9ZRISR type=del size=25981 2024-09-22T08:21:09.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.412+0000 7fe6c9c31780 -1 < failed to complete operation key=6BKB91YV3FMW tag=1BAEGA3QR08O type=write size=284214: (22) Invalid argument 2024-09-22T08:21:09.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.415+0000 7fe6c9c31780 1 > prepared operation key=Z1CK5EDBK4AW tag=VO7S8ATQG0VX type=del size=1776789 2024-09-22T08:21:09.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.415+0000 7fe6c9c31780 1 < completed delete operation key=OX1LY7URY7IV tag=ZNCPFWEY5XC2 type=del 2024-09-22T08:21:09.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.417+0000 7fe6c9c31780 1 > prepared operation key=0PNK2ZW6IJM1 tag=6R89AOFWUGPE type=del size=316124 2024-09-22T08:21:09.420 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.418+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~P4RML4E4YSM9.0 size=1048576 2024-09-22T08:21:09.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.419+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~P4RML4E4YSM9.1 size=1048576 2024-09-22T08:21:09.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.420+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~P4RML4E4YSM9.2 size=651031 2024-09-22T08:21:09.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.423+0000 7fe6c9c31780 1 < completed multipart upload key=CTK01Y0CV1NC upload=P4RML4E4YSM9 tag=EBCBWKKZA5N6 type=write size=3796759 2024-09-22T08:21:09.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.424+0000 7fe6c9c31780 1 > prepared operation key=D85LJGGU3Z6F tag=JQFSSWDQFPIA type=write size=921244 2024-09-22T08:21:09.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.426+0000 7fe6c9c31780 1 < completed delete operation key=0TWY0NNZZ7NN tag=CW47YF32GR30 type=del 2024-09-22T08:21:09.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.427+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=KAYOBZPKAHS0 type=del size=2740367 2024-09-22T08:21:09.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.429+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~4E0TVYSOE2WX.0 size=1048576 2024-09-22T08:21:09.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.430+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~4E0TVYSOE2WX.1 size=1048576 2024-09-22T08:21:09.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.431+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~4E0TVYSOE2WX.2 size=476820 2024-09-22T08:21:09.435 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.434+0000 7fe6c9c31780 1 < completed multipart upload key=T2W6RXP9UGHH upload=4E0TVYSOE2WX tag=2NM7FU8EEPYJ type=write size=3622548 2024-09-22T08:21:09.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.435+0000 7fe6c9c31780 1 > prepared operation key=4KRJ7DTE3KDV tag=FD81I7B1HNWE type=write size=255803 2024-09-22T08:21:09.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.436+0000 7fe6c9c31780 1 < canceled part key=_multipart_ILW34WLX48WN.2~0QMQMB4MPLM2.0 size=1048576 2024-09-22T08:21:09.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.437+0000 7fe6c9c31780 1 < completed part key=_multipart_ILW34WLX48WN.2~0QMQMB4MPLM2.1 size=156842 2024-09-22T08:21:09.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.440+0000 7fe6c9c31780 1 < canceled multipart upload key=ILW34WLX48WN upload=0QMQMB4MPLM2 tag=32BHHUKD9CZG type=write size=2253994 2024-09-22T08:21:09.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.440+0000 7fe6c9c31780 1 > prepared operation key=4KRJ7DTE3KDV tag=YBXCGB53NDDC type=write size=1031405 2024-09-22T08:21:09.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.442+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~WGXAU6P2XQ0B.0 size=364055 2024-09-22T08:21:09.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.444+0000 7fe6c9c31780 1 < completed multipart upload key=FY40JTHLT0KU upload=WGXAU6P2XQ0B tag=VMZ1KLQTU1D8 type=write size=1412631 2024-09-22T08:21:09.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.447+0000 7fe6c9c31780 1 > prepared operation key=TJTB67QBLZH5 tag=HP85LDN6S6VF type=del size=722964 2024-09-22T08:21:09.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.449+0000 7fe6c9c31780 1 < completed delete operation key=LA6ZRVULGQ0H tag=EPRQ85025CNH type=del 2024-09-22T08:21:09.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.450+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=O715TFHLSJZJ type=del size=2195183 2024-09-22T08:21:09.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.452+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~LI5S01K9NLYU.0 size=1048576 2024-09-22T08:21:09.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.453+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~LI5S01K9NLYU.1 size=301301 2024-09-22T08:21:09.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.455+0000 7fe6c9c31780 1 < completed multipart upload key=VP1MP4IC9A7T upload=LI5S01K9NLYU tag=14PTX1PMCGJ8 type=write size=2398453 2024-09-22T08:21:09.458 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.457+0000 7fe6c9c31780 1 > prepared operation key=XJP26CCPYDI7 tag=KSTIW4W1WF9A type=write size=534920 2024-09-22T08:21:09.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.458+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~DOIUC6XVIZ0U.0 size=1048576 2024-09-22T08:21:09.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.459+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~DOIUC6XVIZ0U.1 size=287377 2024-09-22T08:21:09.463 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.462+0000 7fe6c9c31780 1 < completed multipart upload key=946H8F2AUPO2 upload=DOIUC6XVIZ0U tag=EWXDAELDVA4R type=write size=2384529 2024-09-22T08:21:09.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.463+0000 7fe6c9c31780 1 > prepared operation key=LA6ZRVULGQ0H tag=QXBD7XMTH68L type=write size=894387 2024-09-22T08:21:09.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.465+0000 7fe6c9c31780 1 < completed write operation key=O1UBUQXP50CN tag=IC6X8D69NYOL type=write size=561367 2024-09-22T08:21:09.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.466+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=MX0Z2EKI5BJ5 type=del size=855401 2024-09-22T08:21:09.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.468+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~TT5EGFB1MQOS.0 size=1048576 2024-09-22T08:21:09.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.469+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~TT5EGFB1MQOS.1 size=1048576 2024-09-22T08:21:09.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.471+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~TT5EGFB1MQOS.2 size=329099 2024-09-22T08:21:09.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.473+0000 7fe6c9c31780 1 < completed multipart upload key=VP1MP4IC9A7T upload=TT5EGFB1MQOS tag=AWKFEK3HOY3C type=write size=3474827 2024-09-22T08:21:09.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.475+0000 7fe6c9c31780 1 > prepared operation key=1HZ0NAJPXNW1 tag=6U0V8AHNNR7I type=del size=2495576 2024-09-22T08:21:09.478 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.477+0000 7fe6c9c31780 1 < completed delete operation key=D85LJGGU3Z6F tag=L2QO0WPE8K1X type=del 2024-09-22T08:21:09.481 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.480+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~RZZNWJUO8YNJ.0 size=967878 2024-09-22T08:21:09.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.480+0000 7fe6c9c31780 1 > prepared multipart upload key=VP1MP4IC9A7T upload=RZZNWJUO8YNJ tag=EKU20BLKHZ08 type=write size=2016454 2024-09-22T08:21:09.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.482+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~4PQINZI1TEXO.0 size=1048576 2024-09-22T08:21:09.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.483+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~4PQINZI1TEXO.1 size=1048576 2024-09-22T08:21:09.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.484+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~4PQINZI1TEXO.2 size=426311 2024-09-22T08:21:09.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.486+0000 7fe6c9c31780 1 < completed multipart upload key=7446WN19QFV0 upload=4PQINZI1TEXO tag=HYD1O13C0EPM type=write size=3572039 2024-09-22T08:21:09.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.488+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=TYA1T1ART0TS type=del size=1851828 2024-09-22T08:21:09.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.490+0000 7fe6c9c31780 1 < completed write operation key=6BKB91YV3FMW tag=5EOOELIRJT95 type=write size=120854 2024-09-22T08:21:09.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.491+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=G6XHF1GU2VF8 type=write size=130925 2024-09-22T08:21:09.495 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.493+0000 7fe6c9c31780 1 < completed delete operation key=LA6ZRVULGQ0H tag=93X4IY9ZRISR type=del 2024-09-22T08:21:09.497 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.496+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~WFQETZ8FNQZ8.0 size=1048576 2024-09-22T08:21:09.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.498+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~WFQETZ8FNQZ8.1 size=1048576 2024-09-22T08:21:09.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.498+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~WFQETZ8FNQZ8.2 size=293695 2024-09-22T08:21:09.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.498+0000 7fe6c9c31780 1 > prepared multipart upload key=D85LJGGU3Z6F upload=WFQETZ8FNQZ8 tag=6DDM0FO304SW type=write size=3439423 2024-09-22T08:21:09.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.501+0000 7fe6c9c31780 1 < suggested update operation key=Z1CK5EDBK4AW tag=VO7S8ATQG0VX type=del size=1776789 2024-09-22T08:21:09.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.503+0000 7fe6c9c31780 1 > prepared operation key=D85LJGGU3Z6F tag=OPM8OS7K8MGC type=del size=3723884 2024-09-22T08:21:09.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.504+0000 7fe6c9c31780 1 < completed delete operation key=0PNK2ZW6IJM1 tag=6R89AOFWUGPE type=del 2024-09-22T08:21:09.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.506+0000 7fe6c9c31780 1 > prepared operation key=4KRJ7DTE3KDV tag=KC6JUF84THE8 type=del size=3192975 2024-09-22T08:21:09.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.508+0000 7fe6c9c31780 1 < completed write operation key=D85LJGGU3Z6F tag=JQFSSWDQFPIA type=write size=921244 2024-09-22T08:21:09.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.509+0000 7fe6c9c31780 1 > prepared operation key=VP1MP4IC9A7T tag=Z0HC5G5ELKZA type=del size=675135 2024-09-22T08:21:09.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.510+0000 7fe6c9c31780 1 < canceled operation key=TE10GB1F35X4 tag=KAYOBZPKAHS0 type=del size=2740367 2024-09-22T08:21:09.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.512+0000 7fe6c9c31780 1 > prepared operation key=VP1MP4IC9A7T tag=QUF2VWQANSDM type=del size=2571364 2024-09-22T08:21:09.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.514+0000 7fe6c9c31780 1 < completed write operation key=4KRJ7DTE3KDV tag=FD81I7B1HNWE type=write size=255803 2024-09-22T08:21:09.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.516+0000 7fe6c9c31780 1 > prepared operation key=FY40JTHLT0KU tag=M2YRZFZ9EP5C type=del size=2325058 2024-09-22T08:21:09.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.517+0000 7fe6c9c31780 1 < completed write operation key=4KRJ7DTE3KDV tag=YBXCGB53NDDC type=write size=1031405 2024-09-22T08:21:09.520 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.519+0000 7fe6c9c31780 1 > prepared operation key=W9L87PTJEIOA tag=NXZQ4G58X70N type=del size=2943679 2024-09-22T08:21:09.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.520+0000 7fe6c9c31780 1 < completed delete operation key=TJTB67QBLZH5 tag=HP85LDN6S6VF type=del 2024-09-22T08:21:09.524 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.523+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~SY1W1FQD28QD.0 size=1048576 2024-09-22T08:21:09.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.524+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~SY1W1FQD28QD.1 size=421076 2024-09-22T08:21:09.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.524+0000 7fe6c9c31780 1 > prepared multipart upload key=7446WN19QFV0 upload=SY1W1FQD28QD tag=UY1GP675WCQV type=write size=2518228 2024-09-22T08:21:09.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.525+0000 7fe6c9c31780 1 < canceled operation key=0TWY0NNZZ7NN tag=O715TFHLSJZJ type=del size=2195183 2024-09-22T08:21:09.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.527+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=TJ7FT03837PX type=write size=464140 2024-09-22T08:21:09.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.530+0000 7fe6c9c31780 1 < suggested remove operation key=XJP26CCPYDI7 tag=KSTIW4W1WF9A type=write 2024-09-22T08:21:09.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.533+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~TGBC5CK4M0DS.0 size=1048576 2024-09-22T08:21:09.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.534+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~TGBC5CK4M0DS.1 size=281566 2024-09-22T08:21:09.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.534+0000 7fe6c9c31780 1 > prepared multipart upload key=946H8F2AUPO2 upload=TGBC5CK4M0DS tag=IIIE5IPNSOND type=write size=2378718 2024-09-22T08:21:09.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.537+0000 7fe6c9c31780 1 < suggested update operation key=LA6ZRVULGQ0H tag=QXBD7XMTH68L type=write size=894387 2024-09-22T08:21:09.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.540+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~6GUTRJ1B6OF8.0 size=1048576 2024-09-22T08:21:09.542 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.540+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~6GUTRJ1B6OF8.1 size=159123 2024-09-22T08:21:09.542 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.540+0000 7fe6c9c31780 1 > prepared multipart upload key=KZIY400KQ5NH upload=6GUTRJ1B6OF8 tag=4T77PB2VPCDL type=write size=2256275 2024-09-22T08:21:09.543 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.542+0000 7fe6c9c31780 1 < completed delete operation key=DC7VLQWZ3TD1 tag=MX0Z2EKI5BJ5 type=del 2024-09-22T08:21:09.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.546+0000 7fe6c9c31780 1 > prepared part key=_multipart_ZFL9N44PBQX4.2~6VIVLEMUBCA1.0 size=1048576 2024-09-22T08:21:09.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.548+0000 7fe6c9c31780 1 > prepared part key=_multipart_ZFL9N44PBQX4.2~6VIVLEMUBCA1.1 size=1048576 2024-09-22T08:21:09.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.549+0000 7fe6c9c31780 1 > prepared part key=_multipart_ZFL9N44PBQX4.2~6VIVLEMUBCA1.2 size=42171 2024-09-22T08:21:09.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.549+0000 7fe6c9c31780 1 > prepared multipart upload key=ZFL9N44PBQX4 upload=6VIVLEMUBCA1 tag=VFIUL8HF2S3T type=write size=3187899 2024-09-22T08:21:09.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.552+0000 7fe6c9c31780 1 < suggested remove operation key=1HZ0NAJPXNW1 tag=6U0V8AHNNR7I type=del 2024-09-22T08:21:09.555 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.554+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=QNTP6DRNMG82 type=del size=1257430 2024-09-22T08:21:09.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.555+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~RZZNWJUO8YNJ.0 size=967878 2024-09-22T08:21:09.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.558+0000 7fe6c9c31780 1 < completed multipart upload key=VP1MP4IC9A7T upload=RZZNWJUO8YNJ tag=EKU20BLKHZ08 type=write size=2016454 2024-09-22T08:21:09.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.560+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=22NQE7HOBUB2 type=write size=791041 2024-09-22T08:21:09.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.561+0000 7fe6c9c31780 1 < completed delete operation key=T2W6RXP9UGHH tag=TYA1T1ART0TS type=del 2024-09-22T08:21:09.566 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.565+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~SBYAR5TYQ5QA.0 size=1048576 2024-09-22T08:21:09.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.567+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~SBYAR5TYQ5QA.1 size=179730 2024-09-22T08:21:09.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.567+0000 7fe6c9c31780 1 > prepared multipart upload key=TYVQ39KUV2V9 upload=SBYAR5TYQ5QA tag=YA4AY0D6L6F7 type=write size=2276882 2024-09-22T08:21:09.569 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.568+0000 7fe6c9c31780 1 < completed write operation key=DC7VLQWZ3TD1 tag=G6XHF1GU2VF8 type=write size=130925 2024-09-22T08:21:09.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.570+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=36Z5XPXFGLRT type=del size=3293281 2024-09-22T08:21:09.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.571+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~WFQETZ8FNQZ8.0 size=1048576 2024-09-22T08:21:09.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.572+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~WFQETZ8FNQZ8.1 size=1048576 2024-09-22T08:21:09.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.574+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~WFQETZ8FNQZ8.2 size=293695 2024-09-22T08:21:09.578 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.576+0000 7fe6c9c31780 1 < completed multipart upload key=D85LJGGU3Z6F upload=WFQETZ8FNQZ8 tag=6DDM0FO304SW type=write size=3439423 2024-09-22T08:21:09.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.578+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=Y9LD2WPQTWSB type=del size=1422185 2024-09-22T08:21:09.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.580+0000 7fe6c9c31780 1 < completed delete operation key=D85LJGGU3Z6F tag=OPM8OS7K8MGC type=del 2024-09-22T08:21:09.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.581+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=8QE7YG960O7D type=del size=616105 2024-09-22T08:21:09.584 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.583+0000 7fe6c9c31780 1 < completed delete operation key=4KRJ7DTE3KDV tag=KC6JUF84THE8 type=del 2024-09-22T08:21:09.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.586+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~2CD188KD5JX1.0 size=406531 2024-09-22T08:21:09.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.586+0000 7fe6c9c31780 1 > prepared multipart upload key=7446WN19QFV0 upload=2CD188KD5JX1 tag=7WKM16G5MO1G type=write size=1455107 2024-09-22T08:21:09.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.587+0000 7fe6c9c31780 1 < completed delete operation key=VP1MP4IC9A7T tag=Z0HC5G5ELKZA type=del 2024-09-22T08:21:09.590 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.589+0000 7fe6c9c31780 1 > prepared operation key=OX1LY7URY7IV tag=DTAQUVCG67Q4 type=write size=257130 2024-09-22T08:21:09.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.590+0000 7fe6c9c31780 1 < completed delete operation key=VP1MP4IC9A7T tag=QUF2VWQANSDM type=del 2024-09-22T08:21:09.594 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.592+0000 7fe6c9c31780 1 > prepared operation key=4KRJ7DTE3KDV tag=8J88ACYTHKMZ type=del size=3515706 2024-09-22T08:21:09.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.596+0000 7fe6c9c31780 1 < suggested remove operation key=FY40JTHLT0KU tag=M2YRZFZ9EP5C type=del 2024-09-22T08:21:09.598 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.596+0000 7fe6c9c31780 1 > prepared operation key=9FCSIF1WKBDJ tag=LOAA915EVTN8 type=del size=2116991 2024-09-22T08:21:09.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.598+0000 7fe6c9c31780 1 < completed delete operation key=W9L87PTJEIOA tag=NXZQ4G58X70N type=del 2024-09-22T08:21:09.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.600+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=1E9QL2O1PM51 type=del size=2331125 2024-09-22T08:21:09.603 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.601+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~SY1W1FQD28QD.0 size=1048576 2024-09-22T08:21:09.604 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.602+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~SY1W1FQD28QD.1 size=421076 2024-09-22T08:21:09.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.606+0000 7fe6c9c31780 1 < completed multipart upload key=7446WN19QFV0 upload=SY1W1FQD28QD tag=UY1GP675WCQV type=write size=2518228 2024-09-22T08:21:09.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.609+0000 7fe6c9c31780 1 > prepared part key=_multipart_TJTB67QBLZH5.2~W73MQWO4GTHG.0 size=1048576 2024-09-22T08:21:09.611 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.610+0000 7fe6c9c31780 1 > prepared part key=_multipart_TJTB67QBLZH5.2~W73MQWO4GTHG.1 size=55751 2024-09-22T08:21:09.611 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.610+0000 7fe6c9c31780 1 > prepared multipart upload key=TJTB67QBLZH5 upload=W73MQWO4GTHG tag=4YA9APBIEGX1 type=write size=2152903 2024-09-22T08:21:09.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.611+0000 7fe6c9c31780 1 < canceled operation key=T2W6RXP9UGHH tag=TJ7FT03837PX type=write size=464140 2024-09-22T08:21:09.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.614+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~D357IFZTWQ3U.0 size=18626 2024-09-22T08:21:09.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.614+0000 7fe6c9c31780 1 > prepared multipart upload key=T2W6RXP9UGHH upload=D357IFZTWQ3U tag=VSGW6OY4BTM1 type=write size=1067202 2024-09-22T08:21:09.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.614+0000 7fe6c9c31780 1 < canceled part key=_multipart_946H8F2AUPO2.2~TGBC5CK4M0DS.0 size=1048576 2024-09-22T08:21:09.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.615+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~TGBC5CK4M0DS.1 size=281566 2024-09-22T08:21:09.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.618+0000 7fe6c9c31780 1 < canceled multipart upload key=946H8F2AUPO2 upload=TGBC5CK4M0DS tag=IIIE5IPNSOND type=write size=2378718 2024-09-22T08:21:09.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.619+0000 7fe6c9c31780 1 > prepared operation key=JT5AB8VLMEFD tag=D0PLFIFNNF8X type=del size=1327519 2024-09-22T08:21:09.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.621+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~6GUTRJ1B6OF8.0 size=1048576 2024-09-22T08:21:09.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.622+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~6GUTRJ1B6OF8.1 size=159123 2024-09-22T08:21:09.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.625+0000 7fe6c9c31780 1 < completed multipart upload key=KZIY400KQ5NH upload=6GUTRJ1B6OF8 tag=4T77PB2VPCDL type=write size=2256275 2024-09-22T08:21:09.629 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.628+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~X5ITO1NL17WC.0 size=1048576 2024-09-22T08:21:09.631 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.629+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~X5ITO1NL17WC.1 size=1020090 2024-09-22T08:21:09.631 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.629+0000 7fe6c9c31780 1 > prepared multipart upload key=9FCSIF1WKBDJ upload=X5ITO1NL17WC tag=MVZ96GWOAOVX type=write size=3117242 2024-09-22T08:21:09.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.631+0000 7fe6c9c31780 1 < completed part key=_multipart_ZFL9N44PBQX4.2~6VIVLEMUBCA1.0 size=1048576 2024-09-22T08:21:09.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.632+0000 7fe6c9c31780 1 < completed part key=_multipart_ZFL9N44PBQX4.2~6VIVLEMUBCA1.1 size=1048576 2024-09-22T08:21:09.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.633+0000 7fe6c9c31780 1 < completed part key=_multipart_ZFL9N44PBQX4.2~6VIVLEMUBCA1.2 size=42171 2024-09-22T08:21:09.637 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.636+0000 7fe6c9c31780 1 < completed multipart upload key=ZFL9N44PBQX4 upload=6VIVLEMUBCA1 tag=VFIUL8HF2S3T type=write size=3187899 2024-09-22T08:21:09.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.639+0000 7fe6c9c31780 1 > prepared part key=_multipart_9AZWQ9E58QS6.2~W0RGHO5LM04S.0 size=1022414 2024-09-22T08:21:09.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.639+0000 7fe6c9c31780 1 > prepared multipart upload key=9AZWQ9E58QS6 upload=W0RGHO5LM04S tag=70ZX68DZUU1Z type=write size=2070990 2024-09-22T08:21:09.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.640+0000 7fe6c9c31780 1 < completed delete operation key=9AZWQ9E58QS6 tag=QNTP6DRNMG82 type=del 2024-09-22T08:21:09.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.642+0000 7fe6c9c31780 1 > prepared operation key=XJP26CCPYDI7 tag=4W6BYXMG4JS5 type=del size=3959005 2024-09-22T08:21:09.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.646+0000 7fe6c9c31780 1 < suggested update operation key=76HZ3LZGVT9J tag=22NQE7HOBUB2 type=write size=791041 2024-09-22T08:21:09.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.648+0000 7fe6c9c31780 1 > prepared operation key=W9L87PTJEIOA tag=UNGZS2YIASPL type=del size=3764374 2024-09-22T08:21:09.651 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.649+0000 7fe6c9c31780 1 < completed part key=_multipart_TYVQ39KUV2V9.2~SBYAR5TYQ5QA.0 size=1048576 2024-09-22T08:21:09.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.650+0000 7fe6c9c31780 1 < completed part key=_multipart_TYVQ39KUV2V9.2~SBYAR5TYQ5QA.1 size=179730 2024-09-22T08:21:09.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.653+0000 7fe6c9c31780 1 < completed multipart upload key=TYVQ39KUV2V9 upload=SBYAR5TYQ5QA tag=YA4AY0D6L6F7 type=write size=2276882 2024-09-22T08:21:09.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.654+0000 7fe6c9c31780 1 > prepared operation key=VP1MP4IC9A7T tag=QMZ4KERVHOVD type=write size=408119 2024-09-22T08:21:09.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.658+0000 7fe6c9c31780 1 < suggested update operation key=TE10GB1F35X4 tag=36Z5XPXFGLRT type=del size=3293281 2024-09-22T08:21:09.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.659+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=WSJ7E1JOWTTD type=write size=377069 2024-09-22T08:21:09.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.661+0000 7fe6c9c31780 1 < canceled operation key=946H8F2AUPO2 tag=Y9LD2WPQTWSB type=del size=1422185 2024-09-22T08:21:09.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.663+0000 7fe6c9c31780 1 > prepared operation key=ZFL9N44PBQX4 tag=VR177LOBN80Z type=del size=3685899 2024-09-22T08:21:09.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.664+0000 7fe6c9c31780 1 < completed delete operation key=DC7VLQWZ3TD1 tag=8QE7YG960O7D type=del 2024-09-22T08:21:09.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.667+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~7KV9KSQ22Z25.0 size=495467 2024-09-22T08:21:09.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.667+0000 7fe6c9c31780 1 > prepared multipart upload key=DC7VLQWZ3TD1 upload=7KV9KSQ22Z25 tag=799VNWQ93JZ3 type=write size=1544043 2024-09-22T08:21:09.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.668+0000 7fe6c9c31780 1 < canceled part key=_multipart_7446WN19QFV0.2~2CD188KD5JX1.0 size=406531 2024-09-22T08:21:09.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.670+0000 7fe6c9c31780 1 < canceled multipart upload key=7446WN19QFV0 upload=2CD188KD5JX1 tag=7WKM16G5MO1G type=write size=1455107 2024-09-22T08:21:09.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.672+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=4AVDCUQP2K0L type=del size=3610543 2024-09-22T08:21:09.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.673+0000 7fe6c9c31780 1 < completed write operation key=OX1LY7URY7IV tag=DTAQUVCG67Q4 type=write size=257130 2024-09-22T08:21:09.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.676+0000 7fe6c9c31780 1 > prepared part key=_multipart_ZFL9N44PBQX4.2~B1PA8VEYQQIX.0 size=1048576 2024-09-22T08:21:09.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.677+0000 7fe6c9c31780 1 > prepared part key=_multipart_ZFL9N44PBQX4.2~B1PA8VEYQQIX.1 size=1048576 2024-09-22T08:21:09.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.678+0000 7fe6c9c31780 1 > prepared part key=_multipart_ZFL9N44PBQX4.2~B1PA8VEYQQIX.2 size=302855 2024-09-22T08:21:09.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.678+0000 7fe6c9c31780 1 > prepared multipart upload key=ZFL9N44PBQX4 upload=B1PA8VEYQQIX tag=J7VG0BB3I5B1 type=write size=3448583 2024-09-22T08:21:09.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.679+0000 7fe6c9c31780 1 < completed delete operation key=4KRJ7DTE3KDV tag=8J88ACYTHKMZ type=del 2024-09-22T08:21:09.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.681+0000 7fe6c9c31780 1 > prepared operation key=VP1MP4IC9A7T tag=3ICRSPZB4336 type=del size=579816 2024-09-22T08:21:09.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.682+0000 7fe6c9c31780 1 < completed delete operation key=9FCSIF1WKBDJ tag=LOAA915EVTN8 type=del 2024-09-22T08:21:09.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.686+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~YBX4W6T4PDZU.0 size=1048576 2024-09-22T08:21:09.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.686+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~YBX4W6T4PDZU.1 size=529101 2024-09-22T08:21:09.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.686+0000 7fe6c9c31780 1 > prepared multipart upload key=KZIY400KQ5NH upload=YBX4W6T4PDZU tag=F6ECS9428C15 type=write size=2626253 2024-09-22T08:21:09.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.690+0000 7fe6c9c31780 1 < suggested update operation key=2B5QRUMTVE7U tag=1E9QL2O1PM51 type=del size=2331125 2024-09-22T08:21:09.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.691+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=G9X3L3I2SD00 type=del size=772998 2024-09-22T08:21:09.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.692+0000 7fe6c9c31780 1 < completed part key=_multipart_TJTB67QBLZH5.2~W73MQWO4GTHG.0 size=1048576 2024-09-22T08:21:09.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.695+0000 7fe6c9c31780 1 < completed part key=_multipart_TJTB67QBLZH5.2~W73MQWO4GTHG.1 size=55751 2024-09-22T08:21:09.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.699+0000 7fe6c9c31780 1 < completed multipart upload key=TJTB67QBLZH5 upload=W73MQWO4GTHG tag=4YA9APBIEGX1 type=write size=2152903 2024-09-22T08:21:09.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.700+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~K2S8OEHEFEJS.0 size=533737 2024-09-22T08:21:09.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.700+0000 7fe6c9c31780 1 > prepared multipart upload key=CTK01Y0CV1NC upload=K2S8OEHEFEJS tag=X1XI4O2NBYMQ type=write size=1582313 2024-09-22T08:21:09.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.702+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~D357IFZTWQ3U.0 size=18626 2024-09-22T08:21:09.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.704+0000 7fe6c9c31780 1 < completed multipart upload key=T2W6RXP9UGHH upload=D357IFZTWQ3U tag=VSGW6OY4BTM1 type=write size=1067202 2024-09-22T08:21:09.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.706+0000 7fe6c9c31780 1 > prepared operation key=TYVQ39KUV2V9 tag=CF8CPG6FWM95 type=del size=3462147 2024-09-22T08:21:09.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.707+0000 7fe6c9c31780 1 < canceled operation key=JT5AB8VLMEFD tag=D0PLFIFNNF8X type=del size=1327519 2024-09-22T08:21:09.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.709+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=XJJKDYEZ23QN type=del size=2681921 2024-09-22T08:21:09.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.711+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~X5ITO1NL17WC.0 size=1048576 2024-09-22T08:21:09.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.713+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~X5ITO1NL17WC.1 size=1020090 2024-09-22T08:21:09.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.715+0000 7fe6c9c31780 1 < completed multipart upload key=9FCSIF1WKBDJ upload=X5ITO1NL17WC tag=MVZ96GWOAOVX type=write size=3117242 2024-09-22T08:21:09.718 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.716+0000 7fe6c9c31780 1 > prepared operation key=XJP26CCPYDI7 tag=ZDBW2MLD7W6C type=del size=1105718 2024-09-22T08:21:09.718 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.717+0000 7fe6c9c31780 1 < canceled part key=_multipart_9AZWQ9E58QS6.2~W0RGHO5LM04S.0 size=1022414 2024-09-22T08:21:09.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.719+0000 7fe6c9c31780 1 < canceled multipart upload key=9AZWQ9E58QS6 upload=W0RGHO5LM04S tag=70ZX68DZUU1Z type=write size=2070990 2024-09-22T08:21:09.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.721+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=K3NGTMJOZKDG type=write size=1026019 2024-09-22T08:21:09.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.722+0000 7fe6c9c31780 1 < completed delete operation key=XJP26CCPYDI7 tag=4W6BYXMG4JS5 type=del 2024-09-22T08:21:09.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.723+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=AA77X0PNFDQS type=del size=445252 2024-09-22T08:21:09.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.725+0000 7fe6c9c31780 1 < completed delete operation key=W9L87PTJEIOA tag=UNGZS2YIASPL type=del 2024-09-22T08:21:09.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.726+0000 7fe6c9c31780 1 > prepared operation key=0PNK2ZW6IJM1 tag=7F6NJAEV54S6 type=del size=1980605 2024-09-22T08:21:09.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.728+0000 7fe6c9c31780 1 < completed write operation key=VP1MP4IC9A7T tag=QMZ4KERVHOVD type=write size=408119 2024-09-22T08:21:09.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.729+0000 7fe6c9c31780 1 > prepared operation key=TYVQ39KUV2V9 tag=NBXXSWZVWV46 type=del size=1170133 2024-09-22T08:21:09.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.731+0000 7fe6c9c31780 1 < completed write operation key=7446WN19QFV0 tag=WSJ7E1JOWTTD type=write size=377069 2024-09-22T08:21:09.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.732+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=EBTSW1XSIM9J type=del size=3296970 2024-09-22T08:21:09.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.733+0000 7fe6c9c31780 1 < completed delete operation key=ZFL9N44PBQX4 tag=VR177LOBN80Z type=del 2024-09-22T08:21:09.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.736+0000 7fe6c9c31780 1 > prepared operation key=D85LJGGU3Z6F tag=C2OQDCT6AXBD type=del size=1030042 2024-09-22T08:21:09.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.737+0000 7fe6c9c31780 1 < completed part key=_multipart_DC7VLQWZ3TD1.2~7KV9KSQ22Z25.0 size=495467 2024-09-22T08:21:09.741 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.739+0000 7fe6c9c31780 1 < completed multipart upload key=DC7VLQWZ3TD1 upload=7KV9KSQ22Z25 tag=799VNWQ93JZ3 type=write size=1544043 2024-09-22T08:21:09.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.741+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=PDDM37CHXMP1 type=del size=3232206 2024-09-22T08:21:09.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.742+0000 7fe6c9c31780 -1 < failed to complete operation key=2B5QRUMTVE7U tag=4AVDCUQP2K0L type=del size=3610543: (22) Invalid argument 2024-09-22T08:21:09.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.745+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~TEOTON7C34BN.0 size=1048576 2024-09-22T08:21:09.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.747+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~TEOTON7C34BN.1 size=1043854 2024-09-22T08:21:09.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.747+0000 7fe6c9c31780 1 > prepared multipart upload key=946H8F2AUPO2 upload=TEOTON7C34BN tag=XDEIKM81J3PI type=write size=3141006 2024-09-22T08:21:09.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.748+0000 7fe6c9c31780 1 < completed part key=_multipart_ZFL9N44PBQX4.2~B1PA8VEYQQIX.0 size=1048576 2024-09-22T08:21:09.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.749+0000 7fe6c9c31780 1 < completed part key=_multipart_ZFL9N44PBQX4.2~B1PA8VEYQQIX.1 size=1048576 2024-09-22T08:21:09.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.750+0000 7fe6c9c31780 1 < completed part key=_multipart_ZFL9N44PBQX4.2~B1PA8VEYQQIX.2 size=302855 2024-09-22T08:21:09.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.753+0000 7fe6c9c31780 1 < completed multipart upload key=ZFL9N44PBQX4 upload=B1PA8VEYQQIX tag=J7VG0BB3I5B1 type=write size=3448583 2024-09-22T08:21:09.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.754+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=DPXIZBH0TUIG type=del size=283684 2024-09-22T08:21:09.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.755+0000 7fe6c9c31780 1 < completed delete operation key=VP1MP4IC9A7T tag=3ICRSPZB4336 type=del 2024-09-22T08:21:09.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.758+0000 7fe6c9c31780 1 > prepared part key=_multipart_R7UWMW913DJQ.2~8YKSH4F8RJPI.0 size=518973 2024-09-22T08:21:09.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.758+0000 7fe6c9c31780 1 > prepared multipart upload key=R7UWMW913DJQ upload=8YKSH4F8RJPI tag=QRK65V40MJEB type=write size=1567549 2024-09-22T08:21:09.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.758+0000 7fe6c9c31780 1 < canceled part key=_multipart_KZIY400KQ5NH.2~YBX4W6T4PDZU.0 size=1048576 2024-09-22T08:21:09.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.759+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~YBX4W6T4PDZU.1 size=529101 2024-09-22T08:21:09.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.762+0000 7fe6c9c31780 1 < canceled multipart upload key=KZIY400KQ5NH upload=YBX4W6T4PDZU tag=F6ECS9428C15 type=write size=2626253 2024-09-22T08:21:09.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.763+0000 7fe6c9c31780 1 > prepared operation key=9FCSIF1WKBDJ tag=70QUR5KTQ7KF type=write size=811929 2024-09-22T08:21:09.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.767+0000 7fe6c9c31780 1 < suggested update operation key=76HZ3LZGVT9J tag=G9X3L3I2SD00 type=del size=772998 2024-09-22T08:21:09.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.769+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~LYFBSWTQB5MV.0 size=1022917 2024-09-22T08:21:09.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.769+0000 7fe6c9c31780 1 > prepared multipart upload key=CTK01Y0CV1NC upload=LYFBSWTQB5MV tag=TX8OJIJYDFMI type=write size=2071493 2024-09-22T08:21:09.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.771+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~K2S8OEHEFEJS.0 size=533737 2024-09-22T08:21:09.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.774+0000 7fe6c9c31780 1 < completed multipart upload key=CTK01Y0CV1NC upload=K2S8OEHEFEJS tag=X1XI4O2NBYMQ type=write size=1582313 2024-09-22T08:21:09.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.775+0000 7fe6c9c31780 1 > prepared operation key=D85LJGGU3Z6F tag=AV35UAFFXS3C type=del size=2420013 2024-09-22T08:21:09.779 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.778+0000 7fe6c9c31780 1 < suggested remove operation key=TYVQ39KUV2V9 tag=CF8CPG6FWM95 type=del 2024-09-22T08:21:09.781 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.779+0000 7fe6c9c31780 1 > prepared operation key=D85LJGGU3Z6F tag=GA98N3F8VEXH type=del size=1344308 2024-09-22T08:21:09.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.782+0000 7fe6c9c31780 1 < suggested remove operation key=CTK01Y0CV1NC tag=XJJKDYEZ23QN type=del 2024-09-22T08:21:09.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.783+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=TA476TTCCWPY type=del size=1373585 2024-09-22T08:21:09.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.784+0000 7fe6c9c31780 1 < completed delete operation key=XJP26CCPYDI7 tag=ZDBW2MLD7W6C type=del 2024-09-22T08:21:09.787 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.786+0000 7fe6c9c31780 1 > prepared operation key=4KRJ7DTE3KDV tag=MR91XG18Q96J type=del size=2183257 2024-09-22T08:21:09.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.787+0000 7fe6c9c31780 1 < completed write operation key=TE10GB1F35X4 tag=K3NGTMJOZKDG type=write size=1026019 2024-09-22T08:21:09.791 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.790+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~2CSXJQ3K7EJB.0 size=240265 2024-09-22T08:21:09.791 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.790+0000 7fe6c9c31780 1 > prepared multipart upload key=6BKB91YV3FMW upload=2CSXJQ3K7EJB tag=1ENM30D7NG8R type=write size=1288841 2024-09-22T08:21:09.792 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.791+0000 7fe6c9c31780 1 < completed delete operation key=0TWY0NNZZ7NN tag=AA77X0PNFDQS type=del 2024-09-22T08:21:09.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.794+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~86DLZV7QSM1W.0 size=1048576 2024-09-22T08:21:09.796 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.794+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~86DLZV7QSM1W.1 size=1929 2024-09-22T08:21:09.796 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.794+0000 7fe6c9c31780 1 > prepared multipart upload key=76HZ3LZGVT9J upload=86DLZV7QSM1W tag=U2HDTGIBYCQ6 type=write size=2099081 2024-09-22T08:21:09.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.796+0000 7fe6c9c31780 1 < completed delete operation key=0PNK2ZW6IJM1 tag=7F6NJAEV54S6 type=del 2024-09-22T08:21:09.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.798+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=7SV4MBHCQ75J type=del size=2995273 2024-09-22T08:21:09.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.799+0000 7fe6c9c31780 -1 < failed to complete operation key=TYVQ39KUV2V9 tag=NBXXSWZVWV46 type=del size=1170133: (22) Invalid argument 2024-09-22T08:21:09.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.800+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=KHYETFZ2IUIB type=del size=1841357 2024-09-22T08:21:09.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.802+0000 7fe6c9c31780 1 < canceled operation key=R7UWMW913DJQ tag=EBTSW1XSIM9J type=del size=3296970 2024-09-22T08:21:09.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.804+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~UMSJM1OQ93XW.0 size=1048576 2024-09-22T08:21:09.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.806+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~UMSJM1OQ93XW.1 size=1008182 2024-09-22T08:21:09.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.806+0000 7fe6c9c31780 1 > prepared multipart upload key=JT5AB8VLMEFD upload=UMSJM1OQ93XW tag=SYVO3YHKQ1AH type=write size=3105334 2024-09-22T08:21:09.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.807+0000 7fe6c9c31780 1 < canceled operation key=D85LJGGU3Z6F tag=C2OQDCT6AXBD type=del size=1030042 2024-09-22T08:21:09.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.808+0000 7fe6c9c31780 1 > prepared operation key=GEWQUFB9K35E tag=OAM36R9TPJSA type=del size=2642733 2024-09-22T08:21:09.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.810+0000 7fe6c9c31780 1 < canceled operation key=ILW34WLX48WN tag=PDDM37CHXMP1 type=del size=3232206 2024-09-22T08:21:09.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.811+0000 7fe6c9c31780 1 > prepared operation key=TJTB67QBLZH5 tag=RWE9Y7S5U5G7 type=del size=2838202 2024-09-22T08:21:09.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.813+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~TEOTON7C34BN.0 size=1048576 2024-09-22T08:21:09.815 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.814+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~TEOTON7C34BN.1 size=1043854 2024-09-22T08:21:09.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.816+0000 7fe6c9c31780 1 < completed multipart upload key=946H8F2AUPO2 upload=TEOTON7C34BN tag=XDEIKM81J3PI type=write size=3141006 2024-09-22T08:21:09.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.818+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~IRABUL1LUHRZ.0 size=1048576 2024-09-22T08:21:09.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.819+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~IRABUL1LUHRZ.1 size=490625 2024-09-22T08:21:09.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.819+0000 7fe6c9c31780 1 > prepared multipart upload key=O1UBUQXP50CN upload=IRABUL1LUHRZ tag=BW7WB51XM527 type=write size=2587777 2024-09-22T08:21:09.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.823+0000 7fe6c9c31780 1 < suggested remove operation key=DC7VLQWZ3TD1 tag=DPXIZBH0TUIG type=del 2024-09-22T08:21:09.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.826+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~ZTSKS3LS6DNO.0 size=1048576 2024-09-22T08:21:09.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.827+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~ZTSKS3LS6DNO.1 size=907226 2024-09-22T08:21:09.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.827+0000 7fe6c9c31780 1 > prepared multipart upload key=CTK01Y0CV1NC upload=ZTSKS3LS6DNO tag=7OENAJPN8AD4 type=write size=3004378 2024-09-22T08:21:09.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.828+0000 7fe6c9c31780 1 < completed part key=_multipart_R7UWMW913DJQ.2~8YKSH4F8RJPI.0 size=518973 2024-09-22T08:21:09.833 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.831+0000 7fe6c9c31780 1 < completed multipart upload key=R7UWMW913DJQ upload=8YKSH4F8RJPI tag=QRK65V40MJEB type=write size=1567549 2024-09-22T08:21:09.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.834+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=NEZ2E4QKXGQU type=write size=396004 2024-09-22T08:21:09.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.836+0000 7fe6c9c31780 1 < completed write operation key=9FCSIF1WKBDJ tag=70QUR5KTQ7KF type=write size=811929 2024-09-22T08:21:09.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.837+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=3E8BBED5KQZB type=del size=806389 2024-09-22T08:21:09.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.839+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~LYFBSWTQB5MV.0 size=1022917 2024-09-22T08:21:09.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.841+0000 7fe6c9c31780 1 < completed multipart upload key=CTK01Y0CV1NC upload=LYFBSWTQB5MV tag=TX8OJIJYDFMI type=write size=2071493 2024-09-22T08:21:09.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.842+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=94L7UR328R0E type=del size=1423495 2024-09-22T08:21:09.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.844+0000 7fe6c9c31780 1 < completed delete operation key=D85LJGGU3Z6F tag=AV35UAFFXS3C type=del 2024-09-22T08:21:09.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.846+0000 7fe6c9c31780 1 > prepared operation key=FY40JTHLT0KU tag=0M74YBQ5S5EM type=del size=3716074 2024-09-22T08:21:09.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.847+0000 7fe6c9c31780 1 < completed delete operation key=D85LJGGU3Z6F tag=GA98N3F8VEXH type=del 2024-09-22T08:21:09.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.850+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~JMY4DQXCNGAF.0 size=1048576 2024-09-22T08:21:09.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.851+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~JMY4DQXCNGAF.1 size=1048576 2024-09-22T08:21:09.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.852+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~JMY4DQXCNGAF.2 size=332140 2024-09-22T08:21:09.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.852+0000 7fe6c9c31780 1 > prepared multipart upload key=KZIY400KQ5NH upload=JMY4DQXCNGAF tag=PUG3YROYQ0A4 type=write size=3477868 2024-09-22T08:21:09.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.853+0000 7fe6c9c31780 1 < completed delete operation key=9AZWQ9E58QS6 tag=TA476TTCCWPY type=del 2024-09-22T08:21:09.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.854+0000 7fe6c9c31780 1 > prepared operation key=OX1LY7URY7IV tag=SIWH7SJO1Q5C type=del size=3597619 2024-09-22T08:21:09.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.856+0000 7fe6c9c31780 1 < completed delete operation key=4KRJ7DTE3KDV tag=MR91XG18Q96J type=del 2024-09-22T08:21:09.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.857+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=7W1FPE01PU8P type=del size=2191381 2024-09-22T08:21:09.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.858+0000 7fe6c9c31780 1 < completed part key=_multipart_6BKB91YV3FMW.2~2CSXJQ3K7EJB.0 size=240265 2024-09-22T08:21:09.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.861+0000 7fe6c9c31780 1 < completed multipart upload key=6BKB91YV3FMW upload=2CSXJQ3K7EJB tag=1ENM30D7NG8R type=write size=1288841 2024-09-22T08:21:09.865 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.863+0000 7fe6c9c31780 1 > prepared part key=_multipart_1HZ0NAJPXNW1.2~PW01H4LTZ7SM.0 size=1048576 2024-09-22T08:21:09.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.864+0000 7fe6c9c31780 1 > prepared part key=_multipart_1HZ0NAJPXNW1.2~PW01H4LTZ7SM.1 size=201833 2024-09-22T08:21:09.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.864+0000 7fe6c9c31780 1 > prepared multipart upload key=1HZ0NAJPXNW1 upload=PW01H4LTZ7SM tag=01IQ102KT2ET type=write size=2298985 2024-09-22T08:21:09.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.866+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~86DLZV7QSM1W.0 size=1048576 2024-09-22T08:21:09.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.867+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~86DLZV7QSM1W.1 size=1929 2024-09-22T08:21:09.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.870+0000 7fe6c9c31780 1 < completed multipart upload key=76HZ3LZGVT9J upload=86DLZV7QSM1W tag=U2HDTGIBYCQ6 type=write size=2099081 2024-09-22T08:21:09.873 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.872+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~5R238HX5KCLB.0 size=1048576 2024-09-22T08:21:09.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.873+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~5R238HX5KCLB.1 size=176822 2024-09-22T08:21:09.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.873+0000 7fe6c9c31780 1 > prepared multipart upload key=GEWQUFB9K35E upload=5R238HX5KCLB tag=3B8SLEI7RV6D type=write size=2273974 2024-09-22T08:21:09.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.876+0000 7fe6c9c31780 1 < suggested remove operation key=T2W6RXP9UGHH tag=7SV4MBHCQ75J type=del 2024-09-22T08:21:09.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.877+0000 7fe6c9c31780 1 > prepared operation key=VP1MP4IC9A7T tag=YB1H6MTH13GM type=del size=3335048 2024-09-22T08:21:09.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.879+0000 7fe6c9c31780 1 < completed delete operation key=TE10GB1F35X4 tag=KHYETFZ2IUIB type=del 2024-09-22T08:21:09.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.880+0000 7fe6c9c31780 1 > prepared operation key=TJTB67QBLZH5 tag=JS34KLNRC1YW type=del size=1259270 2024-09-22T08:21:09.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.882+0000 7fe6c9c31780 1 < completed part key=_multipart_JT5AB8VLMEFD.2~UMSJM1OQ93XW.0 size=1048576 2024-09-22T08:21:09.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.883+0000 7fe6c9c31780 1 < completed part key=_multipart_JT5AB8VLMEFD.2~UMSJM1OQ93XW.1 size=1008182 2024-09-22T08:21:09.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.886+0000 7fe6c9c31780 1 < completed multipart upload key=JT5AB8VLMEFD upload=UMSJM1OQ93XW tag=SYVO3YHKQ1AH type=write size=3105334 2024-09-22T08:21:09.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.886+0000 7fe6c9c31780 1 > prepared operation key=TJTB67QBLZH5 tag=GGQYV5ILUI5S type=del size=3374364 2024-09-22T08:21:09.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.889+0000 7fe6c9c31780 1 < canceled operation key=GEWQUFB9K35E tag=OAM36R9TPJSA type=del size=2642733 2024-09-22T08:21:09.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.890+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=1C63YCCWJCVW type=del size=2346277 2024-09-22T08:21:09.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.891+0000 7fe6c9c31780 1 < completed delete operation key=TJTB67QBLZH5 tag=RWE9Y7S5U5G7 type=del 2024-09-22T08:21:09.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.893+0000 7fe6c9c31780 1 > prepared operation key=KZIY400KQ5NH tag=LRBOPWB5ESS4 type=del size=3943272 2024-09-22T08:21:09.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.894+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~IRABUL1LUHRZ.0 size=1048576 2024-09-22T08:21:09.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.895+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~IRABUL1LUHRZ.1 size=490625 2024-09-22T08:21:09.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.898+0000 7fe6c9c31780 1 < completed multipart upload key=O1UBUQXP50CN upload=IRABUL1LUHRZ tag=BW7WB51XM527 type=write size=2587777 2024-09-22T08:21:09.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.901+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~882TW1D4NTCW.0 size=1048576 2024-09-22T08:21:09.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.902+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~882TW1D4NTCW.1 size=590864 2024-09-22T08:21:09.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.902+0000 7fe6c9c31780 1 > prepared multipart upload key=946H8F2AUPO2 upload=882TW1D4NTCW tag=0K2HH805K9JV type=write size=2688016 2024-09-22T08:21:09.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.904+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~ZTSKS3LS6DNO.0 size=1048576 2024-09-22T08:21:09.907 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.905+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~ZTSKS3LS6DNO.1 size=907226 2024-09-22T08:21:09.910 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.909+0000 7fe6c9c31780 1 < completed multipart upload key=CTK01Y0CV1NC upload=ZTSKS3LS6DNO tag=7OENAJPN8AD4 type=write size=3004378 2024-09-22T08:21:09.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.910+0000 7fe6c9c31780 1 > prepared operation key=FY40JTHLT0KU tag=V3ZAT6JTCWXN type=del size=1968815 2024-09-22T08:21:09.914 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.912+0000 7fe6c9c31780 -1 < failed to complete operation key=T2W6RXP9UGHH tag=NEZ2E4QKXGQU type=write size=396004: (22) Invalid argument 2024-09-22T08:21:09.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.914+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=UBVQPUEZKD6C type=del size=2309944 2024-09-22T08:21:09.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.917+0000 7fe6c9c31780 1 < suggested update operation key=76HZ3LZGVT9J tag=3E8BBED5KQZB type=del size=806389 2024-09-22T08:21:09.920 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.919+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=JSR7O46IYFIN type=del size=579843 2024-09-22T08:21:09.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.920+0000 7fe6c9c31780 1 < completed delete operation key=7446WN19QFV0 tag=94L7UR328R0E type=del 2024-09-22T08:21:09.925 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.923+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~HKZAQG6DSVJY.0 size=1048576 2024-09-22T08:21:09.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.924+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~HKZAQG6DSVJY.1 size=417853 2024-09-22T08:21:09.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.924+0000 7fe6c9c31780 1 > prepared multipart upload key=2B5QRUMTVE7U upload=HKZAQG6DSVJY tag=YWJENW6BOQJ6 type=write size=2515005 2024-09-22T08:21:09.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.927+0000 7fe6c9c31780 1 < suggested update operation key=FY40JTHLT0KU tag=0M74YBQ5S5EM type=del size=3716074 2024-09-22T08:21:09.932 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.931+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~DPF4T8BPGKEE.0 size=1048576 2024-09-22T08:21:09.933 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.932+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~DPF4T8BPGKEE.1 size=1048576 2024-09-22T08:21:09.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.932+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~DPF4T8BPGKEE.2 size=599481 2024-09-22T08:21:09.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.933+0000 7fe6c9c31780 1 > prepared multipart upload key=FY40JTHLT0KU upload=DPF4T8BPGKEE tag=R4YDOWGW03JM type=write size=3745209 2024-09-22T08:21:09.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.934+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~JMY4DQXCNGAF.0 size=1048576 2024-09-22T08:21:09.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.936+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~JMY4DQXCNGAF.1 size=1048576 2024-09-22T08:21:09.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.937+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~JMY4DQXCNGAF.2 size=332140 2024-09-22T08:21:09.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.940+0000 7fe6c9c31780 1 < completed multipart upload key=KZIY400KQ5NH upload=JMY4DQXCNGAF tag=PUG3YROYQ0A4 type=write size=3477868 2024-09-22T08:21:09.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.941+0000 7fe6c9c31780 1 > prepared operation key=ZFL9N44PBQX4 tag=69MMQ7BM1MLE type=del size=846891 2024-09-22T08:21:09.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.942+0000 7fe6c9c31780 1 < completed delete operation key=OX1LY7URY7IV tag=SIWH7SJO1Q5C type=del 2024-09-22T08:21:09.945 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.944+0000 7fe6c9c31780 1 > prepared operation key=KZIY400KQ5NH tag=1XGI9O44NZQ0 type=del size=3177363 2024-09-22T08:21:09.948 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.947+0000 7fe6c9c31780 1 < suggested update operation key=7446WN19QFV0 tag=7W1FPE01PU8P type=del size=2191381 2024-09-22T08:21:09.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.948+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=HVR8X6VWZV31 type=write size=139312 2024-09-22T08:21:09.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.950+0000 7fe6c9c31780 1 < completed part key=_multipart_1HZ0NAJPXNW1.2~PW01H4LTZ7SM.0 size=1048576 2024-09-22T08:21:09.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.951+0000 7fe6c9c31780 1 < completed part key=_multipart_1HZ0NAJPXNW1.2~PW01H4LTZ7SM.1 size=201833 2024-09-22T08:21:09.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.953+0000 7fe6c9c31780 1 < completed multipart upload key=1HZ0NAJPXNW1 upload=PW01H4LTZ7SM tag=01IQ102KT2ET type=write size=2298985 2024-09-22T08:21:09.957 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.956+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~MILV1XC8N2HM.0 size=1048576 2024-09-22T08:21:09.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.957+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~MILV1XC8N2HM.1 size=75039 2024-09-22T08:21:09.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.957+0000 7fe6c9c31780 1 > prepared multipart upload key=GEWQUFB9K35E upload=MILV1XC8N2HM tag=0PON4SFN15X2 type=write size=2172191 2024-09-22T08:21:09.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.958+0000 7fe6c9c31780 1 < completed part key=_multipart_GEWQUFB9K35E.2~5R238HX5KCLB.0 size=1048576 2024-09-22T08:21:09.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.958+0000 7fe6c9c31780 1 < canceled part key=_multipart_GEWQUFB9K35E.2~5R238HX5KCLB.1 size=176822 2024-09-22T08:21:09.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.961+0000 7fe6c9c31780 1 < canceled multipart upload key=GEWQUFB9K35E upload=5R238HX5KCLB tag=3B8SLEI7RV6D type=write size=2273974 2024-09-22T08:21:09.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.962+0000 7fe6c9c31780 1 > prepared operation key=W9L87PTJEIOA tag=2T25G7C7XLCO type=del size=456295 2024-09-22T08:21:09.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.964+0000 7fe6c9c31780 1 < completed delete operation key=VP1MP4IC9A7T tag=YB1H6MTH13GM type=del 2024-09-22T08:21:09.968 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.967+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~QTQZWZ2Y85JI.0 size=624697 2024-09-22T08:21:09.968 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.967+0000 7fe6c9c31780 1 > prepared multipart upload key=Z1CK5EDBK4AW upload=QTQZWZ2Y85JI tag=PJRSQ19DDS7P type=write size=1673273 2024-09-22T08:21:09.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.968+0000 7fe6c9c31780 1 < completed delete operation key=TJTB67QBLZH5 tag=JS34KLNRC1YW type=del 2024-09-22T08:21:09.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.970+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=L6SOCQYDR7OT type=del size=3900026 2024-09-22T08:21:09.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.975+0000 7fe6c9c31780 1 < suggested remove operation key=TJTB67QBLZH5 tag=GGQYV5ILUI5S type=del 2024-09-22T08:21:09.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.977+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=2CU5DNK56TMZ type=write size=1013821 2024-09-22T08:21:09.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.978+0000 7fe6c9c31780 1 < completed delete operation key=9AZWQ9E58QS6 tag=1C63YCCWJCVW type=del 2024-09-22T08:21:09.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.979+0000 7fe6c9c31780 1 > prepared operation key=TYVQ39KUV2V9 tag=ODWSYBG26E2B type=del size=1606014 2024-09-22T08:21:09.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.981+0000 7fe6c9c31780 1 < completed delete operation key=KZIY400KQ5NH tag=LRBOPWB5ESS4 type=del 2024-09-22T08:21:09.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.983+0000 7fe6c9c31780 1 > prepared operation key=9FCSIF1WKBDJ tag=RSEH0Q2M3ZSU type=del size=66953 2024-09-22T08:21:09.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.984+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~882TW1D4NTCW.0 size=1048576 2024-09-22T08:21:09.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.985+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~882TW1D4NTCW.1 size=590864 2024-09-22T08:21:09.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.988+0000 7fe6c9c31780 1 < completed multipart upload key=946H8F2AUPO2 upload=882TW1D4NTCW tag=0K2HH805K9JV type=write size=2688016 2024-09-22T08:21:09.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.990+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=U360DSR5O69A type=del size=1151076 2024-09-22T08:21:09.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.991+0000 7fe6c9c31780 -1 < failed to complete operation key=FY40JTHLT0KU tag=V3ZAT6JTCWXN type=del size=1968815: (22) Invalid argument 2024-09-22T08:21:09.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.994+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~T0LSR2WOWTVI.0 size=1048576 2024-09-22T08:21:09.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.995+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~T0LSR2WOWTVI.1 size=219636 2024-09-22T08:21:09.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.995+0000 7fe6c9c31780 1 > prepared multipart upload key=KZIY400KQ5NH upload=T0LSR2WOWTVI tag=ZKLNG8TWHJ7D type=write size=2316788 2024-09-22T08:21:09.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.996+0000 7fe6c9c31780 1 < completed delete operation key=T2W6RXP9UGHH tag=UBVQPUEZKD6C type=del 2024-09-22T08:21:10.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.999+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~T3CF8EROVJ7I.0 size=701429 2024-09-22T08:21:10.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:09.999+0000 7fe6c9c31780 1 > prepared multipart upload key=0PNK2ZW6IJM1 upload=T3CF8EROVJ7I tag=YL19ESJKJM78 type=write size=1750005 2024-09-22T08:21:10.002 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.000+0000 7fe6c9c31780 1 < completed delete operation key=76HZ3LZGVT9J tag=JSR7O46IYFIN type=del 2024-09-22T08:21:10.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.002+0000 7fe6c9c31780 1 > prepared operation key=TJTB67QBLZH5 tag=4S93N1HVSTW3 type=del size=722983 2024-09-22T08:21:10.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.004+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~HKZAQG6DSVJY.0 size=1048576 2024-09-22T08:21:10.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.005+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~HKZAQG6DSVJY.1 size=417853 2024-09-22T08:21:10.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.007+0000 7fe6c9c31780 1 < completed multipart upload key=2B5QRUMTVE7U upload=HKZAQG6DSVJY tag=YWJENW6BOQJ6 type=write size=2515005 2024-09-22T08:21:10.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.009+0000 7fe6c9c31780 1 > prepared operation key=JT5AB8VLMEFD tag=WVSSLU3FW43R type=del size=3386614 2024-09-22T08:21:10.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.010+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~DPF4T8BPGKEE.0 size=1048576 2024-09-22T08:21:10.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.011+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~DPF4T8BPGKEE.1 size=1048576 2024-09-22T08:21:10.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.012+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~DPF4T8BPGKEE.2 size=599481 2024-09-22T08:21:10.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.015+0000 7fe6c9c31780 1 < completed multipart upload key=FY40JTHLT0KU upload=DPF4T8BPGKEE tag=R4YDOWGW03JM type=write size=3745209 2024-09-22T08:21:10.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.017+0000 7fe6c9c31780 1 > prepared operation key=KZIY400KQ5NH tag=LSOBGXUAFW33 type=write size=764256 2024-09-22T08:21:10.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.018+0000 7fe6c9c31780 1 < completed delete operation key=ZFL9N44PBQX4 tag=69MMQ7BM1MLE type=del 2024-09-22T08:21:10.022 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.020+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~P86VIASZBV28.0 size=83252 2024-09-22T08:21:10.022 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.020+0000 7fe6c9c31780 1 > prepared multipart upload key=ILW34WLX48WN upload=P86VIASZBV28 tag=Z4PRPAA1ZEJC type=write size=1131828 2024-09-22T08:21:10.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.022+0000 7fe6c9c31780 1 < completed delete operation key=KZIY400KQ5NH tag=1XGI9O44NZQ0 type=del 2024-09-22T08:21:10.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.025+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~ILTSEAN3SOX4.0 size=359883 2024-09-22T08:21:10.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.025+0000 7fe6c9c31780 1 > prepared multipart upload key=946H8F2AUPO2 upload=ILTSEAN3SOX4 tag=WDM6XPQOXHYV type=write size=1408459 2024-09-22T08:21:10.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.027+0000 7fe6c9c31780 1 < completed write operation key=9AZWQ9E58QS6 tag=HVR8X6VWZV31 type=write size=139312 2024-09-22T08:21:10.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.028+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=H1K22WL873N3 type=del size=2598944 2024-09-22T08:21:10.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.030+0000 7fe6c9c31780 1 < completed part key=_multipart_GEWQUFB9K35E.2~MILV1XC8N2HM.0 size=1048576 2024-09-22T08:21:10.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.032+0000 7fe6c9c31780 1 < completed part key=_multipart_GEWQUFB9K35E.2~MILV1XC8N2HM.1 size=75039 2024-09-22T08:21:10.036 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.034+0000 7fe6c9c31780 1 < completed multipart upload key=GEWQUFB9K35E upload=MILV1XC8N2HM tag=0PON4SFN15X2 type=write size=2172191 2024-09-22T08:21:10.037 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.036+0000 7fe6c9c31780 1 > prepared operation key=FY40JTHLT0KU tag=FO77V0G95MD5 type=del size=3874723 2024-09-22T08:21:10.039 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.037+0000 7fe6c9c31780 1 < canceled operation key=W9L87PTJEIOA tag=2T25G7C7XLCO type=del size=456295 2024-09-22T08:21:10.040 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.039+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=7CQ11S86B9GL type=del size=1924649 2024-09-22T08:21:10.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.040+0000 7fe6c9c31780 1 < completed part key=_multipart_Z1CK5EDBK4AW.2~QTQZWZ2Y85JI.0 size=624697 2024-09-22T08:21:10.045 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.044+0000 7fe6c9c31780 1 < completed multipart upload key=Z1CK5EDBK4AW upload=QTQZWZ2Y85JI tag=PJRSQ19DDS7P type=write size=1673273 2024-09-22T08:21:10.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.046+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~857HRLY7LRAI.0 size=1048576 2024-09-22T08:21:10.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.047+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~857HRLY7LRAI.1 size=1048576 2024-09-22T08:21:10.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.048+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~857HRLY7LRAI.2 size=906235 2024-09-22T08:21:10.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.048+0000 7fe6c9c31780 1 > prepared multipart upload key=4KRJ7DTE3KDV upload=857HRLY7LRAI tag=VXLQNWENUP1R type=write size=4051963 2024-09-22T08:21:10.051 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.050+0000 7fe6c9c31780 1 < completed delete operation key=DC7VLQWZ3TD1 tag=L6SOCQYDR7OT type=del 2024-09-22T08:21:10.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.052+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~GHE59060HAJO.0 size=1048576 2024-09-22T08:21:10.055 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.054+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~GHE59060HAJO.1 size=1048576 2024-09-22T08:21:10.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.055+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~GHE59060HAJO.2 size=401422 2024-09-22T08:21:10.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.055+0000 7fe6c9c31780 1 > prepared multipart upload key=JT5AB8VLMEFD upload=GHE59060HAJO tag=ONLR13OR4QCM type=write size=3547150 2024-09-22T08:21:10.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.057+0000 7fe6c9c31780 1 < canceled operation key=946H8F2AUPO2 tag=2CU5DNK56TMZ type=write size=1013821 2024-09-22T08:21:10.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.058+0000 7fe6c9c31780 1 > prepared operation key=W9L87PTJEIOA tag=ZSSUZIDBT4VS type=write size=680354 2024-09-22T08:21:10.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.060+0000 7fe6c9c31780 1 < completed delete operation key=TYVQ39KUV2V9 tag=ODWSYBG26E2B type=del 2024-09-22T08:21:10.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.061+0000 7fe6c9c31780 1 > prepared operation key=D85LJGGU3Z6F tag=H4BYO6H5AF3P type=del size=2887855 2024-09-22T08:21:10.064 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.063+0000 7fe6c9c31780 1 < completed delete operation key=9FCSIF1WKBDJ tag=RSEH0Q2M3ZSU type=del 2024-09-22T08:21:10.067 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.065+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~X5IV2P6FRCIO.0 size=1048576 2024-09-22T08:21:10.068 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.066+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~X5IV2P6FRCIO.1 size=506068 2024-09-22T08:21:10.068 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.066+0000 7fe6c9c31780 1 > prepared multipart upload key=JT5AB8VLMEFD upload=X5IV2P6FRCIO tag=FLJS2THX7AU3 type=write size=2603220 2024-09-22T08:21:10.070 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.068+0000 7fe6c9c31780 1 < completed delete operation key=TE10GB1F35X4 tag=U360DSR5O69A type=del 2024-09-22T08:21:10.072 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.070+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~WZFCORRDXPG5.0 size=1048576 2024-09-22T08:21:10.073 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.072+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~WZFCORRDXPG5.1 size=573407 2024-09-22T08:21:10.073 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.072+0000 7fe6c9c31780 1 > prepared multipart upload key=LA6ZRVULGQ0H upload=WZFCORRDXPG5 tag=8M43MJQF7OAO type=write size=2670559 2024-09-22T08:21:10.075 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.073+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~T0LSR2WOWTVI.0 size=1048576 2024-09-22T08:21:10.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.074+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~T0LSR2WOWTVI.1 size=219636 2024-09-22T08:21:10.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.077+0000 7fe6c9c31780 1 < completed multipart upload key=KZIY400KQ5NH upload=T0LSR2WOWTVI tag=ZKLNG8TWHJ7D type=write size=2316788 2024-09-22T08:21:10.080 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.078+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=8TBQV1F0TP91 type=write size=747198 2024-09-22T08:21:10.082 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.080+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~T3CF8EROVJ7I.0 size=701429 2024-09-22T08:21:10.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.083+0000 7fe6c9c31780 1 < completed multipart upload key=0PNK2ZW6IJM1 upload=T3CF8EROVJ7I tag=YL19ESJKJM78 type=write size=1750005 2024-09-22T08:21:10.086 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.084+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=FNGPE2BJK4WF type=del size=798732 2024-09-22T08:21:10.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.086+0000 7fe6c9c31780 1 < completed delete operation key=TJTB67QBLZH5 tag=4S93N1HVSTW3 type=del 2024-09-22T08:21:10.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.088+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~4DE57HJHFNXI.0 size=1048576 2024-09-22T08:21:10.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.089+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~4DE57HJHFNXI.1 size=862436 2024-09-22T08:21:10.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.089+0000 7fe6c9c31780 1 > prepared multipart upload key=TYVQ39KUV2V9 upload=4DE57HJHFNXI tag=9WALSJ5VL6RK type=write size=2959588 2024-09-22T08:21:10.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.093+0000 7fe6c9c31780 1 < suggested remove operation key=JT5AB8VLMEFD tag=WVSSLU3FW43R type=del 2024-09-22T08:21:10.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.096+0000 7fe6c9c31780 1 > prepared part key=_multipart_TJTB67QBLZH5.2~RK4BDJRXOMMX.0 size=608230 2024-09-22T08:21:10.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.096+0000 7fe6c9c31780 1 > prepared multipart upload key=TJTB67QBLZH5 upload=RK4BDJRXOMMX tag=TJFQES3WYM2N type=write size=1656806 2024-09-22T08:21:10.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.097+0000 7fe6c9c31780 1 < canceled operation key=KZIY400KQ5NH tag=LSOBGXUAFW33 type=write size=764256 2024-09-22T08:21:10.100 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.099+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=CETEN1S8X1B5 type=del size=2408421 2024-09-22T08:21:10.102 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.100+0000 7fe6c9c31780 1 < completed part key=_multipart_ILW34WLX48WN.2~P86VIASZBV28.0 size=83252 2024-09-22T08:21:10.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.103+0000 7fe6c9c31780 1 < completed multipart upload key=ILW34WLX48WN upload=P86VIASZBV28 tag=Z4PRPAA1ZEJC type=write size=1131828 2024-09-22T08:21:10.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.106+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~M2GH9EDI1CS6.0 size=1048576 2024-09-22T08:21:10.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.108+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~M2GH9EDI1CS6.1 size=685724 2024-09-22T08:21:10.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.108+0000 7fe6c9c31780 1 > prepared multipart upload key=XJP26CCPYDI7 upload=M2GH9EDI1CS6 tag=UE9629231CEY type=write size=2782876 2024-09-22T08:21:10.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.109+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~ILTSEAN3SOX4.0 size=359883 2024-09-22T08:21:10.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.112+0000 7fe6c9c31780 1 < completed multipart upload key=946H8F2AUPO2 upload=ILTSEAN3SOX4 tag=WDM6XPQOXHYV type=write size=1408459 2024-09-22T08:21:10.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.113+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=21V2L007UY51 type=write size=383827 2024-09-22T08:21:10.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.115+0000 7fe6c9c31780 1 < canceled operation key=TE10GB1F35X4 tag=H1K22WL873N3 type=del size=2598944 2024-09-22T08:21:10.119 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.117+0000 7fe6c9c31780 1 > prepared operation key=JT5AB8VLMEFD tag=O58AHUT25YP8 type=del size=2503839 2024-09-22T08:21:10.120 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.119+0000 7fe6c9c31780 1 < completed delete operation key=FY40JTHLT0KU tag=FO77V0G95MD5 type=del 2024-09-22T08:21:10.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.122+0000 7fe6c9c31780 1 > prepared part key=_multipart_1HZ0NAJPXNW1.2~D8G868S8M03Y.0 size=1048576 2024-09-22T08:21:10.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.123+0000 7fe6c9c31780 1 > prepared part key=_multipart_1HZ0NAJPXNW1.2~D8G868S8M03Y.1 size=1048576 2024-09-22T08:21:10.126 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.124+0000 7fe6c9c31780 1 > prepared part key=_multipart_1HZ0NAJPXNW1.2~D8G868S8M03Y.2 size=800334 2024-09-22T08:21:10.126 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.124+0000 7fe6c9c31780 1 > prepared multipart upload key=1HZ0NAJPXNW1 upload=D8G868S8M03Y tag=LZB18I6VUSVP type=write size=3946062 2024-09-22T08:21:10.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.127+0000 7fe6c9c31780 1 < completed delete operation key=TE10GB1F35X4 tag=7CQ11S86B9GL type=del 2024-09-22T08:21:10.131 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.129+0000 7fe6c9c31780 1 > prepared part key=_multipart_1HZ0NAJPXNW1.2~M1AAJSB5BPAP.0 size=1048576 2024-09-22T08:21:10.132 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.130+0000 7fe6c9c31780 1 > prepared part key=_multipart_1HZ0NAJPXNW1.2~M1AAJSB5BPAP.1 size=82729 2024-09-22T08:21:10.132 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.130+0000 7fe6c9c31780 1 > prepared multipart upload key=1HZ0NAJPXNW1 upload=M1AAJSB5BPAP tag=LJT1OXFSB80I type=write size=2179881 2024-09-22T08:21:10.133 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.132+0000 7fe6c9c31780 1 < completed part key=_multipart_4KRJ7DTE3KDV.2~857HRLY7LRAI.0 size=1048576 2024-09-22T08:21:10.135 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.133+0000 7fe6c9c31780 1 < completed part key=_multipart_4KRJ7DTE3KDV.2~857HRLY7LRAI.1 size=1048576 2024-09-22T08:21:10.136 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.134+0000 7fe6c9c31780 1 < completed part key=_multipart_4KRJ7DTE3KDV.2~857HRLY7LRAI.2 size=906235 2024-09-22T08:21:10.139 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.137+0000 7fe6c9c31780 1 < completed multipart upload key=4KRJ7DTE3KDV upload=857HRLY7LRAI tag=VXLQNWENUP1R type=write size=4051963 2024-09-22T08:21:10.140 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.139+0000 7fe6c9c31780 1 > prepared operation key=JT5AB8VLMEFD tag=301VN8NGEYPH type=del size=357524 2024-09-22T08:21:10.142 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.140+0000 7fe6c9c31780 1 < completed part key=_multipart_JT5AB8VLMEFD.2~GHE59060HAJO.0 size=1048576 2024-09-22T08:21:10.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.142+0000 7fe6c9c31780 1 < completed part key=_multipart_JT5AB8VLMEFD.2~GHE59060HAJO.1 size=1048576 2024-09-22T08:21:10.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.142+0000 7fe6c9c31780 1 < canceled part key=_multipart_JT5AB8VLMEFD.2~GHE59060HAJO.2 size=401422 2024-09-22T08:21:10.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.144+0000 7fe6c9c31780 1 < canceled multipart upload key=JT5AB8VLMEFD upload=GHE59060HAJO tag=ONLR13OR4QCM type=write size=3547150 2024-09-22T08:21:10.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.147+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~HT2SQTTRIU13.0 size=1048576 2024-09-22T08:21:10.149 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.148+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~HT2SQTTRIU13.1 size=1048576 2024-09-22T08:21:10.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.149+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~HT2SQTTRIU13.2 size=282259 2024-09-22T08:21:10.151 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.149+0000 7fe6c9c31780 1 > prepared multipart upload key=T2W6RXP9UGHH upload=HT2SQTTRIU13 tag=KMQHSA7L9WRT type=write size=3427987 2024-09-22T08:21:10.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.150+0000 7fe6c9c31780 1 < completed write operation key=W9L87PTJEIOA tag=ZSSUZIDBT4VS type=write size=680354 2024-09-22T08:21:10.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.152+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=NC4Q3XGC15F4 type=del size=3395342 2024-09-22T08:21:10.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.154+0000 7fe6c9c31780 1 < completed delete operation key=D85LJGGU3Z6F tag=H4BYO6H5AF3P type=del 2024-09-22T08:21:10.157 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.155+0000 7fe6c9c31780 1 > prepared operation key=VP1MP4IC9A7T tag=EI7D64R0JII2 type=del size=1931960 2024-09-22T08:21:10.158 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.157+0000 7fe6c9c31780 1 < completed part key=_multipart_JT5AB8VLMEFD.2~X5IV2P6FRCIO.0 size=1048576 2024-09-22T08:21:10.159 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.158+0000 7fe6c9c31780 1 < completed part key=_multipart_JT5AB8VLMEFD.2~X5IV2P6FRCIO.1 size=506068 2024-09-22T08:21:10.162 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.160+0000 7fe6c9c31780 1 < completed multipart upload key=JT5AB8VLMEFD upload=X5IV2P6FRCIO tag=FLJS2THX7AU3 type=write size=2603220 2024-09-22T08:21:10.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.161+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=KITPR7NJ1YSM type=write size=849368 2024-09-22T08:21:10.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.163+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~WZFCORRDXPG5.0 size=1048576 2024-09-22T08:21:10.165 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.164+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~WZFCORRDXPG5.1 size=573407 2024-09-22T08:21:10.168 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.166+0000 7fe6c9c31780 1 < completed multipart upload key=LA6ZRVULGQ0H upload=WZFCORRDXPG5 tag=8M43MJQF7OAO type=write size=2670559 2024-09-22T08:21:10.169 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.169+0000 7fe6c9c31780 1 > prepared operation key=XJP26CCPYDI7 tag=URVGXRFQSENE type=del size=417494 2024-09-22T08:21:10.171 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.170+0000 7fe6c9c31780 1 < completed write operation key=946H8F2AUPO2 tag=8TBQV1F0TP91 type=write size=747198 2024-09-22T08:21:10.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.172+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~BJ0EGYSYCG2O.0 size=1048576 2024-09-22T08:21:10.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.173+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~BJ0EGYSYCG2O.1 size=743569 2024-09-22T08:21:10.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.173+0000 7fe6c9c31780 1 > prepared multipart upload key=GEWQUFB9K35E upload=BJ0EGYSYCG2O tag=C3E5LMO376GK type=write size=2840721 2024-09-22T08:21:10.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.175+0000 7fe6c9c31780 1 < completed delete operation key=R7UWMW913DJQ tag=FNGPE2BJK4WF type=del 2024-09-22T08:21:10.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.177+0000 7fe6c9c31780 1 > prepared operation key=0PNK2ZW6IJM1 tag=62OEAWYEX2UW type=del size=1176841 2024-09-22T08:21:10.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.179+0000 7fe6c9c31780 1 < completed part key=_multipart_TYVQ39KUV2V9.2~4DE57HJHFNXI.0 size=1048576 2024-09-22T08:21:10.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.180+0000 7fe6c9c31780 1 < completed part key=_multipart_TYVQ39KUV2V9.2~4DE57HJHFNXI.1 size=862436 2024-09-22T08:21:10.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.182+0000 7fe6c9c31780 1 < completed multipart upload key=TYVQ39KUV2V9 upload=4DE57HJHFNXI tag=9WALSJ5VL6RK type=write size=2959588 2024-09-22T08:21:10.186 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.185+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~6E1ZZH7QO8CE.0 size=1048576 2024-09-22T08:21:10.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.187+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~6E1ZZH7QO8CE.1 size=313087 2024-09-22T08:21:10.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.187+0000 7fe6c9c31780 1 > prepared multipart upload key=ILW34WLX48WN upload=6E1ZZH7QO8CE tag=SIJ8F1JJ62E7 type=write size=2410239 2024-09-22T08:21:10.189 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.188+0000 7fe6c9c31780 1 < completed part key=_multipart_TJTB67QBLZH5.2~RK4BDJRXOMMX.0 size=608230 2024-09-22T08:21:10.192 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.190+0000 7fe6c9c31780 1 < completed multipart upload key=TJTB67QBLZH5 upload=RK4BDJRXOMMX tag=TJFQES3WYM2N type=write size=1656806 2024-09-22T08:21:10.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.192+0000 7fe6c9c31780 1 > prepared operation key=W9L87PTJEIOA tag=OK4DW4UX6WEE type=del size=2126320 2024-09-22T08:21:10.195 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.193+0000 7fe6c9c31780 1 < completed delete operation key=2B5QRUMTVE7U tag=CETEN1S8X1B5 type=del 2024-09-22T08:21:10.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.196+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=U9IE4S4H984M type=del size=3048949 2024-09-22T08:21:10.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.197+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~M2GH9EDI1CS6.0 size=1048576 2024-09-22T08:21:10.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.198+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~M2GH9EDI1CS6.1 size=685724 2024-09-22T08:21:10.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.201+0000 7fe6c9c31780 1 < completed multipart upload key=XJP26CCPYDI7 upload=M2GH9EDI1CS6 tag=UE9629231CEY type=write size=2782876 2024-09-22T08:21:10.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.202+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=5BDZAQJ6TPU5 type=del size=3485467 2024-09-22T08:21:10.205 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.204+0000 7fe6c9c31780 1 < completed write operation key=7446WN19QFV0 tag=21V2L007UY51 type=write size=383827 2024-09-22T08:21:10.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.205+0000 7fe6c9c31780 1 > prepared operation key=4KRJ7DTE3KDV tag=21FYICVCLOTK type=del size=2510169 2024-09-22T08:21:10.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.207+0000 7fe6c9c31780 1 < completed delete operation key=JT5AB8VLMEFD tag=O58AHUT25YP8 type=del 2024-09-22T08:21:10.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.208+0000 7fe6c9c31780 1 > prepared operation key=Z1CK5EDBK4AW tag=ID91N7QI371Y type=del size=2537801 2024-09-22T08:21:10.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.210+0000 7fe6c9c31780 1 < completed part key=_multipart_1HZ0NAJPXNW1.2~D8G868S8M03Y.0 size=1048576 2024-09-22T08:21:10.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.211+0000 7fe6c9c31780 1 < completed part key=_multipart_1HZ0NAJPXNW1.2~D8G868S8M03Y.1 size=1048576 2024-09-22T08:21:10.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.213+0000 7fe6c9c31780 1 < completed part key=_multipart_1HZ0NAJPXNW1.2~D8G868S8M03Y.2 size=800334 2024-09-22T08:21:10.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.215+0000 7fe6c9c31780 1 < completed multipart upload key=1HZ0NAJPXNW1 upload=D8G868S8M03Y tag=LZB18I6VUSVP type=write size=3946062 2024-09-22T08:21:10.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.217+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~BZ2M6YPMPRAA.0 size=1048576 2024-09-22T08:21:10.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.219+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~BZ2M6YPMPRAA.1 size=1048576 2024-09-22T08:21:10.221 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.220+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~BZ2M6YPMPRAA.2 size=758080 2024-09-22T08:21:10.221 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.220+0000 7fe6c9c31780 1 > prepared multipart upload key=O1UBUQXP50CN upload=BZ2M6YPMPRAA tag=25DGP7EZVHV9 type=write size=3903808 2024-09-22T08:21:10.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.221+0000 7fe6c9c31780 1 < completed part key=_multipart_1HZ0NAJPXNW1.2~M1AAJSB5BPAP.0 size=1048576 2024-09-22T08:21:10.224 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.223+0000 7fe6c9c31780 1 < completed part key=_multipart_1HZ0NAJPXNW1.2~M1AAJSB5BPAP.1 size=82729 2024-09-22T08:21:10.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.226+0000 7fe6c9c31780 1 < completed multipart upload key=1HZ0NAJPXNW1 upload=M1AAJSB5BPAP tag=LJT1OXFSB80I type=write size=2179881 2024-09-22T08:21:10.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.227+0000 7fe6c9c31780 1 > prepared operation key=LA6ZRVULGQ0H tag=ZAPM3GZVV2WW type=write size=798924 2024-09-22T08:21:10.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.231+0000 7fe6c9c31780 1 < suggested update operation key=JT5AB8VLMEFD tag=301VN8NGEYPH type=del size=357524 2024-09-22T08:21:10.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.232+0000 7fe6c9c31780 1 > prepared operation key=JT5AB8VLMEFD tag=VTAFZDY43C7H type=write size=586646 2024-09-22T08:21:10.235 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.233+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~HT2SQTTRIU13.0 size=1048576 2024-09-22T08:21:10.235 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.233+0000 7fe6c9c31780 1 < canceled part key=_multipart_T2W6RXP9UGHH.2~HT2SQTTRIU13.1 size=1048576 2024-09-22T08:21:10.236 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.234+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~HT2SQTTRIU13.2 size=282259 2024-09-22T08:21:10.238 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.237+0000 7fe6c9c31780 1 < canceled multipart upload key=T2W6RXP9UGHH upload=HT2SQTTRIU13 tag=KMQHSA7L9WRT type=write size=3427987 2024-09-22T08:21:10.240 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.238+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=PT22I4Y0U3X2 type=del size=3329916 2024-09-22T08:21:10.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.241+0000 7fe6c9c31780 1 < suggested remove operation key=946H8F2AUPO2 tag=NC4Q3XGC15F4 type=del 2024-09-22T08:21:10.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.243+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=GO9WBYA8PP7F type=del size=214752 2024-09-22T08:21:10.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.245+0000 7fe6c9c31780 1 < completed delete operation key=VP1MP4IC9A7T tag=EI7D64R0JII2 type=del 2024-09-22T08:21:10.250 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.249+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~107E3Q9PYTUQ.0 size=136773 2024-09-22T08:21:10.250 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.249+0000 7fe6c9c31780 1 > prepared multipart upload key=7446WN19QFV0 upload=107E3Q9PYTUQ tag=LA7S8QETDC3P type=write size=1185349 2024-09-22T08:21:10.251 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.250+0000 7fe6c9c31780 -1 < failed to complete operation key=946H8F2AUPO2 tag=KITPR7NJ1YSM type=write size=849368: (22) Invalid argument 2024-09-22T08:21:10.254 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.254+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~UW02LM3Y6NAV.0 size=1048576 2024-09-22T08:21:10.256 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.254+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~UW02LM3Y6NAV.1 size=135300 2024-09-22T08:21:10.256 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.254+0000 7fe6c9c31780 1 > prepared multipart upload key=2B5QRUMTVE7U upload=UW02LM3Y6NAV tag=BF5XK6POZPN2 type=write size=2232452 2024-09-22T08:21:10.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.259+0000 7fe6c9c31780 1 < suggested update operation key=XJP26CCPYDI7 tag=URVGXRFQSENE type=del size=417494 2024-09-22T08:21:10.262 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.261+0000 7fe6c9c31780 1 > prepared operation key=O1UBUQXP50CN tag=G19HI4DOJ0QJ type=del size=482288 2024-09-22T08:21:10.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.263+0000 7fe6c9c31780 1 < completed part key=_multipart_GEWQUFB9K35E.2~BJ0EGYSYCG2O.0 size=1048576 2024-09-22T08:21:10.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.263+0000 7fe6c9c31780 1 < canceled part key=_multipart_GEWQUFB9K35E.2~BJ0EGYSYCG2O.1 size=743569 2024-09-22T08:21:10.267 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.265+0000 7fe6c9c31780 1 < canceled multipart upload key=GEWQUFB9K35E upload=BJ0EGYSYCG2O tag=C3E5LMO376GK type=write size=2840721 2024-09-22T08:21:10.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.268+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~OPGZY18B4M52.0 size=1048576 2024-09-22T08:21:10.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.269+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~OPGZY18B4M52.1 size=1048576 2024-09-22T08:21:10.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.270+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~OPGZY18B4M52.2 size=331671 2024-09-22T08:21:10.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.270+0000 7fe6c9c31780 1 > prepared multipart upload key=KZIY400KQ5NH upload=OPGZY18B4M52 tag=KO55LJZ1WPCE type=write size=3477399 2024-09-22T08:21:10.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.272+0000 7fe6c9c31780 1 < canceled operation key=0PNK2ZW6IJM1 tag=62OEAWYEX2UW type=del size=1176841 2024-09-22T08:21:10.276 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.274+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~MBWF9RSKZZG1.0 size=1048576 2024-09-22T08:21:10.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.275+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~MBWF9RSKZZG1.1 size=270688 2024-09-22T08:21:10.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.275+0000 7fe6c9c31780 1 > prepared multipart upload key=7446WN19QFV0 upload=MBWF9RSKZZG1 tag=ALYR8TDO33MR type=write size=2367840 2024-09-22T08:21:10.278 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.277+0000 7fe6c9c31780 1 < completed part key=_multipart_ILW34WLX48WN.2~6E1ZZH7QO8CE.0 size=1048576 2024-09-22T08:21:10.280 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.278+0000 7fe6c9c31780 1 < completed part key=_multipart_ILW34WLX48WN.2~6E1ZZH7QO8CE.1 size=313087 2024-09-22T08:21:10.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.280+0000 7fe6c9c31780 1 < completed multipart upload key=ILW34WLX48WN upload=6E1ZZH7QO8CE tag=SIJ8F1JJ62E7 type=write size=2410239 2024-09-22T08:21:10.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.282+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=FNV6CEJHQBT3 type=del size=1631268 2024-09-22T08:21:10.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.283+0000 7fe6c9c31780 1 < completed delete operation key=W9L87PTJEIOA tag=OK4DW4UX6WEE type=del 2024-09-22T08:21:10.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.286+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~L9PN99LW3DGG.0 size=1048576 2024-09-22T08:21:10.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.287+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~L9PN99LW3DGG.1 size=1048576 2024-09-22T08:21:10.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.288+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~L9PN99LW3DGG.2 size=830109 2024-09-22T08:21:10.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.288+0000 7fe6c9c31780 1 > prepared multipart upload key=4KRJ7DTE3KDV upload=L9PN99LW3DGG tag=KEB688BCC5HH type=write size=3975837 2024-09-22T08:21:10.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.289+0000 7fe6c9c31780 1 < completed delete operation key=2B5QRUMTVE7U tag=U9IE4S4H984M type=del 2024-09-22T08:21:10.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.292+0000 7fe6c9c31780 1 > prepared operation key=TYVQ39KUV2V9 tag=XMXTJ8W1WUX5 type=del size=2006571 2024-09-22T08:21:10.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.292+0000 7fe6c9c31780 1 < completed delete operation key=DC7VLQWZ3TD1 tag=5BDZAQJ6TPU5 type=del 2024-09-22T08:21:10.296 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.294+0000 7fe6c9c31780 1 > prepared operation key=FY40JTHLT0KU tag=U6U48O35J94Y type=write size=749644 2024-09-22T08:21:10.297 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.295+0000 7fe6c9c31780 1 < canceled operation key=4KRJ7DTE3KDV tag=21FYICVCLOTK type=del size=2510169 2024-09-22T08:21:10.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.298+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~EOKOZN7TVQ3M.0 size=1048576 2024-09-22T08:21:10.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.299+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~EOKOZN7TVQ3M.1 size=141544 2024-09-22T08:21:10.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.299+0000 7fe6c9c31780 1 > prepared multipart upload key=6BKB91YV3FMW upload=EOKOZN7TVQ3M tag=VORBD5HVK2QP type=write size=2238696 2024-09-22T08:21:10.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.302+0000 7fe6c9c31780 1 < suggested update operation key=Z1CK5EDBK4AW tag=ID91N7QI371Y type=del size=2537801 2024-09-22T08:21:10.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.304+0000 7fe6c9c31780 1 > prepared operation key=FY40JTHLT0KU tag=9NO4J4H9NT1H type=del size=3790723 2024-09-22T08:21:10.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.305+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~BZ2M6YPMPRAA.0 size=1048576 2024-09-22T08:21:10.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.307+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~BZ2M6YPMPRAA.1 size=1048576 2024-09-22T08:21:10.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.308+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~BZ2M6YPMPRAA.2 size=758080 2024-09-22T08:21:10.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.310+0000 7fe6c9c31780 1 < completed multipart upload key=O1UBUQXP50CN upload=BZ2M6YPMPRAA tag=25DGP7EZVHV9 type=write size=3903808 2024-09-22T08:21:10.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.312+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~RRSMF37G041B.0 size=1048576 2024-09-22T08:21:10.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.313+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~RRSMF37G041B.1 size=1048576 2024-09-22T08:21:10.316 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.315+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~RRSMF37G041B.2 size=314030 2024-09-22T08:21:10.316 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.315+0000 7fe6c9c31780 1 > prepared multipart upload key=OX1LY7URY7IV upload=RRSMF37G041B tag=3K8PVWSC3R7N type=write size=3459758 2024-09-22T08:21:10.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.316+0000 7fe6c9c31780 1 < completed write operation key=LA6ZRVULGQ0H tag=ZAPM3GZVV2WW type=write size=798924 2024-09-22T08:21:10.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.318+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=T3OVII699TEK type=del size=3893212 2024-09-22T08:21:10.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.319+0000 7fe6c9c31780 1 < canceled operation key=JT5AB8VLMEFD tag=VTAFZDY43C7H type=write size=586646 2024-09-22T08:21:10.323 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.321+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=L66NFJ2SPI0M type=write size=225451 2024-09-22T08:21:10.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.324+0000 7fe6c9c31780 1 < completed delete operation key=ILW34WLX48WN tag=PT22I4Y0U3X2 type=del 2024-09-22T08:21:10.326 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.325+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=AUWIJXN5O68T type=del size=3909043 2024-09-22T08:21:10.328 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.326+0000 7fe6c9c31780 1 < completed delete operation key=DC7VLQWZ3TD1 tag=GO9WBYA8PP7F type=del 2024-09-22T08:21:10.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.328+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=4WKAZZY9ZI79 type=del size=2323764 2024-09-22T08:21:10.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.330+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~107E3Q9PYTUQ.0 size=136773 2024-09-22T08:21:10.334 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.334+0000 7fe6c9c31780 1 < completed multipart upload key=7446WN19QFV0 upload=107E3Q9PYTUQ tag=LA7S8QETDC3P type=write size=1185349 2024-09-22T08:21:10.336 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.335+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=6EADQHMFW546 type=del size=604580 2024-09-22T08:21:10.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.337+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~UW02LM3Y6NAV.0 size=1048576 2024-09-22T08:21:10.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.337+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~UW02LM3Y6NAV.1 size=135300 2024-09-22T08:21:10.342 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.341+0000 7fe6c9c31780 1 < completed multipart upload key=2B5QRUMTVE7U upload=UW02LM3Y6NAV tag=BF5XK6POZPN2 type=write size=2232452 2024-09-22T08:21:10.343 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.342+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=0DNYGTTMM5SN type=del size=207570 2024-09-22T08:21:10.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.344+0000 7fe6c9c31780 1 < suggested update operation key=O1UBUQXP50CN tag=G19HI4DOJ0QJ type=del size=482288 2024-09-22T08:21:10.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.346+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=R32TL9640V29 type=del size=2897727 2024-09-22T08:21:10.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.347+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~OPGZY18B4M52.0 size=1048576 2024-09-22T08:21:10.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.349+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~OPGZY18B4M52.1 size=1048576 2024-09-22T08:21:10.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.349+0000 7fe6c9c31780 1 < canceled part key=_multipart_KZIY400KQ5NH.2~OPGZY18B4M52.2 size=331671 2024-09-22T08:21:10.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.351+0000 7fe6c9c31780 1 < canceled multipart upload key=KZIY400KQ5NH upload=OPGZY18B4M52 tag=KO55LJZ1WPCE type=write size=3477399 2024-09-22T08:21:10.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.352+0000 7fe6c9c31780 1 > prepared operation key=JT5AB8VLMEFD tag=CPGQN6QCQIX8 type=write size=775331 2024-09-22T08:21:10.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.354+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~MBWF9RSKZZG1.0 size=1048576 2024-09-22T08:21:10.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.355+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~MBWF9RSKZZG1.1 size=270688 2024-09-22T08:21:10.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.357+0000 7fe6c9c31780 1 < completed multipart upload key=7446WN19QFV0 upload=MBWF9RSKZZG1 tag=ALYR8TDO33MR type=write size=2367840 2024-09-22T08:21:10.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.359+0000 7fe6c9c31780 1 > prepared operation key=XJP26CCPYDI7 tag=H3XUK1VYA55I type=del size=734434 2024-09-22T08:21:10.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.362+0000 7fe6c9c31780 1 < suggested remove operation key=946H8F2AUPO2 tag=FNV6CEJHQBT3 type=del 2024-09-22T08:21:10.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.364+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~SOA9B9U7C220.0 size=1048576 2024-09-22T08:21:10.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.366+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~SOA9B9U7C220.1 size=582219 2024-09-22T08:21:10.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.366+0000 7fe6c9c31780 1 > prepared multipart upload key=TYVQ39KUV2V9 upload=SOA9B9U7C220 tag=C57PPK80L3NJ type=write size=2679371 2024-09-22T08:21:10.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.367+0000 7fe6c9c31780 1 < completed part key=_multipart_4KRJ7DTE3KDV.2~L9PN99LW3DGG.0 size=1048576 2024-09-22T08:21:10.370 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.368+0000 7fe6c9c31780 1 < completed part key=_multipart_4KRJ7DTE3KDV.2~L9PN99LW3DGG.1 size=1048576 2024-09-22T08:21:10.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.370+0000 7fe6c9c31780 1 < completed part key=_multipart_4KRJ7DTE3KDV.2~L9PN99LW3DGG.2 size=830109 2024-09-22T08:21:10.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.372+0000 7fe6c9c31780 1 < completed multipart upload key=4KRJ7DTE3KDV upload=L9PN99LW3DGG tag=KEB688BCC5HH type=write size=3975837 2024-09-22T08:21:10.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.373+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=0G68XB5NTRZ8 type=del size=540683 2024-09-22T08:21:10.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.375+0000 7fe6c9c31780 1 < completed delete operation key=TYVQ39KUV2V9 tag=XMXTJ8W1WUX5 type=del 2024-09-22T08:21:10.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.377+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=NP00VOJ72U46 type=del size=497545 2024-09-22T08:21:10.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.378+0000 7fe6c9c31780 1 < completed write operation key=FY40JTHLT0KU tag=U6U48O35J94Y type=write size=749644 2024-09-22T08:21:10.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.379+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=A4WH6K98RTS1 type=del size=3735124 2024-09-22T08:21:10.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.381+0000 7fe6c9c31780 1 < completed part key=_multipart_6BKB91YV3FMW.2~EOKOZN7TVQ3M.0 size=1048576 2024-09-22T08:21:10.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.382+0000 7fe6c9c31780 1 < completed part key=_multipart_6BKB91YV3FMW.2~EOKOZN7TVQ3M.1 size=141544 2024-09-22T08:21:10.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.384+0000 7fe6c9c31780 1 < completed multipart upload key=6BKB91YV3FMW upload=EOKOZN7TVQ3M tag=VORBD5HVK2QP type=write size=2238696 2024-09-22T08:21:10.388 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.387+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~LR17S3E9VGB1.0 size=1048576 2024-09-22T08:21:10.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.388+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~LR17S3E9VGB1.1 size=1048576 2024-09-22T08:21:10.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.389+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~LR17S3E9VGB1.2 size=844827 2024-09-22T08:21:10.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.389+0000 7fe6c9c31780 1 > prepared multipart upload key=ILW34WLX48WN upload=LR17S3E9VGB1 tag=6F8L4JFAHYJX type=write size=3990555 2024-09-22T08:21:10.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.390+0000 7fe6c9c31780 1 < completed delete operation key=FY40JTHLT0KU tag=9NO4J4H9NT1H type=del 2024-09-22T08:21:10.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.393+0000 7fe6c9c31780 1 > prepared part key=_multipart_W9L87PTJEIOA.2~Z913QGYQF7DH.0 size=1048576 2024-09-22T08:21:10.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.395+0000 7fe6c9c31780 1 > prepared part key=_multipart_W9L87PTJEIOA.2~Z913QGYQF7DH.1 size=620799 2024-09-22T08:21:10.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.395+0000 7fe6c9c31780 1 > prepared multipart upload key=W9L87PTJEIOA upload=Z913QGYQF7DH tag=7L13CE6U32M0 type=write size=2717951 2024-09-22T08:21:10.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.396+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~RRSMF37G041B.0 size=1048576 2024-09-22T08:21:10.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.399+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~RRSMF37G041B.1 size=1048576 2024-09-22T08:21:10.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.399+0000 7fe6c9c31780 1 < canceled part key=_multipart_OX1LY7URY7IV.2~RRSMF37G041B.2 size=314030 2024-09-22T08:21:10.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.400+0000 7fe6c9c31780 1 < canceled multipart upload key=OX1LY7URY7IV upload=RRSMF37G041B tag=3K8PVWSC3R7N type=write size=3459758 2024-09-22T08:21:10.404 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.402+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=NBUV5OGM6KHT type=del size=3207770 2024-09-22T08:21:10.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.403+0000 7fe6c9c31780 1 < completed delete operation key=6BKB91YV3FMW tag=T3OVII699TEK type=del 2024-09-22T08:21:10.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.405+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=5TVM9LMIHLC3 type=del size=2757101 2024-09-22T08:21:10.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.406+0000 7fe6c9c31780 1 < completed write operation key=2B5QRUMTVE7U tag=L66NFJ2SPI0M type=write size=225451 2024-09-22T08:21:10.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.409+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~OCCBWWBRQYPD.0 size=1048576 2024-09-22T08:21:10.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.410+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~OCCBWWBRQYPD.1 size=1048576 2024-09-22T08:21:10.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.411+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~OCCBWWBRQYPD.2 size=556856 2024-09-22T08:21:10.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.411+0000 7fe6c9c31780 1 > prepared multipart upload key=T2W6RXP9UGHH upload=OCCBWWBRQYPD tag=D2VNKOXNXUH0 type=write size=3702584 2024-09-22T08:21:10.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.412+0000 7fe6c9c31780 1 < completed delete operation key=76HZ3LZGVT9J tag=AUWIJXN5O68T type=del 2024-09-22T08:21:10.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.414+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=FCBMKIHQTUWC type=del size=1775988 2024-09-22T08:21:10.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.415+0000 7fe6c9c31780 1 < completed delete operation key=TE10GB1F35X4 tag=4WKAZZY9ZI79 type=del 2024-09-22T08:21:10.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.418+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~HHVKGNE1WJVH.0 size=1048576 2024-09-22T08:21:10.420 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.419+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~HHVKGNE1WJVH.1 size=450291 2024-09-22T08:21:10.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.419+0000 7fe6c9c31780 1 > prepared multipart upload key=946H8F2AUPO2 upload=HHVKGNE1WJVH tag=NW8XUYSRGQWF type=write size=2547443 2024-09-22T08:21:10.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.420+0000 7fe6c9c31780 1 < completed delete operation key=ILW34WLX48WN tag=6EADQHMFW546 type=del 2024-09-22T08:21:10.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.422+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=XXZ7UXSB7Y8A type=del size=2827549 2024-09-22T08:21:10.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.424+0000 7fe6c9c31780 1 < suggested update operation key=6BKB91YV3FMW tag=0DNYGTTMM5SN type=del size=207570 2024-09-22T08:21:10.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.426+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=VLYOSGRQ50NT type=del size=3519869 2024-09-22T08:21:10.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.428+0000 7fe6c9c31780 1 < completed delete operation key=T2W6RXP9UGHH tag=R32TL9640V29 type=del 2024-09-22T08:21:10.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.430+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=5EOXTF1EUFE8 type=del size=4029631 2024-09-22T08:21:10.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.431+0000 7fe6c9c31780 1 < completed write operation key=JT5AB8VLMEFD tag=CPGQN6QCQIX8 type=write size=775331 2024-09-22T08:21:10.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.432+0000 7fe6c9c31780 1 > prepared operation key=9FCSIF1WKBDJ tag=WPEGBBN60NIZ type=del size=251688 2024-09-22T08:21:10.435 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.433+0000 7fe6c9c31780 1 < completed delete operation key=XJP26CCPYDI7 tag=H3XUK1VYA55I type=del 2024-09-22T08:21:10.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.435+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=NR213QLL4KGT type=write size=798102 2024-09-22T08:21:10.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.436+0000 7fe6c9c31780 1 < completed part key=_multipart_TYVQ39KUV2V9.2~SOA9B9U7C220.0 size=1048576 2024-09-22T08:21:10.439 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.437+0000 7fe6c9c31780 1 < completed part key=_multipart_TYVQ39KUV2V9.2~SOA9B9U7C220.1 size=582219 2024-09-22T08:21:10.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.441+0000 7fe6c9c31780 1 < completed multipart upload key=TYVQ39KUV2V9 upload=SOA9B9U7C220 tag=C57PPK80L3NJ type=write size=2679371 2024-09-22T08:21:10.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.442+0000 7fe6c9c31780 1 > prepared operation key=Z1CK5EDBK4AW tag=JEEH0VRU0VCT type=del size=1022455 2024-09-22T08:21:10.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.443+0000 7fe6c9c31780 1 < canceled operation key=9AZWQ9E58QS6 tag=0G68XB5NTRZ8 type=del size=540683 2024-09-22T08:21:10.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.446+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~RXEM7WOU23K9.0 size=1048576 2024-09-22T08:21:10.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.448+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~RXEM7WOU23K9.1 size=1048576 2024-09-22T08:21:10.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.449+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~RXEM7WOU23K9.2 size=221672 2024-09-22T08:21:10.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.449+0000 7fe6c9c31780 1 > prepared multipart upload key=0TWY0NNZZ7NN upload=RXEM7WOU23K9 tag=8HDVTS9LC20Z type=write size=3367400 2024-09-22T08:21:10.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.452+0000 7fe6c9c31780 1 < suggested update operation key=TE10GB1F35X4 tag=NP00VOJ72U46 type=del size=497545 2024-09-22T08:21:10.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.453+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=GPJ0IHHJCDNW type=write size=136607 2024-09-22T08:21:10.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.454+0000 7fe6c9c31780 1 < completed delete operation key=76HZ3LZGVT9J tag=A4WH6K98RTS1 type=del 2024-09-22T08:21:10.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.456+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=PLI88KXTXRKM type=write size=396337 2024-09-22T08:21:10.458 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.456+0000 7fe6c9c31780 1 < canceled part key=_multipart_ILW34WLX48WN.2~LR17S3E9VGB1.0 size=1048576 2024-09-22T08:21:10.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.457+0000 7fe6c9c31780 1 < completed part key=_multipart_ILW34WLX48WN.2~LR17S3E9VGB1.1 size=1048576 2024-09-22T08:21:10.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.458+0000 7fe6c9c31780 1 < completed part key=_multipart_ILW34WLX48WN.2~LR17S3E9VGB1.2 size=844827 2024-09-22T08:21:10.463 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.461+0000 7fe6c9c31780 1 < canceled multipart upload key=ILW34WLX48WN upload=LR17S3E9VGB1 tag=6F8L4JFAHYJX type=write size=3990555 2024-09-22T08:21:10.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.463+0000 7fe6c9c31780 1 > prepared operation key=O1UBUQXP50CN tag=74ILVT7P4DLJ type=del size=3122221 2024-09-22T08:21:10.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.465+0000 7fe6c9c31780 1 < completed part key=_multipart_W9L87PTJEIOA.2~Z913QGYQF7DH.0 size=1048576 2024-09-22T08:21:10.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.466+0000 7fe6c9c31780 1 < completed part key=_multipart_W9L87PTJEIOA.2~Z913QGYQF7DH.1 size=620799 2024-09-22T08:21:10.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.468+0000 7fe6c9c31780 1 < completed multipart upload key=W9L87PTJEIOA upload=Z913QGYQF7DH tag=7L13CE6U32M0 type=write size=2717951 2024-09-22T08:21:10.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.470+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=6PHGR05BYW9H type=del size=1849766 2024-09-22T08:21:10.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.471+0000 7fe6c9c31780 1 < completed delete operation key=T2W6RXP9UGHH tag=NBUV5OGM6KHT type=del 2024-09-22T08:21:10.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.474+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~1O2TSET7UNB1.0 size=1048576 2024-09-22T08:21:10.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.475+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~1O2TSET7UNB1.1 size=33213 2024-09-22T08:21:10.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.475+0000 7fe6c9c31780 1 > prepared multipart upload key=GEWQUFB9K35E upload=1O2TSET7UNB1 tag=JHZVD4Q6CYT7 type=write size=2130365 2024-09-22T08:21:10.478 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.477+0000 7fe6c9c31780 1 < completed delete operation key=CTK01Y0CV1NC tag=5TVM9LMIHLC3 type=del 2024-09-22T08:21:10.481 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.479+0000 7fe6c9c31780 1 > prepared part key=_multipart_ZFL9N44PBQX4.2~9NL14N66T3DH.0 size=1048576 2024-09-22T08:21:10.481 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.480+0000 7fe6c9c31780 1 > prepared part key=_multipart_ZFL9N44PBQX4.2~9NL14N66T3DH.1 size=400311 2024-09-22T08:21:10.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.480+0000 7fe6c9c31780 1 > prepared multipart upload key=ZFL9N44PBQX4 upload=9NL14N66T3DH tag=4FNSC7JSOHAP type=write size=2497463 2024-09-22T08:21:10.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.480+0000 7fe6c9c31780 1 < canceled part key=_multipart_T2W6RXP9UGHH.2~OCCBWWBRQYPD.0 size=1048576 2024-09-22T08:21:10.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.481+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~OCCBWWBRQYPD.1 size=1048576 2024-09-22T08:21:10.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.481+0000 7fe6c9c31780 1 < canceled part key=_multipart_T2W6RXP9UGHH.2~OCCBWWBRQYPD.2 size=556856 2024-09-22T08:21:10.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.484+0000 7fe6c9c31780 1 < canceled multipart upload key=T2W6RXP9UGHH upload=OCCBWWBRQYPD tag=D2VNKOXNXUH0 type=write size=3702584 2024-09-22T08:21:10.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.485+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=51OB5648WA5U type=del size=1951164 2024-09-22T08:21:10.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.488+0000 7fe6c9c31780 1 < suggested remove operation key=ILW34WLX48WN tag=FCBMKIHQTUWC type=del 2024-09-22T08:21:10.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.491+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~A4PH78836L8T.0 size=1048576 2024-09-22T08:21:10.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.492+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~A4PH78836L8T.1 size=1048576 2024-09-22T08:21:10.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.493+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~A4PH78836L8T.2 size=990492 2024-09-22T08:21:10.495 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.493+0000 7fe6c9c31780 1 > prepared multipart upload key=LA6ZRVULGQ0H upload=A4PH78836L8T tag=AHJOMDOHVA1O type=write size=4136220 2024-09-22T08:21:10.496 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.494+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~HHVKGNE1WJVH.0 size=1048576 2024-09-22T08:21:10.497 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.495+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~HHVKGNE1WJVH.1 size=450291 2024-09-22T08:21:10.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.498+0000 7fe6c9c31780 1 < completed multipart upload key=946H8F2AUPO2 upload=HHVKGNE1WJVH tag=NW8XUYSRGQWF type=write size=2547443 2024-09-22T08:21:10.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.499+0000 7fe6c9c31780 1 > prepared operation key=FY40JTHLT0KU tag=O806T2NHIX5I type=del size=2846010 2024-09-22T08:21:10.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.502+0000 7fe6c9c31780 1 < completed delete operation key=DC7VLQWZ3TD1 tag=XXZ7UXSB7Y8A type=del 2024-09-22T08:21:10.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.504+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~LEYKR4FJ1NMA.0 size=1048576 2024-09-22T08:21:10.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.505+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~LEYKR4FJ1NMA.1 size=1048576 2024-09-22T08:21:10.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.507+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~LEYKR4FJ1NMA.2 size=200470 2024-09-22T08:21:10.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.507+0000 7fe6c9c31780 1 > prepared multipart upload key=FY40JTHLT0KU upload=LEYKR4FJ1NMA tag=KVSH57UIO0AB type=write size=3346198 2024-09-22T08:21:10.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.508+0000 7fe6c9c31780 1 < completed delete operation key=9AZWQ9E58QS6 tag=VLYOSGRQ50NT type=del 2024-09-22T08:21:10.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.511+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~FVT53436OPJO.0 size=1048576 2024-09-22T08:21:10.513 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.512+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~FVT53436OPJO.1 size=1048576 2024-09-22T08:21:10.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.514+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~FVT53436OPJO.2 size=734931 2024-09-22T08:21:10.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.514+0000 7fe6c9c31780 1 > prepared multipart upload key=946H8F2AUPO2 upload=FVT53436OPJO tag=SFUXTXX3HJGR type=write size=3880659 2024-09-22T08:21:10.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.514+0000 7fe6c9c31780 1 < completed delete operation key=T2W6RXP9UGHH tag=5EOXTF1EUFE8 type=del 2024-09-22T08:21:10.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.517+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~S28NZALU5685.0 size=1048576 2024-09-22T08:21:10.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.518+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~S28NZALU5685.1 size=751519 2024-09-22T08:21:10.520 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.518+0000 7fe6c9c31780 1 > prepared multipart upload key=T2W6RXP9UGHH upload=S28NZALU5685 tag=K61KPYQF2HKN type=write size=2848671 2024-09-22T08:21:10.521 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.519+0000 7fe6c9c31780 1 < completed delete operation key=9FCSIF1WKBDJ tag=WPEGBBN60NIZ type=del 2024-09-22T08:21:10.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.522+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~NA1G5V8QQB10.0 size=49544 2024-09-22T08:21:10.524 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.522+0000 7fe6c9c31780 1 > prepared multipart upload key=4KRJ7DTE3KDV upload=NA1G5V8QQB10 tag=JDRZ12UQ21J3 type=write size=1098120 2024-09-22T08:21:10.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.523+0000 7fe6c9c31780 1 < completed write operation key=9AZWQ9E58QS6 tag=NR213QLL4KGT type=write size=798102 2024-09-22T08:21:10.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.525+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=CO0U9DFWEL7R type=del size=167787 2024-09-22T08:21:10.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.526+0000 7fe6c9c31780 1 < canceled operation key=Z1CK5EDBK4AW tag=JEEH0VRU0VCT type=del size=1022455 2024-09-22T08:21:10.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.529+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=5577R380V3F3 type=del size=314982 2024-09-22T08:21:10.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.529+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~RXEM7WOU23K9.0 size=1048576 2024-09-22T08:21:10.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.531+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~RXEM7WOU23K9.1 size=1048576 2024-09-22T08:21:10.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.533+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~RXEM7WOU23K9.2 size=221672 2024-09-22T08:21:10.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.536+0000 7fe6c9c31780 1 < completed multipart upload key=0TWY0NNZZ7NN upload=RXEM7WOU23K9 tag=8HDVTS9LC20Z type=write size=3367400 2024-09-22T08:21:10.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.537+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=PI46J3Z908MB type=write size=724080 2024-09-22T08:21:10.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.538+0000 7fe6c9c31780 1 < completed write operation key=76HZ3LZGVT9J tag=GPJ0IHHJCDNW type=write size=136607 2024-09-22T08:21:10.542 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.542+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~S5DNAE6HVQDB.0 size=787433 2024-09-22T08:21:10.543 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.542+0000 7fe6c9c31780 1 > prepared multipart upload key=4KRJ7DTE3KDV upload=S5DNAE6HVQDB tag=JQ4BGCCILULH type=write size=1836009 2024-09-22T08:21:10.544 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.543+0000 7fe6c9c31780 1 < completed write operation key=T2W6RXP9UGHH tag=PLI88KXTXRKM type=write size=396337 2024-09-22T08:21:10.546 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.544+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=I5ZWNW6EZHOU type=del size=3086470 2024-09-22T08:21:10.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.547+0000 7fe6c9c31780 1 < completed delete operation key=O1UBUQXP50CN tag=74ILVT7P4DLJ type=del 2024-09-22T08:21:10.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.548+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=8O063W2IO4YM type=write size=244251 2024-09-22T08:21:10.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.550+0000 7fe6c9c31780 1 < completed delete operation key=0TWY0NNZZ7NN tag=6PHGR05BYW9H type=del 2024-09-22T08:21:10.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.552+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~G2D5N3N991UT.0 size=101653 2024-09-22T08:21:10.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.552+0000 7fe6c9c31780 1 > prepared multipart upload key=TYVQ39KUV2V9 upload=G2D5N3N991UT tag=1Y60FL4XV80H type=write size=1150229 2024-09-22T08:21:10.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.552+0000 7fe6c9c31780 1 < canceled part key=_multipart_GEWQUFB9K35E.2~1O2TSET7UNB1.0 size=1048576 2024-09-22T08:21:10.555 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.554+0000 7fe6c9c31780 1 < completed part key=_multipart_GEWQUFB9K35E.2~1O2TSET7UNB1.1 size=33213 2024-09-22T08:21:10.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.556+0000 7fe6c9c31780 1 < canceled multipart upload key=GEWQUFB9K35E upload=1O2TSET7UNB1 tag=JHZVD4Q6CYT7 type=write size=2130365 2024-09-22T08:21:10.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.557+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=T5P75UV693BZ type=del size=2751868 2024-09-22T08:21:10.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.559+0000 7fe6c9c31780 1 < completed part key=_multipart_ZFL9N44PBQX4.2~9NL14N66T3DH.0 size=1048576 2024-09-22T08:21:10.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.560+0000 7fe6c9c31780 1 < completed part key=_multipart_ZFL9N44PBQX4.2~9NL14N66T3DH.1 size=400311 2024-09-22T08:21:10.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.562+0000 7fe6c9c31780 1 < completed multipart upload key=ZFL9N44PBQX4 upload=9NL14N66T3DH tag=4FNSC7JSOHAP type=write size=2497463 2024-09-22T08:21:10.566 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.564+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~403SSD8K8WOW.0 size=1048576 2024-09-22T08:21:10.567 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.566+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~403SSD8K8WOW.1 size=789869 2024-09-22T08:21:10.567 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.566+0000 7fe6c9c31780 1 > prepared multipart upload key=CTK01Y0CV1NC upload=403SSD8K8WOW tag=0UQU6U8X66GW type=write size=2887021 2024-09-22T08:21:10.569 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.567+0000 7fe6c9c31780 1 < completed delete operation key=76HZ3LZGVT9J tag=51OB5648WA5U type=del 2024-09-22T08:21:10.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.568+0000 7fe6c9c31780 1 > prepared operation key=VP1MP4IC9A7T tag=JGJ3X5T7ZHSA type=write size=949772 2024-09-22T08:21:10.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.570+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~A4PH78836L8T.0 size=1048576 2024-09-22T08:21:10.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.571+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~A4PH78836L8T.1 size=1048576 2024-09-22T08:21:10.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.573+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~A4PH78836L8T.2 size=990492 2024-09-22T08:21:10.578 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.575+0000 7fe6c9c31780 1 < completed multipart upload key=LA6ZRVULGQ0H upload=A4PH78836L8T tag=AHJOMDOHVA1O type=write size=4136220 2024-09-22T08:21:10.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.578+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~9NC334RTOEEB.0 size=1048576 2024-09-22T08:21:10.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.579+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~9NC334RTOEEB.1 size=1048576 2024-09-22T08:21:10.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.580+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~9NC334RTOEEB.2 size=462123 2024-09-22T08:21:10.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.580+0000 7fe6c9c31780 1 > prepared multipart upload key=ILW34WLX48WN upload=9NC334RTOEEB tag=A9CCHZZMFZB7 type=write size=3607851 2024-09-22T08:21:10.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.581+0000 7fe6c9c31780 1 < completed delete operation key=FY40JTHLT0KU tag=O806T2NHIX5I type=del 2024-09-22T08:21:10.585 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.583+0000 7fe6c9c31780 1 > prepared operation key=W9L87PTJEIOA tag=3L3UC32P4GE3 type=write size=788903 2024-09-22T08:21:10.585 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.583+0000 7fe6c9c31780 1 < canceled part key=_multipart_FY40JTHLT0KU.2~LEYKR4FJ1NMA.0 size=1048576 2024-09-22T08:21:10.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.585+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~LEYKR4FJ1NMA.1 size=1048576 2024-09-22T08:21:10.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.586+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~LEYKR4FJ1NMA.2 size=200470 2024-09-22T08:21:10.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.588+0000 7fe6c9c31780 1 < canceled multipart upload key=FY40JTHLT0KU upload=LEYKR4FJ1NMA tag=KVSH57UIO0AB type=write size=3346198 2024-09-22T08:21:10.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.591+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~36E2NTBC72FQ.0 size=366867 2024-09-22T08:21:10.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.591+0000 7fe6c9c31780 1 > prepared multipart upload key=2B5QRUMTVE7U upload=36E2NTBC72FQ tag=4T44Y5SCTO3D type=write size=1415443 2024-09-22T08:21:10.594 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.593+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~FVT53436OPJO.0 size=1048576 2024-09-22T08:21:10.595 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.594+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~FVT53436OPJO.1 size=1048576 2024-09-22T08:21:10.596 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.594+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~FVT53436OPJO.2 size=734931 2024-09-22T08:21:10.598 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.597+0000 7fe6c9c31780 1 < completed multipart upload key=946H8F2AUPO2 upload=FVT53436OPJO tag=SFUXTXX3HJGR type=write size=3880659 2024-09-22T08:21:10.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.598+0000 7fe6c9c31780 1 > prepared operation key=W9L87PTJEIOA tag=MAQFQEP06NMB type=del size=2222197 2024-09-22T08:21:10.602 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.600+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~S28NZALU5685.0 size=1048576 2024-09-22T08:21:10.603 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.602+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~S28NZALU5685.1 size=751519 2024-09-22T08:21:10.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.604+0000 7fe6c9c31780 1 < completed multipart upload key=T2W6RXP9UGHH upload=S28NZALU5685 tag=K61KPYQF2HKN type=write size=2848671 2024-09-22T08:21:10.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.605+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=B2M2ZQXCZP1E type=del size=2691947 2024-09-22T08:21:10.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.607+0000 7fe6c9c31780 1 < completed part key=_multipart_4KRJ7DTE3KDV.2~NA1G5V8QQB10.0 size=49544 2024-09-22T08:21:10.611 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.610+0000 7fe6c9c31780 1 < completed multipart upload key=4KRJ7DTE3KDV upload=NA1G5V8QQB10 tag=JDRZ12UQ21J3 type=write size=1098120 2024-09-22T08:21:10.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.611+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=0XM88XKUEXZR type=write size=786863 2024-09-22T08:21:10.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.612+0000 7fe6c9c31780 1 < completed delete operation key=DC7VLQWZ3TD1 tag=CO0U9DFWEL7R type=del 2024-09-22T08:21:10.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.616+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~JOD6C4FAFD9I.0 size=1048576 2024-09-22T08:21:10.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.617+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~JOD6C4FAFD9I.1 size=1048576 2024-09-22T08:21:10.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.618+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~JOD6C4FAFD9I.2 size=833672 2024-09-22T08:21:10.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.618+0000 7fe6c9c31780 1 > prepared multipart upload key=KZIY400KQ5NH upload=JOD6C4FAFD9I tag=96PIKYZDLFOU type=write size=3979400 2024-09-22T08:21:10.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.619+0000 7fe6c9c31780 1 < completed delete operation key=ILW34WLX48WN tag=5577R380V3F3 type=del 2024-09-22T08:21:10.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.620+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=IDLZIRPSYUTQ type=del size=4167849 2024-09-22T08:21:10.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.622+0000 7fe6c9c31780 1 < completed write operation key=946H8F2AUPO2 tag=PI46J3Z908MB type=write size=724080 2024-09-22T08:21:10.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.624+0000 7fe6c9c31780 1 > prepared part key=_multipart_W9L87PTJEIOA.2~G4KPW2HYB9PD.0 size=1048576 2024-09-22T08:21:10.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.625+0000 7fe6c9c31780 1 > prepared part key=_multipart_W9L87PTJEIOA.2~G4KPW2HYB9PD.1 size=1048576 2024-09-22T08:21:10.628 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.627+0000 7fe6c9c31780 1 > prepared part key=_multipart_W9L87PTJEIOA.2~G4KPW2HYB9PD.2 size=179313 2024-09-22T08:21:10.628 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.627+0000 7fe6c9c31780 1 > prepared multipart upload key=W9L87PTJEIOA upload=G4KPW2HYB9PD tag=5WG23EP4O0HK type=write size=3325041 2024-09-22T08:21:10.630 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.629+0000 7fe6c9c31780 1 < completed part key=_multipart_4KRJ7DTE3KDV.2~S5DNAE6HVQDB.0 size=787433 2024-09-22T08:21:10.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.632+0000 7fe6c9c31780 1 < completed multipart upload key=4KRJ7DTE3KDV upload=S5DNAE6HVQDB tag=JQ4BGCCILULH type=write size=1836009 2024-09-22T08:21:10.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.632+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=53BJZNT2LOS7 type=del size=790034 2024-09-22T08:21:10.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.635+0000 7fe6c9c31780 1 < completed delete operation key=T2W6RXP9UGHH tag=I5ZWNW6EZHOU type=del 2024-09-22T08:21:10.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.637+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~2JTFASC3USJ0.0 size=485241 2024-09-22T08:21:10.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.637+0000 7fe6c9c31780 1 > prepared multipart upload key=T2W6RXP9UGHH upload=2JTFASC3USJ0 tag=NIZ9Y41NHDZT type=write size=1533817 2024-09-22T08:21:10.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.640+0000 7fe6c9c31780 1 < suggested update operation key=9AZWQ9E58QS6 tag=8O063W2IO4YM type=write size=244251 2024-09-22T08:21:10.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.642+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=PR9RZE20DBE4 type=write size=669881 2024-09-22T08:21:10.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.642+0000 7fe6c9c31780 1 < canceled part key=_multipart_TYVQ39KUV2V9.2~G2D5N3N991UT.0 size=101653 2024-09-22T08:21:10.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.644+0000 7fe6c9c31780 1 < canceled multipart upload key=TYVQ39KUV2V9 upload=G2D5N3N991UT tag=1Y60FL4XV80H type=write size=1150229 2024-09-22T08:21:10.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.647+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~1MYATPAJQKQG.0 size=1048576 2024-09-22T08:21:10.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.647+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~1MYATPAJQKQG.1 size=974915 2024-09-22T08:21:10.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.647+0000 7fe6c9c31780 1 > prepared multipart upload key=Z1CK5EDBK4AW upload=1MYATPAJQKQG tag=CKILGD406DO7 type=write size=3072067 2024-09-22T08:21:10.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.649+0000 7fe6c9c31780 1 < canceled operation key=T2W6RXP9UGHH tag=T5P75UV693BZ type=del size=2751868 2024-09-22T08:21:10.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.650+0000 7fe6c9c31780 1 > prepared operation key=OX1LY7URY7IV tag=Y1273RMV9U1C type=del size=3558131 2024-09-22T08:21:10.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.652+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~403SSD8K8WOW.0 size=1048576 2024-09-22T08:21:10.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.652+0000 7fe6c9c31780 1 < canceled part key=_multipart_CTK01Y0CV1NC.2~403SSD8K8WOW.1 size=789869 2024-09-22T08:21:10.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.655+0000 7fe6c9c31780 1 < canceled multipart upload key=CTK01Y0CV1NC upload=403SSD8K8WOW tag=0UQU6U8X66GW type=write size=2887021 2024-09-22T08:21:10.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.657+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~SVZ1JHE4N4UX.0 size=1048576 2024-09-22T08:21:10.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.658+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~SVZ1JHE4N4UX.1 size=1048576 2024-09-22T08:21:10.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.659+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~SVZ1JHE4N4UX.2 size=688134 2024-09-22T08:21:10.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.659+0000 7fe6c9c31780 1 > prepared multipart upload key=O1UBUQXP50CN upload=SVZ1JHE4N4UX tag=DKQG87IR0O9R type=write size=3833862 2024-09-22T08:21:10.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.660+0000 7fe6c9c31780 1 < completed write operation key=VP1MP4IC9A7T tag=JGJ3X5T7ZHSA type=write size=949772 2024-09-22T08:21:10.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.662+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=IK8SB7BY2K2C type=del size=2674430 2024-09-22T08:21:10.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.663+0000 7fe6c9c31780 1 < completed part key=_multipart_ILW34WLX48WN.2~9NC334RTOEEB.0 size=1048576 2024-09-22T08:21:10.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.665+0000 7fe6c9c31780 1 < completed part key=_multipart_ILW34WLX48WN.2~9NC334RTOEEB.1 size=1048576 2024-09-22T08:21:10.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.665+0000 7fe6c9c31780 1 < completed part key=_multipart_ILW34WLX48WN.2~9NC334RTOEEB.2 size=462123 2024-09-22T08:21:10.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.669+0000 7fe6c9c31780 1 < completed multipart upload key=ILW34WLX48WN upload=9NC334RTOEEB tag=A9CCHZZMFZB7 type=write size=3607851 2024-09-22T08:21:10.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.671+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~ESAJIN6LU7NF.0 size=210360 2024-09-22T08:21:10.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.671+0000 7fe6c9c31780 1 > prepared multipart upload key=JT5AB8VLMEFD upload=ESAJIN6LU7NF tag=TBGD4HSPY72X type=write size=1258936 2024-09-22T08:21:10.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.673+0000 7fe6c9c31780 1 < completed write operation key=W9L87PTJEIOA tag=3L3UC32P4GE3 type=write size=788903 2024-09-22T08:21:10.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.674+0000 7fe6c9c31780 1 > prepared operation key=9FCSIF1WKBDJ tag=2MSED2190LIF type=del size=4102283 2024-09-22T08:21:10.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.676+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~36E2NTBC72FQ.0 size=366867 2024-09-22T08:21:10.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.678+0000 7fe6c9c31780 1 < completed multipart upload key=2B5QRUMTVE7U upload=36E2NTBC72FQ tag=4T44Y5SCTO3D type=write size=1415443 2024-09-22T08:21:10.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.679+0000 7fe6c9c31780 1 > prepared operation key=9FCSIF1WKBDJ tag=NIPHCDBZURXP type=del size=1599269 2024-09-22T08:21:10.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.681+0000 7fe6c9c31780 1 < completed delete operation key=W9L87PTJEIOA tag=MAQFQEP06NMB type=del 2024-09-22T08:21:10.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.682+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=EFNWFG8BZNLO type=del size=1600911 2024-09-22T08:21:10.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.684+0000 7fe6c9c31780 1 < completed delete operation key=2B5QRUMTVE7U tag=B2M2ZQXCZP1E type=del 2024-09-22T08:21:10.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.686+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~YBDF4NZ0CS00.0 size=1048576 2024-09-22T08:21:10.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.687+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~YBDF4NZ0CS00.1 size=1048576 2024-09-22T08:21:10.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.688+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~YBDF4NZ0CS00.2 size=331237 2024-09-22T08:21:10.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.688+0000 7fe6c9c31780 1 > prepared multipart upload key=XJP26CCPYDI7 upload=YBDF4NZ0CS00 tag=QIXI2Z99JD5E type=write size=3476965 2024-09-22T08:21:10.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.690+0000 7fe6c9c31780 1 < completed write operation key=ILW34WLX48WN tag=0XM88XKUEXZR type=write size=786863 2024-09-22T08:21:10.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.691+0000 7fe6c9c31780 1 > prepared operation key=1HZ0NAJPXNW1 tag=PZ4AAR6SH4Q2 type=del size=1333519 2024-09-22T08:21:10.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.693+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~JOD6C4FAFD9I.0 size=1048576 2024-09-22T08:21:10.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.694+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~JOD6C4FAFD9I.1 size=1048576 2024-09-22T08:21:10.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.695+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~JOD6C4FAFD9I.2 size=833672 2024-09-22T08:21:10.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.699+0000 7fe6c9c31780 1 < completed multipart upload key=KZIY400KQ5NH upload=JOD6C4FAFD9I tag=96PIKYZDLFOU type=write size=3979400 2024-09-22T08:21:10.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.699+0000 7fe6c9c31780 1 > prepared operation key=XJP26CCPYDI7 tag=9W24SAJA5X6T type=write size=42175 2024-09-22T08:21:10.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.701+0000 7fe6c9c31780 1 < completed delete operation key=T2W6RXP9UGHH tag=IDLZIRPSYUTQ type=del 2024-09-22T08:21:10.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.702+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=YN6ZHM2HXH5S type=del size=1960351 2024-09-22T08:21:10.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.704+0000 7fe6c9c31780 1 < completed part key=_multipart_W9L87PTJEIOA.2~G4KPW2HYB9PD.0 size=1048576 2024-09-22T08:21:10.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.704+0000 7fe6c9c31780 1 < canceled part key=_multipart_W9L87PTJEIOA.2~G4KPW2HYB9PD.1 size=1048576 2024-09-22T08:21:10.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.705+0000 7fe6c9c31780 1 < completed part key=_multipart_W9L87PTJEIOA.2~G4KPW2HYB9PD.2 size=179313 2024-09-22T08:21:10.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.707+0000 7fe6c9c31780 1 < canceled multipart upload key=W9L87PTJEIOA upload=G4KPW2HYB9PD tag=5WG23EP4O0HK type=write size=3325041 2024-09-22T08:21:10.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.709+0000 7fe6c9c31780 1 > prepared operation key=TJTB67QBLZH5 tag=F3BZ4ZDV7AOG type=del size=362331 2024-09-22T08:21:10.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.710+0000 7fe6c9c31780 1 < canceled operation key=ILW34WLX48WN tag=53BJZNT2LOS7 type=del size=790034 2024-09-22T08:21:10.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.713+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~N188P3QPO9AM.0 size=1048576 2024-09-22T08:21:10.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.715+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~N188P3QPO9AM.1 size=634145 2024-09-22T08:21:10.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.715+0000 7fe6c9c31780 1 > prepared multipart upload key=ILW34WLX48WN upload=N188P3QPO9AM tag=LNNYUWYFV2Q5 type=write size=2731297 2024-09-22T08:21:10.717 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.715+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~2JTFASC3USJ0.0 size=485241 2024-09-22T08:21:10.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.719+0000 7fe6c9c31780 1 < completed multipart upload key=T2W6RXP9UGHH upload=2JTFASC3USJ0 tag=NIZ9Y41NHDZT type=write size=1533817 2024-09-22T08:21:10.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.720+0000 7fe6c9c31780 1 > prepared operation key=1HZ0NAJPXNW1 tag=80KPAKZ92IV1 type=del size=4052856 2024-09-22T08:21:10.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.721+0000 7fe6c9c31780 1 < completed write operation key=7446WN19QFV0 tag=PR9RZE20DBE4 type=write size=669881 2024-09-22T08:21:10.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.722+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=N6KZECT45N6U type=write size=147816 2024-09-22T08:21:10.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.724+0000 7fe6c9c31780 1 < completed part key=_multipart_Z1CK5EDBK4AW.2~1MYATPAJQKQG.0 size=1048576 2024-09-22T08:21:10.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.725+0000 7fe6c9c31780 1 < completed part key=_multipart_Z1CK5EDBK4AW.2~1MYATPAJQKQG.1 size=974915 2024-09-22T08:21:10.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.727+0000 7fe6c9c31780 1 < completed multipart upload key=Z1CK5EDBK4AW upload=1MYATPAJQKQG tag=CKILGD406DO7 type=write size=3072067 2024-09-22T08:21:10.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.729+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=CQ13P1EEAGYR type=del size=2671392 2024-09-22T08:21:10.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.730+0000 7fe6c9c31780 1 < completed delete operation key=OX1LY7URY7IV tag=Y1273RMV9U1C type=del 2024-09-22T08:21:10.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.732+0000 7fe6c9c31780 1 > prepared operation key=4KRJ7DTE3KDV tag=FTPF3WSUH5BW type=del size=3155805 2024-09-22T08:21:10.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.734+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~SVZ1JHE4N4UX.0 size=1048576 2024-09-22T08:21:10.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.735+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~SVZ1JHE4N4UX.1 size=1048576 2024-09-22T08:21:10.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.736+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~SVZ1JHE4N4UX.2 size=688134 2024-09-22T08:21:10.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.739+0000 7fe6c9c31780 1 < completed multipart upload key=O1UBUQXP50CN upload=SVZ1JHE4N4UX tag=DKQG87IR0O9R type=write size=3833862 2024-09-22T08:21:10.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.742+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~TVOJ112AGMXC.0 size=1048576 2024-09-22T08:21:10.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.742+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~TVOJ112AGMXC.1 size=571043 2024-09-22T08:21:10.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.742+0000 7fe6c9c31780 1 > prepared multipart upload key=Z1CK5EDBK4AW upload=TVOJ112AGMXC tag=2CDOV0HMKP3H type=write size=2668195 2024-09-22T08:21:10.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.744+0000 7fe6c9c31780 1 < completed delete operation key=R7UWMW913DJQ tag=IK8SB7BY2K2C type=del 2024-09-22T08:21:10.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.747+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~6E9Y7Z0FZQDE.0 size=95803 2024-09-22T08:21:10.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.747+0000 7fe6c9c31780 1 > prepared multipart upload key=946H8F2AUPO2 upload=6E9Y7Z0FZQDE tag=XJGKM9CKTOOJ type=write size=1144379 2024-09-22T08:21:10.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.748+0000 7fe6c9c31780 1 < completed part key=_multipart_JT5AB8VLMEFD.2~ESAJIN6LU7NF.0 size=210360 2024-09-22T08:21:10.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.750+0000 7fe6c9c31780 1 < completed multipart upload key=JT5AB8VLMEFD upload=ESAJIN6LU7NF tag=TBGD4HSPY72X type=write size=1258936 2024-09-22T08:21:10.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.752+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=UZVDJBVEB09I type=write size=323399 2024-09-22T08:21:10.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.753+0000 7fe6c9c31780 1 < completed delete operation key=9FCSIF1WKBDJ tag=2MSED2190LIF type=del 2024-09-22T08:21:10.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.756+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~2N2XVPD0MR6E.0 size=1048576 2024-09-22T08:21:10.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.757+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~2N2XVPD0MR6E.1 size=365931 2024-09-22T08:21:10.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.757+0000 7fe6c9c31780 1 > prepared multipart upload key=CTK01Y0CV1NC upload=2N2XVPD0MR6E tag=JZK7RVZNO4NP type=write size=2463083 2024-09-22T08:21:10.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.758+0000 7fe6c9c31780 1 < completed delete operation key=9FCSIF1WKBDJ tag=NIPHCDBZURXP type=del 2024-09-22T08:21:10.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.761+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~3BM9VGV15W8U.0 size=1048576 2024-09-22T08:21:10.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.762+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~3BM9VGV15W8U.1 size=1048576 2024-09-22T08:21:10.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.763+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~3BM9VGV15W8U.2 size=414474 2024-09-22T08:21:10.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.763+0000 7fe6c9c31780 1 > prepared multipart upload key=0TWY0NNZZ7NN upload=3BM9VGV15W8U tag=5ZJ8L9GNR9ER type=write size=3560202 2024-09-22T08:21:10.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.766+0000 7fe6c9c31780 1 < suggested remove operation key=76HZ3LZGVT9J tag=EFNWFG8BZNLO type=del 2024-09-22T08:21:10.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.767+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=T8ML5JM04E0Q type=del size=1066751 2024-09-22T08:21:10.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.769+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~YBDF4NZ0CS00.0 size=1048576 2024-09-22T08:21:10.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.770+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~YBDF4NZ0CS00.1 size=1048576 2024-09-22T08:21:10.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.771+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~YBDF4NZ0CS00.2 size=331237 2024-09-22T08:21:10.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.774+0000 7fe6c9c31780 1 < completed multipart upload key=XJP26CCPYDI7 upload=YBDF4NZ0CS00 tag=QIXI2Z99JD5E type=write size=3476965 2024-09-22T08:21:10.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.775+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=YS2HA4V1PVXB type=del size=3109593 2024-09-22T08:21:10.779 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.778+0000 7fe6c9c31780 1 < suggested update operation key=1HZ0NAJPXNW1 tag=PZ4AAR6SH4Q2 type=del size=1333519 2024-09-22T08:21:10.782 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.781+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~TNIC5C98TU7O.0 size=1048576 2024-09-22T08:21:10.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.782+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~TNIC5C98TU7O.1 size=1048576 2024-09-22T08:21:10.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.783+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~TNIC5C98TU7O.2 size=716472 2024-09-22T08:21:10.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.783+0000 7fe6c9c31780 1 > prepared multipart upload key=LA6ZRVULGQ0H upload=TNIC5C98TU7O tag=Y5DPC9655NLG type=write size=3862200 2024-09-22T08:21:10.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.784+0000 7fe6c9c31780 1 < completed write operation key=XJP26CCPYDI7 tag=9W24SAJA5X6T type=write size=42175 2024-09-22T08:21:10.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.787+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~VUXD3IPQ7C53.0 size=1048576 2024-09-22T08:21:10.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.787+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~VUXD3IPQ7C53.1 size=174051 2024-09-22T08:21:10.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.787+0000 7fe6c9c31780 1 > prepared multipart upload key=0PNK2ZW6IJM1 upload=VUXD3IPQ7C53 tag=6H7NQVDYYGX1 type=write size=2271203 2024-09-22T08:21:10.792 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.791+0000 7fe6c9c31780 1 < suggested update operation key=9AZWQ9E58QS6 tag=YN6ZHM2HXH5S type=del size=1960351 2024-09-22T08:21:10.793 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.792+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=QCV6BQSLDNVY type=del size=2448935 2024-09-22T08:21:10.796 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.795+0000 7fe6c9c31780 1 < completed delete operation key=TJTB67QBLZH5 tag=F3BZ4ZDV7AOG type=del 2024-09-22T08:21:10.797 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.796+0000 7fe6c9c31780 1 > prepared operation key=GEWQUFB9K35E tag=KJLMVGIROE7S type=del size=3770307 2024-09-22T08:21:10.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.798+0000 7fe6c9c31780 1 < completed part key=_multipart_ILW34WLX48WN.2~N188P3QPO9AM.0 size=1048576 2024-09-22T08:21:10.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.799+0000 7fe6c9c31780 1 < completed part key=_multipart_ILW34WLX48WN.2~N188P3QPO9AM.1 size=634145 2024-09-22T08:21:10.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.802+0000 7fe6c9c31780 1 < completed multipart upload key=ILW34WLX48WN upload=N188P3QPO9AM tag=LNNYUWYFV2Q5 type=write size=2731297 2024-09-22T08:21:10.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.806+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~N2WWC3BEBQC7.0 size=488454 2024-09-22T08:21:10.808 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.806+0000 7fe6c9c31780 1 > prepared multipart upload key=6BKB91YV3FMW upload=N2WWC3BEBQC7 tag=NRTNW960A9ZU type=write size=1537030 2024-09-22T08:21:10.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.808+0000 7fe6c9c31780 -1 < failed to complete operation key=1HZ0NAJPXNW1 tag=80KPAKZ92IV1 type=del size=4052856: (22) Invalid argument 2024-09-22T08:21:10.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.809+0000 7fe6c9c31780 1 > prepared operation key=W9L87PTJEIOA tag=06LKJQ832FBZ type=del size=184483 2024-09-22T08:21:10.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.810+0000 7fe6c9c31780 1 < completed write operation key=946H8F2AUPO2 tag=N6KZECT45N6U type=write size=147816 2024-09-22T08:21:10.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.812+0000 7fe6c9c31780 1 > prepared operation key=O1UBUQXP50CN tag=XFOYAL8JUKW4 type=write size=214071 2024-09-22T08:21:10.816 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.815+0000 7fe6c9c31780 1 < suggested update operation key=0TWY0NNZZ7NN tag=CQ13P1EEAGYR type=del size=2671392 2024-09-22T08:21:10.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.817+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~O82U9H9DPYH0.0 size=1048576 2024-09-22T08:21:10.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.819+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~O82U9H9DPYH0.1 size=170027 2024-09-22T08:21:10.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.819+0000 7fe6c9c31780 1 > prepared multipart upload key=946H8F2AUPO2 upload=O82U9H9DPYH0 tag=KWTDJCNTI12V type=write size=2267179 2024-09-22T08:21:10.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.820+0000 7fe6c9c31780 1 < canceled operation key=4KRJ7DTE3KDV tag=FTPF3WSUH5BW type=del size=3155805 2024-09-22T08:21:10.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.821+0000 7fe6c9c31780 1 > prepared operation key=D85LJGGU3Z6F tag=QUINL650D3S0 type=del size=1963067 2024-09-22T08:21:10.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.823+0000 7fe6c9c31780 1 < completed part key=_multipart_Z1CK5EDBK4AW.2~TVOJ112AGMXC.0 size=1048576 2024-09-22T08:21:10.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.824+0000 7fe6c9c31780 1 < completed part key=_multipart_Z1CK5EDBK4AW.2~TVOJ112AGMXC.1 size=571043 2024-09-22T08:21:10.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.826+0000 7fe6c9c31780 1 < completed multipart upload key=Z1CK5EDBK4AW upload=TVOJ112AGMXC tag=2CDOV0HMKP3H type=write size=2668195 2024-09-22T08:21:10.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.829+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~17K64ZJG1OMQ.0 size=269366 2024-09-22T08:21:10.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.829+0000 7fe6c9c31780 1 > prepared multipart upload key=VP1MP4IC9A7T upload=17K64ZJG1OMQ tag=AHL128AXV8HB type=write size=1317942 2024-09-22T08:21:10.832 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.830+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~6E9Y7Z0FZQDE.0 size=95803 2024-09-22T08:21:10.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.832+0000 7fe6c9c31780 1 < completed multipart upload key=946H8F2AUPO2 upload=6E9Y7Z0FZQDE tag=XJGKM9CKTOOJ type=write size=1144379 2024-09-22T08:21:10.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.834+0000 7fe6c9c31780 1 > prepared operation key=ZFL9N44PBQX4 tag=IY0VLLAQSDN9 type=del size=2659026 2024-09-22T08:21:10.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.836+0000 7fe6c9c31780 1 < suggested update operation key=0TWY0NNZZ7NN tag=UZVDJBVEB09I type=write size=323399 2024-09-22T08:21:10.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.839+0000 7fe6c9c31780 1 > prepared part key=_multipart_TJTB67QBLZH5.2~M69N6VJ05AP7.0 size=1048576 2024-09-22T08:21:10.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.840+0000 7fe6c9c31780 1 > prepared part key=_multipart_TJTB67QBLZH5.2~M69N6VJ05AP7.1 size=1048576 2024-09-22T08:21:10.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.841+0000 7fe6c9c31780 1 > prepared part key=_multipart_TJTB67QBLZH5.2~M69N6VJ05AP7.2 size=756390 2024-09-22T08:21:10.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.841+0000 7fe6c9c31780 1 > prepared multipart upload key=TJTB67QBLZH5 upload=M69N6VJ05AP7 tag=97FDEZ16WOHG type=write size=3902118 2024-09-22T08:21:10.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.842+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~2N2XVPD0MR6E.0 size=1048576 2024-09-22T08:21:10.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.843+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~2N2XVPD0MR6E.1 size=365931 2024-09-22T08:21:10.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.847+0000 7fe6c9c31780 1 < completed multipart upload key=CTK01Y0CV1NC upload=2N2XVPD0MR6E tag=JZK7RVZNO4NP type=write size=2463083 2024-09-22T08:21:10.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.847+0000 7fe6c9c31780 1 > prepared operation key=GEWQUFB9K35E tag=OL4MFD2U4OKL type=write size=106139 2024-09-22T08:21:10.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.850+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~3BM9VGV15W8U.0 size=1048576 2024-09-22T08:21:10.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.850+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~3BM9VGV15W8U.1 size=1048576 2024-09-22T08:21:10.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.851+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~3BM9VGV15W8U.2 size=414474 2024-09-22T08:21:10.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.853+0000 7fe6c9c31780 1 < completed multipart upload key=0TWY0NNZZ7NN upload=3BM9VGV15W8U tag=5ZJ8L9GNR9ER type=write size=3560202 2024-09-22T08:21:10.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.856+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~IS0CZ3C6Q010.0 size=282587 2024-09-22T08:21:10.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.856+0000 7fe6c9c31780 1 > prepared multipart upload key=D85LJGGU3Z6F upload=IS0CZ3C6Q010 tag=UQ3Q6NVAFU43 type=write size=1331163 2024-09-22T08:21:10.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.857+0000 7fe6c9c31780 1 < completed delete operation key=2B5QRUMTVE7U tag=T8ML5JM04E0Q type=del 2024-09-22T08:21:10.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.858+0000 7fe6c9c31780 1 > prepared operation key=ZFL9N44PBQX4 tag=C87QHW5VU7LP type=del size=2526843 2024-09-22T08:21:10.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.860+0000 7fe6c9c31780 1 < completed delete operation key=DC7VLQWZ3TD1 tag=YS2HA4V1PVXB type=del 2024-09-22T08:21:10.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.862+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~YOF08I7NLXGH.0 size=1048576 2024-09-22T08:21:10.865 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.863+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~YOF08I7NLXGH.1 size=1048576 2024-09-22T08:21:10.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.864+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~YOF08I7NLXGH.2 size=923821 2024-09-22T08:21:10.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.864+0000 7fe6c9c31780 1 > prepared multipart upload key=XJP26CCPYDI7 upload=YOF08I7NLXGH tag=AAAL5OMML9CF type=write size=4069549 2024-09-22T08:21:10.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.866+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~TNIC5C98TU7O.0 size=1048576 2024-09-22T08:21:10.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.866+0000 7fe6c9c31780 1 < canceled part key=_multipart_LA6ZRVULGQ0H.2~TNIC5C98TU7O.1 size=1048576 2024-09-22T08:21:10.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.867+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~TNIC5C98TU7O.2 size=716472 2024-09-22T08:21:10.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.869+0000 7fe6c9c31780 1 < canceled multipart upload key=LA6ZRVULGQ0H upload=TNIC5C98TU7O tag=Y5DPC9655NLG type=write size=3862200 2024-09-22T08:21:10.874 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.873+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~NWYFCECJ9LN4.0 size=470848 2024-09-22T08:21:10.874 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.873+0000 7fe6c9c31780 1 > prepared multipart upload key=TE10GB1F35X4 upload=NWYFCECJ9LN4 tag=AKPYV51HUF8A type=write size=1519424 2024-09-22T08:21:10.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.874+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~VUXD3IPQ7C53.0 size=1048576 2024-09-22T08:21:10.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.874+0000 7fe6c9c31780 1 < canceled part key=_multipart_0PNK2ZW6IJM1.2~VUXD3IPQ7C53.1 size=174051 2024-09-22T08:21:10.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.876+0000 7fe6c9c31780 1 < canceled multipart upload key=0PNK2ZW6IJM1 upload=VUXD3IPQ7C53 tag=6H7NQVDYYGX1 type=write size=2271203 2024-09-22T08:21:10.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.879+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~6YWWDRDSNQH3.0 size=1048576 2024-09-22T08:21:10.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.880+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~6YWWDRDSNQH3.1 size=915363 2024-09-22T08:21:10.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.880+0000 7fe6c9c31780 1 > prepared multipart upload key=TYVQ39KUV2V9 upload=6YWWDRDSNQH3 tag=OB3JPRZ93B8F type=write size=3012515 2024-09-22T08:21:10.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.881+0000 7fe6c9c31780 1 < completed delete operation key=ILW34WLX48WN tag=QCV6BQSLDNVY type=del 2024-09-22T08:21:10.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.883+0000 7fe6c9c31780 1 > prepared operation key=KZIY400KQ5NH tag=VC0VA0GG9ZBQ type=del size=4125003 2024-09-22T08:21:10.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.884+0000 7fe6c9c31780 1 < canceled operation key=GEWQUFB9K35E tag=KJLMVGIROE7S type=del size=3770307 2024-09-22T08:21:10.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.887+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~21R2O34YXSI3.0 size=1048576 2024-09-22T08:21:10.889 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.888+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~21R2O34YXSI3.1 size=1048576 2024-09-22T08:21:10.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.889+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~21R2O34YXSI3.2 size=823654 2024-09-22T08:21:10.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.889+0000 7fe6c9c31780 1 > prepared multipart upload key=T2W6RXP9UGHH upload=21R2O34YXSI3 tag=AHL6J4WN68VA type=write size=3969382 2024-09-22T08:21:10.892 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.891+0000 7fe6c9c31780 1 < completed part key=_multipart_6BKB91YV3FMW.2~N2WWC3BEBQC7.0 size=488454 2024-09-22T08:21:10.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.894+0000 7fe6c9c31780 1 < completed multipart upload key=6BKB91YV3FMW upload=N2WWC3BEBQC7 tag=NRTNW960A9ZU type=write size=1537030 2024-09-22T08:21:10.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.895+0000 7fe6c9c31780 1 > prepared operation key=W9L87PTJEIOA tag=ML4NO6JAEIEO type=del size=3803873 2024-09-22T08:21:10.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.896+0000 7fe6c9c31780 1 < completed delete operation key=W9L87PTJEIOA tag=06LKJQ832FBZ type=del 2024-09-22T08:21:10.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.898+0000 7fe6c9c31780 1 > prepared operation key=TYVQ39KUV2V9 tag=7NFQ8TQ9SGHS type=del size=2834684 2024-09-22T08:21:10.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.899+0000 7fe6c9c31780 1 < completed write operation key=O1UBUQXP50CN tag=XFOYAL8JUKW4 type=write size=214071 2024-09-22T08:21:10.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.901+0000 7fe6c9c31780 1 > prepared operation key=JT5AB8VLMEFD tag=5JLNSNYV9TLF type=del size=4072461 2024-09-22T08:21:10.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.902+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~O82U9H9DPYH0.0 size=1048576 2024-09-22T08:21:10.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.903+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~O82U9H9DPYH0.1 size=170027 2024-09-22T08:21:10.907 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.906+0000 7fe6c9c31780 1 < completed multipart upload key=946H8F2AUPO2 upload=O82U9H9DPYH0 tag=KWTDJCNTI12V type=write size=2267179 2024-09-22T08:21:10.908 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.907+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=KX2PFOPUX2UY type=del size=1401007 2024-09-22T08:21:10.910 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.908+0000 7fe6c9c31780 1 < canceled operation key=D85LJGGU3Z6F tag=QUINL650D3S0 type=del size=1963067 2024-09-22T08:21:10.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.911+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~0EJW5W9IRP1X.0 size=1048576 2024-09-22T08:21:10.914 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.913+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~0EJW5W9IRP1X.1 size=642134 2024-09-22T08:21:10.914 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.913+0000 7fe6c9c31780 1 > prepared multipart upload key=CTK01Y0CV1NC upload=0EJW5W9IRP1X tag=FMWKE21454GL type=write size=2739286 2024-09-22T08:21:10.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.913+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~17K64ZJG1OMQ.0 size=269366 2024-09-22T08:21:10.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.916+0000 7fe6c9c31780 1 < completed multipart upload key=VP1MP4IC9A7T upload=17K64ZJG1OMQ tag=AHL128AXV8HB type=write size=1317942 2024-09-22T08:21:10.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.917+0000 7fe6c9c31780 1 > prepared operation key=1HZ0NAJPXNW1 tag=GVQJ7KP6V8XB type=del size=3032547 2024-09-22T08:21:10.920 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.919+0000 7fe6c9c31780 1 < completed delete operation key=ZFL9N44PBQX4 tag=IY0VLLAQSDN9 type=del 2024-09-22T08:21:10.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.921+0000 7fe6c9c31780 1 > prepared operation key=OX1LY7URY7IV tag=XGHLVXOHZ7N9 type=write size=143647 2024-09-22T08:21:10.923 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.922+0000 7fe6c9c31780 1 < completed part key=_multipart_TJTB67QBLZH5.2~M69N6VJ05AP7.0 size=1048576 2024-09-22T08:21:10.924 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.923+0000 7fe6c9c31780 1 < completed part key=_multipart_TJTB67QBLZH5.2~M69N6VJ05AP7.1 size=1048576 2024-09-22T08:21:10.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.924+0000 7fe6c9c31780 1 < completed part key=_multipart_TJTB67QBLZH5.2~M69N6VJ05AP7.2 size=756390 2024-09-22T08:21:10.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.927+0000 7fe6c9c31780 1 < completed multipart upload key=TJTB67QBLZH5 upload=M69N6VJ05AP7 tag=97FDEZ16WOHG type=write size=3902118 2024-09-22T08:21:10.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.929+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~W3B127ADR3KT.0 size=1048576 2024-09-22T08:21:10.932 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.931+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~W3B127ADR3KT.1 size=1048576 2024-09-22T08:21:10.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.933+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~W3B127ADR3KT.2 size=409174 2024-09-22T08:21:10.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.933+0000 7fe6c9c31780 1 > prepared multipart upload key=0PNK2ZW6IJM1 upload=W3B127ADR3KT tag=DX1B8S70QTUB type=write size=3554902 2024-09-22T08:21:10.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.933+0000 7fe6c9c31780 1 < canceled operation key=GEWQUFB9K35E tag=OL4MFD2U4OKL type=write size=106139 2024-09-22T08:21:10.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.937+0000 7fe6c9c31780 1 > prepared operation key=4KRJ7DTE3KDV tag=U5EUPH0B8X9M type=del size=49224 2024-09-22T08:21:10.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.938+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~IS0CZ3C6Q010.0 size=282587 2024-09-22T08:21:10.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.941+0000 7fe6c9c31780 1 < completed multipart upload key=D85LJGGU3Z6F upload=IS0CZ3C6Q010 tag=UQ3Q6NVAFU43 type=write size=1331163 2024-09-22T08:21:10.945 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.944+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~S36X44VAV24J.0 size=1048576 2024-09-22T08:21:10.947 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.946+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~S36X44VAV24J.1 size=1048576 2024-09-22T08:21:10.948 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.946+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~S36X44VAV24J.2 size=398533 2024-09-22T08:21:10.948 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.946+0000 7fe6c9c31780 1 > prepared multipart upload key=0TWY0NNZZ7NN upload=S36X44VAV24J tag=HD26PY1YAK58 type=write size=3544261 2024-09-22T08:21:10.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.948+0000 7fe6c9c31780 1 < completed delete operation key=ZFL9N44PBQX4 tag=C87QHW5VU7LP type=del 2024-09-22T08:21:10.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.951+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~QJSL3G0VUGWV.0 size=1048576 2024-09-22T08:21:10.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.952+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~QJSL3G0VUGWV.1 size=310494 2024-09-22T08:21:10.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.952+0000 7fe6c9c31780 1 > prepared multipart upload key=0PNK2ZW6IJM1 upload=QJSL3G0VUGWV tag=C1OHRRFAVTDZ type=write size=2407646 2024-09-22T08:21:10.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.953+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~YOF08I7NLXGH.0 size=1048576 2024-09-22T08:21:10.956 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.954+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~YOF08I7NLXGH.1 size=1048576 2024-09-22T08:21:10.957 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.956+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~YOF08I7NLXGH.2 size=923821 2024-09-22T08:21:10.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.958+0000 7fe6c9c31780 1 < completed multipart upload key=XJP26CCPYDI7 upload=YOF08I7NLXGH tag=AAAL5OMML9CF type=write size=4069549 2024-09-22T08:21:10.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.959+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=SRVE9X6N1W5N type=del size=1669332 2024-09-22T08:21:10.963 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.961+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~NWYFCECJ9LN4.0 size=470848 2024-09-22T08:21:10.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.964+0000 7fe6c9c31780 1 < completed multipart upload key=TE10GB1F35X4 upload=NWYFCECJ9LN4 tag=AKPYV51HUF8A type=write size=1519424 2024-09-22T08:21:10.967 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.966+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~IENZ74BRU7TG.0 size=118110 2024-09-22T08:21:10.968 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.966+0000 7fe6c9c31780 1 > prepared multipart upload key=4KRJ7DTE3KDV upload=IENZ74BRU7TG tag=JJSUHK1KAC24 type=write size=1166686 2024-09-22T08:21:10.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.968+0000 7fe6c9c31780 1 < completed part key=_multipart_TYVQ39KUV2V9.2~6YWWDRDSNQH3.0 size=1048576 2024-09-22T08:21:10.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.968+0000 7fe6c9c31780 1 < canceled part key=_multipart_TYVQ39KUV2V9.2~6YWWDRDSNQH3.1 size=915363 2024-09-22T08:21:10.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.970+0000 7fe6c9c31780 1 < canceled multipart upload key=TYVQ39KUV2V9 upload=6YWWDRDSNQH3 tag=OB3JPRZ93B8F type=write size=3012515 2024-09-22T08:21:10.973 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.971+0000 7fe6c9c31780 1 > prepared operation key=Z1CK5EDBK4AW tag=4TBF0CL0KUIK type=write size=774881 2024-09-22T08:21:10.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.972+0000 7fe6c9c31780 1 < completed delete operation key=KZIY400KQ5NH tag=VC0VA0GG9ZBQ type=del 2024-09-22T08:21:10.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.974+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=9MH1OYM9GZHJ type=del size=2127050 2024-09-22T08:21:10.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.975+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~21R2O34YXSI3.0 size=1048576 2024-09-22T08:21:10.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.975+0000 7fe6c9c31780 1 < canceled part key=_multipart_T2W6RXP9UGHH.2~21R2O34YXSI3.1 size=1048576 2024-09-22T08:21:10.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.976+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~21R2O34YXSI3.2 size=823654 2024-09-22T08:21:10.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.979+0000 7fe6c9c31780 1 < canceled multipart upload key=T2W6RXP9UGHH upload=21R2O34YXSI3 tag=AHL6J4WN68VA type=write size=3969382 2024-09-22T08:21:10.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.981+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~8PZ52TZVEWA8.0 size=320843 2024-09-22T08:21:10.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.981+0000 7fe6c9c31780 1 > prepared multipart upload key=TE10GB1F35X4 upload=8PZ52TZVEWA8 tag=V02FBEDQAY1L type=write size=1369419 2024-09-22T08:21:10.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.983+0000 7fe6c9c31780 1 < completed delete operation key=W9L87PTJEIOA tag=ML4NO6JAEIEO type=del 2024-09-22T08:21:10.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.984+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=D3R8JROGLM11 type=del size=1888915 2024-09-22T08:21:10.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.987+0000 7fe6c9c31780 1 < suggested remove operation key=TYVQ39KUV2V9 tag=7NFQ8TQ9SGHS type=del 2024-09-22T08:21:10.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.989+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~MZB1383AGC7N.0 size=1048576 2024-09-22T08:21:10.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.990+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~MZB1383AGC7N.1 size=703807 2024-09-22T08:21:10.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.990+0000 7fe6c9c31780 1 > prepared multipart upload key=0TWY0NNZZ7NN upload=MZB1383AGC7N tag=DJHGY2EVNHVW type=write size=2800959 2024-09-22T08:21:10.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.992+0000 7fe6c9c31780 1 < completed delete operation key=JT5AB8VLMEFD tag=5JLNSNYV9TLF type=del 2024-09-22T08:21:10.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.994+0000 7fe6c9c31780 1 > prepared operation key=LA6ZRVULGQ0H tag=DTBCOEEYT1NC type=del size=3241369 2024-09-22T08:21:10.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.996+0000 7fe6c9c31780 1 < suggested update operation key=9AZWQ9E58QS6 tag=KX2PFOPUX2UY type=del size=1401007 2024-09-22T08:21:11.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:10.999+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~2LU1P40L9JG2.0 size=1048576 2024-09-22T08:21:11.002 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.000+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~2LU1P40L9JG2.1 size=859570 2024-09-22T08:21:11.002 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.000+0000 7fe6c9c31780 1 > prepared multipart upload key=OX1LY7URY7IV upload=2LU1P40L9JG2 tag=0AH5N7FYQKFJ type=write size=2956722 2024-09-22T08:21:11.003 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.001+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~0EJW5W9IRP1X.0 size=1048576 2024-09-22T08:21:11.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.003+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~0EJW5W9IRP1X.1 size=642134 2024-09-22T08:21:11.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.005+0000 7fe6c9c31780 1 < completed multipart upload key=CTK01Y0CV1NC upload=0EJW5W9IRP1X tag=FMWKE21454GL type=write size=2739286 2024-09-22T08:21:11.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.008+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~H2JYV1G3KDG1.0 size=1048576 2024-09-22T08:21:11.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.009+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~H2JYV1G3KDG1.1 size=451982 2024-09-22T08:21:11.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.009+0000 7fe6c9c31780 1 > prepared multipart upload key=6BKB91YV3FMW upload=H2JYV1G3KDG1 tag=LFAI4E8Z0HS2 type=write size=2549134 2024-09-22T08:21:11.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.010+0000 7fe6c9c31780 1 < completed delete operation key=1HZ0NAJPXNW1 tag=GVQJ7KP6V8XB type=del 2024-09-22T08:21:11.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.012+0000 7fe6c9c31780 1 > prepared operation key=FY40JTHLT0KU tag=UD3Q6TSEO24T type=write size=994366 2024-09-22T08:21:11.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.014+0000 7fe6c9c31780 1 < completed write operation key=OX1LY7URY7IV tag=XGHLVXOHZ7N9 type=write size=143647 2024-09-22T08:21:11.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.015+0000 7fe6c9c31780 1 > prepared operation key=GEWQUFB9K35E tag=PJGUVRMBSMHC type=del size=1067028 2024-09-22T08:21:11.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.017+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~W3B127ADR3KT.0 size=1048576 2024-09-22T08:21:11.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.018+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~W3B127ADR3KT.1 size=1048576 2024-09-22T08:21:11.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.019+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~W3B127ADR3KT.2 size=409174 2024-09-22T08:21:11.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.022+0000 7fe6c9c31780 1 < completed multipart upload key=0PNK2ZW6IJM1 upload=W3B127ADR3KT tag=DX1B8S70QTUB type=write size=3554902 2024-09-22T08:21:11.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.023+0000 7fe6c9c31780 1 > prepared operation key=VP1MP4IC9A7T tag=6VTMJXH5ED7N type=del size=612996 2024-09-22T08:21:11.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.025+0000 7fe6c9c31780 1 < completed delete operation key=4KRJ7DTE3KDV tag=U5EUPH0B8X9M type=del 2024-09-22T08:21:11.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.026+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=6OZTW60NS0QG type=del size=1939432 2024-09-22T08:21:11.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.028+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~S36X44VAV24J.0 size=1048576 2024-09-22T08:21:11.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.029+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~S36X44VAV24J.1 size=1048576 2024-09-22T08:21:11.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.031+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~S36X44VAV24J.2 size=398533 2024-09-22T08:21:11.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.033+0000 7fe6c9c31780 1 < completed multipart upload key=0TWY0NNZZ7NN upload=S36X44VAV24J tag=HD26PY1YAK58 type=write size=3544261 2024-09-22T08:21:11.036 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.034+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=VTCJ0UY9FE5J type=write size=588967 2024-09-22T08:21:11.037 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.036+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~QJSL3G0VUGWV.0 size=1048576 2024-09-22T08:21:11.039 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.037+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~QJSL3G0VUGWV.1 size=310494 2024-09-22T08:21:11.041 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.039+0000 7fe6c9c31780 1 < completed multipart upload key=0PNK2ZW6IJM1 upload=QJSL3G0VUGWV tag=C1OHRRFAVTDZ type=write size=2407646 2024-09-22T08:21:11.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.043+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~D20P13HVARRH.0 size=1048576 2024-09-22T08:21:11.045 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.044+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~D20P13HVARRH.1 size=1048576 2024-09-22T08:21:11.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.044+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~D20P13HVARRH.2 size=542264 2024-09-22T08:21:11.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.044+0000 7fe6c9c31780 1 > prepared multipart upload key=T2W6RXP9UGHH upload=D20P13HVARRH tag=IDRPJMURH58N type=write size=3687992 2024-09-22T08:21:11.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.048+0000 7fe6c9c31780 1 < suggested remove operation key=7446WN19QFV0 tag=SRVE9X6N1W5N type=del 2024-09-22T08:21:11.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.049+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=QSRC6CZ8OZ7U type=write size=279835 2024-09-22T08:21:11.052 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.050+0000 7fe6c9c31780 1 < completed part key=_multipart_4KRJ7DTE3KDV.2~IENZ74BRU7TG.0 size=118110 2024-09-22T08:21:11.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.053+0000 7fe6c9c31780 1 < completed multipart upload key=4KRJ7DTE3KDV upload=IENZ74BRU7TG tag=JJSUHK1KAC24 type=write size=1166686 2024-09-22T08:21:11.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.054+0000 7fe6c9c31780 1 > prepared operation key=9FCSIF1WKBDJ tag=WYWHW85F4U73 type=del size=3001308 2024-09-22T08:21:11.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.056+0000 7fe6c9c31780 1 < canceled operation key=Z1CK5EDBK4AW tag=4TBF0CL0KUIK type=write size=774881 2024-09-22T08:21:11.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.059+0000 7fe6c9c31780 1 > prepared part key=_multipart_ZFL9N44PBQX4.2~FFOPLTLOKMPJ.0 size=1048576 2024-09-22T08:21:11.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.060+0000 7fe6c9c31780 1 > prepared part key=_multipart_ZFL9N44PBQX4.2~FFOPLTLOKMPJ.1 size=308331 2024-09-22T08:21:11.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.060+0000 7fe6c9c31780 1 > prepared multipart upload key=ZFL9N44PBQX4 upload=FFOPLTLOKMPJ tag=OCXAHPNXPVMU type=write size=2405483 2024-09-22T08:21:11.064 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.062+0000 7fe6c9c31780 1 < suggested update operation key=DC7VLQWZ3TD1 tag=9MH1OYM9GZHJ type=del size=2127050 2024-09-22T08:21:11.067 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.066+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~QJWKIS1TKFUV.0 size=407680 2024-09-22T08:21:11.067 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.066+0000 7fe6c9c31780 1 > prepared multipart upload key=JT5AB8VLMEFD upload=QJWKIS1TKFUV tag=S6N9HGJZX6LP type=write size=1456256 2024-09-22T08:21:11.068 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.067+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~8PZ52TZVEWA8.0 size=320843 2024-09-22T08:21:11.071 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.069+0000 7fe6c9c31780 1 < completed multipart upload key=TE10GB1F35X4 upload=8PZ52TZVEWA8 tag=V02FBEDQAY1L type=write size=1369419 2024-09-22T08:21:11.074 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.073+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~MO5Y9DOQJ909.0 size=265438 2024-09-22T08:21:11.075 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.073+0000 7fe6c9c31780 1 > prepared multipart upload key=JT5AB8VLMEFD upload=MO5Y9DOQJ909 tag=O9WRZUICZUCV type=write size=1314014 2024-09-22T08:21:11.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.076+0000 7fe6c9c31780 1 < suggested update operation key=7446WN19QFV0 tag=D3R8JROGLM11 type=del size=1888915 2024-09-22T08:21:11.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.077+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=1QNX3DHON0GV type=del size=1633853 2024-09-22T08:21:11.080 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.079+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~MZB1383AGC7N.0 size=1048576 2024-09-22T08:21:11.081 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.080+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~MZB1383AGC7N.1 size=703807 2024-09-22T08:21:11.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.082+0000 7fe6c9c31780 1 < completed multipart upload key=0TWY0NNZZ7NN upload=MZB1383AGC7N tag=DJHGY2EVNHVW type=write size=2800959 2024-09-22T08:21:11.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.086+0000 7fe6c9c31780 1 > prepared part key=_multipart_TJTB67QBLZH5.2~RO0TMQXE3TI8.0 size=1048576 2024-09-22T08:21:11.088 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.086+0000 7fe6c9c31780 1 > prepared part key=_multipart_TJTB67QBLZH5.2~RO0TMQXE3TI8.1 size=393829 2024-09-22T08:21:11.088 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.086+0000 7fe6c9c31780 1 > prepared multipart upload key=TJTB67QBLZH5 upload=RO0TMQXE3TI8 tag=T06R991QTW81 type=write size=2490981 2024-09-22T08:21:11.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.089+0000 7fe6c9c31780 1 < suggested update operation key=LA6ZRVULGQ0H tag=DTBCOEEYT1NC type=del size=3241369 2024-09-22T08:21:11.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.091+0000 7fe6c9c31780 1 > prepared operation key=VP1MP4IC9A7T tag=4N6W3P1MZJTS type=del size=2019452 2024-09-22T08:21:11.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.091+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~2LU1P40L9JG2.0 size=1048576 2024-09-22T08:21:11.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.093+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~2LU1P40L9JG2.1 size=859570 2024-09-22T08:21:11.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.095+0000 7fe6c9c31780 1 < completed multipart upload key=OX1LY7URY7IV upload=2LU1P40L9JG2 tag=0AH5N7FYQKFJ type=write size=2956722 2024-09-22T08:21:11.098 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.096+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=QG0PC450VO3A type=del size=2404322 2024-09-22T08:21:11.100 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.098+0000 7fe6c9c31780 1 < completed part key=_multipart_6BKB91YV3FMW.2~H2JYV1G3KDG1.0 size=1048576 2024-09-22T08:21:11.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.099+0000 7fe6c9c31780 1 < completed part key=_multipart_6BKB91YV3FMW.2~H2JYV1G3KDG1.1 size=451982 2024-09-22T08:21:11.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.103+0000 7fe6c9c31780 1 < completed multipart upload key=6BKB91YV3FMW upload=H2JYV1G3KDG1 tag=LFAI4E8Z0HS2 type=write size=2549134 2024-09-22T08:21:11.105 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.103+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=7VWHE4LKG0ZN type=del size=3210929 2024-09-22T08:21:11.106 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.106+0000 7fe6c9c31780 1 < completed write operation key=FY40JTHLT0KU tag=UD3Q6TSEO24T type=write size=994366 2024-09-22T08:21:11.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.107+0000 7fe6c9c31780 1 > prepared part key=_multipart_R7UWMW913DJQ.2~HG4LJS1QDN0U.0 size=1048576 2024-09-22T08:21:11.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.109+0000 7fe6c9c31780 1 > prepared part key=_multipart_R7UWMW913DJQ.2~HG4LJS1QDN0U.1 size=872403 2024-09-22T08:21:11.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.109+0000 7fe6c9c31780 1 > prepared multipart upload key=R7UWMW913DJQ upload=HG4LJS1QDN0U tag=VXYUU58PS62U type=write size=2969555 2024-09-22T08:21:11.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.110+0000 7fe6c9c31780 1 < canceled operation key=GEWQUFB9K35E tag=PJGUVRMBSMHC type=del size=1067028 2024-09-22T08:21:11.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.112+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=XG6N8MRCC5MR type=del size=2520510 2024-09-22T08:21:11.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.115+0000 7fe6c9c31780 1 < suggested remove operation key=VP1MP4IC9A7T tag=6VTMJXH5ED7N type=del 2024-09-22T08:21:11.119 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.117+0000 7fe6c9c31780 1 > prepared part key=_multipart_W9L87PTJEIOA.2~5R1RBWHXTZD0.0 size=1048576 2024-09-22T08:21:11.120 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.118+0000 7fe6c9c31780 1 > prepared part key=_multipart_W9L87PTJEIOA.2~5R1RBWHXTZD0.1 size=1048576 2024-09-22T08:21:11.121 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.120+0000 7fe6c9c31780 1 > prepared part key=_multipart_W9L87PTJEIOA.2~5R1RBWHXTZD0.2 size=201096 2024-09-22T08:21:11.121 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.120+0000 7fe6c9c31780 1 > prepared multipart upload key=W9L87PTJEIOA upload=5R1RBWHXTZD0 tag=VVYUKEHCJNOX type=write size=3346824 2024-09-22T08:21:11.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.121+0000 7fe6c9c31780 1 < completed delete operation key=0TWY0NNZZ7NN tag=6OZTW60NS0QG type=del 2024-09-22T08:21:11.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.123+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=6CPDQR9L82B4 type=del size=1559374 2024-09-22T08:21:11.126 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.124+0000 7fe6c9c31780 1 < completed write operation key=CTK01Y0CV1NC tag=VTCJ0UY9FE5J type=write size=588967 2024-09-22T08:21:11.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.126+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=VRV7KQ0PQHR1 type=del size=70769 2024-09-22T08:21:11.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.126+0000 7fe6c9c31780 1 < canceled part key=_multipart_T2W6RXP9UGHH.2~D20P13HVARRH.0 size=1048576 2024-09-22T08:21:11.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.127+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~D20P13HVARRH.1 size=1048576 2024-09-22T08:21:11.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.128+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~D20P13HVARRH.2 size=542264 2024-09-22T08:21:11.132 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.131+0000 7fe6c9c31780 1 < canceled multipart upload key=T2W6RXP9UGHH upload=D20P13HVARRH tag=IDRPJMURH58N type=write size=3687992 2024-09-22T08:21:11.134 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.132+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=7B1JOH8BE61P type=del size=366214 2024-09-22T08:21:11.135 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.134+0000 7fe6c9c31780 -1 < failed to complete operation key=7446WN19QFV0 tag=QSRC6CZ8OZ7U type=write size=279835: (22) Invalid argument 2024-09-22T08:21:11.137 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.135+0000 7fe6c9c31780 1 > prepared operation key=OX1LY7URY7IV tag=U0DU5J4G4PIA type=del size=3070967 2024-09-22T08:21:11.138 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.136+0000 7fe6c9c31780 1 < completed delete operation key=9FCSIF1WKBDJ tag=WYWHW85F4U73 type=del 2024-09-22T08:21:11.139 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.138+0000 7fe6c9c31780 1 > prepared operation key=ZFL9N44PBQX4 tag=2RHI3HJZB2L6 type=write size=779468 2024-09-22T08:21:11.141 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.139+0000 7fe6c9c31780 1 < completed part key=_multipart_ZFL9N44PBQX4.2~FFOPLTLOKMPJ.0 size=1048576 2024-09-22T08:21:11.142 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.140+0000 7fe6c9c31780 1 < completed part key=_multipart_ZFL9N44PBQX4.2~FFOPLTLOKMPJ.1 size=308331 2024-09-22T08:21:11.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.143+0000 7fe6c9c31780 1 < completed multipart upload key=ZFL9N44PBQX4 upload=FFOPLTLOKMPJ tag=OCXAHPNXPVMU type=write size=2405483 2024-09-22T08:21:11.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.144+0000 7fe6c9c31780 1 > prepared operation key=4KRJ7DTE3KDV tag=6W5PJ68YQ18U type=write size=838672 2024-09-22T08:21:11.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.144+0000 7fe6c9c31780 1 < canceled part key=_multipart_JT5AB8VLMEFD.2~QJWKIS1TKFUV.0 size=407680 2024-09-22T08:21:11.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.147+0000 7fe6c9c31780 1 < canceled multipart upload key=JT5AB8VLMEFD upload=QJWKIS1TKFUV tag=S6N9HGJZX6LP type=write size=1456256 2024-09-22T08:21:11.151 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.149+0000 7fe6c9c31780 1 > prepared part key=_multipart_W9L87PTJEIOA.2~9XP72LJTRN55.0 size=401466 2024-09-22T08:21:11.151 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.149+0000 7fe6c9c31780 1 > prepared multipart upload key=W9L87PTJEIOA upload=9XP72LJTRN55 tag=4OE9SVDA86SF type=write size=1450042 2024-09-22T08:21:11.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.150+0000 7fe6c9c31780 1 < completed part key=_multipart_JT5AB8VLMEFD.2~MO5Y9DOQJ909.0 size=265438 2024-09-22T08:21:11.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.153+0000 7fe6c9c31780 1 < completed multipart upload key=JT5AB8VLMEFD upload=MO5Y9DOQJ909 tag=O9WRZUICZUCV type=write size=1314014 2024-09-22T08:21:11.157 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.155+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~62D6X0WF0LST.0 size=1048576 2024-09-22T08:21:11.158 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.157+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~62D6X0WF0LST.1 size=1048576 2024-09-22T08:21:11.159 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.158+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~62D6X0WF0LST.2 size=710462 2024-09-22T08:21:11.160 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.158+0000 7fe6c9c31780 1 > prepared multipart upload key=0PNK2ZW6IJM1 upload=62D6X0WF0LST tag=G106OK7LUZ58 type=write size=3856190 2024-09-22T08:21:11.161 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.159+0000 7fe6c9c31780 1 < completed delete operation key=0TWY0NNZZ7NN tag=1QNX3DHON0GV type=del 2024-09-22T08:21:11.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.162+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~4Q6EUQ9B9C4B.0 size=154000 2024-09-22T08:21:11.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.162+0000 7fe6c9c31780 1 > prepared multipart upload key=T2W6RXP9UGHH upload=4Q6EUQ9B9C4B tag=KKM6V8ESD2QA type=write size=1202576 2024-09-22T08:21:11.165 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.163+0000 7fe6c9c31780 1 < completed part key=_multipart_TJTB67QBLZH5.2~RO0TMQXE3TI8.0 size=1048576 2024-09-22T08:21:11.166 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.164+0000 7fe6c9c31780 1 < completed part key=_multipart_TJTB67QBLZH5.2~RO0TMQXE3TI8.1 size=393829 2024-09-22T08:21:11.168 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.167+0000 7fe6c9c31780 1 < completed multipart upload key=TJTB67QBLZH5 upload=RO0TMQXE3TI8 tag=T06R991QTW81 type=write size=2490981 2024-09-22T08:21:11.170 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.168+0000 7fe6c9c31780 1 > prepared operation key=LA6ZRVULGQ0H tag=Y43QJ59GAHJ3 type=del size=1669845 2024-09-22T08:21:11.170 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.169+0000 7fe6c9c31780 -1 < no bi entry to suggest for operation key=VP1MP4IC9A7T tag=4N6W3P1MZJTS type=del size=2019452: (2) No such file or directory 2024-09-22T08:21:11.172 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.170+0000 7fe6c9c31780 1 > prepared operation key=GEWQUFB9K35E tag=W40X1H0E9GYH type=write size=42046 2024-09-22T08:21:11.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.174+0000 7fe6c9c31780 1 < suggested update operation key=R7UWMW913DJQ tag=QG0PC450VO3A type=del size=2404322 2024-09-22T08:21:11.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.175+0000 7fe6c9c31780 1 > prepared operation key=KZIY400KQ5NH tag=P86JVYBZITUS type=del size=296579 2024-09-22T08:21:11.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.177+0000 7fe6c9c31780 1 < canceled operation key=6BKB91YV3FMW tag=7VWHE4LKG0ZN type=del size=3210929 2024-09-22T08:21:11.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.180+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~0PVRSWUZI7WE.0 size=1048576 2024-09-22T08:21:11.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.182+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~0PVRSWUZI7WE.1 size=943078 2024-09-22T08:21:11.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.182+0000 7fe6c9c31780 1 > prepared multipart upload key=76HZ3LZGVT9J upload=0PVRSWUZI7WE tag=JUZBNDMZHI62 type=write size=3040230 2024-09-22T08:21:11.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.182+0000 7fe6c9c31780 1 < completed part key=_multipart_R7UWMW913DJQ.2~HG4LJS1QDN0U.0 size=1048576 2024-09-22T08:21:11.185 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.184+0000 7fe6c9c31780 1 < completed part key=_multipart_R7UWMW913DJQ.2~HG4LJS1QDN0U.1 size=872403 2024-09-22T08:21:11.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.186+0000 7fe6c9c31780 1 < completed multipart upload key=R7UWMW913DJQ upload=HG4LJS1QDN0U tag=VXYUU58PS62U type=write size=2969555 2024-09-22T08:21:11.190 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.188+0000 7fe6c9c31780 1 > prepared operation key=0PNK2ZW6IJM1 tag=DIEPU1U9BFZ9 type=write size=546582 2024-09-22T08:21:11.191 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.190+0000 7fe6c9c31780 1 < completed delete operation key=TE10GB1F35X4 tag=XG6N8MRCC5MR type=del 2024-09-22T08:21:11.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.192+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=0IB9VBZKXMW0 type=del size=379628 2024-09-22T08:21:11.195 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.193+0000 7fe6c9c31780 1 < completed part key=_multipart_W9L87PTJEIOA.2~5R1RBWHXTZD0.0 size=1048576 2024-09-22T08:21:11.196 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.195+0000 7fe6c9c31780 1 < completed part key=_multipart_W9L87PTJEIOA.2~5R1RBWHXTZD0.1 size=1048576 2024-09-22T08:21:11.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.196+0000 7fe6c9c31780 1 < completed part key=_multipart_W9L87PTJEIOA.2~5R1RBWHXTZD0.2 size=201096 2024-09-22T08:21:11.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.199+0000 7fe6c9c31780 1 < completed multipart upload key=W9L87PTJEIOA upload=5R1RBWHXTZD0 tag=VVYUKEHCJNOX type=write size=3346824 2024-09-22T08:21:11.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.200+0000 7fe6c9c31780 1 > prepared operation key=VP1MP4IC9A7T tag=AOSLIU1NDAMJ type=del size=3793106 2024-09-22T08:21:11.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.202+0000 7fe6c9c31780 1 < completed delete operation key=0TWY0NNZZ7NN tag=6CPDQR9L82B4 type=del 2024-09-22T08:21:11.205 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.204+0000 7fe6c9c31780 1 > prepared operation key=OX1LY7URY7IV tag=012T4JNBQOZ0 type=del size=4024338 2024-09-22T08:21:11.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.205+0000 7fe6c9c31780 1 < completed delete operation key=2B5QRUMTVE7U tag=VRV7KQ0PQHR1 type=del 2024-09-22T08:21:11.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.208+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~W7SRXMSAAT1Y.0 size=1048576 2024-09-22T08:21:11.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.210+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~W7SRXMSAAT1Y.1 size=280133 2024-09-22T08:21:11.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.210+0000 7fe6c9c31780 1 > prepared multipart upload key=4KRJ7DTE3KDV upload=W7SRXMSAAT1Y tag=5S1VOM0OZEUF type=write size=2377285 2024-09-22T08:21:11.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.211+0000 7fe6c9c31780 1 < completed delete operation key=CTK01Y0CV1NC tag=7B1JOH8BE61P type=del 2024-09-22T08:21:11.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.213+0000 7fe6c9c31780 1 > prepared operation key=VP1MP4IC9A7T tag=S1KZ6LUGGVET type=del size=2752889 2024-09-22T08:21:11.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.214+0000 7fe6c9c31780 1 < completed delete operation key=OX1LY7URY7IV tag=U0DU5J4G4PIA type=del 2024-09-22T08:21:11.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.216+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=RZQU0GOLCZM2 type=del size=345957 2024-09-22T08:21:11.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.217+0000 7fe6c9c31780 1 < completed write operation key=ZFL9N44PBQX4 tag=2RHI3HJZB2L6 type=write size=779468 2024-09-22T08:21:11.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.218+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=2UTZ7QTZLZDN type=del size=1531664 2024-09-22T08:21:11.221 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.220+0000 7fe6c9c31780 1 < completed write operation key=4KRJ7DTE3KDV tag=6W5PJ68YQ18U type=write size=838672 2024-09-22T08:21:11.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.221+0000 7fe6c9c31780 1 > prepared operation key=LA6ZRVULGQ0H tag=3C0K7JLTCX3C type=del size=2614772 2024-09-22T08:21:11.224 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.223+0000 7fe6c9c31780 1 < completed part key=_multipart_W9L87PTJEIOA.2~9XP72LJTRN55.0 size=401466 2024-09-22T08:21:11.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.225+0000 7fe6c9c31780 1 < completed multipart upload key=W9L87PTJEIOA upload=9XP72LJTRN55 tag=4OE9SVDA86SF type=write size=1450042 2024-09-22T08:21:11.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.228+0000 7fe6c9c31780 1 > prepared part key=_multipart_1HZ0NAJPXNW1.2~8H7E0YAB119B.0 size=390099 2024-09-22T08:21:11.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.228+0000 7fe6c9c31780 1 > prepared multipart upload key=1HZ0NAJPXNW1 upload=8H7E0YAB119B tag=9B432WCBJUVS type=write size=1438675 2024-09-22T08:21:11.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.230+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~62D6X0WF0LST.0 size=1048576 2024-09-22T08:21:11.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.231+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~62D6X0WF0LST.1 size=1048576 2024-09-22T08:21:11.234 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.232+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~62D6X0WF0LST.2 size=710462 2024-09-22T08:21:11.236 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.235+0000 7fe6c9c31780 1 < completed multipart upload key=0PNK2ZW6IJM1 upload=62D6X0WF0LST tag=G106OK7LUZ58 type=write size=3856190 2024-09-22T08:21:11.238 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.236+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=W3WNK1WYVP3Q type=del size=3116664 2024-09-22T08:21:11.240 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.238+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~4Q6EUQ9B9C4B.0 size=154000 2024-09-22T08:21:11.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.241+0000 7fe6c9c31780 1 < completed multipart upload key=T2W6RXP9UGHH upload=4Q6EUQ9B9C4B tag=KKM6V8ESD2QA type=write size=1202576 2024-09-22T08:21:11.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.242+0000 7fe6c9c31780 1 > prepared operation key=4KRJ7DTE3KDV tag=HV34WBG1BY0C type=del size=933290 2024-09-22T08:21:11.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.243+0000 7fe6c9c31780 1 < completed delete operation key=LA6ZRVULGQ0H tag=Y43QJ59GAHJ3 type=del 2024-09-22T08:21:11.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.245+0000 7fe6c9c31780 1 > prepared operation key=9FCSIF1WKBDJ tag=3PQ2X7EDAM7K type=del size=370183 2024-09-22T08:21:11.248 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.246+0000 7fe6c9c31780 1 < completed write operation key=GEWQUFB9K35E tag=W40X1H0E9GYH type=write size=42046 2024-09-22T08:21:11.250 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.249+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~JKDK733F2JAF.0 size=1048576 2024-09-22T08:21:11.251 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.250+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~JKDK733F2JAF.1 size=321979 2024-09-22T08:21:11.251 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.250+0000 7fe6c9c31780 1 > prepared multipart upload key=O1UBUQXP50CN upload=JKDK733F2JAF tag=68M8F7PR6QOX type=write size=2419131 2024-09-22T08:21:11.253 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.251+0000 7fe6c9c31780 1 < completed delete operation key=KZIY400KQ5NH tag=P86JVYBZITUS type=del 2024-09-22T08:21:11.254 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.254+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=XRG5VNP2UJJJ type=del size=3088433 2024-09-22T08:21:11.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.256+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~0PVRSWUZI7WE.0 size=1048576 2024-09-22T08:21:11.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.256+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~0PVRSWUZI7WE.1 size=943078 2024-09-22T08:21:11.261 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.259+0000 7fe6c9c31780 1 < completed multipart upload key=76HZ3LZGVT9J upload=0PVRSWUZI7WE tag=JUZBNDMZHI62 type=write size=3040230 2024-09-22T08:21:11.262 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.260+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=TBYWMZNHWV3K type=del size=4074543 2024-09-22T08:21:11.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.263+0000 7fe6c9c31780 1 < suggested remove operation key=0PNK2ZW6IJM1 tag=DIEPU1U9BFZ9 type=write 2024-09-22T08:21:11.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.265+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=CX03ZFYHB42W type=write size=411858 2024-09-22T08:21:11.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.267+0000 7fe6c9c31780 1 < suggested update operation key=76HZ3LZGVT9J tag=0IB9VBZKXMW0 type=del size=379628 2024-09-22T08:21:11.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.270+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~X2EZIERNZ6EB.0 size=225432 2024-09-22T08:21:11.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.270+0000 7fe6c9c31780 1 > prepared multipart upload key=DC7VLQWZ3TD1 upload=X2EZIERNZ6EB tag=S5I1M9JP1FCB type=write size=1274008 2024-09-22T08:21:11.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.273+0000 7fe6c9c31780 1 < suggested update operation key=VP1MP4IC9A7T tag=AOSLIU1NDAMJ type=del size=3793106 2024-09-22T08:21:11.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.275+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~NTEH1Q94IWUA.0 size=1048576 2024-09-22T08:21:11.278 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.276+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~NTEH1Q94IWUA.1 size=1048576 2024-09-22T08:21:11.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.278+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~NTEH1Q94IWUA.2 size=633161 2024-09-22T08:21:11.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.278+0000 7fe6c9c31780 1 > prepared multipart upload key=2B5QRUMTVE7U upload=NTEH1Q94IWUA tag=G4ZVDCTTNX74 type=write size=3778889 2024-09-22T08:21:11.280 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.279+0000 7fe6c9c31780 1 < completed delete operation key=OX1LY7URY7IV tag=012T4JNBQOZ0 type=del 2024-09-22T08:21:11.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.280+0000 7fe6c9c31780 1 > prepared operation key=9FCSIF1WKBDJ tag=CHV6C26MGS9Y type=del size=2738948 2024-09-22T08:21:11.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.282+0000 7fe6c9c31780 1 < completed part key=_multipart_4KRJ7DTE3KDV.2~W7SRXMSAAT1Y.0 size=1048576 2024-09-22T08:21:11.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.283+0000 7fe6c9c31780 1 < completed part key=_multipart_4KRJ7DTE3KDV.2~W7SRXMSAAT1Y.1 size=280133 2024-09-22T08:21:11.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.286+0000 7fe6c9c31780 1 < completed multipart upload key=4KRJ7DTE3KDV upload=W7SRXMSAAT1Y tag=5S1VOM0OZEUF type=write size=2377285 2024-09-22T08:21:11.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.286+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=MS38NH4HP0ES type=write size=523375 2024-09-22T08:21:11.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.289+0000 7fe6c9c31780 1 < suggested update operation key=VP1MP4IC9A7T tag=S1KZ6LUGGVET type=del size=2752889 2024-09-22T08:21:11.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.291+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=SL3Y3ICZXYEB type=del size=2576546 2024-09-22T08:21:11.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.292+0000 7fe6c9c31780 1 < completed delete operation key=6BKB91YV3FMW tag=RZQU0GOLCZM2 type=del 2024-09-22T08:21:11.297 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.295+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~ZK1PAL5LVCQJ.0 size=1048576 2024-09-22T08:21:11.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.296+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~ZK1PAL5LVCQJ.1 size=798752 2024-09-22T08:21:11.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.296+0000 7fe6c9c31780 1 > prepared multipart upload key=6BKB91YV3FMW upload=ZK1PAL5LVCQJ tag=E0GTXK9IJIUW type=write size=2895904 2024-09-22T08:21:11.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.298+0000 7fe6c9c31780 1 < completed delete operation key=TE10GB1F35X4 tag=2UTZ7QTZLZDN type=del 2024-09-22T08:21:11.302 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.300+0000 7fe6c9c31780 1 > prepared part key=_multipart_ZFL9N44PBQX4.2~GJJ9WN1YB7RN.0 size=41436 2024-09-22T08:21:11.302 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.300+0000 7fe6c9c31780 1 > prepared multipart upload key=ZFL9N44PBQX4 upload=GJJ9WN1YB7RN tag=Q324OSS05EAZ type=write size=1090012 2024-09-22T08:21:11.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.304+0000 7fe6c9c31780 1 < suggested remove operation key=LA6ZRVULGQ0H tag=3C0K7JLTCX3C type=del 2024-09-22T08:21:11.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.307+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~QM51PTZ6KR4U.0 size=408096 2024-09-22T08:21:11.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.307+0000 7fe6c9c31780 1 > prepared multipart upload key=OX1LY7URY7IV upload=QM51PTZ6KR4U tag=NXTRKEQYVV48 type=write size=1456672 2024-09-22T08:21:11.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.308+0000 7fe6c9c31780 1 < completed part key=_multipart_1HZ0NAJPXNW1.2~8H7E0YAB119B.0 size=390099 2024-09-22T08:21:11.312 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.311+0000 7fe6c9c31780 1 < completed multipart upload key=1HZ0NAJPXNW1 upload=8H7E0YAB119B tag=9B432WCBJUVS type=write size=1438675 2024-09-22T08:21:11.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.312+0000 7fe6c9c31780 1 > prepared operation key=FY40JTHLT0KU tag=5BFFSPRB1HZ3 type=del size=2182772 2024-09-22T08:21:11.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.314+0000 7fe6c9c31780 1 < completed delete operation key=TE10GB1F35X4 tag=W3WNK1WYVP3Q type=del 2024-09-22T08:21:11.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.316+0000 7fe6c9c31780 1 > prepared operation key=W9L87PTJEIOA tag=D1226PBYLUYM type=del size=2014661 2024-09-22T08:21:11.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.318+0000 7fe6c9c31780 1 < suggested update operation key=4KRJ7DTE3KDV tag=HV34WBG1BY0C type=del size=933290 2024-09-22T08:21:11.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.321+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~9W2BUGWVCYRC.0 size=1048576 2024-09-22T08:21:11.323 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.322+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~9W2BUGWVCYRC.1 size=757578 2024-09-22T08:21:11.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.322+0000 7fe6c9c31780 1 > prepared multipart upload key=KZIY400KQ5NH upload=9W2BUGWVCYRC tag=UN7252US47T8 type=write size=2854730 2024-09-22T08:21:11.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.323+0000 7fe6c9c31780 1 < completed delete operation key=9FCSIF1WKBDJ tag=3PQ2X7EDAM7K type=del 2024-09-22T08:21:11.328 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.326+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~PIX6IWEMFGL6.0 size=1048576 2024-09-22T08:21:11.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.328+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~PIX6IWEMFGL6.1 size=886325 2024-09-22T08:21:11.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.328+0000 7fe6c9c31780 1 > prepared multipart upload key=D85LJGGU3Z6F upload=PIX6IWEMFGL6 tag=ZB4B6VQHTZAH type=write size=2983477 2024-09-22T08:21:11.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.329+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~JKDK733F2JAF.0 size=1048576 2024-09-22T08:21:11.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.330+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~JKDK733F2JAF.1 size=321979 2024-09-22T08:21:11.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.333+0000 7fe6c9c31780 1 < completed multipart upload key=O1UBUQXP50CN upload=JKDK733F2JAF tag=68M8F7PR6QOX type=write size=2419131 2024-09-22T08:21:11.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.336+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~8Q7M1U5H9XTP.0 size=1048576 2024-09-22T08:21:11.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.337+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~8Q7M1U5H9XTP.1 size=1048576 2024-09-22T08:21:11.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.338+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~8Q7M1U5H9XTP.2 size=887377 2024-09-22T08:21:11.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.338+0000 7fe6c9c31780 1 > prepared multipart upload key=KZIY400KQ5NH upload=8Q7M1U5H9XTP tag=BYVX6031T9N4 type=write size=4033105 2024-09-22T08:21:11.342 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.340+0000 7fe6c9c31780 1 < completed delete operation key=6BKB91YV3FMW tag=XRG5VNP2UJJJ type=del 2024-09-22T08:21:11.343 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.341+0000 7fe6c9c31780 1 > prepared operation key=1HZ0NAJPXNW1 tag=6CD946VUHFTU type=del size=3532795 2024-09-22T08:21:11.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.343+0000 7fe6c9c31780 1 < completed delete operation key=0TWY0NNZZ7NN tag=TBYWMZNHWV3K type=del 2024-09-22T08:21:11.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.344+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=420MJX9DQ5J9 type=del size=1319778 2024-09-22T08:21:11.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.348+0000 7fe6c9c31780 1 < suggested update operation key=T2W6RXP9UGHH tag=CX03ZFYHB42W type=write size=411858 2024-09-22T08:21:11.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.351+0000 7fe6c9c31780 1 > prepared operation key=XJP26CCPYDI7 tag=XMXL3F1CY385 type=del size=1824416 2024-09-22T08:21:11.353 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.351+0000 7fe6c9c31780 1 < completed part key=_multipart_DC7VLQWZ3TD1.2~X2EZIERNZ6EB.0 size=225432 2024-09-22T08:21:11.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.354+0000 7fe6c9c31780 1 < completed multipart upload key=DC7VLQWZ3TD1 upload=X2EZIERNZ6EB tag=S5I1M9JP1FCB type=write size=1274008 2024-09-22T08:21:11.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.355+0000 7fe6c9c31780 1 > prepared operation key=KZIY400KQ5NH tag=B6OTXMWQGYMJ type=del size=1864615 2024-09-22T08:21:11.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.358+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~NTEH1Q94IWUA.0 size=1048576 2024-09-22T08:21:11.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.358+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~NTEH1Q94IWUA.1 size=1048576 2024-09-22T08:21:11.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.359+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~NTEH1Q94IWUA.2 size=633161 2024-09-22T08:21:11.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.363+0000 7fe6c9c31780 1 < completed multipart upload key=2B5QRUMTVE7U upload=NTEH1Q94IWUA tag=G4ZVDCTTNX74 type=write size=3778889 2024-09-22T08:21:11.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.363+0000 7fe6c9c31780 1 > prepared operation key=VP1MP4IC9A7T tag=IB1EFEA6X141 type=write size=953983 2024-09-22T08:21:11.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.367+0000 7fe6c9c31780 1 < suggested remove operation key=9FCSIF1WKBDJ tag=CHV6C26MGS9Y type=del 2024-09-22T08:21:11.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.370+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~CIHIUGKKS5J6.0 size=1048576 2024-09-22T08:21:11.372 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.371+0000 7fe6c9c31780 1 > prepared part key=_multipart_4KRJ7DTE3KDV.2~CIHIUGKKS5J6.1 size=73388 2024-09-22T08:21:11.372 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.371+0000 7fe6c9c31780 1 > prepared multipart upload key=4KRJ7DTE3KDV upload=CIHIUGKKS5J6 tag=67ITPOJMGL2M type=write size=2170540 2024-09-22T08:21:11.373 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.372+0000 7fe6c9c31780 1 < completed write operation key=76HZ3LZGVT9J tag=MS38NH4HP0ES type=write size=523375 2024-09-22T08:21:11.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.373+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=YI234BROX2T7 type=del size=2576373 2024-09-22T08:21:11.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.375+0000 7fe6c9c31780 1 < completed delete operation key=7446WN19QFV0 tag=SL3Y3ICZXYEB type=del 2024-09-22T08:21:11.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.378+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~XKAQ1GY1FJPC.0 size=1048576 2024-09-22T08:21:11.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.378+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~XKAQ1GY1FJPC.1 size=376959 2024-09-22T08:21:11.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.378+0000 7fe6c9c31780 1 > prepared multipart upload key=0PNK2ZW6IJM1 upload=XKAQ1GY1FJPC tag=9HYSGWAFB74A type=write size=2474111 2024-09-22T08:21:11.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.380+0000 7fe6c9c31780 1 < completed part key=_multipart_6BKB91YV3FMW.2~ZK1PAL5LVCQJ.0 size=1048576 2024-09-22T08:21:11.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.382+0000 7fe6c9c31780 1 < completed part key=_multipart_6BKB91YV3FMW.2~ZK1PAL5LVCQJ.1 size=798752 2024-09-22T08:21:11.385 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.384+0000 7fe6c9c31780 1 < completed multipart upload key=6BKB91YV3FMW upload=ZK1PAL5LVCQJ tag=E0GTXK9IJIUW type=write size=2895904 2024-09-22T08:21:11.387 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.385+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=FCDV04KO25JX type=del size=2689555 2024-09-22T08:21:11.388 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.386+0000 7fe6c9c31780 1 < completed part key=_multipart_ZFL9N44PBQX4.2~GJJ9WN1YB7RN.0 size=41436 2024-09-22T08:21:11.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.389+0000 7fe6c9c31780 1 < completed multipart upload key=ZFL9N44PBQX4 upload=GJJ9WN1YB7RN tag=Q324OSS05EAZ type=write size=1090012 2024-09-22T08:21:11.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.391+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~WNGOGS9AKF5M.0 size=1048576 2024-09-22T08:21:11.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.393+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~WNGOGS9AKF5M.1 size=918098 2024-09-22T08:21:11.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.393+0000 7fe6c9c31780 1 > prepared multipart upload key=LA6ZRVULGQ0H upload=WNGOGS9AKF5M tag=9HRW4ZO7HLFD type=write size=3015250 2024-09-22T08:21:11.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.394+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~QM51PTZ6KR4U.0 size=408096 2024-09-22T08:21:11.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.397+0000 7fe6c9c31780 1 < completed multipart upload key=OX1LY7URY7IV upload=QM51PTZ6KR4U tag=NXTRKEQYVV48 type=write size=1456672 2024-09-22T08:21:11.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.398+0000 7fe6c9c31780 1 > prepared operation key=JT5AB8VLMEFD tag=40YHA7Q3VDBO type=del size=1647926 2024-09-22T08:21:11.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.400+0000 7fe6c9c31780 1 < completed delete operation key=FY40JTHLT0KU tag=5BFFSPRB1HZ3 type=del 2024-09-22T08:21:11.404 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.403+0000 7fe6c9c31780 1 > prepared part key=_multipart_R7UWMW913DJQ.2~2S8KSLGVX64L.0 size=1048576 2024-09-22T08:21:11.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.404+0000 7fe6c9c31780 1 > prepared part key=_multipart_R7UWMW913DJQ.2~2S8KSLGVX64L.1 size=232455 2024-09-22T08:21:11.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.404+0000 7fe6c9c31780 1 > prepared multipart upload key=R7UWMW913DJQ upload=2S8KSLGVX64L tag=7FLF6F2N628B type=write size=2329607 2024-09-22T08:21:11.407 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.405+0000 7fe6c9c31780 1 < completed delete operation key=W9L87PTJEIOA tag=D1226PBYLUYM type=del 2024-09-22T08:21:11.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.407+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=BB0C6LH0CR7I type=del size=2277305 2024-09-22T08:21:11.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.408+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~9W2BUGWVCYRC.0 size=1048576 2024-09-22T08:21:11.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.410+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~9W2BUGWVCYRC.1 size=757578 2024-09-22T08:21:11.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.412+0000 7fe6c9c31780 1 < completed multipart upload key=KZIY400KQ5NH upload=9W2BUGWVCYRC tag=UN7252US47T8 type=write size=2854730 2024-09-22T08:21:11.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.413+0000 7fe6c9c31780 1 > prepared operation key=ZFL9N44PBQX4 tag=13L6N5N2WBE5 type=del size=2642130 2024-09-22T08:21:11.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.415+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~PIX6IWEMFGL6.0 size=1048576 2024-09-22T08:21:11.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.415+0000 7fe6c9c31780 1 < canceled part key=_multipart_D85LJGGU3Z6F.2~PIX6IWEMFGL6.1 size=886325 2024-09-22T08:21:11.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.417+0000 7fe6c9c31780 1 < canceled multipart upload key=D85LJGGU3Z6F upload=PIX6IWEMFGL6 tag=ZB4B6VQHTZAH type=write size=2983477 2024-09-22T08:21:11.420 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.419+0000 7fe6c9c31780 1 > prepared operation key=O1UBUQXP50CN tag=BMP2X105244E type=del size=3153903 2024-09-22T08:21:11.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.420+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~8Q7M1U5H9XTP.0 size=1048576 2024-09-22T08:21:11.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.421+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~8Q7M1U5H9XTP.1 size=1048576 2024-09-22T08:21:11.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.422+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~8Q7M1U5H9XTP.2 size=887377 2024-09-22T08:21:11.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.425+0000 7fe6c9c31780 1 < completed multipart upload key=KZIY400KQ5NH upload=8Q7M1U5H9XTP tag=BYVX6031T9N4 type=write size=4033105 2024-09-22T08:21:11.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.427+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~6L0RJCCVHQQG.0 size=1048576 2024-09-22T08:21:11.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.428+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~6L0RJCCVHQQG.1 size=798716 2024-09-22T08:21:11.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.428+0000 7fe6c9c31780 1 > prepared multipart upload key=ILW34WLX48WN upload=6L0RJCCVHQQG tag=5K62LRHUG1MR type=write size=2895868 2024-09-22T08:21:11.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.430+0000 7fe6c9c31780 1 < completed delete operation key=1HZ0NAJPXNW1 tag=6CD946VUHFTU type=del 2024-09-22T08:21:11.435 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.433+0000 7fe6c9c31780 1 > prepared part key=_multipart_R7UWMW913DJQ.2~Z671CRQA21X2.0 size=777042 2024-09-22T08:21:11.435 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.433+0000 7fe6c9c31780 1 > prepared multipart upload key=R7UWMW913DJQ upload=Z671CRQA21X2 tag=VRN52YH7B3ST type=write size=1825618 2024-09-22T08:21:11.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.436+0000 7fe6c9c31780 1 < suggested update operation key=76HZ3LZGVT9J tag=420MJX9DQ5J9 type=del size=1319778 2024-09-22T08:21:11.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.438+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~3CH0JZ4A3DOY.0 size=1048576 2024-09-22T08:21:11.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.440+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~3CH0JZ4A3DOY.1 size=86683 2024-09-22T08:21:11.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.440+0000 7fe6c9c31780 1 > prepared multipart upload key=9FCSIF1WKBDJ upload=3CH0JZ4A3DOY tag=QPI32R7DGOK9 type=write size=2183835 2024-09-22T08:21:11.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.441+0000 7fe6c9c31780 1 < completed delete operation key=XJP26CCPYDI7 tag=XMXL3F1CY385 type=del 2024-09-22T08:21:11.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.442+0000 7fe6c9c31780 1 > prepared operation key=LA6ZRVULGQ0H tag=RYUMGYE91ZVM type=del size=1698058 2024-09-22T08:21:11.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.444+0000 7fe6c9c31780 1 < completed delete operation key=KZIY400KQ5NH tag=B6OTXMWQGYMJ type=del 2024-09-22T08:21:11.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.446+0000 7fe6c9c31780 1 > prepared operation key=KZIY400KQ5NH tag=LXCY2O4DUOS5 type=del size=2398746 2024-09-22T08:21:11.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.449+0000 7fe6c9c31780 1 < suggested remove operation key=VP1MP4IC9A7T tag=IB1EFEA6X141 type=write 2024-09-22T08:21:11.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.450+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=6C3XLTV55AR7 type=write size=300739 2024-09-22T08:21:11.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.451+0000 7fe6c9c31780 1 < completed part key=_multipart_4KRJ7DTE3KDV.2~CIHIUGKKS5J6.0 size=1048576 2024-09-22T08:21:11.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.452+0000 7fe6c9c31780 1 < completed part key=_multipart_4KRJ7DTE3KDV.2~CIHIUGKKS5J6.1 size=73388 2024-09-22T08:21:11.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.455+0000 7fe6c9c31780 1 < completed multipart upload key=4KRJ7DTE3KDV upload=CIHIUGKKS5J6 tag=67ITPOJMGL2M type=write size=2170540 2024-09-22T08:21:11.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.458+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~734TN72RVT11.0 size=1048576 2024-09-22T08:21:11.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.459+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~734TN72RVT11.1 size=962729 2024-09-22T08:21:11.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.459+0000 7fe6c9c31780 1 > prepared multipart upload key=76HZ3LZGVT9J upload=734TN72RVT11 tag=YJNE017DWQKX type=write size=3059881 2024-09-22T08:21:11.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.460+0000 7fe6c9c31780 1 < completed delete operation key=DC7VLQWZ3TD1 tag=YI234BROX2T7 type=del 2024-09-22T08:21:11.463 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.462+0000 7fe6c9c31780 1 > prepared operation key=ZFL9N44PBQX4 tag=72KL0VP8829W type=del size=2402508 2024-09-22T08:21:11.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.463+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~XKAQ1GY1FJPC.0 size=1048576 2024-09-22T08:21:11.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.464+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~XKAQ1GY1FJPC.1 size=376959 2024-09-22T08:21:11.469 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.467+0000 7fe6c9c31780 1 < completed multipart upload key=0PNK2ZW6IJM1 upload=XKAQ1GY1FJPC tag=9HYSGWAFB74A type=write size=2474111 2024-09-22T08:21:11.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.470+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~V016Q6DBLW9S.0 size=638745 2024-09-22T08:21:11.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.470+0000 7fe6c9c31780 1 > prepared multipart upload key=VP1MP4IC9A7T upload=V016Q6DBLW9S tag=YZD6KYI7OQX4 type=write size=1687321 2024-09-22T08:21:11.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.471+0000 7fe6c9c31780 1 < canceled operation key=DC7VLQWZ3TD1 tag=FCDV04KO25JX type=del size=2689555 2024-09-22T08:21:11.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.473+0000 7fe6c9c31780 1 > prepared operation key=ZFL9N44PBQX4 tag=LYQZCVWAGPFI type=del size=400834 2024-09-22T08:21:11.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.473+0000 7fe6c9c31780 1 < canceled part key=_multipart_LA6ZRVULGQ0H.2~WNGOGS9AKF5M.0 size=1048576 2024-09-22T08:21:11.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.473+0000 7fe6c9c31780 1 < canceled part key=_multipart_LA6ZRVULGQ0H.2~WNGOGS9AKF5M.1 size=918098 2024-09-22T08:21:11.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.475+0000 7fe6c9c31780 1 < canceled multipart upload key=LA6ZRVULGQ0H upload=WNGOGS9AKF5M tag=9HRW4ZO7HLFD type=write size=3015250 2024-09-22T08:21:11.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.478+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=ANHQBFONUDJU type=del size=3968894 2024-09-22T08:21:11.481 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.479+0000 7fe6c9c31780 1 < completed delete operation key=JT5AB8VLMEFD tag=40YHA7Q3VDBO type=del 2024-09-22T08:21:11.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.480+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=NCBY3ZSTPZGU type=del size=2334802 2024-09-22T08:21:11.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.482+0000 7fe6c9c31780 1 < completed part key=_multipart_R7UWMW913DJQ.2~2S8KSLGVX64L.0 size=1048576 2024-09-22T08:21:11.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.483+0000 7fe6c9c31780 1 < completed part key=_multipart_R7UWMW913DJQ.2~2S8KSLGVX64L.1 size=232455 2024-09-22T08:21:11.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.487+0000 7fe6c9c31780 1 < completed multipart upload key=R7UWMW913DJQ upload=2S8KSLGVX64L tag=7FLF6F2N628B type=write size=2329607 2024-09-22T08:21:11.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.489+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~DR61R3XQYQ76.0 size=1048576 2024-09-22T08:21:11.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.490+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~DR61R3XQYQ76.1 size=181437 2024-09-22T08:21:11.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.490+0000 7fe6c9c31780 1 > prepared multipart upload key=O1UBUQXP50CN upload=DR61R3XQYQ76 tag=5SK0GLI0U2FH type=write size=2278589 2024-09-22T08:21:11.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.492+0000 7fe6c9c31780 1 < completed delete operation key=TE10GB1F35X4 tag=BB0C6LH0CR7I type=del 2024-09-22T08:21:11.495 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.493+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=U3JNBJKCSU07 type=write size=950731 2024-09-22T08:21:11.498 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.496+0000 7fe6c9c31780 1 < suggested remove operation key=ZFL9N44PBQX4 tag=13L6N5N2WBE5 type=del 2024-09-22T08:21:11.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.497+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=R80FP27P30CM type=del size=399809 2024-09-22T08:21:11.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.499+0000 7fe6c9c31780 1 < completed delete operation key=O1UBUQXP50CN tag=BMP2X105244E type=del 2024-09-22T08:21:11.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.500+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=HWTK0112D42I type=del size=2863580 2024-09-22T08:21:11.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.503+0000 7fe6c9c31780 1 < completed part key=_multipart_ILW34WLX48WN.2~6L0RJCCVHQQG.0 size=1048576 2024-09-22T08:21:11.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.504+0000 7fe6c9c31780 1 < completed part key=_multipart_ILW34WLX48WN.2~6L0RJCCVHQQG.1 size=798716 2024-09-22T08:21:11.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.505+0000 7fe6c9c31780 1 < completed multipart upload key=ILW34WLX48WN upload=6L0RJCCVHQQG tag=5K62LRHUG1MR type=write size=2895868 2024-09-22T08:21:11.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.508+0000 7fe6c9c31780 1 > prepared part key=_multipart_R7UWMW913DJQ.2~ZM8UJ50A8VEH.0 size=905244 2024-09-22T08:21:11.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.508+0000 7fe6c9c31780 1 > prepared multipart upload key=R7UWMW913DJQ upload=ZM8UJ50A8VEH tag=B615BG034H5D type=write size=1953820 2024-09-22T08:21:11.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.509+0000 7fe6c9c31780 1 < completed part key=_multipart_R7UWMW913DJQ.2~Z671CRQA21X2.0 size=777042 2024-09-22T08:21:11.513 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.512+0000 7fe6c9c31780 1 < completed multipart upload key=R7UWMW913DJQ upload=Z671CRQA21X2 tag=VRN52YH7B3ST type=write size=1825618 2024-09-22T08:21:11.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.514+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=240JL2D73WX6 type=write size=993990 2024-09-22T08:21:11.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.515+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~3CH0JZ4A3DOY.0 size=1048576 2024-09-22T08:21:11.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.516+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~3CH0JZ4A3DOY.1 size=86683 2024-09-22T08:21:11.520 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.518+0000 7fe6c9c31780 1 < completed multipart upload key=9FCSIF1WKBDJ upload=3CH0JZ4A3DOY tag=QPI32R7DGOK9 type=write size=2183835 2024-09-22T08:21:11.521 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.520+0000 7fe6c9c31780 1 > prepared operation key=TJTB67QBLZH5 tag=GV6ZYLJBHV4K type=write size=654330 2024-09-22T08:21:11.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.521+0000 7fe6c9c31780 1 < completed delete operation key=LA6ZRVULGQ0H tag=RYUMGYE91ZVM type=del 2024-09-22T08:21:11.524 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.522+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=T80K8Q7N9T7E type=del size=499292 2024-09-22T08:21:11.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.524+0000 7fe6c9c31780 1 < completed delete operation key=KZIY400KQ5NH tag=LXCY2O4DUOS5 type=del 2024-09-22T08:21:11.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.525+0000 7fe6c9c31780 1 > prepared operation key=Z1CK5EDBK4AW tag=DRHZSZ4YJ9SP type=del size=938130 2024-09-22T08:21:11.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.527+0000 7fe6c9c31780 1 < completed write operation key=76HZ3LZGVT9J tag=6C3XLTV55AR7 type=write size=300739 2024-09-22T08:21:11.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.528+0000 7fe6c9c31780 1 > prepared operation key=OX1LY7URY7IV tag=UALLMSU9MNVM type=del size=3067051 2024-09-22T08:21:11.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.531+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~734TN72RVT11.0 size=1048576 2024-09-22T08:21:11.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.531+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~734TN72RVT11.1 size=962729 2024-09-22T08:21:11.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.534+0000 7fe6c9c31780 1 < completed multipart upload key=76HZ3LZGVT9J upload=734TN72RVT11 tag=YJNE017DWQKX type=write size=3059881 2024-09-22T08:21:11.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.535+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=CUZGG6EJ4XXG type=write size=229291 2024-09-22T08:21:11.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.537+0000 7fe6c9c31780 -1 < failed to complete operation key=ZFL9N44PBQX4 tag=72KL0VP8829W type=del size=2402508: (22) Invalid argument 2024-09-22T08:21:11.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.540+0000 7fe6c9c31780 1 > prepared part key=_multipart_XJP26CCPYDI7.2~OS6C8LLFHT87.0 size=660879 2024-09-22T08:21:11.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.540+0000 7fe6c9c31780 1 > prepared multipart upload key=XJP26CCPYDI7 upload=OS6C8LLFHT87 tag=XRF86A3KISC5 type=write size=1709455 2024-09-22T08:21:11.542 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.541+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~V016Q6DBLW9S.0 size=638745 2024-09-22T08:21:11.545 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.543+0000 7fe6c9c31780 1 < completed multipart upload key=VP1MP4IC9A7T upload=V016Q6DBLW9S tag=YZD6KYI7OQX4 type=write size=1687321 2024-09-22T08:21:11.546 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.544+0000 7fe6c9c31780 1 > prepared operation key=OX1LY7URY7IV tag=CNQWD03OHSYM type=del size=3253496 2024-09-22T08:21:11.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.546+0000 7fe6c9c31780 -1 < failed to complete operation key=ZFL9N44PBQX4 tag=LYQZCVWAGPFI type=del size=400834: (22) Invalid argument 2024-09-22T08:21:11.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.548+0000 7fe6c9c31780 1 > prepared operation key=LA6ZRVULGQ0H tag=IF1ZR2IDYFA7 type=del size=786160 2024-09-22T08:21:11.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.549+0000 7fe6c9c31780 1 < canceled operation key=TE10GB1F35X4 tag=ANHQBFONUDJU type=del size=3968894 2024-09-22T08:21:11.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.550+0000 7fe6c9c31780 1 > prepared operation key=LA6ZRVULGQ0H tag=12EPU1JC1OR7 type=del size=757574 2024-09-22T08:21:11.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.552+0000 7fe6c9c31780 1 < completed delete operation key=ILW34WLX48WN tag=NCBY3ZSTPZGU type=del 2024-09-22T08:21:11.555 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.553+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=D5XUTCDYWLPM type=write size=994064 2024-09-22T08:21:11.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.554+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~DR61R3XQYQ76.0 size=1048576 2024-09-22T08:21:11.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.556+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~DR61R3XQYQ76.1 size=181437 2024-09-22T08:21:11.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.558+0000 7fe6c9c31780 1 < completed multipart upload key=O1UBUQXP50CN upload=DR61R3XQYQ76 tag=5SK0GLI0U2FH type=write size=2278589 2024-09-22T08:21:11.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.560+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~IKGHJS95P4C2.0 size=1048576 2024-09-22T08:21:11.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.562+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~IKGHJS95P4C2.1 size=437500 2024-09-22T08:21:11.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.562+0000 7fe6c9c31780 1 > prepared multipart upload key=O1UBUQXP50CN upload=IKGHJS95P4C2 tag=AD4G92NGIE0C type=write size=2534652 2024-09-22T08:21:11.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.563+0000 7fe6c9c31780 1 < completed write operation key=TE10GB1F35X4 tag=U3JNBJKCSU07 type=write size=950731 2024-09-22T08:21:11.567 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.566+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~ZVVWT7YT5587.0 size=1048576 2024-09-22T08:21:11.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.568+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~ZVVWT7YT5587.1 size=3851 2024-09-22T08:21:11.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.568+0000 7fe6c9c31780 1 > prepared multipart upload key=VP1MP4IC9A7T upload=ZVVWT7YT5587 tag=JDFTQ47S27DA type=write size=2101003 2024-09-22T08:21:11.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.569+0000 7fe6c9c31780 1 < completed delete operation key=946H8F2AUPO2 tag=R80FP27P30CM type=del 2024-09-22T08:21:11.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.570+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=7NWLOD3PGRD5 type=del size=1702525 2024-09-22T08:21:11.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.572+0000 7fe6c9c31780 1 < completed delete operation key=6BKB91YV3FMW tag=HWTK0112D42I type=del 2024-09-22T08:21:11.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.573+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=D9MMPDA4C8CP type=del size=3418456 2024-09-22T08:21:11.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.576+0000 7fe6c9c31780 1 < completed part key=_multipart_R7UWMW913DJQ.2~ZM8UJ50A8VEH.0 size=905244 2024-09-22T08:21:11.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.578+0000 7fe6c9c31780 1 < completed multipart upload key=R7UWMW913DJQ upload=ZM8UJ50A8VEH tag=B615BG034H5D type=write size=1953820 2024-09-22T08:21:11.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.579+0000 7fe6c9c31780 1 > prepared operation key=FY40JTHLT0KU tag=YONLIMDTV61O type=del size=1468375 2024-09-22T08:21:11.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.581+0000 7fe6c9c31780 1 < completed write operation key=T2W6RXP9UGHH tag=240JL2D73WX6 type=write size=993990 2024-09-22T08:21:11.584 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.582+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=HNXGA6GE641F type=write size=67171 2024-09-22T08:21:11.585 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.583+0000 7fe6c9c31780 1 < completed write operation key=TJTB67QBLZH5 tag=GV6ZYLJBHV4K type=write size=654330 2024-09-22T08:21:11.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.585+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=WD1IE0A7QZ5I type=del size=2815507 2024-09-22T08:21:11.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.587+0000 7fe6c9c31780 1 < completed delete operation key=R7UWMW913DJQ tag=T80K8Q7N9T7E type=del 2024-09-22T08:21:11.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.587+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=KBMM348HCHG3 type=del size=638492 2024-09-22T08:21:11.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.589+0000 7fe6c9c31780 1 < completed delete operation key=Z1CK5EDBK4AW tag=DRHZSZ4YJ9SP type=del 2024-09-22T08:21:11.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.591+0000 7fe6c9c31780 1 > prepared operation key=W9L87PTJEIOA tag=CY0VB4L2J2IK type=del size=495147 2024-09-22T08:21:11.595 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.594+0000 7fe6c9c31780 1 < suggested remove operation key=OX1LY7URY7IV tag=UALLMSU9MNVM type=del 2024-09-22T08:21:11.598 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.596+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~AI14W0H0WD86.0 size=449459 2024-09-22T08:21:11.598 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.596+0000 7fe6c9c31780 1 > prepared multipart upload key=6BKB91YV3FMW upload=AI14W0H0WD86 tag=QSVO5T60JJAP type=write size=1498035 2024-09-22T08:21:11.599 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.598+0000 7fe6c9c31780 1 < canceled operation key=2B5QRUMTVE7U tag=CUZGG6EJ4XXG type=write size=229291 2024-09-22T08:21:11.602 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.600+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~1LZ0QY3LO5SL.0 size=1048576 2024-09-22T08:21:11.603 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.601+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~1LZ0QY3LO5SL.1 size=1048576 2024-09-22T08:21:11.604 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.603+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~1LZ0QY3LO5SL.2 size=148044 2024-09-22T08:21:11.604 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.603+0000 7fe6c9c31780 1 > prepared multipart upload key=KZIY400KQ5NH upload=1LZ0QY3LO5SL tag=NGJ18RYBPQPM type=write size=3293772 2024-09-22T08:21:11.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.605+0000 7fe6c9c31780 1 < completed part key=_multipart_XJP26CCPYDI7.2~OS6C8LLFHT87.0 size=660879 2024-09-22T08:21:11.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.606+0000 7fe6c9c31780 1 < completed multipart upload key=XJP26CCPYDI7 upload=OS6C8LLFHT87 tag=XRF86A3KISC5 type=write size=1709455 2024-09-22T08:21:11.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.608+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=MRYNSGBS9TKE type=write size=263309 2024-09-22T08:21:11.611 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.609+0000 7fe6c9c31780 -1 < failed to complete operation key=OX1LY7URY7IV tag=CNQWD03OHSYM type=del size=3253496: (22) Invalid argument 2024-09-22T08:21:11.613 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.612+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~3PERF4TP0LCA.0 size=1048576 2024-09-22T08:21:11.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.613+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~3PERF4TP0LCA.1 size=1048576 2024-09-22T08:21:11.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.615+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~3PERF4TP0LCA.2 size=129075 2024-09-22T08:21:11.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.615+0000 7fe6c9c31780 1 > prepared multipart upload key=JT5AB8VLMEFD upload=3PERF4TP0LCA tag=E2P3BD1F6P6R type=write size=3274803 2024-09-22T08:21:11.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.616+0000 7fe6c9c31780 1 < completed delete operation key=LA6ZRVULGQ0H tag=IF1ZR2IDYFA7 type=del 2024-09-22T08:21:11.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.618+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=6N7NT1U0TL1L type=write size=522395 2024-09-22T08:21:11.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.620+0000 7fe6c9c31780 1 < suggested update operation key=LA6ZRVULGQ0H tag=12EPU1JC1OR7 type=del size=757574 2024-09-22T08:21:11.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.622+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=RUO1J5PYPO1W type=del size=3801618 2024-09-22T08:21:11.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.624+0000 7fe6c9c31780 1 < completed write operation key=T2W6RXP9UGHH tag=D5XUTCDYWLPM type=write size=994064 2024-09-22T08:21:11.628 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.626+0000 7fe6c9c31780 1 > prepared part key=_multipart_1HZ0NAJPXNW1.2~S58TZAMF14RO.0 size=1048576 2024-09-22T08:21:11.629 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.627+0000 7fe6c9c31780 1 > prepared part key=_multipart_1HZ0NAJPXNW1.2~S58TZAMF14RO.1 size=1048576 2024-09-22T08:21:11.630 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.629+0000 7fe6c9c31780 1 > prepared part key=_multipart_1HZ0NAJPXNW1.2~S58TZAMF14RO.2 size=42680 2024-09-22T08:21:11.630 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.629+0000 7fe6c9c31780 1 > prepared multipart upload key=1HZ0NAJPXNW1 upload=S58TZAMF14RO tag=KUENFCJINIEZ type=write size=3188408 2024-09-22T08:21:11.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.630+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~IKGHJS95P4C2.0 size=1048576 2024-09-22T08:21:11.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.631+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~IKGHJS95P4C2.1 size=437500 2024-09-22T08:21:11.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.633+0000 7fe6c9c31780 1 < completed multipart upload key=O1UBUQXP50CN upload=IKGHJS95P4C2 tag=AD4G92NGIE0C type=write size=2534652 2024-09-22T08:21:11.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.636+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~UNTZWXKFJ7HY.0 size=1048576 2024-09-22T08:21:11.639 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.637+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~UNTZWXKFJ7HY.1 size=257486 2024-09-22T08:21:11.639 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.637+0000 7fe6c9c31780 1 > prepared multipart upload key=76HZ3LZGVT9J upload=UNTZWXKFJ7HY tag=RWCANN5STVZD type=write size=2354638 2024-09-22T08:21:11.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.639+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~ZVVWT7YT5587.0 size=1048576 2024-09-22T08:21:11.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.640+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~ZVVWT7YT5587.1 size=3851 2024-09-22T08:21:11.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.642+0000 7fe6c9c31780 1 < completed multipart upload key=VP1MP4IC9A7T upload=ZVVWT7YT5587 tag=JDFTQ47S27DA type=write size=2101003 2024-09-22T08:21:11.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.644+0000 7fe6c9c31780 1 > prepared operation key=LA6ZRVULGQ0H tag=M4P68HL14G7O type=del size=2916013 2024-09-22T08:21:11.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.646+0000 7fe6c9c31780 1 < completed delete operation key=TE10GB1F35X4 tag=7NWLOD3PGRD5 type=del 2024-09-22T08:21:11.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.649+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~MAEJB6KWZLCR.0 size=1048576 2024-09-22T08:21:11.651 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.650+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~MAEJB6KWZLCR.1 size=736505 2024-09-22T08:21:11.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.650+0000 7fe6c9c31780 1 > prepared multipart upload key=TE10GB1F35X4 upload=MAEJB6KWZLCR tag=B4749TY57ED1 type=write size=2833657 2024-09-22T08:21:11.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.651+0000 7fe6c9c31780 1 < completed delete operation key=TE10GB1F35X4 tag=D9MMPDA4C8CP type=del 2024-09-22T08:21:11.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.653+0000 7fe6c9c31780 1 > prepared operation key=O1UBUQXP50CN tag=3BS6Y3G4USML type=del size=3657388 2024-09-22T08:21:11.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.654+0000 7fe6c9c31780 1 < completed delete operation key=FY40JTHLT0KU tag=YONLIMDTV61O type=del 2024-09-22T08:21:11.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.658+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~850PDQGQDPJ6.0 size=784635 2024-09-22T08:21:11.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.658+0000 7fe6c9c31780 1 > prepared multipart upload key=76HZ3LZGVT9J upload=850PDQGQDPJ6 tag=FED8BHEWSKOW type=write size=1833211 2024-09-22T08:21:11.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.659+0000 7fe6c9c31780 1 < completed write operation key=ILW34WLX48WN tag=HNXGA6GE641F type=write size=67171 2024-09-22T08:21:11.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.662+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~6BAMBIQ2M1JM.0 size=1048576 2024-09-22T08:21:11.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.663+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~6BAMBIQ2M1JM.1 size=1048576 2024-09-22T08:21:11.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.664+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~6BAMBIQ2M1JM.2 size=805788 2024-09-22T08:21:11.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.664+0000 7fe6c9c31780 1 > prepared multipart upload key=DC7VLQWZ3TD1 upload=6BAMBIQ2M1JM tag=KWM15VOL1MPB type=write size=3951516 2024-09-22T08:21:11.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.667+0000 7fe6c9c31780 1 < suggested update operation key=2B5QRUMTVE7U tag=WD1IE0A7QZ5I type=del size=2815507 2024-09-22T08:21:11.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.670+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~HADXII3GOADB.0 size=1048576 2024-09-22T08:21:11.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.671+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~HADXII3GOADB.1 size=1048576 2024-09-22T08:21:11.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.672+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~HADXII3GOADB.2 size=1025133 2024-09-22T08:21:11.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.672+0000 7fe6c9c31780 1 > prepared multipart upload key=Z1CK5EDBK4AW upload=HADXII3GOADB tag=BLZPM1V3IZN1 type=write size=4170861 2024-09-22T08:21:11.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.673+0000 7fe6c9c31780 1 < completed delete operation key=T2W6RXP9UGHH tag=KBMM348HCHG3 type=del 2024-09-22T08:21:11.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.677+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~GPL2SZ5DR1EW.0 size=1048576 2024-09-22T08:21:11.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.677+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~GPL2SZ5DR1EW.1 size=14598 2024-09-22T08:21:11.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.677+0000 7fe6c9c31780 1 > prepared multipart upload key=DC7VLQWZ3TD1 upload=GPL2SZ5DR1EW tag=KX7IZAYJXMIR type=write size=2111750 2024-09-22T08:21:11.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.678+0000 7fe6c9c31780 1 < completed delete operation key=W9L87PTJEIOA tag=CY0VB4L2J2IK type=del 2024-09-22T08:21:11.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.681+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~BZ7U5UIT80FW.0 size=77893 2024-09-22T08:21:11.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.681+0000 7fe6c9c31780 1 > prepared multipart upload key=DC7VLQWZ3TD1 upload=BZ7U5UIT80FW tag=48QRD1D7PHJD type=write size=1126469 2024-09-22T08:21:11.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.681+0000 7fe6c9c31780 1 < canceled part key=_multipart_6BKB91YV3FMW.2~AI14W0H0WD86.0 size=449459 2024-09-22T08:21:11.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.683+0000 7fe6c9c31780 1 < canceled multipart upload key=6BKB91YV3FMW upload=AI14W0H0WD86 tag=QSVO5T60JJAP type=write size=1498035 2024-09-22T08:21:11.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.687+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~AXX3I4IN4CKF.0 size=1048576 2024-09-22T08:21:11.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.688+0000 7fe6c9c31780 1 > prepared part key=_multipart_7446WN19QFV0.2~AXX3I4IN4CKF.1 size=845900 2024-09-22T08:21:11.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.688+0000 7fe6c9c31780 1 > prepared multipart upload key=7446WN19QFV0 upload=AXX3I4IN4CKF tag=4AFPGI8JB05I type=write size=2943052 2024-09-22T08:21:11.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.688+0000 7fe6c9c31780 1 < canceled part key=_multipart_KZIY400KQ5NH.2~1LZ0QY3LO5SL.0 size=1048576 2024-09-22T08:21:11.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.688+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~1LZ0QY3LO5SL.1 size=1048576 2024-09-22T08:21:11.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.690+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~1LZ0QY3LO5SL.2 size=148044 2024-09-22T08:21:11.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.693+0000 7fe6c9c31780 1 < canceled multipart upload key=KZIY400KQ5NH upload=1LZ0QY3LO5SL tag=NGJ18RYBPQPM type=write size=3293772 2024-09-22T08:21:11.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.694+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=W8ZJD4ZA5I6S type=write size=794436 2024-09-22T08:21:11.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.697+0000 7fe6c9c31780 1 < suggested update operation key=R7UWMW913DJQ tag=MRYNSGBS9TKE type=write size=263309 2024-09-22T08:21:11.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.698+0000 7fe6c9c31780 1 > prepared operation key=GEWQUFB9K35E tag=6E7GC6222ET1 type=del size=4055663 2024-09-22T08:21:11.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.699+0000 7fe6c9c31780 1 < completed part key=_multipart_JT5AB8VLMEFD.2~3PERF4TP0LCA.0 size=1048576 2024-09-22T08:21:11.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.701+0000 7fe6c9c31780 1 < completed part key=_multipart_JT5AB8VLMEFD.2~3PERF4TP0LCA.1 size=1048576 2024-09-22T08:21:11.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.702+0000 7fe6c9c31780 1 < completed part key=_multipart_JT5AB8VLMEFD.2~3PERF4TP0LCA.2 size=129075 2024-09-22T08:21:11.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.704+0000 7fe6c9c31780 1 < completed multipart upload key=JT5AB8VLMEFD upload=3PERF4TP0LCA tag=E2P3BD1F6P6R type=write size=3274803 2024-09-22T08:21:11.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.706+0000 7fe6c9c31780 1 > prepared operation key=0PNK2ZW6IJM1 tag=X1NY8CF0J2OM type=del size=1126105 2024-09-22T08:21:11.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.707+0000 7fe6c9c31780 1 < completed write operation key=7446WN19QFV0 tag=6N7NT1U0TL1L type=write size=522395 2024-09-22T08:21:11.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.708+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=TCX78ON2AFIG type=del size=2191486 2024-09-22T08:21:11.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.710+0000 7fe6c9c31780 -1 < failed to complete operation key=R7UWMW913DJQ tag=RUO1J5PYPO1W type=del size=3801618: (22) Invalid argument 2024-09-22T08:21:11.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.711+0000 7fe6c9c31780 1 > prepared operation key=OX1LY7URY7IV tag=2HW76A631F5K type=del size=779915 2024-09-22T08:21:11.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.712+0000 7fe6c9c31780 1 < canceled part key=_multipart_1HZ0NAJPXNW1.2~S58TZAMF14RO.0 size=1048576 2024-09-22T08:21:11.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.713+0000 7fe6c9c31780 1 < completed part key=_multipart_1HZ0NAJPXNW1.2~S58TZAMF14RO.1 size=1048576 2024-09-22T08:21:11.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.714+0000 7fe6c9c31780 1 < completed part key=_multipart_1HZ0NAJPXNW1.2~S58TZAMF14RO.2 size=42680 2024-09-22T08:21:11.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.718+0000 7fe6c9c31780 1 < canceled multipart upload key=1HZ0NAJPXNW1 upload=S58TZAMF14RO tag=KUENFCJINIEZ type=write size=3188408 2024-09-22T08:21:11.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.719+0000 7fe6c9c31780 1 > prepared operation key=2B5QRUMTVE7U tag=GNA982PJZC4X type=del size=3044606 2024-09-22T08:21:11.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.720+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~UNTZWXKFJ7HY.0 size=1048576 2024-09-22T08:21:11.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.722+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~UNTZWXKFJ7HY.1 size=257486 2024-09-22T08:21:11.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.724+0000 7fe6c9c31780 1 < completed multipart upload key=76HZ3LZGVT9J upload=UNTZWXKFJ7HY tag=RWCANN5STVZD type=write size=2354638 2024-09-22T08:21:11.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.726+0000 7fe6c9c31780 1 > prepared operation key=KZIY400KQ5NH tag=D62Q1L5159X4 type=del size=2241427 2024-09-22T08:21:11.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.727+0000 7fe6c9c31780 1 < canceled operation key=LA6ZRVULGQ0H tag=M4P68HL14G7O type=del size=2916013 2024-09-22T08:21:11.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.728+0000 7fe6c9c31780 1 > prepared operation key=LA6ZRVULGQ0H tag=IZXYTO1LW6TB type=del size=1370206 2024-09-22T08:21:11.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.730+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~MAEJB6KWZLCR.0 size=1048576 2024-09-22T08:21:11.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.732+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~MAEJB6KWZLCR.1 size=736505 2024-09-22T08:21:11.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.734+0000 7fe6c9c31780 1 < completed multipart upload key=TE10GB1F35X4 upload=MAEJB6KWZLCR tag=B4749TY57ED1 type=write size=2833657 2024-09-22T08:21:11.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.736+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~I9B61WG2HFSG.0 size=639657 2024-09-22T08:21:11.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.736+0000 7fe6c9c31780 1 > prepared multipart upload key=OX1LY7URY7IV upload=I9B61WG2HFSG tag=G75A8YEAK3MU type=write size=1688233 2024-09-22T08:21:11.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.738+0000 7fe6c9c31780 1 < completed delete operation key=O1UBUQXP50CN tag=3BS6Y3G4USML type=del 2024-09-22T08:21:11.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.741+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~GQOYY4TJIHLF.0 size=1048576 2024-09-22T08:21:11.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.741+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~GQOYY4TJIHLF.1 size=1048576 2024-09-22T08:21:11.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.743+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~GQOYY4TJIHLF.2 size=920152 2024-09-22T08:21:11.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.743+0000 7fe6c9c31780 1 > prepared multipart upload key=O1UBUQXP50CN upload=GQOYY4TJIHLF tag=QRR1SS59XYKB type=write size=4065880 2024-09-22T08:21:11.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.744+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~850PDQGQDPJ6.0 size=784635 2024-09-22T08:21:11.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.746+0000 7fe6c9c31780 1 < completed multipart upload key=76HZ3LZGVT9J upload=850PDQGQDPJ6 tag=FED8BHEWSKOW type=write size=1833211 2024-09-22T08:21:11.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.749+0000 7fe6c9c31780 1 > prepared part key=_multipart_ZFL9N44PBQX4.2~K0CTW5QAL5D3.0 size=543668 2024-09-22T08:21:11.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.749+0000 7fe6c9c31780 1 > prepared multipart upload key=ZFL9N44PBQX4 upload=K0CTW5QAL5D3 tag=PFJQW16YCQRL type=write size=1592244 2024-09-22T08:21:11.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.750+0000 7fe6c9c31780 1 < completed part key=_multipart_DC7VLQWZ3TD1.2~6BAMBIQ2M1JM.0 size=1048576 2024-09-22T08:21:11.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.751+0000 7fe6c9c31780 1 < completed part key=_multipart_DC7VLQWZ3TD1.2~6BAMBIQ2M1JM.1 size=1048576 2024-09-22T08:21:11.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.752+0000 7fe6c9c31780 1 < completed part key=_multipart_DC7VLQWZ3TD1.2~6BAMBIQ2M1JM.2 size=805788 2024-09-22T08:21:11.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.755+0000 7fe6c9c31780 1 < completed multipart upload key=DC7VLQWZ3TD1 upload=6BAMBIQ2M1JM tag=KWM15VOL1MPB type=write size=3951516 2024-09-22T08:21:11.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.759+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~8NGMY0FKDA1R.0 size=1048576 2024-09-22T08:21:11.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.760+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~8NGMY0FKDA1R.1 size=220225 2024-09-22T08:21:11.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.760+0000 7fe6c9c31780 1 > prepared multipart upload key=LA6ZRVULGQ0H upload=8NGMY0FKDA1R tag=JRES9M26E30V type=write size=2317377 2024-09-22T08:21:11.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.761+0000 7fe6c9c31780 1 < completed part key=_multipart_Z1CK5EDBK4AW.2~HADXII3GOADB.0 size=1048576 2024-09-22T08:21:11.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.763+0000 7fe6c9c31780 1 < completed part key=_multipart_Z1CK5EDBK4AW.2~HADXII3GOADB.1 size=1048576 2024-09-22T08:21:11.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.764+0000 7fe6c9c31780 1 < completed part key=_multipart_Z1CK5EDBK4AW.2~HADXII3GOADB.2 size=1025133 2024-09-22T08:21:11.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.766+0000 7fe6c9c31780 1 < completed multipart upload key=Z1CK5EDBK4AW upload=HADXII3GOADB tag=BLZPM1V3IZN1 type=write size=4170861 2024-09-22T08:21:11.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.768+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=OL53RTB2MPD1 type=del size=3989113 2024-09-22T08:21:11.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.770+0000 7fe6c9c31780 1 < completed part key=_multipart_DC7VLQWZ3TD1.2~GPL2SZ5DR1EW.0 size=1048576 2024-09-22T08:21:11.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.770+0000 7fe6c9c31780 1 < completed part key=_multipart_DC7VLQWZ3TD1.2~GPL2SZ5DR1EW.1 size=14598 2024-09-22T08:21:11.774 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.773+0000 7fe6c9c31780 1 < completed multipart upload key=DC7VLQWZ3TD1 upload=GPL2SZ5DR1EW tag=KX7IZAYJXMIR type=write size=2111750 2024-09-22T08:21:11.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.774+0000 7fe6c9c31780 1 > prepared operation key=9FCSIF1WKBDJ tag=3AVX8W3TMEZ0 type=del size=494459 2024-09-22T08:21:11.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.776+0000 7fe6c9c31780 1 < completed part key=_multipart_DC7VLQWZ3TD1.2~BZ7U5UIT80FW.0 size=77893 2024-09-22T08:21:11.780 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.778+0000 7fe6c9c31780 1 < completed multipart upload key=DC7VLQWZ3TD1 upload=BZ7U5UIT80FW tag=48QRD1D7PHJD type=write size=1126469 2024-09-22T08:21:11.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.782+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~85CTPYUD0NHU.0 size=1048576 2024-09-22T08:21:11.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.783+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~85CTPYUD0NHU.1 size=1048576 2024-09-22T08:21:11.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.784+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~85CTPYUD0NHU.2 size=837142 2024-09-22T08:21:11.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.784+0000 7fe6c9c31780 1 > prepared multipart upload key=T2W6RXP9UGHH upload=85CTPYUD0NHU tag=PG0GLGHKR12R type=write size=3982870 2024-09-22T08:21:11.787 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.785+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~AXX3I4IN4CKF.0 size=1048576 2024-09-22T08:21:11.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.787+0000 7fe6c9c31780 1 < completed part key=_multipart_7446WN19QFV0.2~AXX3I4IN4CKF.1 size=845900 2024-09-22T08:21:11.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.790+0000 7fe6c9c31780 1 < completed multipart upload key=7446WN19QFV0 upload=AXX3I4IN4CKF tag=4AFPGI8JB05I type=write size=2943052 2024-09-22T08:21:11.793 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.792+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~SZNWM44CSE7E.0 size=1048576 2024-09-22T08:21:11.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.793+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~SZNWM44CSE7E.1 size=72299 2024-09-22T08:21:11.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.793+0000 7fe6c9c31780 1 > prepared multipart upload key=2B5QRUMTVE7U upload=SZNWM44CSE7E tag=1RSEJXQHCDDU type=write size=2169451 2024-09-22T08:21:11.797 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.796+0000 7fe6c9c31780 1 < suggested remove operation key=2B5QRUMTVE7U tag=W8ZJD4ZA5I6S type=write 2024-09-22T08:21:11.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.797+0000 7fe6c9c31780 1 > prepared operation key=D85LJGGU3Z6F tag=TN2GFCCBKRR8 type=del size=1332360 2024-09-22T08:21:11.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.799+0000 7fe6c9c31780 1 < completed delete operation key=GEWQUFB9K35E tag=6E7GC6222ET1 type=del 2024-09-22T08:21:11.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.800+0000 7fe6c9c31780 1 > prepared operation key=4KRJ7DTE3KDV tag=JB7LYVZ3ZEH8 type=del size=2744825 2024-09-22T08:21:11.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.802+0000 7fe6c9c31780 1 < completed delete operation key=0PNK2ZW6IJM1 tag=X1NY8CF0J2OM type=del 2024-09-22T08:21:11.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.804+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~FP1BQS9XGJ3T.0 size=1048576 2024-09-22T08:21:11.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.806+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~FP1BQS9XGJ3T.1 size=409013 2024-09-22T08:21:11.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.806+0000 7fe6c9c31780 1 > prepared multipart upload key=DC7VLQWZ3TD1 upload=FP1BQS9XGJ3T tag=7P62HDXULAO3 type=write size=2506165 2024-09-22T08:21:11.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.807+0000 7fe6c9c31780 1 < completed delete operation key=ILW34WLX48WN tag=TCX78ON2AFIG type=del 2024-09-22T08:21:11.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.809+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=M3126L6HFDGL type=write size=209876 2024-09-22T08:21:11.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.811+0000 7fe6c9c31780 1 < completed delete operation key=OX1LY7URY7IV tag=2HW76A631F5K type=del 2024-09-22T08:21:11.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.813+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=EEZ787EYPV7K type=del size=1347215 2024-09-22T08:21:11.816 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.814+0000 7fe6c9c31780 -1 < failed to complete operation key=2B5QRUMTVE7U tag=GNA982PJZC4X type=del size=3044606: (22) Invalid argument 2024-09-22T08:21:11.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.816+0000 7fe6c9c31780 1 > prepared operation key=VP1MP4IC9A7T tag=P9ILGDJ3BEOZ type=del size=409128 2024-09-22T08:21:11.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.819+0000 7fe6c9c31780 1 < suggested remove operation key=KZIY400KQ5NH tag=D62Q1L5159X4 type=del 2024-09-22T08:21:11.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.822+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~GEUJWW74G362.0 size=1048576 2024-09-22T08:21:11.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.823+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~GEUJWW74G362.1 size=1048576 2024-09-22T08:21:11.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.824+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~GEUJWW74G362.2 size=79334 2024-09-22T08:21:11.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.824+0000 7fe6c9c31780 1 > prepared multipart upload key=GEWQUFB9K35E upload=GEUJWW74G362 tag=0KRB7S8NBOGE type=write size=3225062 2024-09-22T08:21:11.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.825+0000 7fe6c9c31780 1 < completed delete operation key=LA6ZRVULGQ0H tag=IZXYTO1LW6TB type=del 2024-09-22T08:21:11.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.827+0000 7fe6c9c31780 1 > prepared operation key=OX1LY7URY7IV tag=DFY43H5YI9OK type=write size=1029670 2024-09-22T08:21:11.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.828+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~I9B61WG2HFSG.0 size=639657 2024-09-22T08:21:11.832 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.831+0000 7fe6c9c31780 1 < completed multipart upload key=OX1LY7URY7IV upload=I9B61WG2HFSG tag=G75A8YEAK3MU type=write size=1688233 2024-09-22T08:21:11.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.833+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~QB208PHHPZYU.0 size=1048576 2024-09-22T08:21:11.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.835+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~QB208PHHPZYU.1 size=788109 2024-09-22T08:21:11.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.835+0000 7fe6c9c31780 1 > prepared multipart upload key=LA6ZRVULGQ0H upload=QB208PHHPZYU tag=1VA63SDSG16Z type=write size=2885261 2024-09-22T08:21:11.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.836+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~GQOYY4TJIHLF.0 size=1048576 2024-09-22T08:21:11.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.837+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~GQOYY4TJIHLF.1 size=1048576 2024-09-22T08:21:11.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.838+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~GQOYY4TJIHLF.2 size=920152 2024-09-22T08:21:11.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.841+0000 7fe6c9c31780 1 < completed multipart upload key=O1UBUQXP50CN upload=GQOYY4TJIHLF tag=QRR1SS59XYKB type=write size=4065880 2024-09-22T08:21:11.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.843+0000 7fe6c9c31780 1 > prepared operation key=GEWQUFB9K35E tag=487PM966O8O9 type=del size=2953896 2024-09-22T08:21:11.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.845+0000 7fe6c9c31780 1 < completed part key=_multipart_ZFL9N44PBQX4.2~K0CTW5QAL5D3.0 size=543668 2024-09-22T08:21:11.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.847+0000 7fe6c9c31780 1 < completed multipart upload key=ZFL9N44PBQX4 upload=K0CTW5QAL5D3 tag=PFJQW16YCQRL type=write size=1592244 2024-09-22T08:21:11.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.850+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~2E4DM355YYXK.0 size=1048576 2024-09-22T08:21:11.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.851+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~2E4DM355YYXK.1 size=195036 2024-09-22T08:21:11.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.851+0000 7fe6c9c31780 1 > prepared multipart upload key=D85LJGGU3Z6F upload=2E4DM355YYXK tag=ELUO17SI4GYJ type=write size=2292188 2024-09-22T08:21:11.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.851+0000 7fe6c9c31780 1 < canceled part key=_multipart_LA6ZRVULGQ0H.2~8NGMY0FKDA1R.0 size=1048576 2024-09-22T08:21:11.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.852+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~8NGMY0FKDA1R.1 size=220225 2024-09-22T08:21:11.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.855+0000 7fe6c9c31780 1 < canceled multipart upload key=LA6ZRVULGQ0H upload=8NGMY0FKDA1R tag=JRES9M26E30V type=write size=2317377 2024-09-22T08:21:11.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.856+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=TSCGRYNUA6QK type=write size=303917 2024-09-22T08:21:11.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.858+0000 7fe6c9c31780 1 < completed delete operation key=CTK01Y0CV1NC tag=OL53RTB2MPD1 type=del 2024-09-22T08:21:11.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.859+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=5B4A057KA8XQ type=del size=1182456 2024-09-22T08:21:11.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.860+0000 7fe6c9c31780 1 < completed delete operation key=9FCSIF1WKBDJ tag=3AVX8W3TMEZ0 type=del 2024-09-22T08:21:11.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.862+0000 7fe6c9c31780 1 > prepared operation key=4KRJ7DTE3KDV tag=528D11V2AF8E type=del size=1591336 2024-09-22T08:21:11.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.863+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~85CTPYUD0NHU.0 size=1048576 2024-09-22T08:21:11.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.863+0000 7fe6c9c31780 1 < canceled part key=_multipart_T2W6RXP9UGHH.2~85CTPYUD0NHU.1 size=1048576 2024-09-22T08:21:11.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.863+0000 7fe6c9c31780 1 < canceled part key=_multipart_T2W6RXP9UGHH.2~85CTPYUD0NHU.2 size=837142 2024-09-22T08:21:11.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.866+0000 7fe6c9c31780 1 < canceled multipart upload key=T2W6RXP9UGHH upload=85CTPYUD0NHU tag=PG0GLGHKR12R type=write size=3982870 2024-09-22T08:21:11.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.869+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~OR24AFQ0KZ89.0 size=1048576 2024-09-22T08:21:11.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.870+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~OR24AFQ0KZ89.1 size=1048576 2024-09-22T08:21:11.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.871+0000 7fe6c9c31780 1 > prepared part key=_multipart_VP1MP4IC9A7T.2~OR24AFQ0KZ89.2 size=660598 2024-09-22T08:21:11.873 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.871+0000 7fe6c9c31780 1 > prepared multipart upload key=VP1MP4IC9A7T upload=OR24AFQ0KZ89 tag=4B9DG3P40TWA type=write size=3806326 2024-09-22T08:21:11.874 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.872+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~SZNWM44CSE7E.0 size=1048576 2024-09-22T08:21:11.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.873+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~SZNWM44CSE7E.1 size=72299 2024-09-22T08:21:11.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.876+0000 7fe6c9c31780 1 < completed multipart upload key=2B5QRUMTVE7U upload=SZNWM44CSE7E tag=1RSEJXQHCDDU type=write size=2169451 2024-09-22T08:21:11.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.879+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~FVDUOW4JFIOU.0 size=1048576 2024-09-22T08:21:11.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.880+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~FVDUOW4JFIOU.1 size=1048576 2024-09-22T08:21:11.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.881+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~FVDUOW4JFIOU.2 size=329160 2024-09-22T08:21:11.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.881+0000 7fe6c9c31780 1 > prepared multipart upload key=T2W6RXP9UGHH upload=FVDUOW4JFIOU tag=CGA9G4YRS47A type=write size=3474888 2024-09-22T08:21:11.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.882+0000 7fe6c9c31780 1 < canceled operation key=D85LJGGU3Z6F tag=TN2GFCCBKRR8 type=del size=1332360 2024-09-22T08:21:11.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.885+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~8YGSL2RAD5VO.0 size=1048576 2024-09-22T08:21:11.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.887+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~8YGSL2RAD5VO.1 size=79206 2024-09-22T08:21:11.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.887+0000 7fe6c9c31780 1 > prepared multipart upload key=OX1LY7URY7IV upload=8YGSL2RAD5VO tag=MEQC44IKRMSC type=write size=2176358 2024-09-22T08:21:11.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.888+0000 7fe6c9c31780 1 < completed delete operation key=4KRJ7DTE3KDV tag=JB7LYVZ3ZEH8 type=del 2024-09-22T08:21:11.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.892+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~LIWYW6LVH8IU.0 size=1048576 2024-09-22T08:21:11.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.894+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~LIWYW6LVH8IU.1 size=1048576 2024-09-22T08:21:11.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.896+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~LIWYW6LVH8IU.2 size=942766 2024-09-22T08:21:11.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.896+0000 7fe6c9c31780 1 > prepared multipart upload key=9FCSIF1WKBDJ upload=LIWYW6LVH8IU tag=7M2SWOAPK2X5 type=write size=4088494 2024-09-22T08:21:11.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.897+0000 7fe6c9c31780 1 < canceled part key=_multipart_DC7VLQWZ3TD1.2~FP1BQS9XGJ3T.0 size=1048576 2024-09-22T08:21:11.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.898+0000 7fe6c9c31780 1 < completed part key=_multipart_DC7VLQWZ3TD1.2~FP1BQS9XGJ3T.1 size=409013 2024-09-22T08:21:11.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.900+0000 7fe6c9c31780 1 < canceled multipart upload key=DC7VLQWZ3TD1 upload=FP1BQS9XGJ3T tag=7P62HDXULAO3 type=write size=2506165 2024-09-22T08:21:11.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.903+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~R4ED399EGBGG.0 size=1048576 2024-09-22T08:21:11.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.904+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~R4ED399EGBGG.1 size=335348 2024-09-22T08:21:11.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.904+0000 7fe6c9c31780 1 > prepared multipart upload key=0PNK2ZW6IJM1 upload=R4ED399EGBGG tag=J9G2HX1SM6JJ type=write size=2432500 2024-09-22T08:21:11.908 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.907+0000 7fe6c9c31780 1 < suggested remove operation key=7446WN19QFV0 tag=M3126L6HFDGL type=write 2024-09-22T08:21:11.910 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.908+0000 7fe6c9c31780 1 > prepared operation key=946H8F2AUPO2 tag=9JECBXKWF2BA type=del size=3852557 2024-09-22T08:21:11.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.910+0000 7fe6c9c31780 1 < completed delete operation key=DC7VLQWZ3TD1 tag=EEZ787EYPV7K type=del 2024-09-22T08:21:11.914 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.913+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~AAW86N85UKAU.0 size=282393 2024-09-22T08:21:11.914 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.913+0000 7fe6c9c31780 1 > prepared multipart upload key=ILW34WLX48WN upload=AAW86N85UKAU tag=XWLBFUCJK82O type=write size=1330969 2024-09-22T08:21:11.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.914+0000 7fe6c9c31780 1 < completed delete operation key=VP1MP4IC9A7T tag=P9ILGDJ3BEOZ type=del 2024-09-22T08:21:11.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.918+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~KVPC1BYN6DE0.0 size=1048576 2024-09-22T08:21:11.920 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.918+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~KVPC1BYN6DE0.1 size=703598 2024-09-22T08:21:11.920 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.918+0000 7fe6c9c31780 1 > prepared multipart upload key=6BKB91YV3FMW upload=KVPC1BYN6DE0 tag=TWA30DYC13IM type=write size=2800750 2024-09-22T08:21:11.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.920+0000 7fe6c9c31780 1 < completed part key=_multipart_GEWQUFB9K35E.2~GEUJWW74G362.0 size=1048576 2024-09-22T08:21:11.923 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.922+0000 7fe6c9c31780 1 < completed part key=_multipart_GEWQUFB9K35E.2~GEUJWW74G362.1 size=1048576 2024-09-22T08:21:11.925 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.923+0000 7fe6c9c31780 1 < completed part key=_multipart_GEWQUFB9K35E.2~GEUJWW74G362.2 size=79334 2024-09-22T08:21:11.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.927+0000 7fe6c9c31780 1 < completed multipart upload key=GEWQUFB9K35E upload=GEUJWW74G362 tag=0KRB7S8NBOGE type=write size=3225062 2024-09-22T08:21:11.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.930+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~3JPRIKMC6ZDL.0 size=1048576 2024-09-22T08:21:11.932 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.931+0000 7fe6c9c31780 1 > prepared part key=_multipart_Z1CK5EDBK4AW.2~3JPRIKMC6ZDL.1 size=538610 2024-09-22T08:21:11.932 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.931+0000 7fe6c9c31780 1 > prepared multipart upload key=Z1CK5EDBK4AW upload=3JPRIKMC6ZDL tag=E6PYR5Z1CF2X type=write size=2635762 2024-09-22T08:21:11.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.934+0000 7fe6c9c31780 1 < suggested update operation key=OX1LY7URY7IV tag=DFY43H5YI9OK type=write size=1029670 2024-09-22T08:21:11.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.935+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=1H2X7JWVV4TH type=del size=1841787 2024-09-22T08:21:11.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.937+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~QB208PHHPZYU.0 size=1048576 2024-09-22T08:21:11.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.939+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~QB208PHHPZYU.1 size=788109 2024-09-22T08:21:11.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.941+0000 7fe6c9c31780 1 < completed multipart upload key=LA6ZRVULGQ0H upload=QB208PHHPZYU tag=1VA63SDSG16Z type=write size=2885261 2024-09-22T08:21:11.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.943+0000 7fe6c9c31780 1 > prepared operation key=KZIY400KQ5NH tag=0SYTYUWJD1E5 type=del size=600644 2024-09-22T08:21:11.948 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.946+0000 7fe6c9c31780 1 < suggested update operation key=GEWQUFB9K35E tag=487PM966O8O9 type=del size=2953896 2024-09-22T08:21:11.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.948+0000 7fe6c9c31780 1 > prepared operation key=CTK01Y0CV1NC tag=OCY5Z9ME7EU0 type=del size=1433613 2024-09-22T08:21:11.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.950+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~2E4DM355YYXK.0 size=1048576 2024-09-22T08:21:11.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.951+0000 7fe6c9c31780 1 < completed part key=_multipart_D85LJGGU3Z6F.2~2E4DM355YYXK.1 size=195036 2024-09-22T08:21:11.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.954+0000 7fe6c9c31780 1 < completed multipart upload key=D85LJGGU3Z6F upload=2E4DM355YYXK tag=ELUO17SI4GYJ type=write size=2292188 2024-09-22T08:21:11.957 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.955+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=8V3MV18PEJFJ type=del size=2298882 2024-09-22T08:21:11.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.958+0000 7fe6c9c31780 1 < completed write operation key=DC7VLQWZ3TD1 tag=TSCGRYNUA6QK type=write size=303917 2024-09-22T08:21:11.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.958+0000 7fe6c9c31780 1 > prepared operation key=O1UBUQXP50CN tag=SX6Y5AG7NWEI type=del size=3012875 2024-09-22T08:21:11.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.960+0000 7fe6c9c31780 1 < completed delete operation key=T2W6RXP9UGHH tag=5B4A057KA8XQ type=del 2024-09-22T08:21:11.963 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.961+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=TST7WJPDT770 type=del size=1283632 2024-09-22T08:21:11.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.964+0000 7fe6c9c31780 1 < completed delete operation key=4KRJ7DTE3KDV tag=528D11V2AF8E type=del 2024-09-22T08:21:11.967 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.966+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~T5XDVJMPNGXK.0 size=1048576 2024-09-22T08:21:11.968 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.967+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~T5XDVJMPNGXK.1 size=652805 2024-09-22T08:21:11.968 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.967+0000 7fe6c9c31780 1 > prepared multipart upload key=LA6ZRVULGQ0H upload=T5XDVJMPNGXK tag=8KFKPNDUN2XM type=write size=2749957 2024-09-22T08:21:11.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.969+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~OR24AFQ0KZ89.0 size=1048576 2024-09-22T08:21:11.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.969+0000 7fe6c9c31780 1 < canceled part key=_multipart_VP1MP4IC9A7T.2~OR24AFQ0KZ89.1 size=1048576 2024-09-22T08:21:11.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.970+0000 7fe6c9c31780 1 < completed part key=_multipart_VP1MP4IC9A7T.2~OR24AFQ0KZ89.2 size=660598 2024-09-22T08:21:11.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.972+0000 7fe6c9c31780 1 < canceled multipart upload key=VP1MP4IC9A7T upload=OR24AFQ0KZ89 tag=4B9DG3P40TWA type=write size=3806326 2024-09-22T08:21:11.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.974+0000 7fe6c9c31780 1 > prepared operation key=KZIY400KQ5NH tag=Z3T94FWAPD39 type=del size=4014773 2024-09-22T08:21:11.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.976+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~FVDUOW4JFIOU.0 size=1048576 2024-09-22T08:21:11.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.978+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~FVDUOW4JFIOU.1 size=1048576 2024-09-22T08:21:11.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.978+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~FVDUOW4JFIOU.2 size=329160 2024-09-22T08:21:11.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.982+0000 7fe6c9c31780 1 < completed multipart upload key=T2W6RXP9UGHH upload=FVDUOW4JFIOU tag=CGA9G4YRS47A type=write size=3474888 2024-09-22T08:21:11.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.984+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~6J3R60764P4H.0 size=1048576 2024-09-22T08:21:11.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.985+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~6J3R60764P4H.1 size=1048576 2024-09-22T08:21:11.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.986+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~6J3R60764P4H.2 size=604384 2024-09-22T08:21:11.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.986+0000 7fe6c9c31780 1 > prepared multipart upload key=TE10GB1F35X4 upload=6J3R60764P4H tag=74OZZ9311ML8 type=write size=3750112 2024-09-22T08:21:11.989 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.988+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~8YGSL2RAD5VO.0 size=1048576 2024-09-22T08:21:11.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.989+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~8YGSL2RAD5VO.1 size=79206 2024-09-22T08:21:11.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.991+0000 7fe6c9c31780 1 < completed multipart upload key=OX1LY7URY7IV upload=8YGSL2RAD5VO tag=MEQC44IKRMSC type=write size=2176358 2024-09-22T08:21:11.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.994+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=0QGZBUD6I30P type=write size=178959 2024-09-22T08:21:11.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.996+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~LIWYW6LVH8IU.0 size=1048576 2024-09-22T08:21:11.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.996+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~LIWYW6LVH8IU.1 size=1048576 2024-09-22T08:21:11.999 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:11.998+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~LIWYW6LVH8IU.2 size=942766 2024-09-22T08:21:12.002 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.000+0000 7fe6c9c31780 1 < completed multipart upload key=9FCSIF1WKBDJ upload=LIWYW6LVH8IU tag=7M2SWOAPK2X5 type=write size=4088494 2024-09-22T08:21:12.003 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.002+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=662HZ0ATFRGL type=write size=318466 2024-09-22T08:21:12.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.003+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~R4ED399EGBGG.0 size=1048576 2024-09-22T08:21:12.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.005+0000 7fe6c9c31780 1 < completed part key=_multipart_0PNK2ZW6IJM1.2~R4ED399EGBGG.1 size=335348 2024-09-22T08:21:12.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.007+0000 7fe6c9c31780 1 < completed multipart upload key=0PNK2ZW6IJM1 upload=R4ED399EGBGG tag=J9G2HX1SM6JJ type=write size=2432500 2024-09-22T08:21:12.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.010+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~S7F7RDSNTBVS.0 size=586052 2024-09-22T08:21:12.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.010+0000 7fe6c9c31780 1 > prepared multipart upload key=2B5QRUMTVE7U upload=S7F7RDSNTBVS tag=G5VFSO26TGOQ type=write size=1634628 2024-09-22T08:21:12.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.011+0000 7fe6c9c31780 1 < completed delete operation key=946H8F2AUPO2 tag=9JECBXKWF2BA type=del 2024-09-22T08:21:12.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.014+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=67RNW3NRMEBJ type=del size=649765 2024-09-22T08:21:12.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.015+0000 7fe6c9c31780 1 < completed part key=_multipart_ILW34WLX48WN.2~AAW86N85UKAU.0 size=282393 2024-09-22T08:21:12.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.019+0000 7fe6c9c31780 1 < completed multipart upload key=ILW34WLX48WN upload=AAW86N85UKAU tag=XWLBFUCJK82O type=write size=1330969 2024-09-22T08:21:12.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.020+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=GUMC9B7QA34P type=del size=3574493 2024-09-22T08:21:12.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.022+0000 7fe6c9c31780 1 < completed part key=_multipart_6BKB91YV3FMW.2~KVPC1BYN6DE0.0 size=1048576 2024-09-22T08:21:12.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.023+0000 7fe6c9c31780 1 < completed part key=_multipart_6BKB91YV3FMW.2~KVPC1BYN6DE0.1 size=703598 2024-09-22T08:21:12.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.027+0000 7fe6c9c31780 1 < completed multipart upload key=6BKB91YV3FMW upload=KVPC1BYN6DE0 tag=TWA30DYC13IM type=write size=2800750 2024-09-22T08:21:12.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.028+0000 7fe6c9c31780 1 > prepared operation key=TJTB67QBLZH5 tag=F7V50NQEJ027 type=del size=2357205 2024-09-22T08:21:12.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.030+0000 7fe6c9c31780 1 < completed part key=_multipart_Z1CK5EDBK4AW.2~3JPRIKMC6ZDL.0 size=1048576 2024-09-22T08:21:12.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.030+0000 7fe6c9c31780 1 < completed part key=_multipart_Z1CK5EDBK4AW.2~3JPRIKMC6ZDL.1 size=538610 2024-09-22T08:21:12.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.033+0000 7fe6c9c31780 1 < completed multipart upload key=Z1CK5EDBK4AW upload=3JPRIKMC6ZDL tag=E6PYR5Z1CF2X type=write size=2635762 2024-09-22T08:21:12.036 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.034+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=HWIJ1AP1MJ28 type=del size=1922272 2024-09-22T08:21:12.038 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.036+0000 7fe6c9c31780 1 < completed delete operation key=ILW34WLX48WN tag=1H2X7JWVV4TH type=del 2024-09-22T08:21:12.039 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.039+0000 7fe6c9c31780 1 > prepared operation key=TJTB67QBLZH5 tag=67WACGJXVID2 type=del size=3769772 2024-09-22T08:21:12.041 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.040+0000 7fe6c9c31780 1 < completed delete operation key=KZIY400KQ5NH tag=0SYTYUWJD1E5 type=del 2024-09-22T08:21:12.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.042+0000 7fe6c9c31780 1 > prepared operation key=XJP26CCPYDI7 tag=GN3Z1IXOKZUM type=del size=3359011 2024-09-22T08:21:12.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.045+0000 7fe6c9c31780 1 < completed delete operation key=CTK01Y0CV1NC tag=OCY5Z9ME7EU0 type=del 2024-09-22T08:21:12.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.048+0000 7fe6c9c31780 1 > prepared part key=_multipart_R7UWMW913DJQ.2~JWM487GLCQ03.0 size=1048576 2024-09-22T08:21:12.051 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.049+0000 7fe6c9c31780 1 > prepared part key=_multipart_R7UWMW913DJQ.2~JWM487GLCQ03.1 size=1048576 2024-09-22T08:21:12.052 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.050+0000 7fe6c9c31780 1 > prepared part key=_multipart_R7UWMW913DJQ.2~JWM487GLCQ03.2 size=965351 2024-09-22T08:21:12.052 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.050+0000 7fe6c9c31780 1 > prepared multipart upload key=R7UWMW913DJQ upload=JWM487GLCQ03 tag=A8CEI67ATNLD type=write size=4111079 2024-09-22T08:21:12.053 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.052+0000 7fe6c9c31780 1 < completed delete operation key=T2W6RXP9UGHH tag=8V3MV18PEJFJ type=del 2024-09-22T08:21:12.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.054+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~4P5SKTNSFOZS.0 size=1048576 2024-09-22T08:21:12.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.056+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~4P5SKTNSFOZS.1 size=777905 2024-09-22T08:21:12.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.056+0000 7fe6c9c31780 1 > prepared multipart upload key=O1UBUQXP50CN upload=4P5SKTNSFOZS tag=ANL5S2AWDTS1 type=write size=2875057 2024-09-22T08:21:12.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.059+0000 7fe6c9c31780 1 < suggested update operation key=O1UBUQXP50CN tag=SX6Y5AG7NWEI type=del size=3012875 2024-09-22T08:21:12.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.060+0000 7fe6c9c31780 1 > prepared operation key=XJP26CCPYDI7 tag=BOCRP16IDKD6 type=del size=4002794 2024-09-22T08:21:12.065 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.063+0000 7fe6c9c31780 1 < suggested remove operation key=TE10GB1F35X4 tag=TST7WJPDT770 type=del 2024-09-22T08:21:12.067 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.066+0000 7fe6c9c31780 1 > prepared operation key=W9L87PTJEIOA tag=RSS4Y41NJT2C type=del size=3541467 2024-09-22T08:21:12.068 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.067+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~T5XDVJMPNGXK.0 size=1048576 2024-09-22T08:21:12.068 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.067+0000 7fe6c9c31780 1 < canceled part key=_multipart_LA6ZRVULGQ0H.2~T5XDVJMPNGXK.1 size=652805 2024-09-22T08:21:12.071 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.070+0000 7fe6c9c31780 1 < canceled multipart upload key=LA6ZRVULGQ0H upload=T5XDVJMPNGXK tag=8KFKPNDUN2XM type=write size=2749957 2024-09-22T08:21:12.072 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.072+0000 7fe6c9c31780 1 > prepared operation key=O1UBUQXP50CN tag=1TJA3WEPYGMP type=del size=1105407 2024-09-22T08:21:12.074 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.073+0000 7fe6c9c31780 1 < completed delete operation key=KZIY400KQ5NH tag=Z3T94FWAPD39 type=del 2024-09-22T08:21:12.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.075+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~DJJH7D3MDQB9.0 size=1048576 2024-09-22T08:21:12.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.076+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~DJJH7D3MDQB9.1 size=1048576 2024-09-22T08:21:12.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.077+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~DJJH7D3MDQB9.2 size=905236 2024-09-22T08:21:12.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.077+0000 7fe6c9c31780 1 > prepared multipart upload key=9FCSIF1WKBDJ upload=DJJH7D3MDQB9 tag=BOXB5NQTYS9F type=write size=4050964 2024-09-22T08:21:12.081 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.079+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~6J3R60764P4H.0 size=1048576 2024-09-22T08:21:12.082 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.080+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~6J3R60764P4H.1 size=1048576 2024-09-22T08:21:12.083 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.081+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~6J3R60764P4H.2 size=604384 2024-09-22T08:21:12.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.084+0000 7fe6c9c31780 1 < completed multipart upload key=TE10GB1F35X4 upload=6J3R60764P4H tag=74OZZ9311ML8 type=write size=3750112 2024-09-22T08:21:12.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.085+0000 7fe6c9c31780 1 > prepared operation key=9AZWQ9E58QS6 tag=REU6AK0RE3PK type=del size=1828928 2024-09-22T08:21:12.088 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.087+0000 7fe6c9c31780 1 < completed write operation key=DC7VLQWZ3TD1 tag=0QGZBUD6I30P type=write size=178959 2024-09-22T08:21:12.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.089+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~QCWQPAXQL0SE.0 size=875447 2024-09-22T08:21:12.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.089+0000 7fe6c9c31780 1 > prepared multipart upload key=CTK01Y0CV1NC upload=QCWQPAXQL0SE tag=HBQBEYWBF5I4 type=write size=1924023 2024-09-22T08:21:12.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.091+0000 7fe6c9c31780 1 < completed write operation key=DC7VLQWZ3TD1 tag=662HZ0ATFRGL type=write size=318466 2024-09-22T08:21:12.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.093+0000 7fe6c9c31780 1 > prepared operation key=9FCSIF1WKBDJ tag=4QA5L7292KDC type=del size=1755354 2024-09-22T08:21:12.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.094+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~S7F7RDSNTBVS.0 size=586052 2024-09-22T08:21:12.098 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.097+0000 7fe6c9c31780 1 < completed multipart upload key=2B5QRUMTVE7U upload=S7F7RDSNTBVS tag=G5VFSO26TGOQ type=write size=1634628 2024-09-22T08:21:12.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.098+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=457B5NZCMA4X type=del size=2938703 2024-09-22T08:21:12.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.099+0000 7fe6c9c31780 1 < completed delete operation key=6BKB91YV3FMW tag=67RNW3NRMEBJ type=del 2024-09-22T08:21:12.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.102+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~Y0Z1C5EX3YMW.0 size=1048576 2024-09-22T08:21:12.105 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.103+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~Y0Z1C5EX3YMW.1 size=455692 2024-09-22T08:21:12.105 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.103+0000 7fe6c9c31780 1 > prepared multipart upload key=9FCSIF1WKBDJ upload=Y0Z1C5EX3YMW tag=7PFS0ZJTRUXG type=write size=2552844 2024-09-22T08:21:12.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.105+0000 7fe6c9c31780 1 < completed delete operation key=9AZWQ9E58QS6 tag=GUMC9B7QA34P type=del 2024-09-22T08:21:12.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.108+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~JTXYB9Y1NUM8.0 size=1048576 2024-09-22T08:21:12.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.109+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~JTXYB9Y1NUM8.1 size=1048576 2024-09-22T08:21:12.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.110+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~JTXYB9Y1NUM8.2 size=295197 2024-09-22T08:21:12.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.110+0000 7fe6c9c31780 1 > prepared multipart upload key=T2W6RXP9UGHH upload=JTXYB9Y1NUM8 tag=97TYIPGROLPF type=write size=3440925 2024-09-22T08:21:12.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.113+0000 7fe6c9c31780 1 < suggested remove operation key=TJTB67QBLZH5 tag=F7V50NQEJ027 type=del 2024-09-22T08:21:12.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.116+0000 7fe6c9c31780 1 > prepared part key=_multipart_2B5QRUMTVE7U.2~FLED8L8WREUH.0 size=679973 2024-09-22T08:21:12.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.116+0000 7fe6c9c31780 1 > prepared multipart upload key=2B5QRUMTVE7U upload=FLED8L8WREUH tag=9SR0S77W7J3N type=write size=1728549 2024-09-22T08:21:12.118 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.116+0000 7fe6c9c31780 1 < completed delete operation key=DC7VLQWZ3TD1 tag=HWIJ1AP1MJ28 type=del 2024-09-22T08:21:12.121 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.120+0000 7fe6c9c31780 1 > prepared operation key=ZFL9N44PBQX4 tag=U2KSXVQSN5I2 type=write size=184333 2024-09-22T08:21:12.121 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.120+0000 7fe6c9c31780 -1 < no bi entry to suggest for operation key=TJTB67QBLZH5 tag=67WACGJXVID2 type=del size=3769772: (2) No such file or directory 2024-09-22T08:21:12.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.121+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=AO87SLYWV609 type=write size=726148 2024-09-22T08:21:12.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.123+0000 7fe6c9c31780 1 < canceled operation key=XJP26CCPYDI7 tag=GN3Z1IXOKZUM type=del size=3359011 2024-09-22T08:21:12.126 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.125+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=5NJXI2LUNL3X type=del size=2913823 2024-09-22T08:21:12.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.127+0000 7fe6c9c31780 1 < completed part key=_multipart_R7UWMW913DJQ.2~JWM487GLCQ03.0 size=1048576 2024-09-22T08:21:12.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.129+0000 7fe6c9c31780 1 < completed part key=_multipart_R7UWMW913DJQ.2~JWM487GLCQ03.1 size=1048576 2024-09-22T08:21:12.131 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.130+0000 7fe6c9c31780 1 < completed part key=_multipart_R7UWMW913DJQ.2~JWM487GLCQ03.2 size=965351 2024-09-22T08:21:12.134 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.133+0000 7fe6c9c31780 1 < completed multipart upload key=R7UWMW913DJQ upload=JWM487GLCQ03 tag=A8CEI67ATNLD type=write size=4111079 2024-09-22T08:21:12.135 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.133+0000 7fe6c9c31780 1 > prepared operation key=7446WN19QFV0 tag=0GYCX7O77JS9 type=del size=699335 2024-09-22T08:21:12.137 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.136+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~4P5SKTNSFOZS.0 size=1048576 2024-09-22T08:21:12.138 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.136+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~4P5SKTNSFOZS.1 size=777905 2024-09-22T08:21:12.141 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.139+0000 7fe6c9c31780 1 < completed multipart upload key=O1UBUQXP50CN upload=4P5SKTNSFOZS tag=ANL5S2AWDTS1 type=write size=2875057 2024-09-22T08:21:12.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.143+0000 7fe6c9c31780 1 > prepared part key=_multipart_O1UBUQXP50CN.2~ANAJIDO22XHO.0 size=80240 2024-09-22T08:21:12.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.143+0000 7fe6c9c31780 1 > prepared multipart upload key=O1UBUQXP50CN upload=ANAJIDO22XHO tag=MUX5CGUA21HA type=write size=1128816 2024-09-22T08:21:12.145 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.144+0000 7fe6c9c31780 1 < completed delete operation key=XJP26CCPYDI7 tag=BOCRP16IDKD6 type=del 2024-09-22T08:21:12.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.145+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=9D3796F4DG8J type=del size=852064 2024-09-22T08:21:12.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.146+0000 7fe6c9c31780 1 < completed delete operation key=W9L87PTJEIOA tag=RSS4Y41NJT2C type=del 2024-09-22T08:21:12.149 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.148+0000 7fe6c9c31780 1 > prepared operation key=JT5AB8VLMEFD tag=L8E2M9754WRA type=del size=143998 2024-09-22T08:21:12.151 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.149+0000 7fe6c9c31780 1 < completed delete operation key=O1UBUQXP50CN tag=1TJA3WEPYGMP type=del 2024-09-22T08:21:12.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.151+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=H7BPL5810V4K type=del size=195878 2024-09-22T08:21:12.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.152+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~DJJH7D3MDQB9.0 size=1048576 2024-09-22T08:21:12.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.154+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~DJJH7D3MDQB9.1 size=1048576 2024-09-22T08:21:12.156 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.154+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~DJJH7D3MDQB9.2 size=905236 2024-09-22T08:21:12.158 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.157+0000 7fe6c9c31780 1 < completed multipart upload key=9FCSIF1WKBDJ upload=DJJH7D3MDQB9 tag=BOXB5NQTYS9F type=write size=4050964 2024-09-22T08:21:12.160 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.158+0000 7fe6c9c31780 1 > prepared operation key=JT5AB8VLMEFD tag=DZ1S7FVJT73S type=del size=3255817 2024-09-22T08:21:12.161 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.160+0000 7fe6c9c31780 1 < completed delete operation key=9AZWQ9E58QS6 tag=REU6AK0RE3PK type=del 2024-09-22T08:21:12.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.163+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~AXSDUSMDPFVU.0 size=1048576 2024-09-22T08:21:12.165 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.163+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~AXSDUSMDPFVU.1 size=1048576 2024-09-22T08:21:12.166 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.165+0000 7fe6c9c31780 1 > prepared part key=_multipart_TYVQ39KUV2V9.2~AXSDUSMDPFVU.2 size=971713 2024-09-22T08:21:12.166 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.165+0000 7fe6c9c31780 1 > prepared multipart upload key=TYVQ39KUV2V9 upload=AXSDUSMDPFVU tag=Q3J65O0DVZ1C type=write size=4117441 2024-09-22T08:21:12.168 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.166+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~QCWQPAXQL0SE.0 size=875447 2024-09-22T08:21:12.170 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.169+0000 7fe6c9c31780 1 < completed multipart upload key=CTK01Y0CV1NC upload=QCWQPAXQL0SE tag=HBQBEYWBF5I4 type=write size=1924023 2024-09-22T08:21:12.172 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.171+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~OD82GHBHZB1F.0 size=1048576 2024-09-22T08:21:12.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.172+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~OD82GHBHZB1F.1 size=1048576 2024-09-22T08:21:12.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.173+0000 7fe6c9c31780 1 > prepared part key=_multipart_KZIY400KQ5NH.2~OD82GHBHZB1F.2 size=775835 2024-09-22T08:21:12.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.173+0000 7fe6c9c31780 1 > prepared multipart upload key=KZIY400KQ5NH upload=OD82GHBHZB1F tag=76OOM7UKDTRM type=write size=3921563 2024-09-22T08:21:12.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.174+0000 7fe6c9c31780 1 < completed delete operation key=9FCSIF1WKBDJ tag=4QA5L7292KDC type=del 2024-09-22T08:21:12.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.176+0000 7fe6c9c31780 1 > prepared operation key=4KRJ7DTE3KDV tag=0B1U5DLV3615 type=del size=655373 2024-09-22T08:21:12.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.177+0000 7fe6c9c31780 1 < canceled operation key=R7UWMW913DJQ tag=457B5NZCMA4X type=del size=2938703 2024-09-22T08:21:12.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.181+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~W3HAQJSADRSY.0 size=1048576 2024-09-22T08:21:12.183 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.181+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~W3HAQJSADRSY.1 size=1048576 2024-09-22T08:21:12.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.182+0000 7fe6c9c31780 1 > prepared part key=_multipart_9FCSIF1WKBDJ.2~W3HAQJSADRSY.2 size=167454 2024-09-22T08:21:12.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.182+0000 7fe6c9c31780 1 > prepared multipart upload key=9FCSIF1WKBDJ upload=W3HAQJSADRSY tag=RQYITVH74VMN type=write size=3313182 2024-09-22T08:21:12.187 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.186+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~Y0Z1C5EX3YMW.0 size=1048576 2024-09-22T08:21:12.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.187+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~Y0Z1C5EX3YMW.1 size=455692 2024-09-22T08:21:12.190 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.188+0000 7fe6c9c31780 1 < completed multipart upload key=9FCSIF1WKBDJ upload=Y0Z1C5EX3YMW tag=7PFS0ZJTRUXG type=write size=2552844 2024-09-22T08:21:12.192 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.191+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~F0R7MNZSX61P.0 size=1048576 2024-09-22T08:21:12.194 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.193+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~F0R7MNZSX61P.1 size=1048576 2024-09-22T08:21:12.195 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.194+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~F0R7MNZSX61P.2 size=239821 2024-09-22T08:21:12.195 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.194+0000 7fe6c9c31780 1 > prepared multipart upload key=0TWY0NNZZ7NN upload=F0R7MNZSX61P tag=F0HAP0DO6MZS type=write size=3385549 2024-09-22T08:21:12.196 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.195+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~JTXYB9Y1NUM8.0 size=1048576 2024-09-22T08:21:12.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.196+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~JTXYB9Y1NUM8.1 size=1048576 2024-09-22T08:21:12.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.197+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~JTXYB9Y1NUM8.2 size=295197 2024-09-22T08:21:12.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.200+0000 7fe6c9c31780 1 < completed multipart upload key=T2W6RXP9UGHH upload=JTXYB9Y1NUM8 tag=97TYIPGROLPF type=write size=3440925 2024-09-22T08:21:12.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.202+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~SMAJWAVVV23E.0 size=807750 2024-09-22T08:21:12.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.202+0000 7fe6c9c31780 1 > prepared multipart upload key=LA6ZRVULGQ0H upload=SMAJWAVVV23E tag=ZICQEQWXHETH type=write size=1856326 2024-09-22T08:21:12.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.205+0000 7fe6c9c31780 1 < completed part key=_multipart_2B5QRUMTVE7U.2~FLED8L8WREUH.0 size=679973 2024-09-22T08:21:12.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.206+0000 7fe6c9c31780 1 < completed multipart upload key=2B5QRUMTVE7U upload=FLED8L8WREUH tag=9SR0S77W7J3N type=write size=1728549 2024-09-22T08:21:12.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.208+0000 7fe6c9c31780 1 > prepared operation key=LA6ZRVULGQ0H tag=M15STS5JH8OJ type=del size=2073652 2024-09-22T08:21:12.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.211+0000 7fe6c9c31780 1 < suggested update operation key=ZFL9N44PBQX4 tag=U2KSXVQSN5I2 type=write size=184333 2024-09-22T08:21:12.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.213+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~3KR47B9GV71D.0 size=1048576 2024-09-22T08:21:12.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.214+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~3KR47B9GV71D.1 size=1048576 2024-09-22T08:21:12.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.216+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~3KR47B9GV71D.2 size=660303 2024-09-22T08:21:12.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.216+0000 7fe6c9c31780 1 > prepared multipart upload key=6BKB91YV3FMW upload=3KR47B9GV71D tag=T8C4FA8XA2TF type=write size=3806031 2024-09-22T08:21:12.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.217+0000 7fe6c9c31780 1 < completed write operation key=76HZ3LZGVT9J tag=AO87SLYWV609 type=write size=726148 2024-09-22T08:21:12.221 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.220+0000 7fe6c9c31780 1 > prepared part key=_multipart_OX1LY7URY7IV.2~0VFW0NQ03CH9.0 size=258048 2024-09-22T08:21:12.221 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.220+0000 7fe6c9c31780 1 > prepared multipart upload key=OX1LY7URY7IV upload=0VFW0NQ03CH9 tag=RWCOPMPNA8YQ type=write size=1306624 2024-09-22T08:21:12.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.221+0000 7fe6c9c31780 1 < completed delete operation key=0TWY0NNZZ7NN tag=5NJXI2LUNL3X type=del 2024-09-22T08:21:12.224 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.223+0000 7fe6c9c31780 1 > prepared operation key=KZIY400KQ5NH tag=I206N65BYAN1 type=del size=3294298 2024-09-22T08:21:12.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.224+0000 7fe6c9c31780 1 < completed delete operation key=7446WN19QFV0 tag=0GYCX7O77JS9 type=del 2024-09-22T08:21:12.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.228+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~4GGFQ14TG1ES.0 size=1048576 2024-09-22T08:21:12.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.228+0000 7fe6c9c31780 1 > prepared part key=_multipart_TE10GB1F35X4.2~4GGFQ14TG1ES.1 size=337480 2024-09-22T08:21:12.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.228+0000 7fe6c9c31780 1 > prepared multipart upload key=TE10GB1F35X4 upload=4GGFQ14TG1ES tag=HAXL14ZZDZ2H type=write size=2434632 2024-09-22T08:21:12.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.230+0000 7fe6c9c31780 1 < completed part key=_multipart_O1UBUQXP50CN.2~ANAJIDO22XHO.0 size=80240 2024-09-22T08:21:12.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.233+0000 7fe6c9c31780 1 < completed multipart upload key=O1UBUQXP50CN upload=ANAJIDO22XHO tag=MUX5CGUA21HA type=write size=1128816 2024-09-22T08:21:12.235 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.233+0000 7fe6c9c31780 1 > prepared operation key=ZFL9N44PBQX4 tag=OILCNZILG1G4 type=del size=1492893 2024-09-22T08:21:12.236 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.235+0000 7fe6c9c31780 1 < completed delete operation key=TE10GB1F35X4 tag=9D3796F4DG8J type=del 2024-09-22T08:21:12.239 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.238+0000 7fe6c9c31780 1 > prepared part key=_multipart_R7UWMW913DJQ.2~GP7D7RSUP21L.0 size=1048576 2024-09-22T08:21:12.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.239+0000 7fe6c9c31780 1 > prepared part key=_multipart_R7UWMW913DJQ.2~GP7D7RSUP21L.1 size=1048576 2024-09-22T08:21:12.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.241+0000 7fe6c9c31780 1 > prepared part key=_multipart_R7UWMW913DJQ.2~GP7D7RSUP21L.2 size=862451 2024-09-22T08:21:12.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.241+0000 7fe6c9c31780 1 > prepared multipart upload key=R7UWMW913DJQ upload=GP7D7RSUP21L tag=UBCADP0CTO8N type=write size=4008179 2024-09-22T08:21:12.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.242+0000 7fe6c9c31780 1 < completed delete operation key=JT5AB8VLMEFD tag=L8E2M9754WRA type=del 2024-09-22T08:21:12.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.243+0000 7fe6c9c31780 1 > prepared operation key=LA6ZRVULGQ0H tag=XZJ6MQ9D2X2C type=del size=3909141 2024-09-22T08:21:12.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.245+0000 7fe6c9c31780 1 < completed delete operation key=DC7VLQWZ3TD1 tag=H7BPL5810V4K type=del 2024-09-22T08:21:12.248 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.246+0000 7fe6c9c31780 1 > prepared operation key=W9L87PTJEIOA tag=666185F3XUC1 type=del size=3505958 2024-09-22T08:21:12.251 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.249+0000 7fe6c9c31780 1 < suggested remove operation key=JT5AB8VLMEFD tag=DZ1S7FVJT73S type=del 2024-09-22T08:21:12.252 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.251+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=71UTYIVFJ6RS type=del size=1391674 2024-09-22T08:21:12.254 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.253+0000 7fe6c9c31780 1 < completed part key=_multipart_TYVQ39KUV2V9.2~AXSDUSMDPFVU.0 size=1048576 2024-09-22T08:21:12.255 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.254+0000 7fe6c9c31780 1 < completed part key=_multipart_TYVQ39KUV2V9.2~AXSDUSMDPFVU.1 size=1048576 2024-09-22T08:21:12.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.255+0000 7fe6c9c31780 1 < completed part key=_multipart_TYVQ39KUV2V9.2~AXSDUSMDPFVU.2 size=971713 2024-09-22T08:21:12.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.257+0000 7fe6c9c31780 1 < completed multipart upload key=TYVQ39KUV2V9 upload=AXSDUSMDPFVU tag=Q3J65O0DVZ1C type=write size=4117441 2024-09-22T08:21:12.262 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.260+0000 7fe6c9c31780 1 > prepared part key=_multipart_R7UWMW913DJQ.2~SD0GE7I63D3W.0 size=760323 2024-09-22T08:21:12.262 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.260+0000 7fe6c9c31780 1 > prepared multipart upload key=R7UWMW913DJQ upload=SD0GE7I63D3W tag=PQZZIO6UV51P type=write size=1808899 2024-09-22T08:21:12.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.262+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~OD82GHBHZB1F.0 size=1048576 2024-09-22T08:21:12.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.262+0000 7fe6c9c31780 1 < canceled part key=_multipart_KZIY400KQ5NH.2~OD82GHBHZB1F.1 size=1048576 2024-09-22T08:21:12.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.263+0000 7fe6c9c31780 1 < completed part key=_multipart_KZIY400KQ5NH.2~OD82GHBHZB1F.2 size=775835 2024-09-22T08:21:12.267 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.265+0000 7fe6c9c31780 1 < canceled multipart upload key=KZIY400KQ5NH upload=OD82GHBHZB1F tag=76OOM7UKDTRM type=write size=3921563 2024-09-22T08:21:12.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.268+0000 7fe6c9c31780 1 > prepared part key=_multipart_FY40JTHLT0KU.2~3AR5629JLIUD.0 size=508905 2024-09-22T08:21:12.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.268+0000 7fe6c9c31780 1 > prepared multipart upload key=FY40JTHLT0KU upload=3AR5629JLIUD tag=NUZA4IUHMIRI type=write size=1557481 2024-09-22T08:21:12.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.269+0000 7fe6c9c31780 1 < completed delete operation key=4KRJ7DTE3KDV tag=0B1U5DLV3615 type=del 2024-09-22T08:21:12.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.271+0000 7fe6c9c31780 1 > prepared operation key=0TWY0NNZZ7NN tag=QA57WBY19VC2 type=del size=662858 2024-09-22T08:21:12.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.273+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~W3HAQJSADRSY.0 size=1048576 2024-09-22T08:21:12.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.274+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~W3HAQJSADRSY.1 size=1048576 2024-09-22T08:21:12.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.275+0000 7fe6c9c31780 1 < completed part key=_multipart_9FCSIF1WKBDJ.2~W3HAQJSADRSY.2 size=167454 2024-09-22T08:21:12.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.277+0000 7fe6c9c31780 1 < completed multipart upload key=9FCSIF1WKBDJ upload=W3HAQJSADRSY tag=RQYITVH74VMN type=write size=3313182 2024-09-22T08:21:12.280 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.279+0000 7fe6c9c31780 1 > prepared operation key=O1UBUQXP50CN tag=ECB6ZAQUFUS1 type=del size=1269029 2024-09-22T08:21:12.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.280+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~F0R7MNZSX61P.0 size=1048576 2024-09-22T08:21:12.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.282+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~F0R7MNZSX61P.1 size=1048576 2024-09-22T08:21:12.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.283+0000 7fe6c9c31780 1 < completed part key=_multipart_0TWY0NNZZ7NN.2~F0R7MNZSX61P.2 size=239821 2024-09-22T08:21:12.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.285+0000 7fe6c9c31780 1 < completed multipart upload key=0TWY0NNZZ7NN upload=F0R7MNZSX61P tag=F0HAP0DO6MZS type=write size=3385549 2024-09-22T08:21:12.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.286+0000 7fe6c9c31780 1 > prepared operation key=DC7VLQWZ3TD1 tag=7EI0UECHO0J2 type=del size=564348 2024-09-22T08:21:12.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.288+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~SMAJWAVVV23E.0 size=807750 2024-09-22T08:21:12.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.290+0000 7fe6c9c31780 1 < completed multipart upload key=LA6ZRVULGQ0H upload=SMAJWAVVV23E tag=ZICQEQWXHETH type=write size=1856326 2024-09-22T08:21:12.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.291+0000 7fe6c9c31780 1 > prepared operation key=OX1LY7URY7IV tag=C3023RX71LA8 type=del size=2481908 2024-09-22T08:21:12.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.293+0000 7fe6c9c31780 1 < completed delete operation key=LA6ZRVULGQ0H tag=M15STS5JH8OJ type=del 2024-09-22T08:21:12.297 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.296+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~A8CMSZVUK3MY.0 size=1048576 2024-09-22T08:21:12.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.297+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~A8CMSZVUK3MY.1 size=217180 2024-09-22T08:21:12.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.297+0000 7fe6c9c31780 1 > prepared multipart upload key=LA6ZRVULGQ0H upload=A8CMSZVUK3MY tag=5KPXT5E7AMFP type=write size=2314332 2024-09-22T08:21:12.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.298+0000 7fe6c9c31780 1 < completed part key=_multipart_6BKB91YV3FMW.2~3KR47B9GV71D.0 size=1048576 2024-09-22T08:21:12.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.299+0000 7fe6c9c31780 1 < completed part key=_multipart_6BKB91YV3FMW.2~3KR47B9GV71D.1 size=1048576 2024-09-22T08:21:12.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.300+0000 7fe6c9c31780 1 < completed part key=_multipart_6BKB91YV3FMW.2~3KR47B9GV71D.2 size=660303 2024-09-22T08:21:12.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.302+0000 7fe6c9c31780 1 < completed multipart upload key=6BKB91YV3FMW upload=3KR47B9GV71D tag=T8C4FA8XA2TF type=write size=3806031 2024-09-22T08:21:12.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.305+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~U2LG1W9N99TV.0 size=1048576 2024-09-22T08:21:12.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.306+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~U2LG1W9N99TV.1 size=1048576 2024-09-22T08:21:12.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.307+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~U2LG1W9N99TV.2 size=125234 2024-09-22T08:21:12.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.307+0000 7fe6c9c31780 1 > prepared multipart upload key=CTK01Y0CV1NC upload=U2LG1W9N99TV tag=08XD9L9SPCME type=write size=3270962 2024-09-22T08:21:12.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.308+0000 7fe6c9c31780 1 < completed part key=_multipart_OX1LY7URY7IV.2~0VFW0NQ03CH9.0 size=258048 2024-09-22T08:21:12.312 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.312+0000 7fe6c9c31780 1 < completed multipart upload key=OX1LY7URY7IV upload=0VFW0NQ03CH9 tag=RWCOPMPNA8YQ type=write size=1306624 2024-09-22T08:21:12.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.313+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=6AEW6AB0DPEL type=del size=816628 2024-09-22T08:21:12.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.314+0000 7fe6c9c31780 1 < completed delete operation key=KZIY400KQ5NH tag=I206N65BYAN1 type=del 2024-09-22T08:21:12.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.315+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=7J1W37T7N9B4 type=del size=3581488 2024-09-22T08:21:12.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.319+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~4GGFQ14TG1ES.0 size=1048576 2024-09-22T08:21:12.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.320+0000 7fe6c9c31780 1 < completed part key=_multipart_TE10GB1F35X4.2~4GGFQ14TG1ES.1 size=337480 2024-09-22T08:21:12.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.323+0000 7fe6c9c31780 1 < completed multipart upload key=TE10GB1F35X4 upload=4GGFQ14TG1ES tag=HAXL14ZZDZ2H type=write size=2434632 2024-09-22T08:21:12.326 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.324+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~P526BFG2Z8DI.0 size=1048576 2024-09-22T08:21:12.327 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.326+0000 7fe6c9c31780 1 > prepared part key=_multipart_76HZ3LZGVT9J.2~P526BFG2Z8DI.1 size=631688 2024-09-22T08:21:12.327 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.326+0000 7fe6c9c31780 1 > prepared multipart upload key=76HZ3LZGVT9J upload=P526BFG2Z8DI tag=TJCO6ZDDP2SY type=write size=2728840 2024-09-22T08:21:12.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.327+0000 7fe6c9c31780 1 < completed delete operation key=ZFL9N44PBQX4 tag=OILCNZILG1G4 type=del 2024-09-22T08:21:12.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.329+0000 7fe6c9c31780 1 > prepared operation key=0PNK2ZW6IJM1 tag=OD722QDHT8VS type=del size=4142256 2024-09-22T08:21:12.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.329+0000 7fe6c9c31780 1 < canceled part key=_multipart_R7UWMW913DJQ.2~GP7D7RSUP21L.0 size=1048576 2024-09-22T08:21:12.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.329+0000 7fe6c9c31780 1 < canceled part key=_multipart_R7UWMW913DJQ.2~GP7D7RSUP21L.1 size=1048576 2024-09-22T08:21:12.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.330+0000 7fe6c9c31780 1 < completed part key=_multipart_R7UWMW913DJQ.2~GP7D7RSUP21L.2 size=862451 2024-09-22T08:21:12.334 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.333+0000 7fe6c9c31780 1 < canceled multipart upload key=R7UWMW913DJQ upload=GP7D7RSUP21L tag=UBCADP0CTO8N type=write size=4008179 2024-09-22T08:21:12.336 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.334+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=C42DU09Z1CVL type=write size=525298 2024-09-22T08:21:12.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.336+0000 7fe6c9c31780 1 < completed delete operation key=LA6ZRVULGQ0H tag=XZJ6MQ9D2X2C type=del 2024-09-22T08:21:12.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.339+0000 7fe6c9c31780 1 > prepared operation key=O1UBUQXP50CN tag=01F4AGVZCLXY type=del size=1257 2024-09-22T08:21:12.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.339+0000 7fe6c9c31780 1 < canceled operation key=W9L87PTJEIOA tag=666185F3XUC1 type=del size=3505958 2024-09-22T08:21:12.342 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.341+0000 7fe6c9c31780 1 > prepared operation key=XJP26CCPYDI7 tag=FO4E3KVGBN2A type=write size=452130 2024-09-22T08:21:12.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.344+0000 7fe6c9c31780 1 < suggested update operation key=6BKB91YV3FMW tag=71UTYIVFJ6RS type=del size=1391674 2024-09-22T08:21:12.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.347+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~GRTMDO0WGL28.0 size=1048576 2024-09-22T08:21:12.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.348+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~GRTMDO0WGL28.1 size=1048576 2024-09-22T08:21:12.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.349+0000 7fe6c9c31780 1 > prepared part key=_multipart_946H8F2AUPO2.2~GRTMDO0WGL28.2 size=709770 2024-09-22T08:21:12.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.349+0000 7fe6c9c31780 1 > prepared multipart upload key=946H8F2AUPO2 upload=GRTMDO0WGL28 tag=M85Q0XNQAUK6 type=write size=3855498 2024-09-22T08:21:12.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.350+0000 7fe6c9c31780 1 < completed part key=_multipart_R7UWMW913DJQ.2~SD0GE7I63D3W.0 size=760323 2024-09-22T08:21:12.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.354+0000 7fe6c9c31780 1 < completed multipart upload key=R7UWMW913DJQ upload=SD0GE7I63D3W tag=PQZZIO6UV51P type=write size=1808899 2024-09-22T08:21:12.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.354+0000 7fe6c9c31780 1 > prepared operation key=6BKB91YV3FMW tag=QA9OFOEI0OFL type=del size=3406248 2024-09-22T08:21:12.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.356+0000 7fe6c9c31780 1 < completed part key=_multipart_FY40JTHLT0KU.2~3AR5629JLIUD.0 size=508905 2024-09-22T08:21:12.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.358+0000 7fe6c9c31780 1 < completed multipart upload key=FY40JTHLT0KU upload=3AR5629JLIUD tag=NUZA4IUHMIRI type=write size=1557481 2024-09-22T08:21:12.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.360+0000 7fe6c9c31780 1 > prepared operation key=76HZ3LZGVT9J tag=ZX5NYW54LV6Y type=del size=846726 2024-09-22T08:21:12.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.363+0000 7fe6c9c31780 1 < suggested remove operation key=0TWY0NNZZ7NN tag=QA57WBY19VC2 type=del 2024-09-22T08:21:12.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.365+0000 7fe6c9c31780 1 > prepared part key=_multipart_ILW34WLX48WN.2~780W7VPOAKT6.0 size=509457 2024-09-22T08:21:12.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.365+0000 7fe6c9c31780 1 > prepared multipart upload key=ILW34WLX48WN upload=780W7VPOAKT6 tag=J11B8E7WB6GY type=write size=1558033 2024-09-22T08:21:12.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.367+0000 7fe6c9c31780 1 < completed delete operation key=O1UBUQXP50CN tag=ECB6ZAQUFUS1 type=del 2024-09-22T08:21:12.370 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.368+0000 7fe6c9c31780 1 > prepared operation key=FY40JTHLT0KU tag=97MLRLCW06UX type=del size=3086713 2024-09-22T08:21:12.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.370+0000 7fe6c9c31780 1 < completed delete operation key=DC7VLQWZ3TD1 tag=7EI0UECHO0J2 type=del 2024-09-22T08:21:12.373 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.371+0000 7fe6c9c31780 1 > prepared operation key=D85LJGGU3Z6F tag=7DVDYXQQ170F type=del size=146060 2024-09-22T08:21:12.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.375+0000 7fe6c9c31780 1 < suggested update operation key=OX1LY7URY7IV tag=C3023RX71LA8 type=del size=2481908 2024-09-22T08:21:12.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.378+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~CYKGPFR3ZC9P.0 size=1048576 2024-09-22T08:21:12.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.379+0000 7fe6c9c31780 1 > prepared part key=_multipart_T2W6RXP9UGHH.2~CYKGPFR3ZC9P.1 size=679332 2024-09-22T08:21:12.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.379+0000 7fe6c9c31780 1 > prepared multipart upload key=T2W6RXP9UGHH upload=CYKGPFR3ZC9P tag=CTT25ZCPE3M2 type=write size=2776484 2024-09-22T08:21:12.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.381+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~A8CMSZVUK3MY.0 size=1048576 2024-09-22T08:21:12.384 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.382+0000 7fe6c9c31780 1 < completed part key=_multipart_LA6ZRVULGQ0H.2~A8CMSZVUK3MY.1 size=217180 2024-09-22T08:21:12.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.385+0000 7fe6c9c31780 1 < completed multipart upload key=LA6ZRVULGQ0H upload=A8CMSZVUK3MY tag=5KPXT5E7AMFP type=write size=2314332 2024-09-22T08:21:12.388 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.386+0000 7fe6c9c31780 1 > prepared operation key=T2W6RXP9UGHH tag=GU3TIST56AYZ type=del size=1873906 2024-09-22T08:21:12.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.387+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~U2LG1W9N99TV.0 size=1048576 2024-09-22T08:21:12.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.389+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~U2LG1W9N99TV.1 size=1048576 2024-09-22T08:21:12.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.390+0000 7fe6c9c31780 1 < completed part key=_multipart_CTK01Y0CV1NC.2~U2LG1W9N99TV.2 size=125234 2024-09-22T08:21:12.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.392+0000 7fe6c9c31780 1 < completed multipart upload key=CTK01Y0CV1NC upload=U2LG1W9N99TV tag=08XD9L9SPCME type=write size=3270962 2024-09-22T08:21:12.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.394+0000 7fe6c9c31780 1 > prepared operation key=FY40JTHLT0KU tag=H61FQ2XG8CFN type=del size=1174022 2024-09-22T08:21:12.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.397+0000 7fe6c9c31780 1 < suggested remove operation key=TE10GB1F35X4 tag=6AEW6AB0DPEL type=del 2024-09-22T08:21:12.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.398+0000 7fe6c9c31780 1 > prepared operation key=R7UWMW913DJQ tag=G5EVZV55XSTR type=del size=2791094 2024-09-22T08:21:12.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.400+0000 7fe6c9c31780 -1 < failed to complete operation key=TE10GB1F35X4 tag=7J1W37T7N9B4 type=del size=3581488: (22) Invalid argument 2024-09-22T08:21:12.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.401+0000 7fe6c9c31780 1 > prepared operation key=TYVQ39KUV2V9 tag=HBR33782MP25 type=del size=2077230 2024-09-22T08:21:12.404 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.403+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~P526BFG2Z8DI.0 size=1048576 2024-09-22T08:21:12.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.404+0000 7fe6c9c31780 1 < completed part key=_multipart_76HZ3LZGVT9J.2~P526BFG2Z8DI.1 size=631688 2024-09-22T08:21:12.407 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.406+0000 7fe6c9c31780 1 < completed multipart upload key=76HZ3LZGVT9J upload=P526BFG2Z8DI tag=TJCO6ZDDP2SY type=write size=2728840 2024-09-22T08:21:12.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.407+0000 7fe6c9c31780 1 > prepared operation key=O1UBUQXP50CN tag=WH4DYW3Q9J21 type=write size=308430 2024-09-22T08:21:12.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.409+0000 7fe6c9c31780 1 < completed delete operation key=0PNK2ZW6IJM1 tag=OD722QDHT8VS type=del 2024-09-22T08:21:12.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.411+0000 7fe6c9c31780 1 > prepared operation key=VP1MP4IC9A7T tag=EIOLAI5G4EV9 type=del size=53216 2024-09-22T08:21:12.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.412+0000 7fe6c9c31780 1 < completed write operation key=T2W6RXP9UGHH tag=C42DU09Z1CVL type=write size=525298 2024-09-22T08:21:12.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.414+0000 7fe6c9c31780 1 > prepared operation key=ILW34WLX48WN tag=OTH6KXBBKZXL type=del size=3065333 2024-09-22T08:21:12.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.418+0000 7fe6c9c31780 1 < suggested update operation key=O1UBUQXP50CN tag=01F4AGVZCLXY type=del size=1257 2024-09-22T08:21:12.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.420+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~FNTNT9L2S5I8.0 size=1048576 2024-09-22T08:21:12.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.422+0000 7fe6c9c31780 1 > prepared part key=_multipart_6BKB91YV3FMW.2~FNTNT9L2S5I8.1 size=235148 2024-09-22T08:21:12.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.422+0000 7fe6c9c31780 1 > prepared multipart upload key=6BKB91YV3FMW upload=FNTNT9L2S5I8 tag=SXXNWH6EHJ1N type=write size=2332300 2024-09-22T08:21:12.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.423+0000 7fe6c9c31780 1 < completed write operation key=XJP26CCPYDI7 tag=FO4E3KVGBN2A type=write size=452130 2024-09-22T08:21:12.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.425+0000 7fe6c9c31780 1 > prepared operation key=VP1MP4IC9A7T tag=66ELA33P9AAU type=del size=4030015 2024-09-22T08:21:12.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.426+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~GRTMDO0WGL28.0 size=1048576 2024-09-22T08:21:12.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.427+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~GRTMDO0WGL28.1 size=1048576 2024-09-22T08:21:12.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.428+0000 7fe6c9c31780 1 < completed part key=_multipart_946H8F2AUPO2.2~GRTMDO0WGL28.2 size=709770 2024-09-22T08:21:12.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.431+0000 7fe6c9c31780 1 < completed multipart upload key=946H8F2AUPO2 upload=GRTMDO0WGL28 tag=M85Q0XNQAUK6 type=write size=3855498 2024-09-22T08:21:12.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.432+0000 7fe6c9c31780 1 > prepared operation key=0PNK2ZW6IJM1 tag=PKFJEFV202MN type=del size=1653666 2024-09-22T08:21:12.435 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.433+0000 7fe6c9c31780 1 < completed delete operation key=6BKB91YV3FMW tag=QA9OFOEI0OFL type=del 2024-09-22T08:21:12.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.435+0000 7fe6c9c31780 1 > prepared operation key=FY40JTHLT0KU tag=0D2H1UVJIG7Y type=del size=1298728 2024-09-22T08:21:12.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.436+0000 7fe6c9c31780 1 < completed delete operation key=76HZ3LZGVT9J tag=ZX5NYW54LV6Y type=del 2024-09-22T08:21:12.439 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.438+0000 7fe6c9c31780 1 > prepared operation key=9FCSIF1WKBDJ tag=C9USMAPT32PM type=del size=1694466 2024-09-22T08:21:12.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.439+0000 7fe6c9c31780 1 < completed part key=_multipart_ILW34WLX48WN.2~780W7VPOAKT6.0 size=509457 2024-09-22T08:21:12.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.442+0000 7fe6c9c31780 1 < completed multipart upload key=ILW34WLX48WN upload=780W7VPOAKT6 tag=J11B8E7WB6GY type=write size=1558033 2024-09-22T08:21:12.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.443+0000 7fe6c9c31780 1 > prepared operation key=OX1LY7URY7IV tag=DYZY4I1VM8LI type=del size=3908251 2024-09-22T08:21:12.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.446+0000 7fe6c9c31780 1 < suggested update operation key=FY40JTHLT0KU tag=97MLRLCW06UX type=del size=3086713 2024-09-22T08:21:12.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.449+0000 7fe6c9c31780 1 > prepared part key=_multipart_LA6ZRVULGQ0H.2~12L2W72QAPF2.0 size=289561 2024-09-22T08:21:12.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.449+0000 7fe6c9c31780 1 > prepared multipart upload key=LA6ZRVULGQ0H upload=12L2W72QAPF2 tag=GFNR4GTXZMRE type=write size=1338137 2024-09-22T08:21:12.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.450+0000 7fe6c9c31780 1 < completed delete operation key=D85LJGGU3Z6F tag=7DVDYXQQ170F type=del 2024-09-22T08:21:12.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.453+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~1Q50R05P61BO.0 size=1048576 2024-09-22T08:21:12.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.455+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~1Q50R05P61BO.1 size=1048576 2024-09-22T08:21:12.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.456+0000 7fe6c9c31780 1 > prepared part key=_multipart_0TWY0NNZZ7NN.2~1Q50R05P61BO.2 size=457153 2024-09-22T08:21:12.458 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.456+0000 7fe6c9c31780 1 > prepared multipart upload key=0TWY0NNZZ7NN upload=1Q50R05P61BO tag=AX308VKV7DWI type=write size=3602881 2024-09-22T08:21:12.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.458+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~CYKGPFR3ZC9P.0 size=1048576 2024-09-22T08:21:12.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.460+0000 7fe6c9c31780 1 < completed part key=_multipart_T2W6RXP9UGHH.2~CYKGPFR3ZC9P.1 size=679332 2024-09-22T08:21:12.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.463+0000 7fe6c9c31780 1 < completed multipart upload key=T2W6RXP9UGHH upload=CYKGPFR3ZC9P tag=CTT25ZCPE3M2 type=write size=2776484 2024-09-22T08:21:12.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.464+0000 7fe6c9c31780 1 > prepared operation key=TE10GB1F35X4 tag=WDDRQAXA45GK type=del size=382942 2024-09-22T08:21:12.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.466+0000 7fe6c9c31780 1 < completed delete operation key=T2W6RXP9UGHH tag=GU3TIST56AYZ type=del 2024-09-22T08:21:12.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.468+0000 7fe6c9c31780 1 > prepared part key=_multipart_0PNK2ZW6IJM1.2~XSS4046FAATL.0 size=716926 2024-09-22T08:21:12.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.468+0000 7fe6c9c31780 1 > prepared multipart upload key=0PNK2ZW6IJM1 upload=XSS4046FAATL tag=PBGBWJB37KWW type=write size=1765502 2024-09-22T08:21:12.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.470+0000 7fe6c9c31780 -1 < failed to complete operation key=FY40JTHLT0KU tag=H61FQ2XG8CFN type=del size=1174022: (22) Invalid argument 2024-09-22T08:21:12.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.473+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~PLQ5SHHT5QZ6.0 size=1048576 2024-09-22T08:21:12.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.473+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~PLQ5SHHT5QZ6.1 size=1048576 2024-09-22T08:21:12.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.475+0000 7fe6c9c31780 1 > prepared part key=_multipart_GEWQUFB9K35E.2~PLQ5SHHT5QZ6.2 size=276669 2024-09-22T08:21:12.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.475+0000 7fe6c9c31780 1 > prepared multipart upload key=GEWQUFB9K35E upload=PLQ5SHHT5QZ6 tag=4VAPZ4VYFU1E type=write size=3422397 2024-09-22T08:21:12.480 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.479+0000 7fe6c9c31780 1 < suggested update operation key=R7UWMW913DJQ tag=G5EVZV55XSTR type=del size=2791094 2024-09-22T08:21:12.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.480+0000 7fe6c9c31780 1 > prepared operation key=4KRJ7DTE3KDV tag=MQQG6883D71C type=del size=1359402 2024-09-22T08:21:12.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.482+0000 7fe6c9c31780 1 < completed delete operation key=TYVQ39KUV2V9 tag=HBR33782MP25 type=del 2024-09-22T08:21:12.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.484+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~AGVHT4YAC6MB.0 size=1048576 2024-09-22T08:21:12.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.486+0000 7fe6c9c31780 1 > prepared part key=_multipart_D85LJGGU3Z6F.2~AGVHT4YAC6MB.1 size=611991 2024-09-22T08:21:12.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.486+0000 7fe6c9c31780 1 > prepared multipart upload key=D85LJGGU3Z6F upload=AGVHT4YAC6MB tag=CF2OYKR3OBRF type=write size=2709143 2024-09-22T08:21:12.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.487+0000 7fe6c9c31780 -1 < failed to complete operation key=O1UBUQXP50CN tag=WH4DYW3Q9J21 type=write size=308430: (22) Invalid argument 2024-09-22T08:21:12.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.490+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~ATFR3RHMQSH3.0 size=1048576 2024-09-22T08:21:12.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.491+0000 7fe6c9c31780 1 > prepared part key=_multipart_JT5AB8VLMEFD.2~ATFR3RHMQSH3.1 size=721432 2024-09-22T08:21:12.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.491+0000 7fe6c9c31780 1 > prepared multipart upload key=JT5AB8VLMEFD upload=ATFR3RHMQSH3 tag=RABJ41S369K1 type=write size=2818584 2024-09-22T08:21:12.495 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.494+0000 7fe6c9c31780 1 < suggested remove operation key=VP1MP4IC9A7T tag=EIOLAI5G4EV9 type=del 2024-09-22T08:21:12.497 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.495+0000 7fe6c9c31780 1 > prepared operation key=XJP26CCPYDI7 tag=ZN5BQUO8GBBE type=del size=3683386 2024-09-22T08:21:12.498 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.497+0000 7fe6c9c31780 1 < completed delete operation key=ILW34WLX48WN tag=OTH6KXBBKZXL type=del 2024-09-22T08:21:12.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.498+0000 7fe6c9c31780 1 > prepared operation key=TYVQ39KUV2V9 tag=Q2F83ATE2DK6 type=del size=358106 2024-09-22T08:21:12.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.500+0000 7fe6c9c31780 1 < completed part key=_multipart_6BKB91YV3FMW.2~FNTNT9L2S5I8.0 size=1048576 2024-09-22T08:21:12.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.501+0000 7fe6c9c31780 1 < completed part key=_multipart_6BKB91YV3FMW.2~FNTNT9L2S5I8.1 size=235148 2024-09-22T08:21:12.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.504+0000 7fe6c9c31780 1 < completed multipart upload key=6BKB91YV3FMW upload=FNTNT9L2S5I8 tag=SXXNWH6EHJ1N type=write size=2332300 2024-09-22T08:21:12.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.506+0000 7fe6c9c31780 1 > prepared part key=_multipart_DC7VLQWZ3TD1.2~R5D3UMH1I8SP.0 size=941576 2024-09-22T08:21:12.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.506+0000 7fe6c9c31780 1 > prepared multipart upload key=DC7VLQWZ3TD1 upload=R5D3UMH1I8SP tag=ZMWTU2GI159B type=write size=1990152 2024-09-22T08:21:12.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.507+0000 7fe6c9c31780 -1 < no bi entry to suggest for operation key=VP1MP4IC9A7T tag=66ELA33P9AAU type=del size=4030015: (2) No such file or directory 2024-09-22T08:21:12.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.510+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~PWL8M7QGS9W4.0 size=1048576 2024-09-22T08:21:12.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.511+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~PWL8M7QGS9W4.1 size=1048576 2024-09-22T08:21:12.513 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.512+0000 7fe6c9c31780 1 > prepared part key=_multipart_CTK01Y0CV1NC.2~PWL8M7QGS9W4.2 size=452693 2024-09-22T08:21:12.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:21:12.512+0000 7fe6c9c31780 1 > prepared multipart upload key=CTK01Y0CV1NC upload=PWL8M7QGS9W4 tag=01H4UYAPYSCS type=write size=3598421 2024-09-22T08:21:12.514 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw_stats.simulate (11252 ms) 2024-09-22T08:21:12.514 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 1 test from cls_rgw_stats (11252 ms total) 2024-09-22T08:21:12.514 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-22T08:21:12.514 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-22T08:21:12.889 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 1 test from 1 test suite ran. (13574 ms total) 2024-09-22T08:21:12.889 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 1 test. 2024-09-22T08:21:12.892 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:21:12.893 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:21:12.981 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-22T08:21:12.982 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-22T08:21:12.982 DEBUG:teuthology.orchestra.run.smithi038:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-22T08:21:13.034 INFO:tasks.workunit.client.0.smithi038.stdout:Running main() from gmock_main.cc 2024-09-22T08:21:13.034 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-22T08:21:13.034 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-22T08:21:14.906 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 31 tests from CmpOmap 2024-09-22T08:21:14.907 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-22T08:21:14.917 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (12 ms) 2024-09-22T08:21:14.918 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-22T08:21:15.123 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (205 ms) 2024-09-22T08:21:15.123 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-22T08:21:15.126 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (3 ms) 2024-09-22T08:21:15.126 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-22T08:21:15.130 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (5 ms) 2024-09-22T08:21:15.131 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-22T08:21:15.138 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_vals_str (7 ms) 2024-09-22T08:21:15.138 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-22T08:21:15.147 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_vals_u64 (10 ms) 2024-09-22T08:21:15.147 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-22T08:21:15.151 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (3 ms) 2024-09-22T08:21:15.151 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-22T08:21:15.155 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (4 ms) 2024-09-22T08:21:15.155 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-22T08:21:15.159 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (4 ms) 2024-09-22T08:21:15.159 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-22T08:21:15.164 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (5 ms) 2024-09-22T08:21:15.164 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-22T08:21:15.164 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2024-09-22T08:21:15.165 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-22T08:21:15.165 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (0 ms) 2024-09-22T08:21:15.165 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-22T08:21:15.172 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (7 ms) 2024-09-22T08:21:15.172 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-22T08:21:15.181 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (9 ms) 2024-09-22T08:21:15.181 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-22T08:21:15.188 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (7 ms) 2024-09-22T08:21:15.188 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-22T08:21:15.196 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (8 ms) 2024-09-22T08:21:15.196 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-22T08:21:15.206 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_set_vals_str (10 ms) 2024-09-22T08:21:15.206 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-22T08:21:15.214 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (8 ms) 2024-09-22T08:21:15.214 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-22T08:21:15.216 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (3 ms) 2024-09-22T08:21:15.217 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-22T08:21:15.219 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (2 ms) 2024-09-22T08:21:15.219 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-22T08:21:15.221 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (2 ms) 2024-09-22T08:21:15.221 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-22T08:21:15.221 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (0 ms) 2024-09-22T08:21:15.221 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-22T08:21:15.229 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (8 ms) 2024-09-22T08:21:15.229 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-22T08:21:15.236 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (7 ms) 2024-09-22T08:21:15.236 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-22T08:21:15.245 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (9 ms) 2024-09-22T08:21:15.245 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-22T08:21:15.252 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (7 ms) 2024-09-22T08:21:15.252 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-22T08:21:15.254 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (2 ms) 2024-09-22T08:21:15.254 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-22T08:21:15.257 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (3 ms) 2024-09-22T08:21:15.257 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-22T08:21:15.258 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (1 ms) 2024-09-22T08:21:15.258 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-22T08:21:15.259 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (1 ms) 2024-09-22T08:21:15.259 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-22T08:21:15.267 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (9 ms) 2024-09-22T08:21:15.267 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 31 tests from CmpOmap (362 ms total) 2024-09-22T08:21:15.267 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-22T08:21:15.268 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-22T08:21:15.912 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 31 tests from 1 test suite ran. (2878 ms total) 2024-09-22T08:21:15.912 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 31 tests. 2024-09-22T08:21:15.915 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:21:15.915 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:21:15.961 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-22T08:21:15.962 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-22T08:21:15.962 DEBUG:teuthology.orchestra.run.smithi038:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-22T08:21:16.011 INFO:tasks.workunit.client.0.smithi038.stdout:Running main() from gmock_main.cc 2024-09-22T08:21:16.011 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-22T08:21:16.011 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-22T08:21:16.011 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-22T08:21:16.011 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-22T08:21:18.953 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2942 ms) 2024-09-22T08:21:18.953 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-22T08:21:21.995 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3042 ms) 2024-09-22T08:21:21.995 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-22T08:21:25.051 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.Reserve (3056 ms) 2024-09-22T08:21:25.051 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-22T08:21:28.073 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3022 ms) 2024-09-22T08:21:28.074 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-22T08:21:31.107 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.Commit (3034 ms) 2024-09-22T08:21:31.107 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-22T08:21:34.123 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.Stats (3016 ms) 2024-09-22T08:21:34.123 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-22T08:21:38.160 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4038 ms) 2024-09-22T08:21:38.161 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-22T08:21:41.217 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.Abort (3056 ms) 2024-09-22T08:21:41.217 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-22T08:21:44.234 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.ReserveError (3017 ms) 2024-09-22T08:21:44.234 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-22T08:21:47.294 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.CommitError (3060 ms) 2024-09-22T08:21:47.294 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-22T08:21:50.308 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.AbortError (3013 ms) 2024-09-22T08:21:50.308 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-22T08:21:53.360 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3054 ms) 2024-09-22T08:21:53.361 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-22T08:21:56.415 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3054 ms) 2024-09-22T08:21:56.415 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-22T08:21:59.459 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3044 ms) 2024-09-22T08:21:59.459 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-22T08:22:02.489 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3030 ms) 2024-09-22T08:22:02.490 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-22T08:22:05.526 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3037 ms) 2024-09-22T08:22:05.527 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-22T08:22:08.583 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3057 ms) 2024-09-22T08:22:08.583 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-22T08:22:11.601 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.Cleanup (3018 ms) 2024-09-22T08:22:11.601 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-22T08:22:22.906 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.MultiProducer (11305 ms) 2024-09-22T08:22:22.906 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-22T08:22:25.939 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (3033 ms) 2024-09-22T08:22:25.939 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-22T08:22:40.029 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (14086 ms) 2024-09-22T08:22:40.029 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-22T08:22:44.090 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (4065 ms) 2024-09-22T08:22:44.090 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-22T08:22:49.159 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (5068 ms) 2024-09-22T08:22:49.159 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-22T08:22:54.227 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (5069 ms) 2024-09-22T08:22:54.227 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 24 tests from TestCls2PCQueue (98216 ms total) 2024-09-22T08:22:54.227 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-22T08:22:54.227 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-22T08:22:54.227 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 24 tests from 1 test suite ran. (98216 ms total) 2024-09-22T08:22:54.227 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 24 tests. 2024-09-22T08:22:54.230 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:22:54.230 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:22:54.272 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-22T08:22:54.273 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-22T08:22:54.274 DEBUG:teuthology.orchestra.run.smithi038:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-22T08:22:54.366 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:22:54.366 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:22:54.366 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-22T08:22:54.366 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-22T08:22:56.256 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 4 tests from ClsAccount 2024-09-22T08:22:56.256 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] ClsAccount.add 2024-09-22T08:22:56.277 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] ClsAccount.add (21 ms) 2024-09-22T08:22:56.277 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] ClsAccount.get 2024-09-22T08:22:56.283 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] ClsAccount.get (6 ms) 2024-09-22T08:22:56.283 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] ClsAccount.rm 2024-09-22T08:22:56.291 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] ClsAccount.rm (8 ms) 2024-09-22T08:22:56.291 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] ClsAccount.list 2024-09-22T08:22:56.305 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] ClsAccount.list (14 ms) 2024-09-22T08:22:56.305 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 4 tests from ClsAccount (49 ms total) 2024-09-22T08:22:56.305 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-22T08:22:56.305 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-22T08:22:57.245 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 4 tests from 1 test suite ran. (2879 ms total) 2024-09-22T08:22:57.246 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 4 tests. 2024-09-22T08:22:57.250 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:22:57.250 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:22:57.296 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-22T08:22:57.297 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-22T08:22:57.297 DEBUG:teuthology.orchestra.run.smithi038:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-22T08:22:57.353 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:22:57.354 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:22:57.354 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-22T08:22:57.354 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-22T08:22:59.286 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 6 tests from rgw_gc_log 2024-09-22T08:22:59.287 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-22T08:22:59.299 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] rgw_gc_log.init_existing_queue (13 ms) 2024-09-22T08:22:59.299 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-22T08:22:59.302 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] rgw_gc_log.init_existing_omap (3 ms) 2024-09-22T08:22:59.302 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-22T08:22:59.325 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (23 ms) 2024-09-22T08:22:59.325 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-22T08:22:59.326 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (1 ms) 2024-09-22T08:22:59.326 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-22T08:22:59.329 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] rgw_gc_log.defer1_after_init (3 ms) 2024-09-22T08:22:59.329 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-22T08:22:59.331 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] rgw_gc_log.defer2_before_init (2 ms) 2024-09-22T08:22:59.331 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 6 tests from rgw_gc_log (45 ms total) 2024-09-22T08:22:59.331 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-22T08:22:59.331 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-22T08:23:00.313 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 6 tests from 1 test suite ran. (2959 ms total) 2024-09-22T08:23:00.313 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 6 tests. 2024-09-22T08:23:00.317 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:23:00.317 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:23:00.362 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-22T08:23:00.363 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-22T08:23:00.363 DEBUG:teuthology.orchestra.run.smithi038:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-22T08:23:00.425 INFO:tasks.workunit.client.0.smithi038.stdout:Running main() from gmock_main.cc 2024-09-22T08:23:00.425 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-22T08:23:00.426 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-22T08:23:00.426 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 4 tests from TestRGWObj 2024-09-22T08:23:00.426 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestRGWObj.underscore 2024-09-22T08:23:00.426 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj 2024-09-22T08:23:00.426 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj 2024-09-22T08:23:00.426 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: _obj ns= i= 2024-09-22T08:23:00.426 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj 2024-09-22T08:23:00.426 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj 2024-09-22T08:23:00.426 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: _obj ns= i= 2024-09-22T08:23:00.426 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj 2024-09-22T08:23:00.426 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj 2024-09-22T08:23:00.427 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: _obj ns= i= 2024-09-22T08:23:00.427 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.427 INFO:tasks.workunit.client.0.smithi038.stdout: "obj1": { 2024-09-22T08:23:00.427 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.427 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.427 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.427 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.427 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.427 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.427 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.427 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.427 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.427 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.427 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.427 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.428 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_obj", 2024-09-22T08:23:00.428 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.428 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.428 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.428 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.428 INFO:tasks.workunit.client.0.smithi038.stdout: "obj2": { 2024-09-22T08:23:00.428 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.428 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.428 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.428 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.428 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.428 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.428 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.428 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.428 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.428 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.429 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.429 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.429 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_obj", 2024-09-22T08:23:00.429 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.429 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.429 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.429 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.429 INFO:tasks.workunit.client.0.smithi038.stdout: "obj3": { 2024-09-22T08:23:00.429 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.429 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.429 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.429 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.429 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.429 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.429 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.429 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.430 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.430 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.430 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.430 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.430 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_obj", 2024-09-22T08:23:00.430 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.430 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.430 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.430 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.430 INFO:tasks.workunit.client.0.smithi038.stdout: "obj3-2": { 2024-09-22T08:23:00.430 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.431 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.431 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.431 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.431 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.431 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.431 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.431 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.431 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.431 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.431 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.431 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.431 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_obj", 2024-09-22T08:23:00.431 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.431 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.431 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.432 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.432 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.432 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj 2024-09-22T08:23:00.432 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj 2024-09-22T08:23:00.432 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: _obj ns=ns i= 2024-09-22T08:23:00.432 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj 2024-09-22T08:23:00.432 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj 2024-09-22T08:23:00.432 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: _obj ns=ns i= 2024-09-22T08:23:00.432 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj 2024-09-22T08:23:00.432 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj 2024-09-22T08:23:00.432 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: _obj ns=ns i= 2024-09-22T08:23:00.432 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.432 INFO:tasks.workunit.client.0.smithi038.stdout: "obj1": { 2024-09-22T08:23:00.432 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.432 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.433 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.433 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.433 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.433 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.433 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.433 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.433 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.433 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.433 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.433 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.433 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_obj", 2024-09-22T08:23:00.433 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.433 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.433 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.433 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.434 INFO:tasks.workunit.client.0.smithi038.stdout: "obj2": { 2024-09-22T08:23:00.434 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.434 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.434 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.434 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.434 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.434 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.434 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.434 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.434 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.434 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.434 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.434 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.434 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_obj", 2024-09-22T08:23:00.435 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.435 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.435 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.435 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.435 INFO:tasks.workunit.client.0.smithi038.stdout: "obj3": { 2024-09-22T08:23:00.435 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.435 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.435 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.435 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.435 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.435 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.435 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.435 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.435 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.435 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.435 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.436 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.436 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_obj", 2024-09-22T08:23:00.436 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.436 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.436 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.436 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.436 INFO:tasks.workunit.client.0.smithi038.stdout: "obj3-2": { 2024-09-22T08:23:00.436 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.436 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.436 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.437 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.437 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.437 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.437 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.437 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.437 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.437 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.437 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.437 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.437 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_obj", 2024-09-22T08:23:00.437 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.437 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.437 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.437 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.437 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.438 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj[v1] 2024-09-22T08:23:00.438 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj[v1] 2024-09-22T08:23:00.438 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: _obj ns= i=v1 2024-09-22T08:23:00.438 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj[v1] 2024-09-22T08:23:00.438 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj[v1] 2024-09-22T08:23:00.438 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: _obj ns= i=v1 2024-09-22T08:23:00.438 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj[v1] 2024-09-22T08:23:00.438 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj[v1] 2024-09-22T08:23:00.439 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: _obj ns= i=v1 2024-09-22T08:23:00.439 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.439 INFO:tasks.workunit.client.0.smithi038.stdout: "obj1": { 2024-09-22T08:23:00.439 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.439 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.439 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.439 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.439 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.439 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.439 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.439 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.439 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.439 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.440 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.440 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.440 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_obj", 2024-09-22T08:23:00.440 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "v1", 2024-09-22T08:23:00.440 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.440 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.440 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.440 INFO:tasks.workunit.client.0.smithi038.stdout: "obj2": { 2024-09-22T08:23:00.440 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.440 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.440 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.440 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.440 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.440 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.441 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.441 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.441 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.441 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.441 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.441 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.441 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_obj", 2024-09-22T08:23:00.441 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "v1", 2024-09-22T08:23:00.441 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.441 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.441 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.441 INFO:tasks.workunit.client.0.smithi038.stdout: "obj3": { 2024-09-22T08:23:00.441 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.441 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.442 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.442 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.442 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.442 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.442 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.442 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.442 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.442 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.442 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.442 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.442 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_obj", 2024-09-22T08:23:00.442 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.442 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.442 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.443 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.443 INFO:tasks.workunit.client.0.smithi038.stdout: "obj3-2": { 2024-09-22T08:23:00.443 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.443 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.443 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.443 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.443 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.443 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.443 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.443 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.444 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.444 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.444 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.444 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.444 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_obj", 2024-09-22T08:23:00.444 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "v1", 2024-09-22T08:23:00.444 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.444 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.444 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.444 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.444 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj[v1] 2024-09-22T08:23:00.444 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj[v1] 2024-09-22T08:23:00.444 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: _obj ns=ns i=v1 2024-09-22T08:23:00.444 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj[v1] 2024-09-22T08:23:00.445 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj[v1] 2024-09-22T08:23:00.445 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: _obj ns=ns i=v1 2024-09-22T08:23:00.445 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj[v1] 2024-09-22T08:23:00.445 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj[v1] 2024-09-22T08:23:00.445 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: _obj ns=ns i=v1 2024-09-22T08:23:00.445 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.445 INFO:tasks.workunit.client.0.smithi038.stdout: "obj1": { 2024-09-22T08:23:00.445 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.445 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.445 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.445 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.445 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.445 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.445 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.446 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.446 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.446 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.446 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.446 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.446 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_obj", 2024-09-22T08:23:00.446 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "v1", 2024-09-22T08:23:00.446 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.446 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.446 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.446 INFO:tasks.workunit.client.0.smithi038.stdout: "obj2": { 2024-09-22T08:23:00.446 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.446 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.446 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.447 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.447 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.447 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.447 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.447 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.447 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.447 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.447 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.447 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.447 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_obj", 2024-09-22T08:23:00.447 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "v1", 2024-09-22T08:23:00.447 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.447 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.447 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.448 INFO:tasks.workunit.client.0.smithi038.stdout: "obj3": { 2024-09-22T08:23:00.448 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.448 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.448 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.448 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.448 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.448 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.448 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.448 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.448 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.448 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.448 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.448 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.448 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_obj", 2024-09-22T08:23:00.449 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.449 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.449 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.449 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.449 INFO:tasks.workunit.client.0.smithi038.stdout: "obj3-2": { 2024-09-22T08:23:00.449 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.449 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.449 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.449 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.449 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.449 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.449 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.449 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.449 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.449 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.450 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.450 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.450 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_obj", 2024-09-22T08:23:00.450 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "v1", 2024-09-22T08:23:00.450 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.450 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.450 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.450 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.450 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-09-22T08:23:00.450 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-22T08:23:00.450 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj 2024-09-22T08:23:00.450 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj 2024-09-22T08:23:00.450 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: obj ns= i= 2024-09-22T08:23:00.450 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj 2024-09-22T08:23:00.451 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj 2024-09-22T08:23:00.451 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: obj ns= i= 2024-09-22T08:23:00.451 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj 2024-09-22T08:23:00.451 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj 2024-09-22T08:23:00.451 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: obj ns= i= 2024-09-22T08:23:00.451 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.451 INFO:tasks.workunit.client.0.smithi038.stdout: "obj1": { 2024-09-22T08:23:00.451 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.451 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.451 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.451 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.451 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.451 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.452 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.452 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.452 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.452 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.452 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.452 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.452 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "obj", 2024-09-22T08:23:00.452 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.452 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.452 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.452 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.452 INFO:tasks.workunit.client.0.smithi038.stdout: "obj2": { 2024-09-22T08:23:00.452 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.452 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.453 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.453 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.453 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.453 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.453 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.453 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.453 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.453 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.453 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.453 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.453 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "obj", 2024-09-22T08:23:00.453 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.453 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.453 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.454 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.454 INFO:tasks.workunit.client.0.smithi038.stdout: "obj3": { 2024-09-22T08:23:00.454 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.454 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.454 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.454 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.454 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.454 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.454 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.454 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.454 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.454 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.454 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.455 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.455 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "obj", 2024-09-22T08:23:00.455 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.455 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.455 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.455 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.455 INFO:tasks.workunit.client.0.smithi038.stdout: "obj3-2": { 2024-09-22T08:23:00.455 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.455 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.455 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.455 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.455 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.455 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.455 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.456 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.456 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.456 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.456 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.456 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.456 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "obj", 2024-09-22T08:23:00.456 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.456 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.456 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.456 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.456 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.456 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj 2024-09-22T08:23:00.456 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj 2024-09-22T08:23:00.456 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: obj ns=ns i= 2024-09-22T08:23:00.456 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj 2024-09-22T08:23:00.457 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj 2024-09-22T08:23:00.457 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: obj ns=ns i= 2024-09-22T08:23:00.457 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj 2024-09-22T08:23:00.457 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj 2024-09-22T08:23:00.457 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: obj ns=ns i= 2024-09-22T08:23:00.457 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.457 INFO:tasks.workunit.client.0.smithi038.stdout: "obj1": { 2024-09-22T08:23:00.457 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.457 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.457 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.457 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.457 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.457 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.458 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.458 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.458 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.458 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.458 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.458 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.458 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "obj", 2024-09-22T08:23:00.458 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.458 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.458 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.458 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.458 INFO:tasks.workunit.client.0.smithi038.stdout: "obj2": { 2024-09-22T08:23:00.458 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.459 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.459 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.459 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.459 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.459 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.459 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.459 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.459 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.459 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.459 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.459 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.459 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "obj", 2024-09-22T08:23:00.459 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.459 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.460 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.460 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.460 INFO:tasks.workunit.client.0.smithi038.stdout: "obj3": { 2024-09-22T08:23:00.460 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.460 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.460 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.460 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.460 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.460 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.460 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.460 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.460 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.460 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.460 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.461 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.461 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "obj", 2024-09-22T08:23:00.461 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.461 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.461 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.461 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.461 INFO:tasks.workunit.client.0.smithi038.stdout: "obj3-2": { 2024-09-22T08:23:00.461 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.461 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.461 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.461 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.461 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.461 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.461 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.461 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.462 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.462 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.462 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.462 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.462 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "obj", 2024-09-22T08:23:00.462 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.462 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.462 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.462 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.462 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.462 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj[v1] 2024-09-22T08:23:00.462 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj[v1] 2024-09-22T08:23:00.462 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: obj ns= i=v1 2024-09-22T08:23:00.462 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj[v1] 2024-09-22T08:23:00.463 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj[v1] 2024-09-22T08:23:00.463 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: obj ns= i=v1 2024-09-22T08:23:00.463 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj[v1] 2024-09-22T08:23:00.463 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj[v1] 2024-09-22T08:23:00.463 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: obj ns= i=v1 2024-09-22T08:23:00.463 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.463 INFO:tasks.workunit.client.0.smithi038.stdout: "obj1": { 2024-09-22T08:23:00.463 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.463 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.463 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.463 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.463 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.463 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.463 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.463 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.463 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.464 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.464 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.464 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.464 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "obj", 2024-09-22T08:23:00.464 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "v1", 2024-09-22T08:23:00.464 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.464 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.464 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.464 INFO:tasks.workunit.client.0.smithi038.stdout: "obj2": { 2024-09-22T08:23:00.464 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.464 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.464 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.464 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.464 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.465 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.465 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.465 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.465 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.465 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.465 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.465 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.465 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "obj", 2024-09-22T08:23:00.465 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "v1", 2024-09-22T08:23:00.465 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.465 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.465 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.465 INFO:tasks.workunit.client.0.smithi038.stdout: "obj3": { 2024-09-22T08:23:00.465 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.465 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.465 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.466 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.466 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.466 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.466 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.466 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.466 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.466 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.466 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.466 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.466 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "obj", 2024-09-22T08:23:00.466 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.466 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.466 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.466 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.466 INFO:tasks.workunit.client.0.smithi038.stdout: "obj3-2": { 2024-09-22T08:23:00.467 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.467 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.467 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.467 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.467 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.467 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.467 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.467 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.467 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.467 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.467 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.467 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.467 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "obj", 2024-09-22T08:23:00.467 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "v1", 2024-09-22T08:23:00.468 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.468 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.468 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.468 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.468 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj[v1] 2024-09-22T08:23:00.468 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj[v1] 2024-09-22T08:23:00.468 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: obj ns=ns i=v1 2024-09-22T08:23:00.468 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj[v1] 2024-09-22T08:23:00.468 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj[v1] 2024-09-22T08:23:00.468 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: obj ns=ns i=v1 2024-09-22T08:23:00.468 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj[v1] 2024-09-22T08:23:00.468 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj[v1] 2024-09-22T08:23:00.468 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: obj ns=ns i=v1 2024-09-22T08:23:00.468 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.469 INFO:tasks.workunit.client.0.smithi038.stdout: "obj1": { 2024-09-22T08:23:00.469 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.469 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.469 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.469 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.469 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.469 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.469 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.469 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.469 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.469 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.469 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.469 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.469 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "obj", 2024-09-22T08:23:00.469 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "v1", 2024-09-22T08:23:00.470 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.470 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.470 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.470 INFO:tasks.workunit.client.0.smithi038.stdout: "obj2": { 2024-09-22T08:23:00.470 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.470 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.470 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.470 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.470 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.470 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.470 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.470 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.470 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.470 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.471 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.471 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.471 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "obj", 2024-09-22T08:23:00.471 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "v1", 2024-09-22T08:23:00.471 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.471 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.471 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.471 INFO:tasks.workunit.client.0.smithi038.stdout: "obj3": { 2024-09-22T08:23:00.471 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.471 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.471 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.471 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.471 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.471 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.471 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.472 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.472 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.472 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.472 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.472 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.472 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "obj", 2024-09-22T08:23:00.472 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.472 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.472 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.472 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.472 INFO:tasks.workunit.client.0.smithi038.stdout: "obj3-2": { 2024-09-22T08:23:00.472 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.472 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.472 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.472 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.473 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.473 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.473 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.473 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.473 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.473 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.473 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.473 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.473 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "obj", 2024-09-22T08:23:00.473 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "v1", 2024-09-22T08:23:00.473 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.473 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.473 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.473 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.473 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-09-22T08:23:00.474 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-22T08:23:00.474 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.474 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.474 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.474 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.474 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.474 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.474 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.474 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.474 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.474 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.474 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.474 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.474 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.475 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.475 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-22T08:23:00.475 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.475 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.475 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.475 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.475 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.475 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.475 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.475 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.475 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.475 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.475 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.475 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.475 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-22T08:23:00.476 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.476 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.476 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.476 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.476 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.476 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.476 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-22T08:23:00.476 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": "default-placement.data", 2024-09-22T08:23:00.476 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker_myobj", 2024-09-22T08:23:00.476 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-22T08:23:00.476 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.476 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.476 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.476 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-22T08:23:00.477 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.477 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.477 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.477 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.477 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.477 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.477 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.477 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.477 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.477 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.477 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.477 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.477 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-22T08:23:00.477 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.477 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.478 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.478 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.478 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.478 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.478 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.478 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.478 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.478 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.478 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.478 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.478 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.478 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.478 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.478 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.479 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.479 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.479 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.479 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-22T08:23:00.479 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.479 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.479 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.479 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.479 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.479 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.479 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.479 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.479 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.479 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.479 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.480 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.480 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-22T08:23:00.480 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.480 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.480 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.480 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.480 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.480 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.480 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-22T08:23:00.480 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-22T08:23:00.480 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker_myobj", 2024-09-22T08:23:00.480 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-22T08:23:00.480 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.481 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.481 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.481 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-22T08:23:00.481 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.481 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.481 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.481 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.481 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.481 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.481 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.481 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.481 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.481 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.481 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.482 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.482 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-22T08:23:00.482 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.482 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.482 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.482 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.482 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.482 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.482 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.482 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.482 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.482 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.482 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.482 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.483 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.483 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.483 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.483 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.483 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.483 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.483 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.483 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-22T08:23:00.483 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.483 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.483 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.483 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.483 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.483 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.484 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.484 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.484 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.484 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.484 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.484 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.484 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-22T08:23:00.484 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.484 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.484 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.484 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.485 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.485 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.485 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-22T08:23:00.485 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": "default-placement.data", 2024-09-22T08:23:00.485 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns_myobj", 2024-09-22T08:23:00.485 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-22T08:23:00.485 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.485 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.485 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.485 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-22T08:23:00.485 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.485 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.485 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.485 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.486 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.486 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.486 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.486 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.486 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.486 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.486 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.486 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.486 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-22T08:23:00.486 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.486 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.486 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.486 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.486 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.487 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.487 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.487 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.487 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.487 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.487 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.487 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.487 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.487 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.487 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.487 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.487 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.487 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.487 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.487 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-22T08:23:00.488 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.488 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.488 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.488 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.488 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.488 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.488 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.488 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.488 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.488 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.488 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.488 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.488 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-22T08:23:00.488 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.488 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.489 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.489 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.489 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.489 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.489 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-22T08:23:00.489 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-22T08:23:00.489 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns_myobj", 2024-09-22T08:23:00.489 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-22T08:23:00.489 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.489 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.489 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.489 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-22T08:23:00.489 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.489 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.489 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.490 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.490 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.490 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.490 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.490 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.490 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.490 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.490 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.490 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.490 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-22T08:23:00.490 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.490 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.490 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.490 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.490 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.491 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.491 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.491 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.491 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.491 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.491 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.491 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.491 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.491 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.491 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.491 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.491 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.491 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.491 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.491 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-22T08:23:00.492 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.492 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.492 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.492 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.492 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.492 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.492 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.492 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.492 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.492 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.492 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.492 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.492 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-22T08:23:00.493 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-22T08:23:00.493 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.493 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.493 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.493 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.493 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.493 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-22T08:23:00.493 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": "default-placement.data", 2024-09-22T08:23:00.493 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__:inst_myobj", 2024-09-22T08:23:00.493 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-22T08:23:00.493 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.493 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.493 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.493 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-22T08:23:00.493 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.493 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.494 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.494 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.494 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.494 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.494 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.494 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.494 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.494 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.494 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.494 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.494 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-22T08:23:00.494 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-22T08:23:00.494 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.494 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.494 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.495 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.495 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.495 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.495 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.495 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.495 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.495 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.495 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.495 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.495 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.495 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.495 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.495 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.495 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.495 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.496 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-22T08:23:00.496 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.496 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.496 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.496 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.496 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.496 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.496 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.496 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.496 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.496 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.496 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.496 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.496 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-22T08:23:00.496 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-22T08:23:00.497 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.497 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.497 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.497 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.497 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.497 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-22T08:23:00.497 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-22T08:23:00.497 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__:inst_myobj", 2024-09-22T08:23:00.497 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-22T08:23:00.497 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.497 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.497 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.497 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-22T08:23:00.497 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.497 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.497 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.498 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.498 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.498 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.498 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.498 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.498 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.498 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.498 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.498 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.498 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-22T08:23:00.498 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-22T08:23:00.498 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.498 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.499 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.499 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.499 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.499 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.499 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.499 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.499 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.499 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.499 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.499 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.499 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.499 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.499 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.499 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.499 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.499 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.500 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-22T08:23:00.500 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.500 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.500 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.500 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.500 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.500 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.500 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.500 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.500 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.500 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.500 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.500 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.500 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-22T08:23:00.500 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-22T08:23:00.500 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.501 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.501 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.501 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.501 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.501 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-22T08:23:00.501 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": "default-placement.data", 2024-09-22T08:23:00.501 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns:inst_myobj", 2024-09-22T08:23:00.501 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-22T08:23:00.501 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.501 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.501 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.501 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-22T08:23:00.501 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.501 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.501 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.502 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.502 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.502 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.502 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.502 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.502 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.502 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.502 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.502 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.502 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-22T08:23:00.502 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-22T08:23:00.502 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.502 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.502 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.503 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.503 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.503 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.503 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.503 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.503 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.503 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.503 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.503 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.503 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.503 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.503 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.503 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.503 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.503 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.503 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-22T08:23:00.504 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.504 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.504 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.504 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.504 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.504 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.504 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.504 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.504 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.504 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.504 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.504 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.504 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-22T08:23:00.505 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-22T08:23:00.505 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.505 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.505 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.505 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.505 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.505 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-22T08:23:00.505 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-22T08:23:00.505 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns:inst_myobj", 2024-09-22T08:23:00.505 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-22T08:23:00.505 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.505 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.505 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.505 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-22T08:23:00.505 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.505 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.505 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.506 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.506 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.506 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.506 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.506 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.506 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.506 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.506 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.506 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.506 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-22T08:23:00.506 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-22T08:23:00.506 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.506 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.506 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.507 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.507 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.507 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.507 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.507 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.507 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.507 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.507 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.507 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.507 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.507 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.507 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.507 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.507 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.507 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.507 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-22T08:23:00.507 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.508 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.508 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.508 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.508 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.508 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.508 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.508 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.508 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.508 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.508 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.508 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.508 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-22T08:23:00.508 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.508 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.508 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.509 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.509 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.509 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.509 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-22T08:23:00.509 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": "default-placement.data", 2024-09-22T08:23:00.509 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker___myobj", 2024-09-22T08:23:00.509 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "marker__myobj" 2024-09-22T08:23:00.509 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.509 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.509 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.509 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-22T08:23:00.509 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.509 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.509 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.509 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.509 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.509 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.510 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.510 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.510 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.510 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.510 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.510 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.510 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-22T08:23:00.510 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.510 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.510 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.510 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.510 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.510 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.510 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.511 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.511 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.511 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.511 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.511 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.511 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.511 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.511 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.511 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.511 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.511 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.511 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.511 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-22T08:23:00.511 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.511 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.512 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.512 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.512 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.512 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.512 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.512 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.512 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.512 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.512 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.512 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.512 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-22T08:23:00.512 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.512 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.512 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.512 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.512 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.513 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.513 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-22T08:23:00.513 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-22T08:23:00.513 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker___myobj", 2024-09-22T08:23:00.513 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "marker__myobj" 2024-09-22T08:23:00.513 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.513 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.513 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.513 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-22T08:23:00.513 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.513 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.513 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.513 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.513 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.514 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.514 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.514 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.514 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.514 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.514 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.514 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.514 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-22T08:23:00.514 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.514 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.514 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.514 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.514 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.514 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.515 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.515 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.515 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.515 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.515 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.515 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.515 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.515 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.515 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.515 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.515 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.515 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.515 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.515 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-22T08:23:00.515 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.515 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.516 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.516 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.516 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.516 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.516 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.516 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.516 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.516 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.516 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.516 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.516 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-22T08:23:00.516 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.516 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.516 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.516 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.517 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.517 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.517 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-22T08:23:00.517 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": "default-placement.data", 2024-09-22T08:23:00.517 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns__myobj", 2024-09-22T08:23:00.517 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-22T08:23:00.517 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.517 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.517 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.517 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-22T08:23:00.517 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.517 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.517 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.517 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.517 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.518 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.518 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.518 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.518 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.518 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.518 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.518 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.518 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-22T08:23:00.518 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.518 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.518 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.518 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.518 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.518 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.518 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.518 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.519 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.519 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.519 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.519 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.519 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.519 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.519 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.519 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.519 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.519 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.519 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.519 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-22T08:23:00.519 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.519 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.520 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.520 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.520 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.520 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.520 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.520 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.520 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.520 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.520 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.520 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.520 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-22T08:23:00.520 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.520 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.520 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.520 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.520 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.521 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.521 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-22T08:23:00.521 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-22T08:23:00.521 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns__myobj", 2024-09-22T08:23:00.521 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-22T08:23:00.521 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.521 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.521 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.521 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-22T08:23:00.521 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.521 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.521 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.521 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.521 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.521 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.521 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.522 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.522 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.522 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.522 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.522 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.522 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-22T08:23:00.522 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.522 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.522 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.522 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.522 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.522 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.522 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.522 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.523 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.523 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.523 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.523 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.523 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.523 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.523 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.523 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.523 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.523 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.523 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.523 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-22T08:23:00.523 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.523 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.524 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.524 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.524 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.524 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.524 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.524 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.524 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.524 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.524 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.524 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.524 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-22T08:23:00.524 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-22T08:23:00.524 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.524 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.524 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.525 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.525 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.525 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-22T08:23:00.525 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": "default-placement.data", 2024-09-22T08:23:00.525 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__:inst__myobj", 2024-09-22T08:23:00.525 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "marker__myobj" 2024-09-22T08:23:00.525 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.525 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.525 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.525 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-22T08:23:00.525 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.525 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.525 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.525 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.525 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.525 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.526 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.526 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.526 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.526 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.526 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.526 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.526 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-22T08:23:00.526 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-22T08:23:00.526 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.526 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.526 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.526 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.526 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.526 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.527 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.527 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.527 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.527 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.527 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.527 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.527 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.527 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.527 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.527 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.527 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.527 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.527 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-22T08:23:00.527 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.528 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.528 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.528 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.528 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.528 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.528 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.528 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.528 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.528 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.528 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.528 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.528 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-22T08:23:00.528 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-22T08:23:00.528 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.529 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.529 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.529 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.529 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.529 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-22T08:23:00.529 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-22T08:23:00.529 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__:inst__myobj", 2024-09-22T08:23:00.529 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "marker__myobj" 2024-09-22T08:23:00.529 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.529 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.529 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.529 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-22T08:23:00.529 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.529 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.529 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.530 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.530 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.530 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.530 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.530 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.530 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.530 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.530 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.530 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.530 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-22T08:23:00.530 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-22T08:23:00.530 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.530 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.530 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.531 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.531 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.531 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.531 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.531 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.531 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.531 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.531 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.531 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.531 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.531 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.531 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.531 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.531 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.531 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.531 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-22T08:23:00.532 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.532 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.532 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.532 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.532 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.532 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.532 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.532 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.532 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.532 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.532 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.532 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.532 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-22T08:23:00.532 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-22T08:23:00.532 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.533 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.533 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.533 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.533 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.533 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-22T08:23:00.533 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": "default-placement.data", 2024-09-22T08:23:00.533 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns:inst__myobj", 2024-09-22T08:23:00.533 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-22T08:23:00.533 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.533 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.533 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.533 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-22T08:23:00.533 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.533 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.533 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.533 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.534 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.534 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.534 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.534 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.534 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.534 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.534 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.534 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.534 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-22T08:23:00.534 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-22T08:23:00.534 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.534 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.534 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.535 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.535 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.535 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.535 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.535 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.535 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.535 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.535 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.535 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.535 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.535 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.535 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.535 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.535 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.536 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.536 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-22T08:23:00.536 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.536 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.536 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.536 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.536 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.536 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.536 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.536 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.536 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.536 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.536 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.536 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.536 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-22T08:23:00.537 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-22T08:23:00.537 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.537 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.537 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.537 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.537 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.537 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-22T08:23:00.537 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-22T08:23:00.537 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns:inst__myobj", 2024-09-22T08:23:00.537 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-22T08:23:00.537 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.537 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.537 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.537 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-22T08:23:00.537 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.538 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.538 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.538 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.538 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.538 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.538 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.538 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.538 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.538 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.538 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.538 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.538 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-22T08:23:00.538 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-22T08:23:00.538 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.538 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.538 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.539 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.539 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.539 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.539 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.539 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.539 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.539 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.539 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.539 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.539 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.539 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.539 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.539 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.539 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.539 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.540 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-22T08:23:00.540 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.540 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.540 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.540 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.540 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.540 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.540 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.540 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.540 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.540 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.540 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.540 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.540 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-22T08:23:00.540 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.541 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.541 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.541 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.541 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.541 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.541 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-22T08:23:00.541 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": "default-placement.data", 2024-09-22T08:23:00.541 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker___myobj_", 2024-09-22T08:23:00.541 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "marker__myobj_" 2024-09-22T08:23:00.541 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.541 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.541 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.541 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-22T08:23:00.541 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.541 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.542 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.542 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.542 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.542 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.542 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.542 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.542 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.542 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.542 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.542 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.542 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-22T08:23:00.542 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.542 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.542 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.542 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.542 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.543 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.543 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.543 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.543 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.543 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.543 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.543 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.543 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.543 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.543 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.543 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.543 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.543 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.543 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.543 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-22T08:23:00.544 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.544 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.544 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.544 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.544 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.544 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.544 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.544 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.544 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.544 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.544 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.544 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.544 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-22T08:23:00.544 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.544 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.545 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.545 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.545 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.545 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.545 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-22T08:23:00.545 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-22T08:23:00.545 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker___myobj_", 2024-09-22T08:23:00.545 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "marker__myobj_" 2024-09-22T08:23:00.545 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.545 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.545 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.545 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-22T08:23:00.545 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.545 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.545 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.546 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.546 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.546 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.546 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.546 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.546 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.546 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.546 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.546 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.546 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-22T08:23:00.546 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.546 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.547 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.547 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.547 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.547 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.547 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.547 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.547 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.547 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.547 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.547 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.547 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.547 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.547 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.548 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.548 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.548 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.548 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.548 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-22T08:23:00.548 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.548 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.548 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.548 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.548 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.548 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.548 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.548 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.548 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.548 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.549 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.549 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.549 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-22T08:23:00.549 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.549 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.549 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.549 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.549 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.549 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.549 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-22T08:23:00.549 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": "default-placement.data", 2024-09-22T08:23:00.549 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns__myobj_", 2024-09-22T08:23:00.549 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-22T08:23:00.549 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.550 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.550 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.550 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-22T08:23:00.550 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.550 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.550 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.550 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.550 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.550 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.550 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.550 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.550 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.550 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.550 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.551 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.551 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-22T08:23:00.551 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.551 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.551 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.551 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.551 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.551 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.551 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.551 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.551 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.551 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.551 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.551 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.552 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.552 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.552 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.552 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.552 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.552 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.552 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.552 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-22T08:23:00.552 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.552 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.552 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.552 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.552 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.553 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.553 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.553 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.553 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.553 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.553 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.553 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.553 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-22T08:23:00.553 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.553 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.553 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.553 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.553 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.554 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.554 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-22T08:23:00.554 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-22T08:23:00.554 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns__myobj_", 2024-09-22T08:23:00.554 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-22T08:23:00.554 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.554 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.554 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.554 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-22T08:23:00.554 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.554 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.554 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.554 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.554 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.555 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.555 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.555 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.555 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.555 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.555 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.555 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.555 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-22T08:23:00.555 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.555 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.555 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.555 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.555 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.556 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.556 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.556 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.556 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.556 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.556 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.556 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.556 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.556 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.556 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.556 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.556 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.556 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.556 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.557 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-22T08:23:00.557 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.557 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.557 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.557 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.557 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.557 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.557 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.557 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.557 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.557 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.557 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.558 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.558 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-22T08:23:00.558 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-22T08:23:00.558 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.558 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.558 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.558 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.558 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.558 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-22T08:23:00.558 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": "default-placement.data", 2024-09-22T08:23:00.558 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__:inst__myobj_", 2024-09-22T08:23:00.558 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "marker__myobj_" 2024-09-22T08:23:00.558 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.559 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.559 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.559 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-22T08:23:00.559 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.559 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.559 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.559 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.559 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.559 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.559 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.559 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.559 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.559 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.560 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.560 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.560 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-22T08:23:00.560 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-22T08:23:00.560 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.560 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.560 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.560 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.560 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.560 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.560 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.560 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.560 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.560 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.560 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.560 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.560 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.561 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.561 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.561 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.561 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.561 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.561 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-22T08:23:00.561 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.561 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.561 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.561 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.561 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.561 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.561 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.561 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.562 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.562 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.562 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.562 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.562 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-22T08:23:00.562 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-22T08:23:00.562 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.562 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.562 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.562 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.562 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.562 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-22T08:23:00.562 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-22T08:23:00.562 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__:inst__myobj_", 2024-09-22T08:23:00.563 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "marker__myobj_" 2024-09-22T08:23:00.563 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.563 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.563 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.563 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-22T08:23:00.563 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.563 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.563 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.563 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.563 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.563 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.563 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.563 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.563 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.564 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.564 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.564 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.564 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-22T08:23:00.564 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-22T08:23:00.564 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.564 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.564 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.564 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.564 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.564 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.564 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.564 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.565 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.565 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.565 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.565 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.565 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.565 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.565 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.565 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.565 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.565 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.565 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-22T08:23:00.565 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.565 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.565 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.566 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.566 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.566 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.566 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.566 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.566 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.566 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.566 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.566 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.566 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-22T08:23:00.566 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-22T08:23:00.566 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.566 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.566 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.567 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.567 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.567 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-22T08:23:00.567 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": "default-placement.data", 2024-09-22T08:23:00.567 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-22T08:23:00.567 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-22T08:23:00.567 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.567 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.567 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.567 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-22T08:23:00.567 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.567 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-22T08:23:00.567 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.567 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.568 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.568 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.568 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-22T08:23:00.568 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.568 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-22T08:23:00.568 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.568 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.568 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.568 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-22T08:23:00.568 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-22T08:23:00.568 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.568 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.568 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.568 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.569 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.569 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.569 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.569 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.569 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.569 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.569 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.569 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.569 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.569 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.569 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.569 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.569 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.569 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.569 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-22T08:23:00.570 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.570 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.570 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.570 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.570 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.570 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.570 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.570 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.570 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.570 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.570 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.570 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.570 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-22T08:23:00.570 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-22T08:23:00.571 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.571 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.571 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.571 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.571 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.571 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-22T08:23:00.571 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-22T08:23:00.571 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-22T08:23:00.571 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-22T08:23:00.571 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.571 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.571 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.571 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-22T08:23:00.571 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.571 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.572 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.572 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.572 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.572 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.572 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.572 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.572 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.572 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.572 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.572 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.572 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-22T08:23:00.572 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-22T08:23:00.572 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.572 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.572 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.572 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.573 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestRGWObj.obj_to_raw (0 ms) 2024-09-22T08:23:00.573 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-22T08:23:00.573 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.573 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-22T08:23:00.573 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-22T08:23:00.573 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker_myobj", 2024-09-22T08:23:00.573 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-22T08:23:00.573 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.573 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.573 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.573 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-22T08:23:00.573 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.573 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.573 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.573 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.573 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.574 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.574 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.574 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.574 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.574 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.574 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.574 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.574 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-22T08:23:00.574 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.574 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.574 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.574 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.574 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.574 INFO:tasks.workunit.client.0.smithi038.stdout:raw=.data-pool:marker_myobj 2024-09-22T08:23:00.575 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.575 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj2": { 2024-09-22T08:23:00.575 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-22T08:23:00.575 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker_myobj", 2024-09-22T08:23:00.575 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-22T08:23:00.575 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.575 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.575 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.575 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj2": { 2024-09-22T08:23:00.575 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.575 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.575 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.575 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.575 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.575 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.575 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.576 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.576 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.576 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.576 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.576 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.576 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-22T08:23:00.576 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.576 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.576 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.576 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.576 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.576 INFO:tasks.workunit.client.0.smithi038.stdout:raw2=.data-pool:marker_myobj 2024-09-22T08:23:00.576 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.576 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-22T08:23:00.576 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-22T08:23:00.577 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns_myobj", 2024-09-22T08:23:00.577 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-22T08:23:00.577 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.577 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.577 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.577 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-22T08:23:00.577 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.577 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.577 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.577 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.577 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.577 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.577 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.577 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.577 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.578 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.578 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.578 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.578 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-22T08:23:00.578 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.578 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.578 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.578 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.578 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.578 INFO:tasks.workunit.client.0.smithi038.stdout:raw=.data-pool:marker__ns_myobj 2024-09-22T08:23:00.578 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.578 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj2": { 2024-09-22T08:23:00.578 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-22T08:23:00.578 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns_myobj", 2024-09-22T08:23:00.579 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-22T08:23:00.579 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.579 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.579 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.579 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj2": { 2024-09-22T08:23:00.579 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.579 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.579 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.579 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.579 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.579 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.579 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.579 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.579 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.579 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.579 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.580 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.580 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-22T08:23:00.580 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.580 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.580 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.580 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.580 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.580 INFO:tasks.workunit.client.0.smithi038.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-22T08:23:00.580 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.580 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-22T08:23:00.580 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-22T08:23:00.580 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__:inst_myobj", 2024-09-22T08:23:00.580 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-22T08:23:00.580 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.580 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.580 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.581 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-22T08:23:00.581 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.581 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.581 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.581 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.581 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.581 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.581 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.581 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.581 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.581 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.581 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.581 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.581 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-22T08:23:00.581 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-22T08:23:00.581 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.582 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.582 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.582 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.582 INFO:tasks.workunit.client.0.smithi038.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-22T08:23:00.582 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.582 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj2": { 2024-09-22T08:23:00.582 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-22T08:23:00.582 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__:inst_myobj", 2024-09-22T08:23:00.582 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-22T08:23:00.582 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.582 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.582 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.582 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj2": { 2024-09-22T08:23:00.582 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.583 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.583 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.583 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.583 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.583 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.583 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.583 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.583 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.583 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.583 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.583 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.583 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-22T08:23:00.583 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-22T08:23:00.583 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.584 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.584 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.584 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.584 INFO:tasks.workunit.client.0.smithi038.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-22T08:23:00.584 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.584 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-22T08:23:00.584 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-22T08:23:00.584 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns:inst_myobj", 2024-09-22T08:23:00.584 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-22T08:23:00.584 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.584 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.584 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.584 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-22T08:23:00.584 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.585 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.585 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.585 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.585 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.585 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.585 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.585 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.585 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.585 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.585 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.585 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.585 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-22T08:23:00.585 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-22T08:23:00.585 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.585 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.585 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.586 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.586 INFO:tasks.workunit.client.0.smithi038.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-22T08:23:00.586 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.586 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj2": { 2024-09-22T08:23:00.586 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-22T08:23:00.586 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns:inst_myobj", 2024-09-22T08:23:00.586 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-22T08:23:00.586 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.586 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.586 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.586 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj2": { 2024-09-22T08:23:00.586 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.586 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.586 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.587 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.587 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.587 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.587 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.587 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.587 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.587 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.587 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.587 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.587 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-22T08:23:00.587 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-22T08:23:00.587 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.587 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.587 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.587 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.588 INFO:tasks.workunit.client.0.smithi038.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-22T08:23:00.588 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.588 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-22T08:23:00.588 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-22T08:23:00.588 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker___myobj", 2024-09-22T08:23:00.588 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "marker__myobj" 2024-09-22T08:23:00.588 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.588 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.588 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.588 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-22T08:23:00.588 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.588 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.588 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.588 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.589 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.589 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.589 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.589 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.589 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.589 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.589 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.589 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.589 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-22T08:23:00.589 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.589 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.589 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.589 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.589 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.590 INFO:tasks.workunit.client.0.smithi038.stdout:raw=.data-pool:marker___myobj 2024-09-22T08:23:00.590 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.590 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj2": { 2024-09-22T08:23:00.590 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-22T08:23:00.590 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker___myobj", 2024-09-22T08:23:00.590 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "marker__myobj" 2024-09-22T08:23:00.590 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.590 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.590 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.590 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj2": { 2024-09-22T08:23:00.590 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.590 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.590 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.590 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.590 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.591 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.591 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.591 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.591 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.591 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.591 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.591 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.591 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-22T08:23:00.591 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.591 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.591 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.591 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.591 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.591 INFO:tasks.workunit.client.0.smithi038.stdout:raw2=.data-pool:marker___myobj 2024-09-22T08:23:00.592 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.592 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-22T08:23:00.592 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-22T08:23:00.592 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns__myobj", 2024-09-22T08:23:00.592 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-22T08:23:00.592 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.592 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.592 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.592 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-22T08:23:00.592 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.592 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.592 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.592 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.592 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.592 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.593 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.593 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.593 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.593 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.593 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.593 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.593 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-22T08:23:00.593 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.593 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.593 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.593 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.593 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.593 INFO:tasks.workunit.client.0.smithi038.stdout:raw=.data-pool:marker__ns__myobj 2024-09-22T08:23:00.593 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.594 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj2": { 2024-09-22T08:23:00.594 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-22T08:23:00.594 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns__myobj", 2024-09-22T08:23:00.594 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-22T08:23:00.594 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.594 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.594 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.594 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj2": { 2024-09-22T08:23:00.594 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.594 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.594 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.594 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.594 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.595 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.595 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.595 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.595 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.595 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.595 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.595 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.595 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-22T08:23:00.595 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.595 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.595 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.595 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.595 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.596 INFO:tasks.workunit.client.0.smithi038.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-22T08:23:00.596 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.596 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-22T08:23:00.596 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-22T08:23:00.596 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__:inst__myobj", 2024-09-22T08:23:00.596 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "marker__myobj" 2024-09-22T08:23:00.596 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.596 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.596 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.596 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-22T08:23:00.596 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.596 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.596 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.596 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.596 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.597 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.597 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.597 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.597 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.597 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.597 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.597 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.597 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-22T08:23:00.597 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-22T08:23:00.597 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.597 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.597 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.597 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.598 INFO:tasks.workunit.client.0.smithi038.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-22T08:23:00.598 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.598 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj2": { 2024-09-22T08:23:00.598 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-22T08:23:00.598 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__:inst__myobj", 2024-09-22T08:23:00.598 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "marker__myobj" 2024-09-22T08:23:00.598 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.598 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.598 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.598 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj2": { 2024-09-22T08:23:00.598 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.598 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.598 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.598 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.598 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.599 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.599 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.599 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.599 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.599 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.599 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.599 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.599 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-22T08:23:00.599 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-22T08:23:00.599 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.599 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.599 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.599 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.599 INFO:tasks.workunit.client.0.smithi038.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-22T08:23:00.600 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.600 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-22T08:23:00.600 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-22T08:23:00.600 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns:inst__myobj", 2024-09-22T08:23:00.600 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-22T08:23:00.600 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.600 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.600 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.600 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-22T08:23:00.600 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.600 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.600 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.600 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.601 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.601 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.601 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.601 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.601 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.601 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.601 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.601 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.601 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-22T08:23:00.601 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-22T08:23:00.601 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.601 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.601 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.601 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.602 INFO:tasks.workunit.client.0.smithi038.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-22T08:23:00.602 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.602 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj2": { 2024-09-22T08:23:00.602 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-22T08:23:00.602 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns:inst__myobj", 2024-09-22T08:23:00.602 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-22T08:23:00.602 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.602 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.602 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.602 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj2": { 2024-09-22T08:23:00.602 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.602 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.602 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.602 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.602 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.603 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.603 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.603 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.603 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.603 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.603 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.603 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.603 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-22T08:23:00.603 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-22T08:23:00.603 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.603 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.603 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.603 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.603 INFO:tasks.workunit.client.0.smithi038.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-22T08:23:00.604 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.604 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-22T08:23:00.604 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-22T08:23:00.604 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker___myobj_", 2024-09-22T08:23:00.604 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "marker__myobj_" 2024-09-22T08:23:00.604 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.604 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.604 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.604 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-22T08:23:00.604 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.604 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.604 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.604 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.604 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.605 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.605 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.605 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.605 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.605 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.605 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.605 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.605 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-22T08:23:00.605 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.605 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.605 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.605 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.605 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.605 INFO:tasks.workunit.client.0.smithi038.stdout:raw=.data-pool:marker___myobj_ 2024-09-22T08:23:00.605 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.606 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj2": { 2024-09-22T08:23:00.606 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-22T08:23:00.606 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker___myobj_", 2024-09-22T08:23:00.606 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "marker__myobj_" 2024-09-22T08:23:00.606 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.606 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.606 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.606 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj2": { 2024-09-22T08:23:00.606 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.606 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.606 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.606 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.606 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.607 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.607 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.607 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.607 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.607 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.607 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.607 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.607 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-22T08:23:00.607 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.607 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.607 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.607 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.607 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.608 INFO:tasks.workunit.client.0.smithi038.stdout:raw2=.data-pool:marker___myobj_ 2024-09-22T08:23:00.608 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.608 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-22T08:23:00.608 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-22T08:23:00.608 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns__myobj_", 2024-09-22T08:23:00.608 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-22T08:23:00.608 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.608 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.608 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.608 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-22T08:23:00.608 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.608 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.608 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.608 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.608 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.609 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.609 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.609 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.609 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.609 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.609 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.609 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.609 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-22T08:23:00.609 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.609 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.609 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.609 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.609 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.609 INFO:tasks.workunit.client.0.smithi038.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-22T08:23:00.609 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.610 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj2": { 2024-09-22T08:23:00.610 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-22T08:23:00.610 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns__myobj_", 2024-09-22T08:23:00.610 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-22T08:23:00.610 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.610 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.610 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.610 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj2": { 2024-09-22T08:23:00.610 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.610 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.610 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.610 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.610 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.610 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.610 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.611 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.611 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.611 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.611 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.611 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.611 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-22T08:23:00.611 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-22T08:23:00.611 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.611 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.611 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.611 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.611 INFO:tasks.workunit.client.0.smithi038.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-22T08:23:00.611 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.611 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-22T08:23:00.611 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-22T08:23:00.611 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__:inst__myobj_", 2024-09-22T08:23:00.612 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "marker__myobj_" 2024-09-22T08:23:00.612 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.612 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.612 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.612 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-22T08:23:00.612 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.612 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.612 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.612 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.612 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.612 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.612 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.612 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.612 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.612 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.613 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.613 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.613 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-22T08:23:00.613 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-22T08:23:00.613 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.613 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.613 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.613 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.613 INFO:tasks.workunit.client.0.smithi038.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-22T08:23:00.613 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.613 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj2": { 2024-09-22T08:23:00.613 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-22T08:23:00.613 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__:inst__myobj_", 2024-09-22T08:23:00.613 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "marker__myobj_" 2024-09-22T08:23:00.613 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.613 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.614 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.614 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj2": { 2024-09-22T08:23:00.614 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.614 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.614 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.614 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.614 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.614 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.614 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.614 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.614 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.614 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.614 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.614 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.614 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-22T08:23:00.615 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-22T08:23:00.615 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-22T08:23:00.615 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.615 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.615 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.615 INFO:tasks.workunit.client.0.smithi038.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-22T08:23:00.615 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.615 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-22T08:23:00.615 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-22T08:23:00.615 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-22T08:23:00.615 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-22T08:23:00.615 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.615 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.615 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.615 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-22T08:23:00.616 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.616 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.616 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.616 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.616 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.616 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.616 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.616 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.616 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.616 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.616 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.616 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.616 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-22T08:23:00.616 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-22T08:23:00.616 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.617 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.617 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.617 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.617 INFO:tasks.workunit.client.0.smithi038.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-22T08:23:00.617 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.617 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj2": { 2024-09-22T08:23:00.617 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-22T08:23:00.617 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-22T08:23:00.617 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-22T08:23:00.617 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.617 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.617 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:00.617 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj2": { 2024-09-22T08:23:00.617 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-22T08:23:00.617 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-22T08:23:00.617 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-22T08:23:00.617 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-22T08:23:00.618 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-22T08:23:00.618 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-22T08:23:00.618 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-22T08:23:00.618 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-22T08:23:00.618 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-22T08:23:00.618 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.618 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:00.618 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-22T08:23:00.618 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-22T08:23:00.618 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-22T08:23:00.618 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-22T08:23:00.618 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.618 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:00.618 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:00.618 INFO:tasks.workunit.client.0.smithi038.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-22T08:23:00.619 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2024-09-22T08:23:00.619 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 4 tests from TestRGWObj (0 ms total) 2024-09-22T08:23:00.619 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-22T08:23:00.619 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-22T08:23:00.619 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 4 tests from 1 test suite ran. (0 ms total) 2024-09-22T08:23:00.619 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 4 tests. 2024-09-22T08:23:00.619 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:23:00.619 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:23:00.662 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-22T08:23:00.663 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-22T08:23:00.664 DEBUG:teuthology.orchestra.run.smithi038:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-22T08:23:00.783 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:23:00.783 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:23:00.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:00.822+0000 7f5d5610c800 20 rados->read ofs=0 len=0 2024-09-22T08:23:00.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:00.824+0000 7f5d5610c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:23:00.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:00.824+0000 7f5d5610c800 20 realm 2024-09-22T08:23:00.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:00.824+0000 7f5d5610c800 20 rados->read ofs=0 len=0 2024-09-22T08:23:00.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:00.824+0000 7f5d5610c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:23:00.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:00.824+0000 7f5d5610c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:23:00.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:00.824+0000 7f5d5610c800 20 rados->read ofs=0 len=0 2024-09-22T08:23:00.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:00.824+0000 7f5d5610c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:23:00.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:00.824+0000 7f5d5610c800 20 rados->read ofs=0 len=0 2024-09-22T08:23:00.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:00.825+0000 7f5d5610c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:23:00.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:00.825+0000 7f5d5610c800 20 rados->read ofs=0 len=0 2024-09-22T08:23:00.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:00.826+0000 7f5d5610c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:23:00.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:00.826+0000 7f5d5610c800 20 searching for the correct realm 2024-09-22T08:23:00.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:00.829+0000 7f5d53bfd640 0 -- 172.21.15.38:0/2025761525 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x564703fcf0b0 msgr2=0x564703fd1570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:23:00.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:00.832+0000 7f5d533fc640 0 -- 172.21.15.38:0/2025761525 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f5d44064460 msgr2=0x7f5d440648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:23:01.041 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.039+0000 7f5d5610c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:23:01.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.039+0000 7f5d5610c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:23:01.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.039+0000 7f5d5610c800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:23:01.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.039+0000 7f5d5610c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:23:01.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.039+0000 7f5d5610c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:23:01.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.039+0000 7f5d5610c800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:23:01.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.039+0000 7f5d5610c800 20 rados->read ofs=0 len=0 2024-09-22T08:23:01.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.040+0000 7f5d5610c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:23:01.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.040+0000 7f5d5610c800 20 rados->read ofs=0 len=0 2024-09-22T08:23:01.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.040+0000 7f5d5610c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:23:01.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.040+0000 7f5d5610c800 20 rados->read ofs=0 len=0 2024-09-22T08:23:01.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.040+0000 7f5d5610c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:23:01.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.040+0000 7f5d5610c800 20 zone default found 2024-09-22T08:23:01.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.041+0000 7f5d5610c800 4 Realm: () 2024-09-22T08:23:01.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.041+0000 7f5d5610c800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:23:01.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.041+0000 7f5d5610c800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:23:01.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.041+0000 7f5d5610c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:23:01.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.041+0000 7f5d5610c800 20 zonegroup default 2024-09-22T08:23:01.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.041+0000 7f5d5610c800 20 rados->read ofs=0 len=0 2024-09-22T08:23:01.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.041+0000 7f5d5610c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:23:01.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.041+0000 7f5d5610c800 20 rados->read ofs=0 len=0 2024-09-22T08:23:01.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.041+0000 7f5d5610c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:23:01.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.041+0000 7f5d5610c800 20 rados->read ofs=0 len=0 2024-09-22T08:23:01.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.042+0000 7f5d5610c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:23:01.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.042+0000 7f5d5610c800 20 started sync module instance, tier type = 2024-09-22T08:23:01.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.042+0000 7f5d5610c800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:23:01.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.052+0000 7f5d5610c800 20 add_watcher() i=0 2024-09-22T08:23:01.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.052+0000 7f5d5610c800 20 add_watcher() i=1 2024-09-22T08:23:01.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.052+0000 7f5d5610c800 20 add_watcher() i=2 2024-09-22T08:23:01.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.052+0000 7f5d5610c800 20 add_watcher() i=3 2024-09-22T08:23:01.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.052+0000 7f5d5610c800 20 add_watcher() i=4 2024-09-22T08:23:01.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.052+0000 7f5d5610c800 20 add_watcher() i=5 2024-09-22T08:23:01.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.052+0000 7f5d5610c800 20 add_watcher() i=6 2024-09-22T08:23:01.055 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.054+0000 7f5d5610c800 20 add_watcher() i=7 2024-09-22T08:23:01.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.054+0000 7f5d5610c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:23:01.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.055+0000 7f5c0a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:23:01.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.056+0000 7f5d5610c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:23:01.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.056+0000 7f5d5610c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:23:01.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.056+0000 7f5d5610c800 5 note: GC not initialized 2024-09-22T08:23:01.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.056+0000 7f5c097e2640 20 reqs_thread_entry: start 2024-09-22T08:23:01.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.056+0000 7f5d5610c800 20 init_complete bucket index max shards: 11 2024-09-22T08:23:01.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.057+0000 7f5d5610c800 20 Filter name: none 2024-09-22T08:23:01.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.057+0000 7f5c027fc640 20 reqs_thread_entry: start 2024-09-22T08:23:01.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.057+0000 7f5d5610c800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-22T08:23:01.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.057+0000 7f5d5610c800 20 rados->read ofs=0 len=0 2024-09-22T08:23:01.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.057+0000 7f5d5610c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:23:01.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.057+0000 7f5d5610c800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-22T08:23:01.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.057+0000 7f5d5610c800 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-22T08:23:01.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.057+0000 7f5d5610c800 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-22T08:23:01.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.057+0000 7f5d5610c800 20 rados->read ofs=0 len=0 2024-09-22T08:23:01.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.057+0000 7f5d5610c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:23:01.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.057+0000 7f5d5610c800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-22T08:23:01.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.057+0000 7f5d5610c800 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-22T08:23:01.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.057+0000 7f5d5610c800 10 cache get: name=default.rgw.meta+users.keys+WTsDQjhweIBc2ZcLqsaPbSFzBVE= : miss 2024-09-22T08:23:01.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.057+0000 7f5d5610c800 20 rados->read ofs=0 len=0 2024-09-22T08:23:01.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.058+0000 7f5d5610c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:23:01.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.058+0000 7f5d5610c800 10 cache put: name=default.rgw.meta+users.keys+WTsDQjhweIBc2ZcLqsaPbSFzBVE= info.flags=0x0 2024-09-22T08:23:01.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.058+0000 7f5d5610c800 10 adding default.rgw.meta+users.keys+WTsDQjhweIBc2ZcLqsaPbSFzBVE= to cache LRU end 2024-09-22T08:23:01.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.058+0000 7f5d5610c800 10 cache get: name=default.rgw.meta+users.keys+WTsDQjhweIBc2ZcLqsaPbSFzBVE= : hit (negative entry) 2024-09-22T08:23:01.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.058+0000 7f5d5610c800 10 cache get: name=default.rgw.meta+users.keys+WTsDQjhweIBc2ZcLqsaPbSFzBVE= : hit (negative entry) 2024-09-22T08:23:01.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.059+0000 7f5d5610c800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-22T08:23:01.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.059+0000 7f5d5610c800 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-22T08:23:01.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.059+0000 7f5d5610c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-22T08:23:01.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.059+0000 7f5c32ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791297 cookie 94863009591952 notifier 5222 bl.length()=697 2024-09-22T08:23:01.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.059+0000 7f5c32ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-22T08:23:01.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.059+0000 7f5c32ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-22T08:23:01.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.061+0000 7f5d5610c800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-22T08:23:01.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.061+0000 7f5d5610c800 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-22T08:23:01.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.061+0000 7f5d5610c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-22T08:23:01.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.062+0000 7f5c32ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791296 cookie 94863009588176 notifier 5222 bl.length()=194 2024-09-22T08:23:01.064 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.062+0000 7f5c32ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-22T08:23:01.064 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.062+0000 7f5c32ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-22T08:23:01.065 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.063+0000 7f5d5610c800 10 cache put: name=default.rgw.meta+users.keys+WTsDQjhweIBc2ZcLqsaPbSFzBVE= info.flags=0x7 2024-09-22T08:23:01.065 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.063+0000 7f5d5610c800 10 moving default.rgw.meta+users.keys+WTsDQjhweIBc2ZcLqsaPbSFzBVE= to cache LRU end 2024-09-22T08:23:01.065 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.063+0000 7f5d5610c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:WTsDQjhweIBc2ZcLqsaPbSFzBVE=, ofs0, ns] 2024-09-22T08:23:01.065 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.063+0000 7f5c327fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791297 cookie 94863009588176 notifier 5222 bl.length()=203 2024-09-22T08:23:01.065 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.063+0000 7f5c327fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+WTsDQjhweIBc2ZcLqsaPbSFzBVE= info.flags=0x7 2024-09-22T08:23:01.065 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.063+0000 7f5c327fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+WTsDQjhweIBc2ZcLqsaPbSFzBVE= to cache LRU end 2024-09-22T08:23:01.066 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:23:01.066 INFO:tasks.workunit.client.0.smithi038.stdout: "user_id": "ceph-test-librgw-file", 2024-09-22T08:23:01.066 INFO:tasks.workunit.client.0.smithi038.stdout: "display_name": "librgw test user", 2024-09-22T08:23:01.066 INFO:tasks.workunit.client.0.smithi038.stdout: "email": "librgw@example.com", 2024-09-22T08:23:01.066 INFO:tasks.workunit.client.0.smithi038.stdout: "suspended": 0, 2024-09-22T08:23:01.066 INFO:tasks.workunit.client.0.smithi038.stdout: "max_buckets": 1000, 2024-09-22T08:23:01.066 INFO:tasks.workunit.client.0.smithi038.stdout: "subusers": [], 2024-09-22T08:23:01.066 INFO:tasks.workunit.client.0.smithi038.stdout: "keys": [ 2024-09-22T08:23:01.066 INFO:tasks.workunit.client.0.smithi038.stdout: { 2024-09-22T08:23:01.066 INFO:tasks.workunit.client.0.smithi038.stdout: "user": "ceph-test-librgw-file", 2024-09-22T08:23:01.066 INFO:tasks.workunit.client.0.smithi038.stdout: "access_key": "WTsDQjhweIBc2ZcLqsaPbSFzBVE=", 2024-09-22T08:23:01.067 INFO:tasks.workunit.client.0.smithi038.stdout: "secret_key": "TyeFJ2SoU7Vb78x3XF92OlkSQWLyYYViUCrDRP+5meLeZ3ln3rsQxQ==", 2024-09-22T08:23:01.067 INFO:tasks.workunit.client.0.smithi038.stdout: "active": true, 2024-09-22T08:23:01.067 INFO:tasks.workunit.client.0.smithi038.stdout: "create_date": "2024-09-22T08:23:01.060035Z" 2024-09-22T08:23:01.067 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:23:01.067 INFO:tasks.workunit.client.0.smithi038.stdout: ], 2024-09-22T08:23:01.067 INFO:tasks.workunit.client.0.smithi038.stdout: "swift_keys": [], 2024-09-22T08:23:01.067 INFO:tasks.workunit.client.0.smithi038.stdout: "caps": [], 2024-09-22T08:23:01.067 INFO:tasks.workunit.client.0.smithi038.stdout: "op_mask": "read, write, delete", 2024-09-22T08:23:01.067 INFO:tasks.workunit.client.0.smithi038.stdout: "default_placement": "", 2024-09-22T08:23:01.067 INFO:tasks.workunit.client.0.smithi038.stdout: "default_storage_class": "", 2024-09-22T08:23:01.067 INFO:tasks.workunit.client.0.smithi038.stdout: "placement_tags": [], 2024-09-22T08:23:01.067 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_quota": { 2024-09-22T08:23:01.067 INFO:tasks.workunit.client.0.smithi038.stdout: "enabled": false, 2024-09-22T08:23:01.067 INFO:tasks.workunit.client.0.smithi038.stdout: "check_on_raw": false, 2024-09-22T08:23:01.067 INFO:tasks.workunit.client.0.smithi038.stdout: "max_size": -1, 2024-09-22T08:23:01.067 INFO:tasks.workunit.client.0.smithi038.stdout: "max_size_kb": 0, 2024-09-22T08:23:01.068 INFO:tasks.workunit.client.0.smithi038.stdout: "max_objects": -1 2024-09-22T08:23:01.068 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:01.068 INFO:tasks.workunit.client.0.smithi038.stdout: "user_quota": { 2024-09-22T08:23:01.068 INFO:tasks.workunit.client.0.smithi038.stdout: "enabled": false, 2024-09-22T08:23:01.068 INFO:tasks.workunit.client.0.smithi038.stdout: "check_on_raw": false, 2024-09-22T08:23:01.068 INFO:tasks.workunit.client.0.smithi038.stdout: "max_size": -1, 2024-09-22T08:23:01.068 INFO:tasks.workunit.client.0.smithi038.stdout: "max_size_kb": 0, 2024-09-22T08:23:01.068 INFO:tasks.workunit.client.0.smithi038.stdout: "max_objects": -1 2024-09-22T08:23:01.068 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:23:01.068 INFO:tasks.workunit.client.0.smithi038.stdout: "temp_url_keys": [], 2024-09-22T08:23:01.068 INFO:tasks.workunit.client.0.smithi038.stdout: "type": "rgw", 2024-09-22T08:23:01.068 INFO:tasks.workunit.client.0.smithi038.stdout: "mfa_ids": [], 2024-09-22T08:23:01.068 INFO:tasks.workunit.client.0.smithi038.stdout: "account_id": "", 2024-09-22T08:23:01.068 INFO:tasks.workunit.client.0.smithi038.stdout: "path": "/", 2024-09-22T08:23:01.068 INFO:tasks.workunit.client.0.smithi038.stdout: "create_date": "2024-09-22T08:23:01.060026Z", 2024-09-22T08:23:01.069 INFO:tasks.workunit.client.0.smithi038.stdout: "tags": [], 2024-09-22T08:23:01.069 INFO:tasks.workunit.client.0.smithi038.stdout: "group_ids": [] 2024-09-22T08:23:01.069 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:23:01.069 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-22T08:23:01.069 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.065+0000 7f5c0a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:23:01.069 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.067+0000 7f5d5610c800 20 remove_watcher() i=0 2024-09-22T08:23:01.069 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.067+0000 7f5d5610c800 2 removed watcher, disabling cache 2024-09-22T08:23:01.070 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.069+0000 7f5d5610c800 20 remove_watcher() i=1 2024-09-22T08:23:01.071 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.070+0000 7f5d5610c800 20 remove_watcher() i=2 2024-09-22T08:23:01.072 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.071+0000 7f5d5610c800 20 remove_watcher() i=3 2024-09-22T08:23:01.073 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.072+0000 7f5d5610c800 20 remove_watcher() i=4 2024-09-22T08:23:01.075 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.073+0000 7f5d5610c800 20 remove_watcher() i=5 2024-09-22T08:23:01.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.074+0000 7f5d5610c800 20 remove_watcher() i=6 2024-09-22T08:23:01.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:01.076+0000 7f5d5610c800 20 remove_watcher() i=7 2024-09-22T08:23:01.088 INFO:tasks.workunit.client.0.smithi038.stdout:phase 1.1 2024-09-22T08:23:01.110 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-22T08:23:01.111 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-22T08:23:01.111 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 24 tests from LibRGW 2024-09-22T08:23:01.111 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.INIT 2024-09-22T08:23:01.122 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:23:01.122 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:23:01.711 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.INIT (601 ms) 2024-09-22T08:23:01.712 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-22T08:23:01.713 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-22T08:23:01.713 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MOUNT 2024-09-22T08:23:01.713 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-22T08:23:01.713 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-22T08:23:01.721 INFO:tasks.workunit.client.0.smithi038.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-22T08:23:01.725 INFO:tasks.workunit.client.0.smithi038.stdout:creating: nfsroot:foo/f1 2024-09-22T08:23:01.729 INFO:tasks.workunit.client.0.smithi038.stdout:creating: nfsroot:foo/f2 2024-09-22T08:23:01.731 INFO:tasks.workunit.client.0.smithi038.stdout:creating: nfsroot:foo/bar/f1 2024-09-22T08:23:01.734 INFO:tasks.workunit.client.0.smithi038.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-22T08:23:01.737 INFO:tasks.workunit.client.0.smithi038.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-22T08:23:01.742 INFO:tasks.workunit.client.0.smithi038.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-22T08:23:01.743 INFO:tasks.workunit.client.0.smithi038.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-22T08:23:01.745 INFO:tasks.workunit.client.0.smithi038.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-22T08:23:01.748 INFO:tasks.workunit.client.0.smithi038.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-22T08:23:01.751 INFO:tasks.workunit.client.0.smithi038.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-22T08:23:01.754 INFO:tasks.workunit.client.0.smithi038.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-22T08:23:01.756 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SETUP_HIER1 (43 ms) 2024-09-22T08:23:01.756 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-22T08:23:01.861 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SETUP_DIRS1 (105 ms) 2024-09-22T08:23:01.861 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SETATTR 2024-09-22T08:23:01.861 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-22T08:23:01.861 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-22T08:23:01.879 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (18 ms) 2024-09-22T08:23:01.879 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-22T08:23:01.920 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (41 ms) 2024-09-22T08:23:01.921 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-22T08:23:01.921 INFO:tasks.workunit.client.0.smithi038.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-22T08:23:01.927 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (7 ms) 2024-09-22T08:23:01.927 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-22T08:23:01.927 INFO:tasks.workunit.client.0.smithi038.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-22T08:23:01.933 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (6 ms) 2024-09-22T08:23:01.933 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-22T08:23:01.933 INFO:tasks.workunit.client.0.smithi038.stdout:scanning objects in /bdirs1/dir_0 2024-09-22T08:23:01.934 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-22T08:23:01.934 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-22T08:23:01.934 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-22T08:23:01.934 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-22T08:23:01.934 INFO:tasks.workunit.client.0.smithi038.stdout:scanning objects in /bdirs1/dir_1 2024-09-22T08:23:01.934 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-22T08:23:01.934 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-22T08:23:01.934 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-22T08:23:01.934 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-22T08:23:01.934 INFO:tasks.workunit.client.0.smithi038.stdout:scanning objects in /bdirs1/dir_2 2024-09-22T08:23:01.934 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-22T08:23:01.934 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-22T08:23:01.934 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-22T08:23:01.935 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-22T08:23:01.935 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-22T08:23:01.935 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-22T08:23:01.935 INFO:tasks.workunit.client.0.smithi038.stdout:read back objects in /bdirs1/dir_0 2024-09-22T08:23:01.935 INFO:tasks.workunit.client.0.smithi038.stdout:reading 0,256 dir_0/sfile_0 2024-09-22T08:23:01.935 INFO:tasks.workunit.client.0.smithi038.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-22T08:23:01.935 INFO:tasks.workunit.client.0.smithi038.stdout:reading 0,256 dir_0/sfile_1 2024-09-22T08:23:01.936 INFO:tasks.workunit.client.0.smithi038.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-22T08:23:01.936 INFO:tasks.workunit.client.0.smithi038.stdout:read back objects in /bdirs1/dir_1 2024-09-22T08:23:01.936 INFO:tasks.workunit.client.0.smithi038.stdout:reading 0,256 dir_1/sfile_0 2024-09-22T08:23:01.937 INFO:tasks.workunit.client.0.smithi038.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-22T08:23:01.937 INFO:tasks.workunit.client.0.smithi038.stdout:reading 0,256 dir_1/sfile_1 2024-09-22T08:23:01.938 INFO:tasks.workunit.client.0.smithi038.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-22T08:23:01.938 INFO:tasks.workunit.client.0.smithi038.stdout:read back objects in /bdirs1/dir_2 2024-09-22T08:23:01.938 INFO:tasks.workunit.client.0.smithi038.stdout:reading 0,256 dir_2/sfile_0 2024-09-22T08:23:01.939 INFO:tasks.workunit.client.0.smithi038.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-22T08:23:01.939 INFO:tasks.workunit.client.0.smithi038.stdout:reading 0,256 dir_2/sfile_1 2024-09-22T08:23:01.940 INFO:tasks.workunit.client.0.smithi038.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-22T08:23:01.940 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.READ_DIRS1 (7 ms) 2024-09-22T08:23:01.940 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-22T08:23:02.120 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.READF_SETUP1 (180 ms) 2024-09-22T08:23:02.120 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-22T08:23:02.120 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-22T08:23:02.121 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-22T08:23:02.121 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-22T08:23:02.121 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-22T08:23:02.121 INFO:tasks.workunit.client.0.smithi038.stdout:release sdir_0 type: DIR refs: 2 2024-09-22T08:23:02.121 INFO:tasks.workunit.client.0.smithi038.stdout:release sfile_0 type: FILE refs: 2 2024-09-22T08:23:02.121 INFO:tasks.workunit.client.0.smithi038.stdout:release sdir_1 type: DIR refs: 2 2024-09-22T08:23:02.121 INFO:tasks.workunit.client.0.smithi038.stdout:release sfile_1 type: FILE refs: 2 2024-09-22T08:23:02.121 INFO:tasks.workunit.client.0.smithi038.stdout:release sdir_0 type: DIR refs: 2 2024-09-22T08:23:02.121 INFO:tasks.workunit.client.0.smithi038.stdout:release sfile_0 type: FILE refs: 2 2024-09-22T08:23:02.121 INFO:tasks.workunit.client.0.smithi038.stdout:release sdir_1 type: DIR refs: 2 2024-09-22T08:23:02.121 INFO:tasks.workunit.client.0.smithi038.stdout:release sfile_1 type: FILE refs: 2 2024-09-22T08:23:02.121 INFO:tasks.workunit.client.0.smithi038.stdout:release sdir_0 type: DIR refs: 2 2024-09-22T08:23:02.121 INFO:tasks.workunit.client.0.smithi038.stdout:release sfile_0 type: FILE refs: 2 2024-09-22T08:23:02.121 INFO:tasks.workunit.client.0.smithi038.stdout:release sdir_1 type: DIR refs: 2 2024-09-22T08:23:02.121 INFO:tasks.workunit.client.0.smithi038.stdout:release sfile_1 type: FILE refs: 2 2024-09-22T08:23:02.121 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-22T08:23:02.122 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.HIER1 2024-09-22T08:23:02.127 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-22T08:23:02.128 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-22T08:23:02.131 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-22T08:23:02.132 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-22T08:23:02.136 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-22T08:23:02.136 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-22T08:23:02.137 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-22T08:23:02.137 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-22T08:23:02.138 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-22T08:23:02.138 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-22T08:23:02.139 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-22T08:23:02.141 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-22T08:23:02.141 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-22T08:23:02.141 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-22T08:23:02.141 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo (foo): DIR 2024-09-22T08:23:02.141 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot (nfsroot): DIR 2024-09-22T08:23:02.141 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.HIER1 (21 ms) 2024-09-22T08:23:02.141 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-22T08:23:02.141 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-22T08:23:02.141 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-22T08:23:02.142 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-22T08:23:02.142 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-22T08:23:02.142 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-22T08:23:02.142 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-22T08:23:02.142 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-22T08:23:02.142 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-22T08:23:02.142 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-22T08:23:02.142 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-22T08:23:02.142 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-22T08:23:02.142 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-22T08:23:02.142 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:02.139+0000 7f8cca8bf8c0 -1 shutting down 2024-09-22T08:23:02.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:02.140+0000 7f8ba1b5a640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 62882, si_uid : 1000, si_addr0x3e80000f5a2, si_status0 2024-09-22T08:23:32.055 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SHUTDOWN (29914 ms) 2024-09-22T08:23:32.055 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 24 tests from LibRGW (30945 ms total) 2024-09-22T08:23:32.055 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-22T08:23:32.055 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-22T08:23:32.055 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 24 tests from 1 test suite ran. (30945 ms total) 2024-09-22T08:23:32.055 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 24 tests. 2024-09-22T08:23:32.061 INFO:tasks.workunit.client.0.smithi038.stdout:phase 1.2 2024-09-22T08:23:32.088 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-22T08:23:32.088 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-22T08:23:32.088 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 24 tests from LibRGW 2024-09-22T08:23:32.088 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.INIT 2024-09-22T08:23:32.096 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:23:32.096 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:23:32.487 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.INIT (399 ms) 2024-09-22T08:23:32.487 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-22T08:23:32.488 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-22T08:23:32.489 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MOUNT 2024-09-22T08:23:32.489 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-22T08:23:32.489 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-22T08:23:32.489 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-22T08:23:32.489 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-22T08:23:32.489 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-22T08:23:32.489 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SETATTR 2024-09-22T08:23:32.489 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-22T08:23:32.489 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-22T08:23:32.489 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-22T08:23:32.489 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-22T08:23:32.489 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-22T08:23:32.489 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-22T08:23:32.489 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-22T08:23:32.490 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-22T08:23:32.490 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-22T08:23:32.490 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-22T08:23:32.490 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-22T08:23:32.490 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-22T08:23:32.490 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-22T08:23:32.490 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-22T08:23:32.490 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-22T08:23:32.490 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-22T08:23:32.490 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-22T08:23:32.490 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-22T08:23:32.490 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-22T08:23:32.490 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-22T08:23:32.490 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-22T08:23:32.491 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.HIER1 2024-09-22T08:23:32.491 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-22T08:23:32.491 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-22T08:23:32.491 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-22T08:23:32.491 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-22T08:23:32.491 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-22T08:23:32.491 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-22T08:23:32.491 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-22T08:23:32.491 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-22T08:23:32.491 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-22T08:23:32.491 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-22T08:23:32.491 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-22T08:23:32.491 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-22T08:23:32.491 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-22T08:23:32.492 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-22T08:23:32.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:32.487+0000 7fb21a8a48c0 -1 shutting down 2024-09-22T08:23:32.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:23:32.488+0000 7fb0f45e3640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 63501, si_uid : 1000, si_addr0x3e80000f80d, si_status0 2024-09-22T08:24:02.906 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SHUTDOWN (30417 ms) 2024-09-22T08:24:02.906 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 24 tests from LibRGW (30817 ms total) 2024-09-22T08:24:02.906 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-22T08:24:02.906 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-22T08:24:02.906 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 24 tests from 1 test suite ran. (30818 ms total) 2024-09-22T08:24:02.906 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 24 tests. 2024-09-22T08:24:02.911 INFO:tasks.workunit.client.0.smithi038.stdout:phase 1.3 2024-09-22T08:24:02.936 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-22T08:24:02.936 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-22T08:24:02.936 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 24 tests from LibRGW 2024-09-22T08:24:02.936 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.INIT 2024-09-22T08:24:02.947 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:24:02.947 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:24:03.550 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.INIT (614 ms) 2024-09-22T08:24:03.550 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-22T08:24:03.551 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-22T08:24:03.551 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MOUNT 2024-09-22T08:24:03.551 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-22T08:24:03.551 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-22T08:24:03.555 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SETUP_HIER1 (5 ms) 2024-09-22T08:24:03.556 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-22T08:24:03.614 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SETUP_DIRS1 (58 ms) 2024-09-22T08:24:03.614 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SETATTR 2024-09-22T08:24:03.614 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-22T08:24:03.614 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-22T08:24:03.614 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-22T08:24:03.615 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-22T08:24:03.615 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-22T08:24:03.615 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-22T08:24:03.615 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-22T08:24:03.615 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-22T08:24:03.615 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-22T08:24:03.615 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-22T08:24:03.615 INFO:tasks.workunit.client.0.smithi038.stdout:scanning objects in /bdirs1/dir_0 2024-09-22T08:24:03.615 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-22T08:24:03.615 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-22T08:24:03.615 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-22T08:24:03.615 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-22T08:24:03.615 INFO:tasks.workunit.client.0.smithi038.stdout:scanning objects in /bdirs1/dir_1 2024-09-22T08:24:03.615 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-22T08:24:03.616 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-22T08:24:03.616 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-22T08:24:03.616 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-22T08:24:03.616 INFO:tasks.workunit.client.0.smithi038.stdout:scanning objects in /bdirs1/dir_2 2024-09-22T08:24:03.616 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-22T08:24:03.616 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-22T08:24:03.616 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-22T08:24:03.616 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-22T08:24:03.616 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-22T08:24:03.616 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-22T08:24:03.616 INFO:tasks.workunit.client.0.smithi038.stdout:read back objects in /bdirs1/dir_0 2024-09-22T08:24:03.616 INFO:tasks.workunit.client.0.smithi038.stdout:reading 0,256 dir_0/sfile_0 2024-09-22T08:24:03.617 INFO:tasks.workunit.client.0.smithi038.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-22T08:24:03.617 INFO:tasks.workunit.client.0.smithi038.stdout:reading 0,256 dir_0/sfile_1 2024-09-22T08:24:03.617 INFO:tasks.workunit.client.0.smithi038.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-22T08:24:03.617 INFO:tasks.workunit.client.0.smithi038.stdout:read back objects in /bdirs1/dir_1 2024-09-22T08:24:03.617 INFO:tasks.workunit.client.0.smithi038.stdout:reading 0,256 dir_1/sfile_0 2024-09-22T08:24:03.618 INFO:tasks.workunit.client.0.smithi038.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-22T08:24:03.618 INFO:tasks.workunit.client.0.smithi038.stdout:reading 0,256 dir_1/sfile_1 2024-09-22T08:24:03.619 INFO:tasks.workunit.client.0.smithi038.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-22T08:24:03.619 INFO:tasks.workunit.client.0.smithi038.stdout:read back objects in /bdirs1/dir_2 2024-09-22T08:24:03.619 INFO:tasks.workunit.client.0.smithi038.stdout:reading 0,256 dir_2/sfile_0 2024-09-22T08:24:03.619 INFO:tasks.workunit.client.0.smithi038.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-22T08:24:03.619 INFO:tasks.workunit.client.0.smithi038.stdout:reading 0,256 dir_2/sfile_1 2024-09-22T08:24:03.621 INFO:tasks.workunit.client.0.smithi038.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-22T08:24:03.621 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.READ_DIRS1 (7 ms) 2024-09-22T08:24:03.621 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-22T08:24:03.622 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-22T08:24:03.622 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-22T08:24:03.622 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-22T08:24:03.622 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-22T08:24:03.622 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-22T08:24:03.622 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-22T08:24:03.622 INFO:tasks.workunit.client.0.smithi038.stdout:release sdir_0 type: DIR refs: 2 2024-09-22T08:24:03.622 INFO:tasks.workunit.client.0.smithi038.stdout:release sfile_0 type: FILE refs: 2 2024-09-22T08:24:03.622 INFO:tasks.workunit.client.0.smithi038.stdout:release sdir_1 type: DIR refs: 2 2024-09-22T08:24:03.622 INFO:tasks.workunit.client.0.smithi038.stdout:release sfile_1 type: FILE refs: 2 2024-09-22T08:24:03.622 INFO:tasks.workunit.client.0.smithi038.stdout:release sdir_0 type: DIR refs: 2 2024-09-22T08:24:03.622 INFO:tasks.workunit.client.0.smithi038.stdout:release sfile_0 type: FILE refs: 2 2024-09-22T08:24:03.622 INFO:tasks.workunit.client.0.smithi038.stdout:release sdir_1 type: DIR refs: 2 2024-09-22T08:24:03.623 INFO:tasks.workunit.client.0.smithi038.stdout:release sfile_1 type: FILE refs: 2 2024-09-22T08:24:03.623 INFO:tasks.workunit.client.0.smithi038.stdout:release sdir_0 type: DIR refs: 2 2024-09-22T08:24:03.623 INFO:tasks.workunit.client.0.smithi038.stdout:release sfile_0 type: FILE refs: 2 2024-09-22T08:24:03.623 INFO:tasks.workunit.client.0.smithi038.stdout:release sdir_1 type: DIR refs: 2 2024-09-22T08:24:03.623 INFO:tasks.workunit.client.0.smithi038.stdout:release sfile_1 type: FILE refs: 2 2024-09-22T08:24:03.623 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-22T08:24:03.623 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.HIER1 2024-09-22T08:24:03.628 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-22T08:24:03.629 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-22T08:24:03.632 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-22T08:24:03.634 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-22T08:24:03.637 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-22T08:24:03.637 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-22T08:24:03.638 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-22T08:24:03.638 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-22T08:24:03.639 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-22T08:24:03.639 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-22T08:24:03.639 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-22T08:24:03.642 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-22T08:24:03.642 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-22T08:24:03.642 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-22T08:24:03.642 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo (foo): DIR 2024-09-22T08:24:03.642 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot (nfsroot): DIR 2024-09-22T08:24:03.642 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.HIER1 (21 ms) 2024-09-22T08:24:03.642 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-22T08:24:03.643 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-22T08:24:03.643 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-22T08:24:03.643 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-22T08:24:03.643 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-22T08:24:03.643 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-22T08:24:03.643 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-22T08:24:03.643 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-22T08:24:03.643 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-22T08:24:03.643 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-22T08:24:03.643 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-22T08:24:03.643 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-22T08:24:03.643 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-22T08:24:03.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:24:03.640+0000 7f32fe8808c0 -1 shutting down 2024-09-22T08:24:03.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:24:03.641+0000 7f31d85bf640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64120, si_uid : 1000, si_addr0x3e80000fa78, si_status0 2024-09-22T08:24:33.789 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SHUTDOWN (30147 ms) 2024-09-22T08:24:33.789 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 24 tests from LibRGW (30853 ms total) 2024-09-22T08:24:33.790 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-22T08:24:33.790 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-22T08:24:33.790 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 24 tests from 1 test suite ran. (30853 ms total) 2024-09-22T08:24:33.790 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 24 tests. 2024-09-22T08:24:33.796 INFO:tasks.workunit.client.0.smithi038.stdout:phase 2.1 2024-09-22T08:24:33.822 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-22T08:24:33.822 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-22T08:24:33.822 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 9 tests from LibRGW 2024-09-22T08:24:33.822 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.INIT 2024-09-22T08:24:33.832 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:24:33.832 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:24:34.230 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.INIT (408 ms) 2024-09-22T08:24:34.230 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MOUNT 2024-09-22T08:24:34.231 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-22T08:24:34.231 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-22T08:24:34.240 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CREATE_BUCKET (9 ms) 2024-09-22T08:24:34.240 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-22T08:24:34.240 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-22T08:24:34.240 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-22T08:24:34.248 INFO:tasks.workunit.client.0.smithi038.stdout:created: sorrydave0 2024-09-22T08:24:34.257 INFO:tasks.workunit.client.0.smithi038.stdout:created: sorrydave1 2024-09-22T08:24:34.266 INFO:tasks.workunit.client.0.smithi038.stdout:created: sorrydave2 2024-09-22T08:24:34.274 INFO:tasks.workunit.client.0.smithi038.stdout:created: sorrydave3 2024-09-22T08:24:34.283 INFO:tasks.workunit.client.0.smithi038.stdout:created: sorrydave4 2024-09-22T08:24:34.291 INFO:tasks.workunit.client.0.smithi038.stdout:created: sorrydave5 2024-09-22T08:24:34.298 INFO:tasks.workunit.client.0.smithi038.stdout:created: sorrydave6 2024-09-22T08:24:34.307 INFO:tasks.workunit.client.0.smithi038.stdout:created: sorrydave7 2024-09-22T08:24:34.315 INFO:tasks.workunit.client.0.smithi038.stdout:created: sorrydave8 2024-09-22T08:24:34.322 INFO:tasks.workunit.client.0.smithi038.stdout:created: sorrydave9 2024-09-22T08:24:34.323 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (83 ms) 2024-09-22T08:24:34.323 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-22T08:24:34.594 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (271 ms) 2024-09-22T08:24:34.594 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-22T08:24:34.594 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-22T08:24:34.594 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-22T08:24:34.594 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-22T08:24:34.594 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-22T08:24:34.595 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:24:34.593+0000 7f459fc538c0 -1 shutting down 2024-09-22T08:24:34.595 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:24:34.594+0000 7f4479992640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64739, si_uid : 1000, si_addr0x3e80000fce3, si_status0 2024-09-22T08:25:04.324 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SHUTDOWN (29729 ms) 2024-09-22T08:25:04.324 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 9 tests from LibRGW (30501 ms total) 2024-09-22T08:25:04.324 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-22T08:25:04.324 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-22T08:25:04.324 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 9 tests from 1 test suite ran. (30501 ms total) 2024-09-22T08:25:04.324 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 9 tests. 2024-09-22T08:25:04.330 INFO:tasks.workunit.client.0.smithi038.stdout:phase 2.2 2024-09-22T08:25:04.355 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-22T08:25:04.355 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-22T08:25:04.356 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 9 tests from LibRGW 2024-09-22T08:25:04.356 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.INIT 2024-09-22T08:25:04.364 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:25:04.365 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:25:04.964 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.INIT (608 ms) 2024-09-22T08:25:04.964 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MOUNT 2024-09-22T08:25:04.964 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-22T08:25:04.964 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-22T08:25:04.964 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-22T08:25:04.964 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-22T08:25:04.994 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.DELETE_BUCKET (30 ms) 2024-09-22T08:25:04.994 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-22T08:25:05.002 INFO:tasks.workunit.client.0.smithi038.stdout:created: sorrydave0 2024-09-22T08:25:05.010 INFO:tasks.workunit.client.0.smithi038.stdout:created: sorrydave1 2024-09-22T08:25:05.019 INFO:tasks.workunit.client.0.smithi038.stdout:created: sorrydave2 2024-09-22T08:25:05.028 INFO:tasks.workunit.client.0.smithi038.stdout:created: sorrydave3 2024-09-22T08:25:05.037 INFO:tasks.workunit.client.0.smithi038.stdout:created: sorrydave4 2024-09-22T08:25:05.044 INFO:tasks.workunit.client.0.smithi038.stdout:created: sorrydave5 2024-09-22T08:25:05.052 INFO:tasks.workunit.client.0.smithi038.stdout:created: sorrydave6 2024-09-22T08:25:05.061 INFO:tasks.workunit.client.0.smithi038.stdout:created: sorrydave7 2024-09-22T08:25:05.069 INFO:tasks.workunit.client.0.smithi038.stdout:created: sorrydave8 2024-09-22T08:25:05.077 INFO:tasks.workunit.client.0.smithi038.stdout:created: sorrydave9 2024-09-22T08:25:05.077 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (83 ms) 2024-09-22T08:25:05.077 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-22T08:25:05.351 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (274 ms) 2024-09-22T08:25:05.351 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-22T08:25:05.351 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-22T08:25:05.351 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-22T08:25:05.351 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-22T08:25:05.351 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-22T08:25:05.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:25:05.350+0000 7fe9450878c0 -1 shutting down 2024-09-22T08:25:05.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:25:05.351+0000 7fe81edc4640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65358, si_uid : 1000, si_addr0x3e80000ff4e, si_status0 2024-09-22T08:25:35.277 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SHUTDOWN (29926 ms) 2024-09-22T08:25:35.277 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 9 tests from LibRGW (30922 ms total) 2024-09-22T08:25:35.277 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-22T08:25:35.278 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-22T08:25:35.278 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 9 tests from 1 test suite ran. (30922 ms total) 2024-09-22T08:25:35.278 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 9 tests. 2024-09-22T08:25:35.283 INFO:tasks.workunit.client.0.smithi038.stdout:phase 3.1 2024-09-22T08:25:35.615 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-22T08:25:35.615 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-22T08:25:35.615 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 13 tests from LibRGW 2024-09-22T08:25:35.615 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.INIT 2024-09-22T08:25:35.624 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:25:35.624 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:25:36.011 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.INIT (396 ms) 2024-09-22T08:25:36.011 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MOUNT 2024-09-22T08:25:36.012 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-22T08:25:36.012 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-22T08:25:36.020 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CREATE_BUCKET (8 ms) 2024-09-22T08:25:36.020 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-22T08:25:36.023 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (3 ms) 2024-09-22T08:25:36.023 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-22T08:25:36.025 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-22T08:25:36.025 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.LARGE1 2024-09-22T08:25:36.482 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.LARGE1 (457 ms) 2024-09-22T08:25:36.483 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.LARGE2 2024-09-22T08:25:36.526 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.LARGE2 (44 ms) 2024-09-22T08:25:36.527 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-22T08:25:36.527 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-22T08:25:36.527 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-22T08:25:36.527 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-22T08:25:36.527 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-22T08:25:36.527 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-22T08:25:36.527 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-22T08:25:36.527 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-22T08:25:36.527 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-22T08:25:36.527 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-22T08:25:36.527 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-22T08:25:36.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:25:36.525+0000 7f906a1628c0 -1 shutting down 2024-09-22T08:25:36.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:25:36.527+0000 7f8f42165640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65977, si_uid : 1000, si_addr0x3e8000101b9, si_status0 2024-09-22T08:26:06.253 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SHUTDOWN (29727 ms) 2024-09-22T08:26:06.254 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 13 tests from LibRGW (30638 ms total) 2024-09-22T08:26:06.254 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-22T08:26:06.254 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-22T08:26:06.254 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 13 tests from 1 test suite ran. (30638 ms total) 2024-09-22T08:26:06.254 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 13 tests. 2024-09-22T08:26:06.261 INFO:tasks.workunit.client.0.smithi038.stdout:phase 3.2 2024-09-22T08:26:06.592 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-22T08:26:06.592 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-22T08:26:06.592 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 13 tests from LibRGW 2024-09-22T08:26:06.593 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.INIT 2024-09-22T08:26:06.600 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:26:06.601 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:26:06.988 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.INIT (396 ms) 2024-09-22T08:26:06.988 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MOUNT 2024-09-22T08:26:06.989 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-22T08:26:06.989 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-22T08:26:06.989 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-22T08:26:06.989 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-22T08:26:06.993 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2024-09-22T08:26:06.994 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-22T08:26:06.997 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (3 ms) 2024-09-22T08:26:06.997 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.LARGE1 2024-09-22T08:26:07.076 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.LARGE1 (79 ms) 2024-09-22T08:26:07.076 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.LARGE2 2024-09-22T08:26:07.076 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-22T08:26:07.076 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-22T08:26:07.076 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-22T08:26:07.076 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-22T08:26:07.081 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.DELETE_OBJECT (5 ms) 2024-09-22T08:26:07.081 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-22T08:26:07.110 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.DELETE_BUCKET (28 ms) 2024-09-22T08:26:07.110 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-22T08:26:07.110 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CLEANUP (1 ms) 2024-09-22T08:26:07.110 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-22T08:26:07.110 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-22T08:26:07.110 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-22T08:26:07.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:26:07.109+0000 7f2597d1d8c0 -1 shutting down 2024-09-22T08:26:07.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:26:07.110+0000 7f2471a5c640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66598, si_uid : 1000, si_addr0x3e800010426, si_status0 2024-09-22T08:26:37.215 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SHUTDOWN (30104 ms) 2024-09-22T08:26:37.215 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 13 tests from LibRGW (30622 ms total) 2024-09-22T08:26:37.215 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-22T08:26:37.215 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-22T08:26:37.215 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 13 tests from 1 test suite ran. (30622 ms total) 2024-09-22T08:26:37.215 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 13 tests. 2024-09-22T08:26:37.222 INFO:tasks.workunit.client.0.smithi038.stdout:phase 4.1 2024-09-22T08:26:37.248 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-22T08:26:37.249 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-22T08:26:37.249 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 11 tests from LibRGW 2024-09-22T08:26:37.249 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.TVAR 2024-09-22T08:26:37.249 INFO:tasks.workunit.client.0.smithi038.stdout:read i1: 64001 2024-09-22T08:26:37.249 INFO:tasks.workunit.client.0.smithi038.stdout:read s1: blunderbuss 2024-09-22T08:26:37.249 INFO:tasks.workunit.client.0.smithi038.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-22T08:26:37.249 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.INIT 2024-09-22T08:26:37.260 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:26:37.260 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:26:37.864 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.INIT (616 ms) 2024-09-22T08:26:37.864 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MOUNT 2024-09-22T08:26:37.865 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-22T08:26:37.865 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-22T08:26:37.882 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (17 ms) 2024-09-22T08:26:37.882 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-22T08:26:38.314 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_0 2024-09-22T08:26:38.314 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_1 2024-09-22T08:26:38.314 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_2 2024-09-22T08:26:38.314 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_3 2024-09-22T08:26:38.315 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_4 2024-09-22T08:26:38.315 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_5 2024-09-22T08:26:38.315 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_6 2024-09-22T08:26:38.315 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_7 2024-09-22T08:26:38.315 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_8 2024-09-22T08:26:38.315 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_9 2024-09-22T08:26:38.315 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_10 2024-09-22T08:26:38.315 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_11 2024-09-22T08:26:38.315 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_12 2024-09-22T08:26:38.315 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_13 2024-09-22T08:26:38.315 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_14 2024-09-22T08:26:38.315 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_15 2024-09-22T08:26:38.315 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_16 2024-09-22T08:26:38.315 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_17 2024-09-22T08:26:38.316 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_18 2024-09-22T08:26:38.316 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_19 2024-09-22T08:26:38.316 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_20 2024-09-22T08:26:38.316 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_21 2024-09-22T08:26:38.316 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_22 2024-09-22T08:26:38.316 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_23 2024-09-22T08:26:38.316 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_24 2024-09-22T08:26:38.316 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_25 2024-09-22T08:26:38.316 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_26 2024-09-22T08:26:38.316 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_27 2024-09-22T08:26:38.316 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_28 2024-09-22T08:26:38.316 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_29 2024-09-22T08:26:38.316 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_30 2024-09-22T08:26:38.316 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_31 2024-09-22T08:26:38.317 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_32 2024-09-22T08:26:38.317 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_33 2024-09-22T08:26:38.317 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_34 2024-09-22T08:26:38.317 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_35 2024-09-22T08:26:38.317 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_36 2024-09-22T08:26:38.317 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_37 2024-09-22T08:26:38.317 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_38 2024-09-22T08:26:38.317 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_39 2024-09-22T08:26:38.317 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_40 2024-09-22T08:26:38.317 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_41 2024-09-22T08:26:38.317 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_42 2024-09-22T08:26:38.317 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_43 2024-09-22T08:26:38.317 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_44 2024-09-22T08:26:38.317 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_45 2024-09-22T08:26:38.317 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_46 2024-09-22T08:26:38.318 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_47 2024-09-22T08:26:38.318 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_48 2024-09-22T08:26:38.318 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_49 2024-09-22T08:26:38.318 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_50 2024-09-22T08:26:38.318 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_51 2024-09-22T08:26:38.318 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_52 2024-09-22T08:26:38.318 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_53 2024-09-22T08:26:38.318 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_54 2024-09-22T08:26:38.318 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_55 2024-09-22T08:26:38.318 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_56 2024-09-22T08:26:38.318 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_57 2024-09-22T08:26:38.318 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_58 2024-09-22T08:26:38.318 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_59 2024-09-22T08:26:38.318 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_60 2024-09-22T08:26:38.318 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_61 2024-09-22T08:26:38.319 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_62 2024-09-22T08:26:38.319 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_63 2024-09-22T08:26:38.319 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_64 2024-09-22T08:26:38.319 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_65 2024-09-22T08:26:38.319 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_66 2024-09-22T08:26:38.319 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_67 2024-09-22T08:26:38.319 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_68 2024-09-22T08:26:38.319 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_69 2024-09-22T08:26:38.319 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_70 2024-09-22T08:26:38.319 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_71 2024-09-22T08:26:38.319 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_72 2024-09-22T08:26:38.319 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_73 2024-09-22T08:26:38.319 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_74 2024-09-22T08:26:38.319 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_75 2024-09-22T08:26:38.320 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_76 2024-09-22T08:26:38.320 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_77 2024-09-22T08:26:38.320 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_78 2024-09-22T08:26:38.320 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_79 2024-09-22T08:26:38.320 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_80 2024-09-22T08:26:38.320 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_81 2024-09-22T08:26:38.320 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_82 2024-09-22T08:26:38.320 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_83 2024-09-22T08:26:38.320 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_84 2024-09-22T08:26:38.320 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_85 2024-09-22T08:26:38.320 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_86 2024-09-22T08:26:38.320 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_87 2024-09-22T08:26:38.320 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_88 2024-09-22T08:26:38.320 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_89 2024-09-22T08:26:38.321 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_90 2024-09-22T08:26:38.321 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_91 2024-09-22T08:26:38.321 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_92 2024-09-22T08:26:38.321 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_93 2024-09-22T08:26:38.321 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_94 2024-09-22T08:26:38.321 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_95 2024-09-22T08:26:38.321 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_96 2024-09-22T08:26:38.321 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_97 2024-09-22T08:26:38.321 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_98 2024-09-22T08:26:38.321 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_99 2024-09-22T08:26:38.321 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (432 ms) 2024-09-22T08:26:38.321 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-22T08:26:38.323 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-22T08:26:38.323 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-22T08:26:38.323 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-22T08:26:38.323 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-22T08:26:38.323 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-22T08:26:38.323 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-22T08:26:38.323 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-22T08:26:38.323 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-22T08:26:38.323 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-22T08:26:38.323 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-22T08:26:38.323 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-22T08:26:38.323 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-22T08:26:38.323 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-22T08:26:38.324 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-22T08:26:38.324 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-22T08:26:38.324 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-22T08:26:38.324 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-22T08:26:38.324 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-22T08:26:38.324 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-22T08:26:38.324 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-22T08:26:38.324 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-22T08:26:38.324 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-22T08:26:38.324 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-22T08:26:38.324 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-22T08:26:38.324 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-22T08:26:38.324 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-22T08:26:38.324 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-22T08:26:38.325 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-22T08:26:38.325 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-22T08:26:38.325 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-22T08:26:38.325 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-22T08:26:38.325 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-22T08:26:38.325 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-22T08:26:38.325 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-22T08:26:38.325 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-22T08:26:38.325 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-22T08:26:38.325 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-22T08:26:38.325 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-22T08:26:38.325 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-22T08:26:38.325 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-22T08:26:38.326 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-22T08:26:38.326 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-22T08:26:38.326 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-22T08:26:38.326 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-22T08:26:38.326 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-22T08:26:38.326 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-22T08:26:38.326 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-22T08:26:38.326 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-22T08:26:38.326 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-22T08:26:38.326 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-22T08:26:38.326 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-22T08:26:38.326 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-22T08:26:38.326 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-22T08:26:38.326 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-22T08:26:38.326 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-22T08:26:38.327 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-22T08:26:38.327 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-22T08:26:38.327 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-22T08:26:38.327 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-22T08:26:38.327 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-22T08:26:38.327 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-22T08:26:38.327 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-22T08:26:38.327 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-22T08:26:38.327 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-22T08:26:38.327 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-22T08:26:38.327 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-22T08:26:38.327 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-22T08:26:38.327 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-22T08:26:38.327 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-22T08:26:38.328 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-22T08:26:38.328 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-22T08:26:38.328 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-22T08:26:38.328 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-22T08:26:38.328 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-22T08:26:38.328 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-22T08:26:38.328 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-22T08:26:38.328 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-22T08:26:38.328 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-22T08:26:38.328 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-22T08:26:38.328 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-22T08:26:38.328 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-22T08:26:38.328 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-22T08:26:38.328 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-22T08:26:38.328 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-22T08:26:38.329 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-22T08:26:38.329 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-22T08:26:38.329 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-22T08:26:38.329 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-22T08:26:38.329 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-22T08:26:38.329 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-22T08:26:38.329 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-22T08:26:38.329 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-22T08:26:38.329 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-22T08:26:38.329 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-22T08:26:38.329 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-22T08:26:38.329 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-22T08:26:38.329 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-22T08:26:38.329 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-22T08:26:38.329 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-22T08:26:38.330 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-22T08:26:38.330 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-22T08:26:38.330 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-22T08:26:38.330 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER1_READDIR (2 ms) 2024-09-22T08:26:38.330 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-22T08:26:38.330 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-22T08:26:38.330 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-22T08:26:38.330 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-22T08:26:38.330 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-22T08:26:38.330 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-22T08:26:38.330 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-22T08:26:38.330 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-22T08:26:38.330 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-22T08:26:38.330 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-22T08:26:38.331 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-22T08:26:38.331 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-22T08:26:38.331 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-22T08:26:38.331 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-22T08:26:38.331 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-22T08:26:38.331 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-22T08:26:38.331 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-22T08:26:38.331 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-22T08:26:38.331 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-22T08:26:38.331 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-22T08:26:38.331 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-22T08:26:38.331 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-22T08:26:38.331 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-22T08:26:38.331 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-22T08:26:38.331 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-22T08:26:38.332 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-22T08:26:38.332 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-22T08:26:38.332 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-22T08:26:38.332 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-22T08:26:38.332 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-22T08:26:38.332 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-22T08:26:38.332 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-22T08:26:38.332 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-22T08:26:38.332 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-22T08:26:38.332 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-22T08:26:38.332 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-22T08:26:38.332 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-22T08:26:38.332 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-22T08:26:38.332 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-22T08:26:38.333 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-22T08:26:38.333 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-22T08:26:38.333 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-22T08:26:38.333 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-22T08:26:38.333 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-22T08:26:38.333 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-22T08:26:38.333 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-22T08:26:38.333 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-22T08:26:38.333 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-22T08:26:38.333 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-22T08:26:38.333 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-22T08:26:38.333 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-22T08:26:38.333 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-22T08:26:38.333 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-22T08:26:38.333 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-22T08:26:38.334 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-22T08:26:38.334 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-22T08:26:38.334 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-22T08:26:38.334 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-22T08:26:38.334 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-22T08:26:38.334 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-22T08:26:38.334 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-22T08:26:38.334 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-22T08:26:38.334 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-22T08:26:38.334 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-22T08:26:38.334 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-22T08:26:38.334 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-22T08:26:38.334 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-22T08:26:38.335 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-22T08:26:38.335 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-22T08:26:38.335 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-22T08:26:38.335 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-22T08:26:38.335 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-22T08:26:38.335 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-22T08:26:38.335 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-22T08:26:38.335 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-22T08:26:38.335 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-22T08:26:38.335 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-22T08:26:38.335 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-22T08:26:38.335 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-22T08:26:38.335 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-22T08:26:38.335 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-22T08:26:38.335 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-22T08:26:38.336 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-22T08:26:38.336 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-22T08:26:38.336 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-22T08:26:38.336 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-22T08:26:38.336 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-22T08:26:38.336 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-22T08:26:38.336 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-22T08:26:38.336 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-22T08:26:38.336 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-22T08:26:38.336 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-22T08:26:38.336 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-22T08:26:38.336 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-22T08:26:38.336 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-22T08:26:38.336 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-22T08:26:38.336 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-22T08:26:38.337 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-22T08:26:38.337 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-22T08:26:38.337 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-22T08:26:38.337 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-22T08:26:38.337 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER2_READDIR (2 ms) 2024-09-22T08:26:38.337 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-22T08:26:38.337 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-22T08:26:38.337 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-22T08:26:38.337 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-22T08:26:38.337 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-22T08:26:38.337 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-22T08:26:38.337 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-22T08:26:38.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:26:38.316+0000 7f118c3428c0 -1 shutting down 2024-09-22T08:26:38.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:26:38.318+0000 7f106423f640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67217, si_uid : 1000, si_addr0x3e800010691, si_status0 2024-09-22T08:27:08.204 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SHUTDOWN (29885 ms) 2024-09-22T08:27:08.204 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 11 tests from LibRGW (30956 ms total) 2024-09-22T08:27:08.204 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-22T08:27:08.204 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-22T08:27:08.204 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 11 tests from 1 test suite ran. (30956 ms total) 2024-09-22T08:27:08.204 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 11 tests. 2024-09-22T08:27:08.211 INFO:tasks.workunit.client.0.smithi038.stdout:phase 4.2 2024-09-22T08:27:08.237 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-22T08:27:08.237 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-22T08:27:08.237 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 11 tests from LibRGW 2024-09-22T08:27:08.237 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.TVAR 2024-09-22T08:27:08.237 INFO:tasks.workunit.client.0.smithi038.stdout:read i1: 64001 2024-09-22T08:27:08.237 INFO:tasks.workunit.client.0.smithi038.stdout:read s1: blunderbuss 2024-09-22T08:27:08.237 INFO:tasks.workunit.client.0.smithi038.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-22T08:27:08.237 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.INIT 2024-09-22T08:27:08.246 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:27:08.246 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:27:08.851 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.INIT (614 ms) 2024-09-22T08:27:08.851 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MOUNT 2024-09-22T08:27:08.852 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-22T08:27:08.852 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-22T08:27:08.861 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (9 ms) 2024-09-22T08:27:08.861 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-22T08:27:08.861 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-22T08:27:08.861 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-22T08:27:08.861 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-22T08:27:08.861 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-22T08:27:08.864 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-22T08:27:08.864 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-22T08:27:08.864 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-22T08:27:08.864 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-22T08:27:08.864 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-22T08:27:08.864 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-22T08:27:08.864 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-22T08:27:08.864 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-22T08:27:08.864 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-22T08:27:08.864 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-22T08:27:08.864 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-22T08:27:08.864 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-22T08:27:08.865 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-22T08:27:08.865 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-22T08:27:08.865 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-22T08:27:08.865 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-22T08:27:08.865 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-22T08:27:08.865 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-22T08:27:08.865 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-22T08:27:08.865 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-22T08:27:08.865 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-22T08:27:08.865 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-22T08:27:08.865 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-22T08:27:08.865 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-22T08:27:08.865 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-22T08:27:08.865 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-22T08:27:08.866 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-22T08:27:08.866 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-22T08:27:08.866 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-22T08:27:08.866 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-22T08:27:08.866 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-22T08:27:08.866 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-22T08:27:08.866 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-22T08:27:08.866 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-22T08:27:08.866 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-22T08:27:08.866 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-22T08:27:08.866 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-22T08:27:08.866 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-22T08:27:08.866 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-22T08:27:08.866 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-22T08:27:08.867 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-22T08:27:08.867 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-22T08:27:08.867 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-22T08:27:08.867 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-22T08:27:08.867 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-22T08:27:08.867 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-22T08:27:08.867 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-22T08:27:08.867 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-22T08:27:08.867 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-22T08:27:08.867 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-22T08:27:08.867 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-22T08:27:08.867 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-22T08:27:08.867 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-22T08:27:08.867 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-22T08:27:08.868 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-22T08:27:08.868 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-22T08:27:08.868 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-22T08:27:08.868 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-22T08:27:08.868 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-22T08:27:08.868 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-22T08:27:08.868 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-22T08:27:08.868 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-22T08:27:08.868 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-22T08:27:08.868 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-22T08:27:08.868 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-22T08:27:08.868 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-22T08:27:08.868 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-22T08:27:08.868 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-22T08:27:08.868 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-22T08:27:08.868 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-22T08:27:08.869 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-22T08:27:08.869 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-22T08:27:08.869 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-22T08:27:08.869 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-22T08:27:08.869 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-22T08:27:08.869 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-22T08:27:08.869 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-22T08:27:08.869 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-22T08:27:08.869 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-22T08:27:08.869 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-22T08:27:08.869 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-22T08:27:08.869 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-22T08:27:08.869 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-22T08:27:08.869 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-22T08:27:08.869 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-22T08:27:08.869 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-22T08:27:08.870 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-22T08:27:08.870 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-22T08:27:08.870 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-22T08:27:08.870 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-22T08:27:08.870 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-22T08:27:08.870 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-22T08:27:08.870 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-22T08:27:08.870 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-22T08:27:08.870 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-22T08:27:08.870 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-22T08:27:08.870 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-22T08:27:08.870 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-22T08:27:08.870 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-22T08:27:08.870 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-22T08:27:08.871 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER2_READDIR (3 ms) 2024-09-22T08:27:08.871 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-22T08:27:08.871 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-22T08:27:08.871 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-22T08:27:08.871 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-22T08:27:08.871 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-22T08:27:08.871 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-22T08:27:08.871 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-22T08:27:08.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:27:08.863+0000 7f0ebfc538c0 -1 shutting down 2024-09-22T08:27:08.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:27:08.864+0000 7f0d99992640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67837, si_uid : 1000, si_addr0x3e8000108fd, si_status0 2024-09-22T08:27:39.263 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SHUTDOWN (30399 ms) 2024-09-22T08:27:39.263 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 11 tests from LibRGW (31026 ms total) 2024-09-22T08:27:39.263 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-22T08:27:39.263 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-22T08:27:39.263 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 11 tests from 1 test suite ran. (31026 ms total) 2024-09-22T08:27:39.263 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 11 tests. 2024-09-22T08:27:39.269 INFO:tasks.workunit.client.0.smithi038.stdout:phase 5.1 2024-09-22T08:27:39.305 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-22T08:27:39.305 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-22T08:27:39.305 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 19 tests from LibRGW 2024-09-22T08:27:39.305 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.INIT 2024-09-22T08:27:39.315 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:27:39.316 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:27:39.708 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.INIT (403 ms) 2024-09-22T08:27:39.708 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MOUNT 2024-09-22T08:27:39.708 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-22T08:27:39.709 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-22T08:27:39.718 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CREATE_BUCKET (9 ms) 2024-09-22T08:27:39.718 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-22T08:27:39.721 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (3 ms) 2024-09-22T08:27:39.721 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-22T08:27:39.721 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-22T08:27:39.721 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-22T08:27:39.723 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-22T08:27:39.723 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-22T08:27:39.723 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-22T08:27:39.723 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-22T08:27:39.726 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.PUT_OBJECT (4 ms) 2024-09-22T08:27:39.727 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-22T08:27:39.730 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.GET_OBJECT (2 ms) 2024-09-22T08:27:39.730 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-22T08:27:39.730 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-22T08:27:39.730 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-22T08:27:39.730 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-22T08:27:39.730 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.WRITEV 2024-09-22T08:27:39.730 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-22T08:27:39.730 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.READV 2024-09-22T08:27:39.730 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-22T08:27:39.730 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-22T08:27:39.731 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-22T08:27:39.731 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-22T08:27:39.731 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-22T08:27:39.731 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-22T08:27:39.731 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-22T08:27:39.731 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-22T08:27:39.731 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-22T08:27:39.731 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-22T08:27:39.731 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-22T08:27:39.731 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-22T08:27:39.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:27:39.728+0000 7f0bb1a2f8c0 -1 shutting down 2024-09-22T08:27:39.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:27:39.729+0000 7f0a8b76e640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68456, si_uid : 1000, si_addr0x3e800010b68, si_status0 2024-09-22T08:28:10.146 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SHUTDOWN (30415 ms) 2024-09-22T08:28:10.146 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 19 tests from LibRGW (30840 ms total) 2024-09-22T08:28:10.146 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-22T08:28:10.146 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-22T08:28:10.146 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 19 tests from 1 test suite ran. (30840 ms total) 2024-09-22T08:28:10.146 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 19 tests. 2024-09-22T08:28:10.152 INFO:tasks.workunit.client.0.smithi038.stdout:phase 5.2 2024-09-22T08:28:10.187 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-22T08:28:10.187 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-22T08:28:10.187 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 19 tests from LibRGW 2024-09-22T08:28:10.187 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.INIT 2024-09-22T08:28:10.195 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:28:10.195 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:28:10.590 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.INIT (403 ms) 2024-09-22T08:28:10.590 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MOUNT 2024-09-22T08:28:10.590 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-22T08:28:10.590 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-22T08:28:10.590 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-22T08:28:10.591 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-22T08:28:10.595 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2024-09-22T08:28:10.596 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-22T08:28:10.596 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-22T08:28:10.596 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-22T08:28:10.596 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-22T08:28:10.596 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-22T08:28:10.596 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-22T08:28:10.596 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-22T08:28:10.596 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-22T08:28:10.596 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-22T08:28:10.596 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-22T08:28:10.596 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-22T08:28:10.596 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-22T08:28:10.596 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-22T08:28:10.596 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-22T08:28:10.597 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.WRITEV 2024-09-22T08:28:10.597 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-22T08:28:10.597 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.READV 2024-09-22T08:28:10.597 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-22T08:28:10.597 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-22T08:28:10.597 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-22T08:28:10.597 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-22T08:28:10.598 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.DELETE_OBJECT (3 ms) 2024-09-22T08:28:10.599 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-22T08:28:10.630 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.DELETE_BUCKET (32 ms) 2024-09-22T08:28:10.630 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-22T08:28:10.630 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-22T08:28:10.630 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-22T08:28:10.630 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-22T08:28:10.630 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-22T08:28:10.630 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:28:10.629+0000 7fc36811f8c0 -1 shutting down 2024-09-22T08:28:10.631 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:28:10.630+0000 7fc23f6a4640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69075, si_uid : 1000, si_addr0x3e800010dd3, si_status0 2024-09-22T08:28:40.956 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SHUTDOWN (30325 ms) 2024-09-22T08:28:40.956 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 19 tests from LibRGW (30768 ms total) 2024-09-22T08:28:40.956 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-22T08:28:40.956 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-22T08:28:40.956 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 19 tests from 1 test suite ran. (30768 ms total) 2024-09-22T08:28:40.956 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 19 tests. 2024-09-22T08:28:40.962 INFO:tasks.workunit.client.0.smithi038.stdout:phase 6.1 2024-09-22T08:28:40.990 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-22T08:28:40.990 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-22T08:28:40.990 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 10 tests from LibRGW 2024-09-22T08:28:40.990 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.INIT 2024-09-22T08:28:40.997 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:28:40.997 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:28:41.186 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.INIT (196 ms) 2024-09-22T08:28:41.186 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MOUNT 2024-09-22T08:28:41.187 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-22T08:28:41.187 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-22T08:28:41.205 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CREATE_BUCKETS (18 ms) 2024-09-22T08:28:41.205 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-22T08:28:41.210 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (5 ms) 2024-09-22T08:28:41.210 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-22T08:28:41.226 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.TOPDIR_RENAME (17 ms) 2024-09-22T08:28:41.227 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-22T08:28:41.246 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SUBDIR_RENAME (19 ms) 2024-09-22T08:28:41.246 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-22T08:28:41.267 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (21 ms) 2024-09-22T08:28:41.267 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-22T08:28:41.267 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-22T08:28:41.267 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-22T08:28:41.267 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-22T08:28:41.267 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-22T08:28:41.267 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:28:41.266+0000 7f0ab18988c0 -1 shutting down 2024-09-22T08:28:41.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:28:41.267+0000 7f098b5d7640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69695, si_uid : 1000, si_addr0x3e80001103f, si_status0 2024-09-22T08:29:11.418 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SHUTDOWN (30151 ms) 2024-09-22T08:29:11.418 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 10 tests from LibRGW (30428 ms total) 2024-09-22T08:29:11.419 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-22T08:29:11.419 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-22T08:29:11.419 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 10 tests from 1 test suite ran. (30428 ms total) 2024-09-22T08:29:11.419 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 10 tests. 2024-09-22T08:29:11.425 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:29:11.425 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:29:11.470 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-22T08:29:11.471 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-22T08:29:11.472 DEBUG:teuthology.orchestra.run.smithi038:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-22T08:29:11.507 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -z ']' 2024-09-22T08:29:11.508 INFO:tasks.workunit.client.0.smithi038.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-22T08:29:11.508 INFO:tasks.workunit.client.0.smithi038.stderr:+ AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-22T08:29:11.508 INFO:tasks.workunit.client.0.smithi038.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-22T08:29:11.508 INFO:tasks.workunit.client.0.smithi038.stderr:+ AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-22T08:29:11.508 INFO:tasks.workunit.client.0.smithi038.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name 'maven test user' --email sigv4@example.com 2024-09-22T08:29:11.546 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:29:11.546 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:29:11.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.585+0000 7f8427926800 20 rados->read ofs=0 len=0 2024-09-22T08:29:11.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.587+0000 7f8427926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:29:11.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.587+0000 7f8427926800 20 realm 2024-09-22T08:29:11.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.587+0000 7f8427926800 20 rados->read ofs=0 len=0 2024-09-22T08:29:11.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.587+0000 7f8427926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:29:11.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.587+0000 7f8427926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:29:11.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.587+0000 7f8427926800 20 rados->read ofs=0 len=0 2024-09-22T08:29:11.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.588+0000 7f8427926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:29:11.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.588+0000 7f8427926800 20 rados->read ofs=0 len=0 2024-09-22T08:29:11.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.588+0000 7f8427926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:29:11.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.588+0000 7f8427926800 20 rados->read ofs=0 len=0 2024-09-22T08:29:11.590 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.589+0000 7f8427926800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:29:11.590 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.589+0000 7f8427926800 20 searching for the correct realm 2024-09-22T08:29:11.593 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.592+0000 7f8423dda640 0 -- 172.21.15.38:0/3732874223 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7f8414013030 msgr2=0x7f8414013920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:29:11.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.797+0000 7f84235d9640 0 -- 172.21.15.38:0/3732874223 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x55e1acf36210 msgr2=0x55e1acf386a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:29:11.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.802+0000 7f8427926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:29:11.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.802+0000 7f8427926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:29:11.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.802+0000 7f8427926800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:29:11.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.802+0000 7f8427926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:29:11.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.802+0000 7f8427926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:29:11.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.802+0000 7f8427926800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:29:11.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.802+0000 7f8427926800 20 rados->read ofs=0 len=0 2024-09-22T08:29:11.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.803+0000 7f8427926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:29:11.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.803+0000 7f8427926800 20 rados->read ofs=0 len=0 2024-09-22T08:29:11.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.803+0000 7f8427926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:29:11.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.803+0000 7f8427926800 20 rados->read ofs=0 len=0 2024-09-22T08:29:11.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.804+0000 7f8427926800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:29:11.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.804+0000 7f8427926800 20 zone default found 2024-09-22T08:29:11.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.804+0000 7f8427926800 4 Realm: () 2024-09-22T08:29:11.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.804+0000 7f8427926800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:29:11.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.804+0000 7f8427926800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:29:11.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.804+0000 7f8427926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:29:11.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.804+0000 7f8427926800 20 zonegroup default 2024-09-22T08:29:11.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.804+0000 7f8427926800 20 rados->read ofs=0 len=0 2024-09-22T08:29:11.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.804+0000 7f8427926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:29:11.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.804+0000 7f8427926800 20 rados->read ofs=0 len=0 2024-09-22T08:29:11.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.804+0000 7f8427926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:29:11.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.804+0000 7f8427926800 20 rados->read ofs=0 len=0 2024-09-22T08:29:11.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.805+0000 7f8427926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:29:11.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.805+0000 7f8427926800 20 started sync module instance, tier type = 2024-09-22T08:29:11.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.805+0000 7f8427926800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:29:11.816 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.815+0000 7f8427926800 20 add_watcher() i=0 2024-09-22T08:29:11.816 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.815+0000 7f8427926800 20 add_watcher() i=1 2024-09-22T08:29:11.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.815+0000 7f8427926800 20 add_watcher() i=2 2024-09-22T08:29:11.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.815+0000 7f8427926800 20 add_watcher() i=3 2024-09-22T08:29:11.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.815+0000 7f8427926800 20 add_watcher() i=4 2024-09-22T08:29:11.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.815+0000 7f8427926800 20 add_watcher() i=5 2024-09-22T08:29:11.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.815+0000 7f8427926800 20 add_watcher() i=6 2024-09-22T08:29:11.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.817+0000 7f8427926800 20 add_watcher() i=7 2024-09-22T08:29:11.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.817+0000 7f8427926800 2 all 8 watchers are set, enabling cache 2024-09-22T08:29:11.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.818+0000 7f82d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:29:11.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.819+0000 7f8427926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:29:11.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.819+0000 7f8427926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:29:11.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.819+0000 7f8427926800 5 note: GC not initialized 2024-09-22T08:29:11.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.819+0000 7f82d8fe1640 20 reqs_thread_entry: start 2024-09-22T08:29:11.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.819+0000 7f8427926800 20 init_complete bucket index max shards: 11 2024-09-22T08:29:11.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.819+0000 7f8427926800 20 Filter name: none 2024-09-22T08:29:11.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.819+0000 7f82527fc640 20 reqs_thread_entry: start 2024-09-22T08:29:11.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.819+0000 7f8427926800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-22T08:29:11.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.819+0000 7f8427926800 20 rados->read ofs=0 len=0 2024-09-22T08:29:11.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.820+0000 7f8427926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:29:11.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.820+0000 7f8427926800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-22T08:29:11.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.820+0000 7f8427926800 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-22T08:29:11.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.820+0000 7f8427926800 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-22T08:29:11.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.820+0000 7f8427926800 20 rados->read ofs=0 len=0 2024-09-22T08:29:11.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.820+0000 7f8427926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:29:11.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.820+0000 7f8427926800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-22T08:29:11.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.820+0000 7f8427926800 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-22T08:29:11.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.820+0000 7f8427926800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-22T08:29:11.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.820+0000 7f8427926800 20 rados->read ofs=0 len=0 2024-09-22T08:29:11.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.821+0000 7f8427926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:29:11.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.821+0000 7f8427926800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-22T08:29:11.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.821+0000 7f8427926800 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-22T08:29:11.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.821+0000 7f8427926800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-22T08:29:11.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.821+0000 7f8427926800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-22T08:29:11.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.823+0000 7f8427926800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-22T08:29:11.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.823+0000 7f8427926800 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-22T08:29:11.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.823+0000 7f8427926800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-22T08:29:11.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.823+0000 7f8306ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791310 cookie 94427757716288 notifier 5441 bl.length()=677 2024-09-22T08:29:11.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.823+0000 7f8306ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-22T08:29:11.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.823+0000 7f8306ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-22T08:29:11.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.825+0000 7f8427926800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-22T08:29:11.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.825+0000 7f8427926800 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-22T08:29:11.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.825+0000 7f8427926800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-22T08:29:11.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.825+0000 7f8306ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791307 cookie 94427757643136 notifier 5441 bl.length()=187 2024-09-22T08:29:11.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.825+0000 7f8306ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-22T08:29:11.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.825+0000 7f8306ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-22T08:29:11.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.827+0000 7f8427926800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-22T08:29:11.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.827+0000 7f8427926800 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-22T08:29:11.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.827+0000 7f8427926800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-22T08:29:11.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.828+0000 7f83067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791308 cookie 94427757643136 notifier 5441 bl.length()=197 2024-09-22T08:29:11.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.828+0000 7f83067fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-22T08:29:11.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.828+0000 7f83067fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-22T08:29:11.829 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:29:11.829 INFO:tasks.workunit.client.0.smithi038.stdout: "user_id": "ceph-test-maven", 2024-09-22T08:29:11.829 INFO:tasks.workunit.client.0.smithi038.stdout: "display_name": "maven test user", 2024-09-22T08:29:11.829 INFO:tasks.workunit.client.0.smithi038.stdout: "email": "sigv4@example.com", 2024-09-22T08:29:11.829 INFO:tasks.workunit.client.0.smithi038.stdout: "suspended": 0, 2024-09-22T08:29:11.829 INFO:tasks.workunit.client.0.smithi038.stdout: "max_buckets": 1000, 2024-09-22T08:29:11.830 INFO:tasks.workunit.client.0.smithi038.stdout: "subusers": [], 2024-09-22T08:29:11.830 INFO:tasks.workunit.client.0.smithi038.stdout: "keys": [ 2024-09-22T08:29:11.830 INFO:tasks.workunit.client.0.smithi038.stdout: { 2024-09-22T08:29:11.830 INFO:tasks.workunit.client.0.smithi038.stdout: "user": "ceph-test-maven", 2024-09-22T08:29:11.830 INFO:tasks.workunit.client.0.smithi038.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-22T08:29:11.830 INFO:tasks.workunit.client.0.smithi038.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-22T08:29:11.830 INFO:tasks.workunit.client.0.smithi038.stdout: "active": true, 2024-09-22T08:29:11.830 INFO:tasks.workunit.client.0.smithi038.stdout: "create_date": "2024-09-22T08:29:11.822000Z" 2024-09-22T08:29:11.830 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:29:11.830 INFO:tasks.workunit.client.0.smithi038.stdout: ], 2024-09-22T08:29:11.830 INFO:tasks.workunit.client.0.smithi038.stdout: "swift_keys": [], 2024-09-22T08:29:11.830 INFO:tasks.workunit.client.0.smithi038.stdout: "caps": [], 2024-09-22T08:29:11.830 INFO:tasks.workunit.client.0.smithi038.stdout: "op_mask": "read, write, delete", 2024-09-22T08:29:11.830 INFO:tasks.workunit.client.0.smithi038.stdout: "default_placement": "", 2024-09-22T08:29:11.831 INFO:tasks.workunit.client.0.smithi038.stdout: "default_storage_class": "", 2024-09-22T08:29:11.831 INFO:tasks.workunit.client.0.smithi038.stdout: "placement_tags": [], 2024-09-22T08:29:11.831 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_quota": { 2024-09-22T08:29:11.831 INFO:tasks.workunit.client.0.smithi038.stdout: "enabled": false, 2024-09-22T08:29:11.831 INFO:tasks.workunit.client.0.smithi038.stdout: "check_on_raw": false, 2024-09-22T08:29:11.831 INFO:tasks.workunit.client.0.smithi038.stdout: "max_size": -1, 2024-09-22T08:29:11.831 INFO:tasks.workunit.client.0.smithi038.stdout: "max_size_kb": 0, 2024-09-22T08:29:11.831 INFO:tasks.workunit.client.0.smithi038.stdout: "max_objects": -1 2024-09-22T08:29:11.831 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:29:11.831 INFO:tasks.workunit.client.0.smithi038.stdout: "user_quota": { 2024-09-22T08:29:11.831 INFO:tasks.workunit.client.0.smithi038.stdout: "enabled": false, 2024-09-22T08:29:11.831 INFO:tasks.workunit.client.0.smithi038.stdout: "check_on_raw": false, 2024-09-22T08:29:11.831 INFO:tasks.workunit.client.0.smithi038.stdout: "max_size": -1, 2024-09-22T08:29:11.831 INFO:tasks.workunit.client.0.smithi038.stdout: "max_size_kb": 0, 2024-09-22T08:29:11.831 INFO:tasks.workunit.client.0.smithi038.stdout: "max_objects": -1 2024-09-22T08:29:11.832 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:29:11.832 INFO:tasks.workunit.client.0.smithi038.stdout: "temp_url_keys": [], 2024-09-22T08:29:11.832 INFO:tasks.workunit.client.0.smithi038.stdout: "type": "rgw", 2024-09-22T08:29:11.832 INFO:tasks.workunit.client.0.smithi038.stdout: "mfa_ids": [], 2024-09-22T08:29:11.832 INFO:tasks.workunit.client.0.smithi038.stdout: "account_id": "", 2024-09-22T08:29:11.832 INFO:tasks.workunit.client.0.smithi038.stdout: "path": "/", 2024-09-22T08:29:11.832 INFO:tasks.workunit.client.0.smithi038.stdout: "create_date": "2024-09-22T08:29:11.821976Z", 2024-09-22T08:29:11.832 INFO:tasks.workunit.client.0.smithi038.stdout: "tags": [], 2024-09-22T08:29:11.832 INFO:tasks.workunit.client.0.smithi038.stdout: "group_ids": [] 2024-09-22T08:29:11.832 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:29:11.832 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-22T08:29:11.833 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.829+0000 7f82d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:29:11.833 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.831+0000 7f8427926800 20 remove_watcher() i=0 2024-09-22T08:29:11.833 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.831+0000 7f8427926800 2 removed watcher, disabling cache 2024-09-22T08:29:11.833 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.832+0000 7f8427926800 20 remove_watcher() i=1 2024-09-22T08:29:11.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.834+0000 7f8427926800 20 remove_watcher() i=2 2024-09-22T08:29:11.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.835+0000 7f8427926800 20 remove_watcher() i=3 2024-09-22T08:29:11.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.836+0000 7f8427926800 20 remove_watcher() i=4 2024-09-22T08:29:11.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.837+0000 7f8427926800 20 remove_watcher() i=5 2024-09-22T08:29:11.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.838+0000 7f8427926800 20 remove_watcher() i=6 2024-09-22T08:29:11.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:29:11.840+0000 7f8427926800 20 remove_watcher() i=7 2024-09-22T08:29:11.851 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -z ']' 2024-09-22T08:29:11.852 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -z /home/ubuntu/cephtest ']' 2024-09-22T08:29:11.852 INFO:tasks.workunit.client.0.smithi038.stderr:++ cat /home/ubuntu/cephtest/url_file 2024-09-22T08:29:11.853 INFO:tasks.workunit.client.0.smithi038.stderr:+ export RGW_HTTP_ENDPOINT_URL=https://smithi038.front.sepia.ceph.com:443 2024-09-22T08:29:11.853 INFO:tasks.workunit.client.0.smithi038.stderr:+ RGW_HTTP_ENDPOINT_URL=https://smithi038.front.sepia.ceph.com:443 2024-09-22T08:29:11.853 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -z /home/ubuntu/cephtest/clone.client.0 ']' 2024-09-22T08:29:11.853 INFO:tasks.workunit.client.0.smithi038.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-22T08:29:11.853 INFO:tasks.workunit.client.0.smithi038.stderr:+ ./mvnw clean package 2024-09-22T08:29:11.862 INFO:tasks.workunit.client.0.smithi038.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-22T08:29:14.305 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] Scanning for projects... 2024-09-22T08:29:14.442 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-22T08:29:14.526 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 65 kB/s) 2024-09-22T08:29:14.543 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-22T08:29:14.586 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.4/83 kB Progress (1): 2.8/83 kB Progress (1): 4.1/83 kB Progress (1): 5.5/83 kB Progress (1): 6.9/83 kB Progress (1): 8.3/83 kB Progress (1): 9.7/83 kB Progress (1): 11/83 kB Progress (1): 12/83 kB Progress (1): 14/83 kB Progress (1): 15/83 kB Progress (1): 16/83 kB Progress (1): 33/83 kB Progress (1): 49/83 kB Progress (1): 62/83 kB Progress (1): 78/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 1.9 MB/s) 2024-09-22T08:29:14.598 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-22T08:29:14.616 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/77 kB Progress (1): 33/77 kB Progress (1): 49/77 kB Progress (1): 62/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 4.0 MB/s) 2024-09-22T08:29:14.639 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] 2024-09-22T08:29:14.639 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-22T08:29:14.639 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] Building jcksum 1.0 2024-09-22T08:29:14.639 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] from pom.xml 2024-09-22T08:29:14.639 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-22T08:29:14.642 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-22T08:29:14.658 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 354 kB/s) 2024-09-22T08:29:14.664 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-22T08:29:14.679 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 660 kB/s) 2024-09-22T08:29:14.683 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-22T08:29:14.699 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.8 MB/s) 2024-09-22T08:29:14.704 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-22T08:29:14.722 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.4/21 kB Progress (1): 4.1/21 kB Progress (1): 5.5/21 kB Progress (1): 6.9/21 kB Progress (1): 8.2/21 kB Progress (1): 9.6/21 kB Progress (1): 12/21 kB Progress (1): 14/21 kB Progress (1): 19/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.1 MB/s) 2024-09-22T08:29:14.733 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-22T08:29:14.749 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 2.2 MB/s) 2024-09-22T08:29:14.756 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-22T08:29:14.771 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 544 kB/s) 2024-09-22T08:29:14.773 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-22T08:29:14.788 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 578 kB/s) 2024-09-22T08:29:14.791 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-22T08:29:14.806 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/48 kB Progress (1): 33/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 3.2 MB/s) 2024-09-22T08:29:14.810 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-22T08:29:14.825 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.4 MB/s) 2024-09-22T08:29:14.830 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-22T08:29:14.846 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.9 MB/s) 2024-09-22T08:29:14.851 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-22T08:29:14.866 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 654 kB/s) 2024-09-22T08:29:14.872 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-22T08:29:14.889 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/66 kB Progress (1): 31/66 kB Progress (1): 48/66 kB Progress (1): 64/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.9 MB/s) 2024-09-22T08:29:14.895 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-22T08:29:14.913 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 296 kB/s) 2024-09-22T08:29:14.915 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-22T08:29:14.930 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.5 MB/s) 2024-09-22T08:29:14.934 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-22T08:29:14.949 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 15/50 kB Progress (1): 31/50 kB Progress (1): 48/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 3.3 MB/s) 2024-09-22T08:29:14.954 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-22T08:29:14.968 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.6 MB/s) 2024-09-22T08:29:14.974 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-22T08:29:14.989 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 375 kB/s) 2024-09-22T08:29:14.994 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-22T08:29:15.011 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 2.6 MB/s) 2024-09-22T08:29:15.018 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-22T08:29:15.033 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 423 kB/s) 2024-09-22T08:29:15.036 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-22T08:29:15.051 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 660 kB/s) 2024-09-22T08:29:15.053 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-22T08:29:15.069 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.9 MB/s) 2024-09-22T08:29:15.072 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-22T08:29:15.086 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.5 MB/s) 2024-09-22T08:29:15.092 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-22T08:29:15.108 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.7 MB/s) 2024-09-22T08:29:15.122 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-22T08:29:15.137 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 406 kB/s) 2024-09-22T08:29:15.139 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-22T08:29:15.154 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.4 MB/s) 2024-09-22T08:29:15.158 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-22T08:29:15.173 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.3 MB/s) 2024-09-22T08:29:15.183 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-22T08:29:15.198 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 267 kB/s) 2024-09-22T08:29:15.201 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-22T08:29:15.217 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 97 kB/s) 2024-09-22T08:29:15.219 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-22T08:29:15.234 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 149 kB/s) 2024-09-22T08:29:15.240 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-22T08:29:15.255 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 243 kB/s) 2024-09-22T08:29:15.259 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-22T08:29:15.274 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 215 kB/s) 2024-09-22T08:29:15.280 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-22T08:29:15.295 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 685 kB/s) 2024-09-22T08:29:15.300 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-22T08:29:15.315 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 112 kB/s) 2024-09-22T08:29:15.318 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-22T08:29:15.333 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 255 kB/s) 2024-09-22T08:29:15.337 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-22T08:29:15.351 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 351 kB/s) 2024-09-22T08:29:15.355 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-22T08:29:15.369 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 83 kB/s) 2024-09-22T08:29:15.371 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-22T08:29:15.392 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 256 kB/s) 2024-09-22T08:29:15.395 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-22T08:29:15.401 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 986 kB/s) 2024-09-22T08:29:15.404 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-22T08:29:15.419 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 245 kB/s) 2024-09-22T08:29:15.422 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-22T08:29:15.436 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 163 kB/s) 2024-09-22T08:29:15.440 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-22T08:29:15.454 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 208 kB/s) 2024-09-22T08:29:15.459 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-22T08:29:15.474 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 494 kB/s) 2024-09-22T08:29:15.478 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-22T08:29:15.493 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 364 kB/s) 2024-09-22T08:29:15.497 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-22T08:29:15.517 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 174 kB/s) 2024-09-22T08:29:15.522 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-22T08:29:15.538 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 275 kB/s) 2024-09-22T08:29:15.541 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-22T08:29:15.556 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 161 kB/s) 2024-09-22T08:29:15.559 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-22T08:29:15.574 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 429 kB/s) 2024-09-22T08:29:15.577 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-22T08:29:15.592 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 433 kB/s) 2024-09-22T08:29:15.596 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-22T08:29:15.610 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 212 kB/s) 2024-09-22T08:29:15.613 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-22T08:29:15.628 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 248 kB/s) 2024-09-22T08:29:15.632 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-22T08:29:15.646 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 292 kB/s) 2024-09-22T08:29:15.647 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-22T08:29:15.662 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 118 kB/s) 2024-09-22T08:29:15.665 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-22T08:29:15.679 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 441 kB/s) 2024-09-22T08:29:15.682 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-22T08:29:15.697 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 1.1 MB/s) 2024-09-22T08:29:15.699 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-22T08:29:15.714 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 2.3 MB/s) 2024-09-22T08:29:15.716 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-22T08:29:15.730 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.2 MB/s) 2024-09-22T08:29:15.734 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-22T08:29:15.749 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 331 kB/s) 2024-09-22T08:29:15.752 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-22T08:29:15.766 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 940 kB/s) 2024-09-22T08:29:15.769 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-22T08:29:15.784 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 998 kB/s) 2024-09-22T08:29:15.786 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-22T08:29:15.802 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 49/68 kB Progress (1): 66/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 4.2 MB/s) 2024-09-22T08:29:15.808 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-22T08:29:15.823 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 1.0 MB/s) 2024-09-22T08:29:15.828 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-22T08:29:15.843 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 1.0 MB/s) 2024-09-22T08:29:15.845 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-22T08:29:15.861 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 66/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 5.3 MB/s) 2024-09-22T08:29:15.865 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-22T08:29:15.879 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.3 MB/s) 2024-09-22T08:29:15.883 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-22T08:29:15.898 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.3 MB/s) 2024-09-22T08:29:15.901 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-22T08:29:15.917 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 4.6 MB/s) 2024-09-22T08:29:15.923 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-22T08:29:15.937 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 274 kB/s) 2024-09-22T08:29:15.939 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-22T08:29:15.954 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 920 kB/s) 2024-09-22T08:29:15.957 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-22T08:29:15.971 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 229 kB/s) 2024-09-22T08:29:15.973 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-22T08:29:15.987 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 227 kB/s) 2024-09-22T08:29:15.990 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-22T08:29:16.004 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 145 kB/s) 2024-09-22T08:29:16.006 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-22T08:29:16.020 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 189 kB/s) 2024-09-22T08:29:16.023 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-22T08:29:16.037 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 109 kB/s) 2024-09-22T08:29:16.039 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-22T08:29:16.053 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 215 kB/s) 2024-09-22T08:29:16.055 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-22T08:29:16.069 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 229 kB/s) 2024-09-22T08:29:16.071 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-22T08:29:16.085 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 229 kB/s) 2024-09-22T08:29:16.088 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-22T08:29:16.102 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 73 kB/s) 2024-09-22T08:29:16.105 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-22T08:29:16.120 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 64 kB/s) 2024-09-22T08:29:16.122 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-22T08:29:16.136 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 218 kB/s) 2024-09-22T08:29:16.138 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-22T08:29:16.152 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 217 kB/s) 2024-09-22T08:29:16.154 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-22T08:29:16.169 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 229 kB/s) 2024-09-22T08:29:16.171 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-22T08:29:16.185 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 245 kB/s) 2024-09-22T08:29:16.187 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-22T08:29:16.202 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 202 kB/s) 2024-09-22T08:29:16.219 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-22T08:29:16.311 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 36 MB/s) 2024-09-22T08:29:16.313 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-22T08:29:16.313 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-22T08:29:16.313 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-22T08:29:16.313 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-22T08:29:16.313 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-22T08:29:16.331 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/71 kB Progress (1): 33/71 kB Progress (1): 49/71 kB Progress (1): 62/71 kB Progress (1): 71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 3.7 MB/s) 2024-09-22T08:29:16.331 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-22T08:29:16.345 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 501 kB/s) 2024-09-22T08:29:16.345 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-22T08:29:16.364 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.4/49 kB Progress (2): 1.4/49 kB | 1.4/35 kB Progress (2): 2.8/49 kB | 1.4/35 kB Progress (2): 2.8/49 kB | 2.8/35 kB Progress (2): 4.1/49 kB | 2.8/35 kB Progress (2): 4.1/49 kB | 4.1/35 kB Progress (3): 4.1/49 kB | 4.1/35 kB | 1.4/16 kB Progress (3): 4.1/49 kB | 5.5/35 kB | 1.4/16 kB Progress (3): 5.5/49 kB | 5.5/35 kB | 1.4/16 kB Progress (3): 5.5/49 kB | 5.5/35 kB | 2.8/16 kB Progress (3): 6.9/49 kB | 5.5/35 kB | 2.8/16 kB Progress (3): 6.9/49 kB | 6.9/35 kB | 2.8/16 kB Progress (3): 8.3/49 kB | 6.9/35 kB | 2.8/16 kB Progress (3): 8.3/49 kB | 6.9/35 kB | 4.1/16 kB Progress (3): 9.7/49 kB | 6.9/35 kB | 4.1/16 kB Progress (3): 9.7/49 kB | 8.3/35 kB | 4.1/16 kB Progress (4): 9.7/49 kB | 8.3/35 kB | 4.1/16 kB | 1.4/98 kB Progress (4): 9.7/49 kB | 9.7/35 kB | 4.1/16 kB | 1.4/98 kB Progress (4): 11/49 kB | 9.7/35 kB | 4.1/16 kB | 1.4/98 kB Progress (4): 11/49 kB | 11/35 kB | 4.1/16 kB | 1.4/98 kB Progress (4): 11/49 kB | 11/35 kB | 5.5/16 kB | 1.4/98 kB Progress (4): 11/49 kB | 12/35 kB | 5.5/16 kB | 1.4/98 kB Progress (4): 12/49 kB | 12/35 kB | 5.5/16 kB | 1.4/98 kB Progress (4): 12/49 kB | 12/35 kB | 5.5/16 kB | 2.8/98 kB Progress (4): 12/49 kB | 14/35 kB | 5.5/16 kB | 2.8/98 kB Progress (4): 12/49 kB | 14/35 kB | 6.9/16 kB | 2.8/98 kB Progress (4): 12/49 kB | 15/35 kB | 6.9/16 kB | 2.8/98 kB Progress (4): 12/49 kB | 15/35 kB | 6.9/16 kB | 4.1/98 kB Progress (4): 14/49 kB | 15/35 kB | 6.9/16 kB | 4.1/98 kB Progress (4): 14/49 kB | 15/35 kB | 6.9/16 kB | 5.5/98 kB Progress (4): 14/49 kB | 16/35 kB | 6.9/16 kB | 5.5/98 kB Progress (4): 14/49 kB | 16/35 kB | 8.3/16 kB | 5.5/98 kB Progress (4): 14/49 kB | 16/35 kB | 8.3/16 kB | 6.9/98 kB Progress (4): 15/49 kB | 16/35 kB | 8.3/16 kB | 6.9/98 kB Progress (4): 15/49 kB | 16/35 kB | 8.3/16 kB | 8.3/98 kB Progress (4): 15/49 kB | 16/35 kB | 9.7/16 kB | 8.3/98 kB Progress (4): 15/49 kB | 16/35 kB | 9.7/16 kB | 9.7/98 kB Progress (4): 15/49 kB | 18/35 kB | 9.7/16 kB | 9.7/98 kB Progress (4): 15/49 kB | 18/35 kB | 9.7/16 kB | 11/98 kB Progress (5): 15/49 kB | 18/35 kB | 9.7/16 kB | 11/98 kB | 16/782 kB Progress (5): 15/49 kB | 18/35 kB | 11/16 kB | 11/98 kB | 16/782 kB Progress (5): 16/49 kB | 18/35 kB | 11/16 kB | 11/98 kB | 16/782 kB Progress (5): 16/49 kB | 18/35 kB | 12/16 kB | 11/98 kB | 16/782 kB Progress (5): 16/49 kB | 18/35 kB | 12/16 kB | 12/98 kB | 16/782 kB Progress (5): 16/49 kB | 19/35 kB | 12/16 kB | 12/98 kB | 16/782 kB Progress (5): 16/49 kB | 19/35 kB | 12/16 kB | 14/98 kB | 16/782 kB Progress (5): 16/49 kB | 19/35 kB | 12/16 kB | 14/98 kB | 33/782 kB Progress (5): 16/49 kB | 19/35 kB | 14/16 kB | 14/98 kB | 33/782 kB Progress (5): 18/49 kB | 19/35 kB | 14/16 kB | 14/98 kB | 33/782 kB Progress (5): 18/49 kB | 19/35 kB | 15/16 kB | 14/98 kB | 33/782 kB Progress (5): 18/49 kB | 19/35 kB | 15/16 kB | 15/98 kB | 33/782 kB Progress (5): 18/49 kB | 21/35 kB | 15/16 kB | 15/98 kB | 33/782 kB Progress (5): 18/49 kB | 21/35 kB | 15/16 kB | 16/98 kB | 33/782 kB Progress (5): 18/49 kB | 21/35 kB | 15/16 kB | 16/98 kB | 49/782 kB Progress (5): 18/49 kB | 21/35 kB | 16 kB | 16/98 kB | 49/782 kB Progress (5): 19/49 kB | 21/35 kB | 16 kB | 16/98 kB | 49/782 kB Progress (5): 19/49 kB | 22/35 kB | 16 kB | 16/98 kB | 49/782 kB Progress (5): 21/49 kB | 22/35 kB | 16 kB | 16/98 kB | 49/782 kB Progress (5): 21/49 kB | 23/35 kB | 16 kB | 16/98 kB | 49/782 kB Progress (5): 21/49 kB | 23/35 kB | 16 kB | 16/98 kB | 65/782 kB Progress (5): 21/49 kB | 25/35 kB | 16 kB | 16/98 kB | 65/782 kB Progress (5): 22/49 kB | 25/35 kB | 16 kB | 16/98 kB | 65/782 kB Progress (5): 22/49 kB | 26/35 kB | 16 kB | 16/98 kB | 65/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 322 kB/s) 2024-09-22T08:29:16.364 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (4): 23/49 kB | 26/35 kB | 16/98 kB | 65/782 kB Progress (4): 23/49 kB | 26/35 kB | 16/98 kB | 82/782 kB Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-22T08:29:16.370 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (4): 23/49 kB | 27/35 kB | 16/98 kB | 82/782 kB Progress (4): 25/49 kB | 27/35 kB | 16/98 kB | 82/782 kB Progress (4): 25/49 kB | 29/35 kB | 16/98 kB | 82/782 kB Progress (4): 26/49 kB | 29/35 kB | 16/98 kB | 82/782 kB Progress (4): 26/49 kB | 30/35 kB | 16/98 kB | 82/782 kB Progress (4): 26/49 kB | 30/35 kB | 16/98 kB | 98/782 kB Progress (4): 27/49 kB | 30/35 kB | 16/98 kB | 98/782 kB Progress (4): 29/49 kB | 30/35 kB | 16/98 kB | 98/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 98/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 115/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 131/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 147/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 164/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 180/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 196/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 213/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 229/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 246/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 262/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 278/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 295/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 311/782 kB Progress (4): 32/49 kB | 30/35 kB | 16/98 kB | 311/782 kB Progress (4): 32/49 kB | 30/35 kB | 16/98 kB | 328/782 kB Progress (4): 33/49 kB | 30/35 kB | 16/98 kB | 328/782 kB Progress (4): 33/49 kB | 32/35 kB | 16/98 kB | 328/782 kB Progress (4): 34/49 kB | 32/35 kB | 16/98 kB | 328/782 kB Progress (4): 34/49 kB | 33/35 kB | 16/98 kB | 328/782 kB Progress (4): 36/49 kB | 33/35 kB | 16/98 kB | 328/782 kB Progress (4): 36/49 kB | 34/35 kB | 16/98 kB | 328/782 kB Progress (4): 36/49 kB | 34/35 kB | 16/98 kB | 344/782 kB Progress (4): 36/49 kB | 35 kB | 16/98 kB | 344/782 kB Progress (4): 37/49 kB | 35 kB | 16/98 kB | 344/782 kB Progress (4): 38/49 kB | 35 kB | 16/98 kB | 344/782 kB Progress (4): 38/49 kB | 35 kB | 16/98 kB | 360/782 kB Progress (4): 40/49 kB | 35 kB | 16/98 kB | 360/782 kB Progress (4): 40/49 kB | 35 kB | 33/98 kB | 360/782 kB Progress (4): 41/49 kB | 35 kB | 33/98 kB | 360/782 kB Progress (4): 43/49 kB | 35 kB | 33/98 kB | 360/782 kB Progress (4): 43/49 kB | 35 kB | 33/98 kB | 377/782 kB Progress (4): 44/49 kB | 35 kB | 33/98 kB | 377/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 617 kB/s) 2024-09-22T08:29:16.370 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (3): 45/49 kB | 33/98 kB | 377/782 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-22T08:29:16.372 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (3): 45/49 kB | 33/98 kB | 393/782 kB Progress (3): 45/49 kB | 33/98 kB | 409/782 kB Progress (3): 45/49 kB | 33/98 kB | 426/782 kB Progress (3): 47/49 kB | 33/98 kB | 426/782 kB Progress (3): 48/49 kB | 33/98 kB | 426/782 kB Progress (3): 49 kB | 33/98 kB | 426/782 kB Progress (3): 49 kB | 33/98 kB | 442/782 kB Progress (3): 49 kB | 33/98 kB | 459/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 834 kB/s) 2024-09-22T08:29:16.372 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-22T08:29:16.378 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 33/98 kB | 475/782 kB Progress (2): 49/98 kB | 475/782 kB Progress (2): 49/98 kB | 491/782 kB Progress (2): 49/98 kB | 508/782 kB Progress (2): 49/98 kB | 524/782 kB Progress (2): 49/98 kB | 541/782 kB Progress (2): 49/98 kB | 557/782 kB Progress (2): 49/98 kB | 573/782 kB Progress (2): 49/98 kB | 590/782 kB Progress (2): 49/98 kB | 606/782 kB Progress (3): 49/98 kB | 606/782 kB | 1.4/11 kB Progress (3): 49/98 kB | 606/782 kB | 2.8/11 kB Progress (3): 49/98 kB | 622/782 kB | 2.8/11 kB Progress (3): 49/98 kB | 622/782 kB | 4.1/11 kB Progress (3): 49/98 kB | 639/782 kB | 4.1/11 kB Progress (3): 49/98 kB | 655/782 kB | 4.1/11 kB Progress (3): 49/98 kB | 655/782 kB | 5.5/11 kB Progress (3): 49/98 kB | 655/782 kB | 6.9/11 kB Progress (3): 49/98 kB | 655/782 kB | 8.3/11 kB Progress (3): 49/98 kB | 655/782 kB | 9.7/11 kB Progress (3): 49/98 kB | 672/782 kB | 9.7/11 kB Progress (3): 49/98 kB | 672/782 kB | 11/11 kB Progress (3): 49/98 kB | 672/782 kB | 11 kB Progress (3): 49/98 kB | 688/782 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 178 kB/s) 2024-09-22T08:29:16.378 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 49/98 kB | 704/782 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-22T08:29:16.380 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 49/98 kB | 721/782 kB Progress (2): 49/98 kB | 737/782 kB Progress (2): 49/98 kB | 753/782 kB Progress (2): 49/98 kB | 770/782 kB Progress (2): 49/98 kB | 782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 12 MB/s) 2024-09-22T08:29:16.380 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-22T08:29:16.386 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 66/98 kB Progress (1): 79/98 kB Progress (1): 95/98 kB Progress (1): 98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 1.3 MB/s) 2024-09-22T08:29:16.386 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-22T08:29:16.388 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.4/205 kB Progress (1): 2.8/205 kB Progress (1): 4.1/205 kB Progress (1): 5.5/205 kB Progress (1): 6.9/205 kB Progress (1): 8.3/205 kB Progress (1): 9.7/205 kB Progress (1): 11/205 kB Progress (1): 12/205 kB Progress (1): 14/205 kB Progress (1): 15/205 kB Progress (1): 16/205 kB Progress (2): 16/205 kB | 16/30 kB Progress (2): 33/205 kB | 16/30 kB Progress (2): 33/205 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 408 kB/s) 2024-09-22T08:29:16.388 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-22T08:29:16.400 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 33/205 kB | 1.4/81 kB Progress (2): 33/205 kB | 2.8/81 kB Progress (2): 33/205 kB | 4.1/81 kB Progress (2): 33/205 kB | 5.5/81 kB Progress (2): 33/205 kB | 6.9/81 kB Progress (2): 33/205 kB | 8.3/81 kB Progress (2): 33/205 kB | 9.7/81 kB Progress (2): 33/205 kB | 11/81 kB Progress (2): 33/205 kB | 12/81 kB Progress (2): 33/205 kB | 14/81 kB Progress (2): 33/205 kB | 15/81 kB Progress (2): 33/205 kB | 16/81 kB Progress (3): 33/205 kB | 16/81 kB | 16/798 kB Progress (3): 33/205 kB | 16/81 kB | 33/798 kB Progress (3): 33/205 kB | 16/81 kB | 49/798 kB Progress (3): 33/205 kB | 16/81 kB | 62/798 kB Progress (3): 33/205 kB | 16/81 kB | 78/798 kB Progress (3): 33/205 kB | 16/81 kB | 95/798 kB Progress (3): 33/205 kB | 16/81 kB | 111/798 kB Progress (3): 49/205 kB | 16/81 kB | 111/798 kB Progress (3): 49/205 kB | 16/81 kB | 128/798 kB Progress (3): 49/205 kB | 16/81 kB | 132/798 kB Progress (3): 49/205 kB | 16/81 kB | 148/798 kB Progress (3): 62/205 kB | 16/81 kB | 148/798 kB Progress (3): 62/205 kB | 16/81 kB | 165/798 kB Progress (3): 62/205 kB | 16/81 kB | 181/798 kB Progress (3): 62/205 kB | 16/81 kB | 193/798 kB Progress (4): 62/205 kB | 16/81 kB | 193/798 kB | 13 kB Progress (4): 62/205 kB | 16/81 kB | 210/798 kB | 13 kB Progress (4): 78/205 kB | 16/81 kB | 210/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 158 kB/s) 2024-09-22T08:29:16.400 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-22T08:29:16.408 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (3): 78/205 kB | 16/81 kB | 226/798 kB Progress (3): 78/205 kB | 16/81 kB | 242/798 kB Progress (3): 94/205 kB | 16/81 kB | 242/798 kB Progress (3): 94/205 kB | 16/81 kB | 259/798 kB Progress (3): 111/205 kB | 16/81 kB | 259/798 kB Progress (3): 111/205 kB | 16/81 kB | 275/798 kB Progress (3): 111/205 kB | 16/81 kB | 291/798 kB Progress (3): 111/205 kB | 16/81 kB | 308/798 kB Progress (3): 127/205 kB | 16/81 kB | 308/798 kB Progress (3): 127/205 kB | 16/81 kB | 324/798 kB Progress (3): 127/205 kB | 16/81 kB | 341/798 kB Progress (4): 127/205 kB | 16/81 kB | 341/798 kB | 16/182 kB Progress (4): 127/205 kB | 16/81 kB | 357/798 kB | 16/182 kB Progress (4): 127/205 kB | 33/81 kB | 357/798 kB | 16/182 kB Progress (4): 127/205 kB | 33/81 kB | 373/798 kB | 16/182 kB Progress (4): 143/205 kB | 33/81 kB | 373/798 kB | 16/182 kB Progress (4): 143/205 kB | 33/81 kB | 390/798 kB | 16/182 kB Progress (4): 143/205 kB | 33/81 kB | 390/798 kB | 33/182 kB Progress (4): 143/205 kB | 33/81 kB | 406/798 kB | 33/182 kB Progress (4): 143/205 kB | 49/81 kB | 406/798 kB | 33/182 kB Progress (4): 143/205 kB | 49/81 kB | 423/798 kB | 33/182 kB Progress (4): 143/205 kB | 49/81 kB | 439/798 kB | 33/182 kB Progress (4): 143/205 kB | 49/81 kB | 439/798 kB | 49/182 kB Progress (4): 143/205 kB | 49/81 kB | 455/798 kB | 49/182 kB Progress (4): 143/205 kB | 49/81 kB | 472/798 kB | 49/182 kB Progress (4): 143/205 kB | 64/81 kB | 472/798 kB | 49/182 kB Progress (4): 143/205 kB | 64/81 kB | 488/798 kB | 49/182 kB Progress (4): 143/205 kB | 64/81 kB | 504/798 kB | 49/182 kB Progress (4): 143/205 kB | 64/81 kB | 521/798 kB | 49/182 kB Progress (4): 143/205 kB | 64/81 kB | 521/798 kB | 63/182 kB Progress (4): 143/205 kB | 64/81 kB | 537/798 kB | 63/182 kB Progress (4): 143/205 kB | 80/81 kB | 537/798 kB | 63/182 kB Progress (4): 143/205 kB | 81 kB | 537/798 kB | 63/182 kB Progress (4): 143/205 kB | 81 kB | 554/798 kB | 63/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 864 kB/s) 2024-09-22T08:29:16.408 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (3): 143/205 kB | 570/798 kB | 63/182 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-22T08:29:16.411 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (3): 143/205 kB | 586/798 kB | 63/182 kB Progress (3): 143/205 kB | 603/798 kB | 63/182 kB Progress (3): 143/205 kB | 619/798 kB | 63/182 kB Progress (3): 160/205 kB | 619/798 kB | 63/182 kB Progress (3): 160/205 kB | 636/798 kB | 63/182 kB Progress (3): 176/205 kB | 636/798 kB | 63/182 kB Progress (3): 176/205 kB | 652/798 kB | 63/182 kB Progress (3): 176/205 kB | 668/798 kB | 63/182 kB Progress (3): 193/205 kB | 668/798 kB | 63/182 kB Progress (3): 205 kB | 668/798 kB | 63/182 kB Progress (3): 205 kB | 685/798 kB | 63/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 2.1 MB/s) 2024-09-22T08:29:16.411 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 701/798 kB | 63/182 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-22T08:29:16.414 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 717/798 kB | 63/182 kB Progress (2): 734/798 kB | 63/182 kB Progress (2): 750/798 kB | 63/182 kB Progress (2): 767/798 kB | 63/182 kB Progress (2): 783/798 kB | 63/182 kB Progress (2): 798 kB | 63/182 kB Progress (3): 798 kB | 63/182 kB | 16/151 kB Progress (3): 798 kB | 79/182 kB | 16/151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 8.0 MB/s) 2024-09-22T08:29:16.414 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 79/182 kB | 33/151 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-22T08:29:16.420 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 96/182 kB | 33/151 kB Progress (2): 96/182 kB | 49/151 kB Progress (2): 112/182 kB | 49/151 kB Progress (2): 112/182 kB | 63/151 kB Progress (2): 128/182 kB | 63/151 kB Progress (2): 128/182 kB | 80/151 kB Progress (2): 145/182 kB | 80/151 kB Progress (2): 145/182 kB | 96/151 kB Progress (2): 161/182 kB | 96/151 kB Progress (2): 178/182 kB | 96/151 kB Progress (2): 182 kB | 96/151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.7 MB/s) 2024-09-22T08:29:16.420 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-22T08:29:16.426 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 96/151 kB | 2.7/27 kB Progress (2): 96/151 kB | 11/27 kB Progress (2): 96/151 kB | 19/27 kB Progress (2): 96/151 kB | 26/27 kB Progress (2): 96/151 kB | 27 kB Progress (3): 96/151 kB | 27 kB | 16/30 kB Progress (3): 113/151 kB | 27 kB | 16/30 kB Progress (3): 113/151 kB | 27 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 246 kB/s) 2024-09-22T08:29:16.426 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-22T08:29:16.427 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 129/151 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 271 kB/s) 2024-09-22T08:29:16.427 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-22T08:29:16.428 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 145/151 kB Progress (1): 151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.3 MB/s) 2024-09-22T08:29:16.428 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-22T08:29:16.435 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/385 kB Progress (1): 33/385 kB Progress (1): 49/385 kB Progress (1): 66/385 kB Progress (1): 82/385 kB Progress (1): 98/385 kB Progress (1): 114/385 kB Progress (1): 131/385 kB Progress (1): 147/385 kB Progress (1): 163/385 kB Progress (1): 180/385 kB Progress (1): 196/385 kB Progress (1): 213/385 kB Progress (1): 229/385 kB Progress (1): 245/385 kB Progress (1): 262/385 kB Progress (1): 278/385 kB Progress (1): 294/385 kB Progress (1): 311/385 kB Progress (1): 327/385 kB Progress (1): 344/385 kB Progress (2): 344/385 kB | 13 kB Progress (2): 360/385 kB | 13 kB Progress (2): 376/385 kB | 13 kB Progress (2): 385 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 110 kB/s) 2024-09-22T08:29:16.435 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-22T08:29:16.435 INFO:tasks.workunit.client.0.smithi038.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 3.2 MB/s) 2024-09-22T08:29:16.436 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-22T08:29:16.442 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/75 kB Progress (1): 33/75 kB Progress (1): 49/75 kB Progress (1): 61/75 kB Progress (1): 75 kB Progress (2): 75 kB | 16/780 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 587 kB/s) 2024-09-22T08:29:16.442 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-22T08:29:16.459 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 33/780 kB Progress (2): 33/780 kB | 16/329 kB Progress (2): 49/780 kB | 16/329 kB Progress (2): 49/780 kB | 33/329 kB Progress (2): 62/780 kB | 33/329 kB Progress (2): 79/780 kB | 33/329 kB Progress (2): 95/780 kB | 33/329 kB Progress (2): 95/780 kB | 49/329 kB Progress (2): 111/780 kB | 49/329 kB Progress (2): 128/780 kB | 49/329 kB Progress (2): 144/780 kB | 49/329 kB Progress (2): 144/780 kB | 64/329 kB Progress (2): 160/780 kB | 64/329 kB Progress (2): 177/780 kB | 64/329 kB Progress (2): 177/780 kB | 80/329 kB Progress (2): 193/780 kB | 80/329 kB Progress (2): 193/780 kB | 96/329 kB Progress (2): 210/780 kB | 96/329 kB Progress (2): 226/780 kB | 96/329 kB Progress (2): 226/780 kB | 113/329 kB Progress (2): 242/780 kB | 113/329 kB Progress (2): 259/780 kB | 113/329 kB Progress (3): 259/780 kB | 113/329 kB | 16/501 kB Progress (3): 259/780 kB | 113/329 kB | 33/501 kB Progress (3): 259/780 kB | 113/329 kB | 49/501 kB Progress (3): 259/780 kB | 113/329 kB | 66/501 kB Progress (3): 259/780 kB | 113/329 kB | 82/501 kB Progress (3): 259/780 kB | 113/329 kB | 98/501 kB Progress (4): 259/780 kB | 113/329 kB | 98/501 kB | 16/354 kB Progress (4): 259/780 kB | 113/329 kB | 112/501 kB | 16/354 kB Progress (4): 259/780 kB | 113/329 kB | 112/501 kB | 33/354 kB Progress (4): 259/780 kB | 113/329 kB | 128/501 kB | 33/354 kB Progress (4): 259/780 kB | 113/329 kB | 128/501 kB | 49/354 kB Progress (4): 259/780 kB | 113/329 kB | 145/501 kB | 49/354 kB Progress (4): 259/780 kB | 113/329 kB | 145/501 kB | 66/354 kB Progress (4): 259/780 kB | 113/329 kB | 161/501 kB | 66/354 kB Progress (4): 259/780 kB | 113/329 kB | 161/501 kB | 82/354 kB Progress (4): 259/780 kB | 113/329 kB | 177/501 kB | 82/354 kB Progress (4): 259/780 kB | 113/329 kB | 177/501 kB | 98/354 kB Progress (4): 259/780 kB | 113/329 kB | 194/501 kB | 98/354 kB Progress (4): 259/780 kB | 113/329 kB | 194/501 kB | 115/354 kB Progress (4): 259/780 kB | 113/329 kB | 194/501 kB | 131/354 kB Progress (4): 259/780 kB | 113/329 kB | 210/501 kB | 131/354 kB Progress (4): 275/780 kB | 113/329 kB | 210/501 kB | 131/354 kB Progress (4): 275/780 kB | 129/329 kB | 210/501 kB | 131/354 kB Progress (4): 292/780 kB | 129/329 kB | 210/501 kB | 131/354 kB Progress (4): 292/780 kB | 129/329 kB | 210/501 kB | 147/354 kB Progress (4): 292/780 kB | 129/329 kB | 227/501 kB | 147/354 kB Progress (4): 292/780 kB | 145/329 kB | 227/501 kB | 147/354 kB Progress (4): 308/780 kB | 145/329 kB | 227/501 kB | 147/354 kB Progress (4): 308/780 kB | 145/329 kB | 227/501 kB | 164/354 kB Progress (4): 308/780 kB | 162/329 kB | 227/501 kB | 164/354 kB Progress (4): 308/780 kB | 162/329 kB | 243/501 kB | 164/354 kB Progress (4): 324/780 kB | 162/329 kB | 243/501 kB | 164/354 kB Progress (4): 324/780 kB | 162/329 kB | 243/501 kB | 180/354 kB Progress (4): 341/780 kB | 162/329 kB | 243/501 kB | 180/354 kB Progress (4): 341/780 kB | 162/329 kB | 259/501 kB | 180/354 kB Progress (4): 341/780 kB | 178/329 kB | 259/501 kB | 180/354 kB Progress (4): 357/780 kB | 178/329 kB | 259/501 kB | 180/354 kB Progress (4): 357/780 kB | 178/329 kB | 259/501 kB | 197/354 kB Progress (4): 357/780 kB | 178/329 kB | 276/501 kB | 197/354 kB Progress (4): 373/780 kB | 178/329 kB | 276/501 kB | 197/354 kB Progress (4): 373/780 kB | 178/329 kB | 276/501 kB | 213/354 kB Progress (4): 390/780 kB | 178/329 kB | 276/501 kB | 213/354 kB Progress (4): 390/780 kB | 178/329 kB | 292/501 kB | 213/354 kB Progress (4): 390/780 kB | 195/329 kB | 292/501 kB | 213/354 kB Progress (4): 406/780 kB | 195/329 kB | 292/501 kB | 213/354 kB Progress (4): 406/780 kB | 195/329 kB | 292/501 kB | 229/354 kB Progress (5): 406/780 kB | 195/329 kB | 292/501 kB | 229/354 kB | 16/41 kB Progress (5): 406/780 kB | 195/329 kB | 309/501 kB | 229/354 kB | 16/41 kB Progress (5): 423/780 kB | 195/329 kB | 309/501 kB | 229/354 kB | 16/41 kB Progress (5): 423/780 kB | 195/329 kB | 309/501 kB | 246/354 kB | 16/41 kB Progress (5): 423/780 kB | 195/329 kB | 309/501 kB | 246/354 kB | 32/41 kB Progress (5): 439/780 kB | 195/329 kB | 309/501 kB | 246/354 kB | 32/41 kB Progress (5): 439/780 kB | 211/329 kB | 309/501 kB | 246/354 kB | 32/41 kB Progress (5): 439/780 kB | 211/329 kB | 325/501 kB | 246/354 kB | 32/41 kB Progress (5): 439/780 kB | 211/329 kB | 325/501 kB | 246/354 kB | 41 kB Progress (5): 455/780 kB | 211/329 kB | 325/501 kB | 246/354 kB | 41 kB Progress (5): 455/780 kB | 227/329 kB | 325/501 kB | 246/354 kB | 41 kB Progress (5): 455/780 kB | 227/329 kB | 341/501 kB | 246/354 kB | 41 kB Progress (5): 472/780 kB | 227/329 kB | 341/501 kB | 246/354 kB | 41 kB Progress (5): 472/780 kB | 227/329 kB | 358/501 kB | 246/354 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 290 kB/s) 2024-09-22T08:29:16.459 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (4): 488/780 kB | 227/329 kB | 358/501 kB | 246/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-22T08:29:16.461 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (4): 488/780 kB | 227/329 kB | 374/501 kB | 246/354 kB Progress (4): 488/780 kB | 244/329 kB | 374/501 kB | 246/354 kB Progress (4): 488/780 kB | 244/329 kB | 390/501 kB | 246/354 kB Progress (4): 505/780 kB | 244/329 kB | 390/501 kB | 246/354 kB Progress (4): 505/780 kB | 260/329 kB | 390/501 kB | 246/354 kB Progress (4): 505/780 kB | 260/329 kB | 407/501 kB | 246/354 kB Progress (4): 521/780 kB | 260/329 kB | 407/501 kB | 246/354 kB Progress (4): 521/780 kB | 260/329 kB | 423/501 kB | 246/354 kB Progress (4): 521/780 kB | 277/329 kB | 423/501 kB | 246/354 kB Progress (4): 521/780 kB | 277/329 kB | 440/501 kB | 246/354 kB Progress (4): 537/780 kB | 277/329 kB | 440/501 kB | 246/354 kB Progress (4): 537/780 kB | 293/329 kB | 440/501 kB | 246/354 kB Progress (4): 537/780 kB | 293/329 kB | 456/501 kB | 246/354 kB Progress (4): 554/780 kB | 293/329 kB | 456/501 kB | 246/354 kB Progress (4): 554/780 kB | 293/329 kB | 472/501 kB | 246/354 kB Progress (4): 554/780 kB | 309/329 kB | 472/501 kB | 246/354 kB Progress (4): 554/780 kB | 309/329 kB | 489/501 kB | 246/354 kB Progress (4): 570/780 kB | 309/329 kB | 489/501 kB | 246/354 kB Progress (4): 570/780 kB | 326/329 kB | 489/501 kB | 246/354 kB Progress (4): 570/780 kB | 326/329 kB | 501 kB | 246/354 kB Progress (4): 570/780 kB | 329 kB | 501 kB | 246/354 kB Progress (4): 586/780 kB | 329 kB | 501 kB | 246/354 kB Progress (4): 603/780 kB | 329 kB | 501 kB | 246/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 2.3 MB/s) 2024-09-22T08:29:16.461 INFO:tasks.workunit.client.0.smithi038.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 3.4 MB/s) 2024-09-22T08:29:16.461 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-22T08:29:16.461 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-22T08:29:16.464 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 619/780 kB | 246/354 kB Progress (2): 636/780 kB | 246/354 kB Progress (2): 652/780 kB | 246/354 kB Progress (2): 652/780 kB | 262/354 kB Progress (2): 668/780 kB | 262/354 kB Progress (2): 668/780 kB | 279/354 kB Progress (2): 668/780 kB | 295/354 kB Progress (2): 685/780 kB | 295/354 kB Progress (2): 685/780 kB | 311/354 kB Progress (2): 701/780 kB | 311/354 kB Progress (2): 701/780 kB | 328/354 kB Progress (2): 718/780 kB | 328/354 kB Progress (2): 718/780 kB | 344/354 kB Progress (2): 718/780 kB | 354 kB Progress (2): 734/780 kB | 354 kB Progress (2): 750/780 kB | 354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 2.4 MB/s) 2024-09-22T08:29:16.464 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-22T08:29:16.466 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 767/780 kB Progress (1): 780 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 5.2 MB/s) 2024-09-22T08:29:16.466 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-22T08:29:16.483 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 6.4 kB Progress (2): 6.4 kB | 16/586 kB Progress (3): 6.4 kB | 16/586 kB | 16/211 kB Progress (4): 6.4 kB | 16/586 kB | 16/211 kB | 14 kB Progress (4): 6.4 kB | 33/586 kB | 16/211 kB | 14 kB Progress (4): 6.4 kB | 33/586 kB | 33/211 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 38 kB/s) 2024-09-22T08:29:16.483 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-22T08:29:16.483 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (3): 33/586 kB | 45/211 kB | 14 kB Progress (3): 49/586 kB | 45/211 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 86 kB/s) 2024-09-22T08:29:16.483 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-22T08:29:16.485 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 49/586 kB | 61/211 kB Progress (2): 64/586 kB | 61/211 kB Progress (2): 64/586 kB | 65/211 kB Progress (2): 81/586 kB | 65/211 kB Progress (2): 81/586 kB | 82/211 kB Progress (2): 97/586 kB | 82/211 kB Progress (2): 97/586 kB | 98/211 kB Progress (2): 113/586 kB | 98/211 kB Progress (2): 113/586 kB | 114/211 kB Progress (2): 130/586 kB | 114/211 kB Progress (2): 130/586 kB | 131/211 kB Progress (2): 146/586 kB | 131/211 kB Progress (2): 146/586 kB | 147/211 kB Progress (2): 163/586 kB | 147/211 kB Progress (2): 163/586 kB | 164/211 kB Progress (2): 179/586 kB | 164/211 kB Progress (2): 179/586 kB | 180/211 kB Progress (2): 195/586 kB | 180/211 kB Progress (2): 195/586 kB | 196/211 kB Progress (2): 212/586 kB | 196/211 kB Progress (2): 212/586 kB | 211 kB Progress (2): 228/586 kB | 211 kB Progress (2): 245/586 kB | 211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.2 MB/s) 2024-09-22T08:29:16.485 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 261/586 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-22T08:29:16.490 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 277/586 kB Progress (1): 294/586 kB Progress (1): 310/586 kB Progress (1): 326/586 kB Progress (1): 343/586 kB Progress (1): 359/586 kB Progress (1): 376/586 kB Progress (1): 392/586 kB Progress (1): 408/586 kB Progress (1): 425/586 kB Progress (1): 441/586 kB Progress (1): 458/586 kB Progress (1): 474/586 kB Progress (1): 490/586 kB Progress (1): 507/586 kB Progress (1): 523/586 kB Progress (1): 539/586 kB Progress (1): 556/586 kB Progress (1): 572/586 kB Progress (1): 586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 3.3 MB/s) 2024-09-22T08:29:16.490 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-22T08:29:16.496 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/106 kB Progress (1): 33/106 kB Progress (2): 33/106 kB | 6.8 kB Progress (2): 49/106 kB | 6.8 kB Progress (2): 61/106 kB | 6.8 kB Progress (2): 65/106 kB | 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 38 kB/s) 2024-09-22T08:29:16.496 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-22T08:29:16.497 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 81/106 kB Progress (1): 98/106 kB Progress (2): 98/106 kB | 16/245 kB Progress (2): 106 kB | 16/245 kB Progress (2): 106 kB | 33/245 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 587 kB/s) 2024-09-22T08:29:16.497 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-22T08:29:16.502 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 49/245 kB Progress (1): 62/245 kB Progress (1): 78/245 kB Progress (1): 95/245 kB Progress (1): 111/245 kB Progress (1): 127/245 kB Progress (1): 144/245 kB Progress (2): 144/245 kB | 16/205 kB Progress (2): 160/245 kB | 16/205 kB Progress (2): 160/245 kB | 33/205 kB Progress (2): 177/245 kB | 33/205 kB Progress (2): 177/245 kB | 49/205 kB Progress (2): 193/245 kB | 49/205 kB Progress (2): 193/245 kB | 65/205 kB Progress (2): 209/245 kB | 65/205 kB Progress (2): 209/245 kB | 81/205 kB Progress (2): 226/245 kB | 81/205 kB Progress (2): 226/245 kB | 98/205 kB Progress (2): 242/245 kB | 98/205 kB Progress (2): 245 kB | 98/205 kB Progress (2): 245 kB | 114/205 kB Progress (2): 245 kB | 130/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.3 MB/s) 2024-09-22T08:29:16.502 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 147/205 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-22T08:29:16.503 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 163/205 kB Progress (1): 180/205 kB Progress (1): 196/205 kB Progress (1): 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 1.1 MB/s) 2024-09-22T08:29:16.503 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-22T08:29:16.504 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 81 kB/s) 2024-09-22T08:29:16.504 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-22T08:29:16.510 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Progress (2): 16 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 85 kB/s) 2024-09-22T08:29:16.510 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-22T08:29:16.510 INFO:tasks.workunit.client.0.smithi038.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 33 kB/s) 2024-09-22T08:29:16.517 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 112 kB/s) 2024-09-22T08:29:16.519 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 15/24 kB Progress (1): 24 kB Progress (2): 24 kB | 16/17 kB Progress (2): 24 kB | 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 119 kB/s) 2024-09-22T08:29:16.519 INFO:tasks.workunit.client.0.smithi038.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 85 kB/s) 2024-09-22T08:29:16.529 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/184 kB Progress (1): 33/184 kB Progress (1): 49/184 kB Progress (1): 62/184 kB Progress (1): 79/184 kB Progress (1): 95/184 kB Progress (1): 112/184 kB Progress (1): 128/184 kB Progress (1): 144/184 kB Progress (1): 161/184 kB Progress (1): 177/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 863 kB/s) 2024-09-22T08:29:16.549 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] 2024-09-22T08:29:16.549 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-22T08:29:16.555 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-22T08:29:16.570 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 389 kB/s) 2024-09-22T08:29:16.571 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-22T08:29:16.585 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 364 kB/s) 2024-09-22T08:29:16.587 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-22T08:29:16.602 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/43 kB Progress (1): 33/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.9 MB/s) 2024-09-22T08:29:16.606 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-22T08:29:16.620 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 1.0 MB/s) 2024-09-22T08:29:16.624 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-22T08:29:16.641 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/153 kB Progress (1): 33/153 kB Progress (1): 49/153 kB Progress (1): 57/153 kB Progress (1): 74/153 kB Progress (1): 90/153 kB Progress (1): 107/153 kB Progress (1): 111/153 kB Progress (1): 127/153 kB Progress (1): 143/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 9.0 MB/s) 2024-09-22T08:29:16.641 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-22T08:29:16.658 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/215 kB Progress (1): 33/215 kB Progress (1): 49/215 kB Progress (1): 64/215 kB Progress (1): 81/215 kB Progress (1): 97/215 kB Progress (1): 114/215 kB Progress (1): 130/215 kB Progress (1): 146/215 kB Progress (1): 163/215 kB Progress (1): 179/215 kB Progress (1): 195/215 kB Progress (1): 212/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 13 MB/s) 2024-09-22T08:29:16.697 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] 2024-09-22T08:29:16.697 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-22T08:29:16.701 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-22T08:29:16.716 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 177 kB/s) 2024-09-22T08:29:16.718 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-22T08:29:16.734 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.5 MB/s) 2024-09-22T08:29:16.738 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-22T08:29:16.752 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 585 kB/s) 2024-09-22T08:29:16.755 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-22T08:29:16.770 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.7 MB/s) 2024-09-22T08:29:16.773 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-22T08:29:16.787 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 431 kB/s) 2024-09-22T08:29:16.789 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-22T08:29:16.803 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 230 kB/s) 2024-09-22T08:29:16.806 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-22T08:29:16.819 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 47 kB/s) 2024-09-22T08:29:16.821 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-22T08:29:16.835 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 196 kB/s) 2024-09-22T08:29:16.837 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-22T08:29:16.852 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 940 kB/s) 2024-09-22T08:29:16.855 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-22T08:29:16.869 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 229 kB/s) 2024-09-22T08:29:16.871 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-22T08:29:16.885 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 643 kB/s) 2024-09-22T08:29:16.887 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-22T08:29:16.900 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 643 kB/s) 2024-09-22T08:29:16.903 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-22T08:29:16.917 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 572 kB/s) 2024-09-22T08:29:16.920 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-22T08:29:16.934 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.4 MB/s) 2024-09-22T08:29:16.940 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-22T08:29:16.954 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 364 kB/s) 2024-09-22T08:29:16.957 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-22T08:29:16.971 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 2.2 MB/s) 2024-09-22T08:29:16.977 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-22T08:29:16.991 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 364 kB/s) 2024-09-22T08:29:16.994 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-22T08:29:17.011 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 65/85 kB Progress (1): 81/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 5.3 MB/s) 2024-09-22T08:29:17.011 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-22T08:29:17.011 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-22T08:29:17.011 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-22T08:29:17.011 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-22T08:29:17.011 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-22T08:29:17.026 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.5 kB Progress (2): 2.5 kB | 16/41 kB Progress (3): 2.5 kB | 16/41 kB | 16/55 kB Progress (4): 2.5 kB | 16/41 kB | 16/55 kB | 16/269 kB Progress (4): 2.5 kB | 16/41 kB | 33/55 kB | 16/269 kB Progress (5): 2.5 kB | 16/41 kB | 33/55 kB | 16/269 kB | 8.5 kB Progress (5): 2.5 kB | 32/41 kB | 33/55 kB | 16/269 kB | 8.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 178 kB/s) 2024-09-22T08:29:17.026 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (4): 32/41 kB | 33/55 kB | 33/269 kB | 8.5 kB Progress (4): 41 kB | 33/55 kB | 33/269 kB | 8.5 kB Progress (4): 41 kB | 49/55 kB | 33/269 kB | 8.5 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-22T08:29:17.026 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (4): 41 kB | 55 kB | 33/269 kB | 8.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 606 kB/s) 2024-09-22T08:29:17.026 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (3): 41 kB | 55 kB | 49/269 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-22T08:29:17.026 INFO:tasks.workunit.client.0.smithi038.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.9 MB/s) 2024-09-22T08:29:17.027 INFO:tasks.workunit.client.0.smithi038.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 3.4 MB/s) 2024-09-22T08:29:17.031 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 63/269 kB Progress (1): 80/269 kB Progress (1): 96/269 kB Progress (1): 112/269 kB Progress (1): 129/269 kB Progress (1): 145/269 kB Progress (1): 162/269 kB Progress (1): 178/269 kB Progress (1): 194/269 kB Progress (1): 211/269 kB Progress (1): 227/269 kB Progress (1): 243/269 kB Progress (1): 260/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 13 MB/s) 2024-09-22T08:29:17.046 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/327 kB Progress (2): 16/327 kB | 16/587 kB Progress (2): 16/327 kB | 33/587 kB Progress (2): 33/327 kB | 33/587 kB Progress (2): 33/327 kB | 49/587 kB Progress (2): 49/327 kB | 49/587 kB Progress (2): 49/327 kB | 64/587 kB Progress (2): 65/327 kB | 64/587 kB Progress (2): 65/327 kB | 80/587 kB Progress (2): 65/327 kB | 97/587 kB Progress (2): 82/327 kB | 97/587 kB Progress (2): 82/327 kB | 113/587 kB Progress (2): 98/327 kB | 113/587 kB Progress (2): 98/327 kB | 129/587 kB Progress (2): 98/327 kB | 146/587 kB Progress (2): 114/327 kB | 146/587 kB Progress (2): 114/327 kB | 162/587 kB Progress (2): 131/327 kB | 162/587 kB Progress (2): 131/327 kB | 179/587 kB Progress (2): 131/327 kB | 195/587 kB Progress (2): 147/327 kB | 195/587 kB Progress (2): 147/327 kB | 211/587 kB Progress (2): 163/327 kB | 211/587 kB Progress (2): 163/327 kB | 228/587 kB Progress (2): 163/327 kB | 244/587 kB Progress (2): 180/327 kB | 244/587 kB Progress (2): 180/327 kB | 261/587 kB Progress (2): 196/327 kB | 261/587 kB Progress (2): 196/327 kB | 277/587 kB Progress (2): 196/327 kB | 293/587 kB Progress (2): 213/327 kB | 293/587 kB Progress (2): 213/327 kB | 310/587 kB Progress (2): 229/327 kB | 310/587 kB Progress (2): 229/327 kB | 326/587 kB Progress (2): 229/327 kB | 342/587 kB Progress (2): 245/327 kB | 342/587 kB Progress (2): 245/327 kB | 359/587 kB Progress (2): 245/327 kB | 367/587 kB Progress (2): 262/327 kB | 367/587 kB Progress (2): 262/327 kB | 383/587 kB Progress (2): 262/327 kB | 392/587 kB Progress (2): 278/327 kB | 392/587 kB Progress (2): 278/327 kB | 408/587 kB Progress (2): 278/327 kB | 424/587 kB Progress (2): 295/327 kB | 424/587 kB Progress (2): 295/327 kB | 441/587 kB Progress (2): 311/327 kB | 441/587 kB Progress (2): 311/327 kB | 457/587 kB Progress (2): 311/327 kB | 474/587 kB Progress (2): 327 kB | 474/587 kB Progress (2): 327 kB | 490/587 kB Progress (2): 327 kB | 506/587 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 9.3 MB/s) 2024-09-22T08:29:17.051 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 523/587 kB Progress (1): 539/587 kB Progress (1): 555/587 kB Progress (1): 572/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 15 MB/s) 2024-09-22T08:29:17.093 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-22T08:29:17.093 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] 2024-09-22T08:29:17.094 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-22T08:29:17.099 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-22T08:29:17.114 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 316 kB/s) 2024-09-22T08:29:17.115 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-22T08:29:17.130 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 454 kB/s) 2024-09-22T08:29:17.131 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-22T08:29:17.145 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.3 MB/s) 2024-09-22T08:29:17.147 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-22T08:29:17.161 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 998 kB/s) 2024-09-22T08:29:17.165 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-22T08:29:17.179 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 58 kB/s) 2024-09-22T08:29:17.182 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-22T08:29:17.196 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 303 kB/s) 2024-09-22T08:29:17.199 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-22T08:29:17.213 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.2 MB/s) 2024-09-22T08:29:17.217 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-22T08:29:17.232 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 331 kB/s) 2024-09-22T08:29:17.235 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-22T08:29:17.249 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 296 kB/s) 2024-09-22T08:29:17.253 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-22T08:29:17.267 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 158 kB/s) 2024-09-22T08:29:17.270 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-22T08:29:17.285 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 753 kB/s) 2024-09-22T08:29:17.288 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-22T08:29:17.303 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.1 MB/s) 2024-09-22T08:29:17.306 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-22T08:29:17.320 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 469 kB/s) 2024-09-22T08:29:17.323 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-22T08:29:17.337 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 76 kB/s) 2024-09-22T08:29:17.338 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-22T08:29:17.355 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 4.1/8.4 kB Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 493 kB/s) 2024-09-22T08:29:17.357 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-22T08:29:17.372 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 179 kB/s) 2024-09-22T08:29:17.376 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-22T08:29:17.391 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 375 kB/s) 2024-09-22T08:29:17.394 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-22T08:29:17.410 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 71 kB/s) 2024-09-22T08:29:17.414 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-22T08:29:17.429 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 51 kB/s) 2024-09-22T08:29:17.431 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-22T08:29:17.445 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 431 kB/s) 2024-09-22T08:29:17.447 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-22T08:29:17.462 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.7 MB/s) 2024-09-22T08:29:17.466 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-22T08:29:17.480 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 86 kB/s) 2024-09-22T08:29:17.482 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-22T08:29:17.496 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 94 kB/s) 2024-09-22T08:29:17.504 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-22T08:29:17.519 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 903 kB/s) 2024-09-22T08:29:17.519 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-22T08:29:17.519 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-22T08:29:17.519 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-22T08:29:17.520 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-22T08:29:17.520 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-22T08:29:17.533 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 4.2 kB Progress (2): 4.2 kB | 16/55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 301 kB/s) 2024-09-22T08:29:17.533 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-22T08:29:17.536 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 33/55 kB Progress (2): 33/55 kB | 16/122 kB Progress (3): 33/55 kB | 16/122 kB | 16/27 kB Progress (3): 49/55 kB | 16/122 kB | 16/27 kB Progress (3): 49/55 kB | 16/122 kB | 27 kB Progress (3): 55 kB | 16/122 kB | 27 kB Progress (4): 55 kB | 16/122 kB | 27 kB | 16/334 kB Progress (4): 55 kB | 33/122 kB | 27 kB | 16/334 kB Progress (4): 55 kB | 33/122 kB | 27 kB | 31/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.6 MB/s) 2024-09-22T08:29:17.536 INFO:tasks.workunit.client.0.smithi038.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.8 MB/s) 2024-09-22T08:29:17.536 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 49/122 kB | 31/334 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-22T08:29:17.536 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-22T08:29:17.536 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 49/122 kB | 48/334 kB Progress (2): 66/122 kB | 48/334 kB Progress (2): 66/122 kB | 64/334 kB Progress (2): 82/122 kB | 64/334 kB Progress (2): 96/122 kB | 64/334 kB Progress (2): 96/122 kB | 78/334 kB Progress (2): 113/122 kB | 78/334 kB Progress (2): 113/122 kB | 94/334 kB Progress (2): 122 kB | 94/334 kB Progress (2): 122 kB | 110/334 kB Progress (2): 122 kB | 127/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 7.2 MB/s) 2024-09-22T08:29:17.540 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 143/334 kB Progress (1): 159/334 kB Progress (1): 176/334 kB Progress (1): 192/334 kB Progress (1): 209/334 kB Progress (1): 225/334 kB Progress (1): 241/334 kB Progress (1): 258/334 kB Progress (1): 274/334 kB Progress (1): 291/334 kB Progress (1): 295/334 kB Progress (1): 311/334 kB Progress (1): 327/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 16 MB/s) 2024-09-22T08:29:17.548 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/267 kB Progress (1): 33/267 kB Progress (1): 49/267 kB Progress (1): 64/267 kB Progress (1): 80/267 kB Progress (1): 96/267 kB Progress (2): 96/267 kB | 4.7 kB Progress (3): 96/267 kB | 4.7 kB | 16/23 kB Progress (3): 113/267 kB | 4.7 kB | 16/23 kB Progress (3): 113/267 kB | 4.7 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 166 kB/s) 2024-09-22T08:29:17.548 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 129/267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 814 kB/s) 2024-09-22T08:29:17.551 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 145/267 kB Progress (1): 162/267 kB Progress (1): 178/267 kB Progress (1): 195/267 kB Progress (1): 211/267 kB Progress (1): 227/267 kB Progress (1): 244/267 kB Progress (1): 260/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 8.6 MB/s) 2024-09-22T08:29:17.599 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-22T08:29:17.600 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-22T08:29:18.192 INFO:tasks.workunit.client.0.smithi038.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-22T08:29:18.192 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] 2024-09-22T08:29:18.192 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-22T08:29:18.195 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-22T08:29:18.195 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] 2024-09-22T08:29:18.195 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-22T08:29:18.200 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-22T08:29:18.200 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-22T08:29:18.348 INFO:tasks.workunit.client.0.smithi038.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-22T08:29:18.348 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] 2024-09-22T08:29:18.348 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-22T08:29:18.352 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-22T08:29:18.367 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 416 kB/s) 2024-09-22T08:29:18.370 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-22T08:29:18.385 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 235 kB/s) 2024-09-22T08:29:18.388 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-22T08:29:18.402 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 233 kB/s) 2024-09-22T08:29:18.406 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-22T08:29:18.420 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 290 kB/s) 2024-09-22T08:29:18.423 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-22T08:29:18.438 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 220 kB/s) 2024-09-22T08:29:18.441 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-22T08:29:18.456 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 297 kB/s) 2024-09-22T08:29:18.459 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-22T08:29:18.475 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 110 kB/s) 2024-09-22T08:29:18.478 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-22T08:29:18.492 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 157 kB/s) 2024-09-22T08:29:18.494 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-22T08:29:18.508 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 2.2 MB/s) 2024-09-22T08:29:18.510 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-22T08:29:18.524 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 146 kB/s) 2024-09-22T08:29:18.527 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-22T08:29:18.541 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 414 kB/s) 2024-09-22T08:29:18.544 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-22T08:29:18.558 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 168 kB/s) 2024-09-22T08:29:18.560 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-22T08:29:18.574 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.6 MB/s) 2024-09-22T08:29:18.576 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-22T08:29:18.590 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/37 kB Progress (1): 33/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.7 MB/s) 2024-09-22T08:29:18.592 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-22T08:29:18.606 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 1.1 MB/s) 2024-09-22T08:29:18.608 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-22T08:29:18.621 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 618 kB/s) 2024-09-22T08:29:18.623 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-22T08:29:18.636 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 2.0 MB/s) 2024-09-22T08:29:18.639 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-22T08:29:18.653 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 576 kB/s) 2024-09-22T08:29:18.656 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-22T08:29:18.669 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 167 kB/s) 2024-09-22T08:29:18.672 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-22T08:29:18.686 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 185 kB/s) 2024-09-22T08:29:18.688 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-22T08:29:18.702 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 110 kB/s) 2024-09-22T08:29:18.703 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-22T08:29:18.717 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 219 kB/s) 2024-09-22T08:29:18.718 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-22T08:29:18.732 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.5 MB/s) 2024-09-22T08:29:18.733 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-22T08:29:18.747 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 483 kB/s) 2024-09-22T08:29:18.748 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-22T08:29:18.761 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 1.0 MB/s) 2024-09-22T08:29:18.764 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-22T08:29:18.778 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 212 kB/s) 2024-09-22T08:29:18.779 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-22T08:29:18.792 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 523 kB/s) 2024-09-22T08:29:18.794 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-22T08:29:18.807 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 646 kB/s) 2024-09-22T08:29:18.809 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-22T08:29:18.823 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 148 kB/s) 2024-09-22T08:29:18.825 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-22T08:29:18.839 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 159 kB/s) 2024-09-22T08:29:18.842 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-22T08:29:18.856 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 216 kB/s) 2024-09-22T08:29:18.859 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-22T08:29:18.873 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 1.1 MB/s) 2024-09-22T08:29:18.875 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-22T08:29:18.889 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 1.0 MB/s) 2024-09-22T08:29:18.892 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-22T08:29:18.905 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 1.0 MB/s) 2024-09-22T08:29:18.907 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-22T08:29:18.921 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 342 kB/s) 2024-09-22T08:29:18.923 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-22T08:29:18.937 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 448 kB/s) 2024-09-22T08:29:18.939 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-22T08:29:18.953 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 2.3 MB/s) 2024-09-22T08:29:18.956 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-22T08:29:18.969 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.3 MB/s) 2024-09-22T08:29:18.971 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-22T08:29:18.984 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 1.1 MB/s) 2024-09-22T08:29:18.987 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-22T08:29:19.000 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 58 kB/s) 2024-09-22T08:29:19.002 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-22T08:29:19.015 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 370 kB/s) 2024-09-22T08:29:19.018 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-22T08:29:19.031 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 609 kB/s) 2024-09-22T08:29:19.033 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-22T08:29:19.047 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 214 kB/s) 2024-09-22T08:29:19.050 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-22T08:29:19.063 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 327 kB/s) 2024-09-22T08:29:19.066 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-22T08:29:19.080 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 147 kB/s) 2024-09-22T08:29:19.082 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-22T08:29:19.096 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 248 kB/s) 2024-09-22T08:29:19.099 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-22T08:29:19.113 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.7/11 kB Progress (1): 5.5/11 kB Progress (1): 8.2/11 kB Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 729 kB/s) 2024-09-22T08:29:19.115 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-22T08:29:19.129 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 962 kB/s) 2024-09-22T08:29:19.131 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-22T08:29:19.145 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.3 MB/s) 2024-09-22T08:29:19.147 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-22T08:29:19.161 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 26 kB/s) 2024-09-22T08:29:19.162 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-22T08:29:19.176 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 436 kB/s) 2024-09-22T08:29:19.177 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-22T08:29:19.191 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 524 kB/s) 2024-09-22T08:29:19.192 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-22T08:29:19.205 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 371 kB/s) 2024-09-22T08:29:19.207 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-22T08:29:19.221 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 522 kB/s) 2024-09-22T08:29:19.224 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-22T08:29:19.237 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.4 MB/s) 2024-09-22T08:29:19.239 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-22T08:29:19.253 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 62/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 5.6 MB/s) 2024-09-22T08:29:19.256 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-22T08:29:19.272 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.7/23 kB Progress (1): 8.2/23 kB Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.5 MB/s) 2024-09-22T08:29:19.275 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-22T08:29:19.289 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 404 kB/s) 2024-09-22T08:29:19.291 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-22T08:29:19.304 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 329 kB/s) 2024-09-22T08:29:19.306 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-22T08:29:19.319 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 228 kB/s) 2024-09-22T08:29:19.321 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-22T08:29:19.334 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 2.0 MB/s) 2024-09-22T08:29:19.337 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-22T08:29:19.350 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 182 kB/s) 2024-09-22T08:29:19.355 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-22T08:29:19.376 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 65/308 kB Progress (1): 82/308 kB Progress (1): 98/308 kB Progress (1): 114/308 kB Progress (1): 131/308 kB Progress (1): 147/308 kB Progress (1): 163/308 kB Progress (1): 180/308 kB Progress (1): 196/308 kB Progress (1): 213/308 kB Progress (1): 229/308 kB Progress (1): 245/308 kB Progress (1): 262/308 kB Progress (1): 278/308 kB Progress (1): 294/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 15 MB/s) 2024-09-22T08:29:19.377 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-22T08:29:19.377 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-22T08:29:19.377 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-22T08:29:19.377 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-22T08:29:19.377 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-22T08:29:19.392 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 8.2 kB Progress (2): 8.2 kB | 14 kB Progress (3): 8.2 kB | 14 kB | 16/171 kB Progress (4): 8.2 kB | 14 kB | 16/171 kB | 16/26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 906 kB/s) 2024-09-22T08:29:19.392 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (3): 8.2 kB | 33/171 kB | 16/26 kB Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-22T08:29:19.392 INFO:tasks.workunit.client.0.smithi038.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 584 kB/s) 2024-09-22T08:29:19.392 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 33/171 kB | 26 kB Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-22T08:29:19.392 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 49/171 kB | 26 kB Progress (3): 49/171 kB | 26 kB | 16/118 kB Progress (3): 64/171 kB | 26 kB | 16/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.6 MB/s) 2024-09-22T08:29:19.392 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-22T08:29:19.395 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 64/171 kB | 33/118 kB Progress (2): 81/171 kB | 33/118 kB Progress (2): 81/171 kB | 49/118 kB Progress (2): 97/171 kB | 49/118 kB Progress (2): 97/171 kB | 64/118 kB Progress (2): 113/171 kB | 64/118 kB Progress (2): 113/171 kB | 80/118 kB Progress (2): 130/171 kB | 80/118 kB Progress (2): 130/171 kB | 97/118 kB Progress (2): 146/171 kB | 97/118 kB Progress (2): 146/171 kB | 113/118 kB Progress (2): 146/171 kB | 118 kB Progress (2): 163/171 kB | 118 kB Progress (2): 171 kB | 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 6.9 MB/s) 2024-09-22T08:29:19.395 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-22T08:29:19.395 INFO:tasks.workunit.client.0.smithi038.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 9.0 MB/s) 2024-09-22T08:29:19.395 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-22T08:29:19.407 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/136 kB Progress (2): 16/136 kB | 15/146 kB Progress (2): 33/136 kB | 15/146 kB Progress (2): 49/136 kB | 15/146 kB Progress (2): 49/136 kB | 31/146 kB Progress (2): 66/136 kB | 31/146 kB Progress (3): 66/136 kB | 31/146 kB | 16/61 kB Progress (3): 66/136 kB | 48/146 kB | 16/61 kB Progress (3): 82/136 kB | 48/146 kB | 16/61 kB Progress (3): 82/136 kB | 48/146 kB | 33/61 kB Progress (3): 98/136 kB | 48/146 kB | 33/61 kB Progress (3): 98/136 kB | 64/146 kB | 33/61 kB Progress (3): 113/136 kB | 64/146 kB | 33/61 kB Progress (3): 113/136 kB | 64/146 kB | 49/61 kB Progress (3): 113/136 kB | 78/146 kB | 49/61 kB Progress (3): 130/136 kB | 78/146 kB | 49/61 kB Progress (3): 136 kB | 78/146 kB | 49/61 kB Progress (3): 136 kB | 78/146 kB | 61 kB Progress (3): 136 kB | 94/146 kB | 61 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 4.5 MB/s) 2024-09-22T08:29:19.407 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-22T08:29:19.407 INFO:tasks.workunit.client.0.smithi038.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 2.0 MB/s) 2024-09-22T08:29:19.407 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-22T08:29:19.408 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 111/146 kB Progress (1): 127/146 kB Progress (1): 143/146 kB Progress (2): 143/146 kB | 16/501 kB Progress (2): 146 kB | 16/501 kB Progress (2): 146 kB | 33/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 4.7 MB/s) 2024-09-22T08:29:19.411 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 49/501 kB Progress (1): 66/501 kB Progress (2): 66/501 kB | 16/58 kB Progress (2): 82/501 kB | 16/58 kB Progress (2): 82/501 kB | 33/58 kB Progress (2): 98/501 kB | 33/58 kB Progress (2): 98/501 kB | 49/58 kB Progress (2): 98/501 kB | 58 kB Progress (2): 114/501 kB | 58 kB Progress (2): 131/501 kB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.7 MB/s) 2024-09-22T08:29:19.418 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 147/501 kB Progress (1): 164/501 kB Progress (1): 180/501 kB Progress (1): 196/501 kB Progress (1): 213/501 kB Progress (1): 229/501 kB Progress (1): 246/501 kB Progress (1): 262/501 kB Progress (1): 278/501 kB Progress (1): 295/501 kB Progress (1): 311/501 kB Progress (1): 327/501 kB Progress (1): 344/501 kB Progress (1): 360/501 kB Progress (1): 377/501 kB Progress (1): 393/501 kB Progress (1): 409/501 kB Progress (1): 426/501 kB Progress (1): 442/501 kB Progress (1): 459/501 kB Progress (1): 475/501 kB Progress (1): 491/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 12 MB/s) 2024-09-22T08:29:19.422 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/124 kB Progress (1): 33/124 kB Progress (1): 49/124 kB Progress (1): 65/124 kB Progress (1): 82/124 kB Progress (1): 98/124 kB Progress (1): 114/124 kB Progress (1): 124 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.7 MB/s) 2024-09-22T08:29:19.464 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 28 MB/s) 2024-09-22T08:29:19.555 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] 2024-09-22T08:29:19.555 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-22T08:29:19.559 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-22T08:29:19.574 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 299 kB/s) 2024-09-22T08:29:19.576 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-22T08:29:19.591 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 326 kB/s) 2024-09-22T08:29:19.593 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-22T08:29:19.608 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/45 kB Progress (1): 32/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 3.0 MB/s) 2024-09-22T08:29:19.611 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-22T08:29:19.625 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.4 MB/s) 2024-09-22T08:29:19.629 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-22T08:29:19.644 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 345 kB/s) 2024-09-22T08:29:19.647 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-22T08:29:19.661 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 280 kB/s) 2024-09-22T08:29:19.665 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-22T08:29:19.679 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 430 kB/s) 2024-09-22T08:29:19.682 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-22T08:29:19.697 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 417 kB/s) 2024-09-22T08:29:19.699 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-22T08:29:19.714 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.3 MB/s) 2024-09-22T08:29:19.719 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-22T08:29:19.733 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 1.0 MB/s) 2024-09-22T08:29:19.735 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-22T08:29:19.749 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 146 kB/s) 2024-09-22T08:29:19.751 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-22T08:29:19.765 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 587 kB/s) 2024-09-22T08:29:19.767 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-22T08:29:19.782 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 15/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.7 MB/s) 2024-09-22T08:29:19.789 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-22T08:29:19.803 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.6 MB/s) 2024-09-22T08:29:19.804 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-22T08:29:19.804 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-22T08:29:19.804 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-22T08:29:19.804 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-22T08:29:19.804 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-22T08:29:19.821 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/58 kB Progress (2): 16/58 kB | 16/26 kB Progress (3): 16/58 kB | 16/26 kB | 16/79 kB Progress (4): 16/58 kB | 16/26 kB | 16/79 kB | 16/211 kB Progress (4): 16/58 kB | 26 kB | 16/79 kB | 16/211 kB Progress (4): 33/58 kB | 26 kB | 16/79 kB | 16/211 kB Progress (4): 33/58 kB | 26 kB | 16/79 kB | 33/211 kB Progress (4): 33/58 kB | 26 kB | 33/79 kB | 33/211 kB Progress (4): 49/58 kB | 26 kB | 33/79 kB | 33/211 kB Progress (4): 49/58 kB | 26 kB | 33/79 kB | 49/211 kB Progress (4): 49/58 kB | 26 kB | 49/79 kB | 49/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.6 MB/s) 2024-09-22T08:29:19.822 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (3): 49/58 kB | 49/79 kB | 66/211 kB Progress (3): 58 kB | 49/79 kB | 66/211 kB Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-22T08:29:19.822 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (3): 58 kB | 63/79 kB | 66/211 kB Progress (3): 58 kB | 63/79 kB | 82/211 kB Progress (4): 58 kB | 63/79 kB | 82/211 kB | 0/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.9 MB/s) 2024-09-22T08:29:19.822 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (3): 79 kB | 82/211 kB | 0/1.0 MB Progress (3): 79 kB | 95/211 kB | 0/1.0 MB Progress (3): 79 kB | 95/211 kB | 0/1.0 MB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-22T08:29:19.822 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (3): 79 kB | 112/211 kB | 0/1.0 MB Progress (3): 79 kB | 112/211 kB | 0/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 5.0 MB/s) 2024-09-22T08:29:19.824 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 112/211 kB | 0.1/1.0 MB Progress (2): 128/211 kB | 0.1/1.0 MB Progress (2): 128/211 kB | 0.1/1.0 MB Progress (2): 145/211 kB | 0.1/1.0 MB Progress (2): 145/211 kB | 0.1/1.0 MB Progress (2): 161/211 kB | 0.1/1.0 MB Progress (2): 161/211 kB | 0.1/1.0 MB Progress (2): 177/211 kB | 0.1/1.0 MB Progress (2): 177/211 kB | 0.1/1.0 MB Progress (2): 194/211 kB | 0.1/1.0 MB Progress (2): 194/211 kB | 0.1/1.0 MB Progress (2): 210/211 kB | 0.1/1.0 MB Progress (2): 211 kB | 0.1/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 11 MB/s) 2024-09-22T08:29:19.837 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.9/1.0 MB Progress (2): 0.9/1.0 MB | 16/116 kB Progress (2): 0.9/1.0 MB | 16/116 kB Progress (2): 0.9/1.0 MB | 16/116 kB Progress (2): 0.9/1.0 MB | 33/116 kB Progress (2): 0.9/1.0 MB | 33/116 kB Progress (2): 0.9/1.0 MB | 49/116 kB Progress (2): 0.9/1.0 MB | 49/116 kB Progress (2): 0.9/1.0 MB | 66/116 kB Progress (2): 0.9/1.0 MB | 66/116 kB Progress (2): 0.9/1.0 MB | 82/116 kB Progress (2): 1.0/1.0 MB | 82/116 kB Progress (2): 1.0/1.0 MB | 98/116 kB Progress (2): 1.0/1.0 MB | 98/116 kB Progress (2): 1.0/1.0 MB | 98/116 kB Progress (2): 1.0/1.0 MB | 115/116 kB Progress (2): 1.0/1.0 MB | 116 kB Progress (3): 1.0/1.0 MB | 116 kB | 5.5/267 kB Progress (3): 1.0/1.0 MB | 116 kB | 5.5/267 kB Progress (3): 1.0/1.0 MB | 116 kB | 12/267 kB Progress (3): 1.0 MB | 116 kB | 12/267 kB Progress (3): 1.0 MB | 116 kB | 21/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.7 MB/s) 2024-09-22T08:29:19.837 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 1.0 MB | 27/267 kB Progress (2): 1.0 MB | 30/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 33 MB/s) 2024-09-22T08:29:19.840 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 32/267 kB Progress (1): 33/267 kB Progress (1): 34/267 kB Progress (1): 36/267 kB Progress (1): 37/267 kB Progress (1): 38/267 kB Progress (1): 40/267 kB Progress (1): 41/267 kB Progress (1): 44/267 kB Progress (1): 51/267 kB Progress (1): 60/267 kB Progress (1): 62/267 kB Progress (1): 78/267 kB Progress (1): 95/267 kB Progress (1): 111/267 kB Progress (1): 128/267 kB Progress (1): 144/267 kB Progress (1): 160/267 kB Progress (1): 177/267 kB Progress (1): 193/267 kB Progress (1): 209/267 kB Progress (1): 226/267 kB Progress (1): 242/267 kB Progress (1): 259/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 7.4 MB/s) 2024-09-22T08:29:20.013 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-22T08:29:20.038 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-22T08:29:20.038 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] BUILD SUCCESS 2024-09-22T08:29:20.038 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-22T08:29:20.038 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] Total time: 5.765 s 2024-09-22T08:29:20.039 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] Finished at: 2024-09-22T08:29:20Z 2024-09-22T08:29:20.039 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-22T08:29:20.060 INFO:tasks.workunit.client.0.smithi038.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-22T08:29:20.070 INFO:tasks.workunit.client.0.smithi038.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-22T08:29:21.104 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] Scanning for projects... 2024-09-22T08:29:21.209 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] 2024-09-22T08:29:21.210 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-22T08:29:21.210 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] Building jcksum 1.0 2024-09-22T08:29:21.210 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] from pom.xml 2024-09-22T08:29:21.210 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-22T08:29:21.463 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] 2024-09-22T08:29:21.463 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-22T08:29:21.555 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-22T08:29:21.555 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] 2024-09-22T08:29:21.556 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-22T08:29:21.646 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-22T08:29:21.646 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] 2024-09-22T08:29:21.646 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-22T08:29:21.648 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-22T08:29:21.648 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] 2024-09-22T08:29:21.648 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-22T08:29:21.653 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-22T08:29:21.653 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] 2024-09-22T08:29:21.653 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-22T08:29:21.834 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-22T08:29:22.036 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-22T08:29:22.241 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 22 kB/s) 2024-09-22T08:29:22.253 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-22T08:29:22.272 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 137 kB/s) 2024-09-22T08:29:22.281 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-22T08:29:22.299 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 148 kB/s) 2024-09-22T08:29:22.306 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-22T08:29:22.324 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 168 kB/s) 2024-09-22T08:29:22.327 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-22T08:29:22.345 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 178 kB/s) 2024-09-22T08:29:22.349 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-22T08:29:22.365 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 99 kB/s) 2024-09-22T08:29:22.367 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-22T08:29:22.383 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 177 kB/s) 2024-09-22T08:29:22.389 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-22T08:29:22.412 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.2/27 kB Progress (1): 9.6/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 16/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.2 MB/s) 2024-09-22T08:29:22.414 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-22T08:29:22.414 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-22T08:29:22.414 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-22T08:29:22.414 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-22T08:29:22.415 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-22T08:29:22.454 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/189 kB Progress (1): 33/189 kB Progress (1): 49/189 kB Progress (1): 63/189 kB Progress (1): 79/189 kB Progress (1): 96/189 kB Progress (1): 112/189 kB Progress (1): 128/189 kB Progress (1): 145/189 kB Progress (1): 161/189 kB Progress (1): 178/189 kB Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 4.7 MB/s) 2024-09-22T08:29:22.473 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.4/7.7 kB Progress (2): 1.4/7.7 kB | 1.4/18 kB Progress (3): 1.4/7.7 kB | 1.4/18 kB | 1.4/103 kB Progress (3): 1.4/7.7 kB | 2.8/18 kB | 1.4/103 kB Progress (4): 1.4/7.7 kB | 2.8/18 kB | 1.4/103 kB | 1.4/169 kB Progress (4): 2.8/7.7 kB | 2.8/18 kB | 1.4/103 kB | 1.4/169 kB Progress (4): 2.8/7.7 kB | 2.8/18 kB | 1.4/103 kB | 2.8/169 kB Progress (4): 2.8/7.7 kB | 4.1/18 kB | 1.4/103 kB | 2.8/169 kB Progress (4): 2.8/7.7 kB | 4.1/18 kB | 2.8/103 kB | 2.8/169 kB Progress (4): 2.8/7.7 kB | 5.5/18 kB | 2.8/103 kB | 2.8/169 kB Progress (4): 2.8/7.7 kB | 5.5/18 kB | 2.8/103 kB | 4.1/169 kB Progress (4): 4.1/7.7 kB | 5.5/18 kB | 2.8/103 kB | 4.1/169 kB Progress (4): 4.1/7.7 kB | 5.5/18 kB | 2.8/103 kB | 5.5/169 kB Progress (4): 4.1/7.7 kB | 6.9/18 kB | 2.8/103 kB | 5.5/169 kB Progress (4): 4.1/7.7 kB | 6.9/18 kB | 4.1/103 kB | 5.5/169 kB Progress (4): 4.1/7.7 kB | 8.3/18 kB | 4.1/103 kB | 5.5/169 kB Progress (4): 4.1/7.7 kB | 8.3/18 kB | 4.1/103 kB | 6.9/169 kB Progress (4): 5.5/7.7 kB | 8.3/18 kB | 4.1/103 kB | 6.9/169 kB Progress (4): 5.5/7.7 kB | 8.3/18 kB | 4.1/103 kB | 8.3/169 kB Progress (4): 5.5/7.7 kB | 9.7/18 kB | 4.1/103 kB | 8.3/169 kB Progress (4): 5.5/7.7 kB | 9.7/18 kB | 5.5/103 kB | 8.3/169 kB Progress (4): 5.5/7.7 kB | 11/18 kB | 5.5/103 kB | 8.3/169 kB Progress (4): 5.5/7.7 kB | 11/18 kB | 5.5/103 kB | 9.7/169 kB Progress (4): 6.9/7.7 kB | 11/18 kB | 5.5/103 kB | 9.7/169 kB Progress (4): 6.9/7.7 kB | 11/18 kB | 5.5/103 kB | 11/169 kB Progress (4): 6.9/7.7 kB | 12/18 kB | 5.5/103 kB | 11/169 kB Progress (4): 6.9/7.7 kB | 12/18 kB | 6.9/103 kB | 11/169 kB Progress (4): 6.9/7.7 kB | 14/18 kB | 6.9/103 kB | 11/169 kB Progress (4): 6.9/7.7 kB | 14/18 kB | 6.9/103 kB | 12/169 kB Progress (4): 7.7 kB | 14/18 kB | 6.9/103 kB | 12/169 kB Progress (4): 7.7 kB | 14/18 kB | 6.9/103 kB | 14/169 kB Progress (4): 7.7 kB | 15/18 kB | 6.9/103 kB | 14/169 kB Progress (4): 7.7 kB | 15/18 kB | 8.3/103 kB | 14/169 kB Progress (4): 7.7 kB | 17/18 kB | 8.3/103 kB | 14/169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 132 kB/s) 2024-09-22T08:29:22.475 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (3): 17/18 kB | 8.3/103 kB | 15/169 kB Progress (3): 18 kB | 8.3/103 kB | 15/169 kB Progress (3): 18 kB | 9.7/103 kB | 15/169 kB Progress (3): 18 kB | 9.7/103 kB | 16/169 kB Progress (3): 18 kB | 11/103 kB | 16/169 kB Progress (3): 18 kB | 11/103 kB | 18/169 kB Progress (3): 18 kB | 12/103 kB | 18/169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 283 kB/s) 2024-09-22T08:29:22.499 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 14/103 kB | 18/169 kB Progress (2): 14/103 kB | 19/169 kB Progress (2): 15/103 kB | 19/169 kB Progress (2): 15/103 kB | 21/169 kB Progress (2): 16/103 kB | 21/169 kB Progress (2): 16/103 kB | 22/169 kB Progress (2): 18/103 kB | 22/169 kB Progress (2): 18/103 kB | 23/169 kB Progress (2): 19/103 kB | 23/169 kB Progress (2): 19/103 kB | 25/169 kB Progress (2): 21/103 kB | 25/169 kB Progress (2): 21/103 kB | 26/169 kB Progress (2): 22/103 kB | 26/169 kB Progress (2): 22/103 kB | 27/169 kB Progress (2): 23/103 kB | 27/169 kB Progress (2): 23/103 kB | 29/169 kB Progress (2): 25/103 kB | 29/169 kB Progress (2): 25/103 kB | 30/169 kB Progress (2): 26/103 kB | 30/169 kB Progress (2): 26/103 kB | 32/169 kB Progress (2): 27/103 kB | 32/169 kB Progress (2): 27/103 kB | 33/169 kB Progress (2): 29/103 kB | 33/169 kB Progress (2): 29/103 kB | 34/169 kB Progress (2): 30/103 kB | 34/169 kB Progress (2): 30/103 kB | 36/169 kB Progress (2): 32/103 kB | 36/169 kB Progress (2): 32/103 kB | 37/169 kB Progress (2): 33/103 kB | 37/169 kB Progress (2): 33/103 kB | 38/169 kB Progress (2): 34/103 kB | 38/169 kB Progress (2): 34/103 kB | 40/169 kB Progress (2): 36/103 kB | 40/169 kB Progress (2): 36/103 kB | 41/169 kB Progress (2): 37/103 kB | 41/169 kB Progress (2): 37/103 kB | 43/169 kB Progress (2): 38/103 kB | 43/169 kB Progress (2): 38/103 kB | 44/169 kB Progress (2): 40/103 kB | 44/169 kB Progress (2): 40/103 kB | 45/169 kB Progress (2): 41/103 kB | 45/169 kB Progress (2): 41/103 kB | 47/169 kB Progress (2): 43/103 kB | 47/169 kB Progress (2): 43/103 kB | 48/169 kB Progress (2): 44/103 kB | 48/169 kB Progress (2): 44/103 kB | 49/169 kB Progress (2): 45/103 kB | 49/169 kB Progress (2): 45/103 kB | 51/169 kB Progress (2): 47/103 kB | 51/169 kB Progress (2): 47/103 kB | 52/169 kB Progress (2): 48/103 kB | 52/169 kB Progress (2): 48/103 kB | 54/169 kB Progress (2): 49/103 kB | 54/169 kB Progress (2): 49/103 kB | 55/169 kB Progress (2): 49/103 kB | 56/169 kB Progress (2): 66/103 kB | 56/169 kB Progress (2): 66/103 kB | 58/169 kB Progress (2): 66/103 kB | 59/169 kB Progress (2): 66/103 kB | 61/169 kB Progress (2): 66/103 kB | 62/169 kB Progress (2): 66/103 kB | 78/169 kB Progress (2): 82/103 kB | 78/169 kB Progress (2): 82/103 kB | 94/169 kB Progress (2): 98/103 kB | 94/169 kB Progress (2): 103 kB | 94/169 kB Progress (2): 103 kB | 111/169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.2 MB/s) 2024-09-22T08:29:22.504 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 127/169 kB Progress (1): 144/169 kB Progress (1): 160/169 kB Progress (1): 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 1.9 MB/s) 2024-09-22T08:29:22.520 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] 2024-09-22T08:29:22.521 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] ------------------------------------------------------- 2024-09-22T08:29:22.521 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] T E S T S 2024-09-22T08:29:22.521 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] ------------------------------------------------------- 2024-09-22T08:29:22.951 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-22T08:29:23.085 INFO:tasks.workunit.client.0.smithi038.stdout:PutObjects.java: starting test run: 2024-09-22T08:29:23.085 INFO:tasks.workunit.client.0.smithi038.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-22T08:29:23.085 INFO:tasks.workunit.client.0.smithi038.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-22T08:29:23.085 INFO:tasks.workunit.client.0.smithi038.stdout: EndpointUrl=https://smithi038.front.sepia.ceph.com:443 2024-09-22T08:29:23.085 INFO:tasks.workunit.client.0.smithi038.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-22T08:29:23.182 INFO:tasks.workunit.client.0.smithi038.stdout:DEBUG: Environment Variables Read 2024-09-22T08:29:23.484 INFO:tasks.workunit.client.0.smithi038.stdout:DEBUG: S3 Client Initialized 2024-09-22T08:29:23.484 INFO:tasks.workunit.client.0.smithi038.stdout:DEBUG: Generating File 2024-09-22T08:29:23.484 INFO:tasks.workunit.client.0.smithi038.stdout:DEBUG: File Generated 2024-09-22T08:29:23.485 INFO:tasks.workunit.client.0.smithi038.stdout:DEBUG: Generating File 2024-09-22T08:29:23.485 INFO:tasks.workunit.client.0.smithi038.stdout:DEBUG: File Generated 2024-09-22T08:29:23.485 INFO:tasks.workunit.client.0.smithi038.stdout:DEBUG: Generating File 2024-09-22T08:29:23.485 INFO:tasks.workunit.client.0.smithi038.stdout:DEBUG: File Generated 2024-09-22T08:29:23.485 INFO:tasks.workunit.client.0.smithi038.stdout:DEBUG: Generating File 2024-09-22T08:29:23.485 INFO:tasks.workunit.client.0.smithi038.stdout:DEBUG: File Generated 2024-09-22T08:29:23.485 INFO:tasks.workunit.client.0.smithi038.stdout:DEBUG: Generating File 2024-09-22T08:29:23.485 INFO:tasks.workunit.client.0.smithi038.stdout:DEBUG: File Generated 2024-09-22T08:29:23.485 INFO:tasks.workunit.client.0.smithi038.stdout:DEBUG: Generating File 2024-09-22T08:29:23.485 INFO:tasks.workunit.client.0.smithi038.stdout:DEBUG: File Generated 2024-09-22T08:29:23.485 INFO:tasks.workunit.client.0.smithi038.stdout:DEBUG: Generated Big Files 2024-09-22T08:29:23.778 INFO:tasks.workunit.client.0.smithi038.stdout:HeadBucketResponse() 2024-09-22T08:29:23.778 INFO:tasks.workunit.client.0.smithi038.stdout:sheik is ready 2024-09-22T08:29:23.778 INFO:tasks.workunit.client.0.smithi038.stdout:DEBUG: Test Bucket Created 2024-09-22T08:29:23.883 INFO:tasks.workunit.client.0.smithi038.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-22T08:29:23.951 INFO:tasks.workunit.client.0.smithi038.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-22T08:29:23.983 INFO:tasks.workunit.client.0.smithi038.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-22T08:29:24.040 INFO:tasks.workunit.client.0.smithi038.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-22T08:29:24.083 INFO:tasks.workunit.client.0.smithi038.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-22T08:29:24.183 INFO:tasks.workunit.client.0.smithi038.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-22T08:29:24.225 INFO:tasks.workunit.client.0.smithi038.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-22T08:29:24.284 INFO:tasks.workunit.client.0.smithi038.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-22T08:29:24.384 INFO:tasks.workunit.client.0.smithi038.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-22T08:29:24.484 INFO:tasks.workunit.client.0.smithi038.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-22T08:29:26.489 INFO:tasks.workunit.client.0.smithi038.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-22T08:29:26.888 INFO:tasks.workunit.client.0.smithi038.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-22T08:29:28.844 INFO:tasks.workunit.client.0.smithi038.stdout:arg: file-0b 2024-09-22T08:29:28.845 INFO:tasks.workunit.client.0.smithi038.stdout:arg: file-8b 2024-09-22T08:29:28.846 INFO:tasks.workunit.client.0.smithi038.stdout:arg: file-200b 2024-09-22T08:29:28.847 INFO:tasks.workunit.client.0.smithi038.stdout:arg: file-21983b 2024-09-22T08:29:28.848 INFO:tasks.workunit.client.0.smithi038.stdout:arg: file-5519b 2024-09-22T08:29:28.849 INFO:tasks.workunit.client.0.smithi038.stdout:arg: file-204329b 2024-09-22T08:29:28.850 INFO:tasks.workunit.client.0.smithi038.stdout:arg: file-256k 2024-09-22T08:29:28.851 INFO:tasks.workunit.client.0.smithi038.stdout:arg: file-1m 2024-09-22T08:29:28.852 INFO:tasks.workunit.client.0.smithi038.stdout:arg: file-1038757b 2024-09-22T08:29:28.887 INFO:tasks.workunit.client.0.smithi038.stdout:putObjectFromFileCksum called with file-0b 2024-09-22T08:29:28.887 INFO:tasks.workunit.client.0.smithi038.stdout:PutObjectResponse 2024-09-22T08:29:28.891 INFO:tasks.workunit.client.0.smithi038.stdout:putObjectFromFileCksum called with file-8b 2024-09-22T08:29:28.941 INFO:tasks.workunit.client.0.smithi038.stdout:PutObjectResponse 2024-09-22T08:29:28.991 INFO:tasks.workunit.client.0.smithi038.stdout:putObjectFromFileCksum called with file-200b 2024-09-22T08:29:28.992 INFO:tasks.workunit.client.0.smithi038.stdout:PutObjectResponse 2024-09-22T08:29:29.058 INFO:tasks.workunit.client.0.smithi038.stdout:putObjectFromFileCksum called with file-21983b 2024-09-22T08:29:29.058 INFO:tasks.workunit.client.0.smithi038.stdout:PutObjectResponse 2024-09-22T08:29:29.092 INFO:tasks.workunit.client.0.smithi038.stdout:putObjectFromFileCksum called with file-5519b 2024-09-22T08:29:29.092 INFO:tasks.workunit.client.0.smithi038.stdout:PutObjectResponse 2024-09-22T08:29:29.140 INFO:tasks.workunit.client.0.smithi038.stdout:putObjectFromFileCksum called with file-204329b 2024-09-22T08:29:29.140 INFO:tasks.workunit.client.0.smithi038.stdout:PutObjectResponse 2024-09-22T08:29:29.171 INFO:tasks.workunit.client.0.smithi038.stdout:putObjectFromFileCksum called with file-256k 2024-09-22T08:29:29.171 INFO:tasks.workunit.client.0.smithi038.stdout:PutObjectResponse 2024-09-22T08:29:29.192 INFO:tasks.workunit.client.0.smithi038.stdout:putObjectFromFileCksum called with file-1m 2024-09-22T08:29:29.219 INFO:tasks.workunit.client.0.smithi038.stdout:PutObjectResponse 2024-09-22T08:29:29.268 INFO:tasks.workunit.client.0.smithi038.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-22T08:29:29.268 INFO:tasks.workunit.client.0.smithi038.stdout:PutObjectResponse 2024-09-22T08:29:29.292 INFO:tasks.workunit.client.0.smithi038.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-22T08:29:29.592 INFO:tasks.workunit.client.0.smithi038.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-22T08:29:29.993 INFO:tasks.workunit.client.0.smithi038.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-22T08:29:34.212 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.25 s -- in io.ceph.jcksum.PutObjects 2024-09-22T08:29:34.222 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] 2024-09-22T08:29:34.222 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] Results: 2024-09-22T08:29:34.222 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] 2024-09-22T08:29:34.222 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-22T08:29:34.222 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] 2024-09-22T08:29:34.224 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-22T08:29:34.224 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] BUILD SUCCESS 2024-09-22T08:29:34.224 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-22T08:29:34.225 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] Total time: 13.140 s 2024-09-22T08:29:34.225 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] Finished at: 2024-09-22T08:29:34Z 2024-09-22T08:29:34.226 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-22T08:29:34.237 INFO:tasks.workunit.client.0.smithi038.stderr:+ exit 2024-09-22T08:29:34.237 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:29:34.237 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:29:34.318 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-22T08:29:34.318 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-22T08:29:34.703 DEBUG:teuthology.parallel:result is None 2024-09-22T08:29:34.704 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T08:29:34.743 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T08:29:34.743 DEBUG:teuthology.orchestra.run.smithi038:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-22T08:29:34.813 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T08:29:34.813 INFO:teuthology.run_tasks:Running task workunit... 2024-09-22T08:29:34.822 INFO:tasks.workunit:Pulling workunits from ref 8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:29:34.823 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-22T08:29:34.823 DEBUG:teuthology.orchestra.run.smithi038:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-22T08:29:34.883 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:29:34.883 INFO:teuthology.orchestra.run.smithi038.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-22T08:29:34.883 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-22T08:29:34.953 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-22T08:29:34.954 DEBUG:teuthology.orchestra.run.smithi038:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-22T08:29:35.024 INFO:tasks.workunit:timeout=3h 2024-09-22T08:29:35.024 INFO:tasks.workunit:cleanup=True 2024-09-22T08:29:35.024 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:29:35.095 INFO:tasks.workunit.client.0.smithi038.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-22T08:30:36.151 INFO:tasks.workunit.client.0.smithi038.stderr:Updating files: 92% (11738/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-22T08:30:36.583 INFO:tasks.workunit.client.0.smithi038.stderr:Note: switching to '8852379c050c686f4605f33f0129009b2029ca9d'. 2024-09-22T08:30:36.583 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:30:36.583 INFO:tasks.workunit.client.0.smithi038.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-22T08:30:36.583 INFO:tasks.workunit.client.0.smithi038.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-22T08:30:36.583 INFO:tasks.workunit.client.0.smithi038.stderr:state without impacting any branches by switching back to a branch. 2024-09-22T08:30:36.583 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:30:36.583 INFO:tasks.workunit.client.0.smithi038.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-22T08:30:36.583 INFO:tasks.workunit.client.0.smithi038.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-22T08:30:36.583 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:30:36.583 INFO:tasks.workunit.client.0.smithi038.stderr: git switch -c 2024-09-22T08:30:36.583 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:30:36.584 INFO:tasks.workunit.client.0.smithi038.stderr:Or undo this operation with: 2024-09-22T08:30:36.584 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:30:36.584 INFO:tasks.workunit.client.0.smithi038.stderr: git switch - 2024-09-22T08:30:36.584 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:30:36.584 INFO:tasks.workunit.client.0.smithi038.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-22T08:30:36.584 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:30:36.584 INFO:tasks.workunit.client.0.smithi038.stderr:HEAD is now at 8852379c050 rgw/cloud-restore: Fixed storage class update while listing objects. 2024-09-22T08:30:36.589 DEBUG:teuthology.orchestra.run.smithi038:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-22T08:30:36.659 INFO:tasks.workunit.client.0.smithi038.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-22T08:30:36.661 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-22T08:30:36.661 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-22T08:30:36.712 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-22T08:30:36.763 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-22T08:30:36.803 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-22T08:30:36.805 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-22T08:30:36.805 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-22T08:30:36.844 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-22T08:30:36.848 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-22T08:30:36.848 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-22T08:30:36.918 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-22T08:30:36.919 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-22T08:30:36.919 DEBUG:teuthology.orchestra.run.smithi038:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-22T08:30:36.993 INFO:tasks.workunit.client.0.smithi038.stdout:INFO: fully qualified domain name: smithi038.front.sepia.ceph.com 2024-09-22T08:30:36.994 INFO:tasks.workunit.client.0.smithi038.stdout:== TESTING *ABORTING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-22T08:30:36.994 INFO:tasks.workunit.client.0.smithi038.stdout:== TESTING NON-VERSIONED BUCKET == 2024-09-22T08:30:39.629 INFO:tasks.workunit.client.0.smithi038.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-22T08:30:39.813 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting pip 2024-09-22T08:30:39.819 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-22T08:30:39.865 INFO:tasks.workunit.client.0.smithi038.stdout:Installing collected packages: pip 2024-09-22T08:30:39.866 INFO:tasks.workunit.client.0.smithi038.stdout: Attempting uninstall: pip 2024-09-22T08:30:39.866 INFO:tasks.workunit.client.0.smithi038.stdout: Found existing installation: pip 21.3.1 2024-09-22T08:30:40.031 INFO:tasks.workunit.client.0.smithi038.stdout: Uninstalling pip-21.3.1: 2024-09-22T08:30:40.037 INFO:tasks.workunit.client.0.smithi038.stdout: Successfully uninstalled pip-21.3.1 2024-09-22T08:30:40.810 INFO:tasks.workunit.client.0.smithi038.stdout:Successfully installed pip-24.2 2024-09-22T08:30:41.668 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting boto3 2024-09-22T08:30:41.669 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached boto3-1.35.24-py3-none-any.whl.metadata (6.6 kB) 2024-09-22T08:30:42.239 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting botocore<1.36.0,>=1.35.24 (from boto3) 2024-09-22T08:30:42.241 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached botocore-1.35.24-py3-none-any.whl.metadata (5.7 kB) 2024-09-22T08:30:42.295 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-22T08:30:42.296 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-22T08:30:42.343 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-22T08:30:42.344 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-22T08:30:42.385 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.24->boto3) 2024-09-22T08:30:42.386 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-22T08:30:42.455 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.24->boto3) 2024-09-22T08:30:42.456 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-22T08:30:42.657 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.24->boto3) 2024-09-22T08:30:42.658 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-22T08:30:42.663 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached boto3-1.35.24-py3-none-any.whl (139 kB) 2024-09-22T08:30:42.664 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached botocore-1.35.24-py3-none-any.whl (12.6 MB) 2024-09-22T08:30:42.674 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-22T08:30:42.675 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-22T08:30:42.676 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-22T08:30:42.678 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-22T08:30:42.679 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-22T08:30:42.758 INFO:tasks.workunit.client.0.smithi038.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-22T08:30:43.823 INFO:tasks.workunit.client.0.smithi038.stdout:Successfully installed boto3-1.35.24 botocore-1.35.24 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-22T08:30:44.264 INFO:tasks.workunit.client.0.smithi038.stdout:INFO: creating user 2024-09-22T08:30:44.584 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-22T08:30:44.584 INFO:tasks.workunit.client.0.smithi038.stdout: "user_id": "testid", 2024-09-22T08:30:44.584 INFO:tasks.workunit.client.0.smithi038.stdout: "display_name": "M. Tester", 2024-09-22T08:30:44.584 INFO:tasks.workunit.client.0.smithi038.stdout: "email": "tester@ceph.com", 2024-09-22T08:30:44.584 INFO:tasks.workunit.client.0.smithi038.stdout: "suspended": 0, 2024-09-22T08:30:44.584 INFO:tasks.workunit.client.0.smithi038.stdout: "max_buckets": 1000, 2024-09-22T08:30:44.585 INFO:tasks.workunit.client.0.smithi038.stdout: "subusers": [], 2024-09-22T08:30:44.585 INFO:tasks.workunit.client.0.smithi038.stdout: "keys": [ 2024-09-22T08:30:44.585 INFO:tasks.workunit.client.0.smithi038.stdout: { 2024-09-22T08:30:44.585 INFO:tasks.workunit.client.0.smithi038.stdout: "user": "testid", 2024-09-22T08:30:44.585 INFO:tasks.workunit.client.0.smithi038.stdout: "access_key": "0555b35654ad1656d804", 2024-09-22T08:30:44.585 INFO:tasks.workunit.client.0.smithi038.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-22T08:30:44.585 INFO:tasks.workunit.client.0.smithi038.stdout: "active": true, 2024-09-22T08:30:44.585 INFO:tasks.workunit.client.0.smithi038.stdout: "create_date": "2024-09-22T08:30:44.577668Z" 2024-09-22T08:30:44.585 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-22T08:30:44.585 INFO:tasks.workunit.client.0.smithi038.stdout: ], 2024-09-22T08:30:44.585 INFO:tasks.workunit.client.0.smithi038.stdout: "swift_keys": [], 2024-09-22T08:30:44.585 INFO:tasks.workunit.client.0.smithi038.stdout: "caps": [], 2024-09-22T08:30:44.585 INFO:tasks.workunit.client.0.smithi038.stdout: "op_mask": "read, write, delete", 2024-09-22T08:30:44.585 INFO:tasks.workunit.client.0.smithi038.stdout: "default_placement": "", 2024-09-22T08:30:44.585 INFO:tasks.workunit.client.0.smithi038.stdout: "default_storage_class": "", 2024-09-22T08:30:44.586 INFO:tasks.workunit.client.0.smithi038.stdout: "placement_tags": [], 2024-09-22T08:30:44.586 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_quota": { 2024-09-22T08:30:44.586 INFO:tasks.workunit.client.0.smithi038.stdout: "enabled": false, 2024-09-22T08:30:44.586 INFO:tasks.workunit.client.0.smithi038.stdout: "check_on_raw": false, 2024-09-22T08:30:44.586 INFO:tasks.workunit.client.0.smithi038.stdout: "max_size": -1, 2024-09-22T08:30:44.586 INFO:tasks.workunit.client.0.smithi038.stdout: "max_size_kb": 0, 2024-09-22T08:30:44.586 INFO:tasks.workunit.client.0.smithi038.stdout: "max_objects": -1 2024-09-22T08:30:44.586 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:30:44.586 INFO:tasks.workunit.client.0.smithi038.stdout: "user_quota": { 2024-09-22T08:30:44.586 INFO:tasks.workunit.client.0.smithi038.stdout: "enabled": false, 2024-09-22T08:30:44.586 INFO:tasks.workunit.client.0.smithi038.stdout: "check_on_raw": false, 2024-09-22T08:30:44.586 INFO:tasks.workunit.client.0.smithi038.stdout: "max_size": -1, 2024-09-22T08:30:44.586 INFO:tasks.workunit.client.0.smithi038.stdout: "max_size_kb": 0, 2024-09-22T08:30:44.586 INFO:tasks.workunit.client.0.smithi038.stdout: "max_objects": -1 2024-09-22T08:30:44.587 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-22T08:30:44.587 INFO:tasks.workunit.client.0.smithi038.stdout: "temp_url_keys": [], 2024-09-22T08:30:44.587 INFO:tasks.workunit.client.0.smithi038.stdout: "type": "rgw", 2024-09-22T08:30:44.587 INFO:tasks.workunit.client.0.smithi038.stdout: "mfa_ids": [], 2024-09-22T08:30:44.587 INFO:tasks.workunit.client.0.smithi038.stdout: "account_id": "", 2024-09-22T08:30:44.587 INFO:tasks.workunit.client.0.smithi038.stdout: "path": "/", 2024-09-22T08:30:44.587 INFO:tasks.workunit.client.0.smithi038.stdout: "create_date": "2024-09-22T08:30:44.577656Z", 2024-09-22T08:30:44.587 INFO:tasks.workunit.client.0.smithi038.stdout: "tags": [], 2024-09-22T08:30:44.587 INFO:tasks.workunit.client.0.smithi038.stdout: "group_ids": [] 2024-09-22T08:30:44.587 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-22T08:30:44.587 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-22T08:30:49.422 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi038.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:30:49.422 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:30:49.454 INFO:tasks.workunit.client.0.smithi038.stderr:5+0 records in 2024-09-22T08:30:49.454 INFO:tasks.workunit.client.0.smithi038.stderr:5+0 records out 2024-09-22T08:30:49.454 INFO:tasks.workunit.client.0.smithi038.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0151866 s, 345 MB/s 2024-09-22T08:30:49.457 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi038.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:30:49.457 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:30:49.515 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi038.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:30:49.515 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:30:49.583 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi038.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:30:49.583 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:30:49.643 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi038.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:30:49.643 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:30:49.707 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi038.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:30:49.707 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:30:49.769 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi038.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:30:49.769 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:30:49.830 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi038.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:30:49.830 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:30:49.889 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi038.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:30:49.890 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:30:49.951 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi038.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:30:49.951 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:30:50.009 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi038.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:30:50.009 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:30:50.068 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi038.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:30:50.068 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:30:50.130 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi038.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:30:50.130 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:30:50.188 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi038.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:30:50.188 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:30:50.250 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi038.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:30:50.250 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:30:50.309 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi038.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:30:50.309 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:30:50.318 INFO:tasks.workunit.client.0.smithi038.stdout:bucket nams is reupload-bkt-100227 2024-09-22T08:30:50.318 INFO:tasks.workunit.client.0.smithi038.stdout:endpoint is https://smithi038.front.sepia.ceph.com:443 2024-09-22T08:30:50.319 INFO:tasks.workunit.client.0.smithi038.stdout:start UploadId=2~qb9GZQpBYFFU1uolc0mexCRPzNEhMDL 2024-09-22T08:30:50.319 INFO:tasks.workunit.client.0.smithi038.stdout:phase 1 uploaded part {'ETag': '"f29defc222d021b036fa374db264a025"', 'PartNumber': 1} 2024-09-22T08:30:50.319 INFO:tasks.workunit.client.0.smithi038.stdout:phase 1 uploaded part {'ETag': '"f29defc222d021b036fa374db264a025"', 'PartNumber': 2} 2024-09-22T08:30:50.319 INFO:tasks.workunit.client.0.smithi038.stdout:phase 2 uploaded part {'ETag': '"f29defc222d021b036fa374db264a025"', 'PartNumber': 1} 2024-09-22T08:30:50.319 INFO:tasks.workunit.client.0.smithi038.stdout:phase 2 uploaded part {'ETag': '"f29defc222d021b036fa374db264a025"', 'PartNumber': 1} 2024-09-22T08:30:50.319 INFO:tasks.workunit.client.0.smithi038.stdout:phase 2 uploaded part {'ETag': '"f29defc222d021b036fa374db264a025"', 'PartNumber': 1} 2024-09-22T08:30:50.319 INFO:tasks.workunit.client.0.smithi038.stdout:phase 2 uploaded part {'ETag': '"f29defc222d021b036fa374db264a025"', 'PartNumber': 1} 2024-09-22T08:30:50.319 INFO:tasks.workunit.client.0.smithi038.stdout:phase 2 uploaded part {'ETag': '"f29defc222d021b036fa374db264a025"', 'PartNumber': 1} 2024-09-22T08:30:50.319 INFO:tasks.workunit.client.0.smithi038.stdout:phase 2 uploaded part {'ETag': '"f29defc222d021b036fa374db264a025"', 'PartNumber': 1} 2024-09-22T08:30:50.319 INFO:tasks.workunit.client.0.smithi038.stdout:phase 2 uploaded part {'ETag': '"f29defc222d021b036fa374db264a025"', 'PartNumber': 1} 2024-09-22T08:30:50.319 INFO:tasks.workunit.client.0.smithi038.stdout:phase 2 uploaded part {'ETag': '"f29defc222d021b036fa374db264a025"', 'PartNumber': 1} 2024-09-22T08:30:50.319 INFO:tasks.workunit.client.0.smithi038.stdout:phase 2 uploaded part {'ETag': '"f29defc222d021b036fa374db264a025"', 'PartNumber': 1} 2024-09-22T08:30:50.319 INFO:tasks.workunit.client.0.smithi038.stdout:phase 2 uploaded part {'ETag': '"f29defc222d021b036fa374db264a025"', 'PartNumber': 1} 2024-09-22T08:30:50.320 INFO:tasks.workunit.client.0.smithi038.stdout:phase 2 uploaded part {'ETag': '"f29defc222d021b036fa374db264a025"', 'PartNumber': 1} 2024-09-22T08:30:50.320 INFO:tasks.workunit.client.0.smithi038.stdout:aborting multipart upload, parts=[{'ETag': '"f29defc222d021b036fa374db264a025"', 'PartNumber': 1}, {'ETag': '"f29defc222d021b036fa374db264a025"', 'PartNumber': 2}] 2024-09-22T08:30:51.521 INFO:tasks.workunit.client.0.smithi038.stdout:radosgw-admin bucket radoslist: 2024-09-22T08:30:51.581 INFO:tasks.workunit.client.0.smithi038.stdout:rados ls: 2024-09-22T08:30:51.596 INFO:tasks.workunit.client.0.smithi038.stdout:== PASSED == 2024-09-22T08:30:51.596 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:30:51.596 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:30:51.676 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-22T08:30:51.676 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-22T08:30:52.059 DEBUG:teuthology.parallel:result is None 2024-09-22T08:30:52.059 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T08:30:52.099 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T08:30:52.099 DEBUG:teuthology.orchestra.run.smithi038:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-22T08:30:52.168 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T08:30:52.169 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-22T08:30:52.182 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-22T08:30:52.183 INFO:tasks.ragweed:Downloading ragweed... 2024-09-22T08:30:52.183 INFO:tasks.ragweed:Using branch 'wip-skoduri-cloud-restore' for ragweed 2024-09-22T08:30:52.183 DEBUG:teuthology.orchestra.run.smithi038:> git clone -b wip-skoduri-cloud-restore https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-22T08:30:52.239 INFO:teuthology.orchestra.run.smithi038.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-22T08:30:52.269 INFO:teuthology.orchestra.run.smithi038.stderr:fatal: Remote branch wip-skoduri-cloud-restore not found in upstream origin 2024-09-22T08:30:52.269 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-09-22T08:30:52.270 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2024-09-22T08:30:52.271 DEBUG:teuthology.orchestra.run.smithi038:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-22T08:30:52.340 INFO:teuthology.orchestra.run.smithi038.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-22T08:30:52.500 INFO:tasks.ragweed:Creating rgw users... 2024-09-22T08:30:52.500 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-22T08:30:52.500 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key XORSAVXNGGQDSMZSCJDY --secret gdIQAhsxLUBuzWYKH90VFNqeTj2faQU+xqvh6S8rzJSQk/gV8qIgLA== --email ragweed.client.0+test@test.test --system false 2024-09-22T08:30:52.610 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:30:52.610 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:30:52.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.643+0000 7f1891412800 20 rados->read ofs=0 len=0 2024-09-22T08:30:52.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.645+0000 7f1891412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:30:52.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.645+0000 7f1891412800 20 realm 2024-09-22T08:30:52.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.645+0000 7f1891412800 20 rados->read ofs=0 len=0 2024-09-22T08:30:52.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.645+0000 7f1891412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:30:52.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.645+0000 7f1891412800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:30:52.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.645+0000 7f1891412800 20 rados->read ofs=0 len=0 2024-09-22T08:30:52.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.645+0000 7f1891412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:30:52.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.645+0000 7f1891412800 20 rados->read ofs=0 len=0 2024-09-22T08:30:52.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.646+0000 7f1891412800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:30:52.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.646+0000 7f1891412800 20 rados->read ofs=0 len=0 2024-09-22T08:30:52.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.647+0000 7f1891412800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:30:52.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.647+0000 7f1891412800 20 searching for the correct realm 2024-09-22T08:30:52.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.650+0000 7f188d2cc640 0 -- 172.21.15.38:0/1032361052 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7f187c00e040 msgr2=0x7f187c08b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:30:52.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.855+0000 7f188d2cc640 0 -- 172.21.15.38:0/1032361052 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x561078f60400 msgr2=0x561078f62890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:30:52.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.860+0000 7f1891412800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:30:52.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.860+0000 7f1891412800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:30:52.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.860+0000 7f1891412800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:30:52.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.860+0000 7f1891412800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:30:52.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.860+0000 7f1891412800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:30:52.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.860+0000 7f1891412800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:30:52.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.860+0000 7f1891412800 20 rados->read ofs=0 len=0 2024-09-22T08:30:52.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.861+0000 7f1891412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:30:52.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.861+0000 7f1891412800 20 rados->read ofs=0 len=0 2024-09-22T08:30:52.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.861+0000 7f1891412800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:30:52.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.861+0000 7f1891412800 20 rados->read ofs=0 len=0 2024-09-22T08:30:52.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.861+0000 7f1891412800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:30:52.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.861+0000 7f1891412800 20 zone default found 2024-09-22T08:30:52.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.861+0000 7f1891412800 4 Realm: () 2024-09-22T08:30:52.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.861+0000 7f1891412800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:30:52.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.861+0000 7f1891412800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:30:52.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.861+0000 7f1891412800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:30:52.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.861+0000 7f1891412800 20 zonegroup default 2024-09-22T08:30:52.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.861+0000 7f1891412800 20 rados->read ofs=0 len=0 2024-09-22T08:30:52.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.862+0000 7f1891412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:30:52.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.862+0000 7f1891412800 20 rados->read ofs=0 len=0 2024-09-22T08:30:52.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.862+0000 7f1891412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:30:52.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.862+0000 7f1891412800 20 rados->read ofs=0 len=0 2024-09-22T08:30:52.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.862+0000 7f1891412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:30:52.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.862+0000 7f1891412800 20 started sync module instance, tier type = 2024-09-22T08:30:52.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.862+0000 7f1891412800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:30:52.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.873+0000 7f1891412800 20 add_watcher() i=0 2024-09-22T08:30:52.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.873+0000 7f1891412800 20 add_watcher() i=1 2024-09-22T08:30:52.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.873+0000 7f1891412800 20 add_watcher() i=2 2024-09-22T08:30:52.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.873+0000 7f1891412800 20 add_watcher() i=3 2024-09-22T08:30:52.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.873+0000 7f1891412800 20 add_watcher() i=4 2024-09-22T08:30:52.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.873+0000 7f1891412800 20 add_watcher() i=5 2024-09-22T08:30:52.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.873+0000 7f1891412800 20 add_watcher() i=6 2024-09-22T08:30:52.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.874+0000 7f1891412800 20 add_watcher() i=7 2024-09-22T08:30:52.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.874+0000 7f1891412800 2 all 8 watchers are set, enabling cache 2024-09-22T08:30:52.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.876+0000 7f17437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:30:52.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.876+0000 7f1891412800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:30:52.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.876+0000 7f1891412800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:30:52.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.876+0000 7f1891412800 5 note: GC not initialized 2024-09-22T08:30:52.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.876+0000 7f17427e4640 20 reqs_thread_entry: start 2024-09-22T08:30:52.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.877+0000 7f1891412800 20 init_complete bucket index max shards: 11 2024-09-22T08:30:52.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.877+0000 7f1891412800 20 Filter name: none 2024-09-22T08:30:52.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.877+0000 7f173b7fe640 20 reqs_thread_entry: start 2024-09-22T08:30:52.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.877+0000 7f1891412800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-22T08:30:52.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.877+0000 7f1891412800 20 rados->read ofs=0 len=0 2024-09-22T08:30:52.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.877+0000 7f1891412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:30:52.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.877+0000 7f1891412800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-22T08:30:52.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.877+0000 7f1891412800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-22T08:30:52.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.877+0000 7f1891412800 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-22T08:30:52.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.877+0000 7f1891412800 20 rados->read ofs=0 len=0 2024-09-22T08:30:52.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.877+0000 7f1891412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:30:52.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.877+0000 7f1891412800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-22T08:30:52.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.877+0000 7f1891412800 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-22T08:30:52.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.877+0000 7f1891412800 10 cache get: name=default.rgw.meta+users.keys+XORSAVXNGGQDSMZSCJDY : miss 2024-09-22T08:30:52.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.877+0000 7f1891412800 20 rados->read ofs=0 len=0 2024-09-22T08:30:52.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.878+0000 7f1891412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:30:52.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.878+0000 7f1891412800 10 cache put: name=default.rgw.meta+users.keys+XORSAVXNGGQDSMZSCJDY info.flags=0x0 2024-09-22T08:30:52.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.878+0000 7f1891412800 10 adding default.rgw.meta+users.keys+XORSAVXNGGQDSMZSCJDY to cache LRU end 2024-09-22T08:30:52.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.878+0000 7f1891412800 10 cache get: name=default.rgw.meta+users.keys+XORSAVXNGGQDSMZSCJDY : hit (negative entry) 2024-09-22T08:30:52.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.878+0000 7f1891412800 10 cache get: name=default.rgw.meta+users.keys+XORSAVXNGGQDSMZSCJDY : hit (negative entry) 2024-09-22T08:30:52.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.879+0000 7f1891412800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-22T08:30:52.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.879+0000 7f1891412800 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-22T08:30:52.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.879+0000 7f1891412800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-22T08:30:52.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.879+0000 7f1763fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693294 cookie 94628748928944 notifier 5552 bl.length()=675 2024-09-22T08:30:52.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.879+0000 7f1763fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-22T08:30:52.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.879+0000 7f1763fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-22T08:30:52.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.881+0000 7f1891412800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-22T08:30:52.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.881+0000 7f1891412800 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-22T08:30:52.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.881+0000 7f1891412800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-22T08:30:52.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.881+0000 7f1763fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693198 cookie 94628748861264 notifier 5552 bl.length()=202 2024-09-22T08:30:52.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.881+0000 7f1763fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-22T08:30:52.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.881+0000 7f1763fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-22T08:30:52.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.883+0000 7f1891412800 10 cache put: name=default.rgw.meta+users.keys+XORSAVXNGGQDSMZSCJDY info.flags=0x7 2024-09-22T08:30:52.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.883+0000 7f1891412800 10 moving default.rgw.meta+users.keys+XORSAVXNGGQDSMZSCJDY to cache LRU end 2024-09-22T08:30:52.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.883+0000 7f1891412800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:XORSAVXNGGQDSMZSCJDY, ofs0, ns] 2024-09-22T08:30:52.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.883+0000 7f17637fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693200 cookie 94628748931152 notifier 5552 bl.length()=190 2024-09-22T08:30:52.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.883+0000 7f17637fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+XORSAVXNGGQDSMZSCJDY info.flags=0x7 2024-09-22T08:30:52.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.883+0000 7f17637fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+XORSAVXNGGQDSMZSCJDY to cache LRU end 2024-09-22T08:30:52.886 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-22T08:30:52.887 INFO:teuthology.orchestra.run.smithi038.stdout: "user_id": "ragweed.client.0", 2024-09-22T08:30:52.887 INFO:teuthology.orchestra.run.smithi038.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-22T08:30:52.887 INFO:teuthology.orchestra.run.smithi038.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-22T08:30:52.887 INFO:teuthology.orchestra.run.smithi038.stdout: "suspended": 0, 2024-09-22T08:30:52.887 INFO:teuthology.orchestra.run.smithi038.stdout: "max_buckets": 1000, 2024-09-22T08:30:52.887 INFO:teuthology.orchestra.run.smithi038.stdout: "subusers": [], 2024-09-22T08:30:52.887 INFO:teuthology.orchestra.run.smithi038.stdout: "keys": [ 2024-09-22T08:30:52.887 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-22T08:30:52.887 INFO:teuthology.orchestra.run.smithi038.stdout: "user": "ragweed.client.0", 2024-09-22T08:30:52.888 INFO:teuthology.orchestra.run.smithi038.stdout: "access_key": "XORSAVXNGGQDSMZSCJDY", 2024-09-22T08:30:52.888 INFO:teuthology.orchestra.run.smithi038.stdout: "secret_key": "gdIQAhsxLUBuzWYKH90VFNqeTj2faQU+xqvh6S8rzJSQk/gV8qIgLA==", 2024-09-22T08:30:52.888 INFO:teuthology.orchestra.run.smithi038.stdout: "active": true, 2024-09-22T08:30:52.888 INFO:teuthology.orchestra.run.smithi038.stdout: "create_date": "2024-09-22T08:30:52.878974Z" 2024-09-22T08:30:52.888 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-22T08:30:52.888 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-22T08:30:52.888 INFO:teuthology.orchestra.run.smithi038.stdout: "swift_keys": [], 2024-09-22T08:30:52.888 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": [], 2024-09-22T08:30:52.888 INFO:teuthology.orchestra.run.smithi038.stdout: "op_mask": "read, write, delete", 2024-09-22T08:30:52.889 INFO:teuthology.orchestra.run.smithi038.stdout: "default_placement": "", 2024-09-22T08:30:52.889 INFO:teuthology.orchestra.run.smithi038.stdout: "default_storage_class": "", 2024-09-22T08:30:52.889 INFO:teuthology.orchestra.run.smithi038.stdout: "placement_tags": [], 2024-09-22T08:30:52.889 INFO:teuthology.orchestra.run.smithi038.stdout: "bucket_quota": { 2024-09-22T08:30:52.889 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-22T08:30:52.889 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-22T08:30:52.889 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-22T08:30:52.889 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-22T08:30:52.889 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-22T08:30:52.889 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-22T08:30:52.890 INFO:teuthology.orchestra.run.smithi038.stdout: "user_quota": { 2024-09-22T08:30:52.890 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-22T08:30:52.890 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-22T08:30:52.890 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-22T08:30:52.890 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-22T08:30:52.890 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-22T08:30:52.890 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-22T08:30:52.890 INFO:teuthology.orchestra.run.smithi038.stdout: "temp_url_keys": [], 2024-09-22T08:30:52.890 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "rgw", 2024-09-22T08:30:52.890 INFO:teuthology.orchestra.run.smithi038.stdout: "mfa_ids": [], 2024-09-22T08:30:52.891 INFO:teuthology.orchestra.run.smithi038.stdout: "account_id": "", 2024-09-22T08:30:52.891 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-22T08:30:52.891 INFO:teuthology.orchestra.run.smithi038.stdout: "create_date": "2024-09-22T08:30:52.878962Z", 2024-09-22T08:30:52.891 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-22T08:30:52.891 INFO:teuthology.orchestra.run.smithi038.stdout: "group_ids": [] 2024-09-22T08:30:52.891 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-22T08:30:52.891 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:30:52.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.885+0000 7f17437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:30:52.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.887+0000 7f1891412800 20 remove_watcher() i=0 2024-09-22T08:30:52.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.887+0000 7f1891412800 2 removed watcher, disabling cache 2024-09-22T08:30:52.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.889+0000 7f1891412800 20 remove_watcher() i=1 2024-09-22T08:30:52.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.890+0000 7f1891412800 20 remove_watcher() i=2 2024-09-22T08:30:52.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.891+0000 7f1891412800 20 remove_watcher() i=3 2024-09-22T08:30:52.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.892+0000 7f1891412800 20 remove_watcher() i=4 2024-09-22T08:30:52.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.893+0000 7f1891412800 20 remove_watcher() i=5 2024-09-22T08:30:52.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.894+0000 7f1891412800 20 remove_watcher() i=6 2024-09-22T08:30:52.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:52.895+0000 7f1891412800 20 remove_watcher() i=7 2024-09-22T08:30:52.908 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-22T08:30:52.908 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key BLLEMYUTHNIEHSKDQFHG --secret lLcgexQAQg2Mg1MMHyn12iZHg5eFEvUoFHQZlRFCgXHWr+9V09tp5A== --email sysuser.client.0+test@test.test --system true 2024-09-22T08:30:52.976 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:30:52.977 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:30:53.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.012+0000 7fd417723800 20 rados->read ofs=0 len=0 2024-09-22T08:30:53.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.014+0000 7fd417723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:30:53.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.014+0000 7fd417723800 20 realm 2024-09-22T08:30:53.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.014+0000 7fd417723800 20 rados->read ofs=0 len=0 2024-09-22T08:30:53.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.014+0000 7fd417723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:30:53.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.014+0000 7fd417723800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:30:53.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.014+0000 7fd417723800 20 rados->read ofs=0 len=0 2024-09-22T08:30:53.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.015+0000 7fd417723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:30:53.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.015+0000 7fd417723800 20 rados->read ofs=0 len=0 2024-09-22T08:30:53.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.015+0000 7fd417723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:30:53.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.015+0000 7fd417723800 20 rados->read ofs=0 len=0 2024-09-22T08:30:53.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.016+0000 7fd417723800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:30:53.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.016+0000 7fd417723800 20 searching for the correct realm 2024-09-22T08:30:53.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.019+0000 7fd412c0b640 0 -- 172.21.15.38:0/305857877 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7fd2dc085510 msgr2=0x7fd2dc087940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:30:53.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.225+0000 7fd412c0b640 0 -- 172.21.15.38:0/305857877 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fd40409a910 msgr2=0x7fd40408c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:30:53.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.433+0000 7fd417723800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:30:53.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.433+0000 7fd417723800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:30:53.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.433+0000 7fd417723800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:30:53.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.433+0000 7fd417723800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:30:53.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.433+0000 7fd417723800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:30:53.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.433+0000 7fd417723800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:30:53.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.433+0000 7fd417723800 20 rados->read ofs=0 len=0 2024-09-22T08:30:53.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.433+0000 7fd417723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:30:53.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.433+0000 7fd417723800 20 rados->read ofs=0 len=0 2024-09-22T08:30:53.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.434+0000 7fd417723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:30:53.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.434+0000 7fd417723800 20 rados->read ofs=0 len=0 2024-09-22T08:30:53.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.434+0000 7fd417723800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:30:53.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.434+0000 7fd417723800 20 zone default found 2024-09-22T08:30:53.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.434+0000 7fd417723800 4 Realm: () 2024-09-22T08:30:53.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.434+0000 7fd417723800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:30:53.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.434+0000 7fd417723800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:30:53.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.434+0000 7fd417723800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:30:53.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.434+0000 7fd417723800 20 zonegroup default 2024-09-22T08:30:53.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.434+0000 7fd417723800 20 rados->read ofs=0 len=0 2024-09-22T08:30:53.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.435+0000 7fd417723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:30:53.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.435+0000 7fd417723800 20 rados->read ofs=0 len=0 2024-09-22T08:30:53.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.435+0000 7fd417723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:30:53.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.435+0000 7fd417723800 20 rados->read ofs=0 len=0 2024-09-22T08:30:53.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.435+0000 7fd417723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:30:53.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.435+0000 7fd417723800 20 started sync module instance, tier type = 2024-09-22T08:30:53.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.435+0000 7fd417723800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:30:53.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.446+0000 7fd417723800 20 add_watcher() i=0 2024-09-22T08:30:53.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.446+0000 7fd417723800 20 add_watcher() i=1 2024-09-22T08:30:53.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.446+0000 7fd417723800 20 add_watcher() i=2 2024-09-22T08:30:53.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.446+0000 7fd417723800 20 add_watcher() i=3 2024-09-22T08:30:53.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.446+0000 7fd417723800 20 add_watcher() i=4 2024-09-22T08:30:53.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.446+0000 7fd417723800 20 add_watcher() i=5 2024-09-22T08:30:53.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.446+0000 7fd417723800 20 add_watcher() i=6 2024-09-22T08:30:53.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.447+0000 7fd417723800 20 add_watcher() i=7 2024-09-22T08:30:53.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.447+0000 7fd417723800 2 all 8 watchers are set, enabling cache 2024-09-22T08:30:53.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.448+0000 7fd2c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:30:53.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.449+0000 7fd417723800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:30:53.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.449+0000 7fd417723800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:30:53.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.449+0000 7fd417723800 5 note: GC not initialized 2024-09-22T08:30:53.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.449+0000 7fd2c8fe1640 20 reqs_thread_entry: start 2024-09-22T08:30:53.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.449+0000 7fd417723800 20 init_complete bucket index max shards: 11 2024-09-22T08:30:53.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.449+0000 7fd417723800 20 Filter name: none 2024-09-22T08:30:53.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.449+0000 7fd2427fc640 20 reqs_thread_entry: start 2024-09-22T08:30:53.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.449+0000 7fd417723800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-22T08:30:53.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.449+0000 7fd417723800 20 rados->read ofs=0 len=0 2024-09-22T08:30:53.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.450+0000 7fd417723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:30:53.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.450+0000 7fd417723800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-22T08:30:53.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.450+0000 7fd417723800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-22T08:30:53.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.450+0000 7fd417723800 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-22T08:30:53.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.450+0000 7fd417723800 20 rados->read ofs=0 len=0 2024-09-22T08:30:53.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.450+0000 7fd417723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:30:53.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.450+0000 7fd417723800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-22T08:30:53.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.450+0000 7fd417723800 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-22T08:30:53.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.450+0000 7fd417723800 10 cache get: name=default.rgw.meta+users.keys+BLLEMYUTHNIEHSKDQFHG : miss 2024-09-22T08:30:53.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.450+0000 7fd417723800 20 rados->read ofs=0 len=0 2024-09-22T08:30:53.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.450+0000 7fd417723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:30:53.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.450+0000 7fd417723800 10 cache put: name=default.rgw.meta+users.keys+BLLEMYUTHNIEHSKDQFHG info.flags=0x0 2024-09-22T08:30:53.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.450+0000 7fd417723800 10 adding default.rgw.meta+users.keys+BLLEMYUTHNIEHSKDQFHG to cache LRU end 2024-09-22T08:30:53.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.450+0000 7fd417723800 10 cache get: name=default.rgw.meta+users.keys+BLLEMYUTHNIEHSKDQFHG : hit (negative entry) 2024-09-22T08:30:53.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.450+0000 7fd417723800 10 cache get: name=default.rgw.meta+users.keys+BLLEMYUTHNIEHSKDQFHG : hit (negative entry) 2024-09-22T08:30:53.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.452+0000 7fd417723800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-22T08:30:53.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.452+0000 7fd417723800 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-22T08:30:53.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.452+0000 7fd417723800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-22T08:30:53.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.452+0000 7fd2f6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693199 cookie 94596386183216 notifier 5820 bl.length()=675 2024-09-22T08:30:53.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.452+0000 7fd2f6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-22T08:30:53.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.452+0000 7fd2f6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-22T08:30:53.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.454+0000 7fd417723800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-22T08:30:53.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.454+0000 7fd417723800 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-22T08:30:53.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.454+0000 7fd417723800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-22T08:30:53.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.454+0000 7fd2f6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693295 cookie 94596386190720 notifier 5820 bl.length()=202 2024-09-22T08:30:53.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.454+0000 7fd2f6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-22T08:30:53.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.454+0000 7fd2f6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-22T08:30:53.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.456+0000 7fd417723800 10 cache put: name=default.rgw.meta+users.keys+BLLEMYUTHNIEHSKDQFHG info.flags=0x7 2024-09-22T08:30:53.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.456+0000 7fd417723800 10 moving default.rgw.meta+users.keys+BLLEMYUTHNIEHSKDQFHG to cache LRU end 2024-09-22T08:30:53.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.456+0000 7fd417723800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:BLLEMYUTHNIEHSKDQFHG, ofs0, ns] 2024-09-22T08:30:53.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.456+0000 7fd2f6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693191 cookie 94596386177568 notifier 5820 bl.length()=190 2024-09-22T08:30:53.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.456+0000 7fd2f6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+BLLEMYUTHNIEHSKDQFHG info.flags=0x7 2024-09-22T08:30:53.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.456+0000 7fd2f6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+BLLEMYUTHNIEHSKDQFHG to cache LRU end 2024-09-22T08:30:53.461 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-22T08:30:53.461 INFO:teuthology.orchestra.run.smithi038.stdout: "user_id": "sysuser.client.0", 2024-09-22T08:30:53.462 INFO:teuthology.orchestra.run.smithi038.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-22T08:30:53.462 INFO:teuthology.orchestra.run.smithi038.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-22T08:30:53.462 INFO:teuthology.orchestra.run.smithi038.stdout: "suspended": 0, 2024-09-22T08:30:53.462 INFO:teuthology.orchestra.run.smithi038.stdout: "max_buckets": 1000, 2024-09-22T08:30:53.462 INFO:teuthology.orchestra.run.smithi038.stdout: "subusers": [], 2024-09-22T08:30:53.462 INFO:teuthology.orchestra.run.smithi038.stdout: "keys": [ 2024-09-22T08:30:53.463 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-22T08:30:53.463 INFO:teuthology.orchestra.run.smithi038.stdout: "user": "sysuser.client.0", 2024-09-22T08:30:53.463 INFO:teuthology.orchestra.run.smithi038.stdout: "access_key": "BLLEMYUTHNIEHSKDQFHG", 2024-09-22T08:30:53.463 INFO:teuthology.orchestra.run.smithi038.stdout: "secret_key": "lLcgexQAQg2Mg1MMHyn12iZHg5eFEvUoFHQZlRFCgXHWr+9V09tp5A==", 2024-09-22T08:30:53.463 INFO:teuthology.orchestra.run.smithi038.stdout: "active": true, 2024-09-22T08:30:53.463 INFO:teuthology.orchestra.run.smithi038.stdout: "create_date": "2024-09-22T08:30:53.451624Z" 2024-09-22T08:30:53.464 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-22T08:30:53.464 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-22T08:30:53.464 INFO:teuthology.orchestra.run.smithi038.stdout: "swift_keys": [], 2024-09-22T08:30:53.464 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": [], 2024-09-22T08:30:53.464 INFO:teuthology.orchestra.run.smithi038.stdout: "op_mask": "read, write, delete", 2024-09-22T08:30:53.464 INFO:teuthology.orchestra.run.smithi038.stdout: "system": true, 2024-09-22T08:30:53.465 INFO:teuthology.orchestra.run.smithi038.stdout: "default_placement": "", 2024-09-22T08:30:53.465 INFO:teuthology.orchestra.run.smithi038.stdout: "default_storage_class": "", 2024-09-22T08:30:53.465 INFO:teuthology.orchestra.run.smithi038.stdout: "placement_tags": [], 2024-09-22T08:30:53.465 INFO:teuthology.orchestra.run.smithi038.stdout: "bucket_quota": { 2024-09-22T08:30:53.465 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-22T08:30:53.465 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-22T08:30:53.465 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-22T08:30:53.466 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-22T08:30:53.466 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-22T08:30:53.466 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-22T08:30:53.466 INFO:teuthology.orchestra.run.smithi038.stdout: "user_quota": { 2024-09-22T08:30:53.466 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-22T08:30:53.467 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-22T08:30:53.467 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-22T08:30:53.467 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-22T08:30:53.467 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-22T08:30:53.467 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-22T08:30:53.467 INFO:teuthology.orchestra.run.smithi038.stdout: "temp_url_keys": [], 2024-09-22T08:30:53.468 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "rgw", 2024-09-22T08:30:53.468 INFO:teuthology.orchestra.run.smithi038.stdout: "mfa_ids": [], 2024-09-22T08:30:53.468 INFO:teuthology.orchestra.run.smithi038.stdout: "account_id": "", 2024-09-22T08:30:53.468 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-22T08:30:53.468 INFO:teuthology.orchestra.run.smithi038.stdout: "create_date": "2024-09-22T08:30:53.451611Z", 2024-09-22T08:30:53.468 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-22T08:30:53.469 INFO:teuthology.orchestra.run.smithi038.stdout: "group_ids": [] 2024-09-22T08:30:53.469 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-22T08:30:53.469 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:30:53.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.457+0000 7fd2c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:30:53.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.460+0000 7fd417723800 20 remove_watcher() i=0 2024-09-22T08:30:53.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.460+0000 7fd417723800 2 removed watcher, disabling cache 2024-09-22T08:30:53.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.461+0000 7fd417723800 20 remove_watcher() i=1 2024-09-22T08:30:53.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.462+0000 7fd417723800 20 remove_watcher() i=2 2024-09-22T08:30:53.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.463+0000 7fd417723800 20 remove_watcher() i=3 2024-09-22T08:30:53.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.464+0000 7fd417723800 20 remove_watcher() i=4 2024-09-22T08:30:53.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.465+0000 7fd417723800 20 remove_watcher() i=5 2024-09-22T08:30:53.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.467+0000 7fd417723800 20 remove_watcher() i=6 2024-09-22T08:30:53.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:30:53.468+0000 7fd417723800 20 remove_watcher() i=7 2024-09-22T08:30:53.481 INFO:tasks.ragweed:Configuring ragweed... 2024-09-22T08:30:53.481 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-22T08:30:53.482 DEBUG:teuthology.orchestra.run.smithi038:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-22T08:30:53.511 INFO:tasks.ragweed:Configuring boto... 2024-09-22T08:30:53.512 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-22T08:30:53.512 DEBUG:teuthology.orchestra.run.smithi038:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-22T08:30:53.582 DEBUG:teuthology.orchestra.run.smithi038:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-22T08:30:53.783 INFO:teuthology.orchestra.run.smithi038.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-22T08:30:53.951 INFO:teuthology.orchestra.run.smithi038.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-22T08:30:54.565 INFO:teuthology.orchestra.run.smithi038.stdout:py installdeps: -rrequirements.txt 2024-09-22T08:31:00.879 INFO:teuthology.orchestra.run.smithi038.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-22T08:31:04.431 INFO:teuthology.orchestra.run.smithi038.stdout:py installed: asyncssh==2.13.2,Babel==2.9.1,bcrypt==3.2.2,boto==2.49.0,cachetools==4.2.4,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2023.5.7,cffi==1.14.5,chardet==4.0.0,cheroot==8.6.0,CherryPy==18.6.1,cockpit @ file:///builddir/build/BUILD/cockpit-323/tmp/wheel/cockpit-323-py3-none-any.whl,cryptography==36.0.1,dasbus==1.4,dbus-python==1.2.18,distro==1.5.0,docopt==0.6.2,exceptiongroup==1.2.2,execnet==2.1.1,file-magic==0.4.0,gevent==24.2.1,google-auth==2.34.0,gpg==1.15.1,greenlet==3.1.1,grpcio==1.46.7,grpcio-tools==1.46.7,httplib2==0.22.0,idna==2.10,iniconfig==2.0.0,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.0.0,jaraco.functools==3.5.0,jaraco.text==3.2.0,Jinja2==2.11.3,jsonpatch==1.21,jsonpointer==2.0,kubernetes==26.1.0,libcomps==0.1.18,logutils==0.3.5,lxml==4.6.5,Mako==1.1.4.dev0,MarkupSafe==1.1.1,more-itertools==8.12.0,munch==4.0.0,natsort==7.1.1,nftables==0.1,numpy==1.20.1,oauthlib==3.1.1,packaging==20.9,pecan==1.4.2,perf==0.1,pexpect==4.8.0,pluggy==1.5.0,ply==3.11,portend==3.1.0,prettytable==0.7.2,protobuf==3.14.0,psutil==5.8.0,ptyprocess==0.6.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.20,PyGObject==3.40.1,pyOpenSSL==21.0.0,pyparsing==2.4.7,PySocks==1.7.1,pytest==8.3.3,python-dateutil==2.8.1,python-linux-procfs==0.7.3,pytz==2021.1,pyudev==0.22.0,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=bc708b5eefef98d1006dcb73c1775d135a16a752dc2e25f0ce2721b2da73653d,rbd==2.0.0,registries-conf-ctl==1.0,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rpm==4.16.1.3,rsa==4.9,s3cmd==2.4.0,scipy==1.6.2,selinux==3.6,sepolicy==3.6,setools==4.4.4,setroubleshoot @ file:///builddir/build/BUILD/setroubleshoot-3.3.32/src,six==1.15.0,systemd-python==234,tempora==5.0.0,toml==0.10.2,tomli==2.0.1,typing_extensions==4.12.2,urllib3==1.26.5,WebOb==1.8.8,websocket-client==1.2.3,Werkzeug==2.0.3,zc.lockfile==2.0,zope.event==5.0,zope.interface==7.0.3 2024-09-22T08:31:04.431 INFO:teuthology.orchestra.run.smithi038.stdout:py run-test-pre: PYTHONHASHSEED='3903251219' 2024-09-22T08:31:04.431 INFO:teuthology.orchestra.run.smithi038.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-22T08:31:04.634 INFO:teuthology.orchestra.run.smithi038.stdout:============================= test session starts ============================== 2024-09-22T08:31:04.634 INFO:teuthology.orchestra.run.smithi038.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-22T08:31:04.634 INFO:teuthology.orchestra.run.smithi038.stdout:cachedir: .tox/py/.pytest_cache 2024-09-22T08:31:04.634 INFO:teuthology.orchestra.run.smithi038.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0 2024-09-22T08:31:04.634 INFO:teuthology.orchestra.run.smithi038.stdout:configfile: pytest.ini 2024-09-22T08:31:04.742 INFO:teuthology.orchestra.run.smithi038.stdout:collecting ... collected 9 items 2024-09-22T08:31:04.742 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:31:06.624 INFO:teuthology.orchestra.run.smithi038.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-22T08:31:07.473 INFO:teuthology.orchestra.run.smithi038.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-22T08:31:08.185 INFO:teuthology.orchestra.run.smithi038.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-22T08:31:08.935 INFO:teuthology.orchestra.run.smithi038.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-22T08:31:09.691 INFO:teuthology.orchestra.run.smithi038.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-22T08:31:15.934 INFO:teuthology.orchestra.run.smithi038.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-22T08:31:17.554 INFO:teuthology.orchestra.run.smithi038.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-22T08:31:19.547 INFO:teuthology.orchestra.run.smithi038.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-22T08:31:22.667 INFO:teuthology.orchestra.run.smithi038.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-22T08:31:22.668 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:31:22.668 INFO:teuthology.orchestra.run.smithi038.stdout:=============================== warnings summary =============================== 2024-09-22T08:31:22.668 INFO:teuthology.orchestra.run.smithi038.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-22T08:31:22.668 INFO:teuthology.orchestra.run.smithi038.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-22T08:31:22.668 INFO:teuthology.orchestra.run.smithi038.stdout: import imp 2024-09-22T08:31:22.668 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:31:22.668 INFO:teuthology.orchestra.run.smithi038.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-22T08:31:22.668 INFO:teuthology.orchestra.run.smithi038.stdout:======================== 9 passed, 1 warning in 18.03s ========================= 2024-09-22T08:31:22.700 INFO:teuthology.orchestra.run.smithi038.stdout:___________________________________ summary ____________________________________ 2024-09-22T08:31:22.700 INFO:teuthology.orchestra.run.smithi038.stdout: py: commands succeeded 2024-09-22T08:31:22.700 INFO:teuthology.orchestra.run.smithi038.stdout: congratulations :) 2024-09-22T08:31:22.718 INFO:tasks.ragweed:Cleaning up boto... 2024-09-22T08:31:22.719 DEBUG:teuthology.orchestra.run.smithi038:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-22T08:31:22.748 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-22T08:31:22.847 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:31:22.847 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:31:22.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:22.883+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:22.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:22.885+0000 7ffabe937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:31:22.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:22.885+0000 7ffabe937800 20 realm 2024-09-22T08:31:22.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:22.885+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:22.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:22.885+0000 7ffabe937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:31:22.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:22.885+0000 7ffabe937800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:31:22.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:22.885+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:22.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:22.885+0000 7ffabe937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:31:22.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:22.885+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:22.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:22.886+0000 7ffabe937800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:31:22.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:22.886+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:22.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:22.887+0000 7ffabe937800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:31:22.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:22.887+0000 7ffabe937800 20 searching for the correct realm 2024-09-22T08:31:22.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:22.887+0000 7ffaba67d640 0 -- 172.21.15.38:0/3651398846 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x55f0f8f1dad0 msgr2=0x55f0f8f1ff90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:31:23.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.094+0000 7ffaba67d640 0 -- 172.21.15.38:0/3651398846 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x55f0f8f11020 msgr2=0x55f0f8f134b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:31:23.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.102+0000 7ffabe937800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:31:23.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.102+0000 7ffabe937800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:31:23.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.102+0000 7ffabe937800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:31:23.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.102+0000 7ffabe937800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:31:23.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.102+0000 7ffabe937800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:31:23.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.102+0000 7ffabe937800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:31:23.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.102+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.102+0000 7ffabe937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:31:23.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.102+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.103+0000 7ffabe937800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:31:23.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.103+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.103+0000 7ffabe937800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:31:23.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.103+0000 7ffabe937800 20 zone default found 2024-09-22T08:31:23.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.103+0000 7ffabe937800 4 Realm: () 2024-09-22T08:31:23.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.103+0000 7ffabe937800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:31:23.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.103+0000 7ffabe937800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:31:23.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.103+0000 7ffabe937800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:31:23.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.103+0000 7ffabe937800 20 zonegroup default 2024-09-22T08:31:23.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.103+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.103+0000 7ffabe937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:31:23.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.103+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.104+0000 7ffabe937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:31:23.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.104+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.104+0000 7ffabe937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:31:23.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.104+0000 7ffabe937800 20 started sync module instance, tier type = 2024-09-22T08:31:23.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.104+0000 7ffabe937800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:31:23.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.114+0000 7ffabe937800 20 add_watcher() i=0 2024-09-22T08:31:23.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.114+0000 7ffabe937800 20 add_watcher() i=1 2024-09-22T08:31:23.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.114+0000 7ffabe937800 20 add_watcher() i=2 2024-09-22T08:31:23.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.114+0000 7ffabe937800 20 add_watcher() i=3 2024-09-22T08:31:23.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.114+0000 7ffabe937800 20 add_watcher() i=4 2024-09-22T08:31:23.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.114+0000 7ffabe937800 20 add_watcher() i=5 2024-09-22T08:31:23.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.114+0000 7ffabe937800 20 add_watcher() i=6 2024-09-22T08:31:23.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.116+0000 7ffabe937800 20 add_watcher() i=7 2024-09-22T08:31:23.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.116+0000 7ffabe937800 2 all 8 watchers are set, enabling cache 2024-09-22T08:31:23.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.117+0000 7ff970fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:31:23.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.117+0000 7ffabe937800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:31:23.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.117+0000 7ffabe937800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:31:23.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.156+0000 7ff8eb7fe640 20 reqs_thread_entry: start 2024-09-22T08:31:23.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.156+0000 7ffabe937800 20 init_complete bucket index max shards: 11 2024-09-22T08:31:23.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.156+0000 7ffabe937800 20 Filter name: none 2024-09-22T08:31:23.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.156+0000 7ff8e97fa640 20 reqs_thread_entry: start 2024-09-22T08:31:23.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.156+0000 7ffabe937800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-22T08:31:23.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.156+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.157+0000 7ffabe937800 20 rados_obj.operate() r=0 bl.length=486 2024-09-22T08:31:23.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.157+0000 7ffabe937800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-22T08:31:23.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.157+0000 7ffabe937800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-22T08:31:23.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.157+0000 7ffabe937800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:31:23.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.158+0000 7ffabe937800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:c62f9d7b-f6b6-404a-90de-de5607499115.4584.4 : miss 2024-09-22T08:31:23.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.158+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.158+0000 7ffabe937800 20 rados_obj.operate() r=0 bl.length=426 2024-09-22T08:31:23.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.158+0000 7ffabe937800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:c62f9d7b-f6b6-404a-90de-de5607499115.4584.4 info.flags=0x17 2024-09-22T08:31:23.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.158+0000 7ffabe937800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:c62f9d7b-f6b6-404a-90de-de5607499115.4584.4 to cache LRU end 2024-09-22T08:31:23.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.158+0000 7ffabe937800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:31:23.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.158+0000 7ffabe937800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-22T08:31:23.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.158+0000 7ffabe937800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:c62f9d7b-f6b6-404a-90de-de5607499115.4584.4 2024-09-22T08:31:23.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.159+0000 7ffabe937800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-22T08:31:23.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.160+0000 7ffabe937800 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-22T08:31:23.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.160+0000 7ffabe937800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-22T08:31:23.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.160+0000 7ffabe937800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-22T08:31:23.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.160+0000 7ffabe937800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-22T08:31:23.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.160+0000 7ffabe937800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-22T08:31:23.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.161+0000 7ffabe937800 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-22T08:31:23.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.162+0000 7ffabe937800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-22T08:31:23.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.162+0000 7ffabe937800 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-22T08:31:23.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.163+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8ebcf30 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55f0f8fddbf8 s->prefetch_data=0 2024-09-22T08:31:23.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.164+0000 7ffabe937800 10 manifest: total_size = 15980 2024-09-22T08:31:23.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.164+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.10851059785351314427 2024-09-22T08:31:23.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.164+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8ebcf30 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55f0f8fddbf8 s->prefetch_data=0 2024-09-22T08:31:23.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.164+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8fddbf8 2024-09-22T08:31:23.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.164+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.4.1 2024-09-22T08:31:23.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.166+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8ebcf30 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55f0f8fddbb8 s->prefetch_data=0 2024-09-22T08:31:23.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.166+0000 7ffabe937800 10 manifest: total_size = 7494 2024-09-22T08:31:23.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.166+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.6667050719860465073 2024-09-22T08:31:23.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.166+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8ebcf30 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55f0f8fddbb8 s->prefetch_data=0 2024-09-22T08:31:23.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.166+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8fddbb8 2024-09-22T08:31:23.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.166+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.4.2 2024-09-22T08:31:23.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.167+0000 7ff99dffb640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-22T08:31:23.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.169+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8ebcf30 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55f0f8fddbb8 s->prefetch_data=0 2024-09-22T08:31:23.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.169+0000 7ffabe937800 10 manifest: total_size = 15948 2024-09-22T08:31:23.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.169+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.11170640490489161305 2024-09-22T08:31:23.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.169+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8ebcf30 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55f0f8fddbb8 s->prefetch_data=0 2024-09-22T08:31:23.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.169+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8fddbb8 2024-09-22T08:31:23.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.169+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.4.2 2024-09-22T08:31:23.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.170+0000 7ff99d7fa640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-22T08:31:23.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.172+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8ebcf30 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55f0f8fddbb8 s->prefetch_data=0 2024-09-22T08:31:23.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.173+0000 7ffabe937800 10 manifest: total_size = 13128 2024-09-22T08:31:23.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.173+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.4835082186182490267 2024-09-22T08:31:23.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.173+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8ebcf30 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55f0f8fddbb8 s->prefetch_data=0 2024-09-22T08:31:23.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.173+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8fddbb8 2024-09-22T08:31:23.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.173+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.4.3 2024-09-22T08:31:23.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.173+0000 7ff99dffb640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-22T08:31:23.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.175+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8ebcf30 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55f0f8fddbb8 s->prefetch_data=0 2024-09-22T08:31:23.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.175+0000 7ffabe937800 10 manifest: total_size = 7548 2024-09-22T08:31:23.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.175+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.4223167789205991032 2024-09-22T08:31:23.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.175+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8ebcf30 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55f0f8fddbb8 s->prefetch_data=0 2024-09-22T08:31:23.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.175+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8fddbb8 2024-09-22T08:31:23.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.175+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.4.4 2024-09-22T08:31:23.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.176+0000 7ff99d7fa640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-22T08:31:23.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.178+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f683a0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55f0f8fddbb8 s->prefetch_data=0 2024-09-22T08:31:23.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.178+0000 7ffabe937800 10 manifest: total_size = 4983 2024-09-22T08:31:23.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.178+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.2455411812607115828 2024-09-22T08:31:23.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.178+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f683a0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55f0f8fddbb8 s->prefetch_data=0 2024-09-22T08:31:23.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.178+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8fddbb8 2024-09-22T08:31:23.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.178+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.4.4 2024-09-22T08:31:23.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.179+0000 7ff99dffb640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-22T08:31:23.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.180+0000 7ffabe937800 20 get_obj_state: octx=0x7ffab00bc000 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55f0f8fdd6a8 s->prefetch_data=0 2024-09-22T08:31:23.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.181+0000 7ffabe937800 10 manifest: total_size = 4904 2024-09-22T08:31:23.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.181+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.11764141668820379763 2024-09-22T08:31:23.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.181+0000 7ffabe937800 20 get_obj_state: octx=0x7ffab00bc000 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55f0f8fdd6a8 s->prefetch_data=0 2024-09-22T08:31:23.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.181+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8fdd6a8 2024-09-22T08:31:23.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.181+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.4.5 2024-09-22T08:31:23.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.181+0000 7ff99d7fa640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-22T08:31:23.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.183+0000 7ffabe937800 20 get_obj_state: octx=0x7ffab00bc000 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55f0f8fdd6a8 s->prefetch_data=0 2024-09-22T08:31:23.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.184+0000 7ffabe937800 10 manifest: total_size = 7898 2024-09-22T08:31:23.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.184+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.11275867828007575851 2024-09-22T08:31:23.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.184+0000 7ffabe937800 20 get_obj_state: octx=0x7ffab00bc000 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55f0f8fdd6a8 s->prefetch_data=0 2024-09-22T08:31:23.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.184+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8fdd6a8 2024-09-22T08:31:23.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.184+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.4.7 2024-09-22T08:31:23.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.185+0000 7ff99dffb640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-22T08:31:23.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.186+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8ebcf30 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55f0f8fdd6a8 s->prefetch_data=0 2024-09-22T08:31:23.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.187+0000 7ffabe937800 10 manifest: total_size = 38608 2024-09-22T08:31:23.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.187+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.2112313297426908290 2024-09-22T08:31:23.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.187+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8ebcf30 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55f0f8fdd6a8 s->prefetch_data=0 2024-09-22T08:31:23.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.187+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8fdd6a8 2024-09-22T08:31:23.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.187+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.4.8 2024-09-22T08:31:23.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.187+0000 7ff99d7fa640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-22T08:31:23.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.189+0000 7ffabe937800 20 list_objects_ordered: starting attempt 1 2024-09-22T08:31:23.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.189+0000 7ffabe937800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-22T08:31:23.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.190+0000 7ff99d7fa640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-22T08:31:23.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.190+0000 7ffabe937800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T08:31:23.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.190+0000 7ffabe937800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T08:31:23.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.190+0000 7ffabe937800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T08:31:23.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.190+0000 7ffabe937800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T08:31:23.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.190+0000 7ffabe937800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[c62f9d7b-f6b6-404a-90de-de5607499115.4584.4])"; uploads.size()=0; is_truncated=0 2024-09-22T08:31:23.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.192+0000 7ffabe937800 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-22T08:31:23.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.192+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.192+0000 7ffabe937800 20 rados_obj.operate() r=0 bl.length=204 2024-09-22T08:31:23.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.192+0000 7ffabe937800 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-22T08:31:23.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.192+0000 7ffabe937800 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-22T08:31:23.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.193+0000 7ffabe937800 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-22T08:31:23.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.193+0000 7ffabe937800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-22T08:31:23.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.194+0000 7ff99dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496974 cookie 94493457065728 notifier 5850 bl.length()=162 2024-09-22T08:31:23.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.195+0000 7ffabe937800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:c62f9d7b-f6b6-404a-90de-de5607499115.4584.4 from cache 2024-09-22T08:31:23.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.195+0000 7ffabe937800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:c62f9d7b-f6b6-404a-90de-de5607499115.4584.4, ofs0, ns] 2024-09-22T08:31:23.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.196+0000 7ff99d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496975 cookie 94493457065728 notifier 5850 bl.length()=219 2024-09-22T08:31:23.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.198+0000 7ffabe937800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/c62f9d7b-f6b6-404a-90de-de5607499115.4584.4 : miss 2024-09-22T08:31:23.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.198+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.199+0000 7ffabe937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:31:23.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.199+0000 7ffabe937800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/c62f9d7b-f6b6-404a-90de-de5607499115.4584.4 info.flags=0x0 2024-09-22T08:31:23.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.199+0000 7ffabe937800 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/c62f9d7b-f6b6-404a-90de-de5607499115.4584.4 to cache LRU end 2024-09-22T08:31:23.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.201+0000 7ffabe937800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.11 : miss 2024-09-22T08:31:23.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.201+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.202+0000 7ffabe937800 20 rados_obj.operate() r=0 bl.length=457 2024-09-22T08:31:23.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.202+0000 7ffabe937800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.11 info.flags=0x17 2024-09-22T08:31:23.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.202+0000 7ffabe937800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.11 to cache LRU end 2024-09-22T08:31:23.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.202+0000 7ffabe937800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:31:23.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.202+0000 7ffabe937800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-22T08:31:23.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.202+0000 7ffabe937800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.11 2024-09-22T08:31:23.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.206+0000 7ffabe937800 10 cls_bucket_list_unordered: got foo 2024-09-22T08:31:23.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.206+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f67be0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55f0f8f80f98 s->prefetch_data=0 2024-09-22T08:31:23.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.207+0000 7ffabe937800 10 manifest: total_size = 886297 2024-09-22T08:31:23.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.207+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.14985139845414418464 2024-09-22T08:31:23.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.207+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f67be0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55f0f8f80f98 s->prefetch_data=0 2024-09-22T08:31:23.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.207+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f80f98 2024-09-22T08:31:23.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.207+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.11.10 2024-09-22T08:31:23.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.209+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-22T08:31:23.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.209+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2024-09-22T08:31:23.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.209+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-22T08:31:23.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.209+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-22T08:31:23.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.209+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2024-09-22T08:31:23.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.209+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-09-22T08:31:23.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.209+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-22T08:31:23.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.209+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=246247 2024-09-22T08:31:23.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.209+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-09-22T08:31:23.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.209+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-09-22T08:31:23.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.209+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=4933045 part_ofs=738741 rule->part_size=147556 2024-09-22T08:31:23.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.209+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-09-22T08:31:23.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.209+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - tag is: c62f9d7b-f6b6-404a-90de-de5607499115.4584.14985139845414418464 2024-09-22T08:31:23.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.209+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:31:23.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.209+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.11__multipart_foo.2~Qdoj6MbR16WKKUuXkhPwc_ElJK79vww.1 2024-09-22T08:31:23.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.209+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-22T08:31:23.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.209+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.11__multipart_foo.2~Qdoj6MbR16WKKUuXkhPwc_ElJK79vww.2 2024-09-22T08:31:23.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.209+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-22T08:31:23.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.209+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.11__multipart_foo.2~Qdoj6MbR16WKKUuXkhPwc_ElJK79vww.3 2024-09-22T08:31:23.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.209+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-22T08:31:23.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.209+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.11__multipart_foo.2~Qdoj6MbR16WKKUuXkhPwc_ElJK79vww.4 2024-09-22T08:31:23.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.209+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-22T08:31:23.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.209+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:31:23.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.209+0000 7ffabe937800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: c62f9d7b-f6b6-404a-90de-de5607499115.4584.14985139845414418464 2024-09-22T08:31:23.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.210+0000 7ff99d7fa640 20 handle_completion(): completion ok for obj=foo 2024-09-22T08:31:23.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.211+0000 7ffabe937800 20 list_objects_ordered: starting attempt 1 2024-09-22T08:31:23.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.211+0000 7ffabe937800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-22T08:31:23.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.212+0000 7ffabe937800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T08:31:23.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.212+0000 7ffabe937800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T08:31:23.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.212+0000 7ffabe937800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T08:31:23.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.212+0000 7ffabe937800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T08:31:23.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.212+0000 7ffabe937800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[c62f9d7b-f6b6-404a-90de-de5607499115.4584.11])"; uploads.size()=0; is_truncated=0 2024-09-22T08:31:23.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.213+0000 7ffabe937800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-22T08:31:23.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.213+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.214+0000 7ffabe937800 20 rados_obj.operate() r=0 bl.length=235 2024-09-22T08:31:23.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.214+0000 7ffabe937800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-22T08:31:23.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.214+0000 7ffabe937800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-22T08:31:23.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.215+0000 7ffabe937800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-22T08:31:23.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.215+0000 7ffabe937800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-22T08:31:23.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.215+0000 7ff99dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497077 cookie 94493457125776 notifier 5850 bl.length()=191 2024-09-22T08:31:23.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.217+0000 7ffabe937800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.11 from cache 2024-09-22T08:31:23.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.217+0000 7ffabe937800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.11, ofs0, ns] 2024-09-22T08:31:23.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.217+0000 7ff99d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496981 cookie 94493457127984 notifier 5850 bl.length()=249 2024-09-22T08:31:23.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.220+0000 7ffabe937800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/c62f9d7b-f6b6-404a-90de-de5607499115.4584.11 : miss 2024-09-22T08:31:23.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.220+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.220+0000 7ffabe937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:31:23.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.220+0000 7ffabe937800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/c62f9d7b-f6b6-404a-90de-de5607499115.4584.11 info.flags=0x0 2024-09-22T08:31:23.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.220+0000 7ffabe937800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/c62f9d7b-f6b6-404a-90de-de5607499115.4584.11 to cache LRU end 2024-09-22T08:31:23.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.222+0000 7ffabe937800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.12 : miss 2024-09-22T08:31:23.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.222+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.223+0000 7ffabe937800 20 rados_obj.operate() r=0 bl.length=464 2024-09-22T08:31:23.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.223+0000 7ffabe937800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.12 info.flags=0x17 2024-09-22T08:31:23.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.223+0000 7ffabe937800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.12 to cache LRU end 2024-09-22T08:31:23.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.223+0000 7ffabe937800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:31:23.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.223+0000 7ffabe937800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-22T08:31:23.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.223+0000 7ffabe937800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.12 2024-09-22T08:31:23.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.228+0000 7ffabe937800 10 cls_bucket_list_unordered: got foo 2024-09-22T08:31:23.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.228+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f6c690 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55f0f8f6a218 s->prefetch_data=0 2024-09-22T08:31:23.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.228+0000 7ffabe937800 10 manifest: total_size = 886297 2024-09-22T08:31:23.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.228+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.9315201185618748351 2024-09-22T08:31:23.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.228+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f6c690 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55f0f8f6a218 s->prefetch_data=0 2024-09-22T08:31:23.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.228+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f6a218 2024-09-22T08:31:23.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.228+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.12.10 2024-09-22T08:31:23.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.230+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-22T08:31:23.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.230+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2024-09-22T08:31:23.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.230+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-22T08:31:23.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.230+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-22T08:31:23.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.230+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2024-09-22T08:31:23.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.230+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-09-22T08:31:23.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.230+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-22T08:31:23.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.230+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=246247 2024-09-22T08:31:23.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.230+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-09-22T08:31:23.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.230+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-09-22T08:31:23.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.230+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=4933045 part_ofs=738741 rule->part_size=147556 2024-09-22T08:31:23.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.230+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-09-22T08:31:23.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.230+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - tag is: c62f9d7b-f6b6-404a-90de-de5607499115.4584.9315201185618748351 2024-09-22T08:31:23.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.230+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:31:23.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.230+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.12__multipart_foo.2~_BF4iAJF-6e7Ucrabjm34mrLJbRHSFU.1 2024-09-22T08:31:23.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.230+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-22T08:31:23.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.230+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.12__multipart_foo.2~_BF4iAJF-6e7Ucrabjm34mrLJbRHSFU.2 2024-09-22T08:31:23.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.230+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-22T08:31:23.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.230+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.12__multipart_foo.2~_BF4iAJF-6e7Ucrabjm34mrLJbRHSFU.3 2024-09-22T08:31:23.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.230+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-22T08:31:23.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.230+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.12__multipart_foo.2~_BF4iAJF-6e7Ucrabjm34mrLJbRHSFU.4 2024-09-22T08:31:23.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.230+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-22T08:31:23.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.230+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:31:23.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.230+0000 7ffabe937800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: c62f9d7b-f6b6-404a-90de-de5607499115.4584.9315201185618748351 2024-09-22T08:31:23.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.231+0000 7ff99d7fa640 20 handle_completion(): completion ok for obj=foo 2024-09-22T08:31:23.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.232+0000 7ffabe937800 20 list_objects_ordered: starting attempt 1 2024-09-22T08:31:23.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.232+0000 7ffabe937800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-22T08:31:23.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.233+0000 7ffabe937800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T08:31:23.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.233+0000 7ffabe937800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T08:31:23.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.233+0000 7ffabe937800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T08:31:23.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.233+0000 7ffabe937800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T08:31:23.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.233+0000 7ffabe937800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[c62f9d7b-f6b6-404a-90de-de5607499115.4584.12])"; uploads.size()=0; is_truncated=0 2024-09-22T08:31:23.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.234+0000 7ffabe937800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-22T08:31:23.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.234+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.235+0000 7ffabe937800 20 rados_obj.operate() r=0 bl.length=242 2024-09-22T08:31:23.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.235+0000 7ffabe937800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-22T08:31:23.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.235+0000 7ffabe937800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-22T08:31:23.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.236+0000 7ffabe937800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-22T08:31:23.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.236+0000 7ffabe937800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-22T08:31:23.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.236+0000 7ff99dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496982 cookie 94493457127984 notifier 5850 bl.length()=198 2024-09-22T08:31:23.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.238+0000 7ffabe937800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.12 from cache 2024-09-22T08:31:23.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.238+0000 7ffabe937800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.12, ofs0, ns] 2024-09-22T08:31:23.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.238+0000 7ff99d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496984 cookie 94493457143440 notifier 5850 bl.length()=256 2024-09-22T08:31:23.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.240+0000 7ffabe937800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/c62f9d7b-f6b6-404a-90de-de5607499115.4584.12 : miss 2024-09-22T08:31:23.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.240+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.241+0000 7ffabe937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:31:23.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.241+0000 7ffabe937800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/c62f9d7b-f6b6-404a-90de-de5607499115.4584.12 info.flags=0x0 2024-09-22T08:31:23.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.241+0000 7ffabe937800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/c62f9d7b-f6b6-404a-90de-de5607499115.4584.12 to cache LRU end 2024-09-22T08:31:23.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.243+0000 7ffabe937800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.10 : miss 2024-09-22T08:31:23.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.243+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.243+0000 7ffabe937800 20 rados_obj.operate() r=0 bl.length=459 2024-09-22T08:31:23.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.243+0000 7ffabe937800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.10 info.flags=0x17 2024-09-22T08:31:23.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.243+0000 7ffabe937800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.10 to cache LRU end 2024-09-22T08:31:23.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.243+0000 7ffabe937800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:31:23.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.243+0000 7ffabe937800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-22T08:31:23.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.243+0000 7ffabe937800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.10 2024-09-22T08:31:23.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.247+0000 7ffabe937800 10 cls_bucket_list_unordered: got foo[UdI4lZAYxveIpS6kAzP2indPpbbDEST] 2024-09-22T08:31:23.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.247+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.10.10 2024-09-22T08:31:23.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.248+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f67be0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55f0f8f68b88 s->prefetch_data=0 2024-09-22T08:31:23.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.248+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to sr4bivy76h66zqsl5wfplluwhh53b5qe 2024-09-22T08:31:23.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.248+0000 7ffabe937800 20 get_obj_state_impl: setting s->olh_tag to 2q4i3ldebhzionf9da2cqvqa7aelockg 2024-09-22T08:31:23.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.248+0000 7ffabe937800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2q4i3ldebhzionf9da2cqvqa7aelockg 2024-09-22T08:31:23.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.249+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.10.10 2024-09-22T08:31:23.252 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.251+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.10.10 2024-09-22T08:31:23.252 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.251+0000 7ffabe937800 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-22T08:31:23.252 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.251+0000 7ffabe937800 20 olh_log_entry: epoch=3 op=3 key=foo[UdI4lZAYxveIpS6kAzP2indPpbbDEST] 2024-09-22T08:31:23.252 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.251+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f67be0 obj=test-client.0-r-test-multipart-index-versioning.1:_:UdI4lZAYxveIpS6kAzP2indPpbbDEST_foo state=0x55f0f8f7ed68 s->prefetch_data=0 2024-09-22T08:31:23.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.251+0000 7ffabe937800 10 manifest: total_size = 886297 2024-09-22T08:31:23.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.251+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.2619650540564678229 2024-09-22T08:31:23.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.251+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f67be0 obj=test-client.0-r-test-multipart-index-versioning.1:_:UdI4lZAYxveIpS6kAzP2indPpbbDEST_foo state=0x55f0f8f7ed68 s->prefetch_data=0 2024-09-22T08:31:23.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.251+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f7ed68 2024-09-22T08:31:23.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.251+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.10.10 2024-09-22T08:31:23.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.254+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-22T08:31:23.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.254+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2024-09-22T08:31:23.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.254+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-22T08:31:23.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.254+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-22T08:31:23.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.254+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2024-09-22T08:31:23.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.254+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-09-22T08:31:23.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.254+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-22T08:31:23.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.254+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=246247 2024-09-22T08:31:23.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.254+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-09-22T08:31:23.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.254+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-09-22T08:31:23.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.254+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=4933045 part_ofs=738741 rule->part_size=147556 2024-09-22T08:31:23.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.254+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-09-22T08:31:23.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.254+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - tag is: c62f9d7b-f6b6-404a-90de-de5607499115.4584.2619650540564678229 2024-09-22T08:31:23.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.254+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:31:23.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.254+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.10__multipart_foo.2~XSHNRkr5HvA6wwhuNOemg9NBklVsR_n.1 2024-09-22T08:31:23.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.254+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-22T08:31:23.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.254+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.10__multipart_foo.2~XSHNRkr5HvA6wwhuNOemg9NBklVsR_n.2 2024-09-22T08:31:23.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.254+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-22T08:31:23.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.254+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.10__multipart_foo.2~XSHNRkr5HvA6wwhuNOemg9NBklVsR_n.3 2024-09-22T08:31:23.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.254+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-22T08:31:23.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.254+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.10__multipart_foo.2~XSHNRkr5HvA6wwhuNOemg9NBklVsR_n.4 2024-09-22T08:31:23.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.254+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-22T08:31:23.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.254+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:31:23.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.254+0000 7ffabe937800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: c62f9d7b-f6b6-404a-90de-de5607499115.4584.2619650540564678229 2024-09-22T08:31:23.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.255+0000 7ff99d7fa640 20 handle_completion(): completion ok for obj=foo[UdI4lZAYxveIpS6kAzP2indPpbbDEST] 2024-09-22T08:31:23.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.256+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f67be0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55f0f8f68b88 s->prefetch_data=0 2024-09-22T08:31:23.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.258+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.10.10 2024-09-22T08:31:23.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.260+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.10.10 2024-09-22T08:31:23.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.260+0000 7ffabe937800 20 list_objects_ordered: starting attempt 1 2024-09-22T08:31:23.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.260+0000 7ffabe937800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-22T08:31:23.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.261+0000 7ffabe937800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T08:31:23.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.261+0000 7ffabe937800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T08:31:23.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.261+0000 7ffabe937800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T08:31:23.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.261+0000 7ffabe937800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T08:31:23.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.261+0000 7ffabe937800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[c62f9d7b-f6b6-404a-90de-de5607499115.4584.10])"; uploads.size()=0; is_truncated=0 2024-09-22T08:31:23.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.263+0000 7ffabe937800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-22T08:31:23.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.263+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.263+0000 7ffabe937800 20 rados_obj.operate() r=0 bl.length=237 2024-09-22T08:31:23.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.263+0000 7ffabe937800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-22T08:31:23.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.263+0000 7ffabe937800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-22T08:31:23.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.264+0000 7ffabe937800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-22T08:31:23.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.264+0000 7ffabe937800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-22T08:31:23.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.265+0000 7ff99d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496983 cookie 94493457127984 notifier 5850 bl.length()=193 2024-09-22T08:31:23.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.266+0000 7ffabe937800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.10 from cache 2024-09-22T08:31:23.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.266+0000 7ffabe937800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.10, ofs0, ns] 2024-09-22T08:31:23.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.266+0000 7ff99dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496985 cookie 94493457129552 notifier 5850 bl.length()=251 2024-09-22T08:31:23.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.270+0000 7ffabe937800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/c62f9d7b-f6b6-404a-90de-de5607499115.4584.10 : miss 2024-09-22T08:31:23.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.270+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.270+0000 7ffabe937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:31:23.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.270+0000 7ffabe937800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/c62f9d7b-f6b6-404a-90de-de5607499115.4584.10 info.flags=0x0 2024-09-22T08:31:23.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.270+0000 7ffabe937800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/c62f9d7b-f6b6-404a-90de-de5607499115.4584.10 to cache LRU end 2024-09-22T08:31:23.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.272+0000 7ffabe937800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.9 : miss 2024-09-22T08:31:23.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.272+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.272+0000 7ffabe937800 20 rados_obj.operate() r=0 bl.length=447 2024-09-22T08:31:23.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.272+0000 7ffabe937800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.9 info.flags=0x17 2024-09-22T08:31:23.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.272+0000 7ffabe937800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.9 to cache LRU end 2024-09-22T08:31:23.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.272+0000 7ffabe937800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:31:23.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.272+0000 7ffabe937800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-22T08:31:23.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.272+0000 7ffabe937800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.9 2024-09-22T08:31:23.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.276+0000 7ffabe937800 10 cls_bucket_list_unordered: got foo 2024-09-22T08:31:23.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.276+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f638e0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55f0f8f68b88 s->prefetch_data=0 2024-09-22T08:31:23.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.276+0000 7ffabe937800 10 manifest: total_size = 26079 2024-09-22T08:31:23.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.276+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.1488808610722313733 2024-09-22T08:31:23.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.276+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f638e0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55f0f8f68b88 s->prefetch_data=0 2024-09-22T08:31:23.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.276+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f68b88 2024-09-22T08:31:23.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.276+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.9.10 2024-09-22T08:31:23.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.279+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=4 2024-09-22T08:31:23.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.279+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=7671 2024-09-22T08:31:23.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.279+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=7671 stripe_ofs=7671 part_ofs=7671 rule->part_size=7670 2024-09-22T08:31:23.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.279+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=4 2024-09-22T08:31:23.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.279+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=4201975 part_ofs=7671 rule->part_size=7670 2024-09-22T08:31:23.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.279+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=15341 stripe_ofs=15341 part_ofs=15341 rule->part_size=7671 2024-09-22T08:31:23.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.279+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=4 2024-09-22T08:31:23.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.279+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=4209645 part_ofs=15341 rule->part_size=7671 2024-09-22T08:31:23.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.279+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=23012 stripe_ofs=23012 part_ofs=23012 rule->part_size=3067 2024-09-22T08:31:23.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.279+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=4 2024-09-22T08:31:23.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.279+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=4217316 part_ofs=23012 rule->part_size=3067 2024-09-22T08:31:23.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.279+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=26079 stripe_ofs=26079 part_ofs=26079 rule->part_size=3067 2024-09-22T08:31:23.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.279+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - tag is: c62f9d7b-f6b6-404a-90de-de5607499115.4584.1488808610722313733 2024-09-22T08:31:23.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.279+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:31:23.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.279+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.9__multipart_foo.2~c-Q3A65IzOVRXlbhE-qhOJyht1ITTPg.1 2024-09-22T08:31:23.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.279+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 344 2024-09-22T08:31:23.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.279+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.9__multipart_foo.2~c-Q3A65IzOVRXlbhE-qhOJyht1ITTPg.2 2024-09-22T08:31:23.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.279+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 588 2024-09-22T08:31:23.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.279+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.9__multipart_foo.2~c-Q3A65IzOVRXlbhE-qhOJyht1ITTPg.3 2024-09-22T08:31:23.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.279+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 832 2024-09-22T08:31:23.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.279+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.9__multipart_foo.2~c-Q3A65IzOVRXlbhE-qhOJyht1ITTPg.4 2024-09-22T08:31:23.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.279+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1076 2024-09-22T08:31:23.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.279+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:31:23.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.279+0000 7ffabe937800 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: c62f9d7b-f6b6-404a-90de-de5607499115.4584.1488808610722313733 2024-09-22T08:31:23.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.280+0000 7ff99d7fa640 20 handle_completion(): completion ok for obj=foo 2024-09-22T08:31:23.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.280+0000 7ffabe937800 20 list_objects_ordered: starting attempt 1 2024-09-22T08:31:23.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.280+0000 7ffabe937800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-22T08:31:23.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.281+0000 7ffabe937800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T08:31:23.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.281+0000 7ffabe937800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T08:31:23.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.281+0000 7ffabe937800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T08:31:23.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.281+0000 7ffabe937800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T08:31:23.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.281+0000 7ffabe937800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[c62f9d7b-f6b6-404a-90de-de5607499115.4584.9])"; uploads.size()=0; is_truncated=0 2024-09-22T08:31:23.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.283+0000 7ffabe937800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-22T08:31:23.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.283+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.283+0000 7ffabe937800 20 rados_obj.operate() r=0 bl.length=225 2024-09-22T08:31:23.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.283+0000 7ffabe937800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-22T08:31:23.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.283+0000 7ffabe937800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-22T08:31:23.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.284+0000 7ffabe937800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-22T08:31:23.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.284+0000 7ffabe937800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-22T08:31:23.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.284+0000 7ff99dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497078 cookie 94493457134624 notifier 5850 bl.length()=183 2024-09-22T08:31:23.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.286+0000 7ffabe937800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.9 from cache 2024-09-22T08:31:23.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.286+0000 7ffabe937800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.9, ofs0, ns] 2024-09-22T08:31:23.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.286+0000 7ff99d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496986 cookie 94493457139600 notifier 5850 bl.length()=240 2024-09-22T08:31:23.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.289+0000 7ffabe937800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/c62f9d7b-f6b6-404a-90de-de5607499115.4584.9 : miss 2024-09-22T08:31:23.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.289+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.289+0000 7ffabe937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:31:23.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.289+0000 7ffabe937800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/c62f9d7b-f6b6-404a-90de-de5607499115.4584.9 info.flags=0x0 2024-09-22T08:31:23.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.289+0000 7ffabe937800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/c62f9d7b-f6b6-404a-90de-de5607499115.4584.9 to cache LRU end 2024-09-22T08:31:23.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.291+0000 7ffabe937800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.15 : miss 2024-09-22T08:31:23.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.291+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.291+0000 7ffabe937800 20 rados_obj.operate() r=0 bl.length=455 2024-09-22T08:31:23.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.291+0000 7ffabe937800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.15 info.flags=0x17 2024-09-22T08:31:23.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.291+0000 7ffabe937800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.15 to cache LRU end 2024-09-22T08:31:23.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.291+0000 7ffabe937800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:31:23.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.291+0000 7ffabe937800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-22T08:31:23.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.291+0000 7ffabe937800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.15 2024-09-22T08:31:23.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.292+0000 7ffabe937800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-22T08:31:23.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.293+0000 7ffabe937800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-22T08:31:23.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.293+0000 7ffabe937800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-22T08:31:23.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.294+0000 7ffabe937800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-22T08:31:23.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.294+0000 7ffabe937800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-22T08:31:23.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.294+0000 7ffabe937800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-22T08:31:23.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.295+0000 7ffabe937800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-22T08:31:23.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.295+0000 7ffabe937800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-22T08:31:23.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.295+0000 7ffabe937800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-22T08:31:23.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.295+0000 7ffabe937800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-22T08:31:23.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.295+0000 7ffabe937800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-22T08:31:23.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.296+0000 7ffabe937800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-22T08:31:23.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.296+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8fde830 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55f0f8f7baf8 s->prefetch_data=0 2024-09-22T08:31:23.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.296+0000 7ffabe937800 10 manifest: total_size = 324647 2024-09-22T08:31:23.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.296+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to _XWAy8pxoscMM6eV0DfVPtMaysTzlDU0 2024-09-22T08:31:23.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.296+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8fde830 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55f0f8f7baf8 s->prefetch_data=0 2024-09-22T08:31:23.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.296+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f7baf8 2024-09-22T08:31:23.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.296+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.15.0 2024-09-22T08:31:23.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.299+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:31:23.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.299+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=324647 stripe_ofs=324647 part_ofs=0 rule->part_size=0 2024-09-22T08:31:23.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.299+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - tag is: _XWAy8pxoscMM6eV0DfVPtMaysTzlDU0 2024-09-22T08:31:23.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.299+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:31:23.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.299+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.15__shadow_.TmqC36-OfZaQKegMhj5zvmBmgcB3wKf_0 2024-09-22T08:31:23.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.299+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-22T08:31:23.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.299+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:31:23.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.299+0000 7ffabe937800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: _XWAy8pxoscMM6eV0DfVPtMaysTzlDU0 2024-09-22T08:31:23.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.300+0000 7ff99dffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-22T08:31:23.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.300+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8fde830 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55f0f8f83888 s->prefetch_data=0 2024-09-22T08:31:23.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.301+0000 7ffabe937800 10 manifest: total_size = 5242880 2024-09-22T08:31:23.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.301+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to _35o-ldkK-ip7OHeeE6aBwLgpHZcAiC- 2024-09-22T08:31:23.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.301+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8fde830 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55f0f8f83888 s->prefetch_data=0 2024-09-22T08:31:23.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.301+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f83888 2024-09-22T08:31:23.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.301+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.15.2 2024-09-22T08:31:23.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.304+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:31:23.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.304+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-22T08:31:23.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.304+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - tag is: _35o-ldkK-ip7OHeeE6aBwLgpHZcAiC- 2024-09-22T08:31:23.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.304+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:31:23.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.304+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.15__shadow_.vONc14FV0dTtbb1ojoTL8OI_R8pe4BG_1 2024-09-22T08:31:23.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.304+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-22T08:31:23.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.304+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:31:23.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.304+0000 7ffabe937800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: _35o-ldkK-ip7OHeeE6aBwLgpHZcAiC- 2024-09-22T08:31:23.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.306+0000 7ff99d7fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-22T08:31:23.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.306+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f638b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55f0f8f83888 s->prefetch_data=0 2024-09-22T08:31:23.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.306+0000 7ffabe937800 10 manifest: total_size = 5242880 2024-09-22T08:31:23.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.306+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.8183557636807237596 2024-09-22T08:31:23.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.306+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f638b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55f0f8f83888 s->prefetch_data=0 2024-09-22T08:31:23.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.306+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f83888 2024-09-22T08:31:23.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.306+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.15.3 2024-09-22T08:31:23.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.308+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:31:23.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.308+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-22T08:31:23.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.308+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:31:23.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.308+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-22T08:31:23.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.308+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - tag is: c62f9d7b-f6b6-404a-90de-de5607499115.4584.8183557636807237596 2024-09-22T08:31:23.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.308+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:31:23.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.308+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.15__shadow_.eWg3VnHvcOu-puZvOwgz1c_qHzjTosl_0 2024-09-22T08:31:23.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.308+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-22T08:31:23.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.308+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.15__shadow_.eWg3VnHvcOu-puZvOwgz1c_qHzjTosl_1 2024-09-22T08:31:23.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.308+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-09-22T08:31:23.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.308+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:31:23.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.308+0000 7ffabe937800 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: c62f9d7b-f6b6-404a-90de-de5607499115.4584.8183557636807237596 2024-09-22T08:31:23.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.309+0000 7ff99dffb640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-22T08:31:23.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.310+0000 7ffabe937800 20 get_obj_state: octx=0x7ffab4069900 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55f0f8f83888 s->prefetch_data=0 2024-09-22T08:31:23.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.310+0000 7ffabe937800 10 manifest: total_size = 5242880 2024-09-22T08:31:23.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.310+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to _zNHX_JNE9WSQ5QWLivi9U4mNjahuWLk 2024-09-22T08:31:23.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.310+0000 7ffabe937800 20 get_obj_state: octx=0x7ffab4069900 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55f0f8f83888 s->prefetch_data=0 2024-09-22T08:31:23.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.310+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f83888 2024-09-22T08:31:23.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.310+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.15.5 2024-09-22T08:31:23.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.312+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:31:23.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.312+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-22T08:31:23.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.312+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:31:23.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.312+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-22T08:31:23.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.312+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - tag is: _zNHX_JNE9WSQ5QWLivi9U4mNjahuWLk 2024-09-22T08:31:23.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.312+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:31:23.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.312+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.15__shadow_.I4pK2q3BUuhI1-0PWC5Kgb_gB_M11f5_0 2024-09-22T08:31:23.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.312+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-22T08:31:23.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.312+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.15__shadow_.I4pK2q3BUuhI1-0PWC5Kgb_gB_M11f5_1 2024-09-22T08:31:23.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.312+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-22T08:31:23.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.312+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:31:23.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.312+0000 7ffabe937800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: _zNHX_JNE9WSQ5QWLivi9U4mNjahuWLk 2024-09-22T08:31:23.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.313+0000 7ff99d7fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-22T08:31:23.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.314+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f68700 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55f0f8f83888 s->prefetch_data=0 2024-09-22T08:31:23.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.314+0000 7ffabe937800 10 manifest: total_size = 5242880 2024-09-22T08:31:23.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.314+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to _D_YzSapRUyDUfZjQ1Bp-1OdcQPGqltM 2024-09-22T08:31:23.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.314+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f68700 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55f0f8f83888 s->prefetch_data=0 2024-09-22T08:31:23.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.314+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f83888 2024-09-22T08:31:23.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.314+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.15.5 2024-09-22T08:31:23.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.316+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:31:23.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.316+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-22T08:31:23.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.316+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:31:23.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.316+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-22T08:31:23.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.316+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - tag is: _D_YzSapRUyDUfZjQ1Bp-1OdcQPGqltM 2024-09-22T08:31:23.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.316+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:31:23.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.316+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.15__shadow_.jB20MdoqW-SzLokuXBZ9i2HKl47vroY_0 2024-09-22T08:31:23.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.316+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-22T08:31:23.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.316+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.15__shadow_.jB20MdoqW-SzLokuXBZ9i2HKl47vroY_1 2024-09-22T08:31:23.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.316+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-22T08:31:23.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.316+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:31:23.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.316+0000 7ffabe937800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: _D_YzSapRUyDUfZjQ1Bp-1OdcQPGqltM 2024-09-22T08:31:23.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.317+0000 7ff99dffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-22T08:31:23.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.318+0000 7ffabe937800 20 get_obj_state: octx=0x7ffab00d65c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55f0f8f83888 s->prefetch_data=0 2024-09-22T08:31:23.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.318+0000 7ffabe937800 10 manifest: total_size = 324647 2024-09-22T08:31:23.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.318+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.9911338075008619436 2024-09-22T08:31:23.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.318+0000 7ffabe937800 20 get_obj_state: octx=0x7ffab00d65c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55f0f8f83888 s->prefetch_data=0 2024-09-22T08:31:23.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.318+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f83888 2024-09-22T08:31:23.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.318+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.15.5 2024-09-22T08:31:23.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.320+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8fde830 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55f0f8f83888 s->prefetch_data=0 2024-09-22T08:31:23.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.320+0000 7ffabe937800 10 manifest: total_size = 5242880 2024-09-22T08:31:23.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.320+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to _m1xvS4rjkgQJPPDk0Url48Xg4Dc4RiA 2024-09-22T08:31:23.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.320+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8fde830 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55f0f8f83888 s->prefetch_data=0 2024-09-22T08:31:23.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.320+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f83888 2024-09-22T08:31:23.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.320+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.15.7 2024-09-22T08:31:23.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.321+0000 7ff99d7fa640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-22T08:31:23.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.323+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:31:23.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.323+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-22T08:31:23.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.323+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - tag is: _m1xvS4rjkgQJPPDk0Url48Xg4Dc4RiA 2024-09-22T08:31:23.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.323+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:31:23.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.323+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.15__shadow_.BKiehYpzBqMbZVqr-cVVSQZgXEcMXI2_1 2024-09-22T08:31:23.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.323+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-22T08:31:23.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.323+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:31:23.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.323+0000 7ffabe937800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: _m1xvS4rjkgQJPPDk0Url48Xg4Dc4RiA 2024-09-22T08:31:23.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.324+0000 7ff99dffb640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-22T08:31:23.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.325+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f6b9b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55f0f8f68b88 s->prefetch_data=0 2024-09-22T08:31:23.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.325+0000 7ffabe937800 10 manifest: total_size = 5242880 2024-09-22T08:31:23.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.325+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.14795832951674874818 2024-09-22T08:31:23.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.325+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f6b9b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55f0f8f68b88 s->prefetch_data=0 2024-09-22T08:31:23.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.325+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f68b88 2024-09-22T08:31:23.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.325+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.15.7 2024-09-22T08:31:23.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.327+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:31:23.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.327+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-22T08:31:23.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.327+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:31:23.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.327+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-22T08:31:23.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.327+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - tag is: c62f9d7b-f6b6-404a-90de-de5607499115.4584.14795832951674874818 2024-09-22T08:31:23.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.327+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:31:23.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.327+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.15__shadow_.BnmZKFMUl_1ILVMYPyePFBWdeD_I215_0 2024-09-22T08:31:23.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.327+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-22T08:31:23.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.327+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.15__shadow_.BnmZKFMUl_1ILVMYPyePFBWdeD_I215_1 2024-09-22T08:31:23.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.327+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2024-09-22T08:31:23.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.327+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:31:23.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.327+0000 7ffabe937800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: c62f9d7b-f6b6-404a-90de-de5607499115.4584.14795832951674874818 2024-09-22T08:31:23.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.329+0000 7ff99d7fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-22T08:31:23.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.329+0000 7ffabe937800 20 get_obj_state: octx=0x7ffab4069900 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55f0f8f68b88 s->prefetch_data=0 2024-09-22T08:31:23.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.329+0000 7ffabe937800 10 manifest: total_size = 324647 2024-09-22T08:31:23.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.329+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to _lhXeSx5lJRIvMcl6m_OtbvASri00YBY 2024-09-22T08:31:23.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.329+0000 7ffabe937800 20 get_obj_state: octx=0x7ffab4069900 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55f0f8f68b88 s->prefetch_data=0 2024-09-22T08:31:23.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.329+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f68b88 2024-09-22T08:31:23.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.329+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.15.7 2024-09-22T08:31:23.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.332+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f6c6c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55f0f8f68b88 s->prefetch_data=0 2024-09-22T08:31:23.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.332+0000 7ffabe937800 10 manifest: total_size = 5242880 2024-09-22T08:31:23.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.332+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.256126293028723002 2024-09-22T08:31:23.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.332+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f6c6c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55f0f8f68b88 s->prefetch_data=0 2024-09-22T08:31:23.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.332+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f68b88 2024-09-22T08:31:23.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.332+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.15.8 2024-09-22T08:31:23.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.333+0000 7ff99dffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-22T08:31:23.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.335+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:31:23.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.335+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-22T08:31:23.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.335+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:31:23.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.335+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-22T08:31:23.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.335+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - tag is: c62f9d7b-f6b6-404a-90de-de5607499115.4584.256126293028723002 2024-09-22T08:31:23.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.335+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:31:23.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.335+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.15__shadow_.BnmZKFMUl_1ILVMYPyePFBWdeD_I215_0 2024-09-22T08:31:23.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.335+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-22T08:31:23.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.335+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.15__shadow_.BnmZKFMUl_1ILVMYPyePFBWdeD_I215_1 2024-09-22T08:31:23.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.335+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 577 2024-09-22T08:31:23.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.335+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:31:23.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.335+0000 7ffabe937800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: c62f9d7b-f6b6-404a-90de-de5607499115.4584.256126293028723002 2024-09-22T08:31:23.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.336+0000 7ff99d7fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-22T08:31:23.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.336+0000 7ffabe937800 20 get_obj_state: octx=0x7ffab4069900 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55f0f8f68b88 s->prefetch_data=0 2024-09-22T08:31:23.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.336+0000 7ffabe937800 10 manifest: total_size = 324647 2024-09-22T08:31:23.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.336+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to _nsxot1ayzVLVuF5T94XyrbnyV_aC2gU 2024-09-22T08:31:23.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.336+0000 7ffabe937800 20 get_obj_state: octx=0x7ffab4069900 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55f0f8f68b88 s->prefetch_data=0 2024-09-22T08:31:23.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.336+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f68b88 2024-09-22T08:31:23.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.336+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.15.8 2024-09-22T08:31:23.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.339+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:31:23.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.339+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=324647 stripe_ofs=324647 part_ofs=0 rule->part_size=0 2024-09-22T08:31:23.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.339+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - tag is: _nsxot1ayzVLVuF5T94XyrbnyV_aC2gU 2024-09-22T08:31:23.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.339+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:31:23.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.339+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.15__shadow_.-McLHgJzujgAjshbwAgv0L-xLtJN83-_0 2024-09-22T08:31:23.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.339+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-22T08:31:23.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.339+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:31:23.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.339+0000 7ffabe937800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: _nsxot1ayzVLVuF5T94XyrbnyV_aC2gU 2024-09-22T08:31:23.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.340+0000 7ff99dffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-22T08:31:23.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.340+0000 7ffabe937800 20 get_obj_state: octx=0x7ffab00d65c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55f0f8f68b88 s->prefetch_data=0 2024-09-22T08:31:23.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.340+0000 7ffabe937800 10 manifest: total_size = 5242880 2024-09-22T08:31:23.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.340+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.3232254132714075106 2024-09-22T08:31:23.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.340+0000 7ffabe937800 20 get_obj_state: octx=0x7ffab00d65c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55f0f8f68b88 s->prefetch_data=0 2024-09-22T08:31:23.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.340+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f68b88 2024-09-22T08:31:23.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.340+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.15.9 2024-09-22T08:31:23.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.343+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:31:23.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.343+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-22T08:31:23.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.343+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:31:23.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.343+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-22T08:31:23.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.343+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - tag is: c62f9d7b-f6b6-404a-90de-de5607499115.4584.3232254132714075106 2024-09-22T08:31:23.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.343+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:31:23.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.343+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.15__shadow_.eWg3VnHvcOu-puZvOwgz1c_qHzjTosl_0 2024-09-22T08:31:23.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.343+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-22T08:31:23.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.343+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.15__shadow_.eWg3VnHvcOu-puZvOwgz1c_qHzjTosl_1 2024-09-22T08:31:23.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.343+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-09-22T08:31:23.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.343+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:31:23.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.343+0000 7ffabe937800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: c62f9d7b-f6b6-404a-90de-de5607499115.4584.3232254132714075106 2024-09-22T08:31:23.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.344+0000 7ff99d7fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-22T08:31:23.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.345+0000 7ffabe937800 20 list_objects_ordered: starting attempt 1 2024-09-22T08:31:23.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.345+0000 7ffabe937800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-22T08:31:23.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.345+0000 7ffabe937800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T08:31:23.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.345+0000 7ffabe937800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T08:31:23.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.345+0000 7ffabe937800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T08:31:23.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.345+0000 7ffabe937800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T08:31:23.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.345+0000 7ffabe937800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[c62f9d7b-f6b6-404a-90de-de5607499115.4584.15])"; uploads.size()=0; is_truncated=0 2024-09-22T08:31:23.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.347+0000 7ffabe937800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-22T08:31:23.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.347+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.348+0000 7ffabe937800 20 rados_obj.operate() r=0 bl.length=233 2024-09-22T08:31:23.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.348+0000 7ffabe937800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-22T08:31:23.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.348+0000 7ffabe937800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-22T08:31:23.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.349+0000 7ffabe937800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-22T08:31:23.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.349+0000 7ffabe937800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-22T08:31:23.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.349+0000 7ff99dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496984 cookie 94493457127984 notifier 5850 bl.length()=189 2024-09-22T08:31:23.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.351+0000 7ffabe937800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.15 from cache 2024-09-22T08:31:23.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.351+0000 7ffabe937800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.15, ofs0, ns] 2024-09-22T08:31:23.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.351+0000 7ff99d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496987 cookie 94493457129552 notifier 5850 bl.length()=247 2024-09-22T08:31:23.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.354+0000 7ffabe937800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/c62f9d7b-f6b6-404a-90de-de5607499115.4584.15 : miss 2024-09-22T08:31:23.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.354+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.354+0000 7ffabe937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:31:23.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.354+0000 7ffabe937800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/c62f9d7b-f6b6-404a-90de-de5607499115.4584.15 info.flags=0x0 2024-09-22T08:31:23.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.354+0000 7ffabe937800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/c62f9d7b-f6b6-404a-90de-de5607499115.4584.15 to cache LRU end 2024-09-22T08:31:23.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.356+0000 7ffabe937800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16 : miss 2024-09-22T08:31:23.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.356+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.356+0000 7ffabe937800 20 rados_obj.operate() r=0 bl.length=465 2024-09-22T08:31:23.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.356+0000 7ffabe937800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16 info.flags=0x17 2024-09-22T08:31:23.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.356+0000 7ffabe937800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16 to cache LRU end 2024-09-22T08:31:23.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.356+0000 7ffabe937800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:31:23.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.356+0000 7ffabe937800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-22T08:31:23.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.356+0000 7ffabe937800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16 2024-09-22T08:31:23.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.357+0000 7ffabe937800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-22T08:31:23.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.357+0000 7ffabe937800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-22T08:31:23.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.358+0000 7ffabe937800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-22T08:31:23.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.359+0000 7ffabe937800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-22T08:31:23.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.359+0000 7ffabe937800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-22T08:31:23.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.359+0000 7ffabe937800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-22T08:31:23.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.360+0000 7ffabe937800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-22T08:31:23.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.360+0000 7ffabe937800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-22T08:31:23.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.360+0000 7ffabe937800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-22T08:31:23.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.360+0000 7ffabe937800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-22T08:31:23.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.360+0000 7ffabe937800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-22T08:31:23.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.361+0000 7ffabe937800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-22T08:31:23.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.361+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f7ef60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55f0f8f7cd48 s->prefetch_data=0 2024-09-22T08:31:23.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.361+0000 7ffabe937800 10 manifest: total_size = 45360 2024-09-22T08:31:23.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.361+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to _rPegUd2v8PTbWOqQKA5whv5zX8xDQSi 2024-09-22T08:31:23.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.361+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f7ef60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55f0f8f7cd48 s->prefetch_data=0 2024-09-22T08:31:23.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.361+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f7cd48 2024-09-22T08:31:23.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.361+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.16.0 2024-09-22T08:31:23.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.364+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:31:23.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.364+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=0 rule->part_size=0 2024-09-22T08:31:23.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.364+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - tag is: _rPegUd2v8PTbWOqQKA5whv5zX8xDQSi 2024-09-22T08:31:23.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.364+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:31:23.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.364+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__shadow_.PI6hGwwHpPkbi-9-srX6gHNAs6PQyzP_0 2024-09-22T08:31:23.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.364+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-22T08:31:23.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.364+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:31:23.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.364+0000 7ffabe937800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: _rPegUd2v8PTbWOqQKA5whv5zX8xDQSi 2024-09-22T08:31:23.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.365+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f65460 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55f0f8f7cd48 s->prefetch_data=0 2024-09-22T08:31:23.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.365+0000 7ff99dffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-22T08:31:23.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.365+0000 7ffabe937800 10 manifest: total_size = 11534336 2024-09-22T08:31:23.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.365+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to _4p0YB5H0H4irKoD71H7FS7MWltXa6qD 2024-09-22T08:31:23.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.365+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f65460 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55f0f8f7cd48 s->prefetch_data=0 2024-09-22T08:31:23.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.365+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f7cd48 2024-09-22T08:31:23.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.365+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.16.2 2024-09-22T08:31:23.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.368+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:31:23.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.368+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-22T08:31:23.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.368+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:31:23.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.368+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-22T08:31:23.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.368+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - tag is: _4p0YB5H0H4irKoD71H7FS7MWltXa6qD 2024-09-22T08:31:23.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.368+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:31:23.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.368+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__shadow_._IWqfdiv7OXZYt9NmT0lX7q0QDy1rzZ_1 2024-09-22T08:31:23.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.368+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-22T08:31:23.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.368+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__shadow_._IWqfdiv7OXZYt9NmT0lX7q0QDy1rzZ_2 2024-09-22T08:31:23.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.368+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-22T08:31:23.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.368+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:31:23.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.368+0000 7ffabe937800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: _4p0YB5H0H4irKoD71H7FS7MWltXa6qD 2024-09-22T08:31:23.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.369+0000 7ff99d7fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-22T08:31:23.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.370+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f65460 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55f0f8f7cd48 s->prefetch_data=0 2024-09-22T08:31:23.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.370+0000 7ffabe937800 10 manifest: total_size = 11534336 2024-09-22T08:31:23.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.370+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.14991517335492591333 2024-09-22T08:31:23.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.370+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f65460 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55f0f8f7cd48 s->prefetch_data=0 2024-09-22T08:31:23.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.370+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f7cd48 2024-09-22T08:31:23.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.370+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.16.3 2024-09-22T08:31:23.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.372+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T08:31:23.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.372+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-22T08:31:23.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.372+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-22T08:31:23.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.372+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T08:31:23.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.372+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-22T08:31:23.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.372+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-22T08:31:23.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.372+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T08:31:23.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.372+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-22T08:31:23.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.372+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-22T08:31:23.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.372+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T08:31:23.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.372+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-22T08:31:23.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.372+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-22T08:31:23.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.372+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-22T08:31:23.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.372+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-22T08:31:23.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.372+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-22T08:31:23.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.372+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - tag is: c62f9d7b-f6b6-404a-90de-de5607499115.4584.14991517335492591333 2024-09-22T08:31:23.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.372+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:31:23.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.372+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__multipart_foo-FROZEN.2~85-BmylZYymbNKqB5Ll5Qdr3TlnTwIt.1 2024-09-22T08:31:23.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.372+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-22T08:31:23.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.372+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__shadow_foo-FROZEN.2~85-BmylZYymbNKqB5Ll5Qdr3TlnTwIt.1_1 2024-09-22T08:31:23.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.372+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-09-22T08:31:23.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.372+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__multipart_foo-FROZEN.2~85-BmylZYymbNKqB5Ll5Qdr3TlnTwIt.2 2024-09-22T08:31:23.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.372+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2024-09-22T08:31:23.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.372+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__shadow_foo-FROZEN.2~85-BmylZYymbNKqB5Ll5Qdr3TlnTwIt.2_1 2024-09-22T08:31:23.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.372+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1165 2024-09-22T08:31:23.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.372+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__multipart_foo-FROZEN.2~85-BmylZYymbNKqB5Ll5Qdr3TlnTwIt.3 2024-09-22T08:31:23.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.372+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1432 2024-09-22T08:31:23.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.372+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:31:23.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.372+0000 7ffabe937800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: c62f9d7b-f6b6-404a-90de-de5607499115.4584.14991517335492591333 2024-09-22T08:31:23.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.373+0000 7ff99dffb640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-22T08:31:23.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.374+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f83f40 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55f0f8f7cd48 s->prefetch_data=0 2024-09-22T08:31:23.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.374+0000 7ffabe937800 10 manifest: total_size = 11534336 2024-09-22T08:31:23.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.374+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to _F8LXLIvsWqyCpIveHvVnIar7AMXqhk9 2024-09-22T08:31:23.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.374+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f83f40 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55f0f8f7cd48 s->prefetch_data=0 2024-09-22T08:31:23.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.374+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f7cd48 2024-09-22T08:31:23.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.374+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.16.5 2024-09-22T08:31:23.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.376+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:31:23.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.376+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-22T08:31:23.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.376+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:31:23.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.376+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-22T08:31:23.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.376+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:31:23.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.376+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-22T08:31:23.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.376+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - tag is: _F8LXLIvsWqyCpIveHvVnIar7AMXqhk9 2024-09-22T08:31:23.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.376+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:31:23.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.376+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__shadow_.YCka_L-Tr7dz1716e_mHMS5sRK-d1Oq_0 2024-09-22T08:31:23.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.376+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-22T08:31:23.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.376+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__shadow_.YCka_L-Tr7dz1716e_mHMS5sRK-d1Oq_1 2024-09-22T08:31:23.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.376+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-22T08:31:23.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.376+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__shadow_.YCka_L-Tr7dz1716e_mHMS5sRK-d1Oq_2 2024-09-22T08:31:23.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.376+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 788 2024-09-22T08:31:23.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.376+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:31:23.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.376+0000 7ffabe937800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: _F8LXLIvsWqyCpIveHvVnIar7AMXqhk9 2024-09-22T08:31:23.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.377+0000 7ff99d7fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-22T08:31:23.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.377+0000 7ffabe937800 20 get_obj_state: octx=0x7ffab00bb240 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55f0f8f7cd48 s->prefetch_data=0 2024-09-22T08:31:23.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.378+0000 7ffabe937800 10 manifest: total_size = 11534336 2024-09-22T08:31:23.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.378+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to _zazS380yU0wyTlG1uUCeGkkFOc6MrPQ 2024-09-22T08:31:23.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.378+0000 7ffabe937800 20 get_obj_state: octx=0x7ffab00bb240 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55f0f8f7cd48 s->prefetch_data=0 2024-09-22T08:31:23.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.378+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f7cd48 2024-09-22T08:31:23.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.378+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.16.5 2024-09-22T08:31:23.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.380+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:31:23.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.380+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-22T08:31:23.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.380+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:31:23.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.380+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-22T08:31:23.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.380+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:31:23.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.380+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-22T08:31:23.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.380+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - tag is: _zazS380yU0wyTlG1uUCeGkkFOc6MrPQ 2024-09-22T08:31:23.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.380+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:31:23.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.380+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__shadow_.mC7O2lzEYLEsO64hA49nOutPr70CuYy_0 2024-09-22T08:31:23.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.380+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-22T08:31:23.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.380+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__shadow_.mC7O2lzEYLEsO64hA49nOutPr70CuYy_1 2024-09-22T08:31:23.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.380+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-22T08:31:23.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.380+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__shadow_.mC7O2lzEYLEsO64hA49nOutPr70CuYy_2 2024-09-22T08:31:23.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.380+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 782 2024-09-22T08:31:23.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.380+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:31:23.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.380+0000 7ffabe937800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: _zazS380yU0wyTlG1uUCeGkkFOc6MrPQ 2024-09-22T08:31:23.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.381+0000 7ff99dffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-22T08:31:23.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.381+0000 7ffabe937800 20 get_obj_state: octx=0x7ffaac0269f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55f0f8f7cd48 s->prefetch_data=0 2024-09-22T08:31:23.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.382+0000 7ffabe937800 10 manifest: total_size = 45360 2024-09-22T08:31:23.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.382+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.13214161529353111916 2024-09-22T08:31:23.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.382+0000 7ffabe937800 20 get_obj_state: octx=0x7ffaac0269f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55f0f8f7cd48 s->prefetch_data=0 2024-09-22T08:31:23.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.382+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f7cd48 2024-09-22T08:31:23.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.382+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.16.5 2024-09-22T08:31:23.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.384+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-22T08:31:23.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.384+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2024-09-22T08:31:23.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.384+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-22T08:31:23.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.384+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-22T08:31:23.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.384+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2024-09-22T08:31:23.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.384+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2024-09-22T08:31:23.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.384+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2024-09-22T08:31:23.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.384+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=4134 2024-09-22T08:31:23.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.384+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2024-09-22T08:31:23.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.384+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - tag is: c62f9d7b-f6b6-404a-90de-de5607499115.4584.13214161529353111916 2024-09-22T08:31:23.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.384+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:31:23.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.384+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__multipart_foo-STANDARD.2~E7xfIldHSeOrvgjtD_RSDZHpOwzuGLF.1 2024-09-22T08:31:23.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.384+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-22T08:31:23.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.384+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__multipart_foo-STANDARD.2~E7xfIldHSeOrvgjtD_RSDZHpOwzuGLF.2 2024-09-22T08:31:23.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.384+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-22T08:31:23.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.384+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__multipart_foo-STANDARD.2~E7xfIldHSeOrvgjtD_RSDZHpOwzuGLF.3 2024-09-22T08:31:23.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.384+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-22T08:31:23.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.384+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:31:23.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.384+0000 7ffabe937800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: c62f9d7b-f6b6-404a-90de-de5607499115.4584.13214161529353111916 2024-09-22T08:31:23.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.386+0000 7ff99d7fa640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-22T08:31:23.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.414+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f1cb00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55f0f8f7cd48 s->prefetch_data=0 2024-09-22T08:31:23.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.415+0000 7ffabe937800 10 manifest: total_size = 11534336 2024-09-22T08:31:23.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.415+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to _YSRJQVmi30twWeM0Am8OL-EN74DwLtU 2024-09-22T08:31:23.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.415+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f1cb00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55f0f8f7cd48 s->prefetch_data=0 2024-09-22T08:31:23.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.415+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f7cd48 2024-09-22T08:31:23.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.415+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.16.7 2024-09-22T08:31:23.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.418+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:31:23.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.418+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-22T08:31:23.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.418+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:31:23.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.418+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-22T08:31:23.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.418+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - tag is: _YSRJQVmi30twWeM0Am8OL-EN74DwLtU 2024-09-22T08:31:23.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.418+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:31:23.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.418+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__shadow_.RctwBgm5sUrXyqAzDH3tzSChtjPiCpN_1 2024-09-22T08:31:23.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.418+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-22T08:31:23.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.418+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__shadow_.RctwBgm5sUrXyqAzDH3tzSChtjPiCpN_2 2024-09-22T08:31:23.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.418+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-22T08:31:23.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.418+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:31:23.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.418+0000 7ffabe937800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: _YSRJQVmi30twWeM0Am8OL-EN74DwLtU 2024-09-22T08:31:23.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.419+0000 7ff99dffb640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-22T08:31:23.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.419+0000 7ffabe937800 20 get_obj_state: octx=0x7ffaac0269f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55f0f8f7cd48 s->prefetch_data=0 2024-09-22T08:31:23.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.419+0000 7ffabe937800 10 manifest: total_size = 11534336 2024-09-22T08:31:23.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.419+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.8488745022955541935 2024-09-22T08:31:23.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.419+0000 7ffabe937800 20 get_obj_state: octx=0x7ffaac0269f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55f0f8f7cd48 s->prefetch_data=0 2024-09-22T08:31:23.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.419+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f7cd48 2024-09-22T08:31:23.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.419+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.16.7 2024-09-22T08:31:23.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.421+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T08:31:23.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.421+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-22T08:31:23.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.421+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-22T08:31:23.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.421+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T08:31:23.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.421+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-22T08:31:23.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.421+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-22T08:31:23.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.421+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T08:31:23.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.421+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-22T08:31:23.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.421+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-22T08:31:23.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.421+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T08:31:23.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.421+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-22T08:31:23.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.421+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-22T08:31:23.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.421+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-22T08:31:23.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.421+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-22T08:31:23.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.421+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-22T08:31:23.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.421+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - tag is: c62f9d7b-f6b6-404a-90de-de5607499115.4584.8488745022955541935 2024-09-22T08:31:23.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.421+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:31:23.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.421+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__multipart_foo-LUKEWARM.2~tN0VPYqC8uOQ80M3f5t4uBmqy4MkSDK.1 2024-09-22T08:31:23.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.421+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-22T08:31:23.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.421+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__shadow_foo-LUKEWARM.2~tN0VPYqC8uOQ80M3f5t4uBmqy4MkSDK.1_1 2024-09-22T08:31:23.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.421+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-09-22T08:31:23.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.421+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__multipart_foo-LUKEWARM.2~tN0VPYqC8uOQ80M3f5t4uBmqy4MkSDK.2 2024-09-22T08:31:23.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.421+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-09-22T08:31:23.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.421+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__shadow_foo-LUKEWARM.2~tN0VPYqC8uOQ80M3f5t4uBmqy4MkSDK.2_1 2024-09-22T08:31:23.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.421+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-09-22T08:31:23.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.421+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__multipart_foo-LUKEWARM.2~tN0VPYqC8uOQ80M3f5t4uBmqy4MkSDK.3 2024-09-22T08:31:23.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.421+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-09-22T08:31:23.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.421+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:31:23.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.421+0000 7ffabe937800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: c62f9d7b-f6b6-404a-90de-de5607499115.4584.8488745022955541935 2024-09-22T08:31:23.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.422+0000 7ff99d7fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-22T08:31:23.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.423+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f6b430 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55f0f8f7cd48 s->prefetch_data=0 2024-09-22T08:31:23.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.423+0000 7ffabe937800 10 manifest: total_size = 45360 2024-09-22T08:31:23.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.423+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.13405366920868247854 2024-09-22T08:31:23.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.423+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f6b430 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55f0f8f7cd48 s->prefetch_data=0 2024-09-22T08:31:23.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.423+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f7cd48 2024-09-22T08:31:23.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.423+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.16.7 2024-09-22T08:31:23.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.425+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-22T08:31:23.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.425+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2024-09-22T08:31:23.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.425+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-22T08:31:23.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.425+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-22T08:31:23.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.425+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2024-09-22T08:31:23.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.425+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2024-09-22T08:31:23.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.425+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2024-09-22T08:31:23.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.425+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=4134 2024-09-22T08:31:23.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.425+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2024-09-22T08:31:23.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.425+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - tag is: c62f9d7b-f6b6-404a-90de-de5607499115.4584.13405366920868247854 2024-09-22T08:31:23.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.425+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:31:23.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.425+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__multipart_foo-STANDARD.2~E7xfIldHSeOrvgjtD_RSDZHpOwzuGLF.1 2024-09-22T08:31:23.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.425+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-22T08:31:23.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.425+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__multipart_foo-STANDARD.2~E7xfIldHSeOrvgjtD_RSDZHpOwzuGLF.2 2024-09-22T08:31:23.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.425+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-22T08:31:23.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.425+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__multipart_foo-STANDARD.2~E7xfIldHSeOrvgjtD_RSDZHpOwzuGLF.3 2024-09-22T08:31:23.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.425+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-22T08:31:23.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.425+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:31:23.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.425+0000 7ffabe937800 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: c62f9d7b-f6b6-404a-90de-de5607499115.4584.13405366920868247854 2024-09-22T08:31:23.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.427+0000 7ff99dffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-22T08:31:23.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.427+0000 7ffabe937800 20 get_obj_state: octx=0x7ffab00c9b00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55f0f8f7cd48 s->prefetch_data=0 2024-09-22T08:31:23.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.427+0000 7ffabe937800 10 manifest: total_size = 11534336 2024-09-22T08:31:23.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.427+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.17614334060530338602 2024-09-22T08:31:23.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.427+0000 7ffabe937800 20 get_obj_state: octx=0x7ffab00c9b00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55f0f8f7cd48 s->prefetch_data=0 2024-09-22T08:31:23.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.427+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f7cd48 2024-09-22T08:31:23.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.427+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.16.8 2024-09-22T08:31:23.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.429+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T08:31:23.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.429+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-22T08:31:23.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.429+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-22T08:31:23.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.429+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T08:31:23.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.429+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-22T08:31:23.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.429+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-22T08:31:23.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.429+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T08:31:23.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.429+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-22T08:31:23.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.429+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-22T08:31:23.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.429+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T08:31:23.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.429+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-22T08:31:23.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.429+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-22T08:31:23.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.429+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-22T08:31:23.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.429+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-22T08:31:23.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.429+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-22T08:31:23.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.429+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - tag is: c62f9d7b-f6b6-404a-90de-de5607499115.4584.17614334060530338602 2024-09-22T08:31:23.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.429+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:31:23.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.429+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__multipart_foo-LUKEWARM.2~tN0VPYqC8uOQ80M3f5t4uBmqy4MkSDK.1 2024-09-22T08:31:23.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.429+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-22T08:31:23.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.429+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__shadow_foo-LUKEWARM.2~tN0VPYqC8uOQ80M3f5t4uBmqy4MkSDK.1_1 2024-09-22T08:31:23.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.429+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-09-22T08:31:23.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.429+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__multipart_foo-LUKEWARM.2~tN0VPYqC8uOQ80M3f5t4uBmqy4MkSDK.2 2024-09-22T08:31:23.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.429+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-09-22T08:31:23.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.429+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__shadow_foo-LUKEWARM.2~tN0VPYqC8uOQ80M3f5t4uBmqy4MkSDK.2_1 2024-09-22T08:31:23.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.429+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1189 2024-09-22T08:31:23.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.429+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__multipart_foo-LUKEWARM.2~tN0VPYqC8uOQ80M3f5t4uBmqy4MkSDK.3 2024-09-22T08:31:23.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.429+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1462 2024-09-22T08:31:23.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.429+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:31:23.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.429+0000 7ffabe937800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: c62f9d7b-f6b6-404a-90de-de5607499115.4584.17614334060530338602 2024-09-22T08:31:23.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.430+0000 7ff99d7fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-22T08:31:23.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.431+0000 7ffabe937800 20 get_obj_state: octx=0x7ffab00bb240 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55f0f8f7cd48 s->prefetch_data=0 2024-09-22T08:31:23.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.431+0000 7ffabe937800 10 manifest: total_size = 45360 2024-09-22T08:31:23.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.431+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to _okxa-p9dsVaGHezslLRAvCjIIKZuT1_ 2024-09-22T08:31:23.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.431+0000 7ffabe937800 20 get_obj_state: octx=0x7ffab00bb240 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55f0f8f7cd48 s->prefetch_data=0 2024-09-22T08:31:23.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.431+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f7cd48 2024-09-22T08:31:23.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.431+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.16.8 2024-09-22T08:31:23.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.434+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:31:23.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.434+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=0 rule->part_size=0 2024-09-22T08:31:23.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.434+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - tag is: _okxa-p9dsVaGHezslLRAvCjIIKZuT1_ 2024-09-22T08:31:23.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.434+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:31:23.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.434+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__shadow_.9pHz2JDuxBcjWbzkXfsfku4Ym2KD86k_0 2024-09-22T08:31:23.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.434+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-22T08:31:23.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.434+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:31:23.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.434+0000 7ffabe937800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: _okxa-p9dsVaGHezslLRAvCjIIKZuT1_ 2024-09-22T08:31:23.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.435+0000 7ff99dffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-22T08:31:23.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.435+0000 7ffabe937800 20 get_obj_state: octx=0x7ffab00c9b00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55f0f8f7cd48 s->prefetch_data=0 2024-09-22T08:31:23.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.435+0000 7ffabe937800 10 manifest: total_size = 11534336 2024-09-22T08:31:23.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.435+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.11480861774467150027 2024-09-22T08:31:23.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.435+0000 7ffabe937800 20 get_obj_state: octx=0x7ffab00c9b00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55f0f8f7cd48 s->prefetch_data=0 2024-09-22T08:31:23.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.435+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f7cd48 2024-09-22T08:31:23.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.435+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.16.9 2024-09-22T08:31:23.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.438+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T08:31:23.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.438+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-22T08:31:23.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.438+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-22T08:31:23.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.438+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T08:31:23.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.438+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-22T08:31:23.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.438+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-22T08:31:23.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.438+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T08:31:23.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.438+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-22T08:31:23.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.438+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-22T08:31:23.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.438+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T08:31:23.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.438+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-22T08:31:23.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.438+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-22T08:31:23.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.438+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-22T08:31:23.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.438+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-22T08:31:23.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.438+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-22T08:31:23.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.438+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - tag is: c62f9d7b-f6b6-404a-90de-de5607499115.4584.11480861774467150027 2024-09-22T08:31:23.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.438+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:31:23.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.438+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__multipart_foo-FROZEN.2~85-BmylZYymbNKqB5Ll5Qdr3TlnTwIt.1 2024-09-22T08:31:23.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.438+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-22T08:31:23.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.438+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__shadow_foo-FROZEN.2~85-BmylZYymbNKqB5Ll5Qdr3TlnTwIt.1_1 2024-09-22T08:31:23.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.438+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-09-22T08:31:23.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.438+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__multipart_foo-FROZEN.2~85-BmylZYymbNKqB5Ll5Qdr3TlnTwIt.2 2024-09-22T08:31:23.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.438+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2024-09-22T08:31:23.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.438+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__shadow_foo-FROZEN.2~85-BmylZYymbNKqB5Ll5Qdr3TlnTwIt.2_1 2024-09-22T08:31:23.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.438+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1165 2024-09-22T08:31:23.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.438+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__multipart_foo-FROZEN.2~85-BmylZYymbNKqB5Ll5Qdr3TlnTwIt.3 2024-09-22T08:31:23.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.438+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1432 2024-09-22T08:31:23.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.438+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:31:23.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.438+0000 7ffabe937800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: c62f9d7b-f6b6-404a-90de-de5607499115.4584.11480861774467150027 2024-09-22T08:31:23.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.439+0000 7ffabe937800 20 list_objects_ordered: starting attempt 1 2024-09-22T08:31:23.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.439+0000 7ffabe937800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-22T08:31:23.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.439+0000 7ff99d7fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-22T08:31:23.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.440+0000 7ffabe937800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T08:31:23.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.440+0000 7ffabe937800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T08:31:23.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.440+0000 7ffabe937800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T08:31:23.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.440+0000 7ffabe937800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T08:31:23.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.440+0000 7ffabe937800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[c62f9d7b-f6b6-404a-90de-de5607499115.4584.16])"; uploads.size()=0; is_truncated=0 2024-09-22T08:31:23.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.442+0000 7ffabe937800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-22T08:31:23.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.442+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.442+0000 7ffabe937800 20 rados_obj.operate() r=0 bl.length=243 2024-09-22T08:31:23.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.442+0000 7ffabe937800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-22T08:31:23.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.442+0000 7ffabe937800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-22T08:31:23.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.443+0000 7ffabe937800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-22T08:31:23.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.443+0000 7ffabe937800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-22T08:31:23.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.444+0000 7ff99dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496977 cookie 94493457132528 notifier 5850 bl.length()=199 2024-09-22T08:31:23.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.445+0000 7ffabe937800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16 from cache 2024-09-22T08:31:23.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.445+0000 7ffabe937800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16, ofs0, ns] 2024-09-22T08:31:23.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.446+0000 7ff99d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496976 cookie 94493457065728 notifier 5850 bl.length()=257 2024-09-22T08:31:23.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.448+0000 7ffabe937800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/c62f9d7b-f6b6-404a-90de-de5607499115.4584.16 : miss 2024-09-22T08:31:23.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.448+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.449+0000 7ffabe937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:31:23.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.449+0000 7ffabe937800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/c62f9d7b-f6b6-404a-90de-de5607499115.4584.16 info.flags=0x0 2024-09-22T08:31:23.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.449+0000 7ffabe937800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/c62f9d7b-f6b6-404a-90de-de5607499115.4584.16 to cache LRU end 2024-09-22T08:31:23.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.451+0000 7ffabe937800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.14 : miss 2024-09-22T08:31:23.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.451+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.451+0000 7ffabe937800 20 rados_obj.operate() r=0 bl.length=460 2024-09-22T08:31:23.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.451+0000 7ffabe937800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.14 info.flags=0x17 2024-09-22T08:31:23.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.451+0000 7ffabe937800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.14 to cache LRU end 2024-09-22T08:31:23.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.451+0000 7ffabe937800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:31:23.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.451+0000 7ffabe937800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-22T08:31:23.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.451+0000 7ffabe937800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.14 2024-09-22T08:31:23.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.453+0000 7ffabe937800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-22T08:31:23.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.453+0000 7ffabe937800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-22T08:31:23.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.454+0000 7ffabe937800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-22T08:31:23.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.456+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f7f650 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55f0f8f7da48 s->prefetch_data=0 2024-09-22T08:31:23.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.456+0000 7ffabe937800 10 manifest: total_size = 11534336 2024-09-22T08:31:23.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.456+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.15712378366824766092 2024-09-22T08:31:23.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.456+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f7f650 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55f0f8f7da48 s->prefetch_data=0 2024-09-22T08:31:23.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.456+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f7da48 2024-09-22T08:31:23.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.456+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.14.3 2024-09-22T08:31:23.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.459+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T08:31:23.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.459+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-22T08:31:23.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.459+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-22T08:31:23.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.459+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T08:31:23.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.459+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-22T08:31:23.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.459+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-22T08:31:23.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.459+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T08:31:23.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.459+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-22T08:31:23.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.459+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-22T08:31:23.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.459+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T08:31:23.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.459+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-22T08:31:23.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.459+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-22T08:31:23.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.459+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-22T08:31:23.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.459+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-22T08:31:23.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.459+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-22T08:31:23.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.459+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - tag is: c62f9d7b-f6b6-404a-90de-de5607499115.4584.15712378366824766092 2024-09-22T08:31:23.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.459+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:31:23.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.459+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.14__multipart_foo-FROZEN.2~LjyQqH9WeIcfrdiOUl6eMLhJRmcb3pc.1 2024-09-22T08:31:23.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.459+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-22T08:31:23.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.459+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.14__shadow_foo-FROZEN.2~LjyQqH9WeIcfrdiOUl6eMLhJRmcb3pc.1_1 2024-09-22T08:31:23.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.459+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-09-22T08:31:23.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.459+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.14__multipart_foo-FROZEN.2~LjyQqH9WeIcfrdiOUl6eMLhJRmcb3pc.2 2024-09-22T08:31:23.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.459+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2024-09-22T08:31:23.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.459+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.14__shadow_foo-FROZEN.2~LjyQqH9WeIcfrdiOUl6eMLhJRmcb3pc.2_1 2024-09-22T08:31:23.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.459+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1165 2024-09-22T08:31:23.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.459+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.14__multipart_foo-FROZEN.2~LjyQqH9WeIcfrdiOUl6eMLhJRmcb3pc.3 2024-09-22T08:31:23.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.459+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1432 2024-09-22T08:31:23.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.459+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:31:23.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.459+0000 7ffabe937800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: c62f9d7b-f6b6-404a-90de-de5607499115.4584.15712378366824766092 2024-09-22T08:31:23.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.460+0000 7ff99d7fa640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-22T08:31:23.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.460+0000 7ffabe937800 20 get_obj_state: octx=0x7ffab00aaa20 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55f0f8f826a8 s->prefetch_data=0 2024-09-22T08:31:23.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.461+0000 7ffabe937800 10 manifest: total_size = 1087 2024-09-22T08:31:23.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.461+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.6821188475424177117 2024-09-22T08:31:23.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.461+0000 7ffabe937800 20 get_obj_state: octx=0x7ffab00aaa20 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55f0f8f826a8 s->prefetch_data=0 2024-09-22T08:31:23.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.461+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f826a8 2024-09-22T08:31:23.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.461+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.14.5 2024-09-22T08:31:23.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.463+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-22T08:31:23.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.463+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=516 2024-09-22T08:31:23.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.463+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-22T08:31:23.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.463+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-22T08:31:23.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.463+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=4194820 part_ofs=516 rule->part_size=516 2024-09-22T08:31:23.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.463+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=55 2024-09-22T08:31:23.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.463+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=55 rules.size()=2 2024-09-22T08:31:23.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.463+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=4195336 part_ofs=1032 rule->part_size=55 2024-09-22T08:31:23.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.463+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=1087 rule->part_size=55 2024-09-22T08:31:23.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.463+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - tag is: c62f9d7b-f6b6-404a-90de-de5607499115.4584.6821188475424177117 2024-09-22T08:31:23.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.463+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:31:23.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.463+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.14__multipart_foo-STANDARD.2~QnU2kMzAdk4M7iyl9B_m8nwdWtobLUM.1 2024-09-22T08:31:23.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.463+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-22T08:31:23.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.463+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.14__multipart_foo-STANDARD.2~QnU2kMzAdk4M7iyl9B_m8nwdWtobLUM.2 2024-09-22T08:31:23.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.463+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-22T08:31:23.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.463+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.14__multipart_foo-STANDARD.2~QnU2kMzAdk4M7iyl9B_m8nwdWtobLUM.3 2024-09-22T08:31:23.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.463+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-22T08:31:23.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.463+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:31:23.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.463+0000 7ffabe937800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: c62f9d7b-f6b6-404a-90de-de5607499115.4584.6821188475424177117 2024-09-22T08:31:23.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.464+0000 7ffabe937800 20 get_obj_state: octx=0x7ffab00d65c0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55f0f8f7bb48 s->prefetch_data=0 2024-09-22T08:31:23.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.464+0000 7ff99dffb640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-22T08:31:23.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.465+0000 7ffabe937800 10 manifest: total_size = 11534336 2024-09-22T08:31:23.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.465+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.17125991950678117014 2024-09-22T08:31:23.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.465+0000 7ffabe937800 20 get_obj_state: octx=0x7ffab00d65c0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55f0f8f7bb48 s->prefetch_data=0 2024-09-22T08:31:23.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.465+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f7bb48 2024-09-22T08:31:23.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.465+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.14.7 2024-09-22T08:31:23.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.467+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T08:31:23.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.467+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-22T08:31:23.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.467+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-22T08:31:23.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.467+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T08:31:23.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.467+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-22T08:31:23.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.467+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-22T08:31:23.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.467+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T08:31:23.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.467+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-22T08:31:23.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.467+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-22T08:31:23.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.467+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T08:31:23.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.467+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-22T08:31:23.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.467+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-22T08:31:23.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.467+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-22T08:31:23.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.467+0000 7ffabe937800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-22T08:31:23.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.467+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-22T08:31:23.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.467+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - tag is: c62f9d7b-f6b6-404a-90de-de5607499115.4584.17125991950678117014 2024-09-22T08:31:23.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.467+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:31:23.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.467+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.14__multipart_foo-LUKEWARM.2~Nn3_TvZ4g8Xr48HqygV-Zo4FwZmGYlC.1 2024-09-22T08:31:23.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.467+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-22T08:31:23.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.467+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.14__shadow_foo-LUKEWARM.2~Nn3_TvZ4g8Xr48HqygV-Zo4FwZmGYlC.1_1 2024-09-22T08:31:23.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.467+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-09-22T08:31:23.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.467+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.14__multipart_foo-LUKEWARM.2~Nn3_TvZ4g8Xr48HqygV-Zo4FwZmGYlC.2 2024-09-22T08:31:23.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.467+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-09-22T08:31:23.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.467+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.14__shadow_foo-LUKEWARM.2~Nn3_TvZ4g8Xr48HqygV-Zo4FwZmGYlC.2_1 2024-09-22T08:31:23.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.467+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1189 2024-09-22T08:31:23.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.467+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.14__multipart_foo-LUKEWARM.2~Nn3_TvZ4g8Xr48HqygV-Zo4FwZmGYlC.3 2024-09-22T08:31:23.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.467+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1462 2024-09-22T08:31:23.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.467+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:31:23.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.467+0000 7ffabe937800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: c62f9d7b-f6b6-404a-90de-de5607499115.4584.17125991950678117014 2024-09-22T08:31:23.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.468+0000 7ff99d7fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-22T08:31:23.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.468+0000 7ffabe937800 20 list_objects_ordered: starting attempt 1 2024-09-22T08:31:23.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.468+0000 7ffabe937800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-22T08:31:23.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.469+0000 7ffabe937800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T08:31:23.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.469+0000 7ffabe937800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T08:31:23.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.469+0000 7ffabe937800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T08:31:23.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.469+0000 7ffabe937800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T08:31:23.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.469+0000 7ffabe937800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[c62f9d7b-f6b6-404a-90de-de5607499115.4584.14])"; uploads.size()=0; is_truncated=0 2024-09-22T08:31:23.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.471+0000 7ffabe937800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-22T08:31:23.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.471+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.471+0000 7ffabe937800 20 rados_obj.operate() r=0 bl.length=238 2024-09-22T08:31:23.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.471+0000 7ffabe937800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-22T08:31:23.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.471+0000 7ffabe937800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-22T08:31:23.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.473+0000 7ffabe937800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-22T08:31:23.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.473+0000 7ffabe937800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-22T08:31:23.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.473+0000 7ff99dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496988 cookie 94493457129552 notifier 5850 bl.length()=194 2024-09-22T08:31:23.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.474+0000 7ffabe937800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.14 from cache 2024-09-22T08:31:23.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.474+0000 7ffabe937800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.14, ofs0, ns] 2024-09-22T08:31:23.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.475+0000 7ff99d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496977 cookie 94493457065728 notifier 5850 bl.length()=252 2024-09-22T08:31:23.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.477+0000 7ffabe937800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/c62f9d7b-f6b6-404a-90de-de5607499115.4584.14 : miss 2024-09-22T08:31:23.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.477+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.478+0000 7ffabe937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:31:23.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.478+0000 7ffabe937800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/c62f9d7b-f6b6-404a-90de-de5607499115.4584.14 info.flags=0x0 2024-09-22T08:31:23.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.478+0000 7ffabe937800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/c62f9d7b-f6b6-404a-90de-de5607499115.4584.14 to cache LRU end 2024-09-22T08:31:23.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.480+0000 7ffabe937800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.13 : miss 2024-09-22T08:31:23.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.480+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.480+0000 7ffabe937800 20 rados_obj.operate() r=0 bl.length=450 2024-09-22T08:31:23.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.480+0000 7ffabe937800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.13 info.flags=0x17 2024-09-22T08:31:23.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.480+0000 7ffabe937800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.13 to cache LRU end 2024-09-22T08:31:23.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.480+0000 7ffabe937800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:31:23.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.480+0000 7ffabe937800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-22T08:31:23.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.480+0000 7ffabe937800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.13 2024-09-22T08:31:23.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.482+0000 7ffabe937800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-22T08:31:23.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.483+0000 7ffabe937800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-22T08:31:23.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.483+0000 7ffabe937800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-22T08:31:23.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.484+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f6b740 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55f0f8f7cd48 s->prefetch_data=0 2024-09-22T08:31:23.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.485+0000 7ffabe937800 10 manifest: total_size = 10485760 2024-09-22T08:31:23.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.485+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.15885863959000960366 2024-09-22T08:31:23.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.485+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f6b740 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55f0f8f7cd48 s->prefetch_data=0 2024-09-22T08:31:23.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.485+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f7cd48 2024-09-22T08:31:23.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.485+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.13.3 2024-09-22T08:31:23.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.487+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:31:23.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.487+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-22T08:31:23.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.487+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:31:23.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.487+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-22T08:31:23.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.487+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:31:23.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.487+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-22T08:31:23.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.487+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - tag is: c62f9d7b-f6b6-404a-90de-de5607499115.4584.15885863959000960366 2024-09-22T08:31:23.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.487+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:31:23.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.487+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.13__shadow_.TOocScgjAqQY4Jlt7Cn2ink2YK5g0Oz_0 2024-09-22T08:31:23.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.487+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-22T08:31:23.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.487+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.13__shadow_.TOocScgjAqQY4Jlt7Cn2ink2YK5g0Oz_1 2024-09-22T08:31:23.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.487+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-22T08:31:23.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.487+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.13__shadow_.TOocScgjAqQY4Jlt7Cn2ink2YK5g0Oz_2 2024-09-22T08:31:23.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.487+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 812 2024-09-22T08:31:23.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.487+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:31:23.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.487+0000 7ffabe937800 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: c62f9d7b-f6b6-404a-90de-de5607499115.4584.15885863959000960366 2024-09-22T08:31:23.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.488+0000 7ff99dffb640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-22T08:31:23.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.488+0000 7ffabe937800 20 get_obj_state: octx=0x7ffab4069900 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55f0f8f7cd48 s->prefetch_data=0 2024-09-22T08:31:23.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.489+0000 7ffabe937800 10 manifest: total_size = 44258 2024-09-22T08:31:23.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.489+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.13749796841231889909 2024-09-22T08:31:23.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.489+0000 7ffabe937800 20 get_obj_state: octx=0x7ffab4069900 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55f0f8f7cd48 s->prefetch_data=0 2024-09-22T08:31:23.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.489+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f7cd48 2024-09-22T08:31:23.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.489+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.13.5 2024-09-22T08:31:23.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.491+0000 7ffabe937800 20 get_obj_state: octx=0x7ffab00d69d0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55f0f8f7cd48 s->prefetch_data=0 2024-09-22T08:31:23.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.491+0000 7ffabe937800 10 manifest: total_size = 10485760 2024-09-22T08:31:23.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.491+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.12362179486956355936 2024-09-22T08:31:23.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.491+0000 7ffabe937800 20 get_obj_state: octx=0x7ffab00d69d0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55f0f8f7cd48 s->prefetch_data=0 2024-09-22T08:31:23.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.491+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f7cd48 2024-09-22T08:31:23.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.491+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.13.7 2024-09-22T08:31:23.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.492+0000 7ff99d7fa640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-22T08:31:23.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.494+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:31:23.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.494+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-22T08:31:23.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.494+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:31:23.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.494+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-22T08:31:23.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.494+0000 7ffabe937800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:31:23.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.494+0000 7ffabe937800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-22T08:31:23.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.494+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - tag is: c62f9d7b-f6b6-404a-90de-de5607499115.4584.12362179486956355936 2024-09-22T08:31:23.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.494+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:31:23.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.494+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.13__shadow_.4YhObRU_m3LfSNvajkUt63CyiTi__nW_0 2024-09-22T08:31:23.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.494+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-22T08:31:23.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.494+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.13__shadow_.4YhObRU_m3LfSNvajkUt63CyiTi__nW_1 2024-09-22T08:31:23.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.494+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2024-09-22T08:31:23.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.494+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c62f9d7b-f6b6-404a-90de-de5607499115.4584.13__shadow_.4YhObRU_m3LfSNvajkUt63CyiTi__nW_2 2024-09-22T08:31:23.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.494+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 818 2024-09-22T08:31:23.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.494+0000 7ffabe937800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:31:23.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.494+0000 7ffabe937800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: c62f9d7b-f6b6-404a-90de-de5607499115.4584.12362179486956355936 2024-09-22T08:31:23.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.495+0000 7ff99dffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-22T08:31:23.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.495+0000 7ffabe937800 20 list_objects_ordered: starting attempt 1 2024-09-22T08:31:23.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.495+0000 7ffabe937800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-22T08:31:23.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.496+0000 7ffabe937800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T08:31:23.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.496+0000 7ffabe937800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T08:31:23.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.496+0000 7ffabe937800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T08:31:23.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.496+0000 7ffabe937800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T08:31:23.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.496+0000 7ffabe937800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[c62f9d7b-f6b6-404a-90de-de5607499115.4584.13])"; uploads.size()=0; is_truncated=0 2024-09-22T08:31:23.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.497+0000 7ffabe937800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-22T08:31:23.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.497+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.498+0000 7ffabe937800 20 rados_obj.operate() r=0 bl.length=228 2024-09-22T08:31:23.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.498+0000 7ffabe937800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-22T08:31:23.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.498+0000 7ffabe937800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-22T08:31:23.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.499+0000 7ffabe937800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-22T08:31:23.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.499+0000 7ffabe937800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-22T08:31:23.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.499+0000 7ff99d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496985 cookie 94493457127984 notifier 5850 bl.length()=184 2024-09-22T08:31:23.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.501+0000 7ffabe937800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.13 from cache 2024-09-22T08:31:23.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.501+0000 7ffabe937800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.13, ofs0, ns] 2024-09-22T08:31:23.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.501+0000 7ff99dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496989 cookie 94493457143440 notifier 5850 bl.length()=242 2024-09-22T08:31:23.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.504+0000 7ffabe937800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/c62f9d7b-f6b6-404a-90de-de5607499115.4584.13 : miss 2024-09-22T08:31:23.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.504+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.504+0000 7ffabe937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:31:23.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.504+0000 7ffabe937800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/c62f9d7b-f6b6-404a-90de-de5607499115.4584.13 info.flags=0x0 2024-09-22T08:31:23.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.504+0000 7ffabe937800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/c62f9d7b-f6b6-404a-90de-de5607499115.4584.13 to cache LRU end 2024-09-22T08:31:23.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.506+0000 7ffabe937800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.6 : miss 2024-09-22T08:31:23.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.506+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.507+0000 7ffabe937800 20 rados_obj.operate() r=0 bl.length=445 2024-09-22T08:31:23.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.507+0000 7ffabe937800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.6 info.flags=0x17 2024-09-22T08:31:23.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.507+0000 7ffabe937800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.6 to cache LRU end 2024-09-22T08:31:23.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.507+0000 7ffabe937800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:31:23.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.507+0000 7ffabe937800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-22T08:31:23.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.507+0000 7ffabe937800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.6 2024-09-22T08:31:23.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.508+0000 7ffabe937800 10 cls_bucket_list_unordered: got ___ 2024-09-22T08:31:23.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.508+0000 7ffabe937800 10 cls_bucket_list_unordered: got __ _ 2024-09-22T08:31:23.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.509+0000 7ffabe937800 10 cls_bucket_list_unordered: got __ 2024-09-22T08:31:23.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.510+0000 7ffabe937800 10 cls_bucket_list_unordered: got obj 2024-09-22T08:31:23.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.510+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f1cb00 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55f0f8f6a218 s->prefetch_data=0 2024-09-22T08:31:23.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.511+0000 7ffabe937800 10 manifest: total_size = 0 2024-09-22T08:31:23.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.511+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.14749524902596179863 2024-09-22T08:31:23.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.511+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f1cb00 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55f0f8f6a218 s->prefetch_data=0 2024-09-22T08:31:23.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.511+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f6a218 2024-09-22T08:31:23.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.511+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.6.2 2024-09-22T08:31:23.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.513+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f1cb00 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55f0f8f6a218 s->prefetch_data=0 2024-09-22T08:31:23.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.514+0000 7ffabe937800 10 manifest: total_size = 0 2024-09-22T08:31:23.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.514+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.12558414732557806452 2024-09-22T08:31:23.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.514+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f1cb00 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55f0f8f6a218 s->prefetch_data=0 2024-09-22T08:31:23.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.514+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f6a218 2024-09-22T08:31:23.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.514+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.6.3 2024-09-22T08:31:23.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.514+0000 7ff99d7fa640 20 handle_completion(): completion ok for obj=___ 2024-09-22T08:31:23.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.516+0000 7ffabe937800 20 get_obj_state: octx=0x7ffab00d65c0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55f0f8f6a218 s->prefetch_data=0 2024-09-22T08:31:23.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.516+0000 7ffabe937800 10 manifest: total_size = 0 2024-09-22T08:31:23.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.516+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.13014669178404396440 2024-09-22T08:31:23.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.516+0000 7ffabe937800 20 get_obj_state: octx=0x7ffab00d65c0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55f0f8f6a218 s->prefetch_data=0 2024-09-22T08:31:23.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.516+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f6a218 2024-09-22T08:31:23.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.516+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.6.6 2024-09-22T08:31:23.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.517+0000 7ff99dffb640 20 handle_completion(): completion ok for obj=__ _ 2024-09-22T08:31:23.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.518+0000 7ffabe937800 20 get_obj_state: octx=0x7ffab4069900 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55f0f8f6a218 s->prefetch_data=0 2024-09-22T08:31:23.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.518+0000 7ffabe937800 10 manifest: total_size = 0 2024-09-22T08:31:23.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.518+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.8753503179023116252 2024-09-22T08:31:23.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.518+0000 7ffabe937800 20 get_obj_state: octx=0x7ffab4069900 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55f0f8f6a218 s->prefetch_data=0 2024-09-22T08:31:23.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.518+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f6a218 2024-09-22T08:31:23.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.518+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.6.8 2024-09-22T08:31:23.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.519+0000 7ff99d7fa640 20 handle_completion(): completion ok for obj=__ 2024-09-22T08:31:23.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.521+0000 7ffabe937800 20 list_objects_ordered: starting attempt 1 2024-09-22T08:31:23.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.521+0000 7ffabe937800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-22T08:31:23.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.522+0000 7ff99dffb640 20 handle_completion(): completion ok for obj=obj 2024-09-22T08:31:23.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.522+0000 7ffabe937800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T08:31:23.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.522+0000 7ffabe937800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T08:31:23.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.522+0000 7ffabe937800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T08:31:23.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.522+0000 7ffabe937800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T08:31:23.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.522+0000 7ffabe937800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[c62f9d7b-f6b6-404a-90de-de5607499115.4584.6])"; uploads.size()=0; is_truncated=0 2024-09-22T08:31:23.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.524+0000 7ffabe937800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-22T08:31:23.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.524+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.524+0000 7ffabe937800 20 rados_obj.operate() r=0 bl.length=223 2024-09-22T08:31:23.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.524+0000 7ffabe937800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-22T08:31:23.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.524+0000 7ffabe937800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-22T08:31:23.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.525+0000 7ffabe937800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-22T08:31:23.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.525+0000 7ffabe937800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-22T08:31:23.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.526+0000 7ff99dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497079 cookie 94493457125776 notifier 5850 bl.length()=181 2024-09-22T08:31:23.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.527+0000 7ffabe937800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.6 from cache 2024-09-22T08:31:23.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.527+0000 7ffabe937800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:c62f9d7b-f6b6-404a-90de-de5607499115.4584.6, ofs0, ns] 2024-09-22T08:31:23.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.528+0000 7ff99d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496978 cookie 94493457132528 notifier 5850 bl.length()=238 2024-09-22T08:31:23.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.530+0000 7ffabe937800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/c62f9d7b-f6b6-404a-90de-de5607499115.4584.6 : miss 2024-09-22T08:31:23.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.530+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.531+0000 7ffabe937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:31:23.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.531+0000 7ffabe937800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/c62f9d7b-f6b6-404a-90de-de5607499115.4584.6 info.flags=0x0 2024-09-22T08:31:23.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.531+0000 7ffabe937800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/c62f9d7b-f6b6-404a-90de-de5607499115.4584.6 to cache LRU end 2024-09-22T08:31:23.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.533+0000 7ffabe937800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:c62f9d7b-f6b6-404a-90de-de5607499115.4584.7 : miss 2024-09-22T08:31:23.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.533+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.533+0000 7ffabe937800 20 rados_obj.operate() r=0 bl.length=445 2024-09-22T08:31:23.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.533+0000 7ffabe937800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:c62f9d7b-f6b6-404a-90de-de5607499115.4584.7 info.flags=0x17 2024-09-22T08:31:23.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.533+0000 7ffabe937800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:c62f9d7b-f6b6-404a-90de-de5607499115.4584.7 to cache LRU end 2024-09-22T08:31:23.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.533+0000 7ffabe937800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:31:23.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.533+0000 7ffabe937800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-22T08:31:23.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.533+0000 7ffabe937800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:c62f9d7b-f6b6-404a-90de-de5607499115.4584.7 2024-09-22T08:31:23.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.534+0000 7ffabe937800 10 cls_bucket_list_unordered: got ___ 2024-09-22T08:31:23.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.535+0000 7ffabe937800 10 cls_bucket_list_unordered: got __ _ 2024-09-22T08:31:23.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.536+0000 7ffabe937800 10 cls_bucket_list_unordered: got __ 2024-09-22T08:31:23.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.536+0000 7ffabe937800 10 cls_bucket_list_unordered: got obj 2024-09-22T08:31:23.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.537+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f6c2a0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55f0f8f7da48 s->prefetch_data=0 2024-09-22T08:31:23.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.537+0000 7ffabe937800 10 manifest: total_size = 524288 2024-09-22T08:31:23.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.537+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.12389647297662176524 2024-09-22T08:31:23.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.537+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f6c2a0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55f0f8f7da48 s->prefetch_data=0 2024-09-22T08:31:23.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.537+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f7da48 2024-09-22T08:31:23.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.537+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.7.2 2024-09-22T08:31:23.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.540+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f6c2a0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55f0f8f7da48 s->prefetch_data=0 2024-09-22T08:31:23.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.540+0000 7ffabe937800 10 manifest: total_size = 38 2024-09-22T08:31:23.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.540+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.12130497558072994033 2024-09-22T08:31:23.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.540+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f6c2a0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55f0f8f7da48 s->prefetch_data=0 2024-09-22T08:31:23.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.540+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f7da48 2024-09-22T08:31:23.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.540+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.7.3 2024-09-22T08:31:23.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.541+0000 7ff99dffb640 20 handle_completion(): completion ok for obj=___ 2024-09-22T08:31:23.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.542+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f6c2a0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55f0f8f7da48 s->prefetch_data=0 2024-09-22T08:31:23.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.543+0000 7ffabe937800 10 manifest: total_size = 24595 2024-09-22T08:31:23.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.543+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.16502080679860239614 2024-09-22T08:31:23.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.543+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f6c2a0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55f0f8f7da48 s->prefetch_data=0 2024-09-22T08:31:23.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.543+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f7da48 2024-09-22T08:31:23.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.543+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.7.6 2024-09-22T08:31:23.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.543+0000 7ff99d7fa640 20 handle_completion(): completion ok for obj=__ _ 2024-09-22T08:31:23.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.545+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f6c2a0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55f0f8f7da48 s->prefetch_data=0 2024-09-22T08:31:23.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.546+0000 7ffabe937800 10 manifest: total_size = 527 2024-09-22T08:31:23.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.546+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.6514882200737283947 2024-09-22T08:31:23.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.546+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8f6c2a0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55f0f8f7da48 s->prefetch_data=0 2024-09-22T08:31:23.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.546+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f7da48 2024-09-22T08:31:23.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.546+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.7.8 2024-09-22T08:31:23.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.546+0000 7ff99dffb640 20 handle_completion(): completion ok for obj=__ 2024-09-22T08:31:23.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.548+0000 7ffabe937800 20 list_objects_ordered: starting attempt 1 2024-09-22T08:31:23.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.548+0000 7ffabe937800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-22T08:31:23.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.549+0000 7ff99dffb640 20 handle_completion(): completion ok for obj=obj 2024-09-22T08:31:23.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.549+0000 7ffabe937800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T08:31:23.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.549+0000 7ffabe937800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T08:31:23.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.549+0000 7ffabe937800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T08:31:23.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.549+0000 7ffabe937800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T08:31:23.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.549+0000 7ffabe937800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[c62f9d7b-f6b6-404a-90de-de5607499115.4584.7])"; uploads.size()=0; is_truncated=0 2024-09-22T08:31:23.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.551+0000 7ffabe937800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-22T08:31:23.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.551+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.552+0000 7ffabe937800 20 rados_obj.operate() r=0 bl.length=223 2024-09-22T08:31:23.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.552+0000 7ffabe937800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-22T08:31:23.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.552+0000 7ffabe937800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-22T08:31:23.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.553+0000 7ffabe937800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-22T08:31:23.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.553+0000 7ffabe937800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-22T08:31:23.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.553+0000 7ff99dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497080 cookie 94493457125776 notifier 5850 bl.length()=181 2024-09-22T08:31:23.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.554+0000 7ffabe937800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:c62f9d7b-f6b6-404a-90de-de5607499115.4584.7 from cache 2024-09-22T08:31:23.556 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.554+0000 7ffabe937800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:c62f9d7b-f6b6-404a-90de-de5607499115.4584.7, ofs0, ns] 2024-09-22T08:31:23.556 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.555+0000 7ff99d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496979 cookie 94493457132528 notifier 5850 bl.length()=238 2024-09-22T08:31:23.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.557+0000 7ffabe937800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/c62f9d7b-f6b6-404a-90de-de5607499115.4584.7 : miss 2024-09-22T08:31:23.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.557+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.557+0000 7ffabe937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:31:23.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.557+0000 7ffabe937800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/c62f9d7b-f6b6-404a-90de-de5607499115.4584.7 info.flags=0x0 2024-09-22T08:31:23.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.557+0000 7ffabe937800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/c62f9d7b-f6b6-404a-90de-de5607499115.4584.7 to cache LRU end 2024-09-22T08:31:23.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.559+0000 7ffabe937800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:c62f9d7b-f6b6-404a-90de-de5607499115.4584.8 : miss 2024-09-22T08:31:23.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.559+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.560+0000 7ffabe937800 20 rados_obj.operate() r=0 bl.length=445 2024-09-22T08:31:23.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.560+0000 7ffabe937800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:c62f9d7b-f6b6-404a-90de-de5607499115.4584.8 info.flags=0x17 2024-09-22T08:31:23.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.560+0000 7ffabe937800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:c62f9d7b-f6b6-404a-90de-de5607499115.4584.8 to cache LRU end 2024-09-22T08:31:23.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.560+0000 7ffabe937800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:31:23.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.560+0000 7ffabe937800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-22T08:31:23.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.560+0000 7ffabe937800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:c62f9d7b-f6b6-404a-90de-de5607499115.4584.8 2024-09-22T08:31:23.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.562+0000 7ffabe937800 10 cls_bucket_list_unordered: got ___ 2024-09-22T08:31:23.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.562+0000 7ffabe937800 10 cls_bucket_list_unordered: got __ _ 2024-09-22T08:31:23.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.563+0000 7ffabe937800 10 cls_bucket_list_unordered: got __ 2024-09-22T08:31:23.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.564+0000 7ffabe937800 10 cls_bucket_list_unordered: got obj 2024-09-22T08:31:23.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.565+0000 7ffabe937800 20 get_obj_state: octx=0x7ffab012a150 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55f0f8f6a218 s->prefetch_data=0 2024-09-22T08:31:23.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.565+0000 7ffabe937800 10 manifest: total_size = 49187 2024-09-22T08:31:23.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.565+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.13978073998341837667 2024-09-22T08:31:23.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.565+0000 7ffabe937800 20 get_obj_state: octx=0x7ffab012a150 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55f0f8f6a218 s->prefetch_data=0 2024-09-22T08:31:23.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.565+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f6a218 2024-09-22T08:31:23.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.565+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.8.2 2024-09-22T08:31:23.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.567+0000 7ffabe937800 20 get_obj_state: octx=0x7ffab012a150 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55f0f8f6a218 s->prefetch_data=0 2024-09-22T08:31:23.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.568+0000 7ffabe937800 10 manifest: total_size = 4134 2024-09-22T08:31:23.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.568+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.15623683232977227903 2024-09-22T08:31:23.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.568+0000 7ffabe937800 20 get_obj_state: octx=0x7ffab012a150 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55f0f8f6a218 s->prefetch_data=0 2024-09-22T08:31:23.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.568+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f6a218 2024-09-22T08:31:23.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.568+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.8.3 2024-09-22T08:31:23.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.568+0000 7ff99dffb640 20 handle_completion(): completion ok for obj=___ 2024-09-22T08:31:23.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.570+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8ebcf30 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55f0f8f6a218 s->prefetch_data=0 2024-09-22T08:31:23.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.570+0000 7ffabe937800 10 manifest: total_size = 1048576 2024-09-22T08:31:23.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.570+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.12091931673332941146 2024-09-22T08:31:23.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.570+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8ebcf30 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55f0f8f6a218 s->prefetch_data=0 2024-09-22T08:31:23.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.570+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f6a218 2024-09-22T08:31:23.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.570+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.8.6 2024-09-22T08:31:23.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.571+0000 7ff99d7fa640 20 handle_completion(): completion ok for obj=__ _ 2024-09-22T08:31:23.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.573+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8ebcf30 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55f0f8f6a218 s->prefetch_data=0 2024-09-22T08:31:23.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.573+0000 7ffabe937800 10 manifest: total_size = 1035 2024-09-22T08:31:23.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.573+0000 7ffabe937800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.13108211525719722463 2024-09-22T08:31:23.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.573+0000 7ffabe937800 20 get_obj_state: octx=0x55f0f8ebcf30 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55f0f8f6a218 s->prefetch_data=0 2024-09-22T08:31:23.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.573+0000 7ffabe937800 20 prepare_atomic_modification: state is not atomic. state=0x55f0f8f6a218 2024-09-22T08:31:23.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.573+0000 7ffabe937800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.8.8 2024-09-22T08:31:23.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.574+0000 7ff99dffb640 20 handle_completion(): completion ok for obj=__ 2024-09-22T08:31:23.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.575+0000 7ffabe937800 20 list_objects_ordered: starting attempt 1 2024-09-22T08:31:23.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.575+0000 7ffabe937800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-22T08:31:23.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.577+0000 7ff99dffb640 20 handle_completion(): completion ok for obj=obj 2024-09-22T08:31:23.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.577+0000 7ffabe937800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T08:31:23.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.577+0000 7ffabe937800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T08:31:23.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.577+0000 7ffabe937800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T08:31:23.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.577+0000 7ffabe937800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T08:31:23.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.577+0000 7ffabe937800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[c62f9d7b-f6b6-404a-90de-de5607499115.4584.8])"; uploads.size()=0; is_truncated=0 2024-09-22T08:31:23.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.579+0000 7ffabe937800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-22T08:31:23.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.579+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.579+0000 7ffabe937800 20 rados_obj.operate() r=0 bl.length=223 2024-09-22T08:31:23.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.579+0000 7ffabe937800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-22T08:31:23.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.579+0000 7ffabe937800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-22T08:31:23.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.580+0000 7ffabe937800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-22T08:31:23.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.580+0000 7ffabe937800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-22T08:31:23.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.581+0000 7ff99dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497081 cookie 94493457125776 notifier 5850 bl.length()=181 2024-09-22T08:31:23.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.582+0000 7ffabe937800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:c62f9d7b-f6b6-404a-90de-de5607499115.4584.8 from cache 2024-09-22T08:31:23.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.582+0000 7ffabe937800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:c62f9d7b-f6b6-404a-90de-de5607499115.4584.8, ofs0, ns] 2024-09-22T08:31:23.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.582+0000 7ff99d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496980 cookie 94493457132528 notifier 5850 bl.length()=238 2024-09-22T08:31:23.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.585+0000 7ffabe937800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/c62f9d7b-f6b6-404a-90de-de5607499115.4584.8 : miss 2024-09-22T08:31:23.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.585+0000 7ffabe937800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.585+0000 7ffabe937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:31:23.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.585+0000 7ffabe937800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/c62f9d7b-f6b6-404a-90de-de5607499115.4584.8 info.flags=0x0 2024-09-22T08:31:23.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.585+0000 7ffabe937800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/c62f9d7b-f6b6-404a-90de-de5607499115.4584.8 to cache LRU end 2024-09-22T08:31:23.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.587+0000 7ffabe937800 10 removing key index: XORSAVXNGGQDSMZSCJDY 2024-09-22T08:31:23.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.588+0000 7ffabe937800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.keys:XORSAVXNGGQDSMZSCJDY, ofs0, ns] 2024-09-22T08:31:23.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.589+0000 7ff99d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496990 cookie 94493457143440 notifier 5850 bl.length()=170 2024-09-22T08:31:23.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.589+0000 7ffabe937800 10 removing email index: ragweed.client.0+test@test.test 2024-09-22T08:31:23.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.590+0000 7ffabe937800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-22T08:31:23.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.590+0000 7ff99dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496986 cookie 94493457127984 notifier 5850 bl.length()=182 2024-09-22T08:31:23.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.591+0000 7ffabe937800 10 removing user buckets index 2024-09-22T08:31:23.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.592+0000 7ffabe937800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-22T08:31:23.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.592+0000 7ff99d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496991 cookie 94493457129552 notifier 5850 bl.length()=173 2024-09-22T08:31:23.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.592+0000 7ffabe937800 10 removing user index: ragweed.client.0 2024-09-22T08:31:23.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.593+0000 7ffabe937800 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-22T08:31:23.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.593+0000 7ffabe937800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-22T08:31:23.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.594+0000 7ff99d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497082 cookie 94493457134624 notifier 5850 bl.length()=165 2024-09-22T08:31:23.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.595+0000 7ff970fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:31:23.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.598+0000 7ffabe937800 20 remove_watcher() i=0 2024-09-22T08:31:23.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.598+0000 7ffabe937800 2 removed watcher, disabling cache 2024-09-22T08:31:23.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.599+0000 7ffabe937800 20 remove_watcher() i=1 2024-09-22T08:31:23.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.600+0000 7ffabe937800 20 remove_watcher() i=2 2024-09-22T08:31:23.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.601+0000 7ffabe937800 20 remove_watcher() i=3 2024-09-22T08:31:23.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.602+0000 7ffabe937800 20 remove_watcher() i=4 2024-09-22T08:31:23.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.603+0000 7ffabe937800 20 remove_watcher() i=5 2024-09-22T08:31:23.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.604+0000 7ffabe937800 20 remove_watcher() i=6 2024-09-22T08:31:23.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.605+0000 7ffabe937800 20 remove_watcher() i=7 2024-09-22T08:31:23.618 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-22T08:31:23.675 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:31:23.676 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:31:23.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.710+0000 7fe7e2946800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.712+0000 7fe7e2946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:31:23.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.712+0000 7fe7e2946800 20 realm 2024-09-22T08:31:23.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.712+0000 7fe7e2946800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.712+0000 7fe7e2946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:31:23.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.712+0000 7fe7e2946800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:31:23.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.712+0000 7fe7e2946800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.712+0000 7fe7e2946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:31:23.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.712+0000 7fe7e2946800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.713+0000 7fe7e2946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:31:23.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.713+0000 7fe7e2946800 20 rados->read ofs=0 len=0 2024-09-22T08:31:23.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.714+0000 7fe7e2946800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:31:23.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.714+0000 7fe7e2946800 20 searching for the correct realm 2024-09-22T08:31:23.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.716+0000 7fe7dfc36640 0 -- 172.21.15.38:0/685346199 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7fe7d401a040 msgr2=0x7fe7d4082f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:31:23.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:23.922+0000 7fe7dfc36640 0 -- 172.21.15.38:0/685346199 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fe7d004a040 msgr2=0x7fe7d004a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:31:24.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.131+0000 7fe7e2946800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:31:24.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.131+0000 7fe7e2946800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:31:24.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.131+0000 7fe7e2946800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:31:24.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.131+0000 7fe7e2946800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:31:24.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.131+0000 7fe7e2946800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:31:24.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.131+0000 7fe7e2946800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:31:24.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.131+0000 7fe7e2946800 20 rados->read ofs=0 len=0 2024-09-22T08:31:24.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.131+0000 7fe7e2946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:31:24.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.131+0000 7fe7e2946800 20 rados->read ofs=0 len=0 2024-09-22T08:31:24.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.132+0000 7fe7e2946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:31:24.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.132+0000 7fe7e2946800 20 rados->read ofs=0 len=0 2024-09-22T08:31:24.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.132+0000 7fe7e2946800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:31:24.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.132+0000 7fe7e2946800 20 zone default found 2024-09-22T08:31:24.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.132+0000 7fe7e2946800 4 Realm: () 2024-09-22T08:31:24.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.132+0000 7fe7e2946800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:31:24.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.132+0000 7fe7e2946800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:31:24.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.132+0000 7fe7e2946800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:31:24.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.132+0000 7fe7e2946800 20 zonegroup default 2024-09-22T08:31:24.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.132+0000 7fe7e2946800 20 rados->read ofs=0 len=0 2024-09-22T08:31:24.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.133+0000 7fe7e2946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:31:24.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.133+0000 7fe7e2946800 20 rados->read ofs=0 len=0 2024-09-22T08:31:24.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.133+0000 7fe7e2946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:31:24.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.133+0000 7fe7e2946800 20 rados->read ofs=0 len=0 2024-09-22T08:31:24.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.133+0000 7fe7e2946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:31:24.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.133+0000 7fe7e2946800 20 started sync module instance, tier type = 2024-09-22T08:31:24.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.133+0000 7fe7e2946800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:31:24.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.144+0000 7fe7e2946800 20 add_watcher() i=0 2024-09-22T08:31:24.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.144+0000 7fe7e2946800 20 add_watcher() i=1 2024-09-22T08:31:24.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.144+0000 7fe7e2946800 20 add_watcher() i=2 2024-09-22T08:31:24.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.144+0000 7fe7e2946800 20 add_watcher() i=3 2024-09-22T08:31:24.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.144+0000 7fe7e2946800 20 add_watcher() i=4 2024-09-22T08:31:24.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.144+0000 7fe7e2946800 20 add_watcher() i=5 2024-09-22T08:31:24.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.144+0000 7fe7e2946800 20 add_watcher() i=6 2024-09-22T08:31:24.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.145+0000 7fe7e2946800 20 add_watcher() i=7 2024-09-22T08:31:24.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.145+0000 7fe7e2946800 2 all 8 watchers are set, enabling cache 2024-09-22T08:31:24.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.147+0000 7fe696fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:31:24.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.147+0000 7fe7e2946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:31:24.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.147+0000 7fe7e2946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:31:24.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.189+0000 7fe695fdb640 20 reqs_thread_entry: start 2024-09-22T08:31:24.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.189+0000 7fe7e2946800 20 init_complete bucket index max shards: 11 2024-09-22T08:31:24.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.189+0000 7fe7e2946800 20 Filter name: none 2024-09-22T08:31:24.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.189+0000 7fe6077fe640 20 reqs_thread_entry: start 2024-09-22T08:31:24.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.189+0000 7fe7e2946800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-22T08:31:24.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.189+0000 7fe7e2946800 20 rados->read ofs=0 len=0 2024-09-22T08:31:24.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.190+0000 7fe7e2946800 20 rados_obj.operate() r=0 bl.length=486 2024-09-22T08:31:24.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.190+0000 7fe7e2946800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-22T08:31:24.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.190+0000 7fe7e2946800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-22T08:31:24.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.190+0000 7fe7e2946800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:31:24.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.190+0000 7fe7e2946800 10 removing key index: BLLEMYUTHNIEHSKDQFHG 2024-09-22T08:31:24.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.191+0000 7fe7e2946800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.keys:BLLEMYUTHNIEHSKDQFHG, ofs0, ns] 2024-09-22T08:31:24.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.192+0000 7fe6b77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496978 cookie 94014936665456 notifier 5868 bl.length()=170 2024-09-22T08:31:24.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.192+0000 7fe7e2946800 10 removing email index: sysuser.client.0+test@test.test 2024-09-22T08:31:24.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.193+0000 7fe7e2946800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-22T08:31:24.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.194+0000 7fe6b77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497083 cookie 94014936679776 notifier 5868 bl.length()=182 2024-09-22T08:31:24.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.194+0000 7fe7e2946800 10 removing user buckets index 2024-09-22T08:31:24.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.195+0000 7fe7e2946800 10 removing user index: sysuser.client.0 2024-09-22T08:31:24.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.197+0000 7fe7e2946800 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-22T08:31:24.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.197+0000 7fe7e2946800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-22T08:31:24.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.197+0000 7fe6b6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496987 cookie 94014936673728 notifier 5868 bl.length()=165 2024-09-22T08:31:24.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.198+0000 7fe696fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:31:24.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.200+0000 7fe7e2946800 20 remove_watcher() i=0 2024-09-22T08:31:24.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.200+0000 7fe7e2946800 2 removed watcher, disabling cache 2024-09-22T08:31:24.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.202+0000 7fe7e2946800 20 remove_watcher() i=1 2024-09-22T08:31:24.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.203+0000 7fe7e2946800 20 remove_watcher() i=2 2024-09-22T08:31:24.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.204+0000 7fe7e2946800 20 remove_watcher() i=3 2024-09-22T08:31:24.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.205+0000 7fe7e2946800 20 remove_watcher() i=4 2024-09-22T08:31:24.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.206+0000 7fe7e2946800 20 remove_watcher() i=5 2024-09-22T08:31:24.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.207+0000 7fe7e2946800 20 remove_watcher() i=6 2024-09-22T08:31:24.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:31:24.209+0000 7fe7e2946800 20 remove_watcher() i=7 2024-09-22T08:31:24.222 INFO:tasks.ragweed:Removing ragweed... 2024-09-22T08:31:24.222 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-22T08:31:24.303 INFO:teuthology.run_tasks:Running task workunit... 2024-09-22T08:31:24.313 INFO:tasks.workunit:Pulling workunits from ref 8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:31:24.313 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-22T08:31:24.313 DEBUG:teuthology.orchestra.run.smithi038:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-22T08:31:24.344 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:31:24.344 INFO:teuthology.orchestra.run.smithi038.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-22T08:31:24.345 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-22T08:31:24.414 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-22T08:31:24.415 DEBUG:teuthology.orchestra.run.smithi038:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-22T08:31:24.484 INFO:tasks.workunit:timeout=3h 2024-09-22T08:31:24.485 INFO:tasks.workunit:cleanup=True 2024-09-22T08:31:24.485 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:31:24.555 INFO:tasks.workunit.client.0.smithi038.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-22T08:32:26.914 INFO:tasks.workunit.client.0.smithi038.stderr:Updating files: 91% (11676/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-22T08:32:27.834 INFO:tasks.workunit.client.0.smithi038.stderr:Note: switching to '8852379c050c686f4605f33f0129009b2029ca9d'. 2024-09-22T08:32:27.834 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:32:27.834 INFO:tasks.workunit.client.0.smithi038.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-22T08:32:27.834 INFO:tasks.workunit.client.0.smithi038.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-22T08:32:27.834 INFO:tasks.workunit.client.0.smithi038.stderr:state without impacting any branches by switching back to a branch. 2024-09-22T08:32:27.834 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:32:27.834 INFO:tasks.workunit.client.0.smithi038.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-22T08:32:27.834 INFO:tasks.workunit.client.0.smithi038.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-22T08:32:27.835 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:32:27.835 INFO:tasks.workunit.client.0.smithi038.stderr: git switch -c 2024-09-22T08:32:27.835 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:32:27.835 INFO:tasks.workunit.client.0.smithi038.stderr:Or undo this operation with: 2024-09-22T08:32:27.835 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:32:27.835 INFO:tasks.workunit.client.0.smithi038.stderr: git switch - 2024-09-22T08:32:27.835 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:32:27.835 INFO:tasks.workunit.client.0.smithi038.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-22T08:32:27.835 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:32:27.835 INFO:tasks.workunit.client.0.smithi038.stderr:HEAD is now at 8852379c050 rgw/cloud-restore: Fixed storage class update while listing objects. 2024-09-22T08:32:27.839 DEBUG:teuthology.orchestra.run.smithi038:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-22T08:32:27.909 INFO:tasks.workunit.client.0.smithi038.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-22T08:32:27.911 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-22T08:32:27.912 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-22T08:32:27.963 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-22T08:32:28.013 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-22T08:32:28.053 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-22T08:32:28.054 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-22T08:32:28.054 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-22T08:32:28.093 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-22T08:32:28.097 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-22T08:32:28.097 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-22T08:32:28.167 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-22T08:32:28.168 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-22T08:32:28.168 DEBUG:teuthology.orchestra.run.smithi038:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-22T08:32:28.241 INFO:tasks.workunit.client.0.smithi038.stderr:+ ulimit -c 0 2024-09-22T08:32:28.242 INFO:tasks.workunit.client.0.smithi038.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-22T08:32:28.242 INFO:tasks.workunit.client.0.smithi038.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-22T08:32:28.242 INFO:tasks.workunit.client.0.smithi038.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-22T08:32:30.619 INFO:tasks.workunit.client.0.smithi038.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-22T08:32:30.619 INFO:tasks.workunit.client.0.smithi038.stderr:++ deactivate nondestructive 2024-09-22T08:32:30.619 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -n '' ']' 2024-09-22T08:32:30.620 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -n '' ']' 2024-09-22T08:32:30.620 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-22T08:32:30.620 INFO:tasks.workunit.client.0.smithi038.stderr:++ hash -r 2024-09-22T08:32:30.620 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -n '' ']' 2024-09-22T08:32:30.620 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset VIRTUAL_ENV 2024-09-22T08:32:30.620 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-22T08:32:30.620 INFO:tasks.workunit.client.0.smithi038.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-22T08:32:30.620 INFO:tasks.workunit.client.0.smithi038.stderr:++ export VIRTUAL_ENV 2024-09-22T08:32:30.620 INFO:tasks.workunit.client.0.smithi038.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-22T08:32:30.620 INFO:tasks.workunit.client.0.smithi038.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-22T08:32:30.620 INFO:tasks.workunit.client.0.smithi038.stderr:++ export PATH 2024-09-22T08:32:30.620 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -n '' ']' 2024-09-22T08:32:30.620 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-09-22T08:32:30.620 INFO:tasks.workunit.client.0.smithi038.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-22T08:32:30.621 INFO:tasks.workunit.client.0.smithi038.stderr:++ PS1='(rgw) ' 2024-09-22T08:32:30.621 INFO:tasks.workunit.client.0.smithi038.stderr:++ export PS1 2024-09-22T08:32:30.621 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-22T08:32:30.621 INFO:tasks.workunit.client.0.smithi038.stderr:++ hash -r 2024-09-22T08:32:30.621 INFO:tasks.workunit.client.0.smithi038.stderr:+ pip install pip --upgrade 2024-09-22T08:32:30.855 INFO:tasks.workunit.client.0.smithi038.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-22T08:32:31.041 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting pip 2024-09-22T08:32:31.047 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-22T08:32:31.093 INFO:tasks.workunit.client.0.smithi038.stdout:Installing collected packages: pip 2024-09-22T08:32:31.093 INFO:tasks.workunit.client.0.smithi038.stdout: Attempting uninstall: pip 2024-09-22T08:32:31.094 INFO:tasks.workunit.client.0.smithi038.stdout: Found existing installation: pip 21.3.1 2024-09-22T08:32:31.260 INFO:tasks.workunit.client.0.smithi038.stdout: Uninstalling pip-21.3.1: 2024-09-22T08:32:31.265 INFO:tasks.workunit.client.0.smithi038.stdout: Successfully uninstalled pip-21.3.1 2024-09-22T08:32:32.028 INFO:tasks.workunit.client.0.smithi038.stdout:Successfully installed pip-24.2 2024-09-22T08:32:32.077 INFO:tasks.workunit.client.0.smithi038.stderr:+ pip install boto3 2024-09-22T08:32:32.890 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting boto3 2024-09-22T08:32:32.892 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached boto3-1.35.24-py3-none-any.whl.metadata (6.6 kB) 2024-09-22T08:32:33.452 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting botocore<1.36.0,>=1.35.24 (from boto3) 2024-09-22T08:32:33.454 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached botocore-1.35.24-py3-none-any.whl.metadata (5.7 kB) 2024-09-22T08:32:33.496 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-22T08:32:33.498 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-22T08:32:33.544 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-22T08:32:33.545 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-22T08:32:33.594 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.24->boto3) 2024-09-22T08:32:33.596 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-22T08:32:33.673 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.24->boto3) 2024-09-22T08:32:33.674 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-22T08:32:33.816 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.24->boto3) 2024-09-22T08:32:33.817 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-22T08:32:33.822 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached boto3-1.35.24-py3-none-any.whl (139 kB) 2024-09-22T08:32:33.823 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached botocore-1.35.24-py3-none-any.whl (12.6 MB) 2024-09-22T08:32:33.833 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-22T08:32:33.834 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-22T08:32:33.835 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-22T08:32:33.837 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-22T08:32:33.838 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-22T08:32:33.915 INFO:tasks.workunit.client.0.smithi038.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-22T08:32:34.989 INFO:tasks.workunit.client.0.smithi038.stdout:Successfully installed boto3-1.35.24 botocore-1.35.24 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-22T08:32:35.113 INFO:tasks.workunit.client.0.smithi038.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-22T08:32:35.242 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-22T08:32:35.278 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:32:35.278 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:32:35.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.317+0000 7f269ee0f800 20 rados->read ofs=0 len=0 2024-09-22T08:32:35.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.319+0000 7f269ee0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:35.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.319+0000 7f269ee0f800 20 realm 2024-09-22T08:32:35.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.319+0000 7f269ee0f800 20 rados->read ofs=0 len=0 2024-09-22T08:32:35.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.319+0000 7f269ee0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:35.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.319+0000 7f269ee0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:32:35.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.319+0000 7f269ee0f800 20 rados->read ofs=0 len=0 2024-09-22T08:32:35.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.319+0000 7f269ee0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:35.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.319+0000 7f269ee0f800 20 rados->read ofs=0 len=0 2024-09-22T08:32:35.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.320+0000 7f269ee0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:32:35.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.320+0000 7f269ee0f800 20 rados->read ofs=0 len=0 2024-09-22T08:32:35.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.321+0000 7f269ee0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:32:35.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.321+0000 7f269ee0f800 20 searching for the correct realm 2024-09-22T08:32:35.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.324+0000 7f269ad93640 0 -- 172.21.15.38:0/2935062309 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7f268c0b6a00 msgr2=0x7f268c0ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:32:35.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.529+0000 7f269ad93640 0 -- 172.21.15.38:0/2935062309 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x5640beec9ba0 msgr2=0x5640beecbfb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:32:35.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.534+0000 7f269ee0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:32:35.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.534+0000 7f269ee0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:32:35.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.534+0000 7f269ee0f800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:32:35.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.534+0000 7f269ee0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:32:35.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.534+0000 7f269ee0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:32:35.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.534+0000 7f269ee0f800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:32:35.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.534+0000 7f269ee0f800 20 rados->read ofs=0 len=0 2024-09-22T08:32:35.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.534+0000 7f269ee0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:35.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.534+0000 7f269ee0f800 20 rados->read ofs=0 len=0 2024-09-22T08:32:35.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.535+0000 7f269ee0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:32:35.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.535+0000 7f269ee0f800 20 rados->read ofs=0 len=0 2024-09-22T08:32:35.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.535+0000 7f269ee0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:32:35.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.535+0000 7f269ee0f800 20 zone default found 2024-09-22T08:32:35.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.535+0000 7f269ee0f800 4 Realm: () 2024-09-22T08:32:35.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.535+0000 7f269ee0f800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:32:35.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.535+0000 7f269ee0f800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:32:35.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.535+0000 7f269ee0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:32:35.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.535+0000 7f269ee0f800 20 zonegroup default 2024-09-22T08:32:35.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.535+0000 7f269ee0f800 20 rados->read ofs=0 len=0 2024-09-22T08:32:35.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.535+0000 7f269ee0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:35.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.536+0000 7f269ee0f800 20 rados->read ofs=0 len=0 2024-09-22T08:32:35.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.536+0000 7f269ee0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:35.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.536+0000 7f269ee0f800 20 rados->read ofs=0 len=0 2024-09-22T08:32:35.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.536+0000 7f269ee0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:35.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.536+0000 7f269ee0f800 20 started sync module instance, tier type = 2024-09-22T08:32:35.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.536+0000 7f269ee0f800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:32:35.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.546+0000 7f269ee0f800 20 add_watcher() i=0 2024-09-22T08:32:35.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.546+0000 7f269ee0f800 20 add_watcher() i=1 2024-09-22T08:32:35.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.546+0000 7f269ee0f800 20 add_watcher() i=2 2024-09-22T08:32:35.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.546+0000 7f269ee0f800 20 add_watcher() i=3 2024-09-22T08:32:35.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.546+0000 7f269ee0f800 20 add_watcher() i=4 2024-09-22T08:32:35.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.546+0000 7f269ee0f800 20 add_watcher() i=5 2024-09-22T08:32:35.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.547+0000 7f269ee0f800 20 add_watcher() i=6 2024-09-22T08:32:35.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.548+0000 7f269ee0f800 20 add_watcher() i=7 2024-09-22T08:32:35.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.548+0000 7f269ee0f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:32:35.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.550+0000 7f2550fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:32:35.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.550+0000 7f269ee0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:32:35.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.550+0000 7f269ee0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:32:35.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.550+0000 7f269ee0f800 5 note: GC not initialized 2024-09-22T08:32:35.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.551+0000 7f24cb7fe640 20 reqs_thread_entry: start 2024-09-22T08:32:35.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.551+0000 7f269ee0f800 20 init_complete bucket index max shards: 11 2024-09-22T08:32:35.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.551+0000 7f269ee0f800 20 Filter name: none 2024-09-22T08:32:35.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.551+0000 7f24c97fa640 20 reqs_thread_entry: start 2024-09-22T08:32:35.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.551+0000 7f269ee0f800 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-22T08:32:35.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.551+0000 7f269ee0f800 20 rados->read ofs=0 len=0 2024-09-22T08:32:35.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.551+0000 7f269ee0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:35.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.551+0000 7f269ee0f800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-22T08:32:35.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.551+0000 7f269ee0f800 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-22T08:32:35.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.551+0000 7f269ee0f800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-22T08:32:35.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.551+0000 7f269ee0f800 20 rados->read ofs=0 len=0 2024-09-22T08:32:35.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.552+0000 7f269ee0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:35.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.552+0000 7f269ee0f800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-22T08:32:35.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.552+0000 7f269ee0f800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-22T08:32:35.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.552+0000 7f269ee0f800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-22T08:32:35.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.552+0000 7f269ee0f800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-22T08:32:35.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.553+0000 7f269ee0f800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-22T08:32:35.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.553+0000 7f269ee0f800 10 moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-22T08:32:35.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.553+0000 7f269ee0f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester, ofs0, ns] 2024-09-22T08:32:35.555 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.553+0000 7f257dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496992 cookie 94836081139088 notifier 5627 bl.length()=569 2024-09-22T08:32:35.555 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.554+0000 7f257dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-22T08:32:35.555 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.554+0000 7f257dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-22T08:32:35.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.555+0000 7f269ee0f800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-22T08:32:35.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.555+0000 7f269ee0f800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-22T08:32:35.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.555+0000 7f269ee0f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-22T08:32:35.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.556+0000 7f257dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496993 cookie 94836081153200 notifier 5627 bl.length()=180 2024-09-22T08:32:35.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.556+0000 7f257dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-22T08:32:35.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.556+0000 7f257dffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-22T08:32:35.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.557+0000 7f2550fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:32:35.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.559+0000 7f269ee0f800 20 remove_watcher() i=0 2024-09-22T08:32:35.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.559+0000 7f269ee0f800 2 removed watcher, disabling cache 2024-09-22T08:32:35.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.561+0000 7f269ee0f800 20 remove_watcher() i=1 2024-09-22T08:32:35.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.562+0000 7f269ee0f800 20 remove_watcher() i=2 2024-09-22T08:32:35.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.563+0000 7f269ee0f800 20 remove_watcher() i=3 2024-09-22T08:32:35.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.564+0000 7f269ee0f800 20 remove_watcher() i=4 2024-09-22T08:32:35.566 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.565+0000 7f269ee0f800 20 remove_watcher() i=5 2024-09-22T08:32:35.567 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.566+0000 7f269ee0f800 20 remove_watcher() i=6 2024-09-22T08:32:35.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:35.567+0000 7f269ee0f800 20 remove_watcher() i=7 2024-09-22T08:32:51.217 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:32:51.217 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:32:51.263 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:32:51.263 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:32:51.277 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:32:51.277 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:32:51.291 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:32:51.291 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:32:51.297 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:32:51.297 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:32:51.339 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:32:51.339 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:32:51.381 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard add 2024-09-22T08:32:51.381 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:32:51.383 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T08:32:51.413 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:32:51.414 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:32:51.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.456+0000 7f6faf723800 20 rados->read ofs=0 len=0 2024-09-22T08:32:51.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.458+0000 7f6faf723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:51.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.458+0000 7f6faf723800 20 realm 2024-09-22T08:32:51.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.458+0000 7f6faf723800 20 rados->read ofs=0 len=0 2024-09-22T08:32:51.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.458+0000 7f6faf723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:51.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.458+0000 7f6faf723800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:32:51.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.458+0000 7f6faf723800 20 rados->read ofs=0 len=0 2024-09-22T08:32:51.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.458+0000 7f6faf723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:51.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.458+0000 7f6faf723800 20 rados->read ofs=0 len=0 2024-09-22T08:32:51.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.459+0000 7f6faf723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:32:51.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.459+0000 7f6faf723800 20 rados->read ofs=0 len=0 2024-09-22T08:32:51.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.460+0000 7f6faf723800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:32:51.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.460+0000 7f6faf723800 20 searching for the correct realm 2024-09-22T08:32:51.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.462+0000 7f6faac0b640 0 -- 172.21.15.38:0/3909976137 >> [v2:172.21.15.38:6808/1856522357,v1:172.21.15.38:6809/1856522357] conn(0x557c021104b0 msgr2=0x557c021128a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:32:51.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.466+0000 7f6fab40c640 0 -- 172.21.15.38:0/3909976137 >> [v2:172.21.15.42:6826/1437467409,v1:172.21.15.42:6827/1437467409] conn(0x7f6fa00770c0 msgr2=0x7f6fa005fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:32:51.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.674+0000 7f6faf723800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:32:51.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.674+0000 7f6faf723800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:32:51.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.674+0000 7f6faf723800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:32:51.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.674+0000 7f6faf723800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:32:51.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.674+0000 7f6faf723800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:32:51.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.674+0000 7f6faf723800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:32:51.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.674+0000 7f6faf723800 20 rados->read ofs=0 len=0 2024-09-22T08:32:51.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.674+0000 7f6faf723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:51.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.674+0000 7f6faf723800 20 rados->read ofs=0 len=0 2024-09-22T08:32:51.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.674+0000 7f6faf723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:32:51.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.674+0000 7f6faf723800 20 rados->read ofs=0 len=0 2024-09-22T08:32:51.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.675+0000 7f6faf723800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:32:51.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.675+0000 7f6faf723800 20 zone default found 2024-09-22T08:32:51.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.675+0000 7f6faf723800 4 Realm: () 2024-09-22T08:32:51.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.675+0000 7f6faf723800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:32:51.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.675+0000 7f6faf723800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:32:51.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.675+0000 7f6faf723800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:32:51.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.675+0000 7f6faf723800 20 zonegroup default 2024-09-22T08:32:51.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.675+0000 7f6faf723800 20 rados->read ofs=0 len=0 2024-09-22T08:32:51.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.675+0000 7f6faf723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:51.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.675+0000 7f6faf723800 20 rados->read ofs=0 len=0 2024-09-22T08:32:51.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.676+0000 7f6faf723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:51.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.676+0000 7f6faf723800 20 rados->read ofs=0 len=0 2024-09-22T08:32:51.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.676+0000 7f6faf723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:51.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.676+0000 7f6faf723800 20 started sync module instance, tier type = 2024-09-22T08:32:51.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.676+0000 7f6faf723800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:32:51.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.687+0000 7f6faf723800 20 add_watcher() i=0 2024-09-22T08:32:51.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.687+0000 7f6faf723800 20 add_watcher() i=1 2024-09-22T08:32:51.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.687+0000 7f6faf723800 20 add_watcher() i=2 2024-09-22T08:32:51.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.687+0000 7f6faf723800 20 add_watcher() i=3 2024-09-22T08:32:51.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.687+0000 7f6faf723800 20 add_watcher() i=4 2024-09-22T08:32:51.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.687+0000 7f6faf723800 20 add_watcher() i=5 2024-09-22T08:32:51.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.687+0000 7f6faf723800 20 add_watcher() i=6 2024-09-22T08:32:51.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.688+0000 7f6faf723800 20 add_watcher() i=7 2024-09-22T08:32:51.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.688+0000 7f6faf723800 2 all 8 watchers are set, enabling cache 2024-09-22T08:32:51.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.690+0000 7f6e61fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:32:51.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.691+0000 7f6faf723800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:32:51.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.691+0000 7f6faf723800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:32:51.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.691+0000 7f6faf723800 5 note: GC not initialized 2024-09-22T08:32:51.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.691+0000 7f6e60fe1640 20 reqs_thread_entry: start 2024-09-22T08:32:51.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.691+0000 7f6faf723800 20 init_complete bucket index max shards: 11 2024-09-22T08:32:51.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.691+0000 7f6faf723800 20 Filter name: none 2024-09-22T08:32:51.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.691+0000 7f6dda7fc640 20 reqs_thread_entry: start 2024-09-22T08:32:51.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.691+0000 7f6faf723800 20 rados->read ofs=0 len=0 2024-09-22T08:32:51.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.692+0000 7f6faf723800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:32:51.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.692+0000 7f6faf723800 20 rados->read ofs=0 len=0 2024-09-22T08:32:51.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.692+0000 7f6faf723800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T08:32:51.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.693+0000 7f6faf723800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:32:51.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.693+0000 7f6faf723800 20 rados->read ofs=0 len=0 2024-09-22T08:32:51.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.693+0000 7f6faf723800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:32:51.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.693+0000 7f6faf723800 20 rados->read ofs=0 len=0 2024-09-22T08:32:51.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.693+0000 7f6faf723800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T08:32:51.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.693+0000 7f6faf723800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:32:51.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.695+0000 7f6e61fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:32:51.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.697+0000 7f6faf723800 20 remove_watcher() i=0 2024-09-22T08:32:51.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.697+0000 7f6faf723800 2 removed watcher, disabling cache 2024-09-22T08:32:51.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.699+0000 7f6faf723800 20 remove_watcher() i=1 2024-09-22T08:32:51.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.700+0000 7f6faf723800 20 remove_watcher() i=2 2024-09-22T08:32:51.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.701+0000 7f6faf723800 20 remove_watcher() i=3 2024-09-22T08:32:51.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.702+0000 7f6faf723800 20 remove_watcher() i=4 2024-09-22T08:32:51.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.703+0000 7f6faf723800 20 remove_watcher() i=5 2024-09-22T08:32:51.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.704+0000 7f6faf723800 20 remove_watcher() i=6 2024-09-22T08:32:51.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.706+0000 7f6faf723800 20 remove_watcher() i=7 2024-09-22T08:32:51.719 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:32:51.719 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:32:51.719 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: a-bucket id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-22T08:32:51.719 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:32:51.720 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 12 2024-09-22T08:32:51.752 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:32:51.752 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:32:51.793 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.792+0000 7f70ca528800 20 rados->read ofs=0 len=0 2024-09-22T08:32:51.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.793+0000 7f70ca528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:51.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.793+0000 7f70ca528800 20 realm 2024-09-22T08:32:51.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.793+0000 7f70ca528800 20 rados->read ofs=0 len=0 2024-09-22T08:32:51.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.794+0000 7f70ca528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:51.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.794+0000 7f70ca528800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:32:51.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.794+0000 7f70ca528800 20 rados->read ofs=0 len=0 2024-09-22T08:32:51.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.794+0000 7f70ca528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:51.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.794+0000 7f70ca528800 20 rados->read ofs=0 len=0 2024-09-22T08:32:51.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.795+0000 7f70ca528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:32:51.796 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.795+0000 7f70ca528800 20 rados->read ofs=0 len=0 2024-09-22T08:32:51.796 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.795+0000 7f70ca528800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:32:51.796 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.795+0000 7f70ca528800 20 searching for the correct realm 2024-09-22T08:32:51.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:51.798+0000 7f70c6a70640 0 -- 172.21.15.38:0/939974821 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7f70b80de040 msgr2=0x7f70b80ae790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:32:52.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.004+0000 7f70c626f640 0 -- 172.21.15.38:0/939974821 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x5586a97d4e20 msgr2=0x5586a97d72e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:32:52.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.009+0000 7f70ca528800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:32:52.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.009+0000 7f70ca528800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:32:52.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.009+0000 7f70ca528800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:32:52.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.009+0000 7f70ca528800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:32:52.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.009+0000 7f70ca528800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:32:52.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.009+0000 7f70ca528800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:32:52.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.009+0000 7f70ca528800 20 rados->read ofs=0 len=0 2024-09-22T08:32:52.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.009+0000 7f70ca528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:52.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.009+0000 7f70ca528800 20 rados->read ofs=0 len=0 2024-09-22T08:32:52.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.009+0000 7f70ca528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:32:52.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.009+0000 7f70ca528800 20 rados->read ofs=0 len=0 2024-09-22T08:32:52.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.010+0000 7f70ca528800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:32:52.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.010+0000 7f70ca528800 20 zone default found 2024-09-22T08:32:52.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.010+0000 7f70ca528800 4 Realm: () 2024-09-22T08:32:52.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.010+0000 7f70ca528800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:32:52.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.010+0000 7f70ca528800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:32:52.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.010+0000 7f70ca528800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:32:52.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.010+0000 7f70ca528800 20 zonegroup default 2024-09-22T08:32:52.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.010+0000 7f70ca528800 20 rados->read ofs=0 len=0 2024-09-22T08:32:52.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.010+0000 7f70ca528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:52.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.010+0000 7f70ca528800 20 rados->read ofs=0 len=0 2024-09-22T08:32:52.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.011+0000 7f70ca528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:52.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.011+0000 7f70ca528800 20 rados->read ofs=0 len=0 2024-09-22T08:32:52.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.011+0000 7f70ca528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:52.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.011+0000 7f70ca528800 20 started sync module instance, tier type = 2024-09-22T08:32:52.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.011+0000 7f70ca528800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:32:52.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.021+0000 7f70ca528800 20 add_watcher() i=0 2024-09-22T08:32:52.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.022+0000 7f70ca528800 20 add_watcher() i=1 2024-09-22T08:32:52.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.022+0000 7f70ca528800 20 add_watcher() i=2 2024-09-22T08:32:52.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.022+0000 7f70ca528800 20 add_watcher() i=3 2024-09-22T08:32:52.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.022+0000 7f70ca528800 20 add_watcher() i=4 2024-09-22T08:32:52.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.022+0000 7f70ca528800 20 add_watcher() i=5 2024-09-22T08:32:52.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.022+0000 7f70ca528800 20 add_watcher() i=6 2024-09-22T08:32:52.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.023+0000 7f70ca528800 20 add_watcher() i=7 2024-09-22T08:32:52.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.023+0000 7f70ca528800 2 all 8 watchers are set, enabling cache 2024-09-22T08:32:52.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.024+0000 7f6f7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:32:52.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.025+0000 7f70ca528800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:32:52.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.025+0000 7f70ca528800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:32:52.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.025+0000 7f70ca528800 5 note: GC not initialized 2024-09-22T08:32:52.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.025+0000 7f6ef77fe640 20 reqs_thread_entry: start 2024-09-22T08:32:52.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.025+0000 7f70ca528800 20 init_complete bucket index max shards: 11 2024-09-22T08:32:52.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.025+0000 7f70ca528800 20 Filter name: none 2024-09-22T08:32:52.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.025+0000 7f6ef57fa640 20 reqs_thread_entry: start 2024-09-22T08:32:52.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.025+0000 7f70ca528800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:32:52.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.025+0000 7f70ca528800 20 rados->read ofs=0 len=0 2024-09-22T08:32:52.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.026+0000 7f70ca528800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:32:52.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.026+0000 7f70ca528800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:32:52.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.026+0000 7f70ca528800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:32:52.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.026+0000 7f70ca528800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 : miss 2024-09-22T08:32:52.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.026+0000 7f70ca528800 20 rados->read ofs=0 len=0 2024-09-22T08:32:52.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.026+0000 7f70ca528800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T08:32:52.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.026+0000 7f70ca528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:32:52.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.026+0000 7f70ca528800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:32:52.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.026+0000 7f70ca528800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:32:52.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.026+0000 7f70ca528800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:32:52.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.026+0000 7f70ca528800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 2024-09-22T08:32:52.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.029+0000 7f6f7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:32:52.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.031+0000 7f70ca528800 20 remove_watcher() i=0 2024-09-22T08:32:52.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.031+0000 7f70ca528800 2 removed watcher, disabling cache 2024-09-22T08:32:52.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.033+0000 7f70ca528800 20 remove_watcher() i=1 2024-09-22T08:32:52.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.034+0000 7f70ca528800 20 remove_watcher() i=2 2024-09-22T08:32:52.036 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.035+0000 7f70ca528800 20 remove_watcher() i=3 2024-09-22T08:32:52.037 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.036+0000 7f70ca528800 20 remove_watcher() i=4 2024-09-22T08:32:52.038 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.037+0000 7f70ca528800 20 remove_watcher() i=5 2024-09-22T08:32:52.039 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.039+0000 7f70ca528800 20 remove_watcher() i=6 2024-09-22T08:32:52.040 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.040+0000 7f70ca528800 20 remove_watcher() i=7 2024-09-22T08:32:52.054 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin reshard list 2024-09-22T08:32:52.081 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:32:52.081 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:32:52.120 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.119+0000 7ff0baa98800 20 rados->read ofs=0 len=0 2024-09-22T08:32:52.122 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.121+0000 7ff0baa98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:52.122 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.121+0000 7ff0baa98800 20 realm 2024-09-22T08:32:52.122 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.121+0000 7ff0baa98800 20 rados->read ofs=0 len=0 2024-09-22T08:32:52.122 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.121+0000 7ff0baa98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:52.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.121+0000 7ff0baa98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:32:52.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.121+0000 7ff0baa98800 20 rados->read ofs=0 len=0 2024-09-22T08:32:52.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.121+0000 7ff0baa98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:52.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.121+0000 7ff0baa98800 20 rados->read ofs=0 len=0 2024-09-22T08:32:52.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.122+0000 7ff0baa98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:32:52.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.122+0000 7ff0baa98800 20 rados->read ofs=0 len=0 2024-09-22T08:32:52.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.123+0000 7ff0baa98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:32:52.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.123+0000 7ff0baa98800 20 searching for the correct realm 2024-09-22T08:32:52.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.126+0000 7ff0b8d83640 0 -- 172.21.15.38:0/190380189 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7ff0a8033040 msgr2=0x7ff0a800a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:32:52.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.332+0000 7ff0b8582640 0 -- 172.21.15.38:0/190380189 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x55e84037a130 msgr2=0x55e84037c580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:32:52.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.337+0000 7ff0baa98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:32:52.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.337+0000 7ff0baa98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:32:52.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.337+0000 7ff0baa98800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:32:52.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.337+0000 7ff0baa98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:32:52.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.337+0000 7ff0baa98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:32:52.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.337+0000 7ff0baa98800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:32:52.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.337+0000 7ff0baa98800 20 rados->read ofs=0 len=0 2024-09-22T08:32:52.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.337+0000 7ff0baa98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:52.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.337+0000 7ff0baa98800 20 rados->read ofs=0 len=0 2024-09-22T08:32:52.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.337+0000 7ff0baa98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:32:52.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.337+0000 7ff0baa98800 20 rados->read ofs=0 len=0 2024-09-22T08:32:52.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.337+0000 7ff0baa98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:32:52.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.338+0000 7ff0baa98800 20 zone default found 2024-09-22T08:32:52.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.338+0000 7ff0baa98800 4 Realm: () 2024-09-22T08:32:52.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.338+0000 7ff0baa98800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:32:52.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.338+0000 7ff0baa98800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:32:52.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.338+0000 7ff0baa98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:32:52.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.338+0000 7ff0baa98800 20 zonegroup default 2024-09-22T08:32:52.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.338+0000 7ff0baa98800 20 rados->read ofs=0 len=0 2024-09-22T08:32:52.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.338+0000 7ff0baa98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:52.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.338+0000 7ff0baa98800 20 rados->read ofs=0 len=0 2024-09-22T08:32:52.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.338+0000 7ff0baa98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:52.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.338+0000 7ff0baa98800 20 rados->read ofs=0 len=0 2024-09-22T08:32:52.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.338+0000 7ff0baa98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:52.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.338+0000 7ff0baa98800 20 started sync module instance, tier type = 2024-09-22T08:32:52.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.338+0000 7ff0baa98800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:32:52.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.348+0000 7ff0baa98800 20 add_watcher() i=0 2024-09-22T08:32:52.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.348+0000 7ff0baa98800 20 add_watcher() i=1 2024-09-22T08:32:52.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.348+0000 7ff0baa98800 20 add_watcher() i=2 2024-09-22T08:32:52.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.348+0000 7ff0baa98800 20 add_watcher() i=3 2024-09-22T08:32:52.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.348+0000 7ff0baa98800 20 add_watcher() i=4 2024-09-22T08:32:52.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.348+0000 7ff0baa98800 20 add_watcher() i=5 2024-09-22T08:32:52.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.348+0000 7ff0baa98800 20 add_watcher() i=6 2024-09-22T08:32:52.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.349+0000 7ff0baa98800 20 add_watcher() i=7 2024-09-22T08:32:52.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.349+0000 7ff0baa98800 2 all 8 watchers are set, enabling cache 2024-09-22T08:32:52.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.350+0000 7fef6efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:32:52.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.351+0000 7ff0baa98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:32:52.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.351+0000 7ff0baa98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:32:52.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.351+0000 7ff0baa98800 5 note: GC not initialized 2024-09-22T08:32:52.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.351+0000 7fef6dfdb640 20 reqs_thread_entry: start 2024-09-22T08:32:52.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.351+0000 7ff0baa98800 20 init_complete bucket index max shards: 11 2024-09-22T08:32:52.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.351+0000 7ff0baa98800 20 Filter name: none 2024-09-22T08:32:52.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.351+0000 7feedf7fe640 20 reqs_thread_entry: start 2024-09-22T08:32:52.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.358+0000 7fef6efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:32:52.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.360+0000 7ff0baa98800 20 remove_watcher() i=0 2024-09-22T08:32:52.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.360+0000 7ff0baa98800 2 removed watcher, disabling cache 2024-09-22T08:32:52.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.362+0000 7ff0baa98800 20 remove_watcher() i=1 2024-09-22T08:32:52.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.363+0000 7ff0baa98800 20 remove_watcher() i=2 2024-09-22T08:32:52.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.364+0000 7ff0baa98800 20 remove_watcher() i=3 2024-09-22T08:32:52.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.365+0000 7ff0baa98800 20 remove_watcher() i=4 2024-09-22T08:32:52.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.366+0000 7ff0baa98800 20 remove_watcher() i=5 2024-09-22T08:32:52.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.367+0000 7ff0baa98800 20 remove_watcher() i=6 2024-09-22T08:32:52.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.368+0000 7ff0baa98800 20 remove_watcher() i=7 2024-09-22T08:32:52.380 INFO:tasks.workunit.client.0.smithi038.stderr:bucket name a-bucket 2024-09-22T08:32:52.380 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard process 2024-09-22T08:32:52.381 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:32:52.382 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin reshard process 2024-09-22T08:32:52.409 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:32:52.409 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:32:52.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.448+0000 7ff487bad800 20 rados->read ofs=0 len=0 2024-09-22T08:32:52.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.450+0000 7ff487bad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:52.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.450+0000 7ff487bad800 20 realm 2024-09-22T08:32:52.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.450+0000 7ff487bad800 20 rados->read ofs=0 len=0 2024-09-22T08:32:52.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.450+0000 7ff487bad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:52.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.450+0000 7ff487bad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:32:52.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.450+0000 7ff487bad800 20 rados->read ofs=0 len=0 2024-09-22T08:32:52.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.450+0000 7ff487bad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:52.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.450+0000 7ff487bad800 20 rados->read ofs=0 len=0 2024-09-22T08:32:52.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.451+0000 7ff487bad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:32:52.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.451+0000 7ff487bad800 20 rados->read ofs=0 len=0 2024-09-22T08:32:52.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.452+0000 7ff487bad800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:32:52.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.452+0000 7ff487bad800 20 searching for the correct realm 2024-09-22T08:32:52.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.455+0000 7ff485e98640 0 -- 172.21.15.38:0/423761480 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7ff478017070 msgr2=0x7ff478025400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:32:52.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.659+0000 7ff485697640 0 -- 172.21.15.38:0/423761480 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x5624625c70a0 msgr2=0x5624625c9520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:32:52.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.664+0000 7ff487bad800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:32:52.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.664+0000 7ff487bad800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:32:52.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.664+0000 7ff487bad800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:32:52.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.664+0000 7ff487bad800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:32:52.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.664+0000 7ff487bad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:32:52.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.664+0000 7ff487bad800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:32:52.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.664+0000 7ff487bad800 20 rados->read ofs=0 len=0 2024-09-22T08:32:52.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.664+0000 7ff487bad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:52.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.664+0000 7ff487bad800 20 rados->read ofs=0 len=0 2024-09-22T08:32:52.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.665+0000 7ff487bad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:32:52.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.665+0000 7ff487bad800 20 rados->read ofs=0 len=0 2024-09-22T08:32:52.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.665+0000 7ff487bad800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:32:52.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.665+0000 7ff487bad800 20 zone default found 2024-09-22T08:32:52.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.665+0000 7ff487bad800 4 Realm: () 2024-09-22T08:32:52.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.665+0000 7ff487bad800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:32:52.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.665+0000 7ff487bad800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:32:52.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.665+0000 7ff487bad800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:32:52.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.665+0000 7ff487bad800 20 zonegroup default 2024-09-22T08:32:52.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.665+0000 7ff487bad800 20 rados->read ofs=0 len=0 2024-09-22T08:32:52.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.665+0000 7ff487bad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:52.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.665+0000 7ff487bad800 20 rados->read ofs=0 len=0 2024-09-22T08:32:52.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.666+0000 7ff487bad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:52.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.666+0000 7ff487bad800 20 rados->read ofs=0 len=0 2024-09-22T08:32:52.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.666+0000 7ff487bad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:52.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.666+0000 7ff487bad800 20 started sync module instance, tier type = 2024-09-22T08:32:52.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.666+0000 7ff487bad800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:32:52.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.676+0000 7ff487bad800 20 add_watcher() i=0 2024-09-22T08:32:52.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.676+0000 7ff487bad800 20 add_watcher() i=1 2024-09-22T08:32:52.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.676+0000 7ff487bad800 20 add_watcher() i=2 2024-09-22T08:32:52.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.676+0000 7ff487bad800 20 add_watcher() i=3 2024-09-22T08:32:52.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.676+0000 7ff487bad800 20 add_watcher() i=4 2024-09-22T08:32:52.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.676+0000 7ff487bad800 20 add_watcher() i=5 2024-09-22T08:32:52.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.676+0000 7ff487bad800 20 add_watcher() i=6 2024-09-22T08:32:52.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.677+0000 7ff487bad800 20 add_watcher() i=7 2024-09-22T08:32:52.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.677+0000 7ff487bad800 2 all 8 watchers are set, enabling cache 2024-09-22T08:32:52.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.679+0000 7ff33bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:32:52.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.679+0000 7ff487bad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:32:52.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.679+0000 7ff487bad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:32:52.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.679+0000 7ff487bad800 5 note: GC not initialized 2024-09-22T08:32:52.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.679+0000 7ff33afe5640 20 reqs_thread_entry: start 2024-09-22T08:32:52.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.680+0000 7ff487bad800 20 init_complete bucket index max shards: 11 2024-09-22T08:32:52.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.680+0000 7ff487bad800 20 Filter name: none 2024-09-22T08:32:52.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.680+0000 7ff487bad800 20 processing logshard = reshard.0000000000 2024-09-22T08:32:52.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.680+0000 7ff338fe1640 20 reqs_thread_entry: start 2024-09-22T08:32:52.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.682+0000 7ff487bad800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-22T08:32:52.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.682+0000 7ff487bad800 20 processing logshard = reshard.0000000001 2024-09-22T08:32:52.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.686+0000 7ff487bad800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-22T08:32:52.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.686+0000 7ff487bad800 20 processing logshard = reshard.0000000002 2024-09-22T08:32:52.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.688+0000 7ff487bad800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-22T08:32:52.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.688+0000 7ff487bad800 20 processing logshard = reshard.0000000003 2024-09-22T08:32:52.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.691+0000 7ff487bad800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-22T08:32:52.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.691+0000 7ff487bad800 20 processing logshard = reshard.0000000004 2024-09-22T08:32:52.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.694+0000 7ff487bad800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-22T08:32:52.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.694+0000 7ff487bad800 20 processing logshard = reshard.0000000005 2024-09-22T08:32:52.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.697+0000 7ff487bad800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-22T08:32:52.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.697+0000 7ff487bad800 20 processing logshard = reshard.0000000006 2024-09-22T08:32:52.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.698+0000 7ff487bad800 20 process_entry resharding a-bucket 2024-09-22T08:32:52.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.698+0000 7ff487bad800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:32:52.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.698+0000 7ff487bad800 20 rados->read ofs=0 len=0 2024-09-22T08:32:52.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.699+0000 7ff487bad800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:32:52.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.699+0000 7ff487bad800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-22T08:32:52.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.699+0000 7ff487bad800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:32:52.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.699+0000 7ff487bad800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 : miss 2024-09-22T08:32:52.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.699+0000 7ff487bad800 20 rados->read ofs=0 len=0 2024-09-22T08:32:52.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.699+0000 7ff487bad800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T08:32:52.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.699+0000 7ff487bad800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:32:52.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.699+0000 7ff487bad800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:32:52.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.699+0000 7ff487bad800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:32:52.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.699+0000 7ff487bad800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:32:52.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.699+0000 7ff487bad800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 2024-09-22T08:32:52.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.706+0000 7ff487bad800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:32:52.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.706+0000 7ff487bad800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:32:52.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.706+0000 7ff487bad800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:32:52.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.706+0000 7ff487bad800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17, ofs0, ns] 2024-09-22T08:32:52.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.706+0000 7ff368ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496989 cookie 94714269104768 notifier 5699 bl.length()=827 2024-09-22T08:32:52.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.706+0000 7ff368ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:32:52.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.706+0000 7ff368ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:32:52.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.706+0000 7ff368ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:32:52.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.707+0000 7ff487bad800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_sources= new_sources= 2024-09-22T08:32:52.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.707+0000 7ff487bad800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential sources added=[] removed=[] 2024-09-22T08:32:52.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.707+0000 7ff487bad800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_dests= new_dests= 2024-09-22T08:32:52.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.707+0000 7ff487bad800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential dests added=[] removed=[] 2024-09-22T08:32:52.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.712+0000 7ff487bad800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.0 2024-09-22T08:32:52.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.712+0000 7ff487bad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.0 2024-09-22T08:32:52.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.712+0000 7ff487bad800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.1 2024-09-22T08:32:52.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.712+0000 7ff487bad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.1 2024-09-22T08:32:52.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.712+0000 7ff487bad800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.2 2024-09-22T08:32:52.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.712+0000 7ff487bad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.2 2024-09-22T08:32:52.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.712+0000 7ff487bad800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.3 2024-09-22T08:32:52.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.712+0000 7ff487bad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.3 2024-09-22T08:32:52.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.712+0000 7ff487bad800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.4 2024-09-22T08:32:52.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.712+0000 7ff487bad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.4 2024-09-22T08:32:52.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.712+0000 7ff487bad800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.5 2024-09-22T08:32:52.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.712+0000 7ff487bad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.5 2024-09-22T08:32:52.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.712+0000 7ff487bad800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.6 2024-09-22T08:32:52.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.712+0000 7ff487bad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.6 2024-09-22T08:32:52.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.712+0000 7ff487bad800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.7 2024-09-22T08:32:52.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.712+0000 7ff487bad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.7 2024-09-22T08:32:52.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.712+0000 7ff487bad800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.8 2024-09-22T08:32:52.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.712+0000 7ff487bad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.8 2024-09-22T08:32:52.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.712+0000 7ff487bad800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.9 2024-09-22T08:32:52.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.712+0000 7ff487bad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.9 2024-09-22T08:32:52.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.712+0000 7ff487bad800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.10 2024-09-22T08:32:52.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.712+0000 7ff487bad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.10 2024-09-22T08:32:52.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.712+0000 7ff487bad800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.11 2024-09-22T08:32:52.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.712+0000 7ff487bad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.11 2024-09-22T08:32:52.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.712+0000 7ff487bad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.0 2024-09-22T08:32:52.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.712+0000 7ff487bad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1 2024-09-22T08:32:52.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.713+0000 7ff487bad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2 2024-09-22T08:32:52.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.713+0000 7ff487bad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3 2024-09-22T08:32:52.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.714+0000 7ff487bad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.4 2024-09-22T08:32:52.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.714+0000 7ff487bad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.5 2024-09-22T08:32:52.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.715+0000 7ff487bad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.6 2024-09-22T08:32:52.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.715+0000 7ff487bad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.7 2024-09-22T08:32:52.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.716+0000 7ff487bad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.8 2024-09-22T08:32:52.717 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.716+0000 7ff487bad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.9 2024-09-22T08:32:52.718 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.717+0000 7ff487bad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.10 2024-09-22T08:32:52.718 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.717+0000 7ff487bad800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 : hit (requested=0x17, cached=0x17) 2024-09-22T08:32:52.718 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.717+0000 7ff487bad800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 2024-09-22T08:32:52.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.719+0000 7ff487bad800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:32:52.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.719+0000 7ff487bad800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:32:52.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.719+0000 7ff487bad800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:32:52.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.719+0000 7ff487bad800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17, ofs0, ns] 2024-09-22T08:32:52.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.719+0000 7ff357fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496990 cookie 94714269104768 notifier 5699 bl.length()=827 2024-09-22T08:32:52.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.719+0000 7ff357fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:32:52.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.719+0000 7ff357fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:32:52.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.719+0000 7ff357fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:32:52.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.720+0000 7ff487bad800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_sources= new_sources= 2024-09-22T08:32:52.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.720+0000 7ff487bad800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential sources added=[] removed=[] 2024-09-22T08:32:52.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.720+0000 7ff487bad800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_dests= new_dests= 2024-09-22T08:32:52.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.720+0000 7ff487bad800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential dests added=[] removed=[] 2024-09-22T08:32:52.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.722+0000 7ff487bad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.0 2024-09-22T08:32:52.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.722+0000 7ff487bad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1 2024-09-22T08:32:52.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.723+0000 7ff487bad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2 2024-09-22T08:32:52.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.723+0000 7ff487bad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3 2024-09-22T08:32:52.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.723+0000 7ff487bad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.4 2024-09-22T08:32:52.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.724+0000 7ff487bad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.5 2024-09-22T08:32:52.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.724+0000 7ff487bad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.6 2024-09-22T08:32:52.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.724+0000 7ff487bad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.7 2024-09-22T08:32:52.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.725+0000 7ff487bad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.8 2024-09-22T08:32:52.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.725+0000 7ff487bad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.9 2024-09-22T08:32:52.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.725+0000 7ff487bad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.10 2024-09-22T08:32:52.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.726+0000 7ff487bad800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 : hit (requested=0x17, cached=0x17) 2024-09-22T08:32:52.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.726+0000 7ff487bad800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 2024-09-22T08:32:52.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.727+0000 7ff487bad800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:32:52.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.727+0000 7ff487bad800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:32:52.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.727+0000 7ff487bad800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:32:52.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.727+0000 7ff487bad800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17, ofs0, ns] 2024-09-22T08:32:52.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.727+0000 7ff368ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496991 cookie 94714269104768 notifier 5699 bl.length()=795 2024-09-22T08:32:52.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.727+0000 7ff368ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:32:52.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.727+0000 7ff368ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:32:52.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.727+0000 7ff368ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:32:52.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.728+0000 7ff487bad800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_sources= new_sources= 2024-09-22T08:32:52.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.728+0000 7ff487bad800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential sources added=[] removed=[] 2024-09-22T08:32:52.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.728+0000 7ff487bad800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_dests= new_dests= 2024-09-22T08:32:52.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.728+0000 7ff487bad800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential dests added=[] removed=[] 2024-09-22T08:32:52.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.730+0000 7ff487bad800 1 execute INFO: reshard of bucket "a-bucket" from 11 shards to 12 shards completed successfully 2024-09-22T08:32:52.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.731+0000 7ff487bad800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-22T08:32:52.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.733+0000 7ff487bad800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-22T08:32:52.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.733+0000 7ff487bad800 20 processing logshard = reshard.0000000007 2024-09-22T08:32:52.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.735+0000 7ff487bad800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-22T08:32:52.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.735+0000 7ff487bad800 20 processing logshard = reshard.0000000008 2024-09-22T08:32:52.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.738+0000 7ff487bad800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-22T08:32:52.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.738+0000 7ff487bad800 20 processing logshard = reshard.0000000009 2024-09-22T08:32:52.741 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.740+0000 7ff487bad800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-22T08:32:52.741 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.740+0000 7ff487bad800 20 processing logshard = reshard.0000000010 2024-09-22T08:32:52.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.743+0000 7ff487bad800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-22T08:32:52.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.743+0000 7ff487bad800 20 processing logshard = reshard.0000000011 2024-09-22T08:32:52.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.745+0000 7ff487bad800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-22T08:32:52.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.745+0000 7ff487bad800 20 processing logshard = reshard.0000000012 2024-09-22T08:32:52.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.748+0000 7ff487bad800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-22T08:32:52.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.748+0000 7ff487bad800 20 processing logshard = reshard.0000000013 2024-09-22T08:32:52.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.750+0000 7ff487bad800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-22T08:32:52.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.750+0000 7ff487bad800 20 processing logshard = reshard.0000000014 2024-09-22T08:32:52.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.753+0000 7ff487bad800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-22T08:32:52.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.753+0000 7ff487bad800 20 processing logshard = reshard.0000000015 2024-09-22T08:32:52.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.755+0000 7ff487bad800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-22T08:32:52.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.756+0000 7ff33bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:32:52.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.758+0000 7ff487bad800 20 remove_watcher() i=0 2024-09-22T08:32:52.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.758+0000 7ff487bad800 2 removed watcher, disabling cache 2024-09-22T08:32:52.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.759+0000 7ff487bad800 20 remove_watcher() i=1 2024-09-22T08:32:52.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.760+0000 7ff487bad800 20 remove_watcher() i=2 2024-09-22T08:32:52.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.762+0000 7ff487bad800 20 remove_watcher() i=3 2024-09-22T08:32:52.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.762+0000 7ff487bad800 20 remove_watcher() i=4 2024-09-22T08:32:52.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.764+0000 7ff487bad800 20 remove_watcher() i=5 2024-09-22T08:32:52.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.765+0000 7ff487bad800 20 remove_watcher() i=6 2024-09-22T08:32:52.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:52.766+0000 7ff487bad800 20 remove_watcher() i=7 2024-09-22T08:32:57.786 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T08:32:57.819 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:32:57.819 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:32:57.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:57.866+0000 7f87ca340800 20 rados->read ofs=0 len=0 2024-09-22T08:32:57.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:57.868+0000 7f87ca340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:57.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:57.868+0000 7f87ca340800 20 realm 2024-09-22T08:32:57.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:57.868+0000 7f87ca340800 20 rados->read ofs=0 len=0 2024-09-22T08:32:57.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:57.868+0000 7f87ca340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:57.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:57.868+0000 7f87ca340800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:32:57.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:57.868+0000 7f87ca340800 20 rados->read ofs=0 len=0 2024-09-22T08:32:57.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:57.869+0000 7f87ca340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:57.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:57.869+0000 7f87ca340800 20 rados->read ofs=0 len=0 2024-09-22T08:32:57.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:57.869+0000 7f87ca340800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:32:57.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:57.869+0000 7f87ca340800 20 rados->read ofs=0 len=0 2024-09-22T08:32:57.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:57.870+0000 7f87ca340800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:32:57.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:57.870+0000 7f87ca340800 20 searching for the correct realm 2024-09-22T08:32:57.873 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:57.872+0000 7f87c58bf640 0 -- 172.21.15.38:0/3836887494 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f87bc03e070 msgr2=0x7f87bc043eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:32:58.080 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.079+0000 7f87c58bf640 0 -- 172.21.15.38:0/3836887494 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f87b8073ca0 msgr2=0x7f87b8071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:32:58.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.288+0000 7f87ca340800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:32:58.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.288+0000 7f87ca340800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:32:58.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.288+0000 7f87ca340800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:32:58.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.288+0000 7f87ca340800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:32:58.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.288+0000 7f87ca340800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:32:58.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.288+0000 7f87ca340800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:32:58.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.288+0000 7f87ca340800 20 rados->read ofs=0 len=0 2024-09-22T08:32:58.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.288+0000 7f87ca340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:58.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.288+0000 7f87ca340800 20 rados->read ofs=0 len=0 2024-09-22T08:32:58.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.289+0000 7f87ca340800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:32:58.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.289+0000 7f87ca340800 20 rados->read ofs=0 len=0 2024-09-22T08:32:58.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.289+0000 7f87ca340800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:32:58.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.289+0000 7f87ca340800 20 zone default found 2024-09-22T08:32:58.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.289+0000 7f87ca340800 4 Realm: () 2024-09-22T08:32:58.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.289+0000 7f87ca340800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:32:58.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.289+0000 7f87ca340800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:32:58.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.289+0000 7f87ca340800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:32:58.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.289+0000 7f87ca340800 20 zonegroup default 2024-09-22T08:32:58.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.289+0000 7f87ca340800 20 rados->read ofs=0 len=0 2024-09-22T08:32:58.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.289+0000 7f87ca340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:58.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.289+0000 7f87ca340800 20 rados->read ofs=0 len=0 2024-09-22T08:32:58.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.290+0000 7f87ca340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:58.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.290+0000 7f87ca340800 20 rados->read ofs=0 len=0 2024-09-22T08:32:58.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.290+0000 7f87ca340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:58.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.290+0000 7f87ca340800 20 started sync module instance, tier type = 2024-09-22T08:32:58.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.290+0000 7f87ca340800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:32:58.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.302+0000 7f87ca340800 20 add_watcher() i=0 2024-09-22T08:32:58.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.302+0000 7f87ca340800 20 add_watcher() i=1 2024-09-22T08:32:58.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.302+0000 7f87ca340800 20 add_watcher() i=2 2024-09-22T08:32:58.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.302+0000 7f87ca340800 20 add_watcher() i=3 2024-09-22T08:32:58.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.302+0000 7f87ca340800 20 add_watcher() i=4 2024-09-22T08:32:58.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.302+0000 7f87ca340800 20 add_watcher() i=5 2024-09-22T08:32:58.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.302+0000 7f87ca340800 20 add_watcher() i=6 2024-09-22T08:32:58.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.303+0000 7f87ca340800 20 add_watcher() i=7 2024-09-22T08:32:58.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.303+0000 7f87ca340800 2 all 8 watchers are set, enabling cache 2024-09-22T08:32:58.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.305+0000 7f867cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:32:58.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.305+0000 7f87ca340800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:32:58.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.305+0000 7f87ca340800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:32:58.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.305+0000 7f87ca340800 5 note: GC not initialized 2024-09-22T08:32:58.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.305+0000 7f85f77fe640 20 reqs_thread_entry: start 2024-09-22T08:32:58.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.306+0000 7f87ca340800 20 init_complete bucket index max shards: 11 2024-09-22T08:32:58.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.306+0000 7f87ca340800 20 Filter name: none 2024-09-22T08:32:58.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.306+0000 7f85f57fa640 20 reqs_thread_entry: start 2024-09-22T08:32:58.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.306+0000 7f87ca340800 20 rados->read ofs=0 len=0 2024-09-22T08:32:58.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.306+0000 7f87ca340800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:32:58.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.306+0000 7f87ca340800 20 rados->read ofs=0 len=0 2024-09-22T08:32:58.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.307+0000 7f87ca340800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T08:32:58.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.307+0000 7f87ca340800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:32:58.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.307+0000 7f87ca340800 20 rados->read ofs=0 len=0 2024-09-22T08:32:58.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.307+0000 7f87ca340800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:32:58.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.307+0000 7f87ca340800 20 rados->read ofs=0 len=0 2024-09-22T08:32:58.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.308+0000 7f87ca340800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T08:32:58.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.308+0000 7f87ca340800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:32:58.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.310+0000 7f867cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:32:58.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.313+0000 7f87ca340800 20 remove_watcher() i=0 2024-09-22T08:32:58.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.313+0000 7f87ca340800 2 removed watcher, disabling cache 2024-09-22T08:32:58.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.314+0000 7f87ca340800 20 remove_watcher() i=1 2024-09-22T08:32:58.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.316+0000 7f87ca340800 20 remove_watcher() i=2 2024-09-22T08:32:58.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.317+0000 7f87ca340800 20 remove_watcher() i=3 2024-09-22T08:32:58.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.319+0000 7f87ca340800 20 remove_watcher() i=4 2024-09-22T08:32:58.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.320+0000 7f87ca340800 20 remove_watcher() i=5 2024-09-22T08:32:58.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.322+0000 7f87ca340800 20 remove_watcher() i=6 2024-09-22T08:32:58.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.323+0000 7f87ca340800 20 remove_watcher() i=7 2024-09-22T08:32:58.338 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:32:58.338 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:32:58.338 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: a-bucket id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-22T08:32:58.338 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:32:58.338 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard add non empty bucket 2024-09-22T08:32:58.338 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:32:58.343 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:32:58.343 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:32:58.353 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:32:58.353 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:32:58.360 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:32:58.360 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:32:58.367 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:32:58.367 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:32:58.374 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:32:58.374 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:32:58.381 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:32:58.381 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:32:58.388 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:32:58.388 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:32:58.394 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:32:58.394 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:32:58.400 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T08:32:58.430 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:32:58.430 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:32:58.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.469+0000 7f1f59d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:32:58.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.471+0000 7f1f59d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:58.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.471+0000 7f1f59d1f800 20 realm 2024-09-22T08:32:58.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.471+0000 7f1f59d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:32:58.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.471+0000 7f1f59d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:58.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.471+0000 7f1f59d1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:32:58.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.471+0000 7f1f59d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:32:58.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.472+0000 7f1f59d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:58.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.472+0000 7f1f59d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:32:58.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.472+0000 7f1f59d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:32:58.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.472+0000 7f1f59d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:32:58.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.473+0000 7f1f59d1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:32:58.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.473+0000 7f1f59d1f800 20 searching for the correct realm 2024-09-22T08:32:58.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.476+0000 7f1f562a3640 0 -- 172.21.15.38:0/270191553 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7f1f48061040 msgr2=0x7f1f4806d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:32:58.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.681+0000 7f1f552a1640 0 -- 172.21.15.38:0/270191553 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f1f48055920 msgr2=0x7f1f4808f400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:32:58.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.686+0000 7f1f59d1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:32:58.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.686+0000 7f1f59d1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:32:58.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.686+0000 7f1f59d1f800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:32:58.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.686+0000 7f1f59d1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:32:58.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.686+0000 7f1f59d1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:32:58.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.686+0000 7f1f59d1f800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:32:58.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.686+0000 7f1f59d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:32:58.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.687+0000 7f1f59d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:58.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.687+0000 7f1f59d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:32:58.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.687+0000 7f1f59d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:32:58.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.687+0000 7f1f59d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:32:58.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.687+0000 7f1f59d1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:32:58.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.687+0000 7f1f59d1f800 20 zone default found 2024-09-22T08:32:58.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.687+0000 7f1f59d1f800 4 Realm: () 2024-09-22T08:32:58.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.687+0000 7f1f59d1f800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:32:58.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.687+0000 7f1f59d1f800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:32:58.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.687+0000 7f1f59d1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:32:58.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.687+0000 7f1f59d1f800 20 zonegroup default 2024-09-22T08:32:58.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.687+0000 7f1f59d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:32:58.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.688+0000 7f1f59d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:58.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.688+0000 7f1f59d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:32:58.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.688+0000 7f1f59d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:58.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.688+0000 7f1f59d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:32:58.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.689+0000 7f1f59d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:58.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.689+0000 7f1f59d1f800 20 started sync module instance, tier type = 2024-09-22T08:32:58.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.689+0000 7f1f59d1f800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:32:58.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.698+0000 7f1f59d1f800 20 add_watcher() i=0 2024-09-22T08:32:58.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.698+0000 7f1f59d1f800 20 add_watcher() i=1 2024-09-22T08:32:58.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.698+0000 7f1f59d1f800 20 add_watcher() i=2 2024-09-22T08:32:58.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.698+0000 7f1f59d1f800 20 add_watcher() i=3 2024-09-22T08:32:58.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.698+0000 7f1f59d1f800 20 add_watcher() i=4 2024-09-22T08:32:58.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.698+0000 7f1f59d1f800 20 add_watcher() i=5 2024-09-22T08:32:58.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.698+0000 7f1f59d1f800 20 add_watcher() i=6 2024-09-22T08:32:58.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.699+0000 7f1f59d1f800 20 add_watcher() i=7 2024-09-22T08:32:58.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.699+0000 7f1f59d1f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:32:58.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.701+0000 7f1e07fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:32:58.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.702+0000 7f1f59d1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:32:58.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.702+0000 7f1f59d1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:32:58.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.702+0000 7f1f59d1f800 5 note: GC not initialized 2024-09-22T08:32:58.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.702+0000 7f1e06ffd640 20 reqs_thread_entry: start 2024-09-22T08:32:58.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.702+0000 7f1f59d1f800 20 init_complete bucket index max shards: 11 2024-09-22T08:32:58.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.702+0000 7f1f59d1f800 20 Filter name: none 2024-09-22T08:32:58.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.702+0000 7f1e04ff9640 20 reqs_thread_entry: start 2024-09-22T08:32:58.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.702+0000 7f1f59d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:32:58.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.703+0000 7f1f59d1f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:32:58.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.703+0000 7f1f59d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:32:58.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.704+0000 7f1f59d1f800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T08:32:58.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.704+0000 7f1f59d1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:32:58.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.704+0000 7f1f59d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:32:58.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.704+0000 7f1f59d1f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:32:58.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.704+0000 7f1f59d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:32:58.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.704+0000 7f1f59d1f800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T08:32:58.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.704+0000 7f1f59d1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:32:58.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.706+0000 7f1e07fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:32:58.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.708+0000 7f1f59d1f800 20 remove_watcher() i=0 2024-09-22T08:32:58.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.708+0000 7f1f59d1f800 2 removed watcher, disabling cache 2024-09-22T08:32:58.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.710+0000 7f1f59d1f800 20 remove_watcher() i=1 2024-09-22T08:32:58.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.711+0000 7f1f59d1f800 20 remove_watcher() i=2 2024-09-22T08:32:58.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.712+0000 7f1f59d1f800 20 remove_watcher() i=3 2024-09-22T08:32:58.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.713+0000 7f1f59d1f800 20 remove_watcher() i=4 2024-09-22T08:32:58.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.714+0000 7f1f59d1f800 20 remove_watcher() i=5 2024-09-22T08:32:58.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.715+0000 7f1f59d1f800 20 remove_watcher() i=6 2024-09-22T08:32:58.717 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.716+0000 7f1f59d1f800 20 remove_watcher() i=7 2024-09-22T08:32:58.728 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:32:58.728 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:32:58.728 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: a-bucket id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 num_objects: 8 size_kb: 1 num_shards: 12 2024-09-22T08:32:58.728 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:32:58.729 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 13 2024-09-22T08:32:58.761 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:32:58.761 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:32:58.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.800+0000 7f0146b2e800 20 rados->read ofs=0 len=0 2024-09-22T08:32:58.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.802+0000 7f0146b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:58.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.802+0000 7f0146b2e800 20 realm 2024-09-22T08:32:58.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.802+0000 7f0146b2e800 20 rados->read ofs=0 len=0 2024-09-22T08:32:58.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.802+0000 7f0146b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:58.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.802+0000 7f0146b2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:32:58.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.802+0000 7f0146b2e800 20 rados->read ofs=0 len=0 2024-09-22T08:32:58.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.802+0000 7f0146b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:58.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.802+0000 7f0146b2e800 20 rados->read ofs=0 len=0 2024-09-22T08:32:58.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.803+0000 7f0146b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:32:58.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.803+0000 7f0146b2e800 20 rados->read ofs=0 len=0 2024-09-22T08:32:58.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.804+0000 7f0146b2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:32:58.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.804+0000 7f0146b2e800 20 searching for the correct realm 2024-09-22T08:32:58.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:58.807+0000 7f01430de640 0 -- 172.21.15.38:0/179306940 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7f013403a220 msgr2=0x7f01340600f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:32:59.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.012+0000 7f01428dd640 0 -- 172.21.15.38:0/179306940 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x5564d8b81490 msgr2=0x5564d8b838e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:32:59.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.016+0000 7f0146b2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:32:59.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.016+0000 7f0146b2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:32:59.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.016+0000 7f0146b2e800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:32:59.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.016+0000 7f0146b2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:32:59.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.016+0000 7f0146b2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:32:59.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.016+0000 7f0146b2e800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:32:59.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.016+0000 7f0146b2e800 20 rados->read ofs=0 len=0 2024-09-22T08:32:59.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.017+0000 7f0146b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:59.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.017+0000 7f0146b2e800 20 rados->read ofs=0 len=0 2024-09-22T08:32:59.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.017+0000 7f0146b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:32:59.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.017+0000 7f0146b2e800 20 rados->read ofs=0 len=0 2024-09-22T08:32:59.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.017+0000 7f0146b2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:32:59.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.017+0000 7f0146b2e800 20 zone default found 2024-09-22T08:32:59.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.017+0000 7f0146b2e800 4 Realm: () 2024-09-22T08:32:59.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.017+0000 7f0146b2e800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:32:59.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.017+0000 7f0146b2e800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:32:59.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.017+0000 7f0146b2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:32:59.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.017+0000 7f0146b2e800 20 zonegroup default 2024-09-22T08:32:59.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.017+0000 7f0146b2e800 20 rados->read ofs=0 len=0 2024-09-22T08:32:59.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.018+0000 7f0146b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:59.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.018+0000 7f0146b2e800 20 rados->read ofs=0 len=0 2024-09-22T08:32:59.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.018+0000 7f0146b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:59.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.018+0000 7f0146b2e800 20 rados->read ofs=0 len=0 2024-09-22T08:32:59.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.018+0000 7f0146b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:59.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.018+0000 7f0146b2e800 20 started sync module instance, tier type = 2024-09-22T08:32:59.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.018+0000 7f0146b2e800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:32:59.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.028+0000 7f0146b2e800 20 add_watcher() i=0 2024-09-22T08:32:59.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.028+0000 7f0146b2e800 20 add_watcher() i=1 2024-09-22T08:32:59.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.028+0000 7f0146b2e800 20 add_watcher() i=2 2024-09-22T08:32:59.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.028+0000 7f0146b2e800 20 add_watcher() i=3 2024-09-22T08:32:59.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.028+0000 7f0146b2e800 20 add_watcher() i=4 2024-09-22T08:32:59.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.028+0000 7f0146b2e800 20 add_watcher() i=5 2024-09-22T08:32:59.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.028+0000 7f0146b2e800 20 add_watcher() i=6 2024-09-22T08:32:59.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.029+0000 7f0146b2e800 20 add_watcher() i=7 2024-09-22T08:32:59.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.029+0000 7f0146b2e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:32:59.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.031+0000 7efff97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:32:59.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.032+0000 7f0146b2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:32:59.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.032+0000 7f0146b2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:32:59.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.032+0000 7f0146b2e800 5 note: GC not initialized 2024-09-22T08:32:59.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.032+0000 7eff73fff640 20 reqs_thread_entry: start 2024-09-22T08:32:59.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.032+0000 7f0146b2e800 20 init_complete bucket index max shards: 11 2024-09-22T08:32:59.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.032+0000 7f0146b2e800 20 Filter name: none 2024-09-22T08:32:59.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.032+0000 7eff71ffb640 20 reqs_thread_entry: start 2024-09-22T08:32:59.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.032+0000 7f0146b2e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:32:59.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.032+0000 7f0146b2e800 20 rados->read ofs=0 len=0 2024-09-22T08:32:59.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.033+0000 7f0146b2e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:32:59.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.033+0000 7f0146b2e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:32:59.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.033+0000 7f0146b2e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:32:59.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.033+0000 7f0146b2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 : miss 2024-09-22T08:32:59.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.033+0000 7f0146b2e800 20 rados->read ofs=0 len=0 2024-09-22T08:32:59.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.033+0000 7f0146b2e800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T08:32:59.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.033+0000 7f0146b2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:32:59.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.033+0000 7f0146b2e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:32:59.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.033+0000 7f0146b2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:32:59.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.033+0000 7f0146b2e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:32:59.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.033+0000 7f0146b2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 2024-09-22T08:32:59.036 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.035+0000 7efff97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:32:59.039 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.038+0000 7f0146b2e800 20 remove_watcher() i=0 2024-09-22T08:32:59.039 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.038+0000 7f0146b2e800 2 removed watcher, disabling cache 2024-09-22T08:32:59.040 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.039+0000 7f0146b2e800 20 remove_watcher() i=1 2024-09-22T08:32:59.041 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.040+0000 7f0146b2e800 20 remove_watcher() i=2 2024-09-22T08:32:59.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.041+0000 7f0146b2e800 20 remove_watcher() i=3 2024-09-22T08:32:59.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.042+0000 7f0146b2e800 20 remove_watcher() i=4 2024-09-22T08:32:59.045 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.044+0000 7f0146b2e800 20 remove_watcher() i=5 2024-09-22T08:32:59.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.045+0000 7f0146b2e800 20 remove_watcher() i=6 2024-09-22T08:32:59.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.046+0000 7f0146b2e800 20 remove_watcher() i=7 2024-09-22T08:32:59.060 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin reshard list 2024-09-22T08:32:59.088 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:32:59.088 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:32:59.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.126+0000 7fb3e5146800 20 rados->read ofs=0 len=0 2024-09-22T08:32:59.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.128+0000 7fb3e5146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:59.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.128+0000 7fb3e5146800 20 realm 2024-09-22T08:32:59.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.128+0000 7fb3e5146800 20 rados->read ofs=0 len=0 2024-09-22T08:32:59.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.128+0000 7fb3e5146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:59.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.128+0000 7fb3e5146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:32:59.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.128+0000 7fb3e5146800 20 rados->read ofs=0 len=0 2024-09-22T08:32:59.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.128+0000 7fb3e5146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:59.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.128+0000 7fb3e5146800 20 rados->read ofs=0 len=0 2024-09-22T08:32:59.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.129+0000 7fb3e5146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:32:59.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.129+0000 7fb3e5146800 20 rados->read ofs=0 len=0 2024-09-22T08:32:59.131 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.130+0000 7fb3e5146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:32:59.131 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.130+0000 7fb3e5146800 20 searching for the correct realm 2024-09-22T08:32:59.133 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.132+0000 7fb3e242f640 0 -- 172.21.15.38:0/552422414 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7fb3d801f070 msgr2=0x7fb3d8061fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:32:59.137 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.136+0000 7fb3e242f640 0 -- 172.21.15.38:0/552422414 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fb3d404d040 msgr2=0x7fb3d404c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:32:59.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.344+0000 7fb3e5146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:32:59.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.344+0000 7fb3e5146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:32:59.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.344+0000 7fb3e5146800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:32:59.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.344+0000 7fb3e5146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:32:59.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.344+0000 7fb3e5146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:32:59.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.344+0000 7fb3e5146800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:32:59.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.344+0000 7fb3e5146800 20 rados->read ofs=0 len=0 2024-09-22T08:32:59.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.344+0000 7fb3e5146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:59.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.344+0000 7fb3e5146800 20 rados->read ofs=0 len=0 2024-09-22T08:32:59.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.344+0000 7fb3e5146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:32:59.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.344+0000 7fb3e5146800 20 rados->read ofs=0 len=0 2024-09-22T08:32:59.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.345+0000 7fb3e5146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:32:59.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.345+0000 7fb3e5146800 20 zone default found 2024-09-22T08:32:59.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.345+0000 7fb3e5146800 4 Realm: () 2024-09-22T08:32:59.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.345+0000 7fb3e5146800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:32:59.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.345+0000 7fb3e5146800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:32:59.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.345+0000 7fb3e5146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:32:59.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.345+0000 7fb3e5146800 20 zonegroup default 2024-09-22T08:32:59.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.345+0000 7fb3e5146800 20 rados->read ofs=0 len=0 2024-09-22T08:32:59.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.345+0000 7fb3e5146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:59.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.345+0000 7fb3e5146800 20 rados->read ofs=0 len=0 2024-09-22T08:32:59.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.345+0000 7fb3e5146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:59.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.345+0000 7fb3e5146800 20 rados->read ofs=0 len=0 2024-09-22T08:32:59.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.346+0000 7fb3e5146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:59.348 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.346+0000 7fb3e5146800 20 started sync module instance, tier type = 2024-09-22T08:32:59.348 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.346+0000 7fb3e5146800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:32:59.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.356+0000 7fb3e5146800 20 add_watcher() i=0 2024-09-22T08:32:59.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.356+0000 7fb3e5146800 20 add_watcher() i=1 2024-09-22T08:32:59.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.356+0000 7fb3e5146800 20 add_watcher() i=2 2024-09-22T08:32:59.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.356+0000 7fb3e5146800 20 add_watcher() i=3 2024-09-22T08:32:59.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.356+0000 7fb3e5146800 20 add_watcher() i=4 2024-09-22T08:32:59.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.356+0000 7fb3e5146800 20 add_watcher() i=5 2024-09-22T08:32:59.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.356+0000 7fb3e5146800 20 add_watcher() i=6 2024-09-22T08:32:59.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.357+0000 7fb3e5146800 20 add_watcher() i=7 2024-09-22T08:32:59.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.357+0000 7fb3e5146800 2 all 8 watchers are set, enabling cache 2024-09-22T08:32:59.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.360+0000 7fb2997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:32:59.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.361+0000 7fb3e5146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:32:59.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.361+0000 7fb3e5146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:32:59.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.361+0000 7fb3e5146800 5 note: GC not initialized 2024-09-22T08:32:59.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.361+0000 7fb213fff640 20 reqs_thread_entry: start 2024-09-22T08:32:59.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.361+0000 7fb3e5146800 20 init_complete bucket index max shards: 11 2024-09-22T08:32:59.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.361+0000 7fb3e5146800 20 Filter name: none 2024-09-22T08:32:59.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.361+0000 7fb211ffb640 20 reqs_thread_entry: start 2024-09-22T08:32:59.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.368+0000 7fb2997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:32:59.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.371+0000 7fb3e5146800 20 remove_watcher() i=0 2024-09-22T08:32:59.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.371+0000 7fb3e5146800 2 removed watcher, disabling cache 2024-09-22T08:32:59.372 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.372+0000 7fb3e5146800 20 remove_watcher() i=1 2024-09-22T08:32:59.373 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.373+0000 7fb3e5146800 20 remove_watcher() i=2 2024-09-22T08:32:59.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.374+0000 7fb3e5146800 20 remove_watcher() i=3 2024-09-22T08:32:59.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.375+0000 7fb3e5146800 20 remove_watcher() i=4 2024-09-22T08:32:59.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.376+0000 7fb3e5146800 20 remove_watcher() i=5 2024-09-22T08:32:59.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.377+0000 7fb3e5146800 20 remove_watcher() i=6 2024-09-22T08:32:59.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.379+0000 7fb3e5146800 20 remove_watcher() i=7 2024-09-22T08:32:59.391 INFO:tasks.workunit.client.0.smithi038.stderr:bucket name a-bucket 2024-09-22T08:32:59.391 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard process non empty bucket 2024-09-22T08:32:59.391 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:32:59.392 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin reshard process 2024-09-22T08:32:59.420 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:32:59.420 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:32:59.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.458+0000 7f87b8742800 20 rados->read ofs=0 len=0 2024-09-22T08:32:59.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.460+0000 7f87b8742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:59.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.460+0000 7f87b8742800 20 realm 2024-09-22T08:32:59.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.460+0000 7f87b8742800 20 rados->read ofs=0 len=0 2024-09-22T08:32:59.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.460+0000 7f87b8742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:59.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.460+0000 7f87b8742800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:32:59.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.460+0000 7f87b8742800 20 rados->read ofs=0 len=0 2024-09-22T08:32:59.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.460+0000 7f87b8742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:59.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.460+0000 7f87b8742800 20 rados->read ofs=0 len=0 2024-09-22T08:32:59.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.461+0000 7f87b8742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:32:59.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.461+0000 7f87b8742800 20 rados->read ofs=0 len=0 2024-09-22T08:32:59.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.461+0000 7f87b8742800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:32:59.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.461+0000 7f87b8742800 20 searching for the correct realm 2024-09-22T08:32:59.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.465+0000 7f87b4c87640 0 -- 172.21.15.38:0/3281761666 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7f87a4037bb0 msgr2=0x7f87a4027920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:32:59.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.670+0000 7f87b4486640 0 -- 172.21.15.38:0/3281761666 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x561fa976e1b0 msgr2=0x561fa97705a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:32:59.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.674+0000 7f87b8742800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:32:59.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.674+0000 7f87b8742800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:32:59.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.674+0000 7f87b8742800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:32:59.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.674+0000 7f87b8742800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:32:59.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.674+0000 7f87b8742800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:32:59.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.674+0000 7f87b8742800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:32:59.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.674+0000 7f87b8742800 20 rados->read ofs=0 len=0 2024-09-22T08:32:59.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.674+0000 7f87b8742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:59.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.674+0000 7f87b8742800 20 rados->read ofs=0 len=0 2024-09-22T08:32:59.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.675+0000 7f87b8742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:32:59.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.675+0000 7f87b8742800 20 rados->read ofs=0 len=0 2024-09-22T08:32:59.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.675+0000 7f87b8742800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:32:59.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.675+0000 7f87b8742800 20 zone default found 2024-09-22T08:32:59.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.675+0000 7f87b8742800 4 Realm: () 2024-09-22T08:32:59.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.675+0000 7f87b8742800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:32:59.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.675+0000 7f87b8742800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:32:59.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.675+0000 7f87b8742800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:32:59.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.675+0000 7f87b8742800 20 zonegroup default 2024-09-22T08:32:59.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.675+0000 7f87b8742800 20 rados->read ofs=0 len=0 2024-09-22T08:32:59.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.675+0000 7f87b8742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:59.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.675+0000 7f87b8742800 20 rados->read ofs=0 len=0 2024-09-22T08:32:59.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.676+0000 7f87b8742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:59.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.676+0000 7f87b8742800 20 rados->read ofs=0 len=0 2024-09-22T08:32:59.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.676+0000 7f87b8742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:59.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.676+0000 7f87b8742800 20 started sync module instance, tier type = 2024-09-22T08:32:59.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.676+0000 7f87b8742800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:32:59.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.686+0000 7f87b8742800 20 add_watcher() i=0 2024-09-22T08:32:59.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.686+0000 7f87b8742800 20 add_watcher() i=1 2024-09-22T08:32:59.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.686+0000 7f87b8742800 20 add_watcher() i=2 2024-09-22T08:32:59.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.686+0000 7f87b8742800 20 add_watcher() i=3 2024-09-22T08:32:59.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.686+0000 7f87b8742800 20 add_watcher() i=4 2024-09-22T08:32:59.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.686+0000 7f87b8742800 20 add_watcher() i=5 2024-09-22T08:32:59.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.686+0000 7f87b8742800 20 add_watcher() i=6 2024-09-22T08:32:59.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.687+0000 7f87b8742800 20 add_watcher() i=7 2024-09-22T08:32:59.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.687+0000 7f87b8742800 2 all 8 watchers are set, enabling cache 2024-09-22T08:32:59.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.689+0000 7f866afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:32:59.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.689+0000 7f87b8742800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:32:59.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.689+0000 7f87b8742800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:32:59.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.689+0000 7f87b8742800 5 note: GC not initialized 2024-09-22T08:32:59.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.690+0000 7f8669fe3640 20 reqs_thread_entry: start 2024-09-22T08:32:59.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.690+0000 7f87b8742800 20 init_complete bucket index max shards: 11 2024-09-22T08:32:59.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.690+0000 7f87b8742800 20 Filter name: none 2024-09-22T08:32:59.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.690+0000 7f86637fe640 20 reqs_thread_entry: start 2024-09-22T08:32:59.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.690+0000 7f87b8742800 20 processing logshard = reshard.0000000000 2024-09-22T08:32:59.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.692+0000 7f87b8742800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-22T08:32:59.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.692+0000 7f87b8742800 20 processing logshard = reshard.0000000001 2024-09-22T08:32:59.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.695+0000 7f87b8742800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-22T08:32:59.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.695+0000 7f87b8742800 20 processing logshard = reshard.0000000002 2024-09-22T08:32:59.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.697+0000 7f87b8742800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-22T08:32:59.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.697+0000 7f87b8742800 20 processing logshard = reshard.0000000003 2024-09-22T08:32:59.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.700+0000 7f87b8742800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-22T08:32:59.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.700+0000 7f87b8742800 20 processing logshard = reshard.0000000004 2024-09-22T08:32:59.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.702+0000 7f87b8742800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-22T08:32:59.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.702+0000 7f87b8742800 20 processing logshard = reshard.0000000005 2024-09-22T08:32:59.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.704+0000 7f87b8742800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-22T08:32:59.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.704+0000 7f87b8742800 20 processing logshard = reshard.0000000006 2024-09-22T08:32:59.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.706+0000 7f87b8742800 20 process_entry resharding a-bucket 2024-09-22T08:32:59.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.706+0000 7f87b8742800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:32:59.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.706+0000 7f87b8742800 20 rados->read ofs=0 len=0 2024-09-22T08:32:59.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.706+0000 7f87b8742800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:32:59.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.706+0000 7f87b8742800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-22T08:32:59.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.706+0000 7f87b8742800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:32:59.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.706+0000 7f87b8742800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 : miss 2024-09-22T08:32:59.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.706+0000 7f87b8742800 20 rados->read ofs=0 len=0 2024-09-22T08:32:59.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.706+0000 7f87b8742800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T08:32:59.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.706+0000 7f87b8742800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:32:59.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.706+0000 7f87b8742800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:32:59.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.706+0000 7f87b8742800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:32:59.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.706+0000 7f87b8742800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:32:59.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.706+0000 7f87b8742800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 2024-09-22T08:32:59.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.713+0000 7f87b8742800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:32:59.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.713+0000 7f87b8742800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:32:59.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.713+0000 7f87b8742800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:32:59.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.713+0000 7f87b8742800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17, ofs0, ns] 2024-09-22T08:32:59.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.713+0000 7f8692ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496992 cookie 94693987182144 notifier 5783 bl.length()=827 2024-09-22T08:32:59.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.713+0000 7f8692ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:32:59.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.713+0000 7f8692ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:32:59.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.713+0000 7f8692ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:32:59.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.714+0000 7f87b8742800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_sources= new_sources= 2024-09-22T08:32:59.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.714+0000 7f87b8742800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential sources added=[] removed=[] 2024-09-22T08:32:59.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.714+0000 7f87b8742800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_dests= new_dests= 2024-09-22T08:32:59.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.714+0000 7f87b8742800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential dests added=[] removed=[] 2024-09-22T08:32:59.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.719+0000 7f87b8742800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.0 2024-09-22T08:32:59.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.719+0000 7f87b8742800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.0 2024-09-22T08:32:59.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.719+0000 7f87b8742800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.1 2024-09-22T08:32:59.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.719+0000 7f87b8742800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.1 2024-09-22T08:32:59.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.719+0000 7f87b8742800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.2 2024-09-22T08:32:59.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.719+0000 7f87b8742800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.2 2024-09-22T08:32:59.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.719+0000 7f87b8742800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.3 2024-09-22T08:32:59.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.719+0000 7f87b8742800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.3 2024-09-22T08:32:59.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.719+0000 7f87b8742800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.4 2024-09-22T08:32:59.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.719+0000 7f87b8742800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.4 2024-09-22T08:32:59.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.719+0000 7f87b8742800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.5 2024-09-22T08:32:59.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.719+0000 7f87b8742800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.5 2024-09-22T08:32:59.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.719+0000 7f87b8742800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.6 2024-09-22T08:32:59.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.719+0000 7f87b8742800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.6 2024-09-22T08:32:59.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.719+0000 7f87b8742800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.7 2024-09-22T08:32:59.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.719+0000 7f87b8742800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.7 2024-09-22T08:32:59.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.719+0000 7f87b8742800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.8 2024-09-22T08:32:59.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.719+0000 7f87b8742800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.8 2024-09-22T08:32:59.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.719+0000 7f87b8742800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.9 2024-09-22T08:32:59.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.719+0000 7f87b8742800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.9 2024-09-22T08:32:59.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.719+0000 7f87b8742800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.10 2024-09-22T08:32:59.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.719+0000 7f87b8742800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.10 2024-09-22T08:32:59.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.719+0000 7f87b8742800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.11 2024-09-22T08:32:59.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.719+0000 7f87b8742800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.11 2024-09-22T08:32:59.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.719+0000 7f87b8742800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.12 2024-09-22T08:32:59.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.719+0000 7f87b8742800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.12 2024-09-22T08:32:59.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.719+0000 7f87b8742800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.0 2024-09-22T08:32:59.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.719+0000 7f87b8742800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.0 2024-09-22T08:32:59.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.719+0000 7f87b8742800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.1 2024-09-22T08:32:59.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.719+0000 7f87b8742800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.1 2024-09-22T08:32:59.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.720+0000 7f87b8742800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.2 2024-09-22T08:32:59.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.720+0000 7f87b8742800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.2 2024-09-22T08:32:59.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.720+0000 7f87b8742800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.3 2024-09-22T08:32:59.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.720+0000 7f87b8742800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.3 2024-09-22T08:32:59.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.721+0000 7f87b8742800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.4 2024-09-22T08:32:59.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.721+0000 7f87b8742800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.4 2024-09-22T08:32:59.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.721+0000 7f87b8742800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.5 2024-09-22T08:32:59.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.721+0000 7f87b8742800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.5 2024-09-22T08:32:59.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.722+0000 7f87b8742800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.6 2024-09-22T08:32:59.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.722+0000 7f87b8742800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.6 2024-09-22T08:32:59.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.722+0000 7f87b8742800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.7 2024-09-22T08:32:59.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.722+0000 7f87b8742800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.7 2024-09-22T08:32:59.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.723+0000 7f87b8742800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.8 2024-09-22T08:32:59.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.723+0000 7f87b8742800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.8 2024-09-22T08:32:59.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.724+0000 7f87b8742800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.9 2024-09-22T08:32:59.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.724+0000 7f87b8742800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.9 2024-09-22T08:32:59.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.724+0000 7f87b8742800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.10 2024-09-22T08:32:59.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.724+0000 7f87b8742800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.10 2024-09-22T08:32:59.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.725+0000 7f87b8742800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.11 2024-09-22T08:32:59.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.725+0000 7f87b8742800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.11 2024-09-22T08:32:59.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.727+0000 7f87b8742800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 : hit (requested=0x17, cached=0x17) 2024-09-22T08:32:59.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.727+0000 7f87b8742800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 2024-09-22T08:32:59.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.728+0000 7f87b8742800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:32:59.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.728+0000 7f87b8742800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:32:59.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.728+0000 7f87b8742800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:32:59.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.728+0000 7f87b8742800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17, ofs0, ns] 2024-09-22T08:32:59.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.728+0000 7f86937fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496993 cookie 94693987182144 notifier 5783 bl.length()=827 2024-09-22T08:32:59.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.728+0000 7f86937fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:32:59.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.728+0000 7f86937fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:32:59.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.728+0000 7f86937fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:32:59.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.729+0000 7f87b8742800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_sources= new_sources= 2024-09-22T08:32:59.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.729+0000 7f87b8742800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential sources added=[] removed=[] 2024-09-22T08:32:59.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.729+0000 7f87b8742800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_dests= new_dests= 2024-09-22T08:32:59.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.729+0000 7f87b8742800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential dests added=[] removed=[] 2024-09-22T08:32:59.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.731+0000 7f87b8742800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.0 2024-09-22T08:32:59.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.731+0000 7f87b8742800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.0 2024-09-22T08:32:59.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.731+0000 7f87b8742800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.1 2024-09-22T08:32:59.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.731+0000 7f87b8742800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.1 2024-09-22T08:32:59.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.732+0000 7f87b8742800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.2 2024-09-22T08:32:59.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.732+0000 7f87b8742800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.2 2024-09-22T08:32:59.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.732+0000 7f87b8742800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.3 2024-09-22T08:32:59.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.732+0000 7f87b8742800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.3 2024-09-22T08:32:59.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.732+0000 7f87b8742800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.4 2024-09-22T08:32:59.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.732+0000 7f87b8742800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.4 2024-09-22T08:32:59.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.733+0000 7f87b8742800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.5 2024-09-22T08:32:59.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.733+0000 7f87b8742800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.5 2024-09-22T08:32:59.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.733+0000 7f87b8742800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.6 2024-09-22T08:32:59.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.733+0000 7f87b8742800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.6 2024-09-22T08:32:59.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.734+0000 7f87b8742800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.7 2024-09-22T08:32:59.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.734+0000 7f87b8742800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.7 2024-09-22T08:32:59.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.734+0000 7f87b8742800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.8 2024-09-22T08:32:59.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.734+0000 7f87b8742800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.8 2024-09-22T08:32:59.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.734+0000 7f87b8742800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.9 2024-09-22T08:32:59.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.734+0000 7f87b8742800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.9 2024-09-22T08:32:59.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.735+0000 7f87b8742800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.10 2024-09-22T08:32:59.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.735+0000 7f87b8742800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.10 2024-09-22T08:32:59.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.735+0000 7f87b8742800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.11 2024-09-22T08:32:59.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.735+0000 7f87b8742800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.1.11 2024-09-22T08:32:59.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.735+0000 7f87b8742800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 : hit (requested=0x17, cached=0x17) 2024-09-22T08:32:59.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.735+0000 7f87b8742800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 2024-09-22T08:32:59.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.737+0000 7f87b8742800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:32:59.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.737+0000 7f87b8742800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:32:59.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.737+0000 7f87b8742800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:32:59.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.737+0000 7f87b8742800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17, ofs0, ns] 2024-09-22T08:32:59.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.737+0000 7f8692ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496994 cookie 94693987182144 notifier 5783 bl.length()=795 2024-09-22T08:32:59.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.737+0000 7f8692ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:32:59.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.737+0000 7f8692ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:32:59.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.737+0000 7f8692ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:32:59.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.738+0000 7f87b8742800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_sources= new_sources= 2024-09-22T08:32:59.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.738+0000 7f87b8742800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential sources added=[] removed=[] 2024-09-22T08:32:59.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.738+0000 7f87b8742800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_dests= new_dests= 2024-09-22T08:32:59.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.738+0000 7f87b8742800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential dests added=[] removed=[] 2024-09-22T08:32:59.741 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.740+0000 7f87b8742800 1 execute INFO: reshard of bucket "a-bucket" from 12 shards to 13 shards completed successfully 2024-09-22T08:32:59.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.741+0000 7f87b8742800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-22T08:32:59.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.743+0000 7f87b8742800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-22T08:32:59.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.743+0000 7f87b8742800 20 processing logshard = reshard.0000000007 2024-09-22T08:32:59.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.746+0000 7f87b8742800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-22T08:32:59.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.746+0000 7f87b8742800 20 processing logshard = reshard.0000000008 2024-09-22T08:32:59.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.749+0000 7f87b8742800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-22T08:32:59.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.749+0000 7f87b8742800 20 processing logshard = reshard.0000000009 2024-09-22T08:32:59.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.751+0000 7f87b8742800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-22T08:32:59.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.751+0000 7f87b8742800 20 processing logshard = reshard.0000000010 2024-09-22T08:32:59.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.753+0000 7f87b8742800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-22T08:32:59.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.753+0000 7f87b8742800 20 processing logshard = reshard.0000000011 2024-09-22T08:32:59.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.756+0000 7f87b8742800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-22T08:32:59.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.756+0000 7f87b8742800 20 processing logshard = reshard.0000000012 2024-09-22T08:32:59.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.758+0000 7f87b8742800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-22T08:32:59.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.758+0000 7f87b8742800 20 processing logshard = reshard.0000000013 2024-09-22T08:32:59.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.761+0000 7f87b8742800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-22T08:32:59.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.761+0000 7f87b8742800 20 processing logshard = reshard.0000000014 2024-09-22T08:32:59.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.764+0000 7f87b8742800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-22T08:32:59.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.764+0000 7f87b8742800 20 processing logshard = reshard.0000000015 2024-09-22T08:32:59.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.766+0000 7f87b8742800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-22T08:32:59.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.767+0000 7f866afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:32:59.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.769+0000 7f87b8742800 20 remove_watcher() i=0 2024-09-22T08:32:59.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.769+0000 7f87b8742800 2 removed watcher, disabling cache 2024-09-22T08:32:59.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.770+0000 7f87b8742800 20 remove_watcher() i=1 2024-09-22T08:32:59.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.771+0000 7f87b8742800 20 remove_watcher() i=2 2024-09-22T08:32:59.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.772+0000 7f87b8742800 20 remove_watcher() i=3 2024-09-22T08:32:59.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.773+0000 7f87b8742800 20 remove_watcher() i=4 2024-09-22T08:32:59.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.774+0000 7f87b8742800 20 remove_watcher() i=5 2024-09-22T08:32:59.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.775+0000 7f87b8742800 20 remove_watcher() i=6 2024-09-22T08:32:59.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.776+0000 7f87b8742800 20 remove_watcher() i=7 2024-09-22T08:32:59.789 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T08:32:59.819 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:32:59.819 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:32:59.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.857+0000 7f0c75125800 20 rados->read ofs=0 len=0 2024-09-22T08:32:59.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.859+0000 7f0c75125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:59.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.859+0000 7f0c75125800 20 realm 2024-09-22T08:32:59.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.859+0000 7f0c75125800 20 rados->read ofs=0 len=0 2024-09-22T08:32:59.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.859+0000 7f0c75125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:59.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.859+0000 7f0c75125800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:32:59.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.859+0000 7f0c75125800 20 rados->read ofs=0 len=0 2024-09-22T08:32:59.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.859+0000 7f0c75125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:32:59.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.859+0000 7f0c75125800 20 rados->read ofs=0 len=0 2024-09-22T08:32:59.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.860+0000 7f0c75125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:32:59.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.860+0000 7f0c75125800 20 rados->read ofs=0 len=0 2024-09-22T08:32:59.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.861+0000 7f0c75125800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:32:59.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.861+0000 7f0c75125800 20 searching for the correct realm 2024-09-22T08:32:59.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:32:59.863+0000 7f0c70532640 0 -- 172.21.15.38:0/1547033951 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f0c64034060 msgr2=0x7f0c64067bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:33:00.068 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.067+0000 7f0c70532640 0 -- 172.21.15.38:0/1547033951 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f0c6000b440 msgr2=0x7f0c60061810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:00.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.274+0000 7f0c75125800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:33:00.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.274+0000 7f0c75125800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:33:00.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.274+0000 7f0c75125800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:33:00.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.274+0000 7f0c75125800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:33:00.276 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.274+0000 7f0c75125800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:33:00.276 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.274+0000 7f0c75125800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:33:00.276 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.274+0000 7f0c75125800 20 rados->read ofs=0 len=0 2024-09-22T08:33:00.276 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.274+0000 7f0c75125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:00.276 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.274+0000 7f0c75125800 20 rados->read ofs=0 len=0 2024-09-22T08:33:00.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.275+0000 7f0c75125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:00.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.275+0000 7f0c75125800 20 rados->read ofs=0 len=0 2024-09-22T08:33:00.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.275+0000 7f0c75125800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:33:00.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.275+0000 7f0c75125800 20 zone default found 2024-09-22T08:33:00.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.275+0000 7f0c75125800 4 Realm: () 2024-09-22T08:33:00.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.275+0000 7f0c75125800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:33:00.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.275+0000 7f0c75125800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:33:00.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.275+0000 7f0c75125800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:33:00.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.275+0000 7f0c75125800 20 zonegroup default 2024-09-22T08:33:00.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.275+0000 7f0c75125800 20 rados->read ofs=0 len=0 2024-09-22T08:33:00.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.275+0000 7f0c75125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:00.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.275+0000 7f0c75125800 20 rados->read ofs=0 len=0 2024-09-22T08:33:00.278 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.276+0000 7f0c75125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:00.278 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.276+0000 7f0c75125800 20 rados->read ofs=0 len=0 2024-09-22T08:33:00.278 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.276+0000 7f0c75125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:00.278 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.276+0000 7f0c75125800 20 started sync module instance, tier type = 2024-09-22T08:33:00.278 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.276+0000 7f0c75125800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:33:00.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.287+0000 7f0c75125800 20 add_watcher() i=0 2024-09-22T08:33:00.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.287+0000 7f0c75125800 20 add_watcher() i=1 2024-09-22T08:33:00.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.287+0000 7f0c75125800 20 add_watcher() i=2 2024-09-22T08:33:00.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.287+0000 7f0c75125800 20 add_watcher() i=3 2024-09-22T08:33:00.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.287+0000 7f0c75125800 20 add_watcher() i=4 2024-09-22T08:33:00.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.287+0000 7f0c75125800 20 add_watcher() i=5 2024-09-22T08:33:00.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.287+0000 7f0c75125800 20 add_watcher() i=6 2024-09-22T08:33:00.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.288+0000 7f0c75125800 20 add_watcher() i=7 2024-09-22T08:33:00.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.288+0000 7f0c75125800 2 all 8 watchers are set, enabling cache 2024-09-22T08:33:00.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.290+0000 7f0b277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:00.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.291+0000 7f0c75125800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:33:00.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.291+0000 7f0c75125800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:33:00.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.291+0000 7f0c75125800 5 note: GC not initialized 2024-09-22T08:33:00.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.291+0000 7f0b267e4640 20 reqs_thread_entry: start 2024-09-22T08:33:00.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.291+0000 7f0c75125800 20 init_complete bucket index max shards: 11 2024-09-22T08:33:00.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.291+0000 7f0c75125800 20 Filter name: none 2024-09-22T08:33:00.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.292+0000 7f0b1f7fe640 20 reqs_thread_entry: start 2024-09-22T08:33:00.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.292+0000 7f0c75125800 20 rados->read ofs=0 len=0 2024-09-22T08:33:00.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.292+0000 7f0c75125800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:33:00.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.292+0000 7f0c75125800 20 rados->read ofs=0 len=0 2024-09-22T08:33:00.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.293+0000 7f0c75125800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T08:33:00.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.293+0000 7f0c75125800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:33:00.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.293+0000 7f0c75125800 20 rados->read ofs=0 len=0 2024-09-22T08:33:00.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.293+0000 7f0c75125800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:33:00.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.293+0000 7f0c75125800 20 rados->read ofs=0 len=0 2024-09-22T08:33:00.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.293+0000 7f0c75125800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T08:33:00.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.293+0000 7f0c75125800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:33:00.296 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.295+0000 7f0b277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:00.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.298+0000 7f0c75125800 20 remove_watcher() i=0 2024-09-22T08:33:00.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.298+0000 7f0c75125800 2 removed watcher, disabling cache 2024-09-22T08:33:00.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.299+0000 7f0c75125800 20 remove_watcher() i=1 2024-09-22T08:33:00.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.300+0000 7f0c75125800 20 remove_watcher() i=2 2024-09-22T08:33:00.302 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.301+0000 7f0c75125800 20 remove_watcher() i=3 2024-09-22T08:33:00.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.302+0000 7f0c75125800 20 remove_watcher() i=4 2024-09-22T08:33:00.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.303+0000 7f0c75125800 20 remove_watcher() i=5 2024-09-22T08:33:00.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.304+0000 7f0c75125800 20 remove_watcher() i=6 2024-09-22T08:33:00.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.305+0000 7f0c75125800 20 remove_watcher() i=7 2024-09-22T08:33:00.319 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:00.319 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:33:00.319 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: a-bucket id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-22T08:33:00.319 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:00.319 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-22T08:33:00.319 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:00.321 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:00.321 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:00.335 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:00.335 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:00.377 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:00.378 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:00.386 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:00.386 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:00.392 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:00.392 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:00.399 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:00.399 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:00.405 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:00.405 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:00.411 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:00.412 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:00.418 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:00.418 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:00.424 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:00.424 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:00.431 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:00.431 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:00.437 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:00.437 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:00.443 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:00.443 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:00.450 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:00.450 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:00.456 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:00.456 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:00.462 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:00.462 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:00.468 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:00.468 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:00.474 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:00.475 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:00.481 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:00.481 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:00.487 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:00.487 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:00.492 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:00.492 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:00.499 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:00.499 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:00.505 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-22T08:33:00.534 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:33:00.534 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:33:00.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.572+0000 7fbc2cb25800 20 rados->read ofs=0 len=0 2024-09-22T08:33:00.576 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.574+0000 7fbc2cb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:00.576 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.574+0000 7fbc2cb25800 20 realm 2024-09-22T08:33:00.576 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.574+0000 7fbc2cb25800 20 rados->read ofs=0 len=0 2024-09-22T08:33:00.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.574+0000 7fbc2cb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:00.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.574+0000 7fbc2cb25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:33:00.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.574+0000 7fbc2cb25800 20 rados->read ofs=0 len=0 2024-09-22T08:33:00.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.575+0000 7fbc2cb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:00.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.575+0000 7fbc2cb25800 20 rados->read ofs=0 len=0 2024-09-22T08:33:00.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.575+0000 7fbc2cb25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:00.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.575+0000 7fbc2cb25800 20 rados->read ofs=0 len=0 2024-09-22T08:33:00.578 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.576+0000 7fbc2cb25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:33:00.578 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.576+0000 7fbc2cb25800 20 searching for the correct realm 2024-09-22T08:33:00.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.578+0000 7fbc280a1640 0 -- 172.21.15.38:0/331246941 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7fbc1c068700 msgr2=0x7fbc1c06a950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:00.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.784+0000 7fbc280a1640 0 -- 172.21.15.38:0/331246941 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fbc18056910 msgr2=0x7fbc180483f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:00.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.991+0000 7fbc2cb25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:33:00.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.991+0000 7fbc2cb25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:33:00.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.991+0000 7fbc2cb25800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:33:00.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.991+0000 7fbc2cb25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:33:00.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.991+0000 7fbc2cb25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:33:00.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.991+0000 7fbc2cb25800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:33:00.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.991+0000 7fbc2cb25800 20 rados->read ofs=0 len=0 2024-09-22T08:33:00.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.991+0000 7fbc2cb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:00.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.991+0000 7fbc2cb25800 20 rados->read ofs=0 len=0 2024-09-22T08:33:00.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.992+0000 7fbc2cb25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:00.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.992+0000 7fbc2cb25800 20 rados->read ofs=0 len=0 2024-09-22T08:33:00.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.992+0000 7fbc2cb25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:33:00.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.992+0000 7fbc2cb25800 20 zone default found 2024-09-22T08:33:00.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.992+0000 7fbc2cb25800 4 Realm: () 2024-09-22T08:33:00.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.992+0000 7fbc2cb25800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:33:00.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.992+0000 7fbc2cb25800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:33:00.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.992+0000 7fbc2cb25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:33:00.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.992+0000 7fbc2cb25800 20 zonegroup default 2024-09-22T08:33:00.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.992+0000 7fbc2cb25800 20 rados->read ofs=0 len=0 2024-09-22T08:33:00.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.992+0000 7fbc2cb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:00.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.992+0000 7fbc2cb25800 20 rados->read ofs=0 len=0 2024-09-22T08:33:00.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.993+0000 7fbc2cb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:00.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.993+0000 7fbc2cb25800 20 rados->read ofs=0 len=0 2024-09-22T08:33:00.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.993+0000 7fbc2cb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:00.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.993+0000 7fbc2cb25800 20 started sync module instance, tier type = 2024-09-22T08:33:00.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:00.993+0000 7fbc2cb25800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:33:01.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.003+0000 7fbc2cb25800 20 add_watcher() i=0 2024-09-22T08:33:01.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.003+0000 7fbc2cb25800 20 add_watcher() i=1 2024-09-22T08:33:01.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.003+0000 7fbc2cb25800 20 add_watcher() i=2 2024-09-22T08:33:01.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.003+0000 7fbc2cb25800 20 add_watcher() i=3 2024-09-22T08:33:01.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.003+0000 7fbc2cb25800 20 add_watcher() i=4 2024-09-22T08:33:01.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.003+0000 7fbc2cb25800 20 add_watcher() i=5 2024-09-22T08:33:01.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.003+0000 7fbc2cb25800 20 add_watcher() i=6 2024-09-22T08:33:01.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.004+0000 7fbc2cb25800 20 add_watcher() i=7 2024-09-22T08:33:01.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.004+0000 7fbc2cb25800 2 all 8 watchers are set, enabling cache 2024-09-22T08:33:01.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.006+0000 7fbadefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:01.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.006+0000 7fbc2cb25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:33:01.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.006+0000 7fbc2cb25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:33:01.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.006+0000 7fbc2cb25800 5 note: GC not initialized 2024-09-22T08:33:01.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.007+0000 7fbaddfe3640 20 reqs_thread_entry: start 2024-09-22T08:33:01.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.007+0000 7fbc2cb25800 20 init_complete bucket index max shards: 11 2024-09-22T08:33:01.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.007+0000 7fbc2cb25800 20 Filter name: none 2024-09-22T08:33:01.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.007+0000 7fba4f7fe640 20 reqs_thread_entry: start 2024-09-22T08:33:01.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.007+0000 7fbc2cb25800 20 rados->read ofs=0 len=0 2024-09-22T08:33:01.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.008+0000 7fbc2cb25800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T08:33:01.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.008+0000 7fbc2cb25800 20 rados->read ofs=0 len=0 2024-09-22T08:33:01.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.008+0000 7fbc2cb25800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T08:33:01.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.008+0000 7fbc2cb25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:33:01.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.008+0000 7fbc2cb25800 20 rados->read ofs=0 len=0 2024-09-22T08:33:01.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.009+0000 7fbc2cb25800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T08:33:01.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.009+0000 7fbc2cb25800 20 rados->read ofs=0 len=0 2024-09-22T08:33:01.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.009+0000 7fbc2cb25800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T08:33:01.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.009+0000 7fbc2cb25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:33:01.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.011+0000 7fbadefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:01.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.013+0000 7fbc2cb25800 20 remove_watcher() i=0 2024-09-22T08:33:01.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.013+0000 7fbc2cb25800 2 removed watcher, disabling cache 2024-09-22T08:33:01.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.014+0000 7fbc2cb25800 20 remove_watcher() i=1 2024-09-22T08:33:01.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.015+0000 7fbc2cb25800 20 remove_watcher() i=2 2024-09-22T08:33:01.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.017+0000 7fbc2cb25800 20 remove_watcher() i=3 2024-09-22T08:33:01.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.018+0000 7fbc2cb25800 20 remove_watcher() i=4 2024-09-22T08:33:01.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.019+0000 7fbc2cb25800 20 remove_watcher() i=5 2024-09-22T08:33:01.022 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.020+0000 7fbc2cb25800 20 remove_watcher() i=6 2024-09-22T08:33:01.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.021+0000 7fbc2cb25800 20 remove_watcher() i=7 2024-09-22T08:33:01.035 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:01.035 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:33:01.036 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-init-index id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:33:01.036 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:01.036 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-22T08:33:01.072 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:33:01.073 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:33:01.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.110+0000 7fb9a0c0e800 20 rados->read ofs=0 len=0 2024-09-22T08:33:01.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.112+0000 7fb9a0c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:01.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.112+0000 7fb9a0c0e800 20 realm 2024-09-22T08:33:01.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.112+0000 7fb9a0c0e800 20 rados->read ofs=0 len=0 2024-09-22T08:33:01.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.113+0000 7fb9a0c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:01.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.113+0000 7fb9a0c0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:33:01.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.113+0000 7fb9a0c0e800 20 rados->read ofs=0 len=0 2024-09-22T08:33:01.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.113+0000 7fb9a0c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:01.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.113+0000 7fb9a0c0e800 20 rados->read ofs=0 len=0 2024-09-22T08:33:01.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.114+0000 7fb9a0c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:01.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.114+0000 7fb9a0c0e800 20 rados->read ofs=0 len=0 2024-09-22T08:33:01.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.114+0000 7fb9a0c0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:33:01.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.114+0000 7fb9a0c0e800 20 searching for the correct realm 2024-09-22T08:33:01.118 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.116+0000 7fb99ba58640 0 -- 172.21.15.38:0/1760315724 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7fb990013030 msgr2=0x7fb990053940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:01.121 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.120+0000 7fb99ba58640 0 -- 172.21.15.38:0/1760315724 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fb98c04d9a0 msgr2=0x7fb98c0ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:33:01.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.327+0000 7fb9a0c0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:33:01.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.327+0000 7fb9a0c0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:33:01.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.327+0000 7fb9a0c0e800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:33:01.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.327+0000 7fb9a0c0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:33:01.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.327+0000 7fb9a0c0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:33:01.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.327+0000 7fb9a0c0e800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:33:01.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.327+0000 7fb9a0c0e800 20 rados->read ofs=0 len=0 2024-09-22T08:33:01.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.327+0000 7fb9a0c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:01.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.327+0000 7fb9a0c0e800 20 rados->read ofs=0 len=0 2024-09-22T08:33:01.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.327+0000 7fb9a0c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:01.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.327+0000 7fb9a0c0e800 20 rados->read ofs=0 len=0 2024-09-22T08:33:01.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.328+0000 7fb9a0c0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:33:01.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.328+0000 7fb9a0c0e800 20 zone default found 2024-09-22T08:33:01.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.328+0000 7fb9a0c0e800 4 Realm: () 2024-09-22T08:33:01.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.328+0000 7fb9a0c0e800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:33:01.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.328+0000 7fb9a0c0e800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:33:01.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.328+0000 7fb9a0c0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:33:01.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.328+0000 7fb9a0c0e800 20 zonegroup default 2024-09-22T08:33:01.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.328+0000 7fb9a0c0e800 20 rados->read ofs=0 len=0 2024-09-22T08:33:01.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.329+0000 7fb9a0c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:01.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.329+0000 7fb9a0c0e800 20 rados->read ofs=0 len=0 2024-09-22T08:33:01.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.329+0000 7fb9a0c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:01.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.329+0000 7fb9a0c0e800 20 rados->read ofs=0 len=0 2024-09-22T08:33:01.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.329+0000 7fb9a0c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:01.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.329+0000 7fb9a0c0e800 20 started sync module instance, tier type = 2024-09-22T08:33:01.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.329+0000 7fb9a0c0e800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:33:01.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.339+0000 7fb9a0c0e800 20 add_watcher() i=0 2024-09-22T08:33:01.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.339+0000 7fb9a0c0e800 20 add_watcher() i=1 2024-09-22T08:33:01.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.339+0000 7fb9a0c0e800 20 add_watcher() i=2 2024-09-22T08:33:01.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.339+0000 7fb9a0c0e800 20 add_watcher() i=3 2024-09-22T08:33:01.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.339+0000 7fb9a0c0e800 20 add_watcher() i=4 2024-09-22T08:33:01.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.339+0000 7fb9a0c0e800 20 add_watcher() i=5 2024-09-22T08:33:01.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.339+0000 7fb9a0c0e800 20 add_watcher() i=6 2024-09-22T08:33:01.342 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.340+0000 7fb9a0c0e800 20 add_watcher() i=7 2024-09-22T08:33:01.342 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.340+0000 7fb9a0c0e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:33:01.343 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.342+0000 7fb8527e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:01.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.342+0000 7fb9a0c0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:33:01.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.342+0000 7fb9a0c0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:33:01.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.342+0000 7fb9a0c0e800 5 note: GC not initialized 2024-09-22T08:33:01.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.342+0000 7fb8517e2640 20 reqs_thread_entry: start 2024-09-22T08:33:01.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.342+0000 7fb9a0c0e800 20 init_complete bucket index max shards: 11 2024-09-22T08:33:01.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.342+0000 7fb9a0c0e800 20 Filter name: none 2024-09-22T08:33:01.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.342+0000 7fb7c2ffd640 20 reqs_thread_entry: start 2024-09-22T08:33:01.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.343+0000 7fb9a0c0e800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-22T08:33:01.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.343+0000 7fb9a0c0e800 20 rados->read ofs=0 len=0 2024-09-22T08:33:01.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.343+0000 7fb9a0c0e800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T08:33:01.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.343+0000 7fb9a0c0e800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-22T08:33:01.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.343+0000 7fb9a0c0e800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-22T08:33:01.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.343+0000 7fb9a0c0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.19 : miss 2024-09-22T08:33:01.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.343+0000 7fb9a0c0e800 20 rados->read ofs=0 len=0 2024-09-22T08:33:01.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.343+0000 7fb9a0c0e800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T08:33:01.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.343+0000 7fb9a0c0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.19 info.flags=0x17 2024-09-22T08:33:01.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.343+0000 7fb9a0c0e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.19 to cache LRU end 2024-09-22T08:33:01.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.343+0000 7fb9a0c0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:33:01.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.343+0000 7fb9a0c0e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:01.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.343+0000 7fb9a0c0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.19 2024-09-22T08:33:01.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.345+0000 7fb9a0c0e800 -1 Injecting error=-5 at location=init_index 2024-09-22T08:33:01.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.345+0000 7fb9a0c0e800 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-22T08:33:01.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.347+0000 7fb8527e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:01.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.349+0000 7fb9a0c0e800 20 remove_watcher() i=0 2024-09-22T08:33:01.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.349+0000 7fb9a0c0e800 2 removed watcher, disabling cache 2024-09-22T08:33:01.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.350+0000 7fb9a0c0e800 20 remove_watcher() i=1 2024-09-22T08:33:01.353 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.351+0000 7fb9a0c0e800 20 remove_watcher() i=2 2024-09-22T08:33:01.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.352+0000 7fb9a0c0e800 20 remove_watcher() i=3 2024-09-22T08:33:01.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.353+0000 7fb9a0c0e800 20 remove_watcher() i=4 2024-09-22T08:33:01.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.354+0000 7fb9a0c0e800 20 remove_watcher() i=5 2024-09-22T08:33:01.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.356+0000 7fb9a0c0e800 20 remove_watcher() i=6 2024-09-22T08:33:01.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.357+0000 7fb9a0c0e800 20 remove_watcher() i=7 2024-09-22T08:33:01.372 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-22T08:33:01.402 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:33:01.402 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:33:01.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.439+0000 7f911d72a800 20 rados->read ofs=0 len=0 2024-09-22T08:33:01.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.441+0000 7f911d72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:01.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.441+0000 7f911d72a800 20 realm 2024-09-22T08:33:01.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.441+0000 7f911d72a800 20 rados->read ofs=0 len=0 2024-09-22T08:33:01.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.442+0000 7f911d72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:01.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.442+0000 7f911d72a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:33:01.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.442+0000 7f911d72a800 20 rados->read ofs=0 len=0 2024-09-22T08:33:01.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.442+0000 7f911d72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:01.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.442+0000 7f911d72a800 20 rados->read ofs=0 len=0 2024-09-22T08:33:01.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.443+0000 7f911d72a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:01.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.443+0000 7f911d72a800 20 rados->read ofs=0 len=0 2024-09-22T08:33:01.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.443+0000 7f911d72a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:33:01.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.443+0000 7f911d72a800 20 searching for the correct realm 2024-09-22T08:33:01.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.445+0000 7f9118cac640 0 -- 172.21.15.38:0/518643632 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f91100b4ba0 msgr2=0x7f91100abb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:01.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.651+0000 7f9118cac640 0 -- 172.21.15.38:0/518643632 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f910c06c8d0 msgr2=0x7f910c07d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:33:01.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.857+0000 7f911d72a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:33:01.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.857+0000 7f911d72a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:33:01.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.857+0000 7f911d72a800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:33:01.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.857+0000 7f911d72a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:33:01.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.857+0000 7f911d72a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:33:01.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.857+0000 7f911d72a800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:33:01.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.857+0000 7f911d72a800 20 rados->read ofs=0 len=0 2024-09-22T08:33:01.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.858+0000 7f911d72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:01.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.858+0000 7f911d72a800 20 rados->read ofs=0 len=0 2024-09-22T08:33:01.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.858+0000 7f911d72a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:01.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.858+0000 7f911d72a800 20 rados->read ofs=0 len=0 2024-09-22T08:33:01.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.859+0000 7f911d72a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:33:01.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.859+0000 7f911d72a800 20 zone default found 2024-09-22T08:33:01.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.859+0000 7f911d72a800 4 Realm: () 2024-09-22T08:33:01.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.859+0000 7f911d72a800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:33:01.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.859+0000 7f911d72a800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:33:01.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.859+0000 7f911d72a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:33:01.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.859+0000 7f911d72a800 20 zonegroup default 2024-09-22T08:33:01.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.859+0000 7f911d72a800 20 rados->read ofs=0 len=0 2024-09-22T08:33:01.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.859+0000 7f911d72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:01.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.859+0000 7f911d72a800 20 rados->read ofs=0 len=0 2024-09-22T08:33:01.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.859+0000 7f911d72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:01.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.859+0000 7f911d72a800 20 rados->read ofs=0 len=0 2024-09-22T08:33:01.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.860+0000 7f911d72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:01.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.860+0000 7f911d72a800 20 started sync module instance, tier type = 2024-09-22T08:33:01.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.860+0000 7f911d72a800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:33:01.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.869+0000 7f911d72a800 20 add_watcher() i=0 2024-09-22T08:33:01.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.869+0000 7f911d72a800 20 add_watcher() i=1 2024-09-22T08:33:01.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.869+0000 7f911d72a800 20 add_watcher() i=2 2024-09-22T08:33:01.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.869+0000 7f911d72a800 20 add_watcher() i=3 2024-09-22T08:33:01.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.869+0000 7f911d72a800 20 add_watcher() i=4 2024-09-22T08:33:01.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.869+0000 7f911d72a800 20 add_watcher() i=5 2024-09-22T08:33:01.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.869+0000 7f911d72a800 20 add_watcher() i=6 2024-09-22T08:33:01.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.871+0000 7f911d72a800 20 add_watcher() i=7 2024-09-22T08:33:01.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.871+0000 7f911d72a800 2 all 8 watchers are set, enabling cache 2024-09-22T08:33:01.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.873+0000 7f8fcf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:01.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.873+0000 7f911d72a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:33:01.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.873+0000 7f911d72a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:33:01.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.873+0000 7f911d72a800 5 note: GC not initialized 2024-09-22T08:33:01.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.873+0000 7f8fce7e4640 20 reqs_thread_entry: start 2024-09-22T08:33:01.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.873+0000 7f911d72a800 20 init_complete bucket index max shards: 11 2024-09-22T08:33:01.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.874+0000 7f911d72a800 20 Filter name: none 2024-09-22T08:33:01.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.874+0000 7f8f3ffff640 20 reqs_thread_entry: start 2024-09-22T08:33:01.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.874+0000 7f911d72a800 20 rados->read ofs=0 len=0 2024-09-22T08:33:01.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.874+0000 7f911d72a800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T08:33:01.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.874+0000 7f911d72a800 20 rados->read ofs=0 len=0 2024-09-22T08:33:01.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.874+0000 7f911d72a800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T08:33:01.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.875+0000 7f911d72a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:33:01.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.875+0000 7f911d72a800 20 rados->read ofs=0 len=0 2024-09-22T08:33:01.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.875+0000 7f911d72a800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T08:33:01.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.875+0000 7f911d72a800 20 rados->read ofs=0 len=0 2024-09-22T08:33:01.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.875+0000 7f911d72a800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T08:33:01.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.875+0000 7f911d72a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:33:01.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.877+0000 7f8fcf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:01.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.879+0000 7f911d72a800 20 remove_watcher() i=0 2024-09-22T08:33:01.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.879+0000 7f911d72a800 2 removed watcher, disabling cache 2024-09-22T08:33:01.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.880+0000 7f911d72a800 20 remove_watcher() i=1 2024-09-22T08:33:01.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.881+0000 7f911d72a800 20 remove_watcher() i=2 2024-09-22T08:33:01.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.883+0000 7f911d72a800 20 remove_watcher() i=3 2024-09-22T08:33:01.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.884+0000 7f911d72a800 20 remove_watcher() i=4 2024-09-22T08:33:01.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.885+0000 7f911d72a800 20 remove_watcher() i=5 2024-09-22T08:33:01.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.886+0000 7f911d72a800 20 remove_watcher() i=6 2024-09-22T08:33:01.889 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:01.888+0000 7f911d72a800 20 remove_watcher() i=7 2024-09-22T08:33:01.902 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:01.902 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:33:01.902 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-init-index id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:33:01.902 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:01.904 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:01.904 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:01.911 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:01.911 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:01.953 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:33:01.987 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:33:01.987 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:33:02.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.026+0000 7fcb41f42800 20 rados->read ofs=0 len=0 2024-09-22T08:33:02.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.230+0000 7fcb41f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:02.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.230+0000 7fcb41f42800 20 realm 2024-09-22T08:33:02.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.230+0000 7fcb41f42800 20 rados->read ofs=0 len=0 2024-09-22T08:33:02.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.231+0000 7fcb41f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:02.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.231+0000 7fcb41f42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:33:02.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.231+0000 7fcb41f42800 20 rados->read ofs=0 len=0 2024-09-22T08:33:02.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.231+0000 7fcb41f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:02.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.231+0000 7fcb41f42800 20 rados->read ofs=0 len=0 2024-09-22T08:33:02.234 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.231+0000 7fcb37fff640 0 -- 172.21.15.38:0/1517145003 >> [v2:172.21.15.38:6808/1856522357,v1:172.21.15.38:6809/1856522357] conn(0x55568816d2e0 msgr2=0x55568816f710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:33:02.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.434+0000 7fcb41f42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:02.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.434+0000 7fcb41f42800 20 rados->read ofs=0 len=0 2024-09-22T08:33:02.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.435+0000 7fcb41f42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:33:02.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.435+0000 7fcb41f42800 20 searching for the correct realm 2024-09-22T08:33:02.439 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.438+0000 7fcb37fff640 0 -- 172.21.15.38:0/1517145003 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7fcb28047040 msgr2=0x7fcb28047930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:33:02.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.449+0000 7fcb41f42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:33:02.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.449+0000 7fcb41f42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:33:02.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.449+0000 7fcb41f42800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:33:02.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.449+0000 7fcb41f42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:33:02.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.449+0000 7fcb41f42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:33:02.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.449+0000 7fcb41f42800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:33:02.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.449+0000 7fcb41f42800 20 rados->read ofs=0 len=0 2024-09-22T08:33:02.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.449+0000 7fcb41f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:02.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.449+0000 7fcb41f42800 20 rados->read ofs=0 len=0 2024-09-22T08:33:02.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.450+0000 7fcb41f42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:02.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.450+0000 7fcb41f42800 20 rados->read ofs=0 len=0 2024-09-22T08:33:02.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.450+0000 7fcb41f42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:33:02.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.450+0000 7fcb41f42800 20 zone default found 2024-09-22T08:33:02.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.450+0000 7fcb41f42800 4 Realm: () 2024-09-22T08:33:02.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.450+0000 7fcb41f42800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:33:02.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.450+0000 7fcb41f42800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:33:02.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.450+0000 7fcb41f42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:33:02.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.450+0000 7fcb41f42800 20 zonegroup default 2024-09-22T08:33:02.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.450+0000 7fcb41f42800 20 rados->read ofs=0 len=0 2024-09-22T08:33:02.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.450+0000 7fcb41f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:02.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.450+0000 7fcb41f42800 20 rados->read ofs=0 len=0 2024-09-22T08:33:02.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.451+0000 7fcb41f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:02.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.451+0000 7fcb41f42800 20 rados->read ofs=0 len=0 2024-09-22T08:33:02.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.451+0000 7fcb41f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:02.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.451+0000 7fcb41f42800 20 started sync module instance, tier type = 2024-09-22T08:33:02.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.451+0000 7fcb41f42800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:33:02.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.462+0000 7fcb41f42800 20 add_watcher() i=0 2024-09-22T08:33:02.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.462+0000 7fcb41f42800 20 add_watcher() i=1 2024-09-22T08:33:02.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.462+0000 7fcb41f42800 20 add_watcher() i=2 2024-09-22T08:33:02.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.462+0000 7fcb41f42800 20 add_watcher() i=3 2024-09-22T08:33:02.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.462+0000 7fcb41f42800 20 add_watcher() i=4 2024-09-22T08:33:02.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.462+0000 7fcb41f42800 20 add_watcher() i=5 2024-09-22T08:33:02.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.462+0000 7fcb41f42800 20 add_watcher() i=6 2024-09-22T08:33:02.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.463+0000 7fcb41f42800 20 add_watcher() i=7 2024-09-22T08:33:02.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.463+0000 7fcb41f42800 2 all 8 watchers are set, enabling cache 2024-09-22T08:33:02.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.466+0000 7fc9ef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:02.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.466+0000 7fcb41f42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:33:02.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.466+0000 7fcb41f42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:33:02.469 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.466+0000 7fcb41f42800 5 note: GC not initialized 2024-09-22T08:33:02.469 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.466+0000 7fc9ee7fc640 20 reqs_thread_entry: start 2024-09-22T08:33:02.469 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.467+0000 7fcb41f42800 20 init_complete bucket index max shards: 11 2024-09-22T08:33:02.469 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.467+0000 7fcb41f42800 20 Filter name: none 2024-09-22T08:33:02.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.467+0000 7fc95ffff640 20 reqs_thread_entry: start 2024-09-22T08:33:02.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.467+0000 7fcb41f42800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-22T08:33:02.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.467+0000 7fcb41f42800 20 rados->read ofs=0 len=0 2024-09-22T08:33:02.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.467+0000 7fcb41f42800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T08:33:02.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.467+0000 7fcb41f42800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-22T08:33:02.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.467+0000 7fcb41f42800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-22T08:33:02.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.467+0000 7fcb41f42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.19 : miss 2024-09-22T08:33:02.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.467+0000 7fcb41f42800 20 rados->read ofs=0 len=0 2024-09-22T08:33:02.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.468+0000 7fcb41f42800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T08:33:02.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.468+0000 7fcb41f42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.19 info.flags=0x17 2024-09-22T08:33:02.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.468+0000 7fcb41f42800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.19 to cache LRU end 2024-09-22T08:33:02.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.468+0000 7fcb41f42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:33:02.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.468+0000 7fcb41f42800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:02.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.468+0000 7fcb41f42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.19 2024-09-22T08:33:02.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.474+0000 7fcb41f42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.19 info.flags=0x17 2024-09-22T08:33:02.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.474+0000 7fcb41f42800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.19 to cache LRU end 2024-09-22T08:33:02.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.474+0000 7fcb41f42800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:02.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.474+0000 7fcb41f42800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.19, ofs0, ns] 2024-09-22T08:33:02.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.474+0000 7fca217fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497086 cookie 93830138810768 notifier 6153 bl.length()=911 2024-09-22T08:33:02.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.474+0000 7fca217fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.19 info.flags=0x17 2024-09-22T08:33:02.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.474+0000 7fca217fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.19 to cache LRU end 2024-09-22T08:33:02.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.474+0000 7fca217fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:02.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.475+0000 7fcb41f42800 20 handle_bi_update(): bucket=:error-at-init-index[c62f9d7b-f6b6-404a-90de-de5607499115.4584.19]): orig_sources= new_sources= 2024-09-22T08:33:02.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.475+0000 7fcb41f42800 20 handle_bi_update(): bucket=:error-at-init-index[c62f9d7b-f6b6-404a-90de-de5607499115.4584.19]): potential sources added=[] removed=[] 2024-09-22T08:33:02.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.475+0000 7fcb41f42800 20 handle_bi_update(): bucket=:error-at-init-index[c62f9d7b-f6b6-404a-90de-de5607499115.4584.19]): orig_dests= new_dests= 2024-09-22T08:33:02.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.475+0000 7fcb41f42800 20 handle_bi_update(): bucket=:error-at-init-index[c62f9d7b-f6b6-404a-90de-de5607499115.4584.19]): potential dests added=[] removed=[] 2024-09-22T08:33:02.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.480+0000 7fcb41f42800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.1.0 2024-09-22T08:33:02.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.480+0000 7fcb41f42800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.1.0 2024-09-22T08:33:02.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.480+0000 7fcb41f42800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.1.1 2024-09-22T08:33:02.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.480+0000 7fcb41f42800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.1.1 2024-09-22T08:33:02.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.480+0000 7fcb41f42800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.1.2 2024-09-22T08:33:02.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.480+0000 7fcb41f42800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.1.2 2024-09-22T08:33:02.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.480+0000 7fcb41f42800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.1.3 2024-09-22T08:33:02.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.480+0000 7fcb41f42800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.1.3 2024-09-22T08:33:02.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.480+0000 7fcb41f42800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.1.4 2024-09-22T08:33:02.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.480+0000 7fcb41f42800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.1.4 2024-09-22T08:33:02.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.480+0000 7fcb41f42800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.1.5 2024-09-22T08:33:02.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.480+0000 7fcb41f42800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.1.5 2024-09-22T08:33:02.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.480+0000 7fcb41f42800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.1.6 2024-09-22T08:33:02.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.480+0000 7fcb41f42800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.1.6 2024-09-22T08:33:02.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.480+0000 7fcb41f42800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.1.7 2024-09-22T08:33:02.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.480+0000 7fcb41f42800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.1.7 2024-09-22T08:33:02.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.480+0000 7fcb41f42800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.1.8 2024-09-22T08:33:02.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.480+0000 7fcb41f42800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.1.8 2024-09-22T08:33:02.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.480+0000 7fcb41f42800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.1.9 2024-09-22T08:33:02.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.480+0000 7fcb41f42800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.1.9 2024-09-22T08:33:02.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.480+0000 7fcb41f42800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.1.10 2024-09-22T08:33:02.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.480+0000 7fcb41f42800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.1.10 2024-09-22T08:33:02.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.480+0000 7fcb41f42800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.1.11 2024-09-22T08:33:02.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.480+0000 7fcb41f42800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.1.11 2024-09-22T08:33:02.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.480+0000 7fcb41f42800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.0 2024-09-22T08:33:02.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.481+0000 7fcb41f42800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.1 2024-09-22T08:33:02.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.481+0000 7fcb41f42800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.2 2024-09-22T08:33:02.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.482+0000 7fcb41f42800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.3 2024-09-22T08:33:02.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.482+0000 7fcb41f42800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.4 2024-09-22T08:33:02.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.483+0000 7fcb41f42800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.5 2024-09-22T08:33:02.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.484+0000 7fcb41f42800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.6 2024-09-22T08:33:02.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.484+0000 7fcb41f42800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.7 2024-09-22T08:33:02.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.485+0000 7fcb41f42800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.8 2024-09-22T08:33:02.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.485+0000 7fcb41f42800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.9 2024-09-22T08:33:02.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.486+0000 7fcb41f42800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.10 2024-09-22T08:33:02.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.489+0000 7fcb41f42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.19 : hit (requested=0x17, cached=0x17) 2024-09-22T08:33:02.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.489+0000 7fcb41f42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.19 2024-09-22T08:33:02.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.491+0000 7fcb41f42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.19 info.flags=0x17 2024-09-22T08:33:02.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.491+0000 7fcb41f42800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.19 to cache LRU end 2024-09-22T08:33:02.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.491+0000 7fcb41f42800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:02.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.491+0000 7fcb41f42800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.19, ofs0, ns] 2024-09-22T08:33:02.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.491+0000 7fca217fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497087 cookie 93830138810768 notifier 6153 bl.length()=911 2024-09-22T08:33:02.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.491+0000 7fca217fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.19 info.flags=0x17 2024-09-22T08:33:02.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.491+0000 7fca217fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.19 to cache LRU end 2024-09-22T08:33:02.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.491+0000 7fca217fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:02.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.492+0000 7fcb41f42800 20 handle_bi_update(): bucket=:error-at-init-index[c62f9d7b-f6b6-404a-90de-de5607499115.4584.19]): orig_sources= new_sources= 2024-09-22T08:33:02.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.492+0000 7fcb41f42800 20 handle_bi_update(): bucket=:error-at-init-index[c62f9d7b-f6b6-404a-90de-de5607499115.4584.19]): potential sources added=[] removed=[] 2024-09-22T08:33:02.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.492+0000 7fcb41f42800 20 handle_bi_update(): bucket=:error-at-init-index[c62f9d7b-f6b6-404a-90de-de5607499115.4584.19]): orig_dests= new_dests= 2024-09-22T08:33:02.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.492+0000 7fcb41f42800 20 handle_bi_update(): bucket=:error-at-init-index[c62f9d7b-f6b6-404a-90de-de5607499115.4584.19]): potential dests added=[] removed=[] 2024-09-22T08:33:02.496 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.494+0000 7fcb41f42800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.0 2024-09-22T08:33:02.496 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.495+0000 7fcb41f42800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.1 2024-09-22T08:33:02.497 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.495+0000 7fcb41f42800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.2 2024-09-22T08:33:02.497 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.495+0000 7fcb41f42800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.3 2024-09-22T08:33:02.497 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.496+0000 7fcb41f42800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.4 2024-09-22T08:33:02.498 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.496+0000 7fcb41f42800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.5 2024-09-22T08:33:02.498 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.496+0000 7fcb41f42800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.6 2024-09-22T08:33:02.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.497+0000 7fcb41f42800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.7 2024-09-22T08:33:02.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.497+0000 7fcb41f42800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.8 2024-09-22T08:33:02.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.498+0000 7fcb41f42800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.9 2024-09-22T08:33:02.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.498+0000 7fcb41f42800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.19.10 2024-09-22T08:33:02.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.499+0000 7fcb41f42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.19 : hit (requested=0x17, cached=0x17) 2024-09-22T08:33:02.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.499+0000 7fcb41f42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.19 2024-09-22T08:33:02.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.500+0000 7fcb41f42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.19 info.flags=0x17 2024-09-22T08:33:02.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.500+0000 7fcb41f42800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.19 to cache LRU end 2024-09-22T08:33:02.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.500+0000 7fcb41f42800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:02.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.500+0000 7fcb41f42800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.19, ofs0, ns] 2024-09-22T08:33:02.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.500+0000 7fca20ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497088 cookie 93830138810768 notifier 6153 bl.length()=879 2024-09-22T08:33:02.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.500+0000 7fca20ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.19 info.flags=0x17 2024-09-22T08:33:02.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.500+0000 7fca20ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.19 to cache LRU end 2024-09-22T08:33:02.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.500+0000 7fca20ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:02.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.501+0000 7fcb41f42800 20 handle_bi_update(): bucket=:error-at-init-index[c62f9d7b-f6b6-404a-90de-de5607499115.4584.19]): orig_sources= new_sources= 2024-09-22T08:33:02.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.501+0000 7fcb41f42800 20 handle_bi_update(): bucket=:error-at-init-index[c62f9d7b-f6b6-404a-90de-de5607499115.4584.19]): potential sources added=[] removed=[] 2024-09-22T08:33:02.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.501+0000 7fcb41f42800 20 handle_bi_update(): bucket=:error-at-init-index[c62f9d7b-f6b6-404a-90de-de5607499115.4584.19]): orig_dests= new_dests= 2024-09-22T08:33:02.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.501+0000 7fcb41f42800 20 handle_bi_update(): bucket=:error-at-init-index[c62f9d7b-f6b6-404a-90de-de5607499115.4584.19]): potential dests added=[] removed=[] 2024-09-22T08:33:02.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.503+0000 7fcb41f42800 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-22T08:33:02.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.505+0000 7fc9ef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:02.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.507+0000 7fcb41f42800 20 remove_watcher() i=0 2024-09-22T08:33:02.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.507+0000 7fcb41f42800 2 removed watcher, disabling cache 2024-09-22T08:33:02.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.508+0000 7fcb41f42800 20 remove_watcher() i=1 2024-09-22T08:33:02.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.510+0000 7fcb41f42800 20 remove_watcher() i=2 2024-09-22T08:33:02.513 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.511+0000 7fcb41f42800 20 remove_watcher() i=3 2024-09-22T08:33:02.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.512+0000 7fcb41f42800 20 remove_watcher() i=4 2024-09-22T08:33:02.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.513+0000 7fcb41f42800 20 remove_watcher() i=5 2024-09-22T08:33:02.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.514+0000 7fcb41f42800 20 remove_watcher() i=6 2024-09-22T08:33:02.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.515+0000 7fcb41f42800 20 remove_watcher() i=7 2024-09-22T08:33:02.531 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-22T08:33:02.560 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:33:02.561 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:33:02.602 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.599+0000 7f4408322800 20 rados->read ofs=0 len=0 2024-09-22T08:33:02.603 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.601+0000 7f4408322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:02.603 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.601+0000 7f4408322800 20 realm 2024-09-22T08:33:02.603 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.601+0000 7f4408322800 20 rados->read ofs=0 len=0 2024-09-22T08:33:02.604 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.601+0000 7f4408322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:02.604 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.601+0000 7f4408322800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:33:02.604 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.601+0000 7f4408322800 20 rados->read ofs=0 len=0 2024-09-22T08:33:02.604 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.602+0000 7f4408322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:02.604 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.602+0000 7f4408322800 20 rados->read ofs=0 len=0 2024-09-22T08:33:02.604 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.602+0000 7f4408322800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:02.604 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.602+0000 7f4408322800 20 rados->read ofs=0 len=0 2024-09-22T08:33:02.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.603+0000 7f4408322800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:33:02.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.603+0000 7f4408322800 20 searching for the correct realm 2024-09-22T08:33:02.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.606+0000 7f4404703640 0 -- 172.21.15.38:0/781868579 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7f43f4071040 msgr2=0x7f43f4062470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:33:02.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.811+0000 7f4403f02640 0 -- 172.21.15.38:0/781868579 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x5564662d96b0 msgr2=0x5564662dbb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:02.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.815+0000 7f4408322800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:33:02.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.815+0000 7f4408322800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:33:02.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.815+0000 7f4408322800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:33:02.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.815+0000 7f4408322800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:33:02.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.815+0000 7f4408322800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:33:02.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.815+0000 7f4408322800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:33:02.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.815+0000 7f4408322800 20 rados->read ofs=0 len=0 2024-09-22T08:33:02.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.816+0000 7f4408322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:02.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.816+0000 7f4408322800 20 rados->read ofs=0 len=0 2024-09-22T08:33:02.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.816+0000 7f4408322800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:02.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.816+0000 7f4408322800 20 rados->read ofs=0 len=0 2024-09-22T08:33:02.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.816+0000 7f4408322800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:33:02.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.816+0000 7f4408322800 20 zone default found 2024-09-22T08:33:02.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.816+0000 7f4408322800 4 Realm: () 2024-09-22T08:33:02.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.816+0000 7f4408322800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:33:02.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.816+0000 7f4408322800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:33:02.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.816+0000 7f4408322800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:33:02.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.816+0000 7f4408322800 20 zonegroup default 2024-09-22T08:33:02.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.816+0000 7f4408322800 20 rados->read ofs=0 len=0 2024-09-22T08:33:02.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.817+0000 7f4408322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:02.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.817+0000 7f4408322800 20 rados->read ofs=0 len=0 2024-09-22T08:33:02.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.817+0000 7f4408322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:02.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.817+0000 7f4408322800 20 rados->read ofs=0 len=0 2024-09-22T08:33:02.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.818+0000 7f4408322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:02.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.818+0000 7f4408322800 20 started sync module instance, tier type = 2024-09-22T08:33:02.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.818+0000 7f4408322800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:33:02.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.828+0000 7f4408322800 20 add_watcher() i=0 2024-09-22T08:33:02.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.828+0000 7f4408322800 20 add_watcher() i=1 2024-09-22T08:33:02.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.828+0000 7f4408322800 20 add_watcher() i=2 2024-09-22T08:33:02.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.828+0000 7f4408322800 20 add_watcher() i=3 2024-09-22T08:33:02.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.828+0000 7f4408322800 20 add_watcher() i=4 2024-09-22T08:33:02.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.828+0000 7f4408322800 20 add_watcher() i=5 2024-09-22T08:33:02.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.828+0000 7f4408322800 20 add_watcher() i=6 2024-09-22T08:33:02.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.829+0000 7f4408322800 20 add_watcher() i=7 2024-09-22T08:33:02.832 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.829+0000 7f4408322800 2 all 8 watchers are set, enabling cache 2024-09-22T08:33:02.833 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.831+0000 7f42b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:02.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.832+0000 7f4408322800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:33:02.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.832+0000 7f4408322800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:33:02.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.832+0000 7f4408322800 5 note: GC not initialized 2024-09-22T08:33:02.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.832+0000 7f42b8fe1640 20 reqs_thread_entry: start 2024-09-22T08:33:02.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.832+0000 7f4408322800 20 init_complete bucket index max shards: 11 2024-09-22T08:33:02.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.832+0000 7f4408322800 20 Filter name: none 2024-09-22T08:33:02.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.832+0000 7f42327fc640 20 reqs_thread_entry: start 2024-09-22T08:33:02.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.832+0000 7f4408322800 20 rados->read ofs=0 len=0 2024-09-22T08:33:02.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.833+0000 7f4408322800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T08:33:02.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.833+0000 7f4408322800 20 rados->read ofs=0 len=0 2024-09-22T08:33:02.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.833+0000 7f4408322800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T08:33:02.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.833+0000 7f4408322800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:33:02.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.833+0000 7f4408322800 20 rados->read ofs=0 len=0 2024-09-22T08:33:02.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.834+0000 7f4408322800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T08:33:02.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.834+0000 7f4408322800 20 rados->read ofs=0 len=0 2024-09-22T08:33:02.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.834+0000 7f4408322800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T08:33:02.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.834+0000 7f4408322800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:33:02.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.836+0000 7f42b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:02.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.838+0000 7f4408322800 20 remove_watcher() i=0 2024-09-22T08:33:02.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.838+0000 7f4408322800 2 removed watcher, disabling cache 2024-09-22T08:33:02.841 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.839+0000 7f4408322800 20 remove_watcher() i=1 2024-09-22T08:33:02.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.841+0000 7f4408322800 20 remove_watcher() i=2 2024-09-22T08:33:02.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.842+0000 7f4408322800 20 remove_watcher() i=3 2024-09-22T08:33:02.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.843+0000 7f4408322800 20 remove_watcher() i=4 2024-09-22T08:33:02.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.844+0000 7f4408322800 20 remove_watcher() i=5 2024-09-22T08:33:02.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.845+0000 7f4408322800 20 remove_watcher() i=6 2024-09-22T08:33:02.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:02.846+0000 7f4408322800 20 remove_watcher() i=7 2024-09-22T08:33:02.860 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:02.860 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:33:02.860 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-init-index id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.19 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-22T08:33:02.860 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:02.862 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:02.862 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:02.866 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:02.866 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:02.910 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:02.910 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:02.941 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-22T08:33:02.941 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:02.942 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:02.942 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:02.953 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:02.954 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:02.996 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:02.996 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:03.002 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:03.002 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:03.010 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:03.010 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:03.014 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:03.014 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:03.021 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:03.021 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:03.027 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:03.027 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:03.033 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:03.033 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:03.039 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:03.039 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:03.045 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:03.045 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:03.051 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:03.051 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:03.056 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:03.056 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:03.062 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:03.062 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:03.068 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:03.068 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:03.074 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:03.074 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:03.080 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:03.080 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:03.086 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:03.086 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:03.092 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:03.092 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:03.098 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:03.098 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:03.104 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:03.104 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:03.110 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:03.110 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:03.117 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-22T08:33:03.146 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:33:03.146 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:33:03.186 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.184+0000 7f63bb494800 20 rados->read ofs=0 len=0 2024-09-22T08:33:03.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.186+0000 7f63bb494800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:03.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.186+0000 7f63bb494800 20 realm 2024-09-22T08:33:03.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.186+0000 7f63bb494800 20 rados->read ofs=0 len=0 2024-09-22T08:33:03.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.186+0000 7f63bb494800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:03.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.186+0000 7f63bb494800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:33:03.189 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.186+0000 7f63bb494800 20 rados->read ofs=0 len=0 2024-09-22T08:33:03.189 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.186+0000 7f63bb494800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:03.189 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.186+0000 7f63bb494800 20 rados->read ofs=0 len=0 2024-09-22T08:33:03.189 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.187+0000 7f63bb494800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:03.189 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.187+0000 7f63bb494800 20 rados->read ofs=0 len=0 2024-09-22T08:33:03.190 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.188+0000 7f63bb494800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:33:03.190 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.188+0000 7f63bb494800 20 searching for the correct realm 2024-09-22T08:33:03.191 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.189+0000 7f63b977f640 0 -- 172.21.15.38:0/2885069567 >> [v2:172.21.15.38:6800/703968303,v1:172.21.15.38:6801/703968303] conn(0x55d84a06a9e0 msgr2=0x55d84a06cdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:33:03.194 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.193+0000 7f63b977f640 0 -- 172.21.15.38:0/2885069567 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x55d84a062f30 msgr2=0x55d84a065380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:03.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.198+0000 7f63bb494800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:33:03.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.198+0000 7f63bb494800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:33:03.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.198+0000 7f63bb494800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:33:03.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.198+0000 7f63bb494800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:33:03.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.198+0000 7f63bb494800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:33:03.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.198+0000 7f63bb494800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:33:03.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.198+0000 7f63bb494800 20 rados->read ofs=0 len=0 2024-09-22T08:33:03.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.199+0000 7f63bb494800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:03.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.199+0000 7f63bb494800 20 rados->read ofs=0 len=0 2024-09-22T08:33:03.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.199+0000 7f63bb494800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:03.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.199+0000 7f63bb494800 20 rados->read ofs=0 len=0 2024-09-22T08:33:03.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.200+0000 7f63bb494800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:33:03.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.200+0000 7f63bb494800 20 zone default found 2024-09-22T08:33:03.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.200+0000 7f63bb494800 4 Realm: () 2024-09-22T08:33:03.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.200+0000 7f63bb494800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:33:03.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.200+0000 7f63bb494800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:33:03.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.200+0000 7f63bb494800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:33:03.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.200+0000 7f63bb494800 20 zonegroup default 2024-09-22T08:33:03.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.200+0000 7f63bb494800 20 rados->read ofs=0 len=0 2024-09-22T08:33:03.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.200+0000 7f63bb494800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:03.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.200+0000 7f63bb494800 20 rados->read ofs=0 len=0 2024-09-22T08:33:03.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.200+0000 7f63bb494800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:03.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.200+0000 7f63bb494800 20 rados->read ofs=0 len=0 2024-09-22T08:33:03.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.201+0000 7f63bb494800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:03.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.201+0000 7f63bb494800 20 started sync module instance, tier type = 2024-09-22T08:33:03.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.201+0000 7f63bb494800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:33:03.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.209+0000 7f63bb494800 20 add_watcher() i=0 2024-09-22T08:33:03.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.209+0000 7f63bb494800 20 add_watcher() i=1 2024-09-22T08:33:03.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.209+0000 7f63bb494800 20 add_watcher() i=2 2024-09-22T08:33:03.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.209+0000 7f63bb494800 20 add_watcher() i=3 2024-09-22T08:33:03.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.209+0000 7f63bb494800 20 add_watcher() i=4 2024-09-22T08:33:03.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.209+0000 7f63bb494800 20 add_watcher() i=5 2024-09-22T08:33:03.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.209+0000 7f63bb494800 20 add_watcher() i=6 2024-09-22T08:33:03.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.210+0000 7f63bb494800 20 add_watcher() i=7 2024-09-22T08:33:03.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.210+0000 7f63bb494800 2 all 8 watchers are set, enabling cache 2024-09-22T08:33:03.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.212+0000 7f626efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:03.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.212+0000 7f63bb494800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:33:03.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.212+0000 7f63bb494800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:33:03.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.212+0000 7f63bb494800 5 note: GC not initialized 2024-09-22T08:33:03.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.212+0000 7f626dfe3640 20 reqs_thread_entry: start 2024-09-22T08:33:03.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.213+0000 7f63bb494800 20 init_complete bucket index max shards: 11 2024-09-22T08:33:03.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.213+0000 7f63bb494800 20 Filter name: none 2024-09-22T08:33:03.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.213+0000 7f61df7fe640 20 reqs_thread_entry: start 2024-09-22T08:33:03.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.213+0000 7f63bb494800 20 rados->read ofs=0 len=0 2024-09-22T08:33:03.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.213+0000 7f63bb494800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T08:33:03.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.213+0000 7f63bb494800 20 rados->read ofs=0 len=0 2024-09-22T08:33:03.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.214+0000 7f63bb494800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T08:33:03.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.214+0000 7f63bb494800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:33:03.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.214+0000 7f63bb494800 20 rados->read ofs=0 len=0 2024-09-22T08:33:03.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.214+0000 7f63bb494800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T08:33:03.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.214+0000 7f63bb494800 20 rados->read ofs=0 len=0 2024-09-22T08:33:03.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.215+0000 7f63bb494800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T08:33:03.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.215+0000 7f63bb494800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:33:03.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.217+0000 7f626efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:03.222 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.219+0000 7f63bb494800 20 remove_watcher() i=0 2024-09-22T08:33:03.222 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.219+0000 7f63bb494800 2 removed watcher, disabling cache 2024-09-22T08:33:03.222 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.220+0000 7f63bb494800 20 remove_watcher() i=1 2024-09-22T08:33:03.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.221+0000 7f63bb494800 20 remove_watcher() i=2 2024-09-22T08:33:03.224 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.222+0000 7f63bb494800 20 remove_watcher() i=3 2024-09-22T08:33:03.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.223+0000 7f63bb494800 20 remove_watcher() i=4 2024-09-22T08:33:03.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.224+0000 7f63bb494800 20 remove_watcher() i=5 2024-09-22T08:33:03.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.225+0000 7f63bb494800 20 remove_watcher() i=6 2024-09-22T08:33:03.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.226+0000 7f63bb494800 20 remove_watcher() i=7 2024-09-22T08:33:03.240 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:03.240 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:33:03.240 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-init-index id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:33:03.240 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:03.241 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-22T08:33:03.278 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:33:03.278 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:33:03.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.317+0000 7fd10801d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:03.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.318+0000 7fd10801d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:03.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.318+0000 7fd10801d800 20 realm 2024-09-22T08:33:03.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.318+0000 7fd10801d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:03.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.318+0000 7fd10801d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:03.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.318+0000 7fd10801d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:33:03.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.318+0000 7fd10801d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:03.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.319+0000 7fd10801d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:03.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.319+0000 7fd10801d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:03.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.319+0000 7fd10801d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:03.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.319+0000 7fd10801d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:03.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.320+0000 7fd10801d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:33:03.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.320+0000 7fd10801d800 20 searching for the correct realm 2024-09-22T08:33:03.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.322+0000 7fd102fea640 0 -- 172.21.15.38:0/344378310 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7fd0f804e950 msgr2=0x7fd0f806fa90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:03.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.526+0000 7fd102fea640 0 -- 172.21.15.38:0/344378310 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fd0f4004040 msgr2=0x7fd0f40aea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:33:03.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.733+0000 7fd10801d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:33:03.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.733+0000 7fd10801d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:33:03.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.733+0000 7fd10801d800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:33:03.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.733+0000 7fd10801d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:33:03.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.733+0000 7fd10801d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:33:03.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.733+0000 7fd10801d800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:33:03.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.733+0000 7fd10801d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:03.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.733+0000 7fd10801d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:03.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.733+0000 7fd10801d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:03.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.734+0000 7fd10801d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:03.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.734+0000 7fd10801d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:03.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.734+0000 7fd10801d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:33:03.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.734+0000 7fd10801d800 20 zone default found 2024-09-22T08:33:03.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.734+0000 7fd10801d800 4 Realm: () 2024-09-22T08:33:03.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.734+0000 7fd10801d800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:33:03.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.734+0000 7fd10801d800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:33:03.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.734+0000 7fd10801d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:33:03.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.734+0000 7fd10801d800 20 zonegroup default 2024-09-22T08:33:03.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.734+0000 7fd10801d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:03.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.734+0000 7fd10801d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:03.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.734+0000 7fd10801d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:03.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.735+0000 7fd10801d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:03.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.735+0000 7fd10801d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:03.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.735+0000 7fd10801d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:03.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.735+0000 7fd10801d800 20 started sync module instance, tier type = 2024-09-22T08:33:03.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.735+0000 7fd10801d800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:33:03.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.746+0000 7fd10801d800 20 add_watcher() i=0 2024-09-22T08:33:03.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.746+0000 7fd10801d800 20 add_watcher() i=1 2024-09-22T08:33:03.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.746+0000 7fd10801d800 20 add_watcher() i=2 2024-09-22T08:33:03.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.746+0000 7fd10801d800 20 add_watcher() i=3 2024-09-22T08:33:03.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.746+0000 7fd10801d800 20 add_watcher() i=4 2024-09-22T08:33:03.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.746+0000 7fd10801d800 20 add_watcher() i=5 2024-09-22T08:33:03.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.746+0000 7fd10801d800 20 add_watcher() i=6 2024-09-22T08:33:03.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.747+0000 7fd10801d800 20 add_watcher() i=7 2024-09-22T08:33:03.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.747+0000 7fd10801d800 2 all 8 watchers are set, enabling cache 2024-09-22T08:33:03.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.749+0000 7fcfb9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:03.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.750+0000 7fd10801d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:33:03.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.750+0000 7fd10801d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:33:03.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.750+0000 7fd10801d800 5 note: GC not initialized 2024-09-22T08:33:03.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.750+0000 7fcfb8fe1640 20 reqs_thread_entry: start 2024-09-22T08:33:03.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.750+0000 7fd10801d800 20 init_complete bucket index max shards: 11 2024-09-22T08:33:03.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.750+0000 7fd10801d800 20 Filter name: none 2024-09-22T08:33:03.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.750+0000 7fcf327fc640 20 reqs_thread_entry: start 2024-09-22T08:33:03.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.751+0000 7fd10801d800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-22T08:33:03.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.751+0000 7fd10801d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:03.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.751+0000 7fd10801d800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T08:33:03.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.751+0000 7fd10801d800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-22T08:33:03.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.751+0000 7fd10801d800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-22T08:33:03.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.751+0000 7fd10801d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.20 : miss 2024-09-22T08:33:03.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.751+0000 7fd10801d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:03.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.751+0000 7fd10801d800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T08:33:03.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.751+0000 7fd10801d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.20 info.flags=0x17 2024-09-22T08:33:03.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.751+0000 7fd10801d800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.20 to cache LRU end 2024-09-22T08:33:03.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.751+0000 7fd10801d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:33:03.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.751+0000 7fd10801d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:03.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.751+0000 7fd10801d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.20 2024-09-22T08:33:03.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.753+0000 7fd10801d800 -1 Injecting error=-95 at location=init_index 2024-09-22T08:33:03.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.753+0000 7fd10801d800 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-22T08:33:03.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.758+0000 7fd10801d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.20 info.flags=0x17 2024-09-22T08:33:03.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.758+0000 7fd10801d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.20 to cache LRU end 2024-09-22T08:33:03.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.758+0000 7fd10801d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:03.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.758+0000 7fd10801d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.20, ofs0, ns] 2024-09-22T08:33:03.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.758+0000 7fcfe6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497091 cookie 94058482948384 notifier 5912 bl.length()=911 2024-09-22T08:33:03.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.758+0000 7fcfe6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.20 info.flags=0x17 2024-09-22T08:33:03.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.758+0000 7fcfe6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.20 to cache LRU end 2024-09-22T08:33:03.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.758+0000 7fcfe6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:03.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.758+0000 7fd10801d800 20 handle_bi_update(): bucket=:error-at-init-index[c62f9d7b-f6b6-404a-90de-de5607499115.4584.20]): orig_sources= new_sources= 2024-09-22T08:33:03.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.758+0000 7fd10801d800 20 handle_bi_update(): bucket=:error-at-init-index[c62f9d7b-f6b6-404a-90de-de5607499115.4584.20]): potential sources added=[] removed=[] 2024-09-22T08:33:03.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.758+0000 7fd10801d800 20 handle_bi_update(): bucket=:error-at-init-index[c62f9d7b-f6b6-404a-90de-de5607499115.4584.20]): orig_dests= new_dests= 2024-09-22T08:33:03.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.758+0000 7fd10801d800 20 handle_bi_update(): bucket=:error-at-init-index[c62f9d7b-f6b6-404a-90de-de5607499115.4584.20]): potential dests added=[] removed=[] 2024-09-22T08:33:03.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.761+0000 7fd10801d800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.20.1.0 2024-09-22T08:33:03.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.761+0000 7fd10801d800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.20.1.0 2024-09-22T08:33:03.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.761+0000 7fd10801d800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.20.1.1 2024-09-22T08:33:03.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.761+0000 7fd10801d800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.20.1.1 2024-09-22T08:33:03.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.761+0000 7fd10801d800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.20.1.2 2024-09-22T08:33:03.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.761+0000 7fd10801d800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.20.1.2 2024-09-22T08:33:03.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.761+0000 7fd10801d800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.20.1.3 2024-09-22T08:33:03.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.761+0000 7fd10801d800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.20.1.3 2024-09-22T08:33:03.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.761+0000 7fd10801d800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.20.1.4 2024-09-22T08:33:03.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.761+0000 7fd10801d800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.20.1.4 2024-09-22T08:33:03.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.761+0000 7fd10801d800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.20.1.5 2024-09-22T08:33:03.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.761+0000 7fd10801d800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.20.1.5 2024-09-22T08:33:03.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.761+0000 7fd10801d800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.20.1.6 2024-09-22T08:33:03.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.761+0000 7fd10801d800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.20.1.6 2024-09-22T08:33:03.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.761+0000 7fd10801d800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.20.1.7 2024-09-22T08:33:03.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.761+0000 7fd10801d800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.20.1.7 2024-09-22T08:33:03.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.761+0000 7fd10801d800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.20.1.8 2024-09-22T08:33:03.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.761+0000 7fd10801d800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.20.1.8 2024-09-22T08:33:03.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.761+0000 7fd10801d800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.20.1.9 2024-09-22T08:33:03.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.761+0000 7fd10801d800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.20.1.9 2024-09-22T08:33:03.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.761+0000 7fd10801d800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.20.1.10 2024-09-22T08:33:03.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.761+0000 7fd10801d800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.20.1.10 2024-09-22T08:33:03.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.761+0000 7fd10801d800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.20.1.11 2024-09-22T08:33:03.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.761+0000 7fd10801d800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.20.1.11 2024-09-22T08:33:03.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.761+0000 7fd10801d800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.20.0 2024-09-22T08:33:03.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.762+0000 7fd10801d800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.20.1 2024-09-22T08:33:03.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.762+0000 7fd10801d800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.20.2 2024-09-22T08:33:03.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.763+0000 7fd10801d800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.20.3 2024-09-22T08:33:03.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.764+0000 7fd10801d800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.20.4 2024-09-22T08:33:03.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.765+0000 7fd10801d800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.20.5 2024-09-22T08:33:03.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.765+0000 7fd10801d800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.20.6 2024-09-22T08:33:03.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.766+0000 7fd10801d800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.20.7 2024-09-22T08:33:03.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.766+0000 7fd10801d800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.20.8 2024-09-22T08:33:03.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.767+0000 7fd10801d800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.20.9 2024-09-22T08:33:03.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.768+0000 7fd10801d800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.20.10 2024-09-22T08:33:03.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.771+0000 7fd10801d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.20 : hit (requested=0x17, cached=0x17) 2024-09-22T08:33:03.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.771+0000 7fd10801d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.20 2024-09-22T08:33:03.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.773+0000 7fd10801d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.20 info.flags=0x17 2024-09-22T08:33:03.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.773+0000 7fd10801d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.20 to cache LRU end 2024-09-22T08:33:03.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.773+0000 7fd10801d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:03.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.773+0000 7fd10801d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.20, ofs0, ns] 2024-09-22T08:33:03.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.773+0000 7fcfe6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497092 cookie 94058482948384 notifier 5912 bl.length()=879 2024-09-22T08:33:03.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.773+0000 7fcfe6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.20 info.flags=0x17 2024-09-22T08:33:03.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.773+0000 7fcfe6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:c62f9d7b-f6b6-404a-90de-de5607499115.4584.20 to cache LRU end 2024-09-22T08:33:03.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.773+0000 7fcfe6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:03.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.773+0000 7fd10801d800 20 handle_bi_update(): bucket=:error-at-init-index[c62f9d7b-f6b6-404a-90de-de5607499115.4584.20]): orig_sources= new_sources= 2024-09-22T08:33:03.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.773+0000 7fd10801d800 20 handle_bi_update(): bucket=:error-at-init-index[c62f9d7b-f6b6-404a-90de-de5607499115.4584.20]): potential sources added=[] removed=[] 2024-09-22T08:33:03.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.773+0000 7fd10801d800 20 handle_bi_update(): bucket=:error-at-init-index[c62f9d7b-f6b6-404a-90de-de5607499115.4584.20]): orig_dests= new_dests= 2024-09-22T08:33:03.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.773+0000 7fd10801d800 20 handle_bi_update(): bucket=:error-at-init-index[c62f9d7b-f6b6-404a-90de-de5607499115.4584.20]): potential dests added=[] removed=[] 2024-09-22T08:33:03.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.776+0000 7fd10801d800 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-22T08:33:03.780 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.778+0000 7fcfb9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:03.782 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.780+0000 7fd10801d800 20 remove_watcher() i=0 2024-09-22T08:33:03.782 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.780+0000 7fd10801d800 2 removed watcher, disabling cache 2024-09-22T08:33:03.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.782+0000 7fd10801d800 20 remove_watcher() i=1 2024-09-22T08:33:03.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.783+0000 7fd10801d800 20 remove_watcher() i=2 2024-09-22T08:33:03.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.785+0000 7fd10801d800 20 remove_watcher() i=3 2024-09-22T08:33:03.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.786+0000 7fd10801d800 20 remove_watcher() i=4 2024-09-22T08:33:03.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.788+0000 7fd10801d800 20 remove_watcher() i=5 2024-09-22T08:33:03.792 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.790+0000 7fd10801d800 20 remove_watcher() i=6 2024-09-22T08:33:03.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.792+0000 7fd10801d800 20 remove_watcher() i=7 2024-09-22T08:33:03.808 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-22T08:33:03.838 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:33:03.839 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:33:03.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.877+0000 7f29e7e87800 20 rados->read ofs=0 len=0 2024-09-22T08:33:03.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.878+0000 7f29e7e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:03.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.878+0000 7f29e7e87800 20 realm 2024-09-22T08:33:03.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.878+0000 7f29e7e87800 20 rados->read ofs=0 len=0 2024-09-22T08:33:03.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.879+0000 7f29e7e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:03.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.879+0000 7f29e7e87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:33:03.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.879+0000 7f29e7e87800 20 rados->read ofs=0 len=0 2024-09-22T08:33:03.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.879+0000 7f29e7e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:03.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.879+0000 7f29e7e87800 20 rados->read ofs=0 len=0 2024-09-22T08:33:03.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.880+0000 7f29e7e87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:03.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.880+0000 7f29e7e87800 20 rados->read ofs=0 len=0 2024-09-22T08:33:03.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.880+0000 7f29e7e87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:33:03.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.880+0000 7f29e7e87800 20 searching for the correct realm 2024-09-22T08:33:03.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.882+0000 7f29e5170640 0 -- 172.21.15.38:0/3596046070 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f29dc09b4b0 msgr2=0x7f29dc0469b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:03.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:03.886+0000 7f29e5170640 0 -- 172.21.15.38:0/3596046070 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f29d8042920 msgr2=0x7f29d8051400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:04.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.093+0000 7f29e7e87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:33:04.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.093+0000 7f29e7e87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:33:04.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.093+0000 7f29e7e87800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:33:04.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.093+0000 7f29e7e87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:33:04.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.093+0000 7f29e7e87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:33:04.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.093+0000 7f29e7e87800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:33:04.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.093+0000 7f29e7e87800 20 rados->read ofs=0 len=0 2024-09-22T08:33:04.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.093+0000 7f29e7e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:04.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.093+0000 7f29e7e87800 20 rados->read ofs=0 len=0 2024-09-22T08:33:04.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.093+0000 7f29e7e87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:04.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.093+0000 7f29e7e87800 20 rados->read ofs=0 len=0 2024-09-22T08:33:04.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.094+0000 7f29e7e87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:33:04.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.094+0000 7f29e7e87800 20 zone default found 2024-09-22T08:33:04.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.094+0000 7f29e7e87800 4 Realm: () 2024-09-22T08:33:04.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.094+0000 7f29e7e87800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:33:04.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.094+0000 7f29e7e87800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:33:04.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.094+0000 7f29e7e87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:33:04.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.094+0000 7f29e7e87800 20 zonegroup default 2024-09-22T08:33:04.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.094+0000 7f29e7e87800 20 rados->read ofs=0 len=0 2024-09-22T08:33:04.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.094+0000 7f29e7e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:04.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.094+0000 7f29e7e87800 20 rados->read ofs=0 len=0 2024-09-22T08:33:04.098 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.095+0000 7f29e7e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:04.098 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.095+0000 7f29e7e87800 20 rados->read ofs=0 len=0 2024-09-22T08:33:04.098 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.095+0000 7f29e7e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:04.098 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.095+0000 7f29e7e87800 20 started sync module instance, tier type = 2024-09-22T08:33:04.098 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.095+0000 7f29e7e87800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:33:04.106 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.104+0000 7f29e7e87800 20 add_watcher() i=0 2024-09-22T08:33:04.106 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.104+0000 7f29e7e87800 20 add_watcher() i=1 2024-09-22T08:33:04.106 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.104+0000 7f29e7e87800 20 add_watcher() i=2 2024-09-22T08:33:04.106 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.104+0000 7f29e7e87800 20 add_watcher() i=3 2024-09-22T08:33:04.106 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.104+0000 7f29e7e87800 20 add_watcher() i=4 2024-09-22T08:33:04.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.104+0000 7f29e7e87800 20 add_watcher() i=5 2024-09-22T08:33:04.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.104+0000 7f29e7e87800 20 add_watcher() i=6 2024-09-22T08:33:04.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.105+0000 7f29e7e87800 20 add_watcher() i=7 2024-09-22T08:33:04.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.105+0000 7f29e7e87800 2 all 8 watchers are set, enabling cache 2024-09-22T08:33:04.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.107+0000 7f28977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:04.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.107+0000 7f29e7e87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:33:04.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.107+0000 7f29e7e87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:33:04.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.107+0000 7f29e7e87800 5 note: GC not initialized 2024-09-22T08:33:04.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.108+0000 7f28967fc640 20 reqs_thread_entry: start 2024-09-22T08:33:04.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.108+0000 7f29e7e87800 20 init_complete bucket index max shards: 11 2024-09-22T08:33:04.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.108+0000 7f29e7e87800 20 Filter name: none 2024-09-22T08:33:04.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.108+0000 7f2807fff640 20 reqs_thread_entry: start 2024-09-22T08:33:04.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.108+0000 7f29e7e87800 20 rados->read ofs=0 len=0 2024-09-22T08:33:04.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.108+0000 7f29e7e87800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T08:33:04.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.108+0000 7f29e7e87800 20 rados->read ofs=0 len=0 2024-09-22T08:33:04.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.109+0000 7f29e7e87800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T08:33:04.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.109+0000 7f29e7e87800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:33:04.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.109+0000 7f29e7e87800 20 rados->read ofs=0 len=0 2024-09-22T08:33:04.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.109+0000 7f29e7e87800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T08:33:04.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.110+0000 7f29e7e87800 20 rados->read ofs=0 len=0 2024-09-22T08:33:04.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.110+0000 7f29e7e87800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T08:33:04.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.110+0000 7f29e7e87800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:33:04.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.112+0000 7f28977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:04.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.114+0000 7f29e7e87800 20 remove_watcher() i=0 2024-09-22T08:33:04.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.114+0000 7f29e7e87800 2 removed watcher, disabling cache 2024-09-22T08:33:04.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.115+0000 7f29e7e87800 20 remove_watcher() i=1 2024-09-22T08:33:04.118 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.116+0000 7f29e7e87800 20 remove_watcher() i=2 2024-09-22T08:33:04.119 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.118+0000 7f29e7e87800 20 remove_watcher() i=3 2024-09-22T08:33:04.120 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.119+0000 7f29e7e87800 20 remove_watcher() i=4 2024-09-22T08:33:04.122 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.120+0000 7f29e7e87800 20 remove_watcher() i=5 2024-09-22T08:33:04.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.121+0000 7f29e7e87800 20 remove_watcher() i=6 2024-09-22T08:33:04.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.122+0000 7f29e7e87800 20 remove_watcher() i=7 2024-09-22T08:33:04.135 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:04.135 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:33:04.135 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-init-index id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.20 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-22T08:33:04.136 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:04.137 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:04.138 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:04.140 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:04.140 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:04.183 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:04.184 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:04.211 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with abort at init_index 2024-09-22T08:33:04.211 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:04.212 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:04.212 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:04.223 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:04.223 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:04.266 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:04.266 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:04.273 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:04.273 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:04.279 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:04.279 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:04.285 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:04.285 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:04.291 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:04.291 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:04.297 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:04.298 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:04.304 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:04.304 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:04.310 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:04.310 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:04.316 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:04.317 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:04.322 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:04.322 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:04.329 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:04.329 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:04.334 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:04.334 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:04.341 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:04.341 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:04.347 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:04.348 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:04.354 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:04.354 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:04.360 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:04.360 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:04.366 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:04.366 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:04.371 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:04.372 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:04.378 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:04.378 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:04.383 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:04.384 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:04.390 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-22T08:33:04.419 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:33:04.419 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:33:04.458 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.456+0000 7f63fb61d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:04.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.458+0000 7f63fb61d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:04.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.458+0000 7f63fb61d800 20 realm 2024-09-22T08:33:04.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.458+0000 7f63fb61d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:04.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.458+0000 7f63fb61d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:04.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.458+0000 7f63fb61d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:33:04.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.458+0000 7f63fb61d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:04.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.458+0000 7f63fb61d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:04.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.458+0000 7f63fb61d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:04.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.459+0000 7f63fb61d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:04.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.459+0000 7f63fb61d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:04.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.460+0000 7f63fb61d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:33:04.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.460+0000 7f63fb61d800 20 searching for the correct realm 2024-09-22T08:33:04.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.462+0000 7f63f65ea640 0 -- 172.21.15.38:0/269976527 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f63ec017070 msgr2=0x7f63ec05fe50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:04.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.465+0000 7f63f65ea640 0 -- 172.21.15.38:0/269976527 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f63e8032950 msgr2=0x7f63e8042420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:33:04.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.672+0000 7f63fb61d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:33:04.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.672+0000 7f63fb61d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:33:04.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.672+0000 7f63fb61d800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:33:04.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.672+0000 7f63fb61d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:33:04.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.672+0000 7f63fb61d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:33:04.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.672+0000 7f63fb61d800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:33:04.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.672+0000 7f63fb61d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:04.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.672+0000 7f63fb61d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:04.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.672+0000 7f63fb61d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:04.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.672+0000 7f63fb61d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:04.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.672+0000 7f63fb61d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:04.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.673+0000 7f63fb61d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:33:04.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.673+0000 7f63fb61d800 20 zone default found 2024-09-22T08:33:04.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.673+0000 7f63fb61d800 4 Realm: () 2024-09-22T08:33:04.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.673+0000 7f63fb61d800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:33:04.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.673+0000 7f63fb61d800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:33:04.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.673+0000 7f63fb61d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:33:04.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.673+0000 7f63fb61d800 20 zonegroup default 2024-09-22T08:33:04.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.673+0000 7f63fb61d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:04.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.673+0000 7f63fb61d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:04.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.673+0000 7f63fb61d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:04.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.673+0000 7f63fb61d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:04.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.673+0000 7f63fb61d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:04.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.673+0000 7f63fb61d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:04.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.673+0000 7f63fb61d800 20 started sync module instance, tier type = 2024-09-22T08:33:04.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.673+0000 7f63fb61d800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:33:04.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.682+0000 7f63fb61d800 20 add_watcher() i=0 2024-09-22T08:33:04.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.682+0000 7f63fb61d800 20 add_watcher() i=1 2024-09-22T08:33:04.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.682+0000 7f63fb61d800 20 add_watcher() i=2 2024-09-22T08:33:04.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.682+0000 7f63fb61d800 20 add_watcher() i=3 2024-09-22T08:33:04.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.682+0000 7f63fb61d800 20 add_watcher() i=4 2024-09-22T08:33:04.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.682+0000 7f63fb61d800 20 add_watcher() i=5 2024-09-22T08:33:04.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.682+0000 7f63fb61d800 20 add_watcher() i=6 2024-09-22T08:33:04.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.683+0000 7f63fb61d800 20 add_watcher() i=7 2024-09-22T08:33:04.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.683+0000 7f63fb61d800 2 all 8 watchers are set, enabling cache 2024-09-22T08:33:04.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.685+0000 7f62adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:04.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.685+0000 7f63fb61d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:33:04.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.685+0000 7f63fb61d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:33:04.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.685+0000 7f63fb61d800 5 note: GC not initialized 2024-09-22T08:33:04.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.686+0000 7f62acfe1640 20 reqs_thread_entry: start 2024-09-22T08:33:04.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.686+0000 7f63fb61d800 20 init_complete bucket index max shards: 11 2024-09-22T08:33:04.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.686+0000 7f63fb61d800 20 Filter name: none 2024-09-22T08:33:04.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.686+0000 7f62a5ffb640 20 reqs_thread_entry: start 2024-09-22T08:33:04.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.686+0000 7f63fb61d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:04.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.686+0000 7f63fb61d800 20 rados_obj.operate() r=0 bl.length=188 2024-09-22T08:33:04.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.686+0000 7f63fb61d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:04.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.687+0000 7f63fb61d800 20 rados_obj.operate() r=0 bl.length=410 2024-09-22T08:33:04.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.687+0000 7f63fb61d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:33:04.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.687+0000 7f63fb61d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:04.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.687+0000 7f63fb61d800 20 rados_obj.operate() r=0 bl.length=188 2024-09-22T08:33:04.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.687+0000 7f63fb61d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:04.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.688+0000 7f63fb61d800 20 rados_obj.operate() r=0 bl.length=410 2024-09-22T08:33:04.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.688+0000 7f63fb61d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:33:04.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.689+0000 7f62adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:04.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.692+0000 7f63fb61d800 20 remove_watcher() i=0 2024-09-22T08:33:04.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.692+0000 7f63fb61d800 2 removed watcher, disabling cache 2024-09-22T08:33:04.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.693+0000 7f63fb61d800 20 remove_watcher() i=1 2024-09-22T08:33:04.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.694+0000 7f63fb61d800 20 remove_watcher() i=2 2024-09-22T08:33:04.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.695+0000 7f63fb61d800 20 remove_watcher() i=3 2024-09-22T08:33:04.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.696+0000 7f63fb61d800 20 remove_watcher() i=4 2024-09-22T08:33:04.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.697+0000 7f63fb61d800 20 remove_watcher() i=5 2024-09-22T08:33:04.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.698+0000 7f63fb61d800 20 remove_watcher() i=6 2024-09-22T08:33:04.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.699+0000 7f63fb61d800 20 remove_watcher() i=7 2024-09-22T08:33:04.712 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:04.712 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:33:04.712 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-init-indext id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:33:04.713 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:04.714 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-22T08:33:04.748 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:33:04.748 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:33:04.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.786+0000 7f8cd2e12800 20 rados->read ofs=0 len=0 2024-09-22T08:33:04.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.787+0000 7f8cd2e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:04.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.787+0000 7f8cd2e12800 20 realm 2024-09-22T08:33:04.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.787+0000 7f8cd2e12800 20 rados->read ofs=0 len=0 2024-09-22T08:33:04.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.788+0000 7f8cd2e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:04.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.788+0000 7f8cd2e12800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:33:04.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.788+0000 7f8cd2e12800 20 rados->read ofs=0 len=0 2024-09-22T08:33:04.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.788+0000 7f8cd2e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:04.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.788+0000 7f8cd2e12800 20 rados->read ofs=0 len=0 2024-09-22T08:33:04.791 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.789+0000 7f8cd2e12800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:04.791 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.789+0000 7f8cd2e12800 20 rados->read ofs=0 len=0 2024-09-22T08:33:04.791 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.789+0000 7f8cd2e12800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:33:04.791 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.789+0000 7f8cd2e12800 20 searching for the correct realm 2024-09-22T08:33:04.793 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.791+0000 7f8ccdcca640 0 -- 172.21.15.38:0/319123563 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f8cc4053070 msgr2=0x7f8cc4077500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:04.796 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:04.795+0000 7f8ccdcca640 0 -- 172.21.15.38:0/319123563 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f8cc0099400 msgr2=0x7f8cc0099880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:05.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.001+0000 7f8cd2e12800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:33:05.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.001+0000 7f8cd2e12800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:33:05.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.001+0000 7f8cd2e12800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:33:05.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.001+0000 7f8cd2e12800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:33:05.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.001+0000 7f8cd2e12800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:33:05.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.001+0000 7f8cd2e12800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:33:05.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.001+0000 7f8cd2e12800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.002+0000 7f8cd2e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:05.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.002+0000 7f8cd2e12800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.002+0000 7f8cd2e12800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:05.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.002+0000 7f8cd2e12800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.002+0000 7f8cd2e12800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:33:05.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.003+0000 7f8cd2e12800 20 zone default found 2024-09-22T08:33:05.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.003+0000 7f8cd2e12800 4 Realm: () 2024-09-22T08:33:05.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.003+0000 7f8cd2e12800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:33:05.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.003+0000 7f8cd2e12800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:33:05.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.003+0000 7f8cd2e12800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:33:05.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.003+0000 7f8cd2e12800 20 zonegroup default 2024-09-22T08:33:05.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.003+0000 7f8cd2e12800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.003+0000 7f8cd2e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:05.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.003+0000 7f8cd2e12800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.003+0000 7f8cd2e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:05.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.003+0000 7f8cd2e12800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.003+0000 7f8cd2e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:05.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.003+0000 7f8cd2e12800 20 started sync module instance, tier type = 2024-09-22T08:33:05.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.003+0000 7f8cd2e12800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:33:05.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.012+0000 7f8cd2e12800 20 add_watcher() i=0 2024-09-22T08:33:05.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.012+0000 7f8cd2e12800 20 add_watcher() i=1 2024-09-22T08:33:05.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.012+0000 7f8cd2e12800 20 add_watcher() i=2 2024-09-22T08:33:05.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.012+0000 7f8cd2e12800 20 add_watcher() i=3 2024-09-22T08:33:05.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.012+0000 7f8cd2e12800 20 add_watcher() i=4 2024-09-22T08:33:05.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.012+0000 7f8cd2e12800 20 add_watcher() i=5 2024-09-22T08:33:05.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.012+0000 7f8cd2e12800 20 add_watcher() i=6 2024-09-22T08:33:05.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.013+0000 7f8cd2e12800 20 add_watcher() i=7 2024-09-22T08:33:05.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.013+0000 7f8cd2e12800 2 all 8 watchers are set, enabling cache 2024-09-22T08:33:05.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.015+0000 7f8b84fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:05.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.015+0000 7f8cd2e12800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:33:05.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.015+0000 7f8cd2e12800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:33:05.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.015+0000 7f8cd2e12800 5 note: GC not initialized 2024-09-22T08:33:05.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.015+0000 7f8aff7fe640 20 reqs_thread_entry: start 2024-09-22T08:33:05.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.016+0000 7f8cd2e12800 20 init_complete bucket index max shards: 11 2024-09-22T08:33:05.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.016+0000 7f8cd2e12800 20 Filter name: none 2024-09-22T08:33:05.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.016+0000 7f8afd7fa640 20 reqs_thread_entry: start 2024-09-22T08:33:05.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.016+0000 7f8cd2e12800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-22T08:33:05.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.016+0000 7f8cd2e12800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.017+0000 7f8cd2e12800 20 rados_obj.operate() r=0 bl.length=188 2024-09-22T08:33:05.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.017+0000 7f8cd2e12800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-22T08:33:05.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.017+0000 7f8cd2e12800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-22T08:33:05.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.017+0000 7f8cd2e12800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c62f9d7b-f6b6-404a-90de-de5607499115.4584.21 : miss 2024-09-22T08:33:05.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.017+0000 7f8cd2e12800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.017+0000 7f8cd2e12800 20 rados_obj.operate() r=0 bl.length=410 2024-09-22T08:33:05.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.017+0000 7f8cd2e12800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c62f9d7b-f6b6-404a-90de-de5607499115.4584.21 info.flags=0x17 2024-09-22T08:33:05.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.017+0000 7f8cd2e12800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c62f9d7b-f6b6-404a-90de-de5607499115.4584.21 to cache LRU end 2024-09-22T08:33:05.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.017+0000 7f8cd2e12800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:33:05.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.017+0000 7f8cd2e12800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:05.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.017+0000 7f8cd2e12800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c62f9d7b-f6b6-404a-90de-de5607499115.4584.21 2024-09-22T08:33:05.020 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8cd2e12800 time 2024-09-22T08:33:05.020553+0000 2024-09-22T08:33:05.020 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:33:05.021 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:33:05.021 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8cd3f8c748] 2024-09-22T08:33:05.021 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f8cd3f8c906] 2024-09-22T08:33:05.021 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56237b195e01] 2024-09-22T08:33:05.021 INFO:tasks.workunit.client.0.smithi038.stderr: 4: radosgw-admin(+0xd80ac4) [0x56237b6a7ac4] 2024-09-22T08:33:05.022 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56237b1a5c9d] 2024-09-22T08:33:05.022 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-22T08:33:05.022 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8cd2c29590] 2024-09-22T08:33:05.022 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-22T08:33:05.022 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-22T08:33:05.022 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.019+0000 7f8cd2e12800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8cd2e12800 time 2024-09-22T08:33:05.020553+0000 2024-09-22T08:33:05.022 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:33:05.022 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.022 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:33:05.022 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8cd3f8c748] 2024-09-22T08:33:05.022 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f8cd3f8c906] 2024-09-22T08:33:05.022 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56237b195e01] 2024-09-22T08:33:05.022 INFO:tasks.workunit.client.0.smithi038.stderr: 4: radosgw-admin(+0xd80ac4) [0x56237b6a7ac4] 2024-09-22T08:33:05.023 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56237b1a5c9d] 2024-09-22T08:33:05.023 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-22T08:33:05.023 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8cd2c29590] 2024-09-22T08:33:05.023 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-22T08:33:05.023 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-22T08:33:05.023 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.023 INFO:tasks.workunit.client.0.smithi038.stderr:*** Caught signal (Aborted) ** 2024-09-22T08:33:05.023 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f8cd2e12800 thread_name:radosgw-admin 2024-09-22T08:33:05.039 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:33:05.040 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8cd2c3e6f0] 2024-09-22T08:33:05.040 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8cd2c8b99c] 2024-09-22T08:33:05.040 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:33:05.040 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:33:05.040 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8cd3f8c7a2] 2024-09-22T08:33:05.040 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f8cd3f8c906] 2024-09-22T08:33:05.040 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56237b195e01] 2024-09-22T08:33:05.040 INFO:tasks.workunit.client.0.smithi038.stderr: 8: radosgw-admin(+0xd80ac4) [0x56237b6a7ac4] 2024-09-22T08:33:05.040 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56237b1a5c9d] 2024-09-22T08:33:05.040 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-22T08:33:05.040 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8cd2c29590] 2024-09-22T08:33:05.040 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-22T08:33:05.040 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-22T08:33:05.040 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.020+0000 7f8cd2e12800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:33:05.041 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f8cd2e12800 thread_name:radosgw-admin 2024-09-22T08:33:05.041 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.041 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:33:05.041 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8cd2c3e6f0] 2024-09-22T08:33:05.041 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8cd2c8b99c] 2024-09-22T08:33:05.041 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:33:05.041 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:33:05.041 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8cd3f8c7a2] 2024-09-22T08:33:05.041 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f8cd3f8c906] 2024-09-22T08:33:05.041 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56237b195e01] 2024-09-22T08:33:05.041 INFO:tasks.workunit.client.0.smithi038.stderr: 8: radosgw-admin(+0xd80ac4) [0x56237b6a7ac4] 2024-09-22T08:33:05.041 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56237b1a5c9d] 2024-09-22T08:33:05.041 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-22T08:33:05.041 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8cd2c29590] 2024-09-22T08:33:05.041 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-22T08:33:05.041 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-22T08:33:05.042 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:33:05.042 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.042 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-22T08:33:05.042 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-22T08:33:04.767+0000 7f8ccdcca640 1 monclient: found mon.noname-c 2024-09-22T08:33:05.042 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-22T08:33:04.768+0000 7f8ccdcca640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:33:05.042 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-22T08:33:04.768+0000 7f8bbc608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:33:05.042 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-22T08:33:04.768+0000 7f8bbc608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:33:05.042 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-22T08:33:04.768+0000 7f8bbc608640 10 monclient: dump: 2024-09-22T08:33:05.042 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:33:05.042 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:33:05.042 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:05.042 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:05.042 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:33:05.042 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:05.042 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:33:05.043 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:33:05.043 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:33:05.043 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.043 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-22T08:33:04.768+0000 7f8bbc608640 10 monclient: _finish_auth 0 2024-09-22T08:33:05.043 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-22T08:33:04.768+0000 7f8bbc608640 10 monclient: _check_auth_tickets 2024-09-22T08:33:05.043 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-22T08:33:04.768+0000 7f8bbc608640 10 monclient: handle_config config(0 keys) 2024-09-22T08:33:05.043 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-22T08:33:04.768+0000 7f8bbc608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:33:05.043 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-22T08:33:04.768+0000 7f8bbc608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:33:05.043 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-22T08:33:04.768+0000 7f8bbc608640 10 monclient: dump: 2024-09-22T08:33:05.043 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:33:05.043 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:33:05.043 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:05.043 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:05.043 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:33:05.044 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:05.044 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:33:05.044 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:33:05.044 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:33:05.044 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.044 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-22T08:33:04.768+0000 7f8cd2e12800 5 monclient: authenticate success, global_id 5945 2024-09-22T08:33:05.044 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-22T08:33:04.768+0000 7f8cd2e12800 10 monclient: get_monmap_and_config success 2024-09-22T08:33:05.044 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-22T08:33:04.768+0000 7f8cd2e12800 4 set_mon_vals no callback set 2024-09-22T08:33:05.044 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-22T08:33:04.768+0000 7f8cd2e12800 10 monclient: shutdown 2024-09-22T08:33:05.044 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-22T08:33:04.768+0000 7f8cd2e12800 5 asok(0x56237bf470f0) unregister_commands rotate-key 2024-09-22T08:33:05.044 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 10 monclient: build_initial_monmap 2024-09-22T08:33:05.044 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 1 build_initial for_mkfs: 0 2024-09-22T08:33:05.044 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 10 monclient: monmap: 2024-09-22T08:33:05.044 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:33:05.045 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:33:05.045 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:33:05.045 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:33:05.045 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:33:05.045 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:05.045 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:33:05.045 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:33:05.045 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:33:05.045 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.045 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c16e390) adding auth protocol: cephx 2024-09-22T08:33:05.045 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c16e390) adding auth protocol: cephx 2024-09-22T08:33:05.045 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c16e390) adding auth protocol: cephx 2024-09-22T08:33:05.045 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c16e390) adding con mode: secure 2024-09-22T08:33:05.045 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c16e390) adding con mode: crc 2024-09-22T08:33:05.045 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c16e390) adding con mode: secure 2024-09-22T08:33:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c16e390) adding con mode: crc 2024-09-22T08:33:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c16e390) adding con mode: secure 2024-09-22T08:33:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c16e390) adding con mode: crc 2024-09-22T08:33:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c16e390) adding con mode: crc 2024-09-22T08:33:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c16e390) adding con mode: secure 2024-09-22T08:33:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c16e390) adding con mode: crc 2024-09-22T08:33:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c16e390) adding con mode: secure 2024-09-22T08:33:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c16e390) adding con mode: crc 2024-09-22T08:33:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c16e390) adding con mode: secure 2024-09-22T08:33:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 1 librados: starting msgr at 2024-09-22T08:33:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 1 librados: starting objecter 2024-09-22T08:33:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 asok(0x56237bf470f0) register_command objecter_requests hook 0x56237c170650 2024-09-22T08:33:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 1 librados: setting wanted keys 2024-09-22T08:33:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 1 librados: calling monclient init 2024-09-22T08:33:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 10 monclient: init 2024-09-22T08:33:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c168db0) adding auth protocol: cephx 2024-09-22T08:33:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c168db0) adding auth protocol: cephx 2024-09-22T08:33:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c168db0) adding auth protocol: cephx 2024-09-22T08:33:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c168db0) adding con mode: secure 2024-09-22T08:33:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c168db0) adding con mode: crc 2024-09-22T08:33:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c168db0) adding con mode: secure 2024-09-22T08:33:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c168db0) adding con mode: crc 2024-09-22T08:33:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c168db0) adding con mode: secure 2024-09-22T08:33:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c168db0) adding con mode: crc 2024-09-22T08:33:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c168db0) adding con mode: crc 2024-09-22T08:33:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c168db0) adding con mode: secure 2024-09-22T08:33:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c168db0) adding con mode: crc 2024-09-22T08:33:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c168db0) adding con mode: secure 2024-09-22T08:33:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c168db0) adding con mode: crc 2024-09-22T08:33:05.048 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c168db0) adding con mode: secure 2024-09-22T08:33:05.048 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:05.048 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:05.048 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-22T08:33:04.770+0000 7f8cd2e12800 5 asok(0x56237bf470f0) register_command rotate-key hook 0x56237c168ef8 2024-09-22T08:33:05.048 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-22T08:33:04.770+0000 7f8cd2e12800 10 monclient: _reopen_session rank -1 2024-09-22T08:33:05.048 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-22T08:33:04.770+0000 7f8cd2e12800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T08:33:05.048 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-22T08:33:04.770+0000 7f8cd2e12800 10 monclient(hunting): picked mon.noname-a con 0x56237bff2200 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:33:05.048 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-22T08:33:04.770+0000 7f8cd2e12800 10 monclient(hunting): picked mon.noname-b con 0x56237c01d6b0 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:33:05.048 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-22T08:33:04.770+0000 7f8cd2e12800 10 monclient(hunting): picked mon.noname-c con 0x56237c19f920 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:33:05.048 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-22T08:33:04.770+0000 7f8cd2e12800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:05.048 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-22T08:33:04.770+0000 7f8cd2e12800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:05.048 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-22T08:33:04.770+0000 7f8cd2e12800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:05.048 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-22T08:33:04.770+0000 7f8cd2e12800 10 monclient(hunting): _renew_subs 2024-09-22T08:33:05.048 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-22T08:33:04.770+0000 7f8cd2e12800 10 monclient(hunting): authenticate will time out at 1890.010178s 2024-09-22T08:33:05.049 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-22T08:33:04.770+0000 7f8cce4cb640 10 monclient(hunting): get_auth_request con 0x56237bff2200 auth_method 0 2024-09-22T08:33:05.049 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-22T08:33:04.770+0000 7f8cce4cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:05.049 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-22T08:33:04.770+0000 7f8cce4cb640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:05.049 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-22T08:33:04.770+0000 7f8cce4cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:05.049 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-22T08:33:04.770+0000 7f8cceccc640 10 monclient(hunting): get_auth_request con 0x56237c19f920 auth_method 0 2024-09-22T08:33:05.049 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-22T08:33:04.770+0000 7f8cceccc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:05.049 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-22T08:33:04.770+0000 7f8cceccc640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:05.049 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-22T08:33:04.770+0000 7f8cceccc640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:05.049 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-22T08:33:04.770+0000 7f8cceccc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:05.049 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-22T08:33:04.770+0000 7f8cceccc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:05.049 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-22T08:33:04.770+0000 7f8cceccc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:05.049 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-22T08:33:04.770+0000 7f8cce4cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:05.049 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-22T08:33:04.770+0000 7f8cce4cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:05.049 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-22T08:33:04.770+0000 7f8cce4cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:05.050 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-22T08:33:04.770+0000 7f8cceccc640 10 monclient(hunting): handle_auth_done global_id 5948 payload 824 2024-09-22T08:33:05.050 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-22T08:33:04.770+0000 7f8cceccc640 10 monclient: _finish_hunting 0 2024-09-22T08:33:05.050 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-22T08:33:04.770+0000 7f8cceccc640 1 monclient: found mon.noname-c 2024-09-22T08:33:05.050 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-22T08:33:04.770+0000 7f8cceccc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:33:05.050 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-22T08:33:04.770+0000 7f8bbae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:33:05.050 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-22T08:33:04.770+0000 7f8bbae05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:33:05.050 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-22T08:33:04.770+0000 7f8bbae05640 10 monclient: dump: 2024-09-22T08:33:05.050 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:33:05.050 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:33:05.050 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:05.050 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:05.050 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:33:05.050 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:05.050 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:33:05.051 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:33:05.051 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:33:05.051 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.051 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-22T08:33:04.770+0000 7f8bbae05640 10 monclient: _finish_auth 0 2024-09-22T08:33:05.051 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-22T08:33:04.770+0000 7f8bbae05640 10 monclient: _check_auth_tickets 2024-09-22T08:33:05.051 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-22T08:33:04.770+0000 7f8bbae05640 10 monclient: handle_config config(0 keys) 2024-09-22T08:33:05.051 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-22T08:33:04.770+0000 7f8bbae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:33:05.051 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-22T08:33:04.770+0000 7f8bbae05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:33:05.051 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-22T08:33:04.770+0000 7f8bbae05640 10 monclient: dump: 2024-09-22T08:33:05.051 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:33:05.051 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:33:05.053 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:05.053 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:05.053 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:33:05.053 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:05.053 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:33:05.054 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:33:05.054 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:33:05.054 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.054 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-22T08:33:04.770+0000 7f8cd2e12800 5 monclient: authenticate success, global_id 5948 2024-09-22T08:33:05.054 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-22T08:33:04.770+0000 7f8cd2e12800 10 monclient: _renew_subs 2024-09-22T08:33:05.054 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-22T08:33:04.770+0000 7f8bbc608640 4 set_mon_vals no callback set 2024-09-22T08:33:05.054 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-22T08:33:04.770+0000 7f8cd2e12800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:33:05.054 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-22T08:33:04.770+0000 7f8cd2e12800 10 monclient: _renew_subs 2024-09-22T08:33:05.054 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-22T08:33:04.770+0000 7f8cd2e12800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:33:05.054 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-22T08:33:04.770+0000 7f8cd2e12800 1 librados: init done 2024-09-22T08:33:05.054 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-22T08:33:04.772+0000 7f8bbae05640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:33:05.054 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-22T08:33:04.772+0000 7f8bbae05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:33:05.054 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-22T08:33:04.772+0000 7f8bbae05640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:33:05.054 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-22T08:33:04.773+0000 7f8cce4cb640 10 monclient: get_auth_request con 0x7f8bb4077570 auth_method 0 2024-09-22T08:33:05.055 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-22T08:33:04.773+0000 7f8ccdcca640 10 monclient: get_auth_request con 0x56237c1b1b80 auth_method 0 2024-09-22T08:33:05.055 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-22T08:33:04.774+0000 7f8cce4cb640 10 monclient: get_auth_request con 0x56237c1b4b30 auth_method 0 2024-09-22T08:33:05.055 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-22T08:33:04.774+0000 7f8ccdcca640 10 monclient: get_auth_request con 0x56237c1b8e90 auth_method 0 2024-09-22T08:33:05.055 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-22T08:33:04.775+0000 7f8cceccc640 10 monclient: get_auth_request con 0x56237c1b83b0 auth_method 0 2024-09-22T08:33:05.055 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-22T08:33:04.776+0000 7f8cd2e12800 10 monclient: build_initial_monmap 2024-09-22T08:33:05.055 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-22T08:33:04.776+0000 7f8cd2e12800 1 build_initial for_mkfs: 0 2024-09-22T08:33:05.055 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-22T08:33:04.776+0000 7f8cd2e12800 10 monclient: monmap: 2024-09-22T08:33:05.055 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:33:05.055 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:33:05.055 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:33:05.056 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:33:05.056 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:33:05.056 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:05.056 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:33:05.056 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:33:05.056 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:33:05.056 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.056 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-22T08:33:04.776+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1c0ee0) adding auth protocol: cephx 2024-09-22T08:33:05.056 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-22T08:33:04.776+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1c0ee0) adding auth protocol: cephx 2024-09-22T08:33:05.056 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-22T08:33:04.776+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1c0ee0) adding auth protocol: cephx 2024-09-22T08:33:05.056 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-22T08:33:04.776+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1c0ee0) adding con mode: secure 2024-09-22T08:33:05.056 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-22T08:33:04.776+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1c0ee0) adding con mode: crc 2024-09-22T08:33:05.056 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-22T08:33:04.776+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1c0ee0) adding con mode: secure 2024-09-22T08:33:05.056 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-22T08:33:04.776+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1c0ee0) adding con mode: crc 2024-09-22T08:33:05.057 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-22T08:33:04.776+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1c0ee0) adding con mode: secure 2024-09-22T08:33:05.057 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-22T08:33:04.776+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1c0ee0) adding con mode: crc 2024-09-22T08:33:05.057 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-22T08:33:04.776+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1c0ee0) adding con mode: crc 2024-09-22T08:33:05.057 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-22T08:33:04.776+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1c0ee0) adding con mode: secure 2024-09-22T08:33:05.057 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-22T08:33:04.776+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1c0ee0) adding con mode: crc 2024-09-22T08:33:05.057 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-22T08:33:04.776+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1c0ee0) adding con mode: secure 2024-09-22T08:33:05.057 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-22T08:33:04.776+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1c0ee0) adding con mode: crc 2024-09-22T08:33:05.057 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-22T08:33:04.776+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1c0ee0) adding con mode: secure 2024-09-22T08:33:05.057 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:05.057 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 5 asok(0x56237bf470f0) register_command objecter_requests cmddesc objecter_requests hook 0x56237c1c43f0 EEXIST 2024-09-22T08:33:05.057 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 10 monclient: init 2024-09-22T08:33:05.057 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1bfe28) adding auth protocol: cephx 2024-09-22T08:33:05.057 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1bfe28) adding auth protocol: cephx 2024-09-22T08:33:05.058 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1bfe28) adding auth protocol: cephx 2024-09-22T08:33:05.058 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1bfe28) adding con mode: secure 2024-09-22T08:33:05.058 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1bfe28) adding con mode: crc 2024-09-22T08:33:05.058 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1bfe28) adding con mode: secure 2024-09-22T08:33:05.058 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1bfe28) adding con mode: crc 2024-09-22T08:33:05.058 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1bfe28) adding con mode: secure 2024-09-22T08:33:05.058 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1bfe28) adding con mode: crc 2024-09-22T08:33:05.058 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1bfe28) adding con mode: crc 2024-09-22T08:33:05.058 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1bfe28) adding con mode: secure 2024-09-22T08:33:05.058 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1bfe28) adding con mode: crc 2024-09-22T08:33:05.058 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1bfe28) adding con mode: secure 2024-09-22T08:33:05.058 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1bfe28) adding con mode: crc 2024-09-22T08:33:05.058 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1bfe28) adding con mode: secure 2024-09-22T08:33:05.059 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:05.059 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:05.059 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 5 asok(0x56237bf470f0) register_command rotate-key cmddesc rotate-key hook 0x56237c1bff70 EEXIST 2024-09-22T08:33:05.059 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 10 monclient: _reopen_session rank -1 2024-09-22T08:33:05.059 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T08:33:05.059 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 10 monclient(hunting): picked mon.noname-a con 0x56237c1e8710 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:33:05.059 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 10 monclient(hunting): picked mon.noname-c con 0x56237c1e8af0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:33:05.059 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 10 monclient(hunting): picked mon.noname-b con 0x56237c1e7420 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:33:05.059 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:05.059 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:05.059 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:05.059 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 10 monclient(hunting): _renew_subs 2024-09-22T08:33:05.059 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 10 monclient(hunting): authenticate will time out at 1890.017822s 2024-09-22T08:33:05.059 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-22T08:33:04.777+0000 7f8cceccc640 10 monclient(hunting): get_auth_request con 0x56237c1e8af0 auth_method 0 2024-09-22T08:33:05.060 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-22T08:33:04.777+0000 7f8cceccc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:05.060 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-22T08:33:04.777+0000 7f8cceccc640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:05.060 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-22T08:33:04.777+0000 7f8cceccc640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:05.060 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-22T08:33:04.777+0000 7f8ccdcca640 10 monclient(hunting): get_auth_request con 0x56237c1e8710 auth_method 0 2024-09-22T08:33:05.060 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-22T08:33:04.777+0000 7f8ccdcca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:05.060 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-22T08:33:04.777+0000 7f8ccdcca640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:05.060 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-22T08:33:04.777+0000 7f8ccdcca640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:05.060 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-22T08:33:04.777+0000 7f8cce4cb640 10 monclient(hunting): get_auth_request con 0x56237c1e7420 auth_method 0 2024-09-22T08:33:05.060 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-22T08:33:04.777+0000 7f8cce4cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:05.060 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-22T08:33:04.777+0000 7f8cce4cb640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:05.060 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-22T08:33:04.777+0000 7f8cce4cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:05.060 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-22T08:33:04.778+0000 7f8cceccc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:05.060 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-22T08:33:04.778+0000 7f8cceccc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:05.060 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-22T08:33:04.778+0000 7f8cceccc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:05.060 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-22T08:33:04.778+0000 7f8ccdcca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:05.061 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-22T08:33:04.778+0000 7f8ccdcca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:05.061 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-22T08:33:04.778+0000 7f8ccdcca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:05.061 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-22T08:33:04.778+0000 7f8cce4cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:05.061 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-22T08:33:04.778+0000 7f8cce4cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:05.061 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-22T08:33:04.778+0000 7f8cce4cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:05.061 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-22T08:33:04.778+0000 7f8cceccc640 10 monclient(hunting): handle_auth_done global_id 5951 payload 824 2024-09-22T08:33:05.061 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-22T08:33:04.778+0000 7f8cceccc640 10 monclient: _finish_hunting 0 2024-09-22T08:33:05.061 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-22T08:33:04.778+0000 7f8cceccc640 1 monclient: found mon.noname-c 2024-09-22T08:33:05.061 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-22T08:33:04.778+0000 7f8cceccc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:33:05.061 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-22T08:33:04.778+0000 7f8bb3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:33:05.061 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-22T08:33:04.778+0000 7f8bb3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:33:05.061 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-22T08:33:04.778+0000 7f8bb3fff640 10 monclient: dump: 2024-09-22T08:33:05.061 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:33:05.062 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:33:05.062 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:05.062 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:05.062 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:33:05.062 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:05.062 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:33:05.062 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:33:05.062 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:33:05.062 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.062 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-22T08:33:04.778+0000 7f8bb3fff640 10 monclient: _finish_auth 0 2024-09-22T08:33:05.062 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-22T08:33:04.778+0000 7f8bb3fff640 10 monclient: _check_auth_tickets 2024-09-22T08:33:05.062 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-22T08:33:04.778+0000 7f8bb3fff640 10 monclient: handle_config config(0 keys) 2024-09-22T08:33:05.062 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-22T08:33:04.778+0000 7f8bb3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:33:05.062 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-22T08:33:04.778+0000 7f8bb3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:33:05.063 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-22T08:33:04.778+0000 7f8bb3fff640 10 monclient: dump: 2024-09-22T08:33:05.063 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:33:05.063 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:33:05.063 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:05.063 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:05.063 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:33:05.063 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:05.063 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:33:05.063 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:33:05.063 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:33:05.063 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.063 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-22T08:33:04.778+0000 7f8cd2e12800 5 monclient: authenticate success, global_id 5951 2024-09-22T08:33:05.063 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-22T08:33:04.778+0000 7f8cd2e12800 10 monclient: _renew_subs 2024-09-22T08:33:05.063 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-22T08:33:04.778+0000 7f8cd2e12800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:33:05.063 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-22T08:33:04.778+0000 7f8ccf4cd640 4 set_mon_vals no callback set 2024-09-22T08:33:05.064 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-22T08:33:04.778+0000 7f8cd2e12800 10 monclient: _renew_subs 2024-09-22T08:33:05.064 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-22T08:33:04.778+0000 7f8cd2e12800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:33:05.064 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-22T08:33:04.780+0000 7f8bb3fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:33:05.064 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-22T08:33:04.780+0000 7f8bb3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:33:05.064 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-22T08:33:04.780+0000 7f8bb3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:33:05.064 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 10 monclient: get_monmap_and_config 2024-09-22T08:33:05.064 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 10 monclient: build_initial_monmap 2024-09-22T08:33:05.064 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 1 build_initial for_mkfs: 0 2024-09-22T08:33:05.064 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 10 monclient: monmap: 2024-09-22T08:33:05.064 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:33:05.064 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:33:05.064 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:33:05.064 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:33:05.064 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:33:05.064 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:05.065 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:33:05.065 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:33:05.065 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:33:05.065 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.065 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x56237c208600) adding auth protocol: cephx 2024-09-22T08:33:05.065 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x56237c208600) adding auth protocol: cephx 2024-09-22T08:33:05.065 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x56237c208600) adding auth protocol: cephx 2024-09-22T08:33:05.065 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x56237c208600) adding con mode: secure 2024-09-22T08:33:05.065 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x56237c208600) adding con mode: crc 2024-09-22T08:33:05.065 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x56237c208600) adding con mode: secure 2024-09-22T08:33:05.065 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x56237c208600) adding con mode: crc 2024-09-22T08:33:05.065 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x56237c208600) adding con mode: secure 2024-09-22T08:33:05.065 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x56237c208600) adding con mode: crc 2024-09-22T08:33:05.065 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x56237c208600) adding con mode: crc 2024-09-22T08:33:05.066 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x56237c208600) adding con mode: secure 2024-09-22T08:33:05.066 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x56237c208600) adding con mode: crc 2024-09-22T08:33:05.066 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x56237c208600) adding con mode: secure 2024-09-22T08:33:05.066 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x56237c208600) adding con mode: crc 2024-09-22T08:33:05.066 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x56237c208600) adding con mode: secure 2024-09-22T08:33:05.066 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-22T08:33:04.780+0000 7f8ccdcca640 10 monclient: get_auth_request con 0x7f8ba8077480 auth_method 0 2024-09-22T08:33:05.066 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:05.066 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 10 monclient: init 2024-09-22T08:33:05.066 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64a8a0) adding auth protocol: cephx 2024-09-22T08:33:05.066 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64a8a0) adding auth protocol: cephx 2024-09-22T08:33:05.066 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64a8a0) adding auth protocol: cephx 2024-09-22T08:33:05.066 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64a8a0) adding con mode: secure 2024-09-22T08:33:05.066 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64a8a0) adding con mode: crc 2024-09-22T08:33:05.066 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64a8a0) adding con mode: secure 2024-09-22T08:33:05.066 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64a8a0) adding con mode: crc 2024-09-22T08:33:05.067 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64a8a0) adding con mode: secure 2024-09-22T08:33:05.067 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64a8a0) adding con mode: crc 2024-09-22T08:33:05.067 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64a8a0) adding con mode: crc 2024-09-22T08:33:05.067 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64a8a0) adding con mode: secure 2024-09-22T08:33:05.067 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64a8a0) adding con mode: crc 2024-09-22T08:33:05.067 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64a8a0) adding con mode: secure 2024-09-22T08:33:05.067 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64a8a0) adding con mode: crc 2024-09-22T08:33:05.067 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64a8a0) adding con mode: secure 2024-09-22T08:33:05.067 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-22T08:33:04.781+0000 7f8cd2e12800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:05.067 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-22T08:33:04.781+0000 7f8cd2e12800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:05.067 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-22T08:33:04.781+0000 7f8cd2e12800 5 asok(0x56237bf470f0) register_command rotate-key cmddesc rotate-key hook 0x7ffe5e64a9e8 EEXIST 2024-09-22T08:33:05.067 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-22T08:33:04.781+0000 7f8cd2e12800 10 monclient: _reopen_session rank -1 2024-09-22T08:33:05.067 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-22T08:33:04.781+0000 7f8cd2e12800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T08:33:05.067 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-22T08:33:04.781+0000 7f8cd2e12800 10 monclient(hunting): picked mon.noname-a con 0x56237c23cc80 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:33:05.067 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-22T08:33:04.781+0000 7f8cd2e12800 10 monclient(hunting): picked mon.noname-b con 0x56237c20ca90 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:33:05.068 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-22T08:33:04.781+0000 7f8cd2e12800 10 monclient(hunting): picked mon.noname-c con 0x56237c238040 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:33:05.068 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-22T08:33:04.781+0000 7f8cd2e12800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:05.068 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-22T08:33:04.781+0000 7f8cd2e12800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:05.068 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-22T08:33:04.781+0000 7f8cd2e12800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:05.068 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-22T08:33:04.781+0000 7f8cd2e12800 10 monclient(hunting): _renew_subs 2024-09-22T08:33:05.068 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-22T08:33:04.781+0000 7f8cd2e12800 10 monclient(hunting): authenticate will time out at 1890.021500s 2024-09-22T08:33:05.068 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-22T08:33:04.781+0000 7f8ccdcca640 10 monclient(hunting): get_auth_request con 0x56237c23cc80 auth_method 0 2024-09-22T08:33:05.068 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-22T08:33:04.781+0000 7f8ccdcca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:05.068 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-22T08:33:04.781+0000 7f8ccdcca640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:05.068 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-22T08:33:04.781+0000 7f8ccdcca640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:05.068 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-22T08:33:04.781+0000 7f8cce4cb640 10 monclient(hunting): get_auth_request con 0x56237c238040 auth_method 0 2024-09-22T08:33:05.068 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-22T08:33:04.781+0000 7f8cce4cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:05.068 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-22T08:33:04.781+0000 7f8cce4cb640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:05.069 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-22T08:33:04.781+0000 7f8cce4cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:05.069 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-22T08:33:04.781+0000 7f8cceccc640 10 monclient(hunting): get_auth_request con 0x56237c20ca90 auth_method 0 2024-09-22T08:33:05.069 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-22T08:33:04.781+0000 7f8cceccc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:05.069 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-22T08:33:04.781+0000 7f8cceccc640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:05.069 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-22T08:33:04.781+0000 7f8cceccc640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:05.069 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-22T08:33:04.781+0000 7f8ccdcca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:05.069 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-22T08:33:04.781+0000 7f8ccdcca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:05.069 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-22T08:33:04.781+0000 7f8ccdcca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:05.069 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-22T08:33:04.781+0000 7f8cce4cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:05.069 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-22T08:33:04.781+0000 7f8cce4cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:05.069 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-22T08:33:04.781+0000 7f8cce4cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:05.069 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-22T08:33:04.781+0000 7f8cceccc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:05.069 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-22T08:33:04.781+0000 7f8cceccc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:05.069 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-22T08:33:04.781+0000 7f8cceccc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:05.070 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-22T08:33:04.781+0000 7f8ccdcca640 10 monclient(hunting): handle_auth_done global_id 6267 payload 274 2024-09-22T08:33:05.070 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-22T08:33:04.781+0000 7f8ccdcca640 10 monclient: _finish_hunting 0 2024-09-22T08:33:05.070 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-22T08:33:04.781+0000 7f8ccdcca640 1 monclient: found mon.noname-a 2024-09-22T08:33:05.070 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-22T08:33:04.781+0000 7f8ccdcca640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:33:05.070 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-22T08:33:04.782+0000 7f8bb1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:33:05.070 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-22T08:33:04.782+0000 7f8bb1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:33:05.070 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-22T08:33:04.782+0000 7f8bb1ffb640 10 monclient: dump: 2024-09-22T08:33:05.070 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:33:05.070 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:33:05.070 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:05.070 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:05.070 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:33:05.070 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:05.070 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:33:05.071 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:33:05.071 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:33:05.071 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.071 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-22T08:33:04.782+0000 7f8bb1ffb640 10 monclient: _finish_auth 0 2024-09-22T08:33:05.071 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-22T08:33:04.782+0000 7f8bb1ffb640 10 monclient: _check_auth_tickets 2024-09-22T08:33:05.071 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-22T08:33:04.782+0000 7f8bb1ffb640 10 monclient: handle_config config(0 keys) 2024-09-22T08:33:05.071 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-22T08:33:04.782+0000 7f8bb1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:33:05.071 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-22T08:33:04.782+0000 7f8bb1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:33:05.071 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-22T08:33:04.782+0000 7f8bb1ffb640 10 monclient: dump: 2024-09-22T08:33:05.071 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:33:05.071 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:33:05.071 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:05.071 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:05.071 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:33:05.071 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:05.072 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:33:05.072 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:33:05.072 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:33:05.072 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.072 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 5 monclient: authenticate success, global_id 6267 2024-09-22T08:33:05.072 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 10 monclient: get_monmap_and_config success 2024-09-22T08:33:05.072 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 4 set_mon_vals no callback set 2024-09-22T08:33:05.072 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 10 monclient: shutdown 2024-09-22T08:33:05.072 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 10 monclient: build_initial_monmap 2024-09-22T08:33:05.072 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 1 build_initial for_mkfs: 0 2024-09-22T08:33:05.072 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 10 monclient: monmap: 2024-09-22T08:33:05.072 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:33:05.072 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:33:05.072 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:33:05.072 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:33:05.073 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:33:05.073 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:05.073 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:33:05.073 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:33:05.073 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:33:05.073 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.073 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 5 AuthRegistry(0x56237c20d8d0) adding auth protocol: cephx 2024-09-22T08:33:05.073 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 5 AuthRegistry(0x56237c20d8d0) adding auth protocol: cephx 2024-09-22T08:33:05.073 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 5 AuthRegistry(0x56237c20d8d0) adding auth protocol: cephx 2024-09-22T08:33:05.073 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 5 AuthRegistry(0x56237c20d8d0) adding con mode: secure 2024-09-22T08:33:05.073 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 5 AuthRegistry(0x56237c20d8d0) adding con mode: crc 2024-09-22T08:33:05.073 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 5 AuthRegistry(0x56237c20d8d0) adding con mode: secure 2024-09-22T08:33:05.073 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 5 AuthRegistry(0x56237c20d8d0) adding con mode: crc 2024-09-22T08:33:05.073 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 5 AuthRegistry(0x56237c20d8d0) adding con mode: secure 2024-09-22T08:33:05.073 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 5 AuthRegistry(0x56237c20d8d0) adding con mode: crc 2024-09-22T08:33:05.074 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 5 AuthRegistry(0x56237c20d8d0) adding con mode: crc 2024-09-22T08:33:05.074 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 5 AuthRegistry(0x56237c20d8d0) adding con mode: secure 2024-09-22T08:33:05.074 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 5 AuthRegistry(0x56237c20d8d0) adding con mode: crc 2024-09-22T08:33:05.074 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 5 AuthRegistry(0x56237c20d8d0) adding con mode: secure 2024-09-22T08:33:05.074 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 5 AuthRegistry(0x56237c20d8d0) adding con mode: crc 2024-09-22T08:33:05.074 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 5 AuthRegistry(0x56237c20d8d0) adding con mode: secure 2024-09-22T08:33:05.074 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:05.074 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 1 librados: starting msgr at 2024-09-22T08:33:05.074 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 1 librados: starting objecter 2024-09-22T08:33:05.074 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 5 asok(0x56237bf470f0) register_command objecter_requests cmddesc objecter_requests hook 0x56237c22f9f0 EEXIST 2024-09-22T08:33:05.074 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 1 librados: setting wanted keys 2024-09-22T08:33:05.074 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 1 librados: calling monclient init 2024-09-22T08:33:05.074 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 10 monclient: init 2024-09-22T08:33:05.074 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1fcfd0) adding auth protocol: cephx 2024-09-22T08:33:05.075 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1fcfd0) adding auth protocol: cephx 2024-09-22T08:33:05.075 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1fcfd0) adding auth protocol: cephx 2024-09-22T08:33:05.075 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1fcfd0) adding con mode: secure 2024-09-22T08:33:05.075 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1fcfd0) adding con mode: crc 2024-09-22T08:33:05.075 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1fcfd0) adding con mode: secure 2024-09-22T08:33:05.075 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1fcfd0) adding con mode: crc 2024-09-22T08:33:05.075 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1fcfd0) adding con mode: secure 2024-09-22T08:33:05.075 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1fcfd0) adding con mode: crc 2024-09-22T08:33:05.075 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1fcfd0) adding con mode: crc 2024-09-22T08:33:05.075 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1fcfd0) adding con mode: secure 2024-09-22T08:33:05.075 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1fcfd0) adding con mode: crc 2024-09-22T08:33:05.075 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1fcfd0) adding con mode: secure 2024-09-22T08:33:05.075 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1fcfd0) adding con mode: crc 2024-09-22T08:33:05.075 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1fcfd0) adding con mode: secure 2024-09-22T08:33:05.076 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:05.076 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:05.076 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 5 asok(0x56237bf470f0) register_command rotate-key cmddesc rotate-key hook 0x56237c1fd118 EEXIST 2024-09-22T08:33:05.076 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 10 monclient: _reopen_session rank -1 2024-09-22T08:33:05.076 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T08:33:05.076 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 10 monclient(hunting): picked mon.noname-a con 0x56237c20ca90 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:33:05.076 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 10 monclient(hunting): picked mon.noname-b con 0x56237c238040 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:33:05.076 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 10 monclient(hunting): picked mon.noname-c con 0x56237c23cc80 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:33:05.076 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:05.076 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:05.076 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:05.076 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 10 monclient(hunting): _renew_subs 2024-09-22T08:33:05.076 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 10 monclient(hunting): authenticate will time out at 1890.023760s 2024-09-22T08:33:05.076 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-22T08:33:04.783+0000 7f8ccdcca640 10 monclient(hunting): get_auth_request con 0x56237c20ca90 auth_method 0 2024-09-22T08:33:05.076 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-22T08:33:04.783+0000 7f8ccdcca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:05.077 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-22T08:33:04.783+0000 7f8ccdcca640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:05.077 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-22T08:33:04.783+0000 7f8ccdcca640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:05.077 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-22T08:33:04.783+0000 7f8cce4cb640 10 monclient(hunting): get_auth_request con 0x56237c23cc80 auth_method 0 2024-09-22T08:33:05.077 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-22T08:33:04.783+0000 7f8cce4cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:05.077 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-22T08:33:04.783+0000 7f8cce4cb640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:05.077 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-22T08:33:04.783+0000 7f8cce4cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:05.077 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-22T08:33:04.783+0000 7f8cceccc640 10 monclient(hunting): get_auth_request con 0x56237c238040 auth_method 0 2024-09-22T08:33:05.077 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-22T08:33:04.783+0000 7f8cceccc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:05.077 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-22T08:33:04.783+0000 7f8cceccc640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:05.077 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-22T08:33:04.783+0000 7f8cceccc640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:05.077 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-22T08:33:04.783+0000 7f8ccdcca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:05.078 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-22T08:33:04.783+0000 7f8ccdcca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:05.078 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-22T08:33:04.783+0000 7f8ccdcca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:05.078 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-22T08:33:04.783+0000 7f8cce4cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:05.078 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-22T08:33:04.783+0000 7f8cce4cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:05.078 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-22T08:33:04.783+0000 7f8cce4cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:05.078 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-22T08:33:04.783+0000 7f8cceccc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:05.078 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-22T08:33:04.783+0000 7f8cceccc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:05.078 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-22T08:33:04.783+0000 7f8cceccc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:05.078 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-22T08:33:04.784+0000 7f8ccdcca640 10 monclient(hunting): handle_auth_done global_id 6270 payload 824 2024-09-22T08:33:05.078 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-22T08:33:04.784+0000 7f8ccdcca640 10 monclient: _finish_hunting 0 2024-09-22T08:33:05.078 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-22T08:33:04.784+0000 7f8ccdcca640 1 monclient: found mon.noname-a 2024-09-22T08:33:05.078 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-22T08:33:04.784+0000 7f8ccdcca640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:33:05.078 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-22T08:33:04.784+0000 7f8b9ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:33:05.078 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-22T08:33:04.784+0000 7f8b9ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:33:05.079 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-22T08:33:04.784+0000 7f8b9ffff640 10 monclient: dump: 2024-09-22T08:33:05.079 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:33:05.079 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:33:05.079 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:05.079 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:05.079 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:33:05.079 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:05.079 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:33:05.079 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:33:05.079 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:33:05.079 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.079 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-22T08:33:04.784+0000 7f8b9ffff640 10 monclient: _finish_auth 0 2024-09-22T08:33:05.079 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-22T08:33:04.784+0000 7f8b9ffff640 10 monclient: _check_auth_tickets 2024-09-22T08:33:05.079 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-22T08:33:04.784+0000 7f8b9ffff640 10 monclient: handle_config config(0 keys) 2024-09-22T08:33:05.080 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-22T08:33:04.784+0000 7f8b9ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:33:05.080 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-22T08:33:04.784+0000 7f8b9ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:33:05.080 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-22T08:33:04.784+0000 7f8b9ffff640 10 monclient: dump: 2024-09-22T08:33:05.080 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:33:05.080 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:33:05.080 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:05.080 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:05.080 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:33:05.080 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:05.080 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:33:05.080 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:33:05.080 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:33:05.080 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.080 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-22T08:33:04.784+0000 7f8cd2e12800 5 monclient: authenticate success, global_id 6270 2024-09-22T08:33:05.080 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-22T08:33:04.784+0000 7f8bb1ffb640 4 set_mon_vals no callback set 2024-09-22T08:33:05.081 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-22T08:33:04.784+0000 7f8cd2e12800 10 monclient: _renew_subs 2024-09-22T08:33:05.081 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-22T08:33:04.784+0000 7f8cd2e12800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:33:05.081 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-22T08:33:04.784+0000 7f8cd2e12800 10 monclient: _renew_subs 2024-09-22T08:33:05.081 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-22T08:33:04.784+0000 7f8cd2e12800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:33:05.081 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-22T08:33:04.784+0000 7f8cd2e12800 1 librados: init done 2024-09-22T08:33:05.081 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-22T08:33:04.784+0000 7f8cd2e12800 5 asok(0x56237bf470f0) register_command cr dump hook 0x56237c22c7a8 2024-09-22T08:33:05.081 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-22T08:33:04.786+0000 7f8cd2e12800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.081 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-22T08:33:04.786+0000 7f8b9ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:33:05.081 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-22T08:33:04.786+0000 7f8b9ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:33:05.081 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-22T08:33:04.786+0000 7f8b9ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:33:05.081 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-22T08:33:04.787+0000 7f8cceccc640 10 monclient: get_auth_request con 0x7f8b98077570 auth_method 0 2024-09-22T08:33:05.081 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-22T08:33:04.787+0000 7f8cce4cb640 10 monclient: get_auth_request con 0x56237c256d60 auth_method 0 2024-09-22T08:33:05.081 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-22T08:33:04.787+0000 7f8cd2e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:05.081 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-22T08:33:04.787+0000 7f8cd2e12800 20 realm 2024-09-22T08:33:05.082 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-22T08:33:04.787+0000 7f8cd2e12800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.082 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-22T08:33:04.788+0000 7f8cd2e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:05.082 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-22T08:33:04.788+0000 7f8cd2e12800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:33:05.082 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-22T08:33:04.788+0000 7f8cd2e12800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.082 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-22T08:33:04.788+0000 7f8cd2e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:05.082 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-22T08:33:04.788+0000 7f8cd2e12800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.082 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-22T08:33:04.788+0000 7f8ccdcca640 10 monclient: get_auth_request con 0x56237c25af80 auth_method 0 2024-09-22T08:33:05.082 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-22T08:33:04.789+0000 7f8cd2e12800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:05.082 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-22T08:33:04.789+0000 7f8cd2e12800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.082 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-22T08:33:04.789+0000 7f8cceccc640 10 monclient: get_auth_request con 0x56237c25e7e0 auth_method 0 2024-09-22T08:33:05.082 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-22T08:33:04.789+0000 7f8cd2e12800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:33:05.082 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-22T08:33:04.789+0000 7f8cd2e12800 20 searching for the correct realm 2024-09-22T08:33:05.082 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-22T08:33:04.790+0000 7f8cce4cb640 10 monclient: get_auth_request con 0x56237c263580 auth_method 0 2024-09-22T08:33:05.082 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-22T08:33:04.791+0000 7f8ccdcca640 10 monclient: get_auth_request con 0x7f8cc4053070 auth_method 0 2024-09-22T08:33:05.083 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-22T08:33:04.791+0000 7f8ccdcca640 0 -- 172.21.15.38:0/319123563 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f8cc4053070 msgr2=0x7f8cc4077500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:05.083 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-22T08:33:04.792+0000 7f8b9ffff640 1 client.6270.objecter ms_handle_reset 0x7f8cc4053070 session 0x7f8cc403b210 osd.0 2024-09-22T08:33:05.083 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-22T08:33:04.792+0000 7f8b9ffff640 10 monclient: _renew_subs 2024-09-22T08:33:05.083 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-22T08:33:04.792+0000 7f8b9ffff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:33:05.083 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-22T08:33:04.792+0000 7f8ccdcca640 10 monclient: get_auth_request con 0x7f8b98087090 auth_method 0 2024-09-22T08:33:05.083 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-22T08:33:04.792+0000 7f8cceccc640 10 monclient: get_auth_request con 0x7f8cc007f040 auth_method 0 2024-09-22T08:33:05.083 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-22T08:33:04.794+0000 7f8cce4cb640 10 monclient: get_auth_request con 0x7f8cc400ec20 auth_method 0 2024-09-22T08:33:05.083 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-22T08:33:04.795+0000 7f8ccdcca640 0 -- 172.21.15.38:0/319123563 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f8cc0099400 msgr2=0x7f8cc0099880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:05.083 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-22T08:33:04.795+0000 7f8ccdcca640 10 monclient: get_auth_request con 0x7f8cc0099400 auth_method 0 2024-09-22T08:33:05.083 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-22T08:33:04.996+0000 7f8ccdcca640 10 monclient: get_auth_request con 0x7f8cc0099400 auth_method 0 2024-09-22T08:33:05.083 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-22T08:33:05.001+0000 7f8cd2e12800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:33:05.083 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-22T08:33:05.001+0000 7f8cd2e12800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:33:05.083 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-22T08:33:05.001+0000 7f8cd2e12800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:33:05.083 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-22T08:33:05.001+0000 7f8cd2e12800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:33:05.083 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-22T08:33:05.001+0000 7f8cd2e12800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:33:05.084 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-22T08:33:05.001+0000 7f8cd2e12800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:33:05.084 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-22T08:33:05.001+0000 7f8cd2e12800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.084 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-22T08:33:05.002+0000 7f8cd2e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:05.084 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-22T08:33:05.002+0000 7f8cd2e12800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.084 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-22T08:33:05.002+0000 7f8cd2e12800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:05.084 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-22T08:33:05.002+0000 7f8cd2e12800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.084 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-22T08:33:05.002+0000 7f8cd2e12800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:33:05.084 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-22T08:33:05.003+0000 7f8cd2e12800 20 zone default found 2024-09-22T08:33:05.084 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-22T08:33:05.003+0000 7f8cd2e12800 4 Realm: () 2024-09-22T08:33:05.084 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-22T08:33:05.003+0000 7f8cd2e12800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:33:05.084 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-22T08:33:05.003+0000 7f8cd2e12800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:33:05.084 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-22T08:33:05.003+0000 7f8cd2e12800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:33:05.084 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-22T08:33:05.003+0000 7f8cd2e12800 20 zonegroup default 2024-09-22T08:33:05.084 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-22T08:33:05.003+0000 7f8cd2e12800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.084 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-22T08:33:05.003+0000 7f8cd2e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:05.085 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-22T08:33:05.003+0000 7f8cd2e12800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.085 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-22T08:33:05.003+0000 7f8cd2e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:05.085 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-22T08:33:05.003+0000 7f8cd2e12800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.085 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-22T08:33:05.003+0000 7f8cd2e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:05.085 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-22T08:33:05.003+0000 7f8cd2e12800 20 started sync module instance, tier type = 2024-09-22T08:33:05.085 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-22T08:33:05.003+0000 7f8cd2e12800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:33:05.085 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-22T08:33:05.012+0000 7f8cd2e12800 20 add_watcher() i=0 2024-09-22T08:33:05.085 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-22T08:33:05.012+0000 7f8cd2e12800 20 add_watcher() i=1 2024-09-22T08:33:05.085 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-22T08:33:05.012+0000 7f8cd2e12800 20 add_watcher() i=2 2024-09-22T08:33:05.085 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-22T08:33:05.012+0000 7f8cd2e12800 20 add_watcher() i=3 2024-09-22T08:33:05.085 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-22T08:33:05.012+0000 7f8cd2e12800 20 add_watcher() i=4 2024-09-22T08:33:05.085 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-22T08:33:05.012+0000 7f8cd2e12800 20 add_watcher() i=5 2024-09-22T08:33:05.085 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-22T08:33:05.012+0000 7f8cd2e12800 20 add_watcher() i=6 2024-09-22T08:33:05.085 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-22T08:33:05.013+0000 7f8cd2e12800 20 add_watcher() i=7 2024-09-22T08:33:05.085 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-22T08:33:05.013+0000 7f8cd2e12800 2 all 8 watchers are set, enabling cache 2024-09-22T08:33:05.085 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64ad70) adding auth protocol: cephx 2024-09-22T08:33:05.086 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64ad70) adding auth protocol: cephx 2024-09-22T08:33:05.086 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64ad70) adding auth protocol: cephx 2024-09-22T08:33:05.086 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64ad70) adding con mode: secure 2024-09-22T08:33:05.086 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64ad70) adding con mode: crc 2024-09-22T08:33:05.086 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64ad70) adding con mode: secure 2024-09-22T08:33:05.086 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64ad70) adding con mode: crc 2024-09-22T08:33:05.086 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64ad70) adding con mode: secure 2024-09-22T08:33:05.086 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64ad70) adding con mode: crc 2024-09-22T08:33:05.086 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64ad70) adding con mode: crc 2024-09-22T08:33:05.086 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64ad70) adding con mode: secure 2024-09-22T08:33:05.086 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64ad70) adding con mode: crc 2024-09-22T08:33:05.086 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64ad70) adding con mode: secure 2024-09-22T08:33:05.086 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64ad70) adding con mode: crc 2024-09-22T08:33:05.086 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64ad70) adding con mode: secure 2024-09-22T08:33:05.087 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-22T08:33:05.015+0000 7f8b84fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:05.087 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:05.087 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:33:05.087 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:33:05.087 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 5 asok(0x56237bf470f0) register_command cache list hook 0x56237c22dff0 2024-09-22T08:33:05.087 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 5 asok(0x56237bf470f0) register_command cache inspect hook 0x56237c22dff0 2024-09-22T08:33:05.087 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 5 asok(0x56237bf470f0) register_command cache erase hook 0x56237c22dff0 2024-09-22T08:33:05.087 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 5 asok(0x56237bf470f0) register_command cache zap hook 0x56237c22dff0 2024-09-22T08:33:05.087 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 5 note: GC not initialized 2024-09-22T08:33:05.087 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-22T08:33:05.015+0000 7f8aff7fe640 20 reqs_thread_entry: start 2024-09-22T08:33:05.087 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-22T08:33:05.016+0000 7f8cd2e12800 5 asok(0x56237bf470f0) register_command sync trace show hook 0x7f8cc001c3e0 2024-09-22T08:33:05.087 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-22T08:33:05.016+0000 7f8cd2e12800 5 asok(0x56237bf470f0) register_command sync trace history hook 0x7f8cc001c3e0 2024-09-22T08:33:05.087 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-22T08:33:05.016+0000 7f8cd2e12800 5 asok(0x56237bf470f0) register_command sync trace active hook 0x7f8cc001c3e0 2024-09-22T08:33:05.087 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-22T08:33:05.016+0000 7f8cd2e12800 5 asok(0x56237bf470f0) register_command sync trace active_short hook 0x7f8cc001c3e0 2024-09-22T08:33:05.088 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-22T08:33:05.016+0000 7f8cd2e12800 20 init_complete bucket index max shards: 11 2024-09-22T08:33:05.088 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-22T08:33:05.016+0000 7f8cd2e12800 20 Filter name: none 2024-09-22T08:33:05.088 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-22T08:33:05.016+0000 7f8afd7fa640 20 reqs_thread_entry: start 2024-09-22T08:33:05.088 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-22T08:33:05.016+0000 7f8cd2e12800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-22T08:33:05.088 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-22T08:33:05.016+0000 7f8cd2e12800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.088 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-22T08:33:05.017+0000 7f8cd2e12800 20 rados_obj.operate() r=0 bl.length=188 2024-09-22T08:33:05.088 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-22T08:33:05.017+0000 7f8cd2e12800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-22T08:33:05.088 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-22T08:33:05.017+0000 7f8cd2e12800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-22T08:33:05.088 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-22T08:33:05.017+0000 7f8cd2e12800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c62f9d7b-f6b6-404a-90de-de5607499115.4584.21 : miss 2024-09-22T08:33:05.088 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-22T08:33:05.017+0000 7f8cd2e12800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.088 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-22T08:33:05.017+0000 7f8cd2e12800 20 rados_obj.operate() r=0 bl.length=410 2024-09-22T08:33:05.088 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-22T08:33:05.017+0000 7f8cd2e12800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c62f9d7b-f6b6-404a-90de-de5607499115.4584.21 info.flags=0x17 2024-09-22T08:33:05.088 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-22T08:33:05.017+0000 7f8cd2e12800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c62f9d7b-f6b6-404a-90de-de5607499115.4584.21 to cache LRU end 2024-09-22T08:33:05.088 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-22T08:33:05.017+0000 7f8cd2e12800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:33:05.088 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-22T08:33:05.017+0000 7f8cd2e12800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:05.089 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-22T08:33:05.017+0000 7f8cd2e12800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c62f9d7b-f6b6-404a-90de-de5607499115.4584.21 2024-09-22T08:33:05.089 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-22T08:33:05.019+0000 7f8cd2e12800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8cd2e12800 time 2024-09-22T08:33:05.020553+0000 2024-09-22T08:33:05.089 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:33:05.089 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.089 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:33:05.089 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8cd3f8c748] 2024-09-22T08:33:05.089 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f8cd3f8c906] 2024-09-22T08:33:05.089 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56237b195e01] 2024-09-22T08:33:05.089 INFO:tasks.workunit.client.0.smithi038.stderr: 4: radosgw-admin(+0xd80ac4) [0x56237b6a7ac4] 2024-09-22T08:33:05.089 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56237b1a5c9d] 2024-09-22T08:33:05.089 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-22T08:33:05.089 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8cd2c29590] 2024-09-22T08:33:05.089 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-22T08:33:05.089 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-22T08:33:05.090 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.090 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-22T08:33:05.020+0000 7f8cd2e12800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:33:05.090 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f8cd2e12800 thread_name:radosgw-admin 2024-09-22T08:33:05.090 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.090 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:33:05.090 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8cd2c3e6f0] 2024-09-22T08:33:05.090 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8cd2c8b99c] 2024-09-22T08:33:05.090 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:33:05.090 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:33:05.090 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8cd3f8c7a2] 2024-09-22T08:33:05.090 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f8cd3f8c906] 2024-09-22T08:33:05.090 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56237b195e01] 2024-09-22T08:33:05.090 INFO:tasks.workunit.client.0.smithi038.stderr: 8: radosgw-admin(+0xd80ac4) [0x56237b6a7ac4] 2024-09-22T08:33:05.090 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56237b1a5c9d] 2024-09-22T08:33:05.090 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-22T08:33:05.091 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8cd2c29590] 2024-09-22T08:33:05.091 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-22T08:33:05.091 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-22T08:33:05.091 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:33:05.091 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.091 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-22T08:33:05.091 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-22T08:33:05.091 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-22T08:33:05.091 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-22T08:33:05.091 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-22T08:33:05.091 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-22T08:33:05.091 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-22T08:33:05.091 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-22T08:33:05.091 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-22T08:33:05.091 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-22T08:33:05.092 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-22T08:33:05.092 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-22T08:33:05.092 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-22T08:33:05.092 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-22T08:33:05.092 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-22T08:33:05.092 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-22T08:33:05.092 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-22T08:33:05.092 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-22T08:33:05.092 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-22T08:33:05.092 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-22T08:33:05.092 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-22T08:33:05.092 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-22T08:33:05.092 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-22T08:33:05.092 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-22T08:33:05.092 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:33:05.092 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-22T08:33:05.093 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-22T08:33:05.093 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-22T08:33:05.093 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-22T08:33:05.093 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-22T08:33:05.093 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-22T08:33:05.093 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-22T08:33:05.093 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-22T08:33:05.093 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-22T08:33:05.093 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-22T08:33:05.093 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-22T08:33:05.093 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-22T08:33:05.093 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-22T08:33:05.093 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-22T08:33:05.093 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-22T08:33:05.093 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-22T08:33:05.094 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-22T08:33:05.094 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-22T08:33:05.094 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-22T08:33:05.094 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-22T08:33:05.094 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-22T08:33:05.094 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:33:05.094 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-22T08:33:05.094 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:33:05.094 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-22T08:33:05.094 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-22T08:33:05.094 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-22T08:33:05.094 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-22T08:33:05.094 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-22T08:33:05.094 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-22T08:33:05.095 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-22T08:33:05.095 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-22T08:33:05.095 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-22T08:33:05.095 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-22T08:33:05.095 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-22T08:33:05.095 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-22T08:33:05.095 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-22T08:33:05.095 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-22T08:33:05.095 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-22T08:33:05.095 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-22T08:33:05.095 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-22T08:33:05.095 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-22T08:33:05.095 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:33:05.095 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-22T08:33:05.095 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:33:05.096 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-22T08:33:05.096 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-22T08:33:05.096 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-22T08:33:05.096 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-22T08:33:05.096 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-22T08:33:05.096 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-22T08:33:05.096 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:33:05.096 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-22T08:33:05.096 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-22T08:33:05.096 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:33:05.096 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-22T08:33:05.096 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-22T08:33:05.096 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-22T08:33:05.096 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-22T08:33:05.097 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-22T08:33:05.097 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-22T08:33:05.097 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-22T08:33:05.097 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-22T08:33:05.097 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-22T08:33:05.097 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-22T08:33:05.097 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-22T08:33:05.097 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-22T08:33:05.097 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-22T08:33:05.097 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:33:05.097 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8afd7fa640 / http_manager 2024-09-22T08:33:05.097 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8aff7fe640 / http_manager 2024-09-22T08:33:05.097 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8b84fe1640 / rgw_dt_lg_renew 2024-09-22T08:33:05.097 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8b9ffff640 / ms_dispatch 2024-09-22T08:33:05.097 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8bb1ffb640 / io_context_pool 2024-09-22T08:33:05.098 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8bb3fff640 / ms_dispatch 2024-09-22T08:33:05.098 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8bbae05640 / ms_dispatch 2024-09-22T08:33:05.098 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8bbc608640 / io_context_pool 2024-09-22T08:33:05.098 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8ccdcca640 / msgr-worker-2 2024-09-22T08:33:05.098 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8cce4cb640 / msgr-worker-1 2024-09-22T08:33:05.098 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8cceccc640 / msgr-worker-0 2024-09-22T08:33:05.098 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8ccf4cd640 / io_context_pool 2024-09-22T08:33:05.098 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8cd2e12800 / radosgw-admin 2024-09-22T08:33:05.098 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-22T08:33:05.098 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-22T08:33:05.098 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/log/ceph/ceph-client.admin.89207.log 2024-09-22T08:33:05.098 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-22T08:33:05.098 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-22T08:33:05.098 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-22T08:33:04.767+0000 7f8ccdcca640 1 monclient: found mon.noname-c 2024-09-22T08:33:05.098 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-22T08:33:04.768+0000 7f8ccdcca640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:33:05.099 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-22T08:33:04.768+0000 7f8bbc608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:33:05.099 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-22T08:33:04.768+0000 7f8bbc608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:33:05.099 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-22T08:33:04.768+0000 7f8bbc608640 10 monclient: dump: 2024-09-22T08:33:05.099 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:33:05.099 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:33:05.099 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:05.099 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:05.099 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:33:05.099 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:05.099 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:33:05.099 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:33:05.099 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:33:05.099 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.099 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-22T08:33:04.768+0000 7f8bbc608640 10 monclient: _finish_auth 0 2024-09-22T08:33:05.099 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-22T08:33:04.768+0000 7f8bbc608640 10 monclient: _check_auth_tickets 2024-09-22T08:33:05.100 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-22T08:33:04.768+0000 7f8bbc608640 10 monclient: handle_config config(0 keys) 2024-09-22T08:33:05.100 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-22T08:33:04.768+0000 7f8bbc608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:33:05.100 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-22T08:33:04.768+0000 7f8bbc608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:33:05.100 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-22T08:33:04.768+0000 7f8bbc608640 10 monclient: dump: 2024-09-22T08:33:05.100 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:33:05.100 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:33:05.100 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:05.100 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:05.100 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:33:05.100 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:05.100 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:33:05.100 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:33:05.100 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:33:05.100 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.100 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-22T08:33:04.768+0000 7f8cd2e12800 5 monclient: authenticate success, global_id 5945 2024-09-22T08:33:05.101 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-22T08:33:04.768+0000 7f8cd2e12800 10 monclient: get_monmap_and_config success 2024-09-22T08:33:05.101 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-22T08:33:04.768+0000 7f8cd2e12800 4 set_mon_vals no callback set 2024-09-22T08:33:05.101 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-22T08:33:04.768+0000 7f8cd2e12800 10 monclient: shutdown 2024-09-22T08:33:05.101 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-22T08:33:04.768+0000 7f8cd2e12800 5 asok(0x56237bf470f0) unregister_commands rotate-key 2024-09-22T08:33:05.101 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 10 monclient: build_initial_monmap 2024-09-22T08:33:05.101 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 1 build_initial for_mkfs: 0 2024-09-22T08:33:05.101 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 10 monclient: monmap: 2024-09-22T08:33:05.101 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:33:05.101 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:33:05.101 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:33:05.101 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:33:05.101 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:33:05.101 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:05.101 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:33:05.101 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:33:05.102 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:33:05.102 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.102 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c16e390) adding auth protocol: cephx 2024-09-22T08:33:05.102 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c16e390) adding auth protocol: cephx 2024-09-22T08:33:05.102 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c16e390) adding auth protocol: cephx 2024-09-22T08:33:05.102 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c16e390) adding con mode: secure 2024-09-22T08:33:05.102 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c16e390) adding con mode: crc 2024-09-22T08:33:05.102 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c16e390) adding con mode: secure 2024-09-22T08:33:05.102 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c16e390) adding con mode: crc 2024-09-22T08:33:05.102 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c16e390) adding con mode: secure 2024-09-22T08:33:05.102 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c16e390) adding con mode: crc 2024-09-22T08:33:05.102 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c16e390) adding con mode: crc 2024-09-22T08:33:05.102 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c16e390) adding con mode: secure 2024-09-22T08:33:05.102 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c16e390) adding con mode: crc 2024-09-22T08:33:05.103 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c16e390) adding con mode: secure 2024-09-22T08:33:05.103 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c16e390) adding con mode: crc 2024-09-22T08:33:05.103 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c16e390) adding con mode: secure 2024-09-22T08:33:05.103 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:05.103 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 1 librados: starting msgr at 2024-09-22T08:33:05.103 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 1 librados: starting objecter 2024-09-22T08:33:05.103 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 asok(0x56237bf470f0) register_command objecter_requests hook 0x56237c170650 2024-09-22T08:33:05.103 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 1 librados: setting wanted keys 2024-09-22T08:33:05.103 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 1 librados: calling monclient init 2024-09-22T08:33:05.103 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 10 monclient: init 2024-09-22T08:33:05.103 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c168db0) adding auth protocol: cephx 2024-09-22T08:33:05.103 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c168db0) adding auth protocol: cephx 2024-09-22T08:33:05.103 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c168db0) adding auth protocol: cephx 2024-09-22T08:33:05.103 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c168db0) adding con mode: secure 2024-09-22T08:33:05.103 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c168db0) adding con mode: crc 2024-09-22T08:33:05.103 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c168db0) adding con mode: secure 2024-09-22T08:33:05.104 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c168db0) adding con mode: crc 2024-09-22T08:33:05.104 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c168db0) adding con mode: secure 2024-09-22T08:33:05.104 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c168db0) adding con mode: crc 2024-09-22T08:33:05.104 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c168db0) adding con mode: crc 2024-09-22T08:33:05.104 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c168db0) adding con mode: secure 2024-09-22T08:33:05.104 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c168db0) adding con mode: crc 2024-09-22T08:33:05.104 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c168db0) adding con mode: secure 2024-09-22T08:33:05.104 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c168db0) adding con mode: crc 2024-09-22T08:33:05.104 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 5 AuthRegistry(0x56237c168db0) adding con mode: secure 2024-09-22T08:33:05.104 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:05.104 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-22T08:33:04.769+0000 7f8cd2e12800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:05.104 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-22T08:33:04.770+0000 7f8cd2e12800 5 asok(0x56237bf470f0) register_command rotate-key hook 0x56237c168ef8 2024-09-22T08:33:05.104 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-22T08:33:04.770+0000 7f8cd2e12800 10 monclient: _reopen_session rank -1 2024-09-22T08:33:05.105 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-22T08:33:04.770+0000 7f8cd2e12800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T08:33:05.105 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-22T08:33:04.770+0000 7f8cd2e12800 10 monclient(hunting): picked mon.noname-a con 0x56237bff2200 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:33:05.105 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-22T08:33:04.770+0000 7f8cd2e12800 10 monclient(hunting): picked mon.noname-b con 0x56237c01d6b0 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:33:05.105 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-22T08:33:04.770+0000 7f8cd2e12800 10 monclient(hunting): picked mon.noname-c con 0x56237c19f920 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:33:05.105 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-22T08:33:04.770+0000 7f8cd2e12800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:05.105 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-22T08:33:04.770+0000 7f8cd2e12800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:05.105 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-22T08:33:04.770+0000 7f8cd2e12800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:05.105 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-22T08:33:04.770+0000 7f8cd2e12800 10 monclient(hunting): _renew_subs 2024-09-22T08:33:05.105 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-22T08:33:04.770+0000 7f8cd2e12800 10 monclient(hunting): authenticate will time out at 1890.010178s 2024-09-22T08:33:05.105 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-22T08:33:04.770+0000 7f8cce4cb640 10 monclient(hunting): get_auth_request con 0x56237bff2200 auth_method 0 2024-09-22T08:33:05.105 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-22T08:33:04.770+0000 7f8cce4cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:05.105 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-22T08:33:04.770+0000 7f8cce4cb640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:05.105 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-22T08:33:04.770+0000 7f8cce4cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:05.105 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-22T08:33:04.770+0000 7f8cceccc640 10 monclient(hunting): get_auth_request con 0x56237c19f920 auth_method 0 2024-09-22T08:33:05.105 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-22T08:33:04.770+0000 7f8cceccc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:05.106 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-22T08:33:04.770+0000 7f8cceccc640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:05.106 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-22T08:33:04.770+0000 7f8cceccc640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:05.106 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-22T08:33:04.770+0000 7f8cceccc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:05.106 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-22T08:33:04.770+0000 7f8cceccc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:05.106 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-22T08:33:04.770+0000 7f8cceccc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:05.106 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-22T08:33:04.770+0000 7f8cce4cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:05.106 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-22T08:33:04.770+0000 7f8cce4cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:05.106 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-22T08:33:04.770+0000 7f8cce4cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:05.106 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-22T08:33:04.770+0000 7f8cceccc640 10 monclient(hunting): handle_auth_done global_id 5948 payload 824 2024-09-22T08:33:05.106 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-22T08:33:04.770+0000 7f8cceccc640 10 monclient: _finish_hunting 0 2024-09-22T08:33:05.106 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-22T08:33:04.770+0000 7f8cceccc640 1 monclient: found mon.noname-c 2024-09-22T08:33:05.106 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-22T08:33:04.770+0000 7f8cceccc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:33:05.106 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-22T08:33:04.770+0000 7f8bbae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:33:05.106 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-22T08:33:04.770+0000 7f8bbae05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:33:05.107 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-22T08:33:04.770+0000 7f8bbae05640 10 monclient: dump: 2024-09-22T08:33:05.107 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:33:05.107 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:33:05.107 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:05.107 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:05.107 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:33:05.107 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:05.107 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:33:05.107 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:33:05.107 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:33:05.107 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.107 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-22T08:33:04.770+0000 7f8bbae05640 10 monclient: _finish_auth 0 2024-09-22T08:33:05.107 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-22T08:33:04.770+0000 7f8bbae05640 10 monclient: _check_auth_tickets 2024-09-22T08:33:05.107 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-22T08:33:04.770+0000 7f8bbae05640 10 monclient: handle_config config(0 keys) 2024-09-22T08:33:05.108 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-22T08:33:04.770+0000 7f8bbae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:33:05.108 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-22T08:33:04.770+0000 7f8bbae05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:33:05.108 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-22T08:33:04.770+0000 7f8bbae05640 10 monclient: dump: 2024-09-22T08:33:05.108 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:33:05.108 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:33:05.108 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:05.108 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:05.108 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:33:05.108 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:05.108 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:33:05.108 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:33:05.108 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:33:05.108 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.108 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-22T08:33:04.770+0000 7f8cd2e12800 5 monclient: authenticate success, global_id 5948 2024-09-22T08:33:05.108 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-22T08:33:04.770+0000 7f8cd2e12800 10 monclient: _renew_subs 2024-09-22T08:33:05.108 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-22T08:33:04.770+0000 7f8bbc608640 4 set_mon_vals no callback set 2024-09-22T08:33:05.109 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-22T08:33:04.770+0000 7f8cd2e12800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:33:05.109 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-22T08:33:04.770+0000 7f8cd2e12800 10 monclient: _renew_subs 2024-09-22T08:33:05.109 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-22T08:33:04.770+0000 7f8cd2e12800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:33:05.109 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-22T08:33:04.770+0000 7f8cd2e12800 1 librados: init done 2024-09-22T08:33:05.109 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-22T08:33:04.772+0000 7f8bbae05640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:33:05.109 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-22T08:33:04.772+0000 7f8bbae05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:33:05.109 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-22T08:33:04.772+0000 7f8bbae05640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:33:05.109 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-22T08:33:04.773+0000 7f8cce4cb640 10 monclient: get_auth_request con 0x7f8bb4077570 auth_method 0 2024-09-22T08:33:05.109 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-22T08:33:04.773+0000 7f8ccdcca640 10 monclient: get_auth_request con 0x56237c1b1b80 auth_method 0 2024-09-22T08:33:05.109 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-22T08:33:04.774+0000 7f8cce4cb640 10 monclient: get_auth_request con 0x56237c1b4b30 auth_method 0 2024-09-22T08:33:05.109 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-22T08:33:04.774+0000 7f8ccdcca640 10 monclient: get_auth_request con 0x56237c1b8e90 auth_method 0 2024-09-22T08:33:05.109 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-22T08:33:04.775+0000 7f8cceccc640 10 monclient: get_auth_request con 0x56237c1b83b0 auth_method 0 2024-09-22T08:33:05.109 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-22T08:33:04.776+0000 7f8cd2e12800 10 monclient: build_initial_monmap 2024-09-22T08:33:05.109 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-22T08:33:04.776+0000 7f8cd2e12800 1 build_initial for_mkfs: 0 2024-09-22T08:33:05.109 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-22T08:33:04.776+0000 7f8cd2e12800 10 monclient: monmap: 2024-09-22T08:33:05.110 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:33:05.110 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:33:05.110 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:33:05.110 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:33:05.110 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:33:05.110 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:05.110 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:33:05.110 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:33:05.110 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:33:05.110 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.110 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-22T08:33:04.776+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1c0ee0) adding auth protocol: cephx 2024-09-22T08:33:05.110 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-22T08:33:04.776+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1c0ee0) adding auth protocol: cephx 2024-09-22T08:33:05.110 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-22T08:33:04.776+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1c0ee0) adding auth protocol: cephx 2024-09-22T08:33:05.110 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-22T08:33:04.776+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1c0ee0) adding con mode: secure 2024-09-22T08:33:05.111 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-22T08:33:04.776+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1c0ee0) adding con mode: crc 2024-09-22T08:33:05.111 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-22T08:33:04.776+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1c0ee0) adding con mode: secure 2024-09-22T08:33:05.111 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-22T08:33:04.776+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1c0ee0) adding con mode: crc 2024-09-22T08:33:05.111 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-22T08:33:04.776+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1c0ee0) adding con mode: secure 2024-09-22T08:33:05.111 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-22T08:33:04.776+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1c0ee0) adding con mode: crc 2024-09-22T08:33:05.111 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-22T08:33:04.776+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1c0ee0) adding con mode: crc 2024-09-22T08:33:05.111 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-22T08:33:04.776+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1c0ee0) adding con mode: secure 2024-09-22T08:33:05.111 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-22T08:33:04.776+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1c0ee0) adding con mode: crc 2024-09-22T08:33:05.111 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-22T08:33:04.776+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1c0ee0) adding con mode: secure 2024-09-22T08:33:05.111 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-22T08:33:04.776+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1c0ee0) adding con mode: crc 2024-09-22T08:33:05.111 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-22T08:33:04.776+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1c0ee0) adding con mode: secure 2024-09-22T08:33:05.111 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:05.111 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 5 asok(0x56237bf470f0) register_command objecter_requests cmddesc objecter_requests hook 0x56237c1c43f0 EEXIST 2024-09-22T08:33:05.111 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 10 monclient: init 2024-09-22T08:33:05.111 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1bfe28) adding auth protocol: cephx 2024-09-22T08:33:05.112 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1bfe28) adding auth protocol: cephx 2024-09-22T08:33:05.112 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1bfe28) adding auth protocol: cephx 2024-09-22T08:33:05.112 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1bfe28) adding con mode: secure 2024-09-22T08:33:05.112 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1bfe28) adding con mode: crc 2024-09-22T08:33:05.112 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1bfe28) adding con mode: secure 2024-09-22T08:33:05.112 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1bfe28) adding con mode: crc 2024-09-22T08:33:05.112 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1bfe28) adding con mode: secure 2024-09-22T08:33:05.112 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1bfe28) adding con mode: crc 2024-09-22T08:33:05.112 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1bfe28) adding con mode: crc 2024-09-22T08:33:05.112 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1bfe28) adding con mode: secure 2024-09-22T08:33:05.112 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1bfe28) adding con mode: crc 2024-09-22T08:33:05.112 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1bfe28) adding con mode: secure 2024-09-22T08:33:05.112 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1bfe28) adding con mode: crc 2024-09-22T08:33:05.112 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1bfe28) adding con mode: secure 2024-09-22T08:33:05.112 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:05.113 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:05.113 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 5 asok(0x56237bf470f0) register_command rotate-key cmddesc rotate-key hook 0x56237c1bff70 EEXIST 2024-09-22T08:33:05.113 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 10 monclient: _reopen_session rank -1 2024-09-22T08:33:05.113 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T08:33:05.113 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 10 monclient(hunting): picked mon.noname-a con 0x56237c1e8710 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:33:05.113 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 10 monclient(hunting): picked mon.noname-c con 0x56237c1e8af0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:33:05.113 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 10 monclient(hunting): picked mon.noname-b con 0x56237c1e7420 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:33:05.113 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:05.113 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:05.113 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:05.113 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 10 monclient(hunting): _renew_subs 2024-09-22T08:33:05.113 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-22T08:33:04.777+0000 7f8cd2e12800 10 monclient(hunting): authenticate will time out at 1890.017822s 2024-09-22T08:33:05.113 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-22T08:33:04.777+0000 7f8cceccc640 10 monclient(hunting): get_auth_request con 0x56237c1e8af0 auth_method 0 2024-09-22T08:33:05.113 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-22T08:33:04.777+0000 7f8cceccc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:05.113 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-22T08:33:04.777+0000 7f8cceccc640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:05.114 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-22T08:33:04.777+0000 7f8cceccc640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:05.114 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-22T08:33:04.777+0000 7f8ccdcca640 10 monclient(hunting): get_auth_request con 0x56237c1e8710 auth_method 0 2024-09-22T08:33:05.114 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-22T08:33:04.777+0000 7f8ccdcca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:05.114 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-22T08:33:04.777+0000 7f8ccdcca640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:05.114 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-22T08:33:04.777+0000 7f8ccdcca640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:05.114 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-22T08:33:04.777+0000 7f8cce4cb640 10 monclient(hunting): get_auth_request con 0x56237c1e7420 auth_method 0 2024-09-22T08:33:05.114 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-22T08:33:04.777+0000 7f8cce4cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:05.114 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-22T08:33:04.777+0000 7f8cce4cb640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:05.114 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-22T08:33:04.777+0000 7f8cce4cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:05.114 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-22T08:33:04.778+0000 7f8cceccc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:05.114 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-22T08:33:04.778+0000 7f8cceccc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:05.115 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-22T08:33:04.778+0000 7f8cceccc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:05.115 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-22T08:33:04.778+0000 7f8ccdcca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:05.115 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-22T08:33:04.778+0000 7f8ccdcca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:05.115 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-22T08:33:04.778+0000 7f8ccdcca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:05.115 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-22T08:33:04.778+0000 7f8cce4cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:05.115 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-22T08:33:04.778+0000 7f8cce4cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:05.115 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-22T08:33:04.778+0000 7f8cce4cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:05.115 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-22T08:33:04.778+0000 7f8cceccc640 10 monclient(hunting): handle_auth_done global_id 5951 payload 824 2024-09-22T08:33:05.115 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-22T08:33:04.778+0000 7f8cceccc640 10 monclient: _finish_hunting 0 2024-09-22T08:33:05.115 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-22T08:33:04.778+0000 7f8cceccc640 1 monclient: found mon.noname-c 2024-09-22T08:33:05.115 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-22T08:33:04.778+0000 7f8cceccc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:33:05.115 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-22T08:33:04.778+0000 7f8bb3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:33:05.115 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-22T08:33:04.778+0000 7f8bb3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:33:05.115 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-22T08:33:04.778+0000 7f8bb3fff640 10 monclient: dump: 2024-09-22T08:33:05.116 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:33:05.116 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:33:05.116 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:05.116 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:05.116 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:33:05.116 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:05.116 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:33:05.116 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:33:05.116 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:33:05.116 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.116 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-22T08:33:04.778+0000 7f8bb3fff640 10 monclient: _finish_auth 0 2024-09-22T08:33:05.116 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-22T08:33:04.778+0000 7f8bb3fff640 10 monclient: _check_auth_tickets 2024-09-22T08:33:05.116 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-22T08:33:04.778+0000 7f8bb3fff640 10 monclient: handle_config config(0 keys) 2024-09-22T08:33:05.116 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-22T08:33:04.778+0000 7f8bb3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:33:05.116 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-22T08:33:04.778+0000 7f8bb3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:33:05.117 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-22T08:33:04.778+0000 7f8bb3fff640 10 monclient: dump: 2024-09-22T08:33:05.117 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:33:05.117 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:33:05.117 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:05.117 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:05.117 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:33:05.117 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:05.117 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:33:05.117 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:33:05.117 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:33:05.117 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.117 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-22T08:33:04.778+0000 7f8cd2e12800 5 monclient: authenticate success, global_id 5951 2024-09-22T08:33:05.117 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-22T08:33:04.778+0000 7f8cd2e12800 10 monclient: _renew_subs 2024-09-22T08:33:05.117 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-22T08:33:04.778+0000 7f8cd2e12800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:33:05.117 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-22T08:33:04.778+0000 7f8ccf4cd640 4 set_mon_vals no callback set 2024-09-22T08:33:05.118 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-22T08:33:04.778+0000 7f8cd2e12800 10 monclient: _renew_subs 2024-09-22T08:33:05.118 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-22T08:33:04.778+0000 7f8cd2e12800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:33:05.118 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-22T08:33:04.780+0000 7f8bb3fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:33:05.118 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-22T08:33:04.780+0000 7f8bb3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:33:05.118 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-22T08:33:04.780+0000 7f8bb3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:33:05.118 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 10 monclient: get_monmap_and_config 2024-09-22T08:33:05.118 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 10 monclient: build_initial_monmap 2024-09-22T08:33:05.118 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 1 build_initial for_mkfs: 0 2024-09-22T08:33:05.118 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 10 monclient: monmap: 2024-09-22T08:33:05.118 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:33:05.118 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:33:05.118 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:33:05.118 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:33:05.118 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:33:05.119 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:05.119 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:33:05.119 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:33:05.119 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:33:05.119 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.119 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x56237c208600) adding auth protocol: cephx 2024-09-22T08:33:05.119 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x56237c208600) adding auth protocol: cephx 2024-09-22T08:33:05.119 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x56237c208600) adding auth protocol: cephx 2024-09-22T08:33:05.119 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x56237c208600) adding con mode: secure 2024-09-22T08:33:05.119 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x56237c208600) adding con mode: crc 2024-09-22T08:33:05.119 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x56237c208600) adding con mode: secure 2024-09-22T08:33:05.119 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x56237c208600) adding con mode: crc 2024-09-22T08:33:05.119 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x56237c208600) adding con mode: secure 2024-09-22T08:33:05.119 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x56237c208600) adding con mode: crc 2024-09-22T08:33:05.119 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x56237c208600) adding con mode: crc 2024-09-22T08:33:05.120 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x56237c208600) adding con mode: secure 2024-09-22T08:33:05.120 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x56237c208600) adding con mode: crc 2024-09-22T08:33:05.120 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x56237c208600) adding con mode: secure 2024-09-22T08:33:05.120 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x56237c208600) adding con mode: crc 2024-09-22T08:33:05.120 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x56237c208600) adding con mode: secure 2024-09-22T08:33:05.120 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-22T08:33:04.780+0000 7f8ccdcca640 10 monclient: get_auth_request con 0x7f8ba8077480 auth_method 0 2024-09-22T08:33:05.120 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:05.120 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 10 monclient: init 2024-09-22T08:33:05.120 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64a8a0) adding auth protocol: cephx 2024-09-22T08:33:05.120 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64a8a0) adding auth protocol: cephx 2024-09-22T08:33:05.120 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64a8a0) adding auth protocol: cephx 2024-09-22T08:33:05.120 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64a8a0) adding con mode: secure 2024-09-22T08:33:05.120 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64a8a0) adding con mode: crc 2024-09-22T08:33:05.120 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64a8a0) adding con mode: secure 2024-09-22T08:33:05.120 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64a8a0) adding con mode: crc 2024-09-22T08:33:05.121 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64a8a0) adding con mode: secure 2024-09-22T08:33:05.121 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64a8a0) adding con mode: crc 2024-09-22T08:33:05.121 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64a8a0) adding con mode: crc 2024-09-22T08:33:05.121 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64a8a0) adding con mode: secure 2024-09-22T08:33:05.121 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64a8a0) adding con mode: crc 2024-09-22T08:33:05.121 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64a8a0) adding con mode: secure 2024-09-22T08:33:05.121 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64a8a0) adding con mode: crc 2024-09-22T08:33:05.121 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-22T08:33:04.780+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64a8a0) adding con mode: secure 2024-09-22T08:33:05.121 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-22T08:33:04.781+0000 7f8cd2e12800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:05.121 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-22T08:33:04.781+0000 7f8cd2e12800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:05.121 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-22T08:33:04.781+0000 7f8cd2e12800 5 asok(0x56237bf470f0) register_command rotate-key cmddesc rotate-key hook 0x7ffe5e64a9e8 EEXIST 2024-09-22T08:33:05.121 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-22T08:33:04.781+0000 7f8cd2e12800 10 monclient: _reopen_session rank -1 2024-09-22T08:33:05.121 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-22T08:33:04.781+0000 7f8cd2e12800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T08:33:05.121 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-22T08:33:04.781+0000 7f8cd2e12800 10 monclient(hunting): picked mon.noname-a con 0x56237c23cc80 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:33:05.122 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-22T08:33:04.781+0000 7f8cd2e12800 10 monclient(hunting): picked mon.noname-b con 0x56237c20ca90 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:33:05.122 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-22T08:33:04.781+0000 7f8cd2e12800 10 monclient(hunting): picked mon.noname-c con 0x56237c238040 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:33:05.122 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-22T08:33:04.781+0000 7f8cd2e12800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:05.122 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-22T08:33:04.781+0000 7f8cd2e12800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:05.122 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-22T08:33:04.781+0000 7f8cd2e12800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:05.122 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-22T08:33:04.781+0000 7f8cd2e12800 10 monclient(hunting): _renew_subs 2024-09-22T08:33:05.122 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-22T08:33:04.781+0000 7f8cd2e12800 10 monclient(hunting): authenticate will time out at 1890.021500s 2024-09-22T08:33:05.122 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-22T08:33:04.781+0000 7f8ccdcca640 10 monclient(hunting): get_auth_request con 0x56237c23cc80 auth_method 0 2024-09-22T08:33:05.122 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-22T08:33:04.781+0000 7f8ccdcca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:05.122 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-22T08:33:04.781+0000 7f8ccdcca640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:05.122 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-22T08:33:04.781+0000 7f8ccdcca640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:05.122 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-22T08:33:04.781+0000 7f8cce4cb640 10 monclient(hunting): get_auth_request con 0x56237c238040 auth_method 0 2024-09-22T08:33:05.122 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-22T08:33:04.781+0000 7f8cce4cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:05.122 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-22T08:33:04.781+0000 7f8cce4cb640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:05.122 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-22T08:33:04.781+0000 7f8cce4cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:05.123 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-22T08:33:04.781+0000 7f8cceccc640 10 monclient(hunting): get_auth_request con 0x56237c20ca90 auth_method 0 2024-09-22T08:33:05.123 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-22T08:33:04.781+0000 7f8cceccc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:05.123 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-22T08:33:04.781+0000 7f8cceccc640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:05.123 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-22T08:33:04.781+0000 7f8cceccc640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:05.123 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-22T08:33:04.781+0000 7f8ccdcca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:05.123 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-22T08:33:04.781+0000 7f8ccdcca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:05.123 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-22T08:33:04.781+0000 7f8ccdcca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:05.123 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-22T08:33:04.781+0000 7f8cce4cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:05.123 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-22T08:33:04.781+0000 7f8cce4cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:05.123 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-22T08:33:04.781+0000 7f8cce4cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:05.123 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-22T08:33:04.781+0000 7f8cceccc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:05.123 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-22T08:33:04.781+0000 7f8cceccc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:05.123 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-22T08:33:04.781+0000 7f8cceccc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:05.123 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-22T08:33:04.781+0000 7f8ccdcca640 10 monclient(hunting): handle_auth_done global_id 6267 payload 274 2024-09-22T08:33:05.124 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-22T08:33:04.781+0000 7f8ccdcca640 10 monclient: _finish_hunting 0 2024-09-22T08:33:05.124 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-22T08:33:04.781+0000 7f8ccdcca640 1 monclient: found mon.noname-a 2024-09-22T08:33:05.124 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-22T08:33:04.781+0000 7f8ccdcca640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:33:05.124 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-22T08:33:04.782+0000 7f8bb1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:33:05.124 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-22T08:33:04.782+0000 7f8bb1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:33:05.124 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-22T08:33:04.782+0000 7f8bb1ffb640 10 monclient: dump: 2024-09-22T08:33:05.124 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:33:05.124 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:33:05.124 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:05.124 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:05.124 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:33:05.124 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:05.124 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:33:05.124 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:33:05.125 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:33:05.125 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.125 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-22T08:33:04.782+0000 7f8bb1ffb640 10 monclient: _finish_auth 0 2024-09-22T08:33:05.125 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-22T08:33:04.782+0000 7f8bb1ffb640 10 monclient: _check_auth_tickets 2024-09-22T08:33:05.125 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-22T08:33:04.782+0000 7f8bb1ffb640 10 monclient: handle_config config(0 keys) 2024-09-22T08:33:05.125 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-22T08:33:04.782+0000 7f8bb1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:33:05.125 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-22T08:33:04.782+0000 7f8bb1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:33:05.125 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-22T08:33:04.782+0000 7f8bb1ffb640 10 monclient: dump: 2024-09-22T08:33:05.125 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:33:05.125 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:33:05.125 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:05.125 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:05.125 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:33:05.125 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:05.125 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:33:05.126 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:33:05.126 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:33:05.126 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.126 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 5 monclient: authenticate success, global_id 6267 2024-09-22T08:33:05.126 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 10 monclient: get_monmap_and_config success 2024-09-22T08:33:05.126 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 4 set_mon_vals no callback set 2024-09-22T08:33:05.126 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 10 monclient: shutdown 2024-09-22T08:33:05.126 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 10 monclient: build_initial_monmap 2024-09-22T08:33:05.126 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 1 build_initial for_mkfs: 0 2024-09-22T08:33:05.126 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 10 monclient: monmap: 2024-09-22T08:33:05.126 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:33:05.126 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:33:05.127 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:33:05.127 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:33:05.127 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:33:05.127 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:05.127 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:33:05.127 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:33:05.127 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:33:05.127 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.127 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 5 AuthRegistry(0x56237c20d8d0) adding auth protocol: cephx 2024-09-22T08:33:05.127 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 5 AuthRegistry(0x56237c20d8d0) adding auth protocol: cephx 2024-09-22T08:33:05.127 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 5 AuthRegistry(0x56237c20d8d0) adding auth protocol: cephx 2024-09-22T08:33:05.127 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 5 AuthRegistry(0x56237c20d8d0) adding con mode: secure 2024-09-22T08:33:05.127 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 5 AuthRegistry(0x56237c20d8d0) adding con mode: crc 2024-09-22T08:33:05.127 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 5 AuthRegistry(0x56237c20d8d0) adding con mode: secure 2024-09-22T08:33:05.128 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 5 AuthRegistry(0x56237c20d8d0) adding con mode: crc 2024-09-22T08:33:05.128 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 5 AuthRegistry(0x56237c20d8d0) adding con mode: secure 2024-09-22T08:33:05.128 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 5 AuthRegistry(0x56237c20d8d0) adding con mode: crc 2024-09-22T08:33:05.128 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 5 AuthRegistry(0x56237c20d8d0) adding con mode: crc 2024-09-22T08:33:05.128 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 5 AuthRegistry(0x56237c20d8d0) adding con mode: secure 2024-09-22T08:33:05.128 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 5 AuthRegistry(0x56237c20d8d0) adding con mode: crc 2024-09-22T08:33:05.128 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 5 AuthRegistry(0x56237c20d8d0) adding con mode: secure 2024-09-22T08:33:05.128 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 5 AuthRegistry(0x56237c20d8d0) adding con mode: crc 2024-09-22T08:33:05.128 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-22T08:33:04.782+0000 7f8cd2e12800 5 AuthRegistry(0x56237c20d8d0) adding con mode: secure 2024-09-22T08:33:05.128 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:05.128 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 1 librados: starting msgr at 2024-09-22T08:33:05.128 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 1 librados: starting objecter 2024-09-22T08:33:05.128 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 5 asok(0x56237bf470f0) register_command objecter_requests cmddesc objecter_requests hook 0x56237c22f9f0 EEXIST 2024-09-22T08:33:05.128 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 1 librados: setting wanted keys 2024-09-22T08:33:05.129 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 1 librados: calling monclient init 2024-09-22T08:33:05.129 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 10 monclient: init 2024-09-22T08:33:05.129 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1fcfd0) adding auth protocol: cephx 2024-09-22T08:33:05.129 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1fcfd0) adding auth protocol: cephx 2024-09-22T08:33:05.129 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1fcfd0) adding auth protocol: cephx 2024-09-22T08:33:05.129 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1fcfd0) adding con mode: secure 2024-09-22T08:33:05.129 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1fcfd0) adding con mode: crc 2024-09-22T08:33:05.129 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1fcfd0) adding con mode: secure 2024-09-22T08:33:05.129 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1fcfd0) adding con mode: crc 2024-09-22T08:33:05.129 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1fcfd0) adding con mode: secure 2024-09-22T08:33:05.129 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1fcfd0) adding con mode: crc 2024-09-22T08:33:05.129 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1fcfd0) adding con mode: crc 2024-09-22T08:33:05.129 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1fcfd0) adding con mode: secure 2024-09-22T08:33:05.129 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1fcfd0) adding con mode: crc 2024-09-22T08:33:05.130 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1fcfd0) adding con mode: secure 2024-09-22T08:33:05.130 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1fcfd0) adding con mode: crc 2024-09-22T08:33:05.130 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 5 AuthRegistry(0x56237c1fcfd0) adding con mode: secure 2024-09-22T08:33:05.130 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:05.130 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:05.130 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 5 asok(0x56237bf470f0) register_command rotate-key cmddesc rotate-key hook 0x56237c1fd118 EEXIST 2024-09-22T08:33:05.130 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 10 monclient: _reopen_session rank -1 2024-09-22T08:33:05.130 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T08:33:05.130 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 10 monclient(hunting): picked mon.noname-a con 0x56237c20ca90 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:33:05.130 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 10 monclient(hunting): picked mon.noname-b con 0x56237c238040 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:33:05.130 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 10 monclient(hunting): picked mon.noname-c con 0x56237c23cc80 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:33:05.130 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:05.130 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:05.131 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:05.131 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 10 monclient(hunting): _renew_subs 2024-09-22T08:33:05.131 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-22T08:33:04.783+0000 7f8cd2e12800 10 monclient(hunting): authenticate will time out at 1890.023760s 2024-09-22T08:33:05.131 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-22T08:33:04.783+0000 7f8ccdcca640 10 monclient(hunting): get_auth_request con 0x56237c20ca90 auth_method 0 2024-09-22T08:33:05.131 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-22T08:33:04.783+0000 7f8ccdcca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:05.131 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-22T08:33:04.783+0000 7f8ccdcca640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:05.131 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-22T08:33:04.783+0000 7f8ccdcca640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:05.131 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-22T08:33:04.783+0000 7f8cce4cb640 10 monclient(hunting): get_auth_request con 0x56237c23cc80 auth_method 0 2024-09-22T08:33:05.131 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-22T08:33:04.783+0000 7f8cce4cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:05.131 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-22T08:33:04.783+0000 7f8cce4cb640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:05.131 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-22T08:33:04.783+0000 7f8cce4cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:05.131 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-22T08:33:04.783+0000 7f8cceccc640 10 monclient(hunting): get_auth_request con 0x56237c238040 auth_method 0 2024-09-22T08:33:05.131 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-22T08:33:04.783+0000 7f8cceccc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:05.131 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-22T08:33:04.783+0000 7f8cceccc640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:05.132 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-22T08:33:04.783+0000 7f8cceccc640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:05.132 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-22T08:33:04.783+0000 7f8ccdcca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:05.132 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-22T08:33:04.783+0000 7f8ccdcca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:05.132 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-22T08:33:04.783+0000 7f8ccdcca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:05.132 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-22T08:33:04.783+0000 7f8cce4cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:05.132 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-22T08:33:04.783+0000 7f8cce4cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:05.132 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-22T08:33:04.783+0000 7f8cce4cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:05.132 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-22T08:33:04.783+0000 7f8cceccc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:05.132 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-22T08:33:04.783+0000 7f8cceccc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:05.132 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-22T08:33:04.783+0000 7f8cceccc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:05.132 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-22T08:33:04.784+0000 7f8ccdcca640 10 monclient(hunting): handle_auth_done global_id 6270 payload 824 2024-09-22T08:33:05.132 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-22T08:33:04.784+0000 7f8ccdcca640 10 monclient: _finish_hunting 0 2024-09-22T08:33:05.132 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-22T08:33:04.784+0000 7f8ccdcca640 1 monclient: found mon.noname-a 2024-09-22T08:33:05.133 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-22T08:33:04.784+0000 7f8ccdcca640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:33:05.133 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-22T08:33:04.784+0000 7f8b9ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:33:05.133 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-22T08:33:04.784+0000 7f8b9ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:33:05.133 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-22T08:33:04.784+0000 7f8b9ffff640 10 monclient: dump: 2024-09-22T08:33:05.133 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:33:05.133 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:33:05.133 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:05.133 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:05.133 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:33:05.133 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:05.133 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:33:05.133 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:33:05.133 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:33:05.133 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.134 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-22T08:33:04.784+0000 7f8b9ffff640 10 monclient: _finish_auth 0 2024-09-22T08:33:05.134 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-22T08:33:04.784+0000 7f8b9ffff640 10 monclient: _check_auth_tickets 2024-09-22T08:33:05.134 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-22T08:33:04.784+0000 7f8b9ffff640 10 monclient: handle_config config(0 keys) 2024-09-22T08:33:05.134 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-22T08:33:04.784+0000 7f8b9ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:33:05.134 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-22T08:33:04.784+0000 7f8b9ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:33:05.134 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-22T08:33:04.784+0000 7f8b9ffff640 10 monclient: dump: 2024-09-22T08:33:05.134 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:33:05.134 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:33:05.134 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:05.134 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:05.134 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:33:05.134 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:05.134 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:33:05.134 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:33:05.135 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:33:05.135 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.135 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-22T08:33:04.784+0000 7f8cd2e12800 5 monclient: authenticate success, global_id 6270 2024-09-22T08:33:05.135 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-22T08:33:04.784+0000 7f8bb1ffb640 4 set_mon_vals no callback set 2024-09-22T08:33:05.135 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-22T08:33:04.784+0000 7f8cd2e12800 10 monclient: _renew_subs 2024-09-22T08:33:05.135 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-22T08:33:04.784+0000 7f8cd2e12800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:33:05.135 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-22T08:33:04.784+0000 7f8cd2e12800 10 monclient: _renew_subs 2024-09-22T08:33:05.135 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-22T08:33:04.784+0000 7f8cd2e12800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:33:05.135 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-22T08:33:04.784+0000 7f8cd2e12800 1 librados: init done 2024-09-22T08:33:05.135 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-22T08:33:04.784+0000 7f8cd2e12800 5 asok(0x56237bf470f0) register_command cr dump hook 0x56237c22c7a8 2024-09-22T08:33:05.135 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-22T08:33:04.786+0000 7f8cd2e12800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.135 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-22T08:33:04.786+0000 7f8b9ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:33:05.135 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-22T08:33:04.786+0000 7f8b9ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:33:05.135 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-22T08:33:04.786+0000 7f8b9ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:33:05.135 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-22T08:33:04.787+0000 7f8cceccc640 10 monclient: get_auth_request con 0x7f8b98077570 auth_method 0 2024-09-22T08:33:05.136 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-22T08:33:04.787+0000 7f8cce4cb640 10 monclient: get_auth_request con 0x56237c256d60 auth_method 0 2024-09-22T08:33:05.136 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-22T08:33:04.787+0000 7f8cd2e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:05.136 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-22T08:33:04.787+0000 7f8cd2e12800 20 realm 2024-09-22T08:33:05.136 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-22T08:33:04.787+0000 7f8cd2e12800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.136 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-22T08:33:04.788+0000 7f8cd2e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:05.136 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-22T08:33:04.788+0000 7f8cd2e12800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:33:05.136 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-22T08:33:04.788+0000 7f8cd2e12800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.136 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-22T08:33:04.788+0000 7f8cd2e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:05.136 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-22T08:33:04.788+0000 7f8cd2e12800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.136 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-22T08:33:04.788+0000 7f8ccdcca640 10 monclient: get_auth_request con 0x56237c25af80 auth_method 0 2024-09-22T08:33:05.136 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-22T08:33:04.789+0000 7f8cd2e12800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:05.136 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-22T08:33:04.789+0000 7f8cd2e12800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.136 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-22T08:33:04.789+0000 7f8cceccc640 10 monclient: get_auth_request con 0x56237c25e7e0 auth_method 0 2024-09-22T08:33:05.136 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-22T08:33:04.789+0000 7f8cd2e12800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:33:05.136 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-22T08:33:04.789+0000 7f8cd2e12800 20 searching for the correct realm 2024-09-22T08:33:05.137 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-22T08:33:04.790+0000 7f8cce4cb640 10 monclient: get_auth_request con 0x56237c263580 auth_method 0 2024-09-22T08:33:05.137 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-22T08:33:04.791+0000 7f8ccdcca640 10 monclient: get_auth_request con 0x7f8cc4053070 auth_method 0 2024-09-22T08:33:05.137 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-22T08:33:04.791+0000 7f8ccdcca640 0 -- 172.21.15.38:0/319123563 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f8cc4053070 msgr2=0x7f8cc4077500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:05.137 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-22T08:33:04.792+0000 7f8b9ffff640 1 client.6270.objecter ms_handle_reset 0x7f8cc4053070 session 0x7f8cc403b210 osd.0 2024-09-22T08:33:05.137 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-22T08:33:04.792+0000 7f8b9ffff640 10 monclient: _renew_subs 2024-09-22T08:33:05.137 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-22T08:33:04.792+0000 7f8b9ffff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:33:05.137 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-22T08:33:04.792+0000 7f8ccdcca640 10 monclient: get_auth_request con 0x7f8b98087090 auth_method 0 2024-09-22T08:33:05.137 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-22T08:33:04.792+0000 7f8cceccc640 10 monclient: get_auth_request con 0x7f8cc007f040 auth_method 0 2024-09-22T08:33:05.137 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-22T08:33:04.794+0000 7f8cce4cb640 10 monclient: get_auth_request con 0x7f8cc400ec20 auth_method 0 2024-09-22T08:33:05.137 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-22T08:33:04.795+0000 7f8ccdcca640 0 -- 172.21.15.38:0/319123563 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f8cc0099400 msgr2=0x7f8cc0099880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:05.137 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-22T08:33:04.795+0000 7f8ccdcca640 10 monclient: get_auth_request con 0x7f8cc0099400 auth_method 0 2024-09-22T08:33:05.137 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-22T08:33:04.996+0000 7f8ccdcca640 10 monclient: get_auth_request con 0x7f8cc0099400 auth_method 0 2024-09-22T08:33:05.137 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-22T08:33:05.001+0000 7f8cd2e12800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:33:05.137 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-22T08:33:05.001+0000 7f8cd2e12800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:33:05.137 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-22T08:33:05.001+0000 7f8cd2e12800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:33:05.138 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-22T08:33:05.001+0000 7f8cd2e12800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:33:05.138 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-22T08:33:05.001+0000 7f8cd2e12800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:33:05.138 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-22T08:33:05.001+0000 7f8cd2e12800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:33:05.138 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-22T08:33:05.001+0000 7f8cd2e12800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.138 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-22T08:33:05.002+0000 7f8cd2e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:05.138 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-22T08:33:05.002+0000 7f8cd2e12800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.138 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-22T08:33:05.002+0000 7f8cd2e12800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:05.138 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-22T08:33:05.002+0000 7f8cd2e12800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.138 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-22T08:33:05.002+0000 7f8cd2e12800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:33:05.138 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-22T08:33:05.003+0000 7f8cd2e12800 20 zone default found 2024-09-22T08:33:05.138 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-22T08:33:05.003+0000 7f8cd2e12800 4 Realm: () 2024-09-22T08:33:05.138 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-22T08:33:05.003+0000 7f8cd2e12800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:33:05.138 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-22T08:33:05.003+0000 7f8cd2e12800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:33:05.139 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-22T08:33:05.003+0000 7f8cd2e12800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:33:05.139 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-22T08:33:05.003+0000 7f8cd2e12800 20 zonegroup default 2024-09-22T08:33:05.139 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-22T08:33:05.003+0000 7f8cd2e12800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.139 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-22T08:33:05.003+0000 7f8cd2e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:05.139 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-22T08:33:05.003+0000 7f8cd2e12800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.139 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-22T08:33:05.003+0000 7f8cd2e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:05.139 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-22T08:33:05.003+0000 7f8cd2e12800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.139 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-22T08:33:05.003+0000 7f8cd2e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:05.139 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-22T08:33:05.003+0000 7f8cd2e12800 20 started sync module instance, tier type = 2024-09-22T08:33:05.139 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-22T08:33:05.003+0000 7f8cd2e12800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:33:05.139 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-22T08:33:05.012+0000 7f8cd2e12800 20 add_watcher() i=0 2024-09-22T08:33:05.139 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-22T08:33:05.012+0000 7f8cd2e12800 20 add_watcher() i=1 2024-09-22T08:33:05.139 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-22T08:33:05.012+0000 7f8cd2e12800 20 add_watcher() i=2 2024-09-22T08:33:05.139 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-22T08:33:05.012+0000 7f8cd2e12800 20 add_watcher() i=3 2024-09-22T08:33:05.140 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-22T08:33:05.012+0000 7f8cd2e12800 20 add_watcher() i=4 2024-09-22T08:33:05.140 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-22T08:33:05.012+0000 7f8cd2e12800 20 add_watcher() i=5 2024-09-22T08:33:05.140 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-22T08:33:05.012+0000 7f8cd2e12800 20 add_watcher() i=6 2024-09-22T08:33:05.140 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-22T08:33:05.013+0000 7f8cd2e12800 20 add_watcher() i=7 2024-09-22T08:33:05.140 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-22T08:33:05.013+0000 7f8cd2e12800 2 all 8 watchers are set, enabling cache 2024-09-22T08:33:05.140 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64ad70) adding auth protocol: cephx 2024-09-22T08:33:05.140 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64ad70) adding auth protocol: cephx 2024-09-22T08:33:05.140 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64ad70) adding auth protocol: cephx 2024-09-22T08:33:05.140 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64ad70) adding con mode: secure 2024-09-22T08:33:05.140 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64ad70) adding con mode: crc 2024-09-22T08:33:05.140 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64ad70) adding con mode: secure 2024-09-22T08:33:05.140 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64ad70) adding con mode: crc 2024-09-22T08:33:05.140 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64ad70) adding con mode: secure 2024-09-22T08:33:05.140 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64ad70) adding con mode: crc 2024-09-22T08:33:05.140 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64ad70) adding con mode: crc 2024-09-22T08:33:05.141 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64ad70) adding con mode: secure 2024-09-22T08:33:05.141 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64ad70) adding con mode: crc 2024-09-22T08:33:05.141 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64ad70) adding con mode: secure 2024-09-22T08:33:05.141 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64ad70) adding con mode: crc 2024-09-22T08:33:05.141 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 5 AuthRegistry(0x7ffe5e64ad70) adding con mode: secure 2024-09-22T08:33:05.141 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-22T08:33:05.015+0000 7f8b84fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:05.141 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:05.141 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:33:05.141 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:33:05.141 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 5 asok(0x56237bf470f0) register_command cache list hook 0x56237c22dff0 2024-09-22T08:33:05.141 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 5 asok(0x56237bf470f0) register_command cache inspect hook 0x56237c22dff0 2024-09-22T08:33:05.141 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 5 asok(0x56237bf470f0) register_command cache erase hook 0x56237c22dff0 2024-09-22T08:33:05.141 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 5 asok(0x56237bf470f0) register_command cache zap hook 0x56237c22dff0 2024-09-22T08:33:05.141 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-22T08:33:05.015+0000 7f8cd2e12800 5 note: GC not initialized 2024-09-22T08:33:05.141 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-22T08:33:05.015+0000 7f8aff7fe640 20 reqs_thread_entry: start 2024-09-22T08:33:05.142 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-22T08:33:05.016+0000 7f8cd2e12800 5 asok(0x56237bf470f0) register_command sync trace show hook 0x7f8cc001c3e0 2024-09-22T08:33:05.142 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-22T08:33:05.016+0000 7f8cd2e12800 5 asok(0x56237bf470f0) register_command sync trace history hook 0x7f8cc001c3e0 2024-09-22T08:33:05.142 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-22T08:33:05.016+0000 7f8cd2e12800 5 asok(0x56237bf470f0) register_command sync trace active hook 0x7f8cc001c3e0 2024-09-22T08:33:05.142 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-22T08:33:05.016+0000 7f8cd2e12800 5 asok(0x56237bf470f0) register_command sync trace active_short hook 0x7f8cc001c3e0 2024-09-22T08:33:05.142 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-22T08:33:05.016+0000 7f8cd2e12800 20 init_complete bucket index max shards: 11 2024-09-22T08:33:05.142 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-22T08:33:05.016+0000 7f8cd2e12800 20 Filter name: none 2024-09-22T08:33:05.142 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-22T08:33:05.016+0000 7f8afd7fa640 20 reqs_thread_entry: start 2024-09-22T08:33:05.142 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-22T08:33:05.016+0000 7f8cd2e12800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-22T08:33:05.142 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-22T08:33:05.016+0000 7f8cd2e12800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.142 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-22T08:33:05.017+0000 7f8cd2e12800 20 rados_obj.operate() r=0 bl.length=188 2024-09-22T08:33:05.142 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-22T08:33:05.017+0000 7f8cd2e12800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-22T08:33:05.142 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-22T08:33:05.017+0000 7f8cd2e12800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-22T08:33:05.142 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-22T08:33:05.017+0000 7f8cd2e12800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c62f9d7b-f6b6-404a-90de-de5607499115.4584.21 : miss 2024-09-22T08:33:05.143 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-22T08:33:05.017+0000 7f8cd2e12800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.143 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-22T08:33:05.017+0000 7f8cd2e12800 20 rados_obj.operate() r=0 bl.length=410 2024-09-22T08:33:05.143 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-22T08:33:05.017+0000 7f8cd2e12800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c62f9d7b-f6b6-404a-90de-de5607499115.4584.21 info.flags=0x17 2024-09-22T08:33:05.143 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-22T08:33:05.017+0000 7f8cd2e12800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c62f9d7b-f6b6-404a-90de-de5607499115.4584.21 to cache LRU end 2024-09-22T08:33:05.143 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-22T08:33:05.017+0000 7f8cd2e12800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:33:05.143 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-22T08:33:05.017+0000 7f8cd2e12800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:05.143 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-22T08:33:05.017+0000 7f8cd2e12800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c62f9d7b-f6b6-404a-90de-de5607499115.4584.21 2024-09-22T08:33:05.143 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-22T08:33:05.019+0000 7f8cd2e12800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8cd2e12800 time 2024-09-22T08:33:05.020553+0000 2024-09-22T08:33:05.143 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:33:05.143 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.143 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:33:05.143 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8cd3f8c748] 2024-09-22T08:33:05.143 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f8cd3f8c906] 2024-09-22T08:33:05.143 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56237b195e01] 2024-09-22T08:33:05.144 INFO:tasks.workunit.client.0.smithi038.stderr: 4: radosgw-admin(+0xd80ac4) [0x56237b6a7ac4] 2024-09-22T08:33:05.144 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56237b1a5c9d] 2024-09-22T08:33:05.144 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-22T08:33:05.144 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8cd2c29590] 2024-09-22T08:33:05.144 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-22T08:33:05.144 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-22T08:33:05.144 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.144 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-22T08:33:05.020+0000 7f8cd2e12800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:33:05.144 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f8cd2e12800 thread_name:radosgw-admin 2024-09-22T08:33:05.144 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.144 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:33:05.144 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8cd2c3e6f0] 2024-09-22T08:33:05.144 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8cd2c8b99c] 2024-09-22T08:33:05.144 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:33:05.144 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:33:05.145 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8cd3f8c7a2] 2024-09-22T08:33:05.145 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f8cd3f8c906] 2024-09-22T08:33:05.145 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56237b195e01] 2024-09-22T08:33:05.145 INFO:tasks.workunit.client.0.smithi038.stderr: 8: radosgw-admin(+0xd80ac4) [0x56237b6a7ac4] 2024-09-22T08:33:05.145 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56237b1a5c9d] 2024-09-22T08:33:05.145 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-22T08:33:05.145 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8cd2c29590] 2024-09-22T08:33:05.145 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-22T08:33:05.145 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-22T08:33:05.145 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:33:05.145 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.145 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-22T08:33:05.145 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-22T08:33:05.145 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-22T08:33:05.145 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-22T08:33:05.145 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-22T08:33:05.146 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-22T08:33:05.146 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-22T08:33:05.146 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-22T08:33:05.146 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-22T08:33:05.146 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-22T08:33:05.146 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-22T08:33:05.146 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-22T08:33:05.146 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-22T08:33:05.146 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-22T08:33:05.146 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-22T08:33:05.146 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-22T08:33:05.146 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-22T08:33:05.146 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-22T08:33:05.147 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-22T08:33:05.147 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-22T08:33:05.147 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-22T08:33:05.147 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-22T08:33:05.147 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-22T08:33:05.147 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-22T08:33:05.147 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:33:05.147 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-22T08:33:05.147 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-22T08:33:05.147 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-22T08:33:05.147 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-22T08:33:05.147 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-22T08:33:05.147 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-22T08:33:05.147 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-22T08:33:05.147 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-22T08:33:05.148 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-22T08:33:05.148 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-22T08:33:05.148 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-22T08:33:05.148 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-22T08:33:05.148 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-22T08:33:05.148 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-22T08:33:05.148 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-22T08:33:05.148 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-22T08:33:05.148 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-22T08:33:05.148 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-22T08:33:05.148 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-22T08:33:05.148 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-22T08:33:05.148 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-22T08:33:05.148 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:33:05.148 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-22T08:33:05.148 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:33:05.149 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-22T08:33:05.149 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-22T08:33:05.149 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-22T08:33:05.149 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-22T08:33:05.149 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-22T08:33:05.149 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-22T08:33:05.149 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-22T08:33:05.149 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-22T08:33:05.149 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-22T08:33:05.149 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-22T08:33:05.149 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-22T08:33:05.149 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-22T08:33:05.149 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-22T08:33:05.149 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-22T08:33:05.149 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-22T08:33:05.150 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-22T08:33:05.150 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-22T08:33:05.150 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-22T08:33:05.150 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:33:05.150 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-22T08:33:05.150 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:33:05.150 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-22T08:33:05.150 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-22T08:33:05.150 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-22T08:33:05.150 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-22T08:33:05.150 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-22T08:33:05.150 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-22T08:33:05.150 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:33:05.150 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-22T08:33:05.151 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-22T08:33:05.151 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:33:05.151 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-22T08:33:05.151 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-22T08:33:05.151 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-22T08:33:05.151 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-22T08:33:05.151 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-22T08:33:05.151 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-22T08:33:05.151 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-22T08:33:05.151 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-22T08:33:05.151 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-22T08:33:05.151 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-22T08:33:05.151 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-22T08:33:05.151 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-22T08:33:05.152 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-22T08:33:05.152 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:33:05.152 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8afd7fa640 / http_manager 2024-09-22T08:33:05.152 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8aff7fe640 / http_manager 2024-09-22T08:33:05.152 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8b84fe1640 / rgw_dt_lg_renew 2024-09-22T08:33:05.152 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8b9ffff640 / ms_dispatch 2024-09-22T08:33:05.152 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8bb1ffb640 / io_context_pool 2024-09-22T08:33:05.152 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8bb3fff640 / ms_dispatch 2024-09-22T08:33:05.152 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8bbae05640 / ms_dispatch 2024-09-22T08:33:05.152 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8bbc608640 / io_context_pool 2024-09-22T08:33:05.152 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8ccdcca640 / msgr-worker-2 2024-09-22T08:33:05.152 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8cce4cb640 / msgr-worker-1 2024-09-22T08:33:05.152 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8cceccc640 / msgr-worker-0 2024-09-22T08:33:05.152 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8ccf4cd640 / io_context_pool 2024-09-22T08:33:05.153 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8cd2e12800 / radosgw-admin 2024-09-22T08:33:05.153 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-22T08:33:05.153 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-22T08:33:05.153 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/lib/ceph/crash/2024-09-22T08:33:05.022252Z_73d60186-5d6c-4bdd-ae71-3c9711269e5c/log 2024-09-22T08:33:05.153 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-22T08:33:05.153 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-22T08:33:05.154 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:33:05.154 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:33:05.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.101+0000 7f7873739800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.103+0000 7f7873739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:05.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.103+0000 7f7873739800 20 realm 2024-09-22T08:33:05.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.103+0000 7f7873739800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.103+0000 7f7873739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:05.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.103+0000 7f7873739800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:33:05.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.103+0000 7f7873739800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.103+0000 7f7873739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:05.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.103+0000 7f7873739800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.104+0000 7f7873739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:05.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.104+0000 7f7873739800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.105+0000 7f7873739800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:33:05.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.105+0000 7f7873739800 20 searching for the correct realm 2024-09-22T08:33:05.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.107+0000 7f786fbc8640 0 -- 172.21.15.38:0/967270404 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7f786001e060 msgr2=0x7f7860089fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:05.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.312+0000 7f786fbc8640 0 -- 172.21.15.38:0/967270404 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x5648bf3941b0 msgr2=0x5648bf396630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:05.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.317+0000 7f7873739800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:33:05.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.317+0000 7f7873739800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:33:05.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.317+0000 7f7873739800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:33:05.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.317+0000 7f7873739800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:33:05.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.317+0000 7f7873739800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:33:05.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.317+0000 7f7873739800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:33:05.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.317+0000 7f7873739800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.317+0000 7f7873739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:05.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.317+0000 7f7873739800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.317+0000 7f7873739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:05.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.317+0000 7f7873739800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.318+0000 7f7873739800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:33:05.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.318+0000 7f7873739800 20 zone default found 2024-09-22T08:33:05.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.318+0000 7f7873739800 4 Realm: () 2024-09-22T08:33:05.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.318+0000 7f7873739800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:33:05.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.318+0000 7f7873739800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:33:05.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.318+0000 7f7873739800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:33:05.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.318+0000 7f7873739800 20 zonegroup default 2024-09-22T08:33:05.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.318+0000 7f7873739800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.318+0000 7f7873739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:05.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.318+0000 7f7873739800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.318+0000 7f7873739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:05.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.318+0000 7f7873739800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.318+0000 7f7873739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:05.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.318+0000 7f7873739800 20 started sync module instance, tier type = 2024-09-22T08:33:05.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.318+0000 7f7873739800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:33:05.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.327+0000 7f7873739800 20 add_watcher() i=0 2024-09-22T08:33:05.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.327+0000 7f7873739800 20 add_watcher() i=1 2024-09-22T08:33:05.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.327+0000 7f7873739800 20 add_watcher() i=2 2024-09-22T08:33:05.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.327+0000 7f7873739800 20 add_watcher() i=3 2024-09-22T08:33:05.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.327+0000 7f7873739800 20 add_watcher() i=4 2024-09-22T08:33:05.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.327+0000 7f7873739800 20 add_watcher() i=5 2024-09-22T08:33:05.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.327+0000 7f7873739800 20 add_watcher() i=6 2024-09-22T08:33:05.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.328+0000 7f7873739800 20 add_watcher() i=7 2024-09-22T08:33:05.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.328+0000 7f7873739800 2 all 8 watchers are set, enabling cache 2024-09-22T08:33:05.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.330+0000 7f7725fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:05.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.330+0000 7f7873739800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:33:05.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.330+0000 7f7873739800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:33:05.336 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.330+0000 7f7873739800 5 note: GC not initialized 2024-09-22T08:33:05.336 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.330+0000 7f7724fe1640 20 reqs_thread_entry: start 2024-09-22T08:33:05.336 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.331+0000 7f7873739800 20 init_complete bucket index max shards: 11 2024-09-22T08:33:05.336 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.331+0000 7f7873739800 20 Filter name: none 2024-09-22T08:33:05.336 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.331+0000 7f769e7fc640 20 reqs_thread_entry: start 2024-09-22T08:33:05.336 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.331+0000 7f7873739800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.336 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.331+0000 7f7873739800 20 rados_obj.operate() r=0 bl.length=188 2024-09-22T08:33:05.336 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.331+0000 7f7873739800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.336 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.332+0000 7f7873739800 20 rados_obj.operate() r=0 bl.length=410 2024-09-22T08:33:05.336 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.332+0000 7f7873739800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:33:05.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.332+0000 7f7873739800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.332+0000 7f7873739800 20 rados_obj.operate() r=0 bl.length=188 2024-09-22T08:33:05.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.332+0000 7f7873739800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.333+0000 7f7873739800 20 rados_obj.operate() r=0 bl.length=410 2024-09-22T08:33:05.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.333+0000 7f7873739800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:33:05.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.335+0000 7f7725fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:05.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.337+0000 7f7873739800 20 remove_watcher() i=0 2024-09-22T08:33:05.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.337+0000 7f7873739800 2 removed watcher, disabling cache 2024-09-22T08:33:05.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.338+0000 7f7873739800 20 remove_watcher() i=1 2024-09-22T08:33:05.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.339+0000 7f7873739800 20 remove_watcher() i=2 2024-09-22T08:33:05.342 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.340+0000 7f7873739800 20 remove_watcher() i=3 2024-09-22T08:33:05.342 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.341+0000 7f7873739800 20 remove_watcher() i=4 2024-09-22T08:33:05.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.342+0000 7f7873739800 20 remove_watcher() i=5 2024-09-22T08:33:05.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.343+0000 7f7873739800 20 remove_watcher() i=6 2024-09-22T08:33:05.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.344+0000 7f7873739800 20 remove_watcher() i=7 2024-09-22T08:33:05.357 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.357 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:33:05.357 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-init-indext id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:33:05.358 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:05.359 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:05.359 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:05.365 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:05.365 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:05.408 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:33:05.441 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:33:05.441 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:33:05.480 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.478+0000 7f217cab9800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.480+0000 7f217cab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:05.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.480+0000 7f217cab9800 20 realm 2024-09-22T08:33:05.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.480+0000 7f217cab9800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.480+0000 7f217cab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:05.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.480+0000 7f217cab9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:33:05.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.480+0000 7f217cab9800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.480+0000 7f217cab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:05.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.480+0000 7f217cab9800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.481+0000 7f217cab9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:05.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.481+0000 7f217cab9800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.481+0000 7f217cab9800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:33:05.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.481+0000 7f217cab9800 20 searching for the correct realm 2024-09-22T08:33:05.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.483+0000 7f2179da2640 0 -- 172.21.15.38:0/3291802845 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f217001a050 msgr2=0x7f2170039480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:33:05.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.688+0000 7f2179da2640 0 -- 172.21.15.38:0/3291802845 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f216c0a2130 msgr2=0x7f216c077b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:05.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.894+0000 7f217cab9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:33:05.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.894+0000 7f217cab9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:33:05.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.894+0000 7f217cab9800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:33:05.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.894+0000 7f217cab9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:33:05.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.894+0000 7f217cab9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:33:05.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.894+0000 7f217cab9800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:33:05.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.894+0000 7f217cab9800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.895+0000 7f217cab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:05.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.895+0000 7f217cab9800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.895+0000 7f217cab9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:05.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.895+0000 7f217cab9800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.895+0000 7f217cab9800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:33:05.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.895+0000 7f217cab9800 20 zone default found 2024-09-22T08:33:05.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.895+0000 7f217cab9800 4 Realm: () 2024-09-22T08:33:05.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.895+0000 7f217cab9800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:33:05.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.895+0000 7f217cab9800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:33:05.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.895+0000 7f217cab9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:33:05.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.895+0000 7f217cab9800 20 zonegroup default 2024-09-22T08:33:05.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.895+0000 7f217cab9800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.896+0000 7f217cab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:05.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.896+0000 7f217cab9800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.896+0000 7f217cab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:05.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.896+0000 7f217cab9800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.897+0000 7f217cab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:05.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.897+0000 7f217cab9800 20 started sync module instance, tier type = 2024-09-22T08:33:05.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.897+0000 7f217cab9800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:33:05.908 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.906+0000 7f217cab9800 20 add_watcher() i=0 2024-09-22T08:33:05.908 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.906+0000 7f217cab9800 20 add_watcher() i=1 2024-09-22T08:33:05.908 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.906+0000 7f217cab9800 20 add_watcher() i=2 2024-09-22T08:33:05.908 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.906+0000 7f217cab9800 20 add_watcher() i=3 2024-09-22T08:33:05.908 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.906+0000 7f217cab9800 20 add_watcher() i=4 2024-09-22T08:33:05.908 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.906+0000 7f217cab9800 20 add_watcher() i=5 2024-09-22T08:33:05.908 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.906+0000 7f217cab9800 20 add_watcher() i=6 2024-09-22T08:33:05.909 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.907+0000 7f217cab9800 20 add_watcher() i=7 2024-09-22T08:33:05.909 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.907+0000 7f217cab9800 2 all 8 watchers are set, enabling cache 2024-09-22T08:33:05.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.909+0000 7f2030fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:05.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.909+0000 7f217cab9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:33:05.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.909+0000 7f217cab9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:33:05.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.909+0000 7f217cab9800 5 note: GC not initialized 2024-09-22T08:33:05.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.909+0000 7f1fab7fe640 20 reqs_thread_entry: start 2024-09-22T08:33:05.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.909+0000 7f217cab9800 20 init_complete bucket index max shards: 11 2024-09-22T08:33:05.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.910+0000 7f217cab9800 20 Filter name: none 2024-09-22T08:33:05.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.910+0000 7f1fa97fa640 20 reqs_thread_entry: start 2024-09-22T08:33:05.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.910+0000 7f217cab9800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-22T08:33:05.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.910+0000 7f217cab9800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.910+0000 7f217cab9800 20 rados_obj.operate() r=0 bl.length=188 2024-09-22T08:33:05.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.910+0000 7f217cab9800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-22T08:33:05.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.910+0000 7f217cab9800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-22T08:33:05.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.910+0000 7f217cab9800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c62f9d7b-f6b6-404a-90de-de5607499115.4584.21 : miss 2024-09-22T08:33:05.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.910+0000 7f217cab9800 20 rados->read ofs=0 len=0 2024-09-22T08:33:05.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.911+0000 7f217cab9800 20 rados_obj.operate() r=0 bl.length=410 2024-09-22T08:33:05.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.911+0000 7f217cab9800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c62f9d7b-f6b6-404a-90de-de5607499115.4584.21 info.flags=0x17 2024-09-22T08:33:05.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.911+0000 7f217cab9800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c62f9d7b-f6b6-404a-90de-de5607499115.4584.21 to cache LRU end 2024-09-22T08:33:05.914 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.911+0000 7f217cab9800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:33:05.914 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.911+0000 7f217cab9800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:05.914 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.911+0000 7f217cab9800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c62f9d7b-f6b6-404a-90de-de5607499115.4584.21 2024-09-22T08:33:05.914 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.912+0000 7f217cab9800 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:c62f9d7b-f6b6-404a-90de-de5607499115.4584.21 to be held by another RGW process; skipping for now 2024-09-22T08:33:05.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.913+0000 7f2030fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:05.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.916+0000 7f217cab9800 20 remove_watcher() i=0 2024-09-22T08:33:05.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.916+0000 7f217cab9800 2 removed watcher, disabling cache 2024-09-22T08:33:05.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.917+0000 7f217cab9800 20 remove_watcher() i=1 2024-09-22T08:33:05.920 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.918+0000 7f217cab9800 20 remove_watcher() i=2 2024-09-22T08:33:05.921 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.919+0000 7f217cab9800 20 remove_watcher() i=3 2024-09-22T08:33:05.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.920+0000 7f217cab9800 20 remove_watcher() i=4 2024-09-22T08:33:05.923 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.921+0000 7f217cab9800 20 remove_watcher() i=5 2024-09-22T08:33:05.924 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.922+0000 7f217cab9800 20 remove_watcher() i=6 2024-09-22T08:33:05.925 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:05.923+0000 7f217cab9800 20 remove_watcher() i=7 2024-09-22T08:33:05.936 INFO:tasks.workunit.client.0.smithi038.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-22T08:33:35.967 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:33:36.005 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:33:36.005 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:33:36.051 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.050+0000 7f2f083ad800 20 rados->read ofs=0 len=0 2024-09-22T08:33:36.052 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.052+0000 7f2f083ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:36.052 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.052+0000 7f2f083ad800 20 realm 2024-09-22T08:33:36.052 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.052+0000 7f2f083ad800 20 rados->read ofs=0 len=0 2024-09-22T08:33:36.053 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.052+0000 7f2f083ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:36.053 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.052+0000 7f2f083ad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:33:36.053 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.052+0000 7f2f083ad800 20 rados->read ofs=0 len=0 2024-09-22T08:33:36.053 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.052+0000 7f2f083ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:36.053 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.052+0000 7f2f083ad800 20 rados->read ofs=0 len=0 2024-09-22T08:33:36.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.053+0000 7f2f083ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:36.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.053+0000 7f2f083ad800 20 rados->read ofs=0 len=0 2024-09-22T08:33:36.055 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.054+0000 7f2f083ad800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:33:36.055 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.054+0000 7f2f083ad800 20 searching for the correct realm 2024-09-22T08:33:36.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.057+0000 7f2efffff640 0 -- 172.21.15.38:0/393276596 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f2ef0071210 msgr2=0x7f2ef0066a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:36.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.060+0000 7f2efffff640 0 -- 172.21.15.38:0/393276596 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f2ef801a040 msgr2=0x7f2ef8039410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:36.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.268+0000 7f2f083ad800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:33:36.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.268+0000 7f2f083ad800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:33:36.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.268+0000 7f2f083ad800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:33:36.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.268+0000 7f2f083ad800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:33:36.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.268+0000 7f2f083ad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:33:36.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.268+0000 7f2f083ad800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:33:36.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.268+0000 7f2f083ad800 20 rados->read ofs=0 len=0 2024-09-22T08:33:36.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.268+0000 7f2f083ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:36.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.268+0000 7f2f083ad800 20 rados->read ofs=0 len=0 2024-09-22T08:33:36.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.269+0000 7f2f083ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:36.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.269+0000 7f2f083ad800 20 rados->read ofs=0 len=0 2024-09-22T08:33:36.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.269+0000 7f2f083ad800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:33:36.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.269+0000 7f2f083ad800 20 zone default found 2024-09-22T08:33:36.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.269+0000 7f2f083ad800 4 Realm: () 2024-09-22T08:33:36.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.269+0000 7f2f083ad800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:33:36.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.269+0000 7f2f083ad800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:33:36.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.269+0000 7f2f083ad800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:33:36.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.269+0000 7f2f083ad800 20 zonegroup default 2024-09-22T08:33:36.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.269+0000 7f2f083ad800 20 rados->read ofs=0 len=0 2024-09-22T08:33:36.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.270+0000 7f2f083ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:36.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.270+0000 7f2f083ad800 20 rados->read ofs=0 len=0 2024-09-22T08:33:36.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.270+0000 7f2f083ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:36.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.270+0000 7f2f083ad800 20 rados->read ofs=0 len=0 2024-09-22T08:33:36.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.271+0000 7f2f083ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:36.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.271+0000 7f2f083ad800 20 started sync module instance, tier type = 2024-09-22T08:33:36.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.271+0000 7f2f083ad800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:33:36.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.281+0000 7f2f083ad800 20 add_watcher() i=0 2024-09-22T08:33:36.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.281+0000 7f2f083ad800 20 add_watcher() i=1 2024-09-22T08:33:36.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.281+0000 7f2f083ad800 20 add_watcher() i=2 2024-09-22T08:33:36.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.281+0000 7f2f083ad800 20 add_watcher() i=3 2024-09-22T08:33:36.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.281+0000 7f2f083ad800 20 add_watcher() i=4 2024-09-22T08:33:36.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.281+0000 7f2f083ad800 20 add_watcher() i=5 2024-09-22T08:33:36.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.281+0000 7f2f083ad800 20 add_watcher() i=6 2024-09-22T08:33:36.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.282+0000 7f2f083ad800 20 add_watcher() i=7 2024-09-22T08:33:36.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.282+0000 7f2f083ad800 2 all 8 watchers are set, enabling cache 2024-09-22T08:33:36.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.284+0000 7f2db7fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:36.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.284+0000 7f2f083ad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:33:36.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.284+0000 7f2f083ad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:33:36.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.284+0000 7f2f083ad800 5 note: GC not initialized 2024-09-22T08:33:36.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.285+0000 7f2db6ffd640 20 reqs_thread_entry: start 2024-09-22T08:33:36.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.285+0000 7f2f083ad800 20 init_complete bucket index max shards: 11 2024-09-22T08:33:36.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.285+0000 7f2f083ad800 20 Filter name: none 2024-09-22T08:33:36.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.285+0000 7f2db4ff9640 20 reqs_thread_entry: start 2024-09-22T08:33:36.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.285+0000 7f2f083ad800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-22T08:33:36.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.285+0000 7f2f083ad800 20 rados->read ofs=0 len=0 2024-09-22T08:33:36.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.286+0000 7f2f083ad800 20 rados_obj.operate() r=0 bl.length=188 2024-09-22T08:33:36.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.286+0000 7f2f083ad800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-22T08:33:36.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.286+0000 7f2f083ad800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-22T08:33:36.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.286+0000 7f2f083ad800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c62f9d7b-f6b6-404a-90de-de5607499115.4584.21 : miss 2024-09-22T08:33:36.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.286+0000 7f2f083ad800 20 rados->read ofs=0 len=0 2024-09-22T08:33:36.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.286+0000 7f2f083ad800 20 rados_obj.operate() r=0 bl.length=410 2024-09-22T08:33:36.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.286+0000 7f2f083ad800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c62f9d7b-f6b6-404a-90de-de5607499115.4584.21 info.flags=0x17 2024-09-22T08:33:36.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.286+0000 7f2f083ad800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c62f9d7b-f6b6-404a-90de-de5607499115.4584.21 to cache LRU end 2024-09-22T08:33:36.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.286+0000 7f2f083ad800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:33:36.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.286+0000 7f2f083ad800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:36.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.287+0000 7f2f083ad800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c62f9d7b-f6b6-404a-90de-de5607499115.4584.21 2024-09-22T08:33:36.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.292+0000 7f2f083ad800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c62f9d7b-f6b6-404a-90de-de5607499115.4584.21 info.flags=0x17 2024-09-22T08:33:36.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.292+0000 7f2f083ad800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c62f9d7b-f6b6-404a-90de-de5607499115.4584.21 to cache LRU end 2024-09-22T08:33:36.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.292+0000 7f2f083ad800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:36.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.292+0000 7f2f083ad800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:c62f9d7b-f6b6-404a-90de-de5607499115.4584.21, ofs0, ns] 2024-09-22T08:33:36.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.293+0000 7f2de8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497096 cookie 94213711973152 notifier 6330 bl.length()=913 2024-09-22T08:33:36.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.293+0000 7f2de8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c62f9d7b-f6b6-404a-90de-de5607499115.4584.21 info.flags=0x17 2024-09-22T08:33:36.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.293+0000 7f2de8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c62f9d7b-f6b6-404a-90de-de5607499115.4584.21 to cache LRU end 2024-09-22T08:33:36.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.293+0000 7f2de8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:36.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.293+0000 7f2f083ad800 20 handle_bi_update(): bucket=:abort-at-init-indext[c62f9d7b-f6b6-404a-90de-de5607499115.4584.21]): orig_sources= new_sources= 2024-09-22T08:33:36.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.293+0000 7f2f083ad800 20 handle_bi_update(): bucket=:abort-at-init-indext[c62f9d7b-f6b6-404a-90de-de5607499115.4584.21]): potential sources added=[] removed=[] 2024-09-22T08:33:36.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.293+0000 7f2f083ad800 20 handle_bi_update(): bucket=:abort-at-init-indext[c62f9d7b-f6b6-404a-90de-de5607499115.4584.21]): orig_dests= new_dests= 2024-09-22T08:33:36.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.293+0000 7f2f083ad800 20 handle_bi_update(): bucket=:abort-at-init-indext[c62f9d7b-f6b6-404a-90de-de5607499115.4584.21]): potential dests added=[] removed=[] 2024-09-22T08:33:36.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.298+0000 7f2f083ad800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.1.0 2024-09-22T08:33:36.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.298+0000 7f2f083ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.1.0 2024-09-22T08:33:36.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.298+0000 7f2f083ad800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.1.1 2024-09-22T08:33:36.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.298+0000 7f2f083ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.1.1 2024-09-22T08:33:36.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.298+0000 7f2f083ad800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.1.2 2024-09-22T08:33:36.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.298+0000 7f2f083ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.1.2 2024-09-22T08:33:36.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.298+0000 7f2f083ad800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.1.3 2024-09-22T08:33:36.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.298+0000 7f2f083ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.1.3 2024-09-22T08:33:36.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.298+0000 7f2f083ad800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.1.4 2024-09-22T08:33:36.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.298+0000 7f2f083ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.1.4 2024-09-22T08:33:36.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.298+0000 7f2f083ad800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.1.5 2024-09-22T08:33:36.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.298+0000 7f2f083ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.1.5 2024-09-22T08:33:36.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.298+0000 7f2f083ad800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.1.6 2024-09-22T08:33:36.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.298+0000 7f2f083ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.1.6 2024-09-22T08:33:36.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.298+0000 7f2f083ad800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.1.7 2024-09-22T08:33:36.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.298+0000 7f2f083ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.1.7 2024-09-22T08:33:36.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.298+0000 7f2f083ad800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.1.8 2024-09-22T08:33:36.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.298+0000 7f2f083ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.1.8 2024-09-22T08:33:36.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.298+0000 7f2f083ad800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.1.9 2024-09-22T08:33:36.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.298+0000 7f2f083ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.1.9 2024-09-22T08:33:36.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.298+0000 7f2f083ad800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.1.10 2024-09-22T08:33:36.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.298+0000 7f2f083ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.1.10 2024-09-22T08:33:36.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.298+0000 7f2f083ad800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.1.11 2024-09-22T08:33:36.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.298+0000 7f2f083ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.1.11 2024-09-22T08:33:36.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.298+0000 7f2f083ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.0 2024-09-22T08:33:36.302 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.298+0000 7f2f083ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.1 2024-09-22T08:33:36.302 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.299+0000 7f2f083ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.2 2024-09-22T08:33:36.302 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.299+0000 7f2f083ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.3 2024-09-22T08:33:36.302 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.300+0000 7f2f083ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.4 2024-09-22T08:33:36.302 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.301+0000 7f2f083ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.5 2024-09-22T08:33:36.302 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.301+0000 7f2f083ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.6 2024-09-22T08:33:36.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.302+0000 7f2f083ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.7 2024-09-22T08:33:36.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.303+0000 7f2f083ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.8 2024-09-22T08:33:36.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.303+0000 7f2f083ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.9 2024-09-22T08:33:36.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.304+0000 7f2f083ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.10 2024-09-22T08:33:36.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.308+0000 7f2f083ad800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c62f9d7b-f6b6-404a-90de-de5607499115.4584.21 : hit (requested=0x17, cached=0x17) 2024-09-22T08:33:36.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.308+0000 7f2f083ad800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c62f9d7b-f6b6-404a-90de-de5607499115.4584.21 2024-09-22T08:33:36.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.309+0000 7f2f083ad800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c62f9d7b-f6b6-404a-90de-de5607499115.4584.21 info.flags=0x17 2024-09-22T08:33:36.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.309+0000 7f2f083ad800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c62f9d7b-f6b6-404a-90de-de5607499115.4584.21 to cache LRU end 2024-09-22T08:33:36.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.309+0000 7f2f083ad800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:36.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.309+0000 7f2f083ad800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:c62f9d7b-f6b6-404a-90de-de5607499115.4584.21, ofs0, ns] 2024-09-22T08:33:36.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.309+0000 7f2de97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497097 cookie 94213711973152 notifier 6330 bl.length()=913 2024-09-22T08:33:36.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.310+0000 7f2de97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c62f9d7b-f6b6-404a-90de-de5607499115.4584.21 info.flags=0x17 2024-09-22T08:33:36.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.310+0000 7f2de97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c62f9d7b-f6b6-404a-90de-de5607499115.4584.21 to cache LRU end 2024-09-22T08:33:36.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.310+0000 7f2de97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:36.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.310+0000 7f2f083ad800 20 handle_bi_update(): bucket=:abort-at-init-indext[c62f9d7b-f6b6-404a-90de-de5607499115.4584.21]): orig_sources= new_sources= 2024-09-22T08:33:36.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.310+0000 7f2f083ad800 20 handle_bi_update(): bucket=:abort-at-init-indext[c62f9d7b-f6b6-404a-90de-de5607499115.4584.21]): potential sources added=[] removed=[] 2024-09-22T08:33:36.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.310+0000 7f2f083ad800 20 handle_bi_update(): bucket=:abort-at-init-indext[c62f9d7b-f6b6-404a-90de-de5607499115.4584.21]): orig_dests= new_dests= 2024-09-22T08:33:36.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.310+0000 7f2f083ad800 20 handle_bi_update(): bucket=:abort-at-init-indext[c62f9d7b-f6b6-404a-90de-de5607499115.4584.21]): potential dests added=[] removed=[] 2024-09-22T08:33:36.313 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.313+0000 7f2f083ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.0 2024-09-22T08:33:36.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.313+0000 7f2f083ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.1 2024-09-22T08:33:36.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.313+0000 7f2f083ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.2 2024-09-22T08:33:36.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.314+0000 7f2f083ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.3 2024-09-22T08:33:36.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.314+0000 7f2f083ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.4 2024-09-22T08:33:36.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.315+0000 7f2f083ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.5 2024-09-22T08:33:36.316 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.315+0000 7f2f083ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.6 2024-09-22T08:33:36.316 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.315+0000 7f2f083ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.7 2024-09-22T08:33:36.316 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.316+0000 7f2f083ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.8 2024-09-22T08:33:36.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.316+0000 7f2f083ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.9 2024-09-22T08:33:36.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.317+0000 7f2f083ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.21.10 2024-09-22T08:33:36.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.317+0000 7f2f083ad800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c62f9d7b-f6b6-404a-90de-de5607499115.4584.21 : hit (requested=0x17, cached=0x17) 2024-09-22T08:33:36.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.317+0000 7f2f083ad800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c62f9d7b-f6b6-404a-90de-de5607499115.4584.21 2024-09-22T08:33:36.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.319+0000 7f2f083ad800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c62f9d7b-f6b6-404a-90de-de5607499115.4584.21 info.flags=0x17 2024-09-22T08:33:36.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.319+0000 7f2f083ad800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c62f9d7b-f6b6-404a-90de-de5607499115.4584.21 to cache LRU end 2024-09-22T08:33:36.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.319+0000 7f2f083ad800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:36.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.319+0000 7f2f083ad800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:c62f9d7b-f6b6-404a-90de-de5607499115.4584.21, ofs0, ns] 2024-09-22T08:33:36.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.319+0000 7f2de97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497098 cookie 94213711973152 notifier 6330 bl.length()=881 2024-09-22T08:33:36.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.319+0000 7f2de97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c62f9d7b-f6b6-404a-90de-de5607499115.4584.21 info.flags=0x17 2024-09-22T08:33:36.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.319+0000 7f2de97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c62f9d7b-f6b6-404a-90de-de5607499115.4584.21 to cache LRU end 2024-09-22T08:33:36.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.319+0000 7f2de97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:36.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.319+0000 7f2f083ad800 20 handle_bi_update(): bucket=:abort-at-init-indext[c62f9d7b-f6b6-404a-90de-de5607499115.4584.21]): orig_sources= new_sources= 2024-09-22T08:33:36.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.319+0000 7f2f083ad800 20 handle_bi_update(): bucket=:abort-at-init-indext[c62f9d7b-f6b6-404a-90de-de5607499115.4584.21]): potential sources added=[] removed=[] 2024-09-22T08:33:36.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.319+0000 7f2f083ad800 20 handle_bi_update(): bucket=:abort-at-init-indext[c62f9d7b-f6b6-404a-90de-de5607499115.4584.21]): orig_dests= new_dests= 2024-09-22T08:33:36.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.319+0000 7f2f083ad800 20 handle_bi_update(): bucket=:abort-at-init-indext[c62f9d7b-f6b6-404a-90de-de5607499115.4584.21]): potential dests added=[] removed=[] 2024-09-22T08:33:36.323 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.322+0000 7f2f083ad800 1 execute INFO: reshard of bucket "abort-at-init-indext" from 11 shards to 12 shards completed successfully 2024-09-22T08:33:36.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.324+0000 7f2db7fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:36.327 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.326+0000 7f2f083ad800 20 remove_watcher() i=0 2024-09-22T08:33:36.327 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.326+0000 7f2f083ad800 2 removed watcher, disabling cache 2024-09-22T08:33:36.328 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.327+0000 7f2f083ad800 20 remove_watcher() i=1 2024-09-22T08:33:36.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.329+0000 7f2f083ad800 20 remove_watcher() i=2 2024-09-22T08:33:36.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.330+0000 7f2f083ad800 20 remove_watcher() i=3 2024-09-22T08:33:36.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.331+0000 7f2f083ad800 20 remove_watcher() i=4 2024-09-22T08:33:36.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.332+0000 7f2f083ad800 20 remove_watcher() i=5 2024-09-22T08:33:36.334 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.333+0000 7f2f083ad800 20 remove_watcher() i=6 2024-09-22T08:33:36.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.334+0000 7f2f083ad800 20 remove_watcher() i=7 2024-09-22T08:33:36.349 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-22T08:33:36.379 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:33:36.379 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:33:36.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.418+0000 7ff67f62f800 20 rados->read ofs=0 len=0 2024-09-22T08:33:36.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.420+0000 7ff67f62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:36.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.420+0000 7ff67f62f800 20 realm 2024-09-22T08:33:36.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.420+0000 7ff67f62f800 20 rados->read ofs=0 len=0 2024-09-22T08:33:36.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.421+0000 7ff67f62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:36.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.421+0000 7ff67f62f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:33:36.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.421+0000 7ff67f62f800 20 rados->read ofs=0 len=0 2024-09-22T08:33:36.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.421+0000 7ff67f62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:36.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.421+0000 7ff67f62f800 20 rados->read ofs=0 len=0 2024-09-22T08:33:36.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.422+0000 7ff67f62f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:36.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.422+0000 7ff67f62f800 20 rados->read ofs=0 len=0 2024-09-22T08:33:36.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.422+0000 7ff67f62f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:33:36.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.422+0000 7ff67f62f800 20 searching for the correct realm 2024-09-22T08:33:36.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.425+0000 7ff67d119640 0 -- 172.21.15.38:0/597426635 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x5645b02d0250 msgr2=0x5645b02d26f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:33:36.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.429+0000 7ff67c918640 0 -- 172.21.15.38:0/597426635 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7ff6700d00c0 msgr2=0x7ff6700e60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:36.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.636+0000 7ff67f62f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:33:36.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.636+0000 7ff67f62f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:33:36.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.636+0000 7ff67f62f800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:33:36.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.636+0000 7ff67f62f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:33:36.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.636+0000 7ff67f62f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:33:36.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.636+0000 7ff67f62f800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:33:36.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.636+0000 7ff67f62f800 20 rados->read ofs=0 len=0 2024-09-22T08:33:36.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.636+0000 7ff67f62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:36.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.636+0000 7ff67f62f800 20 rados->read ofs=0 len=0 2024-09-22T08:33:36.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.637+0000 7ff67f62f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:36.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.637+0000 7ff67f62f800 20 rados->read ofs=0 len=0 2024-09-22T08:33:36.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.637+0000 7ff67f62f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:33:36.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.637+0000 7ff67f62f800 20 zone default found 2024-09-22T08:33:36.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.637+0000 7ff67f62f800 4 Realm: () 2024-09-22T08:33:36.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.637+0000 7ff67f62f800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:33:36.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.637+0000 7ff67f62f800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:33:36.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.637+0000 7ff67f62f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:33:36.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.637+0000 7ff67f62f800 20 zonegroup default 2024-09-22T08:33:36.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.637+0000 7ff67f62f800 20 rados->read ofs=0 len=0 2024-09-22T08:33:36.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.638+0000 7ff67f62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:36.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.638+0000 7ff67f62f800 20 rados->read ofs=0 len=0 2024-09-22T08:33:36.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.638+0000 7ff67f62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:36.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.638+0000 7ff67f62f800 20 rados->read ofs=0 len=0 2024-09-22T08:33:36.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.638+0000 7ff67f62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:36.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.638+0000 7ff67f62f800 20 started sync module instance, tier type = 2024-09-22T08:33:36.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.638+0000 7ff67f62f800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:33:36.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.649+0000 7ff67f62f800 20 add_watcher() i=0 2024-09-22T08:33:36.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.649+0000 7ff67f62f800 20 add_watcher() i=1 2024-09-22T08:33:36.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.649+0000 7ff67f62f800 20 add_watcher() i=2 2024-09-22T08:33:36.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.649+0000 7ff67f62f800 20 add_watcher() i=3 2024-09-22T08:33:36.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.649+0000 7ff67f62f800 20 add_watcher() i=4 2024-09-22T08:33:36.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.649+0000 7ff67f62f800 20 add_watcher() i=5 2024-09-22T08:33:36.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.649+0000 7ff67f62f800 20 add_watcher() i=6 2024-09-22T08:33:36.651 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.650+0000 7ff67f62f800 20 add_watcher() i=7 2024-09-22T08:33:36.651 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.650+0000 7ff67f62f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:33:36.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.652+0000 7ff5337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:36.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.652+0000 7ff67f62f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:33:36.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.652+0000 7ff67f62f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:33:36.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.652+0000 7ff67f62f800 5 note: GC not initialized 2024-09-22T08:33:36.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.652+0000 7ff5327e4640 20 reqs_thread_entry: start 2024-09-22T08:33:36.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.653+0000 7ff67f62f800 20 init_complete bucket index max shards: 11 2024-09-22T08:33:36.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.653+0000 7ff67f62f800 20 Filter name: none 2024-09-22T08:33:36.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.653+0000 7ff4a3fff640 20 reqs_thread_entry: start 2024-09-22T08:33:36.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.653+0000 7ff67f62f800 20 rados->read ofs=0 len=0 2024-09-22T08:33:36.655 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.653+0000 7ff67f62f800 20 rados_obj.operate() r=0 bl.length=188 2024-09-22T08:33:36.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.653+0000 7ff67f62f800 20 rados->read ofs=0 len=0 2024-09-22T08:33:36.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.654+0000 7ff67f62f800 20 rados_obj.operate() r=0 bl.length=410 2024-09-22T08:33:36.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.654+0000 7ff67f62f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:33:36.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.654+0000 7ff67f62f800 20 rados->read ofs=0 len=0 2024-09-22T08:33:36.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.655+0000 7ff67f62f800 20 rados_obj.operate() r=0 bl.length=188 2024-09-22T08:33:36.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.655+0000 7ff67f62f800 20 rados->read ofs=0 len=0 2024-09-22T08:33:36.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.655+0000 7ff67f62f800 20 rados_obj.operate() r=0 bl.length=410 2024-09-22T08:33:36.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.655+0000 7ff67f62f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:33:36.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.657+0000 7ff5337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:36.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.660+0000 7ff67f62f800 20 remove_watcher() i=0 2024-09-22T08:33:36.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.660+0000 7ff67f62f800 2 removed watcher, disabling cache 2024-09-22T08:33:36.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.661+0000 7ff67f62f800 20 remove_watcher() i=1 2024-09-22T08:33:36.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.662+0000 7ff67f62f800 20 remove_watcher() i=2 2024-09-22T08:33:36.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.663+0000 7ff67f62f800 20 remove_watcher() i=3 2024-09-22T08:33:36.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.664+0000 7ff67f62f800 20 remove_watcher() i=4 2024-09-22T08:33:36.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.665+0000 7ff67f62f800 20 remove_watcher() i=5 2024-09-22T08:33:36.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.666+0000 7ff67f62f800 20 remove_watcher() i=6 2024-09-22T08:33:36.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:36.668+0000 7ff67f62f800 20 remove_watcher() i=7 2024-09-22T08:33:36.680 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:36.680 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:33:36.680 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-init-indext id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.21 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-22T08:33:36.680 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:36.682 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:36.682 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:36.686 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:36.686 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:36.729 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:36.729 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:36.758 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-22T08:33:36.758 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:36.759 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:36.759 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:36.771 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:36.771 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:36.814 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:36.815 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:36.822 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:36.822 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:36.828 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:36.829 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:36.835 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:36.835 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:36.842 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:36.842 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:36.847 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:36.847 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:36.853 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:36.854 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:36.860 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:36.860 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:36.866 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:36.866 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:36.872 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:36.872 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:36.878 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:36.878 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:36.884 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:36.886 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:36.890 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:36.890 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:36.897 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:36.897 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:36.903 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:36.903 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:36.909 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:36.910 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:36.915 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:36.916 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:36.922 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:36.922 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:36.928 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:36.928 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:36.934 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:36.934 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:36.941 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-22T08:33:36.970 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:33:36.970 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:33:37.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.011+0000 7fa49e21b800 20 rados->read ofs=0 len=0 2024-09-22T08:33:37.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.013+0000 7fa49e21b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:37.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.013+0000 7fa49e21b800 20 realm 2024-09-22T08:33:37.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.013+0000 7fa49e21b800 20 rados->read ofs=0 len=0 2024-09-22T08:33:37.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.013+0000 7fa49e21b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:37.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.013+0000 7fa49e21b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:33:37.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.013+0000 7fa49e21b800 20 rados->read ofs=0 len=0 2024-09-22T08:33:37.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.014+0000 7fa49e21b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:37.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.014+0000 7fa49e21b800 20 rados->read ofs=0 len=0 2024-09-22T08:33:37.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.014+0000 7fa49e21b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:37.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.014+0000 7fa49e21b800 20 rados->read ofs=0 len=0 2024-09-22T08:33:37.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.015+0000 7fa49e21b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:33:37.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.015+0000 7fa49e21b800 20 searching for the correct realm 2024-09-22T08:33:37.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.018+0000 7fa4991ea640 0 -- 172.21.15.38:0/3715296262 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7fa49006c050 msgr2=0x7fa490089130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:33:37.022 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.021+0000 7fa4991ea640 0 -- 172.21.15.38:0/3715296262 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fa48c037040 msgr2=0x7fa48c025400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:33:37.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.228+0000 7fa49e21b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:33:37.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.228+0000 7fa49e21b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:33:37.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.228+0000 7fa49e21b800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:33:37.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.228+0000 7fa49e21b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:33:37.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.228+0000 7fa49e21b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:33:37.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.228+0000 7fa49e21b800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:33:37.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.228+0000 7fa49e21b800 20 rados->read ofs=0 len=0 2024-09-22T08:33:37.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.228+0000 7fa49e21b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:37.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.228+0000 7fa49e21b800 20 rados->read ofs=0 len=0 2024-09-22T08:33:37.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.228+0000 7fa49e21b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:37.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.228+0000 7fa49e21b800 20 rados->read ofs=0 len=0 2024-09-22T08:33:37.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.229+0000 7fa49e21b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:33:37.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.229+0000 7fa49e21b800 20 zone default found 2024-09-22T08:33:37.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.229+0000 7fa49e21b800 4 Realm: () 2024-09-22T08:33:37.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.229+0000 7fa49e21b800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:33:37.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.229+0000 7fa49e21b800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:33:37.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.229+0000 7fa49e21b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:33:37.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.229+0000 7fa49e21b800 20 zonegroup default 2024-09-22T08:33:37.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.229+0000 7fa49e21b800 20 rados->read ofs=0 len=0 2024-09-22T08:33:37.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.229+0000 7fa49e21b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:37.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.229+0000 7fa49e21b800 20 rados->read ofs=0 len=0 2024-09-22T08:33:37.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.229+0000 7fa49e21b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:37.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.229+0000 7fa49e21b800 20 rados->read ofs=0 len=0 2024-09-22T08:33:37.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.230+0000 7fa49e21b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:37.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.230+0000 7fa49e21b800 20 started sync module instance, tier type = 2024-09-22T08:33:37.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.230+0000 7fa49e21b800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:33:37.239 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.238+0000 7fa49e21b800 20 add_watcher() i=0 2024-09-22T08:33:37.239 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.238+0000 7fa49e21b800 20 add_watcher() i=1 2024-09-22T08:33:37.239 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.238+0000 7fa49e21b800 20 add_watcher() i=2 2024-09-22T08:33:37.239 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.238+0000 7fa49e21b800 20 add_watcher() i=3 2024-09-22T08:33:37.239 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.238+0000 7fa49e21b800 20 add_watcher() i=4 2024-09-22T08:33:37.240 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.238+0000 7fa49e21b800 20 add_watcher() i=5 2024-09-22T08:33:37.240 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.238+0000 7fa49e21b800 20 add_watcher() i=6 2024-09-22T08:33:37.240 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.239+0000 7fa49e21b800 20 add_watcher() i=7 2024-09-22T08:33:37.240 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.239+0000 7fa49e21b800 2 all 8 watchers are set, enabling cache 2024-09-22T08:33:37.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.241+0000 7fa34b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:37.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.241+0000 7fa49e21b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:33:37.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.241+0000 7fa49e21b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:33:37.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.241+0000 7fa49e21b800 5 note: GC not initialized 2024-09-22T08:33:37.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.241+0000 7fa34a7fc640 20 reqs_thread_entry: start 2024-09-22T08:33:37.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.242+0000 7fa49e21b800 20 init_complete bucket index max shards: 11 2024-09-22T08:33:37.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.242+0000 7fa49e21b800 20 Filter name: none 2024-09-22T08:33:37.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.242+0000 7fa2bbfff640 20 reqs_thread_entry: start 2024-09-22T08:33:37.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.242+0000 7fa49e21b800 20 rados->read ofs=0 len=0 2024-09-22T08:33:37.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.243+0000 7fa49e21b800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T08:33:37.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.243+0000 7fa49e21b800 20 rados->read ofs=0 len=0 2024-09-22T08:33:37.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.243+0000 7fa49e21b800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T08:33:37.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.243+0000 7fa49e21b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:33:37.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.243+0000 7fa49e21b800 20 rados->read ofs=0 len=0 2024-09-22T08:33:37.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.244+0000 7fa49e21b800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T08:33:37.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.244+0000 7fa49e21b800 20 rados->read ofs=0 len=0 2024-09-22T08:33:37.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.244+0000 7fa49e21b800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T08:33:37.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.244+0000 7fa49e21b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:33:37.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.246+0000 7fa34b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:37.249 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.248+0000 7fa49e21b800 20 remove_watcher() i=0 2024-09-22T08:33:37.249 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.248+0000 7fa49e21b800 2 removed watcher, disabling cache 2024-09-22T08:33:37.250 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.249+0000 7fa49e21b800 20 remove_watcher() i=1 2024-09-22T08:33:37.251 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.250+0000 7fa49e21b800 20 remove_watcher() i=2 2024-09-22T08:33:37.252 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.251+0000 7fa49e21b800 20 remove_watcher() i=3 2024-09-22T08:33:37.253 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.252+0000 7fa49e21b800 20 remove_watcher() i=4 2024-09-22T08:33:37.254 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.253+0000 7fa49e21b800 20 remove_watcher() i=5 2024-09-22T08:33:37.255 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.254+0000 7fa49e21b800 20 remove_watcher() i=6 2024-09-22T08:33:37.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.255+0000 7fa49e21b800 20 remove_watcher() i=7 2024-09-22T08:33:37.267 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:37.267 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:33:37.267 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-set-target-layout id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:33:37.267 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:37.269 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-22T08:33:37.304 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:33:37.304 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:33:37.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.343+0000 7f76db70c800 20 rados->read ofs=0 len=0 2024-09-22T08:33:37.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.345+0000 7f76db70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:37.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.345+0000 7f76db70c800 20 realm 2024-09-22T08:33:37.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.345+0000 7f76db70c800 20 rados->read ofs=0 len=0 2024-09-22T08:33:37.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.345+0000 7f76db70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:37.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.345+0000 7f76db70c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:33:37.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.345+0000 7f76db70c800 20 rados->read ofs=0 len=0 2024-09-22T08:33:37.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.346+0000 7f76db70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:37.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.346+0000 7f76db70c800 20 rados->read ofs=0 len=0 2024-09-22T08:33:37.348 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.346+0000 7f76db70c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:37.348 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.346+0000 7f76db70c800 20 rados->read ofs=0 len=0 2024-09-22T08:33:37.348 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.347+0000 7f76db70c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:33:37.348 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.347+0000 7f76db70c800 20 searching for the correct realm 2024-09-22T08:33:37.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.349+0000 7f76d89f5640 0 -- 172.21.15.38:0/2340806947 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f76d0099410 msgr2=0x7f76d0099890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:37.353 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.352+0000 7f76d89f5640 0 -- 172.21.15.38:0/2340806947 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f76cc03c530 msgr2=0x7f76cc0450f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:33:37.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.558+0000 7f76db70c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:33:37.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.558+0000 7f76db70c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:33:37.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.558+0000 7f76db70c800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:33:37.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.558+0000 7f76db70c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:33:37.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.558+0000 7f76db70c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:33:37.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.558+0000 7f76db70c800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:33:37.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.558+0000 7f76db70c800 20 rados->read ofs=0 len=0 2024-09-22T08:33:37.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.559+0000 7f76db70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:37.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.559+0000 7f76db70c800 20 rados->read ofs=0 len=0 2024-09-22T08:33:37.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.559+0000 7f76db70c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:37.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.559+0000 7f76db70c800 20 rados->read ofs=0 len=0 2024-09-22T08:33:37.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.560+0000 7f76db70c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:33:37.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.560+0000 7f76db70c800 20 zone default found 2024-09-22T08:33:37.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.560+0000 7f76db70c800 4 Realm: () 2024-09-22T08:33:37.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.560+0000 7f76db70c800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:33:37.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.560+0000 7f76db70c800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:33:37.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.560+0000 7f76db70c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:33:37.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.560+0000 7f76db70c800 20 zonegroup default 2024-09-22T08:33:37.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.560+0000 7f76db70c800 20 rados->read ofs=0 len=0 2024-09-22T08:33:37.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.560+0000 7f76db70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:37.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.560+0000 7f76db70c800 20 rados->read ofs=0 len=0 2024-09-22T08:33:37.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.560+0000 7f76db70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:37.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.560+0000 7f76db70c800 20 rados->read ofs=0 len=0 2024-09-22T08:33:37.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.561+0000 7f76db70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:37.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.561+0000 7f76db70c800 20 started sync module instance, tier type = 2024-09-22T08:33:37.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.561+0000 7f76db70c800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:33:37.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.569+0000 7f76db70c800 20 add_watcher() i=0 2024-09-22T08:33:37.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.569+0000 7f76db70c800 20 add_watcher() i=1 2024-09-22T08:33:37.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.569+0000 7f76db70c800 20 add_watcher() i=2 2024-09-22T08:33:37.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.569+0000 7f76db70c800 20 add_watcher() i=3 2024-09-22T08:33:37.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.569+0000 7f76db70c800 20 add_watcher() i=4 2024-09-22T08:33:37.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.569+0000 7f76db70c800 20 add_watcher() i=5 2024-09-22T08:33:37.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.569+0000 7f76db70c800 20 add_watcher() i=6 2024-09-22T08:33:37.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.570+0000 7f76db70c800 20 add_watcher() i=7 2024-09-22T08:33:37.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.570+0000 7f76db70c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:33:37.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.572+0000 7f758f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:37.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.573+0000 7f76db70c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:33:37.576 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.573+0000 7f76db70c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:33:37.576 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.573+0000 7f76db70c800 5 note: GC not initialized 2024-09-22T08:33:37.576 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.573+0000 7f758e7e4640 20 reqs_thread_entry: start 2024-09-22T08:33:37.576 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.573+0000 7f76db70c800 20 init_complete bucket index max shards: 11 2024-09-22T08:33:37.576 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.573+0000 7f76db70c800 20 Filter name: none 2024-09-22T08:33:37.576 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.573+0000 7f74fffff640 20 reqs_thread_entry: start 2024-09-22T08:33:37.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.573+0000 7f76db70c800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-22T08:33:37.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.573+0000 7f76db70c800 20 rados->read ofs=0 len=0 2024-09-22T08:33:37.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.574+0000 7f76db70c800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T08:33:37.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.574+0000 7f76db70c800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-22T08:33:37.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.574+0000 7f76db70c800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-22T08:33:37.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.574+0000 7f76db70c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.22 : miss 2024-09-22T08:33:37.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.574+0000 7f76db70c800 20 rados->read ofs=0 len=0 2024-09-22T08:33:37.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.574+0000 7f76db70c800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T08:33:37.578 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.574+0000 7f76db70c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.22 info.flags=0x17 2024-09-22T08:33:37.578 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.574+0000 7f76db70c800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.22 to cache LRU end 2024-09-22T08:33:37.578 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.574+0000 7f76db70c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:33:37.578 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.574+0000 7f76db70c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:37.578 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.574+0000 7f76db70c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.22 2024-09-22T08:33:37.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.578+0000 7f76db70c800 -1 Injecting error=-5 at location=set_target_layout 2024-09-22T08:33:37.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.578+0000 7f76db70c800 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-22T08:33:37.585 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.584+0000 7f758f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:37.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.586+0000 7f76db70c800 20 remove_watcher() i=0 2024-09-22T08:33:37.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.586+0000 7f76db70c800 2 removed watcher, disabling cache 2024-09-22T08:33:37.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.587+0000 7f76db70c800 20 remove_watcher() i=1 2024-09-22T08:33:37.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.588+0000 7f76db70c800 20 remove_watcher() i=2 2024-09-22T08:33:37.590 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.589+0000 7f76db70c800 20 remove_watcher() i=3 2024-09-22T08:33:37.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.590+0000 7f76db70c800 20 remove_watcher() i=4 2024-09-22T08:33:37.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.591+0000 7f76db70c800 20 remove_watcher() i=5 2024-09-22T08:33:37.593 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.592+0000 7f76db70c800 20 remove_watcher() i=6 2024-09-22T08:33:37.594 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.593+0000 7f76db70c800 20 remove_watcher() i=7 2024-09-22T08:33:37.607 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-22T08:33:37.636 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:33:37.637 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:33:37.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.675+0000 7f18fe535800 20 rados->read ofs=0 len=0 2024-09-22T08:33:37.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.676+0000 7f18fe535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:37.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.676+0000 7f18fe535800 20 realm 2024-09-22T08:33:37.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.676+0000 7f18fe535800 20 rados->read ofs=0 len=0 2024-09-22T08:33:37.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.677+0000 7f18fe535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:37.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.677+0000 7f18fe535800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:33:37.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.677+0000 7f18fe535800 20 rados->read ofs=0 len=0 2024-09-22T08:33:37.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.677+0000 7f18fe535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:37.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.677+0000 7f18fe535800 20 rados->read ofs=0 len=0 2024-09-22T08:33:37.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.678+0000 7f18fe535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:37.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.678+0000 7f18fe535800 20 rados->read ofs=0 len=0 2024-09-22T08:33:37.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.678+0000 7f18fe535800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:33:37.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.678+0000 7f18fe535800 20 searching for the correct realm 2024-09-22T08:33:37.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.680+0000 7f18f9a7c640 0 -- 172.21.15.38:0/1390278042 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f18f007d040 msgr2=0x7f18f008b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:37.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:37.885+0000 7f18f9a7c640 0 -- 172.21.15.38:0/1390278042 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f18ec073a30 msgr2=0x7f18ec0849f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:33:38.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.092+0000 7f18fe535800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:33:38.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.093+0000 7f18fe535800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:33:38.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.093+0000 7f18fe535800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:33:38.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.093+0000 7f18fe535800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:33:38.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.093+0000 7f18fe535800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:33:38.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.093+0000 7f18fe535800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:33:38.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.093+0000 7f18fe535800 20 rados->read ofs=0 len=0 2024-09-22T08:33:38.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.093+0000 7f18fe535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:38.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.093+0000 7f18fe535800 20 rados->read ofs=0 len=0 2024-09-22T08:33:38.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.094+0000 7f18fe535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:38.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.094+0000 7f18fe535800 20 rados->read ofs=0 len=0 2024-09-22T08:33:38.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.094+0000 7f18fe535800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:33:38.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.094+0000 7f18fe535800 20 zone default found 2024-09-22T08:33:38.098 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.094+0000 7f18fe535800 4 Realm: () 2024-09-22T08:33:38.098 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.094+0000 7f18fe535800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:33:38.098 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.094+0000 7f18fe535800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:33:38.098 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.094+0000 7f18fe535800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:33:38.098 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.094+0000 7f18fe535800 20 zonegroup default 2024-09-22T08:33:38.098 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.094+0000 7f18fe535800 20 rados->read ofs=0 len=0 2024-09-22T08:33:38.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.094+0000 7f18fe535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:38.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.094+0000 7f18fe535800 20 rados->read ofs=0 len=0 2024-09-22T08:33:38.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.095+0000 7f18fe535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:38.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.095+0000 7f18fe535800 20 rados->read ofs=0 len=0 2024-09-22T08:33:38.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.095+0000 7f18fe535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:38.100 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.095+0000 7f18fe535800 20 started sync module instance, tier type = 2024-09-22T08:33:38.100 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.095+0000 7f18fe535800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:33:38.106 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.105+0000 7f18fe535800 20 add_watcher() i=0 2024-09-22T08:33:38.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.105+0000 7f18fe535800 20 add_watcher() i=1 2024-09-22T08:33:38.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.105+0000 7f18fe535800 20 add_watcher() i=2 2024-09-22T08:33:38.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.105+0000 7f18fe535800 20 add_watcher() i=3 2024-09-22T08:33:38.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.105+0000 7f18fe535800 20 add_watcher() i=4 2024-09-22T08:33:38.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.105+0000 7f18fe535800 20 add_watcher() i=5 2024-09-22T08:33:38.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.105+0000 7f18fe535800 20 add_watcher() i=6 2024-09-22T08:33:38.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.107+0000 7f18fe535800 20 add_watcher() i=7 2024-09-22T08:33:38.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.107+0000 7f18fe535800 2 all 8 watchers are set, enabling cache 2024-09-22T08:33:38.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.109+0000 7f17b0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:38.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.109+0000 7f18fe535800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:33:38.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.109+0000 7f18fe535800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:33:38.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.109+0000 7f18fe535800 5 note: GC not initialized 2024-09-22T08:33:38.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.109+0000 7f172b7fe640 20 reqs_thread_entry: start 2024-09-22T08:33:38.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.109+0000 7f18fe535800 20 init_complete bucket index max shards: 11 2024-09-22T08:33:38.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.109+0000 7f18fe535800 20 Filter name: none 2024-09-22T08:33:38.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.110+0000 7f17297fa640 20 reqs_thread_entry: start 2024-09-22T08:33:38.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.110+0000 7f18fe535800 20 rados->read ofs=0 len=0 2024-09-22T08:33:38.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.110+0000 7f18fe535800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T08:33:38.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.110+0000 7f18fe535800 20 rados->read ofs=0 len=0 2024-09-22T08:33:38.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.111+0000 7f18fe535800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T08:33:38.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.111+0000 7f18fe535800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:33:38.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.111+0000 7f18fe535800 20 rados->read ofs=0 len=0 2024-09-22T08:33:38.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.111+0000 7f18fe535800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T08:33:38.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.111+0000 7f18fe535800 20 rados->read ofs=0 len=0 2024-09-22T08:33:38.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.112+0000 7f18fe535800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T08:33:38.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.112+0000 7f18fe535800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:33:38.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.114+0000 7f17b0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:38.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.116+0000 7f18fe535800 20 remove_watcher() i=0 2024-09-22T08:33:38.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.116+0000 7f18fe535800 2 removed watcher, disabling cache 2024-09-22T08:33:38.118 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.117+0000 7f18fe535800 20 remove_watcher() i=1 2024-09-22T08:33:38.120 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.120+0000 7f18fe535800 20 remove_watcher() i=2 2024-09-22T08:33:38.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.122+0000 7f18fe535800 20 remove_watcher() i=3 2024-09-22T08:33:38.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.123+0000 7f18fe535800 20 remove_watcher() i=4 2024-09-22T08:33:38.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.124+0000 7f18fe535800 20 remove_watcher() i=5 2024-09-22T08:33:38.126 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.125+0000 7f18fe535800 20 remove_watcher() i=6 2024-09-22T08:33:38.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.127+0000 7f18fe535800 20 remove_watcher() i=7 2024-09-22T08:33:38.140 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:38.141 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:33:38.141 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-set-target-layout id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:33:38.141 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:38.143 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:38.143 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:38.149 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:38.149 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:38.193 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:33:38.227 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:33:38.227 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:33:38.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.269+0000 7f51d8887800 20 rados->read ofs=0 len=0 2024-09-22T08:33:38.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.271+0000 7f51d8887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:38.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.271+0000 7f51d8887800 20 realm 2024-09-22T08:33:38.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.271+0000 7f51d8887800 20 rados->read ofs=0 len=0 2024-09-22T08:33:38.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.271+0000 7f51d8887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:38.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.271+0000 7f51d8887800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:33:38.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.271+0000 7f51d8887800 20 rados->read ofs=0 len=0 2024-09-22T08:33:38.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.271+0000 7f51d8887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:38.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.271+0000 7f51d8887800 20 rados->read ofs=0 len=0 2024-09-22T08:33:38.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.272+0000 7f51d8887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:38.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.272+0000 7f51d8887800 20 rados->read ofs=0 len=0 2024-09-22T08:33:38.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.273+0000 7f51d8887800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:33:38.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.273+0000 7f51d8887800 20 searching for the correct realm 2024-09-22T08:33:38.276 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.276+0000 7f51d5b77640 0 -- 172.21.15.38:0/1673602023 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f51cc077c20 msgr2=0x7f51cc068780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:38.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.482+0000 7f51d5b77640 0 -- 172.21.15.38:0/1673602023 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f51c8099400 msgr2=0x7f51c8099880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:33:38.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.689+0000 7f51d8887800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:33:38.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.689+0000 7f51d8887800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:33:38.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.689+0000 7f51d8887800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:33:38.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.689+0000 7f51d8887800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:33:38.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.689+0000 7f51d8887800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:33:38.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.689+0000 7f51d8887800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:33:38.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.689+0000 7f51d8887800 20 rados->read ofs=0 len=0 2024-09-22T08:33:38.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.690+0000 7f51d8887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:38.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.690+0000 7f51d8887800 20 rados->read ofs=0 len=0 2024-09-22T08:33:38.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.690+0000 7f51d8887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:38.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.690+0000 7f51d8887800 20 rados->read ofs=0 len=0 2024-09-22T08:33:38.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.691+0000 7f51d8887800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:33:38.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.691+0000 7f51d8887800 20 zone default found 2024-09-22T08:33:38.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.691+0000 7f51d8887800 4 Realm: () 2024-09-22T08:33:38.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.691+0000 7f51d8887800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:33:38.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.691+0000 7f51d8887800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:33:38.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.691+0000 7f51d8887800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:33:38.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.691+0000 7f51d8887800 20 zonegroup default 2024-09-22T08:33:38.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.691+0000 7f51d8887800 20 rados->read ofs=0 len=0 2024-09-22T08:33:38.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.691+0000 7f51d8887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:38.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.691+0000 7f51d8887800 20 rados->read ofs=0 len=0 2024-09-22T08:33:38.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.691+0000 7f51d8887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:38.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.691+0000 7f51d8887800 20 rados->read ofs=0 len=0 2024-09-22T08:33:38.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.692+0000 7f51d8887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:38.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.692+0000 7f51d8887800 20 started sync module instance, tier type = 2024-09-22T08:33:38.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.692+0000 7f51d8887800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:33:38.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.703+0000 7f51d8887800 20 add_watcher() i=0 2024-09-22T08:33:38.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.703+0000 7f51d8887800 20 add_watcher() i=1 2024-09-22T08:33:38.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.703+0000 7f51d8887800 20 add_watcher() i=2 2024-09-22T08:33:38.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.703+0000 7f51d8887800 20 add_watcher() i=3 2024-09-22T08:33:38.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.703+0000 7f51d8887800 20 add_watcher() i=4 2024-09-22T08:33:38.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.703+0000 7f51d8887800 20 add_watcher() i=5 2024-09-22T08:33:38.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.703+0000 7f51d8887800 20 add_watcher() i=6 2024-09-22T08:33:38.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.704+0000 7f51d8887800 20 add_watcher() i=7 2024-09-22T08:33:38.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.704+0000 7f51d8887800 2 all 8 watchers are set, enabling cache 2024-09-22T08:33:38.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.706+0000 7f508cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:38.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.707+0000 7f51d8887800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:33:38.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.707+0000 7f51d8887800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:33:38.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.707+0000 7f51d8887800 5 note: GC not initialized 2024-09-22T08:33:38.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.707+0000 7f50077fe640 20 reqs_thread_entry: start 2024-09-22T08:33:38.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.707+0000 7f51d8887800 20 init_complete bucket index max shards: 11 2024-09-22T08:33:38.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.707+0000 7f51d8887800 20 Filter name: none 2024-09-22T08:33:38.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.707+0000 7f50057fa640 20 reqs_thread_entry: start 2024-09-22T08:33:38.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.707+0000 7f51d8887800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-22T08:33:38.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.707+0000 7f51d8887800 20 rados->read ofs=0 len=0 2024-09-22T08:33:38.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.708+0000 7f51d8887800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T08:33:38.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.708+0000 7f51d8887800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-22T08:33:38.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.708+0000 7f51d8887800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-22T08:33:38.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.708+0000 7f51d8887800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.22 : miss 2024-09-22T08:33:38.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.708+0000 7f51d8887800 20 rados->read ofs=0 len=0 2024-09-22T08:33:38.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.708+0000 7f51d8887800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T08:33:38.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.708+0000 7f51d8887800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.22 info.flags=0x17 2024-09-22T08:33:38.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.708+0000 7f51d8887800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.22 to cache LRU end 2024-09-22T08:33:38.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.708+0000 7f51d8887800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:33:38.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.708+0000 7f51d8887800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:38.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.708+0000 7f51d8887800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.22 2024-09-22T08:33:38.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.714+0000 7f51d8887800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.22 info.flags=0x17 2024-09-22T08:33:38.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.714+0000 7f51d8887800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.22 to cache LRU end 2024-09-22T08:33:38.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.714+0000 7f51d8887800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:38.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.714+0000 7f51d8887800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.22, ofs0, ns] 2024-09-22T08:33:38.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.714+0000 7f50b97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496996 cookie 94108592601760 notifier 6426 bl.length()=925 2024-09-22T08:33:38.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.714+0000 7f50b97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.22 info.flags=0x17 2024-09-22T08:33:38.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.714+0000 7f50b97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.22 to cache LRU end 2024-09-22T08:33:38.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.714+0000 7f50b97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:38.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.715+0000 7f51d8887800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.22]): orig_sources= new_sources= 2024-09-22T08:33:38.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.715+0000 7f51d8887800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.22]): potential sources added=[] removed=[] 2024-09-22T08:33:38.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.715+0000 7f51d8887800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.22]): orig_dests= new_dests= 2024-09-22T08:33:38.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.715+0000 7f51d8887800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.22]): potential dests added=[] removed=[] 2024-09-22T08:33:38.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.721+0000 7f51d8887800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.1.0 2024-09-22T08:33:38.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.721+0000 7f51d8887800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.1.0 2024-09-22T08:33:38.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.721+0000 7f51d8887800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.1.1 2024-09-22T08:33:38.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.721+0000 7f51d8887800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.1.1 2024-09-22T08:33:38.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.721+0000 7f51d8887800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.1.2 2024-09-22T08:33:38.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.721+0000 7f51d8887800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.1.2 2024-09-22T08:33:38.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.721+0000 7f51d8887800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.1.3 2024-09-22T08:33:38.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.721+0000 7f51d8887800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.1.3 2024-09-22T08:33:38.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.721+0000 7f51d8887800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.1.4 2024-09-22T08:33:38.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.721+0000 7f51d8887800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.1.4 2024-09-22T08:33:38.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.721+0000 7f51d8887800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.1.5 2024-09-22T08:33:38.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.721+0000 7f51d8887800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.1.5 2024-09-22T08:33:38.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.721+0000 7f51d8887800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.1.6 2024-09-22T08:33:38.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.721+0000 7f51d8887800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.1.6 2024-09-22T08:33:38.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.721+0000 7f51d8887800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.1.7 2024-09-22T08:33:38.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.721+0000 7f51d8887800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.1.7 2024-09-22T08:33:38.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.721+0000 7f51d8887800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.1.8 2024-09-22T08:33:38.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.721+0000 7f51d8887800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.1.8 2024-09-22T08:33:38.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.721+0000 7f51d8887800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.1.9 2024-09-22T08:33:38.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.721+0000 7f51d8887800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.1.9 2024-09-22T08:33:38.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.721+0000 7f51d8887800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.1.10 2024-09-22T08:33:38.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.721+0000 7f51d8887800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.1.10 2024-09-22T08:33:38.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.721+0000 7f51d8887800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.1.11 2024-09-22T08:33:38.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.721+0000 7f51d8887800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.1.11 2024-09-22T08:33:38.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.721+0000 7f51d8887800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.0 2024-09-22T08:33:38.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.721+0000 7f51d8887800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.1 2024-09-22T08:33:38.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.722+0000 7f51d8887800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.2 2024-09-22T08:33:38.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.722+0000 7f51d8887800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.3 2024-09-22T08:33:38.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.723+0000 7f51d8887800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.4 2024-09-22T08:33:38.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.724+0000 7f51d8887800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.5 2024-09-22T08:33:38.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.724+0000 7f51d8887800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.6 2024-09-22T08:33:38.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.725+0000 7f51d8887800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.7 2024-09-22T08:33:38.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.725+0000 7f51d8887800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.8 2024-09-22T08:33:38.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.726+0000 7f51d8887800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.9 2024-09-22T08:33:38.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.726+0000 7f51d8887800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.10 2024-09-22T08:33:38.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.730+0000 7f51d8887800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.22 : hit (requested=0x17, cached=0x17) 2024-09-22T08:33:38.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.730+0000 7f51d8887800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.22 2024-09-22T08:33:38.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.731+0000 7f51d8887800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.22 info.flags=0x17 2024-09-22T08:33:38.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.731+0000 7f51d8887800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.22 to cache LRU end 2024-09-22T08:33:38.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.731+0000 7f51d8887800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:38.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.731+0000 7f51d8887800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.22, ofs0, ns] 2024-09-22T08:33:38.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.732+0000 7f50b97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496997 cookie 94108592601760 notifier 6426 bl.length()=925 2024-09-22T08:33:38.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.732+0000 7f50b97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.22 info.flags=0x17 2024-09-22T08:33:38.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.732+0000 7f50b97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.22 to cache LRU end 2024-09-22T08:33:38.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.732+0000 7f50b97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:38.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.732+0000 7f51d8887800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.22]): orig_sources= new_sources= 2024-09-22T08:33:38.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.732+0000 7f51d8887800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.22]): potential sources added=[] removed=[] 2024-09-22T08:33:38.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.732+0000 7f51d8887800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.22]): orig_dests= new_dests= 2024-09-22T08:33:38.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.732+0000 7f51d8887800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.22]): potential dests added=[] removed=[] 2024-09-22T08:33:38.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.735+0000 7f51d8887800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.0 2024-09-22T08:33:38.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.735+0000 7f51d8887800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.1 2024-09-22T08:33:38.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.736+0000 7f51d8887800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.2 2024-09-22T08:33:38.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.736+0000 7f51d8887800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.3 2024-09-22T08:33:38.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.736+0000 7f51d8887800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.4 2024-09-22T08:33:38.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.737+0000 7f51d8887800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.5 2024-09-22T08:33:38.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.738+0000 7f51d8887800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.6 2024-09-22T08:33:38.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.738+0000 7f51d8887800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.7 2024-09-22T08:33:38.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.738+0000 7f51d8887800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.8 2024-09-22T08:33:38.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.739+0000 7f51d8887800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.9 2024-09-22T08:33:38.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.739+0000 7f51d8887800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.22.10 2024-09-22T08:33:38.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.739+0000 7f51d8887800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.22 : hit (requested=0x17, cached=0x17) 2024-09-22T08:33:38.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.740+0000 7f51d8887800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.22 2024-09-22T08:33:38.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.741+0000 7f51d8887800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.22 info.flags=0x17 2024-09-22T08:33:38.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.741+0000 7f51d8887800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.22 to cache LRU end 2024-09-22T08:33:38.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.741+0000 7f51d8887800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:38.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.741+0000 7f51d8887800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.22, ofs0, ns] 2024-09-22T08:33:38.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.741+0000 7f50b97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496998 cookie 94108592601760 notifier 6426 bl.length()=893 2024-09-22T08:33:38.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.741+0000 7f50b97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.22 info.flags=0x17 2024-09-22T08:33:38.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.741+0000 7f50b97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.22 to cache LRU end 2024-09-22T08:33:38.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.741+0000 7f50b97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:38.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.742+0000 7f51d8887800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.22]): orig_sources= new_sources= 2024-09-22T08:33:38.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.742+0000 7f51d8887800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.22]): potential sources added=[] removed=[] 2024-09-22T08:33:38.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.742+0000 7f51d8887800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.22]): orig_dests= new_dests= 2024-09-22T08:33:38.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.742+0000 7f51d8887800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.22]): potential dests added=[] removed=[] 2024-09-22T08:33:38.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.745+0000 7f51d8887800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-22T08:33:38.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.747+0000 7f508cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:38.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.749+0000 7f51d8887800 20 remove_watcher() i=0 2024-09-22T08:33:38.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.749+0000 7f51d8887800 2 removed watcher, disabling cache 2024-09-22T08:33:38.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.750+0000 7f51d8887800 20 remove_watcher() i=1 2024-09-22T08:33:38.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.751+0000 7f51d8887800 20 remove_watcher() i=2 2024-09-22T08:33:38.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.753+0000 7f51d8887800 20 remove_watcher() i=3 2024-09-22T08:33:38.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.754+0000 7f51d8887800 20 remove_watcher() i=4 2024-09-22T08:33:38.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.755+0000 7f51d8887800 20 remove_watcher() i=5 2024-09-22T08:33:38.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.757+0000 7f51d8887800 20 remove_watcher() i=6 2024-09-22T08:33:38.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.758+0000 7f51d8887800 20 remove_watcher() i=7 2024-09-22T08:33:38.772 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-22T08:33:38.802 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:33:38.803 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:33:38.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.842+0000 7f4eb6125800 20 rados->read ofs=0 len=0 2024-09-22T08:33:38.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.844+0000 7f4eb6125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:38.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.844+0000 7f4eb6125800 20 realm 2024-09-22T08:33:38.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.844+0000 7f4eb6125800 20 rados->read ofs=0 len=0 2024-09-22T08:33:38.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.844+0000 7f4eb6125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:38.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.844+0000 7f4eb6125800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:33:38.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.844+0000 7f4eb6125800 20 rados->read ofs=0 len=0 2024-09-22T08:33:38.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.844+0000 7f4eb6125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:38.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.844+0000 7f4eb6125800 20 rados->read ofs=0 len=0 2024-09-22T08:33:38.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.845+0000 7f4eb6125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:38.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.845+0000 7f4eb6125800 20 rados->read ofs=0 len=0 2024-09-22T08:33:38.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.846+0000 7f4eb6125800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:33:38.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.846+0000 7f4eb6125800 20 searching for the correct realm 2024-09-22T08:33:38.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.848+0000 7f4eb15ad640 0 -- 172.21.15.38:0/993407625 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f4ea8033070 msgr2=0x7f4ea8075990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:38.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:38.852+0000 7f4eb15ad640 0 -- 172.21.15.38:0/993407625 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f4ea4040040 msgr2=0x7f4ea4040420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:33:39.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.059+0000 7f4eb6125800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:33:39.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.059+0000 7f4eb6125800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:33:39.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.059+0000 7f4eb6125800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:33:39.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.059+0000 7f4eb6125800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:33:39.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.059+0000 7f4eb6125800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:33:39.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.059+0000 7f4eb6125800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:33:39.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.059+0000 7f4eb6125800 20 rados->read ofs=0 len=0 2024-09-22T08:33:39.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.060+0000 7f4eb6125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:39.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.060+0000 7f4eb6125800 20 rados->read ofs=0 len=0 2024-09-22T08:33:39.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.060+0000 7f4eb6125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:39.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.060+0000 7f4eb6125800 20 rados->read ofs=0 len=0 2024-09-22T08:33:39.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.060+0000 7f4eb6125800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:33:39.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.060+0000 7f4eb6125800 20 zone default found 2024-09-22T08:33:39.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.060+0000 7f4eb6125800 4 Realm: () 2024-09-22T08:33:39.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.060+0000 7f4eb6125800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:33:39.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.060+0000 7f4eb6125800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:33:39.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.060+0000 7f4eb6125800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:33:39.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.060+0000 7f4eb6125800 20 zonegroup default 2024-09-22T08:33:39.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.060+0000 7f4eb6125800 20 rados->read ofs=0 len=0 2024-09-22T08:33:39.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.061+0000 7f4eb6125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:39.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.061+0000 7f4eb6125800 20 rados->read ofs=0 len=0 2024-09-22T08:33:39.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.061+0000 7f4eb6125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:39.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.061+0000 7f4eb6125800 20 rados->read ofs=0 len=0 2024-09-22T08:33:39.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.061+0000 7f4eb6125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:39.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.061+0000 7f4eb6125800 20 started sync module instance, tier type = 2024-09-22T08:33:39.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.061+0000 7f4eb6125800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:33:39.072 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.071+0000 7f4eb6125800 20 add_watcher() i=0 2024-09-22T08:33:39.072 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.071+0000 7f4eb6125800 20 add_watcher() i=1 2024-09-22T08:33:39.072 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.071+0000 7f4eb6125800 20 add_watcher() i=2 2024-09-22T08:33:39.072 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.071+0000 7f4eb6125800 20 add_watcher() i=3 2024-09-22T08:33:39.072 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.071+0000 7f4eb6125800 20 add_watcher() i=4 2024-09-22T08:33:39.072 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.071+0000 7f4eb6125800 20 add_watcher() i=5 2024-09-22T08:33:39.072 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.071+0000 7f4eb6125800 20 add_watcher() i=6 2024-09-22T08:33:39.073 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.072+0000 7f4eb6125800 20 add_watcher() i=7 2024-09-22T08:33:39.073 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.072+0000 7f4eb6125800 2 all 8 watchers are set, enabling cache 2024-09-22T08:33:39.075 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.074+0000 7f4d637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:39.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.074+0000 7f4eb6125800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:33:39.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.074+0000 7f4eb6125800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:33:39.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.074+0000 7f4eb6125800 5 note: GC not initialized 2024-09-22T08:33:39.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.075+0000 7f4d627fc640 20 reqs_thread_entry: start 2024-09-22T08:33:39.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.075+0000 7f4eb6125800 20 init_complete bucket index max shards: 11 2024-09-22T08:33:39.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.075+0000 7f4eb6125800 20 Filter name: none 2024-09-22T08:33:39.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.075+0000 7f4cd3fff640 20 reqs_thread_entry: start 2024-09-22T08:33:39.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.075+0000 7f4eb6125800 20 rados->read ofs=0 len=0 2024-09-22T08:33:39.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.076+0000 7f4eb6125800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T08:33:39.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.076+0000 7f4eb6125800 20 rados->read ofs=0 len=0 2024-09-22T08:33:39.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.076+0000 7f4eb6125800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T08:33:39.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.076+0000 7f4eb6125800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:33:39.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.076+0000 7f4eb6125800 20 rados->read ofs=0 len=0 2024-09-22T08:33:39.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.077+0000 7f4eb6125800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T08:33:39.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.077+0000 7f4eb6125800 20 rados->read ofs=0 len=0 2024-09-22T08:33:39.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.077+0000 7f4eb6125800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T08:33:39.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.077+0000 7f4eb6125800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:33:39.080 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.079+0000 7f4d637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:39.082 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.081+0000 7f4eb6125800 20 remove_watcher() i=0 2024-09-22T08:33:39.082 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.081+0000 7f4eb6125800 2 removed watcher, disabling cache 2024-09-22T08:33:39.083 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.082+0000 7f4eb6125800 20 remove_watcher() i=1 2024-09-22T08:33:39.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.083+0000 7f4eb6125800 20 remove_watcher() i=2 2024-09-22T08:33:39.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.084+0000 7f4eb6125800 20 remove_watcher() i=3 2024-09-22T08:33:39.086 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.086+0000 7f4eb6125800 20 remove_watcher() i=4 2024-09-22T08:33:39.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.087+0000 7f4eb6125800 20 remove_watcher() i=5 2024-09-22T08:33:39.088 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.088+0000 7f4eb6125800 20 remove_watcher() i=6 2024-09-22T08:33:39.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.089+0000 7f4eb6125800 20 remove_watcher() i=7 2024-09-22T08:33:39.102 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:39.102 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:33:39.102 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-set-target-layout id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.22 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-22T08:33:39.102 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:39.103 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:39.103 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:39.106 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:39.106 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:39.149 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:39.150 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:39.177 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-22T08:33:39.177 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:39.178 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:39.178 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:39.189 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:39.189 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:39.232 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:39.232 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:39.237 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:39.237 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:39.243 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:39.243 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:39.249 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:39.249 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:39.255 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:39.255 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:39.261 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:39.261 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:39.266 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:39.267 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:39.272 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:39.272 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:39.278 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:39.278 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:39.283 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:39.283 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:39.289 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:39.289 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:39.295 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:39.295 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:39.301 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:39.301 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:39.306 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:39.307 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:39.312 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:39.312 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:39.318 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:39.318 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:39.324 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:39.324 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:39.330 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:39.330 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:39.335 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:39.336 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:39.341 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:39.341 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:39.347 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-22T08:33:39.376 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:33:39.377 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:33:39.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.414+0000 7f8352b23800 20 rados->read ofs=0 len=0 2024-09-22T08:33:39.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.416+0000 7f8352b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:39.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.416+0000 7f8352b23800 20 realm 2024-09-22T08:33:39.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.416+0000 7f8352b23800 20 rados->read ofs=0 len=0 2024-09-22T08:33:39.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.417+0000 7f8352b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:39.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.417+0000 7f8352b23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:33:39.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.417+0000 7f8352b23800 20 rados->read ofs=0 len=0 2024-09-22T08:33:39.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.417+0000 7f8352b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:39.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.417+0000 7f8352b23800 20 rados->read ofs=0 len=0 2024-09-22T08:33:39.420 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.417+0000 7f8352b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:39.420 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.417+0000 7f8352b23800 20 rados->read ofs=0 len=0 2024-09-22T08:33:39.420 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.418+0000 7f8352b23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:33:39.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.418+0000 7f8352b23800 20 searching for the correct realm 2024-09-22T08:33:39.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.420+0000 7f834e043640 0 -- 172.21.15.38:0/4220985051 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f8344018070 msgr2=0x7f8344050400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:39.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.625+0000 7f834e043640 0 -- 172.21.15.38:0/4220985051 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f8340027410 msgr2=0x7f8340027890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:39.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.833+0000 7f8352b23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:33:39.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.833+0000 7f8352b23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:33:39.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.833+0000 7f8352b23800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:33:39.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.833+0000 7f8352b23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:33:39.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.833+0000 7f8352b23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:33:39.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.833+0000 7f8352b23800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:33:39.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.833+0000 7f8352b23800 20 rados->read ofs=0 len=0 2024-09-22T08:33:39.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.833+0000 7f8352b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:39.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.833+0000 7f8352b23800 20 rados->read ofs=0 len=0 2024-09-22T08:33:39.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.834+0000 7f8352b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:39.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.834+0000 7f8352b23800 20 rados->read ofs=0 len=0 2024-09-22T08:33:39.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.834+0000 7f8352b23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:33:39.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.834+0000 7f8352b23800 20 zone default found 2024-09-22T08:33:39.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.834+0000 7f8352b23800 4 Realm: () 2024-09-22T08:33:39.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.834+0000 7f8352b23800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:33:39.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.834+0000 7f8352b23800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:33:39.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.834+0000 7f8352b23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:33:39.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.834+0000 7f8352b23800 20 zonegroup default 2024-09-22T08:33:39.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.834+0000 7f8352b23800 20 rados->read ofs=0 len=0 2024-09-22T08:33:39.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.835+0000 7f8352b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:39.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.835+0000 7f8352b23800 20 rados->read ofs=0 len=0 2024-09-22T08:33:39.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.835+0000 7f8352b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:39.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.835+0000 7f8352b23800 20 rados->read ofs=0 len=0 2024-09-22T08:33:39.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.835+0000 7f8352b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:39.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.836+0000 7f8352b23800 20 started sync module instance, tier type = 2024-09-22T08:33:39.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.836+0000 7f8352b23800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:33:39.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.845+0000 7f8352b23800 20 add_watcher() i=0 2024-09-22T08:33:39.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.845+0000 7f8352b23800 20 add_watcher() i=1 2024-09-22T08:33:39.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.845+0000 7f8352b23800 20 add_watcher() i=2 2024-09-22T08:33:39.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.845+0000 7f8352b23800 20 add_watcher() i=3 2024-09-22T08:33:39.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.845+0000 7f8352b23800 20 add_watcher() i=4 2024-09-22T08:33:39.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.845+0000 7f8352b23800 20 add_watcher() i=5 2024-09-22T08:33:39.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.845+0000 7f8352b23800 20 add_watcher() i=6 2024-09-22T08:33:39.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.846+0000 7f8352b23800 20 add_watcher() i=7 2024-09-22T08:33:39.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.846+0000 7f8352b23800 2 all 8 watchers are set, enabling cache 2024-09-22T08:33:39.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.848+0000 7f8205fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:39.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.849+0000 7f8352b23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:33:39.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.849+0000 7f8352b23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:33:39.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.849+0000 7f8352b23800 5 note: GC not initialized 2024-09-22T08:33:39.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.849+0000 7f8204fe1640 20 reqs_thread_entry: start 2024-09-22T08:33:39.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.849+0000 7f8352b23800 20 init_complete bucket index max shards: 11 2024-09-22T08:33:39.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.849+0000 7f8352b23800 20 Filter name: none 2024-09-22T08:33:39.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.849+0000 7f81fdffb640 20 reqs_thread_entry: start 2024-09-22T08:33:39.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.849+0000 7f8352b23800 20 rados->read ofs=0 len=0 2024-09-22T08:33:39.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.850+0000 7f8352b23800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T08:33:39.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.850+0000 7f8352b23800 20 rados->read ofs=0 len=0 2024-09-22T08:33:39.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.851+0000 7f8352b23800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T08:33:39.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.851+0000 7f8352b23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:33:39.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.851+0000 7f8352b23800 20 rados->read ofs=0 len=0 2024-09-22T08:33:39.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.852+0000 7f8352b23800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T08:33:39.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.852+0000 7f8352b23800 20 rados->read ofs=0 len=0 2024-09-22T08:33:39.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.852+0000 7f8352b23800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T08:33:39.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.852+0000 7f8352b23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:33:39.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.854+0000 7f8205fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:39.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.857+0000 7f8352b23800 20 remove_watcher() i=0 2024-09-22T08:33:39.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.857+0000 7f8352b23800 2 removed watcher, disabling cache 2024-09-22T08:33:39.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.858+0000 7f8352b23800 20 remove_watcher() i=1 2024-09-22T08:33:39.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.859+0000 7f8352b23800 20 remove_watcher() i=2 2024-09-22T08:33:39.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.860+0000 7f8352b23800 20 remove_watcher() i=3 2024-09-22T08:33:39.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.861+0000 7f8352b23800 20 remove_watcher() i=4 2024-09-22T08:33:39.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.862+0000 7f8352b23800 20 remove_watcher() i=5 2024-09-22T08:33:39.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.863+0000 7f8352b23800 20 remove_watcher() i=6 2024-09-22T08:33:39.865 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.864+0000 7f8352b23800 20 remove_watcher() i=7 2024-09-22T08:33:39.877 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:39.877 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:33:39.877 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-set-target-layout id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:33:39.877 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:39.879 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-22T08:33:39.916 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:33:39.917 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:33:39.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.957+0000 7f7fcd92e800 20 rados->read ofs=0 len=0 2024-09-22T08:33:39.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.959+0000 7f7fcd92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:39.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.959+0000 7f7fcd92e800 20 realm 2024-09-22T08:33:39.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.959+0000 7f7fcd92e800 20 rados->read ofs=0 len=0 2024-09-22T08:33:39.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.959+0000 7f7fcd92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:39.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.959+0000 7f7fcd92e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:33:39.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.959+0000 7f7fcd92e800 20 rados->read ofs=0 len=0 2024-09-22T08:33:39.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.959+0000 7f7fcd92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:39.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.959+0000 7f7fcd92e800 20 rados->read ofs=0 len=0 2024-09-22T08:33:39.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.960+0000 7f7fcd92e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:39.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.960+0000 7f7fcd92e800 20 rados->read ofs=0 len=0 2024-09-22T08:33:39.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.961+0000 7f7fcd92e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:33:39.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.961+0000 7f7fcd92e800 20 searching for the correct realm 2024-09-22T08:33:39.963 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:39.963+0000 7f7fc8d63640 0 -- 172.21.15.38:0/733892155 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f7fc00737c0 msgr2=0x7f7fc0069a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:33:40.170 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.169+0000 7f7fc8d63640 0 -- 172.21.15.38:0/733892155 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f7fbc071050 msgr2=0x7f7fbc084040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:40.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.377+0000 7f7fcd92e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:33:40.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.377+0000 7f7fcd92e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:33:40.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.377+0000 7f7fcd92e800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:33:40.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.377+0000 7f7fcd92e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:33:40.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.377+0000 7f7fcd92e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:33:40.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.377+0000 7f7fcd92e800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:33:40.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.377+0000 7f7fcd92e800 20 rados->read ofs=0 len=0 2024-09-22T08:33:40.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.377+0000 7f7fcd92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:40.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.377+0000 7f7fcd92e800 20 rados->read ofs=0 len=0 2024-09-22T08:33:40.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.378+0000 7f7fcd92e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:40.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.378+0000 7f7fcd92e800 20 rados->read ofs=0 len=0 2024-09-22T08:33:40.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.378+0000 7f7fcd92e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:33:40.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.378+0000 7f7fcd92e800 20 zone default found 2024-09-22T08:33:40.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.378+0000 7f7fcd92e800 4 Realm: () 2024-09-22T08:33:40.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.378+0000 7f7fcd92e800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:33:40.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.378+0000 7f7fcd92e800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:33:40.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.378+0000 7f7fcd92e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:33:40.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.378+0000 7f7fcd92e800 20 zonegroup default 2024-09-22T08:33:40.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.378+0000 7f7fcd92e800 20 rados->read ofs=0 len=0 2024-09-22T08:33:40.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.379+0000 7f7fcd92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:40.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.379+0000 7f7fcd92e800 20 rados->read ofs=0 len=0 2024-09-22T08:33:40.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.379+0000 7f7fcd92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:40.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.379+0000 7f7fcd92e800 20 rados->read ofs=0 len=0 2024-09-22T08:33:40.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.379+0000 7f7fcd92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:40.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.379+0000 7f7fcd92e800 20 started sync module instance, tier type = 2024-09-22T08:33:40.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.379+0000 7f7fcd92e800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:33:40.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.390+0000 7f7fcd92e800 20 add_watcher() i=0 2024-09-22T08:33:40.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.390+0000 7f7fcd92e800 20 add_watcher() i=1 2024-09-22T08:33:40.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.390+0000 7f7fcd92e800 20 add_watcher() i=2 2024-09-22T08:33:40.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.390+0000 7f7fcd92e800 20 add_watcher() i=3 2024-09-22T08:33:40.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.390+0000 7f7fcd92e800 20 add_watcher() i=4 2024-09-22T08:33:40.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.390+0000 7f7fcd92e800 20 add_watcher() i=5 2024-09-22T08:33:40.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.390+0000 7f7fcd92e800 20 add_watcher() i=6 2024-09-22T08:33:40.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.391+0000 7f7fcd92e800 20 add_watcher() i=7 2024-09-22T08:33:40.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.391+0000 7f7fcd92e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:33:40.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.394+0000 7f7e7f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:40.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.394+0000 7f7fcd92e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:33:40.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.394+0000 7f7fcd92e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:33:40.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.394+0000 7f7fcd92e800 5 note: GC not initialized 2024-09-22T08:33:40.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.394+0000 7f7e7e7e4640 20 reqs_thread_entry: start 2024-09-22T08:33:40.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.394+0000 7f7fcd92e800 20 init_complete bucket index max shards: 11 2024-09-22T08:33:40.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.394+0000 7f7fcd92e800 20 Filter name: none 2024-09-22T08:33:40.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.395+0000 7f7deffff640 20 reqs_thread_entry: start 2024-09-22T08:33:40.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.395+0000 7f7fcd92e800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-22T08:33:40.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.395+0000 7f7fcd92e800 20 rados->read ofs=0 len=0 2024-09-22T08:33:40.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.395+0000 7f7fcd92e800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T08:33:40.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.395+0000 7f7fcd92e800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-22T08:33:40.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.395+0000 7f7fcd92e800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-22T08:33:40.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.395+0000 7f7fcd92e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.23 : miss 2024-09-22T08:33:40.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.395+0000 7f7fcd92e800 20 rados->read ofs=0 len=0 2024-09-22T08:33:40.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.395+0000 7f7fcd92e800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T08:33:40.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.395+0000 7f7fcd92e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.23 info.flags=0x17 2024-09-22T08:33:40.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.395+0000 7f7fcd92e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.23 to cache LRU end 2024-09-22T08:33:40.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.395+0000 7f7fcd92e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:33:40.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.395+0000 7f7fcd92e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:40.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.395+0000 7f7fcd92e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.23 2024-09-22T08:33:40.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.400+0000 7f7fcd92e800 -1 Injecting error=-125 at location=set_target_layout 2024-09-22T08:33:40.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.401+0000 7f7fcd92e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.23 info.flags=0x17 2024-09-22T08:33:40.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.401+0000 7f7fcd92e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.23 to cache LRU end 2024-09-22T08:33:40.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.401+0000 7f7fcd92e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:40.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.401+0000 7f7fcd92e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.23, ofs0, ns] 2024-09-22T08:33:40.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.401+0000 7f7e9bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497001 cookie 94428563983744 notifier 6137 bl.length()=925 2024-09-22T08:33:40.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.401+0000 7f7e9bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.23 info.flags=0x17 2024-09-22T08:33:40.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.401+0000 7f7e9bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.23 to cache LRU end 2024-09-22T08:33:40.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.401+0000 7f7e9bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:40.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.402+0000 7f7fcd92e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.23]): orig_sources= new_sources= 2024-09-22T08:33:40.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.402+0000 7f7fcd92e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.23]): potential sources added=[] removed=[] 2024-09-22T08:33:40.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.402+0000 7f7fcd92e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.23]): orig_dests= new_dests= 2024-09-22T08:33:40.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.402+0000 7f7fcd92e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.23]): potential dests added=[] removed=[] 2024-09-22T08:33:40.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.407+0000 7f7fcd92e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.1.0 2024-09-22T08:33:40.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.407+0000 7f7fcd92e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.1.0 2024-09-22T08:33:40.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.407+0000 7f7fcd92e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.1.1 2024-09-22T08:33:40.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.407+0000 7f7fcd92e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.1.1 2024-09-22T08:33:40.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.407+0000 7f7fcd92e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.1.2 2024-09-22T08:33:40.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.407+0000 7f7fcd92e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.1.2 2024-09-22T08:33:40.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.407+0000 7f7fcd92e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.1.3 2024-09-22T08:33:40.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.407+0000 7f7fcd92e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.1.3 2024-09-22T08:33:40.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.407+0000 7f7fcd92e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.1.4 2024-09-22T08:33:40.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.407+0000 7f7fcd92e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.1.4 2024-09-22T08:33:40.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.407+0000 7f7fcd92e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.1.5 2024-09-22T08:33:40.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.407+0000 7f7fcd92e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.1.5 2024-09-22T08:33:40.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.407+0000 7f7fcd92e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.1.6 2024-09-22T08:33:40.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.407+0000 7f7fcd92e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.1.6 2024-09-22T08:33:40.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.407+0000 7f7fcd92e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.1.7 2024-09-22T08:33:40.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.407+0000 7f7fcd92e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.1.7 2024-09-22T08:33:40.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.407+0000 7f7fcd92e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.1.8 2024-09-22T08:33:40.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.407+0000 7f7fcd92e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.1.8 2024-09-22T08:33:40.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.407+0000 7f7fcd92e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.1.9 2024-09-22T08:33:40.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.407+0000 7f7fcd92e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.1.9 2024-09-22T08:33:40.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.407+0000 7f7fcd92e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.1.10 2024-09-22T08:33:40.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.407+0000 7f7fcd92e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.1.10 2024-09-22T08:33:40.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.407+0000 7f7fcd92e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.1.11 2024-09-22T08:33:40.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.407+0000 7f7fcd92e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.1.11 2024-09-22T08:33:40.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.407+0000 7f7fcd92e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.0 2024-09-22T08:33:40.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.408+0000 7f7fcd92e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.1 2024-09-22T08:33:40.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.408+0000 7f7fcd92e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.2 2024-09-22T08:33:40.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.409+0000 7f7fcd92e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.3 2024-09-22T08:33:40.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.409+0000 7f7fcd92e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.4 2024-09-22T08:33:40.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.410+0000 7f7fcd92e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.5 2024-09-22T08:33:40.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.410+0000 7f7fcd92e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.6 2024-09-22T08:33:40.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.411+0000 7f7fcd92e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.7 2024-09-22T08:33:40.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.411+0000 7f7fcd92e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.8 2024-09-22T08:33:40.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.412+0000 7f7fcd92e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.9 2024-09-22T08:33:40.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.413+0000 7f7fcd92e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.10 2024-09-22T08:33:40.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.416+0000 7f7fcd92e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.23 : hit (requested=0x17, cached=0x17) 2024-09-22T08:33:40.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.416+0000 7f7fcd92e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.23 2024-09-22T08:33:40.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.417+0000 7f7fcd92e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.23 info.flags=0x17 2024-09-22T08:33:40.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.417+0000 7f7fcd92e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.23 to cache LRU end 2024-09-22T08:33:40.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.417+0000 7f7fcd92e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:40.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.417+0000 7f7fcd92e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.23, ofs0, ns] 2024-09-22T08:33:40.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.417+0000 7f7e9bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497002 cookie 94428563983744 notifier 6137 bl.length()=925 2024-09-22T08:33:40.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.417+0000 7f7e9bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.23 info.flags=0x17 2024-09-22T08:33:40.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.417+0000 7f7e9bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.23 to cache LRU end 2024-09-22T08:33:40.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.417+0000 7f7e9bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:40.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.418+0000 7f7fcd92e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.23]): orig_sources= new_sources= 2024-09-22T08:33:40.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.418+0000 7f7fcd92e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.23]): potential sources added=[] removed=[] 2024-09-22T08:33:40.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.418+0000 7f7fcd92e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.23]): orig_dests= new_dests= 2024-09-22T08:33:40.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.418+0000 7f7fcd92e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.23]): potential dests added=[] removed=[] 2024-09-22T08:33:40.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.420+0000 7f7fcd92e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.0 2024-09-22T08:33:40.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.421+0000 7f7fcd92e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.1 2024-09-22T08:33:40.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.421+0000 7f7fcd92e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.2 2024-09-22T08:33:40.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.422+0000 7f7fcd92e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.3 2024-09-22T08:33:40.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.422+0000 7f7fcd92e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.4 2024-09-22T08:33:40.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.422+0000 7f7fcd92e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.5 2024-09-22T08:33:40.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.423+0000 7f7fcd92e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.6 2024-09-22T08:33:40.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.423+0000 7f7fcd92e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.7 2024-09-22T08:33:40.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.423+0000 7f7fcd92e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.8 2024-09-22T08:33:40.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.424+0000 7f7fcd92e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.9 2024-09-22T08:33:40.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.424+0000 7f7fcd92e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.23.10 2024-09-22T08:33:40.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.425+0000 7f7fcd92e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.23 : hit (requested=0x17, cached=0x17) 2024-09-22T08:33:40.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.425+0000 7f7fcd92e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.23 2024-09-22T08:33:40.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.426+0000 7f7fcd92e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.23 info.flags=0x17 2024-09-22T08:33:40.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.426+0000 7f7fcd92e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.23 to cache LRU end 2024-09-22T08:33:40.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.426+0000 7f7fcd92e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:40.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.426+0000 7f7fcd92e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.23, ofs0, ns] 2024-09-22T08:33:40.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.426+0000 7f7e9bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497003 cookie 94428563983744 notifier 6137 bl.length()=893 2024-09-22T08:33:40.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.426+0000 7f7e9bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.23 info.flags=0x17 2024-09-22T08:33:40.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.426+0000 7f7e9bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.23 to cache LRU end 2024-09-22T08:33:40.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.426+0000 7f7e9bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:40.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.427+0000 7f7fcd92e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.23]): orig_sources= new_sources= 2024-09-22T08:33:40.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.427+0000 7f7fcd92e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.23]): potential sources added=[] removed=[] 2024-09-22T08:33:40.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.427+0000 7f7fcd92e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.23]): orig_dests= new_dests= 2024-09-22T08:33:40.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.427+0000 7f7fcd92e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.23]): potential dests added=[] removed=[] 2024-09-22T08:33:40.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.430+0000 7f7fcd92e800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-22T08:33:40.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.432+0000 7f7e7f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:40.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.434+0000 7f7fcd92e800 20 remove_watcher() i=0 2024-09-22T08:33:40.435 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.434+0000 7f7fcd92e800 2 removed watcher, disabling cache 2024-09-22T08:33:40.435 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.435+0000 7f7fcd92e800 20 remove_watcher() i=1 2024-09-22T08:33:40.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.436+0000 7f7fcd92e800 20 remove_watcher() i=2 2024-09-22T08:33:40.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.437+0000 7f7fcd92e800 20 remove_watcher() i=3 2024-09-22T08:33:40.439 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.438+0000 7f7fcd92e800 20 remove_watcher() i=4 2024-09-22T08:33:40.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.439+0000 7f7fcd92e800 20 remove_watcher() i=5 2024-09-22T08:33:40.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.440+0000 7f7fcd92e800 20 remove_watcher() i=6 2024-09-22T08:33:40.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.441+0000 7f7fcd92e800 20 remove_watcher() i=7 2024-09-22T08:33:40.456 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-22T08:33:40.485 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:33:40.486 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:33:40.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.524+0000 7fdaa2526800 20 rados->read ofs=0 len=0 2024-09-22T08:33:40.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.526+0000 7fdaa2526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:40.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.526+0000 7fdaa2526800 20 realm 2024-09-22T08:33:40.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.526+0000 7fdaa2526800 20 rados->read ofs=0 len=0 2024-09-22T08:33:40.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.526+0000 7fdaa2526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:40.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.526+0000 7fdaa2526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:33:40.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.526+0000 7fdaa2526800 20 rados->read ofs=0 len=0 2024-09-22T08:33:40.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.527+0000 7fdaa2526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:40.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.527+0000 7fdaa2526800 20 rados->read ofs=0 len=0 2024-09-22T08:33:40.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.527+0000 7fdaa2526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:40.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.527+0000 7fdaa2526800 20 rados->read ofs=0 len=0 2024-09-22T08:33:40.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.528+0000 7fdaa2526800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:33:40.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.528+0000 7fdaa2526800 20 searching for the correct realm 2024-09-22T08:33:40.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.531+0000 7fda9e9da640 0 -- 172.21.15.38:0/2143974830 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7fda9002f040 msgr2=0x7fda90030430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:40.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.736+0000 7fda9e1d9640 0 -- 172.21.15.38:0/2143974830 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x556a5f6a1110 msgr2=0x556a5f6a35d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:40.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.741+0000 7fdaa2526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:33:40.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.741+0000 7fdaa2526800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:33:40.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.741+0000 7fdaa2526800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:33:40.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.741+0000 7fdaa2526800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:33:40.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.741+0000 7fdaa2526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:33:40.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.741+0000 7fdaa2526800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:33:40.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.741+0000 7fdaa2526800 20 rados->read ofs=0 len=0 2024-09-22T08:33:40.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.741+0000 7fdaa2526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:40.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.741+0000 7fdaa2526800 20 rados->read ofs=0 len=0 2024-09-22T08:33:40.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.741+0000 7fdaa2526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:40.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.741+0000 7fdaa2526800 20 rados->read ofs=0 len=0 2024-09-22T08:33:40.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.742+0000 7fdaa2526800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:33:40.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.742+0000 7fdaa2526800 20 zone default found 2024-09-22T08:33:40.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.742+0000 7fdaa2526800 4 Realm: () 2024-09-22T08:33:40.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.742+0000 7fdaa2526800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:33:40.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.742+0000 7fdaa2526800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:33:40.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.742+0000 7fdaa2526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:33:40.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.742+0000 7fdaa2526800 20 zonegroup default 2024-09-22T08:33:40.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.742+0000 7fdaa2526800 20 rados->read ofs=0 len=0 2024-09-22T08:33:40.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.742+0000 7fdaa2526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:40.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.742+0000 7fdaa2526800 20 rados->read ofs=0 len=0 2024-09-22T08:33:40.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.743+0000 7fdaa2526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:40.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.743+0000 7fdaa2526800 20 rados->read ofs=0 len=0 2024-09-22T08:33:40.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.743+0000 7fdaa2526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:40.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.743+0000 7fdaa2526800 20 started sync module instance, tier type = 2024-09-22T08:33:40.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.743+0000 7fdaa2526800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:33:40.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.753+0000 7fdaa2526800 20 add_watcher() i=0 2024-09-22T08:33:40.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.753+0000 7fdaa2526800 20 add_watcher() i=1 2024-09-22T08:33:40.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.753+0000 7fdaa2526800 20 add_watcher() i=2 2024-09-22T08:33:40.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.753+0000 7fdaa2526800 20 add_watcher() i=3 2024-09-22T08:33:40.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.753+0000 7fdaa2526800 20 add_watcher() i=4 2024-09-22T08:33:40.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.753+0000 7fdaa2526800 20 add_watcher() i=5 2024-09-22T08:33:40.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.753+0000 7fdaa2526800 20 add_watcher() i=6 2024-09-22T08:33:40.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.755+0000 7fdaa2526800 20 add_watcher() i=7 2024-09-22T08:33:40.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.755+0000 7fdaa2526800 2 all 8 watchers are set, enabling cache 2024-09-22T08:33:40.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.756+0000 7fd954fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:40.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.757+0000 7fdaa2526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:33:40.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.757+0000 7fdaa2526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:33:40.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.757+0000 7fdaa2526800 5 note: GC not initialized 2024-09-22T08:33:40.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.757+0000 7fd8cf7fe640 20 reqs_thread_entry: start 2024-09-22T08:33:40.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.757+0000 7fdaa2526800 20 init_complete bucket index max shards: 11 2024-09-22T08:33:40.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.757+0000 7fdaa2526800 20 Filter name: none 2024-09-22T08:33:40.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.757+0000 7fd8cd7fa640 20 reqs_thread_entry: start 2024-09-22T08:33:40.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.757+0000 7fdaa2526800 20 rados->read ofs=0 len=0 2024-09-22T08:33:40.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.758+0000 7fdaa2526800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T08:33:40.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.758+0000 7fdaa2526800 20 rados->read ofs=0 len=0 2024-09-22T08:33:40.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.758+0000 7fdaa2526800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T08:33:40.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.758+0000 7fdaa2526800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:33:40.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.758+0000 7fdaa2526800 20 rados->read ofs=0 len=0 2024-09-22T08:33:40.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.759+0000 7fdaa2526800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T08:33:40.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.759+0000 7fdaa2526800 20 rados->read ofs=0 len=0 2024-09-22T08:33:40.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.759+0000 7fdaa2526800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T08:33:40.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.759+0000 7fdaa2526800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:33:40.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.761+0000 7fd954fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:40.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.763+0000 7fdaa2526800 20 remove_watcher() i=0 2024-09-22T08:33:40.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.763+0000 7fdaa2526800 2 removed watcher, disabling cache 2024-09-22T08:33:40.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.764+0000 7fdaa2526800 20 remove_watcher() i=1 2024-09-22T08:33:40.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.765+0000 7fdaa2526800 20 remove_watcher() i=2 2024-09-22T08:33:40.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.766+0000 7fdaa2526800 20 remove_watcher() i=3 2024-09-22T08:33:40.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.767+0000 7fdaa2526800 20 remove_watcher() i=4 2024-09-22T08:33:40.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.769+0000 7fdaa2526800 20 remove_watcher() i=5 2024-09-22T08:33:40.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.770+0000 7fdaa2526800 20 remove_watcher() i=6 2024-09-22T08:33:40.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:40.771+0000 7fdaa2526800 20 remove_watcher() i=7 2024-09-22T08:33:40.783 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:40.783 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:33:40.783 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-set-target-layout id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.23 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-22T08:33:40.783 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:40.785 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:40.785 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:40.788 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:40.788 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:40.831 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:40.832 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:40.860 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-22T08:33:40.860 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:40.861 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:40.861 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:40.873 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:40.873 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:40.916 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:40.917 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:40.924 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:40.924 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:40.930 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:40.930 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:40.936 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:40.936 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:40.942 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:40.942 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:40.949 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:40.949 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:40.956 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:40.956 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:40.962 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:40.962 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:40.968 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:40.968 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:40.974 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:40.974 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:40.980 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:40.980 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:40.987 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:40.987 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:40.993 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:40.993 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:41.000 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:41.000 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:41.006 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:41.006 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:41.012 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:41.012 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:41.019 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:41.019 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:41.025 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:41.025 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:41.031 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:41.031 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:41.037 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:41.037 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:41.044 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-22T08:33:41.074 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:33:41.074 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:33:41.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.112+0000 7f67d560d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.114+0000 7f67d560d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.114+0000 7f67d560d800 20 realm 2024-09-22T08:33:41.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.114+0000 7f67d560d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.114+0000 7f67d560d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.114+0000 7f67d560d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:33:41.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.114+0000 7f67d560d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.114+0000 7f67d560d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.114+0000 7f67d560d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.115+0000 7f67d560d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:41.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.115+0000 7f67d560d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.115+0000 7f67d560d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:33:41.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.115+0000 7f67d560d800 20 searching for the correct realm 2024-09-22T08:33:41.118 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.118+0000 7f67ca8f6640 0 -- 172.21.15.38:0/553666690 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f67bc017070 msgr2=0x7f67bc05fcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:41.122 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.121+0000 7f67ca8f6640 0 -- 172.21.15.38:0/553666690 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f67c4061400 msgr2=0x7f67c4061860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:33:41.328 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.327+0000 7f67d560d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:33:41.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.327+0000 7f67d560d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:33:41.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.327+0000 7f67d560d800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:33:41.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.327+0000 7f67d560d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:33:41.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.327+0000 7f67d560d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:33:41.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.327+0000 7f67d560d800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:33:41.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.327+0000 7f67d560d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.328+0000 7f67d560d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.328+0000 7f67d560d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.328+0000 7f67d560d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:41.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.328+0000 7f67d560d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.328+0000 7f67d560d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:33:41.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.328+0000 7f67d560d800 20 zone default found 2024-09-22T08:33:41.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.328+0000 7f67d560d800 4 Realm: () 2024-09-22T08:33:41.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.328+0000 7f67d560d800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:33:41.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.328+0000 7f67d560d800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:33:41.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.328+0000 7f67d560d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:33:41.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.328+0000 7f67d560d800 20 zonegroup default 2024-09-22T08:33:41.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.328+0000 7f67d560d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.329+0000 7f67d560d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.329+0000 7f67d560d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.329+0000 7f67d560d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.329+0000 7f67d560d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.329+0000 7f67d560d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.329+0000 7f67d560d800 20 started sync module instance, tier type = 2024-09-22T08:33:41.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.329+0000 7f67d560d800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:33:41.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.339+0000 7f67d560d800 20 add_watcher() i=0 2024-09-22T08:33:41.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.339+0000 7f67d560d800 20 add_watcher() i=1 2024-09-22T08:33:41.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.339+0000 7f67d560d800 20 add_watcher() i=2 2024-09-22T08:33:41.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.339+0000 7f67d560d800 20 add_watcher() i=3 2024-09-22T08:33:41.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.339+0000 7f67d560d800 20 add_watcher() i=4 2024-09-22T08:33:41.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.339+0000 7f67d560d800 20 add_watcher() i=5 2024-09-22T08:33:41.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.339+0000 7f67d560d800 20 add_watcher() i=6 2024-09-22T08:33:41.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.340+0000 7f67d560d800 20 add_watcher() i=7 2024-09-22T08:33:41.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.340+0000 7f67d560d800 2 all 8 watchers are set, enabling cache 2024-09-22T08:33:41.343 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.342+0000 7f6689fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:41.343 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.342+0000 7f67d560d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:33:41.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.342+0000 7f67d560d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:33:41.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.342+0000 7f67d560d800 5 note: GC not initialized 2024-09-22T08:33:41.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.342+0000 7f6688fe1640 20 reqs_thread_entry: start 2024-09-22T08:33:41.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.342+0000 7f67d560d800 20 init_complete bucket index max shards: 11 2024-09-22T08:33:41.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.343+0000 7f67d560d800 20 Filter name: none 2024-09-22T08:33:41.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.343+0000 7f66027fc640 20 reqs_thread_entry: start 2024-09-22T08:33:41.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.343+0000 7f67d560d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.343+0000 7f67d560d800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T08:33:41.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.343+0000 7f67d560d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.344+0000 7f67d560d800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T08:33:41.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.344+0000 7f67d560d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:33:41.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.344+0000 7f67d560d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.345+0000 7f67d560d800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T08:33:41.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.345+0000 7f67d560d800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.345+0000 7f67d560d800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T08:33:41.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.345+0000 7f67d560d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:33:41.348 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.347+0000 7f6689fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:41.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.350+0000 7f67d560d800 20 remove_watcher() i=0 2024-09-22T08:33:41.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.350+0000 7f67d560d800 2 removed watcher, disabling cache 2024-09-22T08:33:41.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.351+0000 7f67d560d800 20 remove_watcher() i=1 2024-09-22T08:33:41.353 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.353+0000 7f67d560d800 20 remove_watcher() i=2 2024-09-22T08:33:41.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.354+0000 7f67d560d800 20 remove_watcher() i=3 2024-09-22T08:33:41.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.355+0000 7f67d560d800 20 remove_watcher() i=4 2024-09-22T08:33:41.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.356+0000 7f67d560d800 20 remove_watcher() i=5 2024-09-22T08:33:41.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.357+0000 7f67d560d800 20 remove_watcher() i=6 2024-09-22T08:33:41.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.358+0000 7f67d560d800 20 remove_watcher() i=7 2024-09-22T08:33:41.371 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.371 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:33:41.371 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-set-target-layout id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:33:41.371 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.372 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-22T08:33:41.407 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:33:41.408 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:33:41.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.446+0000 7ff47a614800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.447+0000 7ff47a614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.447+0000 7ff47a614800 20 realm 2024-09-22T08:33:41.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.447+0000 7ff47a614800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.448+0000 7ff47a614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.448+0000 7ff47a614800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:33:41.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.448+0000 7ff47a614800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.448+0000 7ff47a614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.448+0000 7ff47a614800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.449+0000 7ff47a614800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:41.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.449+0000 7ff47a614800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.449+0000 7ff47a614800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:33:41.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.449+0000 7ff47a614800 20 searching for the correct realm 2024-09-22T08:33:41.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.451+0000 7ff4755df640 0 -- 172.21.15.38:0/2140828749 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7ff46c083030 msgr2=0x7ff46c0660d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:41.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.455+0000 7ff4755df640 0 -- 172.21.15.38:0/2140828749 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7ff468098900 msgr2=0x7ff4680683f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:41.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.662+0000 7ff47a614800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:33:41.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.662+0000 7ff47a614800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:33:41.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.662+0000 7ff47a614800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:33:41.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.662+0000 7ff47a614800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:33:41.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.662+0000 7ff47a614800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:33:41.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.662+0000 7ff47a614800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:33:41.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.662+0000 7ff47a614800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.662+0000 7ff47a614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.662+0000 7ff47a614800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.663+0000 7ff47a614800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:41.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.663+0000 7ff47a614800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.663+0000 7ff47a614800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:33:41.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.663+0000 7ff47a614800 20 zone default found 2024-09-22T08:33:41.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.663+0000 7ff47a614800 4 Realm: () 2024-09-22T08:33:41.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.663+0000 7ff47a614800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:33:41.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.663+0000 7ff47a614800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:33:41.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.663+0000 7ff47a614800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:33:41.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.663+0000 7ff47a614800 20 zonegroup default 2024-09-22T08:33:41.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.663+0000 7ff47a614800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.663+0000 7ff47a614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.663+0000 7ff47a614800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.664+0000 7ff47a614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.664+0000 7ff47a614800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.664+0000 7ff47a614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.664+0000 7ff47a614800 20 started sync module instance, tier type = 2024-09-22T08:33:41.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.664+0000 7ff47a614800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:33:41.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.673+0000 7ff47a614800 20 add_watcher() i=0 2024-09-22T08:33:41.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.673+0000 7ff47a614800 20 add_watcher() i=1 2024-09-22T08:33:41.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.673+0000 7ff47a614800 20 add_watcher() i=2 2024-09-22T08:33:41.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.673+0000 7ff47a614800 20 add_watcher() i=3 2024-09-22T08:33:41.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.673+0000 7ff47a614800 20 add_watcher() i=4 2024-09-22T08:33:41.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.673+0000 7ff47a614800 20 add_watcher() i=5 2024-09-22T08:33:41.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.674+0000 7ff47a614800 20 add_watcher() i=6 2024-09-22T08:33:41.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.674+0000 7ff47a614800 20 add_watcher() i=7 2024-09-22T08:33:41.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.674+0000 7ff47a614800 2 all 8 watchers are set, enabling cache 2024-09-22T08:33:41.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.676+0000 7ff3277fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:41.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.677+0000 7ff47a614800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:33:41.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.677+0000 7ff47a614800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:33:41.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.677+0000 7ff47a614800 5 note: GC not initialized 2024-09-22T08:33:41.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.677+0000 7ff3267fc640 20 reqs_thread_entry: start 2024-09-22T08:33:41.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.677+0000 7ff47a614800 20 init_complete bucket index max shards: 11 2024-09-22T08:33:41.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.677+0000 7ff47a614800 20 Filter name: none 2024-09-22T08:33:41.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.677+0000 7ff297fff640 20 reqs_thread_entry: start 2024-09-22T08:33:41.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.677+0000 7ff47a614800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-22T08:33:41.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.677+0000 7ff47a614800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.678+0000 7ff47a614800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T08:33:41.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.678+0000 7ff47a614800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-22T08:33:41.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.678+0000 7ff47a614800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-22T08:33:41.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.678+0000 7ff47a614800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.24 : miss 2024-09-22T08:33:41.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.678+0000 7ff47a614800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.678+0000 7ff47a614800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T08:33:41.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.678+0000 7ff47a614800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.24 info.flags=0x17 2024-09-22T08:33:41.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.678+0000 7ff47a614800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.24 to cache LRU end 2024-09-22T08:33:41.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.678+0000 7ff47a614800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:33:41.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.678+0000 7ff47a614800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:41.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.678+0000 7ff47a614800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.24 2024-09-22T08:33:41.683 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff47a614800 time 2024-09-22T08:33:41.683713+0000 2024-09-22T08:33:41.683 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:33:41.684 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:33:41.684 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff47b78c748] 2024-09-22T08:33:41.684 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7ff47b78c906] 2024-09-22T08:33:41.684 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55aa34073e01] 2024-09-22T08:33:41.684 INFO:tasks.workunit.client.0.smithi038.stderr: 4: radosgw-admin(+0xd80c08) [0x55aa34585c08] 2024-09-22T08:33:41.684 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55aa34083c9d] 2024-09-22T08:33:41.685 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-22T08:33:41.685 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ff47a429590] 2024-09-22T08:33:41.685 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-22T08:33:41.685 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-22T08:33:41.685 INFO:tasks.workunit.client.0.smithi038.stderr:*** Caught signal (Aborted) ** 2024-09-22T08:33:41.685 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7ff47a614800 thread_name:radosgw-admin 2024-09-22T08:33:41.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.683+0000 7ff47a614800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff47a614800 time 2024-09-22T08:33:41.683713+0000 2024-09-22T08:33:41.685 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:33:41.685 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.685 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:33:41.685 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff47b78c748] 2024-09-22T08:33:41.685 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7ff47b78c906] 2024-09-22T08:33:41.686 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55aa34073e01] 2024-09-22T08:33:41.686 INFO:tasks.workunit.client.0.smithi038.stderr: 4: radosgw-admin(+0xd80c08) [0x55aa34585c08] 2024-09-22T08:33:41.686 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55aa34083c9d] 2024-09-22T08:33:41.686 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-22T08:33:41.686 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ff47a429590] 2024-09-22T08:33:41.686 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-22T08:33:41.686 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-22T08:33:41.686 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.699 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:33:41.699 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff47a43e6f0] 2024-09-22T08:33:41.699 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff47a48b99c] 2024-09-22T08:33:41.699 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:33:41.699 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:33:41.699 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff47b78c7a2] 2024-09-22T08:33:41.699 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7ff47b78c906] 2024-09-22T08:33:41.699 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55aa34073e01] 2024-09-22T08:33:41.699 INFO:tasks.workunit.client.0.smithi038.stderr: 8: radosgw-admin(+0xd80c08) [0x55aa34585c08] 2024-09-22T08:33:41.700 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55aa34083c9d] 2024-09-22T08:33:41.700 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-22T08:33:41.700 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ff47a429590] 2024-09-22T08:33:41.700 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-22T08:33:41.700 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-22T08:33:41.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.684+0000 7ff47a614800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:33:41.700 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7ff47a614800 thread_name:radosgw-admin 2024-09-22T08:33:41.700 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.700 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:33:41.700 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff47a43e6f0] 2024-09-22T08:33:41.700 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff47a48b99c] 2024-09-22T08:33:41.700 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:33:41.700 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:33:41.700 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff47b78c7a2] 2024-09-22T08:33:41.701 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7ff47b78c906] 2024-09-22T08:33:41.701 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55aa34073e01] 2024-09-22T08:33:41.701 INFO:tasks.workunit.client.0.smithi038.stderr: 8: radosgw-admin(+0xd80c08) [0x55aa34585c08] 2024-09-22T08:33:41.701 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55aa34083c9d] 2024-09-22T08:33:41.701 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-22T08:33:41.701 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ff47a429590] 2024-09-22T08:33:41.701 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-22T08:33:41.701 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-22T08:33:41.701 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:33:41.701 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.701 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-22T08:33:41.701 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-22T08:33:41.428+0000 7ff363e07640 10 monclient: dump: 2024-09-22T08:33:41.701 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:33:41.701 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:33:41.701 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:41.702 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:41.702 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:33:41.702 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:41.702 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:33:41.702 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:33:41.702 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:33:41.702 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.702 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-22T08:33:41.428+0000 7ff363e07640 10 monclient: _finish_auth 0 2024-09-22T08:33:41.702 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-22T08:33:41.428+0000 7ff363e07640 10 monclient: _check_auth_tickets 2024-09-22T08:33:41.702 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-22T08:33:41.428+0000 7ff363e07640 10 monclient: handle_config config(0 keys) 2024-09-22T08:33:41.702 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-22T08:33:41.428+0000 7ff363e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:33:41.702 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-22T08:33:41.428+0000 7ff363e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:33:41.702 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-22T08:33:41.428+0000 7ff363e07640 10 monclient: dump: 2024-09-22T08:33:41.702 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:33:41.703 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:33:41.703 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:41.703 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:41.703 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:33:41.703 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:41.703 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:33:41.703 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:33:41.703 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:33:41.703 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.703 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-22T08:33:41.428+0000 7ff47a614800 5 monclient: authenticate success, global_id 6522 2024-09-22T08:33:41.703 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-22T08:33:41.428+0000 7ff47a614800 10 monclient: get_monmap_and_config success 2024-09-22T08:33:41.703 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-22T08:33:41.428+0000 7ff47a614800 4 set_mon_vals no callback set 2024-09-22T08:33:41.703 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-22T08:33:41.428+0000 7ff47a614800 10 monclient: shutdown 2024-09-22T08:33:41.703 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-22T08:33:41.428+0000 7ff47a614800 5 asok(0x55aa352a70f0) unregister_commands rotate-key 2024-09-22T08:33:41.703 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-22T08:33:41.429+0000 7ff47a614800 10 monclient: build_initial_monmap 2024-09-22T08:33:41.704 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-22T08:33:41.429+0000 7ff47a614800 1 build_initial for_mkfs: 0 2024-09-22T08:33:41.704 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-22T08:33:41.429+0000 7ff47a614800 10 monclient: monmap: 2024-09-22T08:33:41.704 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:33:41.704 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:33:41.704 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:33:41.704 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:33:41.704 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:33:41.704 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:41.704 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:33:41.704 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:33:41.704 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:33:41.704 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.704 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354ce680) adding auth protocol: cephx 2024-09-22T08:33:41.704 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354ce680) adding auth protocol: cephx 2024-09-22T08:33:41.705 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354ce680) adding auth protocol: cephx 2024-09-22T08:33:41.705 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354ce680) adding con mode: secure 2024-09-22T08:33:41.705 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354ce680) adding con mode: crc 2024-09-22T08:33:41.705 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354ce680) adding con mode: secure 2024-09-22T08:33:41.705 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354ce680) adding con mode: crc 2024-09-22T08:33:41.705 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354ce680) adding con mode: secure 2024-09-22T08:33:41.705 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354ce680) adding con mode: crc 2024-09-22T08:33:41.705 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354ce680) adding con mode: crc 2024-09-22T08:33:41.705 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354ce680) adding con mode: secure 2024-09-22T08:33:41.705 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354ce680) adding con mode: crc 2024-09-22T08:33:41.705 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354ce680) adding con mode: secure 2024-09-22T08:33:41.705 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354ce680) adding con mode: crc 2024-09-22T08:33:41.705 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354ce680) adding con mode: secure 2024-09-22T08:33:41.705 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-22T08:33:41.429+0000 7ff47a614800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:41.705 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-22T08:33:41.429+0000 7ff47a614800 1 librados: starting msgr at 2024-09-22T08:33:41.706 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-22T08:33:41.429+0000 7ff47a614800 1 librados: starting objecter 2024-09-22T08:33:41.706 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 asok(0x55aa352a70f0) register_command objecter_requests hook 0x55aa354ce0e0 2024-09-22T08:33:41.706 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-22T08:33:41.429+0000 7ff47a614800 1 librados: setting wanted keys 2024-09-22T08:33:41.706 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-22T08:33:41.429+0000 7ff47a614800 1 librados: calling monclient init 2024-09-22T08:33:41.706 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-22T08:33:41.429+0000 7ff47a614800 10 monclient: init 2024-09-22T08:33:41.706 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354c9010) adding auth protocol: cephx 2024-09-22T08:33:41.706 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354c9010) adding auth protocol: cephx 2024-09-22T08:33:41.706 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354c9010) adding auth protocol: cephx 2024-09-22T08:33:41.706 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354c9010) adding con mode: secure 2024-09-22T08:33:41.706 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354c9010) adding con mode: crc 2024-09-22T08:33:41.706 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354c9010) adding con mode: secure 2024-09-22T08:33:41.706 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354c9010) adding con mode: crc 2024-09-22T08:33:41.706 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354c9010) adding con mode: secure 2024-09-22T08:33:41.707 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354c9010) adding con mode: crc 2024-09-22T08:33:41.707 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354c9010) adding con mode: crc 2024-09-22T08:33:41.707 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354c9010) adding con mode: secure 2024-09-22T08:33:41.707 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354c9010) adding con mode: crc 2024-09-22T08:33:41.707 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354c9010) adding con mode: secure 2024-09-22T08:33:41.707 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354c9010) adding con mode: crc 2024-09-22T08:33:41.707 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354c9010) adding con mode: secure 2024-09-22T08:33:41.707 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-22T08:33:41.429+0000 7ff47a614800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:41.707 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-22T08:33:41.429+0000 7ff47a614800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:41.707 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-22T08:33:41.430+0000 7ff47a614800 5 asok(0x55aa352a70f0) register_command rotate-key hook 0x55aa354c9158 2024-09-22T08:33:41.707 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-22T08:33:41.430+0000 7ff47a614800 10 monclient: _reopen_session rank -1 2024-09-22T08:33:41.707 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-22T08:33:41.430+0000 7ff47a614800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T08:33:41.707 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-22T08:33:41.430+0000 7ff47a614800 10 monclient(hunting): picked mon.noname-a con 0x55aa35374bd0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:33:41.707 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-22T08:33:41.430+0000 7ff47a614800 10 monclient(hunting): picked mon.noname-c con 0x55aa3537e640 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:33:41.707 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-22T08:33:41.430+0000 7ff47a614800 10 monclient(hunting): picked mon.noname-b con 0x55aa35410b80 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:33:41.708 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-22T08:33:41.430+0000 7ff47a614800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:41.708 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-22T08:33:41.430+0000 7ff47a614800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:41.708 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-22T08:33:41.430+0000 7ff47a614800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:41.708 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-22T08:33:41.430+0000 7ff47a614800 10 monclient(hunting): _renew_subs 2024-09-22T08:33:41.708 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-22T08:33:41.430+0000 7ff47a614800 10 monclient(hunting): authenticate will time out at 1926.669085s 2024-09-22T08:33:41.708 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-22T08:33:41.430+0000 7ff475de0640 10 monclient(hunting): get_auth_request con 0x55aa35374bd0 auth_method 0 2024-09-22T08:33:41.708 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-22T08:33:41.430+0000 7ff475de0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:41.708 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-22T08:33:41.430+0000 7ff475de0640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:41.708 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-22T08:33:41.430+0000 7ff475de0640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:41.708 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-22T08:33:41.430+0000 7ff4755df640 10 monclient(hunting): get_auth_request con 0x55aa3537e640 auth_method 0 2024-09-22T08:33:41.708 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-22T08:33:41.430+0000 7ff4755df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:41.708 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-22T08:33:41.430+0000 7ff4755df640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:41.708 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-22T08:33:41.430+0000 7ff4755df640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:41.708 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-22T08:33:41.430+0000 7ff475de0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:41.709 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-22T08:33:41.430+0000 7ff475de0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:41.709 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-22T08:33:41.430+0000 7ff475de0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:41.709 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-22T08:33:41.430+0000 7ff4755df640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:41.709 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-22T08:33:41.430+0000 7ff4755df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:41.709 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-22T08:33:41.430+0000 7ff4755df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:41.709 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-22T08:33:41.430+0000 7ff4765e1640 10 monclient(hunting): get_auth_request con 0x55aa35410b80 auth_method 0 2024-09-22T08:33:41.709 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-22T08:33:41.430+0000 7ff4765e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:41.709 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-22T08:33:41.430+0000 7ff4765e1640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:41.709 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-22T08:33:41.430+0000 7ff4765e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:41.709 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-22T08:33:41.430+0000 7ff4765e1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:41.709 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-22T08:33:41.430+0000 7ff4765e1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:41.709 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-22T08:33:41.430+0000 7ff4765e1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:41.709 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-22T08:33:41.430+0000 7ff4755df640 10 monclient(hunting): handle_auth_done global_id 6182 payload 824 2024-09-22T08:33:41.709 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-22T08:33:41.430+0000 7ff4755df640 10 monclient: _finish_hunting 0 2024-09-22T08:33:41.709 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-22T08:33:41.430+0000 7ff4755df640 1 monclient: found mon.noname-c 2024-09-22T08:33:41.710 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-22T08:33:41.430+0000 7ff4755df640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:33:41.710 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-22T08:33:41.430+0000 7ff362604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:33:41.710 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-22T08:33:41.430+0000 7ff362604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:33:41.710 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-22T08:33:41.430+0000 7ff362604640 10 monclient: dump: 2024-09-22T08:33:41.710 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:33:41.710 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:33:41.710 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:41.710 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:41.710 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:33:41.710 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:41.710 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:33:41.710 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:33:41.710 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:33:41.710 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.711 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-22T08:33:41.430+0000 7ff362604640 10 monclient: _finish_auth 0 2024-09-22T08:33:41.711 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-22T08:33:41.430+0000 7ff362604640 10 monclient: _check_auth_tickets 2024-09-22T08:33:41.711 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-22T08:33:41.430+0000 7ff362604640 10 monclient: handle_config config(0 keys) 2024-09-22T08:33:41.711 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-22T08:33:41.430+0000 7ff362604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:33:41.711 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-22T08:33:41.430+0000 7ff362604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:33:41.711 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-22T08:33:41.430+0000 7ff362604640 10 monclient: dump: 2024-09-22T08:33:41.711 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:33:41.711 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:33:41.711 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:41.711 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:41.711 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:33:41.711 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:41.711 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:33:41.711 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:33:41.711 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:33:41.712 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.712 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-22T08:33:41.430+0000 7ff47a614800 5 monclient: authenticate success, global_id 6182 2024-09-22T08:33:41.712 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-22T08:33:41.430+0000 7ff47a614800 10 monclient: _renew_subs 2024-09-22T08:33:41.712 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-22T08:33:41.430+0000 7ff47a614800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:33:41.712 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-22T08:33:41.430+0000 7ff363e07640 4 set_mon_vals no callback set 2024-09-22T08:33:41.712 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-22T08:33:41.430+0000 7ff47a614800 10 monclient: _renew_subs 2024-09-22T08:33:41.712 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-22T08:33:41.430+0000 7ff47a614800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:33:41.712 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-22T08:33:41.430+0000 7ff47a614800 1 librados: init done 2024-09-22T08:33:41.712 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-22T08:33:41.432+0000 7ff362604640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:33:41.712 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-22T08:33:41.432+0000 7ff362604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:33:41.712 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-22T08:33:41.432+0000 7ff362604640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:33:41.712 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-22T08:33:41.433+0000 7ff475de0640 10 monclient: get_auth_request con 0x7ff35c077570 auth_method 0 2024-09-22T08:33:41.712 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-22T08:33:41.433+0000 7ff4765e1640 10 monclient: get_auth_request con 0x55aa3550b3d0 auth_method 0 2024-09-22T08:33:41.712 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-22T08:33:41.433+0000 7ff475de0640 10 monclient: get_auth_request con 0x55aa35514a60 auth_method 0 2024-09-22T08:33:41.713 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-22T08:33:41.434+0000 7ff4755df640 10 monclient: get_auth_request con 0x55aa35518c50 auth_method 0 2024-09-22T08:33:41.713 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-22T08:33:41.435+0000 7ff4765e1640 10 monclient: get_auth_request con 0x55aa35518340 auth_method 0 2024-09-22T08:33:41.713 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-22T08:33:41.436+0000 7ff47a614800 10 monclient: build_initial_monmap 2024-09-22T08:33:41.713 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-22T08:33:41.436+0000 7ff47a614800 1 build_initial for_mkfs: 0 2024-09-22T08:33:41.713 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-22T08:33:41.436+0000 7ff47a614800 10 monclient: monmap: 2024-09-22T08:33:41.713 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:33:41.713 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:33:41.713 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:33:41.713 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:33:41.713 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:33:41.713 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:41.713 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:33:41.713 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:33:41.713 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:33:41.714 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.714 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa35520ed0) adding auth protocol: cephx 2024-09-22T08:33:41.714 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa35520ed0) adding auth protocol: cephx 2024-09-22T08:33:41.714 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa35520ed0) adding auth protocol: cephx 2024-09-22T08:33:41.714 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa35520ed0) adding con mode: secure 2024-09-22T08:33:41.714 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa35520ed0) adding con mode: crc 2024-09-22T08:33:41.714 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa35520ed0) adding con mode: secure 2024-09-22T08:33:41.714 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa35520ed0) adding con mode: crc 2024-09-22T08:33:41.714 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa35520ed0) adding con mode: secure 2024-09-22T08:33:41.714 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa35520ed0) adding con mode: crc 2024-09-22T08:33:41.714 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa35520ed0) adding con mode: crc 2024-09-22T08:33:41.714 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa35520ed0) adding con mode: secure 2024-09-22T08:33:41.714 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa35520ed0) adding con mode: crc 2024-09-22T08:33:41.714 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa35520ed0) adding con mode: secure 2024-09-22T08:33:41.714 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa35520ed0) adding con mode: crc 2024-09-22T08:33:41.715 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa35520ed0) adding con mode: secure 2024-09-22T08:33:41.715 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-22T08:33:41.436+0000 7ff47a614800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:41.715 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 asok(0x55aa352a70f0) register_command objecter_requests cmddesc objecter_requests hook 0x55aa35524360 EEXIST 2024-09-22T08:33:41.715 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-22T08:33:41.436+0000 7ff47a614800 10 monclient: init 2024-09-22T08:33:41.715 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa3551fcd8) adding auth protocol: cephx 2024-09-22T08:33:41.715 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa3551fcd8) adding auth protocol: cephx 2024-09-22T08:33:41.715 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa3551fcd8) adding auth protocol: cephx 2024-09-22T08:33:41.715 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa3551fcd8) adding con mode: secure 2024-09-22T08:33:41.715 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa3551fcd8) adding con mode: crc 2024-09-22T08:33:41.715 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa3551fcd8) adding con mode: secure 2024-09-22T08:33:41.715 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa3551fcd8) adding con mode: crc 2024-09-22T08:33:41.715 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa3551fcd8) adding con mode: secure 2024-09-22T08:33:41.715 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa3551fcd8) adding con mode: crc 2024-09-22T08:33:41.715 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa3551fcd8) adding con mode: crc 2024-09-22T08:33:41.715 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa3551fcd8) adding con mode: secure 2024-09-22T08:33:41.716 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa3551fcd8) adding con mode: crc 2024-09-22T08:33:41.716 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa3551fcd8) adding con mode: secure 2024-09-22T08:33:41.716 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa3551fcd8) adding con mode: crc 2024-09-22T08:33:41.716 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa3551fcd8) adding con mode: secure 2024-09-22T08:33:41.716 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-22T08:33:41.437+0000 7ff47a614800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:41.716 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-22T08:33:41.437+0000 7ff47a614800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:41.716 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-22T08:33:41.437+0000 7ff47a614800 5 asok(0x55aa352a70f0) register_command rotate-key cmddesc rotate-key hook 0x55aa3551fe20 EEXIST 2024-09-22T08:33:41.716 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-22T08:33:41.437+0000 7ff47a614800 10 monclient: _reopen_session rank -1 2024-09-22T08:33:41.716 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-22T08:33:41.437+0000 7ff47a614800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T08:33:41.716 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-22T08:33:41.437+0000 7ff47a614800 10 monclient(hunting): picked mon.noname-b con 0x55aa35548680 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:33:41.716 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-22T08:33:41.437+0000 7ff47a614800 10 monclient(hunting): picked mon.noname-a con 0x55aa35548a60 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:33:41.716 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-22T08:33:41.437+0000 7ff47a614800 10 monclient(hunting): picked mon.noname-c con 0x55aa35547390 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:33:41.716 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-22T08:33:41.437+0000 7ff47a614800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:41.716 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-22T08:33:41.437+0000 7ff47a614800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:41.717 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-22T08:33:41.437+0000 7ff47a614800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:41.717 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-22T08:33:41.437+0000 7ff47a614800 10 monclient(hunting): _renew_subs 2024-09-22T08:33:41.717 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-22T08:33:41.437+0000 7ff47a614800 10 monclient(hunting): authenticate will time out at 1926.676517s 2024-09-22T08:33:41.717 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-22T08:33:41.437+0000 7ff4765e1640 10 monclient(hunting): get_auth_request con 0x55aa35548a60 auth_method 0 2024-09-22T08:33:41.717 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-22T08:33:41.437+0000 7ff4765e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:41.717 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-22T08:33:41.437+0000 7ff4765e1640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:41.717 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-22T08:33:41.437+0000 7ff4765e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:41.717 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-22T08:33:41.437+0000 7ff475de0640 10 monclient(hunting): get_auth_request con 0x55aa35547390 auth_method 0 2024-09-22T08:33:41.717 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-22T08:33:41.437+0000 7ff475de0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:41.717 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-22T08:33:41.437+0000 7ff475de0640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:41.717 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-22T08:33:41.437+0000 7ff475de0640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:41.717 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-22T08:33:41.437+0000 7ff4755df640 10 monclient(hunting): get_auth_request con 0x55aa35548680 auth_method 0 2024-09-22T08:33:41.718 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-22T08:33:41.437+0000 7ff4755df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:41.718 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-22T08:33:41.437+0000 7ff4755df640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:41.718 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-22T08:33:41.437+0000 7ff4755df640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:41.718 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-22T08:33:41.437+0000 7ff4765e1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:41.718 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-22T08:33:41.437+0000 7ff4765e1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:41.718 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-22T08:33:41.437+0000 7ff4765e1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:41.718 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-22T08:33:41.437+0000 7ff475de0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:41.718 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-22T08:33:41.437+0000 7ff475de0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:41.718 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-22T08:33:41.437+0000 7ff475de0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:41.718 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-22T08:33:41.437+0000 7ff4755df640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:41.718 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-22T08:33:41.437+0000 7ff4755df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:41.718 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-22T08:33:41.437+0000 7ff4755df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:41.718 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-22T08:33:41.437+0000 7ff4765e1640 10 monclient(hunting): handle_auth_done global_id 6528 payload 824 2024-09-22T08:33:41.719 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-22T08:33:41.437+0000 7ff4765e1640 10 monclient: _finish_hunting 0 2024-09-22T08:33:41.719 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-22T08:33:41.437+0000 7ff4765e1640 1 monclient: found mon.noname-a 2024-09-22T08:33:41.719 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-22T08:33:41.437+0000 7ff4765e1640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:33:41.719 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-22T08:33:41.438+0000 7ff35b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:33:41.719 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-22T08:33:41.438+0000 7ff35b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:33:41.719 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-22T08:33:41.438+0000 7ff35b7fe640 10 monclient: dump: 2024-09-22T08:33:41.719 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:33:41.719 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:33:41.719 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:41.719 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:41.719 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:33:41.719 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:41.719 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:33:41.719 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:33:41.719 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:33:41.720 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.720 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-22T08:33:41.438+0000 7ff35b7fe640 10 monclient: _finish_auth 0 2024-09-22T08:33:41.720 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-22T08:33:41.438+0000 7ff35b7fe640 10 monclient: _check_auth_tickets 2024-09-22T08:33:41.720 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-22T08:33:41.438+0000 7ff35b7fe640 10 monclient: handle_config config(0 keys) 2024-09-22T08:33:41.720 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-22T08:33:41.438+0000 7ff35b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:33:41.720 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-22T08:33:41.438+0000 7ff35b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:33:41.720 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-22T08:33:41.438+0000 7ff35b7fe640 10 monclient: dump: 2024-09-22T08:33:41.720 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:33:41.720 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:33:41.720 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:41.720 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:41.720 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:33:41.720 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:41.720 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:33:41.721 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:33:41.721 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:33:41.721 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.721 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-22T08:33:41.438+0000 7ff47a614800 5 monclient: authenticate success, global_id 6528 2024-09-22T08:33:41.721 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-22T08:33:41.438+0000 7ff47a614800 10 monclient: _renew_subs 2024-09-22T08:33:41.721 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-22T08:33:41.438+0000 7ff476de2640 4 set_mon_vals no callback set 2024-09-22T08:33:41.721 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-22T08:33:41.438+0000 7ff47a614800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:33:41.721 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-22T08:33:41.438+0000 7ff47a614800 10 monclient: _renew_subs 2024-09-22T08:33:41.721 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-22T08:33:41.438+0000 7ff47a614800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:33:41.721 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-22T08:33:41.440+0000 7ff35b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:33:41.721 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-22T08:33:41.440+0000 7ff35b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:33:41.721 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-22T08:33:41.440+0000 7ff35b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:33:41.721 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-22T08:33:41.440+0000 7ff4755df640 10 monclient: get_auth_request con 0x7ff350077480 auth_method 0 2024-09-22T08:33:41.721 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-22T08:33:41.440+0000 7ff47a614800 10 monclient: get_monmap_and_config 2024-09-22T08:33:41.722 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-22T08:33:41.440+0000 7ff47a614800 10 monclient: build_initial_monmap 2024-09-22T08:33:41.722 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-22T08:33:41.440+0000 7ff47a614800 1 build_initial for_mkfs: 0 2024-09-22T08:33:41.722 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-22T08:33:41.440+0000 7ff47a614800 10 monclient: monmap: 2024-09-22T08:33:41.722 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:33:41.722 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:33:41.722 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:33:41.722 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:33:41.722 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:33:41.722 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:41.722 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:33:41.722 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:33:41.722 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:33:41.722 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.722 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-22T08:33:41.440+0000 7ff47a614800 5 AuthRegistry(0x55aa355685d0) adding auth protocol: cephx 2024-09-22T08:33:41.722 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-22T08:33:41.440+0000 7ff47a614800 5 AuthRegistry(0x55aa355685d0) adding auth protocol: cephx 2024-09-22T08:33:41.723 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-22T08:33:41.440+0000 7ff47a614800 5 AuthRegistry(0x55aa355685d0) adding auth protocol: cephx 2024-09-22T08:33:41.723 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-22T08:33:41.440+0000 7ff47a614800 5 AuthRegistry(0x55aa355685d0) adding con mode: secure 2024-09-22T08:33:41.723 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-22T08:33:41.440+0000 7ff47a614800 5 AuthRegistry(0x55aa355685d0) adding con mode: crc 2024-09-22T08:33:41.723 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-22T08:33:41.440+0000 7ff47a614800 5 AuthRegistry(0x55aa355685d0) adding con mode: secure 2024-09-22T08:33:41.723 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-22T08:33:41.440+0000 7ff47a614800 5 AuthRegistry(0x55aa355685d0) adding con mode: crc 2024-09-22T08:33:41.723 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-22T08:33:41.440+0000 7ff47a614800 5 AuthRegistry(0x55aa355685d0) adding con mode: secure 2024-09-22T08:33:41.723 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-22T08:33:41.440+0000 7ff47a614800 5 AuthRegistry(0x55aa355685d0) adding con mode: crc 2024-09-22T08:33:41.723 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-22T08:33:41.440+0000 7ff47a614800 5 AuthRegistry(0x55aa355685d0) adding con mode: crc 2024-09-22T08:33:41.723 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-22T08:33:41.440+0000 7ff47a614800 5 AuthRegistry(0x55aa355685d0) adding con mode: secure 2024-09-22T08:33:41.723 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-22T08:33:41.440+0000 7ff47a614800 5 AuthRegistry(0x55aa355685d0) adding con mode: crc 2024-09-22T08:33:41.723 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-22T08:33:41.440+0000 7ff47a614800 5 AuthRegistry(0x55aa355685d0) adding con mode: secure 2024-09-22T08:33:41.723 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-22T08:33:41.440+0000 7ff47a614800 5 AuthRegistry(0x55aa355685d0) adding con mode: crc 2024-09-22T08:33:41.723 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-22T08:33:41.440+0000 7ff47a614800 5 AuthRegistry(0x55aa355685d0) adding con mode: secure 2024-09-22T08:33:41.723 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-22T08:33:41.440+0000 7ff47a614800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:41.723 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-22T08:33:41.441+0000 7ff47a614800 10 monclient: init 2024-09-22T08:33:41.724 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-22T08:33:41.441+0000 7ff47a614800 5 AuthRegistry(0x7ffed7095c10) adding auth protocol: cephx 2024-09-22T08:33:41.724 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-22T08:33:41.441+0000 7ff47a614800 5 AuthRegistry(0x7ffed7095c10) adding auth protocol: cephx 2024-09-22T08:33:41.724 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-22T08:33:41.441+0000 7ff47a614800 5 AuthRegistry(0x7ffed7095c10) adding auth protocol: cephx 2024-09-22T08:33:41.724 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-22T08:33:41.441+0000 7ff47a614800 5 AuthRegistry(0x7ffed7095c10) adding con mode: secure 2024-09-22T08:33:41.724 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-22T08:33:41.441+0000 7ff47a614800 5 AuthRegistry(0x7ffed7095c10) adding con mode: crc 2024-09-22T08:33:41.724 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-22T08:33:41.441+0000 7ff47a614800 5 AuthRegistry(0x7ffed7095c10) adding con mode: secure 2024-09-22T08:33:41.724 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-22T08:33:41.441+0000 7ff47a614800 5 AuthRegistry(0x7ffed7095c10) adding con mode: crc 2024-09-22T08:33:41.724 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-22T08:33:41.441+0000 7ff47a614800 5 AuthRegistry(0x7ffed7095c10) adding con mode: secure 2024-09-22T08:33:41.724 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-22T08:33:41.441+0000 7ff47a614800 5 AuthRegistry(0x7ffed7095c10) adding con mode: crc 2024-09-22T08:33:41.724 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-22T08:33:41.441+0000 7ff47a614800 5 AuthRegistry(0x7ffed7095c10) adding con mode: crc 2024-09-22T08:33:41.724 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-22T08:33:41.441+0000 7ff47a614800 5 AuthRegistry(0x7ffed7095c10) adding con mode: secure 2024-09-22T08:33:41.724 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-22T08:33:41.441+0000 7ff47a614800 5 AuthRegistry(0x7ffed7095c10) adding con mode: crc 2024-09-22T08:33:41.724 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-22T08:33:41.441+0000 7ff47a614800 5 AuthRegistry(0x7ffed7095c10) adding con mode: secure 2024-09-22T08:33:41.724 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-22T08:33:41.441+0000 7ff47a614800 5 AuthRegistry(0x7ffed7095c10) adding con mode: crc 2024-09-22T08:33:41.724 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-22T08:33:41.441+0000 7ff47a614800 5 AuthRegistry(0x7ffed7095c10) adding con mode: secure 2024-09-22T08:33:41.725 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-22T08:33:41.441+0000 7ff47a614800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:41.725 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-22T08:33:41.441+0000 7ff47a614800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:41.725 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-22T08:33:41.441+0000 7ff47a614800 5 asok(0x55aa352a70f0) register_command rotate-key cmddesc rotate-key hook 0x7ffed7095d58 EEXIST 2024-09-22T08:33:41.725 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-22T08:33:41.441+0000 7ff47a614800 10 monclient: _reopen_session rank -1 2024-09-22T08:33:41.725 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-22T08:33:41.441+0000 7ff47a614800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T08:33:41.725 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-22T08:33:41.441+0000 7ff47a614800 10 monclient(hunting): picked mon.noname-a con 0x55aa3559cbd0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:33:41.725 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-22T08:33:41.441+0000 7ff47a614800 10 monclient(hunting): picked mon.noname-c con 0x55aa3558d520 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:33:41.725 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-22T08:33:41.441+0000 7ff47a614800 10 monclient(hunting): picked mon.noname-b con 0x55aa35598000 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:33:41.725 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-22T08:33:41.441+0000 7ff47a614800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:41.725 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-22T08:33:41.441+0000 7ff47a614800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:41.725 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-22T08:33:41.441+0000 7ff47a614800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:41.725 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-22T08:33:41.441+0000 7ff47a614800 10 monclient(hunting): _renew_subs 2024-09-22T08:33:41.725 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-22T08:33:41.441+0000 7ff47a614800 10 monclient(hunting): authenticate will time out at 1926.680604s 2024-09-22T08:33:41.725 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-22T08:33:41.441+0000 7ff4765e1640 10 monclient(hunting): get_auth_request con 0x55aa3558d520 auth_method 0 2024-09-22T08:33:41.726 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-22T08:33:41.441+0000 7ff4765e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:41.726 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-22T08:33:41.441+0000 7ff4765e1640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:41.726 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-22T08:33:41.441+0000 7ff4765e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:41.726 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-22T08:33:41.441+0000 7ff4755df640 10 monclient(hunting): get_auth_request con 0x55aa3559cbd0 auth_method 0 2024-09-22T08:33:41.726 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-22T08:33:41.441+0000 7ff4755df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:41.726 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-22T08:33:41.441+0000 7ff4755df640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:41.726 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-22T08:33:41.441+0000 7ff4755df640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:41.726 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-22T08:33:41.441+0000 7ff4765e1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:41.726 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-22T08:33:41.441+0000 7ff4765e1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:41.726 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-22T08:33:41.441+0000 7ff4765e1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:41.726 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-22T08:33:41.441+0000 7ff475de0640 10 monclient(hunting): get_auth_request con 0x55aa35598000 auth_method 0 2024-09-22T08:33:41.726 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-22T08:33:41.441+0000 7ff475de0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:41.726 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-22T08:33:41.441+0000 7ff475de0640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:41.726 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-22T08:33:41.441+0000 7ff475de0640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:41.726 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-22T08:33:41.441+0000 7ff4755df640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:41.727 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-22T08:33:41.441+0000 7ff4755df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:41.727 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-22T08:33:41.441+0000 7ff4755df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:41.727 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-22T08:33:41.441+0000 7ff4765e1640 10 monclient(hunting): handle_auth_done global_id 6188 payload 274 2024-09-22T08:33:41.727 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-22T08:33:41.441+0000 7ff4765e1640 10 monclient: _finish_hunting 0 2024-09-22T08:33:41.727 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-22T08:33:41.441+0000 7ff4765e1640 1 monclient: found mon.noname-c 2024-09-22T08:33:41.727 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-22T08:33:41.441+0000 7ff4765e1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:33:41.727 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-22T08:33:41.442+0000 7ff3597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:33:41.727 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-22T08:33:41.442+0000 7ff3597fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:33:41.727 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-22T08:33:41.442+0000 7ff3597fa640 10 monclient: dump: 2024-09-22T08:33:41.727 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:33:41.727 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:33:41.727 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:41.727 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:41.727 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:33:41.727 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:41.728 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:33:41.728 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:33:41.728 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:33:41.728 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.728 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-22T08:33:41.442+0000 7ff3597fa640 10 monclient: _finish_auth 0 2024-09-22T08:33:41.728 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-22T08:33:41.442+0000 7ff3597fa640 10 monclient: _check_auth_tickets 2024-09-22T08:33:41.728 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-22T08:33:41.442+0000 7ff3597fa640 10 monclient: handle_config config(0 keys) 2024-09-22T08:33:41.728 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-22T08:33:41.442+0000 7ff47a614800 5 monclient: authenticate success, global_id 6188 2024-09-22T08:33:41.728 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-22T08:33:41.442+0000 7ff47a614800 10 monclient: get_monmap_and_config success 2024-09-22T08:33:41.728 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-22T08:33:41.442+0000 7ff47a614800 4 set_mon_vals no callback set 2024-09-22T08:33:41.728 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-22T08:33:41.442+0000 7ff3597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:33:41.728 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-22T08:33:41.442+0000 7ff3597fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:33:41.728 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-22T08:33:41.442+0000 7ff3597fa640 10 monclient: dump: 2024-09-22T08:33:41.728 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:33:41.729 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:33:41.729 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:41.729 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:41.729 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:33:41.729 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:41.729 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:33:41.729 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:33:41.729 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:33:41.729 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.729 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-22T08:33:41.442+0000 7ff47a614800 10 monclient: shutdown 2024-09-22T08:33:41.729 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-22T08:33:41.442+0000 7ff47a614800 10 monclient: build_initial_monmap 2024-09-22T08:33:41.729 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-22T08:33:41.442+0000 7ff47a614800 1 build_initial for_mkfs: 0 2024-09-22T08:33:41.729 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-22T08:33:41.442+0000 7ff47a614800 10 monclient: monmap: 2024-09-22T08:33:41.729 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:33:41.729 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:33:41.730 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:33:41.730 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:33:41.730 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:33:41.730 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:41.730 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:33:41.730 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:33:41.730 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:33:41.730 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.730 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-22T08:33:41.442+0000 7ff47a614800 5 AuthRegistry(0x55aa3556d360) adding auth protocol: cephx 2024-09-22T08:33:41.730 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-22T08:33:41.442+0000 7ff47a614800 5 AuthRegistry(0x55aa3556d360) adding auth protocol: cephx 2024-09-22T08:33:41.730 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-22T08:33:41.442+0000 7ff47a614800 5 AuthRegistry(0x55aa3556d360) adding auth protocol: cephx 2024-09-22T08:33:41.730 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-22T08:33:41.442+0000 7ff47a614800 5 AuthRegistry(0x55aa3556d360) adding con mode: secure 2024-09-22T08:33:41.730 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-22T08:33:41.442+0000 7ff47a614800 5 AuthRegistry(0x55aa3556d360) adding con mode: crc 2024-09-22T08:33:41.730 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-22T08:33:41.442+0000 7ff47a614800 5 AuthRegistry(0x55aa3556d360) adding con mode: secure 2024-09-22T08:33:41.731 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-22T08:33:41.442+0000 7ff47a614800 5 AuthRegistry(0x55aa3556d360) adding con mode: crc 2024-09-22T08:33:41.731 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-22T08:33:41.442+0000 7ff47a614800 5 AuthRegistry(0x55aa3556d360) adding con mode: secure 2024-09-22T08:33:41.731 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-22T08:33:41.442+0000 7ff47a614800 5 AuthRegistry(0x55aa3556d360) adding con mode: crc 2024-09-22T08:33:41.731 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-22T08:33:41.442+0000 7ff47a614800 5 AuthRegistry(0x55aa3556d360) adding con mode: crc 2024-09-22T08:33:41.731 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-22T08:33:41.442+0000 7ff47a614800 5 AuthRegistry(0x55aa3556d360) adding con mode: secure 2024-09-22T08:33:41.731 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-22T08:33:41.442+0000 7ff47a614800 5 AuthRegistry(0x55aa3556d360) adding con mode: crc 2024-09-22T08:33:41.731 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-22T08:33:41.442+0000 7ff47a614800 5 AuthRegistry(0x55aa3556d360) adding con mode: secure 2024-09-22T08:33:41.731 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-22T08:33:41.442+0000 7ff47a614800 5 AuthRegistry(0x55aa3556d360) adding con mode: crc 2024-09-22T08:33:41.731 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-22T08:33:41.442+0000 7ff47a614800 5 AuthRegistry(0x55aa3556d360) adding con mode: secure 2024-09-22T08:33:41.731 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-22T08:33:41.443+0000 7ff47a614800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:41.731 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-22T08:33:41.443+0000 7ff47a614800 1 librados: starting msgr at 2024-09-22T08:33:41.731 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-22T08:33:41.443+0000 7ff47a614800 1 librados: starting objecter 2024-09-22T08:33:41.731 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-22T08:33:41.443+0000 7ff47a614800 5 asok(0x55aa352a70f0) register_command objecter_requests cmddesc objecter_requests hook 0x55aa35597e00 EEXIST 2024-09-22T08:33:41.731 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-22T08:33:41.443+0000 7ff47a614800 1 librados: setting wanted keys 2024-09-22T08:33:41.731 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-22T08:33:41.443+0000 7ff47a614800 1 librados: calling monclient init 2024-09-22T08:33:41.732 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-22T08:33:41.443+0000 7ff47a614800 10 monclient: init 2024-09-22T08:33:41.732 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-22T08:33:41.443+0000 7ff47a614800 5 AuthRegistry(0x55aa3555cf40) adding auth protocol: cephx 2024-09-22T08:33:41.732 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-22T08:33:41.443+0000 7ff47a614800 5 AuthRegistry(0x55aa3555cf40) adding auth protocol: cephx 2024-09-22T08:33:41.732 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-22T08:33:41.443+0000 7ff47a614800 5 AuthRegistry(0x55aa3555cf40) adding auth protocol: cephx 2024-09-22T08:33:41.732 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-22T08:33:41.443+0000 7ff47a614800 5 AuthRegistry(0x55aa3555cf40) adding con mode: secure 2024-09-22T08:33:41.732 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-22T08:33:41.443+0000 7ff47a614800 5 AuthRegistry(0x55aa3555cf40) adding con mode: crc 2024-09-22T08:33:41.732 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-22T08:33:41.443+0000 7ff47a614800 5 AuthRegistry(0x55aa3555cf40) adding con mode: secure 2024-09-22T08:33:41.732 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-22T08:33:41.443+0000 7ff47a614800 5 AuthRegistry(0x55aa3555cf40) adding con mode: crc 2024-09-22T08:33:41.732 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-22T08:33:41.443+0000 7ff47a614800 5 AuthRegistry(0x55aa3555cf40) adding con mode: secure 2024-09-22T08:33:41.732 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-22T08:33:41.443+0000 7ff47a614800 5 AuthRegistry(0x55aa3555cf40) adding con mode: crc 2024-09-22T08:33:41.732 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-22T08:33:41.443+0000 7ff47a614800 5 AuthRegistry(0x55aa3555cf40) adding con mode: crc 2024-09-22T08:33:41.732 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-22T08:33:41.443+0000 7ff47a614800 5 AuthRegistry(0x55aa3555cf40) adding con mode: secure 2024-09-22T08:33:41.732 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-22T08:33:41.443+0000 7ff47a614800 5 AuthRegistry(0x55aa3555cf40) adding con mode: crc 2024-09-22T08:33:41.732 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-22T08:33:41.443+0000 7ff47a614800 5 AuthRegistry(0x55aa3555cf40) adding con mode: secure 2024-09-22T08:33:41.732 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-22T08:33:41.443+0000 7ff47a614800 5 AuthRegistry(0x55aa3555cf40) adding con mode: crc 2024-09-22T08:33:41.733 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-22T08:33:41.443+0000 7ff47a614800 5 AuthRegistry(0x55aa3555cf40) adding con mode: secure 2024-09-22T08:33:41.733 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-22T08:33:41.443+0000 7ff47a614800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:41.733 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-22T08:33:41.443+0000 7ff47a614800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:41.733 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-22T08:33:41.443+0000 7ff47a614800 5 asok(0x55aa352a70f0) register_command rotate-key cmddesc rotate-key hook 0x55aa3555d088 EEXIST 2024-09-22T08:33:41.733 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-22T08:33:41.443+0000 7ff47a614800 10 monclient: _reopen_session rank -1 2024-09-22T08:33:41.733 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-22T08:33:41.443+0000 7ff47a614800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-22T08:33:41.733 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-22T08:33:41.443+0000 7ff47a614800 10 monclient(hunting): picked mon.noname-b con 0x55aa3558d520 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:33:41.733 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-22T08:33:41.443+0000 7ff47a614800 10 monclient(hunting): picked mon.noname-c con 0x55aa35598000 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:33:41.733 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-22T08:33:41.443+0000 7ff47a614800 10 monclient(hunting): picked mon.noname-a con 0x55aa3559cbd0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:33:41.733 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-22T08:33:41.443+0000 7ff47a614800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:41.733 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-22T08:33:41.443+0000 7ff47a614800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:41.733 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-22T08:33:41.443+0000 7ff47a614800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:41.733 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-22T08:33:41.443+0000 7ff47a614800 10 monclient(hunting): _renew_subs 2024-09-22T08:33:41.733 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-22T08:33:41.443+0000 7ff47a614800 10 monclient(hunting): authenticate will time out at 1926.682910s 2024-09-22T08:33:41.733 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-22T08:33:41.444+0000 7ff475de0640 10 monclient(hunting): get_auth_request con 0x55aa3559cbd0 auth_method 0 2024-09-22T08:33:41.734 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-22T08:33:41.444+0000 7ff475de0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:41.734 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-22T08:33:41.444+0000 7ff475de0640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:41.734 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-22T08:33:41.444+0000 7ff475de0640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:41.734 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-22T08:33:41.444+0000 7ff4765e1640 10 monclient(hunting): get_auth_request con 0x55aa35598000 auth_method 0 2024-09-22T08:33:41.734 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-22T08:33:41.444+0000 7ff4765e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:41.734 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-22T08:33:41.444+0000 7ff4765e1640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:41.734 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-22T08:33:41.444+0000 7ff4765e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:41.734 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-22T08:33:41.444+0000 7ff4755df640 10 monclient(hunting): get_auth_request con 0x55aa3558d520 auth_method 0 2024-09-22T08:33:41.734 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-22T08:33:41.444+0000 7ff4755df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:41.734 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-22T08:33:41.444+0000 7ff4755df640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:41.734 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-22T08:33:41.444+0000 7ff4755df640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:41.734 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-22T08:33:41.444+0000 7ff475de0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:41.734 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-22T08:33:41.444+0000 7ff475de0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:41.734 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-22T08:33:41.444+0000 7ff475de0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:41.735 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-22T08:33:41.444+0000 7ff4765e1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:41.735 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-22T08:33:41.444+0000 7ff4765e1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:41.735 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-22T08:33:41.444+0000 7ff4765e1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:41.735 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-22T08:33:41.444+0000 7ff4755df640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:41.735 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-22T08:33:41.444+0000 7ff4755df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:41.735 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-22T08:33:41.444+0000 7ff4755df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:41.735 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-22T08:33:41.444+0000 7ff4765e1640 10 monclient(hunting): handle_auth_done global_id 6191 payload 824 2024-09-22T08:33:41.735 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-22T08:33:41.444+0000 7ff4765e1640 10 monclient: _finish_hunting 0 2024-09-22T08:33:41.735 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-22T08:33:41.444+0000 7ff4765e1640 1 monclient: found mon.noname-c 2024-09-22T08:33:41.735 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-22T08:33:41.444+0000 7ff4765e1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:33:41.735 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-22T08:33:41.444+0000 7ff3477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:33:41.735 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-22T08:33:41.444+0000 7ff3477fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:33:41.735 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-22T08:33:41.444+0000 7ff3477fe640 10 monclient: dump: 2024-09-22T08:33:41.735 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:33:41.735 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:33:41.735 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:41.736 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:41.736 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:33:41.736 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:41.736 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:33:41.736 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:33:41.736 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:33:41.736 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.736 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-22T08:33:41.444+0000 7ff3477fe640 10 monclient: _finish_auth 0 2024-09-22T08:33:41.736 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-22T08:33:41.444+0000 7ff3477fe640 10 monclient: _check_auth_tickets 2024-09-22T08:33:41.736 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-22T08:33:41.444+0000 7ff3477fe640 10 monclient: handle_config config(0 keys) 2024-09-22T08:33:41.736 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-22T08:33:41.444+0000 7ff3477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:33:41.736 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-22T08:33:41.444+0000 7ff3477fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:33:41.736 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-22T08:33:41.444+0000 7ff3477fe640 10 monclient: dump: 2024-09-22T08:33:41.736 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:33:41.736 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:33:41.737 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:41.737 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:41.737 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:33:41.737 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:41.737 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:33:41.737 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:33:41.737 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:33:41.737 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.737 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-22T08:33:41.444+0000 7ff47a614800 5 monclient: authenticate success, global_id 6191 2024-09-22T08:33:41.737 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-22T08:33:41.444+0000 7ff47a614800 10 monclient: _renew_subs 2024-09-22T08:33:41.737 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-22T08:33:41.444+0000 7ff3597fa640 4 set_mon_vals no callback set 2024-09-22T08:33:41.737 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-22T08:33:41.444+0000 7ff47a614800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:33:41.737 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-22T08:33:41.444+0000 7ff47a614800 10 monclient: _renew_subs 2024-09-22T08:33:41.737 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-22T08:33:41.444+0000 7ff47a614800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:33:41.737 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-22T08:33:41.444+0000 7ff47a614800 1 librados: init done 2024-09-22T08:33:41.738 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-22T08:33:41.444+0000 7ff47a614800 5 asok(0x55aa352a70f0) register_command cr dump hook 0x55aa35598b78 2024-09-22T08:33:41.738 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-22T08:33:41.446+0000 7ff47a614800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.738 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-22T08:33:41.446+0000 7ff3477fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:33:41.738 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-22T08:33:41.446+0000 7ff3477fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:33:41.738 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-22T08:33:41.446+0000 7ff3477fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:33:41.738 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-22T08:33:41.447+0000 7ff4755df640 10 monclient: get_auth_request con 0x7ff340077570 auth_method 0 2024-09-22T08:33:41.738 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-22T08:33:41.447+0000 7ff475de0640 10 monclient: get_auth_request con 0x55aa355b6d90 auth_method 0 2024-09-22T08:33:41.738 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-22T08:33:41.447+0000 7ff47a614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.738 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-22T08:33:41.447+0000 7ff47a614800 20 realm 2024-09-22T08:33:41.738 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-22T08:33:41.447+0000 7ff47a614800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.738 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-22T08:33:41.448+0000 7ff47a614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.738 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-22T08:33:41.448+0000 7ff47a614800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:33:41.738 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-22T08:33:41.448+0000 7ff47a614800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.738 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-22T08:33:41.448+0000 7ff47a614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.739 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-22T08:33:41.448+0000 7ff47a614800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.739 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-22T08:33:41.448+0000 7ff4755df640 10 monclient: get_auth_request con 0x55aa355bb050 auth_method 0 2024-09-22T08:33:41.739 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-22T08:33:41.449+0000 7ff47a614800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:41.739 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-22T08:33:41.449+0000 7ff47a614800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.739 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-22T08:33:41.449+0000 7ff4765e1640 10 monclient: get_auth_request con 0x55aa355be8b0 auth_method 0 2024-09-22T08:33:41.739 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-22T08:33:41.449+0000 7ff47a614800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:33:41.739 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-22T08:33:41.449+0000 7ff47a614800 20 searching for the correct realm 2024-09-22T08:33:41.739 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-22T08:33:41.449+0000 7ff475de0640 10 monclient: get_auth_request con 0x55aa355c3650 auth_method 0 2024-09-22T08:33:41.739 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-22T08:33:41.451+0000 7ff4755df640 10 monclient: get_auth_request con 0x7ff46c083030 auth_method 0 2024-09-22T08:33:41.739 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-22T08:33:41.451+0000 7ff4755df640 0 -- 172.21.15.38:0/2140828749 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7ff46c083030 msgr2=0x7ff46c0660d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:41.739 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-22T08:33:41.451+0000 7ff3477fe640 1 client.6191.objecter ms_handle_reset 0x7ff46c083030 session 0x7ff46c005040 osd.0 2024-09-22T08:33:41.739 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-22T08:33:41.451+0000 7ff3477fe640 10 monclient: _renew_subs 2024-09-22T08:33:41.739 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-22T08:33:41.451+0000 7ff3477fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:33:41.739 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-22T08:33:41.452+0000 7ff4755df640 10 monclient: get_auth_request con 0x7ff340087090 auth_method 0 2024-09-22T08:33:41.740 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-22T08:33:41.452+0000 7ff4765e1640 10 monclient: get_auth_request con 0x7ff468071940 auth_method 0 2024-09-22T08:33:41.740 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-22T08:33:41.454+0000 7ff475de0640 10 monclient: get_auth_request con 0x7ff46c08c040 auth_method 0 2024-09-22T08:33:41.740 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-22T08:33:41.455+0000 7ff4755df640 10 monclient: get_auth_request con 0x7ff468098900 auth_method 0 2024-09-22T08:33:41.740 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-22T08:33:41.455+0000 7ff4755df640 0 -- 172.21.15.38:0/2140828749 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7ff468098900 msgr2=0x7ff4680683f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:41.740 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-22T08:33:41.656+0000 7ff4755df640 10 monclient: get_auth_request con 0x7ff468098900 auth_method 0 2024-09-22T08:33:41.740 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-22T08:33:41.662+0000 7ff47a614800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:33:41.740 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-22T08:33:41.662+0000 7ff47a614800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:33:41.740 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-22T08:33:41.662+0000 7ff47a614800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:33:41.740 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-22T08:33:41.662+0000 7ff47a614800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:33:41.740 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-22T08:33:41.662+0000 7ff47a614800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:33:41.740 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-22T08:33:41.662+0000 7ff47a614800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:33:41.741 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-22T08:33:41.662+0000 7ff47a614800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.741 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-22T08:33:41.662+0000 7ff47a614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.741 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-22T08:33:41.662+0000 7ff47a614800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.741 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-22T08:33:41.663+0000 7ff47a614800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:41.741 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-22T08:33:41.663+0000 7ff47a614800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.741 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-22T08:33:41.663+0000 7ff47a614800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:33:41.741 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-22T08:33:41.663+0000 7ff47a614800 20 zone default found 2024-09-22T08:33:41.741 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-22T08:33:41.663+0000 7ff47a614800 4 Realm: () 2024-09-22T08:33:41.741 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-22T08:33:41.663+0000 7ff47a614800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:33:41.741 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-22T08:33:41.663+0000 7ff47a614800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:33:41.741 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-22T08:33:41.663+0000 7ff47a614800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:33:41.741 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-22T08:33:41.663+0000 7ff47a614800 20 zonegroup default 2024-09-22T08:33:41.741 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-22T08:33:41.663+0000 7ff47a614800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.741 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-22T08:33:41.663+0000 7ff47a614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.741 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-22T08:33:41.663+0000 7ff47a614800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.742 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-22T08:33:41.664+0000 7ff47a614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.742 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-22T08:33:41.664+0000 7ff47a614800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.742 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-22T08:33:41.664+0000 7ff47a614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.742 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-22T08:33:41.664+0000 7ff47a614800 20 started sync module instance, tier type = 2024-09-22T08:33:41.742 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-22T08:33:41.664+0000 7ff47a614800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:33:41.742 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-22T08:33:41.673+0000 7ff47a614800 20 add_watcher() i=0 2024-09-22T08:33:41.742 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-22T08:33:41.673+0000 7ff47a614800 20 add_watcher() i=1 2024-09-22T08:33:41.742 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-22T08:33:41.673+0000 7ff47a614800 20 add_watcher() i=2 2024-09-22T08:33:41.742 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-22T08:33:41.673+0000 7ff47a614800 20 add_watcher() i=3 2024-09-22T08:33:41.742 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-22T08:33:41.673+0000 7ff47a614800 20 add_watcher() i=4 2024-09-22T08:33:41.742 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-22T08:33:41.673+0000 7ff47a614800 20 add_watcher() i=5 2024-09-22T08:33:41.742 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-22T08:33:41.674+0000 7ff47a614800 20 add_watcher() i=6 2024-09-22T08:33:41.742 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-22T08:33:41.674+0000 7ff47a614800 20 add_watcher() i=7 2024-09-22T08:33:41.742 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-22T08:33:41.674+0000 7ff47a614800 2 all 8 watchers are set, enabling cache 2024-09-22T08:33:41.742 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-22T08:33:41.676+0000 7ff47a614800 5 AuthRegistry(0x7ffed70960e0) adding auth protocol: cephx 2024-09-22T08:33:41.743 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-22T08:33:41.676+0000 7ff47a614800 5 AuthRegistry(0x7ffed70960e0) adding auth protocol: cephx 2024-09-22T08:33:41.743 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-22T08:33:41.676+0000 7ff47a614800 5 AuthRegistry(0x7ffed70960e0) adding auth protocol: cephx 2024-09-22T08:33:41.743 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-22T08:33:41.676+0000 7ff47a614800 5 AuthRegistry(0x7ffed70960e0) adding con mode: secure 2024-09-22T08:33:41.743 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-22T08:33:41.676+0000 7ff47a614800 5 AuthRegistry(0x7ffed70960e0) adding con mode: crc 2024-09-22T08:33:41.743 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-22T08:33:41.676+0000 7ff47a614800 5 AuthRegistry(0x7ffed70960e0) adding con mode: secure 2024-09-22T08:33:41.743 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-22T08:33:41.676+0000 7ff47a614800 5 AuthRegistry(0x7ffed70960e0) adding con mode: crc 2024-09-22T08:33:41.743 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-22T08:33:41.676+0000 7ff47a614800 5 AuthRegistry(0x7ffed70960e0) adding con mode: secure 2024-09-22T08:33:41.743 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-22T08:33:41.676+0000 7ff47a614800 5 AuthRegistry(0x7ffed70960e0) adding con mode: crc 2024-09-22T08:33:41.743 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-22T08:33:41.676+0000 7ff3277fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:41.743 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-22T08:33:41.676+0000 7ff47a614800 5 AuthRegistry(0x7ffed70960e0) adding con mode: crc 2024-09-22T08:33:41.743 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-22T08:33:41.676+0000 7ff47a614800 5 AuthRegistry(0x7ffed70960e0) adding con mode: secure 2024-09-22T08:33:41.743 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-22T08:33:41.676+0000 7ff47a614800 5 AuthRegistry(0x7ffed70960e0) adding con mode: crc 2024-09-22T08:33:41.743 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-22T08:33:41.676+0000 7ff47a614800 5 AuthRegistry(0x7ffed70960e0) adding con mode: secure 2024-09-22T08:33:41.743 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-22T08:33:41.676+0000 7ff47a614800 5 AuthRegistry(0x7ffed70960e0) adding con mode: crc 2024-09-22T08:33:41.744 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-22T08:33:41.676+0000 7ff47a614800 5 AuthRegistry(0x7ffed70960e0) adding con mode: secure 2024-09-22T08:33:41.744 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-22T08:33:41.677+0000 7ff47a614800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:41.744 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-22T08:33:41.677+0000 7ff47a614800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:33:41.744 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-22T08:33:41.677+0000 7ff47a614800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:33:41.744 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-22T08:33:41.677+0000 7ff47a614800 5 asok(0x55aa352a70f0) register_command cache list hook 0x55aa35592f70 2024-09-22T08:33:41.744 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-22T08:33:41.677+0000 7ff47a614800 5 asok(0x55aa352a70f0) register_command cache inspect hook 0x55aa35592f70 2024-09-22T08:33:41.744 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-22T08:33:41.677+0000 7ff47a614800 5 asok(0x55aa352a70f0) register_command cache erase hook 0x55aa35592f70 2024-09-22T08:33:41.744 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-22T08:33:41.677+0000 7ff47a614800 5 asok(0x55aa352a70f0) register_command cache zap hook 0x55aa35592f70 2024-09-22T08:33:41.744 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-22T08:33:41.677+0000 7ff47a614800 5 note: GC not initialized 2024-09-22T08:33:41.744 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-22T08:33:41.677+0000 7ff3267fc640 20 reqs_thread_entry: start 2024-09-22T08:33:41.744 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-22T08:33:41.677+0000 7ff47a614800 5 asok(0x55aa352a70f0) register_command sync trace show hook 0x7ff46c00f070 2024-09-22T08:33:41.744 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-22T08:33:41.677+0000 7ff47a614800 5 asok(0x55aa352a70f0) register_command sync trace history hook 0x7ff46c00f070 2024-09-22T08:33:41.744 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-22T08:33:41.677+0000 7ff47a614800 5 asok(0x55aa352a70f0) register_command sync trace active hook 0x7ff46c00f070 2024-09-22T08:33:41.744 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-22T08:33:41.677+0000 7ff47a614800 5 asok(0x55aa352a70f0) register_command sync trace active_short hook 0x7ff46c00f070 2024-09-22T08:33:41.745 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-22T08:33:41.677+0000 7ff47a614800 20 init_complete bucket index max shards: 11 2024-09-22T08:33:41.745 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-22T08:33:41.677+0000 7ff47a614800 20 Filter name: none 2024-09-22T08:33:41.745 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-22T08:33:41.677+0000 7ff297fff640 20 reqs_thread_entry: start 2024-09-22T08:33:41.745 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-22T08:33:41.677+0000 7ff47a614800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-22T08:33:41.745 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-22T08:33:41.677+0000 7ff47a614800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.745 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-22T08:33:41.678+0000 7ff47a614800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T08:33:41.745 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-22T08:33:41.678+0000 7ff47a614800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-22T08:33:41.745 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-22T08:33:41.678+0000 7ff47a614800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-22T08:33:41.745 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-22T08:33:41.678+0000 7ff47a614800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.24 : miss 2024-09-22T08:33:41.745 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-22T08:33:41.678+0000 7ff47a614800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.745 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-22T08:33:41.678+0000 7ff47a614800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T08:33:41.745 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-22T08:33:41.678+0000 7ff47a614800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.24 info.flags=0x17 2024-09-22T08:33:41.745 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-22T08:33:41.678+0000 7ff47a614800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.24 to cache LRU end 2024-09-22T08:33:41.746 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-22T08:33:41.678+0000 7ff47a614800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:33:41.746 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-22T08:33:41.678+0000 7ff47a614800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:41.746 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-22T08:33:41.678+0000 7ff47a614800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.24 2024-09-22T08:33:41.746 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-22T08:33:41.683+0000 7ff47a614800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff47a614800 time 2024-09-22T08:33:41.683713+0000 2024-09-22T08:33:41.746 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:33:41.746 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.746 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:33:41.746 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff47b78c748] 2024-09-22T08:33:41.746 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7ff47b78c906] 2024-09-22T08:33:41.746 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55aa34073e01] 2024-09-22T08:33:41.746 INFO:tasks.workunit.client.0.smithi038.stderr: 4: radosgw-admin(+0xd80c08) [0x55aa34585c08] 2024-09-22T08:33:41.746 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55aa34083c9d] 2024-09-22T08:33:41.746 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-22T08:33:41.746 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ff47a429590] 2024-09-22T08:33:41.747 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-22T08:33:41.747 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-22T08:33:41.747 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.747 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-22T08:33:41.684+0000 7ff47a614800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:33:41.747 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7ff47a614800 thread_name:radosgw-admin 2024-09-22T08:33:41.747 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.747 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:33:41.747 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff47a43e6f0] 2024-09-22T08:33:41.747 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff47a48b99c] 2024-09-22T08:33:41.747 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:33:41.747 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:33:41.747 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff47b78c7a2] 2024-09-22T08:33:41.747 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7ff47b78c906] 2024-09-22T08:33:41.747 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55aa34073e01] 2024-09-22T08:33:41.748 INFO:tasks.workunit.client.0.smithi038.stderr: 8: radosgw-admin(+0xd80c08) [0x55aa34585c08] 2024-09-22T08:33:41.748 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55aa34083c9d] 2024-09-22T08:33:41.748 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-22T08:33:41.748 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ff47a429590] 2024-09-22T08:33:41.748 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-22T08:33:41.748 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-22T08:33:41.748 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:33:41.748 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.748 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-22T08:33:41.748 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-22T08:33:41.748 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-22T08:33:41.748 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-22T08:33:41.748 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-22T08:33:41.748 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-22T08:33:41.748 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-22T08:33:41.749 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-22T08:33:41.749 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-22T08:33:41.749 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-22T08:33:41.749 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-22T08:33:41.749 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-22T08:33:41.749 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-22T08:33:41.749 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-22T08:33:41.749 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-22T08:33:41.749 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-22T08:33:41.749 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-22T08:33:41.749 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-22T08:33:41.749 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-22T08:33:41.749 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-22T08:33:41.749 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-22T08:33:41.749 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-22T08:33:41.750 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-22T08:33:41.750 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-22T08:33:41.750 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:33:41.750 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-22T08:33:41.750 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-22T08:33:41.750 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-22T08:33:41.750 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-22T08:33:41.750 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-22T08:33:41.750 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-22T08:33:41.750 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-22T08:33:41.750 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-22T08:33:41.750 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-22T08:33:41.750 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-22T08:33:41.750 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-22T08:33:41.750 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-22T08:33:41.751 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-22T08:33:41.751 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-22T08:33:41.751 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-22T08:33:41.751 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-22T08:33:41.751 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-22T08:33:41.751 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-22T08:33:41.751 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-22T08:33:41.751 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-22T08:33:41.751 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-22T08:33:41.751 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:33:41.751 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-22T08:33:41.751 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:33:41.751 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-22T08:33:41.751 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-22T08:33:41.751 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-22T08:33:41.752 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-22T08:33:41.752 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-22T08:33:41.752 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-22T08:33:41.752 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-22T08:33:41.752 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-22T08:33:41.752 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-22T08:33:41.752 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-22T08:33:41.752 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-22T08:33:41.752 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-22T08:33:41.752 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-22T08:33:41.752 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-22T08:33:41.752 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-22T08:33:41.752 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-22T08:33:41.752 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-22T08:33:41.752 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-22T08:33:41.753 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:33:41.753 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-22T08:33:41.753 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:33:41.753 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-22T08:33:41.753 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-22T08:33:41.753 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-22T08:33:41.753 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-22T08:33:41.753 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-22T08:33:41.753 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-22T08:33:41.753 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:33:41.753 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-22T08:33:41.753 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-22T08:33:41.753 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:33:41.753 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-22T08:33:41.754 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-22T08:33:41.754 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-22T08:33:41.754 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-22T08:33:41.754 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-22T08:33:41.754 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-22T08:33:41.754 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-22T08:33:41.754 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-22T08:33:41.754 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-22T08:33:41.754 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-22T08:33:41.754 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-22T08:33:41.754 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-22T08:33:41.754 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-22T08:33:41.754 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:33:41.754 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff297fff640 / http_manager 2024-09-22T08:33:41.754 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff3267fc640 / http_manager 2024-09-22T08:33:41.755 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff3277fe640 / rgw_dt_lg_renew 2024-09-22T08:33:41.755 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff3477fe640 / ms_dispatch 2024-09-22T08:33:41.755 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff3597fa640 / io_context_pool 2024-09-22T08:33:41.755 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff35b7fe640 / ms_dispatch 2024-09-22T08:33:41.755 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff362604640 / ms_dispatch 2024-09-22T08:33:41.755 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff363e07640 / io_context_pool 2024-09-22T08:33:41.755 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff4755df640 / msgr-worker-2 2024-09-22T08:33:41.755 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff475de0640 / msgr-worker-1 2024-09-22T08:33:41.755 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff4765e1640 / msgr-worker-0 2024-09-22T08:33:41.755 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff476de2640 / io_context_pool 2024-09-22T08:33:41.755 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff47a614800 / radosgw-admin 2024-09-22T08:33:41.755 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-22T08:33:41.755 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-22T08:33:41.755 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/log/ceph/ceph-client.admin.97453.log 2024-09-22T08:33:41.755 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-22T08:33:41.756 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-22T08:33:41.756 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-22T08:33:41.428+0000 7ff363e07640 10 monclient: dump: 2024-09-22T08:33:41.756 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:33:41.756 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:33:41.756 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:41.756 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:41.756 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:33:41.756 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:41.756 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:33:41.756 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:33:41.756 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:33:41.756 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.756 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-22T08:33:41.428+0000 7ff363e07640 10 monclient: _finish_auth 0 2024-09-22T08:33:41.756 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-22T08:33:41.428+0000 7ff363e07640 10 monclient: _check_auth_tickets 2024-09-22T08:33:41.757 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-22T08:33:41.428+0000 7ff363e07640 10 monclient: handle_config config(0 keys) 2024-09-22T08:33:41.757 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-22T08:33:41.428+0000 7ff363e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:33:41.757 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-22T08:33:41.428+0000 7ff363e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:33:41.757 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-22T08:33:41.428+0000 7ff363e07640 10 monclient: dump: 2024-09-22T08:33:41.757 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:33:41.757 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:33:41.757 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:41.757 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:41.757 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:33:41.757 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:41.757 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:33:41.757 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:33:41.757 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:33:41.757 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.757 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-22T08:33:41.428+0000 7ff47a614800 5 monclient: authenticate success, global_id 6522 2024-09-22T08:33:41.758 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-22T08:33:41.428+0000 7ff47a614800 10 monclient: get_monmap_and_config success 2024-09-22T08:33:41.758 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-22T08:33:41.428+0000 7ff47a614800 4 set_mon_vals no callback set 2024-09-22T08:33:41.758 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-22T08:33:41.428+0000 7ff47a614800 10 monclient: shutdown 2024-09-22T08:33:41.758 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-22T08:33:41.428+0000 7ff47a614800 5 asok(0x55aa352a70f0) unregister_commands rotate-key 2024-09-22T08:33:41.758 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-22T08:33:41.429+0000 7ff47a614800 10 monclient: build_initial_monmap 2024-09-22T08:33:41.758 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-22T08:33:41.429+0000 7ff47a614800 1 build_initial for_mkfs: 0 2024-09-22T08:33:41.758 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-22T08:33:41.429+0000 7ff47a614800 10 monclient: monmap: 2024-09-22T08:33:41.758 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:33:41.758 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:33:41.758 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:33:41.758 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:33:41.758 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:33:41.758 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:41.758 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:33:41.758 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:33:41.759 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:33:41.759 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.759 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354ce680) adding auth protocol: cephx 2024-09-22T08:33:41.759 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354ce680) adding auth protocol: cephx 2024-09-22T08:33:41.759 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354ce680) adding auth protocol: cephx 2024-09-22T08:33:41.759 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354ce680) adding con mode: secure 2024-09-22T08:33:41.759 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354ce680) adding con mode: crc 2024-09-22T08:33:41.759 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354ce680) adding con mode: secure 2024-09-22T08:33:41.759 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354ce680) adding con mode: crc 2024-09-22T08:33:41.759 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354ce680) adding con mode: secure 2024-09-22T08:33:41.759 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354ce680) adding con mode: crc 2024-09-22T08:33:41.759 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354ce680) adding con mode: crc 2024-09-22T08:33:41.759 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354ce680) adding con mode: secure 2024-09-22T08:33:41.759 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354ce680) adding con mode: crc 2024-09-22T08:33:41.760 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354ce680) adding con mode: secure 2024-09-22T08:33:41.760 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354ce680) adding con mode: crc 2024-09-22T08:33:41.760 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354ce680) adding con mode: secure 2024-09-22T08:33:41.760 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-22T08:33:41.429+0000 7ff47a614800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:41.760 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-22T08:33:41.429+0000 7ff47a614800 1 librados: starting msgr at 2024-09-22T08:33:41.760 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-22T08:33:41.429+0000 7ff47a614800 1 librados: starting objecter 2024-09-22T08:33:41.760 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 asok(0x55aa352a70f0) register_command objecter_requests hook 0x55aa354ce0e0 2024-09-22T08:33:41.760 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-22T08:33:41.429+0000 7ff47a614800 1 librados: setting wanted keys 2024-09-22T08:33:41.760 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-22T08:33:41.429+0000 7ff47a614800 1 librados: calling monclient init 2024-09-22T08:33:41.760 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-22T08:33:41.429+0000 7ff47a614800 10 monclient: init 2024-09-22T08:33:41.760 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354c9010) adding auth protocol: cephx 2024-09-22T08:33:41.760 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354c9010) adding auth protocol: cephx 2024-09-22T08:33:41.760 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354c9010) adding auth protocol: cephx 2024-09-22T08:33:41.760 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354c9010) adding con mode: secure 2024-09-22T08:33:41.761 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354c9010) adding con mode: crc 2024-09-22T08:33:41.761 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354c9010) adding con mode: secure 2024-09-22T08:33:41.761 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354c9010) adding con mode: crc 2024-09-22T08:33:41.761 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354c9010) adding con mode: secure 2024-09-22T08:33:41.761 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354c9010) adding con mode: crc 2024-09-22T08:33:41.761 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354c9010) adding con mode: crc 2024-09-22T08:33:41.761 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354c9010) adding con mode: secure 2024-09-22T08:33:41.761 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354c9010) adding con mode: crc 2024-09-22T08:33:41.761 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354c9010) adding con mode: secure 2024-09-22T08:33:41.761 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354c9010) adding con mode: crc 2024-09-22T08:33:41.761 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-22T08:33:41.429+0000 7ff47a614800 5 AuthRegistry(0x55aa354c9010) adding con mode: secure 2024-09-22T08:33:41.761 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-22T08:33:41.429+0000 7ff47a614800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:41.761 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-22T08:33:41.429+0000 7ff47a614800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:41.761 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-22T08:33:41.430+0000 7ff47a614800 5 asok(0x55aa352a70f0) register_command rotate-key hook 0x55aa354c9158 2024-09-22T08:33:41.761 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-22T08:33:41.430+0000 7ff47a614800 10 monclient: _reopen_session rank -1 2024-09-22T08:33:41.761 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-22T08:33:41.430+0000 7ff47a614800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T08:33:41.762 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-22T08:33:41.430+0000 7ff47a614800 10 monclient(hunting): picked mon.noname-a con 0x55aa35374bd0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:33:41.762 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-22T08:33:41.430+0000 7ff47a614800 10 monclient(hunting): picked mon.noname-c con 0x55aa3537e640 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:33:41.762 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-22T08:33:41.430+0000 7ff47a614800 10 monclient(hunting): picked mon.noname-b con 0x55aa35410b80 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:33:41.762 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-22T08:33:41.430+0000 7ff47a614800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:41.762 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-22T08:33:41.430+0000 7ff47a614800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:41.762 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-22T08:33:41.430+0000 7ff47a614800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:41.762 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-22T08:33:41.430+0000 7ff47a614800 10 monclient(hunting): _renew_subs 2024-09-22T08:33:41.762 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-22T08:33:41.430+0000 7ff47a614800 10 monclient(hunting): authenticate will time out at 1926.669085s 2024-09-22T08:33:41.762 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-22T08:33:41.430+0000 7ff475de0640 10 monclient(hunting): get_auth_request con 0x55aa35374bd0 auth_method 0 2024-09-22T08:33:41.762 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-22T08:33:41.430+0000 7ff475de0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:41.762 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-22T08:33:41.430+0000 7ff475de0640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:41.762 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-22T08:33:41.430+0000 7ff475de0640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:41.762 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-22T08:33:41.430+0000 7ff4755df640 10 monclient(hunting): get_auth_request con 0x55aa3537e640 auth_method 0 2024-09-22T08:33:41.763 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-22T08:33:41.430+0000 7ff4755df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:41.763 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-22T08:33:41.430+0000 7ff4755df640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:41.763 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-22T08:33:41.430+0000 7ff4755df640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:41.763 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-22T08:33:41.430+0000 7ff475de0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:41.763 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-22T08:33:41.430+0000 7ff475de0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:41.763 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-22T08:33:41.430+0000 7ff475de0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:41.763 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-22T08:33:41.430+0000 7ff4755df640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:41.763 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-22T08:33:41.430+0000 7ff4755df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:41.763 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-22T08:33:41.430+0000 7ff4755df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:41.763 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-22T08:33:41.430+0000 7ff4765e1640 10 monclient(hunting): get_auth_request con 0x55aa35410b80 auth_method 0 2024-09-22T08:33:41.763 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-22T08:33:41.430+0000 7ff4765e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:41.763 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-22T08:33:41.430+0000 7ff4765e1640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:41.763 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-22T08:33:41.430+0000 7ff4765e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:41.763 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-22T08:33:41.430+0000 7ff4765e1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:41.763 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-22T08:33:41.430+0000 7ff4765e1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:41.764 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-22T08:33:41.430+0000 7ff4765e1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:41.764 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-22T08:33:41.430+0000 7ff4755df640 10 monclient(hunting): handle_auth_done global_id 6182 payload 824 2024-09-22T08:33:41.764 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-22T08:33:41.430+0000 7ff4755df640 10 monclient: _finish_hunting 0 2024-09-22T08:33:41.764 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-22T08:33:41.430+0000 7ff4755df640 1 monclient: found mon.noname-c 2024-09-22T08:33:41.765 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-22T08:33:41.430+0000 7ff4755df640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:33:41.766 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-22T08:33:41.430+0000 7ff362604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:33:41.766 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-22T08:33:41.430+0000 7ff362604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:33:41.766 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-22T08:33:41.430+0000 7ff362604640 10 monclient: dump: 2024-09-22T08:33:41.766 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:33:41.766 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:33:41.766 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:41.767 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:41.767 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:33:41.767 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:41.767 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:33:41.767 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:33:41.767 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:33:41.767 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.767 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-22T08:33:41.430+0000 7ff362604640 10 monclient: _finish_auth 0 2024-09-22T08:33:41.767 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-22T08:33:41.430+0000 7ff362604640 10 monclient: _check_auth_tickets 2024-09-22T08:33:41.768 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-22T08:33:41.430+0000 7ff362604640 10 monclient: handle_config config(0 keys) 2024-09-22T08:33:41.768 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-22T08:33:41.430+0000 7ff362604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:33:41.768 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-22T08:33:41.430+0000 7ff362604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:33:41.768 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-22T08:33:41.430+0000 7ff362604640 10 monclient: dump: 2024-09-22T08:33:41.768 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:33:41.768 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:33:41.768 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:41.768 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:41.768 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:33:41.769 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:41.769 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:33:41.769 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:33:41.769 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:33:41.769 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.769 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-22T08:33:41.430+0000 7ff47a614800 5 monclient: authenticate success, global_id 6182 2024-09-22T08:33:41.769 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-22T08:33:41.430+0000 7ff47a614800 10 monclient: _renew_subs 2024-09-22T08:33:41.769 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-22T08:33:41.430+0000 7ff47a614800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:33:41.769 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-22T08:33:41.430+0000 7ff363e07640 4 set_mon_vals no callback set 2024-09-22T08:33:41.769 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-22T08:33:41.430+0000 7ff47a614800 10 monclient: _renew_subs 2024-09-22T08:33:41.769 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-22T08:33:41.430+0000 7ff47a614800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:33:41.769 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-22T08:33:41.430+0000 7ff47a614800 1 librados: init done 2024-09-22T08:33:41.770 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-22T08:33:41.432+0000 7ff362604640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:33:41.770 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-22T08:33:41.432+0000 7ff362604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:33:41.770 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-22T08:33:41.432+0000 7ff362604640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:33:41.770 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-22T08:33:41.433+0000 7ff475de0640 10 monclient: get_auth_request con 0x7ff35c077570 auth_method 0 2024-09-22T08:33:41.770 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-22T08:33:41.433+0000 7ff4765e1640 10 monclient: get_auth_request con 0x55aa3550b3d0 auth_method 0 2024-09-22T08:33:41.770 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-22T08:33:41.433+0000 7ff475de0640 10 monclient: get_auth_request con 0x55aa35514a60 auth_method 0 2024-09-22T08:33:41.770 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-22T08:33:41.434+0000 7ff4755df640 10 monclient: get_auth_request con 0x55aa35518c50 auth_method 0 2024-09-22T08:33:41.771 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-22T08:33:41.435+0000 7ff4765e1640 10 monclient: get_auth_request con 0x55aa35518340 auth_method 0 2024-09-22T08:33:41.771 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-22T08:33:41.436+0000 7ff47a614800 10 monclient: build_initial_monmap 2024-09-22T08:33:41.771 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-22T08:33:41.436+0000 7ff47a614800 1 build_initial for_mkfs: 0 2024-09-22T08:33:41.771 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-22T08:33:41.436+0000 7ff47a614800 10 monclient: monmap: 2024-09-22T08:33:41.771 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:33:41.771 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:33:41.771 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:33:41.772 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:33:41.772 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:33:41.772 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:41.772 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:33:41.772 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:33:41.772 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:33:41.772 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.772 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa35520ed0) adding auth protocol: cephx 2024-09-22T08:33:41.773 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa35520ed0) adding auth protocol: cephx 2024-09-22T08:33:41.773 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa35520ed0) adding auth protocol: cephx 2024-09-22T08:33:41.773 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa35520ed0) adding con mode: secure 2024-09-22T08:33:41.773 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa35520ed0) adding con mode: crc 2024-09-22T08:33:41.773 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa35520ed0) adding con mode: secure 2024-09-22T08:33:41.773 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa35520ed0) adding con mode: crc 2024-09-22T08:33:41.773 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa35520ed0) adding con mode: secure 2024-09-22T08:33:41.773 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa35520ed0) adding con mode: crc 2024-09-22T08:33:41.773 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa35520ed0) adding con mode: crc 2024-09-22T08:33:41.774 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa35520ed0) adding con mode: secure 2024-09-22T08:33:41.774 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa35520ed0) adding con mode: crc 2024-09-22T08:33:41.774 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa35520ed0) adding con mode: secure 2024-09-22T08:33:41.774 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa35520ed0) adding con mode: crc 2024-09-22T08:33:41.774 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa35520ed0) adding con mode: secure 2024-09-22T08:33:41.774 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-22T08:33:41.436+0000 7ff47a614800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:41.774 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 asok(0x55aa352a70f0) register_command objecter_requests cmddesc objecter_requests hook 0x55aa35524360 EEXIST 2024-09-22T08:33:41.775 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-22T08:33:41.436+0000 7ff47a614800 10 monclient: init 2024-09-22T08:33:41.775 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa3551fcd8) adding auth protocol: cephx 2024-09-22T08:33:41.775 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa3551fcd8) adding auth protocol: cephx 2024-09-22T08:33:41.775 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa3551fcd8) adding auth protocol: cephx 2024-09-22T08:33:41.775 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa3551fcd8) adding con mode: secure 2024-09-22T08:33:41.775 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa3551fcd8) adding con mode: crc 2024-09-22T08:33:41.776 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa3551fcd8) adding con mode: secure 2024-09-22T08:33:41.776 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa3551fcd8) adding con mode: crc 2024-09-22T08:33:41.776 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa3551fcd8) adding con mode: secure 2024-09-22T08:33:41.776 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa3551fcd8) adding con mode: crc 2024-09-22T08:33:41.776 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa3551fcd8) adding con mode: crc 2024-09-22T08:33:41.776 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa3551fcd8) adding con mode: secure 2024-09-22T08:33:41.776 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa3551fcd8) adding con mode: crc 2024-09-22T08:33:41.776 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa3551fcd8) adding con mode: secure 2024-09-22T08:33:41.776 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa3551fcd8) adding con mode: crc 2024-09-22T08:33:41.776 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-22T08:33:41.436+0000 7ff47a614800 5 AuthRegistry(0x55aa3551fcd8) adding con mode: secure 2024-09-22T08:33:41.776 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-22T08:33:41.437+0000 7ff47a614800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:41.776 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-22T08:33:41.437+0000 7ff47a614800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:41.777 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-22T08:33:41.437+0000 7ff47a614800 5 asok(0x55aa352a70f0) register_command rotate-key cmddesc rotate-key hook 0x55aa3551fe20 EEXIST 2024-09-22T08:33:41.777 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-22T08:33:41.437+0000 7ff47a614800 10 monclient: _reopen_session rank -1 2024-09-22T08:33:41.777 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-22T08:33:41.437+0000 7ff47a614800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T08:33:41.777 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-22T08:33:41.437+0000 7ff47a614800 10 monclient(hunting): picked mon.noname-b con 0x55aa35548680 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:33:41.777 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-22T08:33:41.437+0000 7ff47a614800 10 monclient(hunting): picked mon.noname-a con 0x55aa35548a60 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:33:41.777 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-22T08:33:41.437+0000 7ff47a614800 10 monclient(hunting): picked mon.noname-c con 0x55aa35547390 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:33:41.777 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-22T08:33:41.437+0000 7ff47a614800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:41.777 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-22T08:33:41.437+0000 7ff47a614800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:41.777 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-22T08:33:41.437+0000 7ff47a614800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:41.777 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-22T08:33:41.437+0000 7ff47a614800 10 monclient(hunting): _renew_subs 2024-09-22T08:33:41.777 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-22T08:33:41.437+0000 7ff47a614800 10 monclient(hunting): authenticate will time out at 1926.676517s 2024-09-22T08:33:41.778 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-22T08:33:41.437+0000 7ff4765e1640 10 monclient(hunting): get_auth_request con 0x55aa35548a60 auth_method 0 2024-09-22T08:33:41.778 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-22T08:33:41.437+0000 7ff4765e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:41.778 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-22T08:33:41.437+0000 7ff4765e1640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:41.778 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-22T08:33:41.437+0000 7ff4765e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:41.778 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-22T08:33:41.437+0000 7ff475de0640 10 monclient(hunting): get_auth_request con 0x55aa35547390 auth_method 0 2024-09-22T08:33:41.778 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-22T08:33:41.437+0000 7ff475de0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:41.778 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-22T08:33:41.437+0000 7ff475de0640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:41.778 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-22T08:33:41.437+0000 7ff475de0640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:41.778 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-22T08:33:41.437+0000 7ff4755df640 10 monclient(hunting): get_auth_request con 0x55aa35548680 auth_method 0 2024-09-22T08:33:41.778 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-22T08:33:41.437+0000 7ff4755df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:41.779 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-22T08:33:41.437+0000 7ff4755df640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:41.779 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-22T08:33:41.437+0000 7ff4755df640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:41.779 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-22T08:33:41.437+0000 7ff4765e1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:41.779 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-22T08:33:41.437+0000 7ff4765e1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:41.779 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-22T08:33:41.437+0000 7ff4765e1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:41.779 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-22T08:33:41.437+0000 7ff475de0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:41.779 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-22T08:33:41.437+0000 7ff475de0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:41.779 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-22T08:33:41.437+0000 7ff475de0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:41.779 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-22T08:33:41.437+0000 7ff4755df640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:41.779 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-22T08:33:41.437+0000 7ff4755df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:41.779 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-22T08:33:41.437+0000 7ff4755df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:41.779 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-22T08:33:41.437+0000 7ff4765e1640 10 monclient(hunting): handle_auth_done global_id 6528 payload 824 2024-09-22T08:33:41.780 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-22T08:33:41.437+0000 7ff4765e1640 10 monclient: _finish_hunting 0 2024-09-22T08:33:41.780 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-22T08:33:41.437+0000 7ff4765e1640 1 monclient: found mon.noname-a 2024-09-22T08:33:41.780 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-22T08:33:41.437+0000 7ff4765e1640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:33:41.780 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-22T08:33:41.438+0000 7ff35b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:33:41.780 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-22T08:33:41.438+0000 7ff35b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:33:41.780 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-22T08:33:41.438+0000 7ff35b7fe640 10 monclient: dump: 2024-09-22T08:33:41.780 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:33:41.780 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:33:41.780 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:41.780 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:41.780 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:33:41.781 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:41.781 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:33:41.781 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:33:41.781 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:33:41.781 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.781 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-22T08:33:41.438+0000 7ff35b7fe640 10 monclient: _finish_auth 0 2024-09-22T08:33:41.781 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-22T08:33:41.438+0000 7ff35b7fe640 10 monclient: _check_auth_tickets 2024-09-22T08:33:41.781 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-22T08:33:41.438+0000 7ff35b7fe640 10 monclient: handle_config config(0 keys) 2024-09-22T08:33:41.781 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-22T08:33:41.438+0000 7ff35b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:33:41.781 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-22T08:33:41.438+0000 7ff35b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:33:41.782 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-22T08:33:41.438+0000 7ff35b7fe640 10 monclient: dump: 2024-09-22T08:33:41.782 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:33:41.782 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:33:41.782 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:41.782 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:41.782 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:33:41.782 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:41.782 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:33:41.782 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:33:41.782 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:33:41.782 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.782 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-22T08:33:41.438+0000 7ff47a614800 5 monclient: authenticate success, global_id 6528 2024-09-22T08:33:41.782 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-22T08:33:41.438+0000 7ff47a614800 10 monclient: _renew_subs 2024-09-22T08:33:41.783 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-22T08:33:41.438+0000 7ff476de2640 4 set_mon_vals no callback set 2024-09-22T08:33:41.783 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-22T08:33:41.438+0000 7ff47a614800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:33:41.783 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-22T08:33:41.438+0000 7ff47a614800 10 monclient: _renew_subs 2024-09-22T08:33:41.783 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-22T08:33:41.438+0000 7ff47a614800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:33:41.783 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-22T08:33:41.440+0000 7ff35b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:33:41.783 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-22T08:33:41.440+0000 7ff35b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:33:41.783 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-22T08:33:41.440+0000 7ff35b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:33:41.783 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-22T08:33:41.440+0000 7ff4755df640 10 monclient: get_auth_request con 0x7ff350077480 auth_method 0 2024-09-22T08:33:41.783 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-22T08:33:41.440+0000 7ff47a614800 10 monclient: get_monmap_and_config 2024-09-22T08:33:41.783 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-22T08:33:41.440+0000 7ff47a614800 10 monclient: build_initial_monmap 2024-09-22T08:33:41.783 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-22T08:33:41.440+0000 7ff47a614800 1 build_initial for_mkfs: 0 2024-09-22T08:33:41.783 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-22T08:33:41.440+0000 7ff47a614800 10 monclient: monmap: 2024-09-22T08:33:41.784 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:33:41.784 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:33:41.784 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:33:41.784 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:33:41.784 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:33:41.784 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:41.784 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:33:41.784 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:33:41.784 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:33:41.784 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.784 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-22T08:33:41.440+0000 7ff47a614800 5 AuthRegistry(0x55aa355685d0) adding auth protocol: cephx 2024-09-22T08:33:41.784 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-22T08:33:41.440+0000 7ff47a614800 5 AuthRegistry(0x55aa355685d0) adding auth protocol: cephx 2024-09-22T08:33:41.784 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-22T08:33:41.440+0000 7ff47a614800 5 AuthRegistry(0x55aa355685d0) adding auth protocol: cephx 2024-09-22T08:33:41.785 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-22T08:33:41.440+0000 7ff47a614800 5 AuthRegistry(0x55aa355685d0) adding con mode: secure 2024-09-22T08:33:41.785 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-22T08:33:41.440+0000 7ff47a614800 5 AuthRegistry(0x55aa355685d0) adding con mode: crc 2024-09-22T08:33:41.785 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-22T08:33:41.440+0000 7ff47a614800 5 AuthRegistry(0x55aa355685d0) adding con mode: secure 2024-09-22T08:33:41.785 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-22T08:33:41.440+0000 7ff47a614800 5 AuthRegistry(0x55aa355685d0) adding con mode: crc 2024-09-22T08:33:41.785 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-22T08:33:41.440+0000 7ff47a614800 5 AuthRegistry(0x55aa355685d0) adding con mode: secure 2024-09-22T08:33:41.785 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-22T08:33:41.440+0000 7ff47a614800 5 AuthRegistry(0x55aa355685d0) adding con mode: crc 2024-09-22T08:33:41.785 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-22T08:33:41.440+0000 7ff47a614800 5 AuthRegistry(0x55aa355685d0) adding con mode: crc 2024-09-22T08:33:41.785 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-22T08:33:41.440+0000 7ff47a614800 5 AuthRegistry(0x55aa355685d0) adding con mode: secure 2024-09-22T08:33:41.785 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-22T08:33:41.440+0000 7ff47a614800 5 AuthRegistry(0x55aa355685d0) adding con mode: crc 2024-09-22T08:33:41.785 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-22T08:33:41.440+0000 7ff47a614800 5 AuthRegistry(0x55aa355685d0) adding con mode: secure 2024-09-22T08:33:41.785 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-22T08:33:41.440+0000 7ff47a614800 5 AuthRegistry(0x55aa355685d0) adding con mode: crc 2024-09-22T08:33:41.785 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-22T08:33:41.440+0000 7ff47a614800 5 AuthRegistry(0x55aa355685d0) adding con mode: secure 2024-09-22T08:33:41.786 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-22T08:33:41.440+0000 7ff47a614800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:41.786 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-22T08:33:41.441+0000 7ff47a614800 10 monclient: init 2024-09-22T08:33:41.786 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-22T08:33:41.441+0000 7ff47a614800 5 AuthRegistry(0x7ffed7095c10) adding auth protocol: cephx 2024-09-22T08:33:41.786 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-22T08:33:41.441+0000 7ff47a614800 5 AuthRegistry(0x7ffed7095c10) adding auth protocol: cephx 2024-09-22T08:33:41.786 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-22T08:33:41.441+0000 7ff47a614800 5 AuthRegistry(0x7ffed7095c10) adding auth protocol: cephx 2024-09-22T08:33:41.786 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-22T08:33:41.441+0000 7ff47a614800 5 AuthRegistry(0x7ffed7095c10) adding con mode: secure 2024-09-22T08:33:41.786 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-22T08:33:41.441+0000 7ff47a614800 5 AuthRegistry(0x7ffed7095c10) adding con mode: crc 2024-09-22T08:33:41.786 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-22T08:33:41.441+0000 7ff47a614800 5 AuthRegistry(0x7ffed7095c10) adding con mode: secure 2024-09-22T08:33:41.786 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-22T08:33:41.441+0000 7ff47a614800 5 AuthRegistry(0x7ffed7095c10) adding con mode: crc 2024-09-22T08:33:41.786 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-22T08:33:41.441+0000 7ff47a614800 5 AuthRegistry(0x7ffed7095c10) adding con mode: secure 2024-09-22T08:33:41.786 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-22T08:33:41.441+0000 7ff47a614800 5 AuthRegistry(0x7ffed7095c10) adding con mode: crc 2024-09-22T08:33:41.786 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-22T08:33:41.441+0000 7ff47a614800 5 AuthRegistry(0x7ffed7095c10) adding con mode: crc 2024-09-22T08:33:41.787 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-22T08:33:41.441+0000 7ff47a614800 5 AuthRegistry(0x7ffed7095c10) adding con mode: secure 2024-09-22T08:33:41.787 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-22T08:33:41.441+0000 7ff47a614800 5 AuthRegistry(0x7ffed7095c10) adding con mode: crc 2024-09-22T08:33:41.787 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-22T08:33:41.441+0000 7ff47a614800 5 AuthRegistry(0x7ffed7095c10) adding con mode: secure 2024-09-22T08:33:41.787 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-22T08:33:41.441+0000 7ff47a614800 5 AuthRegistry(0x7ffed7095c10) adding con mode: crc 2024-09-22T08:33:41.787 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-22T08:33:41.441+0000 7ff47a614800 5 AuthRegistry(0x7ffed7095c10) adding con mode: secure 2024-09-22T08:33:41.787 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-22T08:33:41.441+0000 7ff47a614800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:41.787 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-22T08:33:41.441+0000 7ff47a614800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:41.787 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-22T08:33:41.441+0000 7ff47a614800 5 asok(0x55aa352a70f0) register_command rotate-key cmddesc rotate-key hook 0x7ffed7095d58 EEXIST 2024-09-22T08:33:41.787 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-22T08:33:41.441+0000 7ff47a614800 10 monclient: _reopen_session rank -1 2024-09-22T08:33:41.787 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-22T08:33:41.441+0000 7ff47a614800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T08:33:41.787 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-22T08:33:41.441+0000 7ff47a614800 10 monclient(hunting): picked mon.noname-a con 0x55aa3559cbd0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:33:41.787 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-22T08:33:41.441+0000 7ff47a614800 10 monclient(hunting): picked mon.noname-c con 0x55aa3558d520 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:33:41.787 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-22T08:33:41.441+0000 7ff47a614800 10 monclient(hunting): picked mon.noname-b con 0x55aa35598000 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:33:41.787 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-22T08:33:41.441+0000 7ff47a614800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:41.787 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-22T08:33:41.441+0000 7ff47a614800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:41.788 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-22T08:33:41.441+0000 7ff47a614800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:41.788 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-22T08:33:41.441+0000 7ff47a614800 10 monclient(hunting): _renew_subs 2024-09-22T08:33:41.788 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-22T08:33:41.441+0000 7ff47a614800 10 monclient(hunting): authenticate will time out at 1926.680604s 2024-09-22T08:33:41.788 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-22T08:33:41.441+0000 7ff4765e1640 10 monclient(hunting): get_auth_request con 0x55aa3558d520 auth_method 0 2024-09-22T08:33:41.788 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-22T08:33:41.441+0000 7ff4765e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:41.788 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-22T08:33:41.441+0000 7ff4765e1640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:41.788 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-22T08:33:41.441+0000 7ff4765e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:41.788 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-22T08:33:41.441+0000 7ff4755df640 10 monclient(hunting): get_auth_request con 0x55aa3559cbd0 auth_method 0 2024-09-22T08:33:41.788 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-22T08:33:41.441+0000 7ff4755df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:41.788 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-22T08:33:41.441+0000 7ff4755df640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:41.788 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-22T08:33:41.441+0000 7ff4755df640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:41.788 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-22T08:33:41.441+0000 7ff4765e1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:41.788 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-22T08:33:41.441+0000 7ff4765e1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:41.788 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-22T08:33:41.441+0000 7ff4765e1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:41.788 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-22T08:33:41.441+0000 7ff475de0640 10 monclient(hunting): get_auth_request con 0x55aa35598000 auth_method 0 2024-09-22T08:33:41.789 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-22T08:33:41.441+0000 7ff475de0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:41.789 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-22T08:33:41.441+0000 7ff475de0640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:41.789 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-22T08:33:41.441+0000 7ff475de0640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:41.789 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-22T08:33:41.441+0000 7ff4755df640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:41.789 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-22T08:33:41.441+0000 7ff4755df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:41.789 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-22T08:33:41.441+0000 7ff4755df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:41.789 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-22T08:33:41.441+0000 7ff4765e1640 10 monclient(hunting): handle_auth_done global_id 6188 payload 274 2024-09-22T08:33:41.789 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-22T08:33:41.441+0000 7ff4765e1640 10 monclient: _finish_hunting 0 2024-09-22T08:33:41.789 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-22T08:33:41.441+0000 7ff4765e1640 1 monclient: found mon.noname-c 2024-09-22T08:33:41.789 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-22T08:33:41.441+0000 7ff4765e1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:33:41.789 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-22T08:33:41.442+0000 7ff3597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:33:41.789 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-22T08:33:41.442+0000 7ff3597fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:33:41.789 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-22T08:33:41.442+0000 7ff3597fa640 10 monclient: dump: 2024-09-22T08:33:41.789 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:33:41.789 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:33:41.790 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:41.790 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:41.790 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:33:41.790 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:41.790 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:33:41.790 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:33:41.790 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:33:41.790 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.790 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-22T08:33:41.442+0000 7ff3597fa640 10 monclient: _finish_auth 0 2024-09-22T08:33:41.790 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-22T08:33:41.442+0000 7ff3597fa640 10 monclient: _check_auth_tickets 2024-09-22T08:33:41.790 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-22T08:33:41.442+0000 7ff3597fa640 10 monclient: handle_config config(0 keys) 2024-09-22T08:33:41.790 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-22T08:33:41.442+0000 7ff47a614800 5 monclient: authenticate success, global_id 6188 2024-09-22T08:33:41.790 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-22T08:33:41.442+0000 7ff47a614800 10 monclient: get_monmap_and_config success 2024-09-22T08:33:41.790 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-22T08:33:41.442+0000 7ff47a614800 4 set_mon_vals no callback set 2024-09-22T08:33:41.791 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-22T08:33:41.442+0000 7ff3597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:33:41.791 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-22T08:33:41.442+0000 7ff3597fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:33:41.791 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-22T08:33:41.442+0000 7ff3597fa640 10 monclient: dump: 2024-09-22T08:33:41.791 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:33:41.791 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:33:41.791 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:41.791 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:41.791 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:33:41.791 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:41.791 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:33:41.791 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:33:41.791 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:33:41.792 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.792 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-22T08:33:41.442+0000 7ff47a614800 10 monclient: shutdown 2024-09-22T08:33:41.792 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-22T08:33:41.442+0000 7ff47a614800 10 monclient: build_initial_monmap 2024-09-22T08:33:41.792 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-22T08:33:41.442+0000 7ff47a614800 1 build_initial for_mkfs: 0 2024-09-22T08:33:41.792 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-22T08:33:41.442+0000 7ff47a614800 10 monclient: monmap: 2024-09-22T08:33:41.792 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:33:41.792 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:33:41.792 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:33:41.792 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:33:41.792 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:33:41.792 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:41.793 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:33:41.793 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:33:41.793 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:33:41.793 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.793 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-22T08:33:41.442+0000 7ff47a614800 5 AuthRegistry(0x55aa3556d360) adding auth protocol: cephx 2024-09-22T08:33:41.793 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-22T08:33:41.442+0000 7ff47a614800 5 AuthRegistry(0x55aa3556d360) adding auth protocol: cephx 2024-09-22T08:33:41.793 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-22T08:33:41.442+0000 7ff47a614800 5 AuthRegistry(0x55aa3556d360) adding auth protocol: cephx 2024-09-22T08:33:41.793 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-22T08:33:41.442+0000 7ff47a614800 5 AuthRegistry(0x55aa3556d360) adding con mode: secure 2024-09-22T08:33:41.793 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-22T08:33:41.442+0000 7ff47a614800 5 AuthRegistry(0x55aa3556d360) adding con mode: crc 2024-09-22T08:33:41.793 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-22T08:33:41.442+0000 7ff47a614800 5 AuthRegistry(0x55aa3556d360) adding con mode: secure 2024-09-22T08:33:41.793 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-22T08:33:41.442+0000 7ff47a614800 5 AuthRegistry(0x55aa3556d360) adding con mode: crc 2024-09-22T08:33:41.793 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-22T08:33:41.442+0000 7ff47a614800 5 AuthRegistry(0x55aa3556d360) adding con mode: secure 2024-09-22T08:33:41.794 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-22T08:33:41.442+0000 7ff47a614800 5 AuthRegistry(0x55aa3556d360) adding con mode: crc 2024-09-22T08:33:41.794 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-22T08:33:41.442+0000 7ff47a614800 5 AuthRegistry(0x55aa3556d360) adding con mode: crc 2024-09-22T08:33:41.794 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-22T08:33:41.442+0000 7ff47a614800 5 AuthRegistry(0x55aa3556d360) adding con mode: secure 2024-09-22T08:33:41.794 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-22T08:33:41.442+0000 7ff47a614800 5 AuthRegistry(0x55aa3556d360) adding con mode: crc 2024-09-22T08:33:41.794 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-22T08:33:41.442+0000 7ff47a614800 5 AuthRegistry(0x55aa3556d360) adding con mode: secure 2024-09-22T08:33:41.794 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-22T08:33:41.442+0000 7ff47a614800 5 AuthRegistry(0x55aa3556d360) adding con mode: crc 2024-09-22T08:33:41.794 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-22T08:33:41.442+0000 7ff47a614800 5 AuthRegistry(0x55aa3556d360) adding con mode: secure 2024-09-22T08:33:41.794 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-22T08:33:41.443+0000 7ff47a614800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:41.794 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-22T08:33:41.443+0000 7ff47a614800 1 librados: starting msgr at 2024-09-22T08:33:41.795 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-22T08:33:41.443+0000 7ff47a614800 1 librados: starting objecter 2024-09-22T08:33:41.795 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-22T08:33:41.443+0000 7ff47a614800 5 asok(0x55aa352a70f0) register_command objecter_requests cmddesc objecter_requests hook 0x55aa35597e00 EEXIST 2024-09-22T08:33:41.795 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-22T08:33:41.443+0000 7ff47a614800 1 librados: setting wanted keys 2024-09-22T08:33:41.795 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-22T08:33:41.443+0000 7ff47a614800 1 librados: calling monclient init 2024-09-22T08:33:41.795 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-22T08:33:41.443+0000 7ff47a614800 10 monclient: init 2024-09-22T08:33:41.795 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-22T08:33:41.443+0000 7ff47a614800 5 AuthRegistry(0x55aa3555cf40) adding auth protocol: cephx 2024-09-22T08:33:41.795 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-22T08:33:41.443+0000 7ff47a614800 5 AuthRegistry(0x55aa3555cf40) adding auth protocol: cephx 2024-09-22T08:33:41.795 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-22T08:33:41.443+0000 7ff47a614800 5 AuthRegistry(0x55aa3555cf40) adding auth protocol: cephx 2024-09-22T08:33:41.795 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-22T08:33:41.443+0000 7ff47a614800 5 AuthRegistry(0x55aa3555cf40) adding con mode: secure 2024-09-22T08:33:41.795 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-22T08:33:41.443+0000 7ff47a614800 5 AuthRegistry(0x55aa3555cf40) adding con mode: crc 2024-09-22T08:33:41.795 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-22T08:33:41.443+0000 7ff47a614800 5 AuthRegistry(0x55aa3555cf40) adding con mode: secure 2024-09-22T08:33:41.796 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-22T08:33:41.443+0000 7ff47a614800 5 AuthRegistry(0x55aa3555cf40) adding con mode: crc 2024-09-22T08:33:41.796 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-22T08:33:41.443+0000 7ff47a614800 5 AuthRegistry(0x55aa3555cf40) adding con mode: secure 2024-09-22T08:33:41.796 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-22T08:33:41.443+0000 7ff47a614800 5 AuthRegistry(0x55aa3555cf40) adding con mode: crc 2024-09-22T08:33:41.796 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-22T08:33:41.443+0000 7ff47a614800 5 AuthRegistry(0x55aa3555cf40) adding con mode: crc 2024-09-22T08:33:41.796 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-22T08:33:41.443+0000 7ff47a614800 5 AuthRegistry(0x55aa3555cf40) adding con mode: secure 2024-09-22T08:33:41.796 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-22T08:33:41.443+0000 7ff47a614800 5 AuthRegistry(0x55aa3555cf40) adding con mode: crc 2024-09-22T08:33:41.796 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-22T08:33:41.443+0000 7ff47a614800 5 AuthRegistry(0x55aa3555cf40) adding con mode: secure 2024-09-22T08:33:41.797 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-22T08:33:41.443+0000 7ff47a614800 5 AuthRegistry(0x55aa3555cf40) adding con mode: crc 2024-09-22T08:33:41.797 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-22T08:33:41.443+0000 7ff47a614800 5 AuthRegistry(0x55aa3555cf40) adding con mode: secure 2024-09-22T08:33:41.797 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-22T08:33:41.443+0000 7ff47a614800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:41.797 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-22T08:33:41.443+0000 7ff47a614800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:41.797 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-22T08:33:41.443+0000 7ff47a614800 5 asok(0x55aa352a70f0) register_command rotate-key cmddesc rotate-key hook 0x55aa3555d088 EEXIST 2024-09-22T08:33:41.797 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-22T08:33:41.443+0000 7ff47a614800 10 monclient: _reopen_session rank -1 2024-09-22T08:33:41.798 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-22T08:33:41.443+0000 7ff47a614800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-22T08:33:41.798 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-22T08:33:41.443+0000 7ff47a614800 10 monclient(hunting): picked mon.noname-b con 0x55aa3558d520 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:33:41.798 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-22T08:33:41.443+0000 7ff47a614800 10 monclient(hunting): picked mon.noname-c con 0x55aa35598000 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:33:41.798 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-22T08:33:41.443+0000 7ff47a614800 10 monclient(hunting): picked mon.noname-a con 0x55aa3559cbd0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:33:41.798 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-22T08:33:41.443+0000 7ff47a614800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:41.798 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-22T08:33:41.443+0000 7ff47a614800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:41.799 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-22T08:33:41.443+0000 7ff47a614800 10 monclient(hunting): start opening mon connection 2024-09-22T08:33:41.799 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-22T08:33:41.443+0000 7ff47a614800 10 monclient(hunting): _renew_subs 2024-09-22T08:33:41.799 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-22T08:33:41.443+0000 7ff47a614800 10 monclient(hunting): authenticate will time out at 1926.682910s 2024-09-22T08:33:41.799 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-22T08:33:41.444+0000 7ff475de0640 10 monclient(hunting): get_auth_request con 0x55aa3559cbd0 auth_method 0 2024-09-22T08:33:41.799 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-22T08:33:41.444+0000 7ff475de0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:41.799 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-22T08:33:41.444+0000 7ff475de0640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:41.799 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-22T08:33:41.444+0000 7ff475de0640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:41.800 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-22T08:33:41.444+0000 7ff4765e1640 10 monclient(hunting): get_auth_request con 0x55aa35598000 auth_method 0 2024-09-22T08:33:41.800 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-22T08:33:41.444+0000 7ff4765e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:41.800 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-22T08:33:41.444+0000 7ff4765e1640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:41.800 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-22T08:33:41.444+0000 7ff4765e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:41.800 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-22T08:33:41.444+0000 7ff4755df640 10 monclient(hunting): get_auth_request con 0x55aa3558d520 auth_method 0 2024-09-22T08:33:41.800 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-22T08:33:41.444+0000 7ff4755df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:33:41.800 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-22T08:33:41.444+0000 7ff4755df640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:33:41.801 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-22T08:33:41.444+0000 7ff4755df640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:33:41.801 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-22T08:33:41.444+0000 7ff475de0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:41.801 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-22T08:33:41.444+0000 7ff475de0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:41.801 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-22T08:33:41.444+0000 7ff475de0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:41.801 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-22T08:33:41.444+0000 7ff4765e1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:41.801 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-22T08:33:41.444+0000 7ff4765e1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:41.802 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-22T08:33:41.444+0000 7ff4765e1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:41.802 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-22T08:33:41.444+0000 7ff4755df640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:33:41.802 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-22T08:33:41.444+0000 7ff4755df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:33:41.802 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-22T08:33:41.444+0000 7ff4755df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:33:41.802 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-22T08:33:41.444+0000 7ff4765e1640 10 monclient(hunting): handle_auth_done global_id 6191 payload 824 2024-09-22T08:33:41.802 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-22T08:33:41.444+0000 7ff4765e1640 10 monclient: _finish_hunting 0 2024-09-22T08:33:41.803 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-22T08:33:41.444+0000 7ff4765e1640 1 monclient: found mon.noname-c 2024-09-22T08:33:41.803 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-22T08:33:41.444+0000 7ff4765e1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:33:41.803 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-22T08:33:41.444+0000 7ff3477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:33:41.803 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-22T08:33:41.444+0000 7ff3477fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:33:41.803 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-22T08:33:41.444+0000 7ff3477fe640 10 monclient: dump: 2024-09-22T08:33:41.803 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:33:41.803 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:33:41.804 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:41.804 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:41.804 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:33:41.804 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:41.804 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:33:41.804 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:33:41.805 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:33:41.805 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.805 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-22T08:33:41.444+0000 7ff3477fe640 10 monclient: _finish_auth 0 2024-09-22T08:33:41.805 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-22T08:33:41.444+0000 7ff3477fe640 10 monclient: _check_auth_tickets 2024-09-22T08:33:41.805 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-22T08:33:41.444+0000 7ff3477fe640 10 monclient: handle_config config(0 keys) 2024-09-22T08:33:41.805 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-22T08:33:41.444+0000 7ff3477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:33:41.806 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-22T08:33:41.444+0000 7ff3477fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:33:41.806 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-22T08:33:41.444+0000 7ff3477fe640 10 monclient: dump: 2024-09-22T08:33:41.806 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:33:41.806 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:33:41.806 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:41.806 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:33:41.807 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:33:41.807 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:33:41.807 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:33:41.807 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:33:41.807 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:33:41.807 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.808 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-22T08:33:41.444+0000 7ff47a614800 5 monclient: authenticate success, global_id 6191 2024-09-22T08:33:41.808 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-22T08:33:41.444+0000 7ff47a614800 10 monclient: _renew_subs 2024-09-22T08:33:41.808 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-22T08:33:41.444+0000 7ff3597fa640 4 set_mon_vals no callback set 2024-09-22T08:33:41.808 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-22T08:33:41.444+0000 7ff47a614800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:33:41.808 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-22T08:33:41.444+0000 7ff47a614800 10 monclient: _renew_subs 2024-09-22T08:33:41.808 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-22T08:33:41.444+0000 7ff47a614800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:33:41.809 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-22T08:33:41.444+0000 7ff47a614800 1 librados: init done 2024-09-22T08:33:41.809 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-22T08:33:41.444+0000 7ff47a614800 5 asok(0x55aa352a70f0) register_command cr dump hook 0x55aa35598b78 2024-09-22T08:33:41.809 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-22T08:33:41.446+0000 7ff47a614800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.809 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-22T08:33:41.446+0000 7ff3477fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:33:41.809 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-22T08:33:41.446+0000 7ff3477fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:33:41.809 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-22T08:33:41.446+0000 7ff3477fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:33:41.810 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-22T08:33:41.447+0000 7ff4755df640 10 monclient: get_auth_request con 0x7ff340077570 auth_method 0 2024-09-22T08:33:41.810 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-22T08:33:41.447+0000 7ff475de0640 10 monclient: get_auth_request con 0x55aa355b6d90 auth_method 0 2024-09-22T08:33:41.810 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-22T08:33:41.447+0000 7ff47a614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.810 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-22T08:33:41.447+0000 7ff47a614800 20 realm 2024-09-22T08:33:41.810 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-22T08:33:41.447+0000 7ff47a614800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.810 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-22T08:33:41.448+0000 7ff47a614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.811 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-22T08:33:41.448+0000 7ff47a614800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:33:41.811 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-22T08:33:41.448+0000 7ff47a614800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.811 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-22T08:33:41.448+0000 7ff47a614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.811 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-22T08:33:41.448+0000 7ff47a614800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.811 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-22T08:33:41.448+0000 7ff4755df640 10 monclient: get_auth_request con 0x55aa355bb050 auth_method 0 2024-09-22T08:33:41.811 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-22T08:33:41.449+0000 7ff47a614800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:41.811 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-22T08:33:41.449+0000 7ff47a614800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.812 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-22T08:33:41.449+0000 7ff4765e1640 10 monclient: get_auth_request con 0x55aa355be8b0 auth_method 0 2024-09-22T08:33:41.812 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-22T08:33:41.449+0000 7ff47a614800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:33:41.812 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-22T08:33:41.449+0000 7ff47a614800 20 searching for the correct realm 2024-09-22T08:33:41.812 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-22T08:33:41.449+0000 7ff475de0640 10 monclient: get_auth_request con 0x55aa355c3650 auth_method 0 2024-09-22T08:33:41.812 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-22T08:33:41.451+0000 7ff4755df640 10 monclient: get_auth_request con 0x7ff46c083030 auth_method 0 2024-09-22T08:33:41.812 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-22T08:33:41.451+0000 7ff4755df640 0 -- 172.21.15.38:0/2140828749 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7ff46c083030 msgr2=0x7ff46c0660d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:41.813 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-22T08:33:41.451+0000 7ff3477fe640 1 client.6191.objecter ms_handle_reset 0x7ff46c083030 session 0x7ff46c005040 osd.0 2024-09-22T08:33:41.813 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-22T08:33:41.451+0000 7ff3477fe640 10 monclient: _renew_subs 2024-09-22T08:33:41.813 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-22T08:33:41.451+0000 7ff3477fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:33:41.813 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-22T08:33:41.452+0000 7ff4755df640 10 monclient: get_auth_request con 0x7ff340087090 auth_method 0 2024-09-22T08:33:41.813 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-22T08:33:41.452+0000 7ff4765e1640 10 monclient: get_auth_request con 0x7ff468071940 auth_method 0 2024-09-22T08:33:41.813 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-22T08:33:41.454+0000 7ff475de0640 10 monclient: get_auth_request con 0x7ff46c08c040 auth_method 0 2024-09-22T08:33:41.813 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-22T08:33:41.455+0000 7ff4755df640 10 monclient: get_auth_request con 0x7ff468098900 auth_method 0 2024-09-22T08:33:41.814 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-22T08:33:41.455+0000 7ff4755df640 0 -- 172.21.15.38:0/2140828749 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7ff468098900 msgr2=0x7ff4680683f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:41.814 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-22T08:33:41.656+0000 7ff4755df640 10 monclient: get_auth_request con 0x7ff468098900 auth_method 0 2024-09-22T08:33:41.814 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-22T08:33:41.662+0000 7ff47a614800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:33:41.814 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-22T08:33:41.662+0000 7ff47a614800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:33:41.814 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-22T08:33:41.662+0000 7ff47a614800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:33:41.814 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-22T08:33:41.662+0000 7ff47a614800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:33:41.814 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-22T08:33:41.662+0000 7ff47a614800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:33:41.814 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-22T08:33:41.662+0000 7ff47a614800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:33:41.815 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-22T08:33:41.662+0000 7ff47a614800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.815 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-22T08:33:41.662+0000 7ff47a614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.815 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-22T08:33:41.662+0000 7ff47a614800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.815 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-22T08:33:41.663+0000 7ff47a614800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:41.815 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-22T08:33:41.663+0000 7ff47a614800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.815 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-22T08:33:41.663+0000 7ff47a614800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:33:41.815 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-22T08:33:41.663+0000 7ff47a614800 20 zone default found 2024-09-22T08:33:41.815 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-22T08:33:41.663+0000 7ff47a614800 4 Realm: () 2024-09-22T08:33:41.816 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-22T08:33:41.663+0000 7ff47a614800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:33:41.816 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-22T08:33:41.663+0000 7ff47a614800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:33:41.816 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-22T08:33:41.663+0000 7ff47a614800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:33:41.816 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-22T08:33:41.663+0000 7ff47a614800 20 zonegroup default 2024-09-22T08:33:41.816 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-22T08:33:41.663+0000 7ff47a614800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.816 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-22T08:33:41.663+0000 7ff47a614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.816 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-22T08:33:41.663+0000 7ff47a614800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.816 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-22T08:33:41.664+0000 7ff47a614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.816 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-22T08:33:41.664+0000 7ff47a614800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.816 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-22T08:33:41.664+0000 7ff47a614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.816 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-22T08:33:41.664+0000 7ff47a614800 20 started sync module instance, tier type = 2024-09-22T08:33:41.816 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-22T08:33:41.664+0000 7ff47a614800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:33:41.817 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-22T08:33:41.673+0000 7ff47a614800 20 add_watcher() i=0 2024-09-22T08:33:41.817 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-22T08:33:41.673+0000 7ff47a614800 20 add_watcher() i=1 2024-09-22T08:33:41.817 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-22T08:33:41.673+0000 7ff47a614800 20 add_watcher() i=2 2024-09-22T08:33:41.817 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-22T08:33:41.673+0000 7ff47a614800 20 add_watcher() i=3 2024-09-22T08:33:41.817 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-22T08:33:41.673+0000 7ff47a614800 20 add_watcher() i=4 2024-09-22T08:33:41.817 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-22T08:33:41.673+0000 7ff47a614800 20 add_watcher() i=5 2024-09-22T08:33:41.817 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-22T08:33:41.674+0000 7ff47a614800 20 add_watcher() i=6 2024-09-22T08:33:41.817 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-22T08:33:41.674+0000 7ff47a614800 20 add_watcher() i=7 2024-09-22T08:33:41.817 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-22T08:33:41.674+0000 7ff47a614800 2 all 8 watchers are set, enabling cache 2024-09-22T08:33:41.817 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-22T08:33:41.676+0000 7ff47a614800 5 AuthRegistry(0x7ffed70960e0) adding auth protocol: cephx 2024-09-22T08:33:41.817 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-22T08:33:41.676+0000 7ff47a614800 5 AuthRegistry(0x7ffed70960e0) adding auth protocol: cephx 2024-09-22T08:33:41.817 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-22T08:33:41.676+0000 7ff47a614800 5 AuthRegistry(0x7ffed70960e0) adding auth protocol: cephx 2024-09-22T08:33:41.817 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-22T08:33:41.676+0000 7ff47a614800 5 AuthRegistry(0x7ffed70960e0) adding con mode: secure 2024-09-22T08:33:41.818 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-22T08:33:41.676+0000 7ff47a614800 5 AuthRegistry(0x7ffed70960e0) adding con mode: crc 2024-09-22T08:33:41.818 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-22T08:33:41.676+0000 7ff47a614800 5 AuthRegistry(0x7ffed70960e0) adding con mode: secure 2024-09-22T08:33:41.818 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-22T08:33:41.676+0000 7ff47a614800 5 AuthRegistry(0x7ffed70960e0) adding con mode: crc 2024-09-22T08:33:41.818 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-22T08:33:41.676+0000 7ff47a614800 5 AuthRegistry(0x7ffed70960e0) adding con mode: secure 2024-09-22T08:33:41.818 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-22T08:33:41.676+0000 7ff47a614800 5 AuthRegistry(0x7ffed70960e0) adding con mode: crc 2024-09-22T08:33:41.818 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-22T08:33:41.676+0000 7ff3277fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:41.818 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-22T08:33:41.676+0000 7ff47a614800 5 AuthRegistry(0x7ffed70960e0) adding con mode: crc 2024-09-22T08:33:41.818 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-22T08:33:41.676+0000 7ff47a614800 5 AuthRegistry(0x7ffed70960e0) adding con mode: secure 2024-09-22T08:33:41.818 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-22T08:33:41.676+0000 7ff47a614800 5 AuthRegistry(0x7ffed70960e0) adding con mode: crc 2024-09-22T08:33:41.818 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-22T08:33:41.676+0000 7ff47a614800 5 AuthRegistry(0x7ffed70960e0) adding con mode: secure 2024-09-22T08:33:41.818 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-22T08:33:41.676+0000 7ff47a614800 5 AuthRegistry(0x7ffed70960e0) adding con mode: crc 2024-09-22T08:33:41.818 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-22T08:33:41.676+0000 7ff47a614800 5 AuthRegistry(0x7ffed70960e0) adding con mode: secure 2024-09-22T08:33:41.818 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-22T08:33:41.677+0000 7ff47a614800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:33:41.818 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-22T08:33:41.677+0000 7ff47a614800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:33:41.819 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-22T08:33:41.677+0000 7ff47a614800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:33:41.819 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-22T08:33:41.677+0000 7ff47a614800 5 asok(0x55aa352a70f0) register_command cache list hook 0x55aa35592f70 2024-09-22T08:33:41.819 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-22T08:33:41.677+0000 7ff47a614800 5 asok(0x55aa352a70f0) register_command cache inspect hook 0x55aa35592f70 2024-09-22T08:33:41.819 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-22T08:33:41.677+0000 7ff47a614800 5 asok(0x55aa352a70f0) register_command cache erase hook 0x55aa35592f70 2024-09-22T08:33:41.819 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-22T08:33:41.677+0000 7ff47a614800 5 asok(0x55aa352a70f0) register_command cache zap hook 0x55aa35592f70 2024-09-22T08:33:41.819 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-22T08:33:41.677+0000 7ff47a614800 5 note: GC not initialized 2024-09-22T08:33:41.819 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-22T08:33:41.677+0000 7ff3267fc640 20 reqs_thread_entry: start 2024-09-22T08:33:41.819 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-22T08:33:41.677+0000 7ff47a614800 5 asok(0x55aa352a70f0) register_command sync trace show hook 0x7ff46c00f070 2024-09-22T08:33:41.819 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-22T08:33:41.677+0000 7ff47a614800 5 asok(0x55aa352a70f0) register_command sync trace history hook 0x7ff46c00f070 2024-09-22T08:33:41.819 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-22T08:33:41.677+0000 7ff47a614800 5 asok(0x55aa352a70f0) register_command sync trace active hook 0x7ff46c00f070 2024-09-22T08:33:41.819 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-22T08:33:41.677+0000 7ff47a614800 5 asok(0x55aa352a70f0) register_command sync trace active_short hook 0x7ff46c00f070 2024-09-22T08:33:41.819 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-22T08:33:41.677+0000 7ff47a614800 20 init_complete bucket index max shards: 11 2024-09-22T08:33:41.819 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-22T08:33:41.677+0000 7ff47a614800 20 Filter name: none 2024-09-22T08:33:41.819 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-22T08:33:41.677+0000 7ff297fff640 20 reqs_thread_entry: start 2024-09-22T08:33:41.820 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-22T08:33:41.677+0000 7ff47a614800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-22T08:33:41.820 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-22T08:33:41.677+0000 7ff47a614800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.820 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-22T08:33:41.678+0000 7ff47a614800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T08:33:41.820 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-22T08:33:41.678+0000 7ff47a614800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-22T08:33:41.820 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-22T08:33:41.678+0000 7ff47a614800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-22T08:33:41.820 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-22T08:33:41.678+0000 7ff47a614800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.24 : miss 2024-09-22T08:33:41.820 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-22T08:33:41.678+0000 7ff47a614800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.820 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-22T08:33:41.678+0000 7ff47a614800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T08:33:41.820 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-22T08:33:41.678+0000 7ff47a614800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.24 info.flags=0x17 2024-09-22T08:33:41.820 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-22T08:33:41.678+0000 7ff47a614800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.24 to cache LRU end 2024-09-22T08:33:41.820 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-22T08:33:41.678+0000 7ff47a614800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:33:41.821 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-22T08:33:41.678+0000 7ff47a614800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:41.821 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-22T08:33:41.678+0000 7ff47a614800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.24 2024-09-22T08:33:41.821 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-22T08:33:41.683+0000 7ff47a614800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff47a614800 time 2024-09-22T08:33:41.683713+0000 2024-09-22T08:33:41.821 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:33:41.821 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.821 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:33:41.821 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff47b78c748] 2024-09-22T08:33:41.821 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7ff47b78c906] 2024-09-22T08:33:41.821 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55aa34073e01] 2024-09-22T08:33:41.821 INFO:tasks.workunit.client.0.smithi038.stderr: 4: radosgw-admin(+0xd80c08) [0x55aa34585c08] 2024-09-22T08:33:41.821 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55aa34083c9d] 2024-09-22T08:33:41.821 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-22T08:33:41.821 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ff47a429590] 2024-09-22T08:33:41.822 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-22T08:33:41.822 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-22T08:33:41.822 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.822 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-22T08:33:41.684+0000 7ff47a614800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:33:41.822 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7ff47a614800 thread_name:radosgw-admin 2024-09-22T08:33:41.822 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.822 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:33:41.822 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff47a43e6f0] 2024-09-22T08:33:41.822 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff47a48b99c] 2024-09-22T08:33:41.822 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:33:41.822 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:33:41.822 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff47b78c7a2] 2024-09-22T08:33:41.822 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7ff47b78c906] 2024-09-22T08:33:41.823 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55aa34073e01] 2024-09-22T08:33:41.823 INFO:tasks.workunit.client.0.smithi038.stderr: 8: radosgw-admin(+0xd80c08) [0x55aa34585c08] 2024-09-22T08:33:41.823 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55aa34083c9d] 2024-09-22T08:33:41.823 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-22T08:33:41.823 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ff47a429590] 2024-09-22T08:33:41.823 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-22T08:33:41.823 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-22T08:33:41.823 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:33:41.823 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.824 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-22T08:33:41.824 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-22T08:33:41.824 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-22T08:33:41.824 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-22T08:33:41.824 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-22T08:33:41.824 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-22T08:33:41.824 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-22T08:33:41.824 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-22T08:33:41.824 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-22T08:33:41.824 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-22T08:33:41.825 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-22T08:33:41.825 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-22T08:33:41.825 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-22T08:33:41.825 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-22T08:33:41.825 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-22T08:33:41.825 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-22T08:33:41.825 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-22T08:33:41.825 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-22T08:33:41.825 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-22T08:33:41.825 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-22T08:33:41.825 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-22T08:33:41.826 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-22T08:33:41.826 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-22T08:33:41.826 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-22T08:33:41.826 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:33:41.826 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-22T08:33:41.826 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-22T08:33:41.826 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-22T08:33:41.826 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-22T08:33:41.826 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-22T08:33:41.827 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-22T08:33:41.827 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-22T08:33:41.827 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-22T08:33:41.827 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-22T08:33:41.827 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-22T08:33:41.827 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-22T08:33:41.827 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-22T08:33:41.827 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-22T08:33:41.827 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-22T08:33:41.827 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-22T08:33:41.828 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-22T08:33:41.828 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-22T08:33:41.828 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-22T08:33:41.828 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-22T08:33:41.828 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-22T08:33:41.828 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-22T08:33:41.828 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:33:41.828 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-22T08:33:41.828 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:33:41.828 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-22T08:33:41.829 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-22T08:33:41.829 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-22T08:33:41.829 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-22T08:33:41.829 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-22T08:33:41.829 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-22T08:33:41.829 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-22T08:33:41.829 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-22T08:33:41.829 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-22T08:33:41.830 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-22T08:33:41.830 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-22T08:33:41.830 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-22T08:33:41.830 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-22T08:33:41.830 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-22T08:33:41.830 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-22T08:33:41.830 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-22T08:33:41.830 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-22T08:33:41.830 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-22T08:33:41.831 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:33:41.831 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-22T08:33:41.831 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:33:41.831 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-22T08:33:41.831 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-22T08:33:41.831 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-22T08:33:41.831 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-22T08:33:41.831 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-22T08:33:41.831 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-22T08:33:41.831 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:33:41.832 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-22T08:33:41.832 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-22T08:33:41.832 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:33:41.832 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-22T08:33:41.832 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-22T08:33:41.832 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-22T08:33:41.832 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-22T08:33:41.832 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-22T08:33:41.832 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-22T08:33:41.832 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-22T08:33:41.833 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-22T08:33:41.833 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-22T08:33:41.833 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-22T08:33:41.833 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-22T08:33:41.833 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-22T08:33:41.833 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-22T08:33:41.833 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:33:41.833 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff297fff640 / http_manager 2024-09-22T08:33:41.834 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff3267fc640 / http_manager 2024-09-22T08:33:41.834 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff3277fe640 / rgw_dt_lg_renew 2024-09-22T08:33:41.834 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff3477fe640 / ms_dispatch 2024-09-22T08:33:41.834 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff3597fa640 / io_context_pool 2024-09-22T08:33:41.834 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff35b7fe640 / ms_dispatch 2024-09-22T08:33:41.834 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff362604640 / ms_dispatch 2024-09-22T08:33:41.834 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff363e07640 / io_context_pool 2024-09-22T08:33:41.834 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff4755df640 / msgr-worker-2 2024-09-22T08:33:41.835 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff475de0640 / msgr-worker-1 2024-09-22T08:33:41.835 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff4765e1640 / msgr-worker-0 2024-09-22T08:33:41.835 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff476de2640 / io_context_pool 2024-09-22T08:33:41.835 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff47a614800 / radosgw-admin 2024-09-22T08:33:41.835 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-22T08:33:41.835 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-22T08:33:41.835 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/lib/ceph/crash/2024-09-22T08:33:41.685380Z_b387629d-1c40-4c10-8364-973b0adcc495/log 2024-09-22T08:33:41.835 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-22T08:33:41.835 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-22T08:33:41.842 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:33:41.842 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:33:41.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.764+0000 7f8dbe946800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.766+0000 7f8dbe946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.766+0000 7f8dbe946800 20 realm 2024-09-22T08:33:41.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.766+0000 7f8dbe946800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.767+0000 7f8dbe946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.767+0000 7f8dbe946800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:33:41.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.767+0000 7f8dbe946800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.767+0000 7f8dbe946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.767+0000 7f8dbe946800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.768+0000 7f8dbbc2f640 0 -- 172.21.15.38:0/1778660499 >> [v2:172.21.15.38:6808/1856522357,v1:172.21.15.38:6809/1856522357] conn(0x55830aa12420 msgr2=0x55830aa148e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:41.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.768+0000 7f8dbe946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:41.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.768+0000 7f8dbe946800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.768+0000 7f8dbe946800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:33:41.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.768+0000 7f8dbe946800 20 searching for the correct realm 2024-09-22T08:33:41.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.771+0000 7f8dbbc2f640 0 -- 172.21.15.38:0/1778660499 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f8db0077c20 msgr2=0x7f8db0077180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:41.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.779+0000 7f8dbe946800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:33:41.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.779+0000 7f8dbe946800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:33:41.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.779+0000 7f8dbe946800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:33:41.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.779+0000 7f8dbe946800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:33:41.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.779+0000 7f8dbe946800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:33:41.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.779+0000 7f8dbe946800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:33:41.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.779+0000 7f8dbe946800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.779+0000 7f8dbe946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.779+0000 7f8dbe946800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.779+0000 7f8dbe946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:41.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.779+0000 7f8dbe946800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.780+0000 7f8dbe946800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:33:41.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.780+0000 7f8dbe946800 20 zone default found 2024-09-22T08:33:41.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.780+0000 7f8dbe946800 4 Realm: () 2024-09-22T08:33:41.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.780+0000 7f8dbe946800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:33:41.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.780+0000 7f8dbe946800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:33:41.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.780+0000 7f8dbe946800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:33:41.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.780+0000 7f8dbe946800 20 zonegroup default 2024-09-22T08:33:41.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.780+0000 7f8dbe946800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.780+0000 7f8dbe946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.780+0000 7f8dbe946800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.781+0000 7f8dbe946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.781+0000 7f8dbe946800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.781+0000 7f8dbe946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.781+0000 7f8dbe946800 20 started sync module instance, tier type = 2024-09-22T08:33:41.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.781+0000 7f8dbe946800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:33:41.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.791+0000 7f8dbe946800 20 add_watcher() i=0 2024-09-22T08:33:41.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.791+0000 7f8dbe946800 20 add_watcher() i=1 2024-09-22T08:33:41.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.791+0000 7f8dbe946800 20 add_watcher() i=2 2024-09-22T08:33:41.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.791+0000 7f8dbe946800 20 add_watcher() i=3 2024-09-22T08:33:41.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.791+0000 7f8dbe946800 20 add_watcher() i=4 2024-09-22T08:33:41.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.791+0000 7f8dbe946800 20 add_watcher() i=5 2024-09-22T08:33:41.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.791+0000 7f8dbe946800 20 add_watcher() i=6 2024-09-22T08:33:41.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.792+0000 7f8dbe946800 20 add_watcher() i=7 2024-09-22T08:33:41.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.792+0000 7f8dbe946800 2 all 8 watchers are set, enabling cache 2024-09-22T08:33:41.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.794+0000 7f8c6e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:41.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.794+0000 7f8dbe946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:33:41.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.794+0000 7f8dbe946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:33:41.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.794+0000 7f8dbe946800 5 note: GC not initialized 2024-09-22T08:33:41.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.795+0000 7f8c6d7e2640 20 reqs_thread_entry: start 2024-09-22T08:33:41.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.795+0000 7f8dbe946800 20 init_complete bucket index max shards: 11 2024-09-22T08:33:41.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.795+0000 7f8dbe946800 20 Filter name: none 2024-09-22T08:33:41.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.795+0000 7f8bdeffd640 20 reqs_thread_entry: start 2024-09-22T08:33:41.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.795+0000 7f8dbe946800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.795+0000 7f8dbe946800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T08:33:41.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.795+0000 7f8dbe946800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.796+0000 7f8dbe946800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T08:33:41.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.796+0000 7f8dbe946800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:33:41.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.796+0000 7f8dbe946800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.796+0000 7f8dbe946800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T08:33:41.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.796+0000 7f8dbe946800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.797+0000 7f8dbe946800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T08:33:41.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.797+0000 7f8dbe946800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:33:41.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.799+0000 7f8c6e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:41.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.801+0000 7f8dbe946800 20 remove_watcher() i=0 2024-09-22T08:33:41.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.801+0000 7f8dbe946800 2 removed watcher, disabling cache 2024-09-22T08:33:41.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.802+0000 7f8dbe946800 20 remove_watcher() i=1 2024-09-22T08:33:41.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.803+0000 7f8dbe946800 20 remove_watcher() i=2 2024-09-22T08:33:41.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.804+0000 7f8dbe946800 20 remove_watcher() i=3 2024-09-22T08:33:41.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.805+0000 7f8dbe946800 20 remove_watcher() i=4 2024-09-22T08:33:41.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.806+0000 7f8dbe946800 20 remove_watcher() i=5 2024-09-22T08:33:41.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.807+0000 7f8dbe946800 20 remove_watcher() i=6 2024-09-22T08:33:41.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.808+0000 7f8dbe946800 20 remove_watcher() i=7 2024-09-22T08:33:41.848 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.848 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:33:41.848 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-set-target-layout id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:33:41.848 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:33:41.848 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:41.848 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:41.848 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:33:41.848 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:33:41.870 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:33:41.903 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:33:41.903 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:33:41.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.943+0000 7f7359a98800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.945+0000 7f7359a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.945+0000 7f7359a98800 20 realm 2024-09-22T08:33:41.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.945+0000 7f7359a98800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.945+0000 7f7359a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.945+0000 7f7359a98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:33:41.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.945+0000 7f7359a98800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.947 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.945+0000 7f7359a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.947 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.945+0000 7f7359a98800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.947 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.946+0000 7f7359a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:41.947 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.946+0000 7f7359a98800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.947 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.947+0000 7f7359a98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:33:41.948 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.947+0000 7f7359a98800 20 searching for the correct realm 2024-09-22T08:33:41.948 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.947+0000 7f7357582640 0 -- 172.21.15.38:0/1044881313 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x5581aedce920 msgr2=0x5581aedd0de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:41.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.951+0000 7f7357582640 0 -- 172.21.15.38:0/1044881313 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x5581aedc2070 msgr2=0x5581aedc4500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:41.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.958+0000 7f7359a98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:33:41.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.958+0000 7f7359a98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:33:41.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.958+0000 7f7359a98800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:33:41.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.958+0000 7f7359a98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:33:41.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.958+0000 7f7359a98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:33:41.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.958+0000 7f7359a98800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:33:41.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.958+0000 7f7359a98800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.958+0000 7f7359a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.958+0000 7f7359a98800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.958+0000 7f7359a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:41.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.958+0000 7f7359a98800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.958+0000 7f7359a98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:33:41.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.959+0000 7f7359a98800 20 zone default found 2024-09-22T08:33:41.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.959+0000 7f7359a98800 4 Realm: () 2024-09-22T08:33:41.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.959+0000 7f7359a98800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:33:41.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.959+0000 7f7359a98800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:33:41.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.959+0000 7f7359a98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:33:41.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.959+0000 7f7359a98800 20 zonegroup default 2024-09-22T08:33:41.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.959+0000 7f7359a98800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.959+0000 7f7359a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.959+0000 7f7359a98800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.959+0000 7f7359a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.959+0000 7f7359a98800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.960+0000 7f7359a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:41.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.960+0000 7f7359a98800 20 started sync module instance, tier type = 2024-09-22T08:33:41.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.960+0000 7f7359a98800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:33:41.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.968+0000 7f7359a98800 20 add_watcher() i=0 2024-09-22T08:33:41.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.968+0000 7f7359a98800 20 add_watcher() i=1 2024-09-22T08:33:41.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.968+0000 7f7359a98800 20 add_watcher() i=2 2024-09-22T08:33:41.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.968+0000 7f7359a98800 20 add_watcher() i=3 2024-09-22T08:33:41.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.968+0000 7f7359a98800 20 add_watcher() i=4 2024-09-22T08:33:41.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.968+0000 7f7359a98800 20 add_watcher() i=5 2024-09-22T08:33:41.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.968+0000 7f7359a98800 20 add_watcher() i=6 2024-09-22T08:33:41.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.969+0000 7f7359a98800 20 add_watcher() i=7 2024-09-22T08:33:41.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.969+0000 7f7359a98800 2 all 8 watchers are set, enabling cache 2024-09-22T08:33:41.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.971+0000 7f720dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:41.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.971+0000 7f7359a98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:33:41.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.971+0000 7f7359a98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:33:41.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.971+0000 7f7359a98800 5 note: GC not initialized 2024-09-22T08:33:41.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.971+0000 7f720cfe1640 20 reqs_thread_entry: start 2024-09-22T08:33:41.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.971+0000 7f7359a98800 20 init_complete bucket index max shards: 11 2024-09-22T08:33:41.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.972+0000 7f7359a98800 20 Filter name: none 2024-09-22T08:33:41.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.972+0000 7f71867fc640 20 reqs_thread_entry: start 2024-09-22T08:33:41.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.972+0000 7f7359a98800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-22T08:33:41.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.972+0000 7f7359a98800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.972+0000 7f7359a98800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T08:33:41.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.972+0000 7f7359a98800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-22T08:33:41.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.972+0000 7f7359a98800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-22T08:33:41.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.972+0000 7f7359a98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.24 : miss 2024-09-22T08:33:41.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.972+0000 7f7359a98800 20 rados->read ofs=0 len=0 2024-09-22T08:33:41.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.973+0000 7f7359a98800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T08:33:41.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.973+0000 7f7359a98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.24 info.flags=0x17 2024-09-22T08:33:41.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.973+0000 7f7359a98800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.24 to cache LRU end 2024-09-22T08:33:41.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.973+0000 7f7359a98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:33:41.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.973+0000 7f7359a98800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:33:41.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.973+0000 7f7359a98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.24 2024-09-22T08:33:41.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.974+0000 7f7359a98800 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.24 to be held by another RGW process; skipping for now 2024-09-22T08:33:41.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.975+0000 7f720dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:41.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.977+0000 7f7359a98800 20 remove_watcher() i=0 2024-09-22T08:33:41.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.977+0000 7f7359a98800 2 removed watcher, disabling cache 2024-09-22T08:33:41.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.978+0000 7f7359a98800 20 remove_watcher() i=1 2024-09-22T08:33:41.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.979+0000 7f7359a98800 20 remove_watcher() i=2 2024-09-22T08:33:41.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.980+0000 7f7359a98800 20 remove_watcher() i=3 2024-09-22T08:33:41.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.981+0000 7f7359a98800 20 remove_watcher() i=4 2024-09-22T08:33:41.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.983+0000 7f7359a98800 20 remove_watcher() i=5 2024-09-22T08:33:41.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.984+0000 7f7359a98800 20 remove_watcher() i=6 2024-09-22T08:33:41.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:33:41.985+0000 7f7359a98800 20 remove_watcher() i=7 2024-09-22T08:33:41.997 INFO:tasks.workunit.client.0.smithi038.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-22T08:34:12.002 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:34:12.039 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:34:12.039 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:34:12.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.084+0000 7fb54dd2e800 20 rados->read ofs=0 len=0 2024-09-22T08:34:12.086 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.085+0000 7fb54dd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:12.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.085+0000 7fb54dd2e800 20 realm 2024-09-22T08:34:12.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.085+0000 7fb54dd2e800 20 rados->read ofs=0 len=0 2024-09-22T08:34:12.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.086+0000 7fb54dd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:12.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.086+0000 7fb54dd2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:34:12.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.086+0000 7fb54dd2e800 20 rados->read ofs=0 len=0 2024-09-22T08:34:12.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.086+0000 7fb54dd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:12.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.086+0000 7fb54dd2e800 20 rados->read ofs=0 len=0 2024-09-22T08:34:12.088 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.087+0000 7fb54dd2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:12.088 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.087+0000 7fb54dd2e800 20 rados->read ofs=0 len=0 2024-09-22T08:34:12.088 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.087+0000 7fb54dd2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:34:12.088 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.087+0000 7fb54dd2e800 20 searching for the correct realm 2024-09-22T08:34:12.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.090+0000 7fb5492dc640 0 -- 172.21.15.38:0/2035363215 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7fb54004da20 msgr2=0x7fb5400c9430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:34:12.297 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.296+0000 7fb5492dc640 0 -- 172.21.15.38:0/2035363215 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fb53c017040 msgr2=0x7fb53c06b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:34:12.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.504+0000 7fb54dd2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:34:12.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.504+0000 7fb54dd2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:34:12.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.504+0000 7fb54dd2e800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:34:12.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.504+0000 7fb54dd2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:34:12.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.504+0000 7fb54dd2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:34:12.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.504+0000 7fb54dd2e800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:34:12.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.504+0000 7fb54dd2e800 20 rados->read ofs=0 len=0 2024-09-22T08:34:12.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.505+0000 7fb54dd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:12.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.505+0000 7fb54dd2e800 20 rados->read ofs=0 len=0 2024-09-22T08:34:12.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.505+0000 7fb54dd2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:12.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.505+0000 7fb54dd2e800 20 rados->read ofs=0 len=0 2024-09-22T08:34:12.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.506+0000 7fb54dd2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:34:12.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.506+0000 7fb54dd2e800 20 zone default found 2024-09-22T08:34:12.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.506+0000 7fb54dd2e800 4 Realm: () 2024-09-22T08:34:12.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.506+0000 7fb54dd2e800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:34:12.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.506+0000 7fb54dd2e800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:34:12.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.506+0000 7fb54dd2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:34:12.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.506+0000 7fb54dd2e800 20 zonegroup default 2024-09-22T08:34:12.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.506+0000 7fb54dd2e800 20 rados->read ofs=0 len=0 2024-09-22T08:34:12.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.506+0000 7fb54dd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:12.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.506+0000 7fb54dd2e800 20 rados->read ofs=0 len=0 2024-09-22T08:34:12.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.507+0000 7fb54dd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:12.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.507+0000 7fb54dd2e800 20 rados->read ofs=0 len=0 2024-09-22T08:34:12.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.507+0000 7fb54dd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:12.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.507+0000 7fb54dd2e800 20 started sync module instance, tier type = 2024-09-22T08:34:12.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.507+0000 7fb54dd2e800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:34:12.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.518+0000 7fb54dd2e800 20 add_watcher() i=0 2024-09-22T08:34:12.520 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.518+0000 7fb54dd2e800 20 add_watcher() i=1 2024-09-22T08:34:12.520 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.518+0000 7fb54dd2e800 20 add_watcher() i=2 2024-09-22T08:34:12.520 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.518+0000 7fb54dd2e800 20 add_watcher() i=3 2024-09-22T08:34:12.520 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.518+0000 7fb54dd2e800 20 add_watcher() i=4 2024-09-22T08:34:12.520 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.518+0000 7fb54dd2e800 20 add_watcher() i=5 2024-09-22T08:34:12.520 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.518+0000 7fb54dd2e800 20 add_watcher() i=6 2024-09-22T08:34:12.521 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.519+0000 7fb54dd2e800 20 add_watcher() i=7 2024-09-22T08:34:12.521 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.519+0000 7fb54dd2e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:34:12.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.522+0000 7fb3fffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:12.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.522+0000 7fb54dd2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:34:12.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.522+0000 7fb54dd2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:34:12.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.522+0000 7fb54dd2e800 5 note: GC not initialized 2024-09-22T08:34:12.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.522+0000 7fb3fefe5640 20 reqs_thread_entry: start 2024-09-22T08:34:12.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.523+0000 7fb54dd2e800 20 init_complete bucket index max shards: 11 2024-09-22T08:34:12.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.523+0000 7fb54dd2e800 20 Filter name: none 2024-09-22T08:34:12.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.523+0000 7fb3fcfe1640 20 reqs_thread_entry: start 2024-09-22T08:34:12.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.523+0000 7fb54dd2e800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-22T08:34:12.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.523+0000 7fb54dd2e800 20 rados->read ofs=0 len=0 2024-09-22T08:34:12.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.524+0000 7fb54dd2e800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T08:34:12.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.524+0000 7fb54dd2e800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-22T08:34:12.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.524+0000 7fb54dd2e800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-22T08:34:12.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.524+0000 7fb54dd2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.24 : miss 2024-09-22T08:34:12.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.524+0000 7fb54dd2e800 20 rados->read ofs=0 len=0 2024-09-22T08:34:12.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.524+0000 7fb54dd2e800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T08:34:12.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.524+0000 7fb54dd2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.24 info.flags=0x17 2024-09-22T08:34:12.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.524+0000 7fb54dd2e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.24 to cache LRU end 2024-09-22T08:34:12.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.524+0000 7fb54dd2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:34:12.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.524+0000 7fb54dd2e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:12.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.524+0000 7fb54dd2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.24 2024-09-22T08:34:12.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.530+0000 7fb54dd2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.24 info.flags=0x17 2024-09-22T08:34:12.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.530+0000 7fb54dd2e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.24 to cache LRU end 2024-09-22T08:34:12.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.530+0000 7fb54dd2e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:12.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.530+0000 7fb54dd2e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.24, ofs0, ns] 2024-09-22T08:34:12.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.530+0000 7fb42cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496999 cookie 94698113126448 notifier 6239 bl.length()=925 2024-09-22T08:34:12.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.530+0000 7fb42cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.24 info.flags=0x17 2024-09-22T08:34:12.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.530+0000 7fb42cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.24 to cache LRU end 2024-09-22T08:34:12.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.530+0000 7fb42cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:12.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.531+0000 7fb54dd2e800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.24]): orig_sources= new_sources= 2024-09-22T08:34:12.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.531+0000 7fb54dd2e800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.24]): potential sources added=[] removed=[] 2024-09-22T08:34:12.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.531+0000 7fb54dd2e800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.24]): orig_dests= new_dests= 2024-09-22T08:34:12.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.531+0000 7fb54dd2e800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.24]): potential dests added=[] removed=[] 2024-09-22T08:34:12.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.536+0000 7fb54dd2e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.1.0 2024-09-22T08:34:12.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.536+0000 7fb54dd2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.1.0 2024-09-22T08:34:12.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.536+0000 7fb54dd2e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.1.1 2024-09-22T08:34:12.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.536+0000 7fb54dd2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.1.1 2024-09-22T08:34:12.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.536+0000 7fb54dd2e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.1.2 2024-09-22T08:34:12.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.536+0000 7fb54dd2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.1.2 2024-09-22T08:34:12.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.536+0000 7fb54dd2e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.1.3 2024-09-22T08:34:12.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.536+0000 7fb54dd2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.1.3 2024-09-22T08:34:12.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.536+0000 7fb54dd2e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.1.4 2024-09-22T08:34:12.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.536+0000 7fb54dd2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.1.4 2024-09-22T08:34:12.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.536+0000 7fb54dd2e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.1.5 2024-09-22T08:34:12.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.536+0000 7fb54dd2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.1.5 2024-09-22T08:34:12.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.536+0000 7fb54dd2e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.1.6 2024-09-22T08:34:12.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.536+0000 7fb54dd2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.1.6 2024-09-22T08:34:12.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.536+0000 7fb54dd2e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.1.7 2024-09-22T08:34:12.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.536+0000 7fb54dd2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.1.7 2024-09-22T08:34:12.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.536+0000 7fb54dd2e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.1.8 2024-09-22T08:34:12.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.536+0000 7fb54dd2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.1.8 2024-09-22T08:34:12.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.536+0000 7fb54dd2e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.1.9 2024-09-22T08:34:12.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.536+0000 7fb54dd2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.1.9 2024-09-22T08:34:12.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.536+0000 7fb54dd2e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.1.10 2024-09-22T08:34:12.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.536+0000 7fb54dd2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.1.10 2024-09-22T08:34:12.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.536+0000 7fb54dd2e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.1.11 2024-09-22T08:34:12.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.536+0000 7fb54dd2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.1.11 2024-09-22T08:34:12.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.536+0000 7fb54dd2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.0 2024-09-22T08:34:12.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.537+0000 7fb54dd2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.1 2024-09-22T08:34:12.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.538+0000 7fb54dd2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.2 2024-09-22T08:34:12.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.538+0000 7fb54dd2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.3 2024-09-22T08:34:12.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.539+0000 7fb54dd2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.4 2024-09-22T08:34:12.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.539+0000 7fb54dd2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.5 2024-09-22T08:34:12.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.540+0000 7fb54dd2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.6 2024-09-22T08:34:12.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.541+0000 7fb54dd2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.7 2024-09-22T08:34:12.542 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.541+0000 7fb54dd2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.8 2024-09-22T08:34:12.543 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.542+0000 7fb54dd2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.9 2024-09-22T08:34:12.544 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.543+0000 7fb54dd2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.10 2024-09-22T08:34:12.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.547+0000 7fb54dd2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.24 : hit (requested=0x17, cached=0x17) 2024-09-22T08:34:12.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.547+0000 7fb54dd2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.24 2024-09-22T08:34:12.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.548+0000 7fb54dd2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.24 info.flags=0x17 2024-09-22T08:34:12.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.548+0000 7fb54dd2e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.24 to cache LRU end 2024-09-22T08:34:12.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.548+0000 7fb54dd2e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:12.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.548+0000 7fb54dd2e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.24, ofs0, ns] 2024-09-22T08:34:12.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.549+0000 7fb42cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497000 cookie 94698113126448 notifier 6239 bl.length()=925 2024-09-22T08:34:12.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.549+0000 7fb42cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.24 info.flags=0x17 2024-09-22T08:34:12.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.549+0000 7fb42cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.24 to cache LRU end 2024-09-22T08:34:12.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.549+0000 7fb42cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:12.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.549+0000 7fb54dd2e800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.24]): orig_sources= new_sources= 2024-09-22T08:34:12.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.549+0000 7fb54dd2e800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.24]): potential sources added=[] removed=[] 2024-09-22T08:34:12.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.549+0000 7fb54dd2e800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.24]): orig_dests= new_dests= 2024-09-22T08:34:12.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.549+0000 7fb54dd2e800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.24]): potential dests added=[] removed=[] 2024-09-22T08:34:12.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.552+0000 7fb54dd2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.0 2024-09-22T08:34:12.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.553+0000 7fb54dd2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.1 2024-09-22T08:34:12.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.553+0000 7fb54dd2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.2 2024-09-22T08:34:12.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.553+0000 7fb54dd2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.3 2024-09-22T08:34:12.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.554+0000 7fb54dd2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.4 2024-09-22T08:34:12.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.554+0000 7fb54dd2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.5 2024-09-22T08:34:12.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.555+0000 7fb54dd2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.6 2024-09-22T08:34:12.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.555+0000 7fb54dd2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.7 2024-09-22T08:34:12.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.556+0000 7fb54dd2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.8 2024-09-22T08:34:12.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.556+0000 7fb54dd2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.9 2024-09-22T08:34:12.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.557+0000 7fb54dd2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.24.10 2024-09-22T08:34:12.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.557+0000 7fb54dd2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.24 : hit (requested=0x17, cached=0x17) 2024-09-22T08:34:12.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.557+0000 7fb54dd2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.24 2024-09-22T08:34:12.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.558+0000 7fb54dd2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.24 info.flags=0x17 2024-09-22T08:34:12.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.558+0000 7fb54dd2e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.24 to cache LRU end 2024-09-22T08:34:12.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.558+0000 7fb54dd2e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:12.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.558+0000 7fb54dd2e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.24, ofs0, ns] 2024-09-22T08:34:12.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.559+0000 7fb42d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497001 cookie 94698113126448 notifier 6239 bl.length()=893 2024-09-22T08:34:12.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.559+0000 7fb42d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.24 info.flags=0x17 2024-09-22T08:34:12.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.559+0000 7fb42d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.24 to cache LRU end 2024-09-22T08:34:12.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.559+0000 7fb42d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:12.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.560+0000 7fb54dd2e800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.24]): orig_sources= new_sources= 2024-09-22T08:34:12.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.560+0000 7fb54dd2e800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.24]): potential sources added=[] removed=[] 2024-09-22T08:34:12.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.560+0000 7fb54dd2e800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.24]): orig_dests= new_dests= 2024-09-22T08:34:12.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.560+0000 7fb54dd2e800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.24]): potential dests added=[] removed=[] 2024-09-22T08:34:12.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.562+0000 7fb54dd2e800 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-22T08:34:12.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.564+0000 7fb3fffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:12.567 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.566+0000 7fb54dd2e800 20 remove_watcher() i=0 2024-09-22T08:34:12.567 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.566+0000 7fb54dd2e800 2 removed watcher, disabling cache 2024-09-22T08:34:12.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.568+0000 7fb54dd2e800 20 remove_watcher() i=1 2024-09-22T08:34:12.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.569+0000 7fb54dd2e800 20 remove_watcher() i=2 2024-09-22T08:34:12.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.570+0000 7fb54dd2e800 20 remove_watcher() i=3 2024-09-22T08:34:12.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.571+0000 7fb54dd2e800 20 remove_watcher() i=4 2024-09-22T08:34:12.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.572+0000 7fb54dd2e800 20 remove_watcher() i=5 2024-09-22T08:34:12.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.574+0000 7fb54dd2e800 20 remove_watcher() i=6 2024-09-22T08:34:12.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.575+0000 7fb54dd2e800 20 remove_watcher() i=7 2024-09-22T08:34:12.590 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-22T08:34:12.620 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:34:12.621 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:34:12.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.660+0000 7ff38e925800 20 rados->read ofs=0 len=0 2024-09-22T08:34:12.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.662+0000 7ff38e925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:12.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.662+0000 7ff38e925800 20 realm 2024-09-22T08:34:12.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.662+0000 7ff38e925800 20 rados->read ofs=0 len=0 2024-09-22T08:34:12.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.662+0000 7ff38e925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:12.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.662+0000 7ff38e925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:34:12.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.662+0000 7ff38e925800 20 rados->read ofs=0 len=0 2024-09-22T08:34:12.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.662+0000 7ff38e925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:12.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.662+0000 7ff38e925800 20 rados->read ofs=0 len=0 2024-09-22T08:34:12.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.663+0000 7ff38e925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:12.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.663+0000 7ff38e925800 20 rados->read ofs=0 len=0 2024-09-22T08:34:12.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.664+0000 7ff38e925800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:34:12.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.664+0000 7ff38e925800 20 searching for the correct realm 2024-09-22T08:34:12.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.666+0000 7ff389dad640 0 -- 172.21.15.38:0/4144972466 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7ff38006b020 msgr2=0x7ff3800b0190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:34:12.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.670+0000 7ff389dad640 0 -- 172.21.15.38:0/4144972466 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7ff37c03f960 msgr2=0x7ff37c023410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:34:12.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.877+0000 7ff38e925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:34:12.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.877+0000 7ff38e925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:34:12.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.877+0000 7ff38e925800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:34:12.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.877+0000 7ff38e925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:34:12.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.877+0000 7ff38e925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:34:12.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.877+0000 7ff38e925800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:34:12.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.877+0000 7ff38e925800 20 rados->read ofs=0 len=0 2024-09-22T08:34:12.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.878+0000 7ff38e925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:12.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.878+0000 7ff38e925800 20 rados->read ofs=0 len=0 2024-09-22T08:34:12.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.878+0000 7ff38e925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:12.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.878+0000 7ff38e925800 20 rados->read ofs=0 len=0 2024-09-22T08:34:12.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.878+0000 7ff38e925800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:34:12.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.878+0000 7ff38e925800 20 zone default found 2024-09-22T08:34:12.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.878+0000 7ff38e925800 4 Realm: () 2024-09-22T08:34:12.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.878+0000 7ff38e925800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:34:12.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.878+0000 7ff38e925800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:34:12.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.878+0000 7ff38e925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:34:12.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.878+0000 7ff38e925800 20 zonegroup default 2024-09-22T08:34:12.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.878+0000 7ff38e925800 20 rados->read ofs=0 len=0 2024-09-22T08:34:12.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.879+0000 7ff38e925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:12.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.879+0000 7ff38e925800 20 rados->read ofs=0 len=0 2024-09-22T08:34:12.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.879+0000 7ff38e925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:12.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.879+0000 7ff38e925800 20 rados->read ofs=0 len=0 2024-09-22T08:34:12.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.879+0000 7ff38e925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:12.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.879+0000 7ff38e925800 20 started sync module instance, tier type = 2024-09-22T08:34:12.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.879+0000 7ff38e925800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:34:12.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.889+0000 7ff38e925800 20 add_watcher() i=0 2024-09-22T08:34:12.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.889+0000 7ff38e925800 20 add_watcher() i=1 2024-09-22T08:34:12.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.889+0000 7ff38e925800 20 add_watcher() i=2 2024-09-22T08:34:12.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.889+0000 7ff38e925800 20 add_watcher() i=3 2024-09-22T08:34:12.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.889+0000 7ff38e925800 20 add_watcher() i=4 2024-09-22T08:34:12.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.889+0000 7ff38e925800 20 add_watcher() i=5 2024-09-22T08:34:12.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.889+0000 7ff38e925800 20 add_watcher() i=6 2024-09-22T08:34:12.892 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.891+0000 7ff38e925800 20 add_watcher() i=7 2024-09-22T08:34:12.892 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.891+0000 7ff38e925800 2 all 8 watchers are set, enabling cache 2024-09-22T08:34:12.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.893+0000 7ff240fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:12.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.893+0000 7ff38e925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:34:12.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.893+0000 7ff38e925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:34:12.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.893+0000 7ff38e925800 5 note: GC not initialized 2024-09-22T08:34:12.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.893+0000 7ff1bb7fe640 20 reqs_thread_entry: start 2024-09-22T08:34:12.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.893+0000 7ff38e925800 20 init_complete bucket index max shards: 11 2024-09-22T08:34:12.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.893+0000 7ff38e925800 20 Filter name: none 2024-09-22T08:34:12.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.893+0000 7ff1b97fa640 20 reqs_thread_entry: start 2024-09-22T08:34:12.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.893+0000 7ff38e925800 20 rados->read ofs=0 len=0 2024-09-22T08:34:12.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.894+0000 7ff38e925800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T08:34:12.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.894+0000 7ff38e925800 20 rados->read ofs=0 len=0 2024-09-22T08:34:12.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.895+0000 7ff38e925800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T08:34:12.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.895+0000 7ff38e925800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:34:12.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.895+0000 7ff38e925800 20 rados->read ofs=0 len=0 2024-09-22T08:34:12.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.895+0000 7ff38e925800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T08:34:12.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.895+0000 7ff38e925800 20 rados->read ofs=0 len=0 2024-09-22T08:34:12.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.895+0000 7ff38e925800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T08:34:12.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.895+0000 7ff38e925800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:34:12.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.897+0000 7ff240fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:12.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.900+0000 7ff38e925800 20 remove_watcher() i=0 2024-09-22T08:34:12.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.900+0000 7ff38e925800 2 removed watcher, disabling cache 2024-09-22T08:34:12.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.901+0000 7ff38e925800 20 remove_watcher() i=1 2024-09-22T08:34:12.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.902+0000 7ff38e925800 20 remove_watcher() i=2 2024-09-22T08:34:12.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.903+0000 7ff38e925800 20 remove_watcher() i=3 2024-09-22T08:34:12.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.904+0000 7ff38e925800 20 remove_watcher() i=4 2024-09-22T08:34:12.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.906+0000 7ff38e925800 20 remove_watcher() i=5 2024-09-22T08:34:12.907 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.907+0000 7ff38e925800 20 remove_watcher() i=6 2024-09-22T08:34:12.909 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:12.908+0000 7ff38e925800 20 remove_watcher() i=7 2024-09-22T08:34:12.920 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:12.920 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:34:12.920 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-set-target-layout id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.24 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-22T08:34:12.920 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:12.922 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:12.922 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:12.926 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:12.926 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:12.968 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:12.968 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:12.998 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-22T08:34:12.998 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:12.999 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:12.999 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:13.013 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:13.013 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:13.056 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:13.056 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:13.063 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:13.063 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:13.070 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:13.070 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:13.076 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:13.077 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:13.082 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:13.082 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:13.089 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:13.089 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:13.095 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:13.095 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:13.101 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:13.101 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:13.107 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:13.107 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:13.112 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:13.112 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:13.118 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:13.118 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:13.124 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:13.124 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:13.131 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:13.131 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:13.137 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:13.137 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:13.144 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:13.144 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:13.184 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:13.184 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:13.191 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:13.191 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:13.197 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:13.197 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:13.204 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:13.204 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:13.210 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:13.210 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:13.216 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-22T08:34:13.246 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:34:13.246 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:34:13.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.284+0000 7fe500698800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.286+0000 7fe500698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:13.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.286+0000 7fe500698800 20 realm 2024-09-22T08:34:13.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.286+0000 7fe500698800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.286+0000 7fe500698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:13.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.286+0000 7fe500698800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:34:13.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.286+0000 7fe500698800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.286+0000 7fe500698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:13.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.286+0000 7fe500698800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.287+0000 7fe500698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:13.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.287+0000 7fe500698800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.288+0000 7fe500698800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:34:13.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.288+0000 7fe500698800 20 searching for the correct realm 2024-09-22T08:34:13.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.290+0000 7fe4fe983640 0 -- 172.21.15.38:0/63572037 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7fe4f006a070 msgr2=0x7fe4f00634a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:34:13.498 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.497+0000 7fe4fe983640 0 -- 172.21.15.38:0/63572037 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x55eba3b1bac0 msgr2=0x55eba3b1df50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:34:13.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.501+0000 7fe500698800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:34:13.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.501+0000 7fe500698800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:34:13.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.501+0000 7fe500698800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:34:13.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.501+0000 7fe500698800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:34:13.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.501+0000 7fe500698800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:34:13.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.501+0000 7fe500698800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:34:13.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.501+0000 7fe500698800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.501+0000 7fe500698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:13.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.501+0000 7fe500698800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.501+0000 7fe500698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:13.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.501+0000 7fe500698800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.502+0000 7fe500698800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:34:13.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.502+0000 7fe500698800 20 zone default found 2024-09-22T08:34:13.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.502+0000 7fe500698800 4 Realm: () 2024-09-22T08:34:13.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.502+0000 7fe500698800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:34:13.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.502+0000 7fe500698800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:34:13.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.502+0000 7fe500698800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:34:13.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.502+0000 7fe500698800 20 zonegroup default 2024-09-22T08:34:13.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.502+0000 7fe500698800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.502+0000 7fe500698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:13.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.502+0000 7fe500698800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.503+0000 7fe500698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:13.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.503+0000 7fe500698800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.503+0000 7fe500698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:13.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.503+0000 7fe500698800 20 started sync module instance, tier type = 2024-09-22T08:34:13.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.503+0000 7fe500698800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:34:13.513 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.512+0000 7fe500698800 20 add_watcher() i=0 2024-09-22T08:34:13.513 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.512+0000 7fe500698800 20 add_watcher() i=1 2024-09-22T08:34:13.513 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.512+0000 7fe500698800 20 add_watcher() i=2 2024-09-22T08:34:13.513 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.512+0000 7fe500698800 20 add_watcher() i=3 2024-09-22T08:34:13.513 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.512+0000 7fe500698800 20 add_watcher() i=4 2024-09-22T08:34:13.513 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.512+0000 7fe500698800 20 add_watcher() i=5 2024-09-22T08:34:13.513 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.512+0000 7fe500698800 20 add_watcher() i=6 2024-09-22T08:34:13.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.513+0000 7fe500698800 20 add_watcher() i=7 2024-09-22T08:34:13.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.513+0000 7fe500698800 2 all 8 watchers are set, enabling cache 2024-09-22T08:34:13.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.515+0000 7fe3b4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:13.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.515+0000 7fe500698800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:34:13.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.515+0000 7fe500698800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:34:13.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.515+0000 7fe500698800 5 note: GC not initialized 2024-09-22T08:34:13.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.515+0000 7fe32f7fe640 20 reqs_thread_entry: start 2024-09-22T08:34:13.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.516+0000 7fe500698800 20 init_complete bucket index max shards: 11 2024-09-22T08:34:13.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.516+0000 7fe500698800 20 Filter name: none 2024-09-22T08:34:13.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.516+0000 7fe32d7fa640 20 reqs_thread_entry: start 2024-09-22T08:34:13.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.516+0000 7fe500698800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.516+0000 7fe500698800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T08:34:13.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.516+0000 7fe500698800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.517+0000 7fe500698800 20 rados_obj.operate() r=0 bl.length=423 2024-09-22T08:34:13.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.517+0000 7fe500698800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:34:13.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.517+0000 7fe500698800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.517+0000 7fe500698800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T08:34:13.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.517+0000 7fe500698800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.518+0000 7fe500698800 20 rados_obj.operate() r=0 bl.length=423 2024-09-22T08:34:13.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.518+0000 7fe500698800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:34:13.521 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.520+0000 7fe3b4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:13.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.522+0000 7fe500698800 20 remove_watcher() i=0 2024-09-22T08:34:13.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.522+0000 7fe500698800 2 removed watcher, disabling cache 2024-09-22T08:34:13.524 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.523+0000 7fe500698800 20 remove_watcher() i=1 2024-09-22T08:34:13.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.524+0000 7fe500698800 20 remove_watcher() i=2 2024-09-22T08:34:13.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.525+0000 7fe500698800 20 remove_watcher() i=3 2024-09-22T08:34:13.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.526+0000 7fe500698800 20 remove_watcher() i=4 2024-09-22T08:34:13.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.527+0000 7fe500698800 20 remove_watcher() i=5 2024-09-22T08:34:13.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.528+0000 7fe500698800 20 remove_watcher() i=6 2024-09-22T08:34:13.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.530+0000 7fe500698800 20 remove_watcher() i=7 2024-09-22T08:34:13.542 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:13.542 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:34:13.542 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-trim-reshard-log-entries id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:34:13.542 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:13.544 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-22T08:34:13.579 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:34:13.579 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:34:13.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.618+0000 7fe7add28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.620+0000 7fe7add28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:13.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.620+0000 7fe7add28800 20 realm 2024-09-22T08:34:13.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.620+0000 7fe7add28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.620+0000 7fe7add28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:13.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.620+0000 7fe7add28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:34:13.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.620+0000 7fe7add28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.620+0000 7fe7add28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:13.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.620+0000 7fe7add28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.621+0000 7fe7add28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:13.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.621+0000 7fe7add28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.622+0000 7fe7add28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:34:13.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.622+0000 7fe7add28800 20 searching for the correct realm 2024-09-22T08:34:13.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.625+0000 7fe7aa270640 0 -- 172.21.15.38:0/1505512802 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7fe79c08b350 msgr2=0x7fe79c089dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:34:13.629 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.628+0000 7fe7a9a6f640 0 -- 172.21.15.38:0/1505512802 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x55f1f36ef260 msgr2=0x55f1f36f1690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:34:13.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.633+0000 7fe7add28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:34:13.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.633+0000 7fe7add28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:34:13.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.633+0000 7fe7add28800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:34:13.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.633+0000 7fe7add28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:34:13.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.633+0000 7fe7add28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:34:13.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.633+0000 7fe7add28800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:34:13.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.633+0000 7fe7add28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.633+0000 7fe7add28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:13.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.633+0000 7fe7add28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.633+0000 7fe7add28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:13.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.633+0000 7fe7add28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.637 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.634+0000 7fe7add28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:34:13.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.634+0000 7fe7add28800 20 zone default found 2024-09-22T08:34:13.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.634+0000 7fe7add28800 4 Realm: () 2024-09-22T08:34:13.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.634+0000 7fe7add28800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:34:13.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.634+0000 7fe7add28800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:34:13.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.634+0000 7fe7add28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:34:13.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.634+0000 7fe7add28800 20 zonegroup default 2024-09-22T08:34:13.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.634+0000 7fe7add28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.634+0000 7fe7add28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:13.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.634+0000 7fe7add28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.634+0000 7fe7add28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:13.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.634+0000 7fe7add28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.634+0000 7fe7add28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:13.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.634+0000 7fe7add28800 20 started sync module instance, tier type = 2024-09-22T08:34:13.639 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.634+0000 7fe7add28800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:34:13.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.643+0000 7fe7add28800 20 add_watcher() i=0 2024-09-22T08:34:13.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.643+0000 7fe7add28800 20 add_watcher() i=1 2024-09-22T08:34:13.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.643+0000 7fe7add28800 20 add_watcher() i=2 2024-09-22T08:34:13.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.643+0000 7fe7add28800 20 add_watcher() i=3 2024-09-22T08:34:13.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.643+0000 7fe7add28800 20 add_watcher() i=4 2024-09-22T08:34:13.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.643+0000 7fe7add28800 20 add_watcher() i=5 2024-09-22T08:34:13.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.643+0000 7fe7add28800 20 add_watcher() i=6 2024-09-22T08:34:13.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.644+0000 7fe7add28800 20 add_watcher() i=7 2024-09-22T08:34:13.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.644+0000 7fe7add28800 2 all 8 watchers are set, enabling cache 2024-09-22T08:34:13.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.646+0000 7fe65ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:13.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.646+0000 7fe7add28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:34:13.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.646+0000 7fe7add28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:34:13.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.646+0000 7fe7add28800 5 note: GC not initialized 2024-09-22T08:34:13.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.646+0000 7fe65efe5640 20 reqs_thread_entry: start 2024-09-22T08:34:13.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.646+0000 7fe7add28800 20 init_complete bucket index max shards: 11 2024-09-22T08:34:13.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.646+0000 7fe7add28800 20 Filter name: none 2024-09-22T08:34:13.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.647+0000 7fe65cfe1640 20 reqs_thread_entry: start 2024-09-22T08:34:13.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.647+0000 7fe7add28800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-22T08:34:13.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.647+0000 7fe7add28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.647+0000 7fe7add28800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T08:34:13.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.647+0000 7fe7add28800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-22T08:34:13.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.647+0000 7fe7add28800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-22T08:34:13.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.647+0000 7fe7add28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.25 : miss 2024-09-22T08:34:13.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.647+0000 7fe7add28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.647+0000 7fe7add28800 20 rados_obj.operate() r=0 bl.length=423 2024-09-22T08:34:13.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.647+0000 7fe7add28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.25 info.flags=0x17 2024-09-22T08:34:13.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.647+0000 7fe7add28800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.25 to cache LRU end 2024-09-22T08:34:13.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.647+0000 7fe7add28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:34:13.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.647+0000 7fe7add28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:13.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.647+0000 7fe7add28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.25 2024-09-22T08:34:13.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.652+0000 7fe7add28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.25 info.flags=0x17 2024-09-22T08:34:13.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.652+0000 7fe7add28800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.25 to cache LRU end 2024-09-22T08:34:13.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.652+0000 7fe7add28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:13.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.652+0000 7fe7add28800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.25, ofs0, ns] 2024-09-22T08:34:13.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.653+0000 7fe68cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496980 cookie 94497659619616 notifier 6293 bl.length()=939 2024-09-22T08:34:13.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.653+0000 7fe68cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.25 info.flags=0x17 2024-09-22T08:34:13.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.653+0000 7fe68cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.25 to cache LRU end 2024-09-22T08:34:13.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.653+0000 7fe68cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:13.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.653+0000 7fe7add28800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.25]): orig_sources= new_sources= 2024-09-22T08:34:13.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.653+0000 7fe7add28800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.25]): potential sources added=[] removed=[] 2024-09-22T08:34:13.655 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.653+0000 7fe7add28800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.25]): orig_dests= new_dests= 2024-09-22T08:34:13.655 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.653+0000 7fe7add28800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.25]): potential dests added=[] removed=[] 2024-09-22T08:34:13.655 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.653+0000 7fe7add28800 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-22T08:34:13.655 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.653+0000 7fe7add28800 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-22T08:34:13.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.655+0000 7fe65ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:13.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.657+0000 7fe7add28800 20 remove_watcher() i=0 2024-09-22T08:34:13.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.657+0000 7fe7add28800 2 removed watcher, disabling cache 2024-09-22T08:34:13.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.658+0000 7fe7add28800 20 remove_watcher() i=1 2024-09-22T08:34:13.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.659+0000 7fe7add28800 20 remove_watcher() i=2 2024-09-22T08:34:13.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.660+0000 7fe7add28800 20 remove_watcher() i=3 2024-09-22T08:34:13.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.661+0000 7fe7add28800 20 remove_watcher() i=4 2024-09-22T08:34:13.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.662+0000 7fe7add28800 20 remove_watcher() i=5 2024-09-22T08:34:13.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.663+0000 7fe7add28800 20 remove_watcher() i=6 2024-09-22T08:34:13.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.664+0000 7fe7add28800 20 remove_watcher() i=7 2024-09-22T08:34:13.677 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-22T08:34:13.708 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:34:13.708 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:34:13.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.746+0000 7fee06898800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.748+0000 7fee06898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:13.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.748+0000 7fee06898800 20 realm 2024-09-22T08:34:13.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.748+0000 7fee06898800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.748+0000 7fee06898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:13.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.748+0000 7fee06898800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:34:13.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.748+0000 7fee06898800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.748+0000 7fee06898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:13.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.748+0000 7fee06898800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.749+0000 7fee06898800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:13.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.749+0000 7fee06898800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.750+0000 7fee06898800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:34:13.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.750+0000 7fee06898800 20 searching for the correct realm 2024-09-22T08:34:13.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.752+0000 7fee03b81640 0 -- 172.21.15.38:0/3171087740 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7fedf806d0a0 msgr2=0x7fedf8073a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:34:13.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.756+0000 7fee03b81640 0 -- 172.21.15.38:0/3171087740 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fedf406d040 msgr2=0x7fedf407a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:34:13.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.963+0000 7fee06898800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:34:13.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.963+0000 7fee06898800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:34:13.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.963+0000 7fee06898800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:34:13.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.963+0000 7fee06898800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:34:13.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.963+0000 7fee06898800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:34:13.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.963+0000 7fee06898800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:34:13.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.963+0000 7fee06898800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.963+0000 7fee06898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:13.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.963+0000 7fee06898800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.964+0000 7fee06898800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:13.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.964+0000 7fee06898800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.964+0000 7fee06898800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:34:13.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.964+0000 7fee06898800 20 zone default found 2024-09-22T08:34:13.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.964+0000 7fee06898800 4 Realm: () 2024-09-22T08:34:13.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.964+0000 7fee06898800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:34:13.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.964+0000 7fee06898800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:34:13.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.964+0000 7fee06898800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:34:13.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.964+0000 7fee06898800 20 zonegroup default 2024-09-22T08:34:13.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.964+0000 7fee06898800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.964+0000 7fee06898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:13.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.964+0000 7fee06898800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.967 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.964+0000 7fee06898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:13.967 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.964+0000 7fee06898800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.967 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.965+0000 7fee06898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:13.967 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.965+0000 7fee06898800 20 started sync module instance, tier type = 2024-09-22T08:34:13.967 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.965+0000 7fee06898800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:34:13.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.974+0000 7fee06898800 20 add_watcher() i=0 2024-09-22T08:34:13.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.974+0000 7fee06898800 20 add_watcher() i=1 2024-09-22T08:34:13.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.974+0000 7fee06898800 20 add_watcher() i=2 2024-09-22T08:34:13.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.974+0000 7fee06898800 20 add_watcher() i=3 2024-09-22T08:34:13.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.974+0000 7fee06898800 20 add_watcher() i=4 2024-09-22T08:34:13.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.974+0000 7fee06898800 20 add_watcher() i=5 2024-09-22T08:34:13.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.974+0000 7fee06898800 20 add_watcher() i=6 2024-09-22T08:34:13.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.975+0000 7fee06898800 20 add_watcher() i=7 2024-09-22T08:34:13.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.975+0000 7fee06898800 2 all 8 watchers are set, enabling cache 2024-09-22T08:34:13.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.977+0000 7fecbafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:13.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.978+0000 7fee06898800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:34:13.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.978+0000 7fee06898800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:34:13.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.978+0000 7fee06898800 5 note: GC not initialized 2024-09-22T08:34:13.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.978+0000 7fecb9fdb640 20 reqs_thread_entry: start 2024-09-22T08:34:13.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.978+0000 7fee06898800 20 init_complete bucket index max shards: 11 2024-09-22T08:34:13.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.978+0000 7fee06898800 20 Filter name: none 2024-09-22T08:34:13.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.978+0000 7fec2b7fe640 20 reqs_thread_entry: start 2024-09-22T08:34:13.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.978+0000 7fee06898800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.979+0000 7fee06898800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T08:34:13.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.979+0000 7fee06898800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.980+0000 7fee06898800 20 rados_obj.operate() r=0 bl.length=455 2024-09-22T08:34:13.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.980+0000 7fee06898800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:34:13.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.980+0000 7fee06898800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.980+0000 7fee06898800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T08:34:13.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.980+0000 7fee06898800 20 rados->read ofs=0 len=0 2024-09-22T08:34:13.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.980+0000 7fee06898800 20 rados_obj.operate() r=0 bl.length=455 2024-09-22T08:34:13.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.980+0000 7fee06898800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:34:13.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.982+0000 7fecbafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:13.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.985+0000 7fee06898800 20 remove_watcher() i=0 2024-09-22T08:34:13.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.985+0000 7fee06898800 2 removed watcher, disabling cache 2024-09-22T08:34:13.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.986+0000 7fee06898800 20 remove_watcher() i=1 2024-09-22T08:34:13.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.987+0000 7fee06898800 20 remove_watcher() i=2 2024-09-22T08:34:13.989 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.988+0000 7fee06898800 20 remove_watcher() i=3 2024-09-22T08:34:13.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.989+0000 7fee06898800 20 remove_watcher() i=4 2024-09-22T08:34:13.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.990+0000 7fee06898800 20 remove_watcher() i=5 2024-09-22T08:34:13.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.992+0000 7fee06898800 20 remove_watcher() i=6 2024-09-22T08:34:13.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:13.993+0000 7fee06898800 20 remove_watcher() i=7 2024-09-22T08:34:14.005 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:14.005 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:34:14.005 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-trim-reshard-log-entries id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:34:14.006 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:14.007 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:14.007 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:14.013 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:14.013 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:14.057 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:34:14.091 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:34:14.091 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:34:14.131 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.130+0000 7fbe7b975800 20 rados->read ofs=0 len=0 2024-09-22T08:34:14.133 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.132+0000 7fbe7b975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:14.133 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.132+0000 7fbe7b975800 20 realm 2024-09-22T08:34:14.133 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.132+0000 7fbe7b975800 20 rados->read ofs=0 len=0 2024-09-22T08:34:14.133 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.132+0000 7fbe7b975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:14.133 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.132+0000 7fbe7b975800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:34:14.134 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.132+0000 7fbe7b975800 20 rados->read ofs=0 len=0 2024-09-22T08:34:14.134 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.132+0000 7fbe7b975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:14.134 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.132+0000 7fbe7b975800 20 rados->read ofs=0 len=0 2024-09-22T08:34:14.134 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.133+0000 7fbe7b975800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:14.134 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.133+0000 7fbe7b975800 20 rados->read ofs=0 len=0 2024-09-22T08:34:14.135 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.134+0000 7fbe7b975800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:34:14.135 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.134+0000 7fbe7b975800 20 searching for the correct realm 2024-09-22T08:34:14.137 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.136+0000 7fbe7945f640 0 -- 172.21.15.38:0/1688297609 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x565190277eb0 msgr2=0x56519027a370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:34:14.140 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.140+0000 7fbe78c5e640 0 -- 172.21.15.38:0/1688297609 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fbe6c062330 msgr2=0x7fbe6c06bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:34:14.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.347+0000 7fbe7b975800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:34:14.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.348+0000 7fbe7b975800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:34:14.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.348+0000 7fbe7b975800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:34:14.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.348+0000 7fbe7b975800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:34:14.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.348+0000 7fbe7b975800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:34:14.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.348+0000 7fbe7b975800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:34:14.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.348+0000 7fbe7b975800 20 rados->read ofs=0 len=0 2024-09-22T08:34:14.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.348+0000 7fbe7b975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:14.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.348+0000 7fbe7b975800 20 rados->read ofs=0 len=0 2024-09-22T08:34:14.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.348+0000 7fbe7b975800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:14.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.348+0000 7fbe7b975800 20 rados->read ofs=0 len=0 2024-09-22T08:34:14.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.349+0000 7fbe7b975800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:34:14.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.349+0000 7fbe7b975800 20 zone default found 2024-09-22T08:34:14.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.349+0000 7fbe7b975800 4 Realm: () 2024-09-22T08:34:14.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.349+0000 7fbe7b975800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:34:14.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.349+0000 7fbe7b975800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:34:14.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.349+0000 7fbe7b975800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:34:14.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.349+0000 7fbe7b975800 20 zonegroup default 2024-09-22T08:34:14.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.349+0000 7fbe7b975800 20 rados->read ofs=0 len=0 2024-09-22T08:34:14.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.349+0000 7fbe7b975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:14.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.349+0000 7fbe7b975800 20 rados->read ofs=0 len=0 2024-09-22T08:34:14.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.350+0000 7fbe7b975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:14.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.350+0000 7fbe7b975800 20 rados->read ofs=0 len=0 2024-09-22T08:34:14.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.350+0000 7fbe7b975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:14.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.350+0000 7fbe7b975800 20 started sync module instance, tier type = 2024-09-22T08:34:14.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.350+0000 7fbe7b975800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:34:14.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.360+0000 7fbe7b975800 20 add_watcher() i=0 2024-09-22T08:34:14.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.360+0000 7fbe7b975800 20 add_watcher() i=1 2024-09-22T08:34:14.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.360+0000 7fbe7b975800 20 add_watcher() i=2 2024-09-22T08:34:14.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.360+0000 7fbe7b975800 20 add_watcher() i=3 2024-09-22T08:34:14.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.360+0000 7fbe7b975800 20 add_watcher() i=4 2024-09-22T08:34:14.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.360+0000 7fbe7b975800 20 add_watcher() i=5 2024-09-22T08:34:14.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.360+0000 7fbe7b975800 20 add_watcher() i=6 2024-09-22T08:34:14.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.361+0000 7fbe7b975800 20 add_watcher() i=7 2024-09-22T08:34:14.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.361+0000 7fbe7b975800 2 all 8 watchers are set, enabling cache 2024-09-22T08:34:14.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.362+0000 7fbd2ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:14.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.363+0000 7fbe7b975800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:34:14.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.363+0000 7fbe7b975800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:34:14.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.363+0000 7fbe7b975800 5 note: GC not initialized 2024-09-22T08:34:14.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.363+0000 7fbd2efe5640 20 reqs_thread_entry: start 2024-09-22T08:34:14.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.363+0000 7fbe7b975800 20 init_complete bucket index max shards: 11 2024-09-22T08:34:14.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.363+0000 7fbe7b975800 20 Filter name: none 2024-09-22T08:34:14.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.363+0000 7fbd2cfe1640 20 reqs_thread_entry: start 2024-09-22T08:34:14.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.363+0000 7fbe7b975800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-22T08:34:14.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.363+0000 7fbe7b975800 20 rados->read ofs=0 len=0 2024-09-22T08:34:14.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.364+0000 7fbe7b975800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T08:34:14.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.364+0000 7fbe7b975800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-22T08:34:14.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.364+0000 7fbe7b975800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-22T08:34:14.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.364+0000 7fbe7b975800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.25 : miss 2024-09-22T08:34:14.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.364+0000 7fbe7b975800 20 rados->read ofs=0 len=0 2024-09-22T08:34:14.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.364+0000 7fbe7b975800 20 rados_obj.operate() r=0 bl.length=455 2024-09-22T08:34:14.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.364+0000 7fbe7b975800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.25 info.flags=0x17 2024-09-22T08:34:14.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.364+0000 7fbe7b975800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.25 to cache LRU end 2024-09-22T08:34:14.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.364+0000 7fbe7b975800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:34:14.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.364+0000 7fbe7b975800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:14.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.364+0000 7fbe7b975800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.25 2024-09-22T08:34:14.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.366+0000 7fbe7b975800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-22T08:34:14.373 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.372+0000 7fbe7b975800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.25 info.flags=0x17 2024-09-22T08:34:14.373 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.372+0000 7fbe7b975800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.25 to cache LRU end 2024-09-22T08:34:14.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.372+0000 7fbe7b975800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:14.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.372+0000 7fbe7b975800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.25, ofs0, ns] 2024-09-22T08:34:14.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.373+0000 7fbd4bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496981 cookie 94908310852944 notifier 6681 bl.length()=939 2024-09-22T08:34:14.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.373+0000 7fbd4bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.25 info.flags=0x17 2024-09-22T08:34:14.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.373+0000 7fbd4bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.25 to cache LRU end 2024-09-22T08:34:14.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.373+0000 7fbd4bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:14.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.373+0000 7fbe7b975800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.25]): orig_sources= new_sources= 2024-09-22T08:34:14.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.373+0000 7fbe7b975800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.25]): potential sources added=[] removed=[] 2024-09-22T08:34:14.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.373+0000 7fbe7b975800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.25]): orig_dests= new_dests= 2024-09-22T08:34:14.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.373+0000 7fbe7b975800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.25]): potential dests added=[] removed=[] 2024-09-22T08:34:14.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.379+0000 7fbe7b975800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.2.0 2024-09-22T08:34:14.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.379+0000 7fbe7b975800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.2.0 2024-09-22T08:34:14.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.379+0000 7fbe7b975800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.2.1 2024-09-22T08:34:14.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.379+0000 7fbe7b975800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.2.1 2024-09-22T08:34:14.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.379+0000 7fbe7b975800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.2.2 2024-09-22T08:34:14.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.379+0000 7fbe7b975800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.2.2 2024-09-22T08:34:14.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.379+0000 7fbe7b975800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.2.3 2024-09-22T08:34:14.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.379+0000 7fbe7b975800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.2.3 2024-09-22T08:34:14.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.379+0000 7fbe7b975800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.2.4 2024-09-22T08:34:14.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.379+0000 7fbe7b975800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.2.4 2024-09-22T08:34:14.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.379+0000 7fbe7b975800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.2.5 2024-09-22T08:34:14.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.379+0000 7fbe7b975800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.2.5 2024-09-22T08:34:14.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.379+0000 7fbe7b975800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.2.6 2024-09-22T08:34:14.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.379+0000 7fbe7b975800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.2.6 2024-09-22T08:34:14.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.379+0000 7fbe7b975800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.2.7 2024-09-22T08:34:14.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.379+0000 7fbe7b975800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.2.7 2024-09-22T08:34:14.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.379+0000 7fbe7b975800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.2.8 2024-09-22T08:34:14.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.379+0000 7fbe7b975800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.2.8 2024-09-22T08:34:14.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.379+0000 7fbe7b975800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.2.9 2024-09-22T08:34:14.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.379+0000 7fbe7b975800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.2.9 2024-09-22T08:34:14.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.379+0000 7fbe7b975800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.2.10 2024-09-22T08:34:14.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.379+0000 7fbe7b975800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.2.10 2024-09-22T08:34:14.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.379+0000 7fbe7b975800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.2.11 2024-09-22T08:34:14.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.379+0000 7fbe7b975800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.2.11 2024-09-22T08:34:14.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.379+0000 7fbe7b975800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.0 2024-09-22T08:34:14.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.379+0000 7fbe7b975800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.1 2024-09-22T08:34:14.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.380+0000 7fbe7b975800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.2 2024-09-22T08:34:14.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.381+0000 7fbe7b975800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.3 2024-09-22T08:34:14.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.381+0000 7fbe7b975800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.4 2024-09-22T08:34:14.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.382+0000 7fbe7b975800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.5 2024-09-22T08:34:14.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.382+0000 7fbe7b975800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.6 2024-09-22T08:34:14.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.383+0000 7fbe7b975800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.7 2024-09-22T08:34:14.384 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.383+0000 7fbe7b975800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.8 2024-09-22T08:34:14.385 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.384+0000 7fbe7b975800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.9 2024-09-22T08:34:14.385 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.385+0000 7fbe7b975800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.10 2024-09-22T08:34:14.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.388+0000 7fbe7b975800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.25 : hit (requested=0x17, cached=0x17) 2024-09-22T08:34:14.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.388+0000 7fbe7b975800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.25 2024-09-22T08:34:14.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.389+0000 7fbe7b975800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.25 info.flags=0x17 2024-09-22T08:34:14.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.389+0000 7fbe7b975800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.25 to cache LRU end 2024-09-22T08:34:14.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.389+0000 7fbe7b975800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:14.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.389+0000 7fbe7b975800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.25, ofs0, ns] 2024-09-22T08:34:14.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.389+0000 7fbd4bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496982 cookie 94908310852944 notifier 6681 bl.length()=939 2024-09-22T08:34:14.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.389+0000 7fbd4bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.25 info.flags=0x17 2024-09-22T08:34:14.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.389+0000 7fbd4bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.25 to cache LRU end 2024-09-22T08:34:14.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.389+0000 7fbd4bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:14.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.390+0000 7fbe7b975800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.25]): orig_sources= new_sources= 2024-09-22T08:34:14.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.390+0000 7fbe7b975800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.25]): potential sources added=[] removed=[] 2024-09-22T08:34:14.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.390+0000 7fbe7b975800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.25]): orig_dests= new_dests= 2024-09-22T08:34:14.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.390+0000 7fbe7b975800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.25]): potential dests added=[] removed=[] 2024-09-22T08:34:14.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.392+0000 7fbe7b975800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.0 2024-09-22T08:34:14.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.393+0000 7fbe7b975800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.1 2024-09-22T08:34:14.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.393+0000 7fbe7b975800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.2 2024-09-22T08:34:14.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.394+0000 7fbe7b975800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.3 2024-09-22T08:34:14.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.394+0000 7fbe7b975800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.4 2024-09-22T08:34:14.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.394+0000 7fbe7b975800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.5 2024-09-22T08:34:14.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.394+0000 7fbe7b975800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.6 2024-09-22T08:34:14.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.395+0000 7fbe7b975800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.7 2024-09-22T08:34:14.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.395+0000 7fbe7b975800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.8 2024-09-22T08:34:14.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.396+0000 7fbe7b975800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.9 2024-09-22T08:34:14.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.396+0000 7fbe7b975800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.25.10 2024-09-22T08:34:14.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.397+0000 7fbe7b975800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.25 : hit (requested=0x17, cached=0x17) 2024-09-22T08:34:14.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.397+0000 7fbe7b975800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.25 2024-09-22T08:34:14.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.398+0000 7fbe7b975800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.25 info.flags=0x17 2024-09-22T08:34:14.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.398+0000 7fbe7b975800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.25 to cache LRU end 2024-09-22T08:34:14.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.398+0000 7fbe7b975800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:14.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.398+0000 7fbe7b975800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.25, ofs0, ns] 2024-09-22T08:34:14.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.399+0000 7fbd4bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496983 cookie 94908310852944 notifier 6681 bl.length()=907 2024-09-22T08:34:14.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.399+0000 7fbd4bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.25 info.flags=0x17 2024-09-22T08:34:14.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.399+0000 7fbd4bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.25 to cache LRU end 2024-09-22T08:34:14.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.399+0000 7fbd4bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:14.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.399+0000 7fbe7b975800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.25]): orig_sources= new_sources= 2024-09-22T08:34:14.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.399+0000 7fbe7b975800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.25]): potential sources added=[] removed=[] 2024-09-22T08:34:14.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.399+0000 7fbe7b975800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.25]): orig_dests= new_dests= 2024-09-22T08:34:14.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.399+0000 7fbe7b975800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.25]): potential dests added=[] removed=[] 2024-09-22T08:34:14.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.402+0000 7fbe7b975800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-22T08:34:14.404 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.404+0000 7fbd2ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:14.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.406+0000 7fbe7b975800 20 remove_watcher() i=0 2024-09-22T08:34:14.407 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.406+0000 7fbe7b975800 2 removed watcher, disabling cache 2024-09-22T08:34:14.407 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.407+0000 7fbe7b975800 20 remove_watcher() i=1 2024-09-22T08:34:14.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.408+0000 7fbe7b975800 20 remove_watcher() i=2 2024-09-22T08:34:14.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.409+0000 7fbe7b975800 20 remove_watcher() i=3 2024-09-22T08:34:14.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.410+0000 7fbe7b975800 20 remove_watcher() i=4 2024-09-22T08:34:14.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.411+0000 7fbe7b975800 20 remove_watcher() i=5 2024-09-22T08:34:14.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.412+0000 7fbe7b975800 20 remove_watcher() i=6 2024-09-22T08:34:14.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.413+0000 7fbe7b975800 20 remove_watcher() i=7 2024-09-22T08:34:14.426 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-22T08:34:14.455 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:34:14.456 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:34:14.495 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.494+0000 7f23e9a0e800 20 rados->read ofs=0 len=0 2024-09-22T08:34:14.497 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.496+0000 7f23e9a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:14.497 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.496+0000 7f23e9a0e800 20 realm 2024-09-22T08:34:14.497 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.496+0000 7f23e9a0e800 20 rados->read ofs=0 len=0 2024-09-22T08:34:14.497 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.496+0000 7f23e9a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:14.497 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.496+0000 7f23e9a0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:34:14.497 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.496+0000 7f23e9a0e800 20 rados->read ofs=0 len=0 2024-09-22T08:34:14.497 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.496+0000 7f23e9a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:14.498 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.496+0000 7f23e9a0e800 20 rados->read ofs=0 len=0 2024-09-22T08:34:14.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.497+0000 7f23e9a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:14.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.497+0000 7f23e9a0e800 20 rados->read ofs=0 len=0 2024-09-22T08:34:14.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.498+0000 7f23e9a0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:34:14.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.498+0000 7f23e9a0e800 20 searching for the correct realm 2024-09-22T08:34:14.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.500+0000 7f23e5059640 0 -- 172.21.15.38:0/4016834698 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x55f10cbe1bf0 msgr2=0x55f10cbe4080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:34:14.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.503+0000 7f23dffff640 0 -- 172.21.15.38:0/4016834698 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f23d8093950 msgr2=0x7f23d8073420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:34:14.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.710+0000 7f23e9a0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:34:14.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.710+0000 7f23e9a0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:34:14.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.710+0000 7f23e9a0e800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:34:14.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.710+0000 7f23e9a0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:34:14.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.710+0000 7f23e9a0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:34:14.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.710+0000 7f23e9a0e800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:34:14.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.710+0000 7f23e9a0e800 20 rados->read ofs=0 len=0 2024-09-22T08:34:14.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.710+0000 7f23e9a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:14.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.710+0000 7f23e9a0e800 20 rados->read ofs=0 len=0 2024-09-22T08:34:14.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.710+0000 7f23e9a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:14.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.710+0000 7f23e9a0e800 20 rados->read ofs=0 len=0 2024-09-22T08:34:14.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.711+0000 7f23e9a0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:34:14.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.711+0000 7f23e9a0e800 20 zone default found 2024-09-22T08:34:14.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.711+0000 7f23e9a0e800 4 Realm: () 2024-09-22T08:34:14.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.711+0000 7f23e9a0e800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:34:14.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.711+0000 7f23e9a0e800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:34:14.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.711+0000 7f23e9a0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:34:14.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.711+0000 7f23e9a0e800 20 zonegroup default 2024-09-22T08:34:14.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.711+0000 7f23e9a0e800 20 rados->read ofs=0 len=0 2024-09-22T08:34:14.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.711+0000 7f23e9a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:14.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.711+0000 7f23e9a0e800 20 rados->read ofs=0 len=0 2024-09-22T08:34:14.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.712+0000 7f23e9a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:14.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.712+0000 7f23e9a0e800 20 rados->read ofs=0 len=0 2024-09-22T08:34:14.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.712+0000 7f23e9a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:14.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.712+0000 7f23e9a0e800 20 started sync module instance, tier type = 2024-09-22T08:34:14.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.712+0000 7f23e9a0e800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:34:14.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.722+0000 7f23e9a0e800 20 add_watcher() i=0 2024-09-22T08:34:14.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.722+0000 7f23e9a0e800 20 add_watcher() i=1 2024-09-22T08:34:14.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.722+0000 7f23e9a0e800 20 add_watcher() i=2 2024-09-22T08:34:14.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.722+0000 7f23e9a0e800 20 add_watcher() i=3 2024-09-22T08:34:14.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.722+0000 7f23e9a0e800 20 add_watcher() i=4 2024-09-22T08:34:14.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.722+0000 7f23e9a0e800 20 add_watcher() i=5 2024-09-22T08:34:14.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.722+0000 7f23e9a0e800 20 add_watcher() i=6 2024-09-22T08:34:14.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.723+0000 7f23e9a0e800 20 add_watcher() i=7 2024-09-22T08:34:14.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.723+0000 7f23e9a0e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:34:14.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.725+0000 7f229bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:14.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.726+0000 7f23e9a0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:34:14.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.726+0000 7f23e9a0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:34:14.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.726+0000 7f23e9a0e800 5 note: GC not initialized 2024-09-22T08:34:14.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.726+0000 7f229afe5640 20 reqs_thread_entry: start 2024-09-22T08:34:14.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.726+0000 7f23e9a0e800 20 init_complete bucket index max shards: 11 2024-09-22T08:34:14.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.726+0000 7f23e9a0e800 20 Filter name: none 2024-09-22T08:34:14.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.726+0000 7f2298fe1640 20 reqs_thread_entry: start 2024-09-22T08:34:14.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.726+0000 7f23e9a0e800 20 rados->read ofs=0 len=0 2024-09-22T08:34:14.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.727+0000 7f23e9a0e800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T08:34:14.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.727+0000 7f23e9a0e800 20 rados->read ofs=0 len=0 2024-09-22T08:34:14.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.727+0000 7f23e9a0e800 20 rados_obj.operate() r=0 bl.length=423 2024-09-22T08:34:14.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.727+0000 7f23e9a0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:34:14.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.727+0000 7f23e9a0e800 20 rados->read ofs=0 len=0 2024-09-22T08:34:14.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.728+0000 7f23e9a0e800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T08:34:14.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.728+0000 7f23e9a0e800 20 rados->read ofs=0 len=0 2024-09-22T08:34:14.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.728+0000 7f23e9a0e800 20 rados_obj.operate() r=0 bl.length=423 2024-09-22T08:34:14.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.728+0000 7f23e9a0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:34:14.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.730+0000 7f229bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:14.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.733+0000 7f23e9a0e800 20 remove_watcher() i=0 2024-09-22T08:34:14.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.733+0000 7f23e9a0e800 2 removed watcher, disabling cache 2024-09-22T08:34:14.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.734+0000 7f23e9a0e800 20 remove_watcher() i=1 2024-09-22T08:34:14.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.735+0000 7f23e9a0e800 20 remove_watcher() i=2 2024-09-22T08:34:14.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.736+0000 7f23e9a0e800 20 remove_watcher() i=3 2024-09-22T08:34:14.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.737+0000 7f23e9a0e800 20 remove_watcher() i=4 2024-09-22T08:34:14.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.738+0000 7f23e9a0e800 20 remove_watcher() i=5 2024-09-22T08:34:14.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.739+0000 7f23e9a0e800 20 remove_watcher() i=6 2024-09-22T08:34:14.741 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:14.741+0000 7f23e9a0e800 20 remove_watcher() i=7 2024-09-22T08:34:14.753 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:14.753 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:34:14.753 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-trim-reshard-log-entries id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.25 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-22T08:34:14.753 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:14.755 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:14.755 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:14.759 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:14.759 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:14.802 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:14.803 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:14.832 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-22T08:34:14.832 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:14.832 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:14.833 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:14.844 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:14.844 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:14.887 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:14.887 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:14.892 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:14.893 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:14.899 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:14.899 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:14.904 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:14.904 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:14.910 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:14.911 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:14.917 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:14.917 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:14.922 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:14.922 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:14.928 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:14.928 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:14.934 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:14.935 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:14.940 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:14.941 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:14.946 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:14.946 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:14.952 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:14.952 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:14.958 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:14.958 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:14.963 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:14.963 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:14.969 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:14.969 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:14.975 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:14.975 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:14.981 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:14.981 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:14.987 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:14.987 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:14.992 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:14.992 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:14.998 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:14.998 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:15.004 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-22T08:34:15.035 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:34:15.035 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:34:15.075 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.074+0000 7ff3f5c20800 20 rados->read ofs=0 len=0 2024-09-22T08:34:15.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.076+0000 7ff3f5c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:15.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.076+0000 7ff3f5c20800 20 realm 2024-09-22T08:34:15.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.076+0000 7ff3f5c20800 20 rados->read ofs=0 len=0 2024-09-22T08:34:15.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.076+0000 7ff3f5c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:15.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.076+0000 7ff3f5c20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:34:15.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.076+0000 7ff3f5c20800 20 rados->read ofs=0 len=0 2024-09-22T08:34:15.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.077+0000 7ff3f5c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:15.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.077+0000 7ff3f5c20800 20 rados->read ofs=0 len=0 2024-09-22T08:34:15.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.077+0000 7ff3f5c20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:15.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.077+0000 7ff3f5c20800 20 rados->read ofs=0 len=0 2024-09-22T08:34:15.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.078+0000 7ff3f5c20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:34:15.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.078+0000 7ff3f5c20800 20 searching for the correct realm 2024-09-22T08:34:15.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.078+0000 7ff3f370a640 0 -- 172.21.15.38:0/79202731 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x56047b121f00 msgr2=0x56047b1243a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:34:15.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.283+0000 7ff3f3f0b640 0 -- 172.21.15.38:0/79202731 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x56047b115840 msgr2=0x56047b117c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:34:15.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.290+0000 7ff3f5c20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:34:15.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.290+0000 7ff3f5c20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:34:15.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.290+0000 7ff3f5c20800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:34:15.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.290+0000 7ff3f5c20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:34:15.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.290+0000 7ff3f5c20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:34:15.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.290+0000 7ff3f5c20800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:34:15.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.290+0000 7ff3f5c20800 20 rados->read ofs=0 len=0 2024-09-22T08:34:15.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.291+0000 7ff3f5c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:15.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.291+0000 7ff3f5c20800 20 rados->read ofs=0 len=0 2024-09-22T08:34:15.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.291+0000 7ff3f5c20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:15.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.291+0000 7ff3f5c20800 20 rados->read ofs=0 len=0 2024-09-22T08:34:15.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.291+0000 7ff3f5c20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:34:15.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.291+0000 7ff3f5c20800 20 zone default found 2024-09-22T08:34:15.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.291+0000 7ff3f5c20800 4 Realm: () 2024-09-22T08:34:15.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.291+0000 7ff3f5c20800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:34:15.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.291+0000 7ff3f5c20800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:34:15.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.291+0000 7ff3f5c20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:34:15.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.291+0000 7ff3f5c20800 20 zonegroup default 2024-09-22T08:34:15.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.291+0000 7ff3f5c20800 20 rados->read ofs=0 len=0 2024-09-22T08:34:15.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.292+0000 7ff3f5c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:15.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.292+0000 7ff3f5c20800 20 rados->read ofs=0 len=0 2024-09-22T08:34:15.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.292+0000 7ff3f5c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:15.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.292+0000 7ff3f5c20800 20 rados->read ofs=0 len=0 2024-09-22T08:34:15.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.292+0000 7ff3f5c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:15.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.292+0000 7ff3f5c20800 20 started sync module instance, tier type = 2024-09-22T08:34:15.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.292+0000 7ff3f5c20800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:34:15.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.302+0000 7ff3f5c20800 20 add_watcher() i=0 2024-09-22T08:34:15.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.302+0000 7ff3f5c20800 20 add_watcher() i=1 2024-09-22T08:34:15.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.302+0000 7ff3f5c20800 20 add_watcher() i=2 2024-09-22T08:34:15.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.302+0000 7ff3f5c20800 20 add_watcher() i=3 2024-09-22T08:34:15.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.302+0000 7ff3f5c20800 20 add_watcher() i=4 2024-09-22T08:34:15.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.302+0000 7ff3f5c20800 20 add_watcher() i=5 2024-09-22T08:34:15.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.302+0000 7ff3f5c20800 20 add_watcher() i=6 2024-09-22T08:34:15.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.303+0000 7ff3f5c20800 20 add_watcher() i=7 2024-09-22T08:34:15.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.303+0000 7ff3f5c20800 2 all 8 watchers are set, enabling cache 2024-09-22T08:34:15.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.305+0000 7ff2a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:15.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.305+0000 7ff3f5c20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:34:15.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.305+0000 7ff3f5c20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:34:15.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.306+0000 7ff3f5c20800 5 note: GC not initialized 2024-09-22T08:34:15.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.306+0000 7ff2a8fe1640 20 reqs_thread_entry: start 2024-09-22T08:34:15.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.306+0000 7ff3f5c20800 20 init_complete bucket index max shards: 11 2024-09-22T08:34:15.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.306+0000 7ff3f5c20800 20 Filter name: none 2024-09-22T08:34:15.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.306+0000 7ff2227fc640 20 reqs_thread_entry: start 2024-09-22T08:34:15.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.306+0000 7ff3f5c20800 20 rados->read ofs=0 len=0 2024-09-22T08:34:15.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.307+0000 7ff3f5c20800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T08:34:15.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.307+0000 7ff3f5c20800 20 rados->read ofs=0 len=0 2024-09-22T08:34:15.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.307+0000 7ff3f5c20800 20 rados_obj.operate() r=0 bl.length=423 2024-09-22T08:34:15.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.307+0000 7ff3f5c20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:34:15.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.307+0000 7ff3f5c20800 20 rados->read ofs=0 len=0 2024-09-22T08:34:15.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.308+0000 7ff3f5c20800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T08:34:15.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.308+0000 7ff3f5c20800 20 rados->read ofs=0 len=0 2024-09-22T08:34:15.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.308+0000 7ff3f5c20800 20 rados_obj.operate() r=0 bl.length=423 2024-09-22T08:34:15.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.308+0000 7ff3f5c20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:34:15.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.310+0000 7ff2a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:15.313 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.313+0000 7ff3f5c20800 20 remove_watcher() i=0 2024-09-22T08:34:15.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.313+0000 7ff3f5c20800 2 removed watcher, disabling cache 2024-09-22T08:34:15.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.314+0000 7ff3f5c20800 20 remove_watcher() i=1 2024-09-22T08:34:15.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.315+0000 7ff3f5c20800 20 remove_watcher() i=2 2024-09-22T08:34:15.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.316+0000 7ff3f5c20800 20 remove_watcher() i=3 2024-09-22T08:34:15.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.317+0000 7ff3f5c20800 20 remove_watcher() i=4 2024-09-22T08:34:15.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.318+0000 7ff3f5c20800 20 remove_watcher() i=5 2024-09-22T08:34:15.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.319+0000 7ff3f5c20800 20 remove_watcher() i=6 2024-09-22T08:34:15.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.320+0000 7ff3f5c20800 20 remove_watcher() i=7 2024-09-22T08:34:15.332 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:15.332 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:34:15.332 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-trim-reshard-log-entries id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:34:15.332 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:15.334 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-22T08:34:15.370 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:34:15.370 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:34:15.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.409+0000 7fd710146800 20 rados->read ofs=0 len=0 2024-09-22T08:34:15.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.410+0000 7fd710146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:15.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.410+0000 7fd710146800 20 realm 2024-09-22T08:34:15.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.410+0000 7fd710146800 20 rados->read ofs=0 len=0 2024-09-22T08:34:15.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.410+0000 7fd710146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:15.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.410+0000 7fd710146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:34:15.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.410+0000 7fd710146800 20 rados->read ofs=0 len=0 2024-09-22T08:34:15.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.411+0000 7fd710146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:15.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.411+0000 7fd710146800 20 rados->read ofs=0 len=0 2024-09-22T08:34:15.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.411+0000 7fd710146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:15.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.411+0000 7fd710146800 20 rados->read ofs=0 len=0 2024-09-22T08:34:15.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.412+0000 7fd710146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:34:15.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.412+0000 7fd710146800 20 searching for the correct realm 2024-09-22T08:34:15.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.414+0000 7fd70d42f640 0 -- 172.21.15.38:0/939199654 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7fd70403f030 msgr2=0x7fd704073c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:34:15.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.620+0000 7fd70d42f640 0 -- 172.21.15.38:0/939199654 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fd700069700 msgr2=0x7fd700083120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:34:15.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.828+0000 7fd710146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:34:15.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.828+0000 7fd710146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:34:15.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.828+0000 7fd710146800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:34:15.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.828+0000 7fd710146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:34:15.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.828+0000 7fd710146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:34:15.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.828+0000 7fd710146800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:34:15.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.828+0000 7fd710146800 20 rados->read ofs=0 len=0 2024-09-22T08:34:15.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.828+0000 7fd710146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:15.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.828+0000 7fd710146800 20 rados->read ofs=0 len=0 2024-09-22T08:34:15.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.829+0000 7fd710146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:15.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.829+0000 7fd710146800 20 rados->read ofs=0 len=0 2024-09-22T08:34:15.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.829+0000 7fd710146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:34:15.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.829+0000 7fd710146800 20 zone default found 2024-09-22T08:34:15.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.829+0000 7fd710146800 4 Realm: () 2024-09-22T08:34:15.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.829+0000 7fd710146800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:34:15.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.829+0000 7fd710146800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:34:15.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.829+0000 7fd710146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:34:15.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.829+0000 7fd710146800 20 zonegroup default 2024-09-22T08:34:15.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.829+0000 7fd710146800 20 rados->read ofs=0 len=0 2024-09-22T08:34:15.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.829+0000 7fd710146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:15.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.829+0000 7fd710146800 20 rados->read ofs=0 len=0 2024-09-22T08:34:15.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.830+0000 7fd710146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:15.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.830+0000 7fd710146800 20 rados->read ofs=0 len=0 2024-09-22T08:34:15.832 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.830+0000 7fd710146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:15.832 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.830+0000 7fd710146800 20 started sync module instance, tier type = 2024-09-22T08:34:15.832 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.830+0000 7fd710146800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:34:15.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.840+0000 7fd710146800 20 add_watcher() i=0 2024-09-22T08:34:15.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.840+0000 7fd710146800 20 add_watcher() i=1 2024-09-22T08:34:15.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.840+0000 7fd710146800 20 add_watcher() i=2 2024-09-22T08:34:15.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.840+0000 7fd710146800 20 add_watcher() i=3 2024-09-22T08:34:15.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.840+0000 7fd710146800 20 add_watcher() i=4 2024-09-22T08:34:15.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.840+0000 7fd710146800 20 add_watcher() i=5 2024-09-22T08:34:15.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.840+0000 7fd710146800 20 add_watcher() i=6 2024-09-22T08:34:15.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.842+0000 7fd710146800 20 add_watcher() i=7 2024-09-22T08:34:15.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.842+0000 7fd710146800 2 all 8 watchers are set, enabling cache 2024-09-22T08:34:15.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.844+0000 7fd5c3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:15.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.844+0000 7fd710146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:34:15.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.844+0000 7fd710146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:34:15.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.844+0000 7fd710146800 5 note: GC not initialized 2024-09-22T08:34:15.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.845+0000 7fd5c2fe5640 20 reqs_thread_entry: start 2024-09-22T08:34:15.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.845+0000 7fd710146800 20 init_complete bucket index max shards: 11 2024-09-22T08:34:15.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.845+0000 7fd710146800 20 Filter name: none 2024-09-22T08:34:15.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.845+0000 7fd5c0fe1640 20 reqs_thread_entry: start 2024-09-22T08:34:15.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.845+0000 7fd710146800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-22T08:34:15.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.845+0000 7fd710146800 20 rados->read ofs=0 len=0 2024-09-22T08:34:15.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.845+0000 7fd710146800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T08:34:15.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.845+0000 7fd710146800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-22T08:34:15.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.845+0000 7fd710146800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-22T08:34:15.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.845+0000 7fd710146800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.26 : miss 2024-09-22T08:34:15.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.845+0000 7fd710146800 20 rados->read ofs=0 len=0 2024-09-22T08:34:15.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.846+0000 7fd710146800 20 rados_obj.operate() r=0 bl.length=423 2024-09-22T08:34:15.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.846+0000 7fd710146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.26 info.flags=0x17 2024-09-22T08:34:15.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.846+0000 7fd710146800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.26 to cache LRU end 2024-09-22T08:34:15.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.846+0000 7fd710146800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:34:15.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.846+0000 7fd710146800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:15.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.846+0000 7fd710146800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.26 2024-09-22T08:34:15.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.852+0000 7fd710146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.26 info.flags=0x17 2024-09-22T08:34:15.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.852+0000 7fd710146800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.26 to cache LRU end 2024-09-22T08:34:15.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.852+0000 7fd710146800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:15.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.852+0000 7fd710146800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.26, ofs0, ns] 2024-09-22T08:34:15.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.852+0000 7fd5f17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496986 cookie 94092359914720 notifier 6371 bl.length()=939 2024-09-22T08:34:15.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.852+0000 7fd5f17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.26 info.flags=0x17 2024-09-22T08:34:15.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.852+0000 7fd5f17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.26 to cache LRU end 2024-09-22T08:34:15.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.852+0000 7fd5f17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:15.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.853+0000 7fd710146800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.26]): orig_sources= new_sources= 2024-09-22T08:34:15.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.853+0000 7fd710146800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.26]): potential sources added=[] removed=[] 2024-09-22T08:34:15.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.853+0000 7fd710146800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.26]): orig_dests= new_dests= 2024-09-22T08:34:15.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.853+0000 7fd710146800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.26]): potential dests added=[] removed=[] 2024-09-22T08:34:15.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.853+0000 7fd710146800 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-22T08:34:15.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.853+0000 7fd710146800 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-22T08:34:15.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.856+0000 7fd710146800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.26.1.0 2024-09-22T08:34:15.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.856+0000 7fd710146800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.26.1.0 2024-09-22T08:34:15.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.856+0000 7fd710146800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.26.1.1 2024-09-22T08:34:15.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.856+0000 7fd710146800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.26.1.1 2024-09-22T08:34:15.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.856+0000 7fd710146800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.26.1.2 2024-09-22T08:34:15.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.856+0000 7fd710146800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.26.1.2 2024-09-22T08:34:15.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.856+0000 7fd710146800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.26.1.3 2024-09-22T08:34:15.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.856+0000 7fd710146800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.26.1.3 2024-09-22T08:34:15.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.856+0000 7fd710146800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.26.1.4 2024-09-22T08:34:15.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.856+0000 7fd710146800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.26.1.4 2024-09-22T08:34:15.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.856+0000 7fd710146800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.26.1.5 2024-09-22T08:34:15.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.856+0000 7fd710146800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.26.1.5 2024-09-22T08:34:15.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.857+0000 7fd710146800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.26.1.6 2024-09-22T08:34:15.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.857+0000 7fd710146800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.26.1.6 2024-09-22T08:34:15.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.857+0000 7fd710146800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.26.1.7 2024-09-22T08:34:15.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.857+0000 7fd710146800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.26.1.7 2024-09-22T08:34:15.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.857+0000 7fd710146800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.26.1.8 2024-09-22T08:34:15.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.857+0000 7fd710146800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.26.1.8 2024-09-22T08:34:15.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.857+0000 7fd710146800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.26.1.9 2024-09-22T08:34:15.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.857+0000 7fd710146800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.26.1.9 2024-09-22T08:34:15.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.857+0000 7fd710146800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.26.1.10 2024-09-22T08:34:15.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.857+0000 7fd710146800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.26.1.10 2024-09-22T08:34:15.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.857+0000 7fd710146800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.26.1.11 2024-09-22T08:34:15.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.857+0000 7fd710146800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.26.1.11 2024-09-22T08:34:15.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.857+0000 7fd710146800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.26.0 2024-09-22T08:34:15.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.857+0000 7fd710146800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.26.1 2024-09-22T08:34:15.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.858+0000 7fd710146800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.26.2 2024-09-22T08:34:15.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.858+0000 7fd710146800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.26.3 2024-09-22T08:34:15.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.858+0000 7fd710146800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.26.4 2024-09-22T08:34:15.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.859+0000 7fd710146800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.26.5 2024-09-22T08:34:15.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.860+0000 7fd710146800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.26.6 2024-09-22T08:34:15.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.860+0000 7fd710146800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.26.7 2024-09-22T08:34:15.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.861+0000 7fd710146800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.26.8 2024-09-22T08:34:15.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.861+0000 7fd710146800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.26.9 2024-09-22T08:34:15.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.862+0000 7fd710146800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.26.10 2024-09-22T08:34:15.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.866+0000 7fd710146800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.26 : hit (requested=0x17, cached=0x17) 2024-09-22T08:34:15.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.866+0000 7fd710146800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.26 2024-09-22T08:34:15.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.867+0000 7fd710146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.26 info.flags=0x17 2024-09-22T08:34:15.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.867+0000 7fd710146800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.26 to cache LRU end 2024-09-22T08:34:15.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.867+0000 7fd710146800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:15.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.867+0000 7fd710146800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.26, ofs0, ns] 2024-09-22T08:34:15.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.867+0000 7fd5f0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496987 cookie 94092359914720 notifier 6371 bl.length()=907 2024-09-22T08:34:15.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.867+0000 7fd5f0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.26 info.flags=0x17 2024-09-22T08:34:15.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.867+0000 7fd5f0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.26 to cache LRU end 2024-09-22T08:34:15.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.867+0000 7fd5f0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:15.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.868+0000 7fd710146800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.26]): orig_sources= new_sources= 2024-09-22T08:34:15.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.868+0000 7fd710146800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.26]): potential sources added=[] removed=[] 2024-09-22T08:34:15.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.868+0000 7fd710146800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.26]): orig_dests= new_dests= 2024-09-22T08:34:15.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.868+0000 7fd710146800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.26]): potential dests added=[] removed=[] 2024-09-22T08:34:15.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.870+0000 7fd710146800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-22T08:34:15.873 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.872+0000 7fd5c3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:15.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.875+0000 7fd710146800 20 remove_watcher() i=0 2024-09-22T08:34:15.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.875+0000 7fd710146800 2 removed watcher, disabling cache 2024-09-22T08:34:15.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.876+0000 7fd710146800 20 remove_watcher() i=1 2024-09-22T08:34:15.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.877+0000 7fd710146800 20 remove_watcher() i=2 2024-09-22T08:34:15.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.878+0000 7fd710146800 20 remove_watcher() i=3 2024-09-22T08:34:15.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.879+0000 7fd710146800 20 remove_watcher() i=4 2024-09-22T08:34:15.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.880+0000 7fd710146800 20 remove_watcher() i=5 2024-09-22T08:34:15.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.881+0000 7fd710146800 20 remove_watcher() i=6 2024-09-22T08:34:15.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.883+0000 7fd710146800 20 remove_watcher() i=7 2024-09-22T08:34:15.897 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-22T08:34:15.927 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:34:15.927 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:34:15.967 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.966+0000 7fc7a250c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:15.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.968+0000 7fc7a250c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:15.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.968+0000 7fc7a250c800 20 realm 2024-09-22T08:34:15.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.968+0000 7fc7a250c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:15.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.968+0000 7fc7a250c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:15.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.968+0000 7fc7a250c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:34:15.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.968+0000 7fc7a250c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:15.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.968+0000 7fc7a250c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:15.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.968+0000 7fc7a250c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:15.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.969+0000 7fc7a250c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:15.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.969+0000 7fc7a250c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:15.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.970+0000 7fc7a250c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:34:15.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.970+0000 7fc7a250c800 20 searching for the correct realm 2024-09-22T08:34:15.973 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.972+0000 7fc79f7f5640 0 -- 172.21.15.38:0/1049709428 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7fc7940ac180 msgr2=0x7fc7940aabf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:34:15.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:15.975+0000 7fc79f7f5640 0 -- 172.21.15.38:0/1049709428 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fc7900733a0 msgr2=0x7fc790072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:34:16.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.183+0000 7fc7a250c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:34:16.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.183+0000 7fc7a250c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:34:16.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.183+0000 7fc7a250c800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:34:16.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.183+0000 7fc7a250c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:34:16.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.183+0000 7fc7a250c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:34:16.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.183+0000 7fc7a250c800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:34:16.185 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.183+0000 7fc7a250c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:16.185 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.183+0000 7fc7a250c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:16.185 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.183+0000 7fc7a250c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:16.185 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.183+0000 7fc7a250c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:16.185 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.183+0000 7fc7a250c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:16.186 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.184+0000 7fc7a250c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:34:16.186 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.184+0000 7fc7a250c800 20 zone default found 2024-09-22T08:34:16.186 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.184+0000 7fc7a250c800 4 Realm: () 2024-09-22T08:34:16.186 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.184+0000 7fc7a250c800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:34:16.186 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.184+0000 7fc7a250c800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:34:16.186 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.184+0000 7fc7a250c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:34:16.186 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.184+0000 7fc7a250c800 20 zonegroup default 2024-09-22T08:34:16.186 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.184+0000 7fc7a250c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:16.186 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.184+0000 7fc7a250c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:16.186 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.184+0000 7fc7a250c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:16.187 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.184+0000 7fc7a250c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:16.187 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.184+0000 7fc7a250c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:16.187 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.185+0000 7fc7a250c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:16.187 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.185+0000 7fc7a250c800 20 started sync module instance, tier type = 2024-09-22T08:34:16.187 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.185+0000 7fc7a250c800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:34:16.196 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.195+0000 7fc7a250c800 20 add_watcher() i=0 2024-09-22T08:34:16.196 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.195+0000 7fc7a250c800 20 add_watcher() i=1 2024-09-22T08:34:16.196 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.195+0000 7fc7a250c800 20 add_watcher() i=2 2024-09-22T08:34:16.196 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.195+0000 7fc7a250c800 20 add_watcher() i=3 2024-09-22T08:34:16.196 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.195+0000 7fc7a250c800 20 add_watcher() i=4 2024-09-22T08:34:16.196 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.195+0000 7fc7a250c800 20 add_watcher() i=5 2024-09-22T08:34:16.196 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.195+0000 7fc7a250c800 20 add_watcher() i=6 2024-09-22T08:34:16.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.196+0000 7fc7a250c800 20 add_watcher() i=7 2024-09-22T08:34:16.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.196+0000 7fc7a250c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:34:16.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.198+0000 7fc655fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:16.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.198+0000 7fc7a250c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:34:16.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.198+0000 7fc7a250c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:34:16.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.198+0000 7fc7a250c800 5 note: GC not initialized 2024-09-22T08:34:16.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.199+0000 7fc654fe1640 20 reqs_thread_entry: start 2024-09-22T08:34:16.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.199+0000 7fc7a250c800 20 init_complete bucket index max shards: 11 2024-09-22T08:34:16.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.199+0000 7fc7a250c800 20 Filter name: none 2024-09-22T08:34:16.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.199+0000 7fc5ce7fc640 20 reqs_thread_entry: start 2024-09-22T08:34:16.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.199+0000 7fc7a250c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:16.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.199+0000 7fc7a250c800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T08:34:16.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.199+0000 7fc7a250c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:16.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.200+0000 7fc7a250c800 20 rados_obj.operate() r=0 bl.length=423 2024-09-22T08:34:16.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.200+0000 7fc7a250c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:34:16.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.200+0000 7fc7a250c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:16.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.200+0000 7fc7a250c800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T08:34:16.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.200+0000 7fc7a250c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:16.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.201+0000 7fc7a250c800 20 rados_obj.operate() r=0 bl.length=423 2024-09-22T08:34:16.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.201+0000 7fc7a250c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:34:16.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.203+0000 7fc655fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:16.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.205+0000 7fc7a250c800 20 remove_watcher() i=0 2024-09-22T08:34:16.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.205+0000 7fc7a250c800 2 removed watcher, disabling cache 2024-09-22T08:34:16.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.206+0000 7fc7a250c800 20 remove_watcher() i=1 2024-09-22T08:34:16.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.207+0000 7fc7a250c800 20 remove_watcher() i=2 2024-09-22T08:34:16.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.208+0000 7fc7a250c800 20 remove_watcher() i=3 2024-09-22T08:34:16.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.210+0000 7fc7a250c800 20 remove_watcher() i=4 2024-09-22T08:34:16.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.211+0000 7fc7a250c800 20 remove_watcher() i=5 2024-09-22T08:34:16.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.212+0000 7fc7a250c800 20 remove_watcher() i=6 2024-09-22T08:34:16.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.213+0000 7fc7a250c800 20 remove_watcher() i=7 2024-09-22T08:34:16.225 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:16.225 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:34:16.226 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-trim-reshard-log-entries id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.26 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-22T08:34:16.226 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:16.227 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:16.228 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:16.230 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:16.230 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:16.273 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:16.273 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:16.304 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-22T08:34:16.304 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:16.305 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:16.305 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:16.317 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:16.317 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:16.360 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:16.360 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:16.369 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:16.369 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:16.375 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:16.375 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:16.381 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:16.381 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:16.387 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:16.387 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:16.393 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:16.394 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:16.400 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:16.400 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:16.406 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:16.406 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:16.413 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:16.413 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:16.419 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:16.419 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:16.424 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:16.425 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:16.430 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:16.430 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:16.436 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:16.436 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:16.442 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:16.442 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:16.449 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:16.449 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:16.454 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:16.455 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:16.460 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:16.460 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:16.467 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:16.467 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:16.473 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:16.473 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:16.479 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:16.479 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:16.485 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-22T08:34:16.516 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:34:16.516 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:34:16.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.555+0000 7fbcdf240800 20 rados->read ofs=0 len=0 2024-09-22T08:34:16.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.557+0000 7fbcdf240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:16.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.557+0000 7fbcdf240800 20 realm 2024-09-22T08:34:16.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.557+0000 7fbcdf240800 20 rados->read ofs=0 len=0 2024-09-22T08:34:16.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.557+0000 7fbcdf240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:16.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.557+0000 7fbcdf240800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:34:16.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.557+0000 7fbcdf240800 20 rados->read ofs=0 len=0 2024-09-22T08:34:16.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.557+0000 7fbcdf240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:16.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.557+0000 7fbcdf240800 20 rados->read ofs=0 len=0 2024-09-22T08:34:16.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.558+0000 7fbcdf240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:16.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.558+0000 7fbcdf240800 20 rados->read ofs=0 len=0 2024-09-22T08:34:16.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.559+0000 7fbcdf240800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:34:16.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.559+0000 7fbcdf240800 20 searching for the correct realm 2024-09-22T08:34:16.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.561+0000 7fbcdc529640 0 -- 172.21.15.38:0/1435330121 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7fbcd003b070 msgr2=0x7fbcd003c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:34:16.566 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.565+0000 7fbcdc529640 0 -- 172.21.15.38:0/1435330121 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fbccc0a6220 msgr2=0x7fbccc0aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:34:16.774 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.772+0000 7fbcdf240800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:34:16.774 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.772+0000 7fbcdf240800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:34:16.774 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.772+0000 7fbcdf240800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:34:16.774 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.772+0000 7fbcdf240800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:34:16.774 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.772+0000 7fbcdf240800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:34:16.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.772+0000 7fbcdf240800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:34:16.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.772+0000 7fbcdf240800 20 rados->read ofs=0 len=0 2024-09-22T08:34:16.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.773+0000 7fbcdf240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:16.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.773+0000 7fbcdf240800 20 rados->read ofs=0 len=0 2024-09-22T08:34:16.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.773+0000 7fbcdf240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:16.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.773+0000 7fbcdf240800 20 rados->read ofs=0 len=0 2024-09-22T08:34:16.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.773+0000 7fbcdf240800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:34:16.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.773+0000 7fbcdf240800 20 zone default found 2024-09-22T08:34:16.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.773+0000 7fbcdf240800 4 Realm: () 2024-09-22T08:34:16.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.773+0000 7fbcdf240800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:34:16.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.773+0000 7fbcdf240800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:34:16.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.773+0000 7fbcdf240800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:34:16.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.773+0000 7fbcdf240800 20 zonegroup default 2024-09-22T08:34:16.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.773+0000 7fbcdf240800 20 rados->read ofs=0 len=0 2024-09-22T08:34:16.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.774+0000 7fbcdf240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:16.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.774+0000 7fbcdf240800 20 rados->read ofs=0 len=0 2024-09-22T08:34:16.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.774+0000 7fbcdf240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:16.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.774+0000 7fbcdf240800 20 rados->read ofs=0 len=0 2024-09-22T08:34:16.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.775+0000 7fbcdf240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:16.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.775+0000 7fbcdf240800 20 started sync module instance, tier type = 2024-09-22T08:34:16.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.775+0000 7fbcdf240800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:34:16.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.784+0000 7fbcdf240800 20 add_watcher() i=0 2024-09-22T08:34:16.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.784+0000 7fbcdf240800 20 add_watcher() i=1 2024-09-22T08:34:16.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.784+0000 7fbcdf240800 20 add_watcher() i=2 2024-09-22T08:34:16.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.784+0000 7fbcdf240800 20 add_watcher() i=3 2024-09-22T08:34:16.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.784+0000 7fbcdf240800 20 add_watcher() i=4 2024-09-22T08:34:16.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.784+0000 7fbcdf240800 20 add_watcher() i=5 2024-09-22T08:34:16.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.784+0000 7fbcdf240800 20 add_watcher() i=6 2024-09-22T08:34:16.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.785+0000 7fbcdf240800 20 add_watcher() i=7 2024-09-22T08:34:16.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.785+0000 7fbcdf240800 2 all 8 watchers are set, enabling cache 2024-09-22T08:34:16.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.787+0000 7fbb92fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:16.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.787+0000 7fbcdf240800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:34:16.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.787+0000 7fbcdf240800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:34:16.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.787+0000 7fbcdf240800 5 note: GC not initialized 2024-09-22T08:34:16.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.788+0000 7fbb91fe3640 20 reqs_thread_entry: start 2024-09-22T08:34:16.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.788+0000 7fbcdf240800 20 init_complete bucket index max shards: 11 2024-09-22T08:34:16.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.788+0000 7fbcdf240800 20 Filter name: none 2024-09-22T08:34:16.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.788+0000 7fbb037fe640 20 reqs_thread_entry: start 2024-09-22T08:34:16.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.788+0000 7fbcdf240800 20 rados->read ofs=0 len=0 2024-09-22T08:34:16.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.789+0000 7fbcdf240800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T08:34:16.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.789+0000 7fbcdf240800 20 rados->read ofs=0 len=0 2024-09-22T08:34:16.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.789+0000 7fbcdf240800 20 rados_obj.operate() r=0 bl.length=423 2024-09-22T08:34:16.791 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.789+0000 7fbcdf240800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:34:16.791 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.789+0000 7fbcdf240800 20 rados->read ofs=0 len=0 2024-09-22T08:34:16.791 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.789+0000 7fbcdf240800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T08:34:16.791 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.789+0000 7fbcdf240800 20 rados->read ofs=0 len=0 2024-09-22T08:34:16.791 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.790+0000 7fbcdf240800 20 rados_obj.operate() r=0 bl.length=423 2024-09-22T08:34:16.791 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.790+0000 7fbcdf240800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:34:16.793 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.792+0000 7fbb92fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:16.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.794+0000 7fbcdf240800 20 remove_watcher() i=0 2024-09-22T08:34:16.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.794+0000 7fbcdf240800 2 removed watcher, disabling cache 2024-09-22T08:34:16.796 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.795+0000 7fbcdf240800 20 remove_watcher() i=1 2024-09-22T08:34:16.797 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.796+0000 7fbcdf240800 20 remove_watcher() i=2 2024-09-22T08:34:16.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.797+0000 7fbcdf240800 20 remove_watcher() i=3 2024-09-22T08:34:16.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.798+0000 7fbcdf240800 20 remove_watcher() i=4 2024-09-22T08:34:16.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.799+0000 7fbcdf240800 20 remove_watcher() i=5 2024-09-22T08:34:16.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.801+0000 7fbcdf240800 20 remove_watcher() i=6 2024-09-22T08:34:16.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.802+0000 7fbcdf240800 20 remove_watcher() i=7 2024-09-22T08:34:16.814 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:16.814 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:34:16.814 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-trim-reshard-log-entries id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:34:16.814 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:16.815 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-22T08:34:16.851 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:34:16.851 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:34:16.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.890+0000 7f885d087800 20 rados->read ofs=0 len=0 2024-09-22T08:34:16.892 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.891+0000 7f885d087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:16.892 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.891+0000 7f885d087800 20 realm 2024-09-22T08:34:16.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.891+0000 7f885d087800 20 rados->read ofs=0 len=0 2024-09-22T08:34:16.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.891+0000 7f885d087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:16.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.891+0000 7f885d087800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:34:16.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.891+0000 7f885d087800 20 rados->read ofs=0 len=0 2024-09-22T08:34:16.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.892+0000 7f885d087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:16.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.892+0000 7f885d087800 20 rados->read ofs=0 len=0 2024-09-22T08:34:16.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.892+0000 7f885d087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:16.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.892+0000 7f885d087800 20 rados->read ofs=0 len=0 2024-09-22T08:34:16.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.893+0000 7f885d087800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:34:16.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.893+0000 7f885d087800 20 searching for the correct realm 2024-09-22T08:34:16.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:16.896+0000 7f885b372640 0 -- 172.21.15.38:0/3397590537 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7f884c061040 msgr2=0x7f884c0ba3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:34:17.103 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.102+0000 7f885b372640 0 -- 172.21.15.38:0/3397590537 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x55a0db62a800 msgr2=0x55a0db62cc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:34:17.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.106+0000 7f885d087800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:34:17.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.106+0000 7f885d087800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:34:17.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.106+0000 7f885d087800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:34:17.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.106+0000 7f885d087800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:34:17.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.106+0000 7f885d087800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:34:17.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.106+0000 7f885d087800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:34:17.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.106+0000 7f885d087800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.106+0000 7f885d087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:17.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.106+0000 7f885d087800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.107+0000 7f885d087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:17.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.107+0000 7f885d087800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.107+0000 7f885d087800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:34:17.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.107+0000 7f885d087800 20 zone default found 2024-09-22T08:34:17.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.107+0000 7f885d087800 4 Realm: () 2024-09-22T08:34:17.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.107+0000 7f885d087800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:34:17.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.107+0000 7f885d087800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:34:17.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.107+0000 7f885d087800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:34:17.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.107+0000 7f885d087800 20 zonegroup default 2024-09-22T08:34:17.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.107+0000 7f885d087800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.107+0000 7f885d087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:17.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.107+0000 7f885d087800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.108+0000 7f885d087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:17.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.108+0000 7f885d087800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.108+0000 7f885d087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:17.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.108+0000 7f885d087800 20 started sync module instance, tier type = 2024-09-22T08:34:17.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.108+0000 7f885d087800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:34:17.119 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.118+0000 7f885d087800 20 add_watcher() i=0 2024-09-22T08:34:17.119 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.118+0000 7f885d087800 20 add_watcher() i=1 2024-09-22T08:34:17.119 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.118+0000 7f885d087800 20 add_watcher() i=2 2024-09-22T08:34:17.119 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.118+0000 7f885d087800 20 add_watcher() i=3 2024-09-22T08:34:17.119 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.118+0000 7f885d087800 20 add_watcher() i=4 2024-09-22T08:34:17.119 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.118+0000 7f885d087800 20 add_watcher() i=5 2024-09-22T08:34:17.119 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.118+0000 7f885d087800 20 add_watcher() i=6 2024-09-22T08:34:17.120 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.119+0000 7f885d087800 20 add_watcher() i=7 2024-09-22T08:34:17.120 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.119+0000 7f885d087800 2 all 8 watchers are set, enabling cache 2024-09-22T08:34:17.121 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.121+0000 7f87117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:17.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.121+0000 7f885d087800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:34:17.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.121+0000 7f885d087800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:34:17.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.121+0000 7f885d087800 5 note: GC not initialized 2024-09-22T08:34:17.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.121+0000 7f868bfff640 20 reqs_thread_entry: start 2024-09-22T08:34:17.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.121+0000 7f885d087800 20 init_complete bucket index max shards: 11 2024-09-22T08:34:17.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.121+0000 7f885d087800 20 Filter name: none 2024-09-22T08:34:17.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.122+0000 7f8689ffb640 20 reqs_thread_entry: start 2024-09-22T08:34:17.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.122+0000 7f885d087800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-22T08:34:17.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.122+0000 7f885d087800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.122+0000 7f885d087800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T08:34:17.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.122+0000 7f885d087800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-22T08:34:17.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.122+0000 7f885d087800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-22T08:34:17.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.122+0000 7f885d087800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 : miss 2024-09-22T08:34:17.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.122+0000 7f885d087800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.122+0000 7f885d087800 20 rados_obj.operate() r=0 bl.length=423 2024-09-22T08:34:17.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.122+0000 7f885d087800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 info.flags=0x17 2024-09-22T08:34:17.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.122+0000 7f885d087800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 to cache LRU end 2024-09-22T08:34:17.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.122+0000 7f885d087800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:34:17.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.122+0000 7f885d087800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:17.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.122+0000 7f885d087800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 2024-09-22T08:34:17.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.128+0000 7f885d087800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 info.flags=0x17 2024-09-22T08:34:17.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.128+0000 7f885d087800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 to cache LRU end 2024-09-22T08:34:17.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.128+0000 7f885d087800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:17.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.128+0000 7f885d087800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27, ofs0, ns] 2024-09-22T08:34:17.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.128+0000 7f873dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497004 cookie 94149363887232 notifier 6792 bl.length()=939 2024-09-22T08:34:17.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.128+0000 7f873dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 info.flags=0x17 2024-09-22T08:34:17.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.128+0000 7f873dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 to cache LRU end 2024-09-22T08:34:17.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.128+0000 7f873dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:17.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.129+0000 7f885d087800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.27]): orig_sources= new_sources= 2024-09-22T08:34:17.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.129+0000 7f885d087800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.27]): potential sources added=[] removed=[] 2024-09-22T08:34:17.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.129+0000 7f885d087800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.27]): orig_dests= new_dests= 2024-09-22T08:34:17.130 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f885d087800 time 2024-09-22T08:34:17.129926+0000 2024-09-22T08:34:17.130 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:34:17.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.129+0000 7f885d087800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.27]): potential dests added=[] removed=[] 2024-09-22T08:34:17.131 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:34:17.131 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f886058c748] 2024-09-22T08:34:17.131 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f886058c906] 2024-09-22T08:34:17.131 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a0da950e01] 2024-09-22T08:34:17.131 INFO:tasks.workunit.client.0.smithi038.stderr: 4: radosgw-admin(+0xd817fe) [0x55a0dae637fe] 2024-09-22T08:34:17.131 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a0da960c9d] 2024-09-22T08:34:17.131 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-22T08:34:17.131 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f885f229590] 2024-09-22T08:34:17.131 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-22T08:34:17.132 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-22T08:34:17.132 INFO:tasks.workunit.client.0.smithi038.stderr:*** Caught signal (Aborted) ** 2024-09-22T08:34:17.132 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f885d087800 thread_name:radosgw-admin 2024-09-22T08:34:17.132 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.129+0000 7f885d087800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f885d087800 time 2024-09-22T08:34:17.129926+0000 2024-09-22T08:34:17.132 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:34:17.132 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:17.132 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:34:17.132 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f886058c748] 2024-09-22T08:34:17.132 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f886058c906] 2024-09-22T08:34:17.132 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a0da950e01] 2024-09-22T08:34:17.132 INFO:tasks.workunit.client.0.smithi038.stderr: 4: radosgw-admin(+0xd817fe) [0x55a0dae637fe] 2024-09-22T08:34:17.132 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a0da960c9d] 2024-09-22T08:34:17.132 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-22T08:34:17.132 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f885f229590] 2024-09-22T08:34:17.133 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-22T08:34:17.133 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-22T08:34:17.133 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:17.148 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:34:17.148 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f885f23e6f0] 2024-09-22T08:34:17.148 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f885f28b99c] 2024-09-22T08:34:17.148 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:34:17.148 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:34:17.148 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f886058c7a2] 2024-09-22T08:34:17.148 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f886058c906] 2024-09-22T08:34:17.149 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a0da950e01] 2024-09-22T08:34:17.149 INFO:tasks.workunit.client.0.smithi038.stderr: 8: radosgw-admin(+0xd817fe) [0x55a0dae637fe] 2024-09-22T08:34:17.149 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a0da960c9d] 2024-09-22T08:34:17.149 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-22T08:34:17.149 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f885f229590] 2024-09-22T08:34:17.149 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-22T08:34:17.149 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-22T08:34:17.149 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.130+0000 7f885d087800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:34:17.149 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f885d087800 thread_name:radosgw-admin 2024-09-22T08:34:17.149 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:17.149 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:34:17.149 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f885f23e6f0] 2024-09-22T08:34:17.149 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f885f28b99c] 2024-09-22T08:34:17.149 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:34:17.149 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:34:17.150 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f886058c7a2] 2024-09-22T08:34:17.150 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f886058c906] 2024-09-22T08:34:17.150 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a0da950e01] 2024-09-22T08:34:17.150 INFO:tasks.workunit.client.0.smithi038.stderr: 8: radosgw-admin(+0xd817fe) [0x55a0dae637fe] 2024-09-22T08:34:17.150 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a0da960c9d] 2024-09-22T08:34:17.150 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-22T08:34:17.150 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f885f229590] 2024-09-22T08:34:17.150 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-22T08:34:17.150 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-22T08:34:17.150 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:34:17.150 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:17.150 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-22T08:34:17.150 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-22T08:34:16.871+0000 7f8748e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:34:17.150 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-22T08:34:16.871+0000 7f8748e09640 10 monclient: dump: 2024-09-22T08:34:17.151 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:34:17.151 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:34:17.151 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:17.151 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:17.151 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:34:17.151 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:17.151 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:34:17.151 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:34:17.151 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:34:17.151 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:17.151 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-22T08:34:16.871+0000 7f885d087800 5 monclient: authenticate success, global_id 6780 2024-09-22T08:34:17.151 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-22T08:34:16.871+0000 7f885d087800 10 monclient: get_monmap_and_config success 2024-09-22T08:34:17.151 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-22T08:34:16.871+0000 7f885d087800 4 set_mon_vals no callback set 2024-09-22T08:34:17.151 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-22T08:34:16.872+0000 7f885d087800 10 monclient: shutdown 2024-09-22T08:34:17.151 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-22T08:34:16.872+0000 7f885d087800 5 asok(0x55a0db31b0f0) unregister_commands rotate-key 2024-09-22T08:34:17.152 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-22T08:34:16.872+0000 7f885d087800 10 monclient: build_initial_monmap 2024-09-22T08:34:17.152 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-22T08:34:16.872+0000 7f885d087800 1 build_initial for_mkfs: 0 2024-09-22T08:34:17.152 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-22T08:34:16.872+0000 7f885d087800 10 monclient: monmap: 2024-09-22T08:34:17.152 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:34:17.152 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:34:17.152 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:34:17.152 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:34:17.152 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:34:17.152 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:17.152 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:34:17.152 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:34:17.152 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:34:17.152 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:17.152 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db5413e0) adding auth protocol: cephx 2024-09-22T08:34:17.153 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db5413e0) adding auth protocol: cephx 2024-09-22T08:34:17.153 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db5413e0) adding auth protocol: cephx 2024-09-22T08:34:17.153 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db5413e0) adding con mode: secure 2024-09-22T08:34:17.153 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db5413e0) adding con mode: crc 2024-09-22T08:34:17.153 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db5413e0) adding con mode: secure 2024-09-22T08:34:17.153 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db5413e0) adding con mode: crc 2024-09-22T08:34:17.153 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db5413e0) adding con mode: secure 2024-09-22T08:34:17.153 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db5413e0) adding con mode: crc 2024-09-22T08:34:17.153 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db5413e0) adding con mode: crc 2024-09-22T08:34:17.153 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db5413e0) adding con mode: secure 2024-09-22T08:34:17.153 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db5413e0) adding con mode: crc 2024-09-22T08:34:17.153 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db5413e0) adding con mode: secure 2024-09-22T08:34:17.153 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db5413e0) adding con mode: crc 2024-09-22T08:34:17.153 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db5413e0) adding con mode: secure 2024-09-22T08:34:17.153 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-22T08:34:16.872+0000 7f885d087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:17.154 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-22T08:34:16.872+0000 7f885d087800 1 librados: starting msgr at 2024-09-22T08:34:17.154 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-22T08:34:16.872+0000 7f885d087800 1 librados: starting objecter 2024-09-22T08:34:17.154 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-22T08:34:16.872+0000 7f885d087800 5 asok(0x55a0db31b0f0) register_command objecter_requests hook 0x55a0db3f11c0 2024-09-22T08:34:17.154 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-22T08:34:16.872+0000 7f885d087800 1 librados: setting wanted keys 2024-09-22T08:34:17.154 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-22T08:34:16.872+0000 7f885d087800 1 librados: calling monclient init 2024-09-22T08:34:17.154 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-22T08:34:16.872+0000 7f885d087800 10 monclient: init 2024-09-22T08:34:17.154 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db53be30) adding auth protocol: cephx 2024-09-22T08:34:17.154 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db53be30) adding auth protocol: cephx 2024-09-22T08:34:17.154 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db53be30) adding auth protocol: cephx 2024-09-22T08:34:17.154 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db53be30) adding con mode: secure 2024-09-22T08:34:17.154 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db53be30) adding con mode: crc 2024-09-22T08:34:17.154 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db53be30) adding con mode: secure 2024-09-22T08:34:17.154 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db53be30) adding con mode: crc 2024-09-22T08:34:17.154 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db53be30) adding con mode: secure 2024-09-22T08:34:17.154 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db53be30) adding con mode: crc 2024-09-22T08:34:17.155 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db53be30) adding con mode: crc 2024-09-22T08:34:17.155 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db53be30) adding con mode: secure 2024-09-22T08:34:17.155 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db53be30) adding con mode: crc 2024-09-22T08:34:17.155 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db53be30) adding con mode: secure 2024-09-22T08:34:17.155 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db53be30) adding con mode: crc 2024-09-22T08:34:17.155 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db53be30) adding con mode: secure 2024-09-22T08:34:17.155 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-22T08:34:16.873+0000 7f885d087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:17.155 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-22T08:34:16.873+0000 7f885d087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:17.155 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-22T08:34:16.873+0000 7f885d087800 5 asok(0x55a0db31b0f0) register_command rotate-key hook 0x55a0db53bf78 2024-09-22T08:34:17.155 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-22T08:34:16.873+0000 7f885d087800 10 monclient: _reopen_session rank -1 2024-09-22T08:34:17.155 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-22T08:34:16.873+0000 7f885d087800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T08:34:17.155 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-22T08:34:16.873+0000 7f885d087800 10 monclient(hunting): picked mon.noname-a con 0x55a0db3e8bd0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:34:17.155 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-22T08:34:16.873+0000 7f885d087800 10 monclient(hunting): picked mon.noname-b con 0x55a0db3f2640 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:34:17.155 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-22T08:34:16.873+0000 7f885d087800 10 monclient(hunting): picked mon.noname-c con 0x55a0db47ebd0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:34:17.155 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-22T08:34:16.873+0000 7f885d087800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:17.156 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-22T08:34:16.873+0000 7f885d087800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:17.156 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-22T08:34:16.873+0000 7f885d087800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:17.156 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-22T08:34:16.873+0000 7f885d087800 10 monclient(hunting): _renew_subs 2024-09-22T08:34:17.156 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-22T08:34:16.873+0000 7f885d087800 10 monclient(hunting): authenticate will time out at 1962.112390s 2024-09-22T08:34:17.156 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-22T08:34:16.873+0000 7f885ab71640 10 monclient(hunting): get_auth_request con 0x55a0db3e8bd0 auth_method 0 2024-09-22T08:34:17.156 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-22T08:34:16.873+0000 7f885ab71640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:17.156 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-22T08:34:16.873+0000 7f885ab71640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:17.156 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-22T08:34:16.873+0000 7f885ab71640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:17.156 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-22T08:34:16.873+0000 7f885b372640 10 monclient(hunting): get_auth_request con 0x55a0db47ebd0 auth_method 0 2024-09-22T08:34:17.156 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-22T08:34:16.873+0000 7f885b372640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:17.156 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-22T08:34:16.873+0000 7f885b372640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:17.156 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-22T08:34:16.873+0000 7f885b372640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:17.156 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-22T08:34:16.873+0000 7f885ab71640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:17.156 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-22T08:34:16.873+0000 7f885ab71640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:17.157 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-22T08:34:16.873+0000 7f885ab71640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:17.157 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-22T08:34:16.873+0000 7f885b372640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:17.157 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-22T08:34:16.873+0000 7f885b372640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:17.157 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-22T08:34:16.873+0000 7f885b372640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:17.157 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-22T08:34:16.873+0000 7f885ab71640 10 monclient(hunting): handle_auth_done global_id 6783 payload 824 2024-09-22T08:34:17.157 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-22T08:34:16.873+0000 7f885ab71640 10 monclient: _finish_hunting 0 2024-09-22T08:34:17.157 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-22T08:34:16.873+0000 7f885ab71640 1 monclient: found mon.noname-a 2024-09-22T08:34:17.157 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-22T08:34:16.873+0000 7f885ab71640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:34:17.157 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-22T08:34:16.873+0000 7f885a370640 10 monclient: get_auth_request con 0x55a0db3f2640 auth_method 0 2024-09-22T08:34:17.157 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-22T08:34:16.874+0000 7f8747606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:34:17.157 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-22T08:34:16.874+0000 7f8747606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:34:17.157 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-22T08:34:16.874+0000 7f8747606640 10 monclient: dump: 2024-09-22T08:34:17.157 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:34:17.157 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:34:17.158 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:17.158 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:17.158 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:34:17.158 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:17.158 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:34:17.158 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:34:17.158 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:34:17.158 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:17.158 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-22T08:34:16.874+0000 7f8747606640 10 monclient: _finish_auth 0 2024-09-22T08:34:17.158 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-22T08:34:16.874+0000 7f8747606640 10 monclient: _check_auth_tickets 2024-09-22T08:34:17.158 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-22T08:34:16.874+0000 7f8747606640 10 monclient: handle_config config(0 keys) 2024-09-22T08:34:17.158 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-22T08:34:16.874+0000 7f8747606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:34:17.158 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-22T08:34:16.874+0000 7f8747606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:34:17.158 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-22T08:34:16.874+0000 7f8747606640 10 monclient: dump: 2024-09-22T08:34:17.159 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:34:17.159 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:34:17.159 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:17.159 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:17.159 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:34:17.159 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:17.159 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:34:17.159 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:34:17.159 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:34:17.159 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:17.159 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-22T08:34:16.874+0000 7f885d087800 5 monclient: authenticate success, global_id 6783 2024-09-22T08:34:17.159 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-22T08:34:16.874+0000 7f885d087800 10 monclient: _renew_subs 2024-09-22T08:34:17.159 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-22T08:34:16.874+0000 7f885d087800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:34:17.160 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-22T08:34:16.874+0000 7f8748e09640 4 set_mon_vals no callback set 2024-09-22T08:34:17.160 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-22T08:34:16.874+0000 7f885d087800 10 monclient: _renew_subs 2024-09-22T08:34:17.160 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-22T08:34:16.874+0000 7f885d087800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:34:17.160 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-22T08:34:16.874+0000 7f885d087800 1 librados: init done 2024-09-22T08:34:17.160 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-22T08:34:16.876+0000 7f8747606640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:34:17.160 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-22T08:34:16.876+0000 7f8747606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:34:17.160 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-22T08:34:16.876+0000 7f8747606640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:34:17.160 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-22T08:34:16.876+0000 7f885a370640 10 monclient: get_auth_request con 0x7f8740077570 auth_method 0 2024-09-22T08:34:17.160 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-22T08:34:16.876+0000 7f885b372640 10 monclient: get_auth_request con 0x55a0db5786c0 auth_method 0 2024-09-22T08:34:17.160 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-22T08:34:16.877+0000 7f885ab71640 10 monclient: get_auth_request con 0x55a0db588630 auth_method 0 2024-09-22T08:34:17.160 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-22T08:34:16.878+0000 7f885a370640 10 monclient: get_auth_request con 0x55a0db58ca80 auth_method 0 2024-09-22T08:34:17.160 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-22T08:34:16.879+0000 7f885b372640 10 monclient: get_auth_request con 0x55a0db58bef0 auth_method 0 2024-09-22T08:34:17.160 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-22T08:34:16.880+0000 7f885d087800 10 monclient: build_initial_monmap 2024-09-22T08:34:17.160 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-22T08:34:16.880+0000 7f885d087800 1 build_initial for_mkfs: 0 2024-09-22T08:34:17.161 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-22T08:34:16.880+0000 7f885d087800 10 monclient: monmap: 2024-09-22T08:34:17.161 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:34:17.161 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:34:17.161 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:34:17.161 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:34:17.161 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:34:17.161 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:17.161 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:34:17.161 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:34:17.161 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:34:17.161 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:17.161 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db594c70) adding auth protocol: cephx 2024-09-22T08:34:17.161 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db594c70) adding auth protocol: cephx 2024-09-22T08:34:17.161 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db594c70) adding auth protocol: cephx 2024-09-22T08:34:17.162 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db594c70) adding con mode: secure 2024-09-22T08:34:17.162 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db594c70) adding con mode: crc 2024-09-22T08:34:17.162 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db594c70) adding con mode: secure 2024-09-22T08:34:17.162 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db594c70) adding con mode: crc 2024-09-22T08:34:17.162 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db594c70) adding con mode: secure 2024-09-22T08:34:17.162 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db594c70) adding con mode: crc 2024-09-22T08:34:17.162 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db594c70) adding con mode: crc 2024-09-22T08:34:17.162 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db594c70) adding con mode: secure 2024-09-22T08:34:17.162 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db594c70) adding con mode: crc 2024-09-22T08:34:17.162 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db594c70) adding con mode: secure 2024-09-22T08:34:17.162 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db594c70) adding con mode: crc 2024-09-22T08:34:17.162 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db594c70) adding con mode: secure 2024-09-22T08:34:17.162 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-22T08:34:16.880+0000 7f885d087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:17.162 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-22T08:34:16.880+0000 7f885d087800 5 asok(0x55a0db31b0f0) register_command objecter_requests cmddesc objecter_requests hook 0x55a0db5980c0 EEXIST 2024-09-22T08:34:17.163 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-22T08:34:16.880+0000 7f885d087800 10 monclient: init 2024-09-22T08:34:17.163 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db593b68) adding auth protocol: cephx 2024-09-22T08:34:17.163 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db593b68) adding auth protocol: cephx 2024-09-22T08:34:17.163 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db593b68) adding auth protocol: cephx 2024-09-22T08:34:17.163 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db593b68) adding con mode: secure 2024-09-22T08:34:17.163 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db593b68) adding con mode: crc 2024-09-22T08:34:17.163 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db593b68) adding con mode: secure 2024-09-22T08:34:17.163 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db593b68) adding con mode: crc 2024-09-22T08:34:17.163 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db593b68) adding con mode: secure 2024-09-22T08:34:17.163 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db593b68) adding con mode: crc 2024-09-22T08:34:17.163 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db593b68) adding con mode: crc 2024-09-22T08:34:17.163 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db593b68) adding con mode: secure 2024-09-22T08:34:17.163 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db593b68) adding con mode: crc 2024-09-22T08:34:17.163 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db593b68) adding con mode: secure 2024-09-22T08:34:17.164 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db593b68) adding con mode: crc 2024-09-22T08:34:17.164 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db593b68) adding con mode: secure 2024-09-22T08:34:17.164 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-22T08:34:16.880+0000 7f885d087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:17.164 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-22T08:34:16.881+0000 7f885d087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:17.164 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-22T08:34:16.881+0000 7f885d087800 5 asok(0x55a0db31b0f0) register_command rotate-key cmddesc rotate-key hook 0x55a0db593cb0 EEXIST 2024-09-22T08:34:17.164 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-22T08:34:16.881+0000 7f885d087800 10 monclient: _reopen_session rank -1 2024-09-22T08:34:17.164 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-22T08:34:16.881+0000 7f885d087800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T08:34:17.164 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-22T08:34:16.881+0000 7f885d087800 10 monclient(hunting): picked mon.noname-b con 0x55a0db5bc3e0 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:34:17.164 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-22T08:34:16.881+0000 7f885d087800 10 monclient(hunting): picked mon.noname-a con 0x55a0db5bc7c0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:34:17.164 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-22T08:34:16.881+0000 7f885d087800 10 monclient(hunting): picked mon.noname-c con 0x55a0db5bb0f0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:34:17.164 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-22T08:34:16.881+0000 7f885d087800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:17.164 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-22T08:34:16.881+0000 7f885d087800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:17.164 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-22T08:34:16.881+0000 7f885d087800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:17.164 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-22T08:34:16.881+0000 7f885d087800 10 monclient(hunting): _renew_subs 2024-09-22T08:34:17.164 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-22T08:34:16.881+0000 7f885d087800 10 monclient(hunting): authenticate will time out at 1962.120305s 2024-09-22T08:34:17.165 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-22T08:34:16.881+0000 7f885b372640 10 monclient(hunting): get_auth_request con 0x55a0db5bc7c0 auth_method 0 2024-09-22T08:34:17.165 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-22T08:34:16.881+0000 7f885b372640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:17.165 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-22T08:34:16.881+0000 7f885b372640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:17.165 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-22T08:34:16.881+0000 7f885b372640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:17.165 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-22T08:34:16.881+0000 7f885ab71640 10 monclient(hunting): get_auth_request con 0x55a0db5bb0f0 auth_method 0 2024-09-22T08:34:17.165 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-22T08:34:16.881+0000 7f885ab71640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:17.165 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-22T08:34:16.881+0000 7f885ab71640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:17.165 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-22T08:34:16.881+0000 7f885ab71640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:17.165 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-22T08:34:16.881+0000 7f885a370640 10 monclient(hunting): get_auth_request con 0x55a0db5bc3e0 auth_method 0 2024-09-22T08:34:17.165 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-22T08:34:16.881+0000 7f885a370640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:17.165 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-22T08:34:16.881+0000 7f885a370640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:17.165 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-22T08:34:16.881+0000 7f885a370640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:17.165 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-22T08:34:16.881+0000 7f885b372640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:17.165 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-22T08:34:16.881+0000 7f885b372640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:17.165 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-22T08:34:16.881+0000 7f885b372640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:17.166 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-22T08:34:16.881+0000 7f885ab71640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:17.166 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-22T08:34:16.881+0000 7f885ab71640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:17.166 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-22T08:34:16.881+0000 7f885ab71640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:17.166 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-22T08:34:16.881+0000 7f885a370640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:17.166 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-22T08:34:16.881+0000 7f885a370640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:17.166 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-22T08:34:16.881+0000 7f885a370640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:17.166 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-22T08:34:16.881+0000 7f885b372640 10 monclient(hunting): handle_auth_done global_id 6786 payload 824 2024-09-22T08:34:17.166 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-22T08:34:16.881+0000 7f885b372640 10 monclient: _finish_hunting 0 2024-09-22T08:34:17.166 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-22T08:34:16.881+0000 7f885b372640 1 monclient: found mon.noname-a 2024-09-22T08:34:17.166 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-22T08:34:16.881+0000 7f885b372640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:34:17.166 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-22T08:34:16.882+0000 7f8744e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:34:17.166 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-22T08:34:16.882+0000 7f8744e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:34:17.166 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-22T08:34:16.882+0000 7f8744e01640 10 monclient: dump: 2024-09-22T08:34:17.166 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:34:17.167 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:34:17.167 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:17.167 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:17.167 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:34:17.167 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:17.167 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:34:17.167 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:34:17.167 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:34:17.167 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:17.167 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-22T08:34:16.882+0000 7f8744e01640 10 monclient: _finish_auth 0 2024-09-22T08:34:17.167 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-22T08:34:16.882+0000 7f8744e01640 10 monclient: _check_auth_tickets 2024-09-22T08:34:17.167 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-22T08:34:16.882+0000 7f8744e01640 10 monclient: handle_config config(0 keys) 2024-09-22T08:34:17.167 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-22T08:34:16.882+0000 7f8744e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:34:17.167 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-22T08:34:16.882+0000 7f8744e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:34:17.167 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-22T08:34:16.882+0000 7f8744e01640 10 monclient: dump: 2024-09-22T08:34:17.168 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:34:17.168 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:34:17.168 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:17.168 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:17.168 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:34:17.168 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:17.168 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:34:17.168 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:34:17.168 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:34:17.168 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:17.168 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-22T08:34:16.882+0000 7f885d087800 5 monclient: authenticate success, global_id 6786 2024-09-22T08:34:17.168 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-22T08:34:16.882+0000 7f885d087800 10 monclient: _renew_subs 2024-09-22T08:34:17.168 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-22T08:34:16.882+0000 7f885d087800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:34:17.168 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-22T08:34:16.882+0000 7f885bb73640 4 set_mon_vals no callback set 2024-09-22T08:34:17.169 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-22T08:34:16.882+0000 7f885d087800 10 monclient: _renew_subs 2024-09-22T08:34:17.169 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-22T08:34:16.882+0000 7f885d087800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:34:17.169 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-22T08:34:16.884+0000 7f8744e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:34:17.169 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-22T08:34:16.884+0000 7f8744e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:34:17.169 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-22T08:34:16.884+0000 7f8744e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:34:17.169 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-22T08:34:16.884+0000 7f885a370640 10 monclient: get_auth_request con 0x7f8734077480 auth_method 0 2024-09-22T08:34:17.169 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-22T08:34:16.884+0000 7f885d087800 10 monclient: get_monmap_and_config 2024-09-22T08:34:17.169 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-22T08:34:16.884+0000 7f885d087800 10 monclient: build_initial_monmap 2024-09-22T08:34:17.169 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-22T08:34:16.884+0000 7f885d087800 1 build_initial for_mkfs: 0 2024-09-22T08:34:17.169 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-22T08:34:16.884+0000 7f885d087800 10 monclient: monmap: 2024-09-22T08:34:17.169 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:34:17.169 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:34:17.169 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:34:17.169 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:34:17.169 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:34:17.170 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:17.170 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:34:17.170 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:34:17.170 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:34:17.170 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:17.170 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x55a0db5dc0d0) adding auth protocol: cephx 2024-09-22T08:34:17.170 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x55a0db5dc0d0) adding auth protocol: cephx 2024-09-22T08:34:17.170 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x55a0db5dc0d0) adding auth protocol: cephx 2024-09-22T08:34:17.170 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x55a0db5dc0d0) adding con mode: secure 2024-09-22T08:34:17.170 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x55a0db5dc0d0) adding con mode: crc 2024-09-22T08:34:17.170 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x55a0db5dc0d0) adding con mode: secure 2024-09-22T08:34:17.170 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x55a0db5dc0d0) adding con mode: crc 2024-09-22T08:34:17.170 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x55a0db5dc0d0) adding con mode: secure 2024-09-22T08:34:17.171 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x55a0db5dc0d0) adding con mode: crc 2024-09-22T08:34:17.171 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x55a0db5dc0d0) adding con mode: crc 2024-09-22T08:34:17.171 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x55a0db5dc0d0) adding con mode: secure 2024-09-22T08:34:17.171 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x55a0db5dc0d0) adding con mode: crc 2024-09-22T08:34:17.171 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x55a0db5dc0d0) adding con mode: secure 2024-09-22T08:34:17.171 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x55a0db5dc0d0) adding con mode: crc 2024-09-22T08:34:17.171 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x55a0db5dc0d0) adding con mode: secure 2024-09-22T08:34:17.171 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-22T08:34:16.884+0000 7f885d087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:17.171 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-22T08:34:16.884+0000 7f885d087800 10 monclient: init 2024-09-22T08:34:17.171 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c11a0) adding auth protocol: cephx 2024-09-22T08:34:17.171 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c11a0) adding auth protocol: cephx 2024-09-22T08:34:17.171 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c11a0) adding auth protocol: cephx 2024-09-22T08:34:17.171 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c11a0) adding con mode: secure 2024-09-22T08:34:17.171 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c11a0) adding con mode: crc 2024-09-22T08:34:17.171 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c11a0) adding con mode: secure 2024-09-22T08:34:17.172 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c11a0) adding con mode: crc 2024-09-22T08:34:17.172 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c11a0) adding con mode: secure 2024-09-22T08:34:17.172 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c11a0) adding con mode: crc 2024-09-22T08:34:17.172 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c11a0) adding con mode: crc 2024-09-22T08:34:17.172 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c11a0) adding con mode: secure 2024-09-22T08:34:17.172 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c11a0) adding con mode: crc 2024-09-22T08:34:17.172 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c11a0) adding con mode: secure 2024-09-22T08:34:17.172 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c11a0) adding con mode: crc 2024-09-22T08:34:17.172 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c11a0) adding con mode: secure 2024-09-22T08:34:17.172 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-22T08:34:16.885+0000 7f885d087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:17.172 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-22T08:34:16.885+0000 7f885d087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:17.172 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-22T08:34:16.885+0000 7f885d087800 5 asok(0x55a0db31b0f0) register_command rotate-key cmddesc rotate-key hook 0x7ffcde7c12e8 EEXIST 2024-09-22T08:34:17.172 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-22T08:34:16.885+0000 7f885d087800 10 monclient: _reopen_session rank -1 2024-09-22T08:34:17.172 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-22T08:34:16.885+0000 7f885d087800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T08:34:17.173 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-22T08:34:16.885+0000 7f885d087800 10 monclient(hunting): picked mon.noname-c con 0x55a0db6106b0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:34:17.173 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-22T08:34:16.885+0000 7f885d087800 10 monclient(hunting): picked mon.noname-a con 0x55a0db601000 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:34:17.173 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-22T08:34:16.885+0000 7f885d087800 10 monclient(hunting): picked mon.noname-b con 0x55a0db60bae0 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:34:17.173 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-22T08:34:16.885+0000 7f885d087800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:17.173 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-22T08:34:16.885+0000 7f885d087800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:17.173 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-22T08:34:16.885+0000 7f885d087800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:17.173 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-22T08:34:16.885+0000 7f885d087800 10 monclient(hunting): _renew_subs 2024-09-22T08:34:17.173 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-22T08:34:16.885+0000 7f885d087800 10 monclient(hunting): authenticate will time out at 1962.124473s 2024-09-22T08:34:17.173 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-22T08:34:16.885+0000 7f885a370640 10 monclient(hunting): get_auth_request con 0x55a0db6106b0 auth_method 0 2024-09-22T08:34:17.173 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-22T08:34:16.885+0000 7f885a370640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:17.173 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-22T08:34:16.885+0000 7f885a370640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:17.173 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-22T08:34:16.885+0000 7f885a370640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:17.173 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-22T08:34:16.885+0000 7f885b372640 10 monclient(hunting): get_auth_request con 0x55a0db601000 auth_method 0 2024-09-22T08:34:17.173 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-22T08:34:16.885+0000 7f885b372640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:17.173 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-22T08:34:16.885+0000 7f885b372640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:17.174 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-22T08:34:16.885+0000 7f885b372640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:17.174 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-22T08:34:16.885+0000 7f885a370640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:17.174 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-22T08:34:16.885+0000 7f885a370640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:17.174 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-22T08:34:16.885+0000 7f885a370640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:17.174 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-22T08:34:16.885+0000 7f885b372640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:17.174 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-22T08:34:16.885+0000 7f885b372640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:17.174 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-22T08:34:16.885+0000 7f885b372640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:17.174 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-22T08:34:16.885+0000 7f885ab71640 10 monclient(hunting): get_auth_request con 0x55a0db60bae0 auth_method 0 2024-09-22T08:34:17.174 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-22T08:34:16.885+0000 7f885ab71640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:17.174 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-22T08:34:16.885+0000 7f885ab71640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:17.174 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-22T08:34:16.885+0000 7f885ab71640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:17.174 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-22T08:34:16.885+0000 7f885a370640 10 monclient(hunting): handle_auth_done global_id 6419 payload 274 2024-09-22T08:34:17.174 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-22T08:34:16.885+0000 7f885a370640 10 monclient: _finish_hunting 0 2024-09-22T08:34:17.174 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-22T08:34:16.885+0000 7f885a370640 1 monclient: found mon.noname-c 2024-09-22T08:34:17.175 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-22T08:34:16.885+0000 7f885a370640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:34:17.175 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-22T08:34:16.886+0000 7f873e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:34:17.175 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-22T08:34:16.886+0000 7f873e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:34:17.175 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-22T08:34:16.886+0000 7f873e7fc640 10 monclient: dump: 2024-09-22T08:34:17.175 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:34:17.175 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:34:17.175 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:17.175 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:17.175 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:34:17.175 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:17.175 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:34:17.175 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:34:17.175 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:34:17.175 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:17.175 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-22T08:34:16.886+0000 7f873e7fc640 10 monclient: _finish_auth 0 2024-09-22T08:34:17.176 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-22T08:34:16.886+0000 7f873e7fc640 10 monclient: _check_auth_tickets 2024-09-22T08:34:17.176 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-22T08:34:16.886+0000 7f873e7fc640 10 monclient: handle_config config(0 keys) 2024-09-22T08:34:17.176 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-22T08:34:16.886+0000 7f873e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:34:17.176 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-22T08:34:16.886+0000 7f873e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:34:17.176 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-22T08:34:16.886+0000 7f873e7fc640 10 monclient: dump: 2024-09-22T08:34:17.176 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:34:17.176 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:34:17.176 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:17.176 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:17.176 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:34:17.176 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:17.176 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:34:17.176 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:34:17.176 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:34:17.176 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:17.177 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-22T08:34:16.886+0000 7f885d087800 5 monclient: authenticate success, global_id 6419 2024-09-22T08:34:17.177 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-22T08:34:16.886+0000 7f885d087800 10 monclient: get_monmap_and_config success 2024-09-22T08:34:17.177 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-22T08:34:16.886+0000 7f885d087800 4 set_mon_vals no callback set 2024-09-22T08:34:17.177 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-22T08:34:16.886+0000 7f885d087800 10 monclient: shutdown 2024-09-22T08:34:17.177 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-22T08:34:16.886+0000 7f885d087800 10 monclient: build_initial_monmap 2024-09-22T08:34:17.177 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-22T08:34:16.886+0000 7f885d087800 1 build_initial for_mkfs: 0 2024-09-22T08:34:17.177 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-22T08:34:16.886+0000 7f885d087800 10 monclient: monmap: 2024-09-22T08:34:17.177 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:34:17.177 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:34:17.177 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:34:17.177 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:34:17.177 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:34:17.177 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:17.177 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:34:17.178 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:34:17.178 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:34:17.178 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:17.178 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-22T08:34:16.886+0000 7f885d087800 5 AuthRegistry(0x55a0db5dfc10) adding auth protocol: cephx 2024-09-22T08:34:17.178 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-22T08:34:16.886+0000 7f885d087800 5 AuthRegistry(0x55a0db5dfc10) adding auth protocol: cephx 2024-09-22T08:34:17.178 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-22T08:34:16.886+0000 7f885d087800 5 AuthRegistry(0x55a0db5dfc10) adding auth protocol: cephx 2024-09-22T08:34:17.178 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-22T08:34:16.886+0000 7f885d087800 5 AuthRegistry(0x55a0db5dfc10) adding con mode: secure 2024-09-22T08:34:17.178 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-22T08:34:16.886+0000 7f885d087800 5 AuthRegistry(0x55a0db5dfc10) adding con mode: crc 2024-09-22T08:34:17.178 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-22T08:34:16.886+0000 7f885d087800 5 AuthRegistry(0x55a0db5dfc10) adding con mode: secure 2024-09-22T08:34:17.178 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-22T08:34:16.886+0000 7f885d087800 5 AuthRegistry(0x55a0db5dfc10) adding con mode: crc 2024-09-22T08:34:17.178 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-22T08:34:16.886+0000 7f885d087800 5 AuthRegistry(0x55a0db5dfc10) adding con mode: secure 2024-09-22T08:34:17.178 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-22T08:34:16.886+0000 7f885d087800 5 AuthRegistry(0x55a0db5dfc10) adding con mode: crc 2024-09-22T08:34:17.178 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-22T08:34:16.886+0000 7f885d087800 5 AuthRegistry(0x55a0db5dfc10) adding con mode: crc 2024-09-22T08:34:17.178 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-22T08:34:16.886+0000 7f885d087800 5 AuthRegistry(0x55a0db5dfc10) adding con mode: secure 2024-09-22T08:34:17.178 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-22T08:34:16.886+0000 7f885d087800 5 AuthRegistry(0x55a0db5dfc10) adding con mode: crc 2024-09-22T08:34:17.179 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-22T08:34:16.886+0000 7f885d087800 5 AuthRegistry(0x55a0db5dfc10) adding con mode: secure 2024-09-22T08:34:17.179 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-22T08:34:16.886+0000 7f885d087800 5 AuthRegistry(0x55a0db5dfc10) adding con mode: crc 2024-09-22T08:34:17.179 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-22T08:34:16.886+0000 7f885d087800 5 AuthRegistry(0x55a0db5dfc10) adding con mode: secure 2024-09-22T08:34:17.179 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-22T08:34:16.887+0000 7f885d087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:17.179 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-22T08:34:16.887+0000 7f885d087800 1 librados: starting msgr at 2024-09-22T08:34:17.179 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-22T08:34:16.887+0000 7f885d087800 1 librados: starting objecter 2024-09-22T08:34:17.179 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-22T08:34:16.887+0000 7f885d087800 5 asok(0x55a0db31b0f0) register_command objecter_requests cmddesc objecter_requests hook 0x55a0db606800 EEXIST 2024-09-22T08:34:17.179 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-22T08:34:16.887+0000 7f885d087800 1 librados: setting wanted keys 2024-09-22T08:34:17.179 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-22T08:34:16.887+0000 7f885d087800 1 librados: calling monclient init 2024-09-22T08:34:17.179 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-22T08:34:16.887+0000 7f885d087800 10 monclient: init 2024-09-22T08:34:17.179 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-22T08:34:16.887+0000 7f885d087800 5 AuthRegistry(0x55a0db5d0ca0) adding auth protocol: cephx 2024-09-22T08:34:17.179 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-22T08:34:16.887+0000 7f885d087800 5 AuthRegistry(0x55a0db5d0ca0) adding auth protocol: cephx 2024-09-22T08:34:17.179 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-22T08:34:16.887+0000 7f885d087800 5 AuthRegistry(0x55a0db5d0ca0) adding auth protocol: cephx 2024-09-22T08:34:17.179 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-22T08:34:16.887+0000 7f885d087800 5 AuthRegistry(0x55a0db5d0ca0) adding con mode: secure 2024-09-22T08:34:17.179 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-22T08:34:16.887+0000 7f885d087800 5 AuthRegistry(0x55a0db5d0ca0) adding con mode: crc 2024-09-22T08:34:17.180 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-22T08:34:16.887+0000 7f885d087800 5 AuthRegistry(0x55a0db5d0ca0) adding con mode: secure 2024-09-22T08:34:17.180 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-22T08:34:16.887+0000 7f885d087800 5 AuthRegistry(0x55a0db5d0ca0) adding con mode: crc 2024-09-22T08:34:17.180 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-22T08:34:16.887+0000 7f885d087800 5 AuthRegistry(0x55a0db5d0ca0) adding con mode: secure 2024-09-22T08:34:17.180 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-22T08:34:16.887+0000 7f885d087800 5 AuthRegistry(0x55a0db5d0ca0) adding con mode: crc 2024-09-22T08:34:17.180 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-22T08:34:16.887+0000 7f885d087800 5 AuthRegistry(0x55a0db5d0ca0) adding con mode: crc 2024-09-22T08:34:17.180 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-22T08:34:16.887+0000 7f885d087800 5 AuthRegistry(0x55a0db5d0ca0) adding con mode: secure 2024-09-22T08:34:17.180 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-22T08:34:16.887+0000 7f885d087800 5 AuthRegistry(0x55a0db5d0ca0) adding con mode: crc 2024-09-22T08:34:17.180 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-22T08:34:16.887+0000 7f885d087800 5 AuthRegistry(0x55a0db5d0ca0) adding con mode: secure 2024-09-22T08:34:17.180 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-22T08:34:16.887+0000 7f885d087800 5 AuthRegistry(0x55a0db5d0ca0) adding con mode: crc 2024-09-22T08:34:17.180 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-22T08:34:16.887+0000 7f885d087800 5 AuthRegistry(0x55a0db5d0ca0) adding con mode: secure 2024-09-22T08:34:17.180 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-22T08:34:16.887+0000 7f885d087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:17.180 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-22T08:34:16.887+0000 7f885d087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:17.180 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-22T08:34:16.887+0000 7f885d087800 5 asok(0x55a0db31b0f0) register_command rotate-key cmddesc rotate-key hook 0x55a0db5d0de8 EEXIST 2024-09-22T08:34:17.180 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-22T08:34:16.887+0000 7f885d087800 10 monclient: _reopen_session rank -1 2024-09-22T08:34:17.181 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-22T08:34:16.887+0000 7f885d087800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-22T08:34:17.181 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-22T08:34:16.887+0000 7f885d087800 10 monclient(hunting): picked mon.noname-b con 0x55a0db601000 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:34:17.181 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-22T08:34:16.887+0000 7f885d087800 10 monclient(hunting): picked mon.noname-c con 0x55a0db60bae0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:34:17.181 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-22T08:34:16.887+0000 7f885d087800 10 monclient(hunting): picked mon.noname-a con 0x55a0db6106b0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:34:17.181 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-22T08:34:16.887+0000 7f885d087800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:17.181 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-22T08:34:16.887+0000 7f885d087800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:17.181 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-22T08:34:16.887+0000 7f885d087800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:17.181 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-22T08:34:16.887+0000 7f885d087800 10 monclient(hunting): _renew_subs 2024-09-22T08:34:17.181 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-22T08:34:16.887+0000 7f885d087800 10 monclient(hunting): authenticate will time out at 1962.126822s 2024-09-22T08:34:17.181 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-22T08:34:16.887+0000 7f885ab71640 10 monclient(hunting): get_auth_request con 0x55a0db6106b0 auth_method 0 2024-09-22T08:34:17.181 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-22T08:34:16.887+0000 7f885ab71640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:17.181 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-22T08:34:16.887+0000 7f885ab71640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:17.181 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-22T08:34:16.887+0000 7f885ab71640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:17.181 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-22T08:34:16.887+0000 7f885b372640 10 monclient(hunting): get_auth_request con 0x55a0db60bae0 auth_method 0 2024-09-22T08:34:17.181 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-22T08:34:16.887+0000 7f885b372640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:17.182 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-22T08:34:16.887+0000 7f885b372640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:17.182 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-22T08:34:16.887+0000 7f885b372640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:17.182 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-22T08:34:16.888+0000 7f885ab71640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:17.182 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-22T08:34:16.888+0000 7f885ab71640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:17.182 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-22T08:34:16.888+0000 7f885ab71640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:17.182 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-22T08:34:16.888+0000 7f885b372640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:17.182 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-22T08:34:16.888+0000 7f885b372640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:17.182 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-22T08:34:16.888+0000 7f885b372640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:17.182 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-22T08:34:16.888+0000 7f885a370640 10 monclient(hunting): get_auth_request con 0x55a0db601000 auth_method 0 2024-09-22T08:34:17.182 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-22T08:34:16.888+0000 7f885a370640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:17.182 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-22T08:34:16.888+0000 7f885a370640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:17.182 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-22T08:34:16.888+0000 7f885a370640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:17.182 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-22T08:34:16.888+0000 7f885a370640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:17.182 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-22T08:34:16.888+0000 7f885a370640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:17.183 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-22T08:34:16.888+0000 7f885a370640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:17.183 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-22T08:34:16.888+0000 7f885ab71640 10 monclient(hunting): handle_auth_done global_id 6792 payload 824 2024-09-22T08:34:17.183 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-22T08:34:16.888+0000 7f885ab71640 10 monclient: _finish_hunting 0 2024-09-22T08:34:17.183 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-22T08:34:16.888+0000 7f885ab71640 1 monclient: found mon.noname-a 2024-09-22T08:34:17.183 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-22T08:34:16.888+0000 7f885ab71640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:34:17.183 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-22T08:34:16.888+0000 7f873cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:34:17.183 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-22T08:34:16.888+0000 7f873cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:34:17.183 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-22T08:34:16.888+0000 7f873cff9640 10 monclient: dump: 2024-09-22T08:34:17.183 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:34:17.183 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:34:17.183 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:17.183 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:17.183 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:34:17.183 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:17.183 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:34:17.184 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:34:17.184 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:34:17.184 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:17.184 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-22T08:34:16.888+0000 7f873cff9640 10 monclient: _finish_auth 0 2024-09-22T08:34:17.184 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-22T08:34:16.888+0000 7f873cff9640 10 monclient: _check_auth_tickets 2024-09-22T08:34:17.185 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-22T08:34:16.888+0000 7f873cff9640 10 monclient: handle_config config(0 keys) 2024-09-22T08:34:17.185 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-22T08:34:16.888+0000 7f873cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:34:17.185 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-22T08:34:16.888+0000 7f873cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:34:17.185 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-22T08:34:16.888+0000 7f873cff9640 10 monclient: dump: 2024-09-22T08:34:17.186 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:34:17.186 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:34:17.186 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:17.186 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:17.186 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:34:17.186 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:17.186 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:34:17.186 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:34:17.186 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:34:17.186 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:17.186 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-22T08:34:16.888+0000 7f885d087800 5 monclient: authenticate success, global_id 6792 2024-09-22T08:34:17.186 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-22T08:34:16.888+0000 7f885d087800 10 monclient: _renew_subs 2024-09-22T08:34:17.186 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-22T08:34:16.888+0000 7f873e7fc640 4 set_mon_vals no callback set 2024-09-22T08:34:17.186 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-22T08:34:16.888+0000 7f885d087800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:34:17.186 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-22T08:34:16.888+0000 7f885d087800 10 monclient: _renew_subs 2024-09-22T08:34:17.187 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-22T08:34:16.888+0000 7f885d087800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:34:17.187 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-22T08:34:16.888+0000 7f885d087800 1 librados: init done 2024-09-22T08:34:17.187 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-22T08:34:16.888+0000 7f885d087800 5 asok(0x55a0db31b0f0) register_command cr dump hook 0x55a0db605da8 2024-09-22T08:34:17.187 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-22T08:34:16.890+0000 7f885d087800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.187 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-22T08:34:16.890+0000 7f873cff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:34:17.187 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-22T08:34:16.890+0000 7f873cff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:34:17.187 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-22T08:34:16.890+0000 7f873cff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:34:17.187 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-22T08:34:16.890+0000 7f885a370640 10 monclient: get_auth_request con 0x7f8724077570 auth_method 0 2024-09-22T08:34:17.187 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-22T08:34:16.890+0000 7f885b372640 10 monclient: get_auth_request con 0x55a0db62a800 auth_method 0 2024-09-22T08:34:17.187 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-22T08:34:16.891+0000 7f885d087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:17.187 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-22T08:34:16.891+0000 7f885d087800 20 realm 2024-09-22T08:34:17.187 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-22T08:34:16.891+0000 7f885d087800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.187 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-22T08:34:16.891+0000 7f885d087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:17.187 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-22T08:34:16.891+0000 7f885d087800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:34:17.187 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-22T08:34:16.891+0000 7f885d087800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.188 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-22T08:34:16.892+0000 7f885d087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:17.188 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-22T08:34:16.892+0000 7f885d087800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.188 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-22T08:34:16.892+0000 7f885a370640 10 monclient: get_auth_request con 0x55a0db62ea40 auth_method 0 2024-09-22T08:34:17.188 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-22T08:34:16.892+0000 7f885d087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:17.188 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-22T08:34:16.892+0000 7f885d087800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.188 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-22T08:34:16.893+0000 7f885b372640 10 monclient: get_auth_request con 0x55a0db6322a0 auth_method 0 2024-09-22T08:34:17.188 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-22T08:34:16.893+0000 7f885d087800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:34:17.188 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-22T08:34:16.893+0000 7f885d087800 20 searching for the correct realm 2024-09-22T08:34:17.188 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-22T08:34:16.893+0000 7f885ab71640 10 monclient: get_auth_request con 0x55a0db636fe0 auth_method 0 2024-09-22T08:34:17.188 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-22T08:34:16.895+0000 7f885a370640 10 monclient: get_auth_request con 0x7f885002b070 auth_method 0 2024-09-22T08:34:17.188 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-22T08:34:16.896+0000 7f885b372640 0 -- 172.21.15.38:0/3397590537 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7f884c061040 msgr2=0x7f884c0ba3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:34:17.188 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-22T08:34:17.098+0000 7f885b372640 10 monclient: get_auth_request con 0x7f884c061040 auth_method 0 2024-09-22T08:34:17.188 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-22T08:34:17.100+0000 7f885ab71640 10 monclient: get_auth_request con 0x7f88500521b0 auth_method 0 2024-09-22T08:34:17.188 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-22T08:34:17.101+0000 7f885a370640 10 monclient: get_auth_request con 0x7f884c0cf4d0 auth_method 0 2024-09-22T08:34:17.189 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-22T08:34:17.102+0000 7f885b372640 0 -- 172.21.15.38:0/3397590537 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x55a0db62a800 msgr2=0x55a0db62cc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:34:17.189 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-22T08:34:17.102+0000 7f873cff9640 1 client.6792.objecter ms_handle_reset 0x55a0db62a800 session 0x55a0db62a0f0 osd.6 2024-09-22T08:34:17.189 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-22T08:34:17.102+0000 7f873cff9640 10 monclient: _renew_subs 2024-09-22T08:34:17.189 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-22T08:34:17.102+0000 7f873cff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:34:17.189 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-22T08:34:17.102+0000 7f885b372640 10 monclient: get_auth_request con 0x7f8724087090 auth_method 0 2024-09-22T08:34:17.189 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-22T08:34:17.106+0000 7f885d087800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:34:17.189 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-22T08:34:17.106+0000 7f885d087800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:34:17.189 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-22T08:34:17.106+0000 7f885d087800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:34:17.189 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-22T08:34:17.106+0000 7f885d087800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:34:17.189 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-22T08:34:17.106+0000 7f885d087800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:34:17.189 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-22T08:34:17.106+0000 7f885d087800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:34:17.189 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-22T08:34:17.106+0000 7f885d087800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.189 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-22T08:34:17.106+0000 7f885d087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:17.189 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-22T08:34:17.106+0000 7f885d087800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.190 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-22T08:34:17.107+0000 7f885d087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:17.190 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-22T08:34:17.107+0000 7f885d087800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.190 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-22T08:34:17.107+0000 7f885d087800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:34:17.190 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-22T08:34:17.107+0000 7f885d087800 20 zone default found 2024-09-22T08:34:17.190 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-22T08:34:17.107+0000 7f885d087800 4 Realm: () 2024-09-22T08:34:17.190 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-22T08:34:17.107+0000 7f885d087800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:34:17.190 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-22T08:34:17.107+0000 7f885d087800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:34:17.190 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-22T08:34:17.107+0000 7f885d087800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:34:17.190 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-22T08:34:17.107+0000 7f885d087800 20 zonegroup default 2024-09-22T08:34:17.190 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-22T08:34:17.107+0000 7f885d087800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.190 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-22T08:34:17.107+0000 7f885d087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:17.190 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-22T08:34:17.107+0000 7f885d087800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.190 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-22T08:34:17.108+0000 7f885d087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:17.190 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-22T08:34:17.108+0000 7f885d087800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.190 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-22T08:34:17.108+0000 7f885d087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:17.191 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-22T08:34:17.108+0000 7f885d087800 20 started sync module instance, tier type = 2024-09-22T08:34:17.191 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-22T08:34:17.108+0000 7f885d087800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:34:17.191 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-22T08:34:17.118+0000 7f885d087800 20 add_watcher() i=0 2024-09-22T08:34:17.191 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-22T08:34:17.118+0000 7f885d087800 20 add_watcher() i=1 2024-09-22T08:34:17.191 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-22T08:34:17.118+0000 7f885d087800 20 add_watcher() i=2 2024-09-22T08:34:17.191 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-22T08:34:17.118+0000 7f885d087800 20 add_watcher() i=3 2024-09-22T08:34:17.191 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-22T08:34:17.118+0000 7f885d087800 20 add_watcher() i=4 2024-09-22T08:34:17.191 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-22T08:34:17.118+0000 7f885d087800 20 add_watcher() i=5 2024-09-22T08:34:17.191 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-22T08:34:17.118+0000 7f885d087800 20 add_watcher() i=6 2024-09-22T08:34:17.191 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-22T08:34:17.119+0000 7f885d087800 20 add_watcher() i=7 2024-09-22T08:34:17.191 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-22T08:34:17.119+0000 7f885d087800 2 all 8 watchers are set, enabling cache 2024-09-22T08:34:17.191 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-22T08:34:17.121+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c1670) adding auth protocol: cephx 2024-09-22T08:34:17.191 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-22T08:34:17.121+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c1670) adding auth protocol: cephx 2024-09-22T08:34:17.191 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-22T08:34:17.121+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c1670) adding auth protocol: cephx 2024-09-22T08:34:17.191 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-22T08:34:17.121+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c1670) adding con mode: secure 2024-09-22T08:34:17.192 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-22T08:34:17.121+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c1670) adding con mode: crc 2024-09-22T08:34:17.192 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-22T08:34:17.121+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c1670) adding con mode: secure 2024-09-22T08:34:17.192 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-22T08:34:17.121+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c1670) adding con mode: crc 2024-09-22T08:34:17.192 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-22T08:34:17.121+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c1670) adding con mode: secure 2024-09-22T08:34:17.192 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-22T08:34:17.121+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c1670) adding con mode: crc 2024-09-22T08:34:17.192 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-22T08:34:17.121+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c1670) adding con mode: crc 2024-09-22T08:34:17.192 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-22T08:34:17.121+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c1670) adding con mode: secure 2024-09-22T08:34:17.192 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-22T08:34:17.121+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c1670) adding con mode: crc 2024-09-22T08:34:17.192 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-22T08:34:17.121+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c1670) adding con mode: secure 2024-09-22T08:34:17.192 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-22T08:34:17.121+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c1670) adding con mode: crc 2024-09-22T08:34:17.192 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-22T08:34:17.121+0000 7f87117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:17.192 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-22T08:34:17.121+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c1670) adding con mode: secure 2024-09-22T08:34:17.192 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-22T08:34:17.121+0000 7f885d087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:17.192 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-22T08:34:17.121+0000 7f885d087800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:34:17.192 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-22T08:34:17.121+0000 7f885d087800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:34:17.193 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-22T08:34:17.121+0000 7f885d087800 5 asok(0x55a0db31b0f0) register_command cache list hook 0x55a0db608b90 2024-09-22T08:34:17.193 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-22T08:34:17.121+0000 7f885d087800 5 asok(0x55a0db31b0f0) register_command cache inspect hook 0x55a0db608b90 2024-09-22T08:34:17.193 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-22T08:34:17.121+0000 7f885d087800 5 asok(0x55a0db31b0f0) register_command cache erase hook 0x55a0db608b90 2024-09-22T08:34:17.193 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-22T08:34:17.121+0000 7f885d087800 5 asok(0x55a0db31b0f0) register_command cache zap hook 0x55a0db608b90 2024-09-22T08:34:17.193 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-22T08:34:17.121+0000 7f885d087800 5 note: GC not initialized 2024-09-22T08:34:17.193 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-22T08:34:17.121+0000 7f868bfff640 20 reqs_thread_entry: start 2024-09-22T08:34:17.193 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-22T08:34:17.121+0000 7f885d087800 5 asok(0x55a0db31b0f0) register_command sync trace show hook 0x7f88500109d0 2024-09-22T08:34:17.193 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-22T08:34:17.121+0000 7f885d087800 5 asok(0x55a0db31b0f0) register_command sync trace history hook 0x7f88500109d0 2024-09-22T08:34:17.193 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-22T08:34:17.121+0000 7f885d087800 5 asok(0x55a0db31b0f0) register_command sync trace active hook 0x7f88500109d0 2024-09-22T08:34:17.193 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-22T08:34:17.121+0000 7f885d087800 5 asok(0x55a0db31b0f0) register_command sync trace active_short hook 0x7f88500109d0 2024-09-22T08:34:17.193 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-22T08:34:17.121+0000 7f885d087800 20 init_complete bucket index max shards: 11 2024-09-22T08:34:17.193 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-22T08:34:17.121+0000 7f885d087800 20 Filter name: none 2024-09-22T08:34:17.193 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-22T08:34:17.122+0000 7f8689ffb640 20 reqs_thread_entry: start 2024-09-22T08:34:17.193 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-22T08:34:17.122+0000 7f885d087800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-22T08:34:17.193 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-22T08:34:17.122+0000 7f885d087800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.194 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-22T08:34:17.122+0000 7f885d087800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T08:34:17.194 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-22T08:34:17.122+0000 7f885d087800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-22T08:34:17.194 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-22T08:34:17.122+0000 7f885d087800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-22T08:34:17.194 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-22T08:34:17.122+0000 7f885d087800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 : miss 2024-09-22T08:34:17.194 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-22T08:34:17.122+0000 7f885d087800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.194 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-22T08:34:17.122+0000 7f885d087800 20 rados_obj.operate() r=0 bl.length=423 2024-09-22T08:34:17.194 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-22T08:34:17.122+0000 7f885d087800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 info.flags=0x17 2024-09-22T08:34:17.194 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-22T08:34:17.122+0000 7f885d087800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 to cache LRU end 2024-09-22T08:34:17.194 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-22T08:34:17.122+0000 7f885d087800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:34:17.194 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-22T08:34:17.122+0000 7f885d087800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:17.194 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-22T08:34:17.122+0000 7f885d087800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 2024-09-22T08:34:17.194 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-22T08:34:17.128+0000 7f885d087800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 info.flags=0x17 2024-09-22T08:34:17.194 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-22T08:34:17.128+0000 7f885d087800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 to cache LRU end 2024-09-22T08:34:17.194 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-22T08:34:17.128+0000 7f885d087800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:17.195 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-22T08:34:17.128+0000 7f885d087800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27, ofs0, ns] 2024-09-22T08:34:17.195 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-22T08:34:17.128+0000 7f873dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497004 cookie 94149363887232 notifier 6792 bl.length()=939 2024-09-22T08:34:17.195 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-22T08:34:17.128+0000 7f873dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 info.flags=0x17 2024-09-22T08:34:17.195 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-22T08:34:17.128+0000 7f873dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 to cache LRU end 2024-09-22T08:34:17.195 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-22T08:34:17.128+0000 7f873dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:17.195 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-22T08:34:17.129+0000 7f885d087800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.27]): orig_sources= new_sources= 2024-09-22T08:34:17.195 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-22T08:34:17.129+0000 7f885d087800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.27]): potential sources added=[] removed=[] 2024-09-22T08:34:17.195 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-22T08:34:17.129+0000 7f885d087800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.27]): orig_dests= new_dests= 2024-09-22T08:34:17.195 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-22T08:34:17.129+0000 7f885d087800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.27]): potential dests added=[] removed=[] 2024-09-22T08:34:17.195 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-22T08:34:17.129+0000 7f885d087800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f885d087800 time 2024-09-22T08:34:17.129926+0000 2024-09-22T08:34:17.195 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:34:17.195 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:17.195 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:34:17.195 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f886058c748] 2024-09-22T08:34:17.196 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f886058c906] 2024-09-22T08:34:17.196 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a0da950e01] 2024-09-22T08:34:17.196 INFO:tasks.workunit.client.0.smithi038.stderr: 4: radosgw-admin(+0xd817fe) [0x55a0dae637fe] 2024-09-22T08:34:17.196 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a0da960c9d] 2024-09-22T08:34:17.196 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-22T08:34:17.196 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f885f229590] 2024-09-22T08:34:17.196 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-22T08:34:17.196 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-22T08:34:17.196 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:17.196 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-22T08:34:17.130+0000 7f885d087800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:34:17.196 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f885d087800 thread_name:radosgw-admin 2024-09-22T08:34:17.196 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:17.196 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:34:17.196 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f885f23e6f0] 2024-09-22T08:34:17.196 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f885f28b99c] 2024-09-22T08:34:17.197 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:34:17.197 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:34:17.197 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f886058c7a2] 2024-09-22T08:34:17.197 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f886058c906] 2024-09-22T08:34:17.197 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a0da950e01] 2024-09-22T08:34:17.197 INFO:tasks.workunit.client.0.smithi038.stderr: 8: radosgw-admin(+0xd817fe) [0x55a0dae637fe] 2024-09-22T08:34:17.197 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a0da960c9d] 2024-09-22T08:34:17.197 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-22T08:34:17.197 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f885f229590] 2024-09-22T08:34:17.197 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-22T08:34:17.197 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-22T08:34:17.197 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:34:17.197 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:17.197 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-22T08:34:17.197 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-22T08:34:17.198 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-22T08:34:17.198 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-22T08:34:17.198 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-22T08:34:17.198 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-22T08:34:17.198 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-22T08:34:17.198 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-22T08:34:17.198 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-22T08:34:17.198 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-22T08:34:17.198 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-22T08:34:17.198 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-22T08:34:17.198 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-22T08:34:17.198 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-22T08:34:17.198 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-22T08:34:17.198 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-22T08:34:17.198 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-22T08:34:17.199 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-22T08:34:17.199 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-22T08:34:17.199 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-22T08:34:17.199 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-22T08:34:17.199 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-22T08:34:17.199 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-22T08:34:17.199 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-22T08:34:17.199 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:34:17.199 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-22T08:34:17.199 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-22T08:34:17.199 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-22T08:34:17.199 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-22T08:34:17.199 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-22T08:34:17.199 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-22T08:34:17.199 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-22T08:34:17.200 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-22T08:34:17.200 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-22T08:34:17.200 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-22T08:34:17.200 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-22T08:34:17.200 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-22T08:34:17.200 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-22T08:34:17.200 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-22T08:34:17.200 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-22T08:34:17.200 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-22T08:34:17.200 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-22T08:34:17.200 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-22T08:34:17.200 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-22T08:34:17.200 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-22T08:34:17.200 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-22T08:34:17.200 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:34:17.201 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-22T08:34:17.201 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:34:17.201 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-22T08:34:17.201 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-22T08:34:17.201 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-22T08:34:17.201 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-22T08:34:17.201 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-22T08:34:17.201 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-22T08:34:17.201 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-22T08:34:17.201 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-22T08:34:17.201 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-22T08:34:17.201 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-22T08:34:17.201 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-22T08:34:17.201 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-22T08:34:17.201 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-22T08:34:17.202 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-22T08:34:17.202 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-22T08:34:17.202 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-22T08:34:17.202 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-22T08:34:17.202 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-22T08:34:17.202 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:34:17.202 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-22T08:34:17.202 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:34:17.202 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-22T08:34:17.202 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-22T08:34:17.202 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-22T08:34:17.202 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-22T08:34:17.202 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-22T08:34:17.202 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-22T08:34:17.203 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:34:17.203 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-22T08:34:17.203 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-22T08:34:17.203 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:34:17.203 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-22T08:34:17.203 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-22T08:34:17.203 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-22T08:34:17.203 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-22T08:34:17.203 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-22T08:34:17.203 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-22T08:34:17.203 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-22T08:34:17.203 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-22T08:34:17.203 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-22T08:34:17.203 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-22T08:34:17.203 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-22T08:34:17.204 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-22T08:34:17.204 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-22T08:34:17.204 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:34:17.204 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8689ffb640 / http_manager 2024-09-22T08:34:17.204 INFO:tasks.workunit.client.0.smithi038.stderr: 7f868bfff640 / http_manager 2024-09-22T08:34:17.204 INFO:tasks.workunit.client.0.smithi038.stderr: 7f87117e2640 / rgw_dt_lg_renew 2024-09-22T08:34:17.204 INFO:tasks.workunit.client.0.smithi038.stderr: 7f873cff9640 / ms_dispatch 2024-09-22T08:34:17.204 INFO:tasks.workunit.client.0.smithi038.stderr: 7f873dffb640 / io_context_pool 2024-09-22T08:34:17.204 INFO:tasks.workunit.client.0.smithi038.stderr: 7f873e7fc640 / io_context_pool 2024-09-22T08:34:17.204 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8744e01640 / ms_dispatch 2024-09-22T08:34:17.204 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8747606640 / ms_dispatch 2024-09-22T08:34:17.204 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8748e09640 / io_context_pool 2024-09-22T08:34:17.204 INFO:tasks.workunit.client.0.smithi038.stderr: 7f885a370640 / msgr-worker-2 2024-09-22T08:34:17.204 INFO:tasks.workunit.client.0.smithi038.stderr: 7f885ab71640 / msgr-worker-1 2024-09-22T08:34:17.204 INFO:tasks.workunit.client.0.smithi038.stderr: 7f885b372640 / msgr-worker-0 2024-09-22T08:34:17.205 INFO:tasks.workunit.client.0.smithi038.stderr: 7f885bb73640 / io_context_pool 2024-09-22T08:34:17.205 INFO:tasks.workunit.client.0.smithi038.stderr: 7f885d087800 / radosgw-admin 2024-09-22T08:34:17.205 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-22T08:34:17.205 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-22T08:34:17.205 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/log/ceph/ceph-client.admin.105699.log 2024-09-22T08:34:17.205 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-22T08:34:17.205 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-22T08:34:17.205 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-22T08:34:16.871+0000 7f8748e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:34:17.205 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-22T08:34:16.871+0000 7f8748e09640 10 monclient: dump: 2024-09-22T08:34:17.205 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:34:17.205 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:34:17.205 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:17.205 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:17.206 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:34:17.206 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:17.206 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:34:17.206 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:34:17.206 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:34:17.206 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:17.206 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-22T08:34:16.871+0000 7f885d087800 5 monclient: authenticate success, global_id 6780 2024-09-22T08:34:17.206 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-22T08:34:16.871+0000 7f885d087800 10 monclient: get_monmap_and_config success 2024-09-22T08:34:17.206 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-22T08:34:16.871+0000 7f885d087800 4 set_mon_vals no callback set 2024-09-22T08:34:17.206 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-22T08:34:16.872+0000 7f885d087800 10 monclient: shutdown 2024-09-22T08:34:17.206 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-22T08:34:16.872+0000 7f885d087800 5 asok(0x55a0db31b0f0) unregister_commands rotate-key 2024-09-22T08:34:17.206 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-22T08:34:16.872+0000 7f885d087800 10 monclient: build_initial_monmap 2024-09-22T08:34:17.206 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-22T08:34:16.872+0000 7f885d087800 1 build_initial for_mkfs: 0 2024-09-22T08:34:17.206 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-22T08:34:16.872+0000 7f885d087800 10 monclient: monmap: 2024-09-22T08:34:17.206 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:34:17.207 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:34:17.207 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:34:17.207 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:34:17.207 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:34:17.207 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:17.207 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:34:17.207 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:34:17.207 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:34:17.207 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:17.207 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db5413e0) adding auth protocol: cephx 2024-09-22T08:34:17.207 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db5413e0) adding auth protocol: cephx 2024-09-22T08:34:17.207 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db5413e0) adding auth protocol: cephx 2024-09-22T08:34:17.207 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db5413e0) adding con mode: secure 2024-09-22T08:34:17.207 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db5413e0) adding con mode: crc 2024-09-22T08:34:17.208 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db5413e0) adding con mode: secure 2024-09-22T08:34:17.208 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db5413e0) adding con mode: crc 2024-09-22T08:34:17.208 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db5413e0) adding con mode: secure 2024-09-22T08:34:17.208 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db5413e0) adding con mode: crc 2024-09-22T08:34:17.208 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db5413e0) adding con mode: crc 2024-09-22T08:34:17.208 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db5413e0) adding con mode: secure 2024-09-22T08:34:17.208 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db5413e0) adding con mode: crc 2024-09-22T08:34:17.208 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db5413e0) adding con mode: secure 2024-09-22T08:34:17.208 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db5413e0) adding con mode: crc 2024-09-22T08:34:17.208 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db5413e0) adding con mode: secure 2024-09-22T08:34:17.208 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-22T08:34:16.872+0000 7f885d087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:17.208 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-22T08:34:16.872+0000 7f885d087800 1 librados: starting msgr at 2024-09-22T08:34:17.208 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-22T08:34:16.872+0000 7f885d087800 1 librados: starting objecter 2024-09-22T08:34:17.208 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-22T08:34:16.872+0000 7f885d087800 5 asok(0x55a0db31b0f0) register_command objecter_requests hook 0x55a0db3f11c0 2024-09-22T08:34:17.209 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-22T08:34:16.872+0000 7f885d087800 1 librados: setting wanted keys 2024-09-22T08:34:17.209 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-22T08:34:16.872+0000 7f885d087800 1 librados: calling monclient init 2024-09-22T08:34:17.209 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-22T08:34:16.872+0000 7f885d087800 10 monclient: init 2024-09-22T08:34:17.209 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db53be30) adding auth protocol: cephx 2024-09-22T08:34:17.209 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db53be30) adding auth protocol: cephx 2024-09-22T08:34:17.209 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db53be30) adding auth protocol: cephx 2024-09-22T08:34:17.209 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db53be30) adding con mode: secure 2024-09-22T08:34:17.209 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db53be30) adding con mode: crc 2024-09-22T08:34:17.209 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db53be30) adding con mode: secure 2024-09-22T08:34:17.209 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db53be30) adding con mode: crc 2024-09-22T08:34:17.209 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db53be30) adding con mode: secure 2024-09-22T08:34:17.209 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db53be30) adding con mode: crc 2024-09-22T08:34:17.209 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db53be30) adding con mode: crc 2024-09-22T08:34:17.209 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db53be30) adding con mode: secure 2024-09-22T08:34:17.209 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db53be30) adding con mode: crc 2024-09-22T08:34:17.210 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db53be30) adding con mode: secure 2024-09-22T08:34:17.210 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db53be30) adding con mode: crc 2024-09-22T08:34:17.210 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-22T08:34:16.872+0000 7f885d087800 5 AuthRegistry(0x55a0db53be30) adding con mode: secure 2024-09-22T08:34:17.210 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-22T08:34:16.873+0000 7f885d087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:17.210 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-22T08:34:16.873+0000 7f885d087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:17.210 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-22T08:34:16.873+0000 7f885d087800 5 asok(0x55a0db31b0f0) register_command rotate-key hook 0x55a0db53bf78 2024-09-22T08:34:17.210 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-22T08:34:16.873+0000 7f885d087800 10 monclient: _reopen_session rank -1 2024-09-22T08:34:17.210 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-22T08:34:16.873+0000 7f885d087800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T08:34:17.210 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-22T08:34:16.873+0000 7f885d087800 10 monclient(hunting): picked mon.noname-a con 0x55a0db3e8bd0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:34:17.210 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-22T08:34:16.873+0000 7f885d087800 10 monclient(hunting): picked mon.noname-b con 0x55a0db3f2640 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:34:17.210 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-22T08:34:16.873+0000 7f885d087800 10 monclient(hunting): picked mon.noname-c con 0x55a0db47ebd0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:34:17.210 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-22T08:34:16.873+0000 7f885d087800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:17.210 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-22T08:34:16.873+0000 7f885d087800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:17.210 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-22T08:34:16.873+0000 7f885d087800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:17.211 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-22T08:34:16.873+0000 7f885d087800 10 monclient(hunting): _renew_subs 2024-09-22T08:34:17.211 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-22T08:34:16.873+0000 7f885d087800 10 monclient(hunting): authenticate will time out at 1962.112390s 2024-09-22T08:34:17.211 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-22T08:34:16.873+0000 7f885ab71640 10 monclient(hunting): get_auth_request con 0x55a0db3e8bd0 auth_method 0 2024-09-22T08:34:17.211 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-22T08:34:16.873+0000 7f885ab71640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:17.211 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-22T08:34:16.873+0000 7f885ab71640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:17.211 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-22T08:34:16.873+0000 7f885ab71640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:17.211 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-22T08:34:16.873+0000 7f885b372640 10 monclient(hunting): get_auth_request con 0x55a0db47ebd0 auth_method 0 2024-09-22T08:34:17.211 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-22T08:34:16.873+0000 7f885b372640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:17.211 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-22T08:34:16.873+0000 7f885b372640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:17.211 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-22T08:34:16.873+0000 7f885b372640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:17.211 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-22T08:34:16.873+0000 7f885ab71640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:17.211 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-22T08:34:16.873+0000 7f885ab71640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:17.211 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-22T08:34:16.873+0000 7f885ab71640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:17.211 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-22T08:34:16.873+0000 7f885b372640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:17.212 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-22T08:34:16.873+0000 7f885b372640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:17.212 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-22T08:34:16.873+0000 7f885b372640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:17.212 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-22T08:34:16.873+0000 7f885ab71640 10 monclient(hunting): handle_auth_done global_id 6783 payload 824 2024-09-22T08:34:17.212 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-22T08:34:16.873+0000 7f885ab71640 10 monclient: _finish_hunting 0 2024-09-22T08:34:17.212 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-22T08:34:16.873+0000 7f885ab71640 1 monclient: found mon.noname-a 2024-09-22T08:34:17.212 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-22T08:34:16.873+0000 7f885ab71640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:34:17.212 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-22T08:34:16.873+0000 7f885a370640 10 monclient: get_auth_request con 0x55a0db3f2640 auth_method 0 2024-09-22T08:34:17.212 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-22T08:34:16.874+0000 7f8747606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:34:17.212 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-22T08:34:16.874+0000 7f8747606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:34:17.212 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-22T08:34:16.874+0000 7f8747606640 10 monclient: dump: 2024-09-22T08:34:17.212 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:34:17.212 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:34:17.212 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:17.212 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:17.212 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:34:17.213 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:17.213 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:34:17.213 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:34:17.213 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:34:17.213 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:17.213 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-22T08:34:16.874+0000 7f8747606640 10 monclient: _finish_auth 0 2024-09-22T08:34:17.213 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-22T08:34:16.874+0000 7f8747606640 10 monclient: _check_auth_tickets 2024-09-22T08:34:17.213 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-22T08:34:16.874+0000 7f8747606640 10 monclient: handle_config config(0 keys) 2024-09-22T08:34:17.213 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-22T08:34:16.874+0000 7f8747606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:34:17.213 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-22T08:34:16.874+0000 7f8747606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:34:17.213 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-22T08:34:16.874+0000 7f8747606640 10 monclient: dump: 2024-09-22T08:34:17.213 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:34:17.213 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:34:17.213 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:17.214 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:17.214 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:34:17.214 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:17.214 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:34:17.214 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:34:17.214 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:34:17.214 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:17.214 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-22T08:34:16.874+0000 7f885d087800 5 monclient: authenticate success, global_id 6783 2024-09-22T08:34:17.214 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-22T08:34:16.874+0000 7f885d087800 10 monclient: _renew_subs 2024-09-22T08:34:17.214 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-22T08:34:16.874+0000 7f885d087800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:34:17.214 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-22T08:34:16.874+0000 7f8748e09640 4 set_mon_vals no callback set 2024-09-22T08:34:17.214 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-22T08:34:16.874+0000 7f885d087800 10 monclient: _renew_subs 2024-09-22T08:34:17.214 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-22T08:34:16.874+0000 7f885d087800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:34:17.214 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-22T08:34:16.874+0000 7f885d087800 1 librados: init done 2024-09-22T08:34:17.214 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-22T08:34:16.876+0000 7f8747606640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:34:17.215 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-22T08:34:16.876+0000 7f8747606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:34:17.215 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-22T08:34:16.876+0000 7f8747606640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:34:17.215 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-22T08:34:16.876+0000 7f885a370640 10 monclient: get_auth_request con 0x7f8740077570 auth_method 0 2024-09-22T08:34:17.215 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-22T08:34:16.876+0000 7f885b372640 10 monclient: get_auth_request con 0x55a0db5786c0 auth_method 0 2024-09-22T08:34:17.215 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-22T08:34:16.877+0000 7f885ab71640 10 monclient: get_auth_request con 0x55a0db588630 auth_method 0 2024-09-22T08:34:17.215 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-22T08:34:16.878+0000 7f885a370640 10 monclient: get_auth_request con 0x55a0db58ca80 auth_method 0 2024-09-22T08:34:17.215 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-22T08:34:16.879+0000 7f885b372640 10 monclient: get_auth_request con 0x55a0db58bef0 auth_method 0 2024-09-22T08:34:17.215 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-22T08:34:16.880+0000 7f885d087800 10 monclient: build_initial_monmap 2024-09-22T08:34:17.215 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-22T08:34:16.880+0000 7f885d087800 1 build_initial for_mkfs: 0 2024-09-22T08:34:17.215 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-22T08:34:16.880+0000 7f885d087800 10 monclient: monmap: 2024-09-22T08:34:17.215 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:34:17.215 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:34:17.215 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:34:17.215 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:34:17.215 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:34:17.216 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:17.216 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:34:17.216 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:34:17.216 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:34:17.216 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:17.216 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db594c70) adding auth protocol: cephx 2024-09-22T08:34:17.216 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db594c70) adding auth protocol: cephx 2024-09-22T08:34:17.216 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db594c70) adding auth protocol: cephx 2024-09-22T08:34:17.216 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db594c70) adding con mode: secure 2024-09-22T08:34:17.216 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db594c70) adding con mode: crc 2024-09-22T08:34:17.216 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db594c70) adding con mode: secure 2024-09-22T08:34:17.216 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db594c70) adding con mode: crc 2024-09-22T08:34:17.216 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db594c70) adding con mode: secure 2024-09-22T08:34:17.216 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db594c70) adding con mode: crc 2024-09-22T08:34:17.217 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db594c70) adding con mode: crc 2024-09-22T08:34:17.217 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db594c70) adding con mode: secure 2024-09-22T08:34:17.217 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db594c70) adding con mode: crc 2024-09-22T08:34:17.217 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db594c70) adding con mode: secure 2024-09-22T08:34:17.217 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db594c70) adding con mode: crc 2024-09-22T08:34:17.217 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db594c70) adding con mode: secure 2024-09-22T08:34:17.217 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-22T08:34:16.880+0000 7f885d087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:17.217 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-22T08:34:16.880+0000 7f885d087800 5 asok(0x55a0db31b0f0) register_command objecter_requests cmddesc objecter_requests hook 0x55a0db5980c0 EEXIST 2024-09-22T08:34:17.217 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-22T08:34:16.880+0000 7f885d087800 10 monclient: init 2024-09-22T08:34:17.217 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db593b68) adding auth protocol: cephx 2024-09-22T08:34:17.217 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db593b68) adding auth protocol: cephx 2024-09-22T08:34:17.217 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db593b68) adding auth protocol: cephx 2024-09-22T08:34:17.217 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db593b68) adding con mode: secure 2024-09-22T08:34:17.217 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db593b68) adding con mode: crc 2024-09-22T08:34:17.217 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db593b68) adding con mode: secure 2024-09-22T08:34:17.218 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db593b68) adding con mode: crc 2024-09-22T08:34:17.218 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db593b68) adding con mode: secure 2024-09-22T08:34:17.218 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db593b68) adding con mode: crc 2024-09-22T08:34:17.218 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db593b68) adding con mode: crc 2024-09-22T08:34:17.218 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db593b68) adding con mode: secure 2024-09-22T08:34:17.218 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db593b68) adding con mode: crc 2024-09-22T08:34:17.218 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db593b68) adding con mode: secure 2024-09-22T08:34:17.218 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db593b68) adding con mode: crc 2024-09-22T08:34:17.218 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-22T08:34:16.880+0000 7f885d087800 5 AuthRegistry(0x55a0db593b68) adding con mode: secure 2024-09-22T08:34:17.218 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-22T08:34:16.880+0000 7f885d087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:17.218 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-22T08:34:16.881+0000 7f885d087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:17.218 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-22T08:34:16.881+0000 7f885d087800 5 asok(0x55a0db31b0f0) register_command rotate-key cmddesc rotate-key hook 0x55a0db593cb0 EEXIST 2024-09-22T08:34:17.218 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-22T08:34:16.881+0000 7f885d087800 10 monclient: _reopen_session rank -1 2024-09-22T08:34:17.218 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-22T08:34:16.881+0000 7f885d087800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T08:34:17.219 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-22T08:34:16.881+0000 7f885d087800 10 monclient(hunting): picked mon.noname-b con 0x55a0db5bc3e0 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:34:17.219 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-22T08:34:16.881+0000 7f885d087800 10 monclient(hunting): picked mon.noname-a con 0x55a0db5bc7c0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:34:17.219 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-22T08:34:16.881+0000 7f885d087800 10 monclient(hunting): picked mon.noname-c con 0x55a0db5bb0f0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:34:17.219 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-22T08:34:16.881+0000 7f885d087800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:17.219 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-22T08:34:16.881+0000 7f885d087800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:17.219 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-22T08:34:16.881+0000 7f885d087800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:17.219 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-22T08:34:16.881+0000 7f885d087800 10 monclient(hunting): _renew_subs 2024-09-22T08:34:17.219 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-22T08:34:16.881+0000 7f885d087800 10 monclient(hunting): authenticate will time out at 1962.120305s 2024-09-22T08:34:17.219 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-22T08:34:16.881+0000 7f885b372640 10 monclient(hunting): get_auth_request con 0x55a0db5bc7c0 auth_method 0 2024-09-22T08:34:17.219 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-22T08:34:16.881+0000 7f885b372640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:17.219 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-22T08:34:16.881+0000 7f885b372640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:17.219 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-22T08:34:16.881+0000 7f885b372640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:17.219 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-22T08:34:16.881+0000 7f885ab71640 10 monclient(hunting): get_auth_request con 0x55a0db5bb0f0 auth_method 0 2024-09-22T08:34:17.219 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-22T08:34:16.881+0000 7f885ab71640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:17.220 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-22T08:34:16.881+0000 7f885ab71640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:17.220 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-22T08:34:16.881+0000 7f885ab71640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:17.220 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-22T08:34:16.881+0000 7f885a370640 10 monclient(hunting): get_auth_request con 0x55a0db5bc3e0 auth_method 0 2024-09-22T08:34:17.220 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-22T08:34:16.881+0000 7f885a370640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:17.220 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-22T08:34:16.881+0000 7f885a370640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:17.220 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-22T08:34:16.881+0000 7f885a370640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:17.220 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-22T08:34:16.881+0000 7f885b372640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:17.220 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-22T08:34:16.881+0000 7f885b372640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:17.220 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-22T08:34:16.881+0000 7f885b372640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:17.220 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-22T08:34:16.881+0000 7f885ab71640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:17.220 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-22T08:34:16.881+0000 7f885ab71640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:17.220 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-22T08:34:16.881+0000 7f885ab71640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:17.220 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-22T08:34:16.881+0000 7f885a370640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:17.220 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-22T08:34:16.881+0000 7f885a370640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:17.220 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-22T08:34:16.881+0000 7f885a370640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:17.221 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-22T08:34:16.881+0000 7f885b372640 10 monclient(hunting): handle_auth_done global_id 6786 payload 824 2024-09-22T08:34:17.221 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-22T08:34:16.881+0000 7f885b372640 10 monclient: _finish_hunting 0 2024-09-22T08:34:17.221 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-22T08:34:16.881+0000 7f885b372640 1 monclient: found mon.noname-a 2024-09-22T08:34:17.221 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-22T08:34:16.881+0000 7f885b372640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:34:17.221 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-22T08:34:16.882+0000 7f8744e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:34:17.221 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-22T08:34:16.882+0000 7f8744e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:34:17.221 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-22T08:34:16.882+0000 7f8744e01640 10 monclient: dump: 2024-09-22T08:34:17.221 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:34:17.221 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:34:17.221 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:17.221 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:17.221 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:34:17.221 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:17.221 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:34:17.221 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:34:17.222 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:34:17.222 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:17.222 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-22T08:34:16.882+0000 7f8744e01640 10 monclient: _finish_auth 0 2024-09-22T08:34:17.222 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-22T08:34:16.882+0000 7f8744e01640 10 monclient: _check_auth_tickets 2024-09-22T08:34:17.222 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-22T08:34:16.882+0000 7f8744e01640 10 monclient: handle_config config(0 keys) 2024-09-22T08:34:17.222 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-22T08:34:16.882+0000 7f8744e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:34:17.222 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-22T08:34:16.882+0000 7f8744e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:34:17.222 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-22T08:34:16.882+0000 7f8744e01640 10 monclient: dump: 2024-09-22T08:34:17.222 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:34:17.222 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:34:17.222 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:17.222 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:17.222 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:34:17.222 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:17.222 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:34:17.223 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:34:17.223 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:34:17.223 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:17.223 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-22T08:34:16.882+0000 7f885d087800 5 monclient: authenticate success, global_id 6786 2024-09-22T08:34:17.223 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-22T08:34:16.882+0000 7f885d087800 10 monclient: _renew_subs 2024-09-22T08:34:17.223 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-22T08:34:16.882+0000 7f885d087800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:34:17.223 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-22T08:34:16.882+0000 7f885bb73640 4 set_mon_vals no callback set 2024-09-22T08:34:17.223 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-22T08:34:16.882+0000 7f885d087800 10 monclient: _renew_subs 2024-09-22T08:34:17.223 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-22T08:34:16.882+0000 7f885d087800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:34:17.223 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-22T08:34:16.884+0000 7f8744e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:34:17.223 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-22T08:34:16.884+0000 7f8744e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:34:17.223 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-22T08:34:16.884+0000 7f8744e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:34:17.223 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-22T08:34:16.884+0000 7f885a370640 10 monclient: get_auth_request con 0x7f8734077480 auth_method 0 2024-09-22T08:34:17.223 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-22T08:34:16.884+0000 7f885d087800 10 monclient: get_monmap_and_config 2024-09-22T08:34:17.224 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-22T08:34:16.884+0000 7f885d087800 10 monclient: build_initial_monmap 2024-09-22T08:34:17.224 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-22T08:34:16.884+0000 7f885d087800 1 build_initial for_mkfs: 0 2024-09-22T08:34:17.224 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-22T08:34:16.884+0000 7f885d087800 10 monclient: monmap: 2024-09-22T08:34:17.224 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:34:17.224 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:34:17.224 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:34:17.224 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:34:17.224 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:34:17.224 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:17.224 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:34:17.224 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:34:17.224 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:34:17.224 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:17.224 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x55a0db5dc0d0) adding auth protocol: cephx 2024-09-22T08:34:17.224 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x55a0db5dc0d0) adding auth protocol: cephx 2024-09-22T08:34:17.225 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x55a0db5dc0d0) adding auth protocol: cephx 2024-09-22T08:34:17.225 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x55a0db5dc0d0) adding con mode: secure 2024-09-22T08:34:17.225 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x55a0db5dc0d0) adding con mode: crc 2024-09-22T08:34:17.225 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x55a0db5dc0d0) adding con mode: secure 2024-09-22T08:34:17.225 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x55a0db5dc0d0) adding con mode: crc 2024-09-22T08:34:17.225 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x55a0db5dc0d0) adding con mode: secure 2024-09-22T08:34:17.225 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x55a0db5dc0d0) adding con mode: crc 2024-09-22T08:34:17.225 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x55a0db5dc0d0) adding con mode: crc 2024-09-22T08:34:17.225 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x55a0db5dc0d0) adding con mode: secure 2024-09-22T08:34:17.225 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x55a0db5dc0d0) adding con mode: crc 2024-09-22T08:34:17.225 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x55a0db5dc0d0) adding con mode: secure 2024-09-22T08:34:17.225 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x55a0db5dc0d0) adding con mode: crc 2024-09-22T08:34:17.225 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x55a0db5dc0d0) adding con mode: secure 2024-09-22T08:34:17.225 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-22T08:34:16.884+0000 7f885d087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:17.225 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-22T08:34:16.884+0000 7f885d087800 10 monclient: init 2024-09-22T08:34:17.226 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c11a0) adding auth protocol: cephx 2024-09-22T08:34:17.226 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c11a0) adding auth protocol: cephx 2024-09-22T08:34:17.226 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c11a0) adding auth protocol: cephx 2024-09-22T08:34:17.226 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c11a0) adding con mode: secure 2024-09-22T08:34:17.226 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c11a0) adding con mode: crc 2024-09-22T08:34:17.226 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c11a0) adding con mode: secure 2024-09-22T08:34:17.226 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c11a0) adding con mode: crc 2024-09-22T08:34:17.226 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c11a0) adding con mode: secure 2024-09-22T08:34:17.226 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c11a0) adding con mode: crc 2024-09-22T08:34:17.226 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c11a0) adding con mode: crc 2024-09-22T08:34:17.226 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c11a0) adding con mode: secure 2024-09-22T08:34:17.226 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c11a0) adding con mode: crc 2024-09-22T08:34:17.226 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c11a0) adding con mode: secure 2024-09-22T08:34:17.226 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c11a0) adding con mode: crc 2024-09-22T08:34:17.226 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-22T08:34:16.884+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c11a0) adding con mode: secure 2024-09-22T08:34:17.227 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-22T08:34:16.885+0000 7f885d087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:17.227 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-22T08:34:16.885+0000 7f885d087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:17.227 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-22T08:34:16.885+0000 7f885d087800 5 asok(0x55a0db31b0f0) register_command rotate-key cmddesc rotate-key hook 0x7ffcde7c12e8 EEXIST 2024-09-22T08:34:17.227 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-22T08:34:16.885+0000 7f885d087800 10 monclient: _reopen_session rank -1 2024-09-22T08:34:17.227 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-22T08:34:16.885+0000 7f885d087800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T08:34:17.227 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-22T08:34:16.885+0000 7f885d087800 10 monclient(hunting): picked mon.noname-c con 0x55a0db6106b0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:34:17.227 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-22T08:34:16.885+0000 7f885d087800 10 monclient(hunting): picked mon.noname-a con 0x55a0db601000 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:34:17.227 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-22T08:34:16.885+0000 7f885d087800 10 monclient(hunting): picked mon.noname-b con 0x55a0db60bae0 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:34:17.227 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-22T08:34:16.885+0000 7f885d087800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:17.227 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-22T08:34:16.885+0000 7f885d087800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:17.227 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-22T08:34:16.885+0000 7f885d087800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:17.227 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-22T08:34:16.885+0000 7f885d087800 10 monclient(hunting): _renew_subs 2024-09-22T08:34:17.227 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-22T08:34:16.885+0000 7f885d087800 10 monclient(hunting): authenticate will time out at 1962.124473s 2024-09-22T08:34:17.227 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-22T08:34:16.885+0000 7f885a370640 10 monclient(hunting): get_auth_request con 0x55a0db6106b0 auth_method 0 2024-09-22T08:34:17.228 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-22T08:34:16.885+0000 7f885a370640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:17.228 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-22T08:34:16.885+0000 7f885a370640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:17.228 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-22T08:34:16.885+0000 7f885a370640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:17.228 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-22T08:34:16.885+0000 7f885b372640 10 monclient(hunting): get_auth_request con 0x55a0db601000 auth_method 0 2024-09-22T08:34:17.228 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-22T08:34:16.885+0000 7f885b372640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:17.228 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-22T08:34:16.885+0000 7f885b372640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:17.228 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-22T08:34:16.885+0000 7f885b372640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:17.228 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-22T08:34:16.885+0000 7f885a370640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:17.228 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-22T08:34:16.885+0000 7f885a370640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:17.228 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-22T08:34:16.885+0000 7f885a370640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:17.228 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-22T08:34:16.885+0000 7f885b372640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:17.228 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-22T08:34:16.885+0000 7f885b372640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:17.228 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-22T08:34:16.885+0000 7f885b372640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:17.229 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-22T08:34:16.885+0000 7f885ab71640 10 monclient(hunting): get_auth_request con 0x55a0db60bae0 auth_method 0 2024-09-22T08:34:17.229 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-22T08:34:16.885+0000 7f885ab71640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:17.229 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-22T08:34:16.885+0000 7f885ab71640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:17.229 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-22T08:34:16.885+0000 7f885ab71640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:17.229 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-22T08:34:16.885+0000 7f885a370640 10 monclient(hunting): handle_auth_done global_id 6419 payload 274 2024-09-22T08:34:17.229 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-22T08:34:16.885+0000 7f885a370640 10 monclient: _finish_hunting 0 2024-09-22T08:34:17.229 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-22T08:34:16.885+0000 7f885a370640 1 monclient: found mon.noname-c 2024-09-22T08:34:17.229 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-22T08:34:16.885+0000 7f885a370640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:34:17.229 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-22T08:34:16.886+0000 7f873e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:34:17.229 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-22T08:34:16.886+0000 7f873e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:34:17.229 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-22T08:34:16.886+0000 7f873e7fc640 10 monclient: dump: 2024-09-22T08:34:17.229 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:34:17.229 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:34:17.229 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:17.229 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:17.230 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:34:17.230 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:17.230 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:34:17.230 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:34:17.230 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:34:17.230 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:17.230 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-22T08:34:16.886+0000 7f873e7fc640 10 monclient: _finish_auth 0 2024-09-22T08:34:17.230 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-22T08:34:16.886+0000 7f873e7fc640 10 monclient: _check_auth_tickets 2024-09-22T08:34:17.230 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-22T08:34:16.886+0000 7f873e7fc640 10 monclient: handle_config config(0 keys) 2024-09-22T08:34:17.230 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-22T08:34:16.886+0000 7f873e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:34:17.230 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-22T08:34:16.886+0000 7f873e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:34:17.230 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-22T08:34:16.886+0000 7f873e7fc640 10 monclient: dump: 2024-09-22T08:34:17.230 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:34:17.230 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:34:17.231 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:17.231 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:17.231 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:34:17.231 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:17.231 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:34:17.231 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:34:17.231 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:34:17.231 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:17.231 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-22T08:34:16.886+0000 7f885d087800 5 monclient: authenticate success, global_id 6419 2024-09-22T08:34:17.231 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-22T08:34:16.886+0000 7f885d087800 10 monclient: get_monmap_and_config success 2024-09-22T08:34:17.231 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-22T08:34:16.886+0000 7f885d087800 4 set_mon_vals no callback set 2024-09-22T08:34:17.231 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-22T08:34:16.886+0000 7f885d087800 10 monclient: shutdown 2024-09-22T08:34:17.231 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-22T08:34:16.886+0000 7f885d087800 10 monclient: build_initial_monmap 2024-09-22T08:34:17.231 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-22T08:34:16.886+0000 7f885d087800 1 build_initial for_mkfs: 0 2024-09-22T08:34:17.232 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-22T08:34:16.886+0000 7f885d087800 10 monclient: monmap: 2024-09-22T08:34:17.232 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:34:17.232 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:34:17.232 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:34:17.232 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:34:17.232 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:34:17.232 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:17.232 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:34:17.232 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:34:17.232 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:34:17.232 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:17.232 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-22T08:34:16.886+0000 7f885d087800 5 AuthRegistry(0x55a0db5dfc10) adding auth protocol: cephx 2024-09-22T08:34:17.232 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-22T08:34:16.886+0000 7f885d087800 5 AuthRegistry(0x55a0db5dfc10) adding auth protocol: cephx 2024-09-22T08:34:17.232 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-22T08:34:16.886+0000 7f885d087800 5 AuthRegistry(0x55a0db5dfc10) adding auth protocol: cephx 2024-09-22T08:34:17.232 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-22T08:34:16.886+0000 7f885d087800 5 AuthRegistry(0x55a0db5dfc10) adding con mode: secure 2024-09-22T08:34:17.233 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-22T08:34:16.886+0000 7f885d087800 5 AuthRegistry(0x55a0db5dfc10) adding con mode: crc 2024-09-22T08:34:17.233 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-22T08:34:16.886+0000 7f885d087800 5 AuthRegistry(0x55a0db5dfc10) adding con mode: secure 2024-09-22T08:34:17.233 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-22T08:34:16.886+0000 7f885d087800 5 AuthRegistry(0x55a0db5dfc10) adding con mode: crc 2024-09-22T08:34:17.233 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-22T08:34:16.886+0000 7f885d087800 5 AuthRegistry(0x55a0db5dfc10) adding con mode: secure 2024-09-22T08:34:17.233 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-22T08:34:16.886+0000 7f885d087800 5 AuthRegistry(0x55a0db5dfc10) adding con mode: crc 2024-09-22T08:34:17.233 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-22T08:34:16.886+0000 7f885d087800 5 AuthRegistry(0x55a0db5dfc10) adding con mode: crc 2024-09-22T08:34:17.233 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-22T08:34:16.886+0000 7f885d087800 5 AuthRegistry(0x55a0db5dfc10) adding con mode: secure 2024-09-22T08:34:17.233 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-22T08:34:16.886+0000 7f885d087800 5 AuthRegistry(0x55a0db5dfc10) adding con mode: crc 2024-09-22T08:34:17.233 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-22T08:34:16.886+0000 7f885d087800 5 AuthRegistry(0x55a0db5dfc10) adding con mode: secure 2024-09-22T08:34:17.233 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-22T08:34:16.886+0000 7f885d087800 5 AuthRegistry(0x55a0db5dfc10) adding con mode: crc 2024-09-22T08:34:17.233 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-22T08:34:16.886+0000 7f885d087800 5 AuthRegistry(0x55a0db5dfc10) adding con mode: secure 2024-09-22T08:34:17.233 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-22T08:34:16.887+0000 7f885d087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:17.233 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-22T08:34:16.887+0000 7f885d087800 1 librados: starting msgr at 2024-09-22T08:34:17.233 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-22T08:34:16.887+0000 7f885d087800 1 librados: starting objecter 2024-09-22T08:34:17.234 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-22T08:34:16.887+0000 7f885d087800 5 asok(0x55a0db31b0f0) register_command objecter_requests cmddesc objecter_requests hook 0x55a0db606800 EEXIST 2024-09-22T08:34:17.234 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-22T08:34:16.887+0000 7f885d087800 1 librados: setting wanted keys 2024-09-22T08:34:17.234 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-22T08:34:16.887+0000 7f885d087800 1 librados: calling monclient init 2024-09-22T08:34:17.234 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-22T08:34:16.887+0000 7f885d087800 10 monclient: init 2024-09-22T08:34:17.234 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-22T08:34:16.887+0000 7f885d087800 5 AuthRegistry(0x55a0db5d0ca0) adding auth protocol: cephx 2024-09-22T08:34:17.234 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-22T08:34:16.887+0000 7f885d087800 5 AuthRegistry(0x55a0db5d0ca0) adding auth protocol: cephx 2024-09-22T08:34:17.234 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-22T08:34:16.887+0000 7f885d087800 5 AuthRegistry(0x55a0db5d0ca0) adding auth protocol: cephx 2024-09-22T08:34:17.234 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-22T08:34:16.887+0000 7f885d087800 5 AuthRegistry(0x55a0db5d0ca0) adding con mode: secure 2024-09-22T08:34:17.234 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-22T08:34:16.887+0000 7f885d087800 5 AuthRegistry(0x55a0db5d0ca0) adding con mode: crc 2024-09-22T08:34:17.234 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-22T08:34:16.887+0000 7f885d087800 5 AuthRegistry(0x55a0db5d0ca0) adding con mode: secure 2024-09-22T08:34:17.234 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-22T08:34:16.887+0000 7f885d087800 5 AuthRegistry(0x55a0db5d0ca0) adding con mode: crc 2024-09-22T08:34:17.234 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-22T08:34:16.887+0000 7f885d087800 5 AuthRegistry(0x55a0db5d0ca0) adding con mode: secure 2024-09-22T08:34:17.234 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-22T08:34:16.887+0000 7f885d087800 5 AuthRegistry(0x55a0db5d0ca0) adding con mode: crc 2024-09-22T08:34:17.234 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-22T08:34:16.887+0000 7f885d087800 5 AuthRegistry(0x55a0db5d0ca0) adding con mode: crc 2024-09-22T08:34:17.234 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-22T08:34:16.887+0000 7f885d087800 5 AuthRegistry(0x55a0db5d0ca0) adding con mode: secure 2024-09-22T08:34:17.235 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-22T08:34:16.887+0000 7f885d087800 5 AuthRegistry(0x55a0db5d0ca0) adding con mode: crc 2024-09-22T08:34:17.235 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-22T08:34:16.887+0000 7f885d087800 5 AuthRegistry(0x55a0db5d0ca0) adding con mode: secure 2024-09-22T08:34:17.235 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-22T08:34:16.887+0000 7f885d087800 5 AuthRegistry(0x55a0db5d0ca0) adding con mode: crc 2024-09-22T08:34:17.235 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-22T08:34:16.887+0000 7f885d087800 5 AuthRegistry(0x55a0db5d0ca0) adding con mode: secure 2024-09-22T08:34:17.235 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-22T08:34:16.887+0000 7f885d087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:17.235 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-22T08:34:16.887+0000 7f885d087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:17.235 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-22T08:34:16.887+0000 7f885d087800 5 asok(0x55a0db31b0f0) register_command rotate-key cmddesc rotate-key hook 0x55a0db5d0de8 EEXIST 2024-09-22T08:34:17.235 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-22T08:34:16.887+0000 7f885d087800 10 monclient: _reopen_session rank -1 2024-09-22T08:34:17.235 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-22T08:34:16.887+0000 7f885d087800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-22T08:34:17.235 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-22T08:34:16.887+0000 7f885d087800 10 monclient(hunting): picked mon.noname-b con 0x55a0db601000 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:34:17.235 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-22T08:34:16.887+0000 7f885d087800 10 monclient(hunting): picked mon.noname-c con 0x55a0db60bae0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:34:17.235 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-22T08:34:16.887+0000 7f885d087800 10 monclient(hunting): picked mon.noname-a con 0x55a0db6106b0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:34:17.235 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-22T08:34:16.887+0000 7f885d087800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:17.235 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-22T08:34:16.887+0000 7f885d087800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:17.235 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-22T08:34:16.887+0000 7f885d087800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:17.236 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-22T08:34:16.887+0000 7f885d087800 10 monclient(hunting): _renew_subs 2024-09-22T08:34:17.236 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-22T08:34:16.887+0000 7f885d087800 10 monclient(hunting): authenticate will time out at 1962.126822s 2024-09-22T08:34:17.236 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-22T08:34:16.887+0000 7f885ab71640 10 monclient(hunting): get_auth_request con 0x55a0db6106b0 auth_method 0 2024-09-22T08:34:17.236 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-22T08:34:16.887+0000 7f885ab71640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:17.236 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-22T08:34:16.887+0000 7f885ab71640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:17.236 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-22T08:34:16.887+0000 7f885ab71640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:17.236 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-22T08:34:16.887+0000 7f885b372640 10 monclient(hunting): get_auth_request con 0x55a0db60bae0 auth_method 0 2024-09-22T08:34:17.236 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-22T08:34:16.887+0000 7f885b372640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:17.236 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-22T08:34:16.887+0000 7f885b372640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:17.236 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-22T08:34:16.887+0000 7f885b372640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:17.236 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-22T08:34:16.888+0000 7f885ab71640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:17.236 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-22T08:34:16.888+0000 7f885ab71640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:17.236 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-22T08:34:16.888+0000 7f885ab71640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:17.236 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-22T08:34:16.888+0000 7f885b372640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:17.236 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-22T08:34:16.888+0000 7f885b372640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:17.237 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-22T08:34:16.888+0000 7f885b372640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:17.237 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-22T08:34:16.888+0000 7f885a370640 10 monclient(hunting): get_auth_request con 0x55a0db601000 auth_method 0 2024-09-22T08:34:17.237 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-22T08:34:16.888+0000 7f885a370640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:17.237 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-22T08:34:16.888+0000 7f885a370640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:17.237 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-22T08:34:16.888+0000 7f885a370640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:17.237 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-22T08:34:16.888+0000 7f885a370640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:17.237 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-22T08:34:16.888+0000 7f885a370640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:17.237 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-22T08:34:16.888+0000 7f885a370640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:17.237 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-22T08:34:16.888+0000 7f885ab71640 10 monclient(hunting): handle_auth_done global_id 6792 payload 824 2024-09-22T08:34:17.237 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-22T08:34:16.888+0000 7f885ab71640 10 monclient: _finish_hunting 0 2024-09-22T08:34:17.237 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-22T08:34:16.888+0000 7f885ab71640 1 monclient: found mon.noname-a 2024-09-22T08:34:17.237 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-22T08:34:16.888+0000 7f885ab71640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:34:17.237 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-22T08:34:16.888+0000 7f873cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:34:17.237 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-22T08:34:16.888+0000 7f873cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:34:17.238 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-22T08:34:16.888+0000 7f873cff9640 10 monclient: dump: 2024-09-22T08:34:17.238 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:34:17.238 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:34:17.238 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:17.238 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:17.238 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:34:17.238 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:17.238 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:34:17.238 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:34:17.238 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:34:17.238 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:17.238 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-22T08:34:16.888+0000 7f873cff9640 10 monclient: _finish_auth 0 2024-09-22T08:34:17.238 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-22T08:34:16.888+0000 7f873cff9640 10 monclient: _check_auth_tickets 2024-09-22T08:34:17.238 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-22T08:34:16.888+0000 7f873cff9640 10 monclient: handle_config config(0 keys) 2024-09-22T08:34:17.238 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-22T08:34:16.888+0000 7f873cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:34:17.239 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-22T08:34:16.888+0000 7f873cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:34:17.239 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-22T08:34:16.888+0000 7f873cff9640 10 monclient: dump: 2024-09-22T08:34:17.239 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:34:17.239 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:34:17.239 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:17.239 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:17.239 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:34:17.239 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:17.239 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:34:17.239 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:34:17.239 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:34:17.239 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:17.239 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-22T08:34:16.888+0000 7f885d087800 5 monclient: authenticate success, global_id 6792 2024-09-22T08:34:17.239 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-22T08:34:16.888+0000 7f885d087800 10 monclient: _renew_subs 2024-09-22T08:34:17.239 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-22T08:34:16.888+0000 7f873e7fc640 4 set_mon_vals no callback set 2024-09-22T08:34:17.240 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-22T08:34:16.888+0000 7f885d087800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:34:17.240 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-22T08:34:16.888+0000 7f885d087800 10 monclient: _renew_subs 2024-09-22T08:34:17.240 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-22T08:34:16.888+0000 7f885d087800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:34:17.240 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-22T08:34:16.888+0000 7f885d087800 1 librados: init done 2024-09-22T08:34:17.240 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-22T08:34:16.888+0000 7f885d087800 5 asok(0x55a0db31b0f0) register_command cr dump hook 0x55a0db605da8 2024-09-22T08:34:17.240 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-22T08:34:16.890+0000 7f885d087800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.240 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-22T08:34:16.890+0000 7f873cff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:34:17.240 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-22T08:34:16.890+0000 7f873cff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:34:17.240 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-22T08:34:16.890+0000 7f873cff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:34:17.240 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-22T08:34:16.890+0000 7f885a370640 10 monclient: get_auth_request con 0x7f8724077570 auth_method 0 2024-09-22T08:34:17.240 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-22T08:34:16.890+0000 7f885b372640 10 monclient: get_auth_request con 0x55a0db62a800 auth_method 0 2024-09-22T08:34:17.240 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-22T08:34:16.891+0000 7f885d087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:17.240 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-22T08:34:16.891+0000 7f885d087800 20 realm 2024-09-22T08:34:17.240 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-22T08:34:16.891+0000 7f885d087800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.241 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-22T08:34:16.891+0000 7f885d087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:17.241 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-22T08:34:16.891+0000 7f885d087800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:34:17.241 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-22T08:34:16.891+0000 7f885d087800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.241 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-22T08:34:16.892+0000 7f885d087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:17.241 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-22T08:34:16.892+0000 7f885d087800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.241 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-22T08:34:16.892+0000 7f885a370640 10 monclient: get_auth_request con 0x55a0db62ea40 auth_method 0 2024-09-22T08:34:17.241 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-22T08:34:16.892+0000 7f885d087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:17.241 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-22T08:34:16.892+0000 7f885d087800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.241 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-22T08:34:16.893+0000 7f885b372640 10 monclient: get_auth_request con 0x55a0db6322a0 auth_method 0 2024-09-22T08:34:17.241 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-22T08:34:16.893+0000 7f885d087800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:34:17.241 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-22T08:34:16.893+0000 7f885d087800 20 searching for the correct realm 2024-09-22T08:34:17.241 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-22T08:34:16.893+0000 7f885ab71640 10 monclient: get_auth_request con 0x55a0db636fe0 auth_method 0 2024-09-22T08:34:17.241 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-22T08:34:16.895+0000 7f885a370640 10 monclient: get_auth_request con 0x7f885002b070 auth_method 0 2024-09-22T08:34:17.241 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-22T08:34:16.896+0000 7f885b372640 0 -- 172.21.15.38:0/3397590537 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7f884c061040 msgr2=0x7f884c0ba3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:34:17.241 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-22T08:34:17.098+0000 7f885b372640 10 monclient: get_auth_request con 0x7f884c061040 auth_method 0 2024-09-22T08:34:17.242 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-22T08:34:17.100+0000 7f885ab71640 10 monclient: get_auth_request con 0x7f88500521b0 auth_method 0 2024-09-22T08:34:17.242 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-22T08:34:17.101+0000 7f885a370640 10 monclient: get_auth_request con 0x7f884c0cf4d0 auth_method 0 2024-09-22T08:34:17.242 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-22T08:34:17.102+0000 7f885b372640 0 -- 172.21.15.38:0/3397590537 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x55a0db62a800 msgr2=0x55a0db62cc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:34:17.242 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-22T08:34:17.102+0000 7f873cff9640 1 client.6792.objecter ms_handle_reset 0x55a0db62a800 session 0x55a0db62a0f0 osd.6 2024-09-22T08:34:17.242 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-22T08:34:17.102+0000 7f873cff9640 10 monclient: _renew_subs 2024-09-22T08:34:17.242 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-22T08:34:17.102+0000 7f873cff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:34:17.242 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-22T08:34:17.102+0000 7f885b372640 10 monclient: get_auth_request con 0x7f8724087090 auth_method 0 2024-09-22T08:34:17.242 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-22T08:34:17.106+0000 7f885d087800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:34:17.242 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-22T08:34:17.106+0000 7f885d087800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:34:17.242 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-22T08:34:17.106+0000 7f885d087800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:34:17.242 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-22T08:34:17.106+0000 7f885d087800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:34:17.242 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-22T08:34:17.106+0000 7f885d087800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:34:17.242 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-22T08:34:17.106+0000 7f885d087800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:34:17.242 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-22T08:34:17.106+0000 7f885d087800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.243 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-22T08:34:17.106+0000 7f885d087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:17.243 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-22T08:34:17.106+0000 7f885d087800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.243 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-22T08:34:17.107+0000 7f885d087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:17.243 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-22T08:34:17.107+0000 7f885d087800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.243 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-22T08:34:17.107+0000 7f885d087800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:34:17.243 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-22T08:34:17.107+0000 7f885d087800 20 zone default found 2024-09-22T08:34:17.243 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-22T08:34:17.107+0000 7f885d087800 4 Realm: () 2024-09-22T08:34:17.243 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-22T08:34:17.107+0000 7f885d087800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:34:17.243 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-22T08:34:17.107+0000 7f885d087800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:34:17.243 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-22T08:34:17.107+0000 7f885d087800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:34:17.243 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-22T08:34:17.107+0000 7f885d087800 20 zonegroup default 2024-09-22T08:34:17.243 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-22T08:34:17.107+0000 7f885d087800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.243 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-22T08:34:17.107+0000 7f885d087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:17.243 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-22T08:34:17.107+0000 7f885d087800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.244 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-22T08:34:17.108+0000 7f885d087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:17.244 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-22T08:34:17.108+0000 7f885d087800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.244 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-22T08:34:17.108+0000 7f885d087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:17.244 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-22T08:34:17.108+0000 7f885d087800 20 started sync module instance, tier type = 2024-09-22T08:34:17.244 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-22T08:34:17.108+0000 7f885d087800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:34:17.244 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-22T08:34:17.118+0000 7f885d087800 20 add_watcher() i=0 2024-09-22T08:34:17.244 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-22T08:34:17.118+0000 7f885d087800 20 add_watcher() i=1 2024-09-22T08:34:17.244 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-22T08:34:17.118+0000 7f885d087800 20 add_watcher() i=2 2024-09-22T08:34:17.244 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-22T08:34:17.118+0000 7f885d087800 20 add_watcher() i=3 2024-09-22T08:34:17.244 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-22T08:34:17.118+0000 7f885d087800 20 add_watcher() i=4 2024-09-22T08:34:17.244 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-22T08:34:17.118+0000 7f885d087800 20 add_watcher() i=5 2024-09-22T08:34:17.244 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-22T08:34:17.118+0000 7f885d087800 20 add_watcher() i=6 2024-09-22T08:34:17.244 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-22T08:34:17.119+0000 7f885d087800 20 add_watcher() i=7 2024-09-22T08:34:17.244 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-22T08:34:17.119+0000 7f885d087800 2 all 8 watchers are set, enabling cache 2024-09-22T08:34:17.244 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-22T08:34:17.121+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c1670) adding auth protocol: cephx 2024-09-22T08:34:17.244 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-22T08:34:17.121+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c1670) adding auth protocol: cephx 2024-09-22T08:34:17.245 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-22T08:34:17.121+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c1670) adding auth protocol: cephx 2024-09-22T08:34:17.245 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-22T08:34:17.121+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c1670) adding con mode: secure 2024-09-22T08:34:17.245 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-22T08:34:17.121+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c1670) adding con mode: crc 2024-09-22T08:34:17.245 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-22T08:34:17.121+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c1670) adding con mode: secure 2024-09-22T08:34:17.245 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-22T08:34:17.121+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c1670) adding con mode: crc 2024-09-22T08:34:17.245 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-22T08:34:17.121+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c1670) adding con mode: secure 2024-09-22T08:34:17.245 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-22T08:34:17.121+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c1670) adding con mode: crc 2024-09-22T08:34:17.245 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-22T08:34:17.121+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c1670) adding con mode: crc 2024-09-22T08:34:17.245 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-22T08:34:17.121+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c1670) adding con mode: secure 2024-09-22T08:34:17.245 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-22T08:34:17.121+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c1670) adding con mode: crc 2024-09-22T08:34:17.245 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-22T08:34:17.121+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c1670) adding con mode: secure 2024-09-22T08:34:17.245 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-22T08:34:17.121+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c1670) adding con mode: crc 2024-09-22T08:34:17.245 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-22T08:34:17.121+0000 7f87117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:17.245 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-22T08:34:17.121+0000 7f885d087800 5 AuthRegistry(0x7ffcde7c1670) adding con mode: secure 2024-09-22T08:34:17.245 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-22T08:34:17.121+0000 7f885d087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:17.246 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-22T08:34:17.121+0000 7f885d087800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:34:17.246 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-22T08:34:17.121+0000 7f885d087800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:34:17.246 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-22T08:34:17.121+0000 7f885d087800 5 asok(0x55a0db31b0f0) register_command cache list hook 0x55a0db608b90 2024-09-22T08:34:17.246 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-22T08:34:17.121+0000 7f885d087800 5 asok(0x55a0db31b0f0) register_command cache inspect hook 0x55a0db608b90 2024-09-22T08:34:17.246 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-22T08:34:17.121+0000 7f885d087800 5 asok(0x55a0db31b0f0) register_command cache erase hook 0x55a0db608b90 2024-09-22T08:34:17.246 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-22T08:34:17.121+0000 7f885d087800 5 asok(0x55a0db31b0f0) register_command cache zap hook 0x55a0db608b90 2024-09-22T08:34:17.246 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-22T08:34:17.121+0000 7f885d087800 5 note: GC not initialized 2024-09-22T08:34:17.246 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-22T08:34:17.121+0000 7f868bfff640 20 reqs_thread_entry: start 2024-09-22T08:34:17.246 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-22T08:34:17.121+0000 7f885d087800 5 asok(0x55a0db31b0f0) register_command sync trace show hook 0x7f88500109d0 2024-09-22T08:34:17.246 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-22T08:34:17.121+0000 7f885d087800 5 asok(0x55a0db31b0f0) register_command sync trace history hook 0x7f88500109d0 2024-09-22T08:34:17.246 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-22T08:34:17.121+0000 7f885d087800 5 asok(0x55a0db31b0f0) register_command sync trace active hook 0x7f88500109d0 2024-09-22T08:34:17.246 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-22T08:34:17.121+0000 7f885d087800 5 asok(0x55a0db31b0f0) register_command sync trace active_short hook 0x7f88500109d0 2024-09-22T08:34:17.246 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-22T08:34:17.121+0000 7f885d087800 20 init_complete bucket index max shards: 11 2024-09-22T08:34:17.246 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-22T08:34:17.121+0000 7f885d087800 20 Filter name: none 2024-09-22T08:34:17.247 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-22T08:34:17.122+0000 7f8689ffb640 20 reqs_thread_entry: start 2024-09-22T08:34:17.247 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-22T08:34:17.122+0000 7f885d087800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-22T08:34:17.247 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-22T08:34:17.122+0000 7f885d087800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.247 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-22T08:34:17.122+0000 7f885d087800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T08:34:17.247 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-22T08:34:17.122+0000 7f885d087800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-22T08:34:17.247 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-22T08:34:17.122+0000 7f885d087800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-22T08:34:17.247 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-22T08:34:17.122+0000 7f885d087800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 : miss 2024-09-22T08:34:17.247 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-22T08:34:17.122+0000 7f885d087800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.247 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-22T08:34:17.122+0000 7f885d087800 20 rados_obj.operate() r=0 bl.length=423 2024-09-22T08:34:17.247 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-22T08:34:17.122+0000 7f885d087800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 info.flags=0x17 2024-09-22T08:34:17.247 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-22T08:34:17.122+0000 7f885d087800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 to cache LRU end 2024-09-22T08:34:17.247 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-22T08:34:17.122+0000 7f885d087800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:34:17.247 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-22T08:34:17.122+0000 7f885d087800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:17.247 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-22T08:34:17.122+0000 7f885d087800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 2024-09-22T08:34:17.247 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-22T08:34:17.128+0000 7f885d087800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 info.flags=0x17 2024-09-22T08:34:17.248 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-22T08:34:17.128+0000 7f885d087800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 to cache LRU end 2024-09-22T08:34:17.248 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-22T08:34:17.128+0000 7f885d087800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:17.248 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-22T08:34:17.128+0000 7f885d087800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27, ofs0, ns] 2024-09-22T08:34:17.248 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-22T08:34:17.128+0000 7f873dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497004 cookie 94149363887232 notifier 6792 bl.length()=939 2024-09-22T08:34:17.248 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-22T08:34:17.128+0000 7f873dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 info.flags=0x17 2024-09-22T08:34:17.248 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-22T08:34:17.128+0000 7f873dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 to cache LRU end 2024-09-22T08:34:17.248 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-22T08:34:17.128+0000 7f873dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:17.248 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-22T08:34:17.129+0000 7f885d087800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.27]): orig_sources= new_sources= 2024-09-22T08:34:17.248 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-22T08:34:17.129+0000 7f885d087800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.27]): potential sources added=[] removed=[] 2024-09-22T08:34:17.248 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-22T08:34:17.129+0000 7f885d087800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.27]): orig_dests= new_dests= 2024-09-22T08:34:17.248 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-22T08:34:17.129+0000 7f885d087800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.27]): potential dests added=[] removed=[] 2024-09-22T08:34:17.248 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-22T08:34:17.129+0000 7f885d087800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f885d087800 time 2024-09-22T08:34:17.129926+0000 2024-09-22T08:34:17.248 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:34:17.248 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:17.248 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:34:17.248 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f886058c748] 2024-09-22T08:34:17.249 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f886058c906] 2024-09-22T08:34:17.249 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a0da950e01] 2024-09-22T08:34:17.249 INFO:tasks.workunit.client.0.smithi038.stderr: 4: radosgw-admin(+0xd817fe) [0x55a0dae637fe] 2024-09-22T08:34:17.249 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a0da960c9d] 2024-09-22T08:34:17.249 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-22T08:34:17.249 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f885f229590] 2024-09-22T08:34:17.249 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-22T08:34:17.249 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-22T08:34:17.249 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:17.249 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-22T08:34:17.130+0000 7f885d087800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:34:17.249 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f885d087800 thread_name:radosgw-admin 2024-09-22T08:34:17.249 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:17.249 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:34:17.249 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f885f23e6f0] 2024-09-22T08:34:17.250 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f885f28b99c] 2024-09-22T08:34:17.250 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:34:17.250 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:34:17.250 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f886058c7a2] 2024-09-22T08:34:17.250 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f886058c906] 2024-09-22T08:34:17.250 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a0da950e01] 2024-09-22T08:34:17.250 INFO:tasks.workunit.client.0.smithi038.stderr: 8: radosgw-admin(+0xd817fe) [0x55a0dae637fe] 2024-09-22T08:34:17.250 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a0da960c9d] 2024-09-22T08:34:17.250 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-22T08:34:17.250 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f885f229590] 2024-09-22T08:34:17.250 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-22T08:34:17.250 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-22T08:34:17.250 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:34:17.250 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:17.251 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-22T08:34:17.251 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-22T08:34:17.251 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-22T08:34:17.251 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-22T08:34:17.251 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-22T08:34:17.251 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-22T08:34:17.251 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-22T08:34:17.251 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-22T08:34:17.251 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-22T08:34:17.251 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-22T08:34:17.251 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-22T08:34:17.251 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-22T08:34:17.251 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-22T08:34:17.251 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-22T08:34:17.251 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-22T08:34:17.252 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-22T08:34:17.252 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-22T08:34:17.252 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-22T08:34:17.252 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-22T08:34:17.252 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-22T08:34:17.252 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-22T08:34:17.252 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-22T08:34:17.252 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-22T08:34:17.252 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-22T08:34:17.252 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:34:17.252 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-22T08:34:17.252 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-22T08:34:17.252 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-22T08:34:17.252 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-22T08:34:17.252 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-22T08:34:17.253 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-22T08:34:17.253 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-22T08:34:17.253 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-22T08:34:17.253 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-22T08:34:17.253 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-22T08:34:17.253 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-22T08:34:17.253 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-22T08:34:17.253 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-22T08:34:17.253 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-22T08:34:17.253 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-22T08:34:17.253 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-22T08:34:17.253 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-22T08:34:17.253 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-22T08:34:17.253 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-22T08:34:17.253 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-22T08:34:17.254 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-22T08:34:17.254 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:34:17.254 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-22T08:34:17.254 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:34:17.254 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-22T08:34:17.254 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-22T08:34:17.254 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-22T08:34:17.254 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-22T08:34:17.254 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-22T08:34:17.254 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-22T08:34:17.254 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-22T08:34:17.254 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-22T08:34:17.254 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-22T08:34:17.254 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-22T08:34:17.254 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-22T08:34:17.255 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-22T08:34:17.255 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-22T08:34:17.255 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-22T08:34:17.255 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-22T08:34:17.255 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-22T08:34:17.255 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-22T08:34:17.255 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-22T08:34:17.255 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:34:17.255 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-22T08:34:17.255 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:34:17.255 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-22T08:34:17.255 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-22T08:34:17.255 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-22T08:34:17.255 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-22T08:34:17.256 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-22T08:34:17.256 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-22T08:34:17.256 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:34:17.256 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-22T08:34:17.256 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-22T08:34:17.256 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:34:17.256 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-22T08:34:17.256 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-22T08:34:17.256 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-22T08:34:17.256 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-22T08:34:17.256 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-22T08:34:17.256 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-22T08:34:17.256 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-22T08:34:17.256 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-22T08:34:17.256 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-22T08:34:17.257 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-22T08:34:17.257 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-22T08:34:17.257 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-22T08:34:17.257 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-22T08:34:17.257 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:34:17.257 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8689ffb640 / http_manager 2024-09-22T08:34:17.257 INFO:tasks.workunit.client.0.smithi038.stderr: 7f868bfff640 / http_manager 2024-09-22T08:34:17.257 INFO:tasks.workunit.client.0.smithi038.stderr: 7f87117e2640 / rgw_dt_lg_renew 2024-09-22T08:34:17.257 INFO:tasks.workunit.client.0.smithi038.stderr: 7f873cff9640 / ms_dispatch 2024-09-22T08:34:17.257 INFO:tasks.workunit.client.0.smithi038.stderr: 7f873dffb640 / io_context_pool 2024-09-22T08:34:17.257 INFO:tasks.workunit.client.0.smithi038.stderr: 7f873e7fc640 / io_context_pool 2024-09-22T08:34:17.257 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8744e01640 / ms_dispatch 2024-09-22T08:34:17.257 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8747606640 / ms_dispatch 2024-09-22T08:34:17.257 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8748e09640 / io_context_pool 2024-09-22T08:34:17.257 INFO:tasks.workunit.client.0.smithi038.stderr: 7f885a370640 / msgr-worker-2 2024-09-22T08:34:17.258 INFO:tasks.workunit.client.0.smithi038.stderr: 7f885ab71640 / msgr-worker-1 2024-09-22T08:34:17.258 INFO:tasks.workunit.client.0.smithi038.stderr: 7f885b372640 / msgr-worker-0 2024-09-22T08:34:17.258 INFO:tasks.workunit.client.0.smithi038.stderr: 7f885bb73640 / io_context_pool 2024-09-22T08:34:17.258 INFO:tasks.workunit.client.0.smithi038.stderr: 7f885d087800 / radosgw-admin 2024-09-22T08:34:17.258 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-22T08:34:17.258 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-22T08:34:17.258 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/lib/ceph/crash/2024-09-22T08:34:17.131582Z_3a124824-25d9-45bd-b1e7-a769e679e10d/log 2024-09-22T08:34:17.258 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-22T08:34:17.258 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-22T08:34:17.260 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:34:17.260 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:34:17.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.209+0000 7fbe54746800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.211+0000 7fbe54746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:17.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.211+0000 7fbe54746800 20 realm 2024-09-22T08:34:17.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.211+0000 7fbe54746800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.211+0000 7fbe54746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:17.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.211+0000 7fbe54746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:34:17.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.211+0000 7fbe54746800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.211+0000 7fbe54746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:17.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.211+0000 7fbe54746800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.261 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.212+0000 7fbe54746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:17.261 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.212+0000 7fbe54746800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.261 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.213+0000 7fbe54746800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:34:17.261 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.213+0000 7fbe54746800 20 searching for the correct realm 2024-09-22T08:34:17.261 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.215+0000 7fbe52230640 0 -- 172.21.15.38:0/4029476858 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x56055f9a0500 msgr2=0x56055f9a2950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:34:17.261 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.218+0000 7fbe51a2f640 0 -- 172.21.15.38:0/4029476858 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fbe440adc10 msgr2=0x7fbe440ad0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:34:17.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.424+0000 7fbe54746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:34:17.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.424+0000 7fbe54746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:34:17.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.424+0000 7fbe54746800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:34:17.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.424+0000 7fbe54746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:34:17.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.424+0000 7fbe54746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:34:17.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.424+0000 7fbe54746800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:34:17.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.424+0000 7fbe54746800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.425+0000 7fbe54746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:17.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.425+0000 7fbe54746800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.425+0000 7fbe54746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:17.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.425+0000 7fbe54746800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.426+0000 7fbe54746800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:34:17.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.426+0000 7fbe54746800 20 zone default found 2024-09-22T08:34:17.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.426+0000 7fbe54746800 4 Realm: () 2024-09-22T08:34:17.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.426+0000 7fbe54746800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:34:17.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.426+0000 7fbe54746800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:34:17.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.426+0000 7fbe54746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:34:17.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.426+0000 7fbe54746800 20 zonegroup default 2024-09-22T08:34:17.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.426+0000 7fbe54746800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.426+0000 7fbe54746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:17.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.426+0000 7fbe54746800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.426+0000 7fbe54746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:17.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.426+0000 7fbe54746800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.426+0000 7fbe54746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:17.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.426+0000 7fbe54746800 20 started sync module instance, tier type = 2024-09-22T08:34:17.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.426+0000 7fbe54746800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:34:17.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.436+0000 7fbe54746800 20 add_watcher() i=0 2024-09-22T08:34:17.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.436+0000 7fbe54746800 20 add_watcher() i=1 2024-09-22T08:34:17.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.436+0000 7fbe54746800 20 add_watcher() i=2 2024-09-22T08:34:17.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.436+0000 7fbe54746800 20 add_watcher() i=3 2024-09-22T08:34:17.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.436+0000 7fbe54746800 20 add_watcher() i=4 2024-09-22T08:34:17.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.436+0000 7fbe54746800 20 add_watcher() i=5 2024-09-22T08:34:17.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.436+0000 7fbe54746800 20 add_watcher() i=6 2024-09-22T08:34:17.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.437+0000 7fbe54746800 20 add_watcher() i=7 2024-09-22T08:34:17.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.437+0000 7fbe54746800 2 all 8 watchers are set, enabling cache 2024-09-22T08:34:17.439 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.439+0000 7fbd08fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:17.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.439+0000 7fbe54746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:34:17.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.439+0000 7fbe54746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:34:17.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.439+0000 7fbe54746800 5 note: GC not initialized 2024-09-22T08:34:17.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.439+0000 7fbc837fe640 20 reqs_thread_entry: start 2024-09-22T08:34:17.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.439+0000 7fbe54746800 20 init_complete bucket index max shards: 11 2024-09-22T08:34:17.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.439+0000 7fbe54746800 20 Filter name: none 2024-09-22T08:34:17.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.440+0000 7fbc817fa640 20 reqs_thread_entry: start 2024-09-22T08:34:17.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.440+0000 7fbe54746800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.440+0000 7fbe54746800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T08:34:17.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.440+0000 7fbe54746800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.440+0000 7fbe54746800 20 rados_obj.operate() r=0 bl.length=455 2024-09-22T08:34:17.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.440+0000 7fbe54746800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:34:17.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.441+0000 7fbe54746800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.441+0000 7fbe54746800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T08:34:17.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.441+0000 7fbe54746800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.441+0000 7fbe54746800 20 rados_obj.operate() r=0 bl.length=455 2024-09-22T08:34:17.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.441+0000 7fbe54746800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:34:17.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.443+0000 7fbd08fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:17.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.447+0000 7fbe54746800 20 remove_watcher() i=0 2024-09-22T08:34:17.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.447+0000 7fbe54746800 2 removed watcher, disabling cache 2024-09-22T08:34:17.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.448+0000 7fbe54746800 20 remove_watcher() i=1 2024-09-22T08:34:17.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.449+0000 7fbe54746800 20 remove_watcher() i=2 2024-09-22T08:34:17.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.450+0000 7fbe54746800 20 remove_watcher() i=3 2024-09-22T08:34:17.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.451+0000 7fbe54746800 20 remove_watcher() i=4 2024-09-22T08:34:17.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.452+0000 7fbe54746800 20 remove_watcher() i=5 2024-09-22T08:34:17.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.453+0000 7fbe54746800 20 remove_watcher() i=6 2024-09-22T08:34:17.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.454+0000 7fbe54746800 20 remove_watcher() i=7 2024-09-22T08:34:17.466 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:17.466 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:34:17.466 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-trim-reshard-log-entries id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:34:17.466 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:17.468 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:17.468 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:17.474 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:17.491 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:17.518 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:34:17.550 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:34:17.552 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:34:17.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.588+0000 7fbf60725800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.590+0000 7fbf60725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:17.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.590+0000 7fbf60725800 20 realm 2024-09-22T08:34:17.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.590+0000 7fbf60725800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.590+0000 7fbf60725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:17.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.590+0000 7fbf60725800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:34:17.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.590+0000 7fbf60725800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.590+0000 7fbf60725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:17.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.590+0000 7fbf60725800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.591+0000 7fbf60725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:17.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.591+0000 7fbf60725800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.591+0000 7fbf60725800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:34:17.593 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.591+0000 7fbf60725800 20 searching for the correct realm 2024-09-22T08:34:17.595 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.594+0000 7fbf5c333640 0 -- 172.21.15.38:0/4097418292 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x55bfb5b45040 msgr2=0x55bfb5b47500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:34:17.598 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.597+0000 7fbf5bb32640 0 -- 172.21.15.38:0/4097418292 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fbf4c04e960 msgr2=0x7fbf4c01c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:34:17.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.803+0000 7fbf60725800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:34:17.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.803+0000 7fbf60725800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:34:17.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.803+0000 7fbf60725800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:34:17.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.803+0000 7fbf60725800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:34:17.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.803+0000 7fbf60725800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:34:17.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.803+0000 7fbf60725800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:34:17.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.803+0000 7fbf60725800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.804+0000 7fbf60725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:17.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.804+0000 7fbf60725800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.804+0000 7fbf60725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:17.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.804+0000 7fbf60725800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.804+0000 7fbf60725800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:34:17.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.804+0000 7fbf60725800 20 zone default found 2024-09-22T08:34:17.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.804+0000 7fbf60725800 4 Realm: () 2024-09-22T08:34:17.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.804+0000 7fbf60725800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:34:17.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.804+0000 7fbf60725800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:34:17.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.804+0000 7fbf60725800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:34:17.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.804+0000 7fbf60725800 20 zonegroup default 2024-09-22T08:34:17.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.804+0000 7fbf60725800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.805+0000 7fbf60725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:17.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.805+0000 7fbf60725800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.805+0000 7fbf60725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:17.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.805+0000 7fbf60725800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.805+0000 7fbf60725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:17.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.805+0000 7fbf60725800 20 started sync module instance, tier type = 2024-09-22T08:34:17.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.805+0000 7fbf60725800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:34:17.815 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.815+0000 7fbf60725800 20 add_watcher() i=0 2024-09-22T08:34:17.815 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.815+0000 7fbf60725800 20 add_watcher() i=1 2024-09-22T08:34:17.816 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.815+0000 7fbf60725800 20 add_watcher() i=2 2024-09-22T08:34:17.816 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.815+0000 7fbf60725800 20 add_watcher() i=3 2024-09-22T08:34:17.816 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.815+0000 7fbf60725800 20 add_watcher() i=4 2024-09-22T08:34:17.816 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.815+0000 7fbf60725800 20 add_watcher() i=5 2024-09-22T08:34:17.816 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.815+0000 7fbf60725800 20 add_watcher() i=6 2024-09-22T08:34:17.816 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.816+0000 7fbf60725800 20 add_watcher() i=7 2024-09-22T08:34:17.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.816+0000 7fbf60725800 2 all 8 watchers are set, enabling cache 2024-09-22T08:34:17.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.817+0000 7fbe12fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:17.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.818+0000 7fbf60725800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:34:17.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.818+0000 7fbf60725800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:34:17.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.818+0000 7fbf60725800 5 note: GC not initialized 2024-09-22T08:34:17.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.818+0000 7fbe11fdb640 20 reqs_thread_entry: start 2024-09-22T08:34:17.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.818+0000 7fbf60725800 20 init_complete bucket index max shards: 11 2024-09-22T08:34:17.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.818+0000 7fbf60725800 20 Filter name: none 2024-09-22T08:34:17.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.818+0000 7fbd837fe640 20 reqs_thread_entry: start 2024-09-22T08:34:17.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.818+0000 7fbf60725800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-22T08:34:17.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.818+0000 7fbf60725800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.818+0000 7fbf60725800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T08:34:17.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.818+0000 7fbf60725800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-22T08:34:17.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.818+0000 7fbf60725800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-22T08:34:17.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.819+0000 7fbf60725800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 : miss 2024-09-22T08:34:17.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.819+0000 7fbf60725800 20 rados->read ofs=0 len=0 2024-09-22T08:34:17.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.819+0000 7fbf60725800 20 rados_obj.operate() r=0 bl.length=455 2024-09-22T08:34:17.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.819+0000 7fbf60725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 info.flags=0x17 2024-09-22T08:34:17.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.819+0000 7fbf60725800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 to cache LRU end 2024-09-22T08:34:17.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.819+0000 7fbf60725800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:34:17.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.819+0000 7fbf60725800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:17.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.819+0000 7fbf60725800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 2024-09-22T08:34:17.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.820+0000 7fbf60725800 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 to be held by another RGW process; skipping for now 2024-09-22T08:34:17.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.821+0000 7fbe12fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:17.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.823+0000 7fbf60725800 20 remove_watcher() i=0 2024-09-22T08:34:17.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.823+0000 7fbf60725800 2 removed watcher, disabling cache 2024-09-22T08:34:17.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.824+0000 7fbf60725800 20 remove_watcher() i=1 2024-09-22T08:34:17.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.825+0000 7fbf60725800 20 remove_watcher() i=2 2024-09-22T08:34:17.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.826+0000 7fbf60725800 20 remove_watcher() i=3 2024-09-22T08:34:17.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.827+0000 7fbf60725800 20 remove_watcher() i=4 2024-09-22T08:34:17.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.828+0000 7fbf60725800 20 remove_watcher() i=5 2024-09-22T08:34:17.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.829+0000 7fbf60725800 20 remove_watcher() i=6 2024-09-22T08:34:17.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:17.831+0000 7fbf60725800 20 remove_watcher() i=7 2024-09-22T08:34:17.842 INFO:tasks.workunit.client.0.smithi038.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-22T08:34:47.875 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:34:47.912 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:34:47.912 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:34:47.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:47.958+0000 7f9af092c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:47.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:47.959+0000 7f9af092c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:47.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:47.959+0000 7f9af092c800 20 realm 2024-09-22T08:34:47.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:47.959+0000 7f9af092c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:47.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:47.960+0000 7f9af092c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:47.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:47.960+0000 7f9af092c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:34:47.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:47.960+0000 7f9af092c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:47.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:47.960+0000 7f9af092c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:47.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:47.960+0000 7f9af092c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:47.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:47.961+0000 7f9af092c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:47.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:47.961+0000 7f9af092c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:47.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:47.961+0000 7f9af092c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:34:47.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:47.961+0000 7f9af092c800 20 searching for the correct realm 2024-09-22T08:34:47.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:47.964+0000 7f9aebd3d640 0 -- 172.21.15.38:0/85394531 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f9ae007f930 msgr2=0x7f9ae0061e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:34:47.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:47.968+0000 7f9aebd3d640 0 -- 172.21.15.38:0/85394531 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f9adc0713f0 msgr2=0x7f9adc071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:34:48.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.177+0000 7f9af092c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:34:48.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.177+0000 7f9af092c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:34:48.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.177+0000 7f9af092c800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:34:48.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.177+0000 7f9af092c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:34:48.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.177+0000 7f9af092c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:34:48.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.177+0000 7f9af092c800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:34:48.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.177+0000 7f9af092c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:48.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.178+0000 7f9af092c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:48.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.178+0000 7f9af092c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:48.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.178+0000 7f9af092c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:48.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.178+0000 7f9af092c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:48.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.178+0000 7f9af092c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:34:48.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.178+0000 7f9af092c800 20 zone default found 2024-09-22T08:34:48.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.178+0000 7f9af092c800 4 Realm: () 2024-09-22T08:34:48.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.178+0000 7f9af092c800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:34:48.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.178+0000 7f9af092c800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:34:48.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.178+0000 7f9af092c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:34:48.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.178+0000 7f9af092c800 20 zonegroup default 2024-09-22T08:34:48.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.178+0000 7f9af092c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:48.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.179+0000 7f9af092c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:48.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.179+0000 7f9af092c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:48.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.179+0000 7f9af092c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:48.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.179+0000 7f9af092c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:48.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.180+0000 7f9af092c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:48.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.180+0000 7f9af092c800 20 started sync module instance, tier type = 2024-09-22T08:34:48.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.180+0000 7f9af092c800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:34:48.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.196+0000 7f9af092c800 20 add_watcher() i=0 2024-09-22T08:34:48.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.196+0000 7f9af092c800 20 add_watcher() i=1 2024-09-22T08:34:48.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.196+0000 7f9af092c800 20 add_watcher() i=2 2024-09-22T08:34:48.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.196+0000 7f9af092c800 20 add_watcher() i=3 2024-09-22T08:34:48.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.196+0000 7f9af092c800 20 add_watcher() i=4 2024-09-22T08:34:48.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.196+0000 7f9af092c800 20 add_watcher() i=5 2024-09-22T08:34:48.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.196+0000 7f9af092c800 20 add_watcher() i=6 2024-09-22T08:34:48.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.197+0000 7f9af092c800 20 add_watcher() i=7 2024-09-22T08:34:48.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.197+0000 7f9af092c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:34:48.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.200+0000 7f99a2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:48.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.200+0000 7f9af092c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:34:48.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.200+0000 7f9af092c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:34:48.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.200+0000 7f9af092c800 5 note: GC not initialized 2024-09-22T08:34:48.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.200+0000 7f99a1fdb640 20 reqs_thread_entry: start 2024-09-22T08:34:48.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.201+0000 7f9af092c800 20 init_complete bucket index max shards: 11 2024-09-22T08:34:48.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.201+0000 7f9af092c800 20 Filter name: none 2024-09-22T08:34:48.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.201+0000 7f99137fe640 20 reqs_thread_entry: start 2024-09-22T08:34:48.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.201+0000 7f9af092c800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-22T08:34:48.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.201+0000 7f9af092c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:48.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.201+0000 7f9af092c800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T08:34:48.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.201+0000 7f9af092c800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-22T08:34:48.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.201+0000 7f9af092c800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-22T08:34:48.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.201+0000 7f9af092c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 : miss 2024-09-22T08:34:48.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.201+0000 7f9af092c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:48.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.202+0000 7f9af092c800 20 rados_obj.operate() r=0 bl.length=455 2024-09-22T08:34:48.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.202+0000 7f9af092c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 info.flags=0x17 2024-09-22T08:34:48.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.202+0000 7f9af092c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 to cache LRU end 2024-09-22T08:34:48.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.202+0000 7f9af092c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:34:48.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.202+0000 7f9af092c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:48.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.202+0000 7f9af092c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 2024-09-22T08:34:48.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.203+0000 7f9af092c800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-22T08:34:48.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.212+0000 7f9af092c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 info.flags=0x17 2024-09-22T08:34:48.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.212+0000 7f9af092c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 to cache LRU end 2024-09-22T08:34:48.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.212+0000 7f9af092c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:48.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.212+0000 7f9af092c800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27, ofs0, ns] 2024-09-22T08:34:48.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.212+0000 7f99c2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497005 cookie 94752717948320 notifier 6846 bl.length()=939 2024-09-22T08:34:48.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.212+0000 7f99c2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 info.flags=0x17 2024-09-22T08:34:48.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.212+0000 7f99c2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 to cache LRU end 2024-09-22T08:34:48.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.212+0000 7f99c2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:48.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.213+0000 7f9af092c800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.27]): orig_sources= new_sources= 2024-09-22T08:34:48.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.213+0000 7f9af092c800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.27]): potential sources added=[] removed=[] 2024-09-22T08:34:48.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.213+0000 7f9af092c800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.27]): orig_dests= new_dests= 2024-09-22T08:34:48.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.213+0000 7f9af092c800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.27]): potential dests added=[] removed=[] 2024-09-22T08:34:48.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.219+0000 7f9af092c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.2.0 2024-09-22T08:34:48.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.219+0000 7f9af092c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.2.0 2024-09-22T08:34:48.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.219+0000 7f9af092c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.2.1 2024-09-22T08:34:48.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.219+0000 7f9af092c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.2.1 2024-09-22T08:34:48.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.219+0000 7f9af092c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.2.2 2024-09-22T08:34:48.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.219+0000 7f9af092c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.2.2 2024-09-22T08:34:48.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.219+0000 7f9af092c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.2.3 2024-09-22T08:34:48.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.219+0000 7f9af092c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.2.3 2024-09-22T08:34:48.221 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.219+0000 7f9af092c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.2.4 2024-09-22T08:34:48.221 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.219+0000 7f9af092c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.2.4 2024-09-22T08:34:48.221 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.219+0000 7f9af092c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.2.5 2024-09-22T08:34:48.221 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.219+0000 7f9af092c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.2.5 2024-09-22T08:34:48.221 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.219+0000 7f9af092c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.2.6 2024-09-22T08:34:48.221 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.219+0000 7f9af092c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.2.6 2024-09-22T08:34:48.221 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.219+0000 7f9af092c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.2.7 2024-09-22T08:34:48.221 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.219+0000 7f9af092c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.2.7 2024-09-22T08:34:48.221 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.219+0000 7f9af092c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.2.8 2024-09-22T08:34:48.221 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.219+0000 7f9af092c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.2.8 2024-09-22T08:34:48.221 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.219+0000 7f9af092c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.2.9 2024-09-22T08:34:48.221 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.219+0000 7f9af092c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.2.9 2024-09-22T08:34:48.221 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.219+0000 7f9af092c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.2.10 2024-09-22T08:34:48.221 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.219+0000 7f9af092c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.2.10 2024-09-22T08:34:48.221 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.219+0000 7f9af092c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.2.11 2024-09-22T08:34:48.222 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.219+0000 7f9af092c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.2.11 2024-09-22T08:34:48.222 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.219+0000 7f9af092c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.0 2024-09-22T08:34:48.222 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.219+0000 7f9af092c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.1 2024-09-22T08:34:48.222 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.220+0000 7f9af092c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.2 2024-09-22T08:34:48.222 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.221+0000 7f9af092c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.3 2024-09-22T08:34:48.222 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.221+0000 7f9af092c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.4 2024-09-22T08:34:48.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.222+0000 7f9af092c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.5 2024-09-22T08:34:48.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.222+0000 7f9af092c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.6 2024-09-22T08:34:48.224 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.223+0000 7f9af092c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.7 2024-09-22T08:34:48.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.224+0000 7f9af092c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.8 2024-09-22T08:34:48.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.224+0000 7f9af092c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.9 2024-09-22T08:34:48.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.225+0000 7f9af092c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.10 2024-09-22T08:34:48.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.229+0000 7f9af092c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 : hit (requested=0x17, cached=0x17) 2024-09-22T08:34:48.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.229+0000 7f9af092c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 2024-09-22T08:34:48.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.230+0000 7f9af092c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 info.flags=0x17 2024-09-22T08:34:48.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.230+0000 7f9af092c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 to cache LRU end 2024-09-22T08:34:48.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.230+0000 7f9af092c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:48.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.230+0000 7f9af092c800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27, ofs0, ns] 2024-09-22T08:34:48.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.231+0000 7f99c2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497006 cookie 94752717948320 notifier 6846 bl.length()=939 2024-09-22T08:34:48.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.231+0000 7f99c2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 info.flags=0x17 2024-09-22T08:34:48.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.231+0000 7f99c2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 to cache LRU end 2024-09-22T08:34:48.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.231+0000 7f99c2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:48.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.231+0000 7f9af092c800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.27]): orig_sources= new_sources= 2024-09-22T08:34:48.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.231+0000 7f9af092c800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.27]): potential sources added=[] removed=[] 2024-09-22T08:34:48.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.231+0000 7f9af092c800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.27]): orig_dests= new_dests= 2024-09-22T08:34:48.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.231+0000 7f9af092c800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.27]): potential dests added=[] removed=[] 2024-09-22T08:34:48.235 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.234+0000 7f9af092c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.0 2024-09-22T08:34:48.236 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.235+0000 7f9af092c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.1 2024-09-22T08:34:48.236 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.235+0000 7f9af092c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.2 2024-09-22T08:34:48.236 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.236+0000 7f9af092c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.3 2024-09-22T08:34:48.237 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.236+0000 7f9af092c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.4 2024-09-22T08:34:48.238 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.237+0000 7f9af092c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.5 2024-09-22T08:34:48.238 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.237+0000 7f9af092c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.6 2024-09-22T08:34:48.238 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.238+0000 7f9af092c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.7 2024-09-22T08:34:48.239 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.238+0000 7f9af092c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.8 2024-09-22T08:34:48.239 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.238+0000 7f9af092c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.9 2024-09-22T08:34:48.239 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.239+0000 7f9af092c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.27.10 2024-09-22T08:34:48.240 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.239+0000 7f9af092c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 : hit (requested=0x17, cached=0x17) 2024-09-22T08:34:48.240 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.239+0000 7f9af092c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 2024-09-22T08:34:48.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.240+0000 7f9af092c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 info.flags=0x17 2024-09-22T08:34:48.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.240+0000 7f9af092c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 to cache LRU end 2024-09-22T08:34:48.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.240+0000 7f9af092c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:48.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.240+0000 7f9af092c800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27, ofs0, ns] 2024-09-22T08:34:48.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.241+0000 7f99c37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497007 cookie 94752717948320 notifier 6846 bl.length()=907 2024-09-22T08:34:48.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.241+0000 7f99c37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 info.flags=0x17 2024-09-22T08:34:48.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.241+0000 7f99c37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 to cache LRU end 2024-09-22T08:34:48.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.241+0000 7f99c37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:48.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.241+0000 7f9af092c800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.27]): orig_sources= new_sources= 2024-09-22T08:34:48.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.241+0000 7f9af092c800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.27]): potential sources added=[] removed=[] 2024-09-22T08:34:48.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.241+0000 7f9af092c800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.27]): orig_dests= new_dests= 2024-09-22T08:34:48.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.241+0000 7f9af092c800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c62f9d7b-f6b6-404a-90de-de5607499115.4584.27]): potential dests added=[] removed=[] 2024-09-22T08:34:48.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.244+0000 7f9af092c800 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-22T08:34:48.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.247+0000 7f99a2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:48.250 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.249+0000 7f9af092c800 20 remove_watcher() i=0 2024-09-22T08:34:48.250 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.249+0000 7f9af092c800 2 removed watcher, disabling cache 2024-09-22T08:34:48.251 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.250+0000 7f9af092c800 20 remove_watcher() i=1 2024-09-22T08:34:48.253 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.252+0000 7f9af092c800 20 remove_watcher() i=2 2024-09-22T08:34:48.255 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.254+0000 7f9af092c800 20 remove_watcher() i=3 2024-09-22T08:34:48.256 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.255+0000 7f9af092c800 20 remove_watcher() i=4 2024-09-22T08:34:48.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.257+0000 7f9af092c800 20 remove_watcher() i=5 2024-09-22T08:34:48.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.258+0000 7f9af092c800 20 remove_watcher() i=6 2024-09-22T08:34:48.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.259+0000 7f9af092c800 20 remove_watcher() i=7 2024-09-22T08:34:48.273 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-22T08:34:48.304 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:34:48.304 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:34:48.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.344+0000 7fe36292c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:48.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.345+0000 7fe36292c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:48.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.345+0000 7fe36292c800 20 realm 2024-09-22T08:34:48.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.345+0000 7fe36292c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:48.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.346+0000 7fe36292c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:48.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.346+0000 7fe36292c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:34:48.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.346+0000 7fe36292c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:48.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.346+0000 7fe36292c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:48.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.346+0000 7fe36292c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:48.348 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.347+0000 7fe36292c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:48.348 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.347+0000 7fe36292c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:48.348 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.347+0000 7fe36292c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:34:48.348 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.347+0000 7fe36292c800 20 searching for the correct realm 2024-09-22T08:34:48.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.349+0000 7fe35e6da640 0 -- 172.21.15.38:0/4049735492 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x55ac9b254260 msgr2=0x55ac9b256720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:34:48.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.353+0000 7fe35ded9640 0 -- 172.21.15.38:0/4049735492 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fe350022040 msgr2=0x7fe350021410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:34:48.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.560+0000 7fe36292c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:34:48.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.560+0000 7fe36292c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:34:48.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.560+0000 7fe36292c800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:34:48.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.560+0000 7fe36292c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:34:48.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.560+0000 7fe36292c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:34:48.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.560+0000 7fe36292c800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:34:48.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.560+0000 7fe36292c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:48.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.560+0000 7fe36292c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:48.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.560+0000 7fe36292c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:48.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.561+0000 7fe36292c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:48.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.561+0000 7fe36292c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:48.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.561+0000 7fe36292c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:34:48.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.561+0000 7fe36292c800 20 zone default found 2024-09-22T08:34:48.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.561+0000 7fe36292c800 4 Realm: () 2024-09-22T08:34:48.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.561+0000 7fe36292c800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:34:48.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.561+0000 7fe36292c800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:34:48.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.561+0000 7fe36292c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:34:48.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.561+0000 7fe36292c800 20 zonegroup default 2024-09-22T08:34:48.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.561+0000 7fe36292c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:48.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.561+0000 7fe36292c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:48.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.561+0000 7fe36292c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:48.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.562+0000 7fe36292c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:48.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.562+0000 7fe36292c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:48.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.562+0000 7fe36292c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:48.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.562+0000 7fe36292c800 20 started sync module instance, tier type = 2024-09-22T08:34:48.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.562+0000 7fe36292c800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:34:48.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.572+0000 7fe36292c800 20 add_watcher() i=0 2024-09-22T08:34:48.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.572+0000 7fe36292c800 20 add_watcher() i=1 2024-09-22T08:34:48.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.572+0000 7fe36292c800 20 add_watcher() i=2 2024-09-22T08:34:48.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.572+0000 7fe36292c800 20 add_watcher() i=3 2024-09-22T08:34:48.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.572+0000 7fe36292c800 20 add_watcher() i=4 2024-09-22T08:34:48.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.572+0000 7fe36292c800 20 add_watcher() i=5 2024-09-22T08:34:48.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.572+0000 7fe36292c800 20 add_watcher() i=6 2024-09-22T08:34:48.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.573+0000 7fe36292c800 20 add_watcher() i=7 2024-09-22T08:34:48.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.573+0000 7fe36292c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:34:48.576 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.575+0000 7fe214fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:48.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.575+0000 7fe36292c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:34:48.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.575+0000 7fe36292c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:34:48.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.575+0000 7fe36292c800 5 note: GC not initialized 2024-09-22T08:34:48.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.576+0000 7fe18f7fe640 20 reqs_thread_entry: start 2024-09-22T08:34:48.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.576+0000 7fe36292c800 20 init_complete bucket index max shards: 11 2024-09-22T08:34:48.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.576+0000 7fe36292c800 20 Filter name: none 2024-09-22T08:34:48.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.576+0000 7fe18d7fa640 20 reqs_thread_entry: start 2024-09-22T08:34:48.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.576+0000 7fe36292c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:48.578 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.576+0000 7fe36292c800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T08:34:48.578 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.576+0000 7fe36292c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:48.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.577+0000 7fe36292c800 20 rados_obj.operate() r=0 bl.length=423 2024-09-22T08:34:48.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.577+0000 7fe36292c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:34:48.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.577+0000 7fe36292c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:48.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.577+0000 7fe36292c800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T08:34:48.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.577+0000 7fe36292c800 20 rados->read ofs=0 len=0 2024-09-22T08:34:48.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.578+0000 7fe36292c800 20 rados_obj.operate() r=0 bl.length=423 2024-09-22T08:34:48.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.578+0000 7fe36292c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:34:48.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.580+0000 7fe214fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:48.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.582+0000 7fe36292c800 20 remove_watcher() i=0 2024-09-22T08:34:48.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.582+0000 7fe36292c800 2 removed watcher, disabling cache 2024-09-22T08:34:48.584 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.583+0000 7fe36292c800 20 remove_watcher() i=1 2024-09-22T08:34:48.585 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.584+0000 7fe36292c800 20 remove_watcher() i=2 2024-09-22T08:34:48.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.586+0000 7fe36292c800 20 remove_watcher() i=3 2024-09-22T08:34:48.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.587+0000 7fe36292c800 20 remove_watcher() i=4 2024-09-22T08:34:48.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.588+0000 7fe36292c800 20 remove_watcher() i=5 2024-09-22T08:34:48.590 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.589+0000 7fe36292c800 20 remove_watcher() i=6 2024-09-22T08:34:48.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:48.590+0000 7fe36292c800 20 remove_watcher() i=7 2024-09-22T08:34:48.602 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:48.602 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:34:48.602 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-trim-reshard-log-entries id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.27 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-22T08:34:48.602 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:48.604 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:48.604 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:48.608 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:48.608 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:48.651 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:48.652 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:48.684 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-22T08:34:48.684 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:48.685 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:48.685 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:48.697 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:48.697 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:48.740 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:48.741 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:48.747 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:48.747 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:48.753 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:48.753 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:48.759 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:48.759 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:48.765 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:48.765 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:48.771 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:48.771 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:48.777 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:48.777 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:48.782 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:48.783 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:48.788 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:48.788 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:48.794 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:48.794 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:48.800 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:48.800 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:48.806 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:48.806 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:48.812 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:48.812 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:48.817 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:48.818 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:48.824 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:48.824 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:48.830 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:48.830 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:48.836 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:48.836 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:48.842 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:48.843 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:48.849 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:48.849 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:48.855 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:48.855 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:48.862 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-22T08:34:48.891 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:34:48.891 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:34:49.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.113+0000 7ff8dd7c6640 0 --2- 172.21.15.38:0/142958468 >> [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] conn(0x55fd5688e0a0 0x55fd568017f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-22T08:34:49.133 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.132+0000 7ff8e2339800 20 rados->read ofs=0 len=0 2024-09-22T08:34:49.135 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.134+0000 7ff8e2339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:49.136 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.134+0000 7ff8e2339800 20 realm 2024-09-22T08:34:49.136 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.134+0000 7ff8e2339800 20 rados->read ofs=0 len=0 2024-09-22T08:34:49.136 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.134+0000 7ff8e2339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:49.136 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.134+0000 7ff8e2339800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:34:49.136 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.134+0000 7ff8e2339800 20 rados->read ofs=0 len=0 2024-09-22T08:34:49.136 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.135+0000 7ff8e2339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:49.136 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.135+0000 7ff8e2339800 20 rados->read ofs=0 len=0 2024-09-22T08:34:49.136 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.135+0000 7ff8e2339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:49.136 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.135+0000 7ff8e2339800 20 rados->read ofs=0 len=0 2024-09-22T08:34:49.137 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.136+0000 7ff8e2339800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:34:49.137 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.136+0000 7ff8e2339800 20 searching for the correct realm 2024-09-22T08:34:49.138 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.137+0000 7ff8de7c8640 0 -- 172.21.15.38:0/3830406475 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x55fd56a3b8c0 msgr2=0x55fd56a3dd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:34:49.142 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.141+0000 7ff8ddfc7640 0 -- 172.21.15.38:0/3830406475 >> [v2:172.21.15.42:6826/1437467409,v1:172.21.15.42:6827/1437467409] conn(0x7ff8d403b020 msgr2=0x7ff8d407f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:34:49.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.349+0000 7ff8e2339800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:34:49.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.349+0000 7ff8e2339800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:34:49.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.349+0000 7ff8e2339800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:34:49.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.349+0000 7ff8e2339800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:34:49.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.349+0000 7ff8e2339800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:34:49.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.349+0000 7ff8e2339800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:34:49.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.349+0000 7ff8e2339800 20 rados->read ofs=0 len=0 2024-09-22T08:34:49.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.349+0000 7ff8e2339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:49.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.349+0000 7ff8e2339800 20 rados->read ofs=0 len=0 2024-09-22T08:34:49.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.349+0000 7ff8e2339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:49.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.349+0000 7ff8e2339800 20 rados->read ofs=0 len=0 2024-09-22T08:34:49.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.349+0000 7ff8e2339800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:34:49.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.349+0000 7ff8e2339800 20 zone default found 2024-09-22T08:34:49.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.349+0000 7ff8e2339800 4 Realm: () 2024-09-22T08:34:49.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.349+0000 7ff8e2339800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:34:49.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.349+0000 7ff8e2339800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:34:49.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.349+0000 7ff8e2339800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:34:49.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.349+0000 7ff8e2339800 20 zonegroup default 2024-09-22T08:34:49.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.350+0000 7ff8e2339800 20 rados->read ofs=0 len=0 2024-09-22T08:34:49.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.350+0000 7ff8e2339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:49.353 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.350+0000 7ff8e2339800 20 rados->read ofs=0 len=0 2024-09-22T08:34:49.353 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.350+0000 7ff8e2339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:49.353 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.350+0000 7ff8e2339800 20 rados->read ofs=0 len=0 2024-09-22T08:34:49.353 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.350+0000 7ff8e2339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:49.353 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.350+0000 7ff8e2339800 20 started sync module instance, tier type = 2024-09-22T08:34:49.353 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.350+0000 7ff8e2339800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:34:49.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.359+0000 7ff8e2339800 20 add_watcher() i=0 2024-09-22T08:34:49.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.359+0000 7ff8e2339800 20 add_watcher() i=1 2024-09-22T08:34:49.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.359+0000 7ff8e2339800 20 add_watcher() i=2 2024-09-22T08:34:49.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.359+0000 7ff8e2339800 20 add_watcher() i=3 2024-09-22T08:34:49.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.359+0000 7ff8e2339800 20 add_watcher() i=4 2024-09-22T08:34:49.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.359+0000 7ff8e2339800 20 add_watcher() i=5 2024-09-22T08:34:49.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.359+0000 7ff8e2339800 20 add_watcher() i=6 2024-09-22T08:34:49.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.361+0000 7ff8e2339800 20 add_watcher() i=7 2024-09-22T08:34:49.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.361+0000 7ff8e2339800 2 all 8 watchers are set, enabling cache 2024-09-22T08:34:49.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.362+0000 7ff78f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:49.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.363+0000 7ff8e2339800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:34:49.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.363+0000 7ff8e2339800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:34:49.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.363+0000 7ff8e2339800 5 note: GC not initialized 2024-09-22T08:34:49.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.363+0000 7ff78e7fc640 20 reqs_thread_entry: start 2024-09-22T08:34:49.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.363+0000 7ff8e2339800 20 init_complete bucket index max shards: 11 2024-09-22T08:34:49.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.363+0000 7ff8e2339800 20 Filter name: none 2024-09-22T08:34:49.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.363+0000 7ff6fffff640 20 reqs_thread_entry: start 2024-09-22T08:34:49.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.363+0000 7ff8e2339800 20 rados->read ofs=0 len=0 2024-09-22T08:34:49.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.364+0000 7ff8e2339800 20 rados_obj.operate() r=0 bl.length=189 2024-09-22T08:34:49.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.364+0000 7ff8e2339800 20 rados->read ofs=0 len=0 2024-09-22T08:34:49.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.365+0000 7ff8e2339800 20 rados_obj.operate() r=0 bl.length=411 2024-09-22T08:34:49.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.365+0000 7ff8e2339800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:34:49.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.365+0000 7ff8e2339800 20 rados->read ofs=0 len=0 2024-09-22T08:34:49.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.365+0000 7ff8e2339800 20 rados_obj.operate() r=0 bl.length=189 2024-09-22T08:34:49.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.365+0000 7ff8e2339800 20 rados->read ofs=0 len=0 2024-09-22T08:34:49.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.365+0000 7ff8e2339800 20 rados_obj.operate() r=0 bl.length=411 2024-09-22T08:34:49.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.365+0000 7ff8e2339800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:34:49.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.367+0000 7ff78f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:49.370 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.370+0000 7ff8e2339800 20 remove_watcher() i=0 2024-09-22T08:34:49.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.370+0000 7ff8e2339800 2 removed watcher, disabling cache 2024-09-22T08:34:49.372 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.371+0000 7ff8e2339800 20 remove_watcher() i=1 2024-09-22T08:34:49.372 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.372+0000 7ff8e2339800 20 remove_watcher() i=2 2024-09-22T08:34:49.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.373+0000 7ff8e2339800 20 remove_watcher() i=3 2024-09-22T08:34:49.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.374+0000 7ff8e2339800 20 remove_watcher() i=4 2024-09-22T08:34:49.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.375+0000 7ff8e2339800 20 remove_watcher() i=5 2024-09-22T08:34:49.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.376+0000 7ff8e2339800 20 remove_watcher() i=6 2024-09-22T08:34:49.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.377+0000 7ff8e2339800 20 remove_watcher() i=7 2024-09-22T08:34:49.390 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:49.391 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:34:49.391 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-block-writes id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:34:49.391 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:49.392 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-22T08:34:49.427 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:34:49.428 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:34:49.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.467+0000 7f35cbb3e800 20 rados->read ofs=0 len=0 2024-09-22T08:34:49.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.468+0000 7f35cbb3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:49.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.468+0000 7f35cbb3e800 20 realm 2024-09-22T08:34:49.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.468+0000 7f35cbb3e800 20 rados->read ofs=0 len=0 2024-09-22T08:34:49.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.469+0000 7f35cbb3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:49.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.469+0000 7f35cbb3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:34:49.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.469+0000 7f35cbb3e800 20 rados->read ofs=0 len=0 2024-09-22T08:34:49.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.469+0000 7f35cbb3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:49.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.469+0000 7f35cbb3e800 20 rados->read ofs=0 len=0 2024-09-22T08:34:49.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.470+0000 7f35cbb3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:49.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.470+0000 7f35cbb3e800 20 rados->read ofs=0 len=0 2024-09-22T08:34:49.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.470+0000 7f35cbb3e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:34:49.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.470+0000 7f35cbb3e800 20 searching for the correct realm 2024-09-22T08:34:49.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.472+0000 7f35c70bf640 0 -- 172.21.15.38:0/2647276757 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f35bc01a040 msgr2=0x7f35bc067220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:34:49.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.678+0000 7f35c70bf640 0 -- 172.21.15.38:0/2647276757 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f35b8063440 msgr2=0x7f35b806c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:34:49.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.885+0000 7f35cbb3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:34:49.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.885+0000 7f35cbb3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:34:49.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.885+0000 7f35cbb3e800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:34:49.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.885+0000 7f35cbb3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:34:49.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.885+0000 7f35cbb3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:34:49.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.885+0000 7f35cbb3e800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:34:49.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.885+0000 7f35cbb3e800 20 rados->read ofs=0 len=0 2024-09-22T08:34:49.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.885+0000 7f35cbb3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:49.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.885+0000 7f35cbb3e800 20 rados->read ofs=0 len=0 2024-09-22T08:34:49.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.886+0000 7f35cbb3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:49.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.886+0000 7f35cbb3e800 20 rados->read ofs=0 len=0 2024-09-22T08:34:49.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.886+0000 7f35cbb3e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:34:49.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.886+0000 7f35cbb3e800 20 zone default found 2024-09-22T08:34:49.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.886+0000 7f35cbb3e800 4 Realm: () 2024-09-22T08:34:49.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.886+0000 7f35cbb3e800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:34:49.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.886+0000 7f35cbb3e800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:34:49.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.886+0000 7f35cbb3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:34:49.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.886+0000 7f35cbb3e800 20 zonegroup default 2024-09-22T08:34:49.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.886+0000 7f35cbb3e800 20 rados->read ofs=0 len=0 2024-09-22T08:34:49.889 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.887+0000 7f35cbb3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:49.889 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.887+0000 7f35cbb3e800 20 rados->read ofs=0 len=0 2024-09-22T08:34:49.889 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.887+0000 7f35cbb3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:49.889 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.887+0000 7f35cbb3e800 20 rados->read ofs=0 len=0 2024-09-22T08:34:49.889 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.887+0000 7f35cbb3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:49.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.887+0000 7f35cbb3e800 20 started sync module instance, tier type = 2024-09-22T08:34:49.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.887+0000 7f35cbb3e800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:34:49.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.898+0000 7f35cbb3e800 20 add_watcher() i=0 2024-09-22T08:34:49.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.898+0000 7f35cbb3e800 20 add_watcher() i=1 2024-09-22T08:34:49.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.898+0000 7f35cbb3e800 20 add_watcher() i=2 2024-09-22T08:34:49.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.898+0000 7f35cbb3e800 20 add_watcher() i=3 2024-09-22T08:34:49.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.898+0000 7f35cbb3e800 20 add_watcher() i=4 2024-09-22T08:34:49.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.898+0000 7f35cbb3e800 20 add_watcher() i=5 2024-09-22T08:34:49.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.898+0000 7f35cbb3e800 20 add_watcher() i=6 2024-09-22T08:34:49.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.899+0000 7f35cbb3e800 20 add_watcher() i=7 2024-09-22T08:34:49.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.899+0000 7f35cbb3e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:34:49.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.901+0000 7f347dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:49.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.901+0000 7f35cbb3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:34:49.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.901+0000 7f35cbb3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:34:49.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.901+0000 7f35cbb3e800 5 note: GC not initialized 2024-09-22T08:34:49.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.901+0000 7f347cfe1640 20 reqs_thread_entry: start 2024-09-22T08:34:49.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.902+0000 7f35cbb3e800 20 init_complete bucket index max shards: 11 2024-09-22T08:34:49.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.902+0000 7f35cbb3e800 20 Filter name: none 2024-09-22T08:34:49.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.902+0000 7f33f67fc640 20 reqs_thread_entry: start 2024-09-22T08:34:49.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.902+0000 7f35cbb3e800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-22T08:34:49.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.902+0000 7f35cbb3e800 20 rados->read ofs=0 len=0 2024-09-22T08:34:49.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.902+0000 7f35cbb3e800 20 rados_obj.operate() r=0 bl.length=189 2024-09-22T08:34:49.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.902+0000 7f35cbb3e800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-22T08:34:49.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.902+0000 7f35cbb3e800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-22T08:34:49.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.902+0000 7f35cbb3e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 : miss 2024-09-22T08:34:49.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.902+0000 7f35cbb3e800 20 rados->read ofs=0 len=0 2024-09-22T08:34:49.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.903+0000 7f35cbb3e800 20 rados_obj.operate() r=0 bl.length=411 2024-09-22T08:34:49.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.903+0000 7f35cbb3e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 info.flags=0x17 2024-09-22T08:34:49.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.903+0000 7f35cbb3e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 to cache LRU end 2024-09-22T08:34:49.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.903+0000 7f35cbb3e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:34:49.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.903+0000 7f35cbb3e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:49.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.903+0000 7f35cbb3e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 2024-09-22T08:34:49.910 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.909+0000 7f35cbb3e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 info.flags=0x17 2024-09-22T08:34:49.910 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.909+0000 7f35cbb3e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 to cache LRU end 2024-09-22T08:34:49.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.909+0000 7f35cbb3e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:49.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.909+0000 7f35cbb3e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28, ofs0, ns] 2024-09-22T08:34:49.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.909+0000 7f34a67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496992 cookie 93847404918784 notifier 6900 bl.length()=915 2024-09-22T08:34:49.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.909+0000 7f34a67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 info.flags=0x17 2024-09-22T08:34:49.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.910+0000 7f34a67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 to cache LRU end 2024-09-22T08:34:49.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.910+0000 7f34a67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:49.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.910+0000 7f35cbb3e800 20 handle_bi_update(): bucket=:error-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.28]): orig_sources= new_sources= 2024-09-22T08:34:49.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.910+0000 7f35cbb3e800 20 handle_bi_update(): bucket=:error-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.28]): potential sources added=[] removed=[] 2024-09-22T08:34:49.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.910+0000 7f35cbb3e800 20 handle_bi_update(): bucket=:error-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.28]): orig_dests= new_dests= 2024-09-22T08:34:49.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.910+0000 7f35cbb3e800 20 handle_bi_update(): bucket=:error-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.28]): potential dests added=[] removed=[] 2024-09-22T08:34:49.917 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.916+0000 7f35cbb3e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.0 2024-09-22T08:34:49.917 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.916+0000 7f35cbb3e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.0 2024-09-22T08:34:49.917 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.916+0000 7f35cbb3e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.1 2024-09-22T08:34:49.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.916+0000 7f35cbb3e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.1 2024-09-22T08:34:49.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.916+0000 7f35cbb3e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.2 2024-09-22T08:34:49.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.916+0000 7f35cbb3e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.2 2024-09-22T08:34:49.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.916+0000 7f35cbb3e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.3 2024-09-22T08:34:49.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.916+0000 7f35cbb3e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.3 2024-09-22T08:34:49.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.916+0000 7f35cbb3e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.4 2024-09-22T08:34:49.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.916+0000 7f35cbb3e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.4 2024-09-22T08:34:49.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.916+0000 7f35cbb3e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.5 2024-09-22T08:34:49.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.916+0000 7f35cbb3e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.5 2024-09-22T08:34:49.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.916+0000 7f35cbb3e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.6 2024-09-22T08:34:49.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.916+0000 7f35cbb3e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.6 2024-09-22T08:34:49.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.916+0000 7f35cbb3e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.7 2024-09-22T08:34:49.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.916+0000 7f35cbb3e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.7 2024-09-22T08:34:49.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.916+0000 7f35cbb3e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.8 2024-09-22T08:34:49.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.916+0000 7f35cbb3e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.8 2024-09-22T08:34:49.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.916+0000 7f35cbb3e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.9 2024-09-22T08:34:49.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.916+0000 7f35cbb3e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.9 2024-09-22T08:34:49.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.916+0000 7f35cbb3e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.10 2024-09-22T08:34:49.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.916+0000 7f35cbb3e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.10 2024-09-22T08:34:49.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.916+0000 7f35cbb3e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.11 2024-09-22T08:34:49.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.916+0000 7f35cbb3e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.11 2024-09-22T08:34:49.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.916+0000 7f35cbb3e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.0 2024-09-22T08:34:49.920 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.917+0000 7f35cbb3e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1 2024-09-22T08:34:49.920 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.917+0000 7f35cbb3e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.2 2024-09-22T08:34:49.920 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.918+0000 7f35cbb3e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.3 2024-09-22T08:34:49.920 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.918+0000 7f35cbb3e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.4 2024-09-22T08:34:49.920 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.919+0000 7f35cbb3e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.5 2024-09-22T08:34:49.920 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.919+0000 7f35cbb3e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.6 2024-09-22T08:34:49.921 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.920+0000 7f35cbb3e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.7 2024-09-22T08:34:49.921 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.921+0000 7f35cbb3e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.8 2024-09-22T08:34:49.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.921+0000 7f35cbb3e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.9 2024-09-22T08:34:49.923 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.922+0000 7f35cbb3e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.10 2024-09-22T08:34:49.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.925+0000 7f35cbb3e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 : hit (requested=0x17, cached=0x17) 2024-09-22T08:34:49.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.925+0000 7f35cbb3e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 2024-09-22T08:34:49.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.927+0000 7f35cbb3e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 info.flags=0x17 2024-09-22T08:34:49.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.927+0000 7f35cbb3e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 to cache LRU end 2024-09-22T08:34:49.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.927+0000 7f35cbb3e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:49.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.927+0000 7f35cbb3e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28, ofs0, ns] 2024-09-22T08:34:49.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.927+0000 7f34a6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496993 cookie 93847404918784 notifier 6900 bl.length()=915 2024-09-22T08:34:49.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.927+0000 7f34a6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 info.flags=0x17 2024-09-22T08:34:49.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.927+0000 7f34a6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 to cache LRU end 2024-09-22T08:34:49.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.927+0000 7f34a6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:49.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.928+0000 7f35cbb3e800 20 handle_bi_update(): bucket=:error-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.28]): orig_sources= new_sources= 2024-09-22T08:34:49.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.928+0000 7f35cbb3e800 20 handle_bi_update(): bucket=:error-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.28]): potential sources added=[] removed=[] 2024-09-22T08:34:49.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.928+0000 7f35cbb3e800 20 handle_bi_update(): bucket=:error-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.28]): orig_dests= new_dests= 2024-09-22T08:34:49.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.928+0000 7f35cbb3e800 20 handle_bi_update(): bucket=:error-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.28]): potential dests added=[] removed=[] 2024-09-22T08:34:49.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.928+0000 7f35cbb3e800 -1 Injecting error=-5 at location=block_writes 2024-09-22T08:34:49.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.928+0000 7f35cbb3e800 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-22T08:34:49.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.933+0000 7f35cbb3e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 : hit (requested=0x17, cached=0x17) 2024-09-22T08:34:49.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.933+0000 7f35cbb3e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 2024-09-22T08:34:49.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.935+0000 7f35cbb3e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 info.flags=0x17 2024-09-22T08:34:49.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.935+0000 7f35cbb3e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 to cache LRU end 2024-09-22T08:34:49.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.935+0000 7f35cbb3e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:49.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.935+0000 7f35cbb3e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28, ofs0, ns] 2024-09-22T08:34:49.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.935+0000 7f34a6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496994 cookie 93847404918784 notifier 6900 bl.length()=883 2024-09-22T08:34:49.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.935+0000 7f34a6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 info.flags=0x17 2024-09-22T08:34:49.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.935+0000 7f34a6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 to cache LRU end 2024-09-22T08:34:49.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.935+0000 7f34a6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:49.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.935+0000 7f35cbb3e800 20 handle_bi_update(): bucket=:error-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.28]): orig_sources= new_sources= 2024-09-22T08:34:49.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.935+0000 7f35cbb3e800 20 handle_bi_update(): bucket=:error-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.28]): potential sources added=[] removed=[] 2024-09-22T08:34:49.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.935+0000 7f35cbb3e800 20 handle_bi_update(): bucket=:error-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.28]): orig_dests= new_dests= 2024-09-22T08:34:49.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.935+0000 7f35cbb3e800 20 handle_bi_update(): bucket=:error-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.28]): potential dests added=[] removed=[] 2024-09-22T08:34:49.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.939+0000 7f35cbb3e800 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-22T08:34:49.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.941+0000 7f347dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:49.945 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.944+0000 7f35cbb3e800 20 remove_watcher() i=0 2024-09-22T08:34:49.945 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.944+0000 7f35cbb3e800 2 removed watcher, disabling cache 2024-09-22T08:34:49.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.945+0000 7f35cbb3e800 20 remove_watcher() i=1 2024-09-22T08:34:49.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.947+0000 7f35cbb3e800 20 remove_watcher() i=2 2024-09-22T08:34:49.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.948+0000 7f35cbb3e800 20 remove_watcher() i=3 2024-09-22T08:34:49.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.949+0000 7f35cbb3e800 20 remove_watcher() i=4 2024-09-22T08:34:49.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.950+0000 7f35cbb3e800 20 remove_watcher() i=5 2024-09-22T08:34:49.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.951+0000 7f35cbb3e800 20 remove_watcher() i=6 2024-09-22T08:34:49.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:49.952+0000 7f35cbb3e800 20 remove_watcher() i=7 2024-09-22T08:34:49.967 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-22T08:34:49.997 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:34:49.997 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:34:50.037 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.036+0000 7f9128325800 20 rados->read ofs=0 len=0 2024-09-22T08:34:50.039 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.038+0000 7f9128325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:50.039 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.038+0000 7f9128325800 20 realm 2024-09-22T08:34:50.040 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.038+0000 7f9128325800 20 rados->read ofs=0 len=0 2024-09-22T08:34:50.040 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.038+0000 7f9128325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:50.040 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.038+0000 7f9128325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:34:50.040 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.038+0000 7f9128325800 20 rados->read ofs=0 len=0 2024-09-22T08:34:50.040 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.039+0000 7f9128325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:50.040 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.039+0000 7f9128325800 20 rados->read ofs=0 len=0 2024-09-22T08:34:50.040 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.039+0000 7f9128325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:50.040 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.039+0000 7f9128325800 20 rados->read ofs=0 len=0 2024-09-22T08:34:50.041 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.040+0000 7f9128325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:34:50.041 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.040+0000 7f9128325800 20 searching for the correct realm 2024-09-22T08:34:50.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.042+0000 7f91238a1640 0 -- 172.21.15.38:0/55946343 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f910c0d4070 msgr2=0x7f910c0e4490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:34:50.248 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.247+0000 7f91238a1640 0 -- 172.21.15.38:0/55946343 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f911c01dbe0 msgr2=0x7f911c043960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:34:50.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.454+0000 7f9128325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:34:50.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.454+0000 7f9128325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:34:50.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.454+0000 7f9128325800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:34:50.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.454+0000 7f9128325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:34:50.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.454+0000 7f9128325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:34:50.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.454+0000 7f9128325800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:34:50.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.454+0000 7f9128325800 20 rados->read ofs=0 len=0 2024-09-22T08:34:50.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.454+0000 7f9128325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:50.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.454+0000 7f9128325800 20 rados->read ofs=0 len=0 2024-09-22T08:34:50.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.455+0000 7f9128325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:50.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.455+0000 7f9128325800 20 rados->read ofs=0 len=0 2024-09-22T08:34:50.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.455+0000 7f9128325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:34:50.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.455+0000 7f9128325800 20 zone default found 2024-09-22T08:34:50.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.455+0000 7f9128325800 4 Realm: () 2024-09-22T08:34:50.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.455+0000 7f9128325800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:34:50.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.455+0000 7f9128325800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:34:50.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.455+0000 7f9128325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:34:50.458 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.455+0000 7f9128325800 20 zonegroup default 2024-09-22T08:34:50.458 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.455+0000 7f9128325800 20 rados->read ofs=0 len=0 2024-09-22T08:34:50.458 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.455+0000 7f9128325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:50.458 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.456+0000 7f9128325800 20 rados->read ofs=0 len=0 2024-09-22T08:34:50.458 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.456+0000 7f9128325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:50.458 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.456+0000 7f9128325800 20 rados->read ofs=0 len=0 2024-09-22T08:34:50.458 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.456+0000 7f9128325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:50.458 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.456+0000 7f9128325800 20 started sync module instance, tier type = 2024-09-22T08:34:50.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.456+0000 7f9128325800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:34:50.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.467+0000 7f9128325800 20 add_watcher() i=0 2024-09-22T08:34:50.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.467+0000 7f9128325800 20 add_watcher() i=1 2024-09-22T08:34:50.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.467+0000 7f9128325800 20 add_watcher() i=2 2024-09-22T08:34:50.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.467+0000 7f9128325800 20 add_watcher() i=3 2024-09-22T08:34:50.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.467+0000 7f9128325800 20 add_watcher() i=4 2024-09-22T08:34:50.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.467+0000 7f9128325800 20 add_watcher() i=5 2024-09-22T08:34:50.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.467+0000 7f9128325800 20 add_watcher() i=6 2024-09-22T08:34:50.469 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.468+0000 7f9128325800 20 add_watcher() i=7 2024-09-22T08:34:50.469 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.468+0000 7f9128325800 2 all 8 watchers are set, enabling cache 2024-09-22T08:34:50.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.469+0000 7f8fdafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:50.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.469+0000 7f9128325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:34:50.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.469+0000 7f9128325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:34:50.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.469+0000 7f9128325800 5 note: GC not initialized 2024-09-22T08:34:50.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.469+0000 7f8fd9fdb640 20 reqs_thread_entry: start 2024-09-22T08:34:50.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.470+0000 7f9128325800 20 init_complete bucket index max shards: 11 2024-09-22T08:34:50.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.470+0000 7f9128325800 20 Filter name: none 2024-09-22T08:34:50.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.470+0000 7f8f4b7fe640 20 reqs_thread_entry: start 2024-09-22T08:34:50.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.470+0000 7f9128325800 20 rados->read ofs=0 len=0 2024-09-22T08:34:50.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.470+0000 7f9128325800 20 rados_obj.operate() r=0 bl.length=189 2024-09-22T08:34:50.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.470+0000 7f9128325800 20 rados->read ofs=0 len=0 2024-09-22T08:34:50.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.471+0000 7f9128325800 20 rados_obj.operate() r=0 bl.length=411 2024-09-22T08:34:50.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.471+0000 7f9128325800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:34:50.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.471+0000 7f9128325800 20 rados->read ofs=0 len=0 2024-09-22T08:34:50.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.471+0000 7f9128325800 20 rados_obj.operate() r=0 bl.length=189 2024-09-22T08:34:50.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.471+0000 7f9128325800 20 rados->read ofs=0 len=0 2024-09-22T08:34:50.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.471+0000 7f9128325800 20 rados_obj.operate() r=0 bl.length=411 2024-09-22T08:34:50.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.471+0000 7f9128325800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:34:50.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.473+0000 7f8fdafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:50.478 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.476+0000 7f9128325800 20 remove_watcher() i=0 2024-09-22T08:34:50.478 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.476+0000 7f9128325800 2 removed watcher, disabling cache 2024-09-22T08:34:50.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.477+0000 7f9128325800 20 remove_watcher() i=1 2024-09-22T08:34:50.480 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.478+0000 7f9128325800 20 remove_watcher() i=2 2024-09-22T08:34:50.481 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.480+0000 7f9128325800 20 remove_watcher() i=3 2024-09-22T08:34:50.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.481+0000 7f9128325800 20 remove_watcher() i=4 2024-09-22T08:34:50.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.482+0000 7f9128325800 20 remove_watcher() i=5 2024-09-22T08:34:50.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.483+0000 7f9128325800 20 remove_watcher() i=6 2024-09-22T08:34:50.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.484+0000 7f9128325800 20 remove_watcher() i=7 2024-09-22T08:34:50.498 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:50.498 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:34:50.498 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-block-writes id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:34:50.498 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:50.500 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:50.500 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:50.507 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:50.507 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:50.551 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:34:50.585 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:34:50.585 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:34:50.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.624+0000 7f82a4939800 20 rados->read ofs=0 len=0 2024-09-22T08:34:50.628 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.626+0000 7f82a4939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:50.628 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.626+0000 7f82a4939800 20 realm 2024-09-22T08:34:50.628 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.626+0000 7f82a4939800 20 rados->read ofs=0 len=0 2024-09-22T08:34:50.628 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.626+0000 7f82a4939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:50.628 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.626+0000 7f82a4939800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:34:50.628 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.626+0000 7f82a4939800 20 rados->read ofs=0 len=0 2024-09-22T08:34:50.629 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.626+0000 7f82a4939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:50.629 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.626+0000 7f82a4939800 20 rados->read ofs=0 len=0 2024-09-22T08:34:50.629 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.627+0000 7f82a4939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:50.629 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.627+0000 7f82a4939800 20 rados->read ofs=0 len=0 2024-09-22T08:34:50.629 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.627+0000 7f82a4939800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:34:50.629 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.627+0000 7f82a4939800 20 searching for the correct realm 2024-09-22T08:34:50.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.630+0000 7f829fe80640 0 -- 172.21.15.38:0/718853297 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f829407b030 msgr2=0x7f82940abfd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:34:50.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.634+0000 7f829fe80640 0 -- 172.21.15.38:0/718853297 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f8290010890 msgr2=0x7f829001b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:34:50.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.841+0000 7f82a4939800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:34:50.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.841+0000 7f82a4939800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:34:50.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.841+0000 7f82a4939800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:34:50.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.841+0000 7f82a4939800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:34:50.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.841+0000 7f82a4939800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:34:50.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.841+0000 7f82a4939800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:34:50.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.842+0000 7f82a4939800 20 rados->read ofs=0 len=0 2024-09-22T08:34:50.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.842+0000 7f82a4939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:50.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.842+0000 7f82a4939800 20 rados->read ofs=0 len=0 2024-09-22T08:34:50.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.842+0000 7f82a4939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:50.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.842+0000 7f82a4939800 20 rados->read ofs=0 len=0 2024-09-22T08:34:50.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.842+0000 7f82a4939800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:34:50.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.842+0000 7f82a4939800 20 zone default found 2024-09-22T08:34:50.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.842+0000 7f82a4939800 4 Realm: () 2024-09-22T08:34:50.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.842+0000 7f82a4939800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:34:50.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.842+0000 7f82a4939800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:34:50.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.842+0000 7f82a4939800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:34:50.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.842+0000 7f82a4939800 20 zonegroup default 2024-09-22T08:34:50.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.842+0000 7f82a4939800 20 rados->read ofs=0 len=0 2024-09-22T08:34:50.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.843+0000 7f82a4939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:50.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.843+0000 7f82a4939800 20 rados->read ofs=0 len=0 2024-09-22T08:34:50.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.843+0000 7f82a4939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:50.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.843+0000 7f82a4939800 20 rados->read ofs=0 len=0 2024-09-22T08:34:50.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.844+0000 7f82a4939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:50.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.844+0000 7f82a4939800 20 started sync module instance, tier type = 2024-09-22T08:34:50.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.844+0000 7f82a4939800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:34:50.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.854+0000 7f82a4939800 20 add_watcher() i=0 2024-09-22T08:34:50.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.854+0000 7f82a4939800 20 add_watcher() i=1 2024-09-22T08:34:50.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.854+0000 7f82a4939800 20 add_watcher() i=2 2024-09-22T08:34:50.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.854+0000 7f82a4939800 20 add_watcher() i=3 2024-09-22T08:34:50.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.854+0000 7f82a4939800 20 add_watcher() i=4 2024-09-22T08:34:50.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.854+0000 7f82a4939800 20 add_watcher() i=5 2024-09-22T08:34:50.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.854+0000 7f82a4939800 20 add_watcher() i=6 2024-09-22T08:34:50.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.855+0000 7f82a4939800 20 add_watcher() i=7 2024-09-22T08:34:50.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.855+0000 7f82a4939800 2 all 8 watchers are set, enabling cache 2024-09-22T08:34:50.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.857+0000 7f8156fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:50.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.857+0000 7f82a4939800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:34:50.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.857+0000 7f82a4939800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:34:50.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.858+0000 7f82a4939800 5 note: GC not initialized 2024-09-22T08:34:50.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.858+0000 7f8155fdb640 20 reqs_thread_entry: start 2024-09-22T08:34:50.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.858+0000 7f82a4939800 20 init_complete bucket index max shards: 11 2024-09-22T08:34:50.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.858+0000 7f82a4939800 20 Filter name: none 2024-09-22T08:34:50.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.858+0000 7f80c77fe640 20 reqs_thread_entry: start 2024-09-22T08:34:50.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.858+0000 7f82a4939800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-22T08:34:50.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.858+0000 7f82a4939800 20 rados->read ofs=0 len=0 2024-09-22T08:34:50.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.859+0000 7f82a4939800 20 rados_obj.operate() r=0 bl.length=189 2024-09-22T08:34:50.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.859+0000 7f82a4939800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-22T08:34:50.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.859+0000 7f82a4939800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-22T08:34:50.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.859+0000 7f82a4939800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 : miss 2024-09-22T08:34:50.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.859+0000 7f82a4939800 20 rados->read ofs=0 len=0 2024-09-22T08:34:50.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.859+0000 7f82a4939800 20 rados_obj.operate() r=0 bl.length=411 2024-09-22T08:34:50.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.859+0000 7f82a4939800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 info.flags=0x17 2024-09-22T08:34:50.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.859+0000 7f82a4939800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 to cache LRU end 2024-09-22T08:34:50.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.859+0000 7f82a4939800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:34:50.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.859+0000 7f82a4939800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:50.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.859+0000 7f82a4939800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 2024-09-22T08:34:50.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.865+0000 7f82a4939800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 info.flags=0x17 2024-09-22T08:34:50.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.865+0000 7f82a4939800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 to cache LRU end 2024-09-22T08:34:50.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.865+0000 7f82a4939800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:50.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.865+0000 7f82a4939800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28, ofs0, ns] 2024-09-22T08:34:50.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.865+0000 7f8176ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496995 cookie 94444261009168 notifier 6936 bl.length()=915 2024-09-22T08:34:50.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.865+0000 7f8176ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 info.flags=0x17 2024-09-22T08:34:50.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.865+0000 7f8176ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 to cache LRU end 2024-09-22T08:34:50.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.865+0000 7f8176ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:50.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.865+0000 7f82a4939800 20 handle_bi_update(): bucket=:error-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.28]): orig_sources= new_sources= 2024-09-22T08:34:50.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.865+0000 7f82a4939800 20 handle_bi_update(): bucket=:error-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.28]): potential sources added=[] removed=[] 2024-09-22T08:34:50.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.865+0000 7f82a4939800 20 handle_bi_update(): bucket=:error-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.28]): orig_dests= new_dests= 2024-09-22T08:34:50.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.865+0000 7f82a4939800 20 handle_bi_update(): bucket=:error-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.28]): potential dests added=[] removed=[] 2024-09-22T08:34:50.874 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.872+0000 7f82a4939800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.0 2024-09-22T08:34:50.874 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.872+0000 7f82a4939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.0 2024-09-22T08:34:50.874 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.872+0000 7f82a4939800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.1 2024-09-22T08:34:50.874 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.872+0000 7f82a4939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.1 2024-09-22T08:34:50.874 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.872+0000 7f82a4939800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.2 2024-09-22T08:34:50.874 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.872+0000 7f82a4939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.2 2024-09-22T08:34:50.874 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.872+0000 7f82a4939800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.3 2024-09-22T08:34:50.874 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.872+0000 7f82a4939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.3 2024-09-22T08:34:50.874 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.872+0000 7f82a4939800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.4 2024-09-22T08:34:50.874 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.872+0000 7f82a4939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.4 2024-09-22T08:34:50.874 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.872+0000 7f82a4939800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.5 2024-09-22T08:34:50.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.872+0000 7f82a4939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.5 2024-09-22T08:34:50.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.872+0000 7f82a4939800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.6 2024-09-22T08:34:50.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.872+0000 7f82a4939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.6 2024-09-22T08:34:50.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.872+0000 7f82a4939800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.7 2024-09-22T08:34:50.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.872+0000 7f82a4939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.7 2024-09-22T08:34:50.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.872+0000 7f82a4939800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.8 2024-09-22T08:34:50.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.872+0000 7f82a4939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.8 2024-09-22T08:34:50.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.872+0000 7f82a4939800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.9 2024-09-22T08:34:50.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.872+0000 7f82a4939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.9 2024-09-22T08:34:50.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.872+0000 7f82a4939800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.10 2024-09-22T08:34:50.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.872+0000 7f82a4939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.10 2024-09-22T08:34:50.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.872+0000 7f82a4939800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.11 2024-09-22T08:34:50.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.872+0000 7f82a4939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1.11 2024-09-22T08:34:50.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.872+0000 7f82a4939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.0 2024-09-22T08:34:50.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.872+0000 7f82a4939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1 2024-09-22T08:34:50.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.873+0000 7f82a4939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.2 2024-09-22T08:34:50.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.873+0000 7f82a4939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.3 2024-09-22T08:34:50.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.874+0000 7f82a4939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.4 2024-09-22T08:34:50.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.874+0000 7f82a4939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.5 2024-09-22T08:34:50.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.875+0000 7f82a4939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.6 2024-09-22T08:34:50.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.876+0000 7f82a4939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.7 2024-09-22T08:34:50.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.877+0000 7f82a4939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.8 2024-09-22T08:34:50.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.877+0000 7f82a4939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.9 2024-09-22T08:34:50.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.878+0000 7f82a4939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.10 2024-09-22T08:34:50.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.882+0000 7f82a4939800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 : hit (requested=0x17, cached=0x17) 2024-09-22T08:34:50.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.882+0000 7f82a4939800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 2024-09-22T08:34:50.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.883+0000 7f82a4939800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 info.flags=0x17 2024-09-22T08:34:50.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.883+0000 7f82a4939800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 to cache LRU end 2024-09-22T08:34:50.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.883+0000 7f82a4939800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:50.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.883+0000 7f82a4939800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28, ofs0, ns] 2024-09-22T08:34:50.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.883+0000 7f8176ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496996 cookie 94444261009168 notifier 6936 bl.length()=915 2024-09-22T08:34:50.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.883+0000 7f8176ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 info.flags=0x17 2024-09-22T08:34:50.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.883+0000 7f8176ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 to cache LRU end 2024-09-22T08:34:50.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.883+0000 7f8176ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:50.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.884+0000 7f82a4939800 20 handle_bi_update(): bucket=:error-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.28]): orig_sources= new_sources= 2024-09-22T08:34:50.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.884+0000 7f82a4939800 20 handle_bi_update(): bucket=:error-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.28]): potential sources added=[] removed=[] 2024-09-22T08:34:50.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.884+0000 7f82a4939800 20 handle_bi_update(): bucket=:error-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.28]): orig_dests= new_dests= 2024-09-22T08:34:50.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.884+0000 7f82a4939800 20 handle_bi_update(): bucket=:error-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.28]): potential dests added=[] removed=[] 2024-09-22T08:34:50.889 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.887+0000 7f82a4939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.0 2024-09-22T08:34:50.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.888+0000 7f82a4939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.1 2024-09-22T08:34:50.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.888+0000 7f82a4939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.2 2024-09-22T08:34:50.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.888+0000 7f82a4939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.3 2024-09-22T08:34:50.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.889+0000 7f82a4939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.4 2024-09-22T08:34:50.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.889+0000 7f82a4939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.5 2024-09-22T08:34:50.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.890+0000 7f82a4939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.6 2024-09-22T08:34:50.892 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.890+0000 7f82a4939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.7 2024-09-22T08:34:50.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.891+0000 7f82a4939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.8 2024-09-22T08:34:50.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.891+0000 7f82a4939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.9 2024-09-22T08:34:50.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.891+0000 7f82a4939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.28.10 2024-09-22T08:34:50.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.892+0000 7f82a4939800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 : hit (requested=0x17, cached=0x17) 2024-09-22T08:34:50.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.892+0000 7f82a4939800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 2024-09-22T08:34:50.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.893+0000 7f82a4939800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 info.flags=0x17 2024-09-22T08:34:50.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.893+0000 7f82a4939800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 to cache LRU end 2024-09-22T08:34:50.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.893+0000 7f82a4939800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:50.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.893+0000 7f82a4939800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28, ofs0, ns] 2024-09-22T08:34:50.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.894+0000 7f81777fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496997 cookie 94444261009168 notifier 6936 bl.length()=883 2024-09-22T08:34:50.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.894+0000 7f81777fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 info.flags=0x17 2024-09-22T08:34:50.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.894+0000 7f81777fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 to cache LRU end 2024-09-22T08:34:50.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.894+0000 7f81777fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:50.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.894+0000 7f82a4939800 20 handle_bi_update(): bucket=:error-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.28]): orig_sources= new_sources= 2024-09-22T08:34:50.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.894+0000 7f82a4939800 20 handle_bi_update(): bucket=:error-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.28]): potential sources added=[] removed=[] 2024-09-22T08:34:50.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.894+0000 7f82a4939800 20 handle_bi_update(): bucket=:error-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.28]): orig_dests= new_dests= 2024-09-22T08:34:50.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.894+0000 7f82a4939800 20 handle_bi_update(): bucket=:error-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.28]): potential dests added=[] removed=[] 2024-09-22T08:34:50.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.897+0000 7f82a4939800 1 execute INFO: reshard of bucket "error-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-22T08:34:50.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.899+0000 7f8156fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:50.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.901+0000 7f82a4939800 20 remove_watcher() i=0 2024-09-22T08:34:50.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.901+0000 7f82a4939800 2 removed watcher, disabling cache 2024-09-22T08:34:50.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.902+0000 7f82a4939800 20 remove_watcher() i=1 2024-09-22T08:34:50.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.903+0000 7f82a4939800 20 remove_watcher() i=2 2024-09-22T08:34:50.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.905+0000 7f82a4939800 20 remove_watcher() i=3 2024-09-22T08:34:50.907 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.906+0000 7f82a4939800 20 remove_watcher() i=4 2024-09-22T08:34:50.909 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.907+0000 7f82a4939800 20 remove_watcher() i=5 2024-09-22T08:34:50.910 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.908+0000 7f82a4939800 20 remove_watcher() i=6 2024-09-22T08:34:50.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.909+0000 7f82a4939800 20 remove_watcher() i=7 2024-09-22T08:34:50.924 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-22T08:34:50.953 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:34:50.953 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:34:50.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.990+0000 7f8003922800 20 rados->read ofs=0 len=0 2024-09-22T08:34:50.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.992+0000 7f8003922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:50.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.992+0000 7f8003922800 20 realm 2024-09-22T08:34:50.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.992+0000 7f8003922800 20 rados->read ofs=0 len=0 2024-09-22T08:34:50.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.992+0000 7f8003922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:50.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.992+0000 7f8003922800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:34:50.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.992+0000 7f8003922800 20 rados->read ofs=0 len=0 2024-09-22T08:34:50.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.992+0000 7f8003922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:50.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.992+0000 7f8003922800 20 rados->read ofs=0 len=0 2024-09-22T08:34:50.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.993+0000 7f8003922800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:50.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.993+0000 7f8003922800 20 rados->read ofs=0 len=0 2024-09-22T08:34:50.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.994+0000 7f8003922800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:34:50.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.994+0000 7f8003922800 20 searching for the correct realm 2024-09-22T08:34:50.999 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:50.997+0000 7f7fff668640 0 -- 172.21.15.38:0/1921780767 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x5584c535ac10 msgr2=0x5584c535d0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:34:51.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.002+0000 7f7ffee67640 0 -- 172.21.15.38:0/1921780767 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f7ff0073760 msgr2=0x7f7ff007d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:34:51.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.209+0000 7f8003922800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:34:51.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.209+0000 7f8003922800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:34:51.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.209+0000 7f8003922800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:34:51.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.209+0000 7f8003922800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:34:51.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.209+0000 7f8003922800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:34:51.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.209+0000 7f8003922800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:34:51.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.210+0000 7f8003922800 20 rados->read ofs=0 len=0 2024-09-22T08:34:51.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.210+0000 7f8003922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:51.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.210+0000 7f8003922800 20 rados->read ofs=0 len=0 2024-09-22T08:34:51.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.210+0000 7f8003922800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:51.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.210+0000 7f8003922800 20 rados->read ofs=0 len=0 2024-09-22T08:34:51.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.211+0000 7f8003922800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:34:51.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.211+0000 7f8003922800 20 zone default found 2024-09-22T08:34:51.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.211+0000 7f8003922800 4 Realm: () 2024-09-22T08:34:51.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.211+0000 7f8003922800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:34:51.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.211+0000 7f8003922800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:34:51.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.211+0000 7f8003922800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:34:51.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.211+0000 7f8003922800 20 zonegroup default 2024-09-22T08:34:51.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.211+0000 7f8003922800 20 rados->read ofs=0 len=0 2024-09-22T08:34:51.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.211+0000 7f8003922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:51.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.211+0000 7f8003922800 20 rados->read ofs=0 len=0 2024-09-22T08:34:51.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.211+0000 7f8003922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:51.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.211+0000 7f8003922800 20 rados->read ofs=0 len=0 2024-09-22T08:34:51.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.212+0000 7f8003922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:51.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.212+0000 7f8003922800 20 started sync module instance, tier type = 2024-09-22T08:34:51.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.212+0000 7f8003922800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:34:51.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.223+0000 7f8003922800 20 add_watcher() i=0 2024-09-22T08:34:51.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.223+0000 7f8003922800 20 add_watcher() i=1 2024-09-22T08:34:51.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.223+0000 7f8003922800 20 add_watcher() i=2 2024-09-22T08:34:51.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.223+0000 7f8003922800 20 add_watcher() i=3 2024-09-22T08:34:51.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.223+0000 7f8003922800 20 add_watcher() i=4 2024-09-22T08:34:51.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.223+0000 7f8003922800 20 add_watcher() i=5 2024-09-22T08:34:51.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.223+0000 7f8003922800 20 add_watcher() i=6 2024-09-22T08:34:51.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.224+0000 7f8003922800 20 add_watcher() i=7 2024-09-22T08:34:51.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.224+0000 7f8003922800 2 all 8 watchers are set, enabling cache 2024-09-22T08:34:51.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.226+0000 7f7eb5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:51.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.226+0000 7f8003922800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:34:51.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.226+0000 7f8003922800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:34:51.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.226+0000 7f8003922800 5 note: GC not initialized 2024-09-22T08:34:51.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.226+0000 7f7eb4fe1640 20 reqs_thread_entry: start 2024-09-22T08:34:51.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.227+0000 7f8003922800 20 init_complete bucket index max shards: 11 2024-09-22T08:34:51.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.227+0000 7f8003922800 20 Filter name: none 2024-09-22T08:34:51.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.227+0000 7f7e2e7fc640 20 reqs_thread_entry: start 2024-09-22T08:34:51.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.227+0000 7f8003922800 20 rados->read ofs=0 len=0 2024-09-22T08:34:51.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.227+0000 7f8003922800 20 rados_obj.operate() r=0 bl.length=189 2024-09-22T08:34:51.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.227+0000 7f8003922800 20 rados->read ofs=0 len=0 2024-09-22T08:34:51.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.228+0000 7f8003922800 20 rados_obj.operate() r=0 bl.length=411 2024-09-22T08:34:51.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.228+0000 7f8003922800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:34:51.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.228+0000 7f8003922800 20 rados->read ofs=0 len=0 2024-09-22T08:34:51.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.228+0000 7f8003922800 20 rados_obj.operate() r=0 bl.length=189 2024-09-22T08:34:51.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.228+0000 7f8003922800 20 rados->read ofs=0 len=0 2024-09-22T08:34:51.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.228+0000 7f8003922800 20 rados_obj.operate() r=0 bl.length=411 2024-09-22T08:34:51.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.228+0000 7f8003922800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:34:51.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.230+0000 7f7eb5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:51.235 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.233+0000 7f8003922800 20 remove_watcher() i=0 2024-09-22T08:34:51.235 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.233+0000 7f8003922800 2 removed watcher, disabling cache 2024-09-22T08:34:51.236 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.234+0000 7f8003922800 20 remove_watcher() i=1 2024-09-22T08:34:51.237 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.235+0000 7f8003922800 20 remove_watcher() i=2 2024-09-22T08:34:51.238 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.236+0000 7f8003922800 20 remove_watcher() i=3 2024-09-22T08:34:51.239 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.237+0000 7f8003922800 20 remove_watcher() i=4 2024-09-22T08:34:51.240 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.238+0000 7f8003922800 20 remove_watcher() i=5 2024-09-22T08:34:51.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.240+0000 7f8003922800 20 remove_watcher() i=6 2024-09-22T08:34:51.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.241+0000 7f8003922800 20 remove_watcher() i=7 2024-09-22T08:34:51.254 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:51.255 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:34:51.255 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-block-writes id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.28 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-22T08:34:51.255 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:51.257 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:51.257 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:51.260 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:51.260 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:51.303 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:51.303 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:51.333 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with abort at block_writes 2024-09-22T08:34:51.333 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:51.334 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:51.335 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:51.346 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:51.347 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:51.389 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:51.389 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:51.396 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:51.397 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:51.403 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:51.403 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:51.411 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:51.411 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:51.417 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:51.417 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:51.423 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:51.423 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:51.429 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:51.429 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:51.435 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:51.435 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:51.441 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:51.441 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:51.448 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:51.448 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:51.454 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:51.454 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:51.460 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:51.460 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:51.466 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:51.466 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:51.472 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:51.472 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:51.479 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:51.479 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:51.485 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:51.485 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:51.492 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:51.492 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:51.498 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:51.498 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:51.504 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:51.504 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:51.511 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:51.511 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:51.517 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-22T08:34:51.546 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:34:51.546 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:34:51.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.584+0000 7f970753a800 20 rados->read ofs=0 len=0 2024-09-22T08:34:51.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.585+0000 7f970753a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:51.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.586+0000 7f970753a800 20 realm 2024-09-22T08:34:51.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.586+0000 7f970753a800 20 rados->read ofs=0 len=0 2024-09-22T08:34:51.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.586+0000 7f970753a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:51.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.586+0000 7f970753a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:34:51.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.586+0000 7f970753a800 20 rados->read ofs=0 len=0 2024-09-22T08:34:51.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.586+0000 7f970753a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:51.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.586+0000 7f970753a800 20 rados->read ofs=0 len=0 2024-09-22T08:34:51.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.587+0000 7f970753a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:51.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.587+0000 7f970753a800 20 rados->read ofs=0 len=0 2024-09-22T08:34:51.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.587+0000 7f970753a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:34:51.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.587+0000 7f970753a800 20 searching for the correct realm 2024-09-22T08:34:51.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.590+0000 7f9703abc640 0 -- 172.21.15.38:0/3059566441 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7f96f4038060 msgr2=0x7f96f40680a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:34:51.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.796+0000 7f9703abc640 0 -- 172.21.15.38:0/3059566441 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x55fdd42f52d0 msgr2=0x55fdd42f76c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:34:51.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.800+0000 7f970753a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:34:51.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.800+0000 7f970753a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:34:51.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.800+0000 7f970753a800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:34:51.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.800+0000 7f970753a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:34:51.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.800+0000 7f970753a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:34:51.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.800+0000 7f970753a800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:34:51.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.800+0000 7f970753a800 20 rados->read ofs=0 len=0 2024-09-22T08:34:51.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.801+0000 7f970753a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:51.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.801+0000 7f970753a800 20 rados->read ofs=0 len=0 2024-09-22T08:34:51.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.801+0000 7f970753a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:51.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.801+0000 7f970753a800 20 rados->read ofs=0 len=0 2024-09-22T08:34:51.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.801+0000 7f970753a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:34:51.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.801+0000 7f970753a800 20 zone default found 2024-09-22T08:34:51.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.801+0000 7f970753a800 4 Realm: () 2024-09-22T08:34:51.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.801+0000 7f970753a800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:34:51.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.801+0000 7f970753a800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:34:51.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.801+0000 7f970753a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:34:51.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.801+0000 7f970753a800 20 zonegroup default 2024-09-22T08:34:51.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.801+0000 7f970753a800 20 rados->read ofs=0 len=0 2024-09-22T08:34:51.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.801+0000 7f970753a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:51.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.801+0000 7f970753a800 20 rados->read ofs=0 len=0 2024-09-22T08:34:51.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.802+0000 7f970753a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:51.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.802+0000 7f970753a800 20 rados->read ofs=0 len=0 2024-09-22T08:34:51.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.802+0000 7f970753a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:51.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.802+0000 7f970753a800 20 started sync module instance, tier type = 2024-09-22T08:34:51.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.802+0000 7f970753a800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:34:51.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.811+0000 7f970753a800 20 add_watcher() i=0 2024-09-22T08:34:51.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.811+0000 7f970753a800 20 add_watcher() i=1 2024-09-22T08:34:51.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.811+0000 7f970753a800 20 add_watcher() i=2 2024-09-22T08:34:51.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.811+0000 7f970753a800 20 add_watcher() i=3 2024-09-22T08:34:51.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.811+0000 7f970753a800 20 add_watcher() i=4 2024-09-22T08:34:51.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.811+0000 7f970753a800 20 add_watcher() i=5 2024-09-22T08:34:51.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.811+0000 7f970753a800 20 add_watcher() i=6 2024-09-22T08:34:51.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.812+0000 7f970753a800 20 add_watcher() i=7 2024-09-22T08:34:51.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.812+0000 7f970753a800 2 all 8 watchers are set, enabling cache 2024-09-22T08:34:51.815 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.814+0000 7f95b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:51.816 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.814+0000 7f970753a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:34:51.816 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.814+0000 7f970753a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:34:51.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.814+0000 7f970753a800 5 note: GC not initialized 2024-09-22T08:34:51.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.814+0000 7f95b8fe1640 20 reqs_thread_entry: start 2024-09-22T08:34:51.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.814+0000 7f970753a800 20 init_complete bucket index max shards: 11 2024-09-22T08:34:51.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.814+0000 7f970753a800 20 Filter name: none 2024-09-22T08:34:51.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.814+0000 7f95327fc640 20 reqs_thread_entry: start 2024-09-22T08:34:51.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.815+0000 7f970753a800 20 rados->read ofs=0 len=0 2024-09-22T08:34:51.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.815+0000 7f970753a800 20 rados_obj.operate() r=0 bl.length=189 2024-09-22T08:34:51.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.815+0000 7f970753a800 20 rados->read ofs=0 len=0 2024-09-22T08:34:51.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.816+0000 7f970753a800 20 rados_obj.operate() r=0 bl.length=411 2024-09-22T08:34:51.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.816+0000 7f970753a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:34:51.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.816+0000 7f970753a800 20 rados->read ofs=0 len=0 2024-09-22T08:34:51.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.817+0000 7f970753a800 20 rados_obj.operate() r=0 bl.length=189 2024-09-22T08:34:51.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.817+0000 7f970753a800 20 rados->read ofs=0 len=0 2024-09-22T08:34:51.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.817+0000 7f970753a800 20 rados_obj.operate() r=0 bl.length=411 2024-09-22T08:34:51.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.817+0000 7f970753a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:34:51.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.819+0000 7f95b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:51.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.821+0000 7f970753a800 20 remove_watcher() i=0 2024-09-22T08:34:51.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.821+0000 7f970753a800 2 removed watcher, disabling cache 2024-09-22T08:34:51.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.822+0000 7f970753a800 20 remove_watcher() i=1 2024-09-22T08:34:51.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.823+0000 7f970753a800 20 remove_watcher() i=2 2024-09-22T08:34:51.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.824+0000 7f970753a800 20 remove_watcher() i=3 2024-09-22T08:34:51.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.825+0000 7f970753a800 20 remove_watcher() i=4 2024-09-22T08:34:51.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.826+0000 7f970753a800 20 remove_watcher() i=5 2024-09-22T08:34:51.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.827+0000 7f970753a800 20 remove_watcher() i=6 2024-09-22T08:34:51.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.829+0000 7f970753a800 20 remove_watcher() i=7 2024-09-22T08:34:51.842 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:51.842 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:34:51.842 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-block-writes id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:34:51.842 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:51.843 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-22T08:34:51.878 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:34:51.879 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:34:51.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.916+0000 7fc970d28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:51.921 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.918+0000 7fc970d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:51.921 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.918+0000 7fc970d28800 20 realm 2024-09-22T08:34:51.921 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.918+0000 7fc970d28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:51.921 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.918+0000 7fc970d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:51.921 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.918+0000 7fc970d28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:34:51.921 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.918+0000 7fc970d28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:51.921 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.919+0000 7fc970d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:51.921 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.919+0000 7fc970d28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:51.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.919+0000 7fc970d28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:51.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.919+0000 7fc970d28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:51.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.920+0000 7fc970d28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:34:51.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.920+0000 7fc970d28800 20 searching for the correct realm 2024-09-22T08:34:51.924 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:51.922+0000 7fc96c26e640 0 -- 172.21.15.38:0/1611731035 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7fc96006dc90 msgr2=0x7fc960081ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:34:52.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.127+0000 7fc96c26e640 0 -- 172.21.15.38:0/1611731035 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fc95c040430 msgr2=0x7fc95c040870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:34:52.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.335+0000 7fc970d28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:34:52.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.335+0000 7fc970d28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:34:52.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.335+0000 7fc970d28800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:34:52.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.335+0000 7fc970d28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:34:52.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.335+0000 7fc970d28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:34:52.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.335+0000 7fc970d28800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:34:52.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.335+0000 7fc970d28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.336+0000 7fc970d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:52.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.336+0000 7fc970d28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.336+0000 7fc970d28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:52.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.336+0000 7fc970d28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.336+0000 7fc970d28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:34:52.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.336+0000 7fc970d28800 20 zone default found 2024-09-22T08:34:52.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.336+0000 7fc970d28800 4 Realm: () 2024-09-22T08:34:52.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.336+0000 7fc970d28800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:34:52.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.336+0000 7fc970d28800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:34:52.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.336+0000 7fc970d28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:34:52.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.336+0000 7fc970d28800 20 zonegroup default 2024-09-22T08:34:52.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.336+0000 7fc970d28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.337+0000 7fc970d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:52.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.337+0000 7fc970d28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.337+0000 7fc970d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:52.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.338+0000 7fc970d28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.338+0000 7fc970d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:52.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.338+0000 7fc970d28800 20 started sync module instance, tier type = 2024-09-22T08:34:52.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.338+0000 7fc970d28800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:34:52.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.347+0000 7fc970d28800 20 add_watcher() i=0 2024-09-22T08:34:52.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.347+0000 7fc970d28800 20 add_watcher() i=1 2024-09-22T08:34:52.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.347+0000 7fc970d28800 20 add_watcher() i=2 2024-09-22T08:34:52.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.347+0000 7fc970d28800 20 add_watcher() i=3 2024-09-22T08:34:52.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.347+0000 7fc970d28800 20 add_watcher() i=4 2024-09-22T08:34:52.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.347+0000 7fc970d28800 20 add_watcher() i=5 2024-09-22T08:34:52.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.347+0000 7fc970d28800 20 add_watcher() i=6 2024-09-22T08:34:52.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.348+0000 7fc970d28800 20 add_watcher() i=7 2024-09-22T08:34:52.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.348+0000 7fc970d28800 2 all 8 watchers are set, enabling cache 2024-09-22T08:34:52.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.350+0000 7fc822fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:52.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.351+0000 7fc970d28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:34:52.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.351+0000 7fc970d28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:34:52.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.351+0000 7fc970d28800 5 note: GC not initialized 2024-09-22T08:34:52.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.351+0000 7fc821fe3640 20 reqs_thread_entry: start 2024-09-22T08:34:52.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.351+0000 7fc970d28800 20 init_complete bucket index max shards: 11 2024-09-22T08:34:52.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.351+0000 7fc970d28800 20 Filter name: none 2024-09-22T08:34:52.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.351+0000 7fc7937fe640 20 reqs_thread_entry: start 2024-09-22T08:34:52.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.351+0000 7fc970d28800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-22T08:34:52.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.351+0000 7fc970d28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.352+0000 7fc970d28800 20 rados_obj.operate() r=0 bl.length=189 2024-09-22T08:34:52.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.352+0000 7fc970d28800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-22T08:34:52.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.352+0000 7fc970d28800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-22T08:34:52.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.352+0000 7fc970d28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 : miss 2024-09-22T08:34:52.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.352+0000 7fc970d28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.353+0000 7fc970d28800 20 rados_obj.operate() r=0 bl.length=411 2024-09-22T08:34:52.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.353+0000 7fc970d28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 info.flags=0x17 2024-09-22T08:34:52.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.353+0000 7fc970d28800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 to cache LRU end 2024-09-22T08:34:52.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.353+0000 7fc970d28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:34:52.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.353+0000 7fc970d28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:52.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.353+0000 7fc970d28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 2024-09-22T08:34:52.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.358+0000 7fc970d28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 info.flags=0x17 2024-09-22T08:34:52.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.358+0000 7fc970d28800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 to cache LRU end 2024-09-22T08:34:52.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.358+0000 7fc970d28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:52.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.358+0000 7fc970d28800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29, ofs0, ns] 2024-09-22T08:34:52.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.359+0000 7fc843fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497010 cookie 94370038382400 notifier 6996 bl.length()=915 2024-09-22T08:34:52.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.359+0000 7fc843fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 info.flags=0x17 2024-09-22T08:34:52.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.359+0000 7fc843fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 to cache LRU end 2024-09-22T08:34:52.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.359+0000 7fc843fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:52.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.359+0000 7fc970d28800 20 handle_bi_update(): bucket=:abort-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.29]): orig_sources= new_sources= 2024-09-22T08:34:52.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.359+0000 7fc970d28800 20 handle_bi_update(): bucket=:abort-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.29]): potential sources added=[] removed=[] 2024-09-22T08:34:52.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.359+0000 7fc970d28800 20 handle_bi_update(): bucket=:abort-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.29]): orig_dests= new_dests= 2024-09-22T08:34:52.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.359+0000 7fc970d28800 20 handle_bi_update(): bucket=:abort-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.29]): potential dests added=[] removed=[] 2024-09-22T08:34:52.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.364+0000 7fc970d28800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.0 2024-09-22T08:34:52.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.364+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.0 2024-09-22T08:34:52.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.364+0000 7fc970d28800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.1 2024-09-22T08:34:52.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.364+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.1 2024-09-22T08:34:52.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.364+0000 7fc970d28800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.2 2024-09-22T08:34:52.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.364+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.2 2024-09-22T08:34:52.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.364+0000 7fc970d28800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.3 2024-09-22T08:34:52.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.364+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.3 2024-09-22T08:34:52.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.364+0000 7fc970d28800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.4 2024-09-22T08:34:52.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.364+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.4 2024-09-22T08:34:52.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.364+0000 7fc970d28800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.5 2024-09-22T08:34:52.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.364+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.5 2024-09-22T08:34:52.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.364+0000 7fc970d28800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.6 2024-09-22T08:34:52.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.364+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.6 2024-09-22T08:34:52.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.364+0000 7fc970d28800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.7 2024-09-22T08:34:52.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.364+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.7 2024-09-22T08:34:52.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.364+0000 7fc970d28800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.8 2024-09-22T08:34:52.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.364+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.8 2024-09-22T08:34:52.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.364+0000 7fc970d28800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.9 2024-09-22T08:34:52.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.364+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.9 2024-09-22T08:34:52.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.364+0000 7fc970d28800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.10 2024-09-22T08:34:52.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.364+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.10 2024-09-22T08:34:52.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.364+0000 7fc970d28800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.11 2024-09-22T08:34:52.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.364+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.11 2024-09-22T08:34:52.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.364+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.0 2024-09-22T08:34:52.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.365+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1 2024-09-22T08:34:52.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.365+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.2 2024-09-22T08:34:52.370 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.366+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.3 2024-09-22T08:34:52.370 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.367+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.4 2024-09-22T08:34:52.370 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.367+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.5 2024-09-22T08:34:52.370 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.368+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.6 2024-09-22T08:34:52.370 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.368+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.7 2024-09-22T08:34:52.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.369+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.8 2024-09-22T08:34:52.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.369+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.9 2024-09-22T08:34:52.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.370+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.10 2024-09-22T08:34:52.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.373+0000 7fc970d28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 : hit (requested=0x17, cached=0x17) 2024-09-22T08:34:52.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.373+0000 7fc970d28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 2024-09-22T08:34:52.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.374+0000 7fc970d28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 info.flags=0x17 2024-09-22T08:34:52.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.374+0000 7fc970d28800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 to cache LRU end 2024-09-22T08:34:52.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.374+0000 7fc970d28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:52.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.374+0000 7fc970d28800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29, ofs0, ns] 2024-09-22T08:34:52.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.375+0000 7fc8437fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497011 cookie 94370038382400 notifier 6996 bl.length()=915 2024-09-22T08:34:52.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.375+0000 7fc8437fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 info.flags=0x17 2024-09-22T08:34:52.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.375+0000 7fc8437fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 to cache LRU end 2024-09-22T08:34:52.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.375+0000 7fc8437fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:52.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.375+0000 7fc970d28800 20 handle_bi_update(): bucket=:abort-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.29]): orig_sources= new_sources= 2024-09-22T08:34:52.377 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc970d28800 time 2024-09-22T08:34:52.377440+0000 2024-09-22T08:34:52.377 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:34:52.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.375+0000 7fc970d28800 20 handle_bi_update(): bucket=:abort-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.29]): potential sources added=[] removed=[] 2024-09-22T08:34:52.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.375+0000 7fc970d28800 20 handle_bi_update(): bucket=:abort-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.29]): orig_dests= new_dests= 2024-09-22T08:34:52.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.375+0000 7fc970d28800 20 handle_bi_update(): bucket=:abort-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.29]): potential dests added=[] removed=[] 2024-09-22T08:34:52.378 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:34:52.378 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc97258c748] 2024-09-22T08:34:52.379 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fc97258c906] 2024-09-22T08:34:52.379 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d43a6a6e01] 2024-09-22T08:34:52.379 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55d43a6b5f02] 2024-09-22T08:34:52.379 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55d43a6b6d64] 2024-09-22T08:34:52.379 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-22T08:34:52.379 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc971229590] 2024-09-22T08:34:52.379 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-22T08:34:52.380 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-22T08:34:52.380 INFO:tasks.workunit.client.0.smithi038.stderr:*** Caught signal (Aborted) ** 2024-09-22T08:34:52.380 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7fc970d28800 thread_name:radosgw-admin 2024-09-22T08:34:52.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.376+0000 7fc970d28800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc970d28800 time 2024-09-22T08:34:52.377440+0000 2024-09-22T08:34:52.380 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:34:52.380 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:52.380 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:34:52.380 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc97258c748] 2024-09-22T08:34:52.381 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fc97258c906] 2024-09-22T08:34:52.381 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d43a6a6e01] 2024-09-22T08:34:52.381 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55d43a6b5f02] 2024-09-22T08:34:52.381 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55d43a6b6d64] 2024-09-22T08:34:52.381 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-22T08:34:52.381 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc971229590] 2024-09-22T08:34:52.381 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-22T08:34:52.381 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-22T08:34:52.382 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:52.400 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:34:52.400 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc97123e6f0] 2024-09-22T08:34:52.400 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc97128b99c] 2024-09-22T08:34:52.400 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:34:52.400 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:34:52.402 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc97258c7a2] 2024-09-22T08:34:52.402 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fc97258c906] 2024-09-22T08:34:52.402 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d43a6a6e01] 2024-09-22T08:34:52.402 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55d43a6b5f02] 2024-09-22T08:34:52.402 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55d43a6b6d64] 2024-09-22T08:34:52.402 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-22T08:34:52.402 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc971229590] 2024-09-22T08:34:52.402 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-22T08:34:52.403 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-22T08:34:52.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.377+0000 7fc970d28800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:34:52.403 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7fc970d28800 thread_name:radosgw-admin 2024-09-22T08:34:52.403 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:52.403 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:34:52.403 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc97123e6f0] 2024-09-22T08:34:52.403 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc97128b99c] 2024-09-22T08:34:52.403 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:34:52.403 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:34:52.403 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc97258c7a2] 2024-09-22T08:34:52.403 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fc97258c906] 2024-09-22T08:34:52.403 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d43a6a6e01] 2024-09-22T08:34:52.403 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55d43a6b5f02] 2024-09-22T08:34:52.404 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55d43a6b6d64] 2024-09-22T08:34:52.404 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-22T08:34:52.404 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc971229590] 2024-09-22T08:34:52.404 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-22T08:34:52.404 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-22T08:34:52.404 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:34:52.404 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:52.404 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-22T08:34:52.404 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-22T08:34:51.900+0000 7fc970d28800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:52.404 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-22T08:34:51.900+0000 7fc970d28800 10 monclient(hunting): _renew_subs 2024-09-22T08:34:52.404 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-22T08:34:51.900+0000 7fc970d28800 10 monclient(hunting): authenticate will time out at 1997.140250s 2024-09-22T08:34:52.404 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-22T08:34:51.900+0000 7fc96c26e640 10 monclient(hunting): get_auth_request con 0x55d43c784260 auth_method 0 2024-09-22T08:34:52.404 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-22T08:34:51.900+0000 7fc96c26e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:52.404 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-22T08:34:51.900+0000 7fc96c26e640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:52.404 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-22T08:34:51.900+0000 7fc96c26e640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:52.405 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-22T08:34:51.900+0000 7fc96d270640 10 monclient(hunting): get_auth_request con 0x55d43c8160b0 auth_method 0 2024-09-22T08:34:52.405 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-22T08:34:51.900+0000 7fc96d270640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:52.405 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-22T08:34:51.900+0000 7fc96d270640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:52.405 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-22T08:34:51.900+0000 7fc96d270640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:52.405 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-22T08:34:51.900+0000 7fc96c26e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:52.405 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-22T08:34:51.900+0000 7fc96c26e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:52.405 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-22T08:34:51.900+0000 7fc96c26e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:52.405 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-22T08:34:51.900+0000 7fc96d270640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:52.405 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-22T08:34:51.900+0000 7fc96d270640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:52.405 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-22T08:34:51.900+0000 7fc96d270640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:52.405 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-22T08:34:51.900+0000 7fc96ca6f640 10 monclient(hunting): get_auth_request con 0x55d43c7604a0 auth_method 0 2024-09-22T08:34:52.405 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-22T08:34:51.900+0000 7fc96ca6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:52.405 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-22T08:34:51.900+0000 7fc96ca6f640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:52.405 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-22T08:34:51.900+0000 7fc96ca6f640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:52.406 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-22T08:34:51.900+0000 7fc96c26e640 10 monclient(hunting): handle_auth_done global_id 6987 payload 824 2024-09-22T08:34:52.406 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-22T08:34:51.900+0000 7fc96c26e640 10 monclient: _finish_hunting 0 2024-09-22T08:34:52.406 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-22T08:34:51.900+0000 7fc96c26e640 1 monclient: found mon.noname-a 2024-09-22T08:34:52.406 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-22T08:34:51.900+0000 7fc96c26e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:34:52.406 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-22T08:34:51.900+0000 7fc85960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:34:52.406 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-22T08:34:51.900+0000 7fc85960a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:34:52.406 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-22T08:34:51.900+0000 7fc85960a640 10 monclient: dump: 2024-09-22T08:34:52.406 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:34:52.406 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:34:52.406 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:52.406 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:52.406 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:34:52.406 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:52.406 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:34:52.407 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:34:52.407 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:34:52.407 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:52.407 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-22T08:34:51.900+0000 7fc85960a640 10 monclient: _finish_auth 0 2024-09-22T08:34:52.407 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-22T08:34:51.900+0000 7fc85960a640 10 monclient: _check_auth_tickets 2024-09-22T08:34:52.407 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-22T08:34:51.900+0000 7fc85960a640 10 monclient: handle_config config(0 keys) 2024-09-22T08:34:52.407 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-22T08:34:51.900+0000 7fc85960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:34:52.407 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-22T08:34:51.900+0000 7fc85960a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:34:52.407 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-22T08:34:51.900+0000 7fc85960a640 10 monclient: dump: 2024-09-22T08:34:52.407 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:34:52.407 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:34:52.407 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:52.407 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:52.407 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:34:52.407 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:52.408 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:34:52.408 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:34:52.408 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:34:52.408 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:52.408 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-22T08:34:51.900+0000 7fc970d28800 5 monclient: authenticate success, global_id 6987 2024-09-22T08:34:52.408 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-22T08:34:51.900+0000 7fc970d28800 10 monclient: _renew_subs 2024-09-22T08:34:52.408 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-22T08:34:51.900+0000 7fc970d28800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:34:52.408 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-22T08:34:51.900+0000 7fc85ae0d640 4 set_mon_vals no callback set 2024-09-22T08:34:52.408 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-22T08:34:51.901+0000 7fc970d28800 10 monclient: _renew_subs 2024-09-22T08:34:52.408 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-22T08:34:51.901+0000 7fc970d28800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:34:52.408 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-22T08:34:51.901+0000 7fc970d28800 1 librados: init done 2024-09-22T08:34:52.408 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-22T08:34:51.903+0000 7fc85960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:34:52.408 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-22T08:34:51.903+0000 7fc85960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:34:52.408 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-22T08:34:51.903+0000 7fc85960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:34:52.409 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-22T08:34:51.903+0000 7fc96ca6f640 10 monclient: get_auth_request con 0x7fc854077570 auth_method 0 2024-09-22T08:34:52.409 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-22T08:34:51.903+0000 7fc96d270640 10 monclient: get_auth_request con 0x55d43c8ff490 auth_method 0 2024-09-22T08:34:52.409 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-22T08:34:51.904+0000 7fc96ca6f640 10 monclient: get_auth_request con 0x55d43c922240 auth_method 0 2024-09-22T08:34:52.409 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-22T08:34:51.905+0000 7fc96c26e640 10 monclient: get_auth_request con 0x55d43c9265a0 auth_method 0 2024-09-22T08:34:52.409 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-22T08:34:51.906+0000 7fc96d270640 10 monclient: get_auth_request con 0x55d43c925b10 auth_method 0 2024-09-22T08:34:52.409 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-22T08:34:51.907+0000 7fc970d28800 10 monclient: build_initial_monmap 2024-09-22T08:34:52.409 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-22T08:34:51.907+0000 7fc970d28800 1 build_initial for_mkfs: 0 2024-09-22T08:34:52.409 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-22T08:34:51.907+0000 7fc970d28800 10 monclient: monmap: 2024-09-22T08:34:52.409 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:34:52.409 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:34:52.409 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:34:52.409 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:34:52.409 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:34:52.410 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:52.410 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:34:52.410 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:34:52.410 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:34:52.410 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:52.410 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92e640) adding auth protocol: cephx 2024-09-22T08:34:52.410 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92e640) adding auth protocol: cephx 2024-09-22T08:34:52.410 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92e640) adding auth protocol: cephx 2024-09-22T08:34:52.410 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92e640) adding con mode: secure 2024-09-22T08:34:52.410 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92e640) adding con mode: crc 2024-09-22T08:34:52.410 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92e640) adding con mode: secure 2024-09-22T08:34:52.410 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92e640) adding con mode: crc 2024-09-22T08:34:52.410 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92e640) adding con mode: secure 2024-09-22T08:34:52.410 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92e640) adding con mode: crc 2024-09-22T08:34:52.411 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92e640) adding con mode: crc 2024-09-22T08:34:52.411 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92e640) adding con mode: secure 2024-09-22T08:34:52.411 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92e640) adding con mode: crc 2024-09-22T08:34:52.411 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92e640) adding con mode: secure 2024-09-22T08:34:52.411 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92e640) adding con mode: crc 2024-09-22T08:34:52.411 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92e640) adding con mode: secure 2024-09-22T08:34:52.411 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-22T08:34:51.907+0000 7fc970d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:52.411 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 asok(0x55d43c6b50f0) register_command objecter_requests cmddesc objecter_requests hook 0x55d43c931ad0 EEXIST 2024-09-22T08:34:52.411 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-22T08:34:51.907+0000 7fc970d28800 10 monclient: init 2024-09-22T08:34:52.411 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92d588) adding auth protocol: cephx 2024-09-22T08:34:52.411 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92d588) adding auth protocol: cephx 2024-09-22T08:34:52.411 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92d588) adding auth protocol: cephx 2024-09-22T08:34:52.411 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92d588) adding con mode: secure 2024-09-22T08:34:52.411 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92d588) adding con mode: crc 2024-09-22T08:34:52.411 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92d588) adding con mode: secure 2024-09-22T08:34:52.412 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92d588) adding con mode: crc 2024-09-22T08:34:52.412 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92d588) adding con mode: secure 2024-09-22T08:34:52.412 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92d588) adding con mode: crc 2024-09-22T08:34:52.412 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92d588) adding con mode: crc 2024-09-22T08:34:52.412 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92d588) adding con mode: secure 2024-09-22T08:34:52.412 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92d588) adding con mode: crc 2024-09-22T08:34:52.412 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92d588) adding con mode: secure 2024-09-22T08:34:52.412 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92d588) adding con mode: crc 2024-09-22T08:34:52.412 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92d588) adding con mode: secure 2024-09-22T08:34:52.412 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-22T08:34:51.907+0000 7fc970d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:52.412 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-22T08:34:51.908+0000 7fc970d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:52.412 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-22T08:34:51.908+0000 7fc970d28800 5 asok(0x55d43c6b50f0) register_command rotate-key cmddesc rotate-key hook 0x55d43c92d6d0 EEXIST 2024-09-22T08:34:52.412 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-22T08:34:51.908+0000 7fc970d28800 10 monclient: _reopen_session rank -1 2024-09-22T08:34:52.412 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-22T08:34:51.908+0000 7fc970d28800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T08:34:52.412 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-22T08:34:51.908+0000 7fc970d28800 10 monclient(hunting): picked mon.noname-c con 0x55d43c955df0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:34:52.413 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-22T08:34:51.908+0000 7fc970d28800 10 monclient(hunting): picked mon.noname-a con 0x55d43c9561d0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:34:52.413 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-22T08:34:51.908+0000 7fc970d28800 10 monclient(hunting): picked mon.noname-b con 0x55d43c954b00 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:34:52.413 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-22T08:34:51.908+0000 7fc970d28800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:52.413 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-22T08:34:51.908+0000 7fc970d28800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:52.413 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-22T08:34:51.908+0000 7fc970d28800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:52.413 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-22T08:34:51.908+0000 7fc970d28800 10 monclient(hunting): _renew_subs 2024-09-22T08:34:52.413 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-22T08:34:51.908+0000 7fc970d28800 10 monclient(hunting): authenticate will time out at 1997.148221s 2024-09-22T08:34:52.413 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-22T08:34:51.908+0000 7fc96d270640 10 monclient(hunting): get_auth_request con 0x55d43c9561d0 auth_method 0 2024-09-22T08:34:52.413 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-22T08:34:51.908+0000 7fc96d270640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:52.413 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-22T08:34:51.908+0000 7fc96d270640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:52.413 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-22T08:34:51.908+0000 7fc96d270640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:52.413 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-22T08:34:51.908+0000 7fc96c26e640 10 monclient(hunting): get_auth_request con 0x55d43c955df0 auth_method 0 2024-09-22T08:34:52.413 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-22T08:34:51.908+0000 7fc96c26e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:52.413 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-22T08:34:51.908+0000 7fc96c26e640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:52.414 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-22T08:34:51.908+0000 7fc96c26e640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:52.414 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-22T08:34:51.908+0000 7fc96d270640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:52.414 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-22T08:34:51.908+0000 7fc96d270640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:52.414 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-22T08:34:51.908+0000 7fc96d270640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:52.414 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-22T08:34:51.908+0000 7fc96c26e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:52.414 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-22T08:34:51.908+0000 7fc96c26e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:52.414 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-22T08:34:51.908+0000 7fc96c26e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:52.414 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-22T08:34:51.908+0000 7fc96ca6f640 10 monclient(hunting): get_auth_request con 0x55d43c954b00 auth_method 0 2024-09-22T08:34:52.414 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-22T08:34:51.908+0000 7fc96ca6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:52.414 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-22T08:34:51.908+0000 7fc96ca6f640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:52.415 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-22T08:34:51.908+0000 7fc96ca6f640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:52.415 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-22T08:34:51.908+0000 7fc96ca6f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:52.415 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-22T08:34:51.908+0000 7fc96ca6f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:52.415 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-22T08:34:51.908+0000 7fc96ca6f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:52.415 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-22T08:34:51.908+0000 7fc96d270640 10 monclient(hunting): handle_auth_done global_id 6990 payload 824 2024-09-22T08:34:52.415 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-22T08:34:51.908+0000 7fc96d270640 10 monclient: _finish_hunting 0 2024-09-22T08:34:52.415 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-22T08:34:51.908+0000 7fc96d270640 1 monclient: found mon.noname-a 2024-09-22T08:34:52.415 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-22T08:34:51.908+0000 7fc96d270640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:34:52.415 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-22T08:34:51.908+0000 7fc8527fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:34:52.415 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-22T08:34:51.908+0000 7fc8527fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:34:52.415 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-22T08:34:51.908+0000 7fc8527fc640 10 monclient: dump: 2024-09-22T08:34:52.415 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:34:52.415 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:34:52.415 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:52.416 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:52.416 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:34:52.416 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:52.416 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:34:52.416 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:34:52.416 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:34:52.416 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:52.416 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-22T08:34:51.908+0000 7fc8527fc640 10 monclient: _finish_auth 0 2024-09-22T08:34:52.416 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-22T08:34:51.908+0000 7fc8527fc640 10 monclient: _check_auth_tickets 2024-09-22T08:34:52.416 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-22T08:34:51.908+0000 7fc8527fc640 10 monclient: handle_config config(0 keys) 2024-09-22T08:34:52.416 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-22T08:34:51.908+0000 7fc8527fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:34:52.416 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-22T08:34:51.908+0000 7fc8527fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:34:52.416 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-22T08:34:51.908+0000 7fc8527fc640 10 monclient: dump: 2024-09-22T08:34:52.416 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:34:52.417 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:34:52.417 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:52.417 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:52.417 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:34:52.417 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:52.417 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:34:52.417 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:34:52.417 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:34:52.417 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:52.417 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-22T08:34:51.908+0000 7fc970d28800 5 monclient: authenticate success, global_id 6990 2024-09-22T08:34:52.417 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-22T08:34:51.908+0000 7fc970d28800 10 monclient: _renew_subs 2024-09-22T08:34:52.417 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-22T08:34:51.908+0000 7fc970d28800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:34:52.417 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-22T08:34:51.908+0000 7fc96da71640 4 set_mon_vals no callback set 2024-09-22T08:34:52.417 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-22T08:34:51.909+0000 7fc970d28800 10 monclient: _renew_subs 2024-09-22T08:34:52.418 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-22T08:34:51.909+0000 7fc970d28800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:34:52.418 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-22T08:34:51.910+0000 7fc8527fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:34:52.418 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-22T08:34:51.910+0000 7fc8527fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:34:52.418 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-22T08:34:51.910+0000 7fc8527fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:34:52.418 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-22T08:34:51.911+0000 7fc96c26e640 10 monclient: get_auth_request con 0x7fc844077480 auth_method 0 2024-09-22T08:34:52.418 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-22T08:34:51.911+0000 7fc970d28800 10 monclient: get_monmap_and_config 2024-09-22T08:34:52.418 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-22T08:34:51.911+0000 7fc970d28800 10 monclient: build_initial_monmap 2024-09-22T08:34:52.418 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-22T08:34:51.911+0000 7fc970d28800 1 build_initial for_mkfs: 0 2024-09-22T08:34:52.418 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-22T08:34:51.911+0000 7fc970d28800 10 monclient: monmap: 2024-09-22T08:34:52.418 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:34:52.418 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:34:52.418 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:34:52.418 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:34:52.419 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:34:52.419 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:52.419 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:34:52.419 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:34:52.419 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:34:52.419 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:52.419 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x55d43c975d20) adding auth protocol: cephx 2024-09-22T08:34:52.419 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x55d43c975d20) adding auth protocol: cephx 2024-09-22T08:34:52.419 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x55d43c975d20) adding auth protocol: cephx 2024-09-22T08:34:52.419 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x55d43c975d20) adding con mode: secure 2024-09-22T08:34:52.419 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x55d43c975d20) adding con mode: crc 2024-09-22T08:34:52.419 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x55d43c975d20) adding con mode: secure 2024-09-22T08:34:52.419 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x55d43c975d20) adding con mode: crc 2024-09-22T08:34:52.419 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x55d43c975d20) adding con mode: secure 2024-09-22T08:34:52.419 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x55d43c975d20) adding con mode: crc 2024-09-22T08:34:52.420 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x55d43c975d20) adding con mode: crc 2024-09-22T08:34:52.420 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x55d43c975d20) adding con mode: secure 2024-09-22T08:34:52.420 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x55d43c975d20) adding con mode: crc 2024-09-22T08:34:52.420 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x55d43c975d20) adding con mode: secure 2024-09-22T08:34:52.420 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x55d43c975d20) adding con mode: crc 2024-09-22T08:34:52.420 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x55d43c975d20) adding con mode: secure 2024-09-22T08:34:52.420 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-22T08:34:51.911+0000 7fc970d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:52.420 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-22T08:34:51.911+0000 7fc970d28800 10 monclient: init 2024-09-22T08:34:52.420 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678390) adding auth protocol: cephx 2024-09-22T08:34:52.420 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678390) adding auth protocol: cephx 2024-09-22T08:34:52.420 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678390) adding auth protocol: cephx 2024-09-22T08:34:52.420 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678390) adding con mode: secure 2024-09-22T08:34:52.420 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678390) adding con mode: crc 2024-09-22T08:34:52.421 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678390) adding con mode: secure 2024-09-22T08:34:52.421 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678390) adding con mode: crc 2024-09-22T08:34:52.421 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678390) adding con mode: secure 2024-09-22T08:34:52.421 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678390) adding con mode: crc 2024-09-22T08:34:52.421 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678390) adding con mode: crc 2024-09-22T08:34:52.421 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678390) adding con mode: secure 2024-09-22T08:34:52.421 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678390) adding con mode: crc 2024-09-22T08:34:52.421 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678390) adding con mode: secure 2024-09-22T08:34:52.421 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678390) adding con mode: crc 2024-09-22T08:34:52.421 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678390) adding con mode: secure 2024-09-22T08:34:52.421 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-22T08:34:51.911+0000 7fc970d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:52.421 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-22T08:34:51.912+0000 7fc970d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:52.421 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-22T08:34:51.912+0000 7fc970d28800 5 asok(0x55d43c6b50f0) register_command rotate-key cmddesc rotate-key hook 0x7fffcf6784d8 EEXIST 2024-09-22T08:34:52.421 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-22T08:34:51.912+0000 7fc970d28800 10 monclient: _reopen_session rank -1 2024-09-22T08:34:52.422 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-22T08:34:51.912+0000 7fc970d28800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-22T08:34:52.422 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-22T08:34:51.912+0000 7fc970d28800 10 monclient(hunting): picked mon.noname-c con 0x55d43c9aa340 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:34:52.422 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-22T08:34:51.912+0000 7fc970d28800 10 monclient(hunting): picked mon.noname-b con 0x55d43c9a45a0 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:34:52.422 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-22T08:34:51.912+0000 7fc970d28800 10 monclient(hunting): picked mon.noname-a con 0x55d43c9a5cf0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:34:52.422 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-22T08:34:51.912+0000 7fc970d28800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:52.422 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-22T08:34:51.912+0000 7fc970d28800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:52.422 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-22T08:34:51.912+0000 7fc970d28800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:52.422 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-22T08:34:51.912+0000 7fc970d28800 10 monclient(hunting): _renew_subs 2024-09-22T08:34:52.422 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-22T08:34:51.912+0000 7fc970d28800 10 monclient(hunting): authenticate will time out at 1997.152220s 2024-09-22T08:34:52.422 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-22T08:34:51.912+0000 7fc96c26e640 10 monclient(hunting): get_auth_request con 0x55d43c9aa340 auth_method 0 2024-09-22T08:34:52.422 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-22T08:34:51.912+0000 7fc96c26e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:52.422 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-22T08:34:51.912+0000 7fc96c26e640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:52.422 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-22T08:34:51.912+0000 7fc96c26e640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:52.423 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-22T08:34:51.912+0000 7fc96ca6f640 10 monclient(hunting): get_auth_request con 0x55d43c9a5cf0 auth_method 0 2024-09-22T08:34:52.423 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-22T08:34:51.912+0000 7fc96ca6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:52.423 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-22T08:34:51.912+0000 7fc96ca6f640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:52.423 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-22T08:34:51.912+0000 7fc96ca6f640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:52.423 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-22T08:34:51.912+0000 7fc96c26e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:52.423 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-22T08:34:51.912+0000 7fc96c26e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:52.423 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-22T08:34:51.912+0000 7fc96c26e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:52.423 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-22T08:34:51.912+0000 7fc96d270640 10 monclient(hunting): get_auth_request con 0x55d43c9a45a0 auth_method 0 2024-09-22T08:34:52.423 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-22T08:34:51.912+0000 7fc96d270640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:52.423 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-22T08:34:51.912+0000 7fc96d270640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:52.423 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-22T08:34:51.912+0000 7fc96d270640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:52.423 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-22T08:34:51.912+0000 7fc96ca6f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:52.423 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-22T08:34:51.912+0000 7fc96ca6f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:52.423 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-22T08:34:51.912+0000 7fc96ca6f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:52.424 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-22T08:34:51.912+0000 7fc96d270640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:52.424 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-22T08:34:51.912+0000 7fc96d270640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:52.424 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-22T08:34:51.912+0000 7fc96d270640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:52.424 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-22T08:34:51.912+0000 7fc96c26e640 10 monclient(hunting): handle_auth_done global_id 6605 payload 274 2024-09-22T08:34:52.424 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-22T08:34:51.912+0000 7fc96c26e640 10 monclient: _finish_hunting 0 2024-09-22T08:34:52.424 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-22T08:34:51.912+0000 7fc96c26e640 1 monclient: found mon.noname-c 2024-09-22T08:34:52.424 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-22T08:34:51.912+0000 7fc96c26e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:34:52.424 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-22T08:34:51.912+0000 7fc843fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:34:52.424 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-22T08:34:51.912+0000 7fc843fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:34:52.424 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-22T08:34:51.912+0000 7fc843fff640 10 monclient: dump: 2024-09-22T08:34:52.424 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:34:52.424 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:34:52.424 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:52.424 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:52.425 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:34:52.425 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:52.425 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:34:52.425 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:34:52.425 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:34:52.425 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:52.425 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-22T08:34:51.912+0000 7fc843fff640 10 monclient: _finish_auth 0 2024-09-22T08:34:52.425 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-22T08:34:51.912+0000 7fc843fff640 10 monclient: _check_auth_tickets 2024-09-22T08:34:52.425 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-22T08:34:51.912+0000 7fc843fff640 10 monclient: handle_config config(0 keys) 2024-09-22T08:34:52.425 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-22T08:34:51.912+0000 7fc843fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:34:52.425 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-22T08:34:51.912+0000 7fc843fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:34:52.425 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-22T08:34:51.912+0000 7fc843fff640 10 monclient: dump: 2024-09-22T08:34:52.425 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:34:52.425 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:34:52.425 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:52.426 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:52.426 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:34:52.426 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:52.426 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:34:52.426 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:34:52.426 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:34:52.426 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:52.426 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-22T08:34:51.912+0000 7fc970d28800 5 monclient: authenticate success, global_id 6605 2024-09-22T08:34:52.426 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-22T08:34:51.912+0000 7fc970d28800 10 monclient: get_monmap_and_config success 2024-09-22T08:34:52.426 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-22T08:34:51.912+0000 7fc970d28800 4 set_mon_vals no callback set 2024-09-22T08:34:52.426 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-22T08:34:51.913+0000 7fc970d28800 10 monclient: shutdown 2024-09-22T08:34:52.426 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-22T08:34:51.913+0000 7fc970d28800 10 monclient: build_initial_monmap 2024-09-22T08:34:52.426 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-22T08:34:51.913+0000 7fc970d28800 1 build_initial for_mkfs: 0 2024-09-22T08:34:52.427 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-22T08:34:51.913+0000 7fc970d28800 10 monclient: monmap: 2024-09-22T08:34:52.427 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:34:52.427 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:34:52.427 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:34:52.427 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:34:52.427 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:34:52.427 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:52.427 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:34:52.427 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:34:52.427 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:34:52.427 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:52.427 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c97aef0) adding auth protocol: cephx 2024-09-22T08:34:52.427 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c97aef0) adding auth protocol: cephx 2024-09-22T08:34:52.427 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c97aef0) adding auth protocol: cephx 2024-09-22T08:34:52.427 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c97aef0) adding con mode: secure 2024-09-22T08:34:52.428 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c97aef0) adding con mode: crc 2024-09-22T08:34:52.428 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c97aef0) adding con mode: secure 2024-09-22T08:34:52.428 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c97aef0) adding con mode: crc 2024-09-22T08:34:52.428 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c97aef0) adding con mode: secure 2024-09-22T08:34:52.428 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c97aef0) adding con mode: crc 2024-09-22T08:34:52.428 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c97aef0) adding con mode: crc 2024-09-22T08:34:52.428 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c97aef0) adding con mode: secure 2024-09-22T08:34:52.428 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c97aef0) adding con mode: crc 2024-09-22T08:34:52.428 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c97aef0) adding con mode: secure 2024-09-22T08:34:52.428 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c97aef0) adding con mode: crc 2024-09-22T08:34:52.428 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c97aef0) adding con mode: secure 2024-09-22T08:34:52.428 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-22T08:34:51.913+0000 7fc970d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:52.429 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-22T08:34:51.913+0000 7fc970d28800 1 librados: starting msgr at 2024-09-22T08:34:52.429 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-22T08:34:51.913+0000 7fc970d28800 1 librados: starting objecter 2024-09-22T08:34:52.429 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 asok(0x55d43c6b50f0) register_command objecter_requests cmddesc objecter_requests hook 0x55d43c978570 EEXIST 2024-09-22T08:34:52.429 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-22T08:34:51.913+0000 7fc970d28800 1 librados: setting wanted keys 2024-09-22T08:34:52.429 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-22T08:34:51.913+0000 7fc970d28800 1 librados: calling monclient init 2024-09-22T08:34:52.429 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-22T08:34:51.913+0000 7fc970d28800 10 monclient: init 2024-09-22T08:34:52.429 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c96a6b0) adding auth protocol: cephx 2024-09-22T08:34:52.429 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c96a6b0) adding auth protocol: cephx 2024-09-22T08:34:52.429 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c96a6b0) adding auth protocol: cephx 2024-09-22T08:34:52.429 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c96a6b0) adding con mode: secure 2024-09-22T08:34:52.429 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c96a6b0) adding con mode: crc 2024-09-22T08:34:52.429 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c96a6b0) adding con mode: secure 2024-09-22T08:34:52.429 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c96a6b0) adding con mode: crc 2024-09-22T08:34:52.429 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c96a6b0) adding con mode: secure 2024-09-22T08:34:52.430 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c96a6b0) adding con mode: crc 2024-09-22T08:34:52.430 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c96a6b0) adding con mode: crc 2024-09-22T08:34:52.430 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c96a6b0) adding con mode: secure 2024-09-22T08:34:52.430 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c96a6b0) adding con mode: crc 2024-09-22T08:34:52.430 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c96a6b0) adding con mode: secure 2024-09-22T08:34:52.430 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c96a6b0) adding con mode: crc 2024-09-22T08:34:52.430 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c96a6b0) adding con mode: secure 2024-09-22T08:34:52.430 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-22T08:34:51.914+0000 7fc970d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:52.430 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-22T08:34:51.914+0000 7fc970d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:52.430 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-22T08:34:51.914+0000 7fc970d28800 5 asok(0x55d43c6b50f0) register_command rotate-key cmddesc rotate-key hook 0x55d43c96a7f8 EEXIST 2024-09-22T08:34:52.430 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-22T08:34:51.914+0000 7fc970d28800 10 monclient: _reopen_session rank -1 2024-09-22T08:34:52.430 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-22T08:34:51.914+0000 7fc970d28800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T08:34:52.430 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-22T08:34:51.914+0000 7fc970d28800 10 monclient(hunting): picked mon.noname-a con 0x55d43c9a45a0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:34:52.430 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-22T08:34:51.914+0000 7fc970d28800 10 monclient(hunting): picked mon.noname-c con 0x55d43c9a5cf0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:34:52.431 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-22T08:34:51.914+0000 7fc970d28800 10 monclient(hunting): picked mon.noname-b con 0x55d43c9aa340 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:34:52.431 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-22T08:34:51.914+0000 7fc970d28800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:52.431 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-22T08:34:51.914+0000 7fc970d28800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:52.431 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-22T08:34:51.914+0000 7fc970d28800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:52.431 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-22T08:34:51.914+0000 7fc970d28800 10 monclient(hunting): _renew_subs 2024-09-22T08:34:52.431 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-22T08:34:51.914+0000 7fc970d28800 10 monclient(hunting): authenticate will time out at 1997.154494s 2024-09-22T08:34:52.431 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-22T08:34:51.914+0000 7fc96c26e640 10 monclient(hunting): get_auth_request con 0x55d43c9a45a0 auth_method 0 2024-09-22T08:34:52.431 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-22T08:34:51.914+0000 7fc96c26e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:52.431 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-22T08:34:51.914+0000 7fc96c26e640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:52.431 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-22T08:34:51.914+0000 7fc96c26e640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:52.431 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-22T08:34:51.914+0000 7fc96d270640 10 monclient(hunting): get_auth_request con 0x55d43c9a5cf0 auth_method 0 2024-09-22T08:34:52.431 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-22T08:34:51.914+0000 7fc96d270640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:52.431 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-22T08:34:51.914+0000 7fc96d270640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:52.431 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-22T08:34:51.914+0000 7fc96d270640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:52.431 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-22T08:34:51.914+0000 7fc96c26e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:52.432 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-22T08:34:51.914+0000 7fc96c26e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:52.432 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-22T08:34:51.914+0000 7fc96c26e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:52.432 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-22T08:34:51.914+0000 7fc96ca6f640 10 monclient(hunting): get_auth_request con 0x55d43c9aa340 auth_method 0 2024-09-22T08:34:52.432 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-22T08:34:51.914+0000 7fc96ca6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:52.432 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-22T08:34:51.914+0000 7fc96ca6f640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:52.432 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-22T08:34:51.914+0000 7fc96ca6f640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:52.432 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-22T08:34:51.914+0000 7fc96d270640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:52.432 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-22T08:34:51.914+0000 7fc96d270640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:52.432 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-22T08:34:51.914+0000 7fc96d270640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:52.432 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-22T08:34:51.914+0000 7fc96ca6f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:52.432 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-22T08:34:51.914+0000 7fc96ca6f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:52.432 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-22T08:34:51.914+0000 7fc96ca6f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:52.432 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-22T08:34:51.914+0000 7fc96c26e640 10 monclient(hunting): handle_auth_done global_id 6996 payload 824 2024-09-22T08:34:52.432 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-22T08:34:51.914+0000 7fc96c26e640 10 monclient: _finish_hunting 0 2024-09-22T08:34:52.432 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-22T08:34:51.914+0000 7fc96c26e640 1 monclient: found mon.noname-a 2024-09-22T08:34:52.432 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-22T08:34:51.914+0000 7fc96c26e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:34:52.433 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-22T08:34:51.915+0000 7fc8427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:34:52.433 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-22T08:34:51.915+0000 7fc8427fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:34:52.433 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-22T08:34:51.915+0000 7fc8427fc640 10 monclient: dump: 2024-09-22T08:34:52.433 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:34:52.433 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:34:52.433 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:52.433 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:52.433 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:34:52.433 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:52.433 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:34:52.433 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:34:52.433 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:34:52.433 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:52.433 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-22T08:34:51.915+0000 7fc8427fc640 10 monclient: _finish_auth 0 2024-09-22T08:34:52.434 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-22T08:34:51.915+0000 7fc8427fc640 10 monclient: _check_auth_tickets 2024-09-22T08:34:52.434 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-22T08:34:51.915+0000 7fc8427fc640 10 monclient: handle_config config(0 keys) 2024-09-22T08:34:52.434 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-22T08:34:51.915+0000 7fc8427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:34:52.434 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-22T08:34:51.915+0000 7fc8427fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:34:52.434 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-22T08:34:51.915+0000 7fc8427fc640 10 monclient: dump: 2024-09-22T08:34:52.434 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:34:52.434 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:34:52.434 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:52.434 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:52.434 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:34:52.434 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:52.434 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:34:52.434 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:34:52.434 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:34:52.435 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:52.435 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-22T08:34:51.915+0000 7fc970d28800 5 monclient: authenticate success, global_id 6996 2024-09-22T08:34:52.435 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-22T08:34:51.915+0000 7fc970d28800 10 monclient: _renew_subs 2024-09-22T08:34:52.435 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-22T08:34:51.915+0000 7fc970d28800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:34:52.435 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-22T08:34:51.915+0000 7fc843fff640 4 set_mon_vals no callback set 2024-09-22T08:34:52.435 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-22T08:34:51.915+0000 7fc970d28800 10 monclient: _renew_subs 2024-09-22T08:34:52.435 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-22T08:34:51.915+0000 7fc970d28800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:34:52.435 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-22T08:34:51.915+0000 7fc970d28800 1 librados: init done 2024-09-22T08:34:52.435 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-22T08:34:51.915+0000 7fc970d28800 5 asok(0x55d43c6b50f0) register_command cr dump hook 0x55d43c996d48 2024-09-22T08:34:52.435 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-22T08:34:51.916+0000 7fc970d28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.435 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-22T08:34:51.917+0000 7fc8427fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:34:52.435 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-22T08:34:51.917+0000 7fc8427fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:34:52.435 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-22T08:34:51.917+0000 7fc8427fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:34:52.435 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-22T08:34:51.917+0000 7fc96d270640 10 monclient: get_auth_request con 0x7fc838077570 auth_method 0 2024-09-22T08:34:52.436 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-22T08:34:51.918+0000 7fc96ca6f640 10 monclient: get_auth_request con 0x55d43c9c4160 auth_method 0 2024-09-22T08:34:52.436 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-22T08:34:51.918+0000 7fc970d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:52.436 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-22T08:34:51.918+0000 7fc970d28800 20 realm 2024-09-22T08:34:52.436 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-22T08:34:51.918+0000 7fc970d28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.436 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-22T08:34:51.918+0000 7fc970d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:52.436 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-22T08:34:51.918+0000 7fc970d28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:34:52.436 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-22T08:34:51.918+0000 7fc970d28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.436 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-22T08:34:51.919+0000 7fc970d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:52.436 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-22T08:34:51.919+0000 7fc970d28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.436 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-22T08:34:51.919+0000 7fc96c26e640 10 monclient: get_auth_request con 0x55d43c9c83e0 auth_method 0 2024-09-22T08:34:52.436 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-22T08:34:51.919+0000 7fc970d28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:52.436 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-22T08:34:51.919+0000 7fc970d28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.436 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-22T08:34:51.920+0000 7fc96d270640 10 monclient: get_auth_request con 0x55d43c9cbc40 auth_method 0 2024-09-22T08:34:52.436 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-22T08:34:51.920+0000 7fc970d28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:34:52.437 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-22T08:34:51.920+0000 7fc970d28800 20 searching for the correct realm 2024-09-22T08:34:52.437 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-22T08:34:51.920+0000 7fc96ca6f640 10 monclient: get_auth_request con 0x55d43c9d0a00 auth_method 0 2024-09-22T08:34:52.437 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-22T08:34:51.922+0000 7fc96c26e640 10 monclient: get_auth_request con 0x7fc96006dc90 auth_method 0 2024-09-22T08:34:52.437 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-22T08:34:51.922+0000 7fc96c26e640 0 -- 172.21.15.38:0/1611731035 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7fc96006dc90 msgr2=0x7fc960081ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:34:52.437 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-22T08:34:52.123+0000 7fc96c26e640 10 monclient: get_auth_request con 0x7fc96006dc90 auth_method 0 2024-09-22T08:34:52.437 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-22T08:34:52.124+0000 7fc96d270640 10 monclient: get_auth_request con 0x7fc95c02e5f0 auth_method 0 2024-09-22T08:34:52.437 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-22T08:34:52.126+0000 7fc96ca6f640 10 monclient: get_auth_request con 0x7fc96006b710 auth_method 0 2024-09-22T08:34:52.437 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-22T08:34:52.127+0000 7fc96c26e640 0 -- 172.21.15.38:0/1611731035 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fc95c040430 msgr2=0x7fc95c040870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:34:52.437 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-22T08:34:52.127+0000 7fc96c26e640 10 monclient: get_auth_request con 0x7fc95c040430 auth_method 0 2024-09-22T08:34:52.437 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-22T08:34:52.328+0000 7fc96c26e640 10 monclient: get_auth_request con 0x7fc95c040430 auth_method 0 2024-09-22T08:34:52.437 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-22T08:34:52.334+0000 7fc8427fc640 1 client.6996.objecter ms_handle_reset 0x55d43c9c83e0 session 0x55d43c9c7d60 osd.1 2024-09-22T08:34:52.437 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-22T08:34:52.334+0000 7fc8427fc640 10 monclient: _renew_subs 2024-09-22T08:34:52.437 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-22T08:34:52.334+0000 7fc8427fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:34:52.437 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-22T08:34:52.334+0000 7fc96c26e640 10 monclient: get_auth_request con 0x7fc838087090 auth_method 0 2024-09-22T08:34:52.438 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-22T08:34:52.335+0000 7fc970d28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:34:52.438 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-22T08:34:52.335+0000 7fc970d28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:34:52.438 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-22T08:34:52.335+0000 7fc970d28800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:34:52.438 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-22T08:34:52.335+0000 7fc970d28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:34:52.438 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-22T08:34:52.335+0000 7fc970d28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:34:52.438 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-22T08:34:52.335+0000 7fc970d28800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:34:52.438 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-22T08:34:52.335+0000 7fc970d28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.438 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-22T08:34:52.336+0000 7fc970d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:52.438 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-22T08:34:52.336+0000 7fc970d28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.438 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-22T08:34:52.336+0000 7fc970d28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:52.438 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-22T08:34:52.336+0000 7fc970d28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.438 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-22T08:34:52.336+0000 7fc970d28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:34:52.438 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-22T08:34:52.336+0000 7fc970d28800 20 zone default found 2024-09-22T08:34:52.439 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-22T08:34:52.336+0000 7fc970d28800 4 Realm: () 2024-09-22T08:34:52.439 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-22T08:34:52.336+0000 7fc970d28800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:34:52.439 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-22T08:34:52.336+0000 7fc970d28800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:34:52.439 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-22T08:34:52.336+0000 7fc970d28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:34:52.439 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-22T08:34:52.336+0000 7fc970d28800 20 zonegroup default 2024-09-22T08:34:52.439 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-22T08:34:52.336+0000 7fc970d28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.439 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-22T08:34:52.337+0000 7fc970d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:52.439 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-22T08:34:52.337+0000 7fc970d28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.439 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-22T08:34:52.337+0000 7fc970d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:52.439 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-22T08:34:52.338+0000 7fc970d28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.439 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-22T08:34:52.338+0000 7fc970d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:52.439 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-22T08:34:52.338+0000 7fc970d28800 20 started sync module instance, tier type = 2024-09-22T08:34:52.439 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-22T08:34:52.338+0000 7fc970d28800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:34:52.439 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-22T08:34:52.347+0000 7fc970d28800 20 add_watcher() i=0 2024-09-22T08:34:52.440 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-22T08:34:52.347+0000 7fc970d28800 20 add_watcher() i=1 2024-09-22T08:34:52.440 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-22T08:34:52.347+0000 7fc970d28800 20 add_watcher() i=2 2024-09-22T08:34:52.440 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-22T08:34:52.347+0000 7fc970d28800 20 add_watcher() i=3 2024-09-22T08:34:52.440 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-22T08:34:52.347+0000 7fc970d28800 20 add_watcher() i=4 2024-09-22T08:34:52.440 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-22T08:34:52.347+0000 7fc970d28800 20 add_watcher() i=5 2024-09-22T08:34:52.440 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-22T08:34:52.347+0000 7fc970d28800 20 add_watcher() i=6 2024-09-22T08:34:52.440 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-22T08:34:52.348+0000 7fc970d28800 20 add_watcher() i=7 2024-09-22T08:34:52.440 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-22T08:34:52.348+0000 7fc970d28800 2 all 8 watchers are set, enabling cache 2024-09-22T08:34:52.440 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-22T08:34:52.350+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678860) adding auth protocol: cephx 2024-09-22T08:34:52.440 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-22T08:34:52.350+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678860) adding auth protocol: cephx 2024-09-22T08:34:52.440 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-22T08:34:52.350+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678860) adding auth protocol: cephx 2024-09-22T08:34:52.440 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-22T08:34:52.350+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678860) adding con mode: secure 2024-09-22T08:34:52.440 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-22T08:34:52.350+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678860) adding con mode: crc 2024-09-22T08:34:52.440 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-22T08:34:52.350+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678860) adding con mode: secure 2024-09-22T08:34:52.441 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-22T08:34:52.350+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678860) adding con mode: crc 2024-09-22T08:34:52.441 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-22T08:34:52.350+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678860) adding con mode: secure 2024-09-22T08:34:52.441 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-22T08:34:52.350+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678860) adding con mode: crc 2024-09-22T08:34:52.441 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-22T08:34:52.350+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678860) adding con mode: crc 2024-09-22T08:34:52.441 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-22T08:34:52.350+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678860) adding con mode: secure 2024-09-22T08:34:52.441 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-22T08:34:52.350+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678860) adding con mode: crc 2024-09-22T08:34:52.441 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-22T08:34:52.350+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678860) adding con mode: secure 2024-09-22T08:34:52.441 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-22T08:34:52.350+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678860) adding con mode: crc 2024-09-22T08:34:52.441 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-22T08:34:52.350+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678860) adding con mode: secure 2024-09-22T08:34:52.441 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-22T08:34:52.350+0000 7fc822fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:52.441 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-22T08:34:52.351+0000 7fc970d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:52.441 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-22T08:34:52.351+0000 7fc970d28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:34:52.441 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-22T08:34:52.351+0000 7fc970d28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:34:52.441 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-22T08:34:52.351+0000 7fc970d28800 5 asok(0x55d43c6b50f0) register_command cache list hook 0x55d43c995cb0 2024-09-22T08:34:52.442 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-22T08:34:52.351+0000 7fc970d28800 5 asok(0x55d43c6b50f0) register_command cache inspect hook 0x55d43c995cb0 2024-09-22T08:34:52.442 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-22T08:34:52.351+0000 7fc970d28800 5 asok(0x55d43c6b50f0) register_command cache erase hook 0x55d43c995cb0 2024-09-22T08:34:52.442 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-22T08:34:52.351+0000 7fc970d28800 5 asok(0x55d43c6b50f0) register_command cache zap hook 0x55d43c995cb0 2024-09-22T08:34:52.442 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-22T08:34:52.351+0000 7fc970d28800 5 note: GC not initialized 2024-09-22T08:34:52.442 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-22T08:34:52.351+0000 7fc821fe3640 20 reqs_thread_entry: start 2024-09-22T08:34:52.442 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-22T08:34:52.351+0000 7fc970d28800 5 asok(0x55d43c6b50f0) register_command sync trace show hook 0x7fc9600664b0 2024-09-22T08:34:52.442 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-22T08:34:52.351+0000 7fc970d28800 5 asok(0x55d43c6b50f0) register_command sync trace history hook 0x7fc9600664b0 2024-09-22T08:34:52.442 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-22T08:34:52.351+0000 7fc970d28800 5 asok(0x55d43c6b50f0) register_command sync trace active hook 0x7fc9600664b0 2024-09-22T08:34:52.442 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-22T08:34:52.351+0000 7fc970d28800 5 asok(0x55d43c6b50f0) register_command sync trace active_short hook 0x7fc9600664b0 2024-09-22T08:34:52.442 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-22T08:34:52.351+0000 7fc970d28800 20 init_complete bucket index max shards: 11 2024-09-22T08:34:52.442 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-22T08:34:52.351+0000 7fc970d28800 20 Filter name: none 2024-09-22T08:34:52.442 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-22T08:34:52.351+0000 7fc7937fe640 20 reqs_thread_entry: start 2024-09-22T08:34:52.442 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-22T08:34:52.351+0000 7fc970d28800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-22T08:34:52.443 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-22T08:34:52.351+0000 7fc970d28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.443 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-22T08:34:52.352+0000 7fc970d28800 20 rados_obj.operate() r=0 bl.length=189 2024-09-22T08:34:52.443 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-22T08:34:52.352+0000 7fc970d28800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-22T08:34:52.443 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-22T08:34:52.352+0000 7fc970d28800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-22T08:34:52.443 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-22T08:34:52.352+0000 7fc970d28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 : miss 2024-09-22T08:34:52.443 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-22T08:34:52.352+0000 7fc970d28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.443 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-22T08:34:52.353+0000 7fc970d28800 20 rados_obj.operate() r=0 bl.length=411 2024-09-22T08:34:52.443 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-22T08:34:52.353+0000 7fc970d28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 info.flags=0x17 2024-09-22T08:34:52.443 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-22T08:34:52.353+0000 7fc970d28800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 to cache LRU end 2024-09-22T08:34:52.443 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-22T08:34:52.353+0000 7fc970d28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:34:52.443 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-22T08:34:52.353+0000 7fc970d28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:52.443 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-22T08:34:52.353+0000 7fc970d28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 2024-09-22T08:34:52.443 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-22T08:34:52.358+0000 7fc970d28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 info.flags=0x17 2024-09-22T08:34:52.443 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-22T08:34:52.358+0000 7fc970d28800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 to cache LRU end 2024-09-22T08:34:52.444 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-22T08:34:52.358+0000 7fc970d28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:52.444 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-22T08:34:52.358+0000 7fc970d28800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29, ofs0, ns] 2024-09-22T08:34:52.444 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-22T08:34:52.359+0000 7fc843fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497010 cookie 94370038382400 notifier 6996 bl.length()=915 2024-09-22T08:34:52.444 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-22T08:34:52.359+0000 7fc843fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 info.flags=0x17 2024-09-22T08:34:52.444 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-22T08:34:52.359+0000 7fc843fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 to cache LRU end 2024-09-22T08:34:52.444 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-22T08:34:52.359+0000 7fc843fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:52.444 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-22T08:34:52.359+0000 7fc970d28800 20 handle_bi_update(): bucket=:abort-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.29]): orig_sources= new_sources= 2024-09-22T08:34:52.444 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-22T08:34:52.359+0000 7fc970d28800 20 handle_bi_update(): bucket=:abort-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.29]): potential sources added=[] removed=[] 2024-09-22T08:34:52.444 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-22T08:34:52.359+0000 7fc970d28800 20 handle_bi_update(): bucket=:abort-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.29]): orig_dests= new_dests= 2024-09-22T08:34:52.444 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-22T08:34:52.359+0000 7fc970d28800 20 handle_bi_update(): bucket=:abort-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.29]): potential dests added=[] removed=[] 2024-09-22T08:34:52.444 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-22T08:34:52.364+0000 7fc970d28800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.0 2024-09-22T08:34:52.444 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-22T08:34:52.364+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.0 2024-09-22T08:34:52.444 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-22T08:34:52.364+0000 7fc970d28800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.1 2024-09-22T08:34:52.445 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-22T08:34:52.364+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.1 2024-09-22T08:34:52.445 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-22T08:34:52.364+0000 7fc970d28800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.2 2024-09-22T08:34:52.445 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-22T08:34:52.364+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.2 2024-09-22T08:34:52.445 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-22T08:34:52.364+0000 7fc970d28800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.3 2024-09-22T08:34:52.445 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-22T08:34:52.364+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.3 2024-09-22T08:34:52.445 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-22T08:34:52.364+0000 7fc970d28800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.4 2024-09-22T08:34:52.445 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-22T08:34:52.364+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.4 2024-09-22T08:34:52.445 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-22T08:34:52.364+0000 7fc970d28800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.5 2024-09-22T08:34:52.445 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-22T08:34:52.364+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.5 2024-09-22T08:34:52.445 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-22T08:34:52.364+0000 7fc970d28800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.6 2024-09-22T08:34:52.445 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-22T08:34:52.364+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.6 2024-09-22T08:34:52.445 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-22T08:34:52.364+0000 7fc970d28800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.7 2024-09-22T08:34:52.445 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-22T08:34:52.364+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.7 2024-09-22T08:34:52.445 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-22T08:34:52.364+0000 7fc970d28800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.8 2024-09-22T08:34:52.445 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-22T08:34:52.364+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.8 2024-09-22T08:34:52.446 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-22T08:34:52.364+0000 7fc970d28800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.9 2024-09-22T08:34:52.446 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-22T08:34:52.364+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.9 2024-09-22T08:34:52.446 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-22T08:34:52.364+0000 7fc970d28800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.10 2024-09-22T08:34:52.446 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-22T08:34:52.364+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.10 2024-09-22T08:34:52.446 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-22T08:34:52.364+0000 7fc970d28800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.11 2024-09-22T08:34:52.446 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-22T08:34:52.364+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.11 2024-09-22T08:34:52.446 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-22T08:34:52.364+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.0 2024-09-22T08:34:52.446 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-22T08:34:52.365+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1 2024-09-22T08:34:52.446 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-22T08:34:52.365+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.2 2024-09-22T08:34:52.446 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-22T08:34:52.366+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.3 2024-09-22T08:34:52.446 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-22T08:34:52.367+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.4 2024-09-22T08:34:52.446 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-22T08:34:52.367+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.5 2024-09-22T08:34:52.446 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-22T08:34:52.368+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.6 2024-09-22T08:34:52.446 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-22T08:34:52.368+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.7 2024-09-22T08:34:52.447 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-22T08:34:52.369+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.8 2024-09-22T08:34:52.447 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-22T08:34:52.369+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.9 2024-09-22T08:34:52.447 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-22T08:34:52.370+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.10 2024-09-22T08:34:52.447 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-22T08:34:52.373+0000 7fc970d28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 : hit (requested=0x17, cached=0x17) 2024-09-22T08:34:52.447 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-22T08:34:52.373+0000 7fc970d28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 2024-09-22T08:34:52.447 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-22T08:34:52.374+0000 7fc970d28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 info.flags=0x17 2024-09-22T08:34:52.447 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-22T08:34:52.374+0000 7fc970d28800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 to cache LRU end 2024-09-22T08:34:52.447 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-22T08:34:52.374+0000 7fc970d28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:52.447 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-22T08:34:52.374+0000 7fc970d28800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29, ofs0, ns] 2024-09-22T08:34:52.447 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-22T08:34:52.375+0000 7fc8437fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497011 cookie 94370038382400 notifier 6996 bl.length()=915 2024-09-22T08:34:52.447 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-22T08:34:52.375+0000 7fc8437fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 info.flags=0x17 2024-09-22T08:34:52.447 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-22T08:34:52.375+0000 7fc8437fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 to cache LRU end 2024-09-22T08:34:52.447 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-22T08:34:52.375+0000 7fc8437fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:52.448 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-22T08:34:52.375+0000 7fc970d28800 20 handle_bi_update(): bucket=:abort-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.29]): orig_sources= new_sources= 2024-09-22T08:34:52.448 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-22T08:34:52.375+0000 7fc970d28800 20 handle_bi_update(): bucket=:abort-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.29]): potential sources added=[] removed=[] 2024-09-22T08:34:52.448 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-22T08:34:52.375+0000 7fc970d28800 20 handle_bi_update(): bucket=:abort-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.29]): orig_dests= new_dests= 2024-09-22T08:34:52.448 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-22T08:34:52.375+0000 7fc970d28800 20 handle_bi_update(): bucket=:abort-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.29]): potential dests added=[] removed=[] 2024-09-22T08:34:52.448 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-22T08:34:52.376+0000 7fc970d28800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc970d28800 time 2024-09-22T08:34:52.377440+0000 2024-09-22T08:34:52.448 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:34:52.448 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:52.448 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:34:52.448 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc97258c748] 2024-09-22T08:34:52.448 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fc97258c906] 2024-09-22T08:34:52.448 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d43a6a6e01] 2024-09-22T08:34:52.448 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55d43a6b5f02] 2024-09-22T08:34:52.448 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55d43a6b6d64] 2024-09-22T08:34:52.448 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-22T08:34:52.448 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc971229590] 2024-09-22T08:34:52.449 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-22T08:34:52.449 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-22T08:34:52.449 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:52.449 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-22T08:34:52.377+0000 7fc970d28800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:34:52.449 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7fc970d28800 thread_name:radosgw-admin 2024-09-22T08:34:52.449 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:52.449 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:34:52.449 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc97123e6f0] 2024-09-22T08:34:52.449 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc97128b99c] 2024-09-22T08:34:52.449 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:34:52.449 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:34:52.449 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc97258c7a2] 2024-09-22T08:34:52.449 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fc97258c906] 2024-09-22T08:34:52.450 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d43a6a6e01] 2024-09-22T08:34:52.450 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55d43a6b5f02] 2024-09-22T08:34:52.450 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55d43a6b6d64] 2024-09-22T08:34:52.450 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-22T08:34:52.450 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc971229590] 2024-09-22T08:34:52.450 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-22T08:34:52.450 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-22T08:34:52.450 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:34:52.450 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:52.450 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-22T08:34:52.450 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-22T08:34:52.450 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-22T08:34:52.450 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-22T08:34:52.450 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-22T08:34:52.450 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-22T08:34:52.451 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-22T08:34:52.451 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-22T08:34:52.451 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-22T08:34:52.451 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-22T08:34:52.451 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-22T08:34:52.451 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-22T08:34:52.451 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-22T08:34:52.451 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-22T08:34:52.451 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-22T08:34:52.451 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-22T08:34:52.451 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-22T08:34:52.451 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-22T08:34:52.451 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-22T08:34:52.452 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-22T08:34:52.452 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-22T08:34:52.452 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-22T08:34:52.452 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-22T08:34:52.452 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-22T08:34:52.452 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:34:52.452 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-22T08:34:52.452 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-22T08:34:52.452 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-22T08:34:52.452 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-22T08:34:52.452 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-22T08:34:52.452 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-22T08:34:52.452 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-22T08:34:52.452 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-22T08:34:52.453 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-22T08:34:52.453 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-22T08:34:52.453 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-22T08:34:52.453 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-22T08:34:52.453 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-22T08:34:52.453 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-22T08:34:52.453 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-22T08:34:52.453 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-22T08:34:52.453 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-22T08:34:52.453 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-22T08:34:52.453 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-22T08:34:52.453 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-22T08:34:52.453 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-22T08:34:52.453 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:34:52.453 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-22T08:34:52.454 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:34:52.454 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-22T08:34:52.454 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-22T08:34:52.454 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-22T08:34:52.454 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-22T08:34:52.454 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-22T08:34:52.454 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-22T08:34:52.454 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-22T08:34:52.454 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-22T08:34:52.454 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-22T08:34:52.454 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-22T08:34:52.454 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-22T08:34:52.454 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-22T08:34:52.454 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-22T08:34:52.455 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-22T08:34:52.455 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-22T08:34:52.455 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-22T08:34:52.455 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-22T08:34:52.455 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-22T08:34:52.455 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:34:52.455 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-22T08:34:52.455 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:34:52.455 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-22T08:34:52.455 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-22T08:34:52.455 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-22T08:34:52.455 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-22T08:34:52.455 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-22T08:34:52.455 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-22T08:34:52.455 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:34:52.456 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-22T08:34:52.456 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-22T08:34:52.456 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:34:52.456 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-22T08:34:52.456 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-22T08:34:52.456 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-22T08:34:52.456 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-22T08:34:52.456 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-22T08:34:52.456 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-22T08:34:52.456 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-22T08:34:52.456 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-22T08:34:52.456 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-22T08:34:52.456 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-22T08:34:52.456 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-22T08:34:52.456 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-22T08:34:52.457 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-22T08:34:52.457 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:34:52.457 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc7937fe640 / http_manager 2024-09-22T08:34:52.457 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc821fe3640 / http_manager 2024-09-22T08:34:52.457 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc822fe5640 / rgw_dt_lg_renew 2024-09-22T08:34:52.457 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc8427fc640 / ms_dispatch 2024-09-22T08:34:52.457 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc8437fe640 / io_context_pool 2024-09-22T08:34:52.457 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc843fff640 / io_context_pool 2024-09-22T08:34:52.457 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc8527fc640 / ms_dispatch 2024-09-22T08:34:52.457 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc85960a640 / ms_dispatch 2024-09-22T08:34:52.457 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc85ae0d640 / io_context_pool 2024-09-22T08:34:52.457 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc96c26e640 / msgr-worker-2 2024-09-22T08:34:52.457 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc96ca6f640 / msgr-worker-1 2024-09-22T08:34:52.457 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc96d270640 / msgr-worker-0 2024-09-22T08:34:52.458 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc96da71640 / io_context_pool 2024-09-22T08:34:52.458 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc970d28800 / radosgw-admin 2024-09-22T08:34:52.458 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-22T08:34:52.458 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-22T08:34:52.458 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/log/ceph/ceph-client.admin.112178.log 2024-09-22T08:34:52.458 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-22T08:34:52.458 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-22T08:34:52.458 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-22T08:34:51.900+0000 7fc970d28800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:52.458 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-22T08:34:51.900+0000 7fc970d28800 10 monclient(hunting): _renew_subs 2024-09-22T08:34:52.458 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-22T08:34:51.900+0000 7fc970d28800 10 monclient(hunting): authenticate will time out at 1997.140250s 2024-09-22T08:34:52.458 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-22T08:34:51.900+0000 7fc96c26e640 10 monclient(hunting): get_auth_request con 0x55d43c784260 auth_method 0 2024-09-22T08:34:52.458 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-22T08:34:51.900+0000 7fc96c26e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:52.458 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-22T08:34:51.900+0000 7fc96c26e640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:52.458 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-22T08:34:51.900+0000 7fc96c26e640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:52.458 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-22T08:34:51.900+0000 7fc96d270640 10 monclient(hunting): get_auth_request con 0x55d43c8160b0 auth_method 0 2024-09-22T08:34:52.459 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-22T08:34:51.900+0000 7fc96d270640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:52.459 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-22T08:34:51.900+0000 7fc96d270640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:52.459 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-22T08:34:51.900+0000 7fc96d270640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:52.459 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-22T08:34:51.900+0000 7fc96c26e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:52.459 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-22T08:34:51.900+0000 7fc96c26e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:52.459 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-22T08:34:51.900+0000 7fc96c26e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:52.459 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-22T08:34:51.900+0000 7fc96d270640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:52.459 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-22T08:34:51.900+0000 7fc96d270640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:52.459 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-22T08:34:51.900+0000 7fc96d270640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:52.459 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-22T08:34:51.900+0000 7fc96ca6f640 10 monclient(hunting): get_auth_request con 0x55d43c7604a0 auth_method 0 2024-09-22T08:34:52.459 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-22T08:34:51.900+0000 7fc96ca6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:52.459 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-22T08:34:51.900+0000 7fc96ca6f640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:52.459 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-22T08:34:51.900+0000 7fc96ca6f640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:52.459 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-22T08:34:51.900+0000 7fc96c26e640 10 monclient(hunting): handle_auth_done global_id 6987 payload 824 2024-09-22T08:34:52.460 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-22T08:34:51.900+0000 7fc96c26e640 10 monclient: _finish_hunting 0 2024-09-22T08:34:52.460 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-22T08:34:51.900+0000 7fc96c26e640 1 monclient: found mon.noname-a 2024-09-22T08:34:52.460 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-22T08:34:51.900+0000 7fc96c26e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:34:52.460 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-22T08:34:51.900+0000 7fc85960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:34:52.460 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-22T08:34:51.900+0000 7fc85960a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:34:52.460 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-22T08:34:51.900+0000 7fc85960a640 10 monclient: dump: 2024-09-22T08:34:52.460 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:34:52.460 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:34:52.460 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:52.460 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:52.460 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:34:52.460 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:52.460 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:34:52.460 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:34:52.461 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:34:52.461 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:52.461 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-22T08:34:51.900+0000 7fc85960a640 10 monclient: _finish_auth 0 2024-09-22T08:34:52.461 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-22T08:34:51.900+0000 7fc85960a640 10 monclient: _check_auth_tickets 2024-09-22T08:34:52.461 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-22T08:34:51.900+0000 7fc85960a640 10 monclient: handle_config config(0 keys) 2024-09-22T08:34:52.461 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-22T08:34:51.900+0000 7fc85960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:34:52.461 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-22T08:34:51.900+0000 7fc85960a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:34:52.461 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-22T08:34:51.900+0000 7fc85960a640 10 monclient: dump: 2024-09-22T08:34:52.461 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:34:52.461 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:34:52.461 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:52.461 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:52.461 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:34:52.462 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:52.462 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:34:52.462 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:34:52.462 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:34:52.462 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:52.462 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-22T08:34:51.900+0000 7fc970d28800 5 monclient: authenticate success, global_id 6987 2024-09-22T08:34:52.462 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-22T08:34:51.900+0000 7fc970d28800 10 monclient: _renew_subs 2024-09-22T08:34:52.462 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-22T08:34:51.900+0000 7fc970d28800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:34:52.462 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-22T08:34:51.900+0000 7fc85ae0d640 4 set_mon_vals no callback set 2024-09-22T08:34:52.462 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-22T08:34:51.901+0000 7fc970d28800 10 monclient: _renew_subs 2024-09-22T08:34:52.462 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-22T08:34:51.901+0000 7fc970d28800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:34:52.462 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-22T08:34:51.901+0000 7fc970d28800 1 librados: init done 2024-09-22T08:34:52.462 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-22T08:34:51.903+0000 7fc85960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:34:52.463 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-22T08:34:51.903+0000 7fc85960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:34:52.463 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-22T08:34:51.903+0000 7fc85960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:34:52.463 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-22T08:34:51.903+0000 7fc96ca6f640 10 monclient: get_auth_request con 0x7fc854077570 auth_method 0 2024-09-22T08:34:52.463 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-22T08:34:51.903+0000 7fc96d270640 10 monclient: get_auth_request con 0x55d43c8ff490 auth_method 0 2024-09-22T08:34:52.463 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-22T08:34:51.904+0000 7fc96ca6f640 10 monclient: get_auth_request con 0x55d43c922240 auth_method 0 2024-09-22T08:34:52.463 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-22T08:34:51.905+0000 7fc96c26e640 10 monclient: get_auth_request con 0x55d43c9265a0 auth_method 0 2024-09-22T08:34:52.463 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-22T08:34:51.906+0000 7fc96d270640 10 monclient: get_auth_request con 0x55d43c925b10 auth_method 0 2024-09-22T08:34:52.463 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-22T08:34:51.907+0000 7fc970d28800 10 monclient: build_initial_monmap 2024-09-22T08:34:52.463 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-22T08:34:51.907+0000 7fc970d28800 1 build_initial for_mkfs: 0 2024-09-22T08:34:52.463 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-22T08:34:51.907+0000 7fc970d28800 10 monclient: monmap: 2024-09-22T08:34:52.463 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:34:52.463 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:34:52.463 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:34:52.463 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:34:52.464 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:34:52.464 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:52.464 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:34:52.464 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:34:52.464 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:34:52.464 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:52.464 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92e640) adding auth protocol: cephx 2024-09-22T08:34:52.464 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92e640) adding auth protocol: cephx 2024-09-22T08:34:52.464 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92e640) adding auth protocol: cephx 2024-09-22T08:34:52.464 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92e640) adding con mode: secure 2024-09-22T08:34:52.464 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92e640) adding con mode: crc 2024-09-22T08:34:52.464 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92e640) adding con mode: secure 2024-09-22T08:34:52.464 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92e640) adding con mode: crc 2024-09-22T08:34:52.464 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92e640) adding con mode: secure 2024-09-22T08:34:52.464 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92e640) adding con mode: crc 2024-09-22T08:34:52.465 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92e640) adding con mode: crc 2024-09-22T08:34:52.465 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92e640) adding con mode: secure 2024-09-22T08:34:52.465 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92e640) adding con mode: crc 2024-09-22T08:34:52.465 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92e640) adding con mode: secure 2024-09-22T08:34:52.465 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92e640) adding con mode: crc 2024-09-22T08:34:52.465 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92e640) adding con mode: secure 2024-09-22T08:34:52.465 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-22T08:34:51.907+0000 7fc970d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:52.465 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 asok(0x55d43c6b50f0) register_command objecter_requests cmddesc objecter_requests hook 0x55d43c931ad0 EEXIST 2024-09-22T08:34:52.465 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-22T08:34:51.907+0000 7fc970d28800 10 monclient: init 2024-09-22T08:34:52.465 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92d588) adding auth protocol: cephx 2024-09-22T08:34:52.465 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92d588) adding auth protocol: cephx 2024-09-22T08:34:52.465 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92d588) adding auth protocol: cephx 2024-09-22T08:34:52.465 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92d588) adding con mode: secure 2024-09-22T08:34:52.466 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92d588) adding con mode: crc 2024-09-22T08:34:52.466 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92d588) adding con mode: secure 2024-09-22T08:34:52.466 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92d588) adding con mode: crc 2024-09-22T08:34:52.466 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92d588) adding con mode: secure 2024-09-22T08:34:52.466 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92d588) adding con mode: crc 2024-09-22T08:34:52.466 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92d588) adding con mode: crc 2024-09-22T08:34:52.466 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92d588) adding con mode: secure 2024-09-22T08:34:52.466 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92d588) adding con mode: crc 2024-09-22T08:34:52.466 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92d588) adding con mode: secure 2024-09-22T08:34:52.466 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92d588) adding con mode: crc 2024-09-22T08:34:52.466 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-22T08:34:51.907+0000 7fc970d28800 5 AuthRegistry(0x55d43c92d588) adding con mode: secure 2024-09-22T08:34:52.466 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-22T08:34:51.907+0000 7fc970d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:52.466 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-22T08:34:51.908+0000 7fc970d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:52.466 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-22T08:34:51.908+0000 7fc970d28800 5 asok(0x55d43c6b50f0) register_command rotate-key cmddesc rotate-key hook 0x55d43c92d6d0 EEXIST 2024-09-22T08:34:52.467 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-22T08:34:51.908+0000 7fc970d28800 10 monclient: _reopen_session rank -1 2024-09-22T08:34:52.467 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-22T08:34:51.908+0000 7fc970d28800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T08:34:52.467 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-22T08:34:51.908+0000 7fc970d28800 10 monclient(hunting): picked mon.noname-c con 0x55d43c955df0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:34:52.467 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-22T08:34:51.908+0000 7fc970d28800 10 monclient(hunting): picked mon.noname-a con 0x55d43c9561d0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:34:52.467 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-22T08:34:51.908+0000 7fc970d28800 10 monclient(hunting): picked mon.noname-b con 0x55d43c954b00 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:34:52.467 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-22T08:34:51.908+0000 7fc970d28800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:52.467 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-22T08:34:51.908+0000 7fc970d28800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:52.467 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-22T08:34:51.908+0000 7fc970d28800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:52.467 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-22T08:34:51.908+0000 7fc970d28800 10 monclient(hunting): _renew_subs 2024-09-22T08:34:52.467 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-22T08:34:51.908+0000 7fc970d28800 10 monclient(hunting): authenticate will time out at 1997.148221s 2024-09-22T08:34:52.467 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-22T08:34:51.908+0000 7fc96d270640 10 monclient(hunting): get_auth_request con 0x55d43c9561d0 auth_method 0 2024-09-22T08:34:52.467 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-22T08:34:51.908+0000 7fc96d270640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:52.467 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-22T08:34:51.908+0000 7fc96d270640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:52.467 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-22T08:34:51.908+0000 7fc96d270640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:52.468 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-22T08:34:51.908+0000 7fc96c26e640 10 monclient(hunting): get_auth_request con 0x55d43c955df0 auth_method 0 2024-09-22T08:34:52.468 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-22T08:34:51.908+0000 7fc96c26e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:52.468 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-22T08:34:51.908+0000 7fc96c26e640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:52.468 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-22T08:34:51.908+0000 7fc96c26e640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:52.468 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-22T08:34:51.908+0000 7fc96d270640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:52.468 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-22T08:34:51.908+0000 7fc96d270640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:52.468 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-22T08:34:51.908+0000 7fc96d270640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:52.468 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-22T08:34:51.908+0000 7fc96c26e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:52.468 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-22T08:34:51.908+0000 7fc96c26e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:52.468 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-22T08:34:51.908+0000 7fc96c26e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:52.468 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-22T08:34:51.908+0000 7fc96ca6f640 10 monclient(hunting): get_auth_request con 0x55d43c954b00 auth_method 0 2024-09-22T08:34:52.468 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-22T08:34:51.908+0000 7fc96ca6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:52.468 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-22T08:34:51.908+0000 7fc96ca6f640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:52.469 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-22T08:34:51.908+0000 7fc96ca6f640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:52.469 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-22T08:34:51.908+0000 7fc96ca6f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:52.469 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-22T08:34:51.908+0000 7fc96ca6f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:52.469 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-22T08:34:51.908+0000 7fc96ca6f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:52.469 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-22T08:34:51.908+0000 7fc96d270640 10 monclient(hunting): handle_auth_done global_id 6990 payload 824 2024-09-22T08:34:52.469 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-22T08:34:51.908+0000 7fc96d270640 10 monclient: _finish_hunting 0 2024-09-22T08:34:52.469 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-22T08:34:51.908+0000 7fc96d270640 1 monclient: found mon.noname-a 2024-09-22T08:34:52.469 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-22T08:34:51.908+0000 7fc96d270640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:34:52.469 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-22T08:34:51.908+0000 7fc8527fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:34:52.469 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-22T08:34:51.908+0000 7fc8527fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:34:52.469 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-22T08:34:51.908+0000 7fc8527fc640 10 monclient: dump: 2024-09-22T08:34:52.469 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:34:52.469 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:34:52.469 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:52.470 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:52.470 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:34:52.470 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:52.470 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:34:52.470 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:34:52.470 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:34:52.470 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:52.470 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-22T08:34:51.908+0000 7fc8527fc640 10 monclient: _finish_auth 0 2024-09-22T08:34:52.470 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-22T08:34:51.908+0000 7fc8527fc640 10 monclient: _check_auth_tickets 2024-09-22T08:34:52.470 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-22T08:34:51.908+0000 7fc8527fc640 10 monclient: handle_config config(0 keys) 2024-09-22T08:34:52.470 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-22T08:34:51.908+0000 7fc8527fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:34:52.470 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-22T08:34:51.908+0000 7fc8527fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:34:52.470 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-22T08:34:51.908+0000 7fc8527fc640 10 monclient: dump: 2024-09-22T08:34:52.470 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:34:52.471 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:34:52.471 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:52.471 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:52.471 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:34:52.471 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:52.471 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:34:52.471 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:34:52.471 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:34:52.471 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:52.471 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-22T08:34:51.908+0000 7fc970d28800 5 monclient: authenticate success, global_id 6990 2024-09-22T08:34:52.471 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-22T08:34:51.908+0000 7fc970d28800 10 monclient: _renew_subs 2024-09-22T08:34:52.471 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-22T08:34:51.908+0000 7fc970d28800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:34:52.471 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-22T08:34:51.908+0000 7fc96da71640 4 set_mon_vals no callback set 2024-09-22T08:34:52.471 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-22T08:34:51.909+0000 7fc970d28800 10 monclient: _renew_subs 2024-09-22T08:34:52.472 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-22T08:34:51.909+0000 7fc970d28800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:34:52.472 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-22T08:34:51.910+0000 7fc8527fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:34:52.472 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-22T08:34:51.910+0000 7fc8527fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:34:52.472 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-22T08:34:51.910+0000 7fc8527fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:34:52.472 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-22T08:34:51.911+0000 7fc96c26e640 10 monclient: get_auth_request con 0x7fc844077480 auth_method 0 2024-09-22T08:34:52.472 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-22T08:34:51.911+0000 7fc970d28800 10 monclient: get_monmap_and_config 2024-09-22T08:34:52.472 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-22T08:34:51.911+0000 7fc970d28800 10 monclient: build_initial_monmap 2024-09-22T08:34:52.472 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-22T08:34:51.911+0000 7fc970d28800 1 build_initial for_mkfs: 0 2024-09-22T08:34:52.472 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-22T08:34:51.911+0000 7fc970d28800 10 monclient: monmap: 2024-09-22T08:34:52.472 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:34:52.472 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:34:52.472 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:34:52.472 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:34:52.472 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:34:52.473 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:52.473 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:34:52.473 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:34:52.473 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:34:52.473 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:52.473 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x55d43c975d20) adding auth protocol: cephx 2024-09-22T08:34:52.473 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x55d43c975d20) adding auth protocol: cephx 2024-09-22T08:34:52.473 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x55d43c975d20) adding auth protocol: cephx 2024-09-22T08:34:52.473 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x55d43c975d20) adding con mode: secure 2024-09-22T08:34:52.473 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x55d43c975d20) adding con mode: crc 2024-09-22T08:34:52.473 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x55d43c975d20) adding con mode: secure 2024-09-22T08:34:52.473 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x55d43c975d20) adding con mode: crc 2024-09-22T08:34:52.473 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x55d43c975d20) adding con mode: secure 2024-09-22T08:34:52.473 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x55d43c975d20) adding con mode: crc 2024-09-22T08:34:52.473 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x55d43c975d20) adding con mode: crc 2024-09-22T08:34:52.474 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x55d43c975d20) adding con mode: secure 2024-09-22T08:34:52.474 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x55d43c975d20) adding con mode: crc 2024-09-22T08:34:52.474 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x55d43c975d20) adding con mode: secure 2024-09-22T08:34:52.474 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x55d43c975d20) adding con mode: crc 2024-09-22T08:34:52.474 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x55d43c975d20) adding con mode: secure 2024-09-22T08:34:52.474 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-22T08:34:51.911+0000 7fc970d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:52.474 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-22T08:34:51.911+0000 7fc970d28800 10 monclient: init 2024-09-22T08:34:52.474 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678390) adding auth protocol: cephx 2024-09-22T08:34:52.474 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678390) adding auth protocol: cephx 2024-09-22T08:34:52.474 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678390) adding auth protocol: cephx 2024-09-22T08:34:52.474 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678390) adding con mode: secure 2024-09-22T08:34:52.474 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678390) adding con mode: crc 2024-09-22T08:34:52.474 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678390) adding con mode: secure 2024-09-22T08:34:52.474 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678390) adding con mode: crc 2024-09-22T08:34:52.475 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678390) adding con mode: secure 2024-09-22T08:34:52.475 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678390) adding con mode: crc 2024-09-22T08:34:52.475 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678390) adding con mode: crc 2024-09-22T08:34:52.475 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678390) adding con mode: secure 2024-09-22T08:34:52.475 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678390) adding con mode: crc 2024-09-22T08:34:52.475 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678390) adding con mode: secure 2024-09-22T08:34:52.475 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678390) adding con mode: crc 2024-09-22T08:34:52.475 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-22T08:34:51.911+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678390) adding con mode: secure 2024-09-22T08:34:52.475 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-22T08:34:51.911+0000 7fc970d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:52.475 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-22T08:34:51.912+0000 7fc970d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:52.475 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-22T08:34:51.912+0000 7fc970d28800 5 asok(0x55d43c6b50f0) register_command rotate-key cmddesc rotate-key hook 0x7fffcf6784d8 EEXIST 2024-09-22T08:34:52.475 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-22T08:34:51.912+0000 7fc970d28800 10 monclient: _reopen_session rank -1 2024-09-22T08:34:52.475 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-22T08:34:51.912+0000 7fc970d28800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-22T08:34:52.476 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-22T08:34:51.912+0000 7fc970d28800 10 monclient(hunting): picked mon.noname-c con 0x55d43c9aa340 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:34:52.476 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-22T08:34:51.912+0000 7fc970d28800 10 monclient(hunting): picked mon.noname-b con 0x55d43c9a45a0 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:34:52.476 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-22T08:34:51.912+0000 7fc970d28800 10 monclient(hunting): picked mon.noname-a con 0x55d43c9a5cf0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:34:52.476 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-22T08:34:51.912+0000 7fc970d28800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:52.476 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-22T08:34:51.912+0000 7fc970d28800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:52.476 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-22T08:34:51.912+0000 7fc970d28800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:52.476 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-22T08:34:51.912+0000 7fc970d28800 10 monclient(hunting): _renew_subs 2024-09-22T08:34:52.476 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-22T08:34:51.912+0000 7fc970d28800 10 monclient(hunting): authenticate will time out at 1997.152220s 2024-09-22T08:34:52.476 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-22T08:34:51.912+0000 7fc96c26e640 10 monclient(hunting): get_auth_request con 0x55d43c9aa340 auth_method 0 2024-09-22T08:34:52.476 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-22T08:34:51.912+0000 7fc96c26e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:52.476 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-22T08:34:51.912+0000 7fc96c26e640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:52.476 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-22T08:34:51.912+0000 7fc96c26e640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:52.476 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-22T08:34:51.912+0000 7fc96ca6f640 10 monclient(hunting): get_auth_request con 0x55d43c9a5cf0 auth_method 0 2024-09-22T08:34:52.476 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-22T08:34:51.912+0000 7fc96ca6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:52.477 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-22T08:34:51.912+0000 7fc96ca6f640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:52.477 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-22T08:34:51.912+0000 7fc96ca6f640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:52.477 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-22T08:34:51.912+0000 7fc96c26e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:52.477 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-22T08:34:51.912+0000 7fc96c26e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:52.477 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-22T08:34:51.912+0000 7fc96c26e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:52.477 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-22T08:34:51.912+0000 7fc96d270640 10 monclient(hunting): get_auth_request con 0x55d43c9a45a0 auth_method 0 2024-09-22T08:34:52.477 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-22T08:34:51.912+0000 7fc96d270640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:52.477 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-22T08:34:51.912+0000 7fc96d270640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:52.477 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-22T08:34:51.912+0000 7fc96d270640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:52.477 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-22T08:34:51.912+0000 7fc96ca6f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:52.477 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-22T08:34:51.912+0000 7fc96ca6f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:52.477 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-22T08:34:51.912+0000 7fc96ca6f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:52.477 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-22T08:34:51.912+0000 7fc96d270640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:52.477 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-22T08:34:51.912+0000 7fc96d270640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:52.477 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-22T08:34:51.912+0000 7fc96d270640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:52.478 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-22T08:34:51.912+0000 7fc96c26e640 10 monclient(hunting): handle_auth_done global_id 6605 payload 274 2024-09-22T08:34:52.478 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-22T08:34:51.912+0000 7fc96c26e640 10 monclient: _finish_hunting 0 2024-09-22T08:34:52.478 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-22T08:34:51.912+0000 7fc96c26e640 1 monclient: found mon.noname-c 2024-09-22T08:34:52.478 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-22T08:34:51.912+0000 7fc96c26e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:34:52.478 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-22T08:34:51.912+0000 7fc843fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:34:52.478 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-22T08:34:51.912+0000 7fc843fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:34:52.478 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-22T08:34:51.912+0000 7fc843fff640 10 monclient: dump: 2024-09-22T08:34:52.478 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:34:52.478 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:34:52.478 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:52.478 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:52.478 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:34:52.478 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:52.479 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:34:52.479 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:34:52.479 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:34:52.479 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:52.479 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-22T08:34:51.912+0000 7fc843fff640 10 monclient: _finish_auth 0 2024-09-22T08:34:52.479 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-22T08:34:51.912+0000 7fc843fff640 10 monclient: _check_auth_tickets 2024-09-22T08:34:52.479 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-22T08:34:51.912+0000 7fc843fff640 10 monclient: handle_config config(0 keys) 2024-09-22T08:34:52.479 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-22T08:34:51.912+0000 7fc843fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:34:52.479 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-22T08:34:51.912+0000 7fc843fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:34:52.479 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-22T08:34:51.912+0000 7fc843fff640 10 monclient: dump: 2024-09-22T08:34:52.479 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:34:52.479 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:34:52.479 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:52.479 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:52.480 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:34:52.480 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:52.480 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:34:52.480 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:34:52.480 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:34:52.480 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:52.480 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-22T08:34:51.912+0000 7fc970d28800 5 monclient: authenticate success, global_id 6605 2024-09-22T08:34:52.480 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-22T08:34:51.912+0000 7fc970d28800 10 monclient: get_monmap_and_config success 2024-09-22T08:34:52.480 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-22T08:34:51.912+0000 7fc970d28800 4 set_mon_vals no callback set 2024-09-22T08:34:52.480 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-22T08:34:51.913+0000 7fc970d28800 10 monclient: shutdown 2024-09-22T08:34:52.480 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-22T08:34:51.913+0000 7fc970d28800 10 monclient: build_initial_monmap 2024-09-22T08:34:52.480 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-22T08:34:51.913+0000 7fc970d28800 1 build_initial for_mkfs: 0 2024-09-22T08:34:52.480 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-22T08:34:51.913+0000 7fc970d28800 10 monclient: monmap: 2024-09-22T08:34:52.480 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:34:52.481 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:34:52.481 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:34:52.481 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:34:52.481 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:34:52.481 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:52.481 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:34:52.481 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:34:52.481 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:34:52.481 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:52.481 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c97aef0) adding auth protocol: cephx 2024-09-22T08:34:52.481 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c97aef0) adding auth protocol: cephx 2024-09-22T08:34:52.481 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c97aef0) adding auth protocol: cephx 2024-09-22T08:34:52.481 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c97aef0) adding con mode: secure 2024-09-22T08:34:52.481 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c97aef0) adding con mode: crc 2024-09-22T08:34:52.482 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c97aef0) adding con mode: secure 2024-09-22T08:34:52.482 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c97aef0) adding con mode: crc 2024-09-22T08:34:52.482 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c97aef0) adding con mode: secure 2024-09-22T08:34:52.482 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c97aef0) adding con mode: crc 2024-09-22T08:34:52.482 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c97aef0) adding con mode: crc 2024-09-22T08:34:52.482 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c97aef0) adding con mode: secure 2024-09-22T08:34:52.482 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c97aef0) adding con mode: crc 2024-09-22T08:34:52.482 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c97aef0) adding con mode: secure 2024-09-22T08:34:52.482 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c97aef0) adding con mode: crc 2024-09-22T08:34:52.482 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c97aef0) adding con mode: secure 2024-09-22T08:34:52.482 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-22T08:34:51.913+0000 7fc970d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:52.482 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-22T08:34:51.913+0000 7fc970d28800 1 librados: starting msgr at 2024-09-22T08:34:52.482 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-22T08:34:51.913+0000 7fc970d28800 1 librados: starting objecter 2024-09-22T08:34:52.482 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 asok(0x55d43c6b50f0) register_command objecter_requests cmddesc objecter_requests hook 0x55d43c978570 EEXIST 2024-09-22T08:34:52.483 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-22T08:34:51.913+0000 7fc970d28800 1 librados: setting wanted keys 2024-09-22T08:34:52.483 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-22T08:34:51.913+0000 7fc970d28800 1 librados: calling monclient init 2024-09-22T08:34:52.483 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-22T08:34:51.913+0000 7fc970d28800 10 monclient: init 2024-09-22T08:34:52.483 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c96a6b0) adding auth protocol: cephx 2024-09-22T08:34:52.483 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c96a6b0) adding auth protocol: cephx 2024-09-22T08:34:52.483 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c96a6b0) adding auth protocol: cephx 2024-09-22T08:34:52.483 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c96a6b0) adding con mode: secure 2024-09-22T08:34:52.483 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c96a6b0) adding con mode: crc 2024-09-22T08:34:52.483 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c96a6b0) adding con mode: secure 2024-09-22T08:34:52.483 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c96a6b0) adding con mode: crc 2024-09-22T08:34:52.483 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c96a6b0) adding con mode: secure 2024-09-22T08:34:52.483 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c96a6b0) adding con mode: crc 2024-09-22T08:34:52.483 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c96a6b0) adding con mode: crc 2024-09-22T08:34:52.484 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c96a6b0) adding con mode: secure 2024-09-22T08:34:52.484 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c96a6b0) adding con mode: crc 2024-09-22T08:34:52.484 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c96a6b0) adding con mode: secure 2024-09-22T08:34:52.484 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c96a6b0) adding con mode: crc 2024-09-22T08:34:52.484 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-22T08:34:51.913+0000 7fc970d28800 5 AuthRegistry(0x55d43c96a6b0) adding con mode: secure 2024-09-22T08:34:52.484 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-22T08:34:51.914+0000 7fc970d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:52.484 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-22T08:34:51.914+0000 7fc970d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:52.484 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-22T08:34:51.914+0000 7fc970d28800 5 asok(0x55d43c6b50f0) register_command rotate-key cmddesc rotate-key hook 0x55d43c96a7f8 EEXIST 2024-09-22T08:34:52.484 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-22T08:34:51.914+0000 7fc970d28800 10 monclient: _reopen_session rank -1 2024-09-22T08:34:52.484 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-22T08:34:51.914+0000 7fc970d28800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T08:34:52.484 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-22T08:34:51.914+0000 7fc970d28800 10 monclient(hunting): picked mon.noname-a con 0x55d43c9a45a0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:34:52.484 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-22T08:34:51.914+0000 7fc970d28800 10 monclient(hunting): picked mon.noname-c con 0x55d43c9a5cf0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:34:52.484 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-22T08:34:51.914+0000 7fc970d28800 10 monclient(hunting): picked mon.noname-b con 0x55d43c9aa340 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:34:52.484 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-22T08:34:51.914+0000 7fc970d28800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:52.485 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-22T08:34:51.914+0000 7fc970d28800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:52.485 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-22T08:34:51.914+0000 7fc970d28800 10 monclient(hunting): start opening mon connection 2024-09-22T08:34:52.485 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-22T08:34:51.914+0000 7fc970d28800 10 monclient(hunting): _renew_subs 2024-09-22T08:34:52.485 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-22T08:34:51.914+0000 7fc970d28800 10 monclient(hunting): authenticate will time out at 1997.154494s 2024-09-22T08:34:52.485 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-22T08:34:51.914+0000 7fc96c26e640 10 monclient(hunting): get_auth_request con 0x55d43c9a45a0 auth_method 0 2024-09-22T08:34:52.485 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-22T08:34:51.914+0000 7fc96c26e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:52.485 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-22T08:34:51.914+0000 7fc96c26e640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:52.485 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-22T08:34:51.914+0000 7fc96c26e640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:52.485 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-22T08:34:51.914+0000 7fc96d270640 10 monclient(hunting): get_auth_request con 0x55d43c9a5cf0 auth_method 0 2024-09-22T08:34:52.485 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-22T08:34:51.914+0000 7fc96d270640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:52.485 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-22T08:34:51.914+0000 7fc96d270640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:52.485 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-22T08:34:51.914+0000 7fc96d270640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:52.485 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-22T08:34:51.914+0000 7fc96c26e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:52.485 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-22T08:34:51.914+0000 7fc96c26e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:52.486 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-22T08:34:51.914+0000 7fc96c26e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:52.486 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-22T08:34:51.914+0000 7fc96ca6f640 10 monclient(hunting): get_auth_request con 0x55d43c9aa340 auth_method 0 2024-09-22T08:34:52.486 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-22T08:34:51.914+0000 7fc96ca6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:34:52.486 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-22T08:34:51.914+0000 7fc96ca6f640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:34:52.486 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-22T08:34:51.914+0000 7fc96ca6f640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:34:52.486 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-22T08:34:51.914+0000 7fc96d270640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:52.486 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-22T08:34:51.914+0000 7fc96d270640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:52.486 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-22T08:34:51.914+0000 7fc96d270640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:52.486 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-22T08:34:51.914+0000 7fc96ca6f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:34:52.486 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-22T08:34:51.914+0000 7fc96ca6f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:34:52.486 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-22T08:34:51.914+0000 7fc96ca6f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:34:52.486 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-22T08:34:51.914+0000 7fc96c26e640 10 monclient(hunting): handle_auth_done global_id 6996 payload 824 2024-09-22T08:34:52.486 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-22T08:34:51.914+0000 7fc96c26e640 10 monclient: _finish_hunting 0 2024-09-22T08:34:52.486 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-22T08:34:51.914+0000 7fc96c26e640 1 monclient: found mon.noname-a 2024-09-22T08:34:52.487 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-22T08:34:51.914+0000 7fc96c26e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:34:52.487 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-22T08:34:51.915+0000 7fc8427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:34:52.487 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-22T08:34:51.915+0000 7fc8427fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:34:52.487 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-22T08:34:51.915+0000 7fc8427fc640 10 monclient: dump: 2024-09-22T08:34:52.487 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:34:52.487 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:34:52.487 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:52.487 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:52.487 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:34:52.487 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:52.487 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:34:52.487 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:34:52.487 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:34:52.487 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:52.488 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-22T08:34:51.915+0000 7fc8427fc640 10 monclient: _finish_auth 0 2024-09-22T08:34:52.488 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-22T08:34:51.915+0000 7fc8427fc640 10 monclient: _check_auth_tickets 2024-09-22T08:34:52.488 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-22T08:34:51.915+0000 7fc8427fc640 10 monclient: handle_config config(0 keys) 2024-09-22T08:34:52.488 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-22T08:34:51.915+0000 7fc8427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:34:52.488 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-22T08:34:51.915+0000 7fc8427fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:34:52.488 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-22T08:34:51.915+0000 7fc8427fc640 10 monclient: dump: 2024-09-22T08:34:52.488 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:34:52.488 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:34:52.488 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:52.488 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:34:52.488 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:34:52.488 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:34:52.488 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:34:52.489 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:34:52.489 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:34:52.489 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:52.489 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-22T08:34:51.915+0000 7fc970d28800 5 monclient: authenticate success, global_id 6996 2024-09-22T08:34:52.489 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-22T08:34:51.915+0000 7fc970d28800 10 monclient: _renew_subs 2024-09-22T08:34:52.489 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-22T08:34:51.915+0000 7fc970d28800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:34:52.489 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-22T08:34:51.915+0000 7fc843fff640 4 set_mon_vals no callback set 2024-09-22T08:34:52.489 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-22T08:34:51.915+0000 7fc970d28800 10 monclient: _renew_subs 2024-09-22T08:34:52.489 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-22T08:34:51.915+0000 7fc970d28800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:34:52.489 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-22T08:34:51.915+0000 7fc970d28800 1 librados: init done 2024-09-22T08:34:52.489 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-22T08:34:51.915+0000 7fc970d28800 5 asok(0x55d43c6b50f0) register_command cr dump hook 0x55d43c996d48 2024-09-22T08:34:52.489 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-22T08:34:51.916+0000 7fc970d28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.489 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-22T08:34:51.917+0000 7fc8427fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:34:52.489 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-22T08:34:51.917+0000 7fc8427fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:34:52.490 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-22T08:34:51.917+0000 7fc8427fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:34:52.490 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-22T08:34:51.917+0000 7fc96d270640 10 monclient: get_auth_request con 0x7fc838077570 auth_method 0 2024-09-22T08:34:52.490 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-22T08:34:51.918+0000 7fc96ca6f640 10 monclient: get_auth_request con 0x55d43c9c4160 auth_method 0 2024-09-22T08:34:52.490 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-22T08:34:51.918+0000 7fc970d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:52.490 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-22T08:34:51.918+0000 7fc970d28800 20 realm 2024-09-22T08:34:52.490 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-22T08:34:51.918+0000 7fc970d28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.490 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-22T08:34:51.918+0000 7fc970d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:52.490 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-22T08:34:51.918+0000 7fc970d28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:34:52.490 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-22T08:34:51.918+0000 7fc970d28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.490 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-22T08:34:51.919+0000 7fc970d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:52.490 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-22T08:34:51.919+0000 7fc970d28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.490 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-22T08:34:51.919+0000 7fc96c26e640 10 monclient: get_auth_request con 0x55d43c9c83e0 auth_method 0 2024-09-22T08:34:52.490 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-22T08:34:51.919+0000 7fc970d28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:52.490 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-22T08:34:51.919+0000 7fc970d28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.491 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-22T08:34:51.920+0000 7fc96d270640 10 monclient: get_auth_request con 0x55d43c9cbc40 auth_method 0 2024-09-22T08:34:52.491 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-22T08:34:51.920+0000 7fc970d28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:34:52.491 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-22T08:34:51.920+0000 7fc970d28800 20 searching for the correct realm 2024-09-22T08:34:52.491 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-22T08:34:51.920+0000 7fc96ca6f640 10 monclient: get_auth_request con 0x55d43c9d0a00 auth_method 0 2024-09-22T08:34:52.491 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-22T08:34:51.922+0000 7fc96c26e640 10 monclient: get_auth_request con 0x7fc96006dc90 auth_method 0 2024-09-22T08:34:52.491 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-22T08:34:51.922+0000 7fc96c26e640 0 -- 172.21.15.38:0/1611731035 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7fc96006dc90 msgr2=0x7fc960081ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:34:52.491 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-22T08:34:52.123+0000 7fc96c26e640 10 monclient: get_auth_request con 0x7fc96006dc90 auth_method 0 2024-09-22T08:34:52.491 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-22T08:34:52.124+0000 7fc96d270640 10 monclient: get_auth_request con 0x7fc95c02e5f0 auth_method 0 2024-09-22T08:34:52.491 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-22T08:34:52.126+0000 7fc96ca6f640 10 monclient: get_auth_request con 0x7fc96006b710 auth_method 0 2024-09-22T08:34:52.491 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-22T08:34:52.127+0000 7fc96c26e640 0 -- 172.21.15.38:0/1611731035 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fc95c040430 msgr2=0x7fc95c040870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:34:52.491 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-22T08:34:52.127+0000 7fc96c26e640 10 monclient: get_auth_request con 0x7fc95c040430 auth_method 0 2024-09-22T08:34:52.491 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-22T08:34:52.328+0000 7fc96c26e640 10 monclient: get_auth_request con 0x7fc95c040430 auth_method 0 2024-09-22T08:34:52.491 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-22T08:34:52.334+0000 7fc8427fc640 1 client.6996.objecter ms_handle_reset 0x55d43c9c83e0 session 0x55d43c9c7d60 osd.1 2024-09-22T08:34:52.492 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-22T08:34:52.334+0000 7fc8427fc640 10 monclient: _renew_subs 2024-09-22T08:34:52.492 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-22T08:34:52.334+0000 7fc8427fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:34:52.492 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-22T08:34:52.334+0000 7fc96c26e640 10 monclient: get_auth_request con 0x7fc838087090 auth_method 0 2024-09-22T08:34:52.492 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-22T08:34:52.335+0000 7fc970d28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:34:52.492 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-22T08:34:52.335+0000 7fc970d28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:34:52.492 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-22T08:34:52.335+0000 7fc970d28800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:34:52.492 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-22T08:34:52.335+0000 7fc970d28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:34:52.492 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-22T08:34:52.335+0000 7fc970d28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:34:52.492 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-22T08:34:52.335+0000 7fc970d28800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:34:52.492 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-22T08:34:52.335+0000 7fc970d28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.492 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-22T08:34:52.336+0000 7fc970d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:52.492 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-22T08:34:52.336+0000 7fc970d28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.492 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-22T08:34:52.336+0000 7fc970d28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:52.492 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-22T08:34:52.336+0000 7fc970d28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.492 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-22T08:34:52.336+0000 7fc970d28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:34:52.493 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-22T08:34:52.336+0000 7fc970d28800 20 zone default found 2024-09-22T08:34:52.493 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-22T08:34:52.336+0000 7fc970d28800 4 Realm: () 2024-09-22T08:34:52.493 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-22T08:34:52.336+0000 7fc970d28800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:34:52.493 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-22T08:34:52.336+0000 7fc970d28800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:34:52.493 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-22T08:34:52.336+0000 7fc970d28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:34:52.493 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-22T08:34:52.336+0000 7fc970d28800 20 zonegroup default 2024-09-22T08:34:52.493 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-22T08:34:52.336+0000 7fc970d28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.493 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-22T08:34:52.337+0000 7fc970d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:52.493 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-22T08:34:52.337+0000 7fc970d28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.493 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-22T08:34:52.337+0000 7fc970d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:52.493 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-22T08:34:52.338+0000 7fc970d28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.493 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-22T08:34:52.338+0000 7fc970d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:52.493 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-22T08:34:52.338+0000 7fc970d28800 20 started sync module instance, tier type = 2024-09-22T08:34:52.493 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-22T08:34:52.338+0000 7fc970d28800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:34:52.494 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-22T08:34:52.347+0000 7fc970d28800 20 add_watcher() i=0 2024-09-22T08:34:52.494 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-22T08:34:52.347+0000 7fc970d28800 20 add_watcher() i=1 2024-09-22T08:34:52.494 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-22T08:34:52.347+0000 7fc970d28800 20 add_watcher() i=2 2024-09-22T08:34:52.494 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-22T08:34:52.347+0000 7fc970d28800 20 add_watcher() i=3 2024-09-22T08:34:52.494 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-22T08:34:52.347+0000 7fc970d28800 20 add_watcher() i=4 2024-09-22T08:34:52.494 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-22T08:34:52.347+0000 7fc970d28800 20 add_watcher() i=5 2024-09-22T08:34:52.494 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-22T08:34:52.347+0000 7fc970d28800 20 add_watcher() i=6 2024-09-22T08:34:52.494 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-22T08:34:52.348+0000 7fc970d28800 20 add_watcher() i=7 2024-09-22T08:34:52.494 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-22T08:34:52.348+0000 7fc970d28800 2 all 8 watchers are set, enabling cache 2024-09-22T08:34:52.494 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-22T08:34:52.350+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678860) adding auth protocol: cephx 2024-09-22T08:34:52.494 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-22T08:34:52.350+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678860) adding auth protocol: cephx 2024-09-22T08:34:52.494 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-22T08:34:52.350+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678860) adding auth protocol: cephx 2024-09-22T08:34:52.494 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-22T08:34:52.350+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678860) adding con mode: secure 2024-09-22T08:34:52.495 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-22T08:34:52.350+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678860) adding con mode: crc 2024-09-22T08:34:52.495 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-22T08:34:52.350+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678860) adding con mode: secure 2024-09-22T08:34:52.495 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-22T08:34:52.350+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678860) adding con mode: crc 2024-09-22T08:34:52.495 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-22T08:34:52.350+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678860) adding con mode: secure 2024-09-22T08:34:52.495 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-22T08:34:52.350+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678860) adding con mode: crc 2024-09-22T08:34:52.495 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-22T08:34:52.350+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678860) adding con mode: crc 2024-09-22T08:34:52.495 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-22T08:34:52.350+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678860) adding con mode: secure 2024-09-22T08:34:52.495 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-22T08:34:52.350+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678860) adding con mode: crc 2024-09-22T08:34:52.495 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-22T08:34:52.350+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678860) adding con mode: secure 2024-09-22T08:34:52.495 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-22T08:34:52.350+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678860) adding con mode: crc 2024-09-22T08:34:52.495 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-22T08:34:52.350+0000 7fc970d28800 5 AuthRegistry(0x7fffcf678860) adding con mode: secure 2024-09-22T08:34:52.495 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-22T08:34:52.350+0000 7fc822fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:52.495 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-22T08:34:52.351+0000 7fc970d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:34:52.495 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-22T08:34:52.351+0000 7fc970d28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:34:52.495 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-22T08:34:52.351+0000 7fc970d28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:34:52.496 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-22T08:34:52.351+0000 7fc970d28800 5 asok(0x55d43c6b50f0) register_command cache list hook 0x55d43c995cb0 2024-09-22T08:34:52.496 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-22T08:34:52.351+0000 7fc970d28800 5 asok(0x55d43c6b50f0) register_command cache inspect hook 0x55d43c995cb0 2024-09-22T08:34:52.496 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-22T08:34:52.351+0000 7fc970d28800 5 asok(0x55d43c6b50f0) register_command cache erase hook 0x55d43c995cb0 2024-09-22T08:34:52.496 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-22T08:34:52.351+0000 7fc970d28800 5 asok(0x55d43c6b50f0) register_command cache zap hook 0x55d43c995cb0 2024-09-22T08:34:52.496 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-22T08:34:52.351+0000 7fc970d28800 5 note: GC not initialized 2024-09-22T08:34:52.496 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-22T08:34:52.351+0000 7fc821fe3640 20 reqs_thread_entry: start 2024-09-22T08:34:52.496 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-22T08:34:52.351+0000 7fc970d28800 5 asok(0x55d43c6b50f0) register_command sync trace show hook 0x7fc9600664b0 2024-09-22T08:34:52.496 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-22T08:34:52.351+0000 7fc970d28800 5 asok(0x55d43c6b50f0) register_command sync trace history hook 0x7fc9600664b0 2024-09-22T08:34:52.496 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-22T08:34:52.351+0000 7fc970d28800 5 asok(0x55d43c6b50f0) register_command sync trace active hook 0x7fc9600664b0 2024-09-22T08:34:52.496 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-22T08:34:52.351+0000 7fc970d28800 5 asok(0x55d43c6b50f0) register_command sync trace active_short hook 0x7fc9600664b0 2024-09-22T08:34:52.496 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-22T08:34:52.351+0000 7fc970d28800 20 init_complete bucket index max shards: 11 2024-09-22T08:34:52.496 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-22T08:34:52.351+0000 7fc970d28800 20 Filter name: none 2024-09-22T08:34:52.496 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-22T08:34:52.351+0000 7fc7937fe640 20 reqs_thread_entry: start 2024-09-22T08:34:52.497 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-22T08:34:52.351+0000 7fc970d28800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-22T08:34:52.497 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-22T08:34:52.351+0000 7fc970d28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.497 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-22T08:34:52.352+0000 7fc970d28800 20 rados_obj.operate() r=0 bl.length=189 2024-09-22T08:34:52.497 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-22T08:34:52.352+0000 7fc970d28800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-22T08:34:52.497 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-22T08:34:52.352+0000 7fc970d28800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-22T08:34:52.497 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-22T08:34:52.352+0000 7fc970d28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 : miss 2024-09-22T08:34:52.497 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-22T08:34:52.352+0000 7fc970d28800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.497 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-22T08:34:52.353+0000 7fc970d28800 20 rados_obj.operate() r=0 bl.length=411 2024-09-22T08:34:52.497 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-22T08:34:52.353+0000 7fc970d28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 info.flags=0x17 2024-09-22T08:34:52.497 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-22T08:34:52.353+0000 7fc970d28800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 to cache LRU end 2024-09-22T08:34:52.497 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-22T08:34:52.353+0000 7fc970d28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:34:52.497 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-22T08:34:52.353+0000 7fc970d28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:52.497 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-22T08:34:52.353+0000 7fc970d28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 2024-09-22T08:34:52.497 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-22T08:34:52.358+0000 7fc970d28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 info.flags=0x17 2024-09-22T08:34:52.498 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-22T08:34:52.358+0000 7fc970d28800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 to cache LRU end 2024-09-22T08:34:52.498 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-22T08:34:52.358+0000 7fc970d28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:52.498 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-22T08:34:52.358+0000 7fc970d28800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29, ofs0, ns] 2024-09-22T08:34:52.498 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-22T08:34:52.359+0000 7fc843fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497010 cookie 94370038382400 notifier 6996 bl.length()=915 2024-09-22T08:34:52.498 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-22T08:34:52.359+0000 7fc843fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 info.flags=0x17 2024-09-22T08:34:52.498 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-22T08:34:52.359+0000 7fc843fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 to cache LRU end 2024-09-22T08:34:52.498 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-22T08:34:52.359+0000 7fc843fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:52.498 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-22T08:34:52.359+0000 7fc970d28800 20 handle_bi_update(): bucket=:abort-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.29]): orig_sources= new_sources= 2024-09-22T08:34:52.498 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-22T08:34:52.359+0000 7fc970d28800 20 handle_bi_update(): bucket=:abort-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.29]): potential sources added=[] removed=[] 2024-09-22T08:34:52.498 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-22T08:34:52.359+0000 7fc970d28800 20 handle_bi_update(): bucket=:abort-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.29]): orig_dests= new_dests= 2024-09-22T08:34:52.498 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-22T08:34:52.359+0000 7fc970d28800 20 handle_bi_update(): bucket=:abort-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.29]): potential dests added=[] removed=[] 2024-09-22T08:34:52.498 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-22T08:34:52.364+0000 7fc970d28800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.0 2024-09-22T08:34:52.498 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-22T08:34:52.364+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.0 2024-09-22T08:34:52.498 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-22T08:34:52.364+0000 7fc970d28800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.1 2024-09-22T08:34:52.499 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-22T08:34:52.364+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.1 2024-09-22T08:34:52.499 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-22T08:34:52.364+0000 7fc970d28800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.2 2024-09-22T08:34:52.499 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-22T08:34:52.364+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.2 2024-09-22T08:34:52.499 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-22T08:34:52.364+0000 7fc970d28800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.3 2024-09-22T08:34:52.499 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-22T08:34:52.364+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.3 2024-09-22T08:34:52.499 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-22T08:34:52.364+0000 7fc970d28800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.4 2024-09-22T08:34:52.499 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-22T08:34:52.364+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.4 2024-09-22T08:34:52.499 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-22T08:34:52.364+0000 7fc970d28800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.5 2024-09-22T08:34:52.499 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-22T08:34:52.364+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.5 2024-09-22T08:34:52.499 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-22T08:34:52.364+0000 7fc970d28800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.6 2024-09-22T08:34:52.499 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-22T08:34:52.364+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.6 2024-09-22T08:34:52.499 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-22T08:34:52.364+0000 7fc970d28800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.7 2024-09-22T08:34:52.500 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-22T08:34:52.364+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.7 2024-09-22T08:34:52.500 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-22T08:34:52.364+0000 7fc970d28800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.8 2024-09-22T08:34:52.500 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-22T08:34:52.364+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.8 2024-09-22T08:34:52.500 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-22T08:34:52.364+0000 7fc970d28800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.9 2024-09-22T08:34:52.500 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-22T08:34:52.364+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.9 2024-09-22T08:34:52.500 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-22T08:34:52.364+0000 7fc970d28800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.10 2024-09-22T08:34:52.500 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-22T08:34:52.364+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.10 2024-09-22T08:34:52.500 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-22T08:34:52.364+0000 7fc970d28800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.11 2024-09-22T08:34:52.500 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-22T08:34:52.364+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1.11 2024-09-22T08:34:52.500 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-22T08:34:52.364+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.0 2024-09-22T08:34:52.500 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-22T08:34:52.365+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1 2024-09-22T08:34:52.500 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-22T08:34:52.365+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.2 2024-09-22T08:34:52.500 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-22T08:34:52.366+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.3 2024-09-22T08:34:52.500 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-22T08:34:52.367+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.4 2024-09-22T08:34:52.500 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-22T08:34:52.367+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.5 2024-09-22T08:34:52.501 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-22T08:34:52.368+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.6 2024-09-22T08:34:52.501 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-22T08:34:52.368+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.7 2024-09-22T08:34:52.501 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-22T08:34:52.369+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.8 2024-09-22T08:34:52.501 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-22T08:34:52.369+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.9 2024-09-22T08:34:52.501 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-22T08:34:52.370+0000 7fc970d28800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.10 2024-09-22T08:34:52.501 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-22T08:34:52.373+0000 7fc970d28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 : hit (requested=0x17, cached=0x17) 2024-09-22T08:34:52.501 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-22T08:34:52.373+0000 7fc970d28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 2024-09-22T08:34:52.501 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-22T08:34:52.374+0000 7fc970d28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 info.flags=0x17 2024-09-22T08:34:52.501 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-22T08:34:52.374+0000 7fc970d28800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 to cache LRU end 2024-09-22T08:34:52.501 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-22T08:34:52.374+0000 7fc970d28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:52.501 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-22T08:34:52.374+0000 7fc970d28800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29, ofs0, ns] 2024-09-22T08:34:52.501 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-22T08:34:52.375+0000 7fc8437fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497011 cookie 94370038382400 notifier 6996 bl.length()=915 2024-09-22T08:34:52.501 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-22T08:34:52.375+0000 7fc8437fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 info.flags=0x17 2024-09-22T08:34:52.501 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-22T08:34:52.375+0000 7fc8437fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 to cache LRU end 2024-09-22T08:34:52.502 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-22T08:34:52.375+0000 7fc8437fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:52.502 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-22T08:34:52.375+0000 7fc970d28800 20 handle_bi_update(): bucket=:abort-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.29]): orig_sources= new_sources= 2024-09-22T08:34:52.502 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-22T08:34:52.375+0000 7fc970d28800 20 handle_bi_update(): bucket=:abort-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.29]): potential sources added=[] removed=[] 2024-09-22T08:34:52.502 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-22T08:34:52.375+0000 7fc970d28800 20 handle_bi_update(): bucket=:abort-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.29]): orig_dests= new_dests= 2024-09-22T08:34:52.502 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-22T08:34:52.375+0000 7fc970d28800 20 handle_bi_update(): bucket=:abort-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.29]): potential dests added=[] removed=[] 2024-09-22T08:34:52.502 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-22T08:34:52.376+0000 7fc970d28800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc970d28800 time 2024-09-22T08:34:52.377440+0000 2024-09-22T08:34:52.502 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:34:52.502 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:52.502 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:34:52.502 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc97258c748] 2024-09-22T08:34:52.502 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fc97258c906] 2024-09-22T08:34:52.502 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d43a6a6e01] 2024-09-22T08:34:52.502 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55d43a6b5f02] 2024-09-22T08:34:52.503 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55d43a6b6d64] 2024-09-22T08:34:52.503 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-22T08:34:52.503 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc971229590] 2024-09-22T08:34:52.503 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-22T08:34:52.503 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-22T08:34:52.503 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:52.503 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-22T08:34:52.377+0000 7fc970d28800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:34:52.503 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7fc970d28800 thread_name:radosgw-admin 2024-09-22T08:34:52.503 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:52.503 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:34:52.503 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc97123e6f0] 2024-09-22T08:34:52.503 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc97128b99c] 2024-09-22T08:34:52.504 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:34:52.504 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:34:52.504 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc97258c7a2] 2024-09-22T08:34:52.504 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fc97258c906] 2024-09-22T08:34:52.504 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d43a6a6e01] 2024-09-22T08:34:52.504 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55d43a6b5f02] 2024-09-22T08:34:52.504 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55d43a6b6d64] 2024-09-22T08:34:52.504 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-22T08:34:52.504 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc971229590] 2024-09-22T08:34:52.504 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-22T08:34:52.504 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-22T08:34:52.504 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:34:52.505 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:52.505 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-22T08:34:52.505 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-22T08:34:52.505 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-22T08:34:52.505 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-22T08:34:52.505 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-22T08:34:52.505 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-22T08:34:52.505 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-22T08:34:52.505 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-22T08:34:52.505 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-22T08:34:52.505 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-22T08:34:52.505 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-22T08:34:52.505 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-22T08:34:52.506 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-22T08:34:52.506 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-22T08:34:52.506 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-22T08:34:52.506 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-22T08:34:52.506 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-22T08:34:52.506 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-22T08:34:52.506 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-22T08:34:52.506 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-22T08:34:52.506 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-22T08:34:52.506 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-22T08:34:52.506 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-22T08:34:52.506 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-22T08:34:52.506 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:34:52.506 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-22T08:34:52.507 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-22T08:34:52.507 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-22T08:34:52.507 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-22T08:34:52.507 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-22T08:34:52.507 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-22T08:34:52.507 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-22T08:34:52.507 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-22T08:34:52.507 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-22T08:34:52.507 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-22T08:34:52.507 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-22T08:34:52.507 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-22T08:34:52.507 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-22T08:34:52.507 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-22T08:34:52.507 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-22T08:34:52.507 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-22T08:34:52.507 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-22T08:34:52.508 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-22T08:34:52.508 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-22T08:34:52.508 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-22T08:34:52.508 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-22T08:34:52.508 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:34:52.508 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-22T08:34:52.508 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:34:52.508 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-22T08:34:52.508 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-22T08:34:52.508 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-22T08:34:52.508 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-22T08:34:52.508 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-22T08:34:52.508 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-22T08:34:52.508 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-22T08:34:52.509 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-22T08:34:52.509 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-22T08:34:52.509 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-22T08:34:52.509 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-22T08:34:52.509 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-22T08:34:52.509 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-22T08:34:52.509 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-22T08:34:52.509 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-22T08:34:52.509 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-22T08:34:52.509 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-22T08:34:52.509 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-22T08:34:52.509 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:34:52.509 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-22T08:34:52.509 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:34:52.509 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-22T08:34:52.510 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-22T08:34:52.510 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-22T08:34:52.510 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-22T08:34:52.510 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-22T08:34:52.510 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-22T08:34:52.510 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:34:52.510 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-22T08:34:52.510 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-22T08:34:52.510 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:34:52.510 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-22T08:34:52.510 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-22T08:34:52.510 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-22T08:34:52.510 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-22T08:34:52.510 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-22T08:34:52.510 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-22T08:34:52.511 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-22T08:34:52.511 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-22T08:34:52.511 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-22T08:34:52.511 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-22T08:34:52.511 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-22T08:34:52.511 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-22T08:34:52.511 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-22T08:34:52.511 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:34:52.511 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc7937fe640 / http_manager 2024-09-22T08:34:52.511 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc821fe3640 / http_manager 2024-09-22T08:34:52.511 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc822fe5640 / rgw_dt_lg_renew 2024-09-22T08:34:52.511 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc8427fc640 / ms_dispatch 2024-09-22T08:34:52.511 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc8437fe640 / io_context_pool 2024-09-22T08:34:52.511 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc843fff640 / io_context_pool 2024-09-22T08:34:52.512 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc8527fc640 / ms_dispatch 2024-09-22T08:34:52.512 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc85960a640 / ms_dispatch 2024-09-22T08:34:52.512 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc85ae0d640 / io_context_pool 2024-09-22T08:34:52.512 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc96c26e640 / msgr-worker-2 2024-09-22T08:34:52.512 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc96ca6f640 / msgr-worker-1 2024-09-22T08:34:52.512 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc96d270640 / msgr-worker-0 2024-09-22T08:34:52.512 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc96da71640 / io_context_pool 2024-09-22T08:34:52.512 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc970d28800 / radosgw-admin 2024-09-22T08:34:52.512 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-22T08:34:52.512 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-22T08:34:52.512 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/lib/ceph/crash/2024-09-22T08:34:52.379208Z_257d3972-cc0b-4ba4-9295-e6e4f716be29/log 2024-09-22T08:34:52.512 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-22T08:34:52.512 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-22T08:34:52.514 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:34:52.514 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:34:52.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.457+0000 7ff0c7b19800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.459+0000 7ff0c7b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:52.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.459+0000 7ff0c7b19800 20 realm 2024-09-22T08:34:52.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.459+0000 7ff0c7b19800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.460+0000 7ff0c7b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:52.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.460+0000 7ff0c7b19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:34:52.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.460+0000 7ff0c7b19800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.460+0000 7ff0c7b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:52.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.460+0000 7ff0c7b19800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.461+0000 7ff0c7b19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:52.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.461+0000 7ff0c7b19800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.461+0000 7ff0c7b19800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:34:52.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.461+0000 7ff0c7b19800 20 searching for the correct realm 2024-09-22T08:34:52.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.463+0000 7ff0bce02640 0 -- 172.21.15.38:0/3974262313 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7ff0b0090020 msgr2=0x7ff0b00617f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:34:52.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.468+0000 7ff0bce02640 0 -- 172.21.15.38:0/3974262313 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7ff0b806f0b0 msgr2=0x7ff0b80820d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:34:52.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.675+0000 7ff0c7b19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:34:52.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.675+0000 7ff0c7b19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:34:52.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.675+0000 7ff0c7b19800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:34:52.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.675+0000 7ff0c7b19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:34:52.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.675+0000 7ff0c7b19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:34:52.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.675+0000 7ff0c7b19800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:34:52.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.675+0000 7ff0c7b19800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.675+0000 7ff0c7b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:52.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.675+0000 7ff0c7b19800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.675+0000 7ff0c7b19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:52.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.675+0000 7ff0c7b19800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.676+0000 7ff0c7b19800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:34:52.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.676+0000 7ff0c7b19800 20 zone default found 2024-09-22T08:34:52.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.676+0000 7ff0c7b19800 4 Realm: () 2024-09-22T08:34:52.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.676+0000 7ff0c7b19800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:34:52.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.676+0000 7ff0c7b19800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:34:52.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.676+0000 7ff0c7b19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:34:52.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.676+0000 7ff0c7b19800 20 zonegroup default 2024-09-22T08:34:52.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.676+0000 7ff0c7b19800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.676+0000 7ff0c7b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:52.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.676+0000 7ff0c7b19800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.676+0000 7ff0c7b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:52.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.676+0000 7ff0c7b19800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.677+0000 7ff0c7b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:52.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.677+0000 7ff0c7b19800 20 started sync module instance, tier type = 2024-09-22T08:34:52.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.677+0000 7ff0c7b19800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:34:52.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.687+0000 7ff0c7b19800 20 add_watcher() i=0 2024-09-22T08:34:52.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.687+0000 7ff0c7b19800 20 add_watcher() i=1 2024-09-22T08:34:52.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.687+0000 7ff0c7b19800 20 add_watcher() i=2 2024-09-22T08:34:52.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.687+0000 7ff0c7b19800 20 add_watcher() i=3 2024-09-22T08:34:52.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.687+0000 7ff0c7b19800 20 add_watcher() i=4 2024-09-22T08:34:52.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.687+0000 7ff0c7b19800 20 add_watcher() i=5 2024-09-22T08:34:52.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.687+0000 7ff0c7b19800 20 add_watcher() i=6 2024-09-22T08:34:52.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.688+0000 7ff0c7b19800 20 add_watcher() i=7 2024-09-22T08:34:52.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.688+0000 7ff0c7b19800 2 all 8 watchers are set, enabling cache 2024-09-22T08:34:52.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.690+0000 7fef7b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:52.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.690+0000 7ff0c7b19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:34:52.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.690+0000 7ff0c7b19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:34:52.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.691+0000 7ff0c7b19800 5 note: GC not initialized 2024-09-22T08:34:52.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.691+0000 7fef7a7e4640 20 reqs_thread_entry: start 2024-09-22T08:34:52.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.691+0000 7ff0c7b19800 20 init_complete bucket index max shards: 11 2024-09-22T08:34:52.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.691+0000 7ff0c7b19800 20 Filter name: none 2024-09-22T08:34:52.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.691+0000 7feeebfff640 20 reqs_thread_entry: start 2024-09-22T08:34:52.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.691+0000 7ff0c7b19800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.692+0000 7ff0c7b19800 20 rados_obj.operate() r=0 bl.length=189 2024-09-22T08:34:52.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.692+0000 7ff0c7b19800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.697+0000 7ff0c7b19800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:34:52.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.697+0000 7ff0c7b19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:34:52.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.697+0000 7ff0c7b19800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.698+0000 7ff0c7b19800 20 rados_obj.operate() r=0 bl.length=189 2024-09-22T08:34:52.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.698+0000 7ff0c7b19800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.698+0000 7ff0c7b19800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:34:52.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.698+0000 7ff0c7b19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:34:52.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.700+0000 7fef7b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:52.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.703+0000 7ff0c7b19800 20 remove_watcher() i=0 2024-09-22T08:34:52.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.703+0000 7ff0c7b19800 2 removed watcher, disabling cache 2024-09-22T08:34:52.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.704+0000 7ff0c7b19800 20 remove_watcher() i=1 2024-09-22T08:34:52.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.705+0000 7ff0c7b19800 20 remove_watcher() i=2 2024-09-22T08:34:52.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.706+0000 7ff0c7b19800 20 remove_watcher() i=3 2024-09-22T08:34:52.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.707+0000 7ff0c7b19800 20 remove_watcher() i=4 2024-09-22T08:34:52.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.709+0000 7ff0c7b19800 20 remove_watcher() i=5 2024-09-22T08:34:52.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.710+0000 7ff0c7b19800 20 remove_watcher() i=6 2024-09-22T08:34:52.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.711+0000 7ff0c7b19800 20 remove_watcher() i=7 2024-09-22T08:34:52.724 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:52.724 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:34:52.725 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-block-writes id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:34:52.725 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:34:52.726 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:52.726 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:52.733 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:34:52.733 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:34:52.776 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:34:52.808 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:34:52.808 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:34:52.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.846+0000 7f8ff3810800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.847+0000 7f8ff3810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:52.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.847+0000 7f8ff3810800 20 realm 2024-09-22T08:34:52.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.847+0000 7f8ff3810800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.848+0000 7f8ff3810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:52.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.848+0000 7f8ff3810800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:34:52.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.848+0000 7f8ff3810800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.848+0000 7f8ff3810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:52.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.848+0000 7f8ff3810800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.849+0000 7f8ff3810800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:52.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.849+0000 7f8ff3810800 20 rados->read ofs=0 len=0 2024-09-22T08:34:52.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.850+0000 7f8ff3810800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:34:52.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.850+0000 7f8ff3810800 20 searching for the correct realm 2024-09-22T08:34:52.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:52.853+0000 7f8fef7bd640 0 -- 172.21.15.38:0/3496420764 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7f8fe0003560 msgr2=0x7f8fe0035410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:34:53.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.460+0000 7f8fee7bb640 0 -- 172.21.15.38:0/3496420764 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f8fe0044910 msgr2=0x7f8fe002a430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:34:53.469 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.466+0000 7f8ff3810800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:34:53.469 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.466+0000 7f8ff3810800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:34:53.469 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.466+0000 7f8ff3810800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:34:53.469 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.466+0000 7f8ff3810800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:34:53.469 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.466+0000 7f8ff3810800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:34:53.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.466+0000 7f8ff3810800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:34:53.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.466+0000 7f8ff3810800 20 rados->read ofs=0 len=0 2024-09-22T08:34:53.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.467+0000 7f8ff3810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:53.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.467+0000 7f8ff3810800 20 rados->read ofs=0 len=0 2024-09-22T08:34:53.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.467+0000 7f8ff3810800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:34:53.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.467+0000 7f8ff3810800 20 rados->read ofs=0 len=0 2024-09-22T08:34:53.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.467+0000 7f8ff3810800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:34:53.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.468+0000 7f8ff3810800 20 zone default found 2024-09-22T08:34:53.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.468+0000 7f8ff3810800 4 Realm: () 2024-09-22T08:34:53.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.468+0000 7f8ff3810800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:34:53.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.468+0000 7f8ff3810800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:34:53.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.468+0000 7f8ff3810800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:34:53.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.468+0000 7f8ff3810800 20 zonegroup default 2024-09-22T08:34:53.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.468+0000 7f8ff3810800 20 rados->read ofs=0 len=0 2024-09-22T08:34:53.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.468+0000 7f8ff3810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:53.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.468+0000 7f8ff3810800 20 rados->read ofs=0 len=0 2024-09-22T08:34:53.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.468+0000 7f8ff3810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:53.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.468+0000 7f8ff3810800 20 rados->read ofs=0 len=0 2024-09-22T08:34:53.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.469+0000 7f8ff3810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:34:53.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.469+0000 7f8ff3810800 20 started sync module instance, tier type = 2024-09-22T08:34:53.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.469+0000 7f8ff3810800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:34:53.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.480+0000 7f8ff3810800 20 add_watcher() i=0 2024-09-22T08:34:53.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.480+0000 7f8ff3810800 20 add_watcher() i=1 2024-09-22T08:34:53.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.480+0000 7f8ff3810800 20 add_watcher() i=2 2024-09-22T08:34:53.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.480+0000 7f8ff3810800 20 add_watcher() i=3 2024-09-22T08:34:53.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.480+0000 7f8ff3810800 20 add_watcher() i=4 2024-09-22T08:34:53.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.480+0000 7f8ff3810800 20 add_watcher() i=5 2024-09-22T08:34:53.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.480+0000 7f8ff3810800 20 add_watcher() i=6 2024-09-22T08:34:53.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.482+0000 7f8ff3810800 20 add_watcher() i=7 2024-09-22T08:34:53.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.482+0000 7f8ff3810800 2 all 8 watchers are set, enabling cache 2024-09-22T08:34:53.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.483+0000 7f8ea57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:53.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.484+0000 7f8ff3810800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:34:53.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.484+0000 7f8ff3810800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:34:53.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.484+0000 7f8ff3810800 5 note: GC not initialized 2024-09-22T08:34:53.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.484+0000 7f8e1ffff640 20 reqs_thread_entry: start 2024-09-22T08:34:53.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.484+0000 7f8ff3810800 20 init_complete bucket index max shards: 11 2024-09-22T08:34:53.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.484+0000 7f8ff3810800 20 Filter name: none 2024-09-22T08:34:53.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.484+0000 7f8e1dffb640 20 reqs_thread_entry: start 2024-09-22T08:34:53.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.485+0000 7f8ff3810800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-22T08:34:53.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.485+0000 7f8ff3810800 20 rados->read ofs=0 len=0 2024-09-22T08:34:53.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.485+0000 7f8ff3810800 20 rados_obj.operate() r=0 bl.length=189 2024-09-22T08:34:53.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.485+0000 7f8ff3810800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-22T08:34:53.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.485+0000 7f8ff3810800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-22T08:34:53.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.485+0000 7f8ff3810800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 : miss 2024-09-22T08:34:53.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.485+0000 7f8ff3810800 20 rados->read ofs=0 len=0 2024-09-22T08:34:53.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.486+0000 7f8ff3810800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:34:53.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.486+0000 7f8ff3810800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 info.flags=0x17 2024-09-22T08:34:53.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.486+0000 7f8ff3810800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 to cache LRU end 2024-09-22T08:34:53.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.486+0000 7f8ff3810800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:34:53.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.486+0000 7f8ff3810800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:34:53.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.486+0000 7f8ff3810800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 2024-09-22T08:34:53.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.487+0000 7f8ff3810800 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 to be held by another RGW process; skipping for now 2024-09-22T08:34:53.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.488+0000 7f8ea57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:34:53.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.491+0000 7f8ff3810800 20 remove_watcher() i=0 2024-09-22T08:34:53.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.491+0000 7f8ff3810800 2 removed watcher, disabling cache 2024-09-22T08:34:53.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.492+0000 7f8ff3810800 20 remove_watcher() i=1 2024-09-22T08:34:53.495 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.493+0000 7f8ff3810800 20 remove_watcher() i=2 2024-09-22T08:34:53.496 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.494+0000 7f8ff3810800 20 remove_watcher() i=3 2024-09-22T08:34:53.497 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.495+0000 7f8ff3810800 20 remove_watcher() i=4 2024-09-22T08:34:53.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.497+0000 7f8ff3810800 20 remove_watcher() i=5 2024-09-22T08:34:53.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.498+0000 7f8ff3810800 20 remove_watcher() i=6 2024-09-22T08:34:53.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:34:53.499+0000 7f8ff3810800 20 remove_watcher() i=7 2024-09-22T08:34:53.514 INFO:tasks.workunit.client.0.smithi038.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-22T08:35:23.531 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:35:23.568 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:35:23.568 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:35:23.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.613+0000 7f3e11525800 20 rados->read ofs=0 len=0 2024-09-22T08:35:23.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.614+0000 7f3e11525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:23.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.614+0000 7f3e11525800 20 realm 2024-09-22T08:35:23.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.614+0000 7f3e11525800 20 rados->read ofs=0 len=0 2024-09-22T08:35:23.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.615+0000 7f3e11525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:23.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.615+0000 7f3e11525800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:35:23.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.615+0000 7f3e11525800 20 rados->read ofs=0 len=0 2024-09-22T08:35:23.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.615+0000 7f3e11525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:23.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.615+0000 7f3e11525800 20 rados->read ofs=0 len=0 2024-09-22T08:35:23.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.616+0000 7f3e11525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:35:23.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.616+0000 7f3e11525800 20 rados->read ofs=0 len=0 2024-09-22T08:35:23.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.616+0000 7f3e11525800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:35:23.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.617+0000 7f3e11525800 20 searching for the correct realm 2024-09-22T08:35:23.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.619+0000 7f3e0caa1640 0 -- 172.21.15.38:0/3413239850 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f3e04077590 msgr2=0x7f3e040a54b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:35:23.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.623+0000 7f3e0caa1640 0 -- 172.21.15.38:0/3413239850 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f3e00043400 msgr2=0x7f3e00043860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:35:23.832 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.831+0000 7f3e11525800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:35:23.832 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.831+0000 7f3e11525800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:35:23.832 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.831+0000 7f3e11525800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:35:23.832 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.831+0000 7f3e11525800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:35:23.832 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.831+0000 7f3e11525800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:35:23.833 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.831+0000 7f3e11525800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:35:23.833 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.831+0000 7f3e11525800 20 rados->read ofs=0 len=0 2024-09-22T08:35:23.833 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.831+0000 7f3e11525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:23.833 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.831+0000 7f3e11525800 20 rados->read ofs=0 len=0 2024-09-22T08:35:23.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.832+0000 7f3e11525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:35:23.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.832+0000 7f3e11525800 20 rados->read ofs=0 len=0 2024-09-22T08:35:23.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.832+0000 7f3e11525800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:35:23.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.832+0000 7f3e11525800 20 zone default found 2024-09-22T08:35:23.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.832+0000 7f3e11525800 4 Realm: () 2024-09-22T08:35:23.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.832+0000 7f3e11525800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:35:23.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.832+0000 7f3e11525800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:35:23.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.832+0000 7f3e11525800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:35:23.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.832+0000 7f3e11525800 20 zonegroup default 2024-09-22T08:35:23.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.832+0000 7f3e11525800 20 rados->read ofs=0 len=0 2024-09-22T08:35:23.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.833+0000 7f3e11525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:23.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.833+0000 7f3e11525800 20 rados->read ofs=0 len=0 2024-09-22T08:35:23.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.833+0000 7f3e11525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:23.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.833+0000 7f3e11525800 20 rados->read ofs=0 len=0 2024-09-22T08:35:23.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.833+0000 7f3e11525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:23.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.833+0000 7f3e11525800 20 started sync module instance, tier type = 2024-09-22T08:35:23.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.833+0000 7f3e11525800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:35:23.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.844+0000 7f3e11525800 20 add_watcher() i=0 2024-09-22T08:35:23.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.844+0000 7f3e11525800 20 add_watcher() i=1 2024-09-22T08:35:23.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.844+0000 7f3e11525800 20 add_watcher() i=2 2024-09-22T08:35:23.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.844+0000 7f3e11525800 20 add_watcher() i=3 2024-09-22T08:35:23.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.844+0000 7f3e11525800 20 add_watcher() i=4 2024-09-22T08:35:23.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.844+0000 7f3e11525800 20 add_watcher() i=5 2024-09-22T08:35:23.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.844+0000 7f3e11525800 20 add_watcher() i=6 2024-09-22T08:35:23.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.845+0000 7f3e11525800 20 add_watcher() i=7 2024-09-22T08:35:23.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.846+0000 7f3e11525800 2 all 8 watchers are set, enabling cache 2024-09-22T08:35:23.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.847+0000 7f3cc3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:35:23.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.848+0000 7f3e11525800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:35:23.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.848+0000 7f3e11525800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:35:23.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.848+0000 7f3e11525800 5 note: GC not initialized 2024-09-22T08:35:23.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.848+0000 7f3cc2fe5640 20 reqs_thread_entry: start 2024-09-22T08:35:23.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.848+0000 7f3e11525800 20 init_complete bucket index max shards: 11 2024-09-22T08:35:23.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.848+0000 7f3e11525800 20 Filter name: none 2024-09-22T08:35:23.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.849+0000 7f3cc0fe1640 20 reqs_thread_entry: start 2024-09-22T08:35:23.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.849+0000 7f3e11525800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-22T08:35:23.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.849+0000 7f3e11525800 20 rados->read ofs=0 len=0 2024-09-22T08:35:23.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.849+0000 7f3e11525800 20 rados_obj.operate() r=0 bl.length=189 2024-09-22T08:35:23.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.849+0000 7f3e11525800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-22T08:35:23.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.849+0000 7f3e11525800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-22T08:35:23.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.849+0000 7f3e11525800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 : miss 2024-09-22T08:35:23.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.849+0000 7f3e11525800 20 rados->read ofs=0 len=0 2024-09-22T08:35:23.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.850+0000 7f3e11525800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:35:23.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.850+0000 7f3e11525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 info.flags=0x17 2024-09-22T08:35:23.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.850+0000 7f3e11525800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 to cache LRU end 2024-09-22T08:35:23.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.850+0000 7f3e11525800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:35:23.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.850+0000 7f3e11525800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:35:23.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.850+0000 7f3e11525800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 2024-09-22T08:35:23.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.851+0000 7f3e11525800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-22T08:35:23.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.860+0000 7f3e11525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 info.flags=0x17 2024-09-22T08:35:23.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.860+0000 7f3e11525800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 to cache LRU end 2024-09-22T08:35:23.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.860+0000 7f3e11525800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:35:23.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.860+0000 7f3e11525800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29, ofs0, ns] 2024-09-22T08:35:23.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.860+0000 7f3cf0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497012 cookie 94226231772752 notifier 7050 bl.length()=915 2024-09-22T08:35:23.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.860+0000 7f3cf0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 info.flags=0x17 2024-09-22T08:35:23.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.860+0000 7f3cf0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 to cache LRU end 2024-09-22T08:35:23.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.860+0000 7f3cf0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:35:23.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.861+0000 7f3e11525800 20 handle_bi_update(): bucket=:abort-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.29]): orig_sources= new_sources= 2024-09-22T08:35:23.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.861+0000 7f3e11525800 20 handle_bi_update(): bucket=:abort-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.29]): potential sources added=[] removed=[] 2024-09-22T08:35:23.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.861+0000 7f3e11525800 20 handle_bi_update(): bucket=:abort-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.29]): orig_dests= new_dests= 2024-09-22T08:35:23.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.861+0000 7f3e11525800 20 handle_bi_update(): bucket=:abort-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.29]): potential dests added=[] removed=[] 2024-09-22T08:35:23.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.866+0000 7f3e11525800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.2.0 2024-09-22T08:35:23.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.866+0000 7f3e11525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.2.0 2024-09-22T08:35:23.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.867+0000 7f3e11525800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.2.1 2024-09-22T08:35:23.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.867+0000 7f3e11525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.2.1 2024-09-22T08:35:23.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.867+0000 7f3e11525800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.2.2 2024-09-22T08:35:23.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.867+0000 7f3e11525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.2.2 2024-09-22T08:35:23.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.867+0000 7f3e11525800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.2.3 2024-09-22T08:35:23.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.867+0000 7f3e11525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.2.3 2024-09-22T08:35:23.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.867+0000 7f3e11525800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.2.4 2024-09-22T08:35:23.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.867+0000 7f3e11525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.2.4 2024-09-22T08:35:23.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.867+0000 7f3e11525800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.2.5 2024-09-22T08:35:23.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.867+0000 7f3e11525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.2.5 2024-09-22T08:35:23.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.867+0000 7f3e11525800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.2.6 2024-09-22T08:35:23.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.867+0000 7f3e11525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.2.6 2024-09-22T08:35:23.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.867+0000 7f3e11525800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.2.7 2024-09-22T08:35:23.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.867+0000 7f3e11525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.2.7 2024-09-22T08:35:23.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.867+0000 7f3e11525800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.2.8 2024-09-22T08:35:23.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.867+0000 7f3e11525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.2.8 2024-09-22T08:35:23.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.867+0000 7f3e11525800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.2.9 2024-09-22T08:35:23.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.867+0000 7f3e11525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.2.9 2024-09-22T08:35:23.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.867+0000 7f3e11525800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.2.10 2024-09-22T08:35:23.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.867+0000 7f3e11525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.2.10 2024-09-22T08:35:23.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.867+0000 7f3e11525800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.2.11 2024-09-22T08:35:23.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.867+0000 7f3e11525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.2.11 2024-09-22T08:35:23.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.867+0000 7f3e11525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.0 2024-09-22T08:35:23.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.867+0000 7f3e11525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1 2024-09-22T08:35:23.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.868+0000 7f3e11525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.2 2024-09-22T08:35:23.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.868+0000 7f3e11525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.3 2024-09-22T08:35:23.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.869+0000 7f3e11525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.4 2024-09-22T08:35:23.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.870+0000 7f3e11525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.5 2024-09-22T08:35:23.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.870+0000 7f3e11525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.6 2024-09-22T08:35:23.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.871+0000 7f3e11525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.7 2024-09-22T08:35:23.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.871+0000 7f3e11525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.8 2024-09-22T08:35:23.873 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.872+0000 7f3e11525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.9 2024-09-22T08:35:23.873 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.872+0000 7f3e11525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.10 2024-09-22T08:35:23.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.878+0000 7f3e11525800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 : hit (requested=0x17, cached=0x17) 2024-09-22T08:35:23.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.878+0000 7f3e11525800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 2024-09-22T08:35:23.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.880+0000 7f3e11525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 info.flags=0x17 2024-09-22T08:35:23.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.880+0000 7f3e11525800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 to cache LRU end 2024-09-22T08:35:23.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.880+0000 7f3e11525800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:35:23.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.880+0000 7f3e11525800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29, ofs0, ns] 2024-09-22T08:35:23.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.880+0000 7f3cf0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497013 cookie 94226231772752 notifier 7050 bl.length()=915 2024-09-22T08:35:23.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.880+0000 7f3cf0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 info.flags=0x17 2024-09-22T08:35:23.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.880+0000 7f3cf0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 to cache LRU end 2024-09-22T08:35:23.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.880+0000 7f3cf0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:35:23.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.881+0000 7f3e11525800 20 handle_bi_update(): bucket=:abort-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.29]): orig_sources= new_sources= 2024-09-22T08:35:23.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.881+0000 7f3e11525800 20 handle_bi_update(): bucket=:abort-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.29]): potential sources added=[] removed=[] 2024-09-22T08:35:23.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.881+0000 7f3e11525800 20 handle_bi_update(): bucket=:abort-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.29]): orig_dests= new_dests= 2024-09-22T08:35:23.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.881+0000 7f3e11525800 20 handle_bi_update(): bucket=:abort-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.29]): potential dests added=[] removed=[] 2024-09-22T08:35:23.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.883+0000 7f3e11525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.0 2024-09-22T08:35:23.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.884+0000 7f3e11525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.1 2024-09-22T08:35:23.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.884+0000 7f3e11525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.2 2024-09-22T08:35:23.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.884+0000 7f3e11525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.3 2024-09-22T08:35:23.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.885+0000 7f3e11525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.4 2024-09-22T08:35:23.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.885+0000 7f3e11525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.5 2024-09-22T08:35:23.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.885+0000 7f3e11525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.6 2024-09-22T08:35:23.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.886+0000 7f3e11525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.7 2024-09-22T08:35:23.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.886+0000 7f3e11525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.8 2024-09-22T08:35:23.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.887+0000 7f3e11525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.9 2024-09-22T08:35:23.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.887+0000 7f3e11525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.29.10 2024-09-22T08:35:23.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.887+0000 7f3e11525800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 : hit (requested=0x17, cached=0x17) 2024-09-22T08:35:23.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.887+0000 7f3e11525800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 2024-09-22T08:35:23.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.889+0000 7f3e11525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 info.flags=0x17 2024-09-22T08:35:23.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.889+0000 7f3e11525800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 to cache LRU end 2024-09-22T08:35:23.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.889+0000 7f3e11525800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:35:23.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.889+0000 7f3e11525800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29, ofs0, ns] 2024-09-22T08:35:23.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.889+0000 7f3cdffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497014 cookie 94226231772752 notifier 7050 bl.length()=883 2024-09-22T08:35:23.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.889+0000 7f3cdffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 info.flags=0x17 2024-09-22T08:35:23.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.889+0000 7f3cdffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 to cache LRU end 2024-09-22T08:35:23.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.889+0000 7f3cdffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:35:23.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.890+0000 7f3e11525800 20 handle_bi_update(): bucket=:abort-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.29]): orig_sources= new_sources= 2024-09-22T08:35:23.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.890+0000 7f3e11525800 20 handle_bi_update(): bucket=:abort-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.29]): potential sources added=[] removed=[] 2024-09-22T08:35:23.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.890+0000 7f3e11525800 20 handle_bi_update(): bucket=:abort-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.29]): orig_dests= new_dests= 2024-09-22T08:35:23.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.890+0000 7f3e11525800 20 handle_bi_update(): bucket=:abort-at-block-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.29]): potential dests added=[] removed=[] 2024-09-22T08:35:23.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.893+0000 7f3e11525800 1 execute INFO: reshard of bucket "abort-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-22T08:35:23.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.895+0000 7f3cc3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:35:23.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.897+0000 7f3e11525800 20 remove_watcher() i=0 2024-09-22T08:35:23.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.897+0000 7f3e11525800 2 removed watcher, disabling cache 2024-09-22T08:35:23.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.898+0000 7f3e11525800 20 remove_watcher() i=1 2024-09-22T08:35:23.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.899+0000 7f3e11525800 20 remove_watcher() i=2 2024-09-22T08:35:23.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.901+0000 7f3e11525800 20 remove_watcher() i=3 2024-09-22T08:35:23.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.902+0000 7f3e11525800 20 remove_watcher() i=4 2024-09-22T08:35:23.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.903+0000 7f3e11525800 20 remove_watcher() i=5 2024-09-22T08:35:23.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.904+0000 7f3e11525800 20 remove_watcher() i=6 2024-09-22T08:35:23.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.905+0000 7f3e11525800 20 remove_watcher() i=7 2024-09-22T08:35:23.919 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-22T08:35:23.949 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:35:23.949 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:35:23.989 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.988+0000 7f4d37d28800 20 rados->read ofs=0 len=0 2024-09-22T08:35:23.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.990+0000 7f4d37d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:23.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.990+0000 7f4d37d28800 20 realm 2024-09-22T08:35:23.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.990+0000 7f4d37d28800 20 rados->read ofs=0 len=0 2024-09-22T08:35:23.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.990+0000 7f4d37d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:23.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.990+0000 7f4d37d28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:35:23.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.990+0000 7f4d37d28800 20 rados->read ofs=0 len=0 2024-09-22T08:35:23.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.990+0000 7f4d37d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:23.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.990+0000 7f4d37d28800 20 rados->read ofs=0 len=0 2024-09-22T08:35:23.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.991+0000 7f4d37d28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:35:23.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.991+0000 7f4d37d28800 20 rados->read ofs=0 len=0 2024-09-22T08:35:23.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.992+0000 7f4d37d28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:35:23.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.992+0000 7f4d37d28800 20 searching for the correct realm 2024-09-22T08:35:23.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.994+0000 7f4d33a6f640 0 -- 172.21.15.38:0/1597055315 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f4d2c0cc070 msgr2=0x7f4d2c0aa9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:35:23.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:23.998+0000 7f4d33a6f640 0 -- 172.21.15.38:0/1597055315 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f4d2c0e40b0 msgr2=0x7f4d2c0aa0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:35:24.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.206+0000 7f4d37d28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:35:24.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.206+0000 7f4d37d28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:35:24.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.206+0000 7f4d37d28800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:35:24.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.206+0000 7f4d37d28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:35:24.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.206+0000 7f4d37d28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:35:24.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.206+0000 7f4d37d28800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:35:24.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.206+0000 7f4d37d28800 20 rados->read ofs=0 len=0 2024-09-22T08:35:24.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.206+0000 7f4d37d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:24.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.206+0000 7f4d37d28800 20 rados->read ofs=0 len=0 2024-09-22T08:35:24.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.207+0000 7f4d37d28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:35:24.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.207+0000 7f4d37d28800 20 rados->read ofs=0 len=0 2024-09-22T08:35:24.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.207+0000 7f4d37d28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:35:24.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.207+0000 7f4d37d28800 20 zone default found 2024-09-22T08:35:24.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.207+0000 7f4d37d28800 4 Realm: () 2024-09-22T08:35:24.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.207+0000 7f4d37d28800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:35:24.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.207+0000 7f4d37d28800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:35:24.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.207+0000 7f4d37d28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:35:24.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.207+0000 7f4d37d28800 20 zonegroup default 2024-09-22T08:35:24.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.207+0000 7f4d37d28800 20 rados->read ofs=0 len=0 2024-09-22T08:35:24.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.208+0000 7f4d37d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:24.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.208+0000 7f4d37d28800 20 rados->read ofs=0 len=0 2024-09-22T08:35:24.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.208+0000 7f4d37d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:24.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.208+0000 7f4d37d28800 20 rados->read ofs=0 len=0 2024-09-22T08:35:24.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.208+0000 7f4d37d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:24.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.208+0000 7f4d37d28800 20 started sync module instance, tier type = 2024-09-22T08:35:24.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.208+0000 7f4d37d28800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:35:24.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.218+0000 7f4d37d28800 20 add_watcher() i=0 2024-09-22T08:35:24.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.218+0000 7f4d37d28800 20 add_watcher() i=1 2024-09-22T08:35:24.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.218+0000 7f4d37d28800 20 add_watcher() i=2 2024-09-22T08:35:24.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.218+0000 7f4d37d28800 20 add_watcher() i=3 2024-09-22T08:35:24.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.218+0000 7f4d37d28800 20 add_watcher() i=4 2024-09-22T08:35:24.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.218+0000 7f4d37d28800 20 add_watcher() i=5 2024-09-22T08:35:24.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.219+0000 7f4d37d28800 20 add_watcher() i=6 2024-09-22T08:35:24.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.220+0000 7f4d37d28800 20 add_watcher() i=7 2024-09-22T08:35:24.221 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.220+0000 7f4d37d28800 2 all 8 watchers are set, enabling cache 2024-09-22T08:35:24.222 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.221+0000 7f4be9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:35:24.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.222+0000 7f4d37d28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:35:24.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.222+0000 7f4d37d28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:35:24.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.222+0000 7f4d37d28800 5 note: GC not initialized 2024-09-22T08:35:24.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.222+0000 7f4be8fe1640 20 reqs_thread_entry: start 2024-09-22T08:35:24.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.222+0000 7f4d37d28800 20 init_complete bucket index max shards: 11 2024-09-22T08:35:24.224 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.222+0000 7f4d37d28800 20 Filter name: none 2024-09-22T08:35:24.224 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.222+0000 7f4b627fc640 20 reqs_thread_entry: start 2024-09-22T08:35:24.224 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.222+0000 7f4d37d28800 20 rados->read ofs=0 len=0 2024-09-22T08:35:24.224 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.223+0000 7f4d37d28800 20 rados_obj.operate() r=0 bl.length=189 2024-09-22T08:35:24.224 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.223+0000 7f4d37d28800 20 rados->read ofs=0 len=0 2024-09-22T08:35:24.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.224+0000 7f4d37d28800 20 rados_obj.operate() r=0 bl.length=411 2024-09-22T08:35:24.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.224+0000 7f4d37d28800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:35:24.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.224+0000 7f4d37d28800 20 rados->read ofs=0 len=0 2024-09-22T08:35:24.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.224+0000 7f4d37d28800 20 rados_obj.operate() r=0 bl.length=189 2024-09-22T08:35:24.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.224+0000 7f4d37d28800 20 rados->read ofs=0 len=0 2024-09-22T08:35:24.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.224+0000 7f4d37d28800 20 rados_obj.operate() r=0 bl.length=411 2024-09-22T08:35:24.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.224+0000 7f4d37d28800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:35:24.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.226+0000 7f4be9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:35:24.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.229+0000 7f4d37d28800 20 remove_watcher() i=0 2024-09-22T08:35:24.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.229+0000 7f4d37d28800 2 removed watcher, disabling cache 2024-09-22T08:35:24.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.230+0000 7f4d37d28800 20 remove_watcher() i=1 2024-09-22T08:35:24.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.231+0000 7f4d37d28800 20 remove_watcher() i=2 2024-09-22T08:35:24.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.232+0000 7f4d37d28800 20 remove_watcher() i=3 2024-09-22T08:35:24.234 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.233+0000 7f4d37d28800 20 remove_watcher() i=4 2024-09-22T08:35:24.235 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.234+0000 7f4d37d28800 20 remove_watcher() i=5 2024-09-22T08:35:24.236 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.235+0000 7f4d37d28800 20 remove_watcher() i=6 2024-09-22T08:35:24.237 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.236+0000 7f4d37d28800 20 remove_watcher() i=7 2024-09-22T08:35:24.249 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:24.249 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:35:24.249 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-block-writes id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.29 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-22T08:35:24.249 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:24.251 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:24.251 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:24.255 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:24.255 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:24.297 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:24.297 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:24.327 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-22T08:35:24.327 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:24.328 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:24.329 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:24.340 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:24.340 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:24.383 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:24.383 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:24.391 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:24.391 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:24.397 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:24.397 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:24.403 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:24.403 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:24.409 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:24.409 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:24.415 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:24.415 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:24.422 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:24.422 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:24.429 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:24.429 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:24.435 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:24.435 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:24.441 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:24.441 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:24.447 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:24.447 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:24.455 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:24.455 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:24.460 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:24.461 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:24.467 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:24.467 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:24.473 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:24.474 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:24.480 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:24.480 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:24.486 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:24.486 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:24.493 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:24.493 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:24.499 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:24.499 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:24.505 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:24.505 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:24.511 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-22T08:35:24.541 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:35:24.541 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:35:24.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.580+0000 7f532232c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:24.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.581+0000 7f532232c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:24.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.581+0000 7f532232c800 20 realm 2024-09-22T08:35:24.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.581+0000 7f532232c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:24.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.582+0000 7f532232c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:24.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.582+0000 7f532232c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:35:24.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.582+0000 7f532232c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:24.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.582+0000 7f532232c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:24.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.582+0000 7f532232c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:24.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.582+0000 7f532232c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:35:24.584 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.582+0000 7f532232c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:24.584 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.583+0000 7f532232c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:35:24.584 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.583+0000 7f532232c800 20 searching for the correct realm 2024-09-22T08:35:24.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.585+0000 7f531d8ac640 0 -- 172.21.15.38:0/25256013 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f5314039060 msgr2=0x7f5314067ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:35:24.791 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.790+0000 7f531d8ac640 0 -- 172.21.15.38:0/25256013 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f5310099400 msgr2=0x7f5310099880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:35:24.999 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.998+0000 7f532232c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:35:24.999 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.998+0000 7f532232c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:35:24.999 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.998+0000 7f532232c800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:35:24.999 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.998+0000 7f532232c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:35:24.999 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.998+0000 7f532232c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:35:24.999 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.998+0000 7f532232c800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:35:24.999 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.998+0000 7f532232c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:24.999 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.998+0000 7f532232c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:25.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.998+0000 7f532232c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:25.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.998+0000 7f532232c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:35:25.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.998+0000 7f532232c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:25.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.999+0000 7f532232c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:35:25.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.999+0000 7f532232c800 20 zone default found 2024-09-22T08:35:25.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.999+0000 7f532232c800 4 Realm: () 2024-09-22T08:35:25.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.999+0000 7f532232c800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:35:25.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.999+0000 7f532232c800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:35:25.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.999+0000 7f532232c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:35:25.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.999+0000 7f532232c800 20 zonegroup default 2024-09-22T08:35:25.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.999+0000 7f532232c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:25.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.999+0000 7f532232c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:25.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:24.999+0000 7f532232c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:25.002 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.000+0000 7f532232c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:25.002 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.000+0000 7f532232c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:25.002 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.000+0000 7f532232c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:25.002 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.000+0000 7f532232c800 20 started sync module instance, tier type = 2024-09-22T08:35:25.002 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.000+0000 7f532232c800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:35:25.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.011+0000 7f532232c800 20 add_watcher() i=0 2024-09-22T08:35:25.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.011+0000 7f532232c800 20 add_watcher() i=1 2024-09-22T08:35:25.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.011+0000 7f532232c800 20 add_watcher() i=2 2024-09-22T08:35:25.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.011+0000 7f532232c800 20 add_watcher() i=3 2024-09-22T08:35:25.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.011+0000 7f532232c800 20 add_watcher() i=4 2024-09-22T08:35:25.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.011+0000 7f532232c800 20 add_watcher() i=5 2024-09-22T08:35:25.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.011+0000 7f532232c800 20 add_watcher() i=6 2024-09-22T08:35:25.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.012+0000 7f532232c800 20 add_watcher() i=7 2024-09-22T08:35:25.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.012+0000 7f532232c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:35:25.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.014+0000 7f51d4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:35:25.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.015+0000 7f532232c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:35:25.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.015+0000 7f532232c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:35:25.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.015+0000 7f532232c800 5 note: GC not initialized 2024-09-22T08:35:25.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.015+0000 7f514f7fe640 20 reqs_thread_entry: start 2024-09-22T08:35:25.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.015+0000 7f532232c800 20 init_complete bucket index max shards: 11 2024-09-22T08:35:25.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.015+0000 7f532232c800 20 Filter name: none 2024-09-22T08:35:25.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.015+0000 7f514d7fa640 20 reqs_thread_entry: start 2024-09-22T08:35:25.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.015+0000 7f532232c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:25.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.016+0000 7f532232c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:35:25.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.016+0000 7f532232c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:25.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.016+0000 7f532232c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:35:25.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.016+0000 7f532232c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:35:25.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.016+0000 7f532232c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:25.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.017+0000 7f532232c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:35:25.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.017+0000 7f532232c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:25.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.017+0000 7f532232c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:35:25.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.017+0000 7f532232c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:35:25.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.019+0000 7f51d4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:35:25.022 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.022+0000 7f532232c800 20 remove_watcher() i=0 2024-09-22T08:35:25.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.022+0000 7f532232c800 2 removed watcher, disabling cache 2024-09-22T08:35:25.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.023+0000 7f532232c800 20 remove_watcher() i=1 2024-09-22T08:35:25.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.024+0000 7f532232c800 20 remove_watcher() i=2 2024-09-22T08:35:25.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.025+0000 7f532232c800 20 remove_watcher() i=3 2024-09-22T08:35:25.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.026+0000 7f532232c800 20 remove_watcher() i=4 2024-09-22T08:35:25.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.027+0000 7f532232c800 20 remove_watcher() i=5 2024-09-22T08:35:25.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.028+0000 7f532232c800 20 remove_watcher() i=6 2024-09-22T08:35:25.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.029+0000 7f532232c800 20 remove_watcher() i=7 2024-09-22T08:35:25.042 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:25.042 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:35:25.042 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-commit-target-layout id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:35:25.043 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:25.044 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-22T08:35:25.080 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:35:25.081 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:35:25.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.324+0000 7f228272e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:25.327 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.326+0000 7f228272e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:25.327 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.326+0000 7f228272e800 20 realm 2024-09-22T08:35:25.327 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.326+0000 7f228272e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:25.327 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.326+0000 7f228272e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:25.327 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.326+0000 7f228272e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:35:25.328 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.326+0000 7f228272e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:25.328 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.326+0000 7f228272e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:25.328 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.326+0000 7f228272e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:25.328 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.327+0000 7f228272e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:35:25.328 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.327+0000 7f228272e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:25.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.328+0000 7f228272e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:35:25.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.328+0000 7f228272e800 20 searching for the correct realm 2024-09-22T08:35:25.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.331+0000 7f227db63640 0 -- 172.21.15.38:0/1644753199 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f2274085040 msgr2=0x7f227406d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:35:25.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.537+0000 7f227db63640 0 -- 172.21.15.38:0/1644753199 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f227007f040 msgr2=0x7f2270073310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:35:25.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.744+0000 7f228272e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:35:25.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.744+0000 7f228272e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:35:25.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.744+0000 7f228272e800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:35:25.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.744+0000 7f228272e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:35:25.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.744+0000 7f228272e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:35:25.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.744+0000 7f228272e800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:35:25.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.744+0000 7f228272e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:25.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.745+0000 7f228272e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:25.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.745+0000 7f228272e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:25.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.745+0000 7f228272e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:35:25.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.745+0000 7f228272e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:25.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.746+0000 7f228272e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:35:25.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.746+0000 7f228272e800 20 zone default found 2024-09-22T08:35:25.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.746+0000 7f228272e800 4 Realm: () 2024-09-22T08:35:25.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.746+0000 7f228272e800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:35:25.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.746+0000 7f228272e800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:35:25.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.746+0000 7f228272e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:35:25.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.746+0000 7f228272e800 20 zonegroup default 2024-09-22T08:35:25.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.746+0000 7f228272e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:25.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.746+0000 7f228272e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:25.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.746+0000 7f228272e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:25.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.746+0000 7f228272e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:25.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.746+0000 7f228272e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:25.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.747+0000 7f228272e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:25.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.747+0000 7f228272e800 20 started sync module instance, tier type = 2024-09-22T08:35:25.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.747+0000 7f228272e800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:35:25.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.758+0000 7f228272e800 20 add_watcher() i=0 2024-09-22T08:35:25.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.758+0000 7f228272e800 20 add_watcher() i=1 2024-09-22T08:35:25.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.758+0000 7f228272e800 20 add_watcher() i=2 2024-09-22T08:35:25.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.758+0000 7f228272e800 20 add_watcher() i=3 2024-09-22T08:35:25.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.758+0000 7f228272e800 20 add_watcher() i=4 2024-09-22T08:35:25.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.758+0000 7f228272e800 20 add_watcher() i=5 2024-09-22T08:35:25.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.758+0000 7f228272e800 20 add_watcher() i=6 2024-09-22T08:35:25.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.759+0000 7f228272e800 20 add_watcher() i=7 2024-09-22T08:35:25.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.759+0000 7f228272e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:35:25.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.761+0000 7f2134fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:35:25.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.761+0000 7f228272e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:35:25.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.761+0000 7f228272e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:35:25.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.761+0000 7f228272e800 5 note: GC not initialized 2024-09-22T08:35:25.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.761+0000 7f20af7fe640 20 reqs_thread_entry: start 2024-09-22T08:35:25.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.762+0000 7f228272e800 20 init_complete bucket index max shards: 11 2024-09-22T08:35:25.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.762+0000 7f228272e800 20 Filter name: none 2024-09-22T08:35:25.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.762+0000 7f20ad7fa640 20 reqs_thread_entry: start 2024-09-22T08:35:25.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.762+0000 7f228272e800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-22T08:35:25.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.762+0000 7f228272e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:25.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.762+0000 7f228272e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:35:25.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.762+0000 7f228272e800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-22T08:35:25.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.762+0000 7f228272e800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-22T08:35:25.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.762+0000 7f228272e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.30 : miss 2024-09-22T08:35:25.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.762+0000 7f228272e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:25.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.763+0000 7f228272e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:35:25.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.763+0000 7f228272e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.30 info.flags=0x17 2024-09-22T08:35:25.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.763+0000 7f228272e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.30 to cache LRU end 2024-09-22T08:35:25.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.763+0000 7f228272e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:35:25.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.763+0000 7f228272e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:35:25.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.763+0000 7f228272e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.30 2024-09-22T08:35:25.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.769+0000 7f228272e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.30 info.flags=0x17 2024-09-22T08:35:25.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.769+0000 7f228272e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.30 to cache LRU end 2024-09-22T08:35:25.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.769+0000 7f228272e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:35:25.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.769+0000 7f228272e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.30, ofs0, ns] 2024-09-22T08:35:25.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.770+0000 7f21617fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496995 cookie 93956066557520 notifier 7104 bl.length()=931 2024-09-22T08:35:25.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.770+0000 7f21617fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.30 info.flags=0x17 2024-09-22T08:35:25.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.770+0000 7f21617fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.30 to cache LRU end 2024-09-22T08:35:25.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.770+0000 7f21617fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:35:25.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.770+0000 7f228272e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.30]): orig_sources= new_sources= 2024-09-22T08:35:25.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.770+0000 7f228272e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.30]): potential sources added=[] removed=[] 2024-09-22T08:35:25.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.770+0000 7f228272e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.30]): orig_dests= new_dests= 2024-09-22T08:35:25.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.770+0000 7f228272e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.30]): potential dests added=[] removed=[] 2024-09-22T08:35:25.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.775+0000 7f228272e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.1.0 2024-09-22T08:35:25.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.775+0000 7f228272e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.1.0 2024-09-22T08:35:25.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.775+0000 7f228272e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.1.1 2024-09-22T08:35:25.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.775+0000 7f228272e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.1.1 2024-09-22T08:35:25.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.775+0000 7f228272e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.1.2 2024-09-22T08:35:25.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.775+0000 7f228272e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.1.2 2024-09-22T08:35:25.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.775+0000 7f228272e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.1.3 2024-09-22T08:35:25.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.775+0000 7f228272e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.1.3 2024-09-22T08:35:25.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.775+0000 7f228272e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.1.4 2024-09-22T08:35:25.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.775+0000 7f228272e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.1.4 2024-09-22T08:35:25.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.775+0000 7f228272e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.1.5 2024-09-22T08:35:25.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.775+0000 7f228272e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.1.5 2024-09-22T08:35:25.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.775+0000 7f228272e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.1.6 2024-09-22T08:35:25.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.775+0000 7f228272e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.1.6 2024-09-22T08:35:25.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.775+0000 7f228272e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.1.7 2024-09-22T08:35:25.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.775+0000 7f228272e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.1.7 2024-09-22T08:35:25.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.775+0000 7f228272e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.1.8 2024-09-22T08:35:25.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.775+0000 7f228272e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.1.8 2024-09-22T08:35:25.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.775+0000 7f228272e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.1.9 2024-09-22T08:35:25.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.775+0000 7f228272e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.1.9 2024-09-22T08:35:25.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.775+0000 7f228272e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.1.10 2024-09-22T08:35:25.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.775+0000 7f228272e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.1.10 2024-09-22T08:35:25.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.775+0000 7f228272e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.1.11 2024-09-22T08:35:25.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.775+0000 7f228272e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.1.11 2024-09-22T08:35:25.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.775+0000 7f228272e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.0 2024-09-22T08:35:25.779 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.776+0000 7f228272e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.1 2024-09-22T08:35:25.779 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.777+0000 7f228272e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.2 2024-09-22T08:35:25.779 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.777+0000 7f228272e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.3 2024-09-22T08:35:25.779 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.778+0000 7f228272e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.4 2024-09-22T08:35:25.779 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.778+0000 7f228272e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.5 2024-09-22T08:35:25.780 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.779+0000 7f228272e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.6 2024-09-22T08:35:25.780 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.779+0000 7f228272e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.7 2024-09-22T08:35:25.781 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.780+0000 7f228272e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.8 2024-09-22T08:35:25.781 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.781+0000 7f228272e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.9 2024-09-22T08:35:25.782 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.781+0000 7f228272e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.10 2024-09-22T08:35:25.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.785+0000 7f228272e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.30 : hit (requested=0x17, cached=0x17) 2024-09-22T08:35:25.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.785+0000 7f228272e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.30 2024-09-22T08:35:25.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.787+0000 7f228272e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.30 info.flags=0x17 2024-09-22T08:35:25.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.787+0000 7f228272e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.30 to cache LRU end 2024-09-22T08:35:25.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.787+0000 7f228272e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:35:25.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.787+0000 7f228272e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.30, ofs0, ns] 2024-09-22T08:35:25.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.787+0000 7f2161ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496996 cookie 93956066557520 notifier 7104 bl.length()=931 2024-09-22T08:35:25.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.787+0000 7f2161ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.30 info.flags=0x17 2024-09-22T08:35:25.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.787+0000 7f2161ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.30 to cache LRU end 2024-09-22T08:35:25.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.787+0000 7f2161ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:35:25.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.788+0000 7f228272e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.30]): orig_sources= new_sources= 2024-09-22T08:35:25.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.788+0000 7f228272e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.30]): potential sources added=[] removed=[] 2024-09-22T08:35:25.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.788+0000 7f228272e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.30]): orig_dests= new_dests= 2024-09-22T08:35:25.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.788+0000 7f228272e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.30]): potential dests added=[] removed=[] 2024-09-22T08:35:25.791 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.790+0000 7f228272e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.0 2024-09-22T08:35:25.792 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.791+0000 7f228272e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.1 2024-09-22T08:35:25.792 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.791+0000 7f228272e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.2 2024-09-22T08:35:25.792 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.791+0000 7f228272e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.3 2024-09-22T08:35:25.793 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.792+0000 7f228272e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.4 2024-09-22T08:35:25.793 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.792+0000 7f228272e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.5 2024-09-22T08:35:25.793 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.792+0000 7f228272e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.6 2024-09-22T08:35:25.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.793+0000 7f228272e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.7 2024-09-22T08:35:25.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.793+0000 7f228272e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.8 2024-09-22T08:35:25.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.794+0000 7f228272e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.9 2024-09-22T08:35:25.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.794+0000 7f228272e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.10 2024-09-22T08:35:25.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.795+0000 7f228272e800 -1 Injecting error=-5 at location=commit_target_layout 2024-09-22T08:35:25.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.795+0000 7f228272e800 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-22T08:35:25.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.799+0000 7f2134fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:35:25.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.802+0000 7f228272e800 20 remove_watcher() i=0 2024-09-22T08:35:25.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.802+0000 7f228272e800 2 removed watcher, disabling cache 2024-09-22T08:35:25.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.803+0000 7f228272e800 20 remove_watcher() i=1 2024-09-22T08:35:25.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.805+0000 7f228272e800 20 remove_watcher() i=2 2024-09-22T08:35:25.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.806+0000 7f228272e800 20 remove_watcher() i=3 2024-09-22T08:35:25.808 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.807+0000 7f228272e800 20 remove_watcher() i=4 2024-09-22T08:35:25.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.808+0000 7f228272e800 20 remove_watcher() i=5 2024-09-22T08:35:25.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.810+0000 7f228272e800 20 remove_watcher() i=6 2024-09-22T08:35:25.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.811+0000 7f228272e800 20 remove_watcher() i=7 2024-09-22T08:35:25.825 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-22T08:35:25.856 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:35:25.856 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:35:25.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.896+0000 7f6f24220800 20 rados->read ofs=0 len=0 2024-09-22T08:35:25.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.898+0000 7f6f24220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:25.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.898+0000 7f6f24220800 20 realm 2024-09-22T08:35:25.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.898+0000 7f6f24220800 20 rados->read ofs=0 len=0 2024-09-22T08:35:25.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.898+0000 7f6f24220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:25.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.898+0000 7f6f24220800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:35:25.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.898+0000 7f6f24220800 20 rados->read ofs=0 len=0 2024-09-22T08:35:25.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.898+0000 7f6f24220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:25.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.898+0000 7f6f24220800 20 rados->read ofs=0 len=0 2024-09-22T08:35:25.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.899+0000 7f6f24220800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:35:25.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.899+0000 7f6f24220800 20 rados->read ofs=0 len=0 2024-09-22T08:35:25.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.900+0000 7f6f24220800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:35:25.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.900+0000 7f6f24220800 20 searching for the correct realm 2024-09-22T08:35:25.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:25.902+0000 7f6f21509640 0 -- 172.21.15.38:0/3508092532 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f6f180baea0 msgr2=0x7f6f180ea050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:35:26.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.107+0000 7f6f21d0a640 0 -- 172.21.15.38:0/3508092532 >> [v2:172.21.15.42:6826/1437467409,v1:172.21.15.42:6827/1437467409] conn(0x7f6f180ba870 msgr2=0x7f6f180ba040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:35:26.316 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.315+0000 7f6f24220800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:35:26.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.315+0000 7f6f24220800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:35:26.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.315+0000 7f6f24220800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:35:26.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.315+0000 7f6f24220800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:35:26.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.315+0000 7f6f24220800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:35:26.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.315+0000 7f6f24220800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:35:26.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.315+0000 7f6f24220800 20 rados->read ofs=0 len=0 2024-09-22T08:35:26.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.316+0000 7f6f24220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:26.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.316+0000 7f6f24220800 20 rados->read ofs=0 len=0 2024-09-22T08:35:26.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.316+0000 7f6f24220800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:35:26.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.316+0000 7f6f24220800 20 rados->read ofs=0 len=0 2024-09-22T08:35:26.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.316+0000 7f6f24220800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:35:26.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.316+0000 7f6f24220800 20 zone default found 2024-09-22T08:35:26.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.316+0000 7f6f24220800 4 Realm: () 2024-09-22T08:35:26.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.316+0000 7f6f24220800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:35:26.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.316+0000 7f6f24220800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:35:26.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.316+0000 7f6f24220800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:35:26.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.316+0000 7f6f24220800 20 zonegroup default 2024-09-22T08:35:26.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.316+0000 7f6f24220800 20 rados->read ofs=0 len=0 2024-09-22T08:35:26.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.317+0000 7f6f24220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:26.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.317+0000 7f6f24220800 20 rados->read ofs=0 len=0 2024-09-22T08:35:26.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.317+0000 7f6f24220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:26.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.317+0000 7f6f24220800 20 rados->read ofs=0 len=0 2024-09-22T08:35:26.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.317+0000 7f6f24220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:26.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.317+0000 7f6f24220800 20 started sync module instance, tier type = 2024-09-22T08:35:26.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.317+0000 7f6f24220800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:35:26.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.328+0000 7f6f24220800 20 add_watcher() i=0 2024-09-22T08:35:26.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.328+0000 7f6f24220800 20 add_watcher() i=1 2024-09-22T08:35:26.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.328+0000 7f6f24220800 20 add_watcher() i=2 2024-09-22T08:35:26.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.328+0000 7f6f24220800 20 add_watcher() i=3 2024-09-22T08:35:26.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.328+0000 7f6f24220800 20 add_watcher() i=4 2024-09-22T08:35:26.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.328+0000 7f6f24220800 20 add_watcher() i=5 2024-09-22T08:35:26.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.328+0000 7f6f24220800 20 add_watcher() i=6 2024-09-22T08:35:26.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.329+0000 7f6f24220800 20 add_watcher() i=7 2024-09-22T08:35:26.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.329+0000 7f6f24220800 2 all 8 watchers are set, enabling cache 2024-09-22T08:35:26.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.331+0000 7f6dd3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:35:26.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.331+0000 7f6f24220800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:35:26.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.331+0000 7f6f24220800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:35:26.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.331+0000 7f6f24220800 5 note: GC not initialized 2024-09-22T08:35:26.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.331+0000 7f6dd2ffd640 20 reqs_thread_entry: start 2024-09-22T08:35:26.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.331+0000 7f6f24220800 20 init_complete bucket index max shards: 11 2024-09-22T08:35:26.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.332+0000 7f6f24220800 20 Filter name: none 2024-09-22T08:35:26.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.332+0000 7f6dd0ff9640 20 reqs_thread_entry: start 2024-09-22T08:35:26.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.332+0000 7f6f24220800 20 rados->read ofs=0 len=0 2024-09-22T08:35:26.334 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.332+0000 7f6f24220800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:35:26.334 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.332+0000 7f6f24220800 20 rados->read ofs=0 len=0 2024-09-22T08:35:26.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.333+0000 7f6f24220800 20 rados_obj.operate() r=0 bl.length=451 2024-09-22T08:35:26.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.333+0000 7f6f24220800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:35:26.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.333+0000 7f6f24220800 20 rados->read ofs=0 len=0 2024-09-22T08:35:26.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.333+0000 7f6f24220800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:35:26.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.333+0000 7f6f24220800 20 rados->read ofs=0 len=0 2024-09-22T08:35:26.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.333+0000 7f6f24220800 20 rados_obj.operate() r=0 bl.length=451 2024-09-22T08:35:26.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.333+0000 7f6f24220800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:35:26.336 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.336+0000 7f6dd3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:35:26.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.338+0000 7f6f24220800 20 remove_watcher() i=0 2024-09-22T08:35:26.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.338+0000 7f6f24220800 2 removed watcher, disabling cache 2024-09-22T08:35:26.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.339+0000 7f6f24220800 20 remove_watcher() i=1 2024-09-22T08:35:26.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.341+0000 7f6f24220800 20 remove_watcher() i=2 2024-09-22T08:35:26.343 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.342+0000 7f6f24220800 20 remove_watcher() i=3 2024-09-22T08:35:26.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.344+0000 7f6f24220800 20 remove_watcher() i=4 2024-09-22T08:35:26.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.345+0000 7f6f24220800 20 remove_watcher() i=5 2024-09-22T08:35:26.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.346+0000 7f6f24220800 20 remove_watcher() i=6 2024-09-22T08:35:26.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.348+0000 7f6f24220800 20 remove_watcher() i=7 2024-09-22T08:35:26.360 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:26.360 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:35:26.360 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-commit-target-layout id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:35:26.360 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:26.363 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:26.363 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:26.369 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:26.369 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:26.413 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:35:26.446 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:35:26.446 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:35:26.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.486+0000 7f85dbd2c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:26.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.488+0000 7f85dbd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:26.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.488+0000 7f85dbd2c800 20 realm 2024-09-22T08:35:26.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.488+0000 7f85dbd2c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:26.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.488+0000 7f85dbd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:26.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.488+0000 7f85dbd2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:35:26.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.488+0000 7f85dbd2c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:26.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.488+0000 7f85dbd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:26.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.488+0000 7f85dbd2c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:26.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.489+0000 7f85dbd2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:35:26.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.489+0000 7f85dbd2c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:26.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.489+0000 7f85dbd2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:35:26.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.489+0000 7f85dbd2c800 20 searching for the correct realm 2024-09-22T08:35:26.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.493+0000 7f85d813f640 0 -- 172.21.15.38:0/1064852270 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7f85c8043960 msgr2=0x7f85c8036410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:35:26.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.699+0000 7f85d793e640 0 -- 172.21.15.38:0/1064852270 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x5564b3058c00 msgr2=0x5564b305b0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:35:26.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.704+0000 7f85dbd2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:35:26.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.704+0000 7f85dbd2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:35:26.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.704+0000 7f85dbd2c800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:35:26.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.704+0000 7f85dbd2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:35:26.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.704+0000 7f85dbd2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:35:26.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.704+0000 7f85dbd2c800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:35:26.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.704+0000 7f85dbd2c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:26.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.704+0000 7f85dbd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:26.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.704+0000 7f85dbd2c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:26.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.705+0000 7f85dbd2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:35:26.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.705+0000 7f85dbd2c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:26.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.705+0000 7f85dbd2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:35:26.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.705+0000 7f85dbd2c800 20 zone default found 2024-09-22T08:35:26.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.705+0000 7f85dbd2c800 4 Realm: () 2024-09-22T08:35:26.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.705+0000 7f85dbd2c800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:35:26.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.705+0000 7f85dbd2c800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:35:26.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.705+0000 7f85dbd2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:35:26.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.705+0000 7f85dbd2c800 20 zonegroup default 2024-09-22T08:35:26.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.705+0000 7f85dbd2c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:26.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.705+0000 7f85dbd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:26.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.705+0000 7f85dbd2c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:26.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.706+0000 7f85dbd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:26.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.706+0000 7f85dbd2c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:26.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.706+0000 7f85dbd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:26.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.706+0000 7f85dbd2c800 20 started sync module instance, tier type = 2024-09-22T08:35:26.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.706+0000 7f85dbd2c800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:35:26.718 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.717+0000 7f85dbd2c800 20 add_watcher() i=0 2024-09-22T08:35:26.718 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.717+0000 7f85dbd2c800 20 add_watcher() i=1 2024-09-22T08:35:26.718 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.717+0000 7f85dbd2c800 20 add_watcher() i=2 2024-09-22T08:35:26.718 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.717+0000 7f85dbd2c800 20 add_watcher() i=3 2024-09-22T08:35:26.718 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.717+0000 7f85dbd2c800 20 add_watcher() i=4 2024-09-22T08:35:26.718 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.717+0000 7f85dbd2c800 20 add_watcher() i=5 2024-09-22T08:35:26.718 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.717+0000 7f85dbd2c800 20 add_watcher() i=6 2024-09-22T08:35:26.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.718+0000 7f85dbd2c800 20 add_watcher() i=7 2024-09-22T08:35:26.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.718+0000 7f85dbd2c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:35:26.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.720+0000 7f848dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:35:26.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.720+0000 7f85dbd2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:35:26.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.720+0000 7f85dbd2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:35:26.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.720+0000 7f85dbd2c800 5 note: GC not initialized 2024-09-22T08:35:26.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.720+0000 7f848cfe1640 20 reqs_thread_entry: start 2024-09-22T08:35:26.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.721+0000 7f85dbd2c800 20 init_complete bucket index max shards: 11 2024-09-22T08:35:26.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.721+0000 7f85dbd2c800 20 Filter name: none 2024-09-22T08:35:26.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.721+0000 7f84067fc640 20 reqs_thread_entry: start 2024-09-22T08:35:26.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.721+0000 7f85dbd2c800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-22T08:35:26.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.721+0000 7f85dbd2c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:26.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.721+0000 7f85dbd2c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:35:26.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.721+0000 7f85dbd2c800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-22T08:35:26.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.721+0000 7f85dbd2c800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-22T08:35:26.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.721+0000 7f85dbd2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.30 : miss 2024-09-22T08:35:26.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.721+0000 7f85dbd2c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:26.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.722+0000 7f85dbd2c800 20 rados_obj.operate() r=0 bl.length=451 2024-09-22T08:35:26.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.722+0000 7f85dbd2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.30 info.flags=0x17 2024-09-22T08:35:26.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.722+0000 7f85dbd2c800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.30 to cache LRU end 2024-09-22T08:35:26.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.722+0000 7f85dbd2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:35:26.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.722+0000 7f85dbd2c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:35:26.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.722+0000 7f85dbd2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.30 2024-09-22T08:35:26.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.723+0000 7f85dbd2c800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-22T08:35:26.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.730+0000 7f85dbd2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.30 info.flags=0x17 2024-09-22T08:35:26.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.730+0000 7f85dbd2c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.30 to cache LRU end 2024-09-22T08:35:26.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.730+0000 7f85dbd2c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:35:26.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.730+0000 7f85dbd2c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.30, ofs0, ns] 2024-09-22T08:35:26.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.730+0000 7f84b67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496997 cookie 93890988583840 notifier 7140 bl.length()=931 2024-09-22T08:35:26.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.730+0000 7f84b67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.30 info.flags=0x17 2024-09-22T08:35:26.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.730+0000 7f84b67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.30 to cache LRU end 2024-09-22T08:35:26.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.730+0000 7f84b67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:35:26.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.731+0000 7f85dbd2c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.30]): orig_sources= new_sources= 2024-09-22T08:35:26.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.731+0000 7f85dbd2c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.30]): potential sources added=[] removed=[] 2024-09-22T08:35:26.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.731+0000 7f85dbd2c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.30]): orig_dests= new_dests= 2024-09-22T08:35:26.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.731+0000 7f85dbd2c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.30]): potential dests added=[] removed=[] 2024-09-22T08:35:26.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.736+0000 7f85dbd2c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.2.0 2024-09-22T08:35:26.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.736+0000 7f85dbd2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.2.0 2024-09-22T08:35:26.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.736+0000 7f85dbd2c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.2.1 2024-09-22T08:35:26.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.736+0000 7f85dbd2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.2.1 2024-09-22T08:35:26.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.736+0000 7f85dbd2c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.2.2 2024-09-22T08:35:26.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.736+0000 7f85dbd2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.2.2 2024-09-22T08:35:26.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.736+0000 7f85dbd2c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.2.3 2024-09-22T08:35:26.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.736+0000 7f85dbd2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.2.3 2024-09-22T08:35:26.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.736+0000 7f85dbd2c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.2.4 2024-09-22T08:35:26.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.736+0000 7f85dbd2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.2.4 2024-09-22T08:35:26.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.736+0000 7f85dbd2c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.2.5 2024-09-22T08:35:26.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.736+0000 7f85dbd2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.2.5 2024-09-22T08:35:26.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.736+0000 7f85dbd2c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.2.6 2024-09-22T08:35:26.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.736+0000 7f85dbd2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.2.6 2024-09-22T08:35:26.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.736+0000 7f85dbd2c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.2.7 2024-09-22T08:35:26.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.736+0000 7f85dbd2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.2.7 2024-09-22T08:35:26.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.736+0000 7f85dbd2c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.2.8 2024-09-22T08:35:26.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.736+0000 7f85dbd2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.2.8 2024-09-22T08:35:26.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.736+0000 7f85dbd2c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.2.9 2024-09-22T08:35:26.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.736+0000 7f85dbd2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.2.9 2024-09-22T08:35:26.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.736+0000 7f85dbd2c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.2.10 2024-09-22T08:35:26.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.736+0000 7f85dbd2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.2.10 2024-09-22T08:35:26.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.736+0000 7f85dbd2c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.2.11 2024-09-22T08:35:26.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.736+0000 7f85dbd2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.2.11 2024-09-22T08:35:26.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.736+0000 7f85dbd2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.0 2024-09-22T08:35:26.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.737+0000 7f85dbd2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.1 2024-09-22T08:35:26.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.737+0000 7f85dbd2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.2 2024-09-22T08:35:26.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.738+0000 7f85dbd2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.3 2024-09-22T08:35:26.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.739+0000 7f85dbd2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.4 2024-09-22T08:35:26.741 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.739+0000 7f85dbd2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.5 2024-09-22T08:35:26.741 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.740+0000 7f85dbd2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.6 2024-09-22T08:35:26.741 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.740+0000 7f85dbd2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.7 2024-09-22T08:35:26.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.741+0000 7f85dbd2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.8 2024-09-22T08:35:26.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.741+0000 7f85dbd2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.9 2024-09-22T08:35:26.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.742+0000 7f85dbd2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.10 2024-09-22T08:35:26.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.746+0000 7f85dbd2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.30 : hit (requested=0x17, cached=0x17) 2024-09-22T08:35:26.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.746+0000 7f85dbd2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.30 2024-09-22T08:35:26.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.747+0000 7f85dbd2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.30 info.flags=0x17 2024-09-22T08:35:26.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.747+0000 7f85dbd2c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.30 to cache LRU end 2024-09-22T08:35:26.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.747+0000 7f85dbd2c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:35:26.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.747+0000 7f85dbd2c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.30, ofs0, ns] 2024-09-22T08:35:26.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.748+0000 7f84b67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496998 cookie 93890988583840 notifier 7140 bl.length()=931 2024-09-22T08:35:26.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.748+0000 7f84b67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.30 info.flags=0x17 2024-09-22T08:35:26.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.748+0000 7f84b67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.30 to cache LRU end 2024-09-22T08:35:26.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.748+0000 7f84b67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:35:26.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.748+0000 7f85dbd2c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.30]): orig_sources= new_sources= 2024-09-22T08:35:26.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.748+0000 7f85dbd2c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.30]): potential sources added=[] removed=[] 2024-09-22T08:35:26.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.748+0000 7f85dbd2c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.30]): orig_dests= new_dests= 2024-09-22T08:35:26.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.748+0000 7f85dbd2c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.30]): potential dests added=[] removed=[] 2024-09-22T08:35:26.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.751+0000 7f85dbd2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.0 2024-09-22T08:35:26.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.751+0000 7f85dbd2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.1 2024-09-22T08:35:26.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.751+0000 7f85dbd2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.2 2024-09-22T08:35:26.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.752+0000 7f85dbd2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.3 2024-09-22T08:35:26.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.752+0000 7f85dbd2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.4 2024-09-22T08:35:26.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.752+0000 7f85dbd2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.5 2024-09-22T08:35:26.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.753+0000 7f85dbd2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.6 2024-09-22T08:35:26.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.753+0000 7f85dbd2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.7 2024-09-22T08:35:26.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.754+0000 7f85dbd2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.8 2024-09-22T08:35:26.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.754+0000 7f85dbd2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.9 2024-09-22T08:35:26.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.754+0000 7f85dbd2c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.30.10 2024-09-22T08:35:26.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.755+0000 7f85dbd2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.30 : hit (requested=0x17, cached=0x17) 2024-09-22T08:35:26.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.755+0000 7f85dbd2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.30 2024-09-22T08:35:26.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.756+0000 7f85dbd2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.30 info.flags=0x17 2024-09-22T08:35:26.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.756+0000 7f85dbd2c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.30 to cache LRU end 2024-09-22T08:35:26.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.756+0000 7f85dbd2c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:35:26.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.756+0000 7f85dbd2c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.30, ofs0, ns] 2024-09-22T08:35:26.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.756+0000 7f84b67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496999 cookie 93890988583840 notifier 7140 bl.length()=899 2024-09-22T08:35:26.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.756+0000 7f84b67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.30 info.flags=0x17 2024-09-22T08:35:26.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.756+0000 7f84b67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.30 to cache LRU end 2024-09-22T08:35:26.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.756+0000 7f84b67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:35:26.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.757+0000 7f85dbd2c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.30]): orig_sources= new_sources= 2024-09-22T08:35:26.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.757+0000 7f85dbd2c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.30]): potential sources added=[] removed=[] 2024-09-22T08:35:26.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.757+0000 7f85dbd2c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.30]): orig_dests= new_dests= 2024-09-22T08:35:26.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.757+0000 7f85dbd2c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.30]): potential dests added=[] removed=[] 2024-09-22T08:35:26.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.759+0000 7f85dbd2c800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-22T08:35:26.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.761+0000 7f848dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:35:26.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.763+0000 7f85dbd2c800 20 remove_watcher() i=0 2024-09-22T08:35:26.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.763+0000 7f85dbd2c800 2 removed watcher, disabling cache 2024-09-22T08:35:26.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.764+0000 7f85dbd2c800 20 remove_watcher() i=1 2024-09-22T08:35:26.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.765+0000 7f85dbd2c800 20 remove_watcher() i=2 2024-09-22T08:35:26.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.766+0000 7f85dbd2c800 20 remove_watcher() i=3 2024-09-22T08:35:26.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.768+0000 7f85dbd2c800 20 remove_watcher() i=4 2024-09-22T08:35:26.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.769+0000 7f85dbd2c800 20 remove_watcher() i=5 2024-09-22T08:35:26.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.770+0000 7f85dbd2c800 20 remove_watcher() i=6 2024-09-22T08:35:26.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.771+0000 7f85dbd2c800 20 remove_watcher() i=7 2024-09-22T08:35:26.784 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-22T08:35:26.813 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:35:26.813 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:35:26.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.851+0000 7f28b04bb800 20 rados->read ofs=0 len=0 2024-09-22T08:35:26.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.854+0000 7f28b04bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:26.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.854+0000 7f28b04bb800 20 realm 2024-09-22T08:35:26.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.854+0000 7f28b04bb800 20 rados->read ofs=0 len=0 2024-09-22T08:35:26.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.854+0000 7f28b04bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:26.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.854+0000 7f28b04bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:35:26.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.854+0000 7f28b04bb800 20 rados->read ofs=0 len=0 2024-09-22T08:35:26.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.854+0000 7f28b04bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:26.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.854+0000 7f28b04bb800 20 rados->read ofs=0 len=0 2024-09-22T08:35:26.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.855+0000 7f28b04bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:35:26.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.855+0000 7f28b04bb800 20 rados->read ofs=0 len=0 2024-09-22T08:35:26.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.856+0000 7f28b04bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:35:26.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.856+0000 7f28b04bb800 20 searching for the correct realm 2024-09-22T08:35:26.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.858+0000 7f28adfa5640 0 -- 172.21.15.38:0/1776201643 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x556d791c0080 msgr2=0x556d791c2540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:35:26.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:26.862+0000 7f28ad7a4640 0 -- 172.21.15.38:0/1776201643 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f28a003a410 msgr2=0x7f28a003a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:35:27.071 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.069+0000 7f28b04bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:35:27.071 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.069+0000 7f28b04bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:35:27.071 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.069+0000 7f28b04bb800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:35:27.071 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.069+0000 7f28b04bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:35:27.071 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.069+0000 7f28b04bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:35:27.071 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.069+0000 7f28b04bb800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:35:27.071 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.070+0000 7f28b04bb800 20 rados->read ofs=0 len=0 2024-09-22T08:35:27.072 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.070+0000 7f28b04bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:27.073 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.070+0000 7f28b04bb800 20 rados->read ofs=0 len=0 2024-09-22T08:35:27.073 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.070+0000 7f28b04bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:35:27.073 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.070+0000 7f28b04bb800 20 rados->read ofs=0 len=0 2024-09-22T08:35:27.073 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.071+0000 7f28b04bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:35:27.073 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.071+0000 7f28b04bb800 20 zone default found 2024-09-22T08:35:27.073 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.071+0000 7f28b04bb800 4 Realm: () 2024-09-22T08:35:27.073 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.071+0000 7f28b04bb800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:35:27.073 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.071+0000 7f28b04bb800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:35:27.073 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.071+0000 7f28b04bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:35:27.073 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.071+0000 7f28b04bb800 20 zonegroup default 2024-09-22T08:35:27.073 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.071+0000 7f28b04bb800 20 rados->read ofs=0 len=0 2024-09-22T08:35:27.073 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.071+0000 7f28b04bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:27.073 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.071+0000 7f28b04bb800 20 rados->read ofs=0 len=0 2024-09-22T08:35:27.073 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.072+0000 7f28b04bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:27.074 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.072+0000 7f28b04bb800 20 rados->read ofs=0 len=0 2024-09-22T08:35:27.074 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.072+0000 7f28b04bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:27.074 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.072+0000 7f28b04bb800 20 started sync module instance, tier type = 2024-09-22T08:35:27.074 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.072+0000 7f28b04bb800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:35:27.083 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.082+0000 7f28b04bb800 20 add_watcher() i=0 2024-09-22T08:35:27.083 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.082+0000 7f28b04bb800 20 add_watcher() i=1 2024-09-22T08:35:27.083 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.082+0000 7f28b04bb800 20 add_watcher() i=2 2024-09-22T08:35:27.083 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.082+0000 7f28b04bb800 20 add_watcher() i=3 2024-09-22T08:35:27.083 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.082+0000 7f28b04bb800 20 add_watcher() i=4 2024-09-22T08:35:27.083 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.082+0000 7f28b04bb800 20 add_watcher() i=5 2024-09-22T08:35:27.083 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.082+0000 7f28b04bb800 20 add_watcher() i=6 2024-09-22T08:35:27.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.083+0000 7f28b04bb800 20 add_watcher() i=7 2024-09-22T08:35:27.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.083+0000 7f28b04bb800 2 all 8 watchers are set, enabling cache 2024-09-22T08:35:27.086 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.085+0000 7f275f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:35:27.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.085+0000 7f28b04bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:35:27.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.086+0000 7f28b04bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:35:27.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.086+0000 7f28b04bb800 5 note: GC not initialized 2024-09-22T08:35:27.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.086+0000 7f275e7fc640 20 reqs_thread_entry: start 2024-09-22T08:35:27.088 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.086+0000 7f28b04bb800 20 init_complete bucket index max shards: 11 2024-09-22T08:35:27.088 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.086+0000 7f28b04bb800 20 Filter name: none 2024-09-22T08:35:27.088 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.086+0000 7f26d3fff640 20 reqs_thread_entry: start 2024-09-22T08:35:27.088 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.086+0000 7f28b04bb800 20 rados->read ofs=0 len=0 2024-09-22T08:35:27.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.087+0000 7f28b04bb800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:35:27.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.087+0000 7f28b04bb800 20 rados->read ofs=0 len=0 2024-09-22T08:35:27.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.087+0000 7f28b04bb800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:35:27.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.087+0000 7f28b04bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:35:27.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.087+0000 7f28b04bb800 20 rados->read ofs=0 len=0 2024-09-22T08:35:27.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.087+0000 7f28b04bb800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:35:27.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.087+0000 7f28b04bb800 20 rados->read ofs=0 len=0 2024-09-22T08:35:27.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.088+0000 7f28b04bb800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:35:27.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.088+0000 7f28b04bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:35:27.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.090+0000 7f275f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:35:27.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.092+0000 7f28b04bb800 20 remove_watcher() i=0 2024-09-22T08:35:27.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.092+0000 7f28b04bb800 2 removed watcher, disabling cache 2024-09-22T08:35:27.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.094+0000 7f28b04bb800 20 remove_watcher() i=1 2024-09-22T08:35:27.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.095+0000 7f28b04bb800 20 remove_watcher() i=2 2024-09-22T08:35:27.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.096+0000 7f28b04bb800 20 remove_watcher() i=3 2024-09-22T08:35:27.098 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.097+0000 7f28b04bb800 20 remove_watcher() i=4 2024-09-22T08:35:27.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.098+0000 7f28b04bb800 20 remove_watcher() i=5 2024-09-22T08:35:27.100 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.099+0000 7f28b04bb800 20 remove_watcher() i=6 2024-09-22T08:35:27.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.100+0000 7f28b04bb800 20 remove_watcher() i=7 2024-09-22T08:35:27.112 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:27.113 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:35:27.113 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-commit-target-layout id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.30 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-22T08:35:27.113 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:27.115 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:27.115 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:27.118 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:27.118 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:27.161 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:27.162 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:27.193 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-22T08:35:27.193 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:27.194 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:27.194 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:27.206 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:27.206 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:27.248 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:27.248 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:27.255 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:27.255 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:27.261 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:27.261 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:27.267 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:27.267 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:27.273 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:27.274 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:27.280 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:27.280 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:27.285 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:27.285 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:27.291 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:27.291 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:27.297 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:27.297 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:27.303 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:27.303 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:27.309 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:27.309 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:27.315 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:27.315 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:27.321 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:27.321 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:27.328 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:27.328 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:27.333 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:27.333 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:27.339 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:27.339 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:27.345 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:27.345 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:27.351 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:27.352 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:27.357 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:27.357 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:27.362 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:27.363 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:27.370 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-22T08:35:27.400 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:35:27.401 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:35:27.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.439+0000 7f3d5772e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:27.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.441+0000 7f3d5772e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:27.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.441+0000 7f3d5772e800 20 realm 2024-09-22T08:35:27.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.441+0000 7f3d5772e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:27.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.441+0000 7f3d5772e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:27.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.441+0000 7f3d5772e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:35:27.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.441+0000 7f3d5772e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:27.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.441+0000 7f3d5772e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:27.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.441+0000 7f3d5772e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:27.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.442+0000 7f3d5772e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:35:27.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.442+0000 7f3d5772e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:27.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.443+0000 7f3d5772e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:35:27.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.443+0000 7f3d5772e800 20 searching for the correct realm 2024-09-22T08:35:27.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.445+0000 7f3d52cdc640 0 -- 172.21.15.38:0/304940014 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f3d48068bb0 msgr2=0x7f3d48061c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:35:27.651 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.650+0000 7f3d52cdc640 0 -- 172.21.15.38:0/304940014 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f3d4400bbe0 msgr2=0x7f3d4401f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:35:27.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.858+0000 7f3d5772e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:35:27.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.858+0000 7f3d5772e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:35:27.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.858+0000 7f3d5772e800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:35:27.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.858+0000 7f3d5772e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:35:27.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.858+0000 7f3d5772e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:35:27.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.858+0000 7f3d5772e800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:35:27.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.858+0000 7f3d5772e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:27.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.858+0000 7f3d5772e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:27.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.858+0000 7f3d5772e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:27.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.859+0000 7f3d5772e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:35:27.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.859+0000 7f3d5772e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:27.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.859+0000 7f3d5772e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:35:27.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.859+0000 7f3d5772e800 20 zone default found 2024-09-22T08:35:27.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.859+0000 7f3d5772e800 4 Realm: () 2024-09-22T08:35:27.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.859+0000 7f3d5772e800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:35:27.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.859+0000 7f3d5772e800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:35:27.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.859+0000 7f3d5772e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:35:27.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.859+0000 7f3d5772e800 20 zonegroup default 2024-09-22T08:35:27.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.859+0000 7f3d5772e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:27.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.859+0000 7f3d5772e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:27.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.859+0000 7f3d5772e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:27.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.860+0000 7f3d5772e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:27.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.860+0000 7f3d5772e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:27.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.860+0000 7f3d5772e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:27.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.860+0000 7f3d5772e800 20 started sync module instance, tier type = 2024-09-22T08:35:27.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.860+0000 7f3d5772e800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:35:27.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.870+0000 7f3d5772e800 20 add_watcher() i=0 2024-09-22T08:35:27.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.870+0000 7f3d5772e800 20 add_watcher() i=1 2024-09-22T08:35:27.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.870+0000 7f3d5772e800 20 add_watcher() i=2 2024-09-22T08:35:27.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.870+0000 7f3d5772e800 20 add_watcher() i=3 2024-09-22T08:35:27.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.870+0000 7f3d5772e800 20 add_watcher() i=4 2024-09-22T08:35:27.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.870+0000 7f3d5772e800 20 add_watcher() i=5 2024-09-22T08:35:27.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.870+0000 7f3d5772e800 20 add_watcher() i=6 2024-09-22T08:35:27.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.871+0000 7f3d5772e800 20 add_watcher() i=7 2024-09-22T08:35:27.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.871+0000 7f3d5772e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:35:27.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.873+0000 7f3c09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:35:27.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.873+0000 7f3d5772e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:35:27.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.873+0000 7f3d5772e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:35:27.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.873+0000 7f3d5772e800 5 note: GC not initialized 2024-09-22T08:35:27.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.874+0000 7f3c08fe1640 20 reqs_thread_entry: start 2024-09-22T08:35:27.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.874+0000 7f3d5772e800 20 init_complete bucket index max shards: 11 2024-09-22T08:35:27.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.874+0000 7f3d5772e800 20 Filter name: none 2024-09-22T08:35:27.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.874+0000 7f3b827fc640 20 reqs_thread_entry: start 2024-09-22T08:35:27.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.874+0000 7f3d5772e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:27.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.875+0000 7f3d5772e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:35:27.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.875+0000 7f3d5772e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:27.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.875+0000 7f3d5772e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:35:27.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.875+0000 7f3d5772e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:35:27.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.875+0000 7f3d5772e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:27.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.875+0000 7f3d5772e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:35:27.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.875+0000 7f3d5772e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:27.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.876+0000 7f3d5772e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:35:27.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.876+0000 7f3d5772e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:35:27.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.878+0000 7f3c09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:35:27.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.880+0000 7f3d5772e800 20 remove_watcher() i=0 2024-09-22T08:35:27.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.880+0000 7f3d5772e800 2 removed watcher, disabling cache 2024-09-22T08:35:27.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.881+0000 7f3d5772e800 20 remove_watcher() i=1 2024-09-22T08:35:27.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.882+0000 7f3d5772e800 20 remove_watcher() i=2 2024-09-22T08:35:27.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.884+0000 7f3d5772e800 20 remove_watcher() i=3 2024-09-22T08:35:27.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.885+0000 7f3d5772e800 20 remove_watcher() i=4 2024-09-22T08:35:27.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.886+0000 7f3d5772e800 20 remove_watcher() i=5 2024-09-22T08:35:27.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.887+0000 7f3d5772e800 20 remove_watcher() i=6 2024-09-22T08:35:27.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.888+0000 7f3d5772e800 20 remove_watcher() i=7 2024-09-22T08:35:27.901 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:27.901 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:35:27.901 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-commit-target-layout id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:35:27.901 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:27.903 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-22T08:35:27.940 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:35:27.940 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:35:27.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.979+0000 7ff1a3d73800 20 rados->read ofs=0 len=0 2024-09-22T08:35:27.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.981+0000 7ff1a3d73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:27.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.981+0000 7ff1a3d73800 20 realm 2024-09-22T08:35:27.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.981+0000 7ff1a3d73800 20 rados->read ofs=0 len=0 2024-09-22T08:35:27.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.981+0000 7ff1a3d73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:27.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.981+0000 7ff1a3d73800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:35:27.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.981+0000 7ff1a3d73800 20 rados->read ofs=0 len=0 2024-09-22T08:35:27.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.982+0000 7ff1a3d73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:27.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.982+0000 7ff1a3d73800 20 rados->read ofs=0 len=0 2024-09-22T08:35:27.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.982+0000 7ff1a3d73800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:35:27.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.982+0000 7ff1a3d73800 20 rados->read ofs=0 len=0 2024-09-22T08:35:27.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.983+0000 7ff1a3d73800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:35:27.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.983+0000 7ff1a3d73800 20 searching for the correct realm 2024-09-22T08:35:27.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:27.985+0000 7ff1a105c640 0 -- 172.21.15.38:0/244357014 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7ff19806c9f0 msgr2=0x7ff19806b460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:35:28.191 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.190+0000 7ff1a105c640 0 -- 172.21.15.38:0/244357014 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7ff194072610 msgr2=0x7ff194035360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:35:28.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.398+0000 7ff1a3d73800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:35:28.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.398+0000 7ff1a3d73800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:35:28.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.398+0000 7ff1a3d73800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:35:28.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.398+0000 7ff1a3d73800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:35:28.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.398+0000 7ff1a3d73800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:35:28.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.398+0000 7ff1a3d73800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:35:28.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.398+0000 7ff1a3d73800 20 rados->read ofs=0 len=0 2024-09-22T08:35:28.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.398+0000 7ff1a3d73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:28.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.398+0000 7ff1a3d73800 20 rados->read ofs=0 len=0 2024-09-22T08:35:28.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.399+0000 7ff1a3d73800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:35:28.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.399+0000 7ff1a3d73800 20 rados->read ofs=0 len=0 2024-09-22T08:35:28.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.399+0000 7ff1a3d73800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:35:28.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.399+0000 7ff1a3d73800 20 zone default found 2024-09-22T08:35:28.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.399+0000 7ff1a3d73800 4 Realm: () 2024-09-22T08:35:28.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.399+0000 7ff1a3d73800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:35:28.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.399+0000 7ff1a3d73800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:35:28.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.399+0000 7ff1a3d73800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:35:28.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.399+0000 7ff1a3d73800 20 zonegroup default 2024-09-22T08:35:28.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.399+0000 7ff1a3d73800 20 rados->read ofs=0 len=0 2024-09-22T08:35:28.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.399+0000 7ff1a3d73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:28.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.399+0000 7ff1a3d73800 20 rados->read ofs=0 len=0 2024-09-22T08:35:28.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.400+0000 7ff1a3d73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:28.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.400+0000 7ff1a3d73800 20 rados->read ofs=0 len=0 2024-09-22T08:35:28.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.400+0000 7ff1a3d73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:28.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.400+0000 7ff1a3d73800 20 started sync module instance, tier type = 2024-09-22T08:35:28.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.400+0000 7ff1a3d73800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:35:28.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.410+0000 7ff1a3d73800 20 add_watcher() i=0 2024-09-22T08:35:28.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.410+0000 7ff1a3d73800 20 add_watcher() i=1 2024-09-22T08:35:28.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.410+0000 7ff1a3d73800 20 add_watcher() i=2 2024-09-22T08:35:28.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.410+0000 7ff1a3d73800 20 add_watcher() i=3 2024-09-22T08:35:28.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.410+0000 7ff1a3d73800 20 add_watcher() i=4 2024-09-22T08:35:28.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.410+0000 7ff1a3d73800 20 add_watcher() i=5 2024-09-22T08:35:28.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.410+0000 7ff1a3d73800 20 add_watcher() i=6 2024-09-22T08:35:28.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.412+0000 7ff1a3d73800 20 add_watcher() i=7 2024-09-22T08:35:28.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.412+0000 7ff1a3d73800 2 all 8 watchers are set, enabling cache 2024-09-22T08:35:28.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.414+0000 7ff0537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:35:28.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.414+0000 7ff1a3d73800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:35:28.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.414+0000 7ff1a3d73800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:35:28.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.414+0000 7ff1a3d73800 5 note: GC not initialized 2024-09-22T08:35:28.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.414+0000 7ff0527fc640 20 reqs_thread_entry: start 2024-09-22T08:35:28.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.414+0000 7ff1a3d73800 20 init_complete bucket index max shards: 11 2024-09-22T08:35:28.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.414+0000 7ff1a3d73800 20 Filter name: none 2024-09-22T08:35:28.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.415+0000 7fefc3fff640 20 reqs_thread_entry: start 2024-09-22T08:35:28.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.415+0000 7ff1a3d73800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-22T08:35:28.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.415+0000 7ff1a3d73800 20 rados->read ofs=0 len=0 2024-09-22T08:35:28.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.415+0000 7ff1a3d73800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:35:28.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.415+0000 7ff1a3d73800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-22T08:35:28.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.415+0000 7ff1a3d73800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-22T08:35:28.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.415+0000 7ff1a3d73800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.31 : miss 2024-09-22T08:35:28.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.415+0000 7ff1a3d73800 20 rados->read ofs=0 len=0 2024-09-22T08:35:28.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.415+0000 7ff1a3d73800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:35:28.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.415+0000 7ff1a3d73800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.31 info.flags=0x17 2024-09-22T08:35:28.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.415+0000 7ff1a3d73800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.31 to cache LRU end 2024-09-22T08:35:28.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.415+0000 7ff1a3d73800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:35:28.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.415+0000 7ff1a3d73800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:35:28.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.415+0000 7ff1a3d73800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.31 2024-09-22T08:35:28.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.421+0000 7ff1a3d73800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.31 info.flags=0x17 2024-09-22T08:35:28.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.421+0000 7ff1a3d73800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.31 to cache LRU end 2024-09-22T08:35:28.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.421+0000 7ff1a3d73800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:35:28.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.421+0000 7ff1a3d73800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.31, ofs0, ns] 2024-09-22T08:35:28.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.421+0000 7ff084ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497002 cookie 93995018388288 notifier 6791 bl.length()=931 2024-09-22T08:35:28.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.421+0000 7ff084ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.31 info.flags=0x17 2024-09-22T08:35:28.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.421+0000 7ff084ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.31 to cache LRU end 2024-09-22T08:35:28.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.421+0000 7ff084ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:35:28.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.422+0000 7ff1a3d73800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.31]): orig_sources= new_sources= 2024-09-22T08:35:28.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.422+0000 7ff1a3d73800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.31]): potential sources added=[] removed=[] 2024-09-22T08:35:28.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.422+0000 7ff1a3d73800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.31]): orig_dests= new_dests= 2024-09-22T08:35:28.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.422+0000 7ff1a3d73800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.31]): potential dests added=[] removed=[] 2024-09-22T08:35:28.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.428+0000 7ff1a3d73800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.1.0 2024-09-22T08:35:28.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.428+0000 7ff1a3d73800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.1.0 2024-09-22T08:35:28.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.428+0000 7ff1a3d73800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.1.1 2024-09-22T08:35:28.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.428+0000 7ff1a3d73800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.1.1 2024-09-22T08:35:28.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.428+0000 7ff1a3d73800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.1.2 2024-09-22T08:35:28.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.428+0000 7ff1a3d73800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.1.2 2024-09-22T08:35:28.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.428+0000 7ff1a3d73800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.1.3 2024-09-22T08:35:28.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.428+0000 7ff1a3d73800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.1.3 2024-09-22T08:35:28.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.428+0000 7ff1a3d73800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.1.4 2024-09-22T08:35:28.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.428+0000 7ff1a3d73800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.1.4 2024-09-22T08:35:28.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.428+0000 7ff1a3d73800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.1.5 2024-09-22T08:35:28.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.428+0000 7ff1a3d73800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.1.5 2024-09-22T08:35:28.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.428+0000 7ff1a3d73800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.1.6 2024-09-22T08:35:28.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.428+0000 7ff1a3d73800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.1.6 2024-09-22T08:35:28.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.428+0000 7ff1a3d73800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.1.7 2024-09-22T08:35:28.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.428+0000 7ff1a3d73800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.1.7 2024-09-22T08:35:28.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.428+0000 7ff1a3d73800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.1.8 2024-09-22T08:35:28.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.428+0000 7ff1a3d73800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.1.8 2024-09-22T08:35:28.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.428+0000 7ff1a3d73800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.1.9 2024-09-22T08:35:28.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.428+0000 7ff1a3d73800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.1.9 2024-09-22T08:35:28.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.428+0000 7ff1a3d73800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.1.10 2024-09-22T08:35:28.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.428+0000 7ff1a3d73800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.1.10 2024-09-22T08:35:28.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.428+0000 7ff1a3d73800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.1.11 2024-09-22T08:35:28.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.428+0000 7ff1a3d73800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.1.11 2024-09-22T08:35:28.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.428+0000 7ff1a3d73800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.0 2024-09-22T08:35:28.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.429+0000 7ff1a3d73800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.1 2024-09-22T08:35:28.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.429+0000 7ff1a3d73800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.2 2024-09-22T08:35:28.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.430+0000 7ff1a3d73800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.3 2024-09-22T08:35:28.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.431+0000 7ff1a3d73800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.4 2024-09-22T08:35:28.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.431+0000 7ff1a3d73800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.5 2024-09-22T08:35:28.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.432+0000 7ff1a3d73800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.6 2024-09-22T08:35:28.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.432+0000 7ff1a3d73800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.7 2024-09-22T08:35:28.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.433+0000 7ff1a3d73800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.8 2024-09-22T08:35:28.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.433+0000 7ff1a3d73800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.9 2024-09-22T08:35:28.435 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.434+0000 7ff1a3d73800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.10 2024-09-22T08:35:28.439 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.438+0000 7ff1a3d73800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.31 : hit (requested=0x17, cached=0x17) 2024-09-22T08:35:28.439 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.438+0000 7ff1a3d73800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.31 2024-09-22T08:35:28.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.439+0000 7ff1a3d73800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.31 info.flags=0x17 2024-09-22T08:35:28.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.439+0000 7ff1a3d73800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.31 to cache LRU end 2024-09-22T08:35:28.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.439+0000 7ff1a3d73800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:35:28.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.439+0000 7ff1a3d73800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.31, ofs0, ns] 2024-09-22T08:35:28.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.440+0000 7ff084ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497003 cookie 93995018388288 notifier 6791 bl.length()=931 2024-09-22T08:35:28.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.440+0000 7ff084ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.31 info.flags=0x17 2024-09-22T08:35:28.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.440+0000 7ff084ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.31 to cache LRU end 2024-09-22T08:35:28.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.440+0000 7ff084ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:35:28.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.440+0000 7ff1a3d73800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.31]): orig_sources= new_sources= 2024-09-22T08:35:28.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.440+0000 7ff1a3d73800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.31]): potential sources added=[] removed=[] 2024-09-22T08:35:28.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.440+0000 7ff1a3d73800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.31]): orig_dests= new_dests= 2024-09-22T08:35:28.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.440+0000 7ff1a3d73800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.31]): potential dests added=[] removed=[] 2024-09-22T08:35:28.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.443+0000 7ff1a3d73800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.0 2024-09-22T08:35:28.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.443+0000 7ff1a3d73800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.1 2024-09-22T08:35:28.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.444+0000 7ff1a3d73800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.2 2024-09-22T08:35:28.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.444+0000 7ff1a3d73800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.3 2024-09-22T08:35:28.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.444+0000 7ff1a3d73800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.4 2024-09-22T08:35:28.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.445+0000 7ff1a3d73800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.5 2024-09-22T08:35:28.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.445+0000 7ff1a3d73800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.6 2024-09-22T08:35:28.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.446+0000 7ff1a3d73800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.7 2024-09-22T08:35:28.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.446+0000 7ff1a3d73800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.8 2024-09-22T08:35:28.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.446+0000 7ff1a3d73800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.9 2024-09-22T08:35:28.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.447+0000 7ff1a3d73800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.31.10 2024-09-22T08:35:28.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.447+0000 7ff1a3d73800 -1 Injecting error=-125 at location=commit_target_layout 2024-09-22T08:35:28.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.447+0000 7ff1a3d73800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.31 : hit (requested=0x17, cached=0x17) 2024-09-22T08:35:28.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.447+0000 7ff1a3d73800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.31 2024-09-22T08:35:28.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.449+0000 7ff1a3d73800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.31 info.flags=0x17 2024-09-22T08:35:28.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.449+0000 7ff1a3d73800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.31 to cache LRU end 2024-09-22T08:35:28.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.449+0000 7ff1a3d73800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:35:28.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.449+0000 7ff1a3d73800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.31, ofs0, ns] 2024-09-22T08:35:28.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.449+0000 7ff084ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497004 cookie 93995018388288 notifier 6791 bl.length()=899 2024-09-22T08:35:28.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.449+0000 7ff084ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.31 info.flags=0x17 2024-09-22T08:35:28.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.449+0000 7ff084ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.31 to cache LRU end 2024-09-22T08:35:28.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.449+0000 7ff084ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:35:28.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.449+0000 7ff1a3d73800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.31]): orig_sources= new_sources= 2024-09-22T08:35:28.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.449+0000 7ff1a3d73800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.31]): potential sources added=[] removed=[] 2024-09-22T08:35:28.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.449+0000 7ff1a3d73800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.31]): orig_dests= new_dests= 2024-09-22T08:35:28.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.449+0000 7ff1a3d73800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.31]): potential dests added=[] removed=[] 2024-09-22T08:35:28.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.452+0000 7ff1a3d73800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-22T08:35:28.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.454+0000 7ff0537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:35:28.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.456+0000 7ff1a3d73800 20 remove_watcher() i=0 2024-09-22T08:35:28.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.456+0000 7ff1a3d73800 2 removed watcher, disabling cache 2024-09-22T08:35:28.458 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.457+0000 7ff1a3d73800 20 remove_watcher() i=1 2024-09-22T08:35:28.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.459+0000 7ff1a3d73800 20 remove_watcher() i=2 2024-09-22T08:35:28.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.460+0000 7ff1a3d73800 20 remove_watcher() i=3 2024-09-22T08:35:28.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.461+0000 7ff1a3d73800 20 remove_watcher() i=4 2024-09-22T08:35:28.463 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.462+0000 7ff1a3d73800 20 remove_watcher() i=5 2024-09-22T08:35:28.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.463+0000 7ff1a3d73800 20 remove_watcher() i=6 2024-09-22T08:35:28.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.464+0000 7ff1a3d73800 20 remove_watcher() i=7 2024-09-22T08:35:28.478 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-22T08:35:28.508 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:35:28.508 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:35:28.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.547+0000 7fe42f614800 20 rados->read ofs=0 len=0 2024-09-22T08:35:28.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.549+0000 7fe42f614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:28.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.549+0000 7fe42f614800 20 realm 2024-09-22T08:35:28.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.549+0000 7fe42f614800 20 rados->read ofs=0 len=0 2024-09-22T08:35:28.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.549+0000 7fe42f614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:28.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.549+0000 7fe42f614800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:35:28.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.549+0000 7fe42f614800 20 rados->read ofs=0 len=0 2024-09-22T08:35:28.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.549+0000 7fe42f614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:28.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.549+0000 7fe42f614800 20 rados->read ofs=0 len=0 2024-09-22T08:35:28.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.550+0000 7fe42f614800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:35:28.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.550+0000 7fe42f614800 20 rados->read ofs=0 len=0 2024-09-22T08:35:28.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.551+0000 7fe42f614800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:35:28.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.551+0000 7fe42f614800 20 searching for the correct realm 2024-09-22T08:35:28.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.553+0000 7fe42a5df640 0 -- 172.21.15.38:0/195804134 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7fe42006eb90 msgr2=0x7fe4200993c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:35:28.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.557+0000 7fe42a5df640 0 -- 172.21.15.38:0/195804134 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fe41c0ae5e0 msgr2=0x7fe41c0ad050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:35:28.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.763+0000 7fe42f614800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:35:28.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.764+0000 7fe42f614800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:35:28.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.764+0000 7fe42f614800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:35:28.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.764+0000 7fe42f614800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:35:28.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.764+0000 7fe42f614800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:35:28.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.764+0000 7fe42f614800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:35:28.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.764+0000 7fe42f614800 20 rados->read ofs=0 len=0 2024-09-22T08:35:28.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.764+0000 7fe42f614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:28.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.764+0000 7fe42f614800 20 rados->read ofs=0 len=0 2024-09-22T08:35:28.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.764+0000 7fe42f614800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:35:28.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.764+0000 7fe42f614800 20 rados->read ofs=0 len=0 2024-09-22T08:35:28.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.765+0000 7fe42f614800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:35:28.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.765+0000 7fe42f614800 20 zone default found 2024-09-22T08:35:28.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.765+0000 7fe42f614800 4 Realm: () 2024-09-22T08:35:28.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.765+0000 7fe42f614800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:35:28.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.765+0000 7fe42f614800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:35:28.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.765+0000 7fe42f614800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:35:28.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.765+0000 7fe42f614800 20 zonegroup default 2024-09-22T08:35:28.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.765+0000 7fe42f614800 20 rados->read ofs=0 len=0 2024-09-22T08:35:28.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.765+0000 7fe42f614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:28.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.765+0000 7fe42f614800 20 rados->read ofs=0 len=0 2024-09-22T08:35:28.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.765+0000 7fe42f614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:28.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.765+0000 7fe42f614800 20 rados->read ofs=0 len=0 2024-09-22T08:35:28.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.766+0000 7fe42f614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:28.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.766+0000 7fe42f614800 20 started sync module instance, tier type = 2024-09-22T08:35:28.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.766+0000 7fe42f614800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:35:28.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.776+0000 7fe42f614800 20 add_watcher() i=0 2024-09-22T08:35:28.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.776+0000 7fe42f614800 20 add_watcher() i=1 2024-09-22T08:35:28.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.776+0000 7fe42f614800 20 add_watcher() i=2 2024-09-22T08:35:28.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.776+0000 7fe42f614800 20 add_watcher() i=3 2024-09-22T08:35:28.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.776+0000 7fe42f614800 20 add_watcher() i=4 2024-09-22T08:35:28.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.776+0000 7fe42f614800 20 add_watcher() i=5 2024-09-22T08:35:28.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.776+0000 7fe42f614800 20 add_watcher() i=6 2024-09-22T08:35:28.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.777+0000 7fe42f614800 20 add_watcher() i=7 2024-09-22T08:35:28.779 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.778+0000 7fe42f614800 2 all 8 watchers are set, enabling cache 2024-09-22T08:35:28.780 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.779+0000 7fe2e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:35:28.781 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.780+0000 7fe42f614800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:35:28.781 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.780+0000 7fe42f614800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:35:28.782 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.780+0000 7fe42f614800 5 note: GC not initialized 2024-09-22T08:35:28.782 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.780+0000 7fe25bfff640 20 reqs_thread_entry: start 2024-09-22T08:35:28.782 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.780+0000 7fe42f614800 20 init_complete bucket index max shards: 11 2024-09-22T08:35:28.782 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.780+0000 7fe42f614800 20 Filter name: none 2024-09-22T08:35:28.782 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.780+0000 7fe259ffb640 20 reqs_thread_entry: start 2024-09-22T08:35:28.782 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.780+0000 7fe42f614800 20 rados->read ofs=0 len=0 2024-09-22T08:35:28.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.781+0000 7fe42f614800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:35:28.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.781+0000 7fe42f614800 20 rados->read ofs=0 len=0 2024-09-22T08:35:28.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.781+0000 7fe42f614800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:35:28.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.781+0000 7fe42f614800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:35:28.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.781+0000 7fe42f614800 20 rados->read ofs=0 len=0 2024-09-22T08:35:28.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.782+0000 7fe42f614800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:35:28.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.782+0000 7fe42f614800 20 rados->read ofs=0 len=0 2024-09-22T08:35:28.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.782+0000 7fe42f614800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:35:28.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.782+0000 7fe42f614800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:35:28.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.784+0000 7fe2e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:35:28.787 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.786+0000 7fe42f614800 20 remove_watcher() i=0 2024-09-22T08:35:28.787 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.786+0000 7fe42f614800 2 removed watcher, disabling cache 2024-09-22T08:35:28.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.788+0000 7fe42f614800 20 remove_watcher() i=1 2024-09-22T08:35:28.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.789+0000 7fe42f614800 20 remove_watcher() i=2 2024-09-22T08:35:28.791 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.790+0000 7fe42f614800 20 remove_watcher() i=3 2024-09-22T08:35:28.792 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.791+0000 7fe42f614800 20 remove_watcher() i=4 2024-09-22T08:35:28.793 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.792+0000 7fe42f614800 20 remove_watcher() i=5 2024-09-22T08:35:28.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.793+0000 7fe42f614800 20 remove_watcher() i=6 2024-09-22T08:35:28.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:28.795+0000 7fe42f614800 20 remove_watcher() i=7 2024-09-22T08:35:28.807 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:28.807 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:35:28.807 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-commit-target-layout id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.31 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-22T08:35:28.807 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:28.809 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:28.809 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:28.811 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:28.812 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:28.854 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:28.854 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:28.883 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-22T08:35:28.883 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:28.884 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:28.884 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:28.896 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:28.897 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:28.939 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:28.939 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:28.946 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:28.946 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:28.953 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:28.953 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:28.960 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:28.960 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:28.966 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:28.966 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:28.973 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:28.973 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:28.979 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:28.979 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:28.985 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:28.985 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:28.992 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:28.992 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:28.998 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:28.998 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:29.004 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:29.004 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:29.011 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:29.011 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:29.017 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:29.017 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:29.024 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:29.024 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:29.030 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:29.030 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:29.037 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:29.037 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:29.043 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:29.043 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:29.049 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:29.050 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:29.055 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:29.056 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:29.062 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:29.062 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:35:29.070 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-22T08:35:29.099 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:35:29.100 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:35:29.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.149+0000 7f8fabb75800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.151+0000 7f8fabb75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:29.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.151+0000 7f8fabb75800 20 realm 2024-09-22T08:35:29.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.151+0000 7f8fabb75800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.152+0000 7f8fabb75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:29.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.152+0000 7f8fabb75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:35:29.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.152+0000 7f8fabb75800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.152+0000 7f8fabb75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:29.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.152+0000 7f8fabb75800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.153+0000 7f8fabb75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:35:29.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.153+0000 7f8fabb75800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.153+0000 7f8fabb75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:35:29.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.153+0000 7f8fabb75800 20 searching for the correct realm 2024-09-22T08:35:29.156 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.155+0000 7f8fa8e5e640 0 -- 172.21.15.38:0/821322194 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f8f94070c20 msgr2=0x7f8f9406eac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:35:29.160 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.159+0000 7f8fa8e5e640 0 -- 172.21.15.38:0/821322194 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f8f9c06e4a0 msgr2=0x7f8f9c06de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:35:29.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.366+0000 7f8fabb75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:35:29.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.366+0000 7f8fabb75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:35:29.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.366+0000 7f8fabb75800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:35:29.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.366+0000 7f8fabb75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:35:29.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.366+0000 7f8fabb75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:35:29.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.366+0000 7f8fabb75800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:35:29.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.366+0000 7f8fabb75800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.366+0000 7f8fabb75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:29.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.366+0000 7f8fabb75800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.366+0000 7f8fabb75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:35:29.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.366+0000 7f8fabb75800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.367+0000 7f8fabb75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:35:29.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.367+0000 7f8fabb75800 20 zone default found 2024-09-22T08:35:29.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.367+0000 7f8fabb75800 4 Realm: () 2024-09-22T08:35:29.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.367+0000 7f8fabb75800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:35:29.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.367+0000 7f8fabb75800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:35:29.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.367+0000 7f8fabb75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:35:29.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.367+0000 7f8fabb75800 20 zonegroup default 2024-09-22T08:35:29.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.367+0000 7f8fabb75800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.367+0000 7f8fabb75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:29.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.367+0000 7f8fabb75800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.370 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.368+0000 7f8fabb75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:29.370 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.368+0000 7f8fabb75800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.370 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.368+0000 7f8fabb75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:29.370 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.368+0000 7f8fabb75800 20 started sync module instance, tier type = 2024-09-22T08:35:29.370 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.368+0000 7f8fabb75800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:35:29.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.378+0000 7f8fabb75800 20 add_watcher() i=0 2024-09-22T08:35:29.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.378+0000 7f8fabb75800 20 add_watcher() i=1 2024-09-22T08:35:29.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.378+0000 7f8fabb75800 20 add_watcher() i=2 2024-09-22T08:35:29.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.378+0000 7f8fabb75800 20 add_watcher() i=3 2024-09-22T08:35:29.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.378+0000 7f8fabb75800 20 add_watcher() i=4 2024-09-22T08:35:29.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.378+0000 7f8fabb75800 20 add_watcher() i=5 2024-09-22T08:35:29.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.378+0000 7f8fabb75800 20 add_watcher() i=6 2024-09-22T08:35:29.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.379+0000 7f8fabb75800 20 add_watcher() i=7 2024-09-22T08:35:29.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.379+0000 7f8fabb75800 2 all 8 watchers are set, enabling cache 2024-09-22T08:35:29.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.380+0000 7f8e5f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:35:29.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.380+0000 7f8fabb75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:35:29.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.380+0000 7f8fabb75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:35:29.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.380+0000 7f8fabb75800 5 note: GC not initialized 2024-09-22T08:35:29.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.381+0000 7f8e5e7e4640 20 reqs_thread_entry: start 2024-09-22T08:35:29.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.381+0000 7f8fabb75800 20 init_complete bucket index max shards: 11 2024-09-22T08:35:29.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.381+0000 7f8fabb75800 20 Filter name: none 2024-09-22T08:35:29.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.381+0000 7f8dcffff640 20 reqs_thread_entry: start 2024-09-22T08:35:29.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.381+0000 7f8fabb75800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.382+0000 7f8fabb75800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:35:29.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.382+0000 7f8fabb75800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.382+0000 7f8fabb75800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:35:29.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.382+0000 7f8fabb75800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:35:29.384 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.382+0000 7f8fabb75800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.384 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.383+0000 7f8fabb75800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:35:29.384 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.383+0000 7f8fabb75800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.384 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.383+0000 7f8fabb75800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:35:29.384 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.383+0000 7f8fabb75800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:35:29.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.385+0000 7f8e5f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:35:29.388 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.387+0000 7f8fabb75800 20 remove_watcher() i=0 2024-09-22T08:35:29.388 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.387+0000 7f8fabb75800 2 removed watcher, disabling cache 2024-09-22T08:35:29.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.388+0000 7f8fabb75800 20 remove_watcher() i=1 2024-09-22T08:35:29.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.389+0000 7f8fabb75800 20 remove_watcher() i=2 2024-09-22T08:35:29.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.390+0000 7f8fabb75800 20 remove_watcher() i=3 2024-09-22T08:35:29.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.391+0000 7f8fabb75800 20 remove_watcher() i=4 2024-09-22T08:35:29.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.392+0000 7f8fabb75800 20 remove_watcher() i=5 2024-09-22T08:35:29.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.393+0000 7f8fabb75800 20 remove_watcher() i=6 2024-09-22T08:35:29.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.394+0000 7f8fabb75800 20 remove_watcher() i=7 2024-09-22T08:35:29.406 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:29.406 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:35:29.406 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-commit-target-layout id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:35:29.406 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:29.407 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-22T08:35:29.443 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:35:29.443 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:35:29.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.481+0000 7fd161339800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.483+0000 7fd161339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:29.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.483+0000 7fd161339800 20 realm 2024-09-22T08:35:29.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.483+0000 7fd161339800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.483+0000 7fd161339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:29.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.483+0000 7fd161339800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:35:29.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.483+0000 7fd161339800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.484+0000 7fd161339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:29.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.484+0000 7fd161339800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.485+0000 7fd161339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:35:29.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.485+0000 7fd161339800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.485+0000 7fd161339800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:35:29.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.485+0000 7fd161339800 20 searching for the correct realm 2024-09-22T08:35:29.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.488+0000 7fd15d7c8640 0 -- 172.21.15.38:0/3124990968 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7fd150058930 msgr2=0x7fd1500b0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:35:29.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.694+0000 7fd15d7c8640 0 -- 172.21.15.38:0/3124990968 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x559ee23a4650 msgr2=0x559ee23a6b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:35:29.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.698+0000 7fd161339800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:35:29.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.698+0000 7fd161339800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:35:29.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.698+0000 7fd161339800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:35:29.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.698+0000 7fd161339800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:35:29.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.698+0000 7fd161339800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:35:29.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.698+0000 7fd161339800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:35:29.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.698+0000 7fd161339800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.699+0000 7fd161339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:29.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.699+0000 7fd161339800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.699+0000 7fd161339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:35:29.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.699+0000 7fd161339800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.699+0000 7fd161339800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:35:29.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.699+0000 7fd161339800 20 zone default found 2024-09-22T08:35:29.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.699+0000 7fd161339800 4 Realm: () 2024-09-22T08:35:29.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.699+0000 7fd161339800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:35:29.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.699+0000 7fd161339800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:35:29.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.699+0000 7fd161339800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:35:29.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.699+0000 7fd161339800 20 zonegroup default 2024-09-22T08:35:29.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.699+0000 7fd161339800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.700+0000 7fd161339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:29.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.700+0000 7fd161339800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.700+0000 7fd161339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:29.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.700+0000 7fd161339800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.701+0000 7fd161339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:29.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.701+0000 7fd161339800 20 started sync module instance, tier type = 2024-09-22T08:35:29.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.701+0000 7fd161339800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:35:29.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.710+0000 7fd161339800 20 add_watcher() i=0 2024-09-22T08:35:29.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.710+0000 7fd161339800 20 add_watcher() i=1 2024-09-22T08:35:29.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.710+0000 7fd161339800 20 add_watcher() i=2 2024-09-22T08:35:29.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.710+0000 7fd161339800 20 add_watcher() i=3 2024-09-22T08:35:29.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.710+0000 7fd161339800 20 add_watcher() i=4 2024-09-22T08:35:29.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.710+0000 7fd161339800 20 add_watcher() i=5 2024-09-22T08:35:29.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.710+0000 7fd161339800 20 add_watcher() i=6 2024-09-22T08:35:29.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.712+0000 7fd161339800 20 add_watcher() i=7 2024-09-22T08:35:29.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.712+0000 7fd161339800 2 all 8 watchers are set, enabling cache 2024-09-22T08:35:29.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.714+0000 7fd012fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:35:29.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.714+0000 7fd161339800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:35:29.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.714+0000 7fd161339800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:35:29.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.714+0000 7fd161339800 5 note: GC not initialized 2024-09-22T08:35:29.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.714+0000 7fd011fe3640 20 reqs_thread_entry: start 2024-09-22T08:35:29.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.714+0000 7fd161339800 20 init_complete bucket index max shards: 11 2024-09-22T08:35:29.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.714+0000 7fd161339800 20 Filter name: none 2024-09-22T08:35:29.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.715+0000 7fcf837fe640 20 reqs_thread_entry: start 2024-09-22T08:35:29.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.715+0000 7fd161339800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-22T08:35:29.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.715+0000 7fd161339800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.717 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.715+0000 7fd161339800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:35:29.717 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.715+0000 7fd161339800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-22T08:35:29.717 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.715+0000 7fd161339800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-22T08:35:29.717 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.715+0000 7fd161339800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 : miss 2024-09-22T08:35:29.717 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.715+0000 7fd161339800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.717 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.716+0000 7fd161339800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:35:29.717 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.716+0000 7fd161339800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 info.flags=0x17 2024-09-22T08:35:29.717 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.716+0000 7fd161339800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 to cache LRU end 2024-09-22T08:35:29.717 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.716+0000 7fd161339800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:35:29.717 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.716+0000 7fd161339800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:35:29.717 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.716+0000 7fd161339800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 2024-09-22T08:35:29.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.721+0000 7fd161339800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 info.flags=0x17 2024-09-22T08:35:29.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.721+0000 7fd161339800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 to cache LRU end 2024-09-22T08:35:29.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.721+0000 7fd161339800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:35:29.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.721+0000 7fd161339800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32, ofs0, ns] 2024-09-22T08:35:29.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.722+0000 7fd033fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497008 cookie 94140888731520 notifier 6842 bl.length()=931 2024-09-22T08:35:29.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.722+0000 7fd033fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 info.flags=0x17 2024-09-22T08:35:29.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.722+0000 7fd033fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 to cache LRU end 2024-09-22T08:35:29.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.722+0000 7fd033fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:35:29.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.722+0000 7fd161339800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.32]): orig_sources= new_sources= 2024-09-22T08:35:29.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.722+0000 7fd161339800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.32]): potential sources added=[] removed=[] 2024-09-22T08:35:29.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.722+0000 7fd161339800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.32]): orig_dests= new_dests= 2024-09-22T08:35:29.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.722+0000 7fd161339800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.32]): potential dests added=[] removed=[] 2024-09-22T08:35:29.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.727+0000 7fd161339800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.0 2024-09-22T08:35:29.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.0 2024-09-22T08:35:29.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.728+0000 7fd161339800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.1 2024-09-22T08:35:29.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.1 2024-09-22T08:35:29.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.728+0000 7fd161339800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.2 2024-09-22T08:35:29.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.2 2024-09-22T08:35:29.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.728+0000 7fd161339800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.3 2024-09-22T08:35:29.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.3 2024-09-22T08:35:29.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.728+0000 7fd161339800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.4 2024-09-22T08:35:29.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.4 2024-09-22T08:35:29.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.728+0000 7fd161339800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.5 2024-09-22T08:35:29.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.5 2024-09-22T08:35:29.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.728+0000 7fd161339800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.6 2024-09-22T08:35:29.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.6 2024-09-22T08:35:29.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.728+0000 7fd161339800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.7 2024-09-22T08:35:29.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.7 2024-09-22T08:35:29.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.728+0000 7fd161339800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.8 2024-09-22T08:35:29.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.8 2024-09-22T08:35:29.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.728+0000 7fd161339800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.9 2024-09-22T08:35:29.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.9 2024-09-22T08:35:29.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.728+0000 7fd161339800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.10 2024-09-22T08:35:29.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.10 2024-09-22T08:35:29.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.728+0000 7fd161339800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.11 2024-09-22T08:35:29.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.11 2024-09-22T08:35:29.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.0 2024-09-22T08:35:29.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1 2024-09-22T08:35:29.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.729+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.2 2024-09-22T08:35:29.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.729+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.3 2024-09-22T08:35:29.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.730+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.4 2024-09-22T08:35:29.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.730+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.5 2024-09-22T08:35:29.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.731+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.6 2024-09-22T08:35:29.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.731+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.7 2024-09-22T08:35:29.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.732+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.8 2024-09-22T08:35:29.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.732+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.9 2024-09-22T08:35:29.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.733+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.10 2024-09-22T08:35:29.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.736+0000 7fd161339800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 : hit (requested=0x17, cached=0x17) 2024-09-22T08:35:29.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.736+0000 7fd161339800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 2024-09-22T08:35:29.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.737+0000 7fd161339800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 info.flags=0x17 2024-09-22T08:35:29.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.737+0000 7fd161339800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 to cache LRU end 2024-09-22T08:35:29.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.737+0000 7fd161339800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:35:29.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.737+0000 7fd161339800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32, ofs0, ns] 2024-09-22T08:35:29.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.738+0000 7fd0337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497009 cookie 94140888731520 notifier 6842 bl.length()=931 2024-09-22T08:35:29.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.738+0000 7fd0337fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 info.flags=0x17 2024-09-22T08:35:29.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.738+0000 7fd0337fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 to cache LRU end 2024-09-22T08:35:29.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.738+0000 7fd0337fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:35:29.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.738+0000 7fd161339800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.32]): orig_sources= new_sources= 2024-09-22T08:35:29.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.738+0000 7fd161339800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.32]): potential sources added=[] removed=[] 2024-09-22T08:35:29.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.738+0000 7fd161339800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.32]): orig_dests= new_dests= 2024-09-22T08:35:29.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.738+0000 7fd161339800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.32]): potential dests added=[] removed=[] 2024-09-22T08:35:29.741 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.741+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.0 2024-09-22T08:35:29.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.741+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1 2024-09-22T08:35:29.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.741+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.2 2024-09-22T08:35:29.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.742+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.3 2024-09-22T08:35:29.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.742+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.4 2024-09-22T08:35:29.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.742+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.5 2024-09-22T08:35:29.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.743+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.6 2024-09-22T08:35:29.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.743+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.7 2024-09-22T08:35:29.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.743+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.8 2024-09-22T08:35:29.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.744+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.9 2024-09-22T08:35:29.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.744+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.10 2024-09-22T08:35:29.745 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd161339800 time 2024-09-22T08:35:29.745638+0000 2024-09-22T08:35:29.745 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:35:29.746 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:35:29.746 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd16298c748] 2024-09-22T08:35:29.747 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fd16298c906] 2024-09-22T08:35:29.747 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559edf71be01] 2024-09-22T08:35:29.747 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x559edf72bfb7] 2024-09-22T08:35:29.747 INFO:tasks.workunit.client.0.smithi038.stderr: 5: main() 2024-09-22T08:35:29.747 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fd161629590] 2024-09-22T08:35:29.747 INFO:tasks.workunit.client.0.smithi038.stderr: 7: __libc_start_main() 2024-09-22T08:35:29.747 INFO:tasks.workunit.client.0.smithi038.stderr: 8: _start() 2024-09-22T08:35:29.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.745+0000 7fd161339800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd161339800 time 2024-09-22T08:35:29.745638+0000 2024-09-22T08:35:29.747 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:35:29.747 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:29.747 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:35:29.747 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd16298c748] 2024-09-22T08:35:29.747 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fd16298c906] 2024-09-22T08:35:29.747 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559edf71be01] 2024-09-22T08:35:29.748 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x559edf72bfb7] 2024-09-22T08:35:29.748 INFO:tasks.workunit.client.0.smithi038.stderr: 5: main() 2024-09-22T08:35:29.748 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fd161629590] 2024-09-22T08:35:29.748 INFO:tasks.workunit.client.0.smithi038.stderr: 7: __libc_start_main() 2024-09-22T08:35:29.748 INFO:tasks.workunit.client.0.smithi038.stderr: 8: _start() 2024-09-22T08:35:29.748 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:29.748 INFO:tasks.workunit.client.0.smithi038.stderr:*** Caught signal (Aborted) ** 2024-09-22T08:35:29.748 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7fd161339800 thread_name:radosgw-admin 2024-09-22T08:35:29.761 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:35:29.761 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd16163e6f0] 2024-09-22T08:35:29.762 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd16168b99c] 2024-09-22T08:35:29.762 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:35:29.762 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:35:29.762 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd16298c7a2] 2024-09-22T08:35:29.762 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fd16298c906] 2024-09-22T08:35:29.762 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559edf71be01] 2024-09-22T08:35:29.762 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x559edf72bfb7] 2024-09-22T08:35:29.762 INFO:tasks.workunit.client.0.smithi038.stderr: 9: main() 2024-09-22T08:35:29.762 INFO:tasks.workunit.client.0.smithi038.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fd161629590] 2024-09-22T08:35:29.762 INFO:tasks.workunit.client.0.smithi038.stderr: 11: __libc_start_main() 2024-09-22T08:35:29.762 INFO:tasks.workunit.client.0.smithi038.stderr: 12: _start() 2024-09-22T08:35:29.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.746+0000 7fd161339800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:35:29.762 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7fd161339800 thread_name:radosgw-admin 2024-09-22T08:35:29.763 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:29.763 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:35:29.763 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd16163e6f0] 2024-09-22T08:35:29.763 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd16168b99c] 2024-09-22T08:35:29.763 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:35:29.763 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:35:29.763 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd16298c7a2] 2024-09-22T08:35:29.763 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fd16298c906] 2024-09-22T08:35:29.763 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559edf71be01] 2024-09-22T08:35:29.763 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x559edf72bfb7] 2024-09-22T08:35:29.763 INFO:tasks.workunit.client.0.smithi038.stderr: 9: main() 2024-09-22T08:35:29.763 INFO:tasks.workunit.client.0.smithi038.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fd161629590] 2024-09-22T08:35:29.763 INFO:tasks.workunit.client.0.smithi038.stderr: 11: __libc_start_main() 2024-09-22T08:35:29.763 INFO:tasks.workunit.client.0.smithi038.stderr: 12: _start() 2024-09-22T08:35:29.763 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:35:29.764 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:29.764 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-22T08:35:29.764 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-22T08:35:29.465+0000 7fd161339800 10 monclient(hunting): start opening mon connection 2024-09-22T08:35:29.764 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-22T08:35:29.465+0000 7fd161339800 10 monclient(hunting): start opening mon connection 2024-09-22T08:35:29.764 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-22T08:35:29.465+0000 7fd161339800 10 monclient(hunting): _renew_subs 2024-09-22T08:35:29.764 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-22T08:35:29.465+0000 7fd161339800 10 monclient(hunting): authenticate will time out at 2034.704780s 2024-09-22T08:35:29.764 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-22T08:35:29.465+0000 7fd15cfc7640 10 monclient(hunting): get_auth_request con 0x559ee2164510 auth_method 0 2024-09-22T08:35:29.764 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-22T08:35:29.465+0000 7fd15cfc7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:35:29.764 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-22T08:35:29.465+0000 7fd15cfc7640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:35:29.764 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-22T08:35:29.465+0000 7fd15cfc7640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:35:29.764 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-22T08:35:29.465+0000 7fd15d7c8640 10 monclient(hunting): get_auth_request con 0x559ee21fdef0 auth_method 0 2024-09-22T08:35:29.764 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-22T08:35:29.465+0000 7fd15d7c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:35:29.764 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-22T08:35:29.465+0000 7fd15d7c8640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:35:29.764 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-22T08:35:29.465+0000 7fd15d7c8640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:35:29.764 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-22T08:35:29.465+0000 7fd15cfc7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:35:29.765 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-22T08:35:29.465+0000 7fd15cfc7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:35:29.765 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-22T08:35:29.465+0000 7fd15cfc7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:35:29.765 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-22T08:35:29.465+0000 7fd15d7c8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:35:29.765 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-22T08:35:29.465+0000 7fd15d7c8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:35:29.765 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-22T08:35:29.465+0000 7fd15d7c8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:35:29.765 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-22T08:35:29.466+0000 7fd157fff640 10 monclient(hunting): get_auth_request con 0x559ee216d5b0 auth_method 0 2024-09-22T08:35:29.765 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-22T08:35:29.466+0000 7fd157fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:35:29.765 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-22T08:35:29.466+0000 7fd157fff640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:35:29.765 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-22T08:35:29.466+0000 7fd157fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:35:29.765 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-22T08:35:29.466+0000 7fd15cfc7640 10 monclient(hunting): handle_auth_done global_id 6833 payload 824 2024-09-22T08:35:29.765 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-22T08:35:29.466+0000 7fd15cfc7640 10 monclient: _finish_hunting 0 2024-09-22T08:35:29.765 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-22T08:35:29.466+0000 7fd15cfc7640 1 monclient: found mon.noname-c 2024-09-22T08:35:29.765 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-22T08:35:29.466+0000 7fd15cfc7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:35:29.765 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-22T08:35:29.466+0000 7fd049602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:35:29.765 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-22T08:35:29.466+0000 7fd049602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:35:29.766 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-22T08:35:29.466+0000 7fd049602640 10 monclient: dump: 2024-09-22T08:35:29.766 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:35:29.766 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:35:29.766 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:35:29.766 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:35:29.766 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:35:29.766 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:35:29.766 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:35:29.766 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:35:29.766 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:35:29.766 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:29.766 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-22T08:35:29.466+0000 7fd049602640 10 monclient: _finish_auth 0 2024-09-22T08:35:29.766 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-22T08:35:29.466+0000 7fd049602640 10 monclient: _check_auth_tickets 2024-09-22T08:35:29.766 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-22T08:35:29.466+0000 7fd049602640 10 monclient: handle_config config(0 keys) 2024-09-22T08:35:29.767 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-22T08:35:29.466+0000 7fd049602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:35:29.767 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-22T08:35:29.466+0000 7fd049602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:35:29.767 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-22T08:35:29.466+0000 7fd049602640 10 monclient: dump: 2024-09-22T08:35:29.767 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:35:29.767 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:35:29.767 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:35:29.767 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:35:29.767 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:35:29.767 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:35:29.767 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:35:29.767 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:35:29.767 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:35:29.767 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:29.767 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-22T08:35:29.466+0000 7fd161339800 5 monclient: authenticate success, global_id 6833 2024-09-22T08:35:29.767 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-22T08:35:29.466+0000 7fd161339800 10 monclient: _renew_subs 2024-09-22T08:35:29.768 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-22T08:35:29.466+0000 7fd161339800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:35:29.768 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-22T08:35:29.466+0000 7fd04ae05640 4 set_mon_vals no callback set 2024-09-22T08:35:29.768 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-22T08:35:29.466+0000 7fd161339800 10 monclient: _renew_subs 2024-09-22T08:35:29.768 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-22T08:35:29.466+0000 7fd161339800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:35:29.768 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-22T08:35:29.466+0000 7fd161339800 1 librados: init done 2024-09-22T08:35:29.768 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-22T08:35:29.468+0000 7fd049602640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:35:29.768 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-22T08:35:29.468+0000 7fd049602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:35:29.768 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-22T08:35:29.468+0000 7fd049602640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:35:29.768 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-22T08:35:29.468+0000 7fd157fff640 10 monclient: get_auth_request con 0x7fd044077570 auth_method 0 2024-09-22T08:35:29.768 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-22T08:35:29.468+0000 7fd15d7c8640 10 monclient: get_auth_request con 0x559ee2300530 auth_method 0 2024-09-22T08:35:29.768 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-22T08:35:29.469+0000 7fd15cfc7640 10 monclient: get_auth_request con 0x559ee2303710 auth_method 0 2024-09-22T08:35:29.768 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-22T08:35:29.470+0000 7fd157fff640 10 monclient: get_auth_request con 0x559ee2307900 auth_method 0 2024-09-22T08:35:29.768 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-22T08:35:29.471+0000 7fd15d7c8640 10 monclient: get_auth_request con 0x559ee2306fa0 auth_method 0 2024-09-22T08:35:29.768 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-22T08:35:29.472+0000 7fd161339800 10 monclient: build_initial_monmap 2024-09-22T08:35:29.768 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-22T08:35:29.472+0000 7fd161339800 1 build_initial for_mkfs: 0 2024-09-22T08:35:29.769 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-22T08:35:29.472+0000 7fd161339800 10 monclient: monmap: 2024-09-22T08:35:29.769 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:35:29.769 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:35:29.769 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:35:29.769 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:35:29.769 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:35:29.769 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:35:29.769 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:35:29.769 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:35:29.769 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:35:29.769 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:29.769 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230f900) adding auth protocol: cephx 2024-09-22T08:35:29.769 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230f900) adding auth protocol: cephx 2024-09-22T08:35:29.769 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230f900) adding auth protocol: cephx 2024-09-22T08:35:29.769 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230f900) adding con mode: secure 2024-09-22T08:35:29.770 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230f900) adding con mode: crc 2024-09-22T08:35:29.770 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230f900) adding con mode: secure 2024-09-22T08:35:29.770 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230f900) adding con mode: crc 2024-09-22T08:35:29.770 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230f900) adding con mode: secure 2024-09-22T08:35:29.770 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230f900) adding con mode: crc 2024-09-22T08:35:29.770 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230f900) adding con mode: crc 2024-09-22T08:35:29.770 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230f900) adding con mode: secure 2024-09-22T08:35:29.770 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230f900) adding con mode: crc 2024-09-22T08:35:29.770 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230f900) adding con mode: secure 2024-09-22T08:35:29.770 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230f900) adding con mode: crc 2024-09-22T08:35:29.770 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230f900) adding con mode: secure 2024-09-22T08:35:29.770 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-22T08:35:29.472+0000 7fd161339800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:35:29.770 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-22T08:35:29.472+0000 7fd161339800 5 asok(0x559ee20960f0) register_command objecter_requests cmddesc objecter_requests hook 0x559ee2313260 EEXIST 2024-09-22T08:35:29.771 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-22T08:35:29.472+0000 7fd161339800 10 monclient: init 2024-09-22T08:35:29.771 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230e7f8) adding auth protocol: cephx 2024-09-22T08:35:29.771 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230e7f8) adding auth protocol: cephx 2024-09-22T08:35:29.771 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230e7f8) adding auth protocol: cephx 2024-09-22T08:35:29.771 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230e7f8) adding con mode: secure 2024-09-22T08:35:29.771 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230e7f8) adding con mode: crc 2024-09-22T08:35:29.771 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230e7f8) adding con mode: secure 2024-09-22T08:35:29.771 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230e7f8) adding con mode: crc 2024-09-22T08:35:29.771 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230e7f8) adding con mode: secure 2024-09-22T08:35:29.771 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230e7f8) adding con mode: crc 2024-09-22T08:35:29.771 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230e7f8) adding con mode: crc 2024-09-22T08:35:29.771 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230e7f8) adding con mode: secure 2024-09-22T08:35:29.771 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230e7f8) adding con mode: crc 2024-09-22T08:35:29.771 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230e7f8) adding con mode: secure 2024-09-22T08:35:29.771 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230e7f8) adding con mode: crc 2024-09-22T08:35:29.772 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230e7f8) adding con mode: secure 2024-09-22T08:35:29.772 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-22T08:35:29.473+0000 7fd161339800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:35:29.772 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-22T08:35:29.473+0000 7fd161339800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:35:29.772 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-22T08:35:29.473+0000 7fd161339800 5 asok(0x559ee20960f0) register_command rotate-key cmddesc rotate-key hook 0x559ee230e940 EEXIST 2024-09-22T08:35:29.772 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-22T08:35:29.473+0000 7fd161339800 10 monclient: _reopen_session rank -1 2024-09-22T08:35:29.772 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-22T08:35:29.473+0000 7fd161339800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T08:35:29.772 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-22T08:35:29.473+0000 7fd161339800 10 monclient(hunting): picked mon.noname-b con 0x559ee2336f50 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:35:29.772 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-22T08:35:29.473+0000 7fd161339800 10 monclient(hunting): picked mon.noname-a con 0x559ee2339220 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:35:29.772 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-22T08:35:29.473+0000 7fd161339800 10 monclient(hunting): picked mon.noname-c con 0x559ee2335720 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:35:29.772 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-22T08:35:29.473+0000 7fd161339800 10 monclient(hunting): start opening mon connection 2024-09-22T08:35:29.772 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-22T08:35:29.473+0000 7fd161339800 10 monclient(hunting): start opening mon connection 2024-09-22T08:35:29.772 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-22T08:35:29.473+0000 7fd161339800 10 monclient(hunting): start opening mon connection 2024-09-22T08:35:29.772 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-22T08:35:29.473+0000 7fd161339800 10 monclient(hunting): _renew_subs 2024-09-22T08:35:29.772 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-22T08:35:29.473+0000 7fd161339800 10 monclient(hunting): authenticate will time out at 2034.712431s 2024-09-22T08:35:29.772 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-22T08:35:29.473+0000 7fd15cfc7640 10 monclient(hunting): get_auth_request con 0x559ee2335720 auth_method 0 2024-09-22T08:35:29.773 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-22T08:35:29.473+0000 7fd15cfc7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:35:29.773 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-22T08:35:29.473+0000 7fd15cfc7640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:35:29.773 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-22T08:35:29.473+0000 7fd15cfc7640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:35:29.773 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-22T08:35:29.473+0000 7fd15d7c8640 10 monclient(hunting): get_auth_request con 0x559ee2339220 auth_method 0 2024-09-22T08:35:29.773 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-22T08:35:29.473+0000 7fd15d7c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:35:29.773 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-22T08:35:29.473+0000 7fd15d7c8640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:35:29.773 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-22T08:35:29.473+0000 7fd15d7c8640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:35:29.773 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-22T08:35:29.473+0000 7fd157fff640 10 monclient(hunting): get_auth_request con 0x559ee2336f50 auth_method 0 2024-09-22T08:35:29.773 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-22T08:35:29.473+0000 7fd157fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:35:29.773 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-22T08:35:29.473+0000 7fd157fff640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:35:29.773 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-22T08:35:29.473+0000 7fd157fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:35:29.773 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-22T08:35:29.473+0000 7fd15cfc7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:35:29.773 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-22T08:35:29.473+0000 7fd15cfc7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:35:29.773 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-22T08:35:29.473+0000 7fd15cfc7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:35:29.774 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-22T08:35:29.473+0000 7fd15d7c8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:35:29.774 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-22T08:35:29.473+0000 7fd15d7c8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:35:29.774 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-22T08:35:29.473+0000 7fd15d7c8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:35:29.774 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-22T08:35:29.473+0000 7fd157fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:35:29.774 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-22T08:35:29.473+0000 7fd157fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:35:29.774 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-22T08:35:29.473+0000 7fd157fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:35:29.774 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-22T08:35:29.473+0000 7fd15cfc7640 10 monclient(hunting): handle_auth_done global_id 6836 payload 824 2024-09-22T08:35:29.774 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-22T08:35:29.473+0000 7fd15cfc7640 10 monclient: _finish_hunting 0 2024-09-22T08:35:29.774 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-22T08:35:29.473+0000 7fd15cfc7640 1 monclient: found mon.noname-c 2024-09-22T08:35:29.774 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-22T08:35:29.473+0000 7fd15cfc7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:35:29.774 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-22T08:35:29.474+0000 7fd0427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:35:29.775 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-22T08:35:29.474+0000 7fd0427fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:35:29.775 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-22T08:35:29.474+0000 7fd0427fc640 10 monclient: dump: 2024-09-22T08:35:29.775 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:35:29.775 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:35:29.775 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:35:29.775 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:35:29.775 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:35:29.775 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:35:29.775 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:35:29.775 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:35:29.775 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:35:29.775 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:29.775 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-22T08:35:29.474+0000 7fd0427fc640 10 monclient: _finish_auth 0 2024-09-22T08:35:29.775 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-22T08:35:29.474+0000 7fd0427fc640 10 monclient: _check_auth_tickets 2024-09-22T08:35:29.776 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-22T08:35:29.474+0000 7fd0427fc640 10 monclient: handle_config config(0 keys) 2024-09-22T08:35:29.776 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-22T08:35:29.474+0000 7fd0427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:35:29.776 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-22T08:35:29.474+0000 7fd0427fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:35:29.776 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-22T08:35:29.474+0000 7fd0427fc640 10 monclient: dump: 2024-09-22T08:35:29.776 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:35:29.776 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:35:29.776 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:35:29.776 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:35:29.776 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:35:29.776 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:35:29.776 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:35:29.776 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:35:29.776 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:35:29.776 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:29.776 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-22T08:35:29.474+0000 7fd161339800 5 monclient: authenticate success, global_id 6836 2024-09-22T08:35:29.776 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-22T08:35:29.474+0000 7fd161339800 10 monclient: _renew_subs 2024-09-22T08:35:29.777 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-22T08:35:29.474+0000 7fd15dfc9640 4 set_mon_vals no callback set 2024-09-22T08:35:29.777 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-22T08:35:29.474+0000 7fd161339800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:35:29.777 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-22T08:35:29.474+0000 7fd161339800 10 monclient: _renew_subs 2024-09-22T08:35:29.777 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-22T08:35:29.474+0000 7fd161339800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:35:29.777 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-22T08:35:29.475+0000 7fd0427fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:35:29.777 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-22T08:35:29.475+0000 7fd0427fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:35:29.777 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-22T08:35:29.475+0000 7fd0427fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:35:29.777 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-22T08:35:29.476+0000 7fd157fff640 10 monclient: get_auth_request con 0x7fd034077480 auth_method 0 2024-09-22T08:35:29.777 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-22T08:35:29.476+0000 7fd161339800 10 monclient: get_monmap_and_config 2024-09-22T08:35:29.777 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-22T08:35:29.476+0000 7fd161339800 10 monclient: build_initial_monmap 2024-09-22T08:35:29.777 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-22T08:35:29.476+0000 7fd161339800 1 build_initial for_mkfs: 0 2024-09-22T08:35:29.777 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-22T08:35:29.476+0000 7fd161339800 10 monclient: monmap: 2024-09-22T08:35:29.777 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:35:29.777 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:35:29.778 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:35:29.778 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:35:29.778 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:35:29.778 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:35:29.778 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:35:29.778 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:35:29.778 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:35:29.778 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:29.778 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x559ee2356b50) adding auth protocol: cephx 2024-09-22T08:35:29.778 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x559ee2356b50) adding auth protocol: cephx 2024-09-22T08:35:29.778 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x559ee2356b50) adding auth protocol: cephx 2024-09-22T08:35:29.778 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x559ee2356b50) adding con mode: secure 2024-09-22T08:35:29.778 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x559ee2356b50) adding con mode: crc 2024-09-22T08:35:29.778 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x559ee2356b50) adding con mode: secure 2024-09-22T08:35:29.778 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x559ee2356b50) adding con mode: crc 2024-09-22T08:35:29.779 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x559ee2356b50) adding con mode: secure 2024-09-22T08:35:29.779 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x559ee2356b50) adding con mode: crc 2024-09-22T08:35:29.779 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x559ee2356b50) adding con mode: crc 2024-09-22T08:35:29.779 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x559ee2356b50) adding con mode: secure 2024-09-22T08:35:29.779 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x559ee2356b50) adding con mode: crc 2024-09-22T08:35:29.779 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x559ee2356b50) adding con mode: secure 2024-09-22T08:35:29.779 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x559ee2356b50) adding con mode: crc 2024-09-22T08:35:29.779 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x559ee2356b50) adding con mode: secure 2024-09-22T08:35:29.779 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-22T08:35:29.476+0000 7fd161339800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:35:29.779 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-22T08:35:29.476+0000 7fd161339800 10 monclient: init 2024-09-22T08:35:29.779 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b2f0) adding auth protocol: cephx 2024-09-22T08:35:29.779 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b2f0) adding auth protocol: cephx 2024-09-22T08:35:29.779 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b2f0) adding auth protocol: cephx 2024-09-22T08:35:29.779 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b2f0) adding con mode: secure 2024-09-22T08:35:29.779 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b2f0) adding con mode: crc 2024-09-22T08:35:29.779 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b2f0) adding con mode: secure 2024-09-22T08:35:29.780 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b2f0) adding con mode: crc 2024-09-22T08:35:29.780 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b2f0) adding con mode: secure 2024-09-22T08:35:29.780 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b2f0) adding con mode: crc 2024-09-22T08:35:29.780 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b2f0) adding con mode: crc 2024-09-22T08:35:29.780 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b2f0) adding con mode: secure 2024-09-22T08:35:29.780 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b2f0) adding con mode: crc 2024-09-22T08:35:29.780 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b2f0) adding con mode: secure 2024-09-22T08:35:29.780 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b2f0) adding con mode: crc 2024-09-22T08:35:29.780 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b2f0) adding con mode: secure 2024-09-22T08:35:29.780 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-22T08:35:29.476+0000 7fd161339800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:35:29.780 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-22T08:35:29.477+0000 7fd161339800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:35:29.780 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-22T08:35:29.477+0000 7fd161339800 5 asok(0x559ee20960f0) register_command rotate-key cmddesc rotate-key hook 0x7ffe5400b438 EEXIST 2024-09-22T08:35:29.780 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-22T08:35:29.477+0000 7fd161339800 10 monclient: _reopen_session rank -1 2024-09-22T08:35:29.780 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-22T08:35:29.477+0000 7fd161339800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T08:35:29.780 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-22T08:35:29.477+0000 7fd161339800 10 monclient(hunting): picked mon.noname-b con 0x559ee238b210 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:35:29.781 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-22T08:35:29.477+0000 7fd161339800 10 monclient(hunting): picked mon.noname-a con 0x559ee235c160 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:35:29.781 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-22T08:35:29.477+0000 7fd161339800 10 monclient(hunting): picked mon.noname-c con 0x559ee2386ab0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:35:29.781 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-22T08:35:29.477+0000 7fd161339800 10 monclient(hunting): start opening mon connection 2024-09-22T08:35:29.781 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-22T08:35:29.477+0000 7fd161339800 10 monclient(hunting): start opening mon connection 2024-09-22T08:35:29.781 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-22T08:35:29.477+0000 7fd161339800 10 monclient(hunting): start opening mon connection 2024-09-22T08:35:29.781 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-22T08:35:29.477+0000 7fd161339800 10 monclient(hunting): _renew_subs 2024-09-22T08:35:29.781 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-22T08:35:29.477+0000 7fd161339800 10 monclient(hunting): authenticate will time out at 2034.716263s 2024-09-22T08:35:29.781 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-22T08:35:29.477+0000 7fd15cfc7640 10 monclient(hunting): get_auth_request con 0x559ee2386ab0 auth_method 0 2024-09-22T08:35:29.781 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-22T08:35:29.477+0000 7fd15cfc7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:35:29.781 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-22T08:35:29.477+0000 7fd15cfc7640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:35:29.781 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-22T08:35:29.477+0000 7fd15cfc7640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:35:29.781 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-22T08:35:29.477+0000 7fd15d7c8640 10 monclient(hunting): get_auth_request con 0x559ee235c160 auth_method 0 2024-09-22T08:35:29.781 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-22T08:35:29.477+0000 7fd15d7c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:35:29.781 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-22T08:35:29.477+0000 7fd15d7c8640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:35:29.781 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-22T08:35:29.477+0000 7fd15d7c8640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:35:29.781 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-22T08:35:29.477+0000 7fd15cfc7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:35:29.782 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-22T08:35:29.477+0000 7fd15cfc7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:35:29.782 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-22T08:35:29.477+0000 7fd15cfc7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:35:29.782 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-22T08:35:29.477+0000 7fd15d7c8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:35:29.782 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-22T08:35:29.477+0000 7fd15d7c8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:35:29.782 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-22T08:35:29.477+0000 7fd15d7c8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:35:29.782 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-22T08:35:29.477+0000 7fd15cfc7640 10 monclient(hunting): handle_auth_done global_id 6839 payload 274 2024-09-22T08:35:29.782 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-22T08:35:29.477+0000 7fd15cfc7640 10 monclient: _finish_hunting 0 2024-09-22T08:35:29.782 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-22T08:35:29.477+0000 7fd15cfc7640 1 monclient: found mon.noname-c 2024-09-22T08:35:29.782 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-22T08:35:29.477+0000 7fd15cfc7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:35:29.782 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-22T08:35:29.477+0000 7fd033fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:35:29.782 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-22T08:35:29.477+0000 7fd033fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:35:29.782 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-22T08:35:29.477+0000 7fd033fff640 10 monclient: dump: 2024-09-22T08:35:29.782 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:35:29.783 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:35:29.783 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:35:29.783 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:35:29.783 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:35:29.783 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:35:29.783 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:35:29.783 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:35:29.783 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:35:29.783 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:29.783 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-22T08:35:29.477+0000 7fd033fff640 10 monclient: _finish_auth 0 2024-09-22T08:35:29.783 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-22T08:35:29.477+0000 7fd033fff640 10 monclient: _check_auth_tickets 2024-09-22T08:35:29.783 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-22T08:35:29.477+0000 7fd033fff640 10 monclient: handle_config config(0 keys) 2024-09-22T08:35:29.783 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-22T08:35:29.477+0000 7fd033fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:35:29.783 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-22T08:35:29.477+0000 7fd033fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:35:29.783 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-22T08:35:29.477+0000 7fd033fff640 10 monclient: dump: 2024-09-22T08:35:29.783 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:35:29.784 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:35:29.784 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:35:29.784 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:35:29.784 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:35:29.784 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:35:29.784 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:35:29.784 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:35:29.784 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:35:29.784 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:29.784 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-22T08:35:29.477+0000 7fd161339800 5 monclient: authenticate success, global_id 6839 2024-09-22T08:35:29.784 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-22T08:35:29.477+0000 7fd161339800 10 monclient: get_monmap_and_config success 2024-09-22T08:35:29.784 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-22T08:35:29.477+0000 7fd161339800 4 set_mon_vals no callback set 2024-09-22T08:35:29.784 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-22T08:35:29.478+0000 7fd161339800 10 monclient: shutdown 2024-09-22T08:35:29.784 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-22T08:35:29.478+0000 7fd161339800 10 monclient: build_initial_monmap 2024-09-22T08:35:29.784 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-22T08:35:29.478+0000 7fd161339800 1 build_initial for_mkfs: 0 2024-09-22T08:35:29.784 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-22T08:35:29.478+0000 7fd161339800 10 monclient: monmap: 2024-09-22T08:35:29.784 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:35:29.785 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:35:29.785 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:35:29.785 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:35:29.785 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:35:29.785 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:35:29.785 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:35:29.785 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:35:29.785 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:35:29.785 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:29.785 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee23873e0) adding auth protocol: cephx 2024-09-22T08:35:29.785 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee23873e0) adding auth protocol: cephx 2024-09-22T08:35:29.785 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee23873e0) adding auth protocol: cephx 2024-09-22T08:35:29.785 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee23873e0) adding con mode: secure 2024-09-22T08:35:29.785 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee23873e0) adding con mode: crc 2024-09-22T08:35:29.785 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee23873e0) adding con mode: secure 2024-09-22T08:35:29.786 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee23873e0) adding con mode: crc 2024-09-22T08:35:29.786 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee23873e0) adding con mode: secure 2024-09-22T08:35:29.786 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee23873e0) adding con mode: crc 2024-09-22T08:35:29.786 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee23873e0) adding con mode: crc 2024-09-22T08:35:29.786 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee23873e0) adding con mode: secure 2024-09-22T08:35:29.786 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee23873e0) adding con mode: crc 2024-09-22T08:35:29.786 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee23873e0) adding con mode: secure 2024-09-22T08:35:29.786 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee23873e0) adding con mode: crc 2024-09-22T08:35:29.786 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee23873e0) adding con mode: secure 2024-09-22T08:35:29.786 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-22T08:35:29.478+0000 7fd161339800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:35:29.786 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-22T08:35:29.478+0000 7fd161339800 1 librados: starting msgr at 2024-09-22T08:35:29.786 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-22T08:35:29.478+0000 7fd161339800 1 librados: starting objecter 2024-09-22T08:35:29.786 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-22T08:35:29.478+0000 7fd161339800 5 asok(0x559ee20960f0) register_command objecter_requests cmddesc objecter_requests hook 0x559ee2386230 EEXIST 2024-09-22T08:35:29.786 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-22T08:35:29.478+0000 7fd161339800 1 librados: setting wanted keys 2024-09-22T08:35:29.786 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-22T08:35:29.478+0000 7fd161339800 1 librados: calling monclient init 2024-09-22T08:35:29.787 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-22T08:35:29.478+0000 7fd161339800 10 monclient: init 2024-09-22T08:35:29.787 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee234ed00) adding auth protocol: cephx 2024-09-22T08:35:29.787 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee234ed00) adding auth protocol: cephx 2024-09-22T08:35:29.787 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee234ed00) adding auth protocol: cephx 2024-09-22T08:35:29.787 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee234ed00) adding con mode: secure 2024-09-22T08:35:29.787 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee234ed00) adding con mode: crc 2024-09-22T08:35:29.787 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee234ed00) adding con mode: secure 2024-09-22T08:35:29.787 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee234ed00) adding con mode: crc 2024-09-22T08:35:29.787 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee234ed00) adding con mode: secure 2024-09-22T08:35:29.787 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee234ed00) adding con mode: crc 2024-09-22T08:35:29.787 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee234ed00) adding con mode: crc 2024-09-22T08:35:29.787 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee234ed00) adding con mode: secure 2024-09-22T08:35:29.787 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee234ed00) adding con mode: crc 2024-09-22T08:35:29.787 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee234ed00) adding con mode: secure 2024-09-22T08:35:29.788 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee234ed00) adding con mode: crc 2024-09-22T08:35:29.788 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee234ed00) adding con mode: secure 2024-09-22T08:35:29.788 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-22T08:35:29.479+0000 7fd161339800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:35:29.788 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-22T08:35:29.479+0000 7fd161339800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:35:29.788 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-22T08:35:29.479+0000 7fd161339800 5 asok(0x559ee20960f0) register_command rotate-key cmddesc rotate-key hook 0x559ee234ee48 EEXIST 2024-09-22T08:35:29.788 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-22T08:35:29.479+0000 7fd161339800 10 monclient: _reopen_session rank -1 2024-09-22T08:35:29.788 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-22T08:35:29.479+0000 7fd161339800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T08:35:29.788 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-22T08:35:29.479+0000 7fd161339800 10 monclient(hunting): picked mon.noname-a con 0x559ee235c160 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:35:29.788 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-22T08:35:29.479+0000 7fd161339800 10 monclient(hunting): picked mon.noname-b con 0x559ee2386ab0 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:35:29.788 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-22T08:35:29.479+0000 7fd161339800 10 monclient(hunting): picked mon.noname-c con 0x559ee238b210 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:35:29.788 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-22T08:35:29.479+0000 7fd161339800 10 monclient(hunting): start opening mon connection 2024-09-22T08:35:29.788 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-22T08:35:29.479+0000 7fd161339800 10 monclient(hunting): start opening mon connection 2024-09-22T08:35:29.788 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-22T08:35:29.479+0000 7fd161339800 10 monclient(hunting): start opening mon connection 2024-09-22T08:35:29.788 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-22T08:35:29.479+0000 7fd161339800 10 monclient(hunting): _renew_subs 2024-09-22T08:35:29.788 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-22T08:35:29.479+0000 7fd161339800 10 monclient(hunting): authenticate will time out at 2034.718608s 2024-09-22T08:35:29.788 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-22T08:35:29.479+0000 7fd157fff640 10 monclient(hunting): get_auth_request con 0x559ee235c160 auth_method 0 2024-09-22T08:35:29.788 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-22T08:35:29.479+0000 7fd157fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:35:29.789 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-22T08:35:29.479+0000 7fd157fff640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:35:29.789 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-22T08:35:29.479+0000 7fd157fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:35:29.789 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-22T08:35:29.479+0000 7fd15cfc7640 10 monclient(hunting): get_auth_request con 0x559ee238b210 auth_method 0 2024-09-22T08:35:29.789 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-22T08:35:29.479+0000 7fd15cfc7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:35:29.789 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-22T08:35:29.479+0000 7fd15cfc7640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:35:29.789 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-22T08:35:29.479+0000 7fd15cfc7640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:35:29.789 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-22T08:35:29.479+0000 7fd157fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:35:29.789 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-22T08:35:29.479+0000 7fd157fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:35:29.789 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-22T08:35:29.479+0000 7fd157fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:35:29.789 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-22T08:35:29.479+0000 7fd15cfc7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:35:29.789 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-22T08:35:29.479+0000 7fd15cfc7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:35:29.789 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-22T08:35:29.479+0000 7fd15cfc7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:35:29.789 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-22T08:35:29.479+0000 7fd15d7c8640 10 monclient(hunting): get_auth_request con 0x559ee2386ab0 auth_method 0 2024-09-22T08:35:29.789 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-22T08:35:29.479+0000 7fd15d7c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:35:29.789 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-22T08:35:29.479+0000 7fd15d7c8640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:35:29.790 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-22T08:35:29.479+0000 7fd15d7c8640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:35:29.790 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-22T08:35:29.479+0000 7fd15cfc7640 10 monclient(hunting): handle_auth_done global_id 6842 payload 824 2024-09-22T08:35:29.790 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-22T08:35:29.480+0000 7fd15cfc7640 10 monclient: _finish_hunting 0 2024-09-22T08:35:29.790 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-22T08:35:29.480+0000 7fd15cfc7640 1 monclient: found mon.noname-c 2024-09-22T08:35:29.790 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-22T08:35:29.480+0000 7fd15cfc7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:35:29.790 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-22T08:35:29.480+0000 7fd0327fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:35:29.790 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-22T08:35:29.480+0000 7fd0327fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:35:29.790 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-22T08:35:29.480+0000 7fd0327fc640 10 monclient: dump: 2024-09-22T08:35:29.790 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:35:29.790 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:35:29.790 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:35:29.790 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:35:29.790 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:35:29.790 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:35:29.790 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:35:29.791 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:35:29.791 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:35:29.791 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:29.791 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-22T08:35:29.480+0000 7fd0327fc640 10 monclient: _finish_auth 0 2024-09-22T08:35:29.791 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-22T08:35:29.480+0000 7fd0327fc640 10 monclient: _check_auth_tickets 2024-09-22T08:35:29.791 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-22T08:35:29.480+0000 7fd0327fc640 10 monclient: handle_config config(0 keys) 2024-09-22T08:35:29.791 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-22T08:35:29.480+0000 7fd0327fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:35:29.791 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-22T08:35:29.480+0000 7fd0327fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:35:29.791 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-22T08:35:29.480+0000 7fd0327fc640 10 monclient: dump: 2024-09-22T08:35:29.791 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:35:29.791 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:35:29.791 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:35:29.791 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:35:29.791 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:35:29.791 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:35:29.791 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:35:29.791 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:35:29.792 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:35:29.792 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:29.792 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-22T08:35:29.480+0000 7fd161339800 5 monclient: authenticate success, global_id 6842 2024-09-22T08:35:29.792 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-22T08:35:29.480+0000 7fd161339800 10 monclient: _renew_subs 2024-09-22T08:35:29.792 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-22T08:35:29.480+0000 7fd033fff640 4 set_mon_vals no callback set 2024-09-22T08:35:29.792 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-22T08:35:29.480+0000 7fd161339800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:35:29.792 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-22T08:35:29.480+0000 7fd161339800 10 monclient: _renew_subs 2024-09-22T08:35:29.792 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-22T08:35:29.480+0000 7fd161339800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:35:29.792 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-22T08:35:29.480+0000 7fd161339800 1 librados: init done 2024-09-22T08:35:29.792 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-22T08:35:29.480+0000 7fd161339800 5 asok(0x559ee20960f0) register_command cr dump hook 0x559ee23812e8 2024-09-22T08:35:29.792 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-22T08:35:29.481+0000 7fd161339800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.792 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-22T08:35:29.482+0000 7fd0327fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:35:29.792 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-22T08:35:29.482+0000 7fd0327fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:35:29.792 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-22T08:35:29.482+0000 7fd0327fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:35:29.792 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-22T08:35:29.482+0000 7fd157fff640 10 monclient: get_auth_request con 0x7fd028077570 auth_method 0 2024-09-22T08:35:29.792 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-22T08:35:29.483+0000 7fd15d7c8640 10 monclient: get_auth_request con 0x559ee23a4650 auth_method 0 2024-09-22T08:35:29.793 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-22T08:35:29.483+0000 7fd161339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:29.793 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-22T08:35:29.483+0000 7fd161339800 20 realm 2024-09-22T08:35:29.793 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-22T08:35:29.483+0000 7fd161339800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.793 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-22T08:35:29.483+0000 7fd161339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:29.793 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-22T08:35:29.483+0000 7fd161339800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:35:29.793 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-22T08:35:29.483+0000 7fd161339800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.793 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-22T08:35:29.484+0000 7fd161339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:29.793 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-22T08:35:29.484+0000 7fd161339800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.793 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-22T08:35:29.484+0000 7fd157fff640 10 monclient: get_auth_request con 0x559ee23a8890 auth_method 0 2024-09-22T08:35:29.793 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-22T08:35:29.485+0000 7fd161339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:35:29.793 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-22T08:35:29.485+0000 7fd161339800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.793 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-22T08:35:29.485+0000 7fd15d7c8640 10 monclient: get_auth_request con 0x559ee23ac160 auth_method 0 2024-09-22T08:35:29.793 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-22T08:35:29.485+0000 7fd161339800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:35:29.793 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-22T08:35:29.485+0000 7fd161339800 20 searching for the correct realm 2024-09-22T08:35:29.794 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-22T08:35:29.486+0000 7fd15cfc7640 10 monclient: get_auth_request con 0x559ee23b0e90 auth_method 0 2024-09-22T08:35:29.794 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-22T08:35:29.487+0000 7fd157fff640 10 monclient: get_auth_request con 0x7fd148015070 auth_method 0 2024-09-22T08:35:29.794 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-22T08:35:29.488+0000 7fd15d7c8640 0 -- 172.21.15.38:0/3124990968 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7fd150058930 msgr2=0x7fd1500b0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:35:29.794 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-22T08:35:29.690+0000 7fd15d7c8640 10 monclient: get_auth_request con 0x7fd150058930 auth_method 0 2024-09-22T08:35:29.794 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-22T08:35:29.692+0000 7fd15cfc7640 10 monclient: get_auth_request con 0x7fd148057920 auth_method 0 2024-09-22T08:35:29.794 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-22T08:35:29.693+0000 7fd157fff640 10 monclient: get_auth_request con 0x7fd1500db120 auth_method 0 2024-09-22T08:35:29.794 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-22T08:35:29.694+0000 7fd15d7c8640 0 -- 172.21.15.38:0/3124990968 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x559ee23a4650 msgr2=0x559ee23a6b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:35:29.794 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-22T08:35:29.694+0000 7fd0327fc640 1 client.6842.objecter ms_handle_reset 0x559ee23a4650 session 0x559ee23a3f80 osd.6 2024-09-22T08:35:29.794 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-22T08:35:29.694+0000 7fd0327fc640 10 monclient: _renew_subs 2024-09-22T08:35:29.794 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-22T08:35:29.694+0000 7fd0327fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:35:29.794 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-22T08:35:29.695+0000 7fd15d7c8640 10 monclient: get_auth_request con 0x7fd028087010 auth_method 0 2024-09-22T08:35:29.794 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-22T08:35:29.698+0000 7fd161339800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:35:29.794 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-22T08:35:29.698+0000 7fd161339800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:35:29.794 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-22T08:35:29.698+0000 7fd161339800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:35:29.794 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-22T08:35:29.698+0000 7fd161339800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:35:29.794 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-22T08:35:29.698+0000 7fd161339800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:35:29.795 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-22T08:35:29.698+0000 7fd161339800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:35:29.795 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-22T08:35:29.698+0000 7fd161339800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.795 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-22T08:35:29.699+0000 7fd161339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:29.795 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-22T08:35:29.699+0000 7fd161339800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.795 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-22T08:35:29.699+0000 7fd161339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:35:29.795 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-22T08:35:29.699+0000 7fd161339800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.795 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-22T08:35:29.699+0000 7fd161339800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:35:29.795 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-22T08:35:29.699+0000 7fd161339800 20 zone default found 2024-09-22T08:35:29.795 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-22T08:35:29.699+0000 7fd161339800 4 Realm: () 2024-09-22T08:35:29.795 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-22T08:35:29.699+0000 7fd161339800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:35:29.795 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-22T08:35:29.699+0000 7fd161339800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:35:29.795 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-22T08:35:29.699+0000 7fd161339800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:35:29.795 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-22T08:35:29.699+0000 7fd161339800 20 zonegroup default 2024-09-22T08:35:29.796 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-22T08:35:29.699+0000 7fd161339800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.796 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-22T08:35:29.700+0000 7fd161339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:29.796 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-22T08:35:29.700+0000 7fd161339800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.796 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-22T08:35:29.700+0000 7fd161339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:29.796 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-22T08:35:29.700+0000 7fd161339800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.796 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-22T08:35:29.701+0000 7fd161339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:29.796 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-22T08:35:29.701+0000 7fd161339800 20 started sync module instance, tier type = 2024-09-22T08:35:29.796 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-22T08:35:29.701+0000 7fd161339800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:35:29.796 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-22T08:35:29.710+0000 7fd161339800 20 add_watcher() i=0 2024-09-22T08:35:29.796 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-22T08:35:29.710+0000 7fd161339800 20 add_watcher() i=1 2024-09-22T08:35:29.796 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-22T08:35:29.710+0000 7fd161339800 20 add_watcher() i=2 2024-09-22T08:35:29.796 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-22T08:35:29.710+0000 7fd161339800 20 add_watcher() i=3 2024-09-22T08:35:29.796 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-22T08:35:29.710+0000 7fd161339800 20 add_watcher() i=4 2024-09-22T08:35:29.796 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-22T08:35:29.710+0000 7fd161339800 20 add_watcher() i=5 2024-09-22T08:35:29.797 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-22T08:35:29.710+0000 7fd161339800 20 add_watcher() i=6 2024-09-22T08:35:29.797 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-22T08:35:29.712+0000 7fd161339800 20 add_watcher() i=7 2024-09-22T08:35:29.797 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-22T08:35:29.712+0000 7fd161339800 2 all 8 watchers are set, enabling cache 2024-09-22T08:35:29.797 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-22T08:35:29.714+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b7c0) adding auth protocol: cephx 2024-09-22T08:35:29.797 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-22T08:35:29.714+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b7c0) adding auth protocol: cephx 2024-09-22T08:35:29.797 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-22T08:35:29.714+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b7c0) adding auth protocol: cephx 2024-09-22T08:35:29.797 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-22T08:35:29.714+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b7c0) adding con mode: secure 2024-09-22T08:35:29.797 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-22T08:35:29.714+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b7c0) adding con mode: crc 2024-09-22T08:35:29.797 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-22T08:35:29.714+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b7c0) adding con mode: secure 2024-09-22T08:35:29.797 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-22T08:35:29.714+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b7c0) adding con mode: crc 2024-09-22T08:35:29.797 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-22T08:35:29.714+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b7c0) adding con mode: secure 2024-09-22T08:35:29.797 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-22T08:35:29.714+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b7c0) adding con mode: crc 2024-09-22T08:35:29.797 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-22T08:35:29.714+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b7c0) adding con mode: crc 2024-09-22T08:35:29.797 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-22T08:35:29.714+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b7c0) adding con mode: secure 2024-09-22T08:35:29.798 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-22T08:35:29.714+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b7c0) adding con mode: crc 2024-09-22T08:35:29.798 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-22T08:35:29.714+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b7c0) adding con mode: secure 2024-09-22T08:35:29.798 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-22T08:35:29.714+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b7c0) adding con mode: crc 2024-09-22T08:35:29.798 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-22T08:35:29.714+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b7c0) adding con mode: secure 2024-09-22T08:35:29.798 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-22T08:35:29.714+0000 7fd012fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:35:29.798 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-22T08:35:29.714+0000 7fd161339800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:35:29.798 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-22T08:35:29.714+0000 7fd161339800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:35:29.798 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-22T08:35:29.714+0000 7fd161339800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:35:29.798 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-22T08:35:29.714+0000 7fd161339800 5 asok(0x559ee20960f0) register_command cache list hook 0x559ee237bab0 2024-09-22T08:35:29.798 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-22T08:35:29.714+0000 7fd161339800 5 asok(0x559ee20960f0) register_command cache inspect hook 0x559ee237bab0 2024-09-22T08:35:29.798 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-22T08:35:29.714+0000 7fd161339800 5 asok(0x559ee20960f0) register_command cache erase hook 0x559ee237bab0 2024-09-22T08:35:29.798 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-22T08:35:29.714+0000 7fd161339800 5 asok(0x559ee20960f0) register_command cache zap hook 0x559ee237bab0 2024-09-22T08:35:29.798 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-22T08:35:29.714+0000 7fd161339800 5 note: GC not initialized 2024-09-22T08:35:29.799 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-22T08:35:29.714+0000 7fd011fe3640 20 reqs_thread_entry: start 2024-09-22T08:35:29.799 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-22T08:35:29.714+0000 7fd161339800 5 asok(0x559ee20960f0) register_command sync trace show hook 0x7fd15006f030 2024-09-22T08:35:29.799 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-22T08:35:29.714+0000 7fd161339800 5 asok(0x559ee20960f0) register_command sync trace history hook 0x7fd15006f030 2024-09-22T08:35:29.799 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-22T08:35:29.714+0000 7fd161339800 5 asok(0x559ee20960f0) register_command sync trace active hook 0x7fd15006f030 2024-09-22T08:35:29.799 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-22T08:35:29.714+0000 7fd161339800 5 asok(0x559ee20960f0) register_command sync trace active_short hook 0x7fd15006f030 2024-09-22T08:35:29.799 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-22T08:35:29.714+0000 7fd161339800 20 init_complete bucket index max shards: 11 2024-09-22T08:35:29.799 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-22T08:35:29.714+0000 7fd161339800 20 Filter name: none 2024-09-22T08:35:29.799 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-22T08:35:29.715+0000 7fcf837fe640 20 reqs_thread_entry: start 2024-09-22T08:35:29.799 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-22T08:35:29.715+0000 7fd161339800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-22T08:35:29.799 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-22T08:35:29.715+0000 7fd161339800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.799 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-22T08:35:29.715+0000 7fd161339800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:35:29.799 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-22T08:35:29.715+0000 7fd161339800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-22T08:35:29.799 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-22T08:35:29.715+0000 7fd161339800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-22T08:35:29.799 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-22T08:35:29.715+0000 7fd161339800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 : miss 2024-09-22T08:35:29.799 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-22T08:35:29.715+0000 7fd161339800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.800 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-22T08:35:29.716+0000 7fd161339800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:35:29.800 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-22T08:35:29.716+0000 7fd161339800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 info.flags=0x17 2024-09-22T08:35:29.800 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-22T08:35:29.716+0000 7fd161339800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 to cache LRU end 2024-09-22T08:35:29.800 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-22T08:35:29.716+0000 7fd161339800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:35:29.800 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-22T08:35:29.716+0000 7fd161339800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:35:29.800 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-22T08:35:29.716+0000 7fd161339800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 2024-09-22T08:35:29.800 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-22T08:35:29.721+0000 7fd161339800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 info.flags=0x17 2024-09-22T08:35:29.800 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-22T08:35:29.721+0000 7fd161339800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 to cache LRU end 2024-09-22T08:35:29.800 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-22T08:35:29.721+0000 7fd161339800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:35:29.800 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-22T08:35:29.721+0000 7fd161339800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32, ofs0, ns] 2024-09-22T08:35:29.800 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-22T08:35:29.722+0000 7fd033fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497008 cookie 94140888731520 notifier 6842 bl.length()=931 2024-09-22T08:35:29.800 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-22T08:35:29.722+0000 7fd033fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 info.flags=0x17 2024-09-22T08:35:29.800 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-22T08:35:29.722+0000 7fd033fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 to cache LRU end 2024-09-22T08:35:29.800 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-22T08:35:29.722+0000 7fd033fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:35:29.800 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-22T08:35:29.722+0000 7fd161339800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.32]): orig_sources= new_sources= 2024-09-22T08:35:29.801 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-22T08:35:29.722+0000 7fd161339800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.32]): potential sources added=[] removed=[] 2024-09-22T08:35:29.801 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-22T08:35:29.722+0000 7fd161339800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.32]): orig_dests= new_dests= 2024-09-22T08:35:29.801 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-22T08:35:29.722+0000 7fd161339800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.32]): potential dests added=[] removed=[] 2024-09-22T08:35:29.801 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-22T08:35:29.727+0000 7fd161339800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.0 2024-09-22T08:35:29.801 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.0 2024-09-22T08:35:29.801 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-22T08:35:29.728+0000 7fd161339800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.1 2024-09-22T08:35:29.801 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.1 2024-09-22T08:35:29.801 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-22T08:35:29.728+0000 7fd161339800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.2 2024-09-22T08:35:29.801 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.2 2024-09-22T08:35:29.801 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-22T08:35:29.728+0000 7fd161339800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.3 2024-09-22T08:35:29.801 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.3 2024-09-22T08:35:29.801 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-22T08:35:29.728+0000 7fd161339800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.4 2024-09-22T08:35:29.801 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.4 2024-09-22T08:35:29.801 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-22T08:35:29.728+0000 7fd161339800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.5 2024-09-22T08:35:29.801 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.5 2024-09-22T08:35:29.802 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-22T08:35:29.728+0000 7fd161339800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.6 2024-09-22T08:35:29.802 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.6 2024-09-22T08:35:29.802 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-22T08:35:29.728+0000 7fd161339800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.7 2024-09-22T08:35:29.802 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.7 2024-09-22T08:35:29.802 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-22T08:35:29.728+0000 7fd161339800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.8 2024-09-22T08:35:29.802 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.8 2024-09-22T08:35:29.802 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-22T08:35:29.728+0000 7fd161339800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.9 2024-09-22T08:35:29.802 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.9 2024-09-22T08:35:29.802 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-22T08:35:29.728+0000 7fd161339800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.10 2024-09-22T08:35:29.802 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.10 2024-09-22T08:35:29.802 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-22T08:35:29.728+0000 7fd161339800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.11 2024-09-22T08:35:29.802 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.11 2024-09-22T08:35:29.802 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.0 2024-09-22T08:35:29.802 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1 2024-09-22T08:35:29.802 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-22T08:35:29.729+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.2 2024-09-22T08:35:29.803 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-22T08:35:29.729+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.3 2024-09-22T08:35:29.803 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-22T08:35:29.730+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.4 2024-09-22T08:35:29.803 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-22T08:35:29.730+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.5 2024-09-22T08:35:29.803 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-22T08:35:29.731+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.6 2024-09-22T08:35:29.803 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-22T08:35:29.731+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.7 2024-09-22T08:35:29.803 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-22T08:35:29.732+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.8 2024-09-22T08:35:29.803 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-22T08:35:29.732+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.9 2024-09-22T08:35:29.803 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-22T08:35:29.733+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.10 2024-09-22T08:35:29.803 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-22T08:35:29.736+0000 7fd161339800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 : hit (requested=0x17, cached=0x17) 2024-09-22T08:35:29.803 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-22T08:35:29.736+0000 7fd161339800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 2024-09-22T08:35:29.803 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-22T08:35:29.737+0000 7fd161339800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 info.flags=0x17 2024-09-22T08:35:29.803 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-22T08:35:29.737+0000 7fd161339800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 to cache LRU end 2024-09-22T08:35:29.803 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-22T08:35:29.737+0000 7fd161339800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:35:29.803 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-22T08:35:29.737+0000 7fd161339800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32, ofs0, ns] 2024-09-22T08:35:29.804 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-22T08:35:29.738+0000 7fd0337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497009 cookie 94140888731520 notifier 6842 bl.length()=931 2024-09-22T08:35:29.804 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-22T08:35:29.738+0000 7fd0337fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 info.flags=0x17 2024-09-22T08:35:29.804 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-22T08:35:29.738+0000 7fd0337fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 to cache LRU end 2024-09-22T08:35:29.804 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-22T08:35:29.738+0000 7fd0337fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:35:29.804 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-22T08:35:29.738+0000 7fd161339800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.32]): orig_sources= new_sources= 2024-09-22T08:35:29.804 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-22T08:35:29.738+0000 7fd161339800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.32]): potential sources added=[] removed=[] 2024-09-22T08:35:29.804 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-22T08:35:29.738+0000 7fd161339800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.32]): orig_dests= new_dests= 2024-09-22T08:35:29.804 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-22T08:35:29.738+0000 7fd161339800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.32]): potential dests added=[] removed=[] 2024-09-22T08:35:29.804 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-22T08:35:29.741+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.0 2024-09-22T08:35:29.804 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-22T08:35:29.741+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1 2024-09-22T08:35:29.804 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-22T08:35:29.741+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.2 2024-09-22T08:35:29.804 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-22T08:35:29.742+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.3 2024-09-22T08:35:29.804 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-22T08:35:29.742+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.4 2024-09-22T08:35:29.804 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-22T08:35:29.742+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.5 2024-09-22T08:35:29.805 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-22T08:35:29.743+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.6 2024-09-22T08:35:29.805 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-22T08:35:29.743+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.7 2024-09-22T08:35:29.805 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-22T08:35:29.743+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.8 2024-09-22T08:35:29.805 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-22T08:35:29.744+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.9 2024-09-22T08:35:29.805 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-22T08:35:29.744+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.10 2024-09-22T08:35:29.805 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-22T08:35:29.745+0000 7fd161339800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd161339800 time 2024-09-22T08:35:29.745638+0000 2024-09-22T08:35:29.805 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:35:29.805 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:29.805 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:35:29.805 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd16298c748] 2024-09-22T08:35:29.805 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fd16298c906] 2024-09-22T08:35:29.805 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559edf71be01] 2024-09-22T08:35:29.805 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x559edf72bfb7] 2024-09-22T08:35:29.805 INFO:tasks.workunit.client.0.smithi038.stderr: 5: main() 2024-09-22T08:35:29.805 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fd161629590] 2024-09-22T08:35:29.806 INFO:tasks.workunit.client.0.smithi038.stderr: 7: __libc_start_main() 2024-09-22T08:35:29.806 INFO:tasks.workunit.client.0.smithi038.stderr: 8: _start() 2024-09-22T08:35:29.806 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:29.806 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-22T08:35:29.746+0000 7fd161339800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:35:29.806 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7fd161339800 thread_name:radosgw-admin 2024-09-22T08:35:29.806 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:29.806 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:35:29.806 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd16163e6f0] 2024-09-22T08:35:29.806 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd16168b99c] 2024-09-22T08:35:29.806 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:35:29.806 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:35:29.806 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd16298c7a2] 2024-09-22T08:35:29.806 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fd16298c906] 2024-09-22T08:35:29.807 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559edf71be01] 2024-09-22T08:35:29.807 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x559edf72bfb7] 2024-09-22T08:35:29.807 INFO:tasks.workunit.client.0.smithi038.stderr: 9: main() 2024-09-22T08:35:29.807 INFO:tasks.workunit.client.0.smithi038.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fd161629590] 2024-09-22T08:35:29.807 INFO:tasks.workunit.client.0.smithi038.stderr: 11: __libc_start_main() 2024-09-22T08:35:29.807 INFO:tasks.workunit.client.0.smithi038.stderr: 12: _start() 2024-09-22T08:35:29.807 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:35:29.807 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:29.807 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-22T08:35:29.807 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-22T08:35:29.807 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-22T08:35:29.807 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-22T08:35:29.807 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-22T08:35:29.807 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-22T08:35:29.807 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-22T08:35:29.807 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-22T08:35:29.808 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-22T08:35:29.808 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-22T08:35:29.808 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-22T08:35:29.808 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-22T08:35:29.808 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-22T08:35:29.808 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-22T08:35:29.808 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-22T08:35:29.808 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-22T08:35:29.808 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-22T08:35:29.808 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-22T08:35:29.808 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-22T08:35:29.808 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-22T08:35:29.808 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-22T08:35:29.808 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-22T08:35:29.808 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-22T08:35:29.809 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-22T08:35:29.809 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:35:29.809 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-22T08:35:29.809 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-22T08:35:29.809 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-22T08:35:29.809 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-22T08:35:29.809 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-22T08:35:29.809 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-22T08:35:29.809 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-22T08:35:29.809 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-22T08:35:29.809 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-22T08:35:29.809 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-22T08:35:29.809 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-22T08:35:29.809 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-22T08:35:29.810 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-22T08:35:29.810 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-22T08:35:29.810 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-22T08:35:29.810 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-22T08:35:29.810 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-22T08:35:29.810 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-22T08:35:29.810 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-22T08:35:29.810 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-22T08:35:29.810 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-22T08:35:29.810 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:35:29.810 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-22T08:35:29.810 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:35:29.810 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-22T08:35:29.810 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-22T08:35:29.811 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-22T08:35:29.811 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-22T08:35:29.811 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-22T08:35:29.811 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-22T08:35:29.811 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-22T08:35:29.811 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-22T08:35:29.811 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-22T08:35:29.811 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-22T08:35:29.811 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-22T08:35:29.811 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-22T08:35:29.811 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-22T08:35:29.811 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-22T08:35:29.811 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-22T08:35:29.811 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-22T08:35:29.811 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-22T08:35:29.812 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-22T08:35:29.812 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:35:29.812 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-22T08:35:29.812 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:35:29.812 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-22T08:35:29.812 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-22T08:35:29.812 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-22T08:35:29.812 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-22T08:35:29.812 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-22T08:35:29.812 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-22T08:35:29.812 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:35:29.812 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-22T08:35:29.812 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-22T08:35:29.812 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:35:29.812 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-22T08:35:29.813 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-22T08:35:29.813 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-22T08:35:29.813 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-22T08:35:29.813 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-22T08:35:29.813 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-22T08:35:29.813 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-22T08:35:29.813 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-22T08:35:29.813 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-22T08:35:29.813 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-22T08:35:29.813 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-22T08:35:29.813 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-22T08:35:29.813 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-22T08:35:29.813 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:35:29.813 INFO:tasks.workunit.client.0.smithi038.stderr: 7fcf837fe640 / http_manager 2024-09-22T08:35:29.813 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd011fe3640 / http_manager 2024-09-22T08:35:29.814 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd012fe5640 / rgw_dt_lg_renew 2024-09-22T08:35:29.814 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd0327fc640 / ms_dispatch 2024-09-22T08:35:29.814 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd0337fe640 / io_context_pool 2024-09-22T08:35:29.814 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd033fff640 / io_context_pool 2024-09-22T08:35:29.814 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd0427fc640 / ms_dispatch 2024-09-22T08:35:29.814 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd049602640 / ms_dispatch 2024-09-22T08:35:29.814 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd04ae05640 / io_context_pool 2024-09-22T08:35:29.814 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd157fff640 / msgr-worker-2 2024-09-22T08:35:29.814 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd15cfc7640 / msgr-worker-1 2024-09-22T08:35:29.814 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd15d7c8640 / msgr-worker-0 2024-09-22T08:35:29.814 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd15dfc9640 / io_context_pool 2024-09-22T08:35:29.814 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd161339800 / radosgw-admin 2024-09-22T08:35:29.814 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-22T08:35:29.814 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-22T08:35:29.814 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/log/ceph/ceph-client.admin.120425.log 2024-09-22T08:35:29.815 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-22T08:35:29.815 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-22T08:35:29.815 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-22T08:35:29.465+0000 7fd161339800 10 monclient(hunting): start opening mon connection 2024-09-22T08:35:29.815 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-22T08:35:29.465+0000 7fd161339800 10 monclient(hunting): start opening mon connection 2024-09-22T08:35:29.815 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-22T08:35:29.465+0000 7fd161339800 10 monclient(hunting): _renew_subs 2024-09-22T08:35:29.815 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-22T08:35:29.465+0000 7fd161339800 10 monclient(hunting): authenticate will time out at 2034.704780s 2024-09-22T08:35:29.815 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-22T08:35:29.465+0000 7fd15cfc7640 10 monclient(hunting): get_auth_request con 0x559ee2164510 auth_method 0 2024-09-22T08:35:29.815 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-22T08:35:29.465+0000 7fd15cfc7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:35:29.815 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-22T08:35:29.465+0000 7fd15cfc7640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:35:29.815 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-22T08:35:29.465+0000 7fd15cfc7640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:35:29.815 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-22T08:35:29.465+0000 7fd15d7c8640 10 monclient(hunting): get_auth_request con 0x559ee21fdef0 auth_method 0 2024-09-22T08:35:29.815 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-22T08:35:29.465+0000 7fd15d7c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:35:29.815 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-22T08:35:29.465+0000 7fd15d7c8640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:35:29.815 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-22T08:35:29.465+0000 7fd15d7c8640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:35:29.815 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-22T08:35:29.465+0000 7fd15cfc7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:35:29.816 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-22T08:35:29.465+0000 7fd15cfc7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:35:29.816 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-22T08:35:29.465+0000 7fd15cfc7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:35:29.816 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-22T08:35:29.465+0000 7fd15d7c8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:35:29.816 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-22T08:35:29.465+0000 7fd15d7c8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:35:29.816 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-22T08:35:29.465+0000 7fd15d7c8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:35:29.816 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-22T08:35:29.466+0000 7fd157fff640 10 monclient(hunting): get_auth_request con 0x559ee216d5b0 auth_method 0 2024-09-22T08:35:29.816 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-22T08:35:29.466+0000 7fd157fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:35:29.816 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-22T08:35:29.466+0000 7fd157fff640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:35:29.816 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-22T08:35:29.466+0000 7fd157fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:35:29.816 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-22T08:35:29.466+0000 7fd15cfc7640 10 monclient(hunting): handle_auth_done global_id 6833 payload 824 2024-09-22T08:35:29.816 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-22T08:35:29.466+0000 7fd15cfc7640 10 monclient: _finish_hunting 0 2024-09-22T08:35:29.816 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-22T08:35:29.466+0000 7fd15cfc7640 1 monclient: found mon.noname-c 2024-09-22T08:35:29.816 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-22T08:35:29.466+0000 7fd15cfc7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:35:29.816 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-22T08:35:29.466+0000 7fd049602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:35:29.816 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-22T08:35:29.466+0000 7fd049602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:35:29.817 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-22T08:35:29.466+0000 7fd049602640 10 monclient: dump: 2024-09-22T08:35:29.817 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:35:29.817 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:35:29.817 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:35:29.817 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:35:29.817 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:35:29.817 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:35:29.817 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:35:29.817 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:35:29.817 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:35:29.817 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:29.817 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-22T08:35:29.466+0000 7fd049602640 10 monclient: _finish_auth 0 2024-09-22T08:35:29.817 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-22T08:35:29.466+0000 7fd049602640 10 monclient: _check_auth_tickets 2024-09-22T08:35:29.817 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-22T08:35:29.466+0000 7fd049602640 10 monclient: handle_config config(0 keys) 2024-09-22T08:35:29.818 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-22T08:35:29.466+0000 7fd049602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:35:29.818 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-22T08:35:29.466+0000 7fd049602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:35:29.818 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-22T08:35:29.466+0000 7fd049602640 10 monclient: dump: 2024-09-22T08:35:29.818 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:35:29.818 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:35:29.818 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:35:29.818 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:35:29.818 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:35:29.818 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:35:29.818 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:35:29.818 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:35:29.818 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:35:29.818 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:29.818 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-22T08:35:29.466+0000 7fd161339800 5 monclient: authenticate success, global_id 6833 2024-09-22T08:35:29.818 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-22T08:35:29.466+0000 7fd161339800 10 monclient: _renew_subs 2024-09-22T08:35:29.819 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-22T08:35:29.466+0000 7fd161339800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:35:29.819 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-22T08:35:29.466+0000 7fd04ae05640 4 set_mon_vals no callback set 2024-09-22T08:35:29.819 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-22T08:35:29.466+0000 7fd161339800 10 monclient: _renew_subs 2024-09-22T08:35:29.819 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-22T08:35:29.466+0000 7fd161339800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:35:29.819 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-22T08:35:29.466+0000 7fd161339800 1 librados: init done 2024-09-22T08:35:29.819 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-22T08:35:29.468+0000 7fd049602640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:35:29.819 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-22T08:35:29.468+0000 7fd049602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:35:29.819 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-22T08:35:29.468+0000 7fd049602640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:35:29.819 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-22T08:35:29.468+0000 7fd157fff640 10 monclient: get_auth_request con 0x7fd044077570 auth_method 0 2024-09-22T08:35:29.819 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-22T08:35:29.468+0000 7fd15d7c8640 10 monclient: get_auth_request con 0x559ee2300530 auth_method 0 2024-09-22T08:35:29.819 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-22T08:35:29.469+0000 7fd15cfc7640 10 monclient: get_auth_request con 0x559ee2303710 auth_method 0 2024-09-22T08:35:29.819 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-22T08:35:29.470+0000 7fd157fff640 10 monclient: get_auth_request con 0x559ee2307900 auth_method 0 2024-09-22T08:35:29.819 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-22T08:35:29.471+0000 7fd15d7c8640 10 monclient: get_auth_request con 0x559ee2306fa0 auth_method 0 2024-09-22T08:35:29.819 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-22T08:35:29.472+0000 7fd161339800 10 monclient: build_initial_monmap 2024-09-22T08:35:29.820 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-22T08:35:29.472+0000 7fd161339800 1 build_initial for_mkfs: 0 2024-09-22T08:35:29.820 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-22T08:35:29.472+0000 7fd161339800 10 monclient: monmap: 2024-09-22T08:35:29.820 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:35:29.820 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:35:29.820 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:35:29.820 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:35:29.820 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:35:29.820 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:35:29.820 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:35:29.820 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:35:29.820 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:35:29.820 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:29.820 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230f900) adding auth protocol: cephx 2024-09-22T08:35:29.820 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230f900) adding auth protocol: cephx 2024-09-22T08:35:29.820 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230f900) adding auth protocol: cephx 2024-09-22T08:35:29.821 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230f900) adding con mode: secure 2024-09-22T08:35:29.821 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230f900) adding con mode: crc 2024-09-22T08:35:29.821 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230f900) adding con mode: secure 2024-09-22T08:35:29.821 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230f900) adding con mode: crc 2024-09-22T08:35:29.821 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230f900) adding con mode: secure 2024-09-22T08:35:29.821 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230f900) adding con mode: crc 2024-09-22T08:35:29.821 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230f900) adding con mode: crc 2024-09-22T08:35:29.821 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230f900) adding con mode: secure 2024-09-22T08:35:29.821 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230f900) adding con mode: crc 2024-09-22T08:35:29.821 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230f900) adding con mode: secure 2024-09-22T08:35:29.821 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230f900) adding con mode: crc 2024-09-22T08:35:29.821 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230f900) adding con mode: secure 2024-09-22T08:35:29.821 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-22T08:35:29.472+0000 7fd161339800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:35:29.821 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-22T08:35:29.472+0000 7fd161339800 5 asok(0x559ee20960f0) register_command objecter_requests cmddesc objecter_requests hook 0x559ee2313260 EEXIST 2024-09-22T08:35:29.821 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-22T08:35:29.472+0000 7fd161339800 10 monclient: init 2024-09-22T08:35:29.822 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230e7f8) adding auth protocol: cephx 2024-09-22T08:35:29.822 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230e7f8) adding auth protocol: cephx 2024-09-22T08:35:29.822 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230e7f8) adding auth protocol: cephx 2024-09-22T08:35:29.822 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230e7f8) adding con mode: secure 2024-09-22T08:35:29.822 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230e7f8) adding con mode: crc 2024-09-22T08:35:29.822 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230e7f8) adding con mode: secure 2024-09-22T08:35:29.822 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230e7f8) adding con mode: crc 2024-09-22T08:35:29.822 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230e7f8) adding con mode: secure 2024-09-22T08:35:29.822 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230e7f8) adding con mode: crc 2024-09-22T08:35:29.822 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230e7f8) adding con mode: crc 2024-09-22T08:35:29.822 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230e7f8) adding con mode: secure 2024-09-22T08:35:29.822 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230e7f8) adding con mode: crc 2024-09-22T08:35:29.822 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230e7f8) adding con mode: secure 2024-09-22T08:35:29.822 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230e7f8) adding con mode: crc 2024-09-22T08:35:29.823 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-22T08:35:29.472+0000 7fd161339800 5 AuthRegistry(0x559ee230e7f8) adding con mode: secure 2024-09-22T08:35:29.823 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-22T08:35:29.473+0000 7fd161339800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:35:29.823 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-22T08:35:29.473+0000 7fd161339800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:35:29.823 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-22T08:35:29.473+0000 7fd161339800 5 asok(0x559ee20960f0) register_command rotate-key cmddesc rotate-key hook 0x559ee230e940 EEXIST 2024-09-22T08:35:29.823 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-22T08:35:29.473+0000 7fd161339800 10 monclient: _reopen_session rank -1 2024-09-22T08:35:29.823 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-22T08:35:29.473+0000 7fd161339800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T08:35:29.823 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-22T08:35:29.473+0000 7fd161339800 10 monclient(hunting): picked mon.noname-b con 0x559ee2336f50 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:35:29.823 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-22T08:35:29.473+0000 7fd161339800 10 monclient(hunting): picked mon.noname-a con 0x559ee2339220 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:35:29.823 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-22T08:35:29.473+0000 7fd161339800 10 monclient(hunting): picked mon.noname-c con 0x559ee2335720 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:35:29.823 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-22T08:35:29.473+0000 7fd161339800 10 monclient(hunting): start opening mon connection 2024-09-22T08:35:29.823 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-22T08:35:29.473+0000 7fd161339800 10 monclient(hunting): start opening mon connection 2024-09-22T08:35:29.823 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-22T08:35:29.473+0000 7fd161339800 10 monclient(hunting): start opening mon connection 2024-09-22T08:35:29.823 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-22T08:35:29.473+0000 7fd161339800 10 monclient(hunting): _renew_subs 2024-09-22T08:35:29.823 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-22T08:35:29.473+0000 7fd161339800 10 monclient(hunting): authenticate will time out at 2034.712431s 2024-09-22T08:35:29.823 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-22T08:35:29.473+0000 7fd15cfc7640 10 monclient(hunting): get_auth_request con 0x559ee2335720 auth_method 0 2024-09-22T08:35:29.824 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-22T08:35:29.473+0000 7fd15cfc7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:35:29.824 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-22T08:35:29.473+0000 7fd15cfc7640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:35:29.824 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-22T08:35:29.473+0000 7fd15cfc7640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:35:29.824 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-22T08:35:29.473+0000 7fd15d7c8640 10 monclient(hunting): get_auth_request con 0x559ee2339220 auth_method 0 2024-09-22T08:35:29.824 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-22T08:35:29.473+0000 7fd15d7c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:35:29.824 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-22T08:35:29.473+0000 7fd15d7c8640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:35:29.824 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-22T08:35:29.473+0000 7fd15d7c8640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:35:29.824 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-22T08:35:29.473+0000 7fd157fff640 10 monclient(hunting): get_auth_request con 0x559ee2336f50 auth_method 0 2024-09-22T08:35:29.824 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-22T08:35:29.473+0000 7fd157fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:35:29.824 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-22T08:35:29.473+0000 7fd157fff640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:35:29.824 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-22T08:35:29.473+0000 7fd157fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:35:29.824 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-22T08:35:29.473+0000 7fd15cfc7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:35:29.824 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-22T08:35:29.473+0000 7fd15cfc7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:35:29.824 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-22T08:35:29.473+0000 7fd15cfc7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:35:29.824 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-22T08:35:29.473+0000 7fd15d7c8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:35:29.825 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-22T08:35:29.473+0000 7fd15d7c8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:35:29.825 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-22T08:35:29.473+0000 7fd15d7c8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:35:29.825 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-22T08:35:29.473+0000 7fd157fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:35:29.825 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-22T08:35:29.473+0000 7fd157fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:35:29.825 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-22T08:35:29.473+0000 7fd157fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:35:29.825 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-22T08:35:29.473+0000 7fd15cfc7640 10 monclient(hunting): handle_auth_done global_id 6836 payload 824 2024-09-22T08:35:29.825 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-22T08:35:29.473+0000 7fd15cfc7640 10 monclient: _finish_hunting 0 2024-09-22T08:35:29.825 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-22T08:35:29.473+0000 7fd15cfc7640 1 monclient: found mon.noname-c 2024-09-22T08:35:29.825 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-22T08:35:29.473+0000 7fd15cfc7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:35:29.825 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-22T08:35:29.474+0000 7fd0427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:35:29.825 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-22T08:35:29.474+0000 7fd0427fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:35:29.825 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-22T08:35:29.474+0000 7fd0427fc640 10 monclient: dump: 2024-09-22T08:35:29.825 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:35:29.825 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:35:29.826 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:35:29.826 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:35:29.826 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:35:29.826 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:35:29.826 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:35:29.826 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:35:29.826 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:35:29.826 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:29.826 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-22T08:35:29.474+0000 7fd0427fc640 10 monclient: _finish_auth 0 2024-09-22T08:35:29.826 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-22T08:35:29.474+0000 7fd0427fc640 10 monclient: _check_auth_tickets 2024-09-22T08:35:29.826 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-22T08:35:29.474+0000 7fd0427fc640 10 monclient: handle_config config(0 keys) 2024-09-22T08:35:29.826 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-22T08:35:29.474+0000 7fd0427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:35:29.826 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-22T08:35:29.474+0000 7fd0427fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:35:29.826 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-22T08:35:29.474+0000 7fd0427fc640 10 monclient: dump: 2024-09-22T08:35:29.827 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:35:29.827 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:35:29.827 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:35:29.827 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:35:29.827 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:35:29.827 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:35:29.827 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:35:29.827 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:35:29.827 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:35:29.827 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:29.827 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-22T08:35:29.474+0000 7fd161339800 5 monclient: authenticate success, global_id 6836 2024-09-22T08:35:29.827 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-22T08:35:29.474+0000 7fd161339800 10 monclient: _renew_subs 2024-09-22T08:35:29.827 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-22T08:35:29.474+0000 7fd15dfc9640 4 set_mon_vals no callback set 2024-09-22T08:35:29.827 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-22T08:35:29.474+0000 7fd161339800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:35:29.827 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-22T08:35:29.474+0000 7fd161339800 10 monclient: _renew_subs 2024-09-22T08:35:29.828 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-22T08:35:29.474+0000 7fd161339800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:35:29.828 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-22T08:35:29.475+0000 7fd0427fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:35:29.828 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-22T08:35:29.475+0000 7fd0427fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:35:29.828 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-22T08:35:29.475+0000 7fd0427fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:35:29.828 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-22T08:35:29.476+0000 7fd157fff640 10 monclient: get_auth_request con 0x7fd034077480 auth_method 0 2024-09-22T08:35:29.828 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-22T08:35:29.476+0000 7fd161339800 10 monclient: get_monmap_and_config 2024-09-22T08:35:29.828 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-22T08:35:29.476+0000 7fd161339800 10 monclient: build_initial_monmap 2024-09-22T08:35:29.828 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-22T08:35:29.476+0000 7fd161339800 1 build_initial for_mkfs: 0 2024-09-22T08:35:29.828 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-22T08:35:29.476+0000 7fd161339800 10 monclient: monmap: 2024-09-22T08:35:29.828 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:35:29.828 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:35:29.828 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:35:29.828 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:35:29.828 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:35:29.829 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:35:29.829 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:35:29.829 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:35:29.829 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:35:29.829 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:29.829 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x559ee2356b50) adding auth protocol: cephx 2024-09-22T08:35:29.829 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x559ee2356b50) adding auth protocol: cephx 2024-09-22T08:35:29.829 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x559ee2356b50) adding auth protocol: cephx 2024-09-22T08:35:29.829 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x559ee2356b50) adding con mode: secure 2024-09-22T08:35:29.829 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x559ee2356b50) adding con mode: crc 2024-09-22T08:35:29.829 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x559ee2356b50) adding con mode: secure 2024-09-22T08:35:29.829 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x559ee2356b50) adding con mode: crc 2024-09-22T08:35:29.829 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x559ee2356b50) adding con mode: secure 2024-09-22T08:35:29.829 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x559ee2356b50) adding con mode: crc 2024-09-22T08:35:29.830 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x559ee2356b50) adding con mode: crc 2024-09-22T08:35:29.830 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x559ee2356b50) adding con mode: secure 2024-09-22T08:35:29.830 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x559ee2356b50) adding con mode: crc 2024-09-22T08:35:29.830 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x559ee2356b50) adding con mode: secure 2024-09-22T08:35:29.830 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x559ee2356b50) adding con mode: crc 2024-09-22T08:35:29.830 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x559ee2356b50) adding con mode: secure 2024-09-22T08:35:29.830 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-22T08:35:29.476+0000 7fd161339800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:35:29.830 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-22T08:35:29.476+0000 7fd161339800 10 monclient: init 2024-09-22T08:35:29.830 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b2f0) adding auth protocol: cephx 2024-09-22T08:35:29.830 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b2f0) adding auth protocol: cephx 2024-09-22T08:35:29.830 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b2f0) adding auth protocol: cephx 2024-09-22T08:35:29.830 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b2f0) adding con mode: secure 2024-09-22T08:35:29.830 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b2f0) adding con mode: crc 2024-09-22T08:35:29.830 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b2f0) adding con mode: secure 2024-09-22T08:35:29.831 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b2f0) adding con mode: crc 2024-09-22T08:35:29.831 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b2f0) adding con mode: secure 2024-09-22T08:35:29.831 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b2f0) adding con mode: crc 2024-09-22T08:35:29.831 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b2f0) adding con mode: crc 2024-09-22T08:35:29.831 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b2f0) adding con mode: secure 2024-09-22T08:35:29.831 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b2f0) adding con mode: crc 2024-09-22T08:35:29.831 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b2f0) adding con mode: secure 2024-09-22T08:35:29.831 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b2f0) adding con mode: crc 2024-09-22T08:35:29.831 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-22T08:35:29.476+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b2f0) adding con mode: secure 2024-09-22T08:35:29.831 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-22T08:35:29.476+0000 7fd161339800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:35:29.831 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-22T08:35:29.477+0000 7fd161339800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:35:29.831 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-22T08:35:29.477+0000 7fd161339800 5 asok(0x559ee20960f0) register_command rotate-key cmddesc rotate-key hook 0x7ffe5400b438 EEXIST 2024-09-22T08:35:29.831 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-22T08:35:29.477+0000 7fd161339800 10 monclient: _reopen_session rank -1 2024-09-22T08:35:29.831 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-22T08:35:29.477+0000 7fd161339800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T08:35:29.831 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-22T08:35:29.477+0000 7fd161339800 10 monclient(hunting): picked mon.noname-b con 0x559ee238b210 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:35:29.832 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-22T08:35:29.477+0000 7fd161339800 10 monclient(hunting): picked mon.noname-a con 0x559ee235c160 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:35:29.832 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-22T08:35:29.477+0000 7fd161339800 10 monclient(hunting): picked mon.noname-c con 0x559ee2386ab0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:35:29.832 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-22T08:35:29.477+0000 7fd161339800 10 monclient(hunting): start opening mon connection 2024-09-22T08:35:29.832 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-22T08:35:29.477+0000 7fd161339800 10 monclient(hunting): start opening mon connection 2024-09-22T08:35:29.832 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-22T08:35:29.477+0000 7fd161339800 10 monclient(hunting): start opening mon connection 2024-09-22T08:35:29.832 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-22T08:35:29.477+0000 7fd161339800 10 monclient(hunting): _renew_subs 2024-09-22T08:35:29.832 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-22T08:35:29.477+0000 7fd161339800 10 monclient(hunting): authenticate will time out at 2034.716263s 2024-09-22T08:35:29.832 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-22T08:35:29.477+0000 7fd15cfc7640 10 monclient(hunting): get_auth_request con 0x559ee2386ab0 auth_method 0 2024-09-22T08:35:29.832 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-22T08:35:29.477+0000 7fd15cfc7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:35:29.832 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-22T08:35:29.477+0000 7fd15cfc7640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:35:29.832 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-22T08:35:29.477+0000 7fd15cfc7640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:35:29.832 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-22T08:35:29.477+0000 7fd15d7c8640 10 monclient(hunting): get_auth_request con 0x559ee235c160 auth_method 0 2024-09-22T08:35:29.832 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-22T08:35:29.477+0000 7fd15d7c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:35:29.832 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-22T08:35:29.477+0000 7fd15d7c8640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:35:29.833 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-22T08:35:29.477+0000 7fd15d7c8640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:35:29.833 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-22T08:35:29.477+0000 7fd15cfc7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:35:29.833 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-22T08:35:29.477+0000 7fd15cfc7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:35:29.833 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-22T08:35:29.477+0000 7fd15cfc7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:35:29.833 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-22T08:35:29.477+0000 7fd15d7c8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:35:29.833 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-22T08:35:29.477+0000 7fd15d7c8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:35:29.833 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-22T08:35:29.477+0000 7fd15d7c8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:35:29.833 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-22T08:35:29.477+0000 7fd15cfc7640 10 monclient(hunting): handle_auth_done global_id 6839 payload 274 2024-09-22T08:35:29.833 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-22T08:35:29.477+0000 7fd15cfc7640 10 monclient: _finish_hunting 0 2024-09-22T08:35:29.833 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-22T08:35:29.477+0000 7fd15cfc7640 1 monclient: found mon.noname-c 2024-09-22T08:35:29.833 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-22T08:35:29.477+0000 7fd15cfc7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:35:29.833 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-22T08:35:29.477+0000 7fd033fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:35:29.833 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-22T08:35:29.477+0000 7fd033fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:35:29.833 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-22T08:35:29.477+0000 7fd033fff640 10 monclient: dump: 2024-09-22T08:35:29.833 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:35:29.834 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:35:29.834 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:35:29.834 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:35:29.834 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:35:29.834 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:35:29.834 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:35:29.834 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:35:29.834 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:35:29.834 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:29.834 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-22T08:35:29.477+0000 7fd033fff640 10 monclient: _finish_auth 0 2024-09-22T08:35:29.834 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-22T08:35:29.477+0000 7fd033fff640 10 monclient: _check_auth_tickets 2024-09-22T08:35:29.834 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-22T08:35:29.477+0000 7fd033fff640 10 monclient: handle_config config(0 keys) 2024-09-22T08:35:29.834 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-22T08:35:29.477+0000 7fd033fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:35:29.835 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-22T08:35:29.477+0000 7fd033fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:35:29.835 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-22T08:35:29.477+0000 7fd033fff640 10 monclient: dump: 2024-09-22T08:35:29.835 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:35:29.835 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:35:29.835 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:35:29.835 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:35:29.835 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:35:29.835 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:35:29.835 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:35:29.835 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:35:29.835 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:35:29.835 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:29.835 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-22T08:35:29.477+0000 7fd161339800 5 monclient: authenticate success, global_id 6839 2024-09-22T08:35:29.835 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-22T08:35:29.477+0000 7fd161339800 10 monclient: get_monmap_and_config success 2024-09-22T08:35:29.835 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-22T08:35:29.477+0000 7fd161339800 4 set_mon_vals no callback set 2024-09-22T08:35:29.836 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-22T08:35:29.478+0000 7fd161339800 10 monclient: shutdown 2024-09-22T08:35:29.836 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-22T08:35:29.478+0000 7fd161339800 10 monclient: build_initial_monmap 2024-09-22T08:35:29.836 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-22T08:35:29.478+0000 7fd161339800 1 build_initial for_mkfs: 0 2024-09-22T08:35:29.836 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-22T08:35:29.478+0000 7fd161339800 10 monclient: monmap: 2024-09-22T08:35:29.836 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:35:29.836 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:35:29.836 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:35:29.836 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:35:29.836 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:35:29.836 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:35:29.836 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:35:29.836 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:35:29.836 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:35:29.836 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:29.836 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee23873e0) adding auth protocol: cephx 2024-09-22T08:35:29.836 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee23873e0) adding auth protocol: cephx 2024-09-22T08:35:29.837 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee23873e0) adding auth protocol: cephx 2024-09-22T08:35:29.837 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee23873e0) adding con mode: secure 2024-09-22T08:35:29.837 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee23873e0) adding con mode: crc 2024-09-22T08:35:29.837 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee23873e0) adding con mode: secure 2024-09-22T08:35:29.837 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee23873e0) adding con mode: crc 2024-09-22T08:35:29.837 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee23873e0) adding con mode: secure 2024-09-22T08:35:29.837 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee23873e0) adding con mode: crc 2024-09-22T08:35:29.837 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee23873e0) adding con mode: crc 2024-09-22T08:35:29.837 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee23873e0) adding con mode: secure 2024-09-22T08:35:29.837 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee23873e0) adding con mode: crc 2024-09-22T08:35:29.837 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee23873e0) adding con mode: secure 2024-09-22T08:35:29.837 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee23873e0) adding con mode: crc 2024-09-22T08:35:29.837 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee23873e0) adding con mode: secure 2024-09-22T08:35:29.837 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-22T08:35:29.478+0000 7fd161339800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:35:29.838 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-22T08:35:29.478+0000 7fd161339800 1 librados: starting msgr at 2024-09-22T08:35:29.838 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-22T08:35:29.478+0000 7fd161339800 1 librados: starting objecter 2024-09-22T08:35:29.838 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-22T08:35:29.478+0000 7fd161339800 5 asok(0x559ee20960f0) register_command objecter_requests cmddesc objecter_requests hook 0x559ee2386230 EEXIST 2024-09-22T08:35:29.838 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-22T08:35:29.478+0000 7fd161339800 1 librados: setting wanted keys 2024-09-22T08:35:29.838 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-22T08:35:29.478+0000 7fd161339800 1 librados: calling monclient init 2024-09-22T08:35:29.838 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-22T08:35:29.478+0000 7fd161339800 10 monclient: init 2024-09-22T08:35:29.838 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee234ed00) adding auth protocol: cephx 2024-09-22T08:35:29.838 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee234ed00) adding auth protocol: cephx 2024-09-22T08:35:29.838 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee234ed00) adding auth protocol: cephx 2024-09-22T08:35:29.838 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee234ed00) adding con mode: secure 2024-09-22T08:35:29.838 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee234ed00) adding con mode: crc 2024-09-22T08:35:29.838 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee234ed00) adding con mode: secure 2024-09-22T08:35:29.838 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee234ed00) adding con mode: crc 2024-09-22T08:35:29.838 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee234ed00) adding con mode: secure 2024-09-22T08:35:29.838 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee234ed00) adding con mode: crc 2024-09-22T08:35:29.839 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee234ed00) adding con mode: crc 2024-09-22T08:35:29.839 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee234ed00) adding con mode: secure 2024-09-22T08:35:29.839 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee234ed00) adding con mode: crc 2024-09-22T08:35:29.839 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee234ed00) adding con mode: secure 2024-09-22T08:35:29.839 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee234ed00) adding con mode: crc 2024-09-22T08:35:29.839 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-22T08:35:29.478+0000 7fd161339800 5 AuthRegistry(0x559ee234ed00) adding con mode: secure 2024-09-22T08:35:29.839 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-22T08:35:29.479+0000 7fd161339800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:35:29.839 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-22T08:35:29.479+0000 7fd161339800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:35:29.839 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-22T08:35:29.479+0000 7fd161339800 5 asok(0x559ee20960f0) register_command rotate-key cmddesc rotate-key hook 0x559ee234ee48 EEXIST 2024-09-22T08:35:29.839 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-22T08:35:29.479+0000 7fd161339800 10 monclient: _reopen_session rank -1 2024-09-22T08:35:29.839 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-22T08:35:29.479+0000 7fd161339800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T08:35:29.839 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-22T08:35:29.479+0000 7fd161339800 10 monclient(hunting): picked mon.noname-a con 0x559ee235c160 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:35:29.839 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-22T08:35:29.479+0000 7fd161339800 10 monclient(hunting): picked mon.noname-b con 0x559ee2386ab0 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:35:29.839 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-22T08:35:29.479+0000 7fd161339800 10 monclient(hunting): picked mon.noname-c con 0x559ee238b210 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:35:29.840 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-22T08:35:29.479+0000 7fd161339800 10 monclient(hunting): start opening mon connection 2024-09-22T08:35:29.840 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-22T08:35:29.479+0000 7fd161339800 10 monclient(hunting): start opening mon connection 2024-09-22T08:35:29.840 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-22T08:35:29.479+0000 7fd161339800 10 monclient(hunting): start opening mon connection 2024-09-22T08:35:29.840 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-22T08:35:29.479+0000 7fd161339800 10 monclient(hunting): _renew_subs 2024-09-22T08:35:29.840 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-22T08:35:29.479+0000 7fd161339800 10 monclient(hunting): authenticate will time out at 2034.718608s 2024-09-22T08:35:29.840 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-22T08:35:29.479+0000 7fd157fff640 10 monclient(hunting): get_auth_request con 0x559ee235c160 auth_method 0 2024-09-22T08:35:29.840 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-22T08:35:29.479+0000 7fd157fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:35:29.840 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-22T08:35:29.479+0000 7fd157fff640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:35:29.840 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-22T08:35:29.479+0000 7fd157fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:35:29.840 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-22T08:35:29.479+0000 7fd15cfc7640 10 monclient(hunting): get_auth_request con 0x559ee238b210 auth_method 0 2024-09-22T08:35:29.840 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-22T08:35:29.479+0000 7fd15cfc7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:35:29.840 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-22T08:35:29.479+0000 7fd15cfc7640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:35:29.840 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-22T08:35:29.479+0000 7fd15cfc7640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:35:29.840 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-22T08:35:29.479+0000 7fd157fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:35:29.841 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-22T08:35:29.479+0000 7fd157fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:35:29.841 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-22T08:35:29.479+0000 7fd157fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:35:29.841 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-22T08:35:29.479+0000 7fd15cfc7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:35:29.841 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-22T08:35:29.479+0000 7fd15cfc7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:35:29.841 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-22T08:35:29.479+0000 7fd15cfc7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:35:29.841 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-22T08:35:29.479+0000 7fd15d7c8640 10 monclient(hunting): get_auth_request con 0x559ee2386ab0 auth_method 0 2024-09-22T08:35:29.841 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-22T08:35:29.479+0000 7fd15d7c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:35:29.841 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-22T08:35:29.479+0000 7fd15d7c8640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:35:29.841 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-22T08:35:29.479+0000 7fd15d7c8640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:35:29.841 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-22T08:35:29.479+0000 7fd15cfc7640 10 monclient(hunting): handle_auth_done global_id 6842 payload 824 2024-09-22T08:35:29.841 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-22T08:35:29.480+0000 7fd15cfc7640 10 monclient: _finish_hunting 0 2024-09-22T08:35:29.841 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-22T08:35:29.480+0000 7fd15cfc7640 1 monclient: found mon.noname-c 2024-09-22T08:35:29.841 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-22T08:35:29.480+0000 7fd15cfc7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:35:29.841 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-22T08:35:29.480+0000 7fd0327fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:35:29.841 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-22T08:35:29.480+0000 7fd0327fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:35:29.841 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-22T08:35:29.480+0000 7fd0327fc640 10 monclient: dump: 2024-09-22T08:35:29.842 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:35:29.842 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:35:29.842 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:35:29.842 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:35:29.842 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:35:29.842 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:35:29.842 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:35:29.842 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:35:29.842 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:35:29.842 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:29.842 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-22T08:35:29.480+0000 7fd0327fc640 10 monclient: _finish_auth 0 2024-09-22T08:35:29.842 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-22T08:35:29.480+0000 7fd0327fc640 10 monclient: _check_auth_tickets 2024-09-22T08:35:29.842 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-22T08:35:29.480+0000 7fd0327fc640 10 monclient: handle_config config(0 keys) 2024-09-22T08:35:29.842 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-22T08:35:29.480+0000 7fd0327fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:35:29.843 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-22T08:35:29.480+0000 7fd0327fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:35:29.843 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-22T08:35:29.480+0000 7fd0327fc640 10 monclient: dump: 2024-09-22T08:35:29.843 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:35:29.843 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:35:29.843 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:35:29.843 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:35:29.843 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:35:29.843 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:35:29.843 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:35:29.843 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:35:29.843 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:35:29.843 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:29.843 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-22T08:35:29.480+0000 7fd161339800 5 monclient: authenticate success, global_id 6842 2024-09-22T08:35:29.843 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-22T08:35:29.480+0000 7fd161339800 10 monclient: _renew_subs 2024-09-22T08:35:29.843 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-22T08:35:29.480+0000 7fd033fff640 4 set_mon_vals no callback set 2024-09-22T08:35:29.844 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-22T08:35:29.480+0000 7fd161339800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:35:29.844 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-22T08:35:29.480+0000 7fd161339800 10 monclient: _renew_subs 2024-09-22T08:35:29.844 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-22T08:35:29.480+0000 7fd161339800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:35:29.844 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-22T08:35:29.480+0000 7fd161339800 1 librados: init done 2024-09-22T08:35:29.844 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-22T08:35:29.480+0000 7fd161339800 5 asok(0x559ee20960f0) register_command cr dump hook 0x559ee23812e8 2024-09-22T08:35:29.844 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-22T08:35:29.481+0000 7fd161339800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.844 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-22T08:35:29.482+0000 7fd0327fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:35:29.844 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-22T08:35:29.482+0000 7fd0327fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:35:29.844 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-22T08:35:29.482+0000 7fd0327fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:35:29.844 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-22T08:35:29.482+0000 7fd157fff640 10 monclient: get_auth_request con 0x7fd028077570 auth_method 0 2024-09-22T08:35:29.844 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-22T08:35:29.483+0000 7fd15d7c8640 10 monclient: get_auth_request con 0x559ee23a4650 auth_method 0 2024-09-22T08:35:29.844 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-22T08:35:29.483+0000 7fd161339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:29.844 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-22T08:35:29.483+0000 7fd161339800 20 realm 2024-09-22T08:35:29.844 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-22T08:35:29.483+0000 7fd161339800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.845 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-22T08:35:29.483+0000 7fd161339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:29.845 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-22T08:35:29.483+0000 7fd161339800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:35:29.845 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-22T08:35:29.483+0000 7fd161339800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.845 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-22T08:35:29.484+0000 7fd161339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:29.845 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-22T08:35:29.484+0000 7fd161339800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.845 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-22T08:35:29.484+0000 7fd157fff640 10 monclient: get_auth_request con 0x559ee23a8890 auth_method 0 2024-09-22T08:35:29.845 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-22T08:35:29.485+0000 7fd161339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:35:29.845 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-22T08:35:29.485+0000 7fd161339800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.845 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-22T08:35:29.485+0000 7fd15d7c8640 10 monclient: get_auth_request con 0x559ee23ac160 auth_method 0 2024-09-22T08:35:29.845 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-22T08:35:29.485+0000 7fd161339800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:35:29.845 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-22T08:35:29.485+0000 7fd161339800 20 searching for the correct realm 2024-09-22T08:35:29.845 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-22T08:35:29.486+0000 7fd15cfc7640 10 monclient: get_auth_request con 0x559ee23b0e90 auth_method 0 2024-09-22T08:35:29.845 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-22T08:35:29.487+0000 7fd157fff640 10 monclient: get_auth_request con 0x7fd148015070 auth_method 0 2024-09-22T08:35:29.845 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-22T08:35:29.488+0000 7fd15d7c8640 0 -- 172.21.15.38:0/3124990968 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7fd150058930 msgr2=0x7fd1500b0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:35:29.846 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-22T08:35:29.690+0000 7fd15d7c8640 10 monclient: get_auth_request con 0x7fd150058930 auth_method 0 2024-09-22T08:35:29.846 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-22T08:35:29.692+0000 7fd15cfc7640 10 monclient: get_auth_request con 0x7fd148057920 auth_method 0 2024-09-22T08:35:29.846 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-22T08:35:29.693+0000 7fd157fff640 10 monclient: get_auth_request con 0x7fd1500db120 auth_method 0 2024-09-22T08:35:29.846 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-22T08:35:29.694+0000 7fd15d7c8640 0 -- 172.21.15.38:0/3124990968 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x559ee23a4650 msgr2=0x559ee23a6b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:35:29.846 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-22T08:35:29.694+0000 7fd0327fc640 1 client.6842.objecter ms_handle_reset 0x559ee23a4650 session 0x559ee23a3f80 osd.6 2024-09-22T08:35:29.846 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-22T08:35:29.694+0000 7fd0327fc640 10 monclient: _renew_subs 2024-09-22T08:35:29.846 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-22T08:35:29.694+0000 7fd0327fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:35:29.846 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-22T08:35:29.695+0000 7fd15d7c8640 10 monclient: get_auth_request con 0x7fd028087010 auth_method 0 2024-09-22T08:35:29.846 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-22T08:35:29.698+0000 7fd161339800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:35:29.846 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-22T08:35:29.698+0000 7fd161339800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:35:29.846 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-22T08:35:29.698+0000 7fd161339800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:35:29.846 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-22T08:35:29.698+0000 7fd161339800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:35:29.846 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-22T08:35:29.698+0000 7fd161339800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:35:29.846 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-22T08:35:29.698+0000 7fd161339800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:35:29.847 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-22T08:35:29.698+0000 7fd161339800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.847 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-22T08:35:29.699+0000 7fd161339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:29.847 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-22T08:35:29.699+0000 7fd161339800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.847 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-22T08:35:29.699+0000 7fd161339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:35:29.847 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-22T08:35:29.699+0000 7fd161339800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.847 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-22T08:35:29.699+0000 7fd161339800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:35:29.847 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-22T08:35:29.699+0000 7fd161339800 20 zone default found 2024-09-22T08:35:29.847 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-22T08:35:29.699+0000 7fd161339800 4 Realm: () 2024-09-22T08:35:29.847 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-22T08:35:29.699+0000 7fd161339800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:35:29.847 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-22T08:35:29.699+0000 7fd161339800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:35:29.847 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-22T08:35:29.699+0000 7fd161339800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:35:29.847 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-22T08:35:29.699+0000 7fd161339800 20 zonegroup default 2024-09-22T08:35:29.847 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-22T08:35:29.699+0000 7fd161339800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.847 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-22T08:35:29.700+0000 7fd161339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:29.847 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-22T08:35:29.700+0000 7fd161339800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.848 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-22T08:35:29.700+0000 7fd161339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:29.848 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-22T08:35:29.700+0000 7fd161339800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.848 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-22T08:35:29.701+0000 7fd161339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:29.848 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-22T08:35:29.701+0000 7fd161339800 20 started sync module instance, tier type = 2024-09-22T08:35:29.848 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-22T08:35:29.701+0000 7fd161339800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:35:29.848 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-22T08:35:29.710+0000 7fd161339800 20 add_watcher() i=0 2024-09-22T08:35:29.848 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-22T08:35:29.710+0000 7fd161339800 20 add_watcher() i=1 2024-09-22T08:35:29.848 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-22T08:35:29.710+0000 7fd161339800 20 add_watcher() i=2 2024-09-22T08:35:29.848 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-22T08:35:29.710+0000 7fd161339800 20 add_watcher() i=3 2024-09-22T08:35:29.848 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-22T08:35:29.710+0000 7fd161339800 20 add_watcher() i=4 2024-09-22T08:35:29.848 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-22T08:35:29.710+0000 7fd161339800 20 add_watcher() i=5 2024-09-22T08:35:29.848 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-22T08:35:29.710+0000 7fd161339800 20 add_watcher() i=6 2024-09-22T08:35:29.848 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-22T08:35:29.712+0000 7fd161339800 20 add_watcher() i=7 2024-09-22T08:35:29.848 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-22T08:35:29.712+0000 7fd161339800 2 all 8 watchers are set, enabling cache 2024-09-22T08:35:29.848 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-22T08:35:29.714+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b7c0) adding auth protocol: cephx 2024-09-22T08:35:29.849 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-22T08:35:29.714+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b7c0) adding auth protocol: cephx 2024-09-22T08:35:29.849 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-22T08:35:29.714+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b7c0) adding auth protocol: cephx 2024-09-22T08:35:29.849 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-22T08:35:29.714+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b7c0) adding con mode: secure 2024-09-22T08:35:29.849 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-22T08:35:29.714+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b7c0) adding con mode: crc 2024-09-22T08:35:29.849 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-22T08:35:29.714+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b7c0) adding con mode: secure 2024-09-22T08:35:29.849 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-22T08:35:29.714+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b7c0) adding con mode: crc 2024-09-22T08:35:29.849 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-22T08:35:29.714+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b7c0) adding con mode: secure 2024-09-22T08:35:29.849 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-22T08:35:29.714+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b7c0) adding con mode: crc 2024-09-22T08:35:29.849 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-22T08:35:29.714+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b7c0) adding con mode: crc 2024-09-22T08:35:29.849 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-22T08:35:29.714+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b7c0) adding con mode: secure 2024-09-22T08:35:29.849 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-22T08:35:29.714+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b7c0) adding con mode: crc 2024-09-22T08:35:29.849 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-22T08:35:29.714+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b7c0) adding con mode: secure 2024-09-22T08:35:29.849 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-22T08:35:29.714+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b7c0) adding con mode: crc 2024-09-22T08:35:29.849 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-22T08:35:29.714+0000 7fd161339800 5 AuthRegistry(0x7ffe5400b7c0) adding con mode: secure 2024-09-22T08:35:29.849 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-22T08:35:29.714+0000 7fd012fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:35:29.850 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-22T08:35:29.714+0000 7fd161339800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:35:29.850 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-22T08:35:29.714+0000 7fd161339800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:35:29.850 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-22T08:35:29.714+0000 7fd161339800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:35:29.850 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-22T08:35:29.714+0000 7fd161339800 5 asok(0x559ee20960f0) register_command cache list hook 0x559ee237bab0 2024-09-22T08:35:29.850 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-22T08:35:29.714+0000 7fd161339800 5 asok(0x559ee20960f0) register_command cache inspect hook 0x559ee237bab0 2024-09-22T08:35:29.850 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-22T08:35:29.714+0000 7fd161339800 5 asok(0x559ee20960f0) register_command cache erase hook 0x559ee237bab0 2024-09-22T08:35:29.850 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-22T08:35:29.714+0000 7fd161339800 5 asok(0x559ee20960f0) register_command cache zap hook 0x559ee237bab0 2024-09-22T08:35:29.850 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-22T08:35:29.714+0000 7fd161339800 5 note: GC not initialized 2024-09-22T08:35:29.850 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-22T08:35:29.714+0000 7fd011fe3640 20 reqs_thread_entry: start 2024-09-22T08:35:29.850 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-22T08:35:29.714+0000 7fd161339800 5 asok(0x559ee20960f0) register_command sync trace show hook 0x7fd15006f030 2024-09-22T08:35:29.850 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-22T08:35:29.714+0000 7fd161339800 5 asok(0x559ee20960f0) register_command sync trace history hook 0x7fd15006f030 2024-09-22T08:35:29.850 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-22T08:35:29.714+0000 7fd161339800 5 asok(0x559ee20960f0) register_command sync trace active hook 0x7fd15006f030 2024-09-22T08:35:29.850 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-22T08:35:29.714+0000 7fd161339800 5 asok(0x559ee20960f0) register_command sync trace active_short hook 0x7fd15006f030 2024-09-22T08:35:29.851 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-22T08:35:29.714+0000 7fd161339800 20 init_complete bucket index max shards: 11 2024-09-22T08:35:29.851 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-22T08:35:29.714+0000 7fd161339800 20 Filter name: none 2024-09-22T08:35:29.851 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-22T08:35:29.715+0000 7fcf837fe640 20 reqs_thread_entry: start 2024-09-22T08:35:29.851 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-22T08:35:29.715+0000 7fd161339800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-22T08:35:29.851 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-22T08:35:29.715+0000 7fd161339800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.851 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-22T08:35:29.715+0000 7fd161339800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:35:29.851 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-22T08:35:29.715+0000 7fd161339800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-22T08:35:29.851 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-22T08:35:29.715+0000 7fd161339800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-22T08:35:29.851 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-22T08:35:29.715+0000 7fd161339800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 : miss 2024-09-22T08:35:29.851 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-22T08:35:29.715+0000 7fd161339800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.851 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-22T08:35:29.716+0000 7fd161339800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:35:29.851 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-22T08:35:29.716+0000 7fd161339800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 info.flags=0x17 2024-09-22T08:35:29.851 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-22T08:35:29.716+0000 7fd161339800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 to cache LRU end 2024-09-22T08:35:29.851 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-22T08:35:29.716+0000 7fd161339800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:35:29.852 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-22T08:35:29.716+0000 7fd161339800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:35:29.852 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-22T08:35:29.716+0000 7fd161339800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 2024-09-22T08:35:29.852 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-22T08:35:29.721+0000 7fd161339800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 info.flags=0x17 2024-09-22T08:35:29.852 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-22T08:35:29.721+0000 7fd161339800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 to cache LRU end 2024-09-22T08:35:29.852 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-22T08:35:29.721+0000 7fd161339800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:35:29.852 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-22T08:35:29.721+0000 7fd161339800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32, ofs0, ns] 2024-09-22T08:35:29.852 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-22T08:35:29.722+0000 7fd033fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497008 cookie 94140888731520 notifier 6842 bl.length()=931 2024-09-22T08:35:29.852 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-22T08:35:29.722+0000 7fd033fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 info.flags=0x17 2024-09-22T08:35:29.852 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-22T08:35:29.722+0000 7fd033fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 to cache LRU end 2024-09-22T08:35:29.852 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-22T08:35:29.722+0000 7fd033fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:35:29.852 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-22T08:35:29.722+0000 7fd161339800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.32]): orig_sources= new_sources= 2024-09-22T08:35:29.852 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-22T08:35:29.722+0000 7fd161339800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.32]): potential sources added=[] removed=[] 2024-09-22T08:35:29.852 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-22T08:35:29.722+0000 7fd161339800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.32]): orig_dests= new_dests= 2024-09-22T08:35:29.852 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-22T08:35:29.722+0000 7fd161339800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.32]): potential dests added=[] removed=[] 2024-09-22T08:35:29.853 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-22T08:35:29.727+0000 7fd161339800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.0 2024-09-22T08:35:29.853 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.0 2024-09-22T08:35:29.853 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-22T08:35:29.728+0000 7fd161339800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.1 2024-09-22T08:35:29.853 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.1 2024-09-22T08:35:29.853 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-22T08:35:29.728+0000 7fd161339800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.2 2024-09-22T08:35:29.853 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.2 2024-09-22T08:35:29.853 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-22T08:35:29.728+0000 7fd161339800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.3 2024-09-22T08:35:29.853 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.3 2024-09-22T08:35:29.853 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-22T08:35:29.728+0000 7fd161339800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.4 2024-09-22T08:35:29.853 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.4 2024-09-22T08:35:29.853 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-22T08:35:29.728+0000 7fd161339800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.5 2024-09-22T08:35:29.853 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.5 2024-09-22T08:35:29.853 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-22T08:35:29.728+0000 7fd161339800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.6 2024-09-22T08:35:29.853 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.6 2024-09-22T08:35:29.854 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-22T08:35:29.728+0000 7fd161339800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.7 2024-09-22T08:35:29.854 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.7 2024-09-22T08:35:29.854 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-22T08:35:29.728+0000 7fd161339800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.8 2024-09-22T08:35:29.854 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.8 2024-09-22T08:35:29.854 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-22T08:35:29.728+0000 7fd161339800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.9 2024-09-22T08:35:29.854 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.9 2024-09-22T08:35:29.854 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-22T08:35:29.728+0000 7fd161339800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.10 2024-09-22T08:35:29.854 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.10 2024-09-22T08:35:29.854 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-22T08:35:29.728+0000 7fd161339800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.11 2024-09-22T08:35:29.854 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.11 2024-09-22T08:35:29.854 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.0 2024-09-22T08:35:29.854 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-22T08:35:29.728+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1 2024-09-22T08:35:29.854 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-22T08:35:29.729+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.2 2024-09-22T08:35:29.855 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-22T08:35:29.729+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.3 2024-09-22T08:35:29.855 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-22T08:35:29.730+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.4 2024-09-22T08:35:29.855 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-22T08:35:29.730+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.5 2024-09-22T08:35:29.855 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-22T08:35:29.731+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.6 2024-09-22T08:35:29.855 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-22T08:35:29.731+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.7 2024-09-22T08:35:29.855 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-22T08:35:29.732+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.8 2024-09-22T08:35:29.855 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-22T08:35:29.732+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.9 2024-09-22T08:35:29.855 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-22T08:35:29.733+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.10 2024-09-22T08:35:29.855 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-22T08:35:29.736+0000 7fd161339800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 : hit (requested=0x17, cached=0x17) 2024-09-22T08:35:29.855 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-22T08:35:29.736+0000 7fd161339800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 2024-09-22T08:35:29.855 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-22T08:35:29.737+0000 7fd161339800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 info.flags=0x17 2024-09-22T08:35:29.855 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-22T08:35:29.737+0000 7fd161339800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 to cache LRU end 2024-09-22T08:35:29.855 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-22T08:35:29.737+0000 7fd161339800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:35:29.855 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-22T08:35:29.737+0000 7fd161339800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32, ofs0, ns] 2024-09-22T08:35:29.855 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-22T08:35:29.738+0000 7fd0337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497009 cookie 94140888731520 notifier 6842 bl.length()=931 2024-09-22T08:35:29.856 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-22T08:35:29.738+0000 7fd0337fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 info.flags=0x17 2024-09-22T08:35:29.856 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-22T08:35:29.738+0000 7fd0337fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 to cache LRU end 2024-09-22T08:35:29.856 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-22T08:35:29.738+0000 7fd0337fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:35:29.856 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-22T08:35:29.738+0000 7fd161339800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.32]): orig_sources= new_sources= 2024-09-22T08:35:29.856 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-22T08:35:29.738+0000 7fd161339800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.32]): potential sources added=[] removed=[] 2024-09-22T08:35:29.856 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-22T08:35:29.738+0000 7fd161339800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.32]): orig_dests= new_dests= 2024-09-22T08:35:29.856 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-22T08:35:29.738+0000 7fd161339800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.32]): potential dests added=[] removed=[] 2024-09-22T08:35:29.856 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-22T08:35:29.741+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.0 2024-09-22T08:35:29.856 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-22T08:35:29.741+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1 2024-09-22T08:35:29.856 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-22T08:35:29.741+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.2 2024-09-22T08:35:29.856 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-22T08:35:29.742+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.3 2024-09-22T08:35:29.856 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-22T08:35:29.742+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.4 2024-09-22T08:35:29.856 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-22T08:35:29.742+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.5 2024-09-22T08:35:29.856 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-22T08:35:29.743+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.6 2024-09-22T08:35:29.857 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-22T08:35:29.743+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.7 2024-09-22T08:35:29.857 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-22T08:35:29.743+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.8 2024-09-22T08:35:29.857 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-22T08:35:29.744+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.9 2024-09-22T08:35:29.857 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-22T08:35:29.744+0000 7fd161339800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.10 2024-09-22T08:35:29.857 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-22T08:35:29.745+0000 7fd161339800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd161339800 time 2024-09-22T08:35:29.745638+0000 2024-09-22T08:35:29.857 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:35:29.857 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:29.857 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:35:29.857 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd16298c748] 2024-09-22T08:35:29.857 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fd16298c906] 2024-09-22T08:35:29.857 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559edf71be01] 2024-09-22T08:35:29.857 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x559edf72bfb7] 2024-09-22T08:35:29.857 INFO:tasks.workunit.client.0.smithi038.stderr: 5: main() 2024-09-22T08:35:29.857 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fd161629590] 2024-09-22T08:35:29.857 INFO:tasks.workunit.client.0.smithi038.stderr: 7: __libc_start_main() 2024-09-22T08:35:29.858 INFO:tasks.workunit.client.0.smithi038.stderr: 8: _start() 2024-09-22T08:35:29.858 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:29.858 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-22T08:35:29.746+0000 7fd161339800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:35:29.858 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7fd161339800 thread_name:radosgw-admin 2024-09-22T08:35:29.858 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:29.858 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:35:29.858 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd16163e6f0] 2024-09-22T08:35:29.858 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd16168b99c] 2024-09-22T08:35:29.858 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:35:29.858 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:35:29.858 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd16298c7a2] 2024-09-22T08:35:29.858 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fd16298c906] 2024-09-22T08:35:29.858 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559edf71be01] 2024-09-22T08:35:29.858 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x559edf72bfb7] 2024-09-22T08:35:29.859 INFO:tasks.workunit.client.0.smithi038.stderr: 9: main() 2024-09-22T08:35:29.859 INFO:tasks.workunit.client.0.smithi038.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fd161629590] 2024-09-22T08:35:29.859 INFO:tasks.workunit.client.0.smithi038.stderr: 11: __libc_start_main() 2024-09-22T08:35:29.859 INFO:tasks.workunit.client.0.smithi038.stderr: 12: _start() 2024-09-22T08:35:29.859 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:35:29.859 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:29.859 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-22T08:35:29.859 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-22T08:35:29.859 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-22T08:35:29.859 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-22T08:35:29.859 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-22T08:35:29.859 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-22T08:35:29.859 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-22T08:35:29.859 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-22T08:35:29.859 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-22T08:35:29.860 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-22T08:35:29.860 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-22T08:35:29.860 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-22T08:35:29.860 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-22T08:35:29.860 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-22T08:35:29.860 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-22T08:35:29.860 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-22T08:35:29.860 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-22T08:35:29.860 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-22T08:35:29.860 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-22T08:35:29.860 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-22T08:35:29.860 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-22T08:35:29.860 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-22T08:35:29.860 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-22T08:35:29.860 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-22T08:35:29.861 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:35:29.861 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-22T08:35:29.861 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-22T08:35:29.861 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-22T08:35:29.861 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-22T08:35:29.861 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-22T08:35:29.861 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-22T08:35:29.861 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-22T08:35:29.861 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-22T08:35:29.861 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-22T08:35:29.861 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-22T08:35:29.861 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-22T08:35:29.861 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-22T08:35:29.861 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-22T08:35:29.861 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-22T08:35:29.862 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-22T08:35:29.862 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-22T08:35:29.862 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-22T08:35:29.862 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-22T08:35:29.862 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-22T08:35:29.862 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-22T08:35:29.862 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-22T08:35:29.862 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:35:29.862 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-22T08:35:29.862 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:35:29.862 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-22T08:35:29.862 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-22T08:35:29.862 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-22T08:35:29.862 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-22T08:35:29.863 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-22T08:35:29.863 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-22T08:35:29.863 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-22T08:35:29.863 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-22T08:35:29.863 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-22T08:35:29.863 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-22T08:35:29.863 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-22T08:35:29.863 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-22T08:35:29.863 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-22T08:35:29.863 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-22T08:35:29.863 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-22T08:35:29.863 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-22T08:35:29.863 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-22T08:35:29.863 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-22T08:35:29.863 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:35:29.864 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-22T08:35:29.864 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:35:29.864 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-22T08:35:29.864 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-22T08:35:29.864 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-22T08:35:29.864 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-22T08:35:29.864 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-22T08:35:29.864 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-22T08:35:29.864 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:35:29.864 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-22T08:35:29.864 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-22T08:35:29.864 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:35:29.864 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-22T08:35:29.864 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-22T08:35:29.865 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-22T08:35:29.865 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-22T08:35:29.865 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-22T08:35:29.865 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-22T08:35:29.865 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-22T08:35:29.865 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-22T08:35:29.865 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-22T08:35:29.865 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-22T08:35:29.865 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-22T08:35:29.865 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-22T08:35:29.865 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-22T08:35:29.865 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:35:29.865 INFO:tasks.workunit.client.0.smithi038.stderr: 7fcf837fe640 / http_manager 2024-09-22T08:35:29.865 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd011fe3640 / http_manager 2024-09-22T08:35:29.865 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd012fe5640 / rgw_dt_lg_renew 2024-09-22T08:35:29.865 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd0327fc640 / ms_dispatch 2024-09-22T08:35:29.866 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd0337fe640 / io_context_pool 2024-09-22T08:35:29.866 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd033fff640 / io_context_pool 2024-09-22T08:35:29.866 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd0427fc640 / ms_dispatch 2024-09-22T08:35:29.866 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd049602640 / ms_dispatch 2024-09-22T08:35:29.866 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd04ae05640 / io_context_pool 2024-09-22T08:35:29.866 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd157fff640 / msgr-worker-2 2024-09-22T08:35:29.866 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd15cfc7640 / msgr-worker-1 2024-09-22T08:35:29.866 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd15d7c8640 / msgr-worker-0 2024-09-22T08:35:29.866 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd15dfc9640 / io_context_pool 2024-09-22T08:35:29.866 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd161339800 / radosgw-admin 2024-09-22T08:35:29.866 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-22T08:35:29.866 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-22T08:35:29.866 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/lib/ceph/crash/2024-09-22T08:35:29.747404Z_df1d7799-4218-4611-96bc-76bc91eb36f4/log 2024-09-22T08:35:29.866 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-22T08:35:29.866 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-22T08:35:29.868 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:35:29.868 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:35:29.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.825+0000 7ff65a92e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.827+0000 7ff65a92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:29.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.827+0000 7ff65a92e800 20 realm 2024-09-22T08:35:29.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.827+0000 7ff65a92e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.827+0000 7ff65a92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:29.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.827+0000 7ff65a92e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:35:29.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.827+0000 7ff65a92e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.828+0000 7ff65a92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:29.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.828+0000 7ff65a92e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.828+0000 7ff65a92e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:35:29.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.828+0000 7ff65a92e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:29.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.829+0000 7ff65a92e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:35:29.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.829+0000 7ff65a92e800 20 searching for the correct realm 2024-09-22T08:35:29.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:29.832+0000 7ff656ede640 0 -- 172.21.15.38:0/746675660 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7ff64807f040 msgr2=0x7ff648061aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:35:30.039 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.038+0000 7ff6566dd640 0 -- 172.21.15.38:0/746675660 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x556e649bb6a0 msgr2=0x556e649bdb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:35:30.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.043+0000 7ff65a92e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:35:30.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.043+0000 7ff65a92e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:35:30.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.043+0000 7ff65a92e800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:35:30.045 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.043+0000 7ff65a92e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:35:30.045 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.043+0000 7ff65a92e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:35:30.045 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.043+0000 7ff65a92e800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:35:30.045 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.043+0000 7ff65a92e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:30.045 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.043+0000 7ff65a92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:30.045 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.043+0000 7ff65a92e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:30.045 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.043+0000 7ff65a92e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:35:30.045 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.043+0000 7ff65a92e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:30.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.044+0000 7ff65a92e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:35:30.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.044+0000 7ff65a92e800 20 zone default found 2024-09-22T08:35:30.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.044+0000 7ff65a92e800 4 Realm: () 2024-09-22T08:35:30.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.044+0000 7ff65a92e800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:35:30.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.044+0000 7ff65a92e800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:35:30.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.044+0000 7ff65a92e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:35:30.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.044+0000 7ff65a92e800 20 zonegroup default 2024-09-22T08:35:30.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.044+0000 7ff65a92e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:30.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.044+0000 7ff65a92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:30.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.044+0000 7ff65a92e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:30.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.044+0000 7ff65a92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:30.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.044+0000 7ff65a92e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:30.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.045+0000 7ff65a92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:30.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.045+0000 7ff65a92e800 20 started sync module instance, tier type = 2024-09-22T08:35:30.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.045+0000 7ff65a92e800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:35:30.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.055+0000 7ff65a92e800 20 add_watcher() i=0 2024-09-22T08:35:30.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.055+0000 7ff65a92e800 20 add_watcher() i=1 2024-09-22T08:35:30.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.055+0000 7ff65a92e800 20 add_watcher() i=2 2024-09-22T08:35:30.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.055+0000 7ff65a92e800 20 add_watcher() i=3 2024-09-22T08:35:30.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.055+0000 7ff65a92e800 20 add_watcher() i=4 2024-09-22T08:35:30.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.055+0000 7ff65a92e800 20 add_watcher() i=5 2024-09-22T08:35:30.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.055+0000 7ff65a92e800 20 add_watcher() i=6 2024-09-22T08:35:30.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.056+0000 7ff65a92e800 20 add_watcher() i=7 2024-09-22T08:35:30.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.056+0000 7ff65a92e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:35:30.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.058+0000 7ff50cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:35:30.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.058+0000 7ff65a92e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:35:30.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.058+0000 7ff65a92e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:35:30.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.059+0000 7ff65a92e800 5 note: GC not initialized 2024-09-22T08:35:30.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.059+0000 7ff4877fe640 20 reqs_thread_entry: start 2024-09-22T08:35:30.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.059+0000 7ff65a92e800 20 init_complete bucket index max shards: 11 2024-09-22T08:35:30.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.059+0000 7ff65a92e800 20 Filter name: none 2024-09-22T08:35:30.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.059+0000 7ff4857fa640 20 reqs_thread_entry: start 2024-09-22T08:35:30.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.059+0000 7ff65a92e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:30.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.060+0000 7ff65a92e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:35:30.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.060+0000 7ff65a92e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:30.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.060+0000 7ff65a92e800 20 rados_obj.operate() r=0 bl.length=451 2024-09-22T08:35:30.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.060+0000 7ff65a92e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:35:30.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.060+0000 7ff65a92e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:30.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.060+0000 7ff65a92e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:35:30.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.060+0000 7ff65a92e800 20 rados->read ofs=0 len=0 2024-09-22T08:35:30.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.061+0000 7ff65a92e800 20 rados_obj.operate() r=0 bl.length=451 2024-09-22T08:35:30.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.061+0000 7ff65a92e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:35:30.064 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.063+0000 7ff50cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:35:30.066 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.065+0000 7ff65a92e800 20 remove_watcher() i=0 2024-09-22T08:35:30.066 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.065+0000 7ff65a92e800 2 removed watcher, disabling cache 2024-09-22T08:35:30.067 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.067+0000 7ff65a92e800 20 remove_watcher() i=1 2024-09-22T08:35:30.069 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.068+0000 7ff65a92e800 20 remove_watcher() i=2 2024-09-22T08:35:30.070 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.069+0000 7ff65a92e800 20 remove_watcher() i=3 2024-09-22T08:35:30.071 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.070+0000 7ff65a92e800 20 remove_watcher() i=4 2024-09-22T08:35:30.072 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.071+0000 7ff65a92e800 20 remove_watcher() i=5 2024-09-22T08:35:30.073 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.072+0000 7ff65a92e800 20 remove_watcher() i=6 2024-09-22T08:35:30.075 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:35:30.073+0000 7ff65a92e800 20 remove_watcher() i=7 2024-09-22T08:35:30.086 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:30.086 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:35:30.086 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-commit-target-layout id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:35:30.087 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:35:30.088 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:35:30.088 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:00.130 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:00.130 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:00.174 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:36:00.210 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:00.211 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:00.256 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.255+0000 7f993a123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:00.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.256+0000 7f993a123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:00.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.256+0000 7f993a123800 20 realm 2024-09-22T08:36:00.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.256+0000 7f993a123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:00.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.257+0000 7f993a123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:00.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.257+0000 7f993a123800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:00.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.257+0000 7f993a123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:00.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.258+0000 7f993a123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:00.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.258+0000 7f993a123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:00.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.258+0000 7f993a123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:00.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.258+0000 7f993a123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:00.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.259+0000 7f993a123800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:36:00.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.259+0000 7f993a123800 20 searching for the correct realm 2024-09-22T08:36:00.262 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.261+0000 7f9935532640 0 -- 172.21.15.38:0/3604227993 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f992c027040 msgr2=0x7f992c083af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:00.469 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.468+0000 7f9935532640 0 -- 172.21.15.38:0/3604227993 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f9928058b20 msgr2=0x7f99280c1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:00.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.677+0000 7f993a123800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:00.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.677+0000 7f993a123800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:00.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.677+0000 7f993a123800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:36:00.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.677+0000 7f993a123800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:00.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.677+0000 7f993a123800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:00.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.677+0000 7f993a123800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:36:00.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.677+0000 7f993a123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:00.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.677+0000 7f993a123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:00.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.677+0000 7f993a123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:00.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.678+0000 7f993a123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:00.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.678+0000 7f993a123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:00.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.678+0000 7f993a123800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:36:00.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.678+0000 7f993a123800 20 zone default found 2024-09-22T08:36:00.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.678+0000 7f993a123800 4 Realm: () 2024-09-22T08:36:00.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.678+0000 7f993a123800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:36:00.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.678+0000 7f993a123800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:36:00.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.678+0000 7f993a123800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:00.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.678+0000 7f993a123800 20 zonegroup default 2024-09-22T08:36:00.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.678+0000 7f993a123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:00.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.678+0000 7f993a123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:00.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.679+0000 7f993a123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:00.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.679+0000 7f993a123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:00.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.679+0000 7f993a123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:00.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.679+0000 7f993a123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:00.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.679+0000 7f993a123800 20 started sync module instance, tier type = 2024-09-22T08:36:00.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.679+0000 7f993a123800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:36:00.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.691+0000 7f993a123800 20 add_watcher() i=0 2024-09-22T08:36:00.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.691+0000 7f993a123800 20 add_watcher() i=1 2024-09-22T08:36:00.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.691+0000 7f993a123800 20 add_watcher() i=2 2024-09-22T08:36:00.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.691+0000 7f993a123800 20 add_watcher() i=3 2024-09-22T08:36:00.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.691+0000 7f993a123800 20 add_watcher() i=4 2024-09-22T08:36:00.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.691+0000 7f993a123800 20 add_watcher() i=5 2024-09-22T08:36:00.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.691+0000 7f993a123800 20 add_watcher() i=6 2024-09-22T08:36:00.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.692+0000 7f993a123800 20 add_watcher() i=7 2024-09-22T08:36:00.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.692+0000 7f993a123800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:00.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.695+0000 7f97e77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:00.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.695+0000 7f993a123800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:00.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.695+0000 7f993a123800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:00.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.695+0000 7f993a123800 5 note: GC not initialized 2024-09-22T08:36:00.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.695+0000 7f97e67fc640 20 reqs_thread_entry: start 2024-09-22T08:36:00.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.695+0000 7f993a123800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:00.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.696+0000 7f993a123800 20 Filter name: none 2024-09-22T08:36:00.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.696+0000 7f9757fff640 20 reqs_thread_entry: start 2024-09-22T08:36:00.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.696+0000 7f993a123800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-22T08:36:00.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.696+0000 7f993a123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:00.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.696+0000 7f993a123800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:36:00.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.696+0000 7f993a123800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-22T08:36:00.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.696+0000 7f993a123800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-22T08:36:00.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.696+0000 7f993a123800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 : miss 2024-09-22T08:36:00.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.696+0000 7f993a123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:00.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.697+0000 7f993a123800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:36:00.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.697+0000 7f993a123800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 info.flags=0x17 2024-09-22T08:36:00.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.697+0000 7f993a123800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 to cache LRU end 2024-09-22T08:36:00.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.697+0000 7f993a123800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:00.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.697+0000 7f993a123800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:00.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.697+0000 7f993a123800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 2024-09-22T08:36:00.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.703+0000 7f993a123800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 info.flags=0x17 2024-09-22T08:36:00.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.703+0000 7f993a123800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 to cache LRU end 2024-09-22T08:36:00.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.703+0000 7f993a123800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:00.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.703+0000 7f993a123800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32, ofs0, ns] 2024-09-22T08:36:00.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.703+0000 7f9818ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497011 cookie 93867721102096 notifier 6878 bl.length()=931 2024-09-22T08:36:00.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.703+0000 7f9818ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 info.flags=0x17 2024-09-22T08:36:00.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.703+0000 7f9818ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 to cache LRU end 2024-09-22T08:36:00.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.703+0000 7f9818ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:00.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.704+0000 7f993a123800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.32]): orig_sources= new_sources= 2024-09-22T08:36:00.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.704+0000 7f993a123800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.32]): potential sources added=[] removed=[] 2024-09-22T08:36:00.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.704+0000 7f993a123800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.32]): orig_dests= new_dests= 2024-09-22T08:36:00.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.704+0000 7f993a123800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.32]): potential dests added=[] removed=[] 2024-09-22T08:36:00.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.710+0000 7f993a123800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.0 2024-09-22T08:36:00.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.710+0000 7f993a123800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.0 2024-09-22T08:36:00.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.710+0000 7f993a123800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.1 2024-09-22T08:36:00.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.710+0000 7f993a123800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.1 2024-09-22T08:36:00.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.710+0000 7f993a123800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.2 2024-09-22T08:36:00.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.710+0000 7f993a123800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.2 2024-09-22T08:36:00.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.710+0000 7f993a123800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.3 2024-09-22T08:36:00.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.710+0000 7f993a123800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.3 2024-09-22T08:36:00.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.710+0000 7f993a123800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.4 2024-09-22T08:36:00.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.710+0000 7f993a123800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.4 2024-09-22T08:36:00.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.710+0000 7f993a123800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.5 2024-09-22T08:36:00.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.710+0000 7f993a123800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.5 2024-09-22T08:36:00.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.710+0000 7f993a123800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.6 2024-09-22T08:36:00.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.710+0000 7f993a123800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.6 2024-09-22T08:36:00.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.710+0000 7f993a123800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.7 2024-09-22T08:36:00.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.710+0000 7f993a123800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.7 2024-09-22T08:36:00.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.710+0000 7f993a123800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.8 2024-09-22T08:36:00.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.710+0000 7f993a123800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.8 2024-09-22T08:36:00.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.710+0000 7f993a123800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.9 2024-09-22T08:36:00.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.710+0000 7f993a123800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.9 2024-09-22T08:36:00.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.710+0000 7f993a123800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.10 2024-09-22T08:36:00.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.710+0000 7f993a123800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.10 2024-09-22T08:36:00.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.710+0000 7f993a123800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.11 2024-09-22T08:36:00.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.710+0000 7f993a123800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1.11 2024-09-22T08:36:00.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.710+0000 7f993a123800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.0 2024-09-22T08:36:00.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.711+0000 7f993a123800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1 2024-09-22T08:36:00.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.711+0000 7f993a123800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.2 2024-09-22T08:36:00.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.712+0000 7f993a123800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.3 2024-09-22T08:36:00.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.713+0000 7f993a123800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.4 2024-09-22T08:36:00.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.713+0000 7f993a123800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.5 2024-09-22T08:36:00.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.714+0000 7f993a123800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.6 2024-09-22T08:36:00.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.715+0000 7f993a123800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.7 2024-09-22T08:36:00.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.715+0000 7f993a123800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.8 2024-09-22T08:36:00.717 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.716+0000 7f993a123800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.9 2024-09-22T08:36:00.717 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.717+0000 7f993a123800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.10 2024-09-22T08:36:00.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.720+0000 7f993a123800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 : hit (requested=0x17, cached=0x17) 2024-09-22T08:36:00.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.720+0000 7f993a123800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 2024-09-22T08:36:00.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.722+0000 7f993a123800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 info.flags=0x17 2024-09-22T08:36:00.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.722+0000 7f993a123800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 to cache LRU end 2024-09-22T08:36:00.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.722+0000 7f993a123800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:00.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.722+0000 7f993a123800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32, ofs0, ns] 2024-09-22T08:36:00.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.722+0000 7f9818ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497012 cookie 93867721102096 notifier 6878 bl.length()=931 2024-09-22T08:36:00.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.722+0000 7f9818ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 info.flags=0x17 2024-09-22T08:36:00.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.722+0000 7f9818ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 to cache LRU end 2024-09-22T08:36:00.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.722+0000 7f9818ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:00.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.722+0000 7f993a123800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.32]): orig_sources= new_sources= 2024-09-22T08:36:00.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.722+0000 7f993a123800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.32]): potential sources added=[] removed=[] 2024-09-22T08:36:00.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.722+0000 7f993a123800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.32]): orig_dests= new_dests= 2024-09-22T08:36:00.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.722+0000 7f993a123800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.32]): potential dests added=[] removed=[] 2024-09-22T08:36:00.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.726+0000 7f993a123800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.0 2024-09-22T08:36:00.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.726+0000 7f993a123800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.1 2024-09-22T08:36:00.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.726+0000 7f993a123800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.2 2024-09-22T08:36:00.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.727+0000 7f993a123800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.3 2024-09-22T08:36:00.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.727+0000 7f993a123800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.4 2024-09-22T08:36:00.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.728+0000 7f993a123800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.5 2024-09-22T08:36:00.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.728+0000 7f993a123800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.6 2024-09-22T08:36:00.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.728+0000 7f993a123800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.7 2024-09-22T08:36:00.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.729+0000 7f993a123800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.8 2024-09-22T08:36:00.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.729+0000 7f993a123800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.9 2024-09-22T08:36:00.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.730+0000 7f993a123800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.32.10 2024-09-22T08:36:00.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.730+0000 7f993a123800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 : hit (requested=0x17, cached=0x17) 2024-09-22T08:36:00.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.730+0000 7f993a123800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 2024-09-22T08:36:00.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.731+0000 7f993a123800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 info.flags=0x17 2024-09-22T08:36:00.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.731+0000 7f993a123800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 to cache LRU end 2024-09-22T08:36:00.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.731+0000 7f993a123800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:00.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.731+0000 7f993a123800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32, ofs0, ns] 2024-09-22T08:36:00.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.732+0000 7f9818ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497013 cookie 93867721102096 notifier 6878 bl.length()=899 2024-09-22T08:36:00.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.732+0000 7f9818ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 info.flags=0x17 2024-09-22T08:36:00.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.732+0000 7f9818ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 to cache LRU end 2024-09-22T08:36:00.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.732+0000 7f9818ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:00.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.732+0000 7f993a123800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.32]): orig_sources= new_sources= 2024-09-22T08:36:00.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.732+0000 7f993a123800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.32]): potential sources added=[] removed=[] 2024-09-22T08:36:00.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.732+0000 7f993a123800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.32]): orig_dests= new_dests= 2024-09-22T08:36:00.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.732+0000 7f993a123800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c62f9d7b-f6b6-404a-90de-de5607499115.4584.32]): potential dests added=[] removed=[] 2024-09-22T08:36:00.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.736+0000 7f993a123800 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-22T08:36:00.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.738+0000 7f97e77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:00.741 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.740+0000 7f993a123800 20 remove_watcher() i=0 2024-09-22T08:36:00.741 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.740+0000 7f993a123800 2 removed watcher, disabling cache 2024-09-22T08:36:00.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.741+0000 7f993a123800 20 remove_watcher() i=1 2024-09-22T08:36:00.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.743+0000 7f993a123800 20 remove_watcher() i=2 2024-09-22T08:36:00.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.744+0000 7f993a123800 20 remove_watcher() i=3 2024-09-22T08:36:00.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.745+0000 7f993a123800 20 remove_watcher() i=4 2024-09-22T08:36:00.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.746+0000 7f993a123800 20 remove_watcher() i=5 2024-09-22T08:36:00.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.748+0000 7f993a123800 20 remove_watcher() i=6 2024-09-22T08:36:00.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.749+0000 7f993a123800 20 remove_watcher() i=7 2024-09-22T08:36:00.764 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-22T08:36:00.795 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:00.795 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:00.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.836+0000 7f8b71820800 20 rados->read ofs=0 len=0 2024-09-22T08:36:00.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.838+0000 7f8b71820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:00.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.838+0000 7f8b71820800 20 realm 2024-09-22T08:36:00.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.838+0000 7f8b71820800 20 rados->read ofs=0 len=0 2024-09-22T08:36:00.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.838+0000 7f8b71820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:00.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.838+0000 7f8b71820800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:00.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.838+0000 7f8b71820800 20 rados->read ofs=0 len=0 2024-09-22T08:36:00.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.839+0000 7f8b71820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:00.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.839+0000 7f8b71820800 20 rados->read ofs=0 len=0 2024-09-22T08:36:00.841 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.839+0000 7f8b71820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:00.841 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.839+0000 7f8b71820800 20 rados->read ofs=0 len=0 2024-09-22T08:36:00.841 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.840+0000 7f8b71820800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:36:00.841 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.840+0000 7f8b71820800 20 searching for the correct realm 2024-09-22T08:36:00.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:00.842+0000 7f8b6eb09640 0 -- 172.21.15.38:0/3150055525 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f8b6408b2b0 msgr2=0x7f8b64076c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:01.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.049+0000 7f8b6eb09640 0 -- 172.21.15.38:0/3150055525 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f8b6004b040 msgr2=0x7f8b6000d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:36:01.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.257+0000 7f8b71820800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:01.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.257+0000 7f8b71820800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:01.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.257+0000 7f8b71820800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:36:01.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.257+0000 7f8b71820800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:01.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.257+0000 7f8b71820800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:01.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.257+0000 7f8b71820800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:36:01.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.257+0000 7f8b71820800 20 rados->read ofs=0 len=0 2024-09-22T08:36:01.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.257+0000 7f8b71820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:01.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.257+0000 7f8b71820800 20 rados->read ofs=0 len=0 2024-09-22T08:36:01.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.257+0000 7f8b71820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:01.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.257+0000 7f8b71820800 20 rados->read ofs=0 len=0 2024-09-22T08:36:01.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.258+0000 7f8b71820800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:36:01.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.258+0000 7f8b71820800 20 zone default found 2024-09-22T08:36:01.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.258+0000 7f8b71820800 4 Realm: () 2024-09-22T08:36:01.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.258+0000 7f8b71820800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:36:01.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.258+0000 7f8b71820800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:36:01.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.258+0000 7f8b71820800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:01.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.258+0000 7f8b71820800 20 zonegroup default 2024-09-22T08:36:01.261 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.258+0000 7f8b71820800 20 rados->read ofs=0 len=0 2024-09-22T08:36:01.261 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.258+0000 7f8b71820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:01.261 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.258+0000 7f8b71820800 20 rados->read ofs=0 len=0 2024-09-22T08:36:01.261 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.259+0000 7f8b71820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:01.261 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.259+0000 7f8b71820800 20 rados->read ofs=0 len=0 2024-09-22T08:36:01.261 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.259+0000 7f8b71820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:01.261 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.259+0000 7f8b71820800 20 started sync module instance, tier type = 2024-09-22T08:36:01.261 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.259+0000 7f8b71820800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:36:01.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.270+0000 7f8b71820800 20 add_watcher() i=0 2024-09-22T08:36:01.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.270+0000 7f8b71820800 20 add_watcher() i=1 2024-09-22T08:36:01.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.270+0000 7f8b71820800 20 add_watcher() i=2 2024-09-22T08:36:01.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.270+0000 7f8b71820800 20 add_watcher() i=3 2024-09-22T08:36:01.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.270+0000 7f8b71820800 20 add_watcher() i=4 2024-09-22T08:36:01.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.270+0000 7f8b71820800 20 add_watcher() i=5 2024-09-22T08:36:01.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.270+0000 7f8b71820800 20 add_watcher() i=6 2024-09-22T08:36:01.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.271+0000 7f8b71820800 20 add_watcher() i=7 2024-09-22T08:36:01.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.271+0000 7f8b71820800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:01.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.273+0000 7f8a25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:01.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.273+0000 7f8b71820800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:01.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.273+0000 7f8b71820800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:01.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.273+0000 7f8b71820800 5 note: GC not initialized 2024-09-22T08:36:01.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.274+0000 7f8a24fe1640 20 reqs_thread_entry: start 2024-09-22T08:36:01.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.274+0000 7f8b71820800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:01.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.274+0000 7f8b71820800 20 Filter name: none 2024-09-22T08:36:01.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.274+0000 7f899e7fc640 20 reqs_thread_entry: start 2024-09-22T08:36:01.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.274+0000 7f8b71820800 20 rados->read ofs=0 len=0 2024-09-22T08:36:01.276 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.275+0000 7f8b71820800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:36:01.276 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.275+0000 7f8b71820800 20 rados->read ofs=0 len=0 2024-09-22T08:36:01.276 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.275+0000 7f8b71820800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:36:01.276 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.275+0000 7f8b71820800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:36:01.276 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.275+0000 7f8b71820800 20 rados->read ofs=0 len=0 2024-09-22T08:36:01.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.276+0000 7f8b71820800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:36:01.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.276+0000 7f8b71820800 20 rados->read ofs=0 len=0 2024-09-22T08:36:01.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.276+0000 7f8b71820800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:36:01.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.276+0000 7f8b71820800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:36:01.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.278+0000 7f8a25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:01.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.281+0000 7f8b71820800 20 remove_watcher() i=0 2024-09-22T08:36:01.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.281+0000 7f8b71820800 2 removed watcher, disabling cache 2024-09-22T08:36:01.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.282+0000 7f8b71820800 20 remove_watcher() i=1 2024-09-22T08:36:01.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.283+0000 7f8b71820800 20 remove_watcher() i=2 2024-09-22T08:36:01.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.284+0000 7f8b71820800 20 remove_watcher() i=3 2024-09-22T08:36:01.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.285+0000 7f8b71820800 20 remove_watcher() i=4 2024-09-22T08:36:01.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.287+0000 7f8b71820800 20 remove_watcher() i=5 2024-09-22T08:36:01.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.288+0000 7f8b71820800 20 remove_watcher() i=6 2024-09-22T08:36:01.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.289+0000 7f8b71820800 20 remove_watcher() i=7 2024-09-22T08:36:01.302 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:01.302 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:36:01.302 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-commit-target-layout id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.32 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-22T08:36:01.302 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:01.304 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:01.304 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:01.308 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:01.308 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:01.351 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:01.351 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:01.382 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-22T08:36:01.382 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:01.383 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:01.383 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:01.396 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:01.396 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:01.438 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:01.438 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:01.445 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:01.445 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:01.451 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:01.451 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:01.458 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:01.458 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:01.465 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:01.465 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:01.471 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:01.471 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:01.479 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:01.479 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:01.485 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:01.485 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:01.526 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:01.526 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:01.533 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:01.533 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:01.539 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:01.540 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:01.546 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:01.546 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:01.552 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:01.552 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:01.558 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:01.558 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:01.564 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:01.564 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:01.570 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:01.571 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:01.576 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:01.577 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:01.582 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:01.583 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:01.589 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:01.589 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:01.596 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:01.596 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:01.602 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-22T08:36:01.631 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:01.632 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:01.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.670+0000 7f6702146800 20 rados->read ofs=0 len=0 2024-09-22T08:36:01.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.672+0000 7f6702146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:01.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.672+0000 7f6702146800 20 realm 2024-09-22T08:36:01.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.672+0000 7f6702146800 20 rados->read ofs=0 len=0 2024-09-22T08:36:01.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.672+0000 7f6702146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:01.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.672+0000 7f6702146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:01.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.672+0000 7f6702146800 20 rados->read ofs=0 len=0 2024-09-22T08:36:01.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.672+0000 7f6702146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:01.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.672+0000 7f6702146800 20 rados->read ofs=0 len=0 2024-09-22T08:36:01.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.673+0000 7f6702146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:01.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.673+0000 7f6702146800 20 rados->read ofs=0 len=0 2024-09-22T08:36:01.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.674+0000 7f6702146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:36:01.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.674+0000 7f6702146800 20 searching for the correct realm 2024-09-22T08:36:01.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.676+0000 7f66f7436640 0 -- 172.21.15.38:0/2802602216 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f66e8065040 msgr2=0x7f66e80b23d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:01.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:01.882+0000 7f66f7436640 0 -- 172.21.15.38:0/2802602216 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f66f0053040 msgr2=0x7f66f0053930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:36:02.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.090+0000 7f6702146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:02.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.090+0000 7f6702146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:02.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.090+0000 7f6702146800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:36:02.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.090+0000 7f6702146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:02.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.090+0000 7f6702146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:02.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.090+0000 7f6702146800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:36:02.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.090+0000 7f6702146800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.090+0000 7f6702146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:02.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.090+0000 7f6702146800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.091+0000 7f6702146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:02.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.091+0000 7f6702146800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.091+0000 7f6702146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:36:02.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.091+0000 7f6702146800 20 zone default found 2024-09-22T08:36:02.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.091+0000 7f6702146800 4 Realm: () 2024-09-22T08:36:02.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.091+0000 7f6702146800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:36:02.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.091+0000 7f6702146800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:36:02.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.091+0000 7f6702146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:02.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.091+0000 7f6702146800 20 zonegroup default 2024-09-22T08:36:02.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.091+0000 7f6702146800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.091+0000 7f6702146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:02.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.091+0000 7f6702146800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.092+0000 7f6702146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:02.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.092+0000 7f6702146800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.092+0000 7f6702146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:02.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.092+0000 7f6702146800 20 started sync module instance, tier type = 2024-09-22T08:36:02.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.092+0000 7f6702146800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:36:02.103 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.102+0000 7f6702146800 20 add_watcher() i=0 2024-09-22T08:36:02.103 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.102+0000 7f6702146800 20 add_watcher() i=1 2024-09-22T08:36:02.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.102+0000 7f6702146800 20 add_watcher() i=2 2024-09-22T08:36:02.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.102+0000 7f6702146800 20 add_watcher() i=3 2024-09-22T08:36:02.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.102+0000 7f6702146800 20 add_watcher() i=4 2024-09-22T08:36:02.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.102+0000 7f6702146800 20 add_watcher() i=5 2024-09-22T08:36:02.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.102+0000 7f6702146800 20 add_watcher() i=6 2024-09-22T08:36:02.105 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.104+0000 7f6702146800 20 add_watcher() i=7 2024-09-22T08:36:02.105 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.104+0000 7f6702146800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:02.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.106+0000 7f65b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:02.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.106+0000 7f6702146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:02.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.106+0000 7f6702146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:02.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.106+0000 7f6702146800 5 note: GC not initialized 2024-09-22T08:36:02.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.106+0000 7f65b4fe1640 20 reqs_thread_entry: start 2024-09-22T08:36:02.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.107+0000 7f6702146800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:02.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.107+0000 7f6702146800 20 Filter name: none 2024-09-22T08:36:02.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.107+0000 7f652e7fc640 20 reqs_thread_entry: start 2024-09-22T08:36:02.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.107+0000 7f6702146800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.108+0000 7f6702146800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T08:36:02.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.108+0000 7f6702146800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.108+0000 7f6702146800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T08:36:02.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.108+0000 7f6702146800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:36:02.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.108+0000 7f6702146800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.108+0000 7f6702146800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T08:36:02.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.108+0000 7f6702146800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.109+0000 7f6702146800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T08:36:02.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.109+0000 7f6702146800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:36:02.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.111+0000 7f65b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:02.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.113+0000 7f6702146800 20 remove_watcher() i=0 2024-09-22T08:36:02.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.113+0000 7f6702146800 2 removed watcher, disabling cache 2024-09-22T08:36:02.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.114+0000 7f6702146800 20 remove_watcher() i=1 2024-09-22T08:36:02.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.116+0000 7f6702146800 20 remove_watcher() i=2 2024-09-22T08:36:02.118 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.117+0000 7f6702146800 20 remove_watcher() i=3 2024-09-22T08:36:02.119 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.118+0000 7f6702146800 20 remove_watcher() i=4 2024-09-22T08:36:02.120 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.119+0000 7f6702146800 20 remove_watcher() i=5 2024-09-22T08:36:02.122 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.121+0000 7f6702146800 20 remove_watcher() i=6 2024-09-22T08:36:02.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.122+0000 7f6702146800 20 remove_watcher() i=7 2024-09-22T08:36:02.135 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:02.135 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:36:02.135 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-do-reshard id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:36:02.135 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:02.137 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-22T08:36:02.172 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:02.172 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:02.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.212+0000 7fe39ae0e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.214+0000 7fe39ae0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:02.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.214+0000 7fe39ae0e800 20 realm 2024-09-22T08:36:02.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.214+0000 7fe39ae0e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.215+0000 7fe39ae0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:02.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.215+0000 7fe39ae0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:02.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.215+0000 7fe39ae0e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.215+0000 7fe39ae0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:02.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.215+0000 7fe39ae0e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.215+0000 7fe39ae0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:02.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.215+0000 7fe39ae0e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.216+0000 7fe39ae0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:36:02.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.216+0000 7fe39ae0e800 20 searching for the correct realm 2024-09-22T08:36:02.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.217+0000 7fe39656b640 0 -- 172.21.15.38:0/766916249 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x564d17764f90 msgr2=0x564d17767450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:02.222 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.221+0000 7fe39656b640 0 -- 172.21.15.38:0/766916249 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x564d177587d0 msgr2=0x564d1775abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:02.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.228+0000 7fe39ae0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:02.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.228+0000 7fe39ae0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:02.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.228+0000 7fe39ae0e800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:36:02.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.228+0000 7fe39ae0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:02.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.228+0000 7fe39ae0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:02.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.228+0000 7fe39ae0e800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:36:02.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.228+0000 7fe39ae0e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.229+0000 7fe39ae0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:02.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.229+0000 7fe39ae0e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.229+0000 7fe39ae0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:02.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.229+0000 7fe39ae0e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.229+0000 7fe39ae0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:36:02.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.229+0000 7fe39ae0e800 20 zone default found 2024-09-22T08:36:02.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.229+0000 7fe39ae0e800 4 Realm: () 2024-09-22T08:36:02.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.229+0000 7fe39ae0e800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:36:02.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.229+0000 7fe39ae0e800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:36:02.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.229+0000 7fe39ae0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:02.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.229+0000 7fe39ae0e800 20 zonegroup default 2024-09-22T08:36:02.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.229+0000 7fe39ae0e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.230+0000 7fe39ae0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:02.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.230+0000 7fe39ae0e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.230+0000 7fe39ae0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:02.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.230+0000 7fe39ae0e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.231+0000 7fe39ae0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:02.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.231+0000 7fe39ae0e800 20 started sync module instance, tier type = 2024-09-22T08:36:02.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.231+0000 7fe39ae0e800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:36:02.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.240+0000 7fe39ae0e800 20 add_watcher() i=0 2024-09-22T08:36:02.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.240+0000 7fe39ae0e800 20 add_watcher() i=1 2024-09-22T08:36:02.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.240+0000 7fe39ae0e800 20 add_watcher() i=2 2024-09-22T08:36:02.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.240+0000 7fe39ae0e800 20 add_watcher() i=3 2024-09-22T08:36:02.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.240+0000 7fe39ae0e800 20 add_watcher() i=4 2024-09-22T08:36:02.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.240+0000 7fe39ae0e800 20 add_watcher() i=5 2024-09-22T08:36:02.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.240+0000 7fe39ae0e800 20 add_watcher() i=6 2024-09-22T08:36:02.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.241+0000 7fe39ae0e800 20 add_watcher() i=7 2024-09-22T08:36:02.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.241+0000 7fe39ae0e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:02.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.243+0000 7fe248fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:02.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.243+0000 7fe39ae0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:02.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.243+0000 7fe39ae0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:02.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.243+0000 7fe39ae0e800 5 note: GC not initialized 2024-09-22T08:36:02.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.243+0000 7fe1c37fe640 20 reqs_thread_entry: start 2024-09-22T08:36:02.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.244+0000 7fe39ae0e800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:02.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.244+0000 7fe39ae0e800 20 Filter name: none 2024-09-22T08:36:02.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.244+0000 7fe1c17fa640 20 reqs_thread_entry: start 2024-09-22T08:36:02.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.244+0000 7fe39ae0e800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-22T08:36:02.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.244+0000 7fe39ae0e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.244+0000 7fe39ae0e800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T08:36:02.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.244+0000 7fe39ae0e800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-22T08:36:02.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.244+0000 7fe39ae0e800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-22T08:36:02.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.244+0000 7fe39ae0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.33 : miss 2024-09-22T08:36:02.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.244+0000 7fe39ae0e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.245+0000 7fe39ae0e800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T08:36:02.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.245+0000 7fe39ae0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.33 info.flags=0x17 2024-09-22T08:36:02.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.245+0000 7fe39ae0e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.33 to cache LRU end 2024-09-22T08:36:02.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.245+0000 7fe39ae0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:02.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.245+0000 7fe39ae0e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:02.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.245+0000 7fe39ae0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.33 2024-09-22T08:36:02.251 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.250+0000 7fe39ae0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.33 info.flags=0x17 2024-09-22T08:36:02.251 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.250+0000 7fe39ae0e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.33 to cache LRU end 2024-09-22T08:36:02.251 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.250+0000 7fe39ae0e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:02.251 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.250+0000 7fe39ae0e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.33, ofs0, ns] 2024-09-22T08:36:02.252 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.251+0000 7fe2717fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497017 cookie 94889106119472 notifier 7353 bl.length()=911 2024-09-22T08:36:02.252 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.251+0000 7fe2717fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.33 info.flags=0x17 2024-09-22T08:36:02.252 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.251+0000 7fe2717fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.33 to cache LRU end 2024-09-22T08:36:02.252 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.251+0000 7fe2717fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:02.252 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.251+0000 7fe39ae0e800 20 handle_bi_update(): bucket=:error-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.33]): orig_sources= new_sources= 2024-09-22T08:36:02.252 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.251+0000 7fe39ae0e800 20 handle_bi_update(): bucket=:error-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.33]): potential sources added=[] removed=[] 2024-09-22T08:36:02.252 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.251+0000 7fe39ae0e800 20 handle_bi_update(): bucket=:error-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.33]): orig_dests= new_dests= 2024-09-22T08:36:02.253 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.251+0000 7fe39ae0e800 20 handle_bi_update(): bucket=:error-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.33]): potential dests added=[] removed=[] 2024-09-22T08:36:02.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.257+0000 7fe39ae0e800 -1 Injecting error=-5 at location=do_reshard 2024-09-22T08:36:02.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.265+0000 7fe39ae0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.33 : hit (requested=0x17, cached=0x17) 2024-09-22T08:36:02.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.265+0000 7fe39ae0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.33 2024-09-22T08:36:02.267 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.266+0000 7fe39ae0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.33 info.flags=0x17 2024-09-22T08:36:02.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.266+0000 7fe39ae0e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.33 to cache LRU end 2024-09-22T08:36:02.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.266+0000 7fe39ae0e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:02.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.266+0000 7fe39ae0e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.33, ofs0, ns] 2024-09-22T08:36:02.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.267+0000 7fe271ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497018 cookie 94889106119472 notifier 7353 bl.length()=879 2024-09-22T08:36:02.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.267+0000 7fe271ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.33 info.flags=0x17 2024-09-22T08:36:02.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.267+0000 7fe271ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.33 to cache LRU end 2024-09-22T08:36:02.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.267+0000 7fe271ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:02.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.267+0000 7fe39ae0e800 20 handle_bi_update(): bucket=:error-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.33]): orig_sources= new_sources= 2024-09-22T08:36:02.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.267+0000 7fe39ae0e800 20 handle_bi_update(): bucket=:error-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.33]): potential sources added=[] removed=[] 2024-09-22T08:36:02.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.267+0000 7fe39ae0e800 20 handle_bi_update(): bucket=:error-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.33]): orig_dests= new_dests= 2024-09-22T08:36:02.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.267+0000 7fe39ae0e800 20 handle_bi_update(): bucket=:error-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.33]): potential dests added=[] removed=[] 2024-09-22T08:36:02.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.267+0000 7fe39ae0e800 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-22T08:36:02.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.269+0000 7fe248fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:02.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.271+0000 7fe39ae0e800 20 remove_watcher() i=0 2024-09-22T08:36:02.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.271+0000 7fe39ae0e800 2 removed watcher, disabling cache 2024-09-22T08:36:02.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.272+0000 7fe39ae0e800 20 remove_watcher() i=1 2024-09-22T08:36:02.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.273+0000 7fe39ae0e800 20 remove_watcher() i=2 2024-09-22T08:36:02.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.275+0000 7fe39ae0e800 20 remove_watcher() i=3 2024-09-22T08:36:02.276 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.276+0000 7fe39ae0e800 20 remove_watcher() i=4 2024-09-22T08:36:02.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.277+0000 7fe39ae0e800 20 remove_watcher() i=5 2024-09-22T08:36:02.278 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.278+0000 7fe39ae0e800 20 remove_watcher() i=6 2024-09-22T08:36:02.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.279+0000 7fe39ae0e800 20 remove_watcher() i=7 2024-09-22T08:36:02.292 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-22T08:36:02.321 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:02.321 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:02.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.362+0000 7fd969123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.364+0000 7fd969123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:02.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.364+0000 7fd969123800 20 realm 2024-09-22T08:36:02.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.364+0000 7fd969123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.364+0000 7fd969123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:02.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.364+0000 7fd969123800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:02.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.364+0000 7fd969123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.365+0000 7fd969123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:02.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.365+0000 7fd969123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.365+0000 7fd969123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:02.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.365+0000 7fd969123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.366+0000 7fd969123800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:36:02.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.366+0000 7fd969123800 20 searching for the correct realm 2024-09-22T08:36:02.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.368+0000 7fd95ffff640 0 -- 172.21.15.38:0/1573795394 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7fd950046330 msgr2=0x7fd95003e3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:36:02.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.574+0000 7fd95ffff640 0 -- 172.21.15.38:0/1573795394 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fd95808e630 msgr2=0x7fd95808ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:02.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.782+0000 7fd969123800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:02.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.782+0000 7fd969123800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:02.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.782+0000 7fd969123800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:36:02.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.782+0000 7fd969123800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:02.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.782+0000 7fd969123800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:02.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.782+0000 7fd969123800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:36:02.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.782+0000 7fd969123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.783+0000 7fd969123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:02.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.783+0000 7fd969123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.783+0000 7fd969123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:02.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.783+0000 7fd969123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.784+0000 7fd969123800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:36:02.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.784+0000 7fd969123800 20 zone default found 2024-09-22T08:36:02.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.784+0000 7fd969123800 4 Realm: () 2024-09-22T08:36:02.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.784+0000 7fd969123800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:36:02.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.784+0000 7fd969123800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:36:02.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.784+0000 7fd969123800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:02.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.784+0000 7fd969123800 20 zonegroup default 2024-09-22T08:36:02.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.784+0000 7fd969123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.784+0000 7fd969123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:02.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.784+0000 7fd969123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.785+0000 7fd969123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:02.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.785+0000 7fd969123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.787 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.785+0000 7fd969123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:02.787 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.785+0000 7fd969123800 20 started sync module instance, tier type = 2024-09-22T08:36:02.787 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.785+0000 7fd969123800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:36:02.797 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.796+0000 7fd969123800 20 add_watcher() i=0 2024-09-22T08:36:02.797 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.796+0000 7fd969123800 20 add_watcher() i=1 2024-09-22T08:36:02.797 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.796+0000 7fd969123800 20 add_watcher() i=2 2024-09-22T08:36:02.797 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.796+0000 7fd969123800 20 add_watcher() i=3 2024-09-22T08:36:02.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.796+0000 7fd969123800 20 add_watcher() i=4 2024-09-22T08:36:02.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.796+0000 7fd969123800 20 add_watcher() i=5 2024-09-22T08:36:02.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.796+0000 7fd969123800 20 add_watcher() i=6 2024-09-22T08:36:02.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.797+0000 7fd969123800 20 add_watcher() i=7 2024-09-22T08:36:02.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.797+0000 7fd969123800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:02.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.799+0000 7fd81afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:02.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.800+0000 7fd969123800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:02.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.800+0000 7fd969123800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:02.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.800+0000 7fd969123800 5 note: GC not initialized 2024-09-22T08:36:02.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.800+0000 7fd819fe3640 20 reqs_thread_entry: start 2024-09-22T08:36:02.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.800+0000 7fd969123800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:02.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.800+0000 7fd969123800 20 Filter name: none 2024-09-22T08:36:02.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.800+0000 7fd78b7fe640 20 reqs_thread_entry: start 2024-09-22T08:36:02.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.800+0000 7fd969123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.801+0000 7fd969123800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T08:36:02.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.801+0000 7fd969123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.802+0000 7fd969123800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T08:36:02.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.802+0000 7fd969123800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:36:02.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.802+0000 7fd969123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.802+0000 7fd969123800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T08:36:02.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.802+0000 7fd969123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.803+0000 7fd969123800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T08:36:02.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.803+0000 7fd969123800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:36:02.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.805+0000 7fd81afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:02.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.808+0000 7fd969123800 20 remove_watcher() i=0 2024-09-22T08:36:02.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.808+0000 7fd969123800 2 removed watcher, disabling cache 2024-09-22T08:36:02.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.809+0000 7fd969123800 20 remove_watcher() i=1 2024-09-22T08:36:02.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.810+0000 7fd969123800 20 remove_watcher() i=2 2024-09-22T08:36:02.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.811+0000 7fd969123800 20 remove_watcher() i=3 2024-09-22T08:36:02.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.813+0000 7fd969123800 20 remove_watcher() i=4 2024-09-22T08:36:02.815 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.814+0000 7fd969123800 20 remove_watcher() i=5 2024-09-22T08:36:02.816 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.815+0000 7fd969123800 20 remove_watcher() i=6 2024-09-22T08:36:02.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.817+0000 7fd969123800 20 remove_watcher() i=7 2024-09-22T08:36:02.831 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:02.831 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:36:02.831 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-do-reshard id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:36:02.831 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:02.833 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:02.833 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:02.840 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:02.840 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:02.884 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:36:02.918 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:02.918 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:02.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.961+0000 7f5603b2a800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.963 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.962+0000 7f5603b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:02.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.962+0000 7f5603b2a800 20 realm 2024-09-22T08:36:02.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.962+0000 7f5603b2a800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.962+0000 7f5603b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:02.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.962+0000 7f5603b2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:02.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.962+0000 7f5603b2a800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.963+0000 7f5603b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:02.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.963+0000 7f5603b2a800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.963+0000 7f5603b2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:02.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.963+0000 7f5603b2a800 20 rados->read ofs=0 len=0 2024-09-22T08:36:02.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.964+0000 7f5603b2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:36:02.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.964+0000 7f5603b2a800 20 searching for the correct realm 2024-09-22T08:36:02.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:02.964+0000 7f55ff8da640 0 -- 172.21.15.38:0/3744054963 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x558c7c0971d0 msgr2=0x558c7c099690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:36:03.172 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.171+0000 7f56000db640 0 -- 172.21.15.38:0/3744054963 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x558c7c08a9d0 msgr2=0x558c7c08ce50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:03.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.180+0000 7f5603b2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:03.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.180+0000 7f5603b2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:03.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.180+0000 7f5603b2a800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:36:03.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.180+0000 7f5603b2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:03.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.180+0000 7f5603b2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:03.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.180+0000 7f5603b2a800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:36:03.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.180+0000 7f5603b2a800 20 rados->read ofs=0 len=0 2024-09-22T08:36:03.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.180+0000 7f5603b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:03.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.180+0000 7f5603b2a800 20 rados->read ofs=0 len=0 2024-09-22T08:36:03.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.181+0000 7f5603b2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:03.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.181+0000 7f5603b2a800 20 rados->read ofs=0 len=0 2024-09-22T08:36:03.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.181+0000 7f5603b2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:36:03.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.181+0000 7f5603b2a800 20 zone default found 2024-09-22T08:36:03.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.181+0000 7f5603b2a800 4 Realm: () 2024-09-22T08:36:03.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.181+0000 7f5603b2a800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:36:03.183 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.181+0000 7f5603b2a800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:36:03.183 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.181+0000 7f5603b2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:03.183 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.181+0000 7f5603b2a800 20 zonegroup default 2024-09-22T08:36:03.183 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.181+0000 7f5603b2a800 20 rados->read ofs=0 len=0 2024-09-22T08:36:03.183 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.181+0000 7f5603b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:03.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.181+0000 7f5603b2a800 20 rados->read ofs=0 len=0 2024-09-22T08:36:03.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.182+0000 7f5603b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:03.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.182+0000 7f5603b2a800 20 rados->read ofs=0 len=0 2024-09-22T08:36:03.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.182+0000 7f5603b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:03.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.182+0000 7f5603b2a800 20 started sync module instance, tier type = 2024-09-22T08:36:03.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.182+0000 7f5603b2a800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:36:03.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.193+0000 7f5603b2a800 20 add_watcher() i=0 2024-09-22T08:36:03.194 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.193+0000 7f5603b2a800 20 add_watcher() i=1 2024-09-22T08:36:03.194 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.193+0000 7f5603b2a800 20 add_watcher() i=2 2024-09-22T08:36:03.194 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.193+0000 7f5603b2a800 20 add_watcher() i=3 2024-09-22T08:36:03.194 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.193+0000 7f5603b2a800 20 add_watcher() i=4 2024-09-22T08:36:03.194 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.193+0000 7f5603b2a800 20 add_watcher() i=5 2024-09-22T08:36:03.194 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.193+0000 7f5603b2a800 20 add_watcher() i=6 2024-09-22T08:36:03.195 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.194+0000 7f5603b2a800 20 add_watcher() i=7 2024-09-22T08:36:03.195 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.194+0000 7f5603b2a800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:03.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.196+0000 7f54b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:03.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.196+0000 7f5603b2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:03.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.196+0000 7f5603b2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:03.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.196+0000 7f5603b2a800 5 note: GC not initialized 2024-09-22T08:36:03.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.196+0000 7f54b4fe1640 20 reqs_thread_entry: start 2024-09-22T08:36:03.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.197+0000 7f5603b2a800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:03.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.197+0000 7f5603b2a800 20 Filter name: none 2024-09-22T08:36:03.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.197+0000 7f542e7fc640 20 reqs_thread_entry: start 2024-09-22T08:36:03.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.197+0000 7f5603b2a800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-22T08:36:03.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.197+0000 7f5603b2a800 20 rados->read ofs=0 len=0 2024-09-22T08:36:03.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.197+0000 7f5603b2a800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T08:36:03.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.198+0000 7f5603b2a800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-22T08:36:03.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.198+0000 7f5603b2a800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-22T08:36:03.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.198+0000 7f5603b2a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.33 : miss 2024-09-22T08:36:03.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.198+0000 7f5603b2a800 20 rados->read ofs=0 len=0 2024-09-22T08:36:03.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.198+0000 7f5603b2a800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T08:36:03.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.198+0000 7f5603b2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.33 info.flags=0x17 2024-09-22T08:36:03.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.198+0000 7f5603b2a800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.33 to cache LRU end 2024-09-22T08:36:03.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.198+0000 7f5603b2a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:03.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.198+0000 7f5603b2a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:03.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.198+0000 7f5603b2a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.33 2024-09-22T08:36:03.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.205+0000 7f5603b2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.33 info.flags=0x17 2024-09-22T08:36:03.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.205+0000 7f5603b2a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.33 to cache LRU end 2024-09-22T08:36:03.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.205+0000 7f5603b2a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:03.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.205+0000 7f5603b2a800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.33, ofs0, ns] 2024-09-22T08:36:03.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.205+0000 7f54de7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497019 cookie 94061864809344 notifier 6959 bl.length()=911 2024-09-22T08:36:03.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.205+0000 7f54de7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.33 info.flags=0x17 2024-09-22T08:36:03.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.205+0000 7f54de7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.33 to cache LRU end 2024-09-22T08:36:03.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.205+0000 7f54de7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:03.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.206+0000 7f5603b2a800 20 handle_bi_update(): bucket=:error-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.33]): orig_sources= new_sources= 2024-09-22T08:36:03.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.206+0000 7f5603b2a800 20 handle_bi_update(): bucket=:error-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.33]): potential sources added=[] removed=[] 2024-09-22T08:36:03.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.206+0000 7f5603b2a800 20 handle_bi_update(): bucket=:error-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.33]): orig_dests= new_dests= 2024-09-22T08:36:03.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.206+0000 7f5603b2a800 20 handle_bi_update(): bucket=:error-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.33]): potential dests added=[] removed=[] 2024-09-22T08:36:03.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.211+0000 7f5603b2a800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.1.0 2024-09-22T08:36:03.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.211+0000 7f5603b2a800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.1.0 2024-09-22T08:36:03.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.211+0000 7f5603b2a800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.1.1 2024-09-22T08:36:03.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.211+0000 7f5603b2a800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.1.1 2024-09-22T08:36:03.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.211+0000 7f5603b2a800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.1.2 2024-09-22T08:36:03.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.211+0000 7f5603b2a800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.1.2 2024-09-22T08:36:03.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.211+0000 7f5603b2a800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.1.3 2024-09-22T08:36:03.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.211+0000 7f5603b2a800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.1.3 2024-09-22T08:36:03.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.211+0000 7f5603b2a800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.1.4 2024-09-22T08:36:03.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.211+0000 7f5603b2a800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.1.4 2024-09-22T08:36:03.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.211+0000 7f5603b2a800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.1.5 2024-09-22T08:36:03.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.211+0000 7f5603b2a800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.1.5 2024-09-22T08:36:03.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.211+0000 7f5603b2a800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.1.6 2024-09-22T08:36:03.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.211+0000 7f5603b2a800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.1.6 2024-09-22T08:36:03.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.211+0000 7f5603b2a800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.1.7 2024-09-22T08:36:03.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.211+0000 7f5603b2a800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.1.7 2024-09-22T08:36:03.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.211+0000 7f5603b2a800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.1.8 2024-09-22T08:36:03.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.211+0000 7f5603b2a800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.1.8 2024-09-22T08:36:03.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.211+0000 7f5603b2a800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.1.9 2024-09-22T08:36:03.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.211+0000 7f5603b2a800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.1.9 2024-09-22T08:36:03.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.211+0000 7f5603b2a800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.1.10 2024-09-22T08:36:03.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.211+0000 7f5603b2a800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.1.10 2024-09-22T08:36:03.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.211+0000 7f5603b2a800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.1.11 2024-09-22T08:36:03.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.211+0000 7f5603b2a800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.1.11 2024-09-22T08:36:03.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.211+0000 7f5603b2a800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.0 2024-09-22T08:36:03.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.212+0000 7f5603b2a800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.1 2024-09-22T08:36:03.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.212+0000 7f5603b2a800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.2 2024-09-22T08:36:03.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.213+0000 7f5603b2a800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.3 2024-09-22T08:36:03.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.214+0000 7f5603b2a800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.4 2024-09-22T08:36:03.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.214+0000 7f5603b2a800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.5 2024-09-22T08:36:03.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.215+0000 7f5603b2a800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.6 2024-09-22T08:36:03.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.215+0000 7f5603b2a800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.7 2024-09-22T08:36:03.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.216+0000 7f5603b2a800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.8 2024-09-22T08:36:03.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.216+0000 7f5603b2a800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.9 2024-09-22T08:36:03.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.217+0000 7f5603b2a800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.10 2024-09-22T08:36:03.221 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.220+0000 7f5603b2a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.33 : hit (requested=0x17, cached=0x17) 2024-09-22T08:36:03.221 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.220+0000 7f5603b2a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.33 2024-09-22T08:36:03.222 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.221+0000 7f5603b2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.33 info.flags=0x17 2024-09-22T08:36:03.222 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.221+0000 7f5603b2a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.33 to cache LRU end 2024-09-22T08:36:03.222 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.221+0000 7f5603b2a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:03.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.221+0000 7f5603b2a800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.33, ofs0, ns] 2024-09-22T08:36:03.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.222+0000 7f54deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497020 cookie 94061864809344 notifier 6959 bl.length()=911 2024-09-22T08:36:03.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.222+0000 7f54deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.33 info.flags=0x17 2024-09-22T08:36:03.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.222+0000 7f54deffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.33 to cache LRU end 2024-09-22T08:36:03.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.222+0000 7f54deffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:03.224 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.222+0000 7f5603b2a800 20 handle_bi_update(): bucket=:error-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.33]): orig_sources= new_sources= 2024-09-22T08:36:03.224 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.222+0000 7f5603b2a800 20 handle_bi_update(): bucket=:error-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.33]): potential sources added=[] removed=[] 2024-09-22T08:36:03.224 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.222+0000 7f5603b2a800 20 handle_bi_update(): bucket=:error-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.33]): orig_dests= new_dests= 2024-09-22T08:36:03.224 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.222+0000 7f5603b2a800 20 handle_bi_update(): bucket=:error-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.33]): potential dests added=[] removed=[] 2024-09-22T08:36:03.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.225+0000 7f5603b2a800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.0 2024-09-22T08:36:03.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.225+0000 7f5603b2a800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.1 2024-09-22T08:36:03.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.226+0000 7f5603b2a800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.2 2024-09-22T08:36:03.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.226+0000 7f5603b2a800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.3 2024-09-22T08:36:03.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.227+0000 7f5603b2a800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.4 2024-09-22T08:36:03.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.227+0000 7f5603b2a800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.5 2024-09-22T08:36:03.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.228+0000 7f5603b2a800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.6 2024-09-22T08:36:03.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.228+0000 7f5603b2a800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.7 2024-09-22T08:36:03.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.228+0000 7f5603b2a800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.8 2024-09-22T08:36:03.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.229+0000 7f5603b2a800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.9 2024-09-22T08:36:03.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.229+0000 7f5603b2a800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.33.10 2024-09-22T08:36:03.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.229+0000 7f5603b2a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.33 : hit (requested=0x17, cached=0x17) 2024-09-22T08:36:03.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.229+0000 7f5603b2a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.33 2024-09-22T08:36:03.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.231+0000 7f5603b2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.33 info.flags=0x17 2024-09-22T08:36:03.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.231+0000 7f5603b2a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.33 to cache LRU end 2024-09-22T08:36:03.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.231+0000 7f5603b2a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:03.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.231+0000 7f5603b2a800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.33, ofs0, ns] 2024-09-22T08:36:03.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.231+0000 7f54de7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497021 cookie 94061864809344 notifier 6959 bl.length()=879 2024-09-22T08:36:03.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.231+0000 7f54de7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.33 info.flags=0x17 2024-09-22T08:36:03.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.231+0000 7f54de7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.33 to cache LRU end 2024-09-22T08:36:03.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.231+0000 7f54de7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:03.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.232+0000 7f5603b2a800 20 handle_bi_update(): bucket=:error-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.33]): orig_sources= new_sources= 2024-09-22T08:36:03.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.232+0000 7f5603b2a800 20 handle_bi_update(): bucket=:error-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.33]): potential sources added=[] removed=[] 2024-09-22T08:36:03.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.232+0000 7f5603b2a800 20 handle_bi_update(): bucket=:error-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.33]): orig_dests= new_dests= 2024-09-22T08:36:03.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.232+0000 7f5603b2a800 20 handle_bi_update(): bucket=:error-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.33]): potential dests added=[] removed=[] 2024-09-22T08:36:03.235 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.235+0000 7f5603b2a800 1 execute INFO: reshard of bucket "error-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-22T08:36:03.237 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.237+0000 7f54b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:03.240 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.239+0000 7f5603b2a800 20 remove_watcher() i=0 2024-09-22T08:36:03.240 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.239+0000 7f5603b2a800 2 removed watcher, disabling cache 2024-09-22T08:36:03.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.240+0000 7f5603b2a800 20 remove_watcher() i=1 2024-09-22T08:36:03.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.241+0000 7f5603b2a800 20 remove_watcher() i=2 2024-09-22T08:36:03.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.242+0000 7f5603b2a800 20 remove_watcher() i=3 2024-09-22T08:36:03.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.243+0000 7f5603b2a800 20 remove_watcher() i=4 2024-09-22T08:36:03.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.244+0000 7f5603b2a800 20 remove_watcher() i=5 2024-09-22T08:36:03.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.246+0000 7f5603b2a800 20 remove_watcher() i=6 2024-09-22T08:36:03.248 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.247+0000 7f5603b2a800 20 remove_watcher() i=7 2024-09-22T08:36:03.261 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-22T08:36:03.290 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:03.290 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:03.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.528+0000 7f3431947640 0 --2- 172.21.15.38:0/1348829307 >> [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] conn(0x558ad132b020 0x558ad1349310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-22T08:36:03.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.530+0000 7f3436a13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:03.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.532+0000 7f3436a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:03.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.532+0000 7f3436a13800 20 realm 2024-09-22T08:36:03.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.532+0000 7f3436a13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:03.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.532+0000 7f3436a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:03.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.532+0000 7f3436a13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:03.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.532+0000 7f3436a13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:03.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.532+0000 7f3436a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:03.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.532+0000 7f3436a13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:03.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.533+0000 7f3436a13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:03.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.533+0000 7f3436a13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:03.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.534+0000 7f3436a13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:36:03.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.534+0000 7f3436a13800 20 searching for the correct realm 2024-09-22T08:36:03.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.536+0000 7f3431947640 0 -- 172.21.15.38:0/1348829307 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f3428033060 msgr2=0x7f3428067430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:03.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.743+0000 7f3431947640 0 -- 172.21.15.38:0/1348829307 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f3424043af0 msgr2=0x7f34240434c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:36:03.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.951+0000 7f3436a13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:03.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.951+0000 7f3436a13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:03.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.951+0000 7f3436a13800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:36:03.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.951+0000 7f3436a13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:03.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.951+0000 7f3436a13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:03.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.951+0000 7f3436a13800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:36:03.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.951+0000 7f3436a13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:03.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.951+0000 7f3436a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:03.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.951+0000 7f3436a13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:03.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.952+0000 7f3436a13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:03.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.952+0000 7f3436a13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:03.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.952+0000 7f3436a13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:36:03.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.952+0000 7f3436a13800 20 zone default found 2024-09-22T08:36:03.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.952+0000 7f3436a13800 4 Realm: () 2024-09-22T08:36:03.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.952+0000 7f3436a13800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:36:03.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.952+0000 7f3436a13800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:36:03.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.952+0000 7f3436a13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:03.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.952+0000 7f3436a13800 20 zonegroup default 2024-09-22T08:36:03.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.952+0000 7f3436a13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:03.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.953+0000 7f3436a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:03.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.953+0000 7f3436a13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:03.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.953+0000 7f3436a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:03.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.953+0000 7f3436a13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:03.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.953+0000 7f3436a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:03.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.953+0000 7f3436a13800 20 started sync module instance, tier type = 2024-09-22T08:36:03.956 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.953+0000 7f3436a13800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:36:03.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.965+0000 7f3436a13800 20 add_watcher() i=0 2024-09-22T08:36:03.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.965+0000 7f3436a13800 20 add_watcher() i=1 2024-09-22T08:36:03.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.965+0000 7f3436a13800 20 add_watcher() i=2 2024-09-22T08:36:03.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.965+0000 7f3436a13800 20 add_watcher() i=3 2024-09-22T08:36:03.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.965+0000 7f3436a13800 20 add_watcher() i=4 2024-09-22T08:36:03.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.965+0000 7f3436a13800 20 add_watcher() i=5 2024-09-22T08:36:03.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.965+0000 7f3436a13800 20 add_watcher() i=6 2024-09-22T08:36:03.967 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.966+0000 7f3436a13800 20 add_watcher() i=7 2024-09-22T08:36:03.967 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.966+0000 7f3436a13800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:03.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.968+0000 7f32e8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:03.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.969+0000 7f3436a13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:03.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.969+0000 7f3436a13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:03.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.969+0000 7f3436a13800 5 note: GC not initialized 2024-09-22T08:36:03.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.969+0000 7f32637fe640 20 reqs_thread_entry: start 2024-09-22T08:36:03.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.969+0000 7f3436a13800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:03.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.969+0000 7f3436a13800 20 Filter name: none 2024-09-22T08:36:03.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.969+0000 7f32617fa640 20 reqs_thread_entry: start 2024-09-22T08:36:03.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.970+0000 7f3436a13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:03.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.970+0000 7f3436a13800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T08:36:03.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.970+0000 7f3436a13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:03.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.971+0000 7f3436a13800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T08:36:03.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.971+0000 7f3436a13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:36:03.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.971+0000 7f3436a13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:03.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.971+0000 7f3436a13800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T08:36:03.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.971+0000 7f3436a13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:03.973 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.972+0000 7f3436a13800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T08:36:03.973 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.972+0000 7f3436a13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:36:03.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.974+0000 7f32e8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:03.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.977+0000 7f3436a13800 20 remove_watcher() i=0 2024-09-22T08:36:03.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.977+0000 7f3436a13800 2 removed watcher, disabling cache 2024-09-22T08:36:03.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.978+0000 7f3436a13800 20 remove_watcher() i=1 2024-09-22T08:36:03.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.979+0000 7f3436a13800 20 remove_watcher() i=2 2024-09-22T08:36:03.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.980+0000 7f3436a13800 20 remove_watcher() i=3 2024-09-22T08:36:03.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.981+0000 7f3436a13800 20 remove_watcher() i=4 2024-09-22T08:36:03.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.983+0000 7f3436a13800 20 remove_watcher() i=5 2024-09-22T08:36:03.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.984+0000 7f3436a13800 20 remove_watcher() i=6 2024-09-22T08:36:03.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:03.986+0000 7f3436a13800 20 remove_watcher() i=7 2024-09-22T08:36:03.999 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:03.999 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:36:03.999 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-do-reshard id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.33 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-22T08:36:03.999 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:04.002 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:04.002 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:04.006 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:04.006 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:04.049 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:04.050 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:04.082 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-22T08:36:04.082 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:04.083 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:04.083 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:04.097 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:04.097 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:04.142 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:04.142 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:04.148 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:04.148 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:04.155 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:04.155 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:04.162 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:04.162 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:04.168 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:04.168 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:04.174 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:04.174 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:04.181 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:04.181 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:04.187 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:04.187 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:04.193 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:04.193 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:04.200 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:04.200 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:04.206 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:04.207 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:04.213 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:04.213 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:04.219 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:04.219 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:04.225 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:04.225 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:04.231 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:04.231 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:04.237 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:04.237 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:04.244 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:04.244 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:04.250 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:04.250 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:04.256 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:04.256 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:04.262 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:04.262 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:04.268 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-22T08:36:04.297 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:04.297 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:04.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.336+0000 7f2d6b33e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:04.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.338+0000 7f2d6b33e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:04.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.338+0000 7f2d6b33e800 20 realm 2024-09-22T08:36:04.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.338+0000 7f2d6b33e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:04.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.338+0000 7f2d6b33e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:04.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.338+0000 7f2d6b33e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:04.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.338+0000 7f2d6b33e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:04.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.338+0000 7f2d6b33e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:04.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.338+0000 7f2d6b33e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:04.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.339+0000 7f2d6b33e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:04.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.339+0000 7f2d6b33e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:04.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.339+0000 7f2d6b33e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:36:04.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.339+0000 7f2d6b33e800 20 searching for the correct realm 2024-09-22T08:36:04.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.342+0000 7f2d66885640 0 -- 172.21.15.38:0/1433398106 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f2d5c071d70 msgr2=0x7f2d5c0853b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:04.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.345+0000 7f2d66885640 0 -- 172.21.15.38:0/1433398106 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f2d58082400 msgr2=0x7f2d58082860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:04.555 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.552+0000 7f2d6b33e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:04.555 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.552+0000 7f2d6b33e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:04.555 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.552+0000 7f2d6b33e800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:36:04.555 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.552+0000 7f2d6b33e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:04.555 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.552+0000 7f2d6b33e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:04.555 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.552+0000 7f2d6b33e800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:36:04.555 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.552+0000 7f2d6b33e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:04.555 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.552+0000 7f2d6b33e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:04.555 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.552+0000 7f2d6b33e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:04.555 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.552+0000 7f2d6b33e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:04.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.552+0000 7f2d6b33e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:04.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.553+0000 7f2d6b33e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:36:04.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.553+0000 7f2d6b33e800 20 zone default found 2024-09-22T08:36:04.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.553+0000 7f2d6b33e800 4 Realm: () 2024-09-22T08:36:04.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.553+0000 7f2d6b33e800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:36:04.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.553+0000 7f2d6b33e800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:36:04.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.553+0000 7f2d6b33e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:04.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.553+0000 7f2d6b33e800 20 zonegroup default 2024-09-22T08:36:04.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.553+0000 7f2d6b33e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:04.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.553+0000 7f2d6b33e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:04.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.553+0000 7f2d6b33e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:04.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.553+0000 7f2d6b33e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:04.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.553+0000 7f2d6b33e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:04.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.554+0000 7f2d6b33e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:04.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.554+0000 7f2d6b33e800 20 started sync module instance, tier type = 2024-09-22T08:36:04.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.554+0000 7f2d6b33e800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:36:04.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.563+0000 7f2d6b33e800 20 add_watcher() i=0 2024-09-22T08:36:04.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.563+0000 7f2d6b33e800 20 add_watcher() i=1 2024-09-22T08:36:04.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.563+0000 7f2d6b33e800 20 add_watcher() i=2 2024-09-22T08:36:04.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.563+0000 7f2d6b33e800 20 add_watcher() i=3 2024-09-22T08:36:04.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.563+0000 7f2d6b33e800 20 add_watcher() i=4 2024-09-22T08:36:04.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.563+0000 7f2d6b33e800 20 add_watcher() i=5 2024-09-22T08:36:04.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.563+0000 7f2d6b33e800 20 add_watcher() i=6 2024-09-22T08:36:04.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.564+0000 7f2d6b33e800 20 add_watcher() i=7 2024-09-22T08:36:04.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.564+0000 7f2d6b33e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:04.567 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.566+0000 7f2c1dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:04.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.566+0000 7f2d6b33e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:04.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.566+0000 7f2d6b33e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:04.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.566+0000 7f2d6b33e800 5 note: GC not initialized 2024-09-22T08:36:04.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.566+0000 7f2c1cfe1640 20 reqs_thread_entry: start 2024-09-22T08:36:04.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.567+0000 7f2d6b33e800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:04.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.567+0000 7f2d6b33e800 20 Filter name: none 2024-09-22T08:36:04.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.567+0000 7f2b967fc640 20 reqs_thread_entry: start 2024-09-22T08:36:04.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.567+0000 7f2d6b33e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:04.569 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.567+0000 7f2d6b33e800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T08:36:04.569 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.567+0000 7f2d6b33e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:04.569 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.568+0000 7f2d6b33e800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T08:36:04.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.568+0000 7f2d6b33e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:36:04.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.568+0000 7f2d6b33e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:04.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.568+0000 7f2d6b33e800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T08:36:04.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.568+0000 7f2d6b33e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:04.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.569+0000 7f2d6b33e800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T08:36:04.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.569+0000 7f2d6b33e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:36:04.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.571+0000 7f2c1dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:04.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.574+0000 7f2d6b33e800 20 remove_watcher() i=0 2024-09-22T08:36:04.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.574+0000 7f2d6b33e800 2 removed watcher, disabling cache 2024-09-22T08:36:04.576 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.575+0000 7f2d6b33e800 20 remove_watcher() i=1 2024-09-22T08:36:04.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.576+0000 7f2d6b33e800 20 remove_watcher() i=2 2024-09-22T08:36:04.578 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.577+0000 7f2d6b33e800 20 remove_watcher() i=3 2024-09-22T08:36:04.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.578+0000 7f2d6b33e800 20 remove_watcher() i=4 2024-09-22T08:36:04.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.579+0000 7f2d6b33e800 20 remove_watcher() i=5 2024-09-22T08:36:04.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.580+0000 7f2d6b33e800 20 remove_watcher() i=6 2024-09-22T08:36:04.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.581+0000 7f2d6b33e800 20 remove_watcher() i=7 2024-09-22T08:36:04.593 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:04.593 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:36:04.593 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-do-reshard id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:36:04.593 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:04.595 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-22T08:36:04.629 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:04.630 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:04.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.669+0000 7ffadfc2d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:04.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.670+0000 7ffadfc2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:04.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.670+0000 7ffadfc2d800 20 realm 2024-09-22T08:36:04.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.670+0000 7ffadfc2d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:04.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.670+0000 7ffadfc2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:04.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.670+0000 7ffadfc2d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:04.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.671+0000 7ffadfc2d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:04.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.671+0000 7ffadfc2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:04.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.671+0000 7ffadfc2d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:04.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.671+0000 7ffadfc2d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:04.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.671+0000 7ffadfc2d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:04.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.672+0000 7ffadfc2d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:36:04.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.672+0000 7ffadfc2d800 20 searching for the correct realm 2024-09-22T08:36:04.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.674+0000 7ffadcf16640 0 -- 172.21.15.38:0/2499308591 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7ffad406b020 msgr2=0x7ffad4009e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:04.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.678+0000 7ffadcf16640 0 -- 172.21.15.38:0/2499308591 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7ffad0027040 msgr2=0x7ffad004a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:36:04.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.885+0000 7ffadfc2d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:04.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.885+0000 7ffadfc2d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:04.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.885+0000 7ffadfc2d800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:36:04.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.885+0000 7ffadfc2d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:04.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.885+0000 7ffadfc2d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:04.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.885+0000 7ffadfc2d800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:36:04.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.885+0000 7ffadfc2d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:04.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.885+0000 7ffadfc2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:04.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.885+0000 7ffadfc2d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:04.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.886+0000 7ffadfc2d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:04.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.886+0000 7ffadfc2d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:04.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.886+0000 7ffadfc2d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:36:04.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.886+0000 7ffadfc2d800 20 zone default found 2024-09-22T08:36:04.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.886+0000 7ffadfc2d800 4 Realm: () 2024-09-22T08:36:04.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.886+0000 7ffadfc2d800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:36:04.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.886+0000 7ffadfc2d800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:36:04.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.886+0000 7ffadfc2d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:04.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.886+0000 7ffadfc2d800 20 zonegroup default 2024-09-22T08:36:04.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.886+0000 7ffadfc2d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:04.889 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.886+0000 7ffadfc2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:04.889 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.886+0000 7ffadfc2d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:04.889 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.887+0000 7ffadfc2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:04.889 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.887+0000 7ffadfc2d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:04.889 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.887+0000 7ffadfc2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:04.889 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.887+0000 7ffadfc2d800 20 started sync module instance, tier type = 2024-09-22T08:36:04.889 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.887+0000 7ffadfc2d800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:36:04.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.897+0000 7ffadfc2d800 20 add_watcher() i=0 2024-09-22T08:36:04.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.897+0000 7ffadfc2d800 20 add_watcher() i=1 2024-09-22T08:36:04.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.897+0000 7ffadfc2d800 20 add_watcher() i=2 2024-09-22T08:36:04.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.897+0000 7ffadfc2d800 20 add_watcher() i=3 2024-09-22T08:36:04.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.897+0000 7ffadfc2d800 20 add_watcher() i=4 2024-09-22T08:36:04.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.897+0000 7ffadfc2d800 20 add_watcher() i=5 2024-09-22T08:36:04.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.898+0000 7ffadfc2d800 20 add_watcher() i=6 2024-09-22T08:36:04.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.899+0000 7ffadfc2d800 20 add_watcher() i=7 2024-09-22T08:36:04.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.899+0000 7ffadfc2d800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:04.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.901+0000 7ff9937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:04.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.902+0000 7ffadfc2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:04.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.902+0000 7ffadfc2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:04.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.902+0000 7ffadfc2d800 5 note: GC not initialized 2024-09-22T08:36:04.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.902+0000 7ff9927e4640 20 reqs_thread_entry: start 2024-09-22T08:36:04.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.902+0000 7ffadfc2d800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:04.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.902+0000 7ffadfc2d800 20 Filter name: none 2024-09-22T08:36:04.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.902+0000 7ff903fff640 20 reqs_thread_entry: start 2024-09-22T08:36:04.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.902+0000 7ffadfc2d800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-22T08:36:04.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.902+0000 7ffadfc2d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:04.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.903+0000 7ffadfc2d800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T08:36:04.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.903+0000 7ffadfc2d800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-22T08:36:04.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.903+0000 7ffadfc2d800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-22T08:36:04.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.903+0000 7ffadfc2d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 : miss 2024-09-22T08:36:04.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.903+0000 7ffadfc2d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:04.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.903+0000 7ffadfc2d800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T08:36:04.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.903+0000 7ffadfc2d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 info.flags=0x17 2024-09-22T08:36:04.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.903+0000 7ffadfc2d800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 to cache LRU end 2024-09-22T08:36:04.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.903+0000 7ffadfc2d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:04.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.903+0000 7ffadfc2d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:04.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.903+0000 7ffadfc2d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 2024-09-22T08:36:04.909 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.909+0000 7ffadfc2d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 info.flags=0x17 2024-09-22T08:36:04.910 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.909+0000 7ffadfc2d800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 to cache LRU end 2024-09-22T08:36:04.910 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.909+0000 7ffadfc2d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:04.910 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.909+0000 7ffadfc2d800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34, ofs0, ns] 2024-09-22T08:36:04.910 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.909+0000 7ff9affff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497025 cookie 94920831510944 notifier 7010 bl.length()=911 2024-09-22T08:36:04.910 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.909+0000 7ff9affff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 info.flags=0x17 2024-09-22T08:36:04.910 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.909+0000 7ff9affff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 to cache LRU end 2024-09-22T08:36:04.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.909+0000 7ff9affff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:04.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.909+0000 7ffadfc2d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.34]): orig_sources= new_sources= 2024-09-22T08:36:04.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.909+0000 7ffadfc2d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.34]): potential sources added=[] removed=[] 2024-09-22T08:36:04.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.909+0000 7ffadfc2d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.34]): orig_dests= new_dests= 2024-09-22T08:36:04.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.909+0000 7ffadfc2d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.34]): potential dests added=[] removed=[] 2024-09-22T08:36:04.916 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ffadfc2d800 time 2024-09-22T08:36:04.916726+0000 2024-09-22T08:36:04.916 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:36:04.917 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:36:04.917 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ffae318c748] 2024-09-22T08:36:04.917 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7ffae318c906] 2024-09-22T08:36:04.917 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x565479621e01] 2024-09-22T08:36:04.917 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x565479631d0a] 2024-09-22T08:36:04.917 INFO:tasks.workunit.client.0.smithi038.stderr: 5: main() 2024-09-22T08:36:04.917 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7ffae1e29590] 2024-09-22T08:36:04.917 INFO:tasks.workunit.client.0.smithi038.stderr: 7: __libc_start_main() 2024-09-22T08:36:04.918 INFO:tasks.workunit.client.0.smithi038.stderr: 8: _start() 2024-09-22T08:36:04.918 INFO:tasks.workunit.client.0.smithi038.stderr:*** Caught signal (Aborted) ** 2024-09-22T08:36:04.918 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7ffadfc2d800 thread_name:radosgw-admin 2024-09-22T08:36:04.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.916+0000 7ffadfc2d800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ffadfc2d800 time 2024-09-22T08:36:04.916726+0000 2024-09-22T08:36:04.918 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:36:04.918 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:04.918 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:36:04.918 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ffae318c748] 2024-09-22T08:36:04.919 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7ffae318c906] 2024-09-22T08:36:04.919 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x565479621e01] 2024-09-22T08:36:04.919 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x565479631d0a] 2024-09-22T08:36:04.919 INFO:tasks.workunit.client.0.smithi038.stderr: 5: main() 2024-09-22T08:36:04.919 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7ffae1e29590] 2024-09-22T08:36:04.919 INFO:tasks.workunit.client.0.smithi038.stderr: 7: __libc_start_main() 2024-09-22T08:36:04.919 INFO:tasks.workunit.client.0.smithi038.stderr: 8: _start() 2024-09-22T08:36:04.920 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:04.933 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:36:04.933 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ffae1e3e6f0] 2024-09-22T08:36:04.933 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ffae1e8b99c] 2024-09-22T08:36:04.933 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:36:04.933 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:36:04.933 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ffae318c7a2] 2024-09-22T08:36:04.933 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7ffae318c906] 2024-09-22T08:36:04.933 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x565479621e01] 2024-09-22T08:36:04.934 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x565479631d0a] 2024-09-22T08:36:04.934 INFO:tasks.workunit.client.0.smithi038.stderr: 9: main() 2024-09-22T08:36:04.934 INFO:tasks.workunit.client.0.smithi038.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7ffae1e29590] 2024-09-22T08:36:04.934 INFO:tasks.workunit.client.0.smithi038.stderr: 11: __libc_start_main() 2024-09-22T08:36:04.934 INFO:tasks.workunit.client.0.smithi038.stderr: 12: _start() 2024-09-22T08:36:04.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:04.917+0000 7ffadfc2d800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:36:04.934 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7ffadfc2d800 thread_name:radosgw-admin 2024-09-22T08:36:04.934 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:04.934 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:36:04.934 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ffae1e3e6f0] 2024-09-22T08:36:04.934 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ffae1e8b99c] 2024-09-22T08:36:04.934 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:36:04.934 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:36:04.934 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ffae318c7a2] 2024-09-22T08:36:04.935 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7ffae318c906] 2024-09-22T08:36:04.935 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x565479621e01] 2024-09-22T08:36:04.935 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x565479631d0a] 2024-09-22T08:36:04.935 INFO:tasks.workunit.client.0.smithi038.stderr: 9: main() 2024-09-22T08:36:04.935 INFO:tasks.workunit.client.0.smithi038.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7ffae1e29590] 2024-09-22T08:36:04.935 INFO:tasks.workunit.client.0.smithi038.stderr: 11: __libc_start_main() 2024-09-22T08:36:04.935 INFO:tasks.workunit.client.0.smithi038.stderr: 12: _start() 2024-09-22T08:36:04.935 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:36:04.935 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:04.935 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-22T08:36:04.935 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-22T08:36:04.650+0000 7ff9cb606640 10 monclient: dump: 2024-09-22T08:36:04.935 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:36:04.935 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:36:04.935 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:04.935 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:04.936 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:36:04.936 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:04.936 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:36:04.936 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:36:04.936 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:36:04.936 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:04.936 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-22T08:36:04.650+0000 7ffadfc2d800 5 monclient: authenticate success, global_id 7431 2024-09-22T08:36:04.936 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-22T08:36:04.650+0000 7ffadfc2d800 10 monclient: get_monmap_and_config success 2024-09-22T08:36:04.936 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-22T08:36:04.650+0000 7ffadfc2d800 4 set_mon_vals no callback set 2024-09-22T08:36:04.936 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 10 monclient: shutdown 2024-09-22T08:36:04.936 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 asok(0x56547a3f60f0) unregister_commands rotate-key 2024-09-22T08:36:04.936 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 10 monclient: build_initial_monmap 2024-09-22T08:36:04.936 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 1 build_initial for_mkfs: 0 2024-09-22T08:36:04.936 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 10 monclient: monmap: 2024-09-22T08:36:04.936 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:36:04.937 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:36:04.937 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:36:04.937 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:36:04.937 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:36:04.937 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:04.937 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:36:04.937 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:36:04.937 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:36:04.937 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:04.937 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a61d580) adding auth protocol: cephx 2024-09-22T08:36:04.937 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a61d580) adding auth protocol: cephx 2024-09-22T08:36:04.937 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a61d580) adding auth protocol: cephx 2024-09-22T08:36:04.937 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a61d580) adding con mode: secure 2024-09-22T08:36:04.937 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a61d580) adding con mode: crc 2024-09-22T08:36:04.938 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a61d580) adding con mode: secure 2024-09-22T08:36:04.938 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a61d580) adding con mode: crc 2024-09-22T08:36:04.938 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a61d580) adding con mode: secure 2024-09-22T08:36:04.938 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a61d580) adding con mode: crc 2024-09-22T08:36:04.938 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a61d580) adding con mode: crc 2024-09-22T08:36:04.938 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a61d580) adding con mode: secure 2024-09-22T08:36:04.938 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a61d580) adding con mode: crc 2024-09-22T08:36:04.938 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a61d580) adding con mode: secure 2024-09-22T08:36:04.938 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a61d580) adding con mode: crc 2024-09-22T08:36:04.938 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a61d580) adding con mode: secure 2024-09-22T08:36:04.938 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:04.938 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 1 librados: starting msgr at 2024-09-22T08:36:04.938 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 1 librados: starting objecter 2024-09-22T08:36:04.938 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 asok(0x56547a3f60f0) register_command objecter_requests hook 0x56547a61cd50 2024-09-22T08:36:04.938 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 1 librados: setting wanted keys 2024-09-22T08:36:04.939 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 1 librados: calling monclient init 2024-09-22T08:36:04.939 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 10 monclient: init 2024-09-22T08:36:04.939 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a617f00) adding auth protocol: cephx 2024-09-22T08:36:04.939 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a617f00) adding auth protocol: cephx 2024-09-22T08:36:04.939 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a617f00) adding auth protocol: cephx 2024-09-22T08:36:04.939 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a617f00) adding con mode: secure 2024-09-22T08:36:04.939 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a617f00) adding con mode: crc 2024-09-22T08:36:04.939 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a617f00) adding con mode: secure 2024-09-22T08:36:04.939 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a617f00) adding con mode: crc 2024-09-22T08:36:04.939 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a617f00) adding con mode: secure 2024-09-22T08:36:04.939 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a617f00) adding con mode: crc 2024-09-22T08:36:04.939 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a617f00) adding con mode: crc 2024-09-22T08:36:04.939 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a617f00) adding con mode: secure 2024-09-22T08:36:04.939 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a617f00) adding con mode: crc 2024-09-22T08:36:04.939 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a617f00) adding con mode: secure 2024-09-22T08:36:04.940 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a617f00) adding con mode: crc 2024-09-22T08:36:04.940 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a617f00) adding con mode: secure 2024-09-22T08:36:04.940 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:04.940 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-22T08:36:04.652+0000 7ffadfc2d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:04.940 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-22T08:36:04.652+0000 7ffadfc2d800 5 asok(0x56547a3f60f0) register_command rotate-key hook 0x56547a618048 2024-09-22T08:36:04.940 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-22T08:36:04.652+0000 7ffadfc2d800 10 monclient: _reopen_session rank -1 2024-09-22T08:36:04.940 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-22T08:36:04.652+0000 7ffadfc2d800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T08:36:04.940 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-22T08:36:04.652+0000 7ffadfc2d800 10 monclient(hunting): picked mon.noname-c con 0x56547a490580 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:36:04.940 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-22T08:36:04.652+0000 7ffadfc2d800 10 monclient(hunting): picked mon.noname-a con 0x56547a55a8c0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:36:04.940 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-22T08:36:04.652+0000 7ffadfc2d800 10 monclient(hunting): picked mon.noname-b con 0x56547a642130 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:36:04.940 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-22T08:36:04.652+0000 7ffadfc2d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:04.940 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-22T08:36:04.652+0000 7ffadfc2d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:04.940 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-22T08:36:04.652+0000 7ffadfc2d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:04.940 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-22T08:36:04.652+0000 7ffadfc2d800 10 monclient(hunting): _renew_subs 2024-09-22T08:36:04.941 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-22T08:36:04.652+0000 7ffadfc2d800 10 monclient(hunting): authenticate will time out at 2069.891284s 2024-09-22T08:36:04.941 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-22T08:36:04.652+0000 7ffadcf16640 10 monclient(hunting): get_auth_request con 0x56547a55a8c0 auth_method 0 2024-09-22T08:36:04.941 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-22T08:36:04.652+0000 7ffadcf16640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:04.941 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-22T08:36:04.652+0000 7ffadcf16640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:04.941 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-22T08:36:04.652+0000 7ffadcf16640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:04.941 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-22T08:36:04.652+0000 7ffadd717640 10 monclient(hunting): get_auth_request con 0x56547a490580 auth_method 0 2024-09-22T08:36:04.941 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-22T08:36:04.652+0000 7ffadd717640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:04.941 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-22T08:36:04.652+0000 7ffadd717640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:04.941 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-22T08:36:04.652+0000 7ffadd717640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:04.941 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-22T08:36:04.652+0000 7ffadcf16640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:36:04.941 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-22T08:36:04.652+0000 7ffadcf16640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:36:04.941 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-22T08:36:04.652+0000 7ffadcf16640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:36:04.941 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-22T08:36:04.652+0000 7ffadd717640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:36:04.941 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-22T08:36:04.652+0000 7ffadd717640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:36:04.942 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-22T08:36:04.652+0000 7ffadd717640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:36:04.942 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-22T08:36:04.652+0000 7ffaddf18640 10 monclient(hunting): get_auth_request con 0x56547a642130 auth_method 0 2024-09-22T08:36:04.942 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-22T08:36:04.652+0000 7ffaddf18640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:04.942 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-22T08:36:04.652+0000 7ffaddf18640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:04.942 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-22T08:36:04.652+0000 7ffaddf18640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:04.942 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-22T08:36:04.652+0000 7ffadcf16640 10 monclient(hunting): handle_auth_done global_id 7434 payload 824 2024-09-22T08:36:04.942 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-22T08:36:04.652+0000 7ffadcf16640 10 monclient: _finish_hunting 0 2024-09-22T08:36:04.942 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-22T08:36:04.652+0000 7ffadcf16640 1 monclient: found mon.noname-a 2024-09-22T08:36:04.942 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-22T08:36:04.652+0000 7ffadcf16640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:36:04.942 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-22T08:36:04.652+0000 7ff9c9e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:36:04.942 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-22T08:36:04.652+0000 7ff9c9e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:36:04.942 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-22T08:36:04.652+0000 7ff9c9e03640 10 monclient: dump: 2024-09-22T08:36:04.942 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:36:04.942 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:36:04.943 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:04.943 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:04.943 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:36:04.943 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:04.943 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:36:04.943 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:36:04.943 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:36:04.943 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:04.943 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-22T08:36:04.652+0000 7ff9c9e03640 10 monclient: _finish_auth 0 2024-09-22T08:36:04.943 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-22T08:36:04.652+0000 7ff9c9e03640 10 monclient: _check_auth_tickets 2024-09-22T08:36:04.943 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-22T08:36:04.652+0000 7ff9c9e03640 10 monclient: handle_config config(0 keys) 2024-09-22T08:36:04.943 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-22T08:36:04.653+0000 7ff9c9e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:36:04.943 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-22T08:36:04.653+0000 7ff9c9e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:36:04.943 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-22T08:36:04.653+0000 7ff9c9e03640 10 monclient: dump: 2024-09-22T08:36:04.944 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:36:04.944 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:36:04.944 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:04.944 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:04.944 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:36:04.944 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:04.944 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:36:04.944 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:36:04.944 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:36:04.944 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:04.944 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-22T08:36:04.653+0000 7ffadfc2d800 5 monclient: authenticate success, global_id 7434 2024-09-22T08:36:04.944 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-22T08:36:04.653+0000 7ffadfc2d800 10 monclient: _renew_subs 2024-09-22T08:36:04.944 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-22T08:36:04.653+0000 7ff9cb606640 4 set_mon_vals no callback set 2024-09-22T08:36:04.944 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-22T08:36:04.653+0000 7ffadfc2d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:36:04.945 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-22T08:36:04.653+0000 7ffadfc2d800 10 monclient: _renew_subs 2024-09-22T08:36:04.945 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-22T08:36:04.653+0000 7ffadfc2d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:36:04.945 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-22T08:36:04.653+0000 7ffadfc2d800 1 librados: init done 2024-09-22T08:36:04.945 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-22T08:36:04.655+0000 7ff9c9e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:36:04.945 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-22T08:36:04.655+0000 7ff9c9e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:36:04.945 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-22T08:36:04.655+0000 7ff9c9e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:36:04.945 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-22T08:36:04.655+0000 7ffadd717640 10 monclient: get_auth_request con 0x7ff9c4077570 auth_method 0 2024-09-22T08:36:04.945 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-22T08:36:04.655+0000 7ffaddf18640 10 monclient: get_auth_request con 0x56547a640950 auth_method 0 2024-09-22T08:36:04.945 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-22T08:36:04.656+0000 7ffadd717640 10 monclient: get_auth_request con 0x56547a6634b0 auth_method 0 2024-09-22T08:36:04.945 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-22T08:36:04.657+0000 7ffadcf16640 10 monclient: get_auth_request con 0x56547a667860 auth_method 0 2024-09-22T08:36:04.945 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-22T08:36:04.658+0000 7ffaddf18640 10 monclient: get_auth_request con 0x56547a666d60 auth_method 0 2024-09-22T08:36:04.945 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-22T08:36:04.658+0000 7ffadfc2d800 10 monclient: build_initial_monmap 2024-09-22T08:36:04.945 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-22T08:36:04.658+0000 7ffadfc2d800 1 build_initial for_mkfs: 0 2024-09-22T08:36:04.945 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-22T08:36:04.658+0000 7ffadfc2d800 10 monclient: monmap: 2024-09-22T08:36:04.945 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:36:04.946 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:36:04.946 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:36:04.946 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:36:04.946 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:36:04.946 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:04.946 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:36:04.946 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:36:04.946 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:36:04.946 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:04.946 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-22T08:36:04.658+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66fa40) adding auth protocol: cephx 2024-09-22T08:36:04.946 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-22T08:36:04.658+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66fa40) adding auth protocol: cephx 2024-09-22T08:36:04.946 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-22T08:36:04.658+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66fa40) adding auth protocol: cephx 2024-09-22T08:36:04.946 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-22T08:36:04.658+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66fa40) adding con mode: secure 2024-09-22T08:36:04.946 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-22T08:36:04.658+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66fa40) adding con mode: crc 2024-09-22T08:36:04.947 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-22T08:36:04.658+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66fa40) adding con mode: secure 2024-09-22T08:36:04.947 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-22T08:36:04.658+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66fa40) adding con mode: crc 2024-09-22T08:36:04.947 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-22T08:36:04.658+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66fa40) adding con mode: secure 2024-09-22T08:36:04.947 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-22T08:36:04.658+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66fa40) adding con mode: crc 2024-09-22T08:36:04.947 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-22T08:36:04.658+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66fa40) adding con mode: crc 2024-09-22T08:36:04.947 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-22T08:36:04.658+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66fa40) adding con mode: secure 2024-09-22T08:36:04.947 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-22T08:36:04.658+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66fa40) adding con mode: crc 2024-09-22T08:36:04.947 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-22T08:36:04.658+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66fa40) adding con mode: secure 2024-09-22T08:36:04.947 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-22T08:36:04.658+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66fa40) adding con mode: crc 2024-09-22T08:36:04.947 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-22T08:36:04.658+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66fa40) adding con mode: secure 2024-09-22T08:36:04.947 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:04.947 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 5 asok(0x56547a3f60f0) register_command objecter_requests cmddesc objecter_requests hook 0x56547a672e80 EEXIST 2024-09-22T08:36:04.947 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 10 monclient: init 2024-09-22T08:36:04.947 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66e938) adding auth protocol: cephx 2024-09-22T08:36:04.948 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66e938) adding auth protocol: cephx 2024-09-22T08:36:04.948 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66e938) adding auth protocol: cephx 2024-09-22T08:36:04.948 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66e938) adding con mode: secure 2024-09-22T08:36:04.948 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66e938) adding con mode: crc 2024-09-22T08:36:04.948 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66e938) adding con mode: secure 2024-09-22T08:36:04.948 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66e938) adding con mode: crc 2024-09-22T08:36:04.948 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66e938) adding con mode: secure 2024-09-22T08:36:04.948 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66e938) adding con mode: crc 2024-09-22T08:36:04.948 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66e938) adding con mode: crc 2024-09-22T08:36:04.948 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66e938) adding con mode: secure 2024-09-22T08:36:04.948 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66e938) adding con mode: crc 2024-09-22T08:36:04.948 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66e938) adding con mode: secure 2024-09-22T08:36:04.948 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66e938) adding con mode: crc 2024-09-22T08:36:04.948 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66e938) adding con mode: secure 2024-09-22T08:36:04.949 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:04.949 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:04.949 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 5 asok(0x56547a3f60f0) register_command rotate-key cmddesc rotate-key hook 0x56547a66ea80 EEXIST 2024-09-22T08:36:04.949 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 10 monclient: _reopen_session rank -1 2024-09-22T08:36:04.949 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T08:36:04.949 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 10 monclient(hunting): picked mon.noname-c con 0x56547a6971a0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:36:04.949 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 10 monclient(hunting): picked mon.noname-a con 0x56547a697580 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:36:04.949 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 10 monclient(hunting): picked mon.noname-b con 0x56547a695eb0 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:36:04.949 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:04.949 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:04.949 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-22T08:36:04.660+0000 7ffadfc2d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:04.949 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-22T08:36:04.660+0000 7ffadfc2d800 10 monclient(hunting): _renew_subs 2024-09-22T08:36:04.949 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-22T08:36:04.660+0000 7ffadfc2d800 10 monclient(hunting): authenticate will time out at 2069.899011s 2024-09-22T08:36:04.949 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-22T08:36:04.660+0000 7ffaddf18640 10 monclient(hunting): get_auth_request con 0x56547a697580 auth_method 0 2024-09-22T08:36:04.949 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-22T08:36:04.660+0000 7ffaddf18640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:04.950 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-22T08:36:04.660+0000 7ffaddf18640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:04.950 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-22T08:36:04.660+0000 7ffaddf18640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:04.950 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-22T08:36:04.660+0000 7ffadcf16640 10 monclient(hunting): get_auth_request con 0x56547a6971a0 auth_method 0 2024-09-22T08:36:04.950 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-22T08:36:04.660+0000 7ffadcf16640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:04.950 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-22T08:36:04.660+0000 7ffadcf16640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:04.950 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-22T08:36:04.660+0000 7ffadcf16640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:04.950 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-22T08:36:04.660+0000 7ffaddf18640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:36:04.950 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-22T08:36:04.660+0000 7ffaddf18640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:36:04.950 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-22T08:36:04.660+0000 7ffaddf18640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:36:04.950 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-22T08:36:04.660+0000 7ffadcf16640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:36:04.950 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-22T08:36:04.660+0000 7ffadcf16640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:36:04.950 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-22T08:36:04.660+0000 7ffadcf16640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:36:04.950 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-22T08:36:04.660+0000 7ffadd717640 10 monclient(hunting): get_auth_request con 0x56547a695eb0 auth_method 0 2024-09-22T08:36:04.951 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-22T08:36:04.660+0000 7ffadd717640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:04.951 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-22T08:36:04.660+0000 7ffadd717640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:04.951 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-22T08:36:04.660+0000 7ffadd717640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:04.951 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-22T08:36:04.660+0000 7ffadd717640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:36:04.951 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-22T08:36:04.660+0000 7ffadd717640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:36:04.951 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-22T08:36:04.660+0000 7ffadd717640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:36:04.951 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-22T08:36:04.660+0000 7ffaddf18640 10 monclient(hunting): handle_auth_done global_id 7437 payload 824 2024-09-22T08:36:04.951 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-22T08:36:04.660+0000 7ffaddf18640 10 monclient: _finish_hunting 0 2024-09-22T08:36:04.951 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-22T08:36:04.660+0000 7ffaddf18640 1 monclient: found mon.noname-a 2024-09-22T08:36:04.951 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-22T08:36:04.660+0000 7ffaddf18640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:36:04.951 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-22T08:36:04.660+0000 7ff9c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:36:04.951 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-22T08:36:04.660+0000 7ff9c2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:36:04.951 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-22T08:36:04.660+0000 7ff9c2ffd640 10 monclient: dump: 2024-09-22T08:36:04.951 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:36:04.951 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:36:04.952 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:04.952 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:04.952 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:36:04.952 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:04.952 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:36:04.952 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:36:04.952 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:36:04.952 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:04.952 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-22T08:36:04.660+0000 7ff9c2ffd640 10 monclient: _finish_auth 0 2024-09-22T08:36:04.952 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-22T08:36:04.660+0000 7ff9c2ffd640 10 monclient: _check_auth_tickets 2024-09-22T08:36:04.952 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-22T08:36:04.660+0000 7ff9c2ffd640 10 monclient: handle_config config(0 keys) 2024-09-22T08:36:04.952 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-22T08:36:04.660+0000 7ff9c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:36:04.952 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-22T08:36:04.660+0000 7ff9c2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:36:04.952 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-22T08:36:04.660+0000 7ff9c2ffd640 10 monclient: dump: 2024-09-22T08:36:04.953 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:36:04.953 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:36:04.953 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:04.953 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:04.953 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:36:04.953 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:04.953 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:36:04.953 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:36:04.953 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:36:04.953 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:04.953 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-22T08:36:04.660+0000 7ffadfc2d800 5 monclient: authenticate success, global_id 7437 2024-09-22T08:36:04.953 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-22T08:36:04.660+0000 7ffadfc2d800 10 monclient: _renew_subs 2024-09-22T08:36:04.953 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-22T08:36:04.660+0000 7ffadfc2d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:36:04.954 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-22T08:36:04.660+0000 7ffade719640 4 set_mon_vals no callback set 2024-09-22T08:36:04.954 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-22T08:36:04.660+0000 7ffadfc2d800 10 monclient: _renew_subs 2024-09-22T08:36:04.954 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-22T08:36:04.660+0000 7ffadfc2d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:36:04.954 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-22T08:36:04.662+0000 7ff9c2ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:36:04.954 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-22T08:36:04.662+0000 7ff9c2ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:36:04.954 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-22T08:36:04.662+0000 7ff9c2ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:36:04.954 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 10 monclient: get_monmap_and_config 2024-09-22T08:36:04.954 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 10 monclient: build_initial_monmap 2024-09-22T08:36:04.954 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 1 build_initial for_mkfs: 0 2024-09-22T08:36:04.954 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 10 monclient: monmap: 2024-09-22T08:36:04.954 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:36:04.954 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:36:04.954 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:36:04.954 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:36:04.955 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:36:04.955 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:04.955 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:36:04.955 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:36:04.955 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:36:04.955 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:04.955 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6b7120) adding auth protocol: cephx 2024-09-22T08:36:04.955 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6b7120) adding auth protocol: cephx 2024-09-22T08:36:04.955 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6b7120) adding auth protocol: cephx 2024-09-22T08:36:04.955 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6b7120) adding con mode: secure 2024-09-22T08:36:04.955 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6b7120) adding con mode: crc 2024-09-22T08:36:04.955 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6b7120) adding con mode: secure 2024-09-22T08:36:04.955 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6b7120) adding con mode: crc 2024-09-22T08:36:04.955 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6b7120) adding con mode: secure 2024-09-22T08:36:04.956 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6b7120) adding con mode: crc 2024-09-22T08:36:04.956 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6b7120) adding con mode: crc 2024-09-22T08:36:04.956 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6b7120) adding con mode: secure 2024-09-22T08:36:04.956 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6b7120) adding con mode: crc 2024-09-22T08:36:04.956 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6b7120) adding con mode: secure 2024-09-22T08:36:04.956 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6b7120) adding con mode: crc 2024-09-22T08:36:04.956 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6b7120) adding con mode: secure 2024-09-22T08:36:04.956 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-22T08:36:04.663+0000 7ffadcf16640 10 monclient: get_auth_request con 0x7ff9b8077480 auth_method 0 2024-09-22T08:36:04.956 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:04.956 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 10 monclient: init 2024-09-22T08:36:04.956 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b03d10) adding auth protocol: cephx 2024-09-22T08:36:04.956 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b03d10) adding auth protocol: cephx 2024-09-22T08:36:04.956 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b03d10) adding auth protocol: cephx 2024-09-22T08:36:04.956 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b03d10) adding con mode: secure 2024-09-22T08:36:04.956 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b03d10) adding con mode: crc 2024-09-22T08:36:04.957 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b03d10) adding con mode: secure 2024-09-22T08:36:04.957 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b03d10) adding con mode: crc 2024-09-22T08:36:04.957 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b03d10) adding con mode: secure 2024-09-22T08:36:04.957 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b03d10) adding con mode: crc 2024-09-22T08:36:04.957 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b03d10) adding con mode: crc 2024-09-22T08:36:04.957 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b03d10) adding con mode: secure 2024-09-22T08:36:04.957 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b03d10) adding con mode: crc 2024-09-22T08:36:04.957 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b03d10) adding con mode: secure 2024-09-22T08:36:04.957 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b03d10) adding con mode: crc 2024-09-22T08:36:04.957 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b03d10) adding con mode: secure 2024-09-22T08:36:04.957 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:04.957 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-22T08:36:04.664+0000 7ffadfc2d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:04.957 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-22T08:36:04.664+0000 7ffadfc2d800 5 asok(0x56547a3f60f0) register_command rotate-key cmddesc rotate-key hook 0x7fff95b03e58 EEXIST 2024-09-22T08:36:04.958 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-22T08:36:04.664+0000 7ffadfc2d800 10 monclient: _reopen_session rank -1 2024-09-22T08:36:04.958 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-22T08:36:04.664+0000 7ffadfc2d800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T08:36:04.958 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-22T08:36:04.664+0000 7ffadfc2d800 10 monclient(hunting): picked mon.noname-c con 0x56547a6eb700 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:36:04.958 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-22T08:36:04.664+0000 7ffadfc2d800 10 monclient(hunting): picked mon.noname-a con 0x56547a6bc700 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:36:04.958 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-22T08:36:04.664+0000 7ffadfc2d800 10 monclient(hunting): picked mon.noname-b con 0x56547a6e5c80 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:36:04.958 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-22T08:36:04.664+0000 7ffadfc2d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:04.958 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-22T08:36:04.664+0000 7ffadfc2d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:04.958 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-22T08:36:04.664+0000 7ffadfc2d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:04.958 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-22T08:36:04.664+0000 7ffadfc2d800 10 monclient(hunting): _renew_subs 2024-09-22T08:36:04.958 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-22T08:36:04.664+0000 7ffadfc2d800 10 monclient(hunting): authenticate will time out at 2069.903252s 2024-09-22T08:36:04.958 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-22T08:36:04.664+0000 7ffaddf18640 10 monclient(hunting): get_auth_request con 0x56547a6bc700 auth_method 0 2024-09-22T08:36:04.958 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-22T08:36:04.664+0000 7ffaddf18640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:04.958 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-22T08:36:04.664+0000 7ffaddf18640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:04.959 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-22T08:36:04.664+0000 7ffaddf18640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:04.959 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-22T08:36:04.664+0000 7ffadcf16640 10 monclient(hunting): get_auth_request con 0x56547a6eb700 auth_method 0 2024-09-22T08:36:04.959 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-22T08:36:04.664+0000 7ffadcf16640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:04.959 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-22T08:36:04.664+0000 7ffadcf16640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:04.959 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-22T08:36:04.664+0000 7ffadcf16640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:04.959 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-22T08:36:04.664+0000 7ffaddf18640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:36:04.959 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-22T08:36:04.664+0000 7ffaddf18640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:36:04.959 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-22T08:36:04.664+0000 7ffaddf18640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:36:04.959 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-22T08:36:04.664+0000 7ffadcf16640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:36:04.959 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-22T08:36:04.664+0000 7ffadcf16640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:36:04.959 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-22T08:36:04.664+0000 7ffadcf16640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:36:04.959 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-22T08:36:04.664+0000 7ffadd717640 10 monclient(hunting): get_auth_request con 0x56547a6e5c80 auth_method 0 2024-09-22T08:36:04.960 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-22T08:36:04.664+0000 7ffadd717640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:04.961 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-22T08:36:04.664+0000 7ffadd717640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:04.961 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-22T08:36:04.664+0000 7ffadd717640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:04.961 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-22T08:36:04.664+0000 7ffaddf18640 10 monclient(hunting): handle_auth_done global_id 7440 payload 274 2024-09-22T08:36:04.961 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-22T08:36:04.664+0000 7ffaddf18640 10 monclient: _finish_hunting 0 2024-09-22T08:36:04.962 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-22T08:36:04.664+0000 7ffaddf18640 1 monclient: found mon.noname-a 2024-09-22T08:36:04.962 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-22T08:36:04.664+0000 7ffaddf18640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:36:04.962 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-22T08:36:04.665+0000 7ff9c0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:36:04.962 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-22T08:36:04.665+0000 7ff9c0ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:36:04.962 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-22T08:36:04.665+0000 7ff9c0ff9640 10 monclient: dump: 2024-09-22T08:36:04.962 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:36:04.962 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:36:04.962 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:04.962 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:04.962 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:36:04.962 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:04.962 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:36:04.962 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:36:04.962 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:36:04.963 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:04.963 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-22T08:36:04.665+0000 7ff9c0ff9640 10 monclient: _finish_auth 0 2024-09-22T08:36:04.963 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-22T08:36:04.665+0000 7ff9c0ff9640 10 monclient: _check_auth_tickets 2024-09-22T08:36:04.963 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 5 monclient: authenticate success, global_id 7440 2024-09-22T08:36:04.963 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-22T08:36:04.665+0000 7ff9c0ff9640 10 monclient: handle_config config(0 keys) 2024-09-22T08:36:04.963 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 10 monclient: get_monmap_and_config success 2024-09-22T08:36:04.963 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 4 set_mon_vals no callback set 2024-09-22T08:36:04.963 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-22T08:36:04.665+0000 7ff9c0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:36:04.963 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-22T08:36:04.665+0000 7ff9c0ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:36:04.963 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-22T08:36:04.665+0000 7ff9c0ff9640 10 monclient: dump: 2024-09-22T08:36:04.963 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:36:04.963 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:36:04.963 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:04.964 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:04.964 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:36:04.964 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:04.964 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:36:04.964 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:36:04.964 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:36:04.964 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:04.964 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 10 monclient: shutdown 2024-09-22T08:36:04.964 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 10 monclient: build_initial_monmap 2024-09-22T08:36:04.964 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 1 build_initial for_mkfs: 0 2024-09-22T08:36:04.964 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 10 monclient: monmap: 2024-09-22T08:36:04.964 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:36:04.964 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:36:04.964 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:36:04.964 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:36:04.965 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:36:04.965 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:04.965 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:36:04.965 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:36:04.965 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:36:04.965 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:04.965 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6bbe90) adding auth protocol: cephx 2024-09-22T08:36:04.965 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6bbe90) adding auth protocol: cephx 2024-09-22T08:36:04.965 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6bbe90) adding auth protocol: cephx 2024-09-22T08:36:04.965 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6bbe90) adding con mode: secure 2024-09-22T08:36:04.965 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6bbe90) adding con mode: crc 2024-09-22T08:36:04.965 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6bbe90) adding con mode: secure 2024-09-22T08:36:04.965 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6bbe90) adding con mode: crc 2024-09-22T08:36:04.965 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6bbe90) adding con mode: secure 2024-09-22T08:36:04.966 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6bbe90) adding con mode: crc 2024-09-22T08:36:04.966 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6bbe90) adding con mode: crc 2024-09-22T08:36:04.966 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6bbe90) adding con mode: secure 2024-09-22T08:36:04.966 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6bbe90) adding con mode: crc 2024-09-22T08:36:04.966 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6bbe90) adding con mode: secure 2024-09-22T08:36:04.966 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6bbe90) adding con mode: crc 2024-09-22T08:36:04.966 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6bbe90) adding con mode: secure 2024-09-22T08:36:04.966 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:04.966 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 1 librados: starting msgr at 2024-09-22T08:36:04.966 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 1 librados: starting objecter 2024-09-22T08:36:04.966 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 5 asok(0x56547a3f60f0) register_command objecter_requests cmddesc objecter_requests hook 0x56547a697980 EEXIST 2024-09-22T08:36:04.966 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 1 librados: setting wanted keys 2024-09-22T08:36:04.966 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 1 librados: calling monclient init 2024-09-22T08:36:04.966 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 10 monclient: init 2024-09-22T08:36:04.967 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6aba60) adding auth protocol: cephx 2024-09-22T08:36:04.967 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6aba60) adding auth protocol: cephx 2024-09-22T08:36:04.967 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6aba60) adding auth protocol: cephx 2024-09-22T08:36:04.967 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6aba60) adding con mode: secure 2024-09-22T08:36:04.967 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6aba60) adding con mode: crc 2024-09-22T08:36:04.967 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6aba60) adding con mode: secure 2024-09-22T08:36:04.967 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6aba60) adding con mode: crc 2024-09-22T08:36:04.967 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6aba60) adding con mode: secure 2024-09-22T08:36:04.967 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6aba60) adding con mode: crc 2024-09-22T08:36:04.967 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6aba60) adding con mode: crc 2024-09-22T08:36:04.967 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6aba60) adding con mode: secure 2024-09-22T08:36:04.967 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6aba60) adding con mode: crc 2024-09-22T08:36:04.967 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6aba60) adding con mode: secure 2024-09-22T08:36:04.967 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6aba60) adding con mode: crc 2024-09-22T08:36:04.968 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6aba60) adding con mode: secure 2024-09-22T08:36:04.968 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:04.968 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:04.968 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 5 asok(0x56547a3f60f0) register_command rotate-key cmddesc rotate-key hook 0x56547a6abba8 EEXIST 2024-09-22T08:36:04.968 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 10 monclient: _reopen_session rank -1 2024-09-22T08:36:04.968 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-22T08:36:04.968 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 10 monclient(hunting): picked mon.noname-c con 0x56547a6bc700 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:36:04.968 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 10 monclient(hunting): picked mon.noname-b con 0x56547a6e5c80 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:36:04.968 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 10 monclient(hunting): picked mon.noname-a con 0x56547a6eb700 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:36:04.968 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:04.968 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:04.968 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:04.968 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 10 monclient(hunting): _renew_subs 2024-09-22T08:36:04.969 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 10 monclient(hunting): authenticate will time out at 2069.905772s 2024-09-22T08:36:04.969 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-22T08:36:04.666+0000 7ffadcf16640 10 monclient(hunting): get_auth_request con 0x56547a6bc700 auth_method 0 2024-09-22T08:36:04.969 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-22T08:36:04.666+0000 7ffadcf16640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:04.969 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-22T08:36:04.666+0000 7ffadcf16640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:04.969 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-22T08:36:04.666+0000 7ffadcf16640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:04.969 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-22T08:36:04.666+0000 7ffadd717640 10 monclient(hunting): get_auth_request con 0x56547a6eb700 auth_method 0 2024-09-22T08:36:04.969 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-22T08:36:04.666+0000 7ffadd717640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:04.969 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-22T08:36:04.666+0000 7ffadd717640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:04.969 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-22T08:36:04.666+0000 7ffadd717640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:04.969 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-22T08:36:04.666+0000 7ffadcf16640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:36:04.969 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-22T08:36:04.666+0000 7ffadcf16640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:36:04.969 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-22T08:36:04.666+0000 7ffadcf16640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:36:04.969 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-22T08:36:04.666+0000 7ffadd717640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:36:04.969 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-22T08:36:04.666+0000 7ffadd717640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:36:04.970 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-22T08:36:04.666+0000 7ffadd717640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:36:04.970 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-22T08:36:04.667+0000 7ffaddf18640 10 monclient(hunting): get_auth_request con 0x56547a6e5c80 auth_method 0 2024-09-22T08:36:04.970 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-22T08:36:04.667+0000 7ffaddf18640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:04.970 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-22T08:36:04.667+0000 7ffaddf18640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:04.970 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-22T08:36:04.667+0000 7ffaddf18640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:04.970 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-22T08:36:04.667+0000 7ffadcf16640 10 monclient(hunting): handle_auth_done global_id 7010 payload 824 2024-09-22T08:36:04.970 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-22T08:36:04.667+0000 7ffadcf16640 10 monclient: _finish_hunting 0 2024-09-22T08:36:04.970 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-22T08:36:04.667+0000 7ffadcf16640 1 monclient: found mon.noname-c 2024-09-22T08:36:04.970 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-22T08:36:04.667+0000 7ffadcf16640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:36:04.970 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-22T08:36:04.667+0000 7ff9aeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:36:04.970 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-22T08:36:04.667+0000 7ff9aeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:36:04.970 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-22T08:36:04.667+0000 7ff9aeffd640 10 monclient: dump: 2024-09-22T08:36:04.970 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:36:04.971 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:36:04.971 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:04.971 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:04.971 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:36:04.971 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:04.971 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:36:04.971 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:36:04.971 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:36:04.971 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:04.971 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-22T08:36:04.667+0000 7ff9aeffd640 10 monclient: _finish_auth 0 2024-09-22T08:36:04.971 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-22T08:36:04.667+0000 7ff9aeffd640 10 monclient: _check_auth_tickets 2024-09-22T08:36:04.971 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-22T08:36:04.667+0000 7ff9aeffd640 10 monclient: handle_config config(0 keys) 2024-09-22T08:36:04.971 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-22T08:36:04.667+0000 7ff9aeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:36:04.971 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-22T08:36:04.667+0000 7ff9aeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:36:04.971 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-22T08:36:04.667+0000 7ff9aeffd640 10 monclient: dump: 2024-09-22T08:36:04.972 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:36:04.972 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:36:04.972 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:04.972 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:04.972 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:36:04.972 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:04.972 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:36:04.972 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:36:04.972 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:36:04.972 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:04.972 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-22T08:36:04.667+0000 7ffadfc2d800 5 monclient: authenticate success, global_id 7010 2024-09-22T08:36:04.972 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-22T08:36:04.667+0000 7ffadfc2d800 10 monclient: _renew_subs 2024-09-22T08:36:04.972 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-22T08:36:04.667+0000 7ffadfc2d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:36:04.972 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-22T08:36:04.667+0000 7ff9c0ff9640 4 set_mon_vals no callback set 2024-09-22T08:36:04.973 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-22T08:36:04.667+0000 7ffadfc2d800 10 monclient: _renew_subs 2024-09-22T08:36:04.973 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-22T08:36:04.667+0000 7ffadfc2d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:36:04.973 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-22T08:36:04.667+0000 7ffadfc2d800 1 librados: init done 2024-09-22T08:36:04.973 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-22T08:36:04.667+0000 7ffadfc2d800 5 asok(0x56547a3f60f0) register_command cr dump hook 0x56547a6f9578 2024-09-22T08:36:04.973 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-22T08:36:04.669+0000 7ffadfc2d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:04.973 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-22T08:36:04.669+0000 7ff9aeffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:36:04.973 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-22T08:36:04.669+0000 7ff9aeffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:36:04.973 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-22T08:36:04.669+0000 7ff9aeffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:36:04.973 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-22T08:36:04.669+0000 7ffaddf18640 10 monclient: get_auth_request con 0x7ff9a8077570 auth_method 0 2024-09-22T08:36:04.973 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-22T08:36:04.670+0000 7ffadd717640 10 monclient: get_auth_request con 0x56547a7059c0 auth_method 0 2024-09-22T08:36:04.973 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-22T08:36:04.670+0000 7ffadfc2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:04.973 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-22T08:36:04.670+0000 7ffadfc2d800 20 realm 2024-09-22T08:36:04.973 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-22T08:36:04.670+0000 7ffadfc2d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:04.973 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-22T08:36:04.670+0000 7ffadfc2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:04.973 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-22T08:36:04.670+0000 7ffadfc2d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:04.974 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-22T08:36:04.671+0000 7ffadfc2d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:04.974 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-22T08:36:04.671+0000 7ffadfc2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:04.974 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-22T08:36:04.671+0000 7ffadfc2d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:04.974 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-22T08:36:04.671+0000 7ffadcf16640 10 monclient: get_auth_request con 0x56547a709c00 auth_method 0 2024-09-22T08:36:04.974 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-22T08:36:04.671+0000 7ffadfc2d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:04.974 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-22T08:36:04.671+0000 7ffadfc2d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:04.974 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-22T08:36:04.672+0000 7ffaddf18640 10 monclient: get_auth_request con 0x56547a70d480 auth_method 0 2024-09-22T08:36:04.974 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-22T08:36:04.672+0000 7ffadfc2d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:36:04.974 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-22T08:36:04.672+0000 7ffadfc2d800 20 searching for the correct realm 2024-09-22T08:36:04.974 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-22T08:36:04.672+0000 7ffadd717640 10 monclient: get_auth_request con 0x56547a712240 auth_method 0 2024-09-22T08:36:04.974 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-22T08:36:04.674+0000 7ffadcf16640 10 monclient: get_auth_request con 0x7ffad406b020 auth_method 0 2024-09-22T08:36:04.974 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-22T08:36:04.674+0000 7ffadcf16640 0 -- 172.21.15.38:0/2499308591 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7ffad406b020 msgr2=0x7ffad4009e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:04.974 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-22T08:36:04.674+0000 7ff9aeffd640 1 client.7010.objecter ms_handle_reset 0x7ffad406b020 session 0x7ffad40b5040 osd.0 2024-09-22T08:36:04.975 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-22T08:36:04.674+0000 7ff9aeffd640 10 monclient: _renew_subs 2024-09-22T08:36:04.975 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-22T08:36:04.674+0000 7ff9aeffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:36:04.975 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-22T08:36:04.675+0000 7ffadcf16640 10 monclient: get_auth_request con 0x7ff9a8087090 auth_method 0 2024-09-22T08:36:04.975 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-22T08:36:04.675+0000 7ffaddf18640 10 monclient: get_auth_request con 0x7ffad003a040 auth_method 0 2024-09-22T08:36:04.975 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-22T08:36:04.677+0000 7ffadd717640 10 monclient: get_auth_request con 0x7ffad40c2ba0 auth_method 0 2024-09-22T08:36:04.975 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-22T08:36:04.678+0000 7ffadcf16640 10 monclient: get_auth_request con 0x7ffad0027040 auth_method 0 2024-09-22T08:36:04.975 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-22T08:36:04.678+0000 7ffadcf16640 0 -- 172.21.15.38:0/2499308591 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7ffad0027040 msgr2=0x7ffad004a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:36:04.975 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-22T08:36:04.879+0000 7ffadcf16640 10 monclient: get_auth_request con 0x7ffad0027040 auth_method 0 2024-09-22T08:36:04.975 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-22T08:36:04.885+0000 7ffadfc2d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:04.975 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-22T08:36:04.885+0000 7ffadfc2d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:04.975 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-22T08:36:04.885+0000 7ffadfc2d800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:36:04.975 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-22T08:36:04.885+0000 7ffadfc2d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:04.975 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-22T08:36:04.885+0000 7ffadfc2d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:04.976 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-22T08:36:04.885+0000 7ffadfc2d800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:36:04.976 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-22T08:36:04.885+0000 7ffadfc2d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:04.976 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-22T08:36:04.885+0000 7ffadfc2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:04.976 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-22T08:36:04.885+0000 7ffadfc2d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:04.976 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-22T08:36:04.886+0000 7ffadfc2d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:04.976 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-22T08:36:04.886+0000 7ffadfc2d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:04.976 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-22T08:36:04.886+0000 7ffadfc2d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:36:04.976 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-22T08:36:04.886+0000 7ffadfc2d800 20 zone default found 2024-09-22T08:36:04.976 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-22T08:36:04.886+0000 7ffadfc2d800 4 Realm: () 2024-09-22T08:36:04.976 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-22T08:36:04.886+0000 7ffadfc2d800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:36:04.976 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-22T08:36:04.886+0000 7ffadfc2d800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:36:04.976 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-22T08:36:04.886+0000 7ffadfc2d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:04.976 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-22T08:36:04.886+0000 7ffadfc2d800 20 zonegroup default 2024-09-22T08:36:04.976 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-22T08:36:04.886+0000 7ffadfc2d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:04.976 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-22T08:36:04.886+0000 7ffadfc2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:04.976 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-22T08:36:04.886+0000 7ffadfc2d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:04.976 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-22T08:36:04.887+0000 7ffadfc2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:04.977 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-22T08:36:04.887+0000 7ffadfc2d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:04.977 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-22T08:36:04.887+0000 7ffadfc2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:04.977 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-22T08:36:04.887+0000 7ffadfc2d800 20 started sync module instance, tier type = 2024-09-22T08:36:04.977 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-22T08:36:04.887+0000 7ffadfc2d800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:36:04.977 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-22T08:36:04.897+0000 7ffadfc2d800 20 add_watcher() i=0 2024-09-22T08:36:04.977 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-22T08:36:04.897+0000 7ffadfc2d800 20 add_watcher() i=1 2024-09-22T08:36:04.977 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-22T08:36:04.897+0000 7ffadfc2d800 20 add_watcher() i=2 2024-09-22T08:36:04.977 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-22T08:36:04.897+0000 7ffadfc2d800 20 add_watcher() i=3 2024-09-22T08:36:04.977 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-22T08:36:04.897+0000 7ffadfc2d800 20 add_watcher() i=4 2024-09-22T08:36:04.977 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-22T08:36:04.897+0000 7ffadfc2d800 20 add_watcher() i=5 2024-09-22T08:36:04.977 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-22T08:36:04.898+0000 7ffadfc2d800 20 add_watcher() i=6 2024-09-22T08:36:04.977 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-22T08:36:04.899+0000 7ffadfc2d800 20 add_watcher() i=7 2024-09-22T08:36:04.977 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-22T08:36:04.899+0000 7ffadfc2d800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:04.977 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-22T08:36:04.901+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b041e0) adding auth protocol: cephx 2024-09-22T08:36:04.978 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-22T08:36:04.901+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b041e0) adding auth protocol: cephx 2024-09-22T08:36:04.978 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-22T08:36:04.901+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b041e0) adding auth protocol: cephx 2024-09-22T08:36:04.978 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-22T08:36:04.901+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b041e0) adding con mode: secure 2024-09-22T08:36:04.978 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-22T08:36:04.901+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b041e0) adding con mode: crc 2024-09-22T08:36:04.978 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-22T08:36:04.901+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b041e0) adding con mode: secure 2024-09-22T08:36:04.978 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-22T08:36:04.901+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b041e0) adding con mode: crc 2024-09-22T08:36:04.978 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-22T08:36:04.901+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b041e0) adding con mode: secure 2024-09-22T08:36:04.978 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-22T08:36:04.901+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b041e0) adding con mode: crc 2024-09-22T08:36:04.978 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-22T08:36:04.901+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b041e0) adding con mode: crc 2024-09-22T08:36:04.978 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-22T08:36:04.901+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b041e0) adding con mode: secure 2024-09-22T08:36:04.978 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-22T08:36:04.901+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b041e0) adding con mode: crc 2024-09-22T08:36:04.978 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-22T08:36:04.901+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b041e0) adding con mode: secure 2024-09-22T08:36:04.978 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-22T08:36:04.901+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b041e0) adding con mode: crc 2024-09-22T08:36:04.978 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-22T08:36:04.901+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b041e0) adding con mode: secure 2024-09-22T08:36:04.978 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-22T08:36:04.901+0000 7ff9937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:04.979 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-22T08:36:04.902+0000 7ffadfc2d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:04.979 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-22T08:36:04.902+0000 7ffadfc2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:04.979 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-22T08:36:04.902+0000 7ffadfc2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:04.979 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-22T08:36:04.902+0000 7ffadfc2d800 5 asok(0x56547a3f60f0) register_command cache list hook 0x56547a6f9800 2024-09-22T08:36:04.979 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-22T08:36:04.902+0000 7ffadfc2d800 5 asok(0x56547a3f60f0) register_command cache inspect hook 0x56547a6f9800 2024-09-22T08:36:04.979 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-22T08:36:04.902+0000 7ffadfc2d800 5 asok(0x56547a3f60f0) register_command cache erase hook 0x56547a6f9800 2024-09-22T08:36:04.979 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-22T08:36:04.902+0000 7ffadfc2d800 5 asok(0x56547a3f60f0) register_command cache zap hook 0x56547a6f9800 2024-09-22T08:36:04.979 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-22T08:36:04.902+0000 7ffadfc2d800 5 note: GC not initialized 2024-09-22T08:36:04.979 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-22T08:36:04.902+0000 7ff9927e4640 20 reqs_thread_entry: start 2024-09-22T08:36:04.979 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-22T08:36:04.902+0000 7ffadfc2d800 5 asok(0x56547a3f60f0) register_command sync trace show hook 0x7ffad000e890 2024-09-22T08:36:04.979 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-22T08:36:04.902+0000 7ffadfc2d800 5 asok(0x56547a3f60f0) register_command sync trace history hook 0x7ffad000e890 2024-09-22T08:36:04.980 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-22T08:36:04.902+0000 7ffadfc2d800 5 asok(0x56547a3f60f0) register_command sync trace active hook 0x7ffad000e890 2024-09-22T08:36:04.981 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-22T08:36:04.902+0000 7ffadfc2d800 5 asok(0x56547a3f60f0) register_command sync trace active_short hook 0x7ffad000e890 2024-09-22T08:36:04.981 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-22T08:36:04.902+0000 7ffadfc2d800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:04.981 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-22T08:36:04.902+0000 7ffadfc2d800 20 Filter name: none 2024-09-22T08:36:04.981 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-22T08:36:04.902+0000 7ff903fff640 20 reqs_thread_entry: start 2024-09-22T08:36:04.981 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-22T08:36:04.902+0000 7ffadfc2d800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-22T08:36:04.981 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-22T08:36:04.902+0000 7ffadfc2d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:04.981 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-22T08:36:04.903+0000 7ffadfc2d800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T08:36:04.981 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-22T08:36:04.903+0000 7ffadfc2d800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-22T08:36:04.981 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-22T08:36:04.903+0000 7ffadfc2d800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-22T08:36:04.981 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-22T08:36:04.903+0000 7ffadfc2d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 : miss 2024-09-22T08:36:04.981 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-22T08:36:04.903+0000 7ffadfc2d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:04.981 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-22T08:36:04.903+0000 7ffadfc2d800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T08:36:04.981 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-22T08:36:04.903+0000 7ffadfc2d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 info.flags=0x17 2024-09-22T08:36:04.982 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-22T08:36:04.903+0000 7ffadfc2d800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 to cache LRU end 2024-09-22T08:36:04.982 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-22T08:36:04.903+0000 7ffadfc2d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:04.982 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-22T08:36:04.903+0000 7ffadfc2d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:04.982 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-22T08:36:04.903+0000 7ffadfc2d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 2024-09-22T08:36:04.982 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-22T08:36:04.909+0000 7ffadfc2d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 info.flags=0x17 2024-09-22T08:36:04.982 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-22T08:36:04.909+0000 7ffadfc2d800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 to cache LRU end 2024-09-22T08:36:04.982 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-22T08:36:04.909+0000 7ffadfc2d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:04.982 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-22T08:36:04.909+0000 7ffadfc2d800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34, ofs0, ns] 2024-09-22T08:36:04.982 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-22T08:36:04.909+0000 7ff9affff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497025 cookie 94920831510944 notifier 7010 bl.length()=911 2024-09-22T08:36:04.982 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-22T08:36:04.909+0000 7ff9affff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 info.flags=0x17 2024-09-22T08:36:04.982 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-22T08:36:04.909+0000 7ff9affff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 to cache LRU end 2024-09-22T08:36:04.982 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-22T08:36:04.909+0000 7ff9affff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:04.983 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-22T08:36:04.909+0000 7ffadfc2d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.34]): orig_sources= new_sources= 2024-09-22T08:36:04.983 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-22T08:36:04.909+0000 7ffadfc2d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.34]): potential sources added=[] removed=[] 2024-09-22T08:36:04.983 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-22T08:36:04.909+0000 7ffadfc2d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.34]): orig_dests= new_dests= 2024-09-22T08:36:04.983 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-22T08:36:04.909+0000 7ffadfc2d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.34]): potential dests added=[] removed=[] 2024-09-22T08:36:04.983 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-22T08:36:04.916+0000 7ffadfc2d800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ffadfc2d800 time 2024-09-22T08:36:04.916726+0000 2024-09-22T08:36:04.983 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:36:04.983 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:04.983 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:36:04.983 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ffae318c748] 2024-09-22T08:36:04.983 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7ffae318c906] 2024-09-22T08:36:04.983 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x565479621e01] 2024-09-22T08:36:04.983 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x565479631d0a] 2024-09-22T08:36:04.983 INFO:tasks.workunit.client.0.smithi038.stderr: 5: main() 2024-09-22T08:36:04.984 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7ffae1e29590] 2024-09-22T08:36:04.984 INFO:tasks.workunit.client.0.smithi038.stderr: 7: __libc_start_main() 2024-09-22T08:36:04.984 INFO:tasks.workunit.client.0.smithi038.stderr: 8: _start() 2024-09-22T08:36:04.984 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:04.984 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-22T08:36:04.917+0000 7ffadfc2d800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:36:04.984 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7ffadfc2d800 thread_name:radosgw-admin 2024-09-22T08:36:04.984 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:04.984 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:36:04.984 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ffae1e3e6f0] 2024-09-22T08:36:04.984 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ffae1e8b99c] 2024-09-22T08:36:04.984 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:36:04.984 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:36:04.984 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ffae318c7a2] 2024-09-22T08:36:04.984 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7ffae318c906] 2024-09-22T08:36:04.985 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x565479621e01] 2024-09-22T08:36:04.985 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x565479631d0a] 2024-09-22T08:36:04.985 INFO:tasks.workunit.client.0.smithi038.stderr: 9: main() 2024-09-22T08:36:04.985 INFO:tasks.workunit.client.0.smithi038.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7ffae1e29590] 2024-09-22T08:36:04.985 INFO:tasks.workunit.client.0.smithi038.stderr: 11: __libc_start_main() 2024-09-22T08:36:04.985 INFO:tasks.workunit.client.0.smithi038.stderr: 12: _start() 2024-09-22T08:36:04.985 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:36:04.985 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:04.985 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-22T08:36:04.985 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-22T08:36:04.985 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-22T08:36:04.985 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-22T08:36:04.985 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-22T08:36:04.985 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-22T08:36:04.986 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-22T08:36:04.986 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-22T08:36:04.986 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-22T08:36:04.986 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-22T08:36:04.986 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-22T08:36:04.986 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-22T08:36:04.986 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-22T08:36:04.986 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-22T08:36:04.986 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-22T08:36:04.986 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-22T08:36:04.986 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-22T08:36:04.986 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-22T08:36:04.986 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-22T08:36:04.987 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-22T08:36:04.987 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-22T08:36:04.987 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-22T08:36:04.987 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-22T08:36:04.987 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-22T08:36:04.987 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:36:04.987 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-22T08:36:04.987 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-22T08:36:04.987 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-22T08:36:04.987 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-22T08:36:04.987 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-22T08:36:04.987 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-22T08:36:04.987 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-22T08:36:04.987 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-22T08:36:04.987 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-22T08:36:04.988 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-22T08:36:04.988 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-22T08:36:04.988 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-22T08:36:04.988 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-22T08:36:04.988 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-22T08:36:04.988 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-22T08:36:04.988 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-22T08:36:04.988 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-22T08:36:04.988 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-22T08:36:04.988 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-22T08:36:04.988 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-22T08:36:04.988 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-22T08:36:04.988 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:36:04.988 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-22T08:36:04.989 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:36:04.989 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-22T08:36:04.989 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-22T08:36:04.989 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-22T08:36:04.989 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-22T08:36:04.989 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-22T08:36:04.989 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-22T08:36:04.989 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-22T08:36:04.989 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-22T08:36:04.989 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-22T08:36:04.989 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-22T08:36:04.989 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-22T08:36:04.989 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-22T08:36:04.990 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-22T08:36:04.990 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-22T08:36:04.990 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-22T08:36:04.990 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-22T08:36:04.990 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-22T08:36:04.990 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-22T08:36:04.990 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:36:04.990 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-22T08:36:04.990 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:36:04.990 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-22T08:36:04.990 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-22T08:36:04.990 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-22T08:36:04.990 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-22T08:36:04.990 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-22T08:36:04.991 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-22T08:36:04.991 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:36:04.991 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-22T08:36:04.991 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-22T08:36:04.991 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:36:04.991 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-22T08:36:04.991 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-22T08:36:04.991 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-22T08:36:04.991 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-22T08:36:04.991 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-22T08:36:04.991 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-22T08:36:04.991 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-22T08:36:04.991 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-22T08:36:04.991 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-22T08:36:04.992 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-22T08:36:04.992 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-22T08:36:04.992 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-22T08:36:04.992 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-22T08:36:04.992 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:36:04.992 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff903fff640 / http_manager 2024-09-22T08:36:04.992 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff9927e4640 / http_manager 2024-09-22T08:36:04.992 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff9937e6640 / rgw_dt_lg_renew 2024-09-22T08:36:04.992 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff9aeffd640 / ms_dispatch 2024-09-22T08:36:04.992 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff9affff640 / io_context_pool 2024-09-22T08:36:04.992 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff9c0ff9640 / io_context_pool 2024-09-22T08:36:04.992 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff9c2ffd640 / ms_dispatch 2024-09-22T08:36:04.992 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff9c9e03640 / ms_dispatch 2024-09-22T08:36:04.992 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff9cb606640 / io_context_pool 2024-09-22T08:36:04.993 INFO:tasks.workunit.client.0.smithi038.stderr: 7ffadcf16640 / msgr-worker-2 2024-09-22T08:36:04.993 INFO:tasks.workunit.client.0.smithi038.stderr: 7ffadd717640 / msgr-worker-1 2024-09-22T08:36:04.993 INFO:tasks.workunit.client.0.smithi038.stderr: 7ffaddf18640 / msgr-worker-0 2024-09-22T08:36:04.993 INFO:tasks.workunit.client.0.smithi038.stderr: 7ffade719640 / io_context_pool 2024-09-22T08:36:04.993 INFO:tasks.workunit.client.0.smithi038.stderr: 7ffadfc2d800 / radosgw-admin 2024-09-22T08:36:04.993 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-22T08:36:04.993 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-22T08:36:04.993 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/log/ceph/ceph-client.admin.126316.log 2024-09-22T08:36:04.993 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-22T08:36:04.993 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-22T08:36:04.993 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-22T08:36:04.650+0000 7ff9cb606640 10 monclient: dump: 2024-09-22T08:36:04.993 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:36:04.993 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:36:04.993 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:04.993 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:04.993 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:36:04.994 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:04.994 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:36:04.994 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:36:04.994 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:36:04.994 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:04.994 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-22T08:36:04.650+0000 7ffadfc2d800 5 monclient: authenticate success, global_id 7431 2024-09-22T08:36:04.994 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-22T08:36:04.650+0000 7ffadfc2d800 10 monclient: get_monmap_and_config success 2024-09-22T08:36:04.994 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-22T08:36:04.650+0000 7ffadfc2d800 4 set_mon_vals no callback set 2024-09-22T08:36:04.994 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 10 monclient: shutdown 2024-09-22T08:36:04.994 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 asok(0x56547a3f60f0) unregister_commands rotate-key 2024-09-22T08:36:04.994 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 10 monclient: build_initial_monmap 2024-09-22T08:36:04.994 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 1 build_initial for_mkfs: 0 2024-09-22T08:36:04.994 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 10 monclient: monmap: 2024-09-22T08:36:04.995 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:36:04.995 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:36:04.995 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:36:04.995 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:36:04.995 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:36:04.995 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:04.995 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:36:04.995 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:36:04.995 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:36:04.995 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:04.995 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a61d580) adding auth protocol: cephx 2024-09-22T08:36:04.995 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a61d580) adding auth protocol: cephx 2024-09-22T08:36:04.995 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a61d580) adding auth protocol: cephx 2024-09-22T08:36:04.995 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a61d580) adding con mode: secure 2024-09-22T08:36:04.996 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a61d580) adding con mode: crc 2024-09-22T08:36:04.996 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a61d580) adding con mode: secure 2024-09-22T08:36:04.996 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a61d580) adding con mode: crc 2024-09-22T08:36:04.996 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a61d580) adding con mode: secure 2024-09-22T08:36:04.996 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a61d580) adding con mode: crc 2024-09-22T08:36:04.996 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a61d580) adding con mode: crc 2024-09-22T08:36:04.996 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a61d580) adding con mode: secure 2024-09-22T08:36:04.996 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a61d580) adding con mode: crc 2024-09-22T08:36:04.996 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a61d580) adding con mode: secure 2024-09-22T08:36:04.996 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a61d580) adding con mode: crc 2024-09-22T08:36:04.996 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a61d580) adding con mode: secure 2024-09-22T08:36:04.996 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:04.996 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 1 librados: starting msgr at 2024-09-22T08:36:04.996 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 1 librados: starting objecter 2024-09-22T08:36:04.997 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 asok(0x56547a3f60f0) register_command objecter_requests hook 0x56547a61cd50 2024-09-22T08:36:04.997 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 1 librados: setting wanted keys 2024-09-22T08:36:04.997 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 1 librados: calling monclient init 2024-09-22T08:36:04.997 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 10 monclient: init 2024-09-22T08:36:04.997 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a617f00) adding auth protocol: cephx 2024-09-22T08:36:04.997 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a617f00) adding auth protocol: cephx 2024-09-22T08:36:04.997 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a617f00) adding auth protocol: cephx 2024-09-22T08:36:04.997 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a617f00) adding con mode: secure 2024-09-22T08:36:04.997 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a617f00) adding con mode: crc 2024-09-22T08:36:04.997 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a617f00) adding con mode: secure 2024-09-22T08:36:04.997 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a617f00) adding con mode: crc 2024-09-22T08:36:04.997 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a617f00) adding con mode: secure 2024-09-22T08:36:04.997 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a617f00) adding con mode: crc 2024-09-22T08:36:04.997 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a617f00) adding con mode: crc 2024-09-22T08:36:04.997 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a617f00) adding con mode: secure 2024-09-22T08:36:04.998 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a617f00) adding con mode: crc 2024-09-22T08:36:04.998 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a617f00) adding con mode: secure 2024-09-22T08:36:04.998 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a617f00) adding con mode: crc 2024-09-22T08:36:04.998 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 5 AuthRegistry(0x56547a617f00) adding con mode: secure 2024-09-22T08:36:04.998 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-22T08:36:04.651+0000 7ffadfc2d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:04.998 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-22T08:36:04.652+0000 7ffadfc2d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:04.998 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-22T08:36:04.652+0000 7ffadfc2d800 5 asok(0x56547a3f60f0) register_command rotate-key hook 0x56547a618048 2024-09-22T08:36:04.998 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-22T08:36:04.652+0000 7ffadfc2d800 10 monclient: _reopen_session rank -1 2024-09-22T08:36:04.998 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-22T08:36:04.652+0000 7ffadfc2d800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T08:36:04.998 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-22T08:36:04.652+0000 7ffadfc2d800 10 monclient(hunting): picked mon.noname-c con 0x56547a490580 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:36:04.998 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-22T08:36:04.652+0000 7ffadfc2d800 10 monclient(hunting): picked mon.noname-a con 0x56547a55a8c0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:36:04.998 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-22T08:36:04.652+0000 7ffadfc2d800 10 monclient(hunting): picked mon.noname-b con 0x56547a642130 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:36:04.998 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-22T08:36:04.652+0000 7ffadfc2d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:04.998 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-22T08:36:04.652+0000 7ffadfc2d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:04.999 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-22T08:36:04.652+0000 7ffadfc2d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:04.999 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-22T08:36:04.652+0000 7ffadfc2d800 10 monclient(hunting): _renew_subs 2024-09-22T08:36:04.999 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-22T08:36:04.652+0000 7ffadfc2d800 10 monclient(hunting): authenticate will time out at 2069.891284s 2024-09-22T08:36:04.999 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-22T08:36:04.652+0000 7ffadcf16640 10 monclient(hunting): get_auth_request con 0x56547a55a8c0 auth_method 0 2024-09-22T08:36:04.999 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-22T08:36:04.652+0000 7ffadcf16640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:04.999 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-22T08:36:04.652+0000 7ffadcf16640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:04.999 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-22T08:36:04.652+0000 7ffadcf16640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:04.999 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-22T08:36:04.652+0000 7ffadd717640 10 monclient(hunting): get_auth_request con 0x56547a490580 auth_method 0 2024-09-22T08:36:04.999 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-22T08:36:04.652+0000 7ffadd717640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:04.999 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-22T08:36:04.652+0000 7ffadd717640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:04.999 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-22T08:36:04.652+0000 7ffadd717640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:04.999 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-22T08:36:04.652+0000 7ffadcf16640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:36:04.999 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-22T08:36:04.652+0000 7ffadcf16640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:36:04.999 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-22T08:36:04.652+0000 7ffadcf16640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:36:05.000 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-22T08:36:04.652+0000 7ffadd717640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:36:05.000 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-22T08:36:04.652+0000 7ffadd717640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:36:05.000 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-22T08:36:04.652+0000 7ffadd717640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:36:05.000 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-22T08:36:04.652+0000 7ffaddf18640 10 monclient(hunting): get_auth_request con 0x56547a642130 auth_method 0 2024-09-22T08:36:05.000 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-22T08:36:04.652+0000 7ffaddf18640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:05.000 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-22T08:36:04.652+0000 7ffaddf18640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:05.000 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-22T08:36:04.652+0000 7ffaddf18640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:05.000 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-22T08:36:04.652+0000 7ffadcf16640 10 monclient(hunting): handle_auth_done global_id 7434 payload 824 2024-09-22T08:36:05.000 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-22T08:36:04.652+0000 7ffadcf16640 10 monclient: _finish_hunting 0 2024-09-22T08:36:05.000 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-22T08:36:04.652+0000 7ffadcf16640 1 monclient: found mon.noname-a 2024-09-22T08:36:05.000 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-22T08:36:04.652+0000 7ffadcf16640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:36:05.000 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-22T08:36:04.652+0000 7ff9c9e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:36:05.001 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-22T08:36:04.652+0000 7ff9c9e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:36:05.001 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-22T08:36:04.652+0000 7ff9c9e03640 10 monclient: dump: 2024-09-22T08:36:05.001 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:36:05.001 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:36:05.001 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:05.001 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:05.001 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:36:05.001 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:05.001 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:36:05.001 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:36:05.001 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:36:05.001 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:05.001 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-22T08:36:04.652+0000 7ff9c9e03640 10 monclient: _finish_auth 0 2024-09-22T08:36:05.001 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-22T08:36:04.652+0000 7ff9c9e03640 10 monclient: _check_auth_tickets 2024-09-22T08:36:05.001 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-22T08:36:04.652+0000 7ff9c9e03640 10 monclient: handle_config config(0 keys) 2024-09-22T08:36:05.002 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-22T08:36:04.653+0000 7ff9c9e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:36:05.002 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-22T08:36:04.653+0000 7ff9c9e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:36:05.002 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-22T08:36:04.653+0000 7ff9c9e03640 10 monclient: dump: 2024-09-22T08:36:05.002 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:36:05.002 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:36:05.002 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:05.002 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:05.002 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:36:05.002 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:05.002 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:36:05.002 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:36:05.002 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:36:05.002 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:05.002 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-22T08:36:04.653+0000 7ffadfc2d800 5 monclient: authenticate success, global_id 7434 2024-09-22T08:36:05.003 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-22T08:36:04.653+0000 7ffadfc2d800 10 monclient: _renew_subs 2024-09-22T08:36:05.003 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-22T08:36:04.653+0000 7ff9cb606640 4 set_mon_vals no callback set 2024-09-22T08:36:05.003 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-22T08:36:04.653+0000 7ffadfc2d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:36:05.003 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-22T08:36:04.653+0000 7ffadfc2d800 10 monclient: _renew_subs 2024-09-22T08:36:05.003 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-22T08:36:04.653+0000 7ffadfc2d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:36:05.003 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-22T08:36:04.653+0000 7ffadfc2d800 1 librados: init done 2024-09-22T08:36:05.003 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-22T08:36:04.655+0000 7ff9c9e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:36:05.003 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-22T08:36:04.655+0000 7ff9c9e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:36:05.003 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-22T08:36:04.655+0000 7ff9c9e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:36:05.003 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-22T08:36:04.655+0000 7ffadd717640 10 monclient: get_auth_request con 0x7ff9c4077570 auth_method 0 2024-09-22T08:36:05.003 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-22T08:36:04.655+0000 7ffaddf18640 10 monclient: get_auth_request con 0x56547a640950 auth_method 0 2024-09-22T08:36:05.003 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-22T08:36:04.656+0000 7ffadd717640 10 monclient: get_auth_request con 0x56547a6634b0 auth_method 0 2024-09-22T08:36:05.003 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-22T08:36:04.657+0000 7ffadcf16640 10 monclient: get_auth_request con 0x56547a667860 auth_method 0 2024-09-22T08:36:05.003 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-22T08:36:04.658+0000 7ffaddf18640 10 monclient: get_auth_request con 0x56547a666d60 auth_method 0 2024-09-22T08:36:05.004 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-22T08:36:04.658+0000 7ffadfc2d800 10 monclient: build_initial_monmap 2024-09-22T08:36:05.004 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-22T08:36:04.658+0000 7ffadfc2d800 1 build_initial for_mkfs: 0 2024-09-22T08:36:05.004 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-22T08:36:04.658+0000 7ffadfc2d800 10 monclient: monmap: 2024-09-22T08:36:05.004 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:36:05.004 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:36:05.004 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:36:05.004 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:36:05.004 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:36:05.004 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:05.004 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:36:05.004 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:36:05.004 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:36:05.004 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:05.004 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-22T08:36:04.658+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66fa40) adding auth protocol: cephx 2024-09-22T08:36:05.005 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-22T08:36:04.658+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66fa40) adding auth protocol: cephx 2024-09-22T08:36:05.005 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-22T08:36:04.658+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66fa40) adding auth protocol: cephx 2024-09-22T08:36:05.005 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-22T08:36:04.658+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66fa40) adding con mode: secure 2024-09-22T08:36:05.005 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-22T08:36:04.658+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66fa40) adding con mode: crc 2024-09-22T08:36:05.005 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-22T08:36:04.658+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66fa40) adding con mode: secure 2024-09-22T08:36:05.005 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-22T08:36:04.658+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66fa40) adding con mode: crc 2024-09-22T08:36:05.005 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-22T08:36:04.658+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66fa40) adding con mode: secure 2024-09-22T08:36:05.005 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-22T08:36:04.658+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66fa40) adding con mode: crc 2024-09-22T08:36:05.005 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-22T08:36:04.658+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66fa40) adding con mode: crc 2024-09-22T08:36:05.005 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-22T08:36:04.658+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66fa40) adding con mode: secure 2024-09-22T08:36:05.005 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-22T08:36:04.658+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66fa40) adding con mode: crc 2024-09-22T08:36:05.005 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-22T08:36:04.658+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66fa40) adding con mode: secure 2024-09-22T08:36:05.005 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-22T08:36:04.658+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66fa40) adding con mode: crc 2024-09-22T08:36:05.005 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-22T08:36:04.658+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66fa40) adding con mode: secure 2024-09-22T08:36:05.006 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:05.006 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 5 asok(0x56547a3f60f0) register_command objecter_requests cmddesc objecter_requests hook 0x56547a672e80 EEXIST 2024-09-22T08:36:05.006 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 10 monclient: init 2024-09-22T08:36:05.006 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66e938) adding auth protocol: cephx 2024-09-22T08:36:05.006 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66e938) adding auth protocol: cephx 2024-09-22T08:36:05.006 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66e938) adding auth protocol: cephx 2024-09-22T08:36:05.006 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66e938) adding con mode: secure 2024-09-22T08:36:05.006 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66e938) adding con mode: crc 2024-09-22T08:36:05.006 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66e938) adding con mode: secure 2024-09-22T08:36:05.006 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66e938) adding con mode: crc 2024-09-22T08:36:05.006 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66e938) adding con mode: secure 2024-09-22T08:36:05.006 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66e938) adding con mode: crc 2024-09-22T08:36:05.007 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66e938) adding con mode: crc 2024-09-22T08:36:05.007 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66e938) adding con mode: secure 2024-09-22T08:36:05.007 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66e938) adding con mode: crc 2024-09-22T08:36:05.007 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66e938) adding con mode: secure 2024-09-22T08:36:05.007 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66e938) adding con mode: crc 2024-09-22T08:36:05.007 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 5 AuthRegistry(0x56547a66e938) adding con mode: secure 2024-09-22T08:36:05.007 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:05.007 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:05.007 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 5 asok(0x56547a3f60f0) register_command rotate-key cmddesc rotate-key hook 0x56547a66ea80 EEXIST 2024-09-22T08:36:05.007 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 10 monclient: _reopen_session rank -1 2024-09-22T08:36:05.007 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T08:36:05.007 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 10 monclient(hunting): picked mon.noname-c con 0x56547a6971a0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:36:05.007 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 10 monclient(hunting): picked mon.noname-a con 0x56547a697580 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:36:05.007 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 10 monclient(hunting): picked mon.noname-b con 0x56547a695eb0 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:36:05.007 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:05.008 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-22T08:36:04.659+0000 7ffadfc2d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:05.008 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-22T08:36:04.660+0000 7ffadfc2d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:05.008 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-22T08:36:04.660+0000 7ffadfc2d800 10 monclient(hunting): _renew_subs 2024-09-22T08:36:05.008 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-22T08:36:04.660+0000 7ffadfc2d800 10 monclient(hunting): authenticate will time out at 2069.899011s 2024-09-22T08:36:05.008 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-22T08:36:04.660+0000 7ffaddf18640 10 monclient(hunting): get_auth_request con 0x56547a697580 auth_method 0 2024-09-22T08:36:05.008 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-22T08:36:04.660+0000 7ffaddf18640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:05.008 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-22T08:36:04.660+0000 7ffaddf18640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:05.008 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-22T08:36:04.660+0000 7ffaddf18640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:05.008 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-22T08:36:04.660+0000 7ffadcf16640 10 monclient(hunting): get_auth_request con 0x56547a6971a0 auth_method 0 2024-09-22T08:36:05.008 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-22T08:36:04.660+0000 7ffadcf16640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:05.008 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-22T08:36:04.660+0000 7ffadcf16640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:05.008 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-22T08:36:04.660+0000 7ffadcf16640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:05.008 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-22T08:36:04.660+0000 7ffaddf18640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:36:05.008 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-22T08:36:04.660+0000 7ffaddf18640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:36:05.009 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-22T08:36:04.660+0000 7ffaddf18640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:36:05.009 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-22T08:36:04.660+0000 7ffadcf16640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:36:05.009 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-22T08:36:04.660+0000 7ffadcf16640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:36:05.009 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-22T08:36:04.660+0000 7ffadcf16640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:36:05.009 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-22T08:36:04.660+0000 7ffadd717640 10 monclient(hunting): get_auth_request con 0x56547a695eb0 auth_method 0 2024-09-22T08:36:05.009 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-22T08:36:04.660+0000 7ffadd717640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:05.009 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-22T08:36:04.660+0000 7ffadd717640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:05.009 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-22T08:36:04.660+0000 7ffadd717640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:05.009 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-22T08:36:04.660+0000 7ffadd717640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:36:05.009 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-22T08:36:04.660+0000 7ffadd717640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:36:05.009 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-22T08:36:04.660+0000 7ffadd717640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:36:05.009 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-22T08:36:04.660+0000 7ffaddf18640 10 monclient(hunting): handle_auth_done global_id 7437 payload 824 2024-09-22T08:36:05.009 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-22T08:36:04.660+0000 7ffaddf18640 10 monclient: _finish_hunting 0 2024-09-22T08:36:05.009 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-22T08:36:04.660+0000 7ffaddf18640 1 monclient: found mon.noname-a 2024-09-22T08:36:05.009 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-22T08:36:04.660+0000 7ffaddf18640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:36:05.010 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-22T08:36:04.660+0000 7ff9c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:36:05.010 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-22T08:36:04.660+0000 7ff9c2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:36:05.010 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-22T08:36:04.660+0000 7ff9c2ffd640 10 monclient: dump: 2024-09-22T08:36:05.010 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:36:05.010 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:36:05.010 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:05.010 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:05.010 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:36:05.010 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:05.010 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:36:05.010 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:36:05.010 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:36:05.010 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:05.011 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-22T08:36:04.660+0000 7ff9c2ffd640 10 monclient: _finish_auth 0 2024-09-22T08:36:05.011 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-22T08:36:04.660+0000 7ff9c2ffd640 10 monclient: _check_auth_tickets 2024-09-22T08:36:05.011 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-22T08:36:04.660+0000 7ff9c2ffd640 10 monclient: handle_config config(0 keys) 2024-09-22T08:36:05.011 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-22T08:36:04.660+0000 7ff9c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:36:05.011 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-22T08:36:04.660+0000 7ff9c2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:36:05.011 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-22T08:36:04.660+0000 7ff9c2ffd640 10 monclient: dump: 2024-09-22T08:36:05.011 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:36:05.011 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:36:05.011 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:05.011 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:05.011 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:36:05.011 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:05.011 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:36:05.012 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:36:05.012 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:36:05.012 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:05.012 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-22T08:36:04.660+0000 7ffadfc2d800 5 monclient: authenticate success, global_id 7437 2024-09-22T08:36:05.012 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-22T08:36:04.660+0000 7ffadfc2d800 10 monclient: _renew_subs 2024-09-22T08:36:05.012 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-22T08:36:04.660+0000 7ffadfc2d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:36:05.012 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-22T08:36:04.660+0000 7ffade719640 4 set_mon_vals no callback set 2024-09-22T08:36:05.012 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-22T08:36:04.660+0000 7ffadfc2d800 10 monclient: _renew_subs 2024-09-22T08:36:05.012 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-22T08:36:04.660+0000 7ffadfc2d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:36:05.012 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-22T08:36:04.662+0000 7ff9c2ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:36:05.012 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-22T08:36:04.662+0000 7ff9c2ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:36:05.012 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-22T08:36:04.662+0000 7ff9c2ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:36:05.012 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 10 monclient: get_monmap_and_config 2024-09-22T08:36:05.012 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 10 monclient: build_initial_monmap 2024-09-22T08:36:05.013 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 1 build_initial for_mkfs: 0 2024-09-22T08:36:05.013 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 10 monclient: monmap: 2024-09-22T08:36:05.013 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:36:05.013 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:36:05.013 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:36:05.013 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:36:05.013 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:36:05.013 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:05.013 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:36:05.013 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:36:05.013 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:36:05.013 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:05.013 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6b7120) adding auth protocol: cephx 2024-09-22T08:36:05.013 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6b7120) adding auth protocol: cephx 2024-09-22T08:36:05.014 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6b7120) adding auth protocol: cephx 2024-09-22T08:36:05.014 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6b7120) adding con mode: secure 2024-09-22T08:36:05.014 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6b7120) adding con mode: crc 2024-09-22T08:36:05.014 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6b7120) adding con mode: secure 2024-09-22T08:36:05.014 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6b7120) adding con mode: crc 2024-09-22T08:36:05.014 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6b7120) adding con mode: secure 2024-09-22T08:36:05.014 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6b7120) adding con mode: crc 2024-09-22T08:36:05.014 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6b7120) adding con mode: crc 2024-09-22T08:36:05.014 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6b7120) adding con mode: secure 2024-09-22T08:36:05.014 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6b7120) adding con mode: crc 2024-09-22T08:36:05.014 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6b7120) adding con mode: secure 2024-09-22T08:36:05.014 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6b7120) adding con mode: crc 2024-09-22T08:36:05.014 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6b7120) adding con mode: secure 2024-09-22T08:36:05.014 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-22T08:36:04.663+0000 7ffadcf16640 10 monclient: get_auth_request con 0x7ff9b8077480 auth_method 0 2024-09-22T08:36:05.015 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:05.015 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 10 monclient: init 2024-09-22T08:36:05.015 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b03d10) adding auth protocol: cephx 2024-09-22T08:36:05.015 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b03d10) adding auth protocol: cephx 2024-09-22T08:36:05.015 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b03d10) adding auth protocol: cephx 2024-09-22T08:36:05.015 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b03d10) adding con mode: secure 2024-09-22T08:36:05.015 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b03d10) adding con mode: crc 2024-09-22T08:36:05.015 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b03d10) adding con mode: secure 2024-09-22T08:36:05.015 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b03d10) adding con mode: crc 2024-09-22T08:36:05.015 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b03d10) adding con mode: secure 2024-09-22T08:36:05.015 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b03d10) adding con mode: crc 2024-09-22T08:36:05.015 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b03d10) adding con mode: crc 2024-09-22T08:36:05.015 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b03d10) adding con mode: secure 2024-09-22T08:36:05.015 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b03d10) adding con mode: crc 2024-09-22T08:36:05.016 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b03d10) adding con mode: secure 2024-09-22T08:36:05.016 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b03d10) adding con mode: crc 2024-09-22T08:36:05.016 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b03d10) adding con mode: secure 2024-09-22T08:36:05.016 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-22T08:36:04.663+0000 7ffadfc2d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:05.016 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-22T08:36:04.664+0000 7ffadfc2d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:05.016 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-22T08:36:04.664+0000 7ffadfc2d800 5 asok(0x56547a3f60f0) register_command rotate-key cmddesc rotate-key hook 0x7fff95b03e58 EEXIST 2024-09-22T08:36:05.016 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-22T08:36:04.664+0000 7ffadfc2d800 10 monclient: _reopen_session rank -1 2024-09-22T08:36:05.016 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-22T08:36:04.664+0000 7ffadfc2d800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T08:36:05.016 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-22T08:36:04.664+0000 7ffadfc2d800 10 monclient(hunting): picked mon.noname-c con 0x56547a6eb700 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:36:05.016 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-22T08:36:04.664+0000 7ffadfc2d800 10 monclient(hunting): picked mon.noname-a con 0x56547a6bc700 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:36:05.016 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-22T08:36:04.664+0000 7ffadfc2d800 10 monclient(hunting): picked mon.noname-b con 0x56547a6e5c80 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:36:05.016 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-22T08:36:04.664+0000 7ffadfc2d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:05.016 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-22T08:36:04.664+0000 7ffadfc2d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:05.016 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-22T08:36:04.664+0000 7ffadfc2d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:05.017 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-22T08:36:04.664+0000 7ffadfc2d800 10 monclient(hunting): _renew_subs 2024-09-22T08:36:05.017 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-22T08:36:04.664+0000 7ffadfc2d800 10 monclient(hunting): authenticate will time out at 2069.903252s 2024-09-22T08:36:05.017 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-22T08:36:04.664+0000 7ffaddf18640 10 monclient(hunting): get_auth_request con 0x56547a6bc700 auth_method 0 2024-09-22T08:36:05.017 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-22T08:36:04.664+0000 7ffaddf18640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:05.017 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-22T08:36:04.664+0000 7ffaddf18640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:05.017 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-22T08:36:04.664+0000 7ffaddf18640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:05.017 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-22T08:36:04.664+0000 7ffadcf16640 10 monclient(hunting): get_auth_request con 0x56547a6eb700 auth_method 0 2024-09-22T08:36:05.017 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-22T08:36:04.664+0000 7ffadcf16640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:05.017 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-22T08:36:04.664+0000 7ffadcf16640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:05.017 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-22T08:36:04.664+0000 7ffadcf16640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:05.017 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-22T08:36:04.664+0000 7ffaddf18640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:36:05.017 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-22T08:36:04.664+0000 7ffaddf18640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:36:05.017 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-22T08:36:04.664+0000 7ffaddf18640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:36:05.017 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-22T08:36:04.664+0000 7ffadcf16640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:36:05.018 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-22T08:36:04.664+0000 7ffadcf16640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:36:05.018 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-22T08:36:04.664+0000 7ffadcf16640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:36:05.018 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-22T08:36:04.664+0000 7ffadd717640 10 monclient(hunting): get_auth_request con 0x56547a6e5c80 auth_method 0 2024-09-22T08:36:05.018 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-22T08:36:04.664+0000 7ffadd717640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:05.018 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-22T08:36:04.664+0000 7ffadd717640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:05.018 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-22T08:36:04.664+0000 7ffadd717640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:05.018 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-22T08:36:04.664+0000 7ffaddf18640 10 monclient(hunting): handle_auth_done global_id 7440 payload 274 2024-09-22T08:36:05.018 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-22T08:36:04.664+0000 7ffaddf18640 10 monclient: _finish_hunting 0 2024-09-22T08:36:05.018 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-22T08:36:04.664+0000 7ffaddf18640 1 monclient: found mon.noname-a 2024-09-22T08:36:05.018 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-22T08:36:04.664+0000 7ffaddf18640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:36:05.018 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-22T08:36:04.665+0000 7ff9c0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:36:05.018 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-22T08:36:04.665+0000 7ff9c0ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:36:05.018 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-22T08:36:04.665+0000 7ff9c0ff9640 10 monclient: dump: 2024-09-22T08:36:05.019 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:36:05.019 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:36:05.019 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:05.019 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:05.019 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:36:05.019 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:05.019 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:36:05.019 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:36:05.019 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:36:05.019 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:05.019 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-22T08:36:04.665+0000 7ff9c0ff9640 10 monclient: _finish_auth 0 2024-09-22T08:36:05.019 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-22T08:36:04.665+0000 7ff9c0ff9640 10 monclient: _check_auth_tickets 2024-09-22T08:36:05.019 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 5 monclient: authenticate success, global_id 7440 2024-09-22T08:36:05.019 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-22T08:36:04.665+0000 7ff9c0ff9640 10 monclient: handle_config config(0 keys) 2024-09-22T08:36:05.020 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 10 monclient: get_monmap_and_config success 2024-09-22T08:36:05.020 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 4 set_mon_vals no callback set 2024-09-22T08:36:05.020 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-22T08:36:04.665+0000 7ff9c0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:36:05.020 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-22T08:36:04.665+0000 7ff9c0ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:36:05.020 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-22T08:36:04.665+0000 7ff9c0ff9640 10 monclient: dump: 2024-09-22T08:36:05.020 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:36:05.020 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:36:05.020 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:05.020 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:05.020 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:36:05.020 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:05.020 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:36:05.020 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:36:05.020 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:36:05.020 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:05.021 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 10 monclient: shutdown 2024-09-22T08:36:05.021 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 10 monclient: build_initial_monmap 2024-09-22T08:36:05.021 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 1 build_initial for_mkfs: 0 2024-09-22T08:36:05.021 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 10 monclient: monmap: 2024-09-22T08:36:05.021 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:36:05.021 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:36:05.021 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:36:05.021 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:36:05.021 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:36:05.021 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:05.021 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:36:05.021 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:36:05.021 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:36:05.021 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:05.021 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6bbe90) adding auth protocol: cephx 2024-09-22T08:36:05.022 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6bbe90) adding auth protocol: cephx 2024-09-22T08:36:05.022 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6bbe90) adding auth protocol: cephx 2024-09-22T08:36:05.022 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6bbe90) adding con mode: secure 2024-09-22T08:36:05.022 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6bbe90) adding con mode: crc 2024-09-22T08:36:05.022 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6bbe90) adding con mode: secure 2024-09-22T08:36:05.022 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6bbe90) adding con mode: crc 2024-09-22T08:36:05.022 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6bbe90) adding con mode: secure 2024-09-22T08:36:05.022 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6bbe90) adding con mode: crc 2024-09-22T08:36:05.022 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6bbe90) adding con mode: crc 2024-09-22T08:36:05.022 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6bbe90) adding con mode: secure 2024-09-22T08:36:05.022 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6bbe90) adding con mode: crc 2024-09-22T08:36:05.022 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6bbe90) adding con mode: secure 2024-09-22T08:36:05.022 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6bbe90) adding con mode: crc 2024-09-22T08:36:05.022 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-22T08:36:04.665+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6bbe90) adding con mode: secure 2024-09-22T08:36:05.023 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:05.023 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 1 librados: starting msgr at 2024-09-22T08:36:05.023 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 1 librados: starting objecter 2024-09-22T08:36:05.023 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 5 asok(0x56547a3f60f0) register_command objecter_requests cmddesc objecter_requests hook 0x56547a697980 EEXIST 2024-09-22T08:36:05.023 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 1 librados: setting wanted keys 2024-09-22T08:36:05.023 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 1 librados: calling monclient init 2024-09-22T08:36:05.023 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 10 monclient: init 2024-09-22T08:36:05.023 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6aba60) adding auth protocol: cephx 2024-09-22T08:36:05.023 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6aba60) adding auth protocol: cephx 2024-09-22T08:36:05.023 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6aba60) adding auth protocol: cephx 2024-09-22T08:36:05.023 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6aba60) adding con mode: secure 2024-09-22T08:36:05.023 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6aba60) adding con mode: crc 2024-09-22T08:36:05.023 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6aba60) adding con mode: secure 2024-09-22T08:36:05.023 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6aba60) adding con mode: crc 2024-09-22T08:36:05.024 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6aba60) adding con mode: secure 2024-09-22T08:36:05.024 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6aba60) adding con mode: crc 2024-09-22T08:36:05.024 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6aba60) adding con mode: crc 2024-09-22T08:36:05.024 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6aba60) adding con mode: secure 2024-09-22T08:36:05.024 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6aba60) adding con mode: crc 2024-09-22T08:36:05.024 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6aba60) adding con mode: secure 2024-09-22T08:36:05.024 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6aba60) adding con mode: crc 2024-09-22T08:36:05.024 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 5 AuthRegistry(0x56547a6aba60) adding con mode: secure 2024-09-22T08:36:05.024 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:05.024 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:05.024 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 5 asok(0x56547a3f60f0) register_command rotate-key cmddesc rotate-key hook 0x56547a6abba8 EEXIST 2024-09-22T08:36:05.024 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 10 monclient: _reopen_session rank -1 2024-09-22T08:36:05.024 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-22T08:36:05.024 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 10 monclient(hunting): picked mon.noname-c con 0x56547a6bc700 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:36:05.024 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 10 monclient(hunting): picked mon.noname-b con 0x56547a6e5c80 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:36:05.025 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 10 monclient(hunting): picked mon.noname-a con 0x56547a6eb700 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:36:05.025 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:05.025 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:05.025 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:05.025 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 10 monclient(hunting): _renew_subs 2024-09-22T08:36:05.025 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-22T08:36:04.666+0000 7ffadfc2d800 10 monclient(hunting): authenticate will time out at 2069.905772s 2024-09-22T08:36:05.025 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-22T08:36:04.666+0000 7ffadcf16640 10 monclient(hunting): get_auth_request con 0x56547a6bc700 auth_method 0 2024-09-22T08:36:05.025 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-22T08:36:04.666+0000 7ffadcf16640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:05.025 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-22T08:36:04.666+0000 7ffadcf16640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:05.025 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-22T08:36:04.666+0000 7ffadcf16640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:05.025 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-22T08:36:04.666+0000 7ffadd717640 10 monclient(hunting): get_auth_request con 0x56547a6eb700 auth_method 0 2024-09-22T08:36:05.025 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-22T08:36:04.666+0000 7ffadd717640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:05.025 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-22T08:36:04.666+0000 7ffadd717640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:05.026 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-22T08:36:04.666+0000 7ffadd717640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:05.026 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-22T08:36:04.666+0000 7ffadcf16640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:36:05.026 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-22T08:36:04.666+0000 7ffadcf16640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:36:05.026 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-22T08:36:04.666+0000 7ffadcf16640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:36:05.026 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-22T08:36:04.666+0000 7ffadd717640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:36:05.026 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-22T08:36:04.666+0000 7ffadd717640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:36:05.026 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-22T08:36:04.666+0000 7ffadd717640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:36:05.026 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-22T08:36:04.667+0000 7ffaddf18640 10 monclient(hunting): get_auth_request con 0x56547a6e5c80 auth_method 0 2024-09-22T08:36:05.026 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-22T08:36:04.667+0000 7ffaddf18640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:05.026 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-22T08:36:04.667+0000 7ffaddf18640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:05.026 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-22T08:36:04.667+0000 7ffaddf18640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:05.026 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-22T08:36:04.667+0000 7ffadcf16640 10 monclient(hunting): handle_auth_done global_id 7010 payload 824 2024-09-22T08:36:05.026 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-22T08:36:04.667+0000 7ffadcf16640 10 monclient: _finish_hunting 0 2024-09-22T08:36:05.026 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-22T08:36:04.667+0000 7ffadcf16640 1 monclient: found mon.noname-c 2024-09-22T08:36:05.027 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-22T08:36:04.667+0000 7ffadcf16640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:36:05.027 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-22T08:36:04.667+0000 7ff9aeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:36:05.027 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-22T08:36:04.667+0000 7ff9aeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:36:05.027 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-22T08:36:04.667+0000 7ff9aeffd640 10 monclient: dump: 2024-09-22T08:36:05.027 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:36:05.027 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:36:05.027 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:05.027 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:05.027 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:36:05.027 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:05.027 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:36:05.027 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:36:05.027 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:36:05.027 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:05.028 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-22T08:36:04.667+0000 7ff9aeffd640 10 monclient: _finish_auth 0 2024-09-22T08:36:05.028 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-22T08:36:04.667+0000 7ff9aeffd640 10 monclient: _check_auth_tickets 2024-09-22T08:36:05.028 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-22T08:36:04.667+0000 7ff9aeffd640 10 monclient: handle_config config(0 keys) 2024-09-22T08:36:05.028 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-22T08:36:04.667+0000 7ff9aeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:36:05.028 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-22T08:36:04.667+0000 7ff9aeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:36:05.028 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-22T08:36:04.667+0000 7ff9aeffd640 10 monclient: dump: 2024-09-22T08:36:05.028 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:36:05.028 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:36:05.028 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:05.028 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:05.028 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:36:05.028 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:05.028 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:36:05.028 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:36:05.029 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:36:05.029 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:05.029 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-22T08:36:04.667+0000 7ffadfc2d800 5 monclient: authenticate success, global_id 7010 2024-09-22T08:36:05.029 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-22T08:36:04.667+0000 7ffadfc2d800 10 monclient: _renew_subs 2024-09-22T08:36:05.029 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-22T08:36:04.667+0000 7ffadfc2d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:36:05.029 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-22T08:36:04.667+0000 7ff9c0ff9640 4 set_mon_vals no callback set 2024-09-22T08:36:05.029 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-22T08:36:04.667+0000 7ffadfc2d800 10 monclient: _renew_subs 2024-09-22T08:36:05.029 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-22T08:36:04.667+0000 7ffadfc2d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:36:05.029 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-22T08:36:04.667+0000 7ffadfc2d800 1 librados: init done 2024-09-22T08:36:05.029 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-22T08:36:04.667+0000 7ffadfc2d800 5 asok(0x56547a3f60f0) register_command cr dump hook 0x56547a6f9578 2024-09-22T08:36:05.029 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-22T08:36:04.669+0000 7ffadfc2d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:05.029 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-22T08:36:04.669+0000 7ff9aeffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:36:05.029 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-22T08:36:04.669+0000 7ff9aeffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:36:05.029 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-22T08:36:04.669+0000 7ff9aeffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:36:05.029 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-22T08:36:04.669+0000 7ffaddf18640 10 monclient: get_auth_request con 0x7ff9a8077570 auth_method 0 2024-09-22T08:36:05.030 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-22T08:36:04.670+0000 7ffadd717640 10 monclient: get_auth_request con 0x56547a7059c0 auth_method 0 2024-09-22T08:36:05.030 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-22T08:36:04.670+0000 7ffadfc2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:05.030 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-22T08:36:04.670+0000 7ffadfc2d800 20 realm 2024-09-22T08:36:05.030 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-22T08:36:04.670+0000 7ffadfc2d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:05.030 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-22T08:36:04.670+0000 7ffadfc2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:05.030 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-22T08:36:04.670+0000 7ffadfc2d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:05.030 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-22T08:36:04.671+0000 7ffadfc2d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:05.030 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-22T08:36:04.671+0000 7ffadfc2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:05.030 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-22T08:36:04.671+0000 7ffadfc2d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:05.030 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-22T08:36:04.671+0000 7ffadcf16640 10 monclient: get_auth_request con 0x56547a709c00 auth_method 0 2024-09-22T08:36:05.030 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-22T08:36:04.671+0000 7ffadfc2d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:05.030 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-22T08:36:04.671+0000 7ffadfc2d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:05.030 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-22T08:36:04.672+0000 7ffaddf18640 10 monclient: get_auth_request con 0x56547a70d480 auth_method 0 2024-09-22T08:36:05.030 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-22T08:36:04.672+0000 7ffadfc2d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:36:05.031 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-22T08:36:04.672+0000 7ffadfc2d800 20 searching for the correct realm 2024-09-22T08:36:05.031 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-22T08:36:04.672+0000 7ffadd717640 10 monclient: get_auth_request con 0x56547a712240 auth_method 0 2024-09-22T08:36:05.031 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-22T08:36:04.674+0000 7ffadcf16640 10 monclient: get_auth_request con 0x7ffad406b020 auth_method 0 2024-09-22T08:36:05.031 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-22T08:36:04.674+0000 7ffadcf16640 0 -- 172.21.15.38:0/2499308591 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7ffad406b020 msgr2=0x7ffad4009e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:05.031 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-22T08:36:04.674+0000 7ff9aeffd640 1 client.7010.objecter ms_handle_reset 0x7ffad406b020 session 0x7ffad40b5040 osd.0 2024-09-22T08:36:05.031 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-22T08:36:04.674+0000 7ff9aeffd640 10 monclient: _renew_subs 2024-09-22T08:36:05.031 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-22T08:36:04.674+0000 7ff9aeffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:36:05.031 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-22T08:36:04.675+0000 7ffadcf16640 10 monclient: get_auth_request con 0x7ff9a8087090 auth_method 0 2024-09-22T08:36:05.031 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-22T08:36:04.675+0000 7ffaddf18640 10 monclient: get_auth_request con 0x7ffad003a040 auth_method 0 2024-09-22T08:36:05.031 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-22T08:36:04.677+0000 7ffadd717640 10 monclient: get_auth_request con 0x7ffad40c2ba0 auth_method 0 2024-09-22T08:36:05.031 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-22T08:36:04.678+0000 7ffadcf16640 10 monclient: get_auth_request con 0x7ffad0027040 auth_method 0 2024-09-22T08:36:05.031 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-22T08:36:04.678+0000 7ffadcf16640 0 -- 172.21.15.38:0/2499308591 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7ffad0027040 msgr2=0x7ffad004a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:36:05.031 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-22T08:36:04.879+0000 7ffadcf16640 10 monclient: get_auth_request con 0x7ffad0027040 auth_method 0 2024-09-22T08:36:05.031 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-22T08:36:04.885+0000 7ffadfc2d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:05.032 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-22T08:36:04.885+0000 7ffadfc2d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:05.032 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-22T08:36:04.885+0000 7ffadfc2d800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:36:05.032 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-22T08:36:04.885+0000 7ffadfc2d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:05.032 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-22T08:36:04.885+0000 7ffadfc2d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:05.032 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-22T08:36:04.885+0000 7ffadfc2d800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:36:05.032 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-22T08:36:04.885+0000 7ffadfc2d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:05.032 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-22T08:36:04.885+0000 7ffadfc2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:05.032 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-22T08:36:04.885+0000 7ffadfc2d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:05.032 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-22T08:36:04.886+0000 7ffadfc2d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:05.032 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-22T08:36:04.886+0000 7ffadfc2d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:05.032 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-22T08:36:04.886+0000 7ffadfc2d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:36:05.032 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-22T08:36:04.886+0000 7ffadfc2d800 20 zone default found 2024-09-22T08:36:05.032 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-22T08:36:04.886+0000 7ffadfc2d800 4 Realm: () 2024-09-22T08:36:05.032 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-22T08:36:04.886+0000 7ffadfc2d800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:36:05.033 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-22T08:36:04.886+0000 7ffadfc2d800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:36:05.033 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-22T08:36:04.886+0000 7ffadfc2d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:05.033 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-22T08:36:04.886+0000 7ffadfc2d800 20 zonegroup default 2024-09-22T08:36:05.033 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-22T08:36:04.886+0000 7ffadfc2d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:05.033 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-22T08:36:04.886+0000 7ffadfc2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:05.033 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-22T08:36:04.886+0000 7ffadfc2d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:05.033 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-22T08:36:04.887+0000 7ffadfc2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:05.033 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-22T08:36:04.887+0000 7ffadfc2d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:05.033 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-22T08:36:04.887+0000 7ffadfc2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:05.033 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-22T08:36:04.887+0000 7ffadfc2d800 20 started sync module instance, tier type = 2024-09-22T08:36:05.033 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-22T08:36:04.887+0000 7ffadfc2d800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:36:05.033 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-22T08:36:04.897+0000 7ffadfc2d800 20 add_watcher() i=0 2024-09-22T08:36:05.033 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-22T08:36:04.897+0000 7ffadfc2d800 20 add_watcher() i=1 2024-09-22T08:36:05.033 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-22T08:36:04.897+0000 7ffadfc2d800 20 add_watcher() i=2 2024-09-22T08:36:05.034 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-22T08:36:04.897+0000 7ffadfc2d800 20 add_watcher() i=3 2024-09-22T08:36:05.034 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-22T08:36:04.897+0000 7ffadfc2d800 20 add_watcher() i=4 2024-09-22T08:36:05.034 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-22T08:36:04.897+0000 7ffadfc2d800 20 add_watcher() i=5 2024-09-22T08:36:05.034 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-22T08:36:04.898+0000 7ffadfc2d800 20 add_watcher() i=6 2024-09-22T08:36:05.034 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-22T08:36:04.899+0000 7ffadfc2d800 20 add_watcher() i=7 2024-09-22T08:36:05.034 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-22T08:36:04.899+0000 7ffadfc2d800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:05.034 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-22T08:36:04.901+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b041e0) adding auth protocol: cephx 2024-09-22T08:36:05.034 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-22T08:36:04.901+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b041e0) adding auth protocol: cephx 2024-09-22T08:36:05.034 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-22T08:36:04.901+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b041e0) adding auth protocol: cephx 2024-09-22T08:36:05.034 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-22T08:36:04.901+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b041e0) adding con mode: secure 2024-09-22T08:36:05.034 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-22T08:36:04.901+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b041e0) adding con mode: crc 2024-09-22T08:36:05.034 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-22T08:36:04.901+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b041e0) adding con mode: secure 2024-09-22T08:36:05.035 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-22T08:36:04.901+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b041e0) adding con mode: crc 2024-09-22T08:36:05.035 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-22T08:36:04.901+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b041e0) adding con mode: secure 2024-09-22T08:36:05.035 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-22T08:36:04.901+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b041e0) adding con mode: crc 2024-09-22T08:36:05.035 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-22T08:36:04.901+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b041e0) adding con mode: crc 2024-09-22T08:36:05.035 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-22T08:36:04.901+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b041e0) adding con mode: secure 2024-09-22T08:36:05.035 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-22T08:36:04.901+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b041e0) adding con mode: crc 2024-09-22T08:36:05.035 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-22T08:36:04.901+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b041e0) adding con mode: secure 2024-09-22T08:36:05.035 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-22T08:36:04.901+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b041e0) adding con mode: crc 2024-09-22T08:36:05.035 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-22T08:36:04.901+0000 7ffadfc2d800 5 AuthRegistry(0x7fff95b041e0) adding con mode: secure 2024-09-22T08:36:05.035 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-22T08:36:04.901+0000 7ff9937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:05.035 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-22T08:36:04.902+0000 7ffadfc2d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:05.035 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-22T08:36:04.902+0000 7ffadfc2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:05.035 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-22T08:36:04.902+0000 7ffadfc2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:05.035 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-22T08:36:04.902+0000 7ffadfc2d800 5 asok(0x56547a3f60f0) register_command cache list hook 0x56547a6f9800 2024-09-22T08:36:05.035 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-22T08:36:04.902+0000 7ffadfc2d800 5 asok(0x56547a3f60f0) register_command cache inspect hook 0x56547a6f9800 2024-09-22T08:36:05.036 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-22T08:36:04.902+0000 7ffadfc2d800 5 asok(0x56547a3f60f0) register_command cache erase hook 0x56547a6f9800 2024-09-22T08:36:05.036 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-22T08:36:04.902+0000 7ffadfc2d800 5 asok(0x56547a3f60f0) register_command cache zap hook 0x56547a6f9800 2024-09-22T08:36:05.036 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-22T08:36:04.902+0000 7ffadfc2d800 5 note: GC not initialized 2024-09-22T08:36:05.036 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-22T08:36:04.902+0000 7ff9927e4640 20 reqs_thread_entry: start 2024-09-22T08:36:05.036 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-22T08:36:04.902+0000 7ffadfc2d800 5 asok(0x56547a3f60f0) register_command sync trace show hook 0x7ffad000e890 2024-09-22T08:36:05.036 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-22T08:36:04.902+0000 7ffadfc2d800 5 asok(0x56547a3f60f0) register_command sync trace history hook 0x7ffad000e890 2024-09-22T08:36:05.036 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-22T08:36:04.902+0000 7ffadfc2d800 5 asok(0x56547a3f60f0) register_command sync trace active hook 0x7ffad000e890 2024-09-22T08:36:05.036 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-22T08:36:04.902+0000 7ffadfc2d800 5 asok(0x56547a3f60f0) register_command sync trace active_short hook 0x7ffad000e890 2024-09-22T08:36:05.036 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-22T08:36:04.902+0000 7ffadfc2d800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:05.036 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-22T08:36:04.902+0000 7ffadfc2d800 20 Filter name: none 2024-09-22T08:36:05.036 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-22T08:36:04.902+0000 7ff903fff640 20 reqs_thread_entry: start 2024-09-22T08:36:05.036 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-22T08:36:04.902+0000 7ffadfc2d800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-22T08:36:05.036 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-22T08:36:04.902+0000 7ffadfc2d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:05.037 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-22T08:36:04.903+0000 7ffadfc2d800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T08:36:05.037 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-22T08:36:04.903+0000 7ffadfc2d800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-22T08:36:05.037 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-22T08:36:04.903+0000 7ffadfc2d800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-22T08:36:05.037 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-22T08:36:04.903+0000 7ffadfc2d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 : miss 2024-09-22T08:36:05.037 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-22T08:36:04.903+0000 7ffadfc2d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:05.037 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-22T08:36:04.903+0000 7ffadfc2d800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T08:36:05.037 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-22T08:36:04.903+0000 7ffadfc2d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 info.flags=0x17 2024-09-22T08:36:05.037 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-22T08:36:04.903+0000 7ffadfc2d800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 to cache LRU end 2024-09-22T08:36:05.037 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-22T08:36:04.903+0000 7ffadfc2d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:05.037 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-22T08:36:04.903+0000 7ffadfc2d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:05.037 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-22T08:36:04.903+0000 7ffadfc2d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 2024-09-22T08:36:05.037 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-22T08:36:04.909+0000 7ffadfc2d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 info.flags=0x17 2024-09-22T08:36:05.037 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-22T08:36:04.909+0000 7ffadfc2d800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 to cache LRU end 2024-09-22T08:36:05.038 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-22T08:36:04.909+0000 7ffadfc2d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:05.038 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-22T08:36:04.909+0000 7ffadfc2d800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34, ofs0, ns] 2024-09-22T08:36:05.038 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-22T08:36:04.909+0000 7ff9affff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497025 cookie 94920831510944 notifier 7010 bl.length()=911 2024-09-22T08:36:05.038 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-22T08:36:04.909+0000 7ff9affff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 info.flags=0x17 2024-09-22T08:36:05.038 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-22T08:36:04.909+0000 7ff9affff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 to cache LRU end 2024-09-22T08:36:05.038 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-22T08:36:04.909+0000 7ff9affff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:05.038 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-22T08:36:04.909+0000 7ffadfc2d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.34]): orig_sources= new_sources= 2024-09-22T08:36:05.038 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-22T08:36:04.909+0000 7ffadfc2d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.34]): potential sources added=[] removed=[] 2024-09-22T08:36:05.038 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-22T08:36:04.909+0000 7ffadfc2d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.34]): orig_dests= new_dests= 2024-09-22T08:36:05.038 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-22T08:36:04.909+0000 7ffadfc2d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.34]): potential dests added=[] removed=[] 2024-09-22T08:36:05.038 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-22T08:36:04.916+0000 7ffadfc2d800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ffadfc2d800 time 2024-09-22T08:36:04.916726+0000 2024-09-22T08:36:05.038 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:36:05.038 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:05.039 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:36:05.039 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ffae318c748] 2024-09-22T08:36:05.039 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7ffae318c906] 2024-09-22T08:36:05.039 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x565479621e01] 2024-09-22T08:36:05.039 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x565479631d0a] 2024-09-22T08:36:05.039 INFO:tasks.workunit.client.0.smithi038.stderr: 5: main() 2024-09-22T08:36:05.039 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7ffae1e29590] 2024-09-22T08:36:05.039 INFO:tasks.workunit.client.0.smithi038.stderr: 7: __libc_start_main() 2024-09-22T08:36:05.039 INFO:tasks.workunit.client.0.smithi038.stderr: 8: _start() 2024-09-22T08:36:05.039 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:05.039 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-22T08:36:04.917+0000 7ffadfc2d800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:36:05.039 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7ffadfc2d800 thread_name:radosgw-admin 2024-09-22T08:36:05.039 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:05.039 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:36:05.040 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ffae1e3e6f0] 2024-09-22T08:36:05.040 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ffae1e8b99c] 2024-09-22T08:36:05.040 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:36:05.040 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:36:05.040 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ffae318c7a2] 2024-09-22T08:36:05.040 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7ffae318c906] 2024-09-22T08:36:05.040 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x565479621e01] 2024-09-22T08:36:05.040 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x565479631d0a] 2024-09-22T08:36:05.040 INFO:tasks.workunit.client.0.smithi038.stderr: 9: main() 2024-09-22T08:36:05.040 INFO:tasks.workunit.client.0.smithi038.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7ffae1e29590] 2024-09-22T08:36:05.040 INFO:tasks.workunit.client.0.smithi038.stderr: 11: __libc_start_main() 2024-09-22T08:36:05.040 INFO:tasks.workunit.client.0.smithi038.stderr: 12: _start() 2024-09-22T08:36:05.040 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:36:05.041 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:05.041 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-22T08:36:05.041 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-22T08:36:05.041 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-22T08:36:05.041 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-22T08:36:05.041 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-22T08:36:05.041 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-22T08:36:05.041 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-22T08:36:05.041 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-22T08:36:05.041 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-22T08:36:05.041 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-22T08:36:05.041 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-22T08:36:05.041 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-22T08:36:05.041 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-22T08:36:05.041 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-22T08:36:05.042 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-22T08:36:05.042 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-22T08:36:05.042 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-22T08:36:05.042 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-22T08:36:05.042 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-22T08:36:05.042 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-22T08:36:05.042 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-22T08:36:05.042 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-22T08:36:05.042 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-22T08:36:05.042 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-22T08:36:05.042 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:36:05.042 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-22T08:36:05.042 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-22T08:36:05.043 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-22T08:36:05.043 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-22T08:36:05.043 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-22T08:36:05.043 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-22T08:36:05.043 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-22T08:36:05.043 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-22T08:36:05.043 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-22T08:36:05.043 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-22T08:36:05.043 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-22T08:36:05.043 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-22T08:36:05.043 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-22T08:36:05.043 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-22T08:36:05.043 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-22T08:36:05.043 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-22T08:36:05.043 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-22T08:36:05.044 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-22T08:36:05.044 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-22T08:36:05.044 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-22T08:36:05.044 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-22T08:36:05.044 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:36:05.044 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-22T08:36:05.044 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:36:05.044 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-22T08:36:05.044 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-22T08:36:05.044 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-22T08:36:05.044 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-22T08:36:05.044 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-22T08:36:05.044 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-22T08:36:05.044 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-22T08:36:05.044 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-22T08:36:05.045 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-22T08:36:05.045 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-22T08:36:05.045 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-22T08:36:05.045 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-22T08:36:05.045 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-22T08:36:05.045 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-22T08:36:05.045 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-22T08:36:05.045 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-22T08:36:05.045 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-22T08:36:05.045 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-22T08:36:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:36:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-22T08:36:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:36:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-22T08:36:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-22T08:36:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-22T08:36:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-22T08:36:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-22T08:36:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-22T08:36:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:36:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-22T08:36:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-22T08:36:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:36:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-22T08:36:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-22T08:36:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-22T08:36:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-22T08:36:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-22T08:36:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-22T08:36:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-22T08:36:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-22T08:36:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-22T08:36:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-22T08:36:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-22T08:36:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-22T08:36:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-22T08:36:05.047 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:36:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff903fff640 / http_manager 2024-09-22T08:36:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff9927e4640 / http_manager 2024-09-22T08:36:05.048 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff9937e6640 / rgw_dt_lg_renew 2024-09-22T08:36:05.048 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff9aeffd640 / ms_dispatch 2024-09-22T08:36:05.048 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff9affff640 / io_context_pool 2024-09-22T08:36:05.048 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff9c0ff9640 / io_context_pool 2024-09-22T08:36:05.048 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff9c2ffd640 / ms_dispatch 2024-09-22T08:36:05.048 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff9c9e03640 / ms_dispatch 2024-09-22T08:36:05.048 INFO:tasks.workunit.client.0.smithi038.stderr: 7ff9cb606640 / io_context_pool 2024-09-22T08:36:05.048 INFO:tasks.workunit.client.0.smithi038.stderr: 7ffadcf16640 / msgr-worker-2 2024-09-22T08:36:05.048 INFO:tasks.workunit.client.0.smithi038.stderr: 7ffadd717640 / msgr-worker-1 2024-09-22T08:36:05.048 INFO:tasks.workunit.client.0.smithi038.stderr: 7ffaddf18640 / msgr-worker-0 2024-09-22T08:36:05.048 INFO:tasks.workunit.client.0.smithi038.stderr: 7ffade719640 / io_context_pool 2024-09-22T08:36:05.048 INFO:tasks.workunit.client.0.smithi038.stderr: 7ffadfc2d800 / radosgw-admin 2024-09-22T08:36:05.048 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-22T08:36:05.048 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-22T08:36:05.049 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/lib/ceph/crash/2024-09-22T08:36:04.918145Z_e917cb40-260d-445a-a89d-ecc0f84d4e52/log 2024-09-22T08:36:05.049 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-22T08:36:05.049 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-22T08:36:05.049 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:05.049 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:05.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.199+0000 7fa84ad46800 20 rados->read ofs=0 len=0 2024-09-22T08:36:05.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.201+0000 7fa84ad46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:05.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.201+0000 7fa84ad46800 20 realm 2024-09-22T08:36:05.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.201+0000 7fa84ad46800 20 rados->read ofs=0 len=0 2024-09-22T08:36:05.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.201+0000 7fa84ad46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:05.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.201+0000 7fa84ad46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:05.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.201+0000 7fa84ad46800 20 rados->read ofs=0 len=0 2024-09-22T08:36:05.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.202+0000 7fa84ad46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:05.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.202+0000 7fa84ad46800 20 rados->read ofs=0 len=0 2024-09-22T08:36:05.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.202+0000 7fa84ad46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:05.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.202+0000 7fa84ad46800 20 rados->read ofs=0 len=0 2024-09-22T08:36:05.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.203+0000 7fa84ad46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:36:05.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.203+0000 7fa84ad46800 20 searching for the correct realm 2024-09-22T08:36:05.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.205+0000 7fa848036640 0 -- 172.21.15.38:0/3477448513 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7fa83c041020 msgr2=0x7fa83c06cf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:36:05.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.411+0000 7fa848036640 0 -- 172.21.15.38:0/3477448513 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fa838045e70 msgr2=0x7fa838045840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:05.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.619+0000 7fa84ad46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:05.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.619+0000 7fa84ad46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:05.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.619+0000 7fa84ad46800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:36:05.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.619+0000 7fa84ad46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:05.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.619+0000 7fa84ad46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:05.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.619+0000 7fa84ad46800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:36:05.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.619+0000 7fa84ad46800 20 rados->read ofs=0 len=0 2024-09-22T08:36:05.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.619+0000 7fa84ad46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:05.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.619+0000 7fa84ad46800 20 rados->read ofs=0 len=0 2024-09-22T08:36:05.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.620+0000 7fa84ad46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:05.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.620+0000 7fa84ad46800 20 rados->read ofs=0 len=0 2024-09-22T08:36:05.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.620+0000 7fa84ad46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:36:05.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.620+0000 7fa84ad46800 20 zone default found 2024-09-22T08:36:05.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.620+0000 7fa84ad46800 4 Realm: () 2024-09-22T08:36:05.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.620+0000 7fa84ad46800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:36:05.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.620+0000 7fa84ad46800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:36:05.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.620+0000 7fa84ad46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:05.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.620+0000 7fa84ad46800 20 zonegroup default 2024-09-22T08:36:05.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.620+0000 7fa84ad46800 20 rados->read ofs=0 len=0 2024-09-22T08:36:05.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.621+0000 7fa84ad46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:05.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.621+0000 7fa84ad46800 20 rados->read ofs=0 len=0 2024-09-22T08:36:05.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.621+0000 7fa84ad46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:05.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.621+0000 7fa84ad46800 20 rados->read ofs=0 len=0 2024-09-22T08:36:05.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.622+0000 7fa84ad46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:05.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.622+0000 7fa84ad46800 20 started sync module instance, tier type = 2024-09-22T08:36:05.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.622+0000 7fa84ad46800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:36:05.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.633+0000 7fa84ad46800 20 add_watcher() i=0 2024-09-22T08:36:05.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.633+0000 7fa84ad46800 20 add_watcher() i=1 2024-09-22T08:36:05.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.633+0000 7fa84ad46800 20 add_watcher() i=2 2024-09-22T08:36:05.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.633+0000 7fa84ad46800 20 add_watcher() i=3 2024-09-22T08:36:05.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.633+0000 7fa84ad46800 20 add_watcher() i=4 2024-09-22T08:36:05.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.633+0000 7fa84ad46800 20 add_watcher() i=5 2024-09-22T08:36:05.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.633+0000 7fa84ad46800 20 add_watcher() i=6 2024-09-22T08:36:05.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.634+0000 7fa84ad46800 20 add_watcher() i=7 2024-09-22T08:36:05.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.634+0000 7fa84ad46800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:05.637 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.636+0000 7fa6ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:05.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.636+0000 7fa84ad46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:05.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.636+0000 7fa84ad46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:05.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.636+0000 7fa84ad46800 5 note: GC not initialized 2024-09-22T08:36:05.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.637+0000 7fa6fe7e4640 20 reqs_thread_entry: start 2024-09-22T08:36:05.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.637+0000 7fa84ad46800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:05.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.637+0000 7fa84ad46800 20 Filter name: none 2024-09-22T08:36:05.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.637+0000 7fa6f77fe640 20 reqs_thread_entry: start 2024-09-22T08:36:05.639 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.637+0000 7fa84ad46800 20 rados->read ofs=0 len=0 2024-09-22T08:36:05.639 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.637+0000 7fa84ad46800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T08:36:05.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.637+0000 7fa84ad46800 20 rados->read ofs=0 len=0 2024-09-22T08:36:05.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.638+0000 7fa84ad46800 20 rados_obj.operate() r=0 bl.length=441 2024-09-22T08:36:05.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.638+0000 7fa84ad46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:36:05.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.638+0000 7fa84ad46800 20 rados->read ofs=0 len=0 2024-09-22T08:36:05.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.639+0000 7fa84ad46800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T08:36:05.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.639+0000 7fa84ad46800 20 rados->read ofs=0 len=0 2024-09-22T08:36:05.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.639+0000 7fa84ad46800 20 rados_obj.operate() r=0 bl.length=441 2024-09-22T08:36:05.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.639+0000 7fa84ad46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:36:05.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.641+0000 7fa6ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:05.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.644+0000 7fa84ad46800 20 remove_watcher() i=0 2024-09-22T08:36:05.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.644+0000 7fa84ad46800 2 removed watcher, disabling cache 2024-09-22T08:36:05.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.645+0000 7fa84ad46800 20 remove_watcher() i=1 2024-09-22T08:36:05.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.646+0000 7fa84ad46800 20 remove_watcher() i=2 2024-09-22T08:36:05.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.647+0000 7fa84ad46800 20 remove_watcher() i=3 2024-09-22T08:36:05.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.648+0000 7fa84ad46800 20 remove_watcher() i=4 2024-09-22T08:36:05.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.649+0000 7fa84ad46800 20 remove_watcher() i=5 2024-09-22T08:36:05.651 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.651+0000 7fa84ad46800 20 remove_watcher() i=6 2024-09-22T08:36:05.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.652+0000 7fa84ad46800 20 remove_watcher() i=7 2024-09-22T08:36:05.665 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:05.665 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:36:05.665 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-do-reshard id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:36:05.665 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:05.667 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:05.667 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:05.674 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:05.674 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:05.718 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:36:05.755 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:05.755 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:05.796 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.795+0000 7f3886736800 20 rados->read ofs=0 len=0 2024-09-22T08:36:05.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.797+0000 7f3886736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:05.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.797+0000 7f3886736800 20 realm 2024-09-22T08:36:05.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.797+0000 7f3886736800 20 rados->read ofs=0 len=0 2024-09-22T08:36:05.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.797+0000 7f3886736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:05.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.797+0000 7f3886736800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:05.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.797+0000 7f3886736800 20 rados->read ofs=0 len=0 2024-09-22T08:36:05.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.797+0000 7f3886736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:05.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.797+0000 7f3886736800 20 rados->read ofs=0 len=0 2024-09-22T08:36:05.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.798+0000 7f3886736800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:05.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.798+0000 7f3886736800 20 rados->read ofs=0 len=0 2024-09-22T08:36:05.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.799+0000 7f3886736800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:36:05.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.799+0000 7f3886736800 20 searching for the correct realm 2024-09-22T08:36:05.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.802+0000 7f3881cb6640 0 -- 172.21.15.38:0/1901529478 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f387806a040 msgr2=0x7f3878097400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:05.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:05.806+0000 7f3881cb6640 0 -- 172.21.15.38:0/1901529478 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f387403f920 msgr2=0x7f387401f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:06.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.013+0000 7f3886736800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:06.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.013+0000 7f3886736800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:06.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.013+0000 7f3886736800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:36:06.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.013+0000 7f3886736800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:06.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.013+0000 7f3886736800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:06.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.013+0000 7f3886736800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:36:06.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.013+0000 7f3886736800 20 rados->read ofs=0 len=0 2024-09-22T08:36:06.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.014+0000 7f3886736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:06.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.014+0000 7f3886736800 20 rados->read ofs=0 len=0 2024-09-22T08:36:06.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.014+0000 7f3886736800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:06.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.014+0000 7f3886736800 20 rados->read ofs=0 len=0 2024-09-22T08:36:06.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.015+0000 7f3886736800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:36:06.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.015+0000 7f3886736800 20 zone default found 2024-09-22T08:36:06.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.015+0000 7f3886736800 4 Realm: () 2024-09-22T08:36:06.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.015+0000 7f3886736800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:36:06.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.015+0000 7f3886736800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:36:06.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.015+0000 7f3886736800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:06.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.015+0000 7f3886736800 20 zonegroup default 2024-09-22T08:36:06.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.015+0000 7f3886736800 20 rados->read ofs=0 len=0 2024-09-22T08:36:06.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.015+0000 7f3886736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:06.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.015+0000 7f3886736800 20 rados->read ofs=0 len=0 2024-09-22T08:36:06.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.015+0000 7f3886736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:06.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.015+0000 7f3886736800 20 rados->read ofs=0 len=0 2024-09-22T08:36:06.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.016+0000 7f3886736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:06.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.016+0000 7f3886736800 20 started sync module instance, tier type = 2024-09-22T08:36:06.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.016+0000 7f3886736800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:36:06.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.028+0000 7f3886736800 20 add_watcher() i=0 2024-09-22T08:36:06.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.028+0000 7f3886736800 20 add_watcher() i=1 2024-09-22T08:36:06.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.028+0000 7f3886736800 20 add_watcher() i=2 2024-09-22T08:36:06.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.028+0000 7f3886736800 20 add_watcher() i=3 2024-09-22T08:36:06.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.028+0000 7f3886736800 20 add_watcher() i=4 2024-09-22T08:36:06.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.028+0000 7f3886736800 20 add_watcher() i=5 2024-09-22T08:36:06.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.028+0000 7f3886736800 20 add_watcher() i=6 2024-09-22T08:36:06.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.030+0000 7f3886736800 20 add_watcher() i=7 2024-09-22T08:36:06.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.030+0000 7f3886736800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:06.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.031+0000 7f37397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:06.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.032+0000 7f3886736800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:06.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.032+0000 7f3886736800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:06.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.032+0000 7f3886736800 5 note: GC not initialized 2024-09-22T08:36:06.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.032+0000 7f37337fe640 20 reqs_thread_entry: start 2024-09-22T08:36:06.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.032+0000 7f3886736800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:06.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.032+0000 7f3886736800 20 Filter name: none 2024-09-22T08:36:06.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.032+0000 7f37317fa640 20 reqs_thread_entry: start 2024-09-22T08:36:06.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.033+0000 7f3886736800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-22T08:36:06.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.033+0000 7f3886736800 20 rados->read ofs=0 len=0 2024-09-22T08:36:06.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.033+0000 7f3886736800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T08:36:06.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.033+0000 7f3886736800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-22T08:36:06.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.033+0000 7f3886736800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-22T08:36:06.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.033+0000 7f3886736800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 : miss 2024-09-22T08:36:06.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.033+0000 7f3886736800 20 rados->read ofs=0 len=0 2024-09-22T08:36:06.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.033+0000 7f3886736800 20 rados_obj.operate() r=0 bl.length=441 2024-09-22T08:36:06.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.033+0000 7f3886736800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 info.flags=0x17 2024-09-22T08:36:06.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.033+0000 7f3886736800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 to cache LRU end 2024-09-22T08:36:06.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.033+0000 7f3886736800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:06.036 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.033+0000 7f3886736800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:06.036 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.033+0000 7f3886736800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 2024-09-22T08:36:06.036 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.035+0000 7f3886736800 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 to be held by another RGW process; skipping for now 2024-09-22T08:36:06.036 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.036+0000 7f37397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:06.039 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.038+0000 7f3886736800 20 remove_watcher() i=0 2024-09-22T08:36:06.039 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.038+0000 7f3886736800 2 removed watcher, disabling cache 2024-09-22T08:36:06.040 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.039+0000 7f3886736800 20 remove_watcher() i=1 2024-09-22T08:36:06.041 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.040+0000 7f3886736800 20 remove_watcher() i=2 2024-09-22T08:36:06.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.042+0000 7f3886736800 20 remove_watcher() i=3 2024-09-22T08:36:06.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.043+0000 7f3886736800 20 remove_watcher() i=4 2024-09-22T08:36:06.045 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.044+0000 7f3886736800 20 remove_watcher() i=5 2024-09-22T08:36:06.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.046+0000 7f3886736800 20 remove_watcher() i=6 2024-09-22T08:36:06.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:06.047+0000 7f3886736800 20 remove_watcher() i=7 2024-09-22T08:36:06.059 INFO:tasks.workunit.client.0.smithi038.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-22T08:36:36.091 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:36:36.128 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:36.128 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:36.173 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.172+0000 7f3c68939800 20 rados->read ofs=0 len=0 2024-09-22T08:36:36.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.174+0000 7f3c68939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:36.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.174+0000 7f3c68939800 20 realm 2024-09-22T08:36:36.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.174+0000 7f3c68939800 20 rados->read ofs=0 len=0 2024-09-22T08:36:36.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.175+0000 7f3c68939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:36.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.175+0000 7f3c68939800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:36.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.175+0000 7f3c68939800 20 rados->read ofs=0 len=0 2024-09-22T08:36:36.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.175+0000 7f3c68939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:36.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.175+0000 7f3c68939800 20 rados->read ofs=0 len=0 2024-09-22T08:36:36.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.176+0000 7f3c68939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:36.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.176+0000 7f3c68939800 20 rados->read ofs=0 len=0 2024-09-22T08:36:36.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.176+0000 7f3c68939800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:36:36.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.176+0000 7f3c68939800 20 searching for the correct realm 2024-09-22T08:36:36.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.179+0000 7f3c63dc6640 0 -- 172.21.15.38:0/2917524439 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f3c5809a050 msgr2=0x7f3c58060000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:36.387 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.385+0000 7f3c63dc6640 0 -- 172.21.15.38:0/2917524439 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f3c54031c00 msgr2=0x7f3c5402f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:36:36.595 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.594+0000 7f3c68939800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:36.595 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.594+0000 7f3c68939800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:36.596 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.594+0000 7f3c68939800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:36:36.596 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.594+0000 7f3c68939800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:36.596 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.594+0000 7f3c68939800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:36.596 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.594+0000 7f3c68939800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:36:36.596 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.594+0000 7f3c68939800 20 rados->read ofs=0 len=0 2024-09-22T08:36:36.596 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.594+0000 7f3c68939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:36.596 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.594+0000 7f3c68939800 20 rados->read ofs=0 len=0 2024-09-22T08:36:36.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.595+0000 7f3c68939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:36.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.595+0000 7f3c68939800 20 rados->read ofs=0 len=0 2024-09-22T08:36:36.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.595+0000 7f3c68939800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:36:36.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.595+0000 7f3c68939800 20 zone default found 2024-09-22T08:36:36.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.595+0000 7f3c68939800 4 Realm: () 2024-09-22T08:36:36.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.595+0000 7f3c68939800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:36:36.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.595+0000 7f3c68939800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:36:36.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.595+0000 7f3c68939800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:36.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.595+0000 7f3c68939800 20 zonegroup default 2024-09-22T08:36:36.598 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.595+0000 7f3c68939800 20 rados->read ofs=0 len=0 2024-09-22T08:36:36.598 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.596+0000 7f3c68939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:36.598 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.596+0000 7f3c68939800 20 rados->read ofs=0 len=0 2024-09-22T08:36:36.598 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.596+0000 7f3c68939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:36.598 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.596+0000 7f3c68939800 20 rados->read ofs=0 len=0 2024-09-22T08:36:36.598 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.596+0000 7f3c68939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:36.598 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.596+0000 7f3c68939800 20 started sync module instance, tier type = 2024-09-22T08:36:36.598 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.596+0000 7f3c68939800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:36:36.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.607+0000 7f3c68939800 20 add_watcher() i=0 2024-09-22T08:36:36.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.607+0000 7f3c68939800 20 add_watcher() i=1 2024-09-22T08:36:36.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.607+0000 7f3c68939800 20 add_watcher() i=2 2024-09-22T08:36:36.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.607+0000 7f3c68939800 20 add_watcher() i=3 2024-09-22T08:36:36.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.607+0000 7f3c68939800 20 add_watcher() i=4 2024-09-22T08:36:36.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.607+0000 7f3c68939800 20 add_watcher() i=5 2024-09-22T08:36:36.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.607+0000 7f3c68939800 20 add_watcher() i=6 2024-09-22T08:36:36.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.609+0000 7f3c68939800 20 add_watcher() i=7 2024-09-22T08:36:36.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.609+0000 7f3c68939800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:36.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.611+0000 7f3b1afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:36.613 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.612+0000 7f3c68939800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:36.613 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.612+0000 7f3c68939800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:36.613 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.612+0000 7f3c68939800 5 note: GC not initialized 2024-09-22T08:36:36.613 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.612+0000 7f3b19fdb640 20 reqs_thread_entry: start 2024-09-22T08:36:36.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.612+0000 7f3c68939800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:36.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.612+0000 7f3c68939800 20 Filter name: none 2024-09-22T08:36:36.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.612+0000 7f3a8b7fe640 20 reqs_thread_entry: start 2024-09-22T08:36:36.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.612+0000 7f3c68939800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-22T08:36:36.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.612+0000 7f3c68939800 20 rados->read ofs=0 len=0 2024-09-22T08:36:36.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.613+0000 7f3c68939800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T08:36:36.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.613+0000 7f3c68939800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-22T08:36:36.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.613+0000 7f3c68939800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-22T08:36:36.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.613+0000 7f3c68939800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 : miss 2024-09-22T08:36:36.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.613+0000 7f3c68939800 20 rados->read ofs=0 len=0 2024-09-22T08:36:36.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.614+0000 7f3c68939800 20 rados_obj.operate() r=0 bl.length=441 2024-09-22T08:36:36.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.614+0000 7f3c68939800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 info.flags=0x17 2024-09-22T08:36:36.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.614+0000 7f3c68939800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 to cache LRU end 2024-09-22T08:36:36.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.614+0000 7f3c68939800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:36.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.614+0000 7f3c68939800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:36.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.614+0000 7f3c68939800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 2024-09-22T08:36:36.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.615+0000 7f3c68939800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-22T08:36:36.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.624+0000 7f3c68939800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 info.flags=0x17 2024-09-22T08:36:36.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.624+0000 7f3c68939800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 to cache LRU end 2024-09-22T08:36:36.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.624+0000 7f3c68939800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:36.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.624+0000 7f3c68939800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34, ofs0, ns] 2024-09-22T08:36:36.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.624+0000 7f3b3b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497026 cookie 94064159754672 notifier 7503 bl.length()=911 2024-09-22T08:36:36.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.624+0000 7f3b3b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 info.flags=0x17 2024-09-22T08:36:36.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.624+0000 7f3b3b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 to cache LRU end 2024-09-22T08:36:36.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.624+0000 7f3b3b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:36.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.624+0000 7f3c68939800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.34]): orig_sources= new_sources= 2024-09-22T08:36:36.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.624+0000 7f3c68939800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.34]): potential sources added=[] removed=[] 2024-09-22T08:36:36.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.624+0000 7f3c68939800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.34]): orig_dests= new_dests= 2024-09-22T08:36:36.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.624+0000 7f3c68939800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.34]): potential dests added=[] removed=[] 2024-09-22T08:36:36.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.631+0000 7f3c68939800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.2.0 2024-09-22T08:36:36.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.631+0000 7f3c68939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.2.0 2024-09-22T08:36:36.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.631+0000 7f3c68939800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.2.1 2024-09-22T08:36:36.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.631+0000 7f3c68939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.2.1 2024-09-22T08:36:36.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.631+0000 7f3c68939800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.2.2 2024-09-22T08:36:36.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.631+0000 7f3c68939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.2.2 2024-09-22T08:36:36.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.631+0000 7f3c68939800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.2.3 2024-09-22T08:36:36.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.631+0000 7f3c68939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.2.3 2024-09-22T08:36:36.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.631+0000 7f3c68939800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.2.4 2024-09-22T08:36:36.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.631+0000 7f3c68939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.2.4 2024-09-22T08:36:36.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.631+0000 7f3c68939800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.2.5 2024-09-22T08:36:36.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.631+0000 7f3c68939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.2.5 2024-09-22T08:36:36.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.631+0000 7f3c68939800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.2.6 2024-09-22T08:36:36.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.631+0000 7f3c68939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.2.6 2024-09-22T08:36:36.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.631+0000 7f3c68939800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.2.7 2024-09-22T08:36:36.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.631+0000 7f3c68939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.2.7 2024-09-22T08:36:36.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.631+0000 7f3c68939800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.2.8 2024-09-22T08:36:36.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.631+0000 7f3c68939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.2.8 2024-09-22T08:36:36.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.631+0000 7f3c68939800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.2.9 2024-09-22T08:36:36.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.631+0000 7f3c68939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.2.9 2024-09-22T08:36:36.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.631+0000 7f3c68939800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.2.10 2024-09-22T08:36:36.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.631+0000 7f3c68939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.2.10 2024-09-22T08:36:36.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.631+0000 7f3c68939800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.2.11 2024-09-22T08:36:36.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.631+0000 7f3c68939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.2.11 2024-09-22T08:36:36.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.631+0000 7f3c68939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.0 2024-09-22T08:36:36.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.632+0000 7f3c68939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.1 2024-09-22T08:36:36.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.632+0000 7f3c68939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.2 2024-09-22T08:36:36.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.633+0000 7f3c68939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.3 2024-09-22T08:36:36.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.633+0000 7f3c68939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.4 2024-09-22T08:36:36.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.634+0000 7f3c68939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.5 2024-09-22T08:36:36.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.634+0000 7f3c68939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.6 2024-09-22T08:36:36.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.635+0000 7f3c68939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.7 2024-09-22T08:36:36.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.636+0000 7f3c68939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.8 2024-09-22T08:36:36.637 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.636+0000 7f3c68939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.9 2024-09-22T08:36:36.637 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.637+0000 7f3c68939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.10 2024-09-22T08:36:36.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.641+0000 7f3c68939800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 : hit (requested=0x17, cached=0x17) 2024-09-22T08:36:36.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.641+0000 7f3c68939800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 2024-09-22T08:36:36.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.642+0000 7f3c68939800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 info.flags=0x17 2024-09-22T08:36:36.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.642+0000 7f3c68939800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 to cache LRU end 2024-09-22T08:36:36.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.642+0000 7f3c68939800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:36.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.642+0000 7f3c68939800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34, ofs0, ns] 2024-09-22T08:36:36.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.642+0000 7f3b3affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497027 cookie 94064159754672 notifier 7503 bl.length()=911 2024-09-22T08:36:36.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.642+0000 7f3b3affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 info.flags=0x17 2024-09-22T08:36:36.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.642+0000 7f3b3affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 to cache LRU end 2024-09-22T08:36:36.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.642+0000 7f3b3affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:36.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.643+0000 7f3c68939800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.34]): orig_sources= new_sources= 2024-09-22T08:36:36.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.643+0000 7f3c68939800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.34]): potential sources added=[] removed=[] 2024-09-22T08:36:36.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.643+0000 7f3c68939800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.34]): orig_dests= new_dests= 2024-09-22T08:36:36.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.643+0000 7f3c68939800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.34]): potential dests added=[] removed=[] 2024-09-22T08:36:36.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.646+0000 7f3c68939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.0 2024-09-22T08:36:36.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.646+0000 7f3c68939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.1 2024-09-22T08:36:36.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.646+0000 7f3c68939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.2 2024-09-22T08:36:36.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.647+0000 7f3c68939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.3 2024-09-22T08:36:36.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.647+0000 7f3c68939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.4 2024-09-22T08:36:36.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.648+0000 7f3c68939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.5 2024-09-22T08:36:36.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.648+0000 7f3c68939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.6 2024-09-22T08:36:36.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.649+0000 7f3c68939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.7 2024-09-22T08:36:36.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.649+0000 7f3c68939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.8 2024-09-22T08:36:36.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.650+0000 7f3c68939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.9 2024-09-22T08:36:36.651 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.650+0000 7f3c68939800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.34.10 2024-09-22T08:36:36.651 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.651+0000 7f3c68939800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 : hit (requested=0x17, cached=0x17) 2024-09-22T08:36:36.651 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.651+0000 7f3c68939800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 2024-09-22T08:36:36.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.652+0000 7f3c68939800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 info.flags=0x17 2024-09-22T08:36:36.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.652+0000 7f3c68939800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 to cache LRU end 2024-09-22T08:36:36.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.652+0000 7f3c68939800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:36.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.652+0000 7f3c68939800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34, ofs0, ns] 2024-09-22T08:36:36.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.652+0000 7f3b3b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497028 cookie 94064159754672 notifier 7503 bl.length()=879 2024-09-22T08:36:36.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.652+0000 7f3b3b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 info.flags=0x17 2024-09-22T08:36:36.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.652+0000 7f3b3b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 to cache LRU end 2024-09-22T08:36:36.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.652+0000 7f3b3b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:36.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.653+0000 7f3c68939800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.34]): orig_sources= new_sources= 2024-09-22T08:36:36.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.653+0000 7f3c68939800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.34]): potential sources added=[] removed=[] 2024-09-22T08:36:36.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.653+0000 7f3c68939800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.34]): orig_dests= new_dests= 2024-09-22T08:36:36.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.653+0000 7f3c68939800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c62f9d7b-f6b6-404a-90de-de5607499115.4584.34]): potential dests added=[] removed=[] 2024-09-22T08:36:36.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.655+0000 7f3c68939800 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-22T08:36:36.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.657+0000 7f3b1afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:36.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.660+0000 7f3c68939800 20 remove_watcher() i=0 2024-09-22T08:36:36.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.660+0000 7f3c68939800 2 removed watcher, disabling cache 2024-09-22T08:36:36.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.661+0000 7f3c68939800 20 remove_watcher() i=1 2024-09-22T08:36:36.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.662+0000 7f3c68939800 20 remove_watcher() i=2 2024-09-22T08:36:36.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.663+0000 7f3c68939800 20 remove_watcher() i=3 2024-09-22T08:36:36.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.665+0000 7f3c68939800 20 remove_watcher() i=4 2024-09-22T08:36:36.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.666+0000 7f3c68939800 20 remove_watcher() i=5 2024-09-22T08:36:36.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.667+0000 7f3c68939800 20 remove_watcher() i=6 2024-09-22T08:36:36.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.669+0000 7f3c68939800 20 remove_watcher() i=7 2024-09-22T08:36:36.684 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-22T08:36:36.715 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:36.715 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:36.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.755+0000 7f143c10c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:36.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.757+0000 7f143c10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:36.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.757+0000 7f143c10c800 20 realm 2024-09-22T08:36:36.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.757+0000 7f143c10c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:36.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.757+0000 7f143c10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:36.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.757+0000 7f143c10c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:36.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.757+0000 7f143c10c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:36.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.757+0000 7f143c10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:36.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.757+0000 7f143c10c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:36.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.758+0000 7f143c10c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:36.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.758+0000 7f143c10c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:36.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.759+0000 7f143c10c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:36:36.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.759+0000 7f143c10c800 20 searching for the correct realm 2024-09-22T08:36:36.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.762+0000 7f1439bfd640 0 -- 172.21.15.38:0/2637876004 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x556713e53100 msgr2=0x556713e555c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:36.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.765+0000 7f14313fc640 0 -- 172.21.15.38:0/2637876004 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f142c0bbb20 msgr2=0x7f142c0030b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:36.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.973+0000 7f143c10c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:36.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.973+0000 7f143c10c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:36.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.973+0000 7f143c10c800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:36:36.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.973+0000 7f143c10c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:36.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.973+0000 7f143c10c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:36.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.973+0000 7f143c10c800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:36:36.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.973+0000 7f143c10c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:36.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.974+0000 7f143c10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:36.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.974+0000 7f143c10c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:36.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.974+0000 7f143c10c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:36.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.974+0000 7f143c10c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:36.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.974+0000 7f143c10c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:36:36.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.974+0000 7f143c10c800 20 zone default found 2024-09-22T08:36:36.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.974+0000 7f143c10c800 4 Realm: () 2024-09-22T08:36:36.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.974+0000 7f143c10c800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:36:36.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.974+0000 7f143c10c800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:36:36.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.974+0000 7f143c10c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:36.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.974+0000 7f143c10c800 20 zonegroup default 2024-09-22T08:36:36.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.974+0000 7f143c10c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:36.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.975+0000 7f143c10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:36.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.975+0000 7f143c10c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:36.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.975+0000 7f143c10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:36.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.975+0000 7f143c10c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:36.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.975+0000 7f143c10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:36.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.975+0000 7f143c10c800 20 started sync module instance, tier type = 2024-09-22T08:36:36.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.975+0000 7f143c10c800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:36:36.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.986+0000 7f143c10c800 20 add_watcher() i=0 2024-09-22T08:36:36.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.986+0000 7f143c10c800 20 add_watcher() i=1 2024-09-22T08:36:36.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.986+0000 7f143c10c800 20 add_watcher() i=2 2024-09-22T08:36:36.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.986+0000 7f143c10c800 20 add_watcher() i=3 2024-09-22T08:36:36.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.986+0000 7f143c10c800 20 add_watcher() i=4 2024-09-22T08:36:36.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.986+0000 7f143c10c800 20 add_watcher() i=5 2024-09-22T08:36:36.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.986+0000 7f143c10c800 20 add_watcher() i=6 2024-09-22T08:36:36.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.987+0000 7f143c10c800 20 add_watcher() i=7 2024-09-22T08:36:36.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.987+0000 7f143c10c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:36.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.989+0000 7f12eb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:36.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.990+0000 7f143c10c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:36.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.990+0000 7f143c10c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:36.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.990+0000 7f143c10c800 5 note: GC not initialized 2024-09-22T08:36:36.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.990+0000 7f12ea7fc640 20 reqs_thread_entry: start 2024-09-22T08:36:36.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.990+0000 7f143c10c800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:36.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.990+0000 7f143c10c800 20 Filter name: none 2024-09-22T08:36:36.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.990+0000 7f125bfff640 20 reqs_thread_entry: start 2024-09-22T08:36:36.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.990+0000 7f143c10c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:36.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.991+0000 7f143c10c800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T08:36:36.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.991+0000 7f143c10c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:36.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.991+0000 7f143c10c800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T08:36:36.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.991+0000 7f143c10c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:36:36.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.991+0000 7f143c10c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:36.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.992+0000 7f143c10c800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T08:36:36.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.992+0000 7f143c10c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:36.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.992+0000 7f143c10c800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T08:36:36.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.992+0000 7f143c10c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:36:36.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.994+0000 7f12eb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:36.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.997+0000 7f143c10c800 20 remove_watcher() i=0 2024-09-22T08:36:36.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.997+0000 7f143c10c800 2 removed watcher, disabling cache 2024-09-22T08:36:36.999 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.998+0000 7f143c10c800 20 remove_watcher() i=1 2024-09-22T08:36:37.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:36.999+0000 7f143c10c800 20 remove_watcher() i=2 2024-09-22T08:36:37.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.000+0000 7f143c10c800 20 remove_watcher() i=3 2024-09-22T08:36:37.002 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.001+0000 7f143c10c800 20 remove_watcher() i=4 2024-09-22T08:36:37.003 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.003+0000 7f143c10c800 20 remove_watcher() i=5 2024-09-22T08:36:37.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.004+0000 7f143c10c800 20 remove_watcher() i=6 2024-09-22T08:36:37.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.005+0000 7f143c10c800 20 remove_watcher() i=7 2024-09-22T08:36:37.019 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:37.019 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:36:37.019 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-do-reshard id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.34 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-22T08:36:37.019 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:37.021 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:37.021 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:37.024 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:37.025 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:37.068 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:37.068 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:37.098 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-22T08:36:37.098 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:37.099 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:37.099 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:37.111 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:37.111 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:37.153 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:37.154 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:37.162 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:37.162 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:37.168 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:37.168 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:37.175 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:37.175 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:37.181 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:37.181 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:37.187 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:37.187 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:37.194 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:37.194 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:37.200 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:37.200 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:37.206 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:37.206 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:37.214 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:37.214 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:37.220 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:37.220 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:37.226 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:37.226 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:37.232 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:37.232 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:37.239 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:37.239 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:37.245 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:37.245 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:37.251 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:37.251 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:37.258 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:37.258 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:37.264 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:37.264 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:37.270 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:37.270 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:37.276 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:37.276 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:37.283 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-22T08:36:37.312 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:37.312 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:37.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.350+0000 7f2946f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:37.353 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.352+0000 7f2946f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:37.353 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.352+0000 7f2946f2c800 20 realm 2024-09-22T08:36:37.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.352+0000 7f2946f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:37.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.352+0000 7f2946f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:37.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.352+0000 7f2946f2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:37.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.352+0000 7f2946f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:37.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.352+0000 7f2946f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:37.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.353+0000 7f2946f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:37.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.353+0000 7f2946f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:37.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.353+0000 7f2946f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:37.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.354+0000 7f2946f2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:36:37.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.354+0000 7f2946f2c800 20 searching for the correct realm 2024-09-22T08:36:37.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.356+0000 7f294233d640 0 -- 172.21.15.38:0/2135408019 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f292c045020 msgr2=0x7f292c077310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:36:37.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.561+0000 7f294233d640 0 -- 172.21.15.38:0/2135408019 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f293409cb60 msgr2=0x7f2934060780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:37.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.768+0000 7f2946f2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:37.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.768+0000 7f2946f2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:37.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.768+0000 7f2946f2c800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:36:37.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.768+0000 7f2946f2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:37.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.768+0000 7f2946f2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:37.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.768+0000 7f2946f2c800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:36:37.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.768+0000 7f2946f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:37.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.769+0000 7f2946f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:37.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.769+0000 7f2946f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:37.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.769+0000 7f2946f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:37.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.769+0000 7f2946f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:37.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.770+0000 7f2946f2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:36:37.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.770+0000 7f2946f2c800 20 zone default found 2024-09-22T08:36:37.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.770+0000 7f2946f2c800 4 Realm: () 2024-09-22T08:36:37.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.770+0000 7f2946f2c800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:36:37.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.770+0000 7f2946f2c800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:36:37.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.770+0000 7f2946f2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:37.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.770+0000 7f2946f2c800 20 zonegroup default 2024-09-22T08:36:37.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.770+0000 7f2946f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:37.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.770+0000 7f2946f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:37.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.770+0000 7f2946f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:37.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.770+0000 7f2946f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:37.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.770+0000 7f2946f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:37.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.771+0000 7f2946f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:37.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.771+0000 7f2946f2c800 20 started sync module instance, tier type = 2024-09-22T08:36:37.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.771+0000 7f2946f2c800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:36:37.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.782+0000 7f2946f2c800 20 add_watcher() i=0 2024-09-22T08:36:37.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.782+0000 7f2946f2c800 20 add_watcher() i=1 2024-09-22T08:36:37.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.782+0000 7f2946f2c800 20 add_watcher() i=2 2024-09-22T08:36:37.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.782+0000 7f2946f2c800 20 add_watcher() i=3 2024-09-22T08:36:37.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.782+0000 7f2946f2c800 20 add_watcher() i=4 2024-09-22T08:36:37.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.782+0000 7f2946f2c800 20 add_watcher() i=5 2024-09-22T08:36:37.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.782+0000 7f2946f2c800 20 add_watcher() i=6 2024-09-22T08:36:37.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.783+0000 7f2946f2c800 20 add_watcher() i=7 2024-09-22T08:36:37.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.783+0000 7f2946f2c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:37.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.785+0000 7f27f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:37.787 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.785+0000 7f2946f2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:37.787 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.785+0000 7f2946f2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:37.787 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.785+0000 7f2946f2c800 5 note: GC not initialized 2024-09-22T08:36:37.787 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.786+0000 7f2773fff640 20 reqs_thread_entry: start 2024-09-22T08:36:37.787 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.786+0000 7f2946f2c800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:37.787 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.786+0000 7f2946f2c800 20 Filter name: none 2024-09-22T08:36:37.787 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.786+0000 7f2771ffb640 20 reqs_thread_entry: start 2024-09-22T08:36:37.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.786+0000 7f2946f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:37.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.787+0000 7f2946f2c800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T08:36:37.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.787+0000 7f2946f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:37.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.787+0000 7f2946f2c800 20 rados_obj.operate() r=0 bl.length=415 2024-09-22T08:36:37.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.787+0000 7f2946f2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:36:37.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.787+0000 7f2946f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:37.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.788+0000 7f2946f2c800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T08:36:37.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.788+0000 7f2946f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:37.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.788+0000 7f2946f2c800 20 rados_obj.operate() r=0 bl.length=415 2024-09-22T08:36:37.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.788+0000 7f2946f2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:36:37.791 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.790+0000 7f27f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:37.793 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.793+0000 7f2946f2c800 20 remove_watcher() i=0 2024-09-22T08:36:37.793 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.793+0000 7f2946f2c800 2 removed watcher, disabling cache 2024-09-22T08:36:37.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.794+0000 7f2946f2c800 20 remove_watcher() i=1 2024-09-22T08:36:37.796 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.795+0000 7f2946f2c800 20 remove_watcher() i=2 2024-09-22T08:36:37.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.797+0000 7f2946f2c800 20 remove_watcher() i=3 2024-09-22T08:36:37.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.798+0000 7f2946f2c800 20 remove_watcher() i=4 2024-09-22T08:36:37.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.799+0000 7f2946f2c800 20 remove_watcher() i=5 2024-09-22T08:36:37.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.801+0000 7f2946f2c800 20 remove_watcher() i=6 2024-09-22T08:36:37.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.802+0000 7f2946f2c800 20 remove_watcher() i=7 2024-09-22T08:36:37.815 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:37.815 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:36:37.815 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-logrecord-writes id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:36:37.815 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:37.817 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-22T08:36:37.852 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:37.852 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:37.892 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.891+0000 7f7fe2d39800 20 rados->read ofs=0 len=0 2024-09-22T08:36:37.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.893+0000 7f7fe2d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:37.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.893+0000 7f7fe2d39800 20 realm 2024-09-22T08:36:37.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.893+0000 7f7fe2d39800 20 rados->read ofs=0 len=0 2024-09-22T08:36:37.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.893+0000 7f7fe2d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:37.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.893+0000 7f7fe2d39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:37.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.893+0000 7f7fe2d39800 20 rados->read ofs=0 len=0 2024-09-22T08:36:37.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.894+0000 7f7fe2d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:37.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.894+0000 7f7fe2d39800 20 rados->read ofs=0 len=0 2024-09-22T08:36:37.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.894+0000 7f7fe2d39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:37.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.894+0000 7f7fe2d39800 20 rados->read ofs=0 len=0 2024-09-22T08:36:37.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.895+0000 7f7fe2d39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:36:37.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.895+0000 7f7fe2d39800 20 searching for the correct realm 2024-09-22T08:36:37.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:37.898+0000 7f7fdf1c8640 0 -- 172.21.15.38:0/3958565655 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7f7fd00487a0 msgr2=0x7f7fd0047270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:38.106 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.104+0000 7f7fde9c7640 0 -- 172.21.15.38:0/3958565655 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x55c72f90f660 msgr2=0x55c72f911ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:38.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.109+0000 7f7fe2d39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:38.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.109+0000 7f7fe2d39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:38.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.109+0000 7f7fe2d39800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:36:38.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.109+0000 7f7fe2d39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:38.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.109+0000 7f7fe2d39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:38.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.109+0000 7f7fe2d39800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:36:38.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.109+0000 7f7fe2d39800 20 rados->read ofs=0 len=0 2024-09-22T08:36:38.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.109+0000 7f7fe2d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:38.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.109+0000 7f7fe2d39800 20 rados->read ofs=0 len=0 2024-09-22T08:36:38.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.110+0000 7f7fe2d39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:38.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.110+0000 7f7fe2d39800 20 rados->read ofs=0 len=0 2024-09-22T08:36:38.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.110+0000 7f7fe2d39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:36:38.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.110+0000 7f7fe2d39800 20 zone default found 2024-09-22T08:36:38.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.110+0000 7f7fe2d39800 4 Realm: () 2024-09-22T08:36:38.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.110+0000 7f7fe2d39800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:36:38.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.110+0000 7f7fe2d39800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:36:38.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.110+0000 7f7fe2d39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:38.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.110+0000 7f7fe2d39800 20 zonegroup default 2024-09-22T08:36:38.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.110+0000 7f7fe2d39800 20 rados->read ofs=0 len=0 2024-09-22T08:36:38.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.110+0000 7f7fe2d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:38.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.110+0000 7f7fe2d39800 20 rados->read ofs=0 len=0 2024-09-22T08:36:38.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.111+0000 7f7fe2d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:38.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.111+0000 7f7fe2d39800 20 rados->read ofs=0 len=0 2024-09-22T08:36:38.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.111+0000 7f7fe2d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:38.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.111+0000 7f7fe2d39800 20 started sync module instance, tier type = 2024-09-22T08:36:38.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.111+0000 7f7fe2d39800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:36:38.122 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.121+0000 7f7fe2d39800 20 add_watcher() i=0 2024-09-22T08:36:38.122 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.121+0000 7f7fe2d39800 20 add_watcher() i=1 2024-09-22T08:36:38.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.121+0000 7f7fe2d39800 20 add_watcher() i=2 2024-09-22T08:36:38.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.121+0000 7f7fe2d39800 20 add_watcher() i=3 2024-09-22T08:36:38.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.121+0000 7f7fe2d39800 20 add_watcher() i=4 2024-09-22T08:36:38.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.121+0000 7f7fe2d39800 20 add_watcher() i=5 2024-09-22T08:36:38.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.121+0000 7f7fe2d39800 20 add_watcher() i=6 2024-09-22T08:36:38.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.123+0000 7f7fe2d39800 20 add_watcher() i=7 2024-09-22T08:36:38.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.123+0000 7f7fe2d39800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:38.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.124+0000 7f7e957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:38.126 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.125+0000 7f7fe2d39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:38.126 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.125+0000 7f7fe2d39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:38.126 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.125+0000 7f7fe2d39800 5 note: GC not initialized 2024-09-22T08:36:38.126 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.125+0000 7f7e0ffff640 20 reqs_thread_entry: start 2024-09-22T08:36:38.126 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.125+0000 7f7fe2d39800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:38.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.125+0000 7f7fe2d39800 20 Filter name: none 2024-09-22T08:36:38.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.125+0000 7f7e0dffb640 20 reqs_thread_entry: start 2024-09-22T08:36:38.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.125+0000 7f7fe2d39800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-22T08:36:38.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.125+0000 7f7fe2d39800 20 rados->read ofs=0 len=0 2024-09-22T08:36:38.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.126+0000 7f7fe2d39800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T08:36:38.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.126+0000 7f7fe2d39800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-22T08:36:38.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.126+0000 7f7fe2d39800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-22T08:36:38.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.126+0000 7f7fe2d39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.35 : miss 2024-09-22T08:36:38.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.126+0000 7f7fe2d39800 20 rados->read ofs=0 len=0 2024-09-22T08:36:38.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.126+0000 7f7fe2d39800 20 rados_obj.operate() r=0 bl.length=415 2024-09-22T08:36:38.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.126+0000 7f7fe2d39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.35 info.flags=0x17 2024-09-22T08:36:38.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.126+0000 7f7fe2d39800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.35 to cache LRU end 2024-09-22T08:36:38.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.126+0000 7f7fe2d39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:38.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.126+0000 7f7fe2d39800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:38.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.126+0000 7f7fe2d39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.35 2024-09-22T08:36:38.133 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.132+0000 7f7fe2d39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.35 info.flags=0x17 2024-09-22T08:36:38.133 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.132+0000 7f7fe2d39800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.35 to cache LRU end 2024-09-22T08:36:38.133 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.132+0000 7f7fe2d39800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:38.133 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.132+0000 7f7fe2d39800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.35, ofs0, ns] 2024-09-22T08:36:38.133 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.132+0000 7f7ec1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497016 cookie 94313984949168 notifier 7103 bl.length()=923 2024-09-22T08:36:38.133 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.132+0000 7f7ec1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.35 info.flags=0x17 2024-09-22T08:36:38.133 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.132+0000 7f7ec1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.35 to cache LRU end 2024-09-22T08:36:38.133 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.132+0000 7f7ec1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:38.134 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.132+0000 7f7fe2d39800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.35]): orig_sources= new_sources= 2024-09-22T08:36:38.134 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.132+0000 7f7fe2d39800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.35]): potential sources added=[] removed=[] 2024-09-22T08:36:38.134 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.132+0000 7f7fe2d39800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.35]): orig_dests= new_dests= 2024-09-22T08:36:38.134 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.132+0000 7f7fe2d39800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.35]): potential dests added=[] removed=[] 2024-09-22T08:36:38.136 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.135+0000 7f7fe2d39800 -1 Injecting error=-5 at location=logrecord_writes 2024-09-22T08:36:38.136 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.135+0000 7f7fe2d39800 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-22T08:36:38.141 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.140+0000 7f7fe2d39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.35 : hit (requested=0x17, cached=0x17) 2024-09-22T08:36:38.141 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.140+0000 7f7fe2d39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.35 2024-09-22T08:36:38.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.141+0000 7f7fe2d39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.35 info.flags=0x17 2024-09-22T08:36:38.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.141+0000 7f7fe2d39800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.35 to cache LRU end 2024-09-22T08:36:38.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.141+0000 7f7fe2d39800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:38.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.141+0000 7f7fe2d39800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.35, ofs0, ns] 2024-09-22T08:36:38.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.141+0000 7f7ec27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497017 cookie 94313984949168 notifier 7103 bl.length()=891 2024-09-22T08:36:38.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.141+0000 7f7ec27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.35 info.flags=0x17 2024-09-22T08:36:38.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.141+0000 7f7ec27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.35 to cache LRU end 2024-09-22T08:36:38.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.141+0000 7f7ec27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:38.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.142+0000 7f7fe2d39800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.35]): orig_sources= new_sources= 2024-09-22T08:36:38.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.142+0000 7f7fe2d39800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.35]): potential sources added=[] removed=[] 2024-09-22T08:36:38.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.142+0000 7f7fe2d39800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.35]): orig_dests= new_dests= 2024-09-22T08:36:38.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.142+0000 7f7fe2d39800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.35]): potential dests added=[] removed=[] 2024-09-22T08:36:38.145 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.144+0000 7f7e957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:38.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.146+0000 7f7fe2d39800 20 remove_watcher() i=0 2024-09-22T08:36:38.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.146+0000 7f7fe2d39800 2 removed watcher, disabling cache 2024-09-22T08:36:38.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.147+0000 7f7fe2d39800 20 remove_watcher() i=1 2024-09-22T08:36:38.149 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.148+0000 7f7fe2d39800 20 remove_watcher() i=2 2024-09-22T08:36:38.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.149+0000 7f7fe2d39800 20 remove_watcher() i=3 2024-09-22T08:36:38.151 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.150+0000 7f7fe2d39800 20 remove_watcher() i=4 2024-09-22T08:36:38.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.151+0000 7f7fe2d39800 20 remove_watcher() i=5 2024-09-22T08:36:38.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.152+0000 7f7fe2d39800 20 remove_watcher() i=6 2024-09-22T08:36:38.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.154+0000 7f7fe2d39800 20 remove_watcher() i=7 2024-09-22T08:36:38.167 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-22T08:36:38.196 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:38.197 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:38.240 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.238+0000 7f75e7326800 20 rados->read ofs=0 len=0 2024-09-22T08:36:38.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.240+0000 7f75e7326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:38.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.240+0000 7f75e7326800 20 realm 2024-09-22T08:36:38.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.240+0000 7f75e7326800 20 rados->read ofs=0 len=0 2024-09-22T08:36:38.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.241+0000 7f75e7326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:38.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.241+0000 7f75e7326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:38.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.241+0000 7f75e7326800 20 rados->read ofs=0 len=0 2024-09-22T08:36:38.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.241+0000 7f75e7326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:38.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.241+0000 7f75e7326800 20 rados->read ofs=0 len=0 2024-09-22T08:36:38.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.242+0000 7f75e7326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:38.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.242+0000 7f75e7326800 20 rados->read ofs=0 len=0 2024-09-22T08:36:38.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.242+0000 7f75e7326800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:36:38.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.242+0000 7f75e7326800 20 searching for the correct realm 2024-09-22T08:36:38.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.446+0000 7f75e27d8640 0 -- 172.21.15.38:0/2732633589 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f75cc027040 msgr2=0x7f75cc069350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:38.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.653+0000 7f75e27d8640 0 -- 172.21.15.38:0/2732633589 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f75d4053910 msgr2=0x7f75d400d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:38.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.861+0000 7f75e7326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:38.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.861+0000 7f75e7326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:38.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.861+0000 7f75e7326800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:36:38.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.861+0000 7f75e7326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:38.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.861+0000 7f75e7326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:38.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.861+0000 7f75e7326800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:36:38.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.861+0000 7f75e7326800 20 rados->read ofs=0 len=0 2024-09-22T08:36:38.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.861+0000 7f75e7326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:38.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.861+0000 7f75e7326800 20 rados->read ofs=0 len=0 2024-09-22T08:36:38.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.862+0000 7f75e7326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:38.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.862+0000 7f75e7326800 20 rados->read ofs=0 len=0 2024-09-22T08:36:38.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.862+0000 7f75e7326800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:36:38.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.862+0000 7f75e7326800 20 zone default found 2024-09-22T08:36:38.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.862+0000 7f75e7326800 4 Realm: () 2024-09-22T08:36:38.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.862+0000 7f75e7326800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:36:38.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.862+0000 7f75e7326800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:36:38.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.862+0000 7f75e7326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:38.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.862+0000 7f75e7326800 20 zonegroup default 2024-09-22T08:36:38.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.862+0000 7f75e7326800 20 rados->read ofs=0 len=0 2024-09-22T08:36:38.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.862+0000 7f75e7326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:38.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.862+0000 7f75e7326800 20 rados->read ofs=0 len=0 2024-09-22T08:36:38.865 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.863+0000 7f75e7326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:38.865 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.863+0000 7f75e7326800 20 rados->read ofs=0 len=0 2024-09-22T08:36:38.865 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.863+0000 7f75e7326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:38.865 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.863+0000 7f75e7326800 20 started sync module instance, tier type = 2024-09-22T08:36:38.865 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.863+0000 7f75e7326800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:36:38.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.874+0000 7f75e7326800 20 add_watcher() i=0 2024-09-22T08:36:38.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.874+0000 7f75e7326800 20 add_watcher() i=1 2024-09-22T08:36:38.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.874+0000 7f75e7326800 20 add_watcher() i=2 2024-09-22T08:36:38.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.874+0000 7f75e7326800 20 add_watcher() i=3 2024-09-22T08:36:38.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.874+0000 7f75e7326800 20 add_watcher() i=4 2024-09-22T08:36:38.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.874+0000 7f75e7326800 20 add_watcher() i=5 2024-09-22T08:36:38.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.874+0000 7f75e7326800 20 add_watcher() i=6 2024-09-22T08:36:38.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.876+0000 7f75e7326800 20 add_watcher() i=7 2024-09-22T08:36:38.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.876+0000 7f75e7326800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:38.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.878+0000 7f7499fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:38.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.878+0000 7f75e7326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:38.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.878+0000 7f75e7326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:38.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.878+0000 7f75e7326800 5 note: GC not initialized 2024-09-22T08:36:38.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.879+0000 7f7498fe1640 20 reqs_thread_entry: start 2024-09-22T08:36:38.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.879+0000 7f75e7326800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:38.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.879+0000 7f75e7326800 20 Filter name: none 2024-09-22T08:36:38.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.879+0000 7f7491ffb640 20 reqs_thread_entry: start 2024-09-22T08:36:38.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.879+0000 7f75e7326800 20 rados->read ofs=0 len=0 2024-09-22T08:36:38.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.880+0000 7f75e7326800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T08:36:38.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.880+0000 7f75e7326800 20 rados->read ofs=0 len=0 2024-09-22T08:36:38.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.880+0000 7f75e7326800 20 rados_obj.operate() r=0 bl.length=415 2024-09-22T08:36:38.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.880+0000 7f75e7326800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:36:38.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.880+0000 7f75e7326800 20 rados->read ofs=0 len=0 2024-09-22T08:36:38.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.881+0000 7f75e7326800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T08:36:38.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.881+0000 7f75e7326800 20 rados->read ofs=0 len=0 2024-09-22T08:36:38.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.881+0000 7f75e7326800 20 rados_obj.operate() r=0 bl.length=415 2024-09-22T08:36:38.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.881+0000 7f75e7326800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:36:38.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.883+0000 7f7499fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:38.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.886+0000 7f75e7326800 20 remove_watcher() i=0 2024-09-22T08:36:38.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.886+0000 7f75e7326800 2 removed watcher, disabling cache 2024-09-22T08:36:38.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.887+0000 7f75e7326800 20 remove_watcher() i=1 2024-09-22T08:36:38.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.889+0000 7f75e7326800 20 remove_watcher() i=2 2024-09-22T08:36:38.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.890+0000 7f75e7326800 20 remove_watcher() i=3 2024-09-22T08:36:38.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.892+0000 7f75e7326800 20 remove_watcher() i=4 2024-09-22T08:36:38.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.893+0000 7f75e7326800 20 remove_watcher() i=5 2024-09-22T08:36:38.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.894+0000 7f75e7326800 20 remove_watcher() i=6 2024-09-22T08:36:38.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:38.895+0000 7f75e7326800 20 remove_watcher() i=7 2024-09-22T08:36:38.910 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:38.910 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:36:38.910 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-logrecord-writes id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:36:38.910 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:38.912 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:38.912 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:38.919 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:38.919 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:38.962 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:36:38.997 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:38.997 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:39.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.041+0000 7f24f2a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:39.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.042+0000 7f24f2a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:39.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.042+0000 7f24f2a0f800 20 realm 2024-09-22T08:36:39.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.042+0000 7f24f2a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:39.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.043+0000 7f24f2a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:39.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.043+0000 7f24f2a0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:39.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.043+0000 7f24f2a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:39.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.043+0000 7f24f2a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:39.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.043+0000 7f24f2a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:39.045 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.044+0000 7f24f2a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:39.045 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.044+0000 7f24f2a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:39.045 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.044+0000 7f24f2a0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:36:39.045 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.044+0000 7f24f2a0f800 20 searching for the correct realm 2024-09-22T08:36:39.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.046+0000 7f24efcf8640 0 -- 172.21.15.38:0/4257393163 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f24e40a3c20 msgr2=0x7f24e406d990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:39.253 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.252+0000 7f24efcf8640 0 -- 172.21.15.38:0/4257393163 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f24e00193e0 msgr2=0x7f24e0019840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:39.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.459+0000 7f24f2a0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:39.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.459+0000 7f24f2a0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:39.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.459+0000 7f24f2a0f800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:36:39.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.459+0000 7f24f2a0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:39.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.459+0000 7f24f2a0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:39.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.459+0000 7f24f2a0f800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:36:39.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.459+0000 7f24f2a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:39.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.460+0000 7f24f2a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:39.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.460+0000 7f24f2a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:39.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.460+0000 7f24f2a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:39.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.460+0000 7f24f2a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:39.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.460+0000 7f24f2a0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:36:39.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.460+0000 7f24f2a0f800 20 zone default found 2024-09-22T08:36:39.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.460+0000 7f24f2a0f800 4 Realm: () 2024-09-22T08:36:39.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.460+0000 7f24f2a0f800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:36:39.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.460+0000 7f24f2a0f800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:36:39.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.460+0000 7f24f2a0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:39.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.460+0000 7f24f2a0f800 20 zonegroup default 2024-09-22T08:36:39.463 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.460+0000 7f24f2a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:39.463 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.461+0000 7f24f2a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:39.463 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.461+0000 7f24f2a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:39.463 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.461+0000 7f24f2a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:39.463 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.461+0000 7f24f2a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:39.463 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.461+0000 7f24f2a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:39.463 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.461+0000 7f24f2a0f800 20 started sync module instance, tier type = 2024-09-22T08:36:39.463 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.461+0000 7f24f2a0f800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:36:39.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.472+0000 7f24f2a0f800 20 add_watcher() i=0 2024-09-22T08:36:39.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.472+0000 7f24f2a0f800 20 add_watcher() i=1 2024-09-22T08:36:39.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.472+0000 7f24f2a0f800 20 add_watcher() i=2 2024-09-22T08:36:39.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.472+0000 7f24f2a0f800 20 add_watcher() i=3 2024-09-22T08:36:39.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.472+0000 7f24f2a0f800 20 add_watcher() i=4 2024-09-22T08:36:39.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.472+0000 7f24f2a0f800 20 add_watcher() i=5 2024-09-22T08:36:39.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.472+0000 7f24f2a0f800 20 add_watcher() i=6 2024-09-22T08:36:39.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.473+0000 7f24f2a0f800 20 add_watcher() i=7 2024-09-22T08:36:39.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.473+0000 7f24f2a0f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:39.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.476+0000 7f23a6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:39.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.476+0000 7f24f2a0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:39.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.476+0000 7f24f2a0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:39.478 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.476+0000 7f24f2a0f800 5 note: GC not initialized 2024-09-22T08:36:39.478 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.476+0000 7f23a5fdb640 20 reqs_thread_entry: start 2024-09-22T08:36:39.478 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.476+0000 7f24f2a0f800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:39.478 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.476+0000 7f24f2a0f800 20 Filter name: none 2024-09-22T08:36:39.478 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.477+0000 7f23177fe640 20 reqs_thread_entry: start 2024-09-22T08:36:39.478 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.477+0000 7f24f2a0f800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-22T08:36:39.478 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.477+0000 7f24f2a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:39.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.477+0000 7f24f2a0f800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T08:36:39.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.477+0000 7f24f2a0f800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-22T08:36:39.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.477+0000 7f24f2a0f800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-22T08:36:39.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.477+0000 7f24f2a0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.35 : miss 2024-09-22T08:36:39.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.477+0000 7f24f2a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:39.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.477+0000 7f24f2a0f800 20 rados_obj.operate() r=0 bl.length=415 2024-09-22T08:36:39.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.477+0000 7f24f2a0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.35 info.flags=0x17 2024-09-22T08:36:39.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.477+0000 7f24f2a0f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.35 to cache LRU end 2024-09-22T08:36:39.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.477+0000 7f24f2a0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:39.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.477+0000 7f24f2a0f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:39.480 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.478+0000 7f24f2a0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.35 2024-09-22T08:36:39.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.483+0000 7f24f2a0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.35 info.flags=0x17 2024-09-22T08:36:39.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.483+0000 7f24f2a0f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.35 to cache LRU end 2024-09-22T08:36:39.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.483+0000 7f24f2a0f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:39.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.483+0000 7f24f2a0f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.35, ofs0, ns] 2024-09-22T08:36:39.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.483+0000 7f23c6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497018 cookie 94408078036896 notifier 7596 bl.length()=923 2024-09-22T08:36:39.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.483+0000 7f23c6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.35 info.flags=0x17 2024-09-22T08:36:39.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.483+0000 7f23c6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.35 to cache LRU end 2024-09-22T08:36:39.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.483+0000 7f23c6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:39.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.484+0000 7f24f2a0f800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.35]): orig_sources= new_sources= 2024-09-22T08:36:39.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.484+0000 7f24f2a0f800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.35]): potential sources added=[] removed=[] 2024-09-22T08:36:39.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.484+0000 7f24f2a0f800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.35]): orig_dests= new_dests= 2024-09-22T08:36:39.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.484+0000 7f24f2a0f800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.35]): potential dests added=[] removed=[] 2024-09-22T08:36:39.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.489+0000 7f24f2a0f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.1.0 2024-09-22T08:36:39.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.489+0000 7f24f2a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.1.0 2024-09-22T08:36:39.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.489+0000 7f24f2a0f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.1.1 2024-09-22T08:36:39.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.489+0000 7f24f2a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.1.1 2024-09-22T08:36:39.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.489+0000 7f24f2a0f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.1.2 2024-09-22T08:36:39.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.489+0000 7f24f2a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.1.2 2024-09-22T08:36:39.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.489+0000 7f24f2a0f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.1.3 2024-09-22T08:36:39.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.489+0000 7f24f2a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.1.3 2024-09-22T08:36:39.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.489+0000 7f24f2a0f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.1.4 2024-09-22T08:36:39.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.489+0000 7f24f2a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.1.4 2024-09-22T08:36:39.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.489+0000 7f24f2a0f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.1.5 2024-09-22T08:36:39.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.489+0000 7f24f2a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.1.5 2024-09-22T08:36:39.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.489+0000 7f24f2a0f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.1.6 2024-09-22T08:36:39.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.489+0000 7f24f2a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.1.6 2024-09-22T08:36:39.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.489+0000 7f24f2a0f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.1.7 2024-09-22T08:36:39.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.489+0000 7f24f2a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.1.7 2024-09-22T08:36:39.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.489+0000 7f24f2a0f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.1.8 2024-09-22T08:36:39.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.489+0000 7f24f2a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.1.8 2024-09-22T08:36:39.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.489+0000 7f24f2a0f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.1.9 2024-09-22T08:36:39.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.489+0000 7f24f2a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.1.9 2024-09-22T08:36:39.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.489+0000 7f24f2a0f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.1.10 2024-09-22T08:36:39.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.489+0000 7f24f2a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.1.10 2024-09-22T08:36:39.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.489+0000 7f24f2a0f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.1.11 2024-09-22T08:36:39.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.489+0000 7f24f2a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.1.11 2024-09-22T08:36:39.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.489+0000 7f24f2a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.0 2024-09-22T08:36:39.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.490+0000 7f24f2a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.1 2024-09-22T08:36:39.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.490+0000 7f24f2a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.2 2024-09-22T08:36:39.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.491+0000 7f24f2a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.3 2024-09-22T08:36:39.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.491+0000 7f24f2a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.4 2024-09-22T08:36:39.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.492+0000 7f24f2a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.5 2024-09-22T08:36:39.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.492+0000 7f24f2a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.6 2024-09-22T08:36:39.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.493+0000 7f24f2a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.7 2024-09-22T08:36:39.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.493+0000 7f24f2a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.8 2024-09-22T08:36:39.495 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.494+0000 7f24f2a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.9 2024-09-22T08:36:39.495 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.494+0000 7f24f2a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.10 2024-09-22T08:36:39.498 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.497+0000 7f24f2a0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.35 : hit (requested=0x17, cached=0x17) 2024-09-22T08:36:39.498 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.497+0000 7f24f2a0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.35 2024-09-22T08:36:39.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.499+0000 7f24f2a0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.35 info.flags=0x17 2024-09-22T08:36:39.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.499+0000 7f24f2a0f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.35 to cache LRU end 2024-09-22T08:36:39.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.499+0000 7f24f2a0f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:39.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.499+0000 7f24f2a0f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.35, ofs0, ns] 2024-09-22T08:36:39.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.499+0000 7f23c77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497019 cookie 94408078036896 notifier 7596 bl.length()=923 2024-09-22T08:36:39.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.499+0000 7f23c77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.35 info.flags=0x17 2024-09-22T08:36:39.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.499+0000 7f23c77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.35 to cache LRU end 2024-09-22T08:36:39.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.499+0000 7f23c77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:39.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.499+0000 7f24f2a0f800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.35]): orig_sources= new_sources= 2024-09-22T08:36:39.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.499+0000 7f24f2a0f800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.35]): potential sources added=[] removed=[] 2024-09-22T08:36:39.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.499+0000 7f24f2a0f800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.35]): orig_dests= new_dests= 2024-09-22T08:36:39.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.499+0000 7f24f2a0f800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.35]): potential dests added=[] removed=[] 2024-09-22T08:36:39.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.502+0000 7f24f2a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.0 2024-09-22T08:36:39.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.502+0000 7f24f2a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.1 2024-09-22T08:36:39.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.502+0000 7f24f2a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.2 2024-09-22T08:36:39.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.503+0000 7f24f2a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.3 2024-09-22T08:36:39.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.503+0000 7f24f2a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.4 2024-09-22T08:36:39.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.503+0000 7f24f2a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.5 2024-09-22T08:36:39.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.504+0000 7f24f2a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.6 2024-09-22T08:36:39.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.504+0000 7f24f2a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.7 2024-09-22T08:36:39.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.505+0000 7f24f2a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.8 2024-09-22T08:36:39.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.505+0000 7f24f2a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.9 2024-09-22T08:36:39.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.505+0000 7f24f2a0f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.35.10 2024-09-22T08:36:39.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.506+0000 7f24f2a0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.35 : hit (requested=0x17, cached=0x17) 2024-09-22T08:36:39.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.506+0000 7f24f2a0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.35 2024-09-22T08:36:39.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.507+0000 7f24f2a0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.35 info.flags=0x17 2024-09-22T08:36:39.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.507+0000 7f24f2a0f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.35 to cache LRU end 2024-09-22T08:36:39.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.507+0000 7f24f2a0f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:39.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.507+0000 7f24f2a0f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.35, ofs0, ns] 2024-09-22T08:36:39.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.507+0000 7f23c77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497020 cookie 94408078036896 notifier 7596 bl.length()=891 2024-09-22T08:36:39.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.507+0000 7f23c77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.35 info.flags=0x17 2024-09-22T08:36:39.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.507+0000 7f23c77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.35 to cache LRU end 2024-09-22T08:36:39.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.507+0000 7f23c77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:39.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.508+0000 7f24f2a0f800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.35]): orig_sources= new_sources= 2024-09-22T08:36:39.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.508+0000 7f24f2a0f800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.35]): potential sources added=[] removed=[] 2024-09-22T08:36:39.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.508+0000 7f24f2a0f800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.35]): orig_dests= new_dests= 2024-09-22T08:36:39.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.508+0000 7f24f2a0f800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.35]): potential dests added=[] removed=[] 2024-09-22T08:36:39.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.510+0000 7f24f2a0f800 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-22T08:36:39.513 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.512+0000 7f23a6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:39.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.514+0000 7f24f2a0f800 20 remove_watcher() i=0 2024-09-22T08:36:39.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.514+0000 7f24f2a0f800 2 removed watcher, disabling cache 2024-09-22T08:36:39.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.515+0000 7f24f2a0f800 20 remove_watcher() i=1 2024-09-22T08:36:39.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.516+0000 7f24f2a0f800 20 remove_watcher() i=2 2024-09-22T08:36:39.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.518+0000 7f24f2a0f800 20 remove_watcher() i=3 2024-09-22T08:36:39.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.519+0000 7f24f2a0f800 20 remove_watcher() i=4 2024-09-22T08:36:39.521 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.520+0000 7f24f2a0f800 20 remove_watcher() i=5 2024-09-22T08:36:39.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.521+0000 7f24f2a0f800 20 remove_watcher() i=6 2024-09-22T08:36:39.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.522+0000 7f24f2a0f800 20 remove_watcher() i=7 2024-09-22T08:36:39.536 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-22T08:36:39.566 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:39.566 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:39.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.604+0000 7f88fbe87800 20 rados->read ofs=0 len=0 2024-09-22T08:36:39.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.606+0000 7f88fbe87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:39.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.606+0000 7f88fbe87800 20 realm 2024-09-22T08:36:39.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.606+0000 7f88fbe87800 20 rados->read ofs=0 len=0 2024-09-22T08:36:39.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.606+0000 7f88fbe87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:39.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.606+0000 7f88fbe87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:39.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.606+0000 7f88fbe87800 20 rados->read ofs=0 len=0 2024-09-22T08:36:39.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.607+0000 7f88fbe87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:39.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.607+0000 7f88fbe87800 20 rados->read ofs=0 len=0 2024-09-22T08:36:39.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.607+0000 7f88fbe87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:39.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.607+0000 7f88fbe87800 20 rados->read ofs=0 len=0 2024-09-22T08:36:39.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.608+0000 7f88fbe87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:36:39.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.608+0000 7f88fbe87800 20 searching for the correct realm 2024-09-22T08:36:39.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.611+0000 7f88fa179640 0 -- 172.21.15.38:0/1852910279 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7f88ec033040 msgr2=0x7f88ec014ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:36:39.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.816+0000 7f88f9978640 0 -- 172.21.15.38:0/1852910279 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x5615e8221a20 msgr2=0x5615e8223eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:39.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.821+0000 7f88fbe87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:39.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.821+0000 7f88fbe87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:39.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.821+0000 7f88fbe87800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:36:39.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.821+0000 7f88fbe87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:39.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.821+0000 7f88fbe87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:39.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.821+0000 7f88fbe87800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:36:39.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.821+0000 7f88fbe87800 20 rados->read ofs=0 len=0 2024-09-22T08:36:39.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.822+0000 7f88fbe87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:39.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.822+0000 7f88fbe87800 20 rados->read ofs=0 len=0 2024-09-22T08:36:39.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.822+0000 7f88fbe87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:39.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.822+0000 7f88fbe87800 20 rados->read ofs=0 len=0 2024-09-22T08:36:39.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.822+0000 7f88fbe87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:36:39.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.822+0000 7f88fbe87800 20 zone default found 2024-09-22T08:36:39.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.822+0000 7f88fbe87800 4 Realm: () 2024-09-22T08:36:39.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.822+0000 7f88fbe87800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:36:39.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.822+0000 7f88fbe87800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:36:39.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.822+0000 7f88fbe87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:39.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.822+0000 7f88fbe87800 20 zonegroup default 2024-09-22T08:36:39.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.822+0000 7f88fbe87800 20 rados->read ofs=0 len=0 2024-09-22T08:36:39.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.823+0000 7f88fbe87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:39.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.823+0000 7f88fbe87800 20 rados->read ofs=0 len=0 2024-09-22T08:36:39.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.823+0000 7f88fbe87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:39.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.823+0000 7f88fbe87800 20 rados->read ofs=0 len=0 2024-09-22T08:36:39.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.823+0000 7f88fbe87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:39.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.823+0000 7f88fbe87800 20 started sync module instance, tier type = 2024-09-22T08:36:39.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.823+0000 7f88fbe87800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:36:39.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.833+0000 7f88fbe87800 20 add_watcher() i=0 2024-09-22T08:36:39.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.833+0000 7f88fbe87800 20 add_watcher() i=1 2024-09-22T08:36:39.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.833+0000 7f88fbe87800 20 add_watcher() i=2 2024-09-22T08:36:39.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.833+0000 7f88fbe87800 20 add_watcher() i=3 2024-09-22T08:36:39.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.833+0000 7f88fbe87800 20 add_watcher() i=4 2024-09-22T08:36:39.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.833+0000 7f88fbe87800 20 add_watcher() i=5 2024-09-22T08:36:39.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.833+0000 7f88fbe87800 20 add_watcher() i=6 2024-09-22T08:36:39.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.835+0000 7f88fbe87800 20 add_watcher() i=7 2024-09-22T08:36:39.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.835+0000 7f88fbe87800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:39.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.836+0000 7f87abfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:39.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.837+0000 7f88fbe87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:39.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.837+0000 7f88fbe87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:39.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.837+0000 7f88fbe87800 5 note: GC not initialized 2024-09-22T08:36:39.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.837+0000 7f87aaffd640 20 reqs_thread_entry: start 2024-09-22T08:36:39.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.837+0000 7f88fbe87800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:39.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.837+0000 7f88fbe87800 20 Filter name: none 2024-09-22T08:36:39.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.837+0000 7f87a8ff9640 20 reqs_thread_entry: start 2024-09-22T08:36:39.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.837+0000 7f88fbe87800 20 rados->read ofs=0 len=0 2024-09-22T08:36:39.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.838+0000 7f88fbe87800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T08:36:39.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.838+0000 7f88fbe87800 20 rados->read ofs=0 len=0 2024-09-22T08:36:39.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.838+0000 7f88fbe87800 20 rados_obj.operate() r=0 bl.length=415 2024-09-22T08:36:39.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.838+0000 7f88fbe87800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:36:39.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.838+0000 7f88fbe87800 20 rados->read ofs=0 len=0 2024-09-22T08:36:39.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.839+0000 7f88fbe87800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T08:36:39.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.839+0000 7f88fbe87800 20 rados->read ofs=0 len=0 2024-09-22T08:36:39.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.839+0000 7f88fbe87800 20 rados_obj.operate() r=0 bl.length=415 2024-09-22T08:36:39.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.839+0000 7f88fbe87800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:36:39.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.841+0000 7f87abfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:39.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.843+0000 7f88fbe87800 20 remove_watcher() i=0 2024-09-22T08:36:39.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.843+0000 7f88fbe87800 2 removed watcher, disabling cache 2024-09-22T08:36:39.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.844+0000 7f88fbe87800 20 remove_watcher() i=1 2024-09-22T08:36:39.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.846+0000 7f88fbe87800 20 remove_watcher() i=2 2024-09-22T08:36:39.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.847+0000 7f88fbe87800 20 remove_watcher() i=3 2024-09-22T08:36:39.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.848+0000 7f88fbe87800 20 remove_watcher() i=4 2024-09-22T08:36:39.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.849+0000 7f88fbe87800 20 remove_watcher() i=5 2024-09-22T08:36:39.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.850+0000 7f88fbe87800 20 remove_watcher() i=6 2024-09-22T08:36:39.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:39.851+0000 7f88fbe87800 20 remove_watcher() i=7 2024-09-22T08:36:39.863 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:39.863 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:36:39.864 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-logrecord-writes id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.35 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-22T08:36:39.864 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:39.866 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:39.866 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:39.869 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:39.869 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:39.912 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:39.913 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:39.944 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-22T08:36:39.944 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:39.945 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:39.945 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:39.958 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:39.958 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:39.999 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:39.999 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:40.006 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:40.006 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:40.012 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:40.013 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:40.020 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:40.020 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:40.027 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:40.027 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:40.033 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:40.033 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:40.039 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:40.039 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:40.046 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:40.046 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:40.052 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:40.052 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:40.058 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:40.058 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:40.064 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:40.064 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:40.071 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:40.071 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:40.077 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:40.077 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:40.084 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:40.084 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:40.090 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:40.090 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:40.096 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:40.096 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:40.102 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:40.102 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:40.108 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:40.108 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:40.115 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:40.115 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:40.128 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:40.128 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:40.138 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-22T08:36:40.167 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:40.167 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:40.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.205+0000 7f3688d3b800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.207+0000 7f3688d3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.207+0000 7f3688d3b800 20 realm 2024-09-22T08:36:40.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.207+0000 7f3688d3b800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.207+0000 7f3688d3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.207+0000 7f3688d3b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:40.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.207+0000 7f3688d3b800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.207+0000 7f3688d3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.207+0000 7f3688d3b800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.208+0000 7f3688d3b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:40.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.208+0000 7f3688d3b800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.209+0000 7f3688d3b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:36:40.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.209+0000 7f3688d3b800 20 searching for the correct realm 2024-09-22T08:36:40.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.211+0000 7f3685226640 0 -- 172.21.15.38:0/2377436136 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7f367400e070 msgr2=0x7f36740601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:40.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.416+0000 7f3684a25640 0 -- 172.21.15.38:0/2377436136 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x55bae4cdaf80 msgr2=0x55bae4cdd3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:40.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.420+0000 7f3688d3b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:40.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.420+0000 7f3688d3b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:40.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.420+0000 7f3688d3b800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:36:40.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.420+0000 7f3688d3b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:40.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.420+0000 7f3688d3b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:40.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.420+0000 7f3688d3b800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:36:40.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.420+0000 7f3688d3b800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.420+0000 7f3688d3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.420+0000 7f3688d3b800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.421+0000 7f3688d3b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:40.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.421+0000 7f3688d3b800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.421+0000 7f3688d3b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:36:40.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.421+0000 7f3688d3b800 20 zone default found 2024-09-22T08:36:40.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.421+0000 7f3688d3b800 4 Realm: () 2024-09-22T08:36:40.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.421+0000 7f3688d3b800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:36:40.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.421+0000 7f3688d3b800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:36:40.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.421+0000 7f3688d3b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:40.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.421+0000 7f3688d3b800 20 zonegroup default 2024-09-22T08:36:40.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.421+0000 7f3688d3b800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.422+0000 7f3688d3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.422+0000 7f3688d3b800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.422+0000 7f3688d3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.422+0000 7f3688d3b800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.422+0000 7f3688d3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.422+0000 7f3688d3b800 20 started sync module instance, tier type = 2024-09-22T08:36:40.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.422+0000 7f3688d3b800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:36:40.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.431+0000 7f3688d3b800 20 add_watcher() i=0 2024-09-22T08:36:40.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.431+0000 7f3688d3b800 20 add_watcher() i=1 2024-09-22T08:36:40.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.431+0000 7f3688d3b800 20 add_watcher() i=2 2024-09-22T08:36:40.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.431+0000 7f3688d3b800 20 add_watcher() i=3 2024-09-22T08:36:40.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.431+0000 7f3688d3b800 20 add_watcher() i=4 2024-09-22T08:36:40.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.431+0000 7f3688d3b800 20 add_watcher() i=5 2024-09-22T08:36:40.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.431+0000 7f3688d3b800 20 add_watcher() i=6 2024-09-22T08:36:40.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.433+0000 7f3688d3b800 20 add_watcher() i=7 2024-09-22T08:36:40.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.433+0000 7f3688d3b800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:40.435 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.435+0000 7f353afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:40.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.435+0000 7f3688d3b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:40.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.435+0000 7f3688d3b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:40.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.435+0000 7f3688d3b800 5 note: GC not initialized 2024-09-22T08:36:40.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.435+0000 7f3539fe3640 20 reqs_thread_entry: start 2024-09-22T08:36:40.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.435+0000 7f3688d3b800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:40.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.435+0000 7f3688d3b800 20 Filter name: none 2024-09-22T08:36:40.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.435+0000 7f34ab7fe640 20 reqs_thread_entry: start 2024-09-22T08:36:40.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.435+0000 7f3688d3b800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.436+0000 7f3688d3b800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T08:36:40.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.436+0000 7f3688d3b800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.437+0000 7f3688d3b800 20 rados_obj.operate() r=0 bl.length=415 2024-09-22T08:36:40.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.437+0000 7f3688d3b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:36:40.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.437+0000 7f3688d3b800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.437+0000 7f3688d3b800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T08:36:40.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.437+0000 7f3688d3b800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.439 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.437+0000 7f3688d3b800 20 rados_obj.operate() r=0 bl.length=415 2024-09-22T08:36:40.439 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.437+0000 7f3688d3b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:36:40.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.439+0000 7f353afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:40.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.441+0000 7f3688d3b800 20 remove_watcher() i=0 2024-09-22T08:36:40.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.441+0000 7f3688d3b800 2 removed watcher, disabling cache 2024-09-22T08:36:40.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.442+0000 7f3688d3b800 20 remove_watcher() i=1 2024-09-22T08:36:40.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.443+0000 7f3688d3b800 20 remove_watcher() i=2 2024-09-22T08:36:40.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.444+0000 7f3688d3b800 20 remove_watcher() i=3 2024-09-22T08:36:40.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.445+0000 7f3688d3b800 20 remove_watcher() i=4 2024-09-22T08:36:40.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.447+0000 7f3688d3b800 20 remove_watcher() i=5 2024-09-22T08:36:40.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.448+0000 7f3688d3b800 20 remove_watcher() i=6 2024-09-22T08:36:40.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.449+0000 7f3688d3b800 20 remove_watcher() i=7 2024-09-22T08:36:40.461 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:40.461 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:36:40.461 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-logrecord-writes id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:36:40.461 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:40.462 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-22T08:36:40.497 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:40.497 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:40.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.536+0000 7f8edce13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.538+0000 7f8edce13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.538+0000 7f8edce13800 20 realm 2024-09-22T08:36:40.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.538+0000 7f8edce13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.538+0000 7f8edce13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.538+0000 7f8edce13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:40.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.538+0000 7f8edce13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.538+0000 7f8edce13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.538+0000 7f8edce13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.539+0000 7f8edce13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:40.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.539+0000 7f8edce13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.540+0000 7f8edce13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:36:40.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.540+0000 7f8edce13800 20 searching for the correct realm 2024-09-22T08:36:40.543 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.542+0000 7f8ed7d91640 0 -- 172.21.15.38:0/1622099161 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f8ecc07b030 msgr2=0x7f8ecc02b780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:40.546 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.545+0000 7f8ed7d91640 0 -- 172.21.15.38:0/1622099161 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f8ec80cd040 msgr2=0x7f8ec80de050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:40.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.752+0000 7f8edce13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:40.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.752+0000 7f8edce13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:40.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.752+0000 7f8edce13800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:36:40.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.752+0000 7f8edce13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:40.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.752+0000 7f8edce13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:40.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.752+0000 7f8edce13800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:36:40.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.752+0000 7f8edce13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.752+0000 7f8edce13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.752+0000 7f8edce13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.753+0000 7f8edce13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:40.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.753+0000 7f8edce13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.753+0000 7f8edce13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:36:40.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.753+0000 7f8edce13800 20 zone default found 2024-09-22T08:36:40.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.753+0000 7f8edce13800 4 Realm: () 2024-09-22T08:36:40.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.753+0000 7f8edce13800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:36:40.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.753+0000 7f8edce13800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:36:40.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.753+0000 7f8edce13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:40.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.753+0000 7f8edce13800 20 zonegroup default 2024-09-22T08:36:40.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.753+0000 7f8edce13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.753+0000 7f8edce13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.753+0000 7f8edce13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.754+0000 7f8edce13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.754+0000 7f8edce13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.754+0000 7f8edce13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.754+0000 7f8edce13800 20 started sync module instance, tier type = 2024-09-22T08:36:40.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.754+0000 7f8edce13800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:36:40.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.764+0000 7f8edce13800 20 add_watcher() i=0 2024-09-22T08:36:40.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.764+0000 7f8edce13800 20 add_watcher() i=1 2024-09-22T08:36:40.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.764+0000 7f8edce13800 20 add_watcher() i=2 2024-09-22T08:36:40.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.764+0000 7f8edce13800 20 add_watcher() i=3 2024-09-22T08:36:40.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.764+0000 7f8edce13800 20 add_watcher() i=4 2024-09-22T08:36:40.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.764+0000 7f8edce13800 20 add_watcher() i=5 2024-09-22T08:36:40.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.764+0000 7f8edce13800 20 add_watcher() i=6 2024-09-22T08:36:40.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.766+0000 7f8edce13800 20 add_watcher() i=7 2024-09-22T08:36:40.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.766+0000 7f8edce13800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:40.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.768+0000 7f8d8efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:40.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.768+0000 7f8edce13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:40.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.768+0000 7f8edce13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:40.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.768+0000 7f8edce13800 5 note: GC not initialized 2024-09-22T08:36:40.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.768+0000 7f8d8dfdb640 20 reqs_thread_entry: start 2024-09-22T08:36:40.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.769+0000 7f8edce13800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:40.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.769+0000 7f8edce13800 20 Filter name: none 2024-09-22T08:36:40.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.769+0000 7f8cff7fe640 20 reqs_thread_entry: start 2024-09-22T08:36:40.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.769+0000 7f8edce13800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-22T08:36:40.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.769+0000 7f8edce13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.769+0000 7f8edce13800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T08:36:40.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.769+0000 7f8edce13800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-22T08:36:40.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.769+0000 7f8edce13800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-22T08:36:40.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.769+0000 7f8edce13800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 : miss 2024-09-22T08:36:40.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.769+0000 7f8edce13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.770+0000 7f8edce13800 20 rados_obj.operate() r=0 bl.length=415 2024-09-22T08:36:40.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.770+0000 7f8edce13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 info.flags=0x17 2024-09-22T08:36:40.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.770+0000 7f8edce13800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 to cache LRU end 2024-09-22T08:36:40.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.770+0000 7f8edce13800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:40.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.770+0000 7f8edce13800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:40.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.770+0000 7f8edce13800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 2024-09-22T08:36:40.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.775+0000 7f8edce13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 info.flags=0x17 2024-09-22T08:36:40.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.775+0000 7f8edce13800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 to cache LRU end 2024-09-22T08:36:40.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.775+0000 7f8edce13800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:40.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.775+0000 7f8edce13800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36, ofs0, ns] 2024-09-22T08:36:40.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.776+0000 7f8daeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497110 cookie 93861951621632 notifier 7650 bl.length()=923 2024-09-22T08:36:40.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.776+0000 7f8daeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 info.flags=0x17 2024-09-22T08:36:40.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.776+0000 7f8daeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 to cache LRU end 2024-09-22T08:36:40.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.776+0000 7f8daeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:40.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.776+0000 7f8edce13800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.36]): orig_sources= new_sources= 2024-09-22T08:36:40.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.776+0000 7f8edce13800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.36]): potential sources added=[] removed=[] 2024-09-22T08:36:40.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.776+0000 7f8edce13800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.36]): orig_dests= new_dests= 2024-09-22T08:36:40.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.776+0000 7f8edce13800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.36]): potential dests added=[] removed=[] 2024-09-22T08:36:40.781 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8edce13800 time 2024-09-22T08:36:40.781083+0000 2024-09-22T08:36:40.781 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:36:40.782 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:36:40.782 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8eddf8c748] 2024-09-22T08:36:40.782 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f8eddf8c906] 2024-09-22T08:36:40.782 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555def250e01] 2024-09-22T08:36:40.782 INFO:tasks.workunit.client.0.smithi038.stderr: 4: radosgw-admin(+0xd8186c) [0x555def76386c] 2024-09-22T08:36:40.782 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x555def260c9d] 2024-09-22T08:36:40.782 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-22T08:36:40.782 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8edcc29590] 2024-09-22T08:36:40.782 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-22T08:36:40.782 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-22T08:36:40.782 INFO:tasks.workunit.client.0.smithi038.stderr:*** Caught signal (Aborted) ** 2024-09-22T08:36:40.783 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f8edce13800 thread_name:radosgw-admin 2024-09-22T08:36:40.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.781+0000 7f8edce13800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8edce13800 time 2024-09-22T08:36:40.781083+0000 2024-09-22T08:36:40.783 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:36:40.783 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:40.783 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:36:40.783 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8eddf8c748] 2024-09-22T08:36:40.783 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f8eddf8c906] 2024-09-22T08:36:40.783 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555def250e01] 2024-09-22T08:36:40.784 INFO:tasks.workunit.client.0.smithi038.stderr: 4: radosgw-admin(+0xd8186c) [0x555def76386c] 2024-09-22T08:36:40.784 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x555def260c9d] 2024-09-22T08:36:40.784 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-22T08:36:40.784 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8edcc29590] 2024-09-22T08:36:40.784 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-22T08:36:40.784 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-22T08:36:40.784 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:40.803 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:36:40.804 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8edcc3e6f0] 2024-09-22T08:36:40.804 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8edcc8b99c] 2024-09-22T08:36:40.804 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:36:40.804 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:36:40.804 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8eddf8c7a2] 2024-09-22T08:36:40.804 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f8eddf8c906] 2024-09-22T08:36:40.804 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555def250e01] 2024-09-22T08:36:40.804 INFO:tasks.workunit.client.0.smithi038.stderr: 8: radosgw-admin(+0xd8186c) [0x555def76386c] 2024-09-22T08:36:40.805 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x555def260c9d] 2024-09-22T08:36:40.805 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-22T08:36:40.805 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8edcc29590] 2024-09-22T08:36:40.805 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-22T08:36:40.805 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-22T08:36:40.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.781+0000 7f8edce13800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:36:40.805 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f8edce13800 thread_name:radosgw-admin 2024-09-22T08:36:40.805 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:40.805 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:36:40.805 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8edcc3e6f0] 2024-09-22T08:36:40.805 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8edcc8b99c] 2024-09-22T08:36:40.806 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:36:40.806 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:36:40.806 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8eddf8c7a2] 2024-09-22T08:36:40.806 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f8eddf8c906] 2024-09-22T08:36:40.806 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555def250e01] 2024-09-22T08:36:40.806 INFO:tasks.workunit.client.0.smithi038.stderr: 8: radosgw-admin(+0xd8186c) [0x555def76386c] 2024-09-22T08:36:40.806 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x555def260c9d] 2024-09-22T08:36:40.806 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-22T08:36:40.806 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8edcc29590] 2024-09-22T08:36:40.806 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-22T08:36:40.806 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-22T08:36:40.806 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:36:40.807 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:40.807 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-22T08:36:40.807 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-22T08:36:40.518+0000 7f8edce13800 10 monclient: build_initial_monmap 2024-09-22T08:36:40.807 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-22T08:36:40.518+0000 7f8edce13800 1 build_initial for_mkfs: 0 2024-09-22T08:36:40.807 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-22T08:36:40.518+0000 7f8edce13800 10 monclient: monmap: 2024-09-22T08:36:40.807 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:36:40.807 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:36:40.807 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:36:40.807 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:36:40.807 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:36:40.807 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:40.807 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:36:40.807 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:36:40.808 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:36:40.808 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:40.808 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-22T08:36:40.518+0000 7f8edce13800 5 AuthRegistry(0x555df03935c0) adding auth protocol: cephx 2024-09-22T08:36:40.808 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-22T08:36:40.518+0000 7f8edce13800 5 AuthRegistry(0x555df03935c0) adding auth protocol: cephx 2024-09-22T08:36:40.808 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-22T08:36:40.518+0000 7f8edce13800 5 AuthRegistry(0x555df03935c0) adding auth protocol: cephx 2024-09-22T08:36:40.808 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-22T08:36:40.518+0000 7f8edce13800 5 AuthRegistry(0x555df03935c0) adding con mode: secure 2024-09-22T08:36:40.808 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-22T08:36:40.518+0000 7f8edce13800 5 AuthRegistry(0x555df03935c0) adding con mode: crc 2024-09-22T08:36:40.808 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-22T08:36:40.518+0000 7f8edce13800 5 AuthRegistry(0x555df03935c0) adding con mode: secure 2024-09-22T08:36:40.808 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-22T08:36:40.518+0000 7f8edce13800 5 AuthRegistry(0x555df03935c0) adding con mode: crc 2024-09-22T08:36:40.808 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-22T08:36:40.518+0000 7f8edce13800 5 AuthRegistry(0x555df03935c0) adding con mode: secure 2024-09-22T08:36:40.808 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-22T08:36:40.518+0000 7f8edce13800 5 AuthRegistry(0x555df03935c0) adding con mode: crc 2024-09-22T08:36:40.808 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-22T08:36:40.518+0000 7f8edce13800 5 AuthRegistry(0x555df03935c0) adding con mode: crc 2024-09-22T08:36:40.808 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-22T08:36:40.518+0000 7f8edce13800 5 AuthRegistry(0x555df03935c0) adding con mode: secure 2024-09-22T08:36:40.808 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-22T08:36:40.518+0000 7f8edce13800 5 AuthRegistry(0x555df03935c0) adding con mode: crc 2024-09-22T08:36:40.809 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-22T08:36:40.518+0000 7f8edce13800 5 AuthRegistry(0x555df03935c0) adding con mode: secure 2024-09-22T08:36:40.809 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-22T08:36:40.518+0000 7f8edce13800 5 AuthRegistry(0x555df03935c0) adding con mode: crc 2024-09-22T08:36:40.809 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-22T08:36:40.518+0000 7f8edce13800 5 AuthRegistry(0x555df03935c0) adding con mode: secure 2024-09-22T08:36:40.809 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-22T08:36:40.518+0000 7f8edce13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:40.809 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-22T08:36:40.518+0000 7f8edce13800 1 librados: starting msgr at 2024-09-22T08:36:40.809 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-22T08:36:40.518+0000 7f8edce13800 1 librados: starting objecter 2024-09-22T08:36:40.809 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-22T08:36:40.519+0000 7f8edce13800 5 asok(0x555df016c0f0) register_command objecter_requests hook 0x555df03bf290 2024-09-22T08:36:40.809 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-22T08:36:40.519+0000 7f8edce13800 1 librados: setting wanted keys 2024-09-22T08:36:40.809 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-22T08:36:40.519+0000 7f8edce13800 1 librados: calling monclient init 2024-09-22T08:36:40.809 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-22T08:36:40.519+0000 7f8edce13800 10 monclient: init 2024-09-22T08:36:40.810 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-22T08:36:40.519+0000 7f8edce13800 5 AuthRegistry(0x555df038dfd0) adding auth protocol: cephx 2024-09-22T08:36:40.810 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-22T08:36:40.519+0000 7f8edce13800 5 AuthRegistry(0x555df038dfd0) adding auth protocol: cephx 2024-09-22T08:36:40.810 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-22T08:36:40.519+0000 7f8edce13800 5 AuthRegistry(0x555df038dfd0) adding auth protocol: cephx 2024-09-22T08:36:40.810 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-22T08:36:40.519+0000 7f8edce13800 5 AuthRegistry(0x555df038dfd0) adding con mode: secure 2024-09-22T08:36:40.810 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-22T08:36:40.519+0000 7f8edce13800 5 AuthRegistry(0x555df038dfd0) adding con mode: crc 2024-09-22T08:36:40.810 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-22T08:36:40.519+0000 7f8edce13800 5 AuthRegistry(0x555df038dfd0) adding con mode: secure 2024-09-22T08:36:40.810 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-22T08:36:40.519+0000 7f8edce13800 5 AuthRegistry(0x555df038dfd0) adding con mode: crc 2024-09-22T08:36:40.810 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-22T08:36:40.519+0000 7f8edce13800 5 AuthRegistry(0x555df038dfd0) adding con mode: secure 2024-09-22T08:36:40.810 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-22T08:36:40.519+0000 7f8edce13800 5 AuthRegistry(0x555df038dfd0) adding con mode: crc 2024-09-22T08:36:40.810 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-22T08:36:40.519+0000 7f8edce13800 5 AuthRegistry(0x555df038dfd0) adding con mode: crc 2024-09-22T08:36:40.811 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-22T08:36:40.519+0000 7f8edce13800 5 AuthRegistry(0x555df038dfd0) adding con mode: secure 2024-09-22T08:36:40.811 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-22T08:36:40.519+0000 7f8edce13800 5 AuthRegistry(0x555df038dfd0) adding con mode: crc 2024-09-22T08:36:40.811 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-22T08:36:40.519+0000 7f8edce13800 5 AuthRegistry(0x555df038dfd0) adding con mode: secure 2024-09-22T08:36:40.811 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-22T08:36:40.519+0000 7f8edce13800 5 AuthRegistry(0x555df038dfd0) adding con mode: crc 2024-09-22T08:36:40.811 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-22T08:36:40.519+0000 7f8edce13800 5 AuthRegistry(0x555df038dfd0) adding con mode: secure 2024-09-22T08:36:40.811 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-22T08:36:40.519+0000 7f8edce13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:40.811 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-22T08:36:40.519+0000 7f8edce13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:40.811 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-22T08:36:40.519+0000 7f8edce13800 5 asok(0x555df016c0f0) register_command rotate-key hook 0x555df038e118 2024-09-22T08:36:40.811 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-22T08:36:40.519+0000 7f8edce13800 10 monclient: _reopen_session rank -1 2024-09-22T08:36:40.811 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-22T08:36:40.519+0000 7f8edce13800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T08:36:40.811 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-22T08:36:40.519+0000 7f8edce13800 10 monclient(hunting): picked mon.noname-c con 0x555df02d0830 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:36:40.811 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-22T08:36:40.519+0000 7f8edce13800 10 monclient(hunting): picked mon.noname-a con 0x555df02d38f0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:36:40.811 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-22T08:36:40.519+0000 7f8edce13800 10 monclient(hunting): picked mon.noname-b con 0x555df02d69e0 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:36:40.811 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-22T08:36:40.519+0000 7f8edce13800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:40.812 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-22T08:36:40.519+0000 7f8edce13800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:40.812 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-22T08:36:40.519+0000 7f8edce13800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:40.812 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-22T08:36:40.519+0000 7f8edce13800 10 monclient(hunting): _renew_subs 2024-09-22T08:36:40.812 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-22T08:36:40.519+0000 7f8edce13800 10 monclient(hunting): authenticate will time out at 2105.758757s 2024-09-22T08:36:40.812 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-22T08:36:40.519+0000 7f8ed7d91640 10 monclient(hunting): get_auth_request con 0x555df02d38f0 auth_method 0 2024-09-22T08:36:40.812 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-22T08:36:40.519+0000 7f8ed7d91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:40.812 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-22T08:36:40.519+0000 7f8ed7d91640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:40.812 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-22T08:36:40.519+0000 7f8ed7d91640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:40.812 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-22T08:36:40.519+0000 7f8ed8592640 10 monclient(hunting): get_auth_request con 0x555df02d0830 auth_method 0 2024-09-22T08:36:40.812 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-22T08:36:40.519+0000 7f8ed8592640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:40.812 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-22T08:36:40.519+0000 7f8ed8592640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:40.812 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-22T08:36:40.519+0000 7f8ed8592640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:40.812 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-22T08:36:40.519+0000 7f8ed7d91640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:36:40.813 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-22T08:36:40.519+0000 7f8ed7d91640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:36:40.813 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-22T08:36:40.519+0000 7f8ed7d91640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:36:40.813 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-22T08:36:40.519+0000 7f8ed8592640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:36:40.813 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-22T08:36:40.519+0000 7f8ed8592640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:36:40.813 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-22T08:36:40.519+0000 7f8ed8592640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:36:40.813 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-22T08:36:40.519+0000 7f8ed8d93640 10 monclient(hunting): get_auth_request con 0x555df02d69e0 auth_method 0 2024-09-22T08:36:40.813 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-22T08:36:40.519+0000 7f8ed8d93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:40.813 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-22T08:36:40.519+0000 7f8ed8d93640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:40.813 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-22T08:36:40.519+0000 7f8ed8d93640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:40.813 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-22T08:36:40.520+0000 7f8ed8d93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:36:40.813 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-22T08:36:40.520+0000 7f8ed8d93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:36:40.813 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-22T08:36:40.520+0000 7f8ed8d93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:36:40.813 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-22T08:36:40.520+0000 7f8ed8592640 10 monclient(hunting): handle_auth_done global_id 7178 payload 824 2024-09-22T08:36:40.814 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-22T08:36:40.520+0000 7f8ed8592640 10 monclient: _finish_hunting 0 2024-09-22T08:36:40.814 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-22T08:36:40.520+0000 7f8ed8592640 1 monclient: found mon.noname-c 2024-09-22T08:36:40.814 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-22T08:36:40.520+0000 7f8ed8592640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:36:40.814 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-22T08:36:40.520+0000 7f8dc4e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:36:40.814 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-22T08:36:40.520+0000 7f8dc4e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:36:40.814 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-22T08:36:40.520+0000 7f8dc4e09640 10 monclient: dump: 2024-09-22T08:36:40.814 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:36:40.814 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:36:40.814 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:40.814 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:40.814 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:36:40.814 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:40.814 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:36:40.815 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:36:40.815 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:36:40.815 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:40.815 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-22T08:36:40.520+0000 7f8dc4e09640 10 monclient: _finish_auth 0 2024-09-22T08:36:40.815 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-22T08:36:40.520+0000 7f8dc4e09640 10 monclient: _check_auth_tickets 2024-09-22T08:36:40.815 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-22T08:36:40.520+0000 7f8dc4e09640 10 monclient: handle_config config(0 keys) 2024-09-22T08:36:40.815 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-22T08:36:40.520+0000 7f8dc4e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:36:40.815 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-22T08:36:40.520+0000 7f8dc4e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:36:40.815 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-22T08:36:40.520+0000 7f8dc4e09640 10 monclient: dump: 2024-09-22T08:36:40.815 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:36:40.815 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:36:40.815 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:40.815 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:40.815 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:36:40.816 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:40.816 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:36:40.816 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:36:40.816 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:36:40.817 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:40.817 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-22T08:36:40.520+0000 7f8edce13800 5 monclient: authenticate success, global_id 7178 2024-09-22T08:36:40.817 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-22T08:36:40.520+0000 7f8edce13800 10 monclient: _renew_subs 2024-09-22T08:36:40.817 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-22T08:36:40.520+0000 7f8edce13800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:36:40.817 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-22T08:36:40.520+0000 7f8dc660c640 4 set_mon_vals no callback set 2024-09-22T08:36:40.817 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-22T08:36:40.520+0000 7f8edce13800 10 monclient: _renew_subs 2024-09-22T08:36:40.817 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-22T08:36:40.520+0000 7f8edce13800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:36:40.817 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-22T08:36:40.520+0000 7f8edce13800 1 librados: init done 2024-09-22T08:36:40.817 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-22T08:36:40.522+0000 7f8dc4e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:36:40.817 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-22T08:36:40.522+0000 7f8dc4e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:36:40.817 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-22T08:36:40.522+0000 7f8dc4e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:36:40.818 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-22T08:36:40.522+0000 7f8ed7d91640 10 monclient: get_auth_request con 0x7f8dc0077570 auth_method 0 2024-09-22T08:36:40.818 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-22T08:36:40.523+0000 7f8ed8d93640 10 monclient: get_auth_request con 0x555df03b69d0 auth_method 0 2024-09-22T08:36:40.818 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-22T08:36:40.523+0000 7f8ed8592640 10 monclient: get_auth_request con 0x555df03d9730 auth_method 0 2024-09-22T08:36:40.818 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-22T08:36:40.524+0000 7f8ed7d91640 10 monclient: get_auth_request con 0x555df03dd970 auth_method 0 2024-09-22T08:36:40.818 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-22T08:36:40.525+0000 7f8ed8d93640 10 monclient: get_auth_request con 0x555df03dcf90 auth_method 0 2024-09-22T08:36:40.818 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-22T08:36:40.526+0000 7f8edce13800 10 monclient: build_initial_monmap 2024-09-22T08:36:40.818 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-22T08:36:40.526+0000 7f8edce13800 1 build_initial for_mkfs: 0 2024-09-22T08:36:40.818 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-22T08:36:40.526+0000 7f8edce13800 10 monclient: monmap: 2024-09-22T08:36:40.818 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:36:40.818 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:36:40.818 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:36:40.818 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:36:40.818 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:36:40.818 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:40.819 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:36:40.819 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:36:40.819 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:36:40.819 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:40.819 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-22T08:36:40.526+0000 7f8edce13800 5 AuthRegistry(0x555df03e5b60) adding auth protocol: cephx 2024-09-22T08:36:40.819 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-22T08:36:40.526+0000 7f8edce13800 5 AuthRegistry(0x555df03e5b60) adding auth protocol: cephx 2024-09-22T08:36:40.819 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-22T08:36:40.526+0000 7f8edce13800 5 AuthRegistry(0x555df03e5b60) adding auth protocol: cephx 2024-09-22T08:36:40.819 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-22T08:36:40.526+0000 7f8edce13800 5 AuthRegistry(0x555df03e5b60) adding con mode: secure 2024-09-22T08:36:40.819 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-22T08:36:40.526+0000 7f8edce13800 5 AuthRegistry(0x555df03e5b60) adding con mode: crc 2024-09-22T08:36:40.819 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-22T08:36:40.526+0000 7f8edce13800 5 AuthRegistry(0x555df03e5b60) adding con mode: secure 2024-09-22T08:36:40.819 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-22T08:36:40.526+0000 7f8edce13800 5 AuthRegistry(0x555df03e5b60) adding con mode: crc 2024-09-22T08:36:40.819 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-22T08:36:40.526+0000 7f8edce13800 5 AuthRegistry(0x555df03e5b60) adding con mode: secure 2024-09-22T08:36:40.819 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-22T08:36:40.526+0000 7f8edce13800 5 AuthRegistry(0x555df03e5b60) adding con mode: crc 2024-09-22T08:36:40.820 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-22T08:36:40.526+0000 7f8edce13800 5 AuthRegistry(0x555df03e5b60) adding con mode: crc 2024-09-22T08:36:40.820 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-22T08:36:40.526+0000 7f8edce13800 5 AuthRegistry(0x555df03e5b60) adding con mode: secure 2024-09-22T08:36:40.820 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-22T08:36:40.526+0000 7f8edce13800 5 AuthRegistry(0x555df03e5b60) adding con mode: crc 2024-09-22T08:36:40.820 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-22T08:36:40.526+0000 7f8edce13800 5 AuthRegistry(0x555df03e5b60) adding con mode: secure 2024-09-22T08:36:40.820 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-22T08:36:40.526+0000 7f8edce13800 5 AuthRegistry(0x555df03e5b60) adding con mode: crc 2024-09-22T08:36:40.820 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-22T08:36:40.526+0000 7f8edce13800 5 AuthRegistry(0x555df03e5b60) adding con mode: secure 2024-09-22T08:36:40.820 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-22T08:36:40.526+0000 7f8edce13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:40.820 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-22T08:36:40.526+0000 7f8edce13800 5 asok(0x555df016c0f0) register_command objecter_requests cmddesc objecter_requests hook 0x555df03e8ff0 EEXIST 2024-09-22T08:36:40.820 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-22T08:36:40.527+0000 7f8edce13800 10 monclient: init 2024-09-22T08:36:40.820 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-22T08:36:40.527+0000 7f8edce13800 5 AuthRegistry(0x555df03e4968) adding auth protocol: cephx 2024-09-22T08:36:40.820 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-22T08:36:40.527+0000 7f8edce13800 5 AuthRegistry(0x555df03e4968) adding auth protocol: cephx 2024-09-22T08:36:40.820 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-22T08:36:40.527+0000 7f8edce13800 5 AuthRegistry(0x555df03e4968) adding auth protocol: cephx 2024-09-22T08:36:40.820 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-22T08:36:40.527+0000 7f8edce13800 5 AuthRegistry(0x555df03e4968) adding con mode: secure 2024-09-22T08:36:40.821 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-22T08:36:40.527+0000 7f8edce13800 5 AuthRegistry(0x555df03e4968) adding con mode: crc 2024-09-22T08:36:40.821 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-22T08:36:40.527+0000 7f8edce13800 5 AuthRegistry(0x555df03e4968) adding con mode: secure 2024-09-22T08:36:40.821 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-22T08:36:40.527+0000 7f8edce13800 5 AuthRegistry(0x555df03e4968) adding con mode: crc 2024-09-22T08:36:40.821 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-22T08:36:40.527+0000 7f8edce13800 5 AuthRegistry(0x555df03e4968) adding con mode: secure 2024-09-22T08:36:40.821 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-22T08:36:40.527+0000 7f8edce13800 5 AuthRegistry(0x555df03e4968) adding con mode: crc 2024-09-22T08:36:40.821 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-22T08:36:40.527+0000 7f8edce13800 5 AuthRegistry(0x555df03e4968) adding con mode: crc 2024-09-22T08:36:40.821 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-22T08:36:40.527+0000 7f8edce13800 5 AuthRegistry(0x555df03e4968) adding con mode: secure 2024-09-22T08:36:40.821 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-22T08:36:40.527+0000 7f8edce13800 5 AuthRegistry(0x555df03e4968) adding con mode: crc 2024-09-22T08:36:40.821 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-22T08:36:40.527+0000 7f8edce13800 5 AuthRegistry(0x555df03e4968) adding con mode: secure 2024-09-22T08:36:40.821 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-22T08:36:40.527+0000 7f8edce13800 5 AuthRegistry(0x555df03e4968) adding con mode: crc 2024-09-22T08:36:40.821 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-22T08:36:40.527+0000 7f8edce13800 5 AuthRegistry(0x555df03e4968) adding con mode: secure 2024-09-22T08:36:40.821 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-22T08:36:40.527+0000 7f8edce13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:40.821 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-22T08:36:40.527+0000 7f8edce13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:40.821 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-22T08:36:40.527+0000 7f8edce13800 5 asok(0x555df016c0f0) register_command rotate-key cmddesc rotate-key hook 0x555df03e4ab0 EEXIST 2024-09-22T08:36:40.822 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-22T08:36:40.527+0000 7f8edce13800 10 monclient: _reopen_session rank -1 2024-09-22T08:36:40.822 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-22T08:36:40.527+0000 7f8edce13800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-22T08:36:40.822 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-22T08:36:40.527+0000 7f8edce13800 10 monclient(hunting): picked mon.noname-c con 0x555df040d310 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:36:40.822 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-22T08:36:40.527+0000 7f8edce13800 10 monclient(hunting): picked mon.noname-b con 0x555df040d6f0 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:36:40.822 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-22T08:36:40.527+0000 7f8edce13800 10 monclient(hunting): picked mon.noname-a con 0x555df040c020 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:36:40.822 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-22T08:36:40.527+0000 7f8edce13800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:40.822 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-22T08:36:40.527+0000 7f8edce13800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:40.822 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-22T08:36:40.527+0000 7f8edce13800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:40.822 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-22T08:36:40.527+0000 7f8edce13800 10 monclient(hunting): _renew_subs 2024-09-22T08:36:40.822 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-22T08:36:40.527+0000 7f8edce13800 10 monclient(hunting): authenticate will time out at 2105.766580s 2024-09-22T08:36:40.822 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-22T08:36:40.527+0000 7f8ed7d91640 10 monclient(hunting): get_auth_request con 0x555df040d310 auth_method 0 2024-09-22T08:36:40.822 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-22T08:36:40.527+0000 7f8ed7d91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:40.823 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-22T08:36:40.527+0000 7f8ed7d91640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:40.823 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-22T08:36:40.527+0000 7f8ed7d91640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:40.823 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-22T08:36:40.527+0000 7f8ed8592640 10 monclient(hunting): get_auth_request con 0x555df040c020 auth_method 0 2024-09-22T08:36:40.823 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-22T08:36:40.527+0000 7f8ed8592640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:40.823 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-22T08:36:40.527+0000 7f8ed8592640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:40.823 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-22T08:36:40.527+0000 7f8ed8592640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:40.823 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-22T08:36:40.527+0000 7f8ed8d93640 10 monclient(hunting): get_auth_request con 0x555df040d6f0 auth_method 0 2024-09-22T08:36:40.823 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-22T08:36:40.527+0000 7f8ed8d93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:40.823 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-22T08:36:40.527+0000 7f8ed8d93640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:40.823 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-22T08:36:40.527+0000 7f8ed8d93640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:40.823 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-22T08:36:40.527+0000 7f8ed7d91640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:36:40.823 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-22T08:36:40.527+0000 7f8ed7d91640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:36:40.823 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-22T08:36:40.527+0000 7f8ed7d91640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:36:40.823 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-22T08:36:40.527+0000 7f8ed8592640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:36:40.824 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-22T08:36:40.527+0000 7f8ed8592640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:36:40.824 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-22T08:36:40.527+0000 7f8ed8592640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:36:40.824 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-22T08:36:40.527+0000 7f8ed8d93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:36:40.824 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-22T08:36:40.527+0000 7f8ed8d93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:36:40.824 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-22T08:36:40.527+0000 7f8ed8d93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:36:40.824 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-22T08:36:40.527+0000 7f8ed7d91640 10 monclient(hunting): handle_auth_done global_id 7181 payload 824 2024-09-22T08:36:40.824 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-22T08:36:40.527+0000 7f8ed7d91640 10 monclient: _finish_hunting 0 2024-09-22T08:36:40.824 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-22T08:36:40.527+0000 7f8ed7d91640 1 monclient: found mon.noname-c 2024-09-22T08:36:40.824 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-22T08:36:40.527+0000 7f8ed7d91640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:36:40.824 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-22T08:36:40.528+0000 7f8dbdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:36:40.824 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-22T08:36:40.528+0000 7f8dbdffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:36:40.824 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-22T08:36:40.528+0000 7f8dbdffb640 10 monclient: dump: 2024-09-22T08:36:40.824 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:36:40.824 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:36:40.825 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:40.825 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:40.825 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:36:40.825 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:40.825 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:36:40.825 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:36:40.825 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:36:40.825 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:40.825 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-22T08:36:40.528+0000 7f8dbdffb640 10 monclient: _finish_auth 0 2024-09-22T08:36:40.825 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-22T08:36:40.528+0000 7f8dbdffb640 10 monclient: _check_auth_tickets 2024-09-22T08:36:40.825 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-22T08:36:40.528+0000 7f8dbdffb640 10 monclient: handle_config config(0 keys) 2024-09-22T08:36:40.825 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-22T08:36:40.528+0000 7f8dbdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:36:40.825 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-22T08:36:40.528+0000 7f8dbdffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:36:40.825 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-22T08:36:40.528+0000 7f8dbdffb640 10 monclient: dump: 2024-09-22T08:36:40.825 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:36:40.826 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:36:40.826 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:40.826 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:40.826 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:36:40.826 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:40.826 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:36:40.826 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:36:40.826 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:36:40.826 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:40.826 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-22T08:36:40.528+0000 7f8edce13800 5 monclient: authenticate success, global_id 7181 2024-09-22T08:36:40.826 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-22T08:36:40.528+0000 7f8ed9594640 4 set_mon_vals no callback set 2024-09-22T08:36:40.826 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-22T08:36:40.528+0000 7f8edce13800 10 monclient: _renew_subs 2024-09-22T08:36:40.826 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-22T08:36:40.528+0000 7f8edce13800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:36:40.827 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-22T08:36:40.528+0000 7f8edce13800 10 monclient: _renew_subs 2024-09-22T08:36:40.827 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-22T08:36:40.528+0000 7f8edce13800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:36:40.827 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-22T08:36:40.530+0000 7f8dbdffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:36:40.827 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-22T08:36:40.530+0000 7f8dbdffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:36:40.827 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-22T08:36:40.530+0000 7f8dbdffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:36:40.827 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-22T08:36:40.530+0000 7f8ed8d93640 10 monclient: get_auth_request con 0x7f8db0077480 auth_method 0 2024-09-22T08:36:40.827 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-22T08:36:40.530+0000 7f8edce13800 10 monclient: get_monmap_and_config 2024-09-22T08:36:40.827 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-22T08:36:40.530+0000 7f8edce13800 10 monclient: build_initial_monmap 2024-09-22T08:36:40.827 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-22T08:36:40.530+0000 7f8edce13800 1 build_initial for_mkfs: 0 2024-09-22T08:36:40.827 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-22T08:36:40.530+0000 7f8edce13800 10 monclient: monmap: 2024-09-22T08:36:40.827 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:36:40.827 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:36:40.827 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:36:40.827 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:36:40.828 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:36:40.828 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:40.828 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:36:40.828 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:36:40.828 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:36:40.828 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:40.828 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-22T08:36:40.530+0000 7f8edce13800 5 AuthRegistry(0x555df042d2d0) adding auth protocol: cephx 2024-09-22T08:36:40.828 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-22T08:36:40.530+0000 7f8edce13800 5 AuthRegistry(0x555df042d2d0) adding auth protocol: cephx 2024-09-22T08:36:40.828 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-22T08:36:40.530+0000 7f8edce13800 5 AuthRegistry(0x555df042d2d0) adding auth protocol: cephx 2024-09-22T08:36:40.828 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-22T08:36:40.530+0000 7f8edce13800 5 AuthRegistry(0x555df042d2d0) adding con mode: secure 2024-09-22T08:36:40.828 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-22T08:36:40.530+0000 7f8edce13800 5 AuthRegistry(0x555df042d2d0) adding con mode: crc 2024-09-22T08:36:40.828 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-22T08:36:40.530+0000 7f8edce13800 5 AuthRegistry(0x555df042d2d0) adding con mode: secure 2024-09-22T08:36:40.828 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-22T08:36:40.530+0000 7f8edce13800 5 AuthRegistry(0x555df042d2d0) adding con mode: crc 2024-09-22T08:36:40.828 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-22T08:36:40.530+0000 7f8edce13800 5 AuthRegistry(0x555df042d2d0) adding con mode: secure 2024-09-22T08:36:40.829 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-22T08:36:40.530+0000 7f8edce13800 5 AuthRegistry(0x555df042d2d0) adding con mode: crc 2024-09-22T08:36:40.829 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-22T08:36:40.530+0000 7f8edce13800 5 AuthRegistry(0x555df042d2d0) adding con mode: crc 2024-09-22T08:36:40.829 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-22T08:36:40.530+0000 7f8edce13800 5 AuthRegistry(0x555df042d2d0) adding con mode: secure 2024-09-22T08:36:40.829 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-22T08:36:40.530+0000 7f8edce13800 5 AuthRegistry(0x555df042d2d0) adding con mode: crc 2024-09-22T08:36:40.829 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-22T08:36:40.530+0000 7f8edce13800 5 AuthRegistry(0x555df042d2d0) adding con mode: secure 2024-09-22T08:36:40.829 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-22T08:36:40.530+0000 7f8edce13800 5 AuthRegistry(0x555df042d2d0) adding con mode: crc 2024-09-22T08:36:40.829 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-22T08:36:40.530+0000 7f8edce13800 5 AuthRegistry(0x555df042d2d0) adding con mode: secure 2024-09-22T08:36:40.829 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-22T08:36:40.531+0000 7f8edce13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:40.829 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-22T08:36:40.531+0000 7f8edce13800 10 monclient: init 2024-09-22T08:36:40.829 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-22T08:36:40.531+0000 7f8edce13800 5 AuthRegistry(0x7ffe45681da0) adding auth protocol: cephx 2024-09-22T08:36:40.829 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-22T08:36:40.531+0000 7f8edce13800 5 AuthRegistry(0x7ffe45681da0) adding auth protocol: cephx 2024-09-22T08:36:40.829 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-22T08:36:40.531+0000 7f8edce13800 5 AuthRegistry(0x7ffe45681da0) adding auth protocol: cephx 2024-09-22T08:36:40.829 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-22T08:36:40.531+0000 7f8edce13800 5 AuthRegistry(0x7ffe45681da0) adding con mode: secure 2024-09-22T08:36:40.829 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-22T08:36:40.531+0000 7f8edce13800 5 AuthRegistry(0x7ffe45681da0) adding con mode: crc 2024-09-22T08:36:40.829 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-22T08:36:40.531+0000 7f8edce13800 5 AuthRegistry(0x7ffe45681da0) adding con mode: secure 2024-09-22T08:36:40.830 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-22T08:36:40.531+0000 7f8edce13800 5 AuthRegistry(0x7ffe45681da0) adding con mode: crc 2024-09-22T08:36:40.830 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-22T08:36:40.531+0000 7f8edce13800 5 AuthRegistry(0x7ffe45681da0) adding con mode: secure 2024-09-22T08:36:40.830 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-22T08:36:40.531+0000 7f8edce13800 5 AuthRegistry(0x7ffe45681da0) adding con mode: crc 2024-09-22T08:36:40.830 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-22T08:36:40.531+0000 7f8edce13800 5 AuthRegistry(0x7ffe45681da0) adding con mode: crc 2024-09-22T08:36:40.830 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-22T08:36:40.531+0000 7f8edce13800 5 AuthRegistry(0x7ffe45681da0) adding con mode: secure 2024-09-22T08:36:40.830 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-22T08:36:40.531+0000 7f8edce13800 5 AuthRegistry(0x7ffe45681da0) adding con mode: crc 2024-09-22T08:36:40.830 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-22T08:36:40.531+0000 7f8edce13800 5 AuthRegistry(0x7ffe45681da0) adding con mode: secure 2024-09-22T08:36:40.830 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-22T08:36:40.531+0000 7f8edce13800 5 AuthRegistry(0x7ffe45681da0) adding con mode: crc 2024-09-22T08:36:40.830 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-22T08:36:40.531+0000 7f8edce13800 5 AuthRegistry(0x7ffe45681da0) adding con mode: secure 2024-09-22T08:36:40.830 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-22T08:36:40.531+0000 7f8edce13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:40.830 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-22T08:36:40.531+0000 7f8edce13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:40.830 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-22T08:36:40.531+0000 7f8edce13800 5 asok(0x555df016c0f0) register_command rotate-key cmddesc rotate-key hook 0x7ffe45681ee8 EEXIST 2024-09-22T08:36:40.830 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-22T08:36:40.531+0000 7f8edce13800 10 monclient: _reopen_session rank -1 2024-09-22T08:36:40.830 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-22T08:36:40.531+0000 7f8edce13800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T08:36:40.831 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-22T08:36:40.531+0000 7f8edce13800 10 monclient(hunting): picked mon.noname-a con 0x555df0461930 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:36:40.831 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-22T08:36:40.531+0000 7f8edce13800 10 monclient(hunting): picked mon.noname-c con 0x555df0432940 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:36:40.831 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-22T08:36:40.531+0000 7f8edce13800 10 monclient(hunting): picked mon.noname-b con 0x555df045ce10 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:36:40.831 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-22T08:36:40.531+0000 7f8edce13800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:40.831 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-22T08:36:40.531+0000 7f8edce13800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:40.831 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-22T08:36:40.531+0000 7f8edce13800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:40.831 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-22T08:36:40.531+0000 7f8edce13800 10 monclient(hunting): _renew_subs 2024-09-22T08:36:40.831 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-22T08:36:40.531+0000 7f8edce13800 10 monclient(hunting): authenticate will time out at 2105.770702s 2024-09-22T08:36:40.831 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-22T08:36:40.531+0000 7f8ed7d91640 10 monclient(hunting): get_auth_request con 0x555df0461930 auth_method 0 2024-09-22T08:36:40.831 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-22T08:36:40.531+0000 7f8ed7d91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:40.831 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-22T08:36:40.531+0000 7f8ed7d91640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:40.832 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-22T08:36:40.531+0000 7f8ed7d91640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:40.832 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-22T08:36:40.531+0000 7f8ed7d91640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:36:40.832 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-22T08:36:40.531+0000 7f8ed7d91640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:36:40.832 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-22T08:36:40.531+0000 7f8ed7d91640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:36:40.832 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-22T08:36:40.531+0000 7f8ed8d93640 10 monclient(hunting): get_auth_request con 0x555df0432940 auth_method 0 2024-09-22T08:36:40.832 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-22T08:36:40.531+0000 7f8ed8d93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:40.832 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-22T08:36:40.531+0000 7f8ed8d93640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:40.832 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-22T08:36:40.531+0000 7f8ed8d93640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:40.832 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-22T08:36:40.531+0000 7f8ed8592640 10 monclient(hunting): get_auth_request con 0x555df045ce10 auth_method 0 2024-09-22T08:36:40.832 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-22T08:36:40.531+0000 7f8ed8592640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:40.832 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-22T08:36:40.531+0000 7f8ed8592640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:40.832 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-22T08:36:40.531+0000 7f8ed8592640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:40.832 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-22T08:36:40.531+0000 7f8ed8d93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:36:40.832 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-22T08:36:40.531+0000 7f8ed8d93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:36:40.833 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-22T08:36:40.531+0000 7f8ed8d93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:36:40.833 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-22T08:36:40.531+0000 7f8ed7d91640 10 monclient(hunting): handle_auth_done global_id 7647 payload 274 2024-09-22T08:36:40.833 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-22T08:36:40.532+0000 7f8ed7d91640 10 monclient: _finish_hunting 0 2024-09-22T08:36:40.833 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-22T08:36:40.532+0000 7f8ed7d91640 1 monclient: found mon.noname-a 2024-09-22T08:36:40.833 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-22T08:36:40.532+0000 7f8ed7d91640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:36:40.833 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-22T08:36:40.532+0000 7f8daf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:36:40.833 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-22T08:36:40.532+0000 7f8daf7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:36:40.833 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-22T08:36:40.532+0000 7f8daf7fe640 10 monclient: dump: 2024-09-22T08:36:40.833 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:36:40.833 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:36:40.833 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:40.833 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:40.833 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:36:40.834 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:40.834 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:36:40.834 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:36:40.834 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:36:40.834 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:40.834 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-22T08:36:40.532+0000 7f8daf7fe640 10 monclient: _finish_auth 0 2024-09-22T08:36:40.834 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-22T08:36:40.532+0000 7f8daf7fe640 10 monclient: _check_auth_tickets 2024-09-22T08:36:40.834 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-22T08:36:40.532+0000 7f8daf7fe640 10 monclient: handle_config config(0 keys) 2024-09-22T08:36:40.834 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-22T08:36:40.532+0000 7f8daf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:36:40.834 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-22T08:36:40.532+0000 7f8daf7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:36:40.834 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-22T08:36:40.532+0000 7f8daf7fe640 10 monclient: dump: 2024-09-22T08:36:40.834 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:36:40.834 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:36:40.834 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:40.835 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:40.835 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:36:40.835 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:40.835 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:36:40.835 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:36:40.835 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:36:40.835 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:40.835 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-22T08:36:40.532+0000 7f8edce13800 5 monclient: authenticate success, global_id 7647 2024-09-22T08:36:40.835 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-22T08:36:40.532+0000 7f8edce13800 10 monclient: get_monmap_and_config success 2024-09-22T08:36:40.835 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-22T08:36:40.532+0000 7f8edce13800 4 set_mon_vals no callback set 2024-09-22T08:36:40.835 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-22T08:36:40.532+0000 7f8edce13800 10 monclient: shutdown 2024-09-22T08:36:40.835 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-22T08:36:40.532+0000 7f8edce13800 10 monclient: build_initial_monmap 2024-09-22T08:36:40.835 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-22T08:36:40.532+0000 7f8edce13800 1 build_initial for_mkfs: 0 2024-09-22T08:36:40.835 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-22T08:36:40.532+0000 7f8edce13800 10 monclient: monmap: 2024-09-22T08:36:40.835 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:36:40.836 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:36:40.836 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:36:40.836 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:36:40.836 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:36:40.836 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:40.836 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:36:40.836 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:36:40.836 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:36:40.836 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:40.836 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-22T08:36:40.532+0000 7f8edce13800 5 AuthRegistry(0x555df045d9f0) adding auth protocol: cephx 2024-09-22T08:36:40.836 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df045d9f0) adding auth protocol: cephx 2024-09-22T08:36:40.836 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df045d9f0) adding auth protocol: cephx 2024-09-22T08:36:40.836 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df045d9f0) adding con mode: secure 2024-09-22T08:36:40.837 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df045d9f0) adding con mode: crc 2024-09-22T08:36:40.837 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df045d9f0) adding con mode: secure 2024-09-22T08:36:40.837 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df045d9f0) adding con mode: crc 2024-09-22T08:36:40.837 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df045d9f0) adding con mode: secure 2024-09-22T08:36:40.837 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df045d9f0) adding con mode: crc 2024-09-22T08:36:40.837 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df045d9f0) adding con mode: crc 2024-09-22T08:36:40.837 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df045d9f0) adding con mode: secure 2024-09-22T08:36:40.837 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df045d9f0) adding con mode: crc 2024-09-22T08:36:40.837 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df045d9f0) adding con mode: secure 2024-09-22T08:36:40.837 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df045d9f0) adding con mode: crc 2024-09-22T08:36:40.837 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df045d9f0) adding con mode: secure 2024-09-22T08:36:40.837 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-22T08:36:40.533+0000 7f8edce13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:40.837 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-22T08:36:40.533+0000 7f8edce13800 1 librados: starting msgr at 2024-09-22T08:36:40.837 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-22T08:36:40.533+0000 7f8edce13800 1 librados: starting objecter 2024-09-22T08:36:40.838 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 asok(0x555df016c0f0) register_command objecter_requests cmddesc objecter_requests hook 0x555df0432d20 EEXIST 2024-09-22T08:36:40.838 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-22T08:36:40.533+0000 7f8edce13800 1 librados: setting wanted keys 2024-09-22T08:36:40.838 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-22T08:36:40.533+0000 7f8edce13800 1 librados: calling monclient init 2024-09-22T08:36:40.838 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-22T08:36:40.533+0000 7f8edce13800 10 monclient: init 2024-09-22T08:36:40.838 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df0421bd0) adding auth protocol: cephx 2024-09-22T08:36:40.838 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df0421bd0) adding auth protocol: cephx 2024-09-22T08:36:40.838 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df0421bd0) adding auth protocol: cephx 2024-09-22T08:36:40.838 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df0421bd0) adding con mode: secure 2024-09-22T08:36:40.838 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df0421bd0) adding con mode: crc 2024-09-22T08:36:40.838 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df0421bd0) adding con mode: secure 2024-09-22T08:36:40.838 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df0421bd0) adding con mode: crc 2024-09-22T08:36:40.838 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df0421bd0) adding con mode: secure 2024-09-22T08:36:40.839 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df0421bd0) adding con mode: crc 2024-09-22T08:36:40.839 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df0421bd0) adding con mode: crc 2024-09-22T08:36:40.839 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df0421bd0) adding con mode: secure 2024-09-22T08:36:40.839 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df0421bd0) adding con mode: crc 2024-09-22T08:36:40.839 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df0421bd0) adding con mode: secure 2024-09-22T08:36:40.839 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df0421bd0) adding con mode: crc 2024-09-22T08:36:40.839 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df0421bd0) adding con mode: secure 2024-09-22T08:36:40.839 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-22T08:36:40.533+0000 7f8edce13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:40.839 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-22T08:36:40.533+0000 7f8edce13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:40.839 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 asok(0x555df016c0f0) register_command rotate-key cmddesc rotate-key hook 0x555df0421d18 EEXIST 2024-09-22T08:36:40.839 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-22T08:36:40.533+0000 7f8edce13800 10 monclient: _reopen_session rank -1 2024-09-22T08:36:40.839 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-22T08:36:40.533+0000 7f8edce13800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T08:36:40.839 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-22T08:36:40.533+0000 7f8edce13800 10 monclient(hunting): picked mon.noname-a con 0x555df0432940 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:36:40.839 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-22T08:36:40.533+0000 7f8edce13800 10 monclient(hunting): picked mon.noname-b con 0x555df045ce10 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:36:40.840 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-22T08:36:40.533+0000 7f8edce13800 10 monclient(hunting): picked mon.noname-c con 0x555df0461930 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:36:40.840 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-22T08:36:40.533+0000 7f8edce13800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:40.840 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-22T08:36:40.533+0000 7f8edce13800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:40.840 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-22T08:36:40.533+0000 7f8edce13800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:40.840 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-22T08:36:40.533+0000 7f8edce13800 10 monclient(hunting): _renew_subs 2024-09-22T08:36:40.840 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-22T08:36:40.533+0000 7f8edce13800 10 monclient(hunting): authenticate will time out at 2105.772969s 2024-09-22T08:36:40.840 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-22T08:36:40.534+0000 7f8ed7d91640 10 monclient(hunting): get_auth_request con 0x555df0432940 auth_method 0 2024-09-22T08:36:40.840 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-22T08:36:40.534+0000 7f8ed7d91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:40.840 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-22T08:36:40.534+0000 7f8ed7d91640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:40.840 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-22T08:36:40.534+0000 7f8ed7d91640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:40.840 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-22T08:36:40.534+0000 7f8ed8592640 10 monclient(hunting): get_auth_request con 0x555df0461930 auth_method 0 2024-09-22T08:36:40.840 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-22T08:36:40.534+0000 7f8ed8592640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:40.840 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-22T08:36:40.534+0000 7f8ed8592640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:40.840 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-22T08:36:40.534+0000 7f8ed8592640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:40.841 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-22T08:36:40.534+0000 7f8ed7d91640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:36:40.841 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-22T08:36:40.534+0000 7f8ed7d91640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:36:40.841 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-22T08:36:40.534+0000 7f8ed7d91640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:36:40.841 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-22T08:36:40.534+0000 7f8ed8d93640 10 monclient(hunting): get_auth_request con 0x555df045ce10 auth_method 0 2024-09-22T08:36:40.841 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-22T08:36:40.534+0000 7f8ed8d93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:40.841 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-22T08:36:40.534+0000 7f8ed8d93640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:40.841 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-22T08:36:40.534+0000 7f8ed8d93640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:40.841 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-22T08:36:40.534+0000 7f8ed8592640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:36:40.841 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-22T08:36:40.534+0000 7f8ed8592640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:36:40.841 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-22T08:36:40.534+0000 7f8ed8592640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:36:40.841 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-22T08:36:40.534+0000 7f8ed8d93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:36:40.841 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-22T08:36:40.534+0000 7f8ed8d93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:36:40.841 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-22T08:36:40.534+0000 7f8ed8d93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:36:40.841 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-22T08:36:40.534+0000 7f8ed7d91640 10 monclient(hunting): handle_auth_done global_id 7650 payload 824 2024-09-22T08:36:40.842 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-22T08:36:40.534+0000 7f8ed7d91640 10 monclient: _finish_hunting 0 2024-09-22T08:36:40.842 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-22T08:36:40.534+0000 7f8ed7d91640 1 monclient: found mon.noname-a 2024-09-22T08:36:40.842 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-22T08:36:40.534+0000 7f8ed7d91640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:36:40.842 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-22T08:36:40.534+0000 7f8dadffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:36:40.842 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-22T08:36:40.534+0000 7f8dadffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:36:40.842 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-22T08:36:40.534+0000 7f8dadffb640 10 monclient: dump: 2024-09-22T08:36:40.842 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:36:40.842 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:36:40.842 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:40.842 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:40.842 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:36:40.842 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:40.842 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:36:40.843 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:36:40.843 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:36:40.843 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:40.843 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-22T08:36:40.534+0000 7f8dadffb640 10 monclient: _finish_auth 0 2024-09-22T08:36:40.843 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-22T08:36:40.534+0000 7f8dadffb640 10 monclient: _check_auth_tickets 2024-09-22T08:36:40.843 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-22T08:36:40.534+0000 7f8dadffb640 10 monclient: handle_config config(0 keys) 2024-09-22T08:36:40.843 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-22T08:36:40.534+0000 7f8dadffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:36:40.843 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-22T08:36:40.534+0000 7f8dadffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:36:40.844 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-22T08:36:40.534+0000 7f8dadffb640 10 monclient: dump: 2024-09-22T08:36:40.844 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:36:40.844 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:36:40.844 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:40.844 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:40.844 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:36:40.844 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:40.845 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:36:40.845 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:36:40.845 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:36:40.845 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:40.845 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-22T08:36:40.534+0000 7f8edce13800 5 monclient: authenticate success, global_id 7650 2024-09-22T08:36:40.845 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-22T08:36:40.534+0000 7f8daf7fe640 4 set_mon_vals no callback set 2024-09-22T08:36:40.845 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-22T08:36:40.534+0000 7f8edce13800 10 monclient: _renew_subs 2024-09-22T08:36:40.846 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-22T08:36:40.534+0000 7f8edce13800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:36:40.846 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-22T08:36:40.534+0000 7f8edce13800 10 monclient: _renew_subs 2024-09-22T08:36:40.846 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-22T08:36:40.534+0000 7f8edce13800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:36:40.846 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-22T08:36:40.534+0000 7f8edce13800 1 librados: init done 2024-09-22T08:36:40.846 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-22T08:36:40.534+0000 7f8edce13800 5 asok(0x555df016c0f0) register_command cr dump hook 0x555df0455228 2024-09-22T08:36:40.846 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-22T08:36:40.536+0000 7f8edce13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.846 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-22T08:36:40.537+0000 7f8dadffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:36:40.846 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-22T08:36:40.537+0000 7f8dadffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:36:40.846 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-22T08:36:40.537+0000 7f8dadffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:36:40.846 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-22T08:36:40.537+0000 7f8ed8d93640 10 monclient: get_auth_request con 0x7f8da0077570 auth_method 0 2024-09-22T08:36:40.846 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-22T08:36:40.537+0000 7f8ed8592640 10 monclient: get_auth_request con 0x555df047b820 auth_method 0 2024-09-22T08:36:40.846 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-22T08:36:40.538+0000 7f8edce13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.847 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-22T08:36:40.538+0000 7f8edce13800 20 realm 2024-09-22T08:36:40.847 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-22T08:36:40.538+0000 7f8edce13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.847 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-22T08:36:40.538+0000 7f8edce13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.847 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-22T08:36:40.538+0000 7f8edce13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:40.847 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-22T08:36:40.538+0000 7f8edce13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.847 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-22T08:36:40.538+0000 7f8edce13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.847 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-22T08:36:40.538+0000 7f8edce13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.847 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-22T08:36:40.538+0000 7f8ed7d91640 10 monclient: get_auth_request con 0x555df047fb30 auth_method 0 2024-09-22T08:36:40.847 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-22T08:36:40.539+0000 7f8edce13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:40.847 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-22T08:36:40.539+0000 7f8edce13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.847 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-22T08:36:40.539+0000 7f8ed8d93640 10 monclient: get_auth_request con 0x555df0483270 auth_method 0 2024-09-22T08:36:40.847 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-22T08:36:40.540+0000 7f8edce13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:36:40.847 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-22T08:36:40.540+0000 7f8edce13800 20 searching for the correct realm 2024-09-22T08:36:40.847 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-22T08:36:40.540+0000 7f8ed8592640 10 monclient: get_auth_request con 0x555df0488010 auth_method 0 2024-09-22T08:36:40.848 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-22T08:36:40.541+0000 7f8ed7d91640 10 monclient: get_auth_request con 0x7f8ecc07b030 auth_method 0 2024-09-22T08:36:40.848 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-22T08:36:40.542+0000 7f8ed7d91640 0 -- 172.21.15.38:0/1622099161 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f8ecc07b030 msgr2=0x7f8ecc02b780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:40.848 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-22T08:36:40.542+0000 7f8dadffb640 1 client.7650.objecter ms_handle_reset 0x7f8ecc07b030 session 0x7f8ecc026040 osd.0 2024-09-22T08:36:40.848 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-22T08:36:40.542+0000 7f8dadffb640 10 monclient: _renew_subs 2024-09-22T08:36:40.848 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-22T08:36:40.542+0000 7f8dadffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:36:40.848 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-22T08:36:40.542+0000 7f8ed7d91640 10 monclient: get_auth_request con 0x7f8da0087090 auth_method 0 2024-09-22T08:36:40.848 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-22T08:36:40.542+0000 7f8ed8d93640 10 monclient: get_auth_request con 0x7f8ec806b020 auth_method 0 2024-09-22T08:36:40.848 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-22T08:36:40.544+0000 7f8ed8592640 10 monclient: get_auth_request con 0x7f8ecc03e020 auth_method 0 2024-09-22T08:36:40.848 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-22T08:36:40.545+0000 7f8ed7d91640 0 -- 172.21.15.38:0/1622099161 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f8ec80cd040 msgr2=0x7f8ec80de050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:40.848 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-22T08:36:40.545+0000 7f8ed7d91640 10 monclient: get_auth_request con 0x7f8ec80cd040 auth_method 0 2024-09-22T08:36:40.848 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-22T08:36:40.746+0000 7f8ed7d91640 10 monclient: get_auth_request con 0x7f8ec80cd040 auth_method 0 2024-09-22T08:36:40.848 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-22T08:36:40.752+0000 7f8edce13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:40.848 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-22T08:36:40.752+0000 7f8edce13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:40.848 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-22T08:36:40.752+0000 7f8edce13800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:36:40.849 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-22T08:36:40.752+0000 7f8edce13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:40.849 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-22T08:36:40.752+0000 7f8edce13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:40.849 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-22T08:36:40.752+0000 7f8edce13800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:36:40.849 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-22T08:36:40.752+0000 7f8edce13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.849 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-22T08:36:40.752+0000 7f8edce13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.849 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-22T08:36:40.752+0000 7f8edce13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.849 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-22T08:36:40.753+0000 7f8edce13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:40.849 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-22T08:36:40.753+0000 7f8edce13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.849 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-22T08:36:40.753+0000 7f8edce13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:36:40.849 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-22T08:36:40.753+0000 7f8edce13800 20 zone default found 2024-09-22T08:36:40.849 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-22T08:36:40.753+0000 7f8edce13800 4 Realm: () 2024-09-22T08:36:40.849 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-22T08:36:40.753+0000 7f8edce13800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:36:40.849 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-22T08:36:40.753+0000 7f8edce13800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:36:40.850 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-22T08:36:40.753+0000 7f8edce13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:40.850 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-22T08:36:40.753+0000 7f8edce13800 20 zonegroup default 2024-09-22T08:36:40.850 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-22T08:36:40.753+0000 7f8edce13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.850 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-22T08:36:40.753+0000 7f8edce13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.850 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-22T08:36:40.753+0000 7f8edce13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.850 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-22T08:36:40.754+0000 7f8edce13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.850 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-22T08:36:40.754+0000 7f8edce13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.850 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-22T08:36:40.754+0000 7f8edce13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.850 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-22T08:36:40.754+0000 7f8edce13800 20 started sync module instance, tier type = 2024-09-22T08:36:40.850 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-22T08:36:40.754+0000 7f8edce13800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:36:40.850 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-22T08:36:40.764+0000 7f8edce13800 20 add_watcher() i=0 2024-09-22T08:36:40.851 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-22T08:36:40.764+0000 7f8edce13800 20 add_watcher() i=1 2024-09-22T08:36:40.851 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-22T08:36:40.764+0000 7f8edce13800 20 add_watcher() i=2 2024-09-22T08:36:40.851 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-22T08:36:40.764+0000 7f8edce13800 20 add_watcher() i=3 2024-09-22T08:36:40.851 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-22T08:36:40.764+0000 7f8edce13800 20 add_watcher() i=4 2024-09-22T08:36:40.851 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-22T08:36:40.764+0000 7f8edce13800 20 add_watcher() i=5 2024-09-22T08:36:40.851 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-22T08:36:40.764+0000 7f8edce13800 20 add_watcher() i=6 2024-09-22T08:36:40.851 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-22T08:36:40.766+0000 7f8edce13800 20 add_watcher() i=7 2024-09-22T08:36:40.851 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-22T08:36:40.766+0000 7f8edce13800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:40.852 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-22T08:36:40.768+0000 7f8edce13800 5 AuthRegistry(0x7ffe45682270) adding auth protocol: cephx 2024-09-22T08:36:40.852 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-22T08:36:40.768+0000 7f8edce13800 5 AuthRegistry(0x7ffe45682270) adding auth protocol: cephx 2024-09-22T08:36:40.852 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-22T08:36:40.768+0000 7f8edce13800 5 AuthRegistry(0x7ffe45682270) adding auth protocol: cephx 2024-09-22T08:36:40.852 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-22T08:36:40.768+0000 7f8edce13800 5 AuthRegistry(0x7ffe45682270) adding con mode: secure 2024-09-22T08:36:40.852 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-22T08:36:40.768+0000 7f8edce13800 5 AuthRegistry(0x7ffe45682270) adding con mode: crc 2024-09-22T08:36:40.852 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-22T08:36:40.768+0000 7f8edce13800 5 AuthRegistry(0x7ffe45682270) adding con mode: secure 2024-09-22T08:36:40.852 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-22T08:36:40.768+0000 7f8edce13800 5 AuthRegistry(0x7ffe45682270) adding con mode: crc 2024-09-22T08:36:40.852 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-22T08:36:40.768+0000 7f8edce13800 5 AuthRegistry(0x7ffe45682270) adding con mode: secure 2024-09-22T08:36:40.852 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-22T08:36:40.768+0000 7f8edce13800 5 AuthRegistry(0x7ffe45682270) adding con mode: crc 2024-09-22T08:36:40.852 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-22T08:36:40.768+0000 7f8edce13800 5 AuthRegistry(0x7ffe45682270) adding con mode: crc 2024-09-22T08:36:40.852 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-22T08:36:40.768+0000 7f8edce13800 5 AuthRegistry(0x7ffe45682270) adding con mode: secure 2024-09-22T08:36:40.852 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-22T08:36:40.768+0000 7f8edce13800 5 AuthRegistry(0x7ffe45682270) adding con mode: crc 2024-09-22T08:36:40.852 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-22T08:36:40.768+0000 7f8edce13800 5 AuthRegistry(0x7ffe45682270) adding con mode: secure 2024-09-22T08:36:40.852 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-22T08:36:40.768+0000 7f8edce13800 5 AuthRegistry(0x7ffe45682270) adding con mode: crc 2024-09-22T08:36:40.853 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-22T08:36:40.768+0000 7f8edce13800 5 AuthRegistry(0x7ffe45682270) adding con mode: secure 2024-09-22T08:36:40.853 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-22T08:36:40.768+0000 7f8d8efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:40.853 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-22T08:36:40.768+0000 7f8edce13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:40.853 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-22T08:36:40.768+0000 7f8edce13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:40.853 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-22T08:36:40.768+0000 7f8edce13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:40.853 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-22T08:36:40.768+0000 7f8edce13800 5 asok(0x555df016c0f0) register_command cache list hook 0x555df0456f30 2024-09-22T08:36:40.853 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-22T08:36:40.768+0000 7f8edce13800 5 asok(0x555df016c0f0) register_command cache inspect hook 0x555df0456f30 2024-09-22T08:36:40.853 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-22T08:36:40.768+0000 7f8edce13800 5 asok(0x555df016c0f0) register_command cache erase hook 0x555df0456f30 2024-09-22T08:36:40.853 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-22T08:36:40.768+0000 7f8edce13800 5 asok(0x555df016c0f0) register_command cache zap hook 0x555df0456f30 2024-09-22T08:36:40.853 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-22T08:36:40.768+0000 7f8edce13800 5 note: GC not initialized 2024-09-22T08:36:40.853 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-22T08:36:40.768+0000 7f8d8dfdb640 20 reqs_thread_entry: start 2024-09-22T08:36:40.853 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-22T08:36:40.769+0000 7f8edce13800 5 asok(0x555df016c0f0) register_command sync trace show hook 0x7f8ec80a9040 2024-09-22T08:36:40.853 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-22T08:36:40.769+0000 7f8edce13800 5 asok(0x555df016c0f0) register_command sync trace history hook 0x7f8ec80a9040 2024-09-22T08:36:40.853 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-22T08:36:40.769+0000 7f8edce13800 5 asok(0x555df016c0f0) register_command sync trace active hook 0x7f8ec80a9040 2024-09-22T08:36:40.854 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-22T08:36:40.769+0000 7f8edce13800 5 asok(0x555df016c0f0) register_command sync trace active_short hook 0x7f8ec80a9040 2024-09-22T08:36:40.854 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-22T08:36:40.769+0000 7f8edce13800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:40.854 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-22T08:36:40.769+0000 7f8edce13800 20 Filter name: none 2024-09-22T08:36:40.854 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-22T08:36:40.769+0000 7f8cff7fe640 20 reqs_thread_entry: start 2024-09-22T08:36:40.854 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-22T08:36:40.769+0000 7f8edce13800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-22T08:36:40.854 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-22T08:36:40.769+0000 7f8edce13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.854 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-22T08:36:40.769+0000 7f8edce13800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T08:36:40.854 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-22T08:36:40.769+0000 7f8edce13800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-22T08:36:40.854 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-22T08:36:40.769+0000 7f8edce13800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-22T08:36:40.854 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-22T08:36:40.769+0000 7f8edce13800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 : miss 2024-09-22T08:36:40.854 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-22T08:36:40.769+0000 7f8edce13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.854 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-22T08:36:40.770+0000 7f8edce13800 20 rados_obj.operate() r=0 bl.length=415 2024-09-22T08:36:40.855 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-22T08:36:40.770+0000 7f8edce13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 info.flags=0x17 2024-09-22T08:36:40.855 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-22T08:36:40.770+0000 7f8edce13800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 to cache LRU end 2024-09-22T08:36:40.855 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-22T08:36:40.770+0000 7f8edce13800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:40.855 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-22T08:36:40.770+0000 7f8edce13800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:40.855 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-22T08:36:40.770+0000 7f8edce13800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 2024-09-22T08:36:40.855 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-22T08:36:40.775+0000 7f8edce13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 info.flags=0x17 2024-09-22T08:36:40.855 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-22T08:36:40.775+0000 7f8edce13800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 to cache LRU end 2024-09-22T08:36:40.855 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-22T08:36:40.775+0000 7f8edce13800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:40.856 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-22T08:36:40.775+0000 7f8edce13800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36, ofs0, ns] 2024-09-22T08:36:40.856 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-22T08:36:40.776+0000 7f8daeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497110 cookie 93861951621632 notifier 7650 bl.length()=923 2024-09-22T08:36:40.856 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-22T08:36:40.776+0000 7f8daeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 info.flags=0x17 2024-09-22T08:36:40.856 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-22T08:36:40.776+0000 7f8daeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 to cache LRU end 2024-09-22T08:36:40.856 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-22T08:36:40.776+0000 7f8daeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:40.856 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-22T08:36:40.776+0000 7f8edce13800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.36]): orig_sources= new_sources= 2024-09-22T08:36:40.856 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-22T08:36:40.776+0000 7f8edce13800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.36]): potential sources added=[] removed=[] 2024-09-22T08:36:40.856 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-22T08:36:40.776+0000 7f8edce13800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.36]): orig_dests= new_dests= 2024-09-22T08:36:40.856 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-22T08:36:40.776+0000 7f8edce13800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.36]): potential dests added=[] removed=[] 2024-09-22T08:36:40.857 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-22T08:36:40.781+0000 7f8edce13800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8edce13800 time 2024-09-22T08:36:40.781083+0000 2024-09-22T08:36:40.857 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:36:40.857 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:40.857 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:36:40.857 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8eddf8c748] 2024-09-22T08:36:40.857 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f8eddf8c906] 2024-09-22T08:36:40.857 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555def250e01] 2024-09-22T08:36:40.857 INFO:tasks.workunit.client.0.smithi038.stderr: 4: radosgw-admin(+0xd8186c) [0x555def76386c] 2024-09-22T08:36:40.858 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x555def260c9d] 2024-09-22T08:36:40.858 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-22T08:36:40.858 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8edcc29590] 2024-09-22T08:36:40.858 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-22T08:36:40.858 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-22T08:36:40.858 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:40.858 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-22T08:36:40.781+0000 7f8edce13800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:36:40.859 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f8edce13800 thread_name:radosgw-admin 2024-09-22T08:36:40.859 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:40.859 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:36:40.859 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8edcc3e6f0] 2024-09-22T08:36:40.859 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8edcc8b99c] 2024-09-22T08:36:40.859 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:36:40.859 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:36:40.859 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8eddf8c7a2] 2024-09-22T08:36:40.860 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f8eddf8c906] 2024-09-22T08:36:40.860 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555def250e01] 2024-09-22T08:36:40.860 INFO:tasks.workunit.client.0.smithi038.stderr: 8: radosgw-admin(+0xd8186c) [0x555def76386c] 2024-09-22T08:36:40.860 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x555def260c9d] 2024-09-22T08:36:40.860 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-22T08:36:40.860 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8edcc29590] 2024-09-22T08:36:40.860 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-22T08:36:40.860 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-22T08:36:40.860 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:36:40.860 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:40.860 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-22T08:36:40.861 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-22T08:36:40.861 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-22T08:36:40.861 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-22T08:36:40.861 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-22T08:36:40.861 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-22T08:36:40.861 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-22T08:36:40.861 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-22T08:36:40.861 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-22T08:36:40.861 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-22T08:36:40.861 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-22T08:36:40.862 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-22T08:36:40.862 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-22T08:36:40.862 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-22T08:36:40.862 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-22T08:36:40.862 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-22T08:36:40.862 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-22T08:36:40.862 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-22T08:36:40.862 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-22T08:36:40.862 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-22T08:36:40.862 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-22T08:36:40.862 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-22T08:36:40.862 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-22T08:36:40.862 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-22T08:36:40.863 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:36:40.863 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-22T08:36:40.863 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-22T08:36:40.863 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-22T08:36:40.863 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-22T08:36:40.863 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-22T08:36:40.863 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-22T08:36:40.863 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-22T08:36:40.863 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-22T08:36:40.863 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-22T08:36:40.863 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-22T08:36:40.863 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-22T08:36:40.863 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-22T08:36:40.863 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-22T08:36:40.864 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-22T08:36:40.864 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-22T08:36:40.864 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-22T08:36:40.864 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-22T08:36:40.864 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-22T08:36:40.864 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-22T08:36:40.864 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-22T08:36:40.864 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-22T08:36:40.864 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:36:40.864 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-22T08:36:40.864 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:36:40.864 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-22T08:36:40.864 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-22T08:36:40.864 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-22T08:36:40.864 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-22T08:36:40.865 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-22T08:36:40.865 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-22T08:36:40.865 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-22T08:36:40.865 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-22T08:36:40.865 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-22T08:36:40.865 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-22T08:36:40.865 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-22T08:36:40.865 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-22T08:36:40.865 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-22T08:36:40.865 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-22T08:36:40.865 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-22T08:36:40.865 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-22T08:36:40.865 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-22T08:36:40.865 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-22T08:36:40.866 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:36:40.866 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-22T08:36:40.866 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:36:40.866 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-22T08:36:40.866 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-22T08:36:40.866 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-22T08:36:40.866 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-22T08:36:40.866 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-22T08:36:40.866 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-22T08:36:40.866 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:36:40.866 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-22T08:36:40.866 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-22T08:36:40.866 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:36:40.866 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-22T08:36:40.866 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-22T08:36:40.867 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-22T08:36:40.867 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-22T08:36:40.867 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-22T08:36:40.867 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-22T08:36:40.867 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-22T08:36:40.867 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-22T08:36:40.867 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-22T08:36:40.867 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-22T08:36:40.867 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-22T08:36:40.867 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-22T08:36:40.867 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-22T08:36:40.868 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:36:40.868 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8cff7fe640 / http_manager 2024-09-22T08:36:40.868 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8d8dfdb640 / http_manager 2024-09-22T08:36:40.868 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8d8efdd640 / rgw_dt_lg_renew 2024-09-22T08:36:40.868 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8dadffb640 / ms_dispatch 2024-09-22T08:36:40.868 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8daeffd640 / io_context_pool 2024-09-22T08:36:40.868 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8daf7fe640 / io_context_pool 2024-09-22T08:36:40.868 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8dbdffb640 / ms_dispatch 2024-09-22T08:36:40.868 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8dc4e09640 / ms_dispatch 2024-09-22T08:36:40.868 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8dc660c640 / io_context_pool 2024-09-22T08:36:40.869 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8ed7d91640 / msgr-worker-2 2024-09-22T08:36:40.869 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8ed8592640 / msgr-worker-1 2024-09-22T08:36:40.869 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8ed8d93640 / msgr-worker-0 2024-09-22T08:36:40.869 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8ed9594640 / io_context_pool 2024-09-22T08:36:40.869 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8edce13800 / radosgw-admin 2024-09-22T08:36:40.869 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-22T08:36:40.869 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-22T08:36:40.869 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/log/ceph/ceph-client.admin.132795.log 2024-09-22T08:36:40.869 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-22T08:36:40.869 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-22T08:36:40.869 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-22T08:36:40.518+0000 7f8edce13800 10 monclient: build_initial_monmap 2024-09-22T08:36:40.869 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-22T08:36:40.518+0000 7f8edce13800 1 build_initial for_mkfs: 0 2024-09-22T08:36:40.869 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-22T08:36:40.518+0000 7f8edce13800 10 monclient: monmap: 2024-09-22T08:36:40.869 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:36:40.870 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:36:40.870 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:36:40.870 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:36:40.870 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:36:40.870 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:40.870 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:36:40.870 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:36:40.870 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:36:40.870 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:40.870 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-22T08:36:40.518+0000 7f8edce13800 5 AuthRegistry(0x555df03935c0) adding auth protocol: cephx 2024-09-22T08:36:40.870 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-22T08:36:40.518+0000 7f8edce13800 5 AuthRegistry(0x555df03935c0) adding auth protocol: cephx 2024-09-22T08:36:40.870 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-22T08:36:40.518+0000 7f8edce13800 5 AuthRegistry(0x555df03935c0) adding auth protocol: cephx 2024-09-22T08:36:40.871 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-22T08:36:40.518+0000 7f8edce13800 5 AuthRegistry(0x555df03935c0) adding con mode: secure 2024-09-22T08:36:40.871 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-22T08:36:40.518+0000 7f8edce13800 5 AuthRegistry(0x555df03935c0) adding con mode: crc 2024-09-22T08:36:40.871 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-22T08:36:40.518+0000 7f8edce13800 5 AuthRegistry(0x555df03935c0) adding con mode: secure 2024-09-22T08:36:40.871 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-22T08:36:40.518+0000 7f8edce13800 5 AuthRegistry(0x555df03935c0) adding con mode: crc 2024-09-22T08:36:40.871 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-22T08:36:40.518+0000 7f8edce13800 5 AuthRegistry(0x555df03935c0) adding con mode: secure 2024-09-22T08:36:40.871 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-22T08:36:40.518+0000 7f8edce13800 5 AuthRegistry(0x555df03935c0) adding con mode: crc 2024-09-22T08:36:40.871 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-22T08:36:40.518+0000 7f8edce13800 5 AuthRegistry(0x555df03935c0) adding con mode: crc 2024-09-22T08:36:40.871 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-22T08:36:40.518+0000 7f8edce13800 5 AuthRegistry(0x555df03935c0) adding con mode: secure 2024-09-22T08:36:40.871 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-22T08:36:40.518+0000 7f8edce13800 5 AuthRegistry(0x555df03935c0) adding con mode: crc 2024-09-22T08:36:40.871 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-22T08:36:40.518+0000 7f8edce13800 5 AuthRegistry(0x555df03935c0) adding con mode: secure 2024-09-22T08:36:40.872 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-22T08:36:40.518+0000 7f8edce13800 5 AuthRegistry(0x555df03935c0) adding con mode: crc 2024-09-22T08:36:40.872 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-22T08:36:40.518+0000 7f8edce13800 5 AuthRegistry(0x555df03935c0) adding con mode: secure 2024-09-22T08:36:40.872 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-22T08:36:40.518+0000 7f8edce13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:40.872 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-22T08:36:40.518+0000 7f8edce13800 1 librados: starting msgr at 2024-09-22T08:36:40.872 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-22T08:36:40.518+0000 7f8edce13800 1 librados: starting objecter 2024-09-22T08:36:40.872 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-22T08:36:40.519+0000 7f8edce13800 5 asok(0x555df016c0f0) register_command objecter_requests hook 0x555df03bf290 2024-09-22T08:36:40.872 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-22T08:36:40.519+0000 7f8edce13800 1 librados: setting wanted keys 2024-09-22T08:36:40.872 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-22T08:36:40.519+0000 7f8edce13800 1 librados: calling monclient init 2024-09-22T08:36:40.872 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-22T08:36:40.519+0000 7f8edce13800 10 monclient: init 2024-09-22T08:36:40.872 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-22T08:36:40.519+0000 7f8edce13800 5 AuthRegistry(0x555df038dfd0) adding auth protocol: cephx 2024-09-22T08:36:40.872 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-22T08:36:40.519+0000 7f8edce13800 5 AuthRegistry(0x555df038dfd0) adding auth protocol: cephx 2024-09-22T08:36:40.872 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-22T08:36:40.519+0000 7f8edce13800 5 AuthRegistry(0x555df038dfd0) adding auth protocol: cephx 2024-09-22T08:36:40.872 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-22T08:36:40.519+0000 7f8edce13800 5 AuthRegistry(0x555df038dfd0) adding con mode: secure 2024-09-22T08:36:40.873 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-22T08:36:40.519+0000 7f8edce13800 5 AuthRegistry(0x555df038dfd0) adding con mode: crc 2024-09-22T08:36:40.873 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-22T08:36:40.519+0000 7f8edce13800 5 AuthRegistry(0x555df038dfd0) adding con mode: secure 2024-09-22T08:36:40.873 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-22T08:36:40.519+0000 7f8edce13800 5 AuthRegistry(0x555df038dfd0) adding con mode: crc 2024-09-22T08:36:40.873 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-22T08:36:40.519+0000 7f8edce13800 5 AuthRegistry(0x555df038dfd0) adding con mode: secure 2024-09-22T08:36:40.873 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-22T08:36:40.519+0000 7f8edce13800 5 AuthRegistry(0x555df038dfd0) adding con mode: crc 2024-09-22T08:36:40.873 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-22T08:36:40.519+0000 7f8edce13800 5 AuthRegistry(0x555df038dfd0) adding con mode: crc 2024-09-22T08:36:40.873 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-22T08:36:40.519+0000 7f8edce13800 5 AuthRegistry(0x555df038dfd0) adding con mode: secure 2024-09-22T08:36:40.873 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-22T08:36:40.519+0000 7f8edce13800 5 AuthRegistry(0x555df038dfd0) adding con mode: crc 2024-09-22T08:36:40.873 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-22T08:36:40.519+0000 7f8edce13800 5 AuthRegistry(0x555df038dfd0) adding con mode: secure 2024-09-22T08:36:40.873 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-22T08:36:40.519+0000 7f8edce13800 5 AuthRegistry(0x555df038dfd0) adding con mode: crc 2024-09-22T08:36:40.873 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-22T08:36:40.519+0000 7f8edce13800 5 AuthRegistry(0x555df038dfd0) adding con mode: secure 2024-09-22T08:36:40.873 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-22T08:36:40.519+0000 7f8edce13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:40.873 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-22T08:36:40.519+0000 7f8edce13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:40.873 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-22T08:36:40.519+0000 7f8edce13800 5 asok(0x555df016c0f0) register_command rotate-key hook 0x555df038e118 2024-09-22T08:36:40.874 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-22T08:36:40.519+0000 7f8edce13800 10 monclient: _reopen_session rank -1 2024-09-22T08:36:40.874 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-22T08:36:40.519+0000 7f8edce13800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T08:36:40.874 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-22T08:36:40.519+0000 7f8edce13800 10 monclient(hunting): picked mon.noname-c con 0x555df02d0830 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:36:40.874 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-22T08:36:40.519+0000 7f8edce13800 10 monclient(hunting): picked mon.noname-a con 0x555df02d38f0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:36:40.874 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-22T08:36:40.519+0000 7f8edce13800 10 monclient(hunting): picked mon.noname-b con 0x555df02d69e0 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:36:40.874 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-22T08:36:40.519+0000 7f8edce13800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:40.874 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-22T08:36:40.519+0000 7f8edce13800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:40.874 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-22T08:36:40.519+0000 7f8edce13800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:40.874 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-22T08:36:40.519+0000 7f8edce13800 10 monclient(hunting): _renew_subs 2024-09-22T08:36:40.874 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-22T08:36:40.519+0000 7f8edce13800 10 monclient(hunting): authenticate will time out at 2105.758757s 2024-09-22T08:36:40.874 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-22T08:36:40.519+0000 7f8ed7d91640 10 monclient(hunting): get_auth_request con 0x555df02d38f0 auth_method 0 2024-09-22T08:36:40.874 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-22T08:36:40.519+0000 7f8ed7d91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:40.874 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-22T08:36:40.519+0000 7f8ed7d91640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:40.875 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-22T08:36:40.519+0000 7f8ed7d91640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:40.875 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-22T08:36:40.519+0000 7f8ed8592640 10 monclient(hunting): get_auth_request con 0x555df02d0830 auth_method 0 2024-09-22T08:36:40.875 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-22T08:36:40.519+0000 7f8ed8592640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:40.875 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-22T08:36:40.519+0000 7f8ed8592640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:40.875 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-22T08:36:40.519+0000 7f8ed8592640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:40.875 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-22T08:36:40.519+0000 7f8ed7d91640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:36:40.875 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-22T08:36:40.519+0000 7f8ed7d91640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:36:40.875 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-22T08:36:40.519+0000 7f8ed7d91640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:36:40.875 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-22T08:36:40.519+0000 7f8ed8592640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:36:40.875 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-22T08:36:40.519+0000 7f8ed8592640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:36:40.875 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-22T08:36:40.519+0000 7f8ed8592640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:36:40.875 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-22T08:36:40.519+0000 7f8ed8d93640 10 monclient(hunting): get_auth_request con 0x555df02d69e0 auth_method 0 2024-09-22T08:36:40.875 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-22T08:36:40.519+0000 7f8ed8d93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:40.876 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-22T08:36:40.519+0000 7f8ed8d93640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:40.876 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-22T08:36:40.519+0000 7f8ed8d93640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:40.876 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-22T08:36:40.520+0000 7f8ed8d93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:36:40.876 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-22T08:36:40.520+0000 7f8ed8d93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:36:40.876 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-22T08:36:40.520+0000 7f8ed8d93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:36:40.876 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-22T08:36:40.520+0000 7f8ed8592640 10 monclient(hunting): handle_auth_done global_id 7178 payload 824 2024-09-22T08:36:40.876 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-22T08:36:40.520+0000 7f8ed8592640 10 monclient: _finish_hunting 0 2024-09-22T08:36:40.876 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-22T08:36:40.520+0000 7f8ed8592640 1 monclient: found mon.noname-c 2024-09-22T08:36:40.876 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-22T08:36:40.520+0000 7f8ed8592640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:36:40.876 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-22T08:36:40.520+0000 7f8dc4e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:36:40.876 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-22T08:36:40.520+0000 7f8dc4e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:36:40.876 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-22T08:36:40.520+0000 7f8dc4e09640 10 monclient: dump: 2024-09-22T08:36:40.876 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:36:40.876 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:36:40.877 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:40.877 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:40.877 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:36:40.877 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:40.877 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:36:40.877 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:36:40.877 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:36:40.877 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:40.877 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-22T08:36:40.520+0000 7f8dc4e09640 10 monclient: _finish_auth 0 2024-09-22T08:36:40.877 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-22T08:36:40.520+0000 7f8dc4e09640 10 monclient: _check_auth_tickets 2024-09-22T08:36:40.877 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-22T08:36:40.520+0000 7f8dc4e09640 10 monclient: handle_config config(0 keys) 2024-09-22T08:36:40.877 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-22T08:36:40.520+0000 7f8dc4e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:36:40.877 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-22T08:36:40.520+0000 7f8dc4e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:36:40.877 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-22T08:36:40.520+0000 7f8dc4e09640 10 monclient: dump: 2024-09-22T08:36:40.878 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:36:40.878 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:36:40.878 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:40.878 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:40.878 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:36:40.878 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:40.878 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:36:40.878 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:36:40.878 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:36:40.878 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:40.878 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-22T08:36:40.520+0000 7f8edce13800 5 monclient: authenticate success, global_id 7178 2024-09-22T08:36:40.878 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-22T08:36:40.520+0000 7f8edce13800 10 monclient: _renew_subs 2024-09-22T08:36:40.878 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-22T08:36:40.520+0000 7f8edce13800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:36:40.879 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-22T08:36:40.520+0000 7f8dc660c640 4 set_mon_vals no callback set 2024-09-22T08:36:40.879 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-22T08:36:40.520+0000 7f8edce13800 10 monclient: _renew_subs 2024-09-22T08:36:40.879 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-22T08:36:40.520+0000 7f8edce13800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:36:40.879 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-22T08:36:40.520+0000 7f8edce13800 1 librados: init done 2024-09-22T08:36:40.879 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-22T08:36:40.522+0000 7f8dc4e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:36:40.879 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-22T08:36:40.522+0000 7f8dc4e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:36:40.879 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-22T08:36:40.522+0000 7f8dc4e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:36:40.879 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-22T08:36:40.522+0000 7f8ed7d91640 10 monclient: get_auth_request con 0x7f8dc0077570 auth_method 0 2024-09-22T08:36:40.879 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-22T08:36:40.523+0000 7f8ed8d93640 10 monclient: get_auth_request con 0x555df03b69d0 auth_method 0 2024-09-22T08:36:40.879 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-22T08:36:40.523+0000 7f8ed8592640 10 monclient: get_auth_request con 0x555df03d9730 auth_method 0 2024-09-22T08:36:40.879 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-22T08:36:40.524+0000 7f8ed7d91640 10 monclient: get_auth_request con 0x555df03dd970 auth_method 0 2024-09-22T08:36:40.879 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-22T08:36:40.525+0000 7f8ed8d93640 10 monclient: get_auth_request con 0x555df03dcf90 auth_method 0 2024-09-22T08:36:40.880 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-22T08:36:40.526+0000 7f8edce13800 10 monclient: build_initial_monmap 2024-09-22T08:36:40.880 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-22T08:36:40.526+0000 7f8edce13800 1 build_initial for_mkfs: 0 2024-09-22T08:36:40.880 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-22T08:36:40.526+0000 7f8edce13800 10 monclient: monmap: 2024-09-22T08:36:40.880 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:36:40.880 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:36:40.880 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:36:40.880 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:36:40.880 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:36:40.880 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:40.880 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:36:40.880 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:36:40.880 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:36:40.880 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:40.881 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-22T08:36:40.526+0000 7f8edce13800 5 AuthRegistry(0x555df03e5b60) adding auth protocol: cephx 2024-09-22T08:36:40.881 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-22T08:36:40.526+0000 7f8edce13800 5 AuthRegistry(0x555df03e5b60) adding auth protocol: cephx 2024-09-22T08:36:40.881 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-22T08:36:40.526+0000 7f8edce13800 5 AuthRegistry(0x555df03e5b60) adding auth protocol: cephx 2024-09-22T08:36:40.881 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-22T08:36:40.526+0000 7f8edce13800 5 AuthRegistry(0x555df03e5b60) adding con mode: secure 2024-09-22T08:36:40.881 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-22T08:36:40.526+0000 7f8edce13800 5 AuthRegistry(0x555df03e5b60) adding con mode: crc 2024-09-22T08:36:40.881 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-22T08:36:40.526+0000 7f8edce13800 5 AuthRegistry(0x555df03e5b60) adding con mode: secure 2024-09-22T08:36:40.881 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-22T08:36:40.526+0000 7f8edce13800 5 AuthRegistry(0x555df03e5b60) adding con mode: crc 2024-09-22T08:36:40.881 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-22T08:36:40.526+0000 7f8edce13800 5 AuthRegistry(0x555df03e5b60) adding con mode: secure 2024-09-22T08:36:40.881 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-22T08:36:40.526+0000 7f8edce13800 5 AuthRegistry(0x555df03e5b60) adding con mode: crc 2024-09-22T08:36:40.881 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-22T08:36:40.526+0000 7f8edce13800 5 AuthRegistry(0x555df03e5b60) adding con mode: crc 2024-09-22T08:36:40.881 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-22T08:36:40.526+0000 7f8edce13800 5 AuthRegistry(0x555df03e5b60) adding con mode: secure 2024-09-22T08:36:40.881 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-22T08:36:40.526+0000 7f8edce13800 5 AuthRegistry(0x555df03e5b60) adding con mode: crc 2024-09-22T08:36:40.881 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-22T08:36:40.526+0000 7f8edce13800 5 AuthRegistry(0x555df03e5b60) adding con mode: secure 2024-09-22T08:36:40.882 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-22T08:36:40.526+0000 7f8edce13800 5 AuthRegistry(0x555df03e5b60) adding con mode: crc 2024-09-22T08:36:40.882 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-22T08:36:40.526+0000 7f8edce13800 5 AuthRegistry(0x555df03e5b60) adding con mode: secure 2024-09-22T08:36:40.882 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-22T08:36:40.526+0000 7f8edce13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:40.882 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-22T08:36:40.526+0000 7f8edce13800 5 asok(0x555df016c0f0) register_command objecter_requests cmddesc objecter_requests hook 0x555df03e8ff0 EEXIST 2024-09-22T08:36:40.882 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-22T08:36:40.527+0000 7f8edce13800 10 monclient: init 2024-09-22T08:36:40.882 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-22T08:36:40.527+0000 7f8edce13800 5 AuthRegistry(0x555df03e4968) adding auth protocol: cephx 2024-09-22T08:36:40.882 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-22T08:36:40.527+0000 7f8edce13800 5 AuthRegistry(0x555df03e4968) adding auth protocol: cephx 2024-09-22T08:36:40.882 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-22T08:36:40.527+0000 7f8edce13800 5 AuthRegistry(0x555df03e4968) adding auth protocol: cephx 2024-09-22T08:36:40.882 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-22T08:36:40.527+0000 7f8edce13800 5 AuthRegistry(0x555df03e4968) adding con mode: secure 2024-09-22T08:36:40.882 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-22T08:36:40.527+0000 7f8edce13800 5 AuthRegistry(0x555df03e4968) adding con mode: crc 2024-09-22T08:36:40.883 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-22T08:36:40.527+0000 7f8edce13800 5 AuthRegistry(0x555df03e4968) adding con mode: secure 2024-09-22T08:36:40.883 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-22T08:36:40.527+0000 7f8edce13800 5 AuthRegistry(0x555df03e4968) adding con mode: crc 2024-09-22T08:36:40.883 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-22T08:36:40.527+0000 7f8edce13800 5 AuthRegistry(0x555df03e4968) adding con mode: secure 2024-09-22T08:36:40.883 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-22T08:36:40.527+0000 7f8edce13800 5 AuthRegistry(0x555df03e4968) adding con mode: crc 2024-09-22T08:36:40.883 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-22T08:36:40.527+0000 7f8edce13800 5 AuthRegistry(0x555df03e4968) adding con mode: crc 2024-09-22T08:36:40.883 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-22T08:36:40.527+0000 7f8edce13800 5 AuthRegistry(0x555df03e4968) adding con mode: secure 2024-09-22T08:36:40.883 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-22T08:36:40.527+0000 7f8edce13800 5 AuthRegistry(0x555df03e4968) adding con mode: crc 2024-09-22T08:36:40.883 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-22T08:36:40.527+0000 7f8edce13800 5 AuthRegistry(0x555df03e4968) adding con mode: secure 2024-09-22T08:36:40.883 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-22T08:36:40.527+0000 7f8edce13800 5 AuthRegistry(0x555df03e4968) adding con mode: crc 2024-09-22T08:36:40.883 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-22T08:36:40.527+0000 7f8edce13800 5 AuthRegistry(0x555df03e4968) adding con mode: secure 2024-09-22T08:36:40.883 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-22T08:36:40.527+0000 7f8edce13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:40.883 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-22T08:36:40.527+0000 7f8edce13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:40.883 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-22T08:36:40.527+0000 7f8edce13800 5 asok(0x555df016c0f0) register_command rotate-key cmddesc rotate-key hook 0x555df03e4ab0 EEXIST 2024-09-22T08:36:40.883 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-22T08:36:40.527+0000 7f8edce13800 10 monclient: _reopen_session rank -1 2024-09-22T08:36:40.884 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-22T08:36:40.527+0000 7f8edce13800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-22T08:36:40.884 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-22T08:36:40.527+0000 7f8edce13800 10 monclient(hunting): picked mon.noname-c con 0x555df040d310 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:36:40.884 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-22T08:36:40.527+0000 7f8edce13800 10 monclient(hunting): picked mon.noname-b con 0x555df040d6f0 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:36:40.884 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-22T08:36:40.527+0000 7f8edce13800 10 monclient(hunting): picked mon.noname-a con 0x555df040c020 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:36:40.884 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-22T08:36:40.527+0000 7f8edce13800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:40.884 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-22T08:36:40.527+0000 7f8edce13800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:40.884 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-22T08:36:40.527+0000 7f8edce13800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:40.884 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-22T08:36:40.527+0000 7f8edce13800 10 monclient(hunting): _renew_subs 2024-09-22T08:36:40.884 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-22T08:36:40.527+0000 7f8edce13800 10 monclient(hunting): authenticate will time out at 2105.766580s 2024-09-22T08:36:40.884 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-22T08:36:40.527+0000 7f8ed7d91640 10 monclient(hunting): get_auth_request con 0x555df040d310 auth_method 0 2024-09-22T08:36:40.884 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-22T08:36:40.527+0000 7f8ed7d91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:40.885 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-22T08:36:40.527+0000 7f8ed7d91640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:40.885 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-22T08:36:40.527+0000 7f8ed7d91640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:40.885 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-22T08:36:40.527+0000 7f8ed8592640 10 monclient(hunting): get_auth_request con 0x555df040c020 auth_method 0 2024-09-22T08:36:40.885 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-22T08:36:40.527+0000 7f8ed8592640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:40.885 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-22T08:36:40.527+0000 7f8ed8592640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:40.885 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-22T08:36:40.527+0000 7f8ed8592640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:40.886 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-22T08:36:40.527+0000 7f8ed8d93640 10 monclient(hunting): get_auth_request con 0x555df040d6f0 auth_method 0 2024-09-22T08:36:40.886 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-22T08:36:40.527+0000 7f8ed8d93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:40.886 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-22T08:36:40.527+0000 7f8ed8d93640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:40.886 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-22T08:36:40.527+0000 7f8ed8d93640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:40.886 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-22T08:36:40.527+0000 7f8ed7d91640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:36:40.886 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-22T08:36:40.527+0000 7f8ed7d91640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:36:40.887 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-22T08:36:40.527+0000 7f8ed7d91640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:36:40.887 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-22T08:36:40.527+0000 7f8ed8592640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:36:40.887 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-22T08:36:40.527+0000 7f8ed8592640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:36:40.887 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-22T08:36:40.527+0000 7f8ed8592640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:36:40.887 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-22T08:36:40.527+0000 7f8ed8d93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:36:40.887 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-22T08:36:40.527+0000 7f8ed8d93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:36:40.888 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-22T08:36:40.527+0000 7f8ed8d93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:36:40.888 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-22T08:36:40.527+0000 7f8ed7d91640 10 monclient(hunting): handle_auth_done global_id 7181 payload 824 2024-09-22T08:36:40.888 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-22T08:36:40.527+0000 7f8ed7d91640 10 monclient: _finish_hunting 0 2024-09-22T08:36:40.888 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-22T08:36:40.527+0000 7f8ed7d91640 1 monclient: found mon.noname-c 2024-09-22T08:36:40.888 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-22T08:36:40.527+0000 7f8ed7d91640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:36:40.888 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-22T08:36:40.528+0000 7f8dbdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:36:40.889 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-22T08:36:40.528+0000 7f8dbdffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:36:40.889 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-22T08:36:40.528+0000 7f8dbdffb640 10 monclient: dump: 2024-09-22T08:36:40.889 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:36:40.889 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:36:40.889 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:40.889 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:40.889 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:36:40.889 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:40.890 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:36:40.890 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:36:40.890 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:36:40.890 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:40.890 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-22T08:36:40.528+0000 7f8dbdffb640 10 monclient: _finish_auth 0 2024-09-22T08:36:40.890 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-22T08:36:40.528+0000 7f8dbdffb640 10 monclient: _check_auth_tickets 2024-09-22T08:36:40.890 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-22T08:36:40.528+0000 7f8dbdffb640 10 monclient: handle_config config(0 keys) 2024-09-22T08:36:40.890 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-22T08:36:40.528+0000 7f8dbdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:36:40.890 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-22T08:36:40.528+0000 7f8dbdffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:36:40.890 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-22T08:36:40.528+0000 7f8dbdffb640 10 monclient: dump: 2024-09-22T08:36:40.890 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:36:40.890 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:36:40.890 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:40.890 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:40.891 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:36:40.891 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:40.891 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:36:40.891 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:36:40.891 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:36:40.891 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:40.891 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-22T08:36:40.528+0000 7f8edce13800 5 monclient: authenticate success, global_id 7181 2024-09-22T08:36:40.891 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-22T08:36:40.528+0000 7f8ed9594640 4 set_mon_vals no callback set 2024-09-22T08:36:40.891 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-22T08:36:40.528+0000 7f8edce13800 10 monclient: _renew_subs 2024-09-22T08:36:40.891 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-22T08:36:40.528+0000 7f8edce13800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:36:40.891 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-22T08:36:40.528+0000 7f8edce13800 10 monclient: _renew_subs 2024-09-22T08:36:40.891 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-22T08:36:40.528+0000 7f8edce13800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:36:40.891 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-22T08:36:40.530+0000 7f8dbdffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:36:40.891 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-22T08:36:40.530+0000 7f8dbdffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:36:40.892 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-22T08:36:40.530+0000 7f8dbdffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:36:40.892 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-22T08:36:40.530+0000 7f8ed8d93640 10 monclient: get_auth_request con 0x7f8db0077480 auth_method 0 2024-09-22T08:36:40.892 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-22T08:36:40.530+0000 7f8edce13800 10 monclient: get_monmap_and_config 2024-09-22T08:36:40.892 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-22T08:36:40.530+0000 7f8edce13800 10 monclient: build_initial_monmap 2024-09-22T08:36:40.892 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-22T08:36:40.530+0000 7f8edce13800 1 build_initial for_mkfs: 0 2024-09-22T08:36:40.892 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-22T08:36:40.530+0000 7f8edce13800 10 monclient: monmap: 2024-09-22T08:36:40.892 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:36:40.892 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:36:40.892 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:36:40.892 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:36:40.892 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:36:40.892 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:40.892 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:36:40.892 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:36:40.893 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:36:40.893 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:40.893 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-22T08:36:40.530+0000 7f8edce13800 5 AuthRegistry(0x555df042d2d0) adding auth protocol: cephx 2024-09-22T08:36:40.893 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-22T08:36:40.530+0000 7f8edce13800 5 AuthRegistry(0x555df042d2d0) adding auth protocol: cephx 2024-09-22T08:36:40.893 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-22T08:36:40.530+0000 7f8edce13800 5 AuthRegistry(0x555df042d2d0) adding auth protocol: cephx 2024-09-22T08:36:40.893 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-22T08:36:40.530+0000 7f8edce13800 5 AuthRegistry(0x555df042d2d0) adding con mode: secure 2024-09-22T08:36:40.893 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-22T08:36:40.530+0000 7f8edce13800 5 AuthRegistry(0x555df042d2d0) adding con mode: crc 2024-09-22T08:36:40.893 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-22T08:36:40.530+0000 7f8edce13800 5 AuthRegistry(0x555df042d2d0) adding con mode: secure 2024-09-22T08:36:40.893 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-22T08:36:40.530+0000 7f8edce13800 5 AuthRegistry(0x555df042d2d0) adding con mode: crc 2024-09-22T08:36:40.893 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-22T08:36:40.530+0000 7f8edce13800 5 AuthRegistry(0x555df042d2d0) adding con mode: secure 2024-09-22T08:36:40.893 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-22T08:36:40.530+0000 7f8edce13800 5 AuthRegistry(0x555df042d2d0) adding con mode: crc 2024-09-22T08:36:40.893 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-22T08:36:40.530+0000 7f8edce13800 5 AuthRegistry(0x555df042d2d0) adding con mode: crc 2024-09-22T08:36:40.893 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-22T08:36:40.530+0000 7f8edce13800 5 AuthRegistry(0x555df042d2d0) adding con mode: secure 2024-09-22T08:36:40.893 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-22T08:36:40.530+0000 7f8edce13800 5 AuthRegistry(0x555df042d2d0) adding con mode: crc 2024-09-22T08:36:40.893 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-22T08:36:40.530+0000 7f8edce13800 5 AuthRegistry(0x555df042d2d0) adding con mode: secure 2024-09-22T08:36:40.894 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-22T08:36:40.530+0000 7f8edce13800 5 AuthRegistry(0x555df042d2d0) adding con mode: crc 2024-09-22T08:36:40.894 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-22T08:36:40.530+0000 7f8edce13800 5 AuthRegistry(0x555df042d2d0) adding con mode: secure 2024-09-22T08:36:40.894 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-22T08:36:40.531+0000 7f8edce13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:40.894 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-22T08:36:40.531+0000 7f8edce13800 10 monclient: init 2024-09-22T08:36:40.894 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-22T08:36:40.531+0000 7f8edce13800 5 AuthRegistry(0x7ffe45681da0) adding auth protocol: cephx 2024-09-22T08:36:40.894 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-22T08:36:40.531+0000 7f8edce13800 5 AuthRegistry(0x7ffe45681da0) adding auth protocol: cephx 2024-09-22T08:36:40.894 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-22T08:36:40.531+0000 7f8edce13800 5 AuthRegistry(0x7ffe45681da0) adding auth protocol: cephx 2024-09-22T08:36:40.894 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-22T08:36:40.531+0000 7f8edce13800 5 AuthRegistry(0x7ffe45681da0) adding con mode: secure 2024-09-22T08:36:40.894 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-22T08:36:40.531+0000 7f8edce13800 5 AuthRegistry(0x7ffe45681da0) adding con mode: crc 2024-09-22T08:36:40.894 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-22T08:36:40.531+0000 7f8edce13800 5 AuthRegistry(0x7ffe45681da0) adding con mode: secure 2024-09-22T08:36:40.894 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-22T08:36:40.531+0000 7f8edce13800 5 AuthRegistry(0x7ffe45681da0) adding con mode: crc 2024-09-22T08:36:40.894 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-22T08:36:40.531+0000 7f8edce13800 5 AuthRegistry(0x7ffe45681da0) adding con mode: secure 2024-09-22T08:36:40.894 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-22T08:36:40.531+0000 7f8edce13800 5 AuthRegistry(0x7ffe45681da0) adding con mode: crc 2024-09-22T08:36:40.895 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-22T08:36:40.531+0000 7f8edce13800 5 AuthRegistry(0x7ffe45681da0) adding con mode: crc 2024-09-22T08:36:40.895 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-22T08:36:40.531+0000 7f8edce13800 5 AuthRegistry(0x7ffe45681da0) adding con mode: secure 2024-09-22T08:36:40.895 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-22T08:36:40.531+0000 7f8edce13800 5 AuthRegistry(0x7ffe45681da0) adding con mode: crc 2024-09-22T08:36:40.895 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-22T08:36:40.531+0000 7f8edce13800 5 AuthRegistry(0x7ffe45681da0) adding con mode: secure 2024-09-22T08:36:40.895 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-22T08:36:40.531+0000 7f8edce13800 5 AuthRegistry(0x7ffe45681da0) adding con mode: crc 2024-09-22T08:36:40.895 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-22T08:36:40.531+0000 7f8edce13800 5 AuthRegistry(0x7ffe45681da0) adding con mode: secure 2024-09-22T08:36:40.895 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-22T08:36:40.531+0000 7f8edce13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:40.895 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-22T08:36:40.531+0000 7f8edce13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:40.895 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-22T08:36:40.531+0000 7f8edce13800 5 asok(0x555df016c0f0) register_command rotate-key cmddesc rotate-key hook 0x7ffe45681ee8 EEXIST 2024-09-22T08:36:40.895 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-22T08:36:40.531+0000 7f8edce13800 10 monclient: _reopen_session rank -1 2024-09-22T08:36:40.895 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-22T08:36:40.531+0000 7f8edce13800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T08:36:40.895 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-22T08:36:40.531+0000 7f8edce13800 10 monclient(hunting): picked mon.noname-a con 0x555df0461930 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:36:40.896 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-22T08:36:40.531+0000 7f8edce13800 10 monclient(hunting): picked mon.noname-c con 0x555df0432940 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:36:40.896 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-22T08:36:40.531+0000 7f8edce13800 10 monclient(hunting): picked mon.noname-b con 0x555df045ce10 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:36:40.896 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-22T08:36:40.531+0000 7f8edce13800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:40.896 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-22T08:36:40.531+0000 7f8edce13800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:40.896 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-22T08:36:40.531+0000 7f8edce13800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:40.896 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-22T08:36:40.531+0000 7f8edce13800 10 monclient(hunting): _renew_subs 2024-09-22T08:36:40.896 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-22T08:36:40.531+0000 7f8edce13800 10 monclient(hunting): authenticate will time out at 2105.770702s 2024-09-22T08:36:40.896 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-22T08:36:40.531+0000 7f8ed7d91640 10 monclient(hunting): get_auth_request con 0x555df0461930 auth_method 0 2024-09-22T08:36:40.896 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-22T08:36:40.531+0000 7f8ed7d91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:40.896 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-22T08:36:40.531+0000 7f8ed7d91640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:40.896 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-22T08:36:40.531+0000 7f8ed7d91640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:40.896 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-22T08:36:40.531+0000 7f8ed7d91640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:36:40.896 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-22T08:36:40.531+0000 7f8ed7d91640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:36:40.896 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-22T08:36:40.531+0000 7f8ed7d91640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:36:40.897 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-22T08:36:40.531+0000 7f8ed8d93640 10 monclient(hunting): get_auth_request con 0x555df0432940 auth_method 0 2024-09-22T08:36:40.897 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-22T08:36:40.531+0000 7f8ed8d93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:40.897 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-22T08:36:40.531+0000 7f8ed8d93640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:40.897 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-22T08:36:40.531+0000 7f8ed8d93640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:40.897 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-22T08:36:40.531+0000 7f8ed8592640 10 monclient(hunting): get_auth_request con 0x555df045ce10 auth_method 0 2024-09-22T08:36:40.897 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-22T08:36:40.531+0000 7f8ed8592640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:40.897 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-22T08:36:40.531+0000 7f8ed8592640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:40.897 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-22T08:36:40.531+0000 7f8ed8592640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:40.897 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-22T08:36:40.531+0000 7f8ed8d93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:36:40.897 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-22T08:36:40.531+0000 7f8ed8d93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:36:40.897 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-22T08:36:40.531+0000 7f8ed8d93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:36:40.897 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-22T08:36:40.531+0000 7f8ed7d91640 10 monclient(hunting): handle_auth_done global_id 7647 payload 274 2024-09-22T08:36:40.897 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-22T08:36:40.532+0000 7f8ed7d91640 10 monclient: _finish_hunting 0 2024-09-22T08:36:40.897 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-22T08:36:40.532+0000 7f8ed7d91640 1 monclient: found mon.noname-a 2024-09-22T08:36:40.897 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-22T08:36:40.532+0000 7f8ed7d91640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:36:40.898 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-22T08:36:40.532+0000 7f8daf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:36:40.898 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-22T08:36:40.532+0000 7f8daf7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:36:40.898 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-22T08:36:40.532+0000 7f8daf7fe640 10 monclient: dump: 2024-09-22T08:36:40.898 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:36:40.898 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:36:40.898 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:40.899 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:40.899 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:36:40.899 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:40.899 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:36:40.899 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:36:40.899 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:36:40.900 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:40.900 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-22T08:36:40.532+0000 7f8daf7fe640 10 monclient: _finish_auth 0 2024-09-22T08:36:40.900 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-22T08:36:40.532+0000 7f8daf7fe640 10 monclient: _check_auth_tickets 2024-09-22T08:36:40.900 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-22T08:36:40.532+0000 7f8daf7fe640 10 monclient: handle_config config(0 keys) 2024-09-22T08:36:40.900 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-22T08:36:40.532+0000 7f8daf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:36:40.900 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-22T08:36:40.532+0000 7f8daf7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:36:40.900 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-22T08:36:40.532+0000 7f8daf7fe640 10 monclient: dump: 2024-09-22T08:36:40.900 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:36:40.900 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:36:40.900 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:40.900 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:40.900 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:36:40.900 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:40.901 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:36:40.901 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:36:40.901 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:36:40.901 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:40.901 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-22T08:36:40.532+0000 7f8edce13800 5 monclient: authenticate success, global_id 7647 2024-09-22T08:36:40.901 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-22T08:36:40.532+0000 7f8edce13800 10 monclient: get_monmap_and_config success 2024-09-22T08:36:40.901 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-22T08:36:40.532+0000 7f8edce13800 4 set_mon_vals no callback set 2024-09-22T08:36:40.901 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-22T08:36:40.532+0000 7f8edce13800 10 monclient: shutdown 2024-09-22T08:36:40.901 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-22T08:36:40.532+0000 7f8edce13800 10 monclient: build_initial_monmap 2024-09-22T08:36:40.902 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-22T08:36:40.532+0000 7f8edce13800 1 build_initial for_mkfs: 0 2024-09-22T08:36:40.902 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-22T08:36:40.532+0000 7f8edce13800 10 monclient: monmap: 2024-09-22T08:36:40.902 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:36:40.902 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:36:40.902 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:36:40.902 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:36:40.902 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:36:40.902 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:40.902 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:36:40.902 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:36:40.902 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:36:40.902 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:40.902 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-22T08:36:40.532+0000 7f8edce13800 5 AuthRegistry(0x555df045d9f0) adding auth protocol: cephx 2024-09-22T08:36:40.903 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df045d9f0) adding auth protocol: cephx 2024-09-22T08:36:40.903 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df045d9f0) adding auth protocol: cephx 2024-09-22T08:36:40.903 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df045d9f0) adding con mode: secure 2024-09-22T08:36:40.903 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df045d9f0) adding con mode: crc 2024-09-22T08:36:40.903 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df045d9f0) adding con mode: secure 2024-09-22T08:36:40.903 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df045d9f0) adding con mode: crc 2024-09-22T08:36:40.903 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df045d9f0) adding con mode: secure 2024-09-22T08:36:40.903 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df045d9f0) adding con mode: crc 2024-09-22T08:36:40.903 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df045d9f0) adding con mode: crc 2024-09-22T08:36:40.903 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df045d9f0) adding con mode: secure 2024-09-22T08:36:40.903 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df045d9f0) adding con mode: crc 2024-09-22T08:36:40.903 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df045d9f0) adding con mode: secure 2024-09-22T08:36:40.903 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df045d9f0) adding con mode: crc 2024-09-22T08:36:40.903 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df045d9f0) adding con mode: secure 2024-09-22T08:36:40.904 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-22T08:36:40.533+0000 7f8edce13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:40.904 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-22T08:36:40.533+0000 7f8edce13800 1 librados: starting msgr at 2024-09-22T08:36:40.904 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-22T08:36:40.533+0000 7f8edce13800 1 librados: starting objecter 2024-09-22T08:36:40.904 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 asok(0x555df016c0f0) register_command objecter_requests cmddesc objecter_requests hook 0x555df0432d20 EEXIST 2024-09-22T08:36:40.904 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-22T08:36:40.533+0000 7f8edce13800 1 librados: setting wanted keys 2024-09-22T08:36:40.904 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-22T08:36:40.533+0000 7f8edce13800 1 librados: calling monclient init 2024-09-22T08:36:40.904 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-22T08:36:40.533+0000 7f8edce13800 10 monclient: init 2024-09-22T08:36:40.904 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df0421bd0) adding auth protocol: cephx 2024-09-22T08:36:40.904 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df0421bd0) adding auth protocol: cephx 2024-09-22T08:36:40.904 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df0421bd0) adding auth protocol: cephx 2024-09-22T08:36:40.904 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df0421bd0) adding con mode: secure 2024-09-22T08:36:40.904 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df0421bd0) adding con mode: crc 2024-09-22T08:36:40.904 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df0421bd0) adding con mode: secure 2024-09-22T08:36:40.905 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df0421bd0) adding con mode: crc 2024-09-22T08:36:40.905 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df0421bd0) adding con mode: secure 2024-09-22T08:36:40.905 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df0421bd0) adding con mode: crc 2024-09-22T08:36:40.905 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df0421bd0) adding con mode: crc 2024-09-22T08:36:40.905 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df0421bd0) adding con mode: secure 2024-09-22T08:36:40.905 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df0421bd0) adding con mode: crc 2024-09-22T08:36:40.905 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df0421bd0) adding con mode: secure 2024-09-22T08:36:40.905 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df0421bd0) adding con mode: crc 2024-09-22T08:36:40.905 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 AuthRegistry(0x555df0421bd0) adding con mode: secure 2024-09-22T08:36:40.905 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-22T08:36:40.533+0000 7f8edce13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:40.905 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-22T08:36:40.533+0000 7f8edce13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:40.905 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-22T08:36:40.533+0000 7f8edce13800 5 asok(0x555df016c0f0) register_command rotate-key cmddesc rotate-key hook 0x555df0421d18 EEXIST 2024-09-22T08:36:40.906 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-22T08:36:40.533+0000 7f8edce13800 10 monclient: _reopen_session rank -1 2024-09-22T08:36:40.906 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-22T08:36:40.533+0000 7f8edce13800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T08:36:40.906 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-22T08:36:40.533+0000 7f8edce13800 10 monclient(hunting): picked mon.noname-a con 0x555df0432940 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:36:40.906 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-22T08:36:40.533+0000 7f8edce13800 10 monclient(hunting): picked mon.noname-b con 0x555df045ce10 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:36:40.906 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-22T08:36:40.533+0000 7f8edce13800 10 monclient(hunting): picked mon.noname-c con 0x555df0461930 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:36:40.906 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-22T08:36:40.533+0000 7f8edce13800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:40.906 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-22T08:36:40.533+0000 7f8edce13800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:40.906 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-22T08:36:40.533+0000 7f8edce13800 10 monclient(hunting): start opening mon connection 2024-09-22T08:36:40.906 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-22T08:36:40.533+0000 7f8edce13800 10 monclient(hunting): _renew_subs 2024-09-22T08:36:40.906 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-22T08:36:40.533+0000 7f8edce13800 10 monclient(hunting): authenticate will time out at 2105.772969s 2024-09-22T08:36:40.907 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-22T08:36:40.534+0000 7f8ed7d91640 10 monclient(hunting): get_auth_request con 0x555df0432940 auth_method 0 2024-09-22T08:36:40.907 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-22T08:36:40.534+0000 7f8ed7d91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:40.907 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-22T08:36:40.534+0000 7f8ed7d91640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:40.907 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-22T08:36:40.534+0000 7f8ed7d91640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:40.907 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-22T08:36:40.534+0000 7f8ed8592640 10 monclient(hunting): get_auth_request con 0x555df0461930 auth_method 0 2024-09-22T08:36:40.907 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-22T08:36:40.534+0000 7f8ed8592640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:40.907 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-22T08:36:40.534+0000 7f8ed8592640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:40.907 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-22T08:36:40.534+0000 7f8ed8592640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:40.907 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-22T08:36:40.534+0000 7f8ed7d91640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:36:40.907 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-22T08:36:40.534+0000 7f8ed7d91640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:36:40.908 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-22T08:36:40.534+0000 7f8ed7d91640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:36:40.908 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-22T08:36:40.534+0000 7f8ed8d93640 10 monclient(hunting): get_auth_request con 0x555df045ce10 auth_method 0 2024-09-22T08:36:40.908 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-22T08:36:40.534+0000 7f8ed8d93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:36:40.908 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-22T08:36:40.534+0000 7f8ed8d93640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:36:40.908 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-22T08:36:40.534+0000 7f8ed8d93640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:36:40.908 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-22T08:36:40.534+0000 7f8ed8592640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:36:40.908 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-22T08:36:40.534+0000 7f8ed8592640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:36:40.908 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-22T08:36:40.534+0000 7f8ed8592640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:36:40.908 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-22T08:36:40.534+0000 7f8ed8d93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:36:40.908 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-22T08:36:40.534+0000 7f8ed8d93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:36:40.909 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-22T08:36:40.534+0000 7f8ed8d93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:36:40.909 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-22T08:36:40.534+0000 7f8ed7d91640 10 monclient(hunting): handle_auth_done global_id 7650 payload 824 2024-09-22T08:36:40.909 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-22T08:36:40.534+0000 7f8ed7d91640 10 monclient: _finish_hunting 0 2024-09-22T08:36:40.909 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-22T08:36:40.534+0000 7f8ed7d91640 1 monclient: found mon.noname-a 2024-09-22T08:36:40.909 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-22T08:36:40.534+0000 7f8ed7d91640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:36:40.909 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-22T08:36:40.534+0000 7f8dadffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:36:40.909 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-22T08:36:40.534+0000 7f8dadffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:36:40.909 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-22T08:36:40.534+0000 7f8dadffb640 10 monclient: dump: 2024-09-22T08:36:40.909 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:36:40.909 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:36:40.909 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:40.910 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:40.910 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:36:40.910 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:40.910 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:36:40.910 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:36:40.910 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:36:40.910 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:40.910 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-22T08:36:40.534+0000 7f8dadffb640 10 monclient: _finish_auth 0 2024-09-22T08:36:40.910 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-22T08:36:40.534+0000 7f8dadffb640 10 monclient: _check_auth_tickets 2024-09-22T08:36:40.910 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-22T08:36:40.534+0000 7f8dadffb640 10 monclient: handle_config config(0 keys) 2024-09-22T08:36:40.911 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-22T08:36:40.534+0000 7f8dadffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:36:40.911 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-22T08:36:40.534+0000 7f8dadffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:36:40.911 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-22T08:36:40.534+0000 7f8dadffb640 10 monclient: dump: 2024-09-22T08:36:40.911 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:36:40.911 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:36:40.911 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:40.911 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:36:40.911 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:36:40.911 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:36:40.911 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:36:40.911 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:36:40.911 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:36:40.911 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:40.911 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-22T08:36:40.534+0000 7f8edce13800 5 monclient: authenticate success, global_id 7650 2024-09-22T08:36:40.912 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-22T08:36:40.534+0000 7f8daf7fe640 4 set_mon_vals no callback set 2024-09-22T08:36:40.912 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-22T08:36:40.534+0000 7f8edce13800 10 monclient: _renew_subs 2024-09-22T08:36:40.912 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-22T08:36:40.534+0000 7f8edce13800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:36:40.912 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-22T08:36:40.534+0000 7f8edce13800 10 monclient: _renew_subs 2024-09-22T08:36:40.912 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-22T08:36:40.534+0000 7f8edce13800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:36:40.912 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-22T08:36:40.534+0000 7f8edce13800 1 librados: init done 2024-09-22T08:36:40.912 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-22T08:36:40.534+0000 7f8edce13800 5 asok(0x555df016c0f0) register_command cr dump hook 0x555df0455228 2024-09-22T08:36:40.912 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-22T08:36:40.536+0000 7f8edce13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.912 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-22T08:36:40.537+0000 7f8dadffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:36:40.912 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-22T08:36:40.537+0000 7f8dadffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:36:40.912 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-22T08:36:40.537+0000 7f8dadffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:36:40.912 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-22T08:36:40.537+0000 7f8ed8d93640 10 monclient: get_auth_request con 0x7f8da0077570 auth_method 0 2024-09-22T08:36:40.912 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-22T08:36:40.537+0000 7f8ed8592640 10 monclient: get_auth_request con 0x555df047b820 auth_method 0 2024-09-22T08:36:40.912 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-22T08:36:40.538+0000 7f8edce13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.912 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-22T08:36:40.538+0000 7f8edce13800 20 realm 2024-09-22T08:36:40.913 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-22T08:36:40.538+0000 7f8edce13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.913 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-22T08:36:40.538+0000 7f8edce13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.913 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-22T08:36:40.538+0000 7f8edce13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:40.913 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-22T08:36:40.538+0000 7f8edce13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.913 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-22T08:36:40.538+0000 7f8edce13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.913 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-22T08:36:40.538+0000 7f8edce13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.913 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-22T08:36:40.538+0000 7f8ed7d91640 10 monclient: get_auth_request con 0x555df047fb30 auth_method 0 2024-09-22T08:36:40.913 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-22T08:36:40.539+0000 7f8edce13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:40.913 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-22T08:36:40.539+0000 7f8edce13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.913 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-22T08:36:40.539+0000 7f8ed8d93640 10 monclient: get_auth_request con 0x555df0483270 auth_method 0 2024-09-22T08:36:40.913 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-22T08:36:40.540+0000 7f8edce13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:36:40.913 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-22T08:36:40.540+0000 7f8edce13800 20 searching for the correct realm 2024-09-22T08:36:40.913 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-22T08:36:40.540+0000 7f8ed8592640 10 monclient: get_auth_request con 0x555df0488010 auth_method 0 2024-09-22T08:36:40.913 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-22T08:36:40.541+0000 7f8ed7d91640 10 monclient: get_auth_request con 0x7f8ecc07b030 auth_method 0 2024-09-22T08:36:40.914 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-22T08:36:40.542+0000 7f8ed7d91640 0 -- 172.21.15.38:0/1622099161 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f8ecc07b030 msgr2=0x7f8ecc02b780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:40.914 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-22T08:36:40.542+0000 7f8dadffb640 1 client.7650.objecter ms_handle_reset 0x7f8ecc07b030 session 0x7f8ecc026040 osd.0 2024-09-22T08:36:40.914 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-22T08:36:40.542+0000 7f8dadffb640 10 monclient: _renew_subs 2024-09-22T08:36:40.914 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-22T08:36:40.542+0000 7f8dadffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:36:40.914 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-22T08:36:40.542+0000 7f8ed7d91640 10 monclient: get_auth_request con 0x7f8da0087090 auth_method 0 2024-09-22T08:36:40.914 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-22T08:36:40.542+0000 7f8ed8d93640 10 monclient: get_auth_request con 0x7f8ec806b020 auth_method 0 2024-09-22T08:36:40.914 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-22T08:36:40.544+0000 7f8ed8592640 10 monclient: get_auth_request con 0x7f8ecc03e020 auth_method 0 2024-09-22T08:36:40.914 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-22T08:36:40.545+0000 7f8ed7d91640 0 -- 172.21.15.38:0/1622099161 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f8ec80cd040 msgr2=0x7f8ec80de050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:40.914 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-22T08:36:40.545+0000 7f8ed7d91640 10 monclient: get_auth_request con 0x7f8ec80cd040 auth_method 0 2024-09-22T08:36:40.914 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-22T08:36:40.746+0000 7f8ed7d91640 10 monclient: get_auth_request con 0x7f8ec80cd040 auth_method 0 2024-09-22T08:36:40.914 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-22T08:36:40.752+0000 7f8edce13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:40.914 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-22T08:36:40.752+0000 7f8edce13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:40.914 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-22T08:36:40.752+0000 7f8edce13800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:36:40.915 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-22T08:36:40.752+0000 7f8edce13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:40.915 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-22T08:36:40.752+0000 7f8edce13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:40.915 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-22T08:36:40.752+0000 7f8edce13800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:36:40.915 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-22T08:36:40.752+0000 7f8edce13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.915 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-22T08:36:40.752+0000 7f8edce13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.915 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-22T08:36:40.752+0000 7f8edce13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.915 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-22T08:36:40.753+0000 7f8edce13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:40.915 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-22T08:36:40.753+0000 7f8edce13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.915 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-22T08:36:40.753+0000 7f8edce13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:36:40.915 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-22T08:36:40.753+0000 7f8edce13800 20 zone default found 2024-09-22T08:36:40.915 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-22T08:36:40.753+0000 7f8edce13800 4 Realm: () 2024-09-22T08:36:40.915 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-22T08:36:40.753+0000 7f8edce13800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:36:40.915 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-22T08:36:40.753+0000 7f8edce13800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:36:40.916 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-22T08:36:40.753+0000 7f8edce13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:40.916 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-22T08:36:40.753+0000 7f8edce13800 20 zonegroup default 2024-09-22T08:36:40.916 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-22T08:36:40.753+0000 7f8edce13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.916 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-22T08:36:40.753+0000 7f8edce13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.916 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-22T08:36:40.753+0000 7f8edce13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.916 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-22T08:36:40.754+0000 7f8edce13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.916 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-22T08:36:40.754+0000 7f8edce13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.916 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-22T08:36:40.754+0000 7f8edce13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.916 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-22T08:36:40.754+0000 7f8edce13800 20 started sync module instance, tier type = 2024-09-22T08:36:40.916 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-22T08:36:40.754+0000 7f8edce13800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:36:40.916 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-22T08:36:40.764+0000 7f8edce13800 20 add_watcher() i=0 2024-09-22T08:36:40.916 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-22T08:36:40.764+0000 7f8edce13800 20 add_watcher() i=1 2024-09-22T08:36:40.916 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-22T08:36:40.764+0000 7f8edce13800 20 add_watcher() i=2 2024-09-22T08:36:40.916 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-22T08:36:40.764+0000 7f8edce13800 20 add_watcher() i=3 2024-09-22T08:36:40.916 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-22T08:36:40.764+0000 7f8edce13800 20 add_watcher() i=4 2024-09-22T08:36:40.917 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-22T08:36:40.764+0000 7f8edce13800 20 add_watcher() i=5 2024-09-22T08:36:40.917 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-22T08:36:40.764+0000 7f8edce13800 20 add_watcher() i=6 2024-09-22T08:36:40.917 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-22T08:36:40.766+0000 7f8edce13800 20 add_watcher() i=7 2024-09-22T08:36:40.917 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-22T08:36:40.766+0000 7f8edce13800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:40.917 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-22T08:36:40.768+0000 7f8edce13800 5 AuthRegistry(0x7ffe45682270) adding auth protocol: cephx 2024-09-22T08:36:40.917 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-22T08:36:40.768+0000 7f8edce13800 5 AuthRegistry(0x7ffe45682270) adding auth protocol: cephx 2024-09-22T08:36:40.917 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-22T08:36:40.768+0000 7f8edce13800 5 AuthRegistry(0x7ffe45682270) adding auth protocol: cephx 2024-09-22T08:36:40.917 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-22T08:36:40.768+0000 7f8edce13800 5 AuthRegistry(0x7ffe45682270) adding con mode: secure 2024-09-22T08:36:40.917 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-22T08:36:40.768+0000 7f8edce13800 5 AuthRegistry(0x7ffe45682270) adding con mode: crc 2024-09-22T08:36:40.917 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-22T08:36:40.768+0000 7f8edce13800 5 AuthRegistry(0x7ffe45682270) adding con mode: secure 2024-09-22T08:36:40.917 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-22T08:36:40.768+0000 7f8edce13800 5 AuthRegistry(0x7ffe45682270) adding con mode: crc 2024-09-22T08:36:40.917 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-22T08:36:40.768+0000 7f8edce13800 5 AuthRegistry(0x7ffe45682270) adding con mode: secure 2024-09-22T08:36:40.918 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-22T08:36:40.768+0000 7f8edce13800 5 AuthRegistry(0x7ffe45682270) adding con mode: crc 2024-09-22T08:36:40.918 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-22T08:36:40.768+0000 7f8edce13800 5 AuthRegistry(0x7ffe45682270) adding con mode: crc 2024-09-22T08:36:40.918 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-22T08:36:40.768+0000 7f8edce13800 5 AuthRegistry(0x7ffe45682270) adding con mode: secure 2024-09-22T08:36:40.918 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-22T08:36:40.768+0000 7f8edce13800 5 AuthRegistry(0x7ffe45682270) adding con mode: crc 2024-09-22T08:36:40.918 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-22T08:36:40.768+0000 7f8edce13800 5 AuthRegistry(0x7ffe45682270) adding con mode: secure 2024-09-22T08:36:40.918 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-22T08:36:40.768+0000 7f8edce13800 5 AuthRegistry(0x7ffe45682270) adding con mode: crc 2024-09-22T08:36:40.918 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-22T08:36:40.768+0000 7f8edce13800 5 AuthRegistry(0x7ffe45682270) adding con mode: secure 2024-09-22T08:36:40.918 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-22T08:36:40.768+0000 7f8d8efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:40.918 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-22T08:36:40.768+0000 7f8edce13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:36:40.918 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-22T08:36:40.768+0000 7f8edce13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:40.918 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-22T08:36:40.768+0000 7f8edce13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:40.918 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-22T08:36:40.768+0000 7f8edce13800 5 asok(0x555df016c0f0) register_command cache list hook 0x555df0456f30 2024-09-22T08:36:40.918 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-22T08:36:40.768+0000 7f8edce13800 5 asok(0x555df016c0f0) register_command cache inspect hook 0x555df0456f30 2024-09-22T08:36:40.918 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-22T08:36:40.768+0000 7f8edce13800 5 asok(0x555df016c0f0) register_command cache erase hook 0x555df0456f30 2024-09-22T08:36:40.919 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-22T08:36:40.768+0000 7f8edce13800 5 asok(0x555df016c0f0) register_command cache zap hook 0x555df0456f30 2024-09-22T08:36:40.919 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-22T08:36:40.768+0000 7f8edce13800 5 note: GC not initialized 2024-09-22T08:36:40.919 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-22T08:36:40.768+0000 7f8d8dfdb640 20 reqs_thread_entry: start 2024-09-22T08:36:40.919 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-22T08:36:40.769+0000 7f8edce13800 5 asok(0x555df016c0f0) register_command sync trace show hook 0x7f8ec80a9040 2024-09-22T08:36:40.919 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-22T08:36:40.769+0000 7f8edce13800 5 asok(0x555df016c0f0) register_command sync trace history hook 0x7f8ec80a9040 2024-09-22T08:36:40.919 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-22T08:36:40.769+0000 7f8edce13800 5 asok(0x555df016c0f0) register_command sync trace active hook 0x7f8ec80a9040 2024-09-22T08:36:40.919 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-22T08:36:40.769+0000 7f8edce13800 5 asok(0x555df016c0f0) register_command sync trace active_short hook 0x7f8ec80a9040 2024-09-22T08:36:40.919 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-22T08:36:40.769+0000 7f8edce13800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:40.919 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-22T08:36:40.769+0000 7f8edce13800 20 Filter name: none 2024-09-22T08:36:40.919 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-22T08:36:40.769+0000 7f8cff7fe640 20 reqs_thread_entry: start 2024-09-22T08:36:40.919 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-22T08:36:40.769+0000 7f8edce13800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-22T08:36:40.919 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-22T08:36:40.769+0000 7f8edce13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.919 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-22T08:36:40.769+0000 7f8edce13800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T08:36:40.919 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-22T08:36:40.769+0000 7f8edce13800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-22T08:36:40.920 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-22T08:36:40.769+0000 7f8edce13800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-22T08:36:40.920 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-22T08:36:40.769+0000 7f8edce13800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 : miss 2024-09-22T08:36:40.920 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-22T08:36:40.769+0000 7f8edce13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.920 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-22T08:36:40.770+0000 7f8edce13800 20 rados_obj.operate() r=0 bl.length=415 2024-09-22T08:36:40.920 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-22T08:36:40.770+0000 7f8edce13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 info.flags=0x17 2024-09-22T08:36:40.920 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-22T08:36:40.770+0000 7f8edce13800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 to cache LRU end 2024-09-22T08:36:40.920 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-22T08:36:40.770+0000 7f8edce13800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:40.920 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-22T08:36:40.770+0000 7f8edce13800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:40.920 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-22T08:36:40.770+0000 7f8edce13800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 2024-09-22T08:36:40.920 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-22T08:36:40.775+0000 7f8edce13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 info.flags=0x17 2024-09-22T08:36:40.920 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-22T08:36:40.775+0000 7f8edce13800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 to cache LRU end 2024-09-22T08:36:40.920 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-22T08:36:40.775+0000 7f8edce13800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:40.921 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-22T08:36:40.775+0000 7f8edce13800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36, ofs0, ns] 2024-09-22T08:36:40.921 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-22T08:36:40.776+0000 7f8daeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497110 cookie 93861951621632 notifier 7650 bl.length()=923 2024-09-22T08:36:40.921 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-22T08:36:40.776+0000 7f8daeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 info.flags=0x17 2024-09-22T08:36:40.921 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-22T08:36:40.776+0000 7f8daeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 to cache LRU end 2024-09-22T08:36:40.921 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-22T08:36:40.776+0000 7f8daeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:40.921 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-22T08:36:40.776+0000 7f8edce13800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.36]): orig_sources= new_sources= 2024-09-22T08:36:40.921 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-22T08:36:40.776+0000 7f8edce13800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.36]): potential sources added=[] removed=[] 2024-09-22T08:36:40.921 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-22T08:36:40.776+0000 7f8edce13800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.36]): orig_dests= new_dests= 2024-09-22T08:36:40.921 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-22T08:36:40.776+0000 7f8edce13800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.36]): potential dests added=[] removed=[] 2024-09-22T08:36:40.921 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-22T08:36:40.781+0000 7f8edce13800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8edce13800 time 2024-09-22T08:36:40.781083+0000 2024-09-22T08:36:40.921 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:36:40.921 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:40.921 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:36:40.921 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8eddf8c748] 2024-09-22T08:36:40.922 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f8eddf8c906] 2024-09-22T08:36:40.922 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555def250e01] 2024-09-22T08:36:40.922 INFO:tasks.workunit.client.0.smithi038.stderr: 4: radosgw-admin(+0xd8186c) [0x555def76386c] 2024-09-22T08:36:40.922 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x555def260c9d] 2024-09-22T08:36:40.922 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-22T08:36:40.922 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8edcc29590] 2024-09-22T08:36:40.922 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-22T08:36:40.922 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-22T08:36:40.922 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:40.922 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-22T08:36:40.781+0000 7f8edce13800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:36:40.922 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f8edce13800 thread_name:radosgw-admin 2024-09-22T08:36:40.922 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:40.922 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:36:40.923 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8edcc3e6f0] 2024-09-22T08:36:40.923 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8edcc8b99c] 2024-09-22T08:36:40.923 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:36:40.923 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:36:40.923 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8eddf8c7a2] 2024-09-22T08:36:40.923 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f8eddf8c906] 2024-09-22T08:36:40.923 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555def250e01] 2024-09-22T08:36:40.923 INFO:tasks.workunit.client.0.smithi038.stderr: 8: radosgw-admin(+0xd8186c) [0x555def76386c] 2024-09-22T08:36:40.923 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x555def260c9d] 2024-09-22T08:36:40.923 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-22T08:36:40.923 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8edcc29590] 2024-09-22T08:36:40.923 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-22T08:36:40.924 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-22T08:36:40.924 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:36:40.924 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:40.924 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-22T08:36:40.924 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-22T08:36:40.924 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-22T08:36:40.924 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-22T08:36:40.924 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-22T08:36:40.924 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-22T08:36:40.924 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-22T08:36:40.924 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-22T08:36:40.924 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-22T08:36:40.924 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-22T08:36:40.924 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-22T08:36:40.925 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-22T08:36:40.925 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-22T08:36:40.925 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-22T08:36:40.925 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-22T08:36:40.925 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-22T08:36:40.925 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-22T08:36:40.925 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-22T08:36:40.925 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-22T08:36:40.925 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-22T08:36:40.925 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-22T08:36:40.925 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-22T08:36:40.925 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-22T08:36:40.925 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-22T08:36:40.925 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:36:40.926 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-22T08:36:40.926 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-22T08:36:40.926 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-22T08:36:40.926 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-22T08:36:40.926 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-22T08:36:40.926 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-22T08:36:40.926 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-22T08:36:40.926 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-22T08:36:40.926 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-22T08:36:40.926 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-22T08:36:40.926 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-22T08:36:40.926 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-22T08:36:40.927 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-22T08:36:40.927 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-22T08:36:40.927 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-22T08:36:40.927 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-22T08:36:40.927 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-22T08:36:40.927 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-22T08:36:40.927 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-22T08:36:40.927 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-22T08:36:40.927 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-22T08:36:40.927 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:36:40.927 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-22T08:36:40.927 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:36:40.927 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-22T08:36:40.927 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-22T08:36:40.927 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-22T08:36:40.928 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-22T08:36:40.928 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-22T08:36:40.928 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-22T08:36:40.928 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-22T08:36:40.928 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-22T08:36:40.928 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-22T08:36:40.928 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-22T08:36:40.928 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-22T08:36:40.928 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-22T08:36:40.928 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-22T08:36:40.928 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-22T08:36:40.928 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-22T08:36:40.928 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-22T08:36:40.928 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-22T08:36:40.928 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-22T08:36:40.929 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:36:40.929 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-22T08:36:40.929 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:36:40.929 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-22T08:36:40.929 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-22T08:36:40.929 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-22T08:36:40.929 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-22T08:36:40.929 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-22T08:36:40.929 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-22T08:36:40.929 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:36:40.929 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-22T08:36:40.929 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-22T08:36:40.929 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:36:40.929 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-22T08:36:40.929 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-22T08:36:40.930 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-22T08:36:40.930 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-22T08:36:40.930 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-22T08:36:40.930 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-22T08:36:40.930 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-22T08:36:40.930 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-22T08:36:40.930 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-22T08:36:40.930 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-22T08:36:40.930 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-22T08:36:40.930 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-22T08:36:40.930 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-22T08:36:40.930 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:36:40.930 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8cff7fe640 / http_manager 2024-09-22T08:36:40.930 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8d8dfdb640 / http_manager 2024-09-22T08:36:40.931 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8d8efdd640 / rgw_dt_lg_renew 2024-09-22T08:36:40.931 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8dadffb640 / ms_dispatch 2024-09-22T08:36:40.931 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8daeffd640 / io_context_pool 2024-09-22T08:36:40.931 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8daf7fe640 / io_context_pool 2024-09-22T08:36:40.931 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8dbdffb640 / ms_dispatch 2024-09-22T08:36:40.931 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8dc4e09640 / ms_dispatch 2024-09-22T08:36:40.931 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8dc660c640 / io_context_pool 2024-09-22T08:36:40.931 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8ed7d91640 / msgr-worker-2 2024-09-22T08:36:40.931 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8ed8592640 / msgr-worker-1 2024-09-22T08:36:40.931 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8ed8d93640 / msgr-worker-0 2024-09-22T08:36:40.931 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8ed9594640 / io_context_pool 2024-09-22T08:36:40.931 INFO:tasks.workunit.client.0.smithi038.stderr: 7f8edce13800 / radosgw-admin 2024-09-22T08:36:40.931 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-22T08:36:40.931 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-22T08:36:40.932 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/lib/ceph/crash/2024-09-22T08:36:40.782759Z_8595516d-c479-48e5-8cb6-62c721211b69/log 2024-09-22T08:36:40.932 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-22T08:36:40.932 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-22T08:36:40.933 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:40.933 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:40.933 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.861+0000 7f4c17922800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.863+0000 7f4c17922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.863+0000 7f4c17922800 20 realm 2024-09-22T08:36:40.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.863+0000 7f4c17922800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.864+0000 7f4c17922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.864+0000 7f4c17922800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:40.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.864+0000 7f4c17922800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.864+0000 7f4c17922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.864+0000 7f4c17922800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.865+0000 7f4c17922800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:40.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.865+0000 7f4c17922800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.865+0000 7f4c17922800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:36:40.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.865+0000 7f4c17922800 20 searching for the correct realm 2024-09-22T08:36:40.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:40.866+0000 7f4c13668640 0 -- 172.21.15.38:0/699869238 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x5620c8a882c0 msgr2=0x5620c8a8a780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:41.072 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.070+0000 7f4c13668640 0 -- 172.21.15.38:0/699869238 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x5620c8a7ba90 msgr2=0x5620c8a7df50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:41.082 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.077+0000 7f4c17922800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:41.082 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.077+0000 7f4c17922800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:41.082 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.077+0000 7f4c17922800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:36:41.082 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.077+0000 7f4c17922800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:41.082 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.077+0000 7f4c17922800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:41.083 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.077+0000 7f4c17922800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:36:41.083 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.077+0000 7f4c17922800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.083 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.078+0000 7f4c17922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.083 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.078+0000 7f4c17922800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.083 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.078+0000 7f4c17922800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:41.083 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.078+0000 7f4c17922800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.078+0000 7f4c17922800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:36:41.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.078+0000 7f4c17922800 20 zone default found 2024-09-22T08:36:41.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.078+0000 7f4c17922800 4 Realm: () 2024-09-22T08:36:41.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.078+0000 7f4c17922800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:36:41.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.078+0000 7f4c17922800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:36:41.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.078+0000 7f4c17922800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:41.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.078+0000 7f4c17922800 20 zonegroup default 2024-09-22T08:36:41.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.078+0000 7f4c17922800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.079+0000 7f4c17922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.079+0000 7f4c17922800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.086 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.079+0000 7f4c17922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.086 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.079+0000 7f4c17922800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.086 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.079+0000 7f4c17922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.086 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.079+0000 7f4c17922800 20 started sync module instance, tier type = 2024-09-22T08:36:41.086 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.079+0000 7f4c17922800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:36:41.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.089+0000 7f4c17922800 20 add_watcher() i=0 2024-09-22T08:36:41.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.089+0000 7f4c17922800 20 add_watcher() i=1 2024-09-22T08:36:41.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.089+0000 7f4c17922800 20 add_watcher() i=2 2024-09-22T08:36:41.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.089+0000 7f4c17922800 20 add_watcher() i=3 2024-09-22T08:36:41.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.089+0000 7f4c17922800 20 add_watcher() i=4 2024-09-22T08:36:41.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.089+0000 7f4c17922800 20 add_watcher() i=5 2024-09-22T08:36:41.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.089+0000 7f4c17922800 20 add_watcher() i=6 2024-09-22T08:36:41.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.090+0000 7f4c17922800 20 add_watcher() i=7 2024-09-22T08:36:41.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.090+0000 7f4c17922800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:41.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.092+0000 7f4ac9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:41.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.093+0000 7f4c17922800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:41.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.093+0000 7f4c17922800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:41.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.093+0000 7f4c17922800 5 note: GC not initialized 2024-09-22T08:36:41.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.093+0000 7f4ac8fe1640 20 reqs_thread_entry: start 2024-09-22T08:36:41.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.093+0000 7f4c17922800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:41.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.093+0000 7f4c17922800 20 Filter name: none 2024-09-22T08:36:41.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.093+0000 7f4a427fc640 20 reqs_thread_entry: start 2024-09-22T08:36:41.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.093+0000 7f4c17922800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.094+0000 7f4c17922800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T08:36:41.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.094+0000 7f4c17922800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.098 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.094+0000 7f4c17922800 20 rados_obj.operate() r=0 bl.length=447 2024-09-22T08:36:41.098 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.094+0000 7f4c17922800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:36:41.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.094+0000 7f4c17922800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.094+0000 7f4c17922800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T08:36:41.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.094+0000 7f4c17922800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.095+0000 7f4c17922800 20 rados_obj.operate() r=0 bl.length=447 2024-09-22T08:36:41.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.095+0000 7f4c17922800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:36:41.100 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.097+0000 7f4ac9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:41.102 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.100+0000 7f4c17922800 20 remove_watcher() i=0 2024-09-22T08:36:41.102 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.100+0000 7f4c17922800 2 removed watcher, disabling cache 2024-09-22T08:36:41.103 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.101+0000 7f4c17922800 20 remove_watcher() i=1 2024-09-22T08:36:41.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.102+0000 7f4c17922800 20 remove_watcher() i=2 2024-09-22T08:36:41.105 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.103+0000 7f4c17922800 20 remove_watcher() i=3 2024-09-22T08:36:41.106 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.104+0000 7f4c17922800 20 remove_watcher() i=4 2024-09-22T08:36:41.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.105+0000 7f4c17922800 20 remove_watcher() i=5 2024-09-22T08:36:41.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.106+0000 7f4c17922800 20 remove_watcher() i=6 2024-09-22T08:36:41.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.107+0000 7f4c17922800 20 remove_watcher() i=7 2024-09-22T08:36:41.121 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:41.121 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:36:41.121 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-logrecord-writes id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:36:41.121 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:36:41.126 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:41.126 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:41.132 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:36:41.133 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:36:41.176 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:36:41.208 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:41.208 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:41.248 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.246+0000 7ff768375800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.250 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.247+0000 7ff768375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.250 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.247+0000 7ff768375800 20 realm 2024-09-22T08:36:41.250 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.247+0000 7ff768375800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.250 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.248+0000 7ff768375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.250 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.248+0000 7ff768375800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:41.250 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.248+0000 7ff768375800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.250 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.248+0000 7ff768375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.250 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.248+0000 7ff768375800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.251 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.249+0000 7ff768375800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:41.251 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.249+0000 7ff768375800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.252 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.250+0000 7ff768375800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:36:41.252 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.250+0000 7ff768375800 20 searching for the correct realm 2024-09-22T08:36:41.254 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.252+0000 7ff75ffff640 0 -- 172.21.15.38:0/2409549658 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7ff75004d040 msgr2=0x7ff75004e940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:41.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.255+0000 7ff75ffff640 0 -- 172.21.15.38:0/2409549658 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7ff7580b6bd0 msgr2=0x7ff7580b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:41.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.462+0000 7ff768375800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:41.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.462+0000 7ff768375800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:41.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.462+0000 7ff768375800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:36:41.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.462+0000 7ff768375800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:41.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.462+0000 7ff768375800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:41.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.462+0000 7ff768375800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:36:41.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.462+0000 7ff768375800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.462+0000 7ff768375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.462+0000 7ff768375800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.462+0000 7ff768375800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:41.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.463+0000 7ff768375800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.464+0000 7ff768375800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:36:41.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.464+0000 7ff768375800 20 zone default found 2024-09-22T08:36:41.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.464+0000 7ff768375800 4 Realm: () 2024-09-22T08:36:41.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.464+0000 7ff768375800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:36:41.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.464+0000 7ff768375800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:36:41.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.464+0000 7ff768375800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:41.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.464+0000 7ff768375800 20 zonegroup default 2024-09-22T08:36:41.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.464+0000 7ff768375800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.464+0000 7ff768375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.464+0000 7ff768375800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.465+0000 7ff768375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.465+0000 7ff768375800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.465+0000 7ff768375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.465+0000 7ff768375800 20 started sync module instance, tier type = 2024-09-22T08:36:41.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.465+0000 7ff768375800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:36:41.478 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.476+0000 7ff768375800 20 add_watcher() i=0 2024-09-22T08:36:41.478 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.476+0000 7ff768375800 20 add_watcher() i=1 2024-09-22T08:36:41.478 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.476+0000 7ff768375800 20 add_watcher() i=2 2024-09-22T08:36:41.478 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.476+0000 7ff768375800 20 add_watcher() i=3 2024-09-22T08:36:41.478 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.476+0000 7ff768375800 20 add_watcher() i=4 2024-09-22T08:36:41.478 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.476+0000 7ff768375800 20 add_watcher() i=5 2024-09-22T08:36:41.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.476+0000 7ff768375800 20 add_watcher() i=6 2024-09-22T08:36:41.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.477+0000 7ff768375800 20 add_watcher() i=7 2024-09-22T08:36:41.480 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.477+0000 7ff768375800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:41.481 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.479+0000 7ff6177fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:41.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.480+0000 7ff768375800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:41.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.480+0000 7ff768375800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:41.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.480+0000 7ff768375800 5 note: GC not initialized 2024-09-22T08:36:41.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.480+0000 7ff6167fc640 20 reqs_thread_entry: start 2024-09-22T08:36:41.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.480+0000 7ff768375800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:41.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.480+0000 7ff768375800 20 Filter name: none 2024-09-22T08:36:41.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.481+0000 7ff587fff640 20 reqs_thread_entry: start 2024-09-22T08:36:41.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.481+0000 7ff768375800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-22T08:36:41.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.481+0000 7ff768375800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.481+0000 7ff768375800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T08:36:41.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.481+0000 7ff768375800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-22T08:36:41.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.481+0000 7ff768375800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-22T08:36:41.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.481+0000 7ff768375800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 : miss 2024-09-22T08:36:41.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.481+0000 7ff768375800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.482+0000 7ff768375800 20 rados_obj.operate() r=0 bl.length=447 2024-09-22T08:36:41.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.482+0000 7ff768375800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 info.flags=0x17 2024-09-22T08:36:41.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.482+0000 7ff768375800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 to cache LRU end 2024-09-22T08:36:41.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.482+0000 7ff768375800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:41.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.482+0000 7ff768375800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:36:41.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.482+0000 7ff768375800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 2024-09-22T08:36:41.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.483+0000 7ff768375800 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 to be held by another RGW process; skipping for now 2024-09-22T08:36:41.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.484+0000 7ff6177fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:41.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.486+0000 7ff768375800 20 remove_watcher() i=0 2024-09-22T08:36:41.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.486+0000 7ff768375800 2 removed watcher, disabling cache 2024-09-22T08:36:41.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.488+0000 7ff768375800 20 remove_watcher() i=1 2024-09-22T08:36:41.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.489+0000 7ff768375800 20 remove_watcher() i=2 2024-09-22T08:36:41.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.490+0000 7ff768375800 20 remove_watcher() i=3 2024-09-22T08:36:41.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.491+0000 7ff768375800 20 remove_watcher() i=4 2024-09-22T08:36:41.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.492+0000 7ff768375800 20 remove_watcher() i=5 2024-09-22T08:36:41.495 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.493+0000 7ff768375800 20 remove_watcher() i=6 2024-09-22T08:36:41.496 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:36:41.495+0000 7ff768375800 20 remove_watcher() i=7 2024-09-22T08:36:41.507 INFO:tasks.workunit.client.0.smithi038.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-22T08:37:11.519 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:37:11.558 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:11.558 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:11.604 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:11.603+0000 7efdd3920800 20 rados->read ofs=0 len=0 2024-09-22T08:37:11.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:11.604+0000 7efdd3920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:11.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:11.604+0000 7efdd3920800 20 realm 2024-09-22T08:37:11.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:11.604+0000 7efdd3920800 20 rados->read ofs=0 len=0 2024-09-22T08:37:11.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:11.604+0000 7efdd3920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:11.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:11.604+0000 7efdd3920800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:11.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:11.604+0000 7efdd3920800 20 rados->read ofs=0 len=0 2024-09-22T08:37:11.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:11.605+0000 7efdd3920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:11.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:11.605+0000 7efdd3920800 20 rados->read ofs=0 len=0 2024-09-22T08:37:11.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:11.605+0000 7efdd3920800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:11.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:11.605+0000 7efdd3920800 20 rados->read ofs=0 len=0 2024-09-22T08:37:11.808 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:11.807+0000 7efdd3920800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:37:11.808 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:11.807+0000 7efdd3920800 20 searching for the correct realm 2024-09-22T08:37:11.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:11.810+0000 7efdced01640 0 -- 172.21.15.38:0/4177871205 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7efdc407d040 msgr2=0x7efdc407d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:12.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.017+0000 7efdced01640 0 -- 172.21.15.38:0/4177871205 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7efdc0043960 msgr2=0x7efdc00403c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:12.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.226+0000 7efdd3920800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:12.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.226+0000 7efdd3920800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:12.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.226+0000 7efdd3920800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:37:12.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.226+0000 7efdd3920800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:12.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.226+0000 7efdd3920800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:12.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.226+0000 7efdd3920800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:37:12.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.226+0000 7efdd3920800 20 rados->read ofs=0 len=0 2024-09-22T08:37:12.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.227+0000 7efdd3920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:12.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.227+0000 7efdd3920800 20 rados->read ofs=0 len=0 2024-09-22T08:37:12.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.227+0000 7efdd3920800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:12.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.227+0000 7efdd3920800 20 rados->read ofs=0 len=0 2024-09-22T08:37:12.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.227+0000 7efdd3920800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:37:12.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.227+0000 7efdd3920800 20 zone default found 2024-09-22T08:37:12.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.228+0000 7efdd3920800 4 Realm: () 2024-09-22T08:37:12.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.228+0000 7efdd3920800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:37:12.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.228+0000 7efdd3920800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:37:12.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.228+0000 7efdd3920800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:12.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.228+0000 7efdd3920800 20 zonegroup default 2024-09-22T08:37:12.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.228+0000 7efdd3920800 20 rados->read ofs=0 len=0 2024-09-22T08:37:12.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.228+0000 7efdd3920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:12.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.228+0000 7efdd3920800 20 rados->read ofs=0 len=0 2024-09-22T08:37:12.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.228+0000 7efdd3920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:12.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.228+0000 7efdd3920800 20 rados->read ofs=0 len=0 2024-09-22T08:37:12.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.229+0000 7efdd3920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:12.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.229+0000 7efdd3920800 20 started sync module instance, tier type = 2024-09-22T08:37:12.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.229+0000 7efdd3920800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:37:12.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.240+0000 7efdd3920800 20 add_watcher() i=0 2024-09-22T08:37:12.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.240+0000 7efdd3920800 20 add_watcher() i=1 2024-09-22T08:37:12.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.240+0000 7efdd3920800 20 add_watcher() i=2 2024-09-22T08:37:12.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.240+0000 7efdd3920800 20 add_watcher() i=3 2024-09-22T08:37:12.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.240+0000 7efdd3920800 20 add_watcher() i=4 2024-09-22T08:37:12.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.240+0000 7efdd3920800 20 add_watcher() i=5 2024-09-22T08:37:12.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.240+0000 7efdd3920800 20 add_watcher() i=6 2024-09-22T08:37:12.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.241+0000 7efdd3920800 20 add_watcher() i=7 2024-09-22T08:37:12.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.241+0000 7efdd3920800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:12.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.244+0000 7efc85fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:12.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.244+0000 7efdd3920800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:12.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.244+0000 7efdd3920800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:12.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.244+0000 7efdd3920800 5 note: GC not initialized 2024-09-22T08:37:12.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.245+0000 7efc84fe1640 20 reqs_thread_entry: start 2024-09-22T08:37:12.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.245+0000 7efdd3920800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:12.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.245+0000 7efdd3920800 20 Filter name: none 2024-09-22T08:37:12.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.245+0000 7efbfe7fc640 20 reqs_thread_entry: start 2024-09-22T08:37:12.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.245+0000 7efdd3920800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-22T08:37:12.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.245+0000 7efdd3920800 20 rados->read ofs=0 len=0 2024-09-22T08:37:12.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.245+0000 7efdd3920800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T08:37:12.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.245+0000 7efdd3920800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-22T08:37:12.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.245+0000 7efdd3920800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-22T08:37:12.248 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.245+0000 7efdd3920800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 : miss 2024-09-22T08:37:12.248 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.245+0000 7efdd3920800 20 rados->read ofs=0 len=0 2024-09-22T08:37:12.248 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.246+0000 7efdd3920800 20 rados_obj.operate() r=0 bl.length=447 2024-09-22T08:37:12.248 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.246+0000 7efdd3920800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 info.flags=0x17 2024-09-22T08:37:12.248 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.246+0000 7efdd3920800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 to cache LRU end 2024-09-22T08:37:12.248 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.246+0000 7efdd3920800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:37:12.248 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.246+0000 7efdd3920800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:12.248 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.246+0000 7efdd3920800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 2024-09-22T08:37:12.249 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.248+0000 7efdd3920800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-22T08:37:12.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.256+0000 7efdd3920800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 info.flags=0x17 2024-09-22T08:37:12.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.256+0000 7efdd3920800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 to cache LRU end 2024-09-22T08:37:12.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.256+0000 7efdd3920800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:12.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.256+0000 7efdd3920800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36, ofs0, ns] 2024-09-22T08:37:12.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.256+0000 7efcb2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497111 cookie 94872098402160 notifier 7701 bl.length()=923 2024-09-22T08:37:12.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.256+0000 7efcb2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 info.flags=0x17 2024-09-22T08:37:12.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.256+0000 7efcb2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 to cache LRU end 2024-09-22T08:37:12.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.256+0000 7efcb2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:12.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.257+0000 7efdd3920800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.36]): orig_sources= new_sources= 2024-09-22T08:37:12.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.257+0000 7efdd3920800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.36]): potential sources added=[] removed=[] 2024-09-22T08:37:12.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.257+0000 7efdd3920800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.36]): orig_dests= new_dests= 2024-09-22T08:37:12.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.257+0000 7efdd3920800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.36]): potential dests added=[] removed=[] 2024-09-22T08:37:12.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.262+0000 7efdd3920800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.2.0 2024-09-22T08:37:12.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.262+0000 7efdd3920800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.2.0 2024-09-22T08:37:12.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.262+0000 7efdd3920800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.2.1 2024-09-22T08:37:12.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.262+0000 7efdd3920800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.2.1 2024-09-22T08:37:12.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.262+0000 7efdd3920800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.2.2 2024-09-22T08:37:12.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.262+0000 7efdd3920800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.2.2 2024-09-22T08:37:12.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.262+0000 7efdd3920800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.2.3 2024-09-22T08:37:12.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.262+0000 7efdd3920800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.2.3 2024-09-22T08:37:12.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.262+0000 7efdd3920800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.2.4 2024-09-22T08:37:12.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.262+0000 7efdd3920800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.2.4 2024-09-22T08:37:12.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.262+0000 7efdd3920800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.2.5 2024-09-22T08:37:12.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.262+0000 7efdd3920800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.2.5 2024-09-22T08:37:12.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.262+0000 7efdd3920800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.2.6 2024-09-22T08:37:12.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.262+0000 7efdd3920800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.2.6 2024-09-22T08:37:12.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.262+0000 7efdd3920800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.2.7 2024-09-22T08:37:12.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.262+0000 7efdd3920800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.2.7 2024-09-22T08:37:12.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.262+0000 7efdd3920800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.2.8 2024-09-22T08:37:12.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.262+0000 7efdd3920800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.2.8 2024-09-22T08:37:12.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.262+0000 7efdd3920800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.2.9 2024-09-22T08:37:12.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.262+0000 7efdd3920800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.2.9 2024-09-22T08:37:12.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.262+0000 7efdd3920800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.2.10 2024-09-22T08:37:12.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.262+0000 7efdd3920800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.2.10 2024-09-22T08:37:12.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.262+0000 7efdd3920800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.2.11 2024-09-22T08:37:12.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.262+0000 7efdd3920800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.2.11 2024-09-22T08:37:12.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.262+0000 7efdd3920800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.0 2024-09-22T08:37:12.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.263+0000 7efdd3920800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.1 2024-09-22T08:37:12.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.263+0000 7efdd3920800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.2 2024-09-22T08:37:12.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.264+0000 7efdd3920800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.3 2024-09-22T08:37:12.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.264+0000 7efdd3920800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.4 2024-09-22T08:37:12.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.265+0000 7efdd3920800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.5 2024-09-22T08:37:12.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.266+0000 7efdd3920800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.6 2024-09-22T08:37:12.267 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.266+0000 7efdd3920800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.7 2024-09-22T08:37:12.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.267+0000 7efdd3920800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.8 2024-09-22T08:37:12.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.267+0000 7efdd3920800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.9 2024-09-22T08:37:12.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.268+0000 7efdd3920800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.10 2024-09-22T08:37:12.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.271+0000 7efdd3920800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 : hit (requested=0x17, cached=0x17) 2024-09-22T08:37:12.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.272+0000 7efdd3920800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 2024-09-22T08:37:12.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.273+0000 7efdd3920800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 info.flags=0x17 2024-09-22T08:37:12.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.273+0000 7efdd3920800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 to cache LRU end 2024-09-22T08:37:12.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.273+0000 7efdd3920800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:12.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.273+0000 7efdd3920800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36, ofs0, ns] 2024-09-22T08:37:12.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.274+0000 7efcb2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497112 cookie 94872098402160 notifier 7701 bl.length()=923 2024-09-22T08:37:12.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.274+0000 7efcb2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 info.flags=0x17 2024-09-22T08:37:12.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.274+0000 7efcb2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 to cache LRU end 2024-09-22T08:37:12.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.274+0000 7efcb2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:12.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.274+0000 7efdd3920800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.36]): orig_sources= new_sources= 2024-09-22T08:37:12.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.274+0000 7efdd3920800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.36]): potential sources added=[] removed=[] 2024-09-22T08:37:12.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.274+0000 7efdd3920800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.36]): orig_dests= new_dests= 2024-09-22T08:37:12.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.274+0000 7efdd3920800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.36]): potential dests added=[] removed=[] 2024-09-22T08:37:12.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.278+0000 7efdd3920800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.0 2024-09-22T08:37:12.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.278+0000 7efdd3920800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.1 2024-09-22T08:37:12.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.279+0000 7efdd3920800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.2 2024-09-22T08:37:12.280 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.279+0000 7efdd3920800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.3 2024-09-22T08:37:12.280 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.279+0000 7efdd3920800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.4 2024-09-22T08:37:12.281 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.280+0000 7efdd3920800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.5 2024-09-22T08:37:12.281 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.280+0000 7efdd3920800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.6 2024-09-22T08:37:12.281 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.281+0000 7efdd3920800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.7 2024-09-22T08:37:12.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.281+0000 7efdd3920800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.8 2024-09-22T08:37:12.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.281+0000 7efdd3920800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.9 2024-09-22T08:37:12.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.282+0000 7efdd3920800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.36.10 2024-09-22T08:37:12.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.282+0000 7efdd3920800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 : hit (requested=0x17, cached=0x17) 2024-09-22T08:37:12.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.282+0000 7efdd3920800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 2024-09-22T08:37:12.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.284+0000 7efdd3920800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 info.flags=0x17 2024-09-22T08:37:12.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.284+0000 7efdd3920800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 to cache LRU end 2024-09-22T08:37:12.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.284+0000 7efdd3920800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:12.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.284+0000 7efdd3920800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36, ofs0, ns] 2024-09-22T08:37:12.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.284+0000 7efcb2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497113 cookie 94872098402160 notifier 7701 bl.length()=891 2024-09-22T08:37:12.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.284+0000 7efcb2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 info.flags=0x17 2024-09-22T08:37:12.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.284+0000 7efcb2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 to cache LRU end 2024-09-22T08:37:12.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.284+0000 7efcb2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:12.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.284+0000 7efdd3920800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.36]): orig_sources= new_sources= 2024-09-22T08:37:12.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.284+0000 7efdd3920800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.36]): potential sources added=[] removed=[] 2024-09-22T08:37:12.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.284+0000 7efdd3920800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.36]): orig_dests= new_dests= 2024-09-22T08:37:12.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.284+0000 7efdd3920800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c62f9d7b-f6b6-404a-90de-de5607499115.4584.36]): potential dests added=[] removed=[] 2024-09-22T08:37:12.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.288+0000 7efdd3920800 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-22T08:37:12.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.290+0000 7efc85fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:12.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.292+0000 7efdd3920800 20 remove_watcher() i=0 2024-09-22T08:37:12.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.292+0000 7efdd3920800 2 removed watcher, disabling cache 2024-09-22T08:37:12.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.293+0000 7efdd3920800 20 remove_watcher() i=1 2024-09-22T08:37:12.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.294+0000 7efdd3920800 20 remove_watcher() i=2 2024-09-22T08:37:12.296 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.295+0000 7efdd3920800 20 remove_watcher() i=3 2024-09-22T08:37:12.297 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.296+0000 7efdd3920800 20 remove_watcher() i=4 2024-09-22T08:37:12.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.298+0000 7efdd3920800 20 remove_watcher() i=5 2024-09-22T08:37:12.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.299+0000 7efdd3920800 20 remove_watcher() i=6 2024-09-22T08:37:12.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.300+0000 7efdd3920800 20 remove_watcher() i=7 2024-09-22T08:37:12.316 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-22T08:37:12.345 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:12.346 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:12.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.385+0000 7fe5e5414800 20 rados->read ofs=0 len=0 2024-09-22T08:37:12.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.387+0000 7fe5e5414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:12.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.387+0000 7fe5e5414800 20 realm 2024-09-22T08:37:12.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.387+0000 7fe5e5414800 20 rados->read ofs=0 len=0 2024-09-22T08:37:12.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.388+0000 7fe5e5414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:12.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.388+0000 7fe5e5414800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:12.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.388+0000 7fe5e5414800 20 rados->read ofs=0 len=0 2024-09-22T08:37:12.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.388+0000 7fe5e5414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:12.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.388+0000 7fe5e5414800 20 rados->read ofs=0 len=0 2024-09-22T08:37:12.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.389+0000 7fe5e5414800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:12.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.389+0000 7fe5e5414800 20 rados->read ofs=0 len=0 2024-09-22T08:37:12.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.389+0000 7fe5e5414800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:37:12.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.389+0000 7fe5e5414800 20 searching for the correct realm 2024-09-22T08:37:12.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.392+0000 7fe5e12cc640 0 -- 172.21.15.38:0/3206289440 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7fe5d006e040 msgr2=0x7fe5d00e60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:12.599 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.598+0000 7fe5e12cc640 0 -- 172.21.15.38:0/3206289440 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x5614357b29d0 msgr2=0x5614357b4dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:12.604 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.603+0000 7fe5e5414800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:12.604 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.603+0000 7fe5e5414800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:12.604 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.603+0000 7fe5e5414800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:37:12.604 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.603+0000 7fe5e5414800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:12.604 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.603+0000 7fe5e5414800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:12.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.603+0000 7fe5e5414800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:37:12.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.603+0000 7fe5e5414800 20 rados->read ofs=0 len=0 2024-09-22T08:37:12.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.603+0000 7fe5e5414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:12.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.603+0000 7fe5e5414800 20 rados->read ofs=0 len=0 2024-09-22T08:37:12.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.604+0000 7fe5e5414800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:12.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.604+0000 7fe5e5414800 20 rados->read ofs=0 len=0 2024-09-22T08:37:12.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.604+0000 7fe5e5414800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:37:12.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.604+0000 7fe5e5414800 20 zone default found 2024-09-22T08:37:12.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.604+0000 7fe5e5414800 4 Realm: () 2024-09-22T08:37:12.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.604+0000 7fe5e5414800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:37:12.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.604+0000 7fe5e5414800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:37:12.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.604+0000 7fe5e5414800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:12.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.604+0000 7fe5e5414800 20 zonegroup default 2024-09-22T08:37:12.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.604+0000 7fe5e5414800 20 rados->read ofs=0 len=0 2024-09-22T08:37:12.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.604+0000 7fe5e5414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:12.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.604+0000 7fe5e5414800 20 rados->read ofs=0 len=0 2024-09-22T08:37:12.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.606+0000 7fe5e5414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:12.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.606+0000 7fe5e5414800 20 rados->read ofs=0 len=0 2024-09-22T08:37:12.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.606+0000 7fe5e5414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:12.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.606+0000 7fe5e5414800 20 started sync module instance, tier type = 2024-09-22T08:37:12.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.606+0000 7fe5e5414800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:37:12.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.616+0000 7fe5e5414800 20 add_watcher() i=0 2024-09-22T08:37:12.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.616+0000 7fe5e5414800 20 add_watcher() i=1 2024-09-22T08:37:12.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.616+0000 7fe5e5414800 20 add_watcher() i=2 2024-09-22T08:37:12.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.616+0000 7fe5e5414800 20 add_watcher() i=3 2024-09-22T08:37:12.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.616+0000 7fe5e5414800 20 add_watcher() i=4 2024-09-22T08:37:12.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.616+0000 7fe5e5414800 20 add_watcher() i=5 2024-09-22T08:37:12.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.616+0000 7fe5e5414800 20 add_watcher() i=6 2024-09-22T08:37:12.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.617+0000 7fe5e5414800 20 add_watcher() i=7 2024-09-22T08:37:12.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.617+0000 7fe5e5414800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:12.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.620+0000 7fe496fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:12.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.621+0000 7fe5e5414800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:12.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.621+0000 7fe5e5414800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:12.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.621+0000 7fe5e5414800 5 note: GC not initialized 2024-09-22T08:37:12.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.621+0000 7fe495fe3640 20 reqs_thread_entry: start 2024-09-22T08:37:12.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.621+0000 7fe5e5414800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:12.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.621+0000 7fe5e5414800 20 Filter name: none 2024-09-22T08:37:12.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.621+0000 7fe4077fe640 20 reqs_thread_entry: start 2024-09-22T08:37:12.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.621+0000 7fe5e5414800 20 rados->read ofs=0 len=0 2024-09-22T08:37:12.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.622+0000 7fe5e5414800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T08:37:12.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.622+0000 7fe5e5414800 20 rados->read ofs=0 len=0 2024-09-22T08:37:12.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.622+0000 7fe5e5414800 20 rados_obj.operate() r=0 bl.length=415 2024-09-22T08:37:12.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.623+0000 7fe5e5414800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:37:12.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.623+0000 7fe5e5414800 20 rados->read ofs=0 len=0 2024-09-22T08:37:12.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.623+0000 7fe5e5414800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T08:37:12.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.623+0000 7fe5e5414800 20 rados->read ofs=0 len=0 2024-09-22T08:37:12.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.623+0000 7fe5e5414800 20 rados_obj.operate() r=0 bl.length=415 2024-09-22T08:37:12.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.623+0000 7fe5e5414800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:37:12.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.625+0000 7fe496fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:12.628 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.628+0000 7fe5e5414800 20 remove_watcher() i=0 2024-09-22T08:37:12.628 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.628+0000 7fe5e5414800 2 removed watcher, disabling cache 2024-09-22T08:37:12.630 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.629+0000 7fe5e5414800 20 remove_watcher() i=1 2024-09-22T08:37:12.631 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.630+0000 7fe5e5414800 20 remove_watcher() i=2 2024-09-22T08:37:12.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.631+0000 7fe5e5414800 20 remove_watcher() i=3 2024-09-22T08:37:12.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.632+0000 7fe5e5414800 20 remove_watcher() i=4 2024-09-22T08:37:12.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.633+0000 7fe5e5414800 20 remove_watcher() i=5 2024-09-22T08:37:12.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.634+0000 7fe5e5414800 20 remove_watcher() i=6 2024-09-22T08:37:12.637 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.636+0000 7fe5e5414800 20 remove_watcher() i=7 2024-09-22T08:37:12.648 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:12.648 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:37:12.648 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-logrecord-writes id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.36 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-22T08:37:12.648 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:12.650 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:12.650 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:12.654 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:12.654 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:12.697 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:12.698 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:12.727 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-22T08:37:12.727 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:12.728 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:12.728 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:12.740 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:12.740 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:12.783 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:12.784 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:12.791 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:12.791 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:12.798 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:12.798 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:12.804 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:12.804 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:12.810 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:12.810 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:12.817 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:12.817 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:12.823 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:12.823 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:12.830 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:12.830 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:12.837 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:12.837 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:12.842 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:12.843 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:12.848 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:12.848 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:12.855 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:12.855 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:12.861 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:12.861 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:12.867 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:12.867 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:12.873 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:12.873 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:12.879 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:12.879 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:12.885 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:12.885 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:12.891 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:12.892 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:12.898 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:12.898 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:12.903 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:12.903 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:12.910 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-22T08:37:12.939 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:12.939 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:12.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.977+0000 7f540ca0d800 20 rados->read ofs=0 len=0 2024-09-22T08:37:12.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.979+0000 7f540ca0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:12.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.979+0000 7f540ca0d800 20 realm 2024-09-22T08:37:12.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.979+0000 7f540ca0d800 20 rados->read ofs=0 len=0 2024-09-22T08:37:12.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.979+0000 7f540ca0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:12.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.979+0000 7f540ca0d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:12.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.979+0000 7f540ca0d800 20 rados->read ofs=0 len=0 2024-09-22T08:37:12.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.979+0000 7f540ca0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:12.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.979+0000 7f540ca0d800 20 rados->read ofs=0 len=0 2024-09-22T08:37:12.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.980+0000 7f540ca0d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:12.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.980+0000 7f540ca0d800 20 rados->read ofs=0 len=0 2024-09-22T08:37:12.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.981+0000 7f540ca0d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:37:12.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.981+0000 7f540ca0d800 20 searching for the correct realm 2024-09-22T08:37:12.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:12.984+0000 7f540acf8640 0 -- 172.21.15.38:0/917060437 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7f53fc056980 msgr2=0x7f53fc064440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:37:13.191 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.189+0000 7f540a4f7640 0 -- 172.21.15.38:0/917060437 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x55facd1dbc00 msgr2=0x55facd1de0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:13.195 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.194+0000 7f540ca0d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:13.195 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.194+0000 7f540ca0d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:13.195 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.194+0000 7f540ca0d800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:37:13.195 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.194+0000 7f540ca0d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:13.195 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.194+0000 7f540ca0d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:13.195 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.194+0000 7f540ca0d800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:37:13.195 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.194+0000 7f540ca0d800 20 rados->read ofs=0 len=0 2024-09-22T08:37:13.195 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.194+0000 7f540ca0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:13.195 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.194+0000 7f540ca0d800 20 rados->read ofs=0 len=0 2024-09-22T08:37:13.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.194+0000 7f540ca0d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:13.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.194+0000 7f540ca0d800 20 rados->read ofs=0 len=0 2024-09-22T08:37:13.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.195+0000 7f540ca0d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:37:13.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.195+0000 7f540ca0d800 20 zone default found 2024-09-22T08:37:13.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.195+0000 7f540ca0d800 4 Realm: () 2024-09-22T08:37:13.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.195+0000 7f540ca0d800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:37:13.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.195+0000 7f540ca0d800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:37:13.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.195+0000 7f540ca0d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:13.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.195+0000 7f540ca0d800 20 zonegroup default 2024-09-22T08:37:13.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.195+0000 7f540ca0d800 20 rados->read ofs=0 len=0 2024-09-22T08:37:13.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.195+0000 7f540ca0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:13.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.195+0000 7f540ca0d800 20 rados->read ofs=0 len=0 2024-09-22T08:37:13.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.195+0000 7f540ca0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:13.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.195+0000 7f540ca0d800 20 rados->read ofs=0 len=0 2024-09-22T08:37:13.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.195+0000 7f540ca0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:13.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.195+0000 7f540ca0d800 20 started sync module instance, tier type = 2024-09-22T08:37:13.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.195+0000 7f540ca0d800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:37:13.205 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.204+0000 7f540ca0d800 20 add_watcher() i=0 2024-09-22T08:37:13.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.204+0000 7f540ca0d800 20 add_watcher() i=1 2024-09-22T08:37:13.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.204+0000 7f540ca0d800 20 add_watcher() i=2 2024-09-22T08:37:13.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.204+0000 7f540ca0d800 20 add_watcher() i=3 2024-09-22T08:37:13.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.204+0000 7f540ca0d800 20 add_watcher() i=4 2024-09-22T08:37:13.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.204+0000 7f540ca0d800 20 add_watcher() i=5 2024-09-22T08:37:13.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.204+0000 7f540ca0d800 20 add_watcher() i=6 2024-09-22T08:37:13.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.205+0000 7f540ca0d800 20 add_watcher() i=7 2024-09-22T08:37:13.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.205+0000 7f540ca0d800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:13.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.207+0000 7f52c0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:13.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.207+0000 7f540ca0d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:13.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.207+0000 7f540ca0d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:13.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.207+0000 7f540ca0d800 5 note: GC not initialized 2024-09-22T08:37:13.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.208+0000 7f523b7fe640 20 reqs_thread_entry: start 2024-09-22T08:37:13.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.208+0000 7f540ca0d800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:13.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.208+0000 7f540ca0d800 20 Filter name: none 2024-09-22T08:37:13.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.208+0000 7f52397fa640 20 reqs_thread_entry: start 2024-09-22T08:37:13.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.208+0000 7f540ca0d800 20 rados->read ofs=0 len=0 2024-09-22T08:37:13.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.209+0000 7f540ca0d800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:37:13.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.209+0000 7f540ca0d800 20 rados->read ofs=0 len=0 2024-09-22T08:37:13.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.209+0000 7f540ca0d800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:37:13.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.209+0000 7f540ca0d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:37:13.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.209+0000 7f540ca0d800 20 rados->read ofs=0 len=0 2024-09-22T08:37:13.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.209+0000 7f540ca0d800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:37:13.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.209+0000 7f540ca0d800 20 rados->read ofs=0 len=0 2024-09-22T08:37:13.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.210+0000 7f540ca0d800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:37:13.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.210+0000 7f540ca0d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:37:13.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.212+0000 7f52c0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:13.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.214+0000 7f540ca0d800 20 remove_watcher() i=0 2024-09-22T08:37:13.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.214+0000 7f540ca0d800 2 removed watcher, disabling cache 2024-09-22T08:37:13.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.215+0000 7f540ca0d800 20 remove_watcher() i=1 2024-09-22T08:37:13.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.216+0000 7f540ca0d800 20 remove_watcher() i=2 2024-09-22T08:37:13.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.217+0000 7f540ca0d800 20 remove_watcher() i=3 2024-09-22T08:37:13.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.218+0000 7f540ca0d800 20 remove_watcher() i=4 2024-09-22T08:37:13.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.219+0000 7f540ca0d800 20 remove_watcher() i=5 2024-09-22T08:37:13.221 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.220+0000 7f540ca0d800 20 remove_watcher() i=6 2024-09-22T08:37:13.222 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.221+0000 7f540ca0d800 20 remove_watcher() i=7 2024-09-22T08:37:13.233 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:13.233 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:37:13.233 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-change-reshard-state id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:37:13.233 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:13.234 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-22T08:37:13.270 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:13.270 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:13.312 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.311+0000 7f1a4433b800 20 rados->read ofs=0 len=0 2024-09-22T08:37:13.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.313+0000 7f1a4433b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:13.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.313+0000 7f1a4433b800 20 realm 2024-09-22T08:37:13.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.313+0000 7f1a4433b800 20 rados->read ofs=0 len=0 2024-09-22T08:37:13.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.313+0000 7f1a4433b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:13.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.313+0000 7f1a4433b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:13.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.313+0000 7f1a4433b800 20 rados->read ofs=0 len=0 2024-09-22T08:37:13.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.313+0000 7f1a4433b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:13.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.313+0000 7f1a4433b800 20 rados->read ofs=0 len=0 2024-09-22T08:37:13.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.314+0000 7f1a4433b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:13.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.314+0000 7f1a4433b800 20 rados->read ofs=0 len=0 2024-09-22T08:37:13.316 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.315+0000 7f1a4433b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:37:13.316 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.315+0000 7f1a4433b800 20 searching for the correct realm 2024-09-22T08:37:13.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.317+0000 7f1a40826640 0 -- 172.21.15.38:0/895044052 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7f1a30080040 msgr2=0x7f1a30072400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:13.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.522+0000 7f1a40025640 0 -- 172.21.15.38:0/895044052 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x563a75944f80 msgr2=0x563a759473a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:13.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.527+0000 7f1a4433b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:13.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.527+0000 7f1a4433b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:13.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.527+0000 7f1a4433b800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:37:13.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.527+0000 7f1a4433b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:13.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.527+0000 7f1a4433b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:13.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.527+0000 7f1a4433b800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:37:13.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.527+0000 7f1a4433b800 20 rados->read ofs=0 len=0 2024-09-22T08:37:13.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.528+0000 7f1a4433b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:13.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.528+0000 7f1a4433b800 20 rados->read ofs=0 len=0 2024-09-22T08:37:13.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.528+0000 7f1a4433b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:13.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.528+0000 7f1a4433b800 20 rados->read ofs=0 len=0 2024-09-22T08:37:13.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.528+0000 7f1a4433b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:37:13.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.528+0000 7f1a4433b800 20 zone default found 2024-09-22T08:37:13.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.528+0000 7f1a4433b800 4 Realm: () 2024-09-22T08:37:13.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.528+0000 7f1a4433b800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:37:13.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.528+0000 7f1a4433b800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:37:13.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.528+0000 7f1a4433b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:13.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.528+0000 7f1a4433b800 20 zonegroup default 2024-09-22T08:37:13.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.528+0000 7f1a4433b800 20 rados->read ofs=0 len=0 2024-09-22T08:37:13.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.529+0000 7f1a4433b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:13.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.529+0000 7f1a4433b800 20 rados->read ofs=0 len=0 2024-09-22T08:37:13.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.529+0000 7f1a4433b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:13.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.529+0000 7f1a4433b800 20 rados->read ofs=0 len=0 2024-09-22T08:37:13.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.529+0000 7f1a4433b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:13.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.529+0000 7f1a4433b800 20 started sync module instance, tier type = 2024-09-22T08:37:13.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.529+0000 7f1a4433b800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:37:13.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.539+0000 7f1a4433b800 20 add_watcher() i=0 2024-09-22T08:37:13.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.539+0000 7f1a4433b800 20 add_watcher() i=1 2024-09-22T08:37:13.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.539+0000 7f1a4433b800 20 add_watcher() i=2 2024-09-22T08:37:13.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.539+0000 7f1a4433b800 20 add_watcher() i=3 2024-09-22T08:37:13.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.539+0000 7f1a4433b800 20 add_watcher() i=4 2024-09-22T08:37:13.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.539+0000 7f1a4433b800 20 add_watcher() i=5 2024-09-22T08:37:13.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.539+0000 7f1a4433b800 20 add_watcher() i=6 2024-09-22T08:37:13.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.540+0000 7f1a4433b800 20 add_watcher() i=7 2024-09-22T08:37:13.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.540+0000 7f1a4433b800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:13.543 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.542+0000 7f18f6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:13.543 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.542+0000 7f1a4433b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:13.544 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.542+0000 7f1a4433b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:13.544 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.542+0000 7f1a4433b800 5 note: GC not initialized 2024-09-22T08:37:13.544 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.542+0000 7f18f5fdb640 20 reqs_thread_entry: start 2024-09-22T08:37:13.544 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.542+0000 7f1a4433b800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:13.544 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.542+0000 7f1a4433b800 20 Filter name: none 2024-09-22T08:37:13.544 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.543+0000 7f18677fe640 20 reqs_thread_entry: start 2024-09-22T08:37:13.544 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.543+0000 7f1a4433b800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-22T08:37:13.544 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.543+0000 7f1a4433b800 20 rados->read ofs=0 len=0 2024-09-22T08:37:13.545 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.543+0000 7f1a4433b800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:37:13.545 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.543+0000 7f1a4433b800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-22T08:37:13.545 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.543+0000 7f1a4433b800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-22T08:37:13.545 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.543+0000 7f1a4433b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.37 : miss 2024-09-22T08:37:13.545 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.543+0000 7f1a4433b800 20 rados->read ofs=0 len=0 2024-09-22T08:37:13.545 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.543+0000 7f1a4433b800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:37:13.545 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.543+0000 7f1a4433b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.37 info.flags=0x17 2024-09-22T08:37:13.545 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.543+0000 7f1a4433b800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.37 to cache LRU end 2024-09-22T08:37:13.545 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.543+0000 7f1a4433b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:37:13.545 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.543+0000 7f1a4433b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:13.545 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.543+0000 7f1a4433b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.37 2024-09-22T08:37:13.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.549+0000 7f1a4433b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.37 info.flags=0x17 2024-09-22T08:37:13.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.549+0000 7f1a4433b800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.37 to cache LRU end 2024-09-22T08:37:13.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.549+0000 7f1a4433b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:13.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.549+0000 7f1a4433b800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.37, ofs0, ns] 2024-09-22T08:37:13.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.549+0000 7f1916ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497023 cookie 94809080811664 notifier 7749 bl.length()=931 2024-09-22T08:37:13.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.549+0000 7f1916ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.37 info.flags=0x17 2024-09-22T08:37:13.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.549+0000 7f1916ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.37 to cache LRU end 2024-09-22T08:37:13.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.549+0000 7f1916ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:13.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.549+0000 7f1a4433b800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.37]): orig_sources= new_sources= 2024-09-22T08:37:13.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.549+0000 7f1a4433b800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.37]): potential sources added=[] removed=[] 2024-09-22T08:37:13.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.549+0000 7f1a4433b800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.37]): orig_dests= new_dests= 2024-09-22T08:37:13.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.549+0000 7f1a4433b800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.37]): potential dests added=[] removed=[] 2024-09-22T08:37:13.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.555+0000 7f1a4433b800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.0 2024-09-22T08:37:13.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.555+0000 7f1a4433b800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.0 2024-09-22T08:37:13.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.555+0000 7f1a4433b800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.1 2024-09-22T08:37:13.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.555+0000 7f1a4433b800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.1 2024-09-22T08:37:13.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.555+0000 7f1a4433b800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.2 2024-09-22T08:37:13.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.555+0000 7f1a4433b800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.2 2024-09-22T08:37:13.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.555+0000 7f1a4433b800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.3 2024-09-22T08:37:13.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.555+0000 7f1a4433b800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.3 2024-09-22T08:37:13.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.555+0000 7f1a4433b800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.4 2024-09-22T08:37:13.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.555+0000 7f1a4433b800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.4 2024-09-22T08:37:13.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.555+0000 7f1a4433b800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.5 2024-09-22T08:37:13.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.555+0000 7f1a4433b800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.5 2024-09-22T08:37:13.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.555+0000 7f1a4433b800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.6 2024-09-22T08:37:13.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.555+0000 7f1a4433b800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.6 2024-09-22T08:37:13.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.555+0000 7f1a4433b800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.7 2024-09-22T08:37:13.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.555+0000 7f1a4433b800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.7 2024-09-22T08:37:13.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.555+0000 7f1a4433b800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.8 2024-09-22T08:37:13.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.555+0000 7f1a4433b800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.8 2024-09-22T08:37:13.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.555+0000 7f1a4433b800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.9 2024-09-22T08:37:13.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.555+0000 7f1a4433b800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.9 2024-09-22T08:37:13.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.555+0000 7f1a4433b800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.10 2024-09-22T08:37:13.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.555+0000 7f1a4433b800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.10 2024-09-22T08:37:13.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.555+0000 7f1a4433b800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.11 2024-09-22T08:37:13.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.555+0000 7f1a4433b800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.11 2024-09-22T08:37:13.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.555+0000 7f1a4433b800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.0 2024-09-22T08:37:13.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.555+0000 7f1a4433b800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1 2024-09-22T08:37:13.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.556+0000 7f1a4433b800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.2 2024-09-22T08:37:13.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.556+0000 7f1a4433b800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.3 2024-09-22T08:37:13.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.557+0000 7f1a4433b800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.4 2024-09-22T08:37:13.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.557+0000 7f1a4433b800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.5 2024-09-22T08:37:13.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.558+0000 7f1a4433b800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.6 2024-09-22T08:37:13.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.558+0000 7f1a4433b800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.7 2024-09-22T08:37:13.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.559+0000 7f1a4433b800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.8 2024-09-22T08:37:13.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.559+0000 7f1a4433b800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.9 2024-09-22T08:37:13.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.560+0000 7f1a4433b800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.10 2024-09-22T08:37:13.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.563+0000 7f1a4433b800 -1 Injecting error=-5 at location=change_reshard_state 2024-09-22T08:37:13.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.563+0000 7f1a4433b800 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-22T08:37:13.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.574+0000 7f1a4433b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.37 : hit (requested=0x17, cached=0x17) 2024-09-22T08:37:13.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.574+0000 7f1a4433b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.37 2024-09-22T08:37:13.576 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.575+0000 7f1a4433b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.37 info.flags=0x17 2024-09-22T08:37:13.576 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.575+0000 7f1a4433b800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.37 to cache LRU end 2024-09-22T08:37:13.576 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.575+0000 7f1a4433b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:13.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.575+0000 7f1a4433b800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.37, ofs0, ns] 2024-09-22T08:37:13.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.576+0000 7f19177fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497024 cookie 94809080811664 notifier 7749 bl.length()=899 2024-09-22T08:37:13.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.576+0000 7f19177fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.37 info.flags=0x17 2024-09-22T08:37:13.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.576+0000 7f19177fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.37 to cache LRU end 2024-09-22T08:37:13.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.576+0000 7f19177fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:13.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.576+0000 7f1a4433b800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.37]): orig_sources= new_sources= 2024-09-22T08:37:13.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.576+0000 7f1a4433b800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.37]): potential sources added=[] removed=[] 2024-09-22T08:37:13.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.576+0000 7f1a4433b800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.37]): orig_dests= new_dests= 2024-09-22T08:37:13.578 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.576+0000 7f1a4433b800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.37]): potential dests added=[] removed=[] 2024-09-22T08:37:13.578 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.576+0000 7f1a4433b800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-22T08:37:13.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.578+0000 7f18f6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:13.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.580+0000 7f1a4433b800 20 remove_watcher() i=0 2024-09-22T08:37:13.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.580+0000 7f1a4433b800 2 removed watcher, disabling cache 2024-09-22T08:37:13.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.581+0000 7f1a4433b800 20 remove_watcher() i=1 2024-09-22T08:37:13.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.582+0000 7f1a4433b800 20 remove_watcher() i=2 2024-09-22T08:37:13.585 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.584+0000 7f1a4433b800 20 remove_watcher() i=3 2024-09-22T08:37:13.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.585+0000 7f1a4433b800 20 remove_watcher() i=4 2024-09-22T08:37:13.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.586+0000 7f1a4433b800 20 remove_watcher() i=5 2024-09-22T08:37:13.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.587+0000 7f1a4433b800 20 remove_watcher() i=6 2024-09-22T08:37:13.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.588+0000 7f1a4433b800 20 remove_watcher() i=7 2024-09-22T08:37:13.602 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-22T08:37:13.631 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:13.631 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:13.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.670+0000 7f756f60f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:13.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.672+0000 7f756f60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:13.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.672+0000 7f756f60f800 20 realm 2024-09-22T08:37:13.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.672+0000 7f756f60f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:13.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.672+0000 7f756f60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:13.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.672+0000 7f756f60f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:13.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.672+0000 7f756f60f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:13.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.672+0000 7f756f60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:13.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.672+0000 7f756f60f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:13.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.673+0000 7f756f60f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:13.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.673+0000 7f756f60f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:13.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.674+0000 7f756f60f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:37:13.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.674+0000 7f756f60f800 20 searching for the correct realm 2024-09-22T08:37:13.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.676+0000 7f756c8f8640 0 -- 172.21.15.38:0/3462206726 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f75640770e0 msgr2=0x7f7564076ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:13.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:13.881+0000 7f756c8f8640 0 -- 172.21.15.38:0/3462206726 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f756008e450 msgr2=0x7f756008e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:14.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.088+0000 7f756f60f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:14.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.088+0000 7f756f60f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:14.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.088+0000 7f756f60f800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:37:14.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.088+0000 7f756f60f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:14.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.088+0000 7f756f60f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:14.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.088+0000 7f756f60f800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:37:14.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.088+0000 7f756f60f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:14.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.088+0000 7f756f60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:14.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.088+0000 7f756f60f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:14.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.088+0000 7f756f60f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:14.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.088+0000 7f756f60f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:14.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.089+0000 7f756f60f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:37:14.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.089+0000 7f756f60f800 20 zone default found 2024-09-22T08:37:14.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.089+0000 7f756f60f800 4 Realm: () 2024-09-22T08:37:14.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.089+0000 7f756f60f800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:37:14.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.089+0000 7f756f60f800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:37:14.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.089+0000 7f756f60f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:14.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.089+0000 7f756f60f800 20 zonegroup default 2024-09-22T08:37:14.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.089+0000 7f756f60f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:14.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.089+0000 7f756f60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:14.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.089+0000 7f756f60f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:14.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.089+0000 7f756f60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:14.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.089+0000 7f756f60f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:14.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.090+0000 7f756f60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:14.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.090+0000 7f756f60f800 20 started sync module instance, tier type = 2024-09-22T08:37:14.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.090+0000 7f756f60f800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:37:14.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.099+0000 7f756f60f800 20 add_watcher() i=0 2024-09-22T08:37:14.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.099+0000 7f756f60f800 20 add_watcher() i=1 2024-09-22T08:37:14.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.099+0000 7f756f60f800 20 add_watcher() i=2 2024-09-22T08:37:14.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.099+0000 7f756f60f800 20 add_watcher() i=3 2024-09-22T08:37:14.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.099+0000 7f756f60f800 20 add_watcher() i=4 2024-09-22T08:37:14.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.099+0000 7f756f60f800 20 add_watcher() i=5 2024-09-22T08:37:14.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.099+0000 7f756f60f800 20 add_watcher() i=6 2024-09-22T08:37:14.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.100+0000 7f756f60f800 20 add_watcher() i=7 2024-09-22T08:37:14.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.100+0000 7f756f60f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:14.103 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.102+0000 7f74237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:14.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.103+0000 7f756f60f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:14.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.103+0000 7f756f60f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:14.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.103+0000 7f756f60f800 5 note: GC not initialized 2024-09-22T08:37:14.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.103+0000 7f74227e4640 20 reqs_thread_entry: start 2024-09-22T08:37:14.105 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.103+0000 7f756f60f800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:14.105 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.103+0000 7f756f60f800 20 Filter name: none 2024-09-22T08:37:14.105 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.103+0000 7f7393fff640 20 reqs_thread_entry: start 2024-09-22T08:37:14.105 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.103+0000 7f756f60f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:14.105 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.104+0000 7f756f60f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:37:14.106 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.104+0000 7f756f60f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:14.106 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.105+0000 7f756f60f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:37:14.106 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.105+0000 7f756f60f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:37:14.106 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.105+0000 7f756f60f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:14.106 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.105+0000 7f756f60f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:37:14.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.105+0000 7f756f60f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:14.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.105+0000 7f756f60f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:37:14.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.105+0000 7f756f60f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:37:14.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.107+0000 7f74237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:14.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.109+0000 7f756f60f800 20 remove_watcher() i=0 2024-09-22T08:37:14.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.109+0000 7f756f60f800 2 removed watcher, disabling cache 2024-09-22T08:37:14.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.110+0000 7f756f60f800 20 remove_watcher() i=1 2024-09-22T08:37:14.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.111+0000 7f756f60f800 20 remove_watcher() i=2 2024-09-22T08:37:14.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.112+0000 7f756f60f800 20 remove_watcher() i=3 2024-09-22T08:37:14.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.113+0000 7f756f60f800 20 remove_watcher() i=4 2024-09-22T08:37:14.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.115+0000 7f756f60f800 20 remove_watcher() i=5 2024-09-22T08:37:14.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.116+0000 7f756f60f800 20 remove_watcher() i=6 2024-09-22T08:37:14.118 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.117+0000 7f756f60f800 20 remove_watcher() i=7 2024-09-22T08:37:14.129 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:14.129 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:37:14.129 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-change-reshard-state id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:37:14.129 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:14.131 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:14.131 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:14.137 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:14.137 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:14.181 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:37:14.215 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:14.215 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:14.255 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.254+0000 7f945300f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:14.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.255+0000 7f945300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:14.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.255+0000 7f945300f800 20 realm 2024-09-22T08:37:14.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.255+0000 7f945300f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:14.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.256+0000 7f945300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:14.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.256+0000 7f945300f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:14.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.256+0000 7f945300f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:14.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.256+0000 7f945300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:14.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.256+0000 7f945300f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:14.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.257+0000 7f945300f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:14.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.257+0000 7f945300f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:14.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.257+0000 7f945300f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:37:14.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.257+0000 7f945300f800 20 searching for the correct realm 2024-09-22T08:37:14.261 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.260+0000 7f944df91640 0 -- 172.21.15.38:0/3793117990 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f943808d9a0 msgr2=0x7f943808a430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:37:14.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.264+0000 7f944df91640 0 -- 172.21.15.38:0/3793117990 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f944003b3c0 msgr2=0x7f9440041d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:37:14.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.473+0000 7f945300f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:14.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.473+0000 7f945300f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:14.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.473+0000 7f945300f800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:37:14.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.473+0000 7f945300f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:14.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.473+0000 7f945300f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:14.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.473+0000 7f945300f800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:37:14.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.473+0000 7f945300f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:14.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.473+0000 7f945300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:14.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.473+0000 7f945300f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:14.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.473+0000 7f945300f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:14.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.473+0000 7f945300f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:14.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.474+0000 7f945300f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:37:14.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.474+0000 7f945300f800 20 zone default found 2024-09-22T08:37:14.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.474+0000 7f945300f800 4 Realm: () 2024-09-22T08:37:14.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.474+0000 7f945300f800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:37:14.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.474+0000 7f945300f800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:37:14.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.474+0000 7f945300f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:14.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.474+0000 7f945300f800 20 zonegroup default 2024-09-22T08:37:14.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.474+0000 7f945300f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:14.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.474+0000 7f945300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:14.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.474+0000 7f945300f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:14.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.475+0000 7f945300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:14.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.475+0000 7f945300f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:14.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.475+0000 7f945300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:14.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.475+0000 7f945300f800 20 started sync module instance, tier type = 2024-09-22T08:37:14.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.475+0000 7f945300f800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:37:14.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.485+0000 7f945300f800 20 add_watcher() i=0 2024-09-22T08:37:14.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.485+0000 7f945300f800 20 add_watcher() i=1 2024-09-22T08:37:14.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.485+0000 7f945300f800 20 add_watcher() i=2 2024-09-22T08:37:14.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.485+0000 7f945300f800 20 add_watcher() i=3 2024-09-22T08:37:14.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.485+0000 7f945300f800 20 add_watcher() i=4 2024-09-22T08:37:14.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.485+0000 7f945300f800 20 add_watcher() i=5 2024-09-22T08:37:14.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.485+0000 7f945300f800 20 add_watcher() i=6 2024-09-22T08:37:14.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.486+0000 7f945300f800 20 add_watcher() i=7 2024-09-22T08:37:14.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.486+0000 7f945300f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:14.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.488+0000 7f93057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:14.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.488+0000 7f945300f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:14.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.488+0000 7f945300f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:14.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.488+0000 7f945300f800 5 note: GC not initialized 2024-09-22T08:37:14.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.489+0000 7f92ff7fe640 20 reqs_thread_entry: start 2024-09-22T08:37:14.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.489+0000 7f945300f800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:14.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.489+0000 7f945300f800 20 Filter name: none 2024-09-22T08:37:14.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.489+0000 7f92fd7fa640 20 reqs_thread_entry: start 2024-09-22T08:37:14.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.489+0000 7f945300f800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-22T08:37:14.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.489+0000 7f945300f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:14.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.489+0000 7f945300f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:37:14.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.489+0000 7f945300f800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-22T08:37:14.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.489+0000 7f945300f800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-22T08:37:14.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.489+0000 7f945300f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.37 : miss 2024-09-22T08:37:14.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.489+0000 7f945300f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:14.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.490+0000 7f945300f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:37:14.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.490+0000 7f945300f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.37 info.flags=0x17 2024-09-22T08:37:14.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.490+0000 7f945300f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.37 to cache LRU end 2024-09-22T08:37:14.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.490+0000 7f945300f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:37:14.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.490+0000 7f945300f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:14.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.490+0000 7f945300f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.37 2024-09-22T08:37:14.498 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.496+0000 7f945300f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.37 info.flags=0x17 2024-09-22T08:37:14.498 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.496+0000 7f945300f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.37 to cache LRU end 2024-09-22T08:37:14.498 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.496+0000 7f945300f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:14.498 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.496+0000 7f945300f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.37, ofs0, ns] 2024-09-22T08:37:14.498 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.496+0000 7f93317fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497025 cookie 94227834850384 notifier 7325 bl.length()=931 2024-09-22T08:37:14.498 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.496+0000 7f93317fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.37 info.flags=0x17 2024-09-22T08:37:14.498 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.496+0000 7f93317fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.37 to cache LRU end 2024-09-22T08:37:14.498 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.496+0000 7f93317fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:14.498 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.497+0000 7f945300f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.37]): orig_sources= new_sources= 2024-09-22T08:37:14.498 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.497+0000 7f945300f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.37]): potential sources added=[] removed=[] 2024-09-22T08:37:14.498 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.497+0000 7f945300f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.37]): orig_dests= new_dests= 2024-09-22T08:37:14.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.497+0000 7f945300f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.37]): potential dests added=[] removed=[] 2024-09-22T08:37:14.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.502+0000 7f945300f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.0 2024-09-22T08:37:14.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.502+0000 7f945300f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.0 2024-09-22T08:37:14.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.502+0000 7f945300f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.1 2024-09-22T08:37:14.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.502+0000 7f945300f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.1 2024-09-22T08:37:14.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.502+0000 7f945300f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.2 2024-09-22T08:37:14.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.502+0000 7f945300f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.2 2024-09-22T08:37:14.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.502+0000 7f945300f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.3 2024-09-22T08:37:14.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.502+0000 7f945300f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.3 2024-09-22T08:37:14.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.502+0000 7f945300f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.4 2024-09-22T08:37:14.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.502+0000 7f945300f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.4 2024-09-22T08:37:14.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.502+0000 7f945300f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.5 2024-09-22T08:37:14.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.502+0000 7f945300f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.5 2024-09-22T08:37:14.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.502+0000 7f945300f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.6 2024-09-22T08:37:14.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.502+0000 7f945300f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.6 2024-09-22T08:37:14.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.502+0000 7f945300f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.7 2024-09-22T08:37:14.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.502+0000 7f945300f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.7 2024-09-22T08:37:14.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.502+0000 7f945300f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.8 2024-09-22T08:37:14.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.502+0000 7f945300f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.8 2024-09-22T08:37:14.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.502+0000 7f945300f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.9 2024-09-22T08:37:14.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.502+0000 7f945300f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.9 2024-09-22T08:37:14.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.502+0000 7f945300f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.10 2024-09-22T08:37:14.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.502+0000 7f945300f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.10 2024-09-22T08:37:14.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.502+0000 7f945300f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.11 2024-09-22T08:37:14.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.502+0000 7f945300f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1.11 2024-09-22T08:37:14.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.502+0000 7f945300f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.0 2024-09-22T08:37:14.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.503+0000 7f945300f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1 2024-09-22T08:37:14.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.503+0000 7f945300f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.2 2024-09-22T08:37:14.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.503+0000 7f945300f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.3 2024-09-22T08:37:14.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.504+0000 7f945300f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.4 2024-09-22T08:37:14.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.504+0000 7f945300f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.5 2024-09-22T08:37:14.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.505+0000 7f945300f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.6 2024-09-22T08:37:14.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.506+0000 7f945300f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.7 2024-09-22T08:37:14.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.506+0000 7f945300f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.8 2024-09-22T08:37:14.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.507+0000 7f945300f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.9 2024-09-22T08:37:14.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.507+0000 7f945300f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.10 2024-09-22T08:37:14.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.511+0000 7f945300f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.37 : hit (requested=0x17, cached=0x17) 2024-09-22T08:37:14.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.511+0000 7f945300f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.37 2024-09-22T08:37:14.513 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.512+0000 7f945300f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.37 info.flags=0x17 2024-09-22T08:37:14.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.512+0000 7f945300f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.37 to cache LRU end 2024-09-22T08:37:14.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.512+0000 7f945300f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:14.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.512+0000 7f945300f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.37, ofs0, ns] 2024-09-22T08:37:14.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.512+0000 7f9331ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497026 cookie 94227834850384 notifier 7325 bl.length()=931 2024-09-22T08:37:14.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.512+0000 7f9331ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.37 info.flags=0x17 2024-09-22T08:37:14.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.512+0000 7f9331ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.37 to cache LRU end 2024-09-22T08:37:14.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.512+0000 7f9331ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:14.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.513+0000 7f945300f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.37]): orig_sources= new_sources= 2024-09-22T08:37:14.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.513+0000 7f945300f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.37]): potential sources added=[] removed=[] 2024-09-22T08:37:14.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.513+0000 7f945300f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.37]): orig_dests= new_dests= 2024-09-22T08:37:14.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.513+0000 7f945300f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.37]): potential dests added=[] removed=[] 2024-09-22T08:37:14.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.515+0000 7f945300f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.0 2024-09-22T08:37:14.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.515+0000 7f945300f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.1 2024-09-22T08:37:14.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.516+0000 7f945300f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.2 2024-09-22T08:37:14.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.516+0000 7f945300f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.3 2024-09-22T08:37:14.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.516+0000 7f945300f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.4 2024-09-22T08:37:14.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.517+0000 7f945300f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.5 2024-09-22T08:37:14.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.517+0000 7f945300f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.6 2024-09-22T08:37:14.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.518+0000 7f945300f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.7 2024-09-22T08:37:14.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.518+0000 7f945300f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.8 2024-09-22T08:37:14.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.518+0000 7f945300f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.9 2024-09-22T08:37:14.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.518+0000 7f945300f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.37.10 2024-09-22T08:37:14.520 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.519+0000 7f945300f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.37 : hit (requested=0x17, cached=0x17) 2024-09-22T08:37:14.520 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.519+0000 7f945300f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.37 2024-09-22T08:37:14.521 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.520+0000 7f945300f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.37 info.flags=0x17 2024-09-22T08:37:14.521 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.520+0000 7f945300f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.37 to cache LRU end 2024-09-22T08:37:14.521 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.520+0000 7f945300f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:14.521 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.520+0000 7f945300f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.37, ofs0, ns] 2024-09-22T08:37:14.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.520+0000 7f93317fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497027 cookie 94227834850384 notifier 7325 bl.length()=899 2024-09-22T08:37:14.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.520+0000 7f93317fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.37 info.flags=0x17 2024-09-22T08:37:14.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.520+0000 7f93317fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.37 to cache LRU end 2024-09-22T08:37:14.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.520+0000 7f93317fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:14.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.521+0000 7f945300f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.37]): orig_sources= new_sources= 2024-09-22T08:37:14.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.521+0000 7f945300f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.37]): potential sources added=[] removed=[] 2024-09-22T08:37:14.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.521+0000 7f945300f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.37]): orig_dests= new_dests= 2024-09-22T08:37:14.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.521+0000 7f945300f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.37]): potential dests added=[] removed=[] 2024-09-22T08:37:14.524 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.523+0000 7f945300f800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-22T08:37:14.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.525+0000 7f93057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:14.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.528+0000 7f945300f800 20 remove_watcher() i=0 2024-09-22T08:37:14.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.528+0000 7f945300f800 2 removed watcher, disabling cache 2024-09-22T08:37:14.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.529+0000 7f945300f800 20 remove_watcher() i=1 2024-09-22T08:37:14.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.530+0000 7f945300f800 20 remove_watcher() i=2 2024-09-22T08:37:14.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.531+0000 7f945300f800 20 remove_watcher() i=3 2024-09-22T08:37:14.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.532+0000 7f945300f800 20 remove_watcher() i=4 2024-09-22T08:37:14.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.533+0000 7f945300f800 20 remove_watcher() i=5 2024-09-22T08:37:14.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.534+0000 7f945300f800 20 remove_watcher() i=6 2024-09-22T08:37:14.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.536+0000 7f945300f800 20 remove_watcher() i=7 2024-09-22T08:37:14.549 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-22T08:37:14.579 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:14.579 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:14.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.617+0000 7fa5b780e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:14.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.619+0000 7fa5b780e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:14.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.619+0000 7fa5b780e800 20 realm 2024-09-22T08:37:14.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.619+0000 7fa5b780e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:14.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.619+0000 7fa5b780e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:14.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.619+0000 7fa5b780e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:14.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.619+0000 7fa5b780e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:14.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.620+0000 7fa5b780e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:14.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.620+0000 7fa5b780e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:14.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.620+0000 7fa5b780e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:14.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.620+0000 7fa5b780e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:14.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.621+0000 7fa5b780e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:37:14.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.621+0000 7fa5b780e800 20 searching for the correct realm 2024-09-22T08:37:14.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.623+0000 7fa5b27bb640 0 -- 172.21.15.38:0/3392562313 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7fa5a801d430 msgr2=0x7fa5a801d870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:14.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.627+0000 7fa5b27bb640 0 -- 172.21.15.38:0/3392562313 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fa5a4073a10 msgr2=0x7fa5a406c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:14.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.835+0000 7fa5b780e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:14.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.835+0000 7fa5b780e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:14.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.835+0000 7fa5b780e800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:37:14.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.835+0000 7fa5b780e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:14.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.835+0000 7fa5b780e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:14.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.835+0000 7fa5b780e800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:37:14.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.835+0000 7fa5b780e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:14.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.835+0000 7fa5b780e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:14.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.835+0000 7fa5b780e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:14.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.835+0000 7fa5b780e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:14.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.835+0000 7fa5b780e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:14.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.836+0000 7fa5b780e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:37:14.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.836+0000 7fa5b780e800 20 zone default found 2024-09-22T08:37:14.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.836+0000 7fa5b780e800 4 Realm: () 2024-09-22T08:37:14.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.836+0000 7fa5b780e800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:37:14.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.836+0000 7fa5b780e800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:37:14.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.836+0000 7fa5b780e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:14.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.836+0000 7fa5b780e800 20 zonegroup default 2024-09-22T08:37:14.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.836+0000 7fa5b780e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:14.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.836+0000 7fa5b780e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:14.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.836+0000 7fa5b780e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:14.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.837+0000 7fa5b780e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:14.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.837+0000 7fa5b780e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:14.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.837+0000 7fa5b780e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:14.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.837+0000 7fa5b780e800 20 started sync module instance, tier type = 2024-09-22T08:37:14.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.837+0000 7fa5b780e800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:37:14.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.848+0000 7fa5b780e800 20 add_watcher() i=0 2024-09-22T08:37:14.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.848+0000 7fa5b780e800 20 add_watcher() i=1 2024-09-22T08:37:14.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.848+0000 7fa5b780e800 20 add_watcher() i=2 2024-09-22T08:37:14.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.848+0000 7fa5b780e800 20 add_watcher() i=3 2024-09-22T08:37:14.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.848+0000 7fa5b780e800 20 add_watcher() i=4 2024-09-22T08:37:14.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.848+0000 7fa5b780e800 20 add_watcher() i=5 2024-09-22T08:37:14.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.848+0000 7fa5b780e800 20 add_watcher() i=6 2024-09-22T08:37:14.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.849+0000 7fa5b780e800 20 add_watcher() i=7 2024-09-22T08:37:14.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.849+0000 7fa5b780e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:14.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.851+0000 7fa4697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:14.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.851+0000 7fa5b780e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:14.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.851+0000 7fa5b780e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:14.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.851+0000 7fa5b780e800 5 note: GC not initialized 2024-09-22T08:37:14.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.852+0000 7fa3e3fff640 20 reqs_thread_entry: start 2024-09-22T08:37:14.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.852+0000 7fa5b780e800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:14.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.852+0000 7fa5b780e800 20 Filter name: none 2024-09-22T08:37:14.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.852+0000 7fa3e1ffb640 20 reqs_thread_entry: start 2024-09-22T08:37:14.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.852+0000 7fa5b780e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:14.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.852+0000 7fa5b780e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:37:14.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.852+0000 7fa5b780e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:14.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.853+0000 7fa5b780e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:37:14.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.853+0000 7fa5b780e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:37:14.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.853+0000 7fa5b780e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:14.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.853+0000 7fa5b780e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:37:14.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.853+0000 7fa5b780e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:14.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.854+0000 7fa5b780e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:37:14.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.854+0000 7fa5b780e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:37:14.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.855+0000 7fa4697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:14.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.858+0000 7fa5b780e800 20 remove_watcher() i=0 2024-09-22T08:37:14.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.858+0000 7fa5b780e800 2 removed watcher, disabling cache 2024-09-22T08:37:14.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.859+0000 7fa5b780e800 20 remove_watcher() i=1 2024-09-22T08:37:14.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.860+0000 7fa5b780e800 20 remove_watcher() i=2 2024-09-22T08:37:14.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.862+0000 7fa5b780e800 20 remove_watcher() i=3 2024-09-22T08:37:14.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.863+0000 7fa5b780e800 20 remove_watcher() i=4 2024-09-22T08:37:14.865 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.864+0000 7fa5b780e800 20 remove_watcher() i=5 2024-09-22T08:37:14.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.865+0000 7fa5b780e800 20 remove_watcher() i=6 2024-09-22T08:37:14.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:14.867+0000 7fa5b780e800 20 remove_watcher() i=7 2024-09-22T08:37:14.879 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:14.879 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:37:14.879 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-change-reshard-state id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.37 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-22T08:37:14.879 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:14.881 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:14.881 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:14.884 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:14.884 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:14.928 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:14.928 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:14.958 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-22T08:37:14.958 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:14.959 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:14.959 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:14.970 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:14.970 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:15.013 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:15.013 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:15.019 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:15.019 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:15.025 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:15.026 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:15.031 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:15.031 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:15.039 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:15.039 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:15.045 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:15.045 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:15.051 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:15.051 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:15.057 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:15.057 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:15.063 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:15.063 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:15.069 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:15.069 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:15.076 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:15.076 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:15.081 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:15.081 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:15.087 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:15.087 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:15.093 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:15.093 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:15.099 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:15.100 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:15.105 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:15.105 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:15.111 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:15.111 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:15.116 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:15.117 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:15.122 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:15.123 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:15.129 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:15.129 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:15.136 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-22T08:37:15.165 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:15.165 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:15.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.203+0000 7f15ec32c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:15.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.205+0000 7f15ec32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:15.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.205+0000 7f15ec32c800 20 realm 2024-09-22T08:37:15.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.205+0000 7f15ec32c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:15.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.206+0000 7f15ec32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:15.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.206+0000 7f15ec32c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:15.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.206+0000 7f15ec32c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:15.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.206+0000 7f15ec32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:15.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.206+0000 7f15ec32c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:15.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.206+0000 7f15ec32c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:15.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.206+0000 7f15ec32c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:15.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.207+0000 7f15ec32c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:37:15.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.207+0000 7f15ec32c800 20 searching for the correct realm 2024-09-22T08:37:15.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.210+0000 7f15e873f640 0 -- 172.21.15.38:0/3881641550 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7f15d80b8150 msgr2=0x7f15d8059050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:15.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.416+0000 7f15e873f640 0 -- 172.21.15.38:0/3881641550 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x5633a5fccc10 msgr2=0x5633a5fcf050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:15.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.420+0000 7f15ec32c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:15.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.420+0000 7f15ec32c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:15.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.420+0000 7f15ec32c800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:37:15.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.420+0000 7f15ec32c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:15.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.420+0000 7f15ec32c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:15.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.420+0000 7f15ec32c800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:37:15.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.420+0000 7f15ec32c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:15.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.421+0000 7f15ec32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:15.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.421+0000 7f15ec32c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:15.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.421+0000 7f15ec32c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:15.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.421+0000 7f15ec32c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:15.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.421+0000 7f15ec32c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:37:15.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.421+0000 7f15ec32c800 20 zone default found 2024-09-22T08:37:15.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.421+0000 7f15ec32c800 4 Realm: () 2024-09-22T08:37:15.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.421+0000 7f15ec32c800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:37:15.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.421+0000 7f15ec32c800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:37:15.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.421+0000 7f15ec32c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:15.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.421+0000 7f15ec32c800 20 zonegroup default 2024-09-22T08:37:15.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.421+0000 7f15ec32c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:15.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.422+0000 7f15ec32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:15.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.422+0000 7f15ec32c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:15.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.422+0000 7f15ec32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:15.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.422+0000 7f15ec32c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:15.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.422+0000 7f15ec32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:15.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.422+0000 7f15ec32c800 20 started sync module instance, tier type = 2024-09-22T08:37:15.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.422+0000 7f15ec32c800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:37:15.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.431+0000 7f15ec32c800 20 add_watcher() i=0 2024-09-22T08:37:15.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.431+0000 7f15ec32c800 20 add_watcher() i=1 2024-09-22T08:37:15.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.431+0000 7f15ec32c800 20 add_watcher() i=2 2024-09-22T08:37:15.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.431+0000 7f15ec32c800 20 add_watcher() i=3 2024-09-22T08:37:15.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.431+0000 7f15ec32c800 20 add_watcher() i=4 2024-09-22T08:37:15.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.431+0000 7f15ec32c800 20 add_watcher() i=5 2024-09-22T08:37:15.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.431+0000 7f15ec32c800 20 add_watcher() i=6 2024-09-22T08:37:15.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.432+0000 7f15ec32c800 20 add_watcher() i=7 2024-09-22T08:37:15.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.432+0000 7f15ec32c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:15.435 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.434+0000 7f149e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:15.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.435+0000 7f15ec32c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:15.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.435+0000 7f15ec32c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:15.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.435+0000 7f15ec32c800 5 note: GC not initialized 2024-09-22T08:37:15.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.435+0000 7f149d7e2640 20 reqs_thread_entry: start 2024-09-22T08:37:15.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.435+0000 7f15ec32c800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:15.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.435+0000 7f15ec32c800 20 Filter name: none 2024-09-22T08:37:15.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.435+0000 7f14967fc640 20 reqs_thread_entry: start 2024-09-22T08:37:15.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.435+0000 7f15ec32c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:15.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.436+0000 7f15ec32c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:37:15.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.436+0000 7f15ec32c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:15.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.436+0000 7f15ec32c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:37:15.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.436+0000 7f15ec32c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:37:15.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.436+0000 7f15ec32c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:15.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.437+0000 7f15ec32c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:37:15.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.437+0000 7f15ec32c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:15.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.437+0000 7f15ec32c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:37:15.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.437+0000 7f15ec32c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:37:15.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.439+0000 7f149e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:15.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.441+0000 7f15ec32c800 20 remove_watcher() i=0 2024-09-22T08:37:15.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.441+0000 7f15ec32c800 2 removed watcher, disabling cache 2024-09-22T08:37:15.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.442+0000 7f15ec32c800 20 remove_watcher() i=1 2024-09-22T08:37:15.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.443+0000 7f15ec32c800 20 remove_watcher() i=2 2024-09-22T08:37:15.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.444+0000 7f15ec32c800 20 remove_watcher() i=3 2024-09-22T08:37:15.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.445+0000 7f15ec32c800 20 remove_watcher() i=4 2024-09-22T08:37:15.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.446+0000 7f15ec32c800 20 remove_watcher() i=5 2024-09-22T08:37:15.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.447+0000 7f15ec32c800 20 remove_watcher() i=6 2024-09-22T08:37:15.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.448+0000 7f15ec32c800 20 remove_watcher() i=7 2024-09-22T08:37:15.461 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:15.461 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:37:15.461 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-change-reshard-state id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:37:15.461 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:15.462 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-22T08:37:15.499 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:15.499 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:15.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.538+0000 7f54151ad800 20 rados->read ofs=0 len=0 2024-09-22T08:37:15.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.539+0000 7f54151ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:15.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.539+0000 7f54151ad800 20 realm 2024-09-22T08:37:15.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.539+0000 7f54151ad800 20 rados->read ofs=0 len=0 2024-09-22T08:37:15.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.540+0000 7f54151ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:15.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.540+0000 7f54151ad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:15.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.540+0000 7f54151ad800 20 rados->read ofs=0 len=0 2024-09-22T08:37:15.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.540+0000 7f54151ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:15.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.540+0000 7f54151ad800 20 rados->read ofs=0 len=0 2024-09-22T08:37:15.542 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.540+0000 7f54151ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:15.542 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.540+0000 7f54151ad800 20 rados->read ofs=0 len=0 2024-09-22T08:37:15.542 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.541+0000 7f54151ad800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:37:15.542 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.541+0000 7f54151ad800 20 searching for the correct realm 2024-09-22T08:37:15.545 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.544+0000 7f5412c97640 0 -- 172.21.15.38:0/1776759713 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x55a3ac1f1d20 msgr2=0x55a3ac1f41e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:15.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.547+0000 7f5412496640 0 -- 172.21.15.38:0/1776759713 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f54040680b0 msgr2=0x7f540406a1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:37:15.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.754+0000 7f54151ad800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:15.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.754+0000 7f54151ad800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:15.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.754+0000 7f54151ad800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:37:15.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.754+0000 7f54151ad800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:15.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.754+0000 7f54151ad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:15.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.754+0000 7f54151ad800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:37:15.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.754+0000 7f54151ad800 20 rados->read ofs=0 len=0 2024-09-22T08:37:15.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.755+0000 7f54151ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:15.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.755+0000 7f54151ad800 20 rados->read ofs=0 len=0 2024-09-22T08:37:15.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.755+0000 7f54151ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:15.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.755+0000 7f54151ad800 20 rados->read ofs=0 len=0 2024-09-22T08:37:15.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.755+0000 7f54151ad800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:37:15.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.755+0000 7f54151ad800 20 zone default found 2024-09-22T08:37:15.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.755+0000 7f54151ad800 4 Realm: () 2024-09-22T08:37:15.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.755+0000 7f54151ad800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:37:15.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.755+0000 7f54151ad800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:37:15.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.755+0000 7f54151ad800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:15.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.755+0000 7f54151ad800 20 zonegroup default 2024-09-22T08:37:15.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.755+0000 7f54151ad800 20 rados->read ofs=0 len=0 2024-09-22T08:37:15.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.756+0000 7f54151ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:15.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.756+0000 7f54151ad800 20 rados->read ofs=0 len=0 2024-09-22T08:37:15.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.756+0000 7f54151ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:15.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.756+0000 7f54151ad800 20 rados->read ofs=0 len=0 2024-09-22T08:37:15.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.757+0000 7f54151ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:15.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.757+0000 7f54151ad800 20 started sync module instance, tier type = 2024-09-22T08:37:15.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.757+0000 7f54151ad800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:37:15.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.766+0000 7f54151ad800 20 add_watcher() i=0 2024-09-22T08:37:15.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.766+0000 7f54151ad800 20 add_watcher() i=1 2024-09-22T08:37:15.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.766+0000 7f54151ad800 20 add_watcher() i=2 2024-09-22T08:37:15.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.766+0000 7f54151ad800 20 add_watcher() i=3 2024-09-22T08:37:15.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.766+0000 7f54151ad800 20 add_watcher() i=4 2024-09-22T08:37:15.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.766+0000 7f54151ad800 20 add_watcher() i=5 2024-09-22T08:37:15.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.766+0000 7f54151ad800 20 add_watcher() i=6 2024-09-22T08:37:15.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.767+0000 7f54151ad800 20 add_watcher() i=7 2024-09-22T08:37:15.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.767+0000 7f54151ad800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:15.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.769+0000 7f52c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:15.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.769+0000 7f54151ad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:15.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.769+0000 7f54151ad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:15.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.769+0000 7f54151ad800 5 note: GC not initialized 2024-09-22T08:37:15.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.770+0000 7f52c8fe1640 20 reqs_thread_entry: start 2024-09-22T08:37:15.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.770+0000 7f54151ad800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:15.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.770+0000 7f54151ad800 20 Filter name: none 2024-09-22T08:37:15.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.770+0000 7f52c1ffb640 20 reqs_thread_entry: start 2024-09-22T08:37:15.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.770+0000 7f54151ad800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-22T08:37:15.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.770+0000 7f54151ad800 20 rados->read ofs=0 len=0 2024-09-22T08:37:15.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.770+0000 7f54151ad800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:37:15.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.770+0000 7f54151ad800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-22T08:37:15.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.770+0000 7f54151ad800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-22T08:37:15.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.770+0000 7f54151ad800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.38 : miss 2024-09-22T08:37:15.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.770+0000 7f54151ad800 20 rados->read ofs=0 len=0 2024-09-22T08:37:15.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.771+0000 7f54151ad800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:37:15.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.771+0000 7f54151ad800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.38 info.flags=0x17 2024-09-22T08:37:15.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.771+0000 7f54151ad800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.38 to cache LRU end 2024-09-22T08:37:15.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.771+0000 7f54151ad800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:37:15.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.771+0000 7f54151ad800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:15.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.771+0000 7f54151ad800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.38 2024-09-22T08:37:15.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.777+0000 7f54151ad800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.38 info.flags=0x17 2024-09-22T08:37:15.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.777+0000 7f54151ad800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.38 to cache LRU end 2024-09-22T08:37:15.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.777+0000 7f54151ad800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:15.779 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.777+0000 7f54151ad800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.38, ofs0, ns] 2024-09-22T08:37:15.779 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.777+0000 7f52f5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497030 cookie 94161455766384 notifier 7373 bl.length()=931 2024-09-22T08:37:15.779 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.777+0000 7f52f5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.38 info.flags=0x17 2024-09-22T08:37:15.779 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.777+0000 7f52f5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.38 to cache LRU end 2024-09-22T08:37:15.779 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.777+0000 7f52f5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:15.780 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.778+0000 7f54151ad800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.38]): orig_sources= new_sources= 2024-09-22T08:37:15.780 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.778+0000 7f54151ad800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.38]): potential sources added=[] removed=[] 2024-09-22T08:37:15.780 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.778+0000 7f54151ad800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.38]): orig_dests= new_dests= 2024-09-22T08:37:15.780 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.778+0000 7f54151ad800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.38]): potential dests added=[] removed=[] 2024-09-22T08:37:15.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.782+0000 7f54151ad800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.1.0 2024-09-22T08:37:15.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.782+0000 7f54151ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.1.0 2024-09-22T08:37:15.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.782+0000 7f54151ad800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.1.1 2024-09-22T08:37:15.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.782+0000 7f54151ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.1.1 2024-09-22T08:37:15.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.782+0000 7f54151ad800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.1.2 2024-09-22T08:37:15.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.782+0000 7f54151ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.1.2 2024-09-22T08:37:15.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.782+0000 7f54151ad800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.1.3 2024-09-22T08:37:15.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.782+0000 7f54151ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.1.3 2024-09-22T08:37:15.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.782+0000 7f54151ad800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.1.4 2024-09-22T08:37:15.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.782+0000 7f54151ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.1.4 2024-09-22T08:37:15.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.782+0000 7f54151ad800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.1.5 2024-09-22T08:37:15.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.782+0000 7f54151ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.1.5 2024-09-22T08:37:15.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.782+0000 7f54151ad800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.1.6 2024-09-22T08:37:15.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.782+0000 7f54151ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.1.6 2024-09-22T08:37:15.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.782+0000 7f54151ad800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.1.7 2024-09-22T08:37:15.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.782+0000 7f54151ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.1.7 2024-09-22T08:37:15.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.782+0000 7f54151ad800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.1.8 2024-09-22T08:37:15.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.782+0000 7f54151ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.1.8 2024-09-22T08:37:15.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.782+0000 7f54151ad800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.1.9 2024-09-22T08:37:15.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.782+0000 7f54151ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.1.9 2024-09-22T08:37:15.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.782+0000 7f54151ad800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.1.10 2024-09-22T08:37:15.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.782+0000 7f54151ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.1.10 2024-09-22T08:37:15.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.782+0000 7f54151ad800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.1.11 2024-09-22T08:37:15.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.782+0000 7f54151ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.1.11 2024-09-22T08:37:15.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.782+0000 7f54151ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.0 2024-09-22T08:37:15.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.783+0000 7f54151ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.1 2024-09-22T08:37:15.787 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.783+0000 7f54151ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.2 2024-09-22T08:37:15.787 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.784+0000 7f54151ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.3 2024-09-22T08:37:15.787 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.785+0000 7f54151ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.4 2024-09-22T08:37:15.787 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.785+0000 7f54151ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.5 2024-09-22T08:37:15.787 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.786+0000 7f54151ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.6 2024-09-22T08:37:15.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.786+0000 7f54151ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.7 2024-09-22T08:37:15.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.787+0000 7f54151ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.8 2024-09-22T08:37:15.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.787+0000 7f54151ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.9 2024-09-22T08:37:15.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.788+0000 7f54151ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.10 2024-09-22T08:37:15.792 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.791+0000 7f54151ad800 -1 Injecting error=-125 at location=change_reshard_state 2024-09-22T08:37:15.792 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.791+0000 7f54151ad800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.38 : hit (requested=0x17, cached=0x17) 2024-09-22T08:37:15.792 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.791+0000 7f54151ad800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.38 2024-09-22T08:37:15.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.792+0000 7f54151ad800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.38 info.flags=0x17 2024-09-22T08:37:15.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.792+0000 7f54151ad800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.38 to cache LRU end 2024-09-22T08:37:15.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.792+0000 7f54151ad800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:15.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.792+0000 7f54151ad800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.38, ofs0, ns] 2024-09-22T08:37:15.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.793+0000 7f52f5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497031 cookie 94161455766384 notifier 7373 bl.length()=931 2024-09-22T08:37:15.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.793+0000 7f52f5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.38 info.flags=0x17 2024-09-22T08:37:15.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.793+0000 7f52f5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.38 to cache LRU end 2024-09-22T08:37:15.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.793+0000 7f52f5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:15.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.793+0000 7f54151ad800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.38]): orig_sources= new_sources= 2024-09-22T08:37:15.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.793+0000 7f54151ad800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.38]): potential sources added=[] removed=[] 2024-09-22T08:37:15.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.793+0000 7f54151ad800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.38]): orig_dests= new_dests= 2024-09-22T08:37:15.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.793+0000 7f54151ad800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.38]): potential dests added=[] removed=[] 2024-09-22T08:37:15.797 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.796+0000 7f54151ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.0 2024-09-22T08:37:15.797 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.796+0000 7f54151ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.1 2024-09-22T08:37:15.797 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.796+0000 7f54151ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.2 2024-09-22T08:37:15.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.797+0000 7f54151ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.3 2024-09-22T08:37:15.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.797+0000 7f54151ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.4 2024-09-22T08:37:15.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.798+0000 7f54151ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.5 2024-09-22T08:37:15.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.798+0000 7f54151ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.6 2024-09-22T08:37:15.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.798+0000 7f54151ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.7 2024-09-22T08:37:15.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.799+0000 7f54151ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.8 2024-09-22T08:37:15.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.799+0000 7f54151ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.9 2024-09-22T08:37:15.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.799+0000 7f54151ad800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.38.10 2024-09-22T08:37:15.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.800+0000 7f54151ad800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.38 : hit (requested=0x17, cached=0x17) 2024-09-22T08:37:15.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.800+0000 7f54151ad800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.38 2024-09-22T08:37:15.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.801+0000 7f54151ad800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.38 info.flags=0x17 2024-09-22T08:37:15.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.801+0000 7f54151ad800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.38 to cache LRU end 2024-09-22T08:37:15.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.801+0000 7f54151ad800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:15.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.801+0000 7f54151ad800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.38, ofs0, ns] 2024-09-22T08:37:15.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.801+0000 7f52f5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497032 cookie 94161455766384 notifier 7373 bl.length()=899 2024-09-22T08:37:15.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.801+0000 7f52f5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.38 info.flags=0x17 2024-09-22T08:37:15.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.801+0000 7f52f5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.38 to cache LRU end 2024-09-22T08:37:15.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.801+0000 7f52f5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:15.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.802+0000 7f54151ad800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.38]): orig_sources= new_sources= 2024-09-22T08:37:15.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.802+0000 7f54151ad800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.38]): potential sources added=[] removed=[] 2024-09-22T08:37:15.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.802+0000 7f54151ad800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.38]): orig_dests= new_dests= 2024-09-22T08:37:15.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.802+0000 7f54151ad800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.38]): potential dests added=[] removed=[] 2024-09-22T08:37:15.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.804+0000 7f54151ad800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-22T08:37:15.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.806+0000 7f52c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:15.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.808+0000 7f54151ad800 20 remove_watcher() i=0 2024-09-22T08:37:15.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.808+0000 7f54151ad800 2 removed watcher, disabling cache 2024-09-22T08:37:15.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.809+0000 7f54151ad800 20 remove_watcher() i=1 2024-09-22T08:37:15.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.810+0000 7f54151ad800 20 remove_watcher() i=2 2024-09-22T08:37:15.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.811+0000 7f54151ad800 20 remove_watcher() i=3 2024-09-22T08:37:15.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.812+0000 7f54151ad800 20 remove_watcher() i=4 2024-09-22T08:37:15.815 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.814+0000 7f54151ad800 20 remove_watcher() i=5 2024-09-22T08:37:15.816 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.815+0000 7f54151ad800 20 remove_watcher() i=6 2024-09-22T08:37:15.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.816+0000 7f54151ad800 20 remove_watcher() i=7 2024-09-22T08:37:15.829 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-22T08:37:15.859 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:15.859 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:15.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.897+0000 7f63bc00e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:15.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.899+0000 7f63bc00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:15.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.899+0000 7f63bc00e800 20 realm 2024-09-22T08:37:15.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.899+0000 7f63bc00e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:15.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.899+0000 7f63bc00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:15.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.899+0000 7f63bc00e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:15.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.899+0000 7f63bc00e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:15.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.899+0000 7f63bc00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:15.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.899+0000 7f63bc00e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:15.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.900+0000 7f63bc00e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:15.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.900+0000 7f63bc00e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:15.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.900+0000 7f63bc00e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:37:15.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.900+0000 7f63bc00e800 20 searching for the correct realm 2024-09-22T08:37:15.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.903+0000 7f63b6e58640 0 -- 172.21.15.38:0/197640776 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f63ac0a4280 msgr2=0x7f63ac0a3cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:37:15.907 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:15.906+0000 7f63b6e58640 0 -- 172.21.15.38:0/197640776 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f63a804a960 msgr2=0x7f63a80493e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:16.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.112+0000 7f63bc00e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:16.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.112+0000 7f63bc00e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:16.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.112+0000 7f63bc00e800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:37:16.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.112+0000 7f63bc00e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:16.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.112+0000 7f63bc00e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:16.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.112+0000 7f63bc00e800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:37:16.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.113+0000 7f63bc00e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:16.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.113+0000 7f63bc00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:16.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.113+0000 7f63bc00e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:16.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.113+0000 7f63bc00e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:16.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.113+0000 7f63bc00e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:16.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.113+0000 7f63bc00e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:37:16.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.113+0000 7f63bc00e800 20 zone default found 2024-09-22T08:37:16.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.113+0000 7f63bc00e800 4 Realm: () 2024-09-22T08:37:16.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.113+0000 7f63bc00e800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:37:16.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.113+0000 7f63bc00e800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:37:16.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.113+0000 7f63bc00e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:16.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.113+0000 7f63bc00e800 20 zonegroup default 2024-09-22T08:37:16.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.113+0000 7f63bc00e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:16.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.114+0000 7f63bc00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:16.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.114+0000 7f63bc00e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:16.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.114+0000 7f63bc00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:16.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.114+0000 7f63bc00e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:16.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.115+0000 7f63bc00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:16.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.115+0000 7f63bc00e800 20 started sync module instance, tier type = 2024-09-22T08:37:16.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.115+0000 7f63bc00e800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:37:16.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.124+0000 7f63bc00e800 20 add_watcher() i=0 2024-09-22T08:37:16.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.124+0000 7f63bc00e800 20 add_watcher() i=1 2024-09-22T08:37:16.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.124+0000 7f63bc00e800 20 add_watcher() i=2 2024-09-22T08:37:16.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.124+0000 7f63bc00e800 20 add_watcher() i=3 2024-09-22T08:37:16.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.124+0000 7f63bc00e800 20 add_watcher() i=4 2024-09-22T08:37:16.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.124+0000 7f63bc00e800 20 add_watcher() i=5 2024-09-22T08:37:16.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.124+0000 7f63bc00e800 20 add_watcher() i=6 2024-09-22T08:37:16.126 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.125+0000 7f63bc00e800 20 add_watcher() i=7 2024-09-22T08:37:16.126 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.125+0000 7f63bc00e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:16.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.127+0000 7f626dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:16.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.127+0000 7f63bc00e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:16.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.127+0000 7f63bc00e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:16.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.127+0000 7f63bc00e800 5 note: GC not initialized 2024-09-22T08:37:16.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.127+0000 7f626cfe1640 20 reqs_thread_entry: start 2024-09-22T08:37:16.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.128+0000 7f63bc00e800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:16.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.128+0000 7f63bc00e800 20 Filter name: none 2024-09-22T08:37:16.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.128+0000 7f61e67fc640 20 reqs_thread_entry: start 2024-09-22T08:37:16.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.128+0000 7f63bc00e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:16.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.128+0000 7f63bc00e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:37:16.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.128+0000 7f63bc00e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:16.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.129+0000 7f63bc00e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:37:16.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.129+0000 7f63bc00e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:37:16.131 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.129+0000 7f63bc00e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:16.131 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.129+0000 7f63bc00e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:37:16.131 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.129+0000 7f63bc00e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:16.131 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.130+0000 7f63bc00e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:37:16.131 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.130+0000 7f63bc00e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:37:16.133 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.132+0000 7f626dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:16.135 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.134+0000 7f63bc00e800 20 remove_watcher() i=0 2024-09-22T08:37:16.135 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.134+0000 7f63bc00e800 2 removed watcher, disabling cache 2024-09-22T08:37:16.136 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.135+0000 7f63bc00e800 20 remove_watcher() i=1 2024-09-22T08:37:16.137 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.136+0000 7f63bc00e800 20 remove_watcher() i=2 2024-09-22T08:37:16.138 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.137+0000 7f63bc00e800 20 remove_watcher() i=3 2024-09-22T08:37:16.139 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.138+0000 7f63bc00e800 20 remove_watcher() i=4 2024-09-22T08:37:16.140 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.139+0000 7f63bc00e800 20 remove_watcher() i=5 2024-09-22T08:37:16.141 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.140+0000 7f63bc00e800 20 remove_watcher() i=6 2024-09-22T08:37:16.142 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.141+0000 7f63bc00e800 20 remove_watcher() i=7 2024-09-22T08:37:16.153 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:16.153 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:37:16.154 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-change-reshard-state id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.38 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-22T08:37:16.154 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:16.155 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:16.155 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:16.158 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:16.158 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:16.202 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:16.202 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:16.229 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-22T08:37:16.230 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:16.231 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:16.231 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:16.243 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:16.243 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:16.287 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:16.287 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:16.295 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:16.295 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:16.301 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:16.301 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:16.307 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:16.308 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:16.313 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:16.313 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:16.319 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:16.319 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:16.325 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:16.326 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:16.332 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:16.332 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:16.338 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:16.338 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:16.344 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:16.344 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:16.350 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:16.351 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:16.356 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:16.357 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:16.363 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:16.363 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:16.370 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:16.370 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:16.376 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:16.377 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:16.383 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:16.383 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:16.388 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:16.388 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:16.395 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:16.395 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:16.402 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:16.402 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:16.408 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:16.408 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:16.414 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-22T08:37:16.443 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:16.443 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:16.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.480+0000 7f3e98b32800 20 rados->read ofs=0 len=0 2024-09-22T08:37:16.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.482+0000 7f3e98b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:16.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.482+0000 7f3e98b32800 20 realm 2024-09-22T08:37:16.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.482+0000 7f3e98b32800 20 rados->read ofs=0 len=0 2024-09-22T08:37:16.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.482+0000 7f3e98b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:16.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.482+0000 7f3e98b32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:16.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.482+0000 7f3e98b32800 20 rados->read ofs=0 len=0 2024-09-22T08:37:16.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.483+0000 7f3e98b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:16.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.483+0000 7f3e98b32800 20 rados->read ofs=0 len=0 2024-09-22T08:37:16.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.483+0000 7f3e98b32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:16.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.483+0000 7f3e98b32800 20 rados->read ofs=0 len=0 2024-09-22T08:37:16.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.484+0000 7f3e98b32800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:37:16.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.484+0000 7f3e98b32800 20 searching for the correct realm 2024-09-22T08:37:16.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.486+0000 7f3e93fbb640 0 -- 172.21.15.38:0/4197468212 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f3e8807ebf0 msgr2=0x7f3e88087410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:16.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.489+0000 7f3e93fbb640 0 -- 172.21.15.38:0/4197468212 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f3e8407e570 msgr2=0x7f3e840a6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:37:16.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.696+0000 7f3e98b32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:16.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.696+0000 7f3e98b32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:16.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.696+0000 7f3e98b32800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:37:16.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.696+0000 7f3e98b32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:16.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.696+0000 7f3e98b32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:16.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.696+0000 7f3e98b32800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:37:16.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.696+0000 7f3e98b32800 20 rados->read ofs=0 len=0 2024-09-22T08:37:16.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.696+0000 7f3e98b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:16.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.696+0000 7f3e98b32800 20 rados->read ofs=0 len=0 2024-09-22T08:37:16.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.696+0000 7f3e98b32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:16.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.696+0000 7f3e98b32800 20 rados->read ofs=0 len=0 2024-09-22T08:37:16.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.697+0000 7f3e98b32800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:37:16.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.697+0000 7f3e98b32800 20 zone default found 2024-09-22T08:37:16.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.697+0000 7f3e98b32800 4 Realm: () 2024-09-22T08:37:16.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.697+0000 7f3e98b32800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:37:16.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.697+0000 7f3e98b32800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:37:16.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.697+0000 7f3e98b32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:16.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.697+0000 7f3e98b32800 20 zonegroup default 2024-09-22T08:37:16.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.697+0000 7f3e98b32800 20 rados->read ofs=0 len=0 2024-09-22T08:37:16.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.697+0000 7f3e98b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:16.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.697+0000 7f3e98b32800 20 rados->read ofs=0 len=0 2024-09-22T08:37:16.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.697+0000 7f3e98b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:16.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.697+0000 7f3e98b32800 20 rados->read ofs=0 len=0 2024-09-22T08:37:16.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.698+0000 7f3e98b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:16.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.698+0000 7f3e98b32800 20 started sync module instance, tier type = 2024-09-22T08:37:16.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.698+0000 7f3e98b32800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:37:16.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.707+0000 7f3e98b32800 20 add_watcher() i=0 2024-09-22T08:37:16.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.707+0000 7f3e98b32800 20 add_watcher() i=1 2024-09-22T08:37:16.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.707+0000 7f3e98b32800 20 add_watcher() i=2 2024-09-22T08:37:16.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.707+0000 7f3e98b32800 20 add_watcher() i=3 2024-09-22T08:37:16.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.707+0000 7f3e98b32800 20 add_watcher() i=4 2024-09-22T08:37:16.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.707+0000 7f3e98b32800 20 add_watcher() i=5 2024-09-22T08:37:16.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.707+0000 7f3e98b32800 20 add_watcher() i=6 2024-09-22T08:37:16.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.708+0000 7f3e98b32800 20 add_watcher() i=7 2024-09-22T08:37:16.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.708+0000 7f3e98b32800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:16.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.711+0000 7f3d4afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:16.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.711+0000 7f3e98b32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:16.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.711+0000 7f3e98b32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:16.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.711+0000 7f3e98b32800 5 note: GC not initialized 2024-09-22T08:37:16.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.711+0000 7f3d49fdb640 20 reqs_thread_entry: start 2024-09-22T08:37:16.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.711+0000 7f3e98b32800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:16.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.711+0000 7f3e98b32800 20 Filter name: none 2024-09-22T08:37:16.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.711+0000 7f3cbb7fe640 20 reqs_thread_entry: start 2024-09-22T08:37:16.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.711+0000 7f3e98b32800 20 rados->read ofs=0 len=0 2024-09-22T08:37:16.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.712+0000 7f3e98b32800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:37:16.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.712+0000 7f3e98b32800 20 rados->read ofs=0 len=0 2024-09-22T08:37:16.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.713+0000 7f3e98b32800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:37:16.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.713+0000 7f3e98b32800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:37:16.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.713+0000 7f3e98b32800 20 rados->read ofs=0 len=0 2024-09-22T08:37:16.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.713+0000 7f3e98b32800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:37:16.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.713+0000 7f3e98b32800 20 rados->read ofs=0 len=0 2024-09-22T08:37:16.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.713+0000 7f3e98b32800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:37:16.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.713+0000 7f3e98b32800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:37:16.717 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.716+0000 7f3d4afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:16.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.718+0000 7f3e98b32800 20 remove_watcher() i=0 2024-09-22T08:37:16.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.718+0000 7f3e98b32800 2 removed watcher, disabling cache 2024-09-22T08:37:16.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.719+0000 7f3e98b32800 20 remove_watcher() i=1 2024-09-22T08:37:16.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.720+0000 7f3e98b32800 20 remove_watcher() i=2 2024-09-22T08:37:16.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.722+0000 7f3e98b32800 20 remove_watcher() i=3 2024-09-22T08:37:16.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.723+0000 7f3e98b32800 20 remove_watcher() i=4 2024-09-22T08:37:16.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.724+0000 7f3e98b32800 20 remove_watcher() i=5 2024-09-22T08:37:16.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.725+0000 7f3e98b32800 20 remove_watcher() i=6 2024-09-22T08:37:16.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.726+0000 7f3e98b32800 20 remove_watcher() i=7 2024-09-22T08:37:16.738 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:16.738 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:37:16.738 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-change-reshard-state id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:37:16.738 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:16.740 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-22T08:37:16.775 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:16.775 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:16.815 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.813+0000 7f14a6c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:16.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.815+0000 7f14a6c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:16.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.815+0000 7f14a6c2f800 20 realm 2024-09-22T08:37:16.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.815+0000 7f14a6c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:16.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.816+0000 7f14a6c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:16.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.816+0000 7f14a6c2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:16.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.816+0000 7f14a6c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:16.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.816+0000 7f14a6c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:16.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.816+0000 7f14a6c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:16.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.817+0000 7f14a6c2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:16.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.817+0000 7f14a6c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:16.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.817+0000 7f14a6c2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:37:16.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.817+0000 7f14a6c2f800 20 searching for the correct realm 2024-09-22T08:37:16.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.820+0000 7f14a3f18640 0 -- 172.21.15.38:0/192092855 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f148c0910c0 msgr2=0x7f148c089080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:16.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:16.823+0000 7f14a3f18640 0 -- 172.21.15.38:0/192092855 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f149406a9c0 msgr2=0x7f1494073040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:37:17.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.030+0000 7f14a6c2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:17.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.030+0000 7f14a6c2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:17.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.030+0000 7f14a6c2f800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:37:17.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.030+0000 7f14a6c2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:17.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.030+0000 7f14a6c2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:17.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.030+0000 7f14a6c2f800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:37:17.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.030+0000 7f14a6c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.031+0000 7f14a6c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:17.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.031+0000 7f14a6c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.031+0000 7f14a6c2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:17.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.031+0000 7f14a6c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.031+0000 7f14a6c2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:37:17.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.031+0000 7f14a6c2f800 20 zone default found 2024-09-22T08:37:17.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.031+0000 7f14a6c2f800 4 Realm: () 2024-09-22T08:37:17.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.031+0000 7f14a6c2f800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:37:17.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.031+0000 7f14a6c2f800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:37:17.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.031+0000 7f14a6c2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:17.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.031+0000 7f14a6c2f800 20 zonegroup default 2024-09-22T08:37:17.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.031+0000 7f14a6c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.032+0000 7f14a6c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:17.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.032+0000 7f14a6c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.032+0000 7f14a6c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:17.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.032+0000 7f14a6c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.032+0000 7f14a6c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:17.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.032+0000 7f14a6c2f800 20 started sync module instance, tier type = 2024-09-22T08:37:17.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.032+0000 7f14a6c2f800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:37:17.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.042+0000 7f14a6c2f800 20 add_watcher() i=0 2024-09-22T08:37:17.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.042+0000 7f14a6c2f800 20 add_watcher() i=1 2024-09-22T08:37:17.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.042+0000 7f14a6c2f800 20 add_watcher() i=2 2024-09-22T08:37:17.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.042+0000 7f14a6c2f800 20 add_watcher() i=3 2024-09-22T08:37:17.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.042+0000 7f14a6c2f800 20 add_watcher() i=4 2024-09-22T08:37:17.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.042+0000 7f14a6c2f800 20 add_watcher() i=5 2024-09-22T08:37:17.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.042+0000 7f14a6c2f800 20 add_watcher() i=6 2024-09-22T08:37:17.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.043+0000 7f14a6c2f800 20 add_watcher() i=7 2024-09-22T08:37:17.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.043+0000 7f14a6c2f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:17.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.045+0000 7f135afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:17.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.046+0000 7f14a6c2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:17.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.046+0000 7f14a6c2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:17.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.046+0000 7f14a6c2f800 5 note: GC not initialized 2024-09-22T08:37:17.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.046+0000 7f1359fdb640 20 reqs_thread_entry: start 2024-09-22T08:37:17.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.046+0000 7f14a6c2f800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:17.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.046+0000 7f14a6c2f800 20 Filter name: none 2024-09-22T08:37:17.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.046+0000 7f12cb7fe640 20 reqs_thread_entry: start 2024-09-22T08:37:17.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.046+0000 7f14a6c2f800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-22T08:37:17.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.046+0000 7f14a6c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.047+0000 7f14a6c2f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:37:17.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.047+0000 7f14a6c2f800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-22T08:37:17.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.047+0000 7f14a6c2f800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-22T08:37:17.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.047+0000 7f14a6c2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 : miss 2024-09-22T08:37:17.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.047+0000 7f14a6c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.047+0000 7f14a6c2f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:37:17.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.047+0000 7f14a6c2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 info.flags=0x17 2024-09-22T08:37:17.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.047+0000 7f14a6c2f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 to cache LRU end 2024-09-22T08:37:17.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.047+0000 7f14a6c2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:37:17.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.047+0000 7f14a6c2f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:17.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.047+0000 7f14a6c2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 2024-09-22T08:37:17.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.053+0000 7f14a6c2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 info.flags=0x17 2024-09-22T08:37:17.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.053+0000 7f14a6c2f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 to cache LRU end 2024-09-22T08:37:17.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.053+0000 7f14a6c2f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:17.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.053+0000 7f14a6c2f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39, ofs0, ns] 2024-09-22T08:37:17.055 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.053+0000 7f137b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497120 cookie 93947630377024 notifier 7896 bl.length()=931 2024-09-22T08:37:17.055 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.053+0000 7f137b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 info.flags=0x17 2024-09-22T08:37:17.055 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.053+0000 7f137b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 to cache LRU end 2024-09-22T08:37:17.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.053+0000 7f137b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:17.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.054+0000 7f14a6c2f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.39]): orig_sources= new_sources= 2024-09-22T08:37:17.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.054+0000 7f14a6c2f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.39]): potential sources added=[] removed=[] 2024-09-22T08:37:17.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.054+0000 7f14a6c2f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.39]): orig_dests= new_dests= 2024-09-22T08:37:17.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.054+0000 7f14a6c2f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.39]): potential dests added=[] removed=[] 2024-09-22T08:37:17.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.058+0000 7f14a6c2f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.0 2024-09-22T08:37:17.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.058+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.0 2024-09-22T08:37:17.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.058+0000 7f14a6c2f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.1 2024-09-22T08:37:17.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.058+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.1 2024-09-22T08:37:17.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.058+0000 7f14a6c2f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.2 2024-09-22T08:37:17.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.058+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.2 2024-09-22T08:37:17.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.058+0000 7f14a6c2f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.3 2024-09-22T08:37:17.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.058+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.3 2024-09-22T08:37:17.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.058+0000 7f14a6c2f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.4 2024-09-22T08:37:17.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.058+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.4 2024-09-22T08:37:17.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.058+0000 7f14a6c2f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.5 2024-09-22T08:37:17.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.058+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.5 2024-09-22T08:37:17.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.058+0000 7f14a6c2f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.6 2024-09-22T08:37:17.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.058+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.6 2024-09-22T08:37:17.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.058+0000 7f14a6c2f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.7 2024-09-22T08:37:17.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.058+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.7 2024-09-22T08:37:17.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.058+0000 7f14a6c2f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.8 2024-09-22T08:37:17.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.058+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.8 2024-09-22T08:37:17.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.059+0000 7f14a6c2f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.9 2024-09-22T08:37:17.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.059+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.9 2024-09-22T08:37:17.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.059+0000 7f14a6c2f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.10 2024-09-22T08:37:17.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.059+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.10 2024-09-22T08:37:17.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.059+0000 7f14a6c2f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.11 2024-09-22T08:37:17.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.059+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.11 2024-09-22T08:37:17.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.059+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.0 2024-09-22T08:37:17.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.059+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1 2024-09-22T08:37:17.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.059+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.2 2024-09-22T08:37:17.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.060+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.3 2024-09-22T08:37:17.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.060+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.4 2024-09-22T08:37:17.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.061+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.5 2024-09-22T08:37:17.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.061+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.6 2024-09-22T08:37:17.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.062+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.7 2024-09-22T08:37:17.064 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.063+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.8 2024-09-22T08:37:17.064 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.063+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.9 2024-09-22T08:37:17.065 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.064+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.10 2024-09-22T08:37:17.068 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f14a6c2f800 time 2024-09-22T08:37:17.068176+0000 2024-09-22T08:37:17.068 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:37:17.069 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:37:17.069 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f14aa18c748] 2024-09-22T08:37:17.069 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f14aa18c906] 2024-09-22T08:37:17.069 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5571e1efee01] 2024-09-22T08:37:17.070 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5571e1f0de9b] 2024-09-22T08:37:17.070 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5571e1f0ed64] 2024-09-22T08:37:17.070 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-22T08:37:17.070 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f14a8e29590] 2024-09-22T08:37:17.070 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-22T08:37:17.070 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-22T08:37:17.071 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.068+0000 7f14a6c2f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f14a6c2f800 time 2024-09-22T08:37:17.068176+0000 2024-09-22T08:37:17.071 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:37:17.071 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:17.071 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:37:17.071 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f14aa18c748] 2024-09-22T08:37:17.071 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f14aa18c906] 2024-09-22T08:37:17.071 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5571e1efee01] 2024-09-22T08:37:17.072 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5571e1f0de9b] 2024-09-22T08:37:17.072 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5571e1f0ed64] 2024-09-22T08:37:17.072 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-22T08:37:17.072 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f14a8e29590] 2024-09-22T08:37:17.072 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-22T08:37:17.072 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-22T08:37:17.072 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:17.073 INFO:tasks.workunit.client.0.smithi038.stderr:*** Caught signal (Aborted) ** 2024-09-22T08:37:17.073 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f14a6c2f800 thread_name:radosgw-admin 2024-09-22T08:37:17.096 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:37:17.097 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f14a8e3e6f0] 2024-09-22T08:37:17.097 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f14a8e8b99c] 2024-09-22T08:37:17.097 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:37:17.097 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:37:17.097 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f14aa18c7a2] 2024-09-22T08:37:17.097 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f14aa18c906] 2024-09-22T08:37:17.098 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5571e1efee01] 2024-09-22T08:37:17.098 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5571e1f0de9b] 2024-09-22T08:37:17.098 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5571e1f0ed64] 2024-09-22T08:37:17.098 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-22T08:37:17.098 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f14a8e29590] 2024-09-22T08:37:17.098 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-22T08:37:17.098 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-22T08:37:17.098 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.068+0000 7f14a6c2f800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:37:17.098 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f14a6c2f800 thread_name:radosgw-admin 2024-09-22T08:37:17.098 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:17.098 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:37:17.099 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f14a8e3e6f0] 2024-09-22T08:37:17.099 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f14a8e8b99c] 2024-09-22T08:37:17.099 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:37:17.099 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:37:17.099 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f14aa18c7a2] 2024-09-22T08:37:17.099 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f14aa18c906] 2024-09-22T08:37:17.099 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5571e1efee01] 2024-09-22T08:37:17.099 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5571e1f0de9b] 2024-09-22T08:37:17.099 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5571e1f0ed64] 2024-09-22T08:37:17.099 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-22T08:37:17.099 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f14a8e29590] 2024-09-22T08:37:17.100 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-22T08:37:17.100 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-22T08:37:17.100 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:37:17.100 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:17.100 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-22T08:37:17.100 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-22T08:37:16.797+0000 7f14a6c2f800 5 AuthRegistry(0x5571e312e070) adding con mode: crc 2024-09-22T08:37:17.100 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-22T08:37:16.797+0000 7f14a6c2f800 5 AuthRegistry(0x5571e312e070) adding con mode: secure 2024-09-22T08:37:17.100 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-22T08:37:16.797+0000 7f14a6c2f800 5 AuthRegistry(0x5571e312e070) adding con mode: crc 2024-09-22T08:37:17.100 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-22T08:37:16.797+0000 7f14a6c2f800 5 AuthRegistry(0x5571e312e070) adding con mode: secure 2024-09-22T08:37:17.100 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-22T08:37:16.797+0000 7f14a6c2f800 5 AuthRegistry(0x5571e312e070) adding con mode: crc 2024-09-22T08:37:17.100 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-22T08:37:16.797+0000 7f14a6c2f800 5 AuthRegistry(0x5571e312e070) adding con mode: secure 2024-09-22T08:37:17.100 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-22T08:37:16.797+0000 7f14a6c2f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:17.100 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-22T08:37:16.797+0000 7f14a6c2f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:17.100 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-22T08:37:16.797+0000 7f14a6c2f800 5 asok(0x5571e2f0a0f0) register_command rotate-key hook 0x5571e312e1b8 2024-09-22T08:37:17.101 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-22T08:37:16.797+0000 7f14a6c2f800 10 monclient: _reopen_session rank -1 2024-09-22T08:37:17.101 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-22T08:37:16.797+0000 7f14a6c2f800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T08:37:17.101 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-22T08:37:16.797+0000 7f14a6c2f800 10 monclient(hunting): picked mon.noname-a con 0x5571e2fb54a0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:37:17.101 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-22T08:37:16.797+0000 7f14a6c2f800 10 monclient(hunting): picked mon.noname-c con 0x5571e3070c80 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:37:17.101 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-22T08:37:16.797+0000 7f14a6c2f800 10 monclient(hunting): picked mon.noname-b con 0x5571e3073e40 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:37:17.101 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-22T08:37:16.797+0000 7f14a6c2f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:17.101 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-22T08:37:16.797+0000 7f14a6c2f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:17.101 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-22T08:37:16.797+0000 7f14a6c2f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:17.101 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-22T08:37:16.797+0000 7f14a6c2f800 10 monclient(hunting): _renew_subs 2024-09-22T08:37:17.101 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-22T08:37:16.797+0000 7f14a6c2f800 10 monclient(hunting): authenticate will time out at 2142.036640s 2024-09-22T08:37:17.101 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-22T08:37:16.797+0000 7f14a3f18640 10 monclient(hunting): get_auth_request con 0x5571e3070c80 auth_method 0 2024-09-22T08:37:17.101 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-22T08:37:16.797+0000 7f14a3f18640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:17.101 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-22T08:37:16.797+0000 7f14a3f18640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:17.101 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-22T08:37:16.797+0000 7f14a3f18640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:17.102 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-22T08:37:16.797+0000 7f14a4719640 10 monclient(hunting): get_auth_request con 0x5571e2fb54a0 auth_method 0 2024-09-22T08:37:17.102 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-22T08:37:16.797+0000 7f14a4719640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:17.102 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-22T08:37:16.797+0000 7f14a4719640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:17.102 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-22T08:37:16.797+0000 7f14a4719640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:17.102 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-22T08:37:16.797+0000 7f14a4f1a640 10 monclient(hunting): get_auth_request con 0x5571e3073e40 auth_method 0 2024-09-22T08:37:17.102 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-22T08:37:16.797+0000 7f14a4f1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:17.102 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-22T08:37:16.797+0000 7f14a4f1a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:17.102 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-22T08:37:16.797+0000 7f14a4f1a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:17.102 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-22T08:37:16.797+0000 7f14a3f18640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:37:17.102 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-22T08:37:16.797+0000 7f14a3f18640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:37:17.102 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-22T08:37:16.797+0000 7f14a3f18640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:37:17.102 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-22T08:37:16.797+0000 7f14a4719640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:37:17.102 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-22T08:37:16.797+0000 7f14a4719640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:37:17.102 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-22T08:37:16.797+0000 7f14a4719640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:37:17.103 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-22T08:37:16.797+0000 7f14a4f1a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:37:17.103 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-22T08:37:16.797+0000 7f14a4f1a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:37:17.103 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-22T08:37:16.797+0000 7f14a4f1a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:37:17.103 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-22T08:37:16.797+0000 7f14a3f18640 10 monclient(hunting): handle_auth_done global_id 7415 payload 824 2024-09-22T08:37:17.103 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-22T08:37:16.797+0000 7f14a3f18640 10 monclient: _finish_hunting 0 2024-09-22T08:37:17.103 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-22T08:37:16.797+0000 7f14a3f18640 1 monclient: found mon.noname-c 2024-09-22T08:37:17.103 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-22T08:37:16.797+0000 7f14a3f18640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:37:17.103 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-22T08:37:16.798+0000 7f1390e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:37:17.103 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-22T08:37:16.798+0000 7f1390e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:37:17.103 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-22T08:37:16.798+0000 7f1390e09640 10 monclient: dump: 2024-09-22T08:37:17.103 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:37:17.103 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:37:17.103 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:17.103 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:17.104 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:37:17.104 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:17.104 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:37:17.104 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:37:17.104 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:37:17.104 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:17.104 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-22T08:37:16.798+0000 7f1390e09640 10 monclient: _finish_auth 0 2024-09-22T08:37:17.104 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-22T08:37:16.798+0000 7f1390e09640 10 monclient: _check_auth_tickets 2024-09-22T08:37:17.104 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-22T08:37:16.798+0000 7f1390e09640 10 monclient: handle_config config(0 keys) 2024-09-22T08:37:17.104 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-22T08:37:16.798+0000 7f1390e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:37:17.104 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-22T08:37:16.798+0000 7f1390e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:37:17.104 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-22T08:37:16.798+0000 7f1390e09640 10 monclient: dump: 2024-09-22T08:37:17.104 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:37:17.104 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:37:17.104 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:17.105 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:17.105 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:37:17.105 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:17.105 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:37:17.105 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:37:17.105 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:37:17.105 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:17.105 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-22T08:37:16.798+0000 7f14a6c2f800 5 monclient: authenticate success, global_id 7415 2024-09-22T08:37:17.105 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-22T08:37:16.798+0000 7f14a6c2f800 10 monclient: _renew_subs 2024-09-22T08:37:17.105 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-22T08:37:16.798+0000 7f14a6c2f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:37:17.105 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-22T08:37:16.798+0000 7f139260c640 4 set_mon_vals no callback set 2024-09-22T08:37:17.105 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-22T08:37:16.798+0000 7f14a6c2f800 10 monclient: _renew_subs 2024-09-22T08:37:17.105 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-22T08:37:16.798+0000 7f14a6c2f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:37:17.105 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-22T08:37:16.798+0000 7f14a6c2f800 1 librados: init done 2024-09-22T08:37:17.106 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-22T08:37:16.800+0000 7f1390e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:37:17.106 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-22T08:37:16.800+0000 7f1390e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:37:17.106 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-22T08:37:16.800+0000 7f1390e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:37:17.106 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-22T08:37:16.800+0000 7f14a4719640 10 monclient: get_auth_request con 0x7f138c0775a0 auth_method 0 2024-09-22T08:37:17.106 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-22T08:37:16.800+0000 7f14a4f1a640 10 monclient: get_auth_request con 0x5571e31561b0 auth_method 0 2024-09-22T08:37:17.106 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-22T08:37:16.801+0000 7f14a4719640 10 monclient: get_auth_request con 0x5571e31792b0 auth_method 0 2024-09-22T08:37:17.106 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-22T08:37:16.802+0000 7f14a3f18640 10 monclient: get_auth_request con 0x5571e317d660 auth_method 0 2024-09-22T08:37:17.106 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-22T08:37:16.803+0000 7f14a4f1a640 10 monclient: get_auth_request con 0x5571e317cb90 auth_method 0 2024-09-22T08:37:17.106 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 10 monclient: build_initial_monmap 2024-09-22T08:37:17.106 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 1 build_initial for_mkfs: 0 2024-09-22T08:37:17.106 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 10 monclient: monmap: 2024-09-22T08:37:17.106 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:37:17.106 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:37:17.107 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:37:17.107 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:37:17.107 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:37:17.107 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:17.107 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:37:17.107 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:37:17.107 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:37:17.107 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:17.107 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31857d0) adding auth protocol: cephx 2024-09-22T08:37:17.107 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31857d0) adding auth protocol: cephx 2024-09-22T08:37:17.107 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31857d0) adding auth protocol: cephx 2024-09-22T08:37:17.107 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31857d0) adding con mode: secure 2024-09-22T08:37:17.107 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31857d0) adding con mode: crc 2024-09-22T08:37:17.107 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31857d0) adding con mode: secure 2024-09-22T08:37:17.107 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31857d0) adding con mode: crc 2024-09-22T08:37:17.108 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31857d0) adding con mode: secure 2024-09-22T08:37:17.108 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31857d0) adding con mode: crc 2024-09-22T08:37:17.108 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31857d0) adding con mode: crc 2024-09-22T08:37:17.108 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31857d0) adding con mode: secure 2024-09-22T08:37:17.108 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31857d0) adding con mode: crc 2024-09-22T08:37:17.108 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31857d0) adding con mode: secure 2024-09-22T08:37:17.108 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31857d0) adding con mode: crc 2024-09-22T08:37:17.108 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31857d0) adding con mode: secure 2024-09-22T08:37:17.108 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:17.108 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 asok(0x5571e2f0a0f0) register_command objecter_requests cmddesc objecter_requests hook 0x5571e31891e0 EEXIST 2024-09-22T08:37:17.108 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 10 monclient: init 2024-09-22T08:37:17.108 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e3184788) adding auth protocol: cephx 2024-09-22T08:37:17.108 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e3184788) adding auth protocol: cephx 2024-09-22T08:37:17.108 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e3184788) adding auth protocol: cephx 2024-09-22T08:37:17.108 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e3184788) adding con mode: secure 2024-09-22T08:37:17.109 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e3184788) adding con mode: crc 2024-09-22T08:37:17.109 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e3184788) adding con mode: secure 2024-09-22T08:37:17.109 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e3184788) adding con mode: crc 2024-09-22T08:37:17.109 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e3184788) adding con mode: secure 2024-09-22T08:37:17.109 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e3184788) adding con mode: crc 2024-09-22T08:37:17.109 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e3184788) adding con mode: crc 2024-09-22T08:37:17.109 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e3184788) adding con mode: secure 2024-09-22T08:37:17.109 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e3184788) adding con mode: crc 2024-09-22T08:37:17.109 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e3184788) adding con mode: secure 2024-09-22T08:37:17.110 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e3184788) adding con mode: crc 2024-09-22T08:37:17.110 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e3184788) adding con mode: secure 2024-09-22T08:37:17.110 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-22T08:37:16.805+0000 7f14a6c2f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:17.110 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-22T08:37:16.805+0000 7f14a6c2f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:17.110 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-22T08:37:16.805+0000 7f14a6c2f800 5 asok(0x5571e2f0a0f0) register_command rotate-key cmddesc rotate-key hook 0x5571e31848d0 EEXIST 2024-09-22T08:37:17.110 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-22T08:37:16.805+0000 7f14a6c2f800 10 monclient: _reopen_session rank -1 2024-09-22T08:37:17.110 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-22T08:37:16.805+0000 7f14a6c2f800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-22T08:37:17.110 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-22T08:37:16.805+0000 7f14a6c2f800 10 monclient(hunting): picked mon.noname-b con 0x5571e31aced0 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:37:17.110 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-22T08:37:16.805+0000 7f14a6c2f800 10 monclient(hunting): picked mon.noname-c con 0x5571e31af1a0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:37:17.110 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-22T08:37:16.805+0000 7f14a6c2f800 10 monclient(hunting): picked mon.noname-a con 0x5571e31ab6a0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:37:17.111 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-22T08:37:16.805+0000 7f14a6c2f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:17.111 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-22T08:37:16.805+0000 7f14a6c2f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:17.111 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-22T08:37:16.805+0000 7f14a6c2f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:17.111 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-22T08:37:16.805+0000 7f14a6c2f800 10 monclient(hunting): _renew_subs 2024-09-22T08:37:17.111 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-22T08:37:16.805+0000 7f14a6c2f800 10 monclient(hunting): authenticate will time out at 2142.044325s 2024-09-22T08:37:17.111 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-22T08:37:16.805+0000 7f14a4f1a640 10 monclient(hunting): get_auth_request con 0x5571e31af1a0 auth_method 0 2024-09-22T08:37:17.111 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-22T08:37:16.805+0000 7f14a4f1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:17.111 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-22T08:37:16.805+0000 7f14a4f1a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:17.111 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-22T08:37:16.805+0000 7f14a4f1a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:17.111 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-22T08:37:16.805+0000 7f14a3f18640 10 monclient(hunting): get_auth_request con 0x5571e31aced0 auth_method 0 2024-09-22T08:37:17.111 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-22T08:37:16.805+0000 7f14a3f18640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:17.111 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-22T08:37:16.805+0000 7f14a3f18640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:17.111 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-22T08:37:16.805+0000 7f14a3f18640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:17.111 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-22T08:37:16.805+0000 7f14a4719640 10 monclient(hunting): get_auth_request con 0x5571e31ab6a0 auth_method 0 2024-09-22T08:37:17.112 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-22T08:37:16.805+0000 7f14a4719640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:17.112 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-22T08:37:16.805+0000 7f14a4719640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:17.112 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-22T08:37:16.805+0000 7f14a4719640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:17.112 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-22T08:37:16.805+0000 7f14a4f1a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:37:17.112 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-22T08:37:16.805+0000 7f14a4f1a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:37:17.112 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-22T08:37:16.805+0000 7f14a4f1a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:37:17.112 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-22T08:37:16.805+0000 7f14a3f18640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:37:17.112 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-22T08:37:16.805+0000 7f14a3f18640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:37:17.112 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-22T08:37:16.805+0000 7f14a3f18640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:37:17.113 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-22T08:37:16.805+0000 7f14a4719640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:37:17.113 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-22T08:37:16.805+0000 7f14a4719640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:37:17.113 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-22T08:37:16.805+0000 7f14a4719640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:37:17.113 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-22T08:37:16.805+0000 7f14a3f18640 10 monclient(hunting): handle_auth_done global_id 7144 payload 824 2024-09-22T08:37:17.113 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-22T08:37:16.805+0000 7f14a3f18640 10 monclient: _finish_hunting 0 2024-09-22T08:37:17.113 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-22T08:37:16.805+0000 7f14a3f18640 1 monclient: found mon.noname-b 2024-09-22T08:37:17.113 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-22T08:37:16.805+0000 7f14a3f18640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.42:3300/0 2024-09-22T08:37:17.113 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-22T08:37:16.806+0000 7f1389ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:37:17.113 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-22T08:37:16.806+0000 7f1389ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-22T08:37:17.113 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-22T08:37:16.806+0000 7f1389ffb640 10 monclient: dump: 2024-09-22T08:37:17.113 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:37:17.113 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:37:17.113 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:17.114 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:17.114 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:37:17.114 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:17.114 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:37:17.114 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:37:17.114 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:37:17.114 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:17.114 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-22T08:37:16.806+0000 7f1389ffb640 10 monclient: _finish_auth 0 2024-09-22T08:37:17.114 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-22T08:37:16.806+0000 7f1389ffb640 10 monclient: _check_auth_tickets 2024-09-22T08:37:17.114 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-22T08:37:16.806+0000 7f1389ffb640 10 monclient: handle_config config(0 keys) 2024-09-22T08:37:17.114 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-22T08:37:16.806+0000 7f14a6c2f800 5 monclient: authenticate success, global_id 7144 2024-09-22T08:37:17.114 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-22T08:37:16.806+0000 7f14a6c2f800 10 monclient: _renew_subs 2024-09-22T08:37:17.114 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-22T08:37:16.806+0000 7f14a6c2f800 10 monclient: _send_mon_message to mon.b at v2:172.21.15.42:3300/0 2024-09-22T08:37:17.115 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-22T08:37:16.806+0000 7f1389ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:37:17.115 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-22T08:37:16.806+0000 7f1389ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-22T08:37:17.115 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-22T08:37:16.806+0000 7f1389ffb640 10 monclient: dump: 2024-09-22T08:37:17.115 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:37:17.115 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:37:17.115 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:17.115 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:17.115 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:37:17.115 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:17.115 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:37:17.115 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:37:17.115 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:37:17.115 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:17.115 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-22T08:37:16.806+0000 7f14a571b640 4 set_mon_vals no callback set 2024-09-22T08:37:17.116 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-22T08:37:16.806+0000 7f14a6c2f800 10 monclient: _renew_subs 2024-09-22T08:37:17.116 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-22T08:37:16.806+0000 7f14a6c2f800 10 monclient: _send_mon_message to mon.b at v2:172.21.15.42:3300/0 2024-09-22T08:37:17.116 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-22T08:37:16.808+0000 7f1389ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:37:17.116 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-22T08:37:16.808+0000 7f1389ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:37:17.116 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-22T08:37:16.808+0000 7f1389ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:37:17.116 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 10 monclient: get_monmap_and_config 2024-09-22T08:37:17.116 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 10 monclient: build_initial_monmap 2024-09-22T08:37:17.116 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 1 build_initial for_mkfs: 0 2024-09-22T08:37:17.116 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 10 monclient: monmap: 2024-09-22T08:37:17.116 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:37:17.116 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:37:17.116 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:37:17.116 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:37:17.116 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:37:17.116 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:17.116 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:37:17.116 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:37:17.117 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:37:17.117 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:17.117 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-22T08:37:16.808+0000 7f14a4f1a640 10 monclient: get_auth_request con 0x7f137c077480 auth_method 0 2024-09-22T08:37:17.117 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31ccbc0) adding auth protocol: cephx 2024-09-22T08:37:17.117 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31ccbc0) adding auth protocol: cephx 2024-09-22T08:37:17.117 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31ccbc0) adding auth protocol: cephx 2024-09-22T08:37:17.117 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31ccbc0) adding con mode: secure 2024-09-22T08:37:17.117 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31ccbc0) adding con mode: crc 2024-09-22T08:37:17.117 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31ccbc0) adding con mode: secure 2024-09-22T08:37:17.117 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31ccbc0) adding con mode: crc 2024-09-22T08:37:17.117 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31ccbc0) adding con mode: secure 2024-09-22T08:37:17.117 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31ccbc0) adding con mode: crc 2024-09-22T08:37:17.117 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31ccbc0) adding con mode: crc 2024-09-22T08:37:17.117 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31ccbc0) adding con mode: secure 2024-09-22T08:37:17.117 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31ccbc0) adding con mode: crc 2024-09-22T08:37:17.118 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31ccbc0) adding con mode: secure 2024-09-22T08:37:17.118 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31ccbc0) adding con mode: crc 2024-09-22T08:37:17.118 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31ccbc0) adding con mode: secure 2024-09-22T08:37:17.118 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:17.118 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 10 monclient: init 2024-09-22T08:37:17.118 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc41948210) adding auth protocol: cephx 2024-09-22T08:37:17.118 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc41948210) adding auth protocol: cephx 2024-09-22T08:37:17.118 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc41948210) adding auth protocol: cephx 2024-09-22T08:37:17.118 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc41948210) adding con mode: secure 2024-09-22T08:37:17.118 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc41948210) adding con mode: crc 2024-09-22T08:37:17.118 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc41948210) adding con mode: secure 2024-09-22T08:37:17.118 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc41948210) adding con mode: crc 2024-09-22T08:37:17.118 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc41948210) adding con mode: secure 2024-09-22T08:37:17.119 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc41948210) adding con mode: crc 2024-09-22T08:37:17.119 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc41948210) adding con mode: crc 2024-09-22T08:37:17.119 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc41948210) adding con mode: secure 2024-09-22T08:37:17.119 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc41948210) adding con mode: crc 2024-09-22T08:37:17.119 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc41948210) adding con mode: secure 2024-09-22T08:37:17.119 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc41948210) adding con mode: crc 2024-09-22T08:37:17.119 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc41948210) adding con mode: secure 2024-09-22T08:37:17.119 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-22T08:37:16.809+0000 7f14a6c2f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:17.119 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-22T08:37:16.809+0000 7f14a6c2f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:17.119 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-22T08:37:16.809+0000 7f14a6c2f800 5 asok(0x5571e2f0a0f0) register_command rotate-key cmddesc rotate-key hook 0x7ffc41948358 EEXIST 2024-09-22T08:37:17.119 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-22T08:37:16.809+0000 7f14a6c2f800 10 monclient: _reopen_session rank -1 2024-09-22T08:37:17.119 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-22T08:37:16.809+0000 7f14a6c2f800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T08:37:17.119 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-22T08:37:16.809+0000 7f14a6c2f800 10 monclient(hunting): picked mon.noname-a con 0x5571e3201280 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:37:17.119 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-22T08:37:16.809+0000 7f14a6c2f800 10 monclient(hunting): picked mon.noname-c con 0x5571e31d21d0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:37:17.119 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-22T08:37:16.809+0000 7f14a6c2f800 10 monclient(hunting): picked mon.noname-b con 0x5571e31fcb20 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:37:17.120 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-22T08:37:16.809+0000 7f14a6c2f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:17.120 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-22T08:37:16.809+0000 7f14a6c2f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:17.120 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-22T08:37:16.809+0000 7f14a6c2f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:17.120 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-22T08:37:16.809+0000 7f14a6c2f800 10 monclient(hunting): _renew_subs 2024-09-22T08:37:17.120 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-22T08:37:16.809+0000 7f14a6c2f800 10 monclient(hunting): authenticate will time out at 2142.048469s 2024-09-22T08:37:17.120 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-22T08:37:16.809+0000 7f14a3f18640 10 monclient(hunting): get_auth_request con 0x5571e3201280 auth_method 0 2024-09-22T08:37:17.120 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-22T08:37:16.809+0000 7f14a3f18640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:17.120 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-22T08:37:16.809+0000 7f14a3f18640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:17.120 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-22T08:37:16.809+0000 7f14a3f18640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:17.120 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-22T08:37:16.809+0000 7f14a4f1a640 10 monclient(hunting): get_auth_request con 0x5571e31d21d0 auth_method 0 2024-09-22T08:37:17.121 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-22T08:37:16.809+0000 7f14a4f1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:17.121 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-22T08:37:16.809+0000 7f14a4f1a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:17.121 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-22T08:37:16.809+0000 7f14a4f1a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:17.121 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-22T08:37:16.809+0000 7f14a3f18640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:37:17.121 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-22T08:37:16.809+0000 7f14a3f18640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:37:17.121 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-22T08:37:16.809+0000 7f14a3f18640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:37:17.121 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-22T08:37:16.809+0000 7f14a4f1a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:37:17.121 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-22T08:37:16.809+0000 7f14a4f1a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:37:17.121 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-22T08:37:16.809+0000 7f14a4f1a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:37:17.121 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-22T08:37:16.809+0000 7f14a4719640 10 monclient(hunting): get_auth_request con 0x5571e31fcb20 auth_method 0 2024-09-22T08:37:17.121 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-22T08:37:16.809+0000 7f14a4719640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:17.121 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-22T08:37:16.809+0000 7f14a4719640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:17.121 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-22T08:37:16.809+0000 7f14a4719640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:17.121 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-22T08:37:16.809+0000 7f14a3f18640 10 monclient(hunting): handle_auth_done global_id 7893 payload 274 2024-09-22T08:37:17.121 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-22T08:37:16.809+0000 7f14a3f18640 10 monclient: _finish_hunting 0 2024-09-22T08:37:17.121 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-22T08:37:16.809+0000 7f14a3f18640 1 monclient: found mon.noname-a 2024-09-22T08:37:17.122 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-22T08:37:16.809+0000 7f14a3f18640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:37:17.122 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-22T08:37:16.809+0000 7f137b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:37:17.122 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-22T08:37:16.810+0000 7f137b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:37:17.122 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-22T08:37:16.810+0000 7f137b7fe640 10 monclient: dump: 2024-09-22T08:37:17.122 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:37:17.122 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:37:17.122 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:17.122 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:17.122 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:37:17.122 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:17.122 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:37:17.122 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:37:17.122 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:37:17.122 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:17.123 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-22T08:37:16.810+0000 7f137b7fe640 10 monclient: _finish_auth 0 2024-09-22T08:37:17.123 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-22T08:37:16.810+0000 7f137b7fe640 10 monclient: _check_auth_tickets 2024-09-22T08:37:17.123 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 5 monclient: authenticate success, global_id 7893 2024-09-22T08:37:17.123 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-22T08:37:16.810+0000 7f137b7fe640 10 monclient: handle_config config(0 keys) 2024-09-22T08:37:17.123 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 10 monclient: get_monmap_and_config success 2024-09-22T08:37:17.123 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 4 set_mon_vals no callback set 2024-09-22T08:37:17.123 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-22T08:37:16.810+0000 7f137b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:37:17.123 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-22T08:37:16.810+0000 7f137b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:37:17.123 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-22T08:37:16.810+0000 7f137b7fe640 10 monclient: dump: 2024-09-22T08:37:17.123 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:37:17.123 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:37:17.123 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:17.123 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:17.123 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:37:17.124 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:17.124 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:37:17.124 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:37:17.124 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:37:17.124 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:17.124 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 10 monclient: shutdown 2024-09-22T08:37:17.124 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 10 monclient: build_initial_monmap 2024-09-22T08:37:17.124 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 1 build_initial for_mkfs: 0 2024-09-22T08:37:17.124 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 10 monclient: monmap: 2024-09-22T08:37:17.124 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:37:17.124 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:37:17.124 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:37:17.124 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:37:17.124 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:37:17.124 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:17.125 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:37:17.125 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:37:17.125 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:37:17.125 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:17.125 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31f2e50) adding auth protocol: cephx 2024-09-22T08:37:17.125 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31f2e50) adding auth protocol: cephx 2024-09-22T08:37:17.125 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31f2e50) adding auth protocol: cephx 2024-09-22T08:37:17.125 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31f2e50) adding con mode: secure 2024-09-22T08:37:17.125 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31f2e50) adding con mode: crc 2024-09-22T08:37:17.125 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31f2e50) adding con mode: secure 2024-09-22T08:37:17.125 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31f2e50) adding con mode: crc 2024-09-22T08:37:17.125 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31f2e50) adding con mode: secure 2024-09-22T08:37:17.125 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31f2e50) adding con mode: crc 2024-09-22T08:37:17.126 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31f2e50) adding con mode: crc 2024-09-22T08:37:17.126 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31f2e50) adding con mode: secure 2024-09-22T08:37:17.126 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31f2e50) adding con mode: crc 2024-09-22T08:37:17.126 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31f2e50) adding con mode: secure 2024-09-22T08:37:17.126 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31f2e50) adding con mode: crc 2024-09-22T08:37:17.126 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31f2e50) adding con mode: secure 2024-09-22T08:37:17.126 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:17.126 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 1 librados: starting msgr at 2024-09-22T08:37:17.126 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 1 librados: starting objecter 2024-09-22T08:37:17.126 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 5 asok(0x5571e2f0a0f0) register_command objecter_requests cmddesc objecter_requests hook 0x5571e31d0190 EEXIST 2024-09-22T08:37:17.126 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 1 librados: setting wanted keys 2024-09-22T08:37:17.126 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 1 librados: calling monclient init 2024-09-22T08:37:17.126 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 10 monclient: init 2024-09-22T08:37:17.126 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31c4c80) adding auth protocol: cephx 2024-09-22T08:37:17.127 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31c4c80) adding auth protocol: cephx 2024-09-22T08:37:17.127 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31c4c80) adding auth protocol: cephx 2024-09-22T08:37:17.127 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31c4c80) adding con mode: secure 2024-09-22T08:37:17.127 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31c4c80) adding con mode: crc 2024-09-22T08:37:17.127 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31c4c80) adding con mode: secure 2024-09-22T08:37:17.127 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31c4c80) adding con mode: crc 2024-09-22T08:37:17.127 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31c4c80) adding con mode: secure 2024-09-22T08:37:17.127 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31c4c80) adding con mode: crc 2024-09-22T08:37:17.127 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31c4c80) adding con mode: crc 2024-09-22T08:37:17.127 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31c4c80) adding con mode: secure 2024-09-22T08:37:17.127 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31c4c80) adding con mode: crc 2024-09-22T08:37:17.127 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31c4c80) adding con mode: secure 2024-09-22T08:37:17.127 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31c4c80) adding con mode: crc 2024-09-22T08:37:17.127 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31c4c80) adding con mode: secure 2024-09-22T08:37:17.128 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:17.128 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:17.128 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 5 asok(0x5571e2f0a0f0) register_command rotate-key cmddesc rotate-key hook 0x5571e31c4dc8 EEXIST 2024-09-22T08:37:17.128 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 10 monclient: _reopen_session rank -1 2024-09-22T08:37:17.128 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-22T08:37:17.128 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 10 monclient(hunting): picked mon.noname-b con 0x5571e31d21d0 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:37:17.128 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 10 monclient(hunting): picked mon.noname-c con 0x5571e31fcb20 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:37:17.128 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 10 monclient(hunting): picked mon.noname-a con 0x5571e3201280 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:37:17.128 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:17.128 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:17.128 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:17.128 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 10 monclient(hunting): _renew_subs 2024-09-22T08:37:17.128 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 10 monclient(hunting): authenticate will time out at 2142.050707s 2024-09-22T08:37:17.129 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-22T08:37:16.811+0000 7f14a4719640 10 monclient(hunting): get_auth_request con 0x5571e3201280 auth_method 0 2024-09-22T08:37:17.129 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-22T08:37:16.811+0000 7f14a4719640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:17.129 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-22T08:37:16.811+0000 7f14a4719640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:17.129 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-22T08:37:16.811+0000 7f14a4719640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:17.129 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-22T08:37:16.811+0000 7f14a4f1a640 10 monclient(hunting): get_auth_request con 0x5571e31fcb20 auth_method 0 2024-09-22T08:37:17.129 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-22T08:37:16.811+0000 7f14a4f1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:17.129 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-22T08:37:16.811+0000 7f14a4f1a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:17.129 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-22T08:37:16.811+0000 7f14a4f1a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:17.129 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-22T08:37:16.811+0000 7f14a4719640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:37:17.129 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-22T08:37:16.811+0000 7f14a4719640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:37:17.129 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-22T08:37:16.811+0000 7f14a4719640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:37:17.129 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-22T08:37:16.811+0000 7f14a4f1a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:37:17.129 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-22T08:37:16.811+0000 7f14a4f1a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:37:17.130 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-22T08:37:16.811+0000 7f14a4f1a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:37:17.130 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-22T08:37:16.812+0000 7f14a3f18640 10 monclient(hunting): get_auth_request con 0x5571e31d21d0 auth_method 0 2024-09-22T08:37:17.130 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-22T08:37:16.812+0000 7f14a3f18640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:17.130 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-22T08:37:16.812+0000 7f14a3f18640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:17.130 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-22T08:37:16.812+0000 7f14a3f18640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:17.130 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-22T08:37:16.812+0000 7f14a4719640 10 monclient(hunting): handle_auth_done global_id 7896 payload 824 2024-09-22T08:37:17.130 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-22T08:37:16.812+0000 7f14a4719640 10 monclient: _finish_hunting 0 2024-09-22T08:37:17.130 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-22T08:37:16.812+0000 7f14a4719640 1 monclient: found mon.noname-a 2024-09-22T08:37:17.130 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-22T08:37:16.812+0000 7f14a4719640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:37:17.130 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-22T08:37:16.812+0000 7f1379ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:37:17.131 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-22T08:37:16.812+0000 7f1379ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:37:17.131 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-22T08:37:16.812+0000 7f1379ffb640 10 monclient: dump: 2024-09-22T08:37:17.131 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:37:17.131 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:37:17.131 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:17.131 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:17.131 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:37:17.131 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:17.131 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:37:17.131 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:37:17.131 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:37:17.131 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:17.131 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-22T08:37:16.812+0000 7f1379ffb640 10 monclient: _finish_auth 0 2024-09-22T08:37:17.131 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-22T08:37:16.812+0000 7f1379ffb640 10 monclient: _check_auth_tickets 2024-09-22T08:37:17.132 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-22T08:37:16.812+0000 7f1379ffb640 10 monclient: handle_config config(0 keys) 2024-09-22T08:37:17.132 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-22T08:37:16.812+0000 7f1379ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:37:17.132 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-22T08:37:16.812+0000 7f1379ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:37:17.132 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-22T08:37:16.812+0000 7f1379ffb640 10 monclient: dump: 2024-09-22T08:37:17.132 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:37:17.132 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:37:17.132 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:17.132 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:17.132 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:37:17.132 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:17.132 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:37:17.132 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:37:17.132 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:37:17.132 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:17.133 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-22T08:37:16.812+0000 7f14a6c2f800 5 monclient: authenticate success, global_id 7896 2024-09-22T08:37:17.133 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-22T08:37:16.812+0000 7f137b7fe640 4 set_mon_vals no callback set 2024-09-22T08:37:17.133 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-22T08:37:16.812+0000 7f14a6c2f800 10 monclient: _renew_subs 2024-09-22T08:37:17.133 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-22T08:37:16.812+0000 7f14a6c2f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:37:17.133 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-22T08:37:16.812+0000 7f14a6c2f800 10 monclient: _renew_subs 2024-09-22T08:37:17.133 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-22T08:37:16.812+0000 7f14a6c2f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:37:17.133 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-22T08:37:16.812+0000 7f14a6c2f800 1 librados: init done 2024-09-22T08:37:17.133 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-22T08:37:16.812+0000 7f14a6c2f800 5 asok(0x5571e2f0a0f0) register_command cr dump hook 0x7f148c07c228 2024-09-22T08:37:17.133 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-22T08:37:16.813+0000 7f14a6c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.133 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-22T08:37:16.814+0000 7f1379ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:37:17.133 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-22T08:37:16.814+0000 7f1379ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:37:17.133 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-22T08:37:16.814+0000 7f1379ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:37:17.133 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-22T08:37:16.815+0000 7f14a3f18640 10 monclient: get_auth_request con 0x7f136c077570 auth_method 0 2024-09-22T08:37:17.134 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-22T08:37:16.815+0000 7f14a4f1a640 10 monclient: get_auth_request con 0x5571e321b2e0 auth_method 0 2024-09-22T08:37:17.134 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-22T08:37:16.815+0000 7f14a6c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:17.134 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-22T08:37:16.815+0000 7f14a6c2f800 20 realm 2024-09-22T08:37:17.134 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-22T08:37:16.815+0000 7f14a6c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.134 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-22T08:37:16.816+0000 7f14a6c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:17.134 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-22T08:37:16.816+0000 7f14a6c2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:17.134 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-22T08:37:16.816+0000 7f14a6c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.134 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-22T08:37:16.816+0000 7f14a6c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:17.134 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-22T08:37:16.816+0000 7f14a6c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.134 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-22T08:37:16.816+0000 7f14a3f18640 10 monclient: get_auth_request con 0x5571e321f460 auth_method 0 2024-09-22T08:37:17.134 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-22T08:37:16.817+0000 7f14a6c2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:17.134 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-22T08:37:16.817+0000 7f14a6c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.134 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-22T08:37:16.817+0000 7f14a4f1a640 10 monclient: get_auth_request con 0x5571e3222ca0 auth_method 0 2024-09-22T08:37:17.134 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-22T08:37:16.817+0000 7f14a6c2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:37:17.135 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-22T08:37:16.817+0000 7f14a6c2f800 20 searching for the correct realm 2024-09-22T08:37:17.135 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-22T08:37:16.818+0000 7f14a4719640 10 monclient: get_auth_request con 0x5571e32279c0 auth_method 0 2024-09-22T08:37:17.135 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-22T08:37:16.819+0000 7f14a3f18640 10 monclient: get_auth_request con 0x7f148c0910c0 auth_method 0 2024-09-22T08:37:17.135 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-22T08:37:16.820+0000 7f14a3f18640 0 -- 172.21.15.38:0/192092855 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f148c0910c0 msgr2=0x7f148c089080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:17.135 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-22T08:37:16.820+0000 7f1379ffb640 1 client.7896.objecter ms_handle_reset 0x7f148c0910c0 session 0x7f148c005040 osd.0 2024-09-22T08:37:17.135 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-22T08:37:16.820+0000 7f1379ffb640 10 monclient: _renew_subs 2024-09-22T08:37:17.135 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-22T08:37:16.820+0000 7f1379ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:37:17.135 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-22T08:37:16.820+0000 7f14a3f18640 10 monclient: get_auth_request con 0x7f136c087090 auth_method 0 2024-09-22T08:37:17.135 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-22T08:37:16.820+0000 7f14a4f1a640 10 monclient: get_auth_request con 0x7f149403a020 auth_method 0 2024-09-22T08:37:17.135 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-22T08:37:16.822+0000 7f14a4719640 10 monclient: get_auth_request con 0x7f148c05ab20 auth_method 0 2024-09-22T08:37:17.135 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-22T08:37:16.823+0000 7f14a3f18640 10 monclient: get_auth_request con 0x7f149406a9c0 auth_method 0 2024-09-22T08:37:17.135 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-22T08:37:16.823+0000 7f14a3f18640 0 -- 172.21.15.38:0/192092855 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f149406a9c0 msgr2=0x7f1494073040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:37:17.135 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-22T08:37:17.024+0000 7f14a3f18640 10 monclient: get_auth_request con 0x7f149406a9c0 auth_method 0 2024-09-22T08:37:17.135 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-22T08:37:17.029+0000 7f1379ffb640 1 client.7896.objecter ms_handle_reset 0x7f149406a9c0 session 0x7f149406a760 osd.3 2024-09-22T08:37:17.136 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-22T08:37:17.029+0000 7f14a3f18640 10 monclient: get_auth_request con 0x7f148c0910c0 auth_method 0 2024-09-22T08:37:17.136 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-22T08:37:17.030+0000 7f14a6c2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:17.136 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-22T08:37:17.030+0000 7f14a6c2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:17.136 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-22T08:37:17.030+0000 7f14a6c2f800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:37:17.136 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-22T08:37:17.030+0000 7f14a6c2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:17.136 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-22T08:37:17.030+0000 7f14a6c2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:17.136 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-22T08:37:17.030+0000 7f14a6c2f800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:37:17.136 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-22T08:37:17.030+0000 7f14a6c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.136 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-22T08:37:17.031+0000 7f14a6c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:17.136 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-22T08:37:17.031+0000 7f14a6c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.136 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-22T08:37:17.031+0000 7f14a6c2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:17.136 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-22T08:37:17.031+0000 7f14a6c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.136 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-22T08:37:17.031+0000 7f14a6c2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:37:17.136 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-22T08:37:17.031+0000 7f14a6c2f800 20 zone default found 2024-09-22T08:37:17.136 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-22T08:37:17.031+0000 7f14a6c2f800 4 Realm: () 2024-09-22T08:37:17.137 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-22T08:37:17.031+0000 7f14a6c2f800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:37:17.137 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-22T08:37:17.031+0000 7f14a6c2f800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:37:17.137 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-22T08:37:17.031+0000 7f14a6c2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:17.137 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-22T08:37:17.031+0000 7f14a6c2f800 20 zonegroup default 2024-09-22T08:37:17.137 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-22T08:37:17.031+0000 7f14a6c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.137 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-22T08:37:17.032+0000 7f14a6c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:17.137 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-22T08:37:17.032+0000 7f14a6c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.137 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-22T08:37:17.032+0000 7f14a6c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:17.137 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-22T08:37:17.032+0000 7f14a6c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.137 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-22T08:37:17.032+0000 7f14a6c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:17.137 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-22T08:37:17.032+0000 7f14a6c2f800 20 started sync module instance, tier type = 2024-09-22T08:37:17.137 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-22T08:37:17.032+0000 7f14a6c2f800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:37:17.137 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-22T08:37:17.042+0000 7f14a6c2f800 20 add_watcher() i=0 2024-09-22T08:37:17.137 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-22T08:37:17.042+0000 7f14a6c2f800 20 add_watcher() i=1 2024-09-22T08:37:17.137 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-22T08:37:17.042+0000 7f14a6c2f800 20 add_watcher() i=2 2024-09-22T08:37:17.138 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-22T08:37:17.042+0000 7f14a6c2f800 20 add_watcher() i=3 2024-09-22T08:37:17.138 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-22T08:37:17.042+0000 7f14a6c2f800 20 add_watcher() i=4 2024-09-22T08:37:17.138 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-22T08:37:17.042+0000 7f14a6c2f800 20 add_watcher() i=5 2024-09-22T08:37:17.138 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-22T08:37:17.042+0000 7f14a6c2f800 20 add_watcher() i=6 2024-09-22T08:37:17.138 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-22T08:37:17.043+0000 7f14a6c2f800 20 add_watcher() i=7 2024-09-22T08:37:17.138 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-22T08:37:17.043+0000 7f14a6c2f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:17.138 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-22T08:37:17.045+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc419486e0) adding auth protocol: cephx 2024-09-22T08:37:17.138 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-22T08:37:17.045+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc419486e0) adding auth protocol: cephx 2024-09-22T08:37:17.138 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-22T08:37:17.045+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc419486e0) adding auth protocol: cephx 2024-09-22T08:37:17.138 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-22T08:37:17.045+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc419486e0) adding con mode: secure 2024-09-22T08:37:17.138 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-22T08:37:17.045+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc419486e0) adding con mode: crc 2024-09-22T08:37:17.138 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-22T08:37:17.045+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc419486e0) adding con mode: secure 2024-09-22T08:37:17.138 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-22T08:37:17.045+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc419486e0) adding con mode: crc 2024-09-22T08:37:17.139 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-22T08:37:17.045+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc419486e0) adding con mode: secure 2024-09-22T08:37:17.139 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-22T08:37:17.045+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc419486e0) adding con mode: crc 2024-09-22T08:37:17.139 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-22T08:37:17.045+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc419486e0) adding con mode: crc 2024-09-22T08:37:17.139 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-22T08:37:17.045+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc419486e0) adding con mode: secure 2024-09-22T08:37:17.139 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-22T08:37:17.045+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc419486e0) adding con mode: crc 2024-09-22T08:37:17.139 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-22T08:37:17.045+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc419486e0) adding con mode: secure 2024-09-22T08:37:17.139 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-22T08:37:17.045+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc419486e0) adding con mode: crc 2024-09-22T08:37:17.139 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-22T08:37:17.045+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc419486e0) adding con mode: secure 2024-09-22T08:37:17.139 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-22T08:37:17.045+0000 7f135afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:17.139 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-22T08:37:17.046+0000 7f14a6c2f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:17.139 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-22T08:37:17.046+0000 7f14a6c2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:17.139 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-22T08:37:17.046+0000 7f14a6c2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:17.139 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-22T08:37:17.046+0000 7f14a6c2f800 5 asok(0x5571e2f0a0f0) register_command cache list hook 0x5571e31f7800 2024-09-22T08:37:17.140 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-22T08:37:17.046+0000 7f14a6c2f800 5 asok(0x5571e2f0a0f0) register_command cache inspect hook 0x5571e31f7800 2024-09-22T08:37:17.140 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-22T08:37:17.046+0000 7f14a6c2f800 5 asok(0x5571e2f0a0f0) register_command cache erase hook 0x5571e31f7800 2024-09-22T08:37:17.140 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-22T08:37:17.046+0000 7f14a6c2f800 5 asok(0x5571e2f0a0f0) register_command cache zap hook 0x5571e31f7800 2024-09-22T08:37:17.140 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-22T08:37:17.046+0000 7f14a6c2f800 5 note: GC not initialized 2024-09-22T08:37:17.140 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-22T08:37:17.046+0000 7f1359fdb640 20 reqs_thread_entry: start 2024-09-22T08:37:17.140 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-22T08:37:17.046+0000 7f14a6c2f800 5 asok(0x5571e2f0a0f0) register_command sync trace show hook 0x7f148c081020 2024-09-22T08:37:17.140 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-22T08:37:17.046+0000 7f14a6c2f800 5 asok(0x5571e2f0a0f0) register_command sync trace history hook 0x7f148c081020 2024-09-22T08:37:17.140 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-22T08:37:17.046+0000 7f14a6c2f800 5 asok(0x5571e2f0a0f0) register_command sync trace active hook 0x7f148c081020 2024-09-22T08:37:17.140 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-22T08:37:17.046+0000 7f14a6c2f800 5 asok(0x5571e2f0a0f0) register_command sync trace active_short hook 0x7f148c081020 2024-09-22T08:37:17.140 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-22T08:37:17.046+0000 7f14a6c2f800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:17.140 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-22T08:37:17.046+0000 7f14a6c2f800 20 Filter name: none 2024-09-22T08:37:17.140 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-22T08:37:17.046+0000 7f12cb7fe640 20 reqs_thread_entry: start 2024-09-22T08:37:17.140 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-22T08:37:17.046+0000 7f14a6c2f800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-22T08:37:17.140 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-22T08:37:17.046+0000 7f14a6c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.141 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-22T08:37:17.047+0000 7f14a6c2f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:37:17.141 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-22T08:37:17.047+0000 7f14a6c2f800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-22T08:37:17.141 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-22T08:37:17.047+0000 7f14a6c2f800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-22T08:37:17.141 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-22T08:37:17.047+0000 7f14a6c2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 : miss 2024-09-22T08:37:17.141 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-22T08:37:17.047+0000 7f14a6c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.141 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-22T08:37:17.047+0000 7f14a6c2f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:37:17.141 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-22T08:37:17.047+0000 7f14a6c2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 info.flags=0x17 2024-09-22T08:37:17.141 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-22T08:37:17.047+0000 7f14a6c2f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 to cache LRU end 2024-09-22T08:37:17.141 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-22T08:37:17.047+0000 7f14a6c2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:37:17.141 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-22T08:37:17.047+0000 7f14a6c2f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:17.141 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-22T08:37:17.047+0000 7f14a6c2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 2024-09-22T08:37:17.142 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-22T08:37:17.053+0000 7f14a6c2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 info.flags=0x17 2024-09-22T08:37:17.142 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-22T08:37:17.053+0000 7f14a6c2f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 to cache LRU end 2024-09-22T08:37:17.142 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-22T08:37:17.053+0000 7f14a6c2f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:17.142 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-22T08:37:17.053+0000 7f14a6c2f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39, ofs0, ns] 2024-09-22T08:37:17.142 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-22T08:37:17.053+0000 7f137b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497120 cookie 93947630377024 notifier 7896 bl.length()=931 2024-09-22T08:37:17.142 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-22T08:37:17.053+0000 7f137b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 info.flags=0x17 2024-09-22T08:37:17.142 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-22T08:37:17.053+0000 7f137b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 to cache LRU end 2024-09-22T08:37:17.142 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-22T08:37:17.053+0000 7f137b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:17.142 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-22T08:37:17.054+0000 7f14a6c2f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.39]): orig_sources= new_sources= 2024-09-22T08:37:17.142 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-22T08:37:17.054+0000 7f14a6c2f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.39]): potential sources added=[] removed=[] 2024-09-22T08:37:17.142 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-22T08:37:17.054+0000 7f14a6c2f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.39]): orig_dests= new_dests= 2024-09-22T08:37:17.142 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-22T08:37:17.054+0000 7f14a6c2f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.39]): potential dests added=[] removed=[] 2024-09-22T08:37:17.142 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-22T08:37:17.058+0000 7f14a6c2f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.0 2024-09-22T08:37:17.142 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-22T08:37:17.058+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.0 2024-09-22T08:37:17.143 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-22T08:37:17.058+0000 7f14a6c2f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.1 2024-09-22T08:37:17.143 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-22T08:37:17.058+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.1 2024-09-22T08:37:17.143 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-22T08:37:17.058+0000 7f14a6c2f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.2 2024-09-22T08:37:17.143 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-22T08:37:17.058+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.2 2024-09-22T08:37:17.143 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-22T08:37:17.058+0000 7f14a6c2f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.3 2024-09-22T08:37:17.143 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-22T08:37:17.058+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.3 2024-09-22T08:37:17.143 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-22T08:37:17.058+0000 7f14a6c2f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.4 2024-09-22T08:37:17.143 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-22T08:37:17.058+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.4 2024-09-22T08:37:17.143 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-22T08:37:17.058+0000 7f14a6c2f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.5 2024-09-22T08:37:17.143 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-22T08:37:17.058+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.5 2024-09-22T08:37:17.143 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-22T08:37:17.058+0000 7f14a6c2f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.6 2024-09-22T08:37:17.143 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-22T08:37:17.058+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.6 2024-09-22T08:37:17.143 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-22T08:37:17.058+0000 7f14a6c2f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.7 2024-09-22T08:37:17.143 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-22T08:37:17.058+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.7 2024-09-22T08:37:17.144 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-22T08:37:17.058+0000 7f14a6c2f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.8 2024-09-22T08:37:17.144 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-22T08:37:17.058+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.8 2024-09-22T08:37:17.144 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-22T08:37:17.059+0000 7f14a6c2f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.9 2024-09-22T08:37:17.144 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-22T08:37:17.059+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.9 2024-09-22T08:37:17.144 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-22T08:37:17.059+0000 7f14a6c2f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.10 2024-09-22T08:37:17.144 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-22T08:37:17.059+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.10 2024-09-22T08:37:17.144 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-22T08:37:17.059+0000 7f14a6c2f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.11 2024-09-22T08:37:17.144 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-22T08:37:17.059+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.11 2024-09-22T08:37:17.144 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-22T08:37:17.059+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.0 2024-09-22T08:37:17.144 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-22T08:37:17.059+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1 2024-09-22T08:37:17.144 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-22T08:37:17.059+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.2 2024-09-22T08:37:17.144 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-22T08:37:17.060+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.3 2024-09-22T08:37:17.144 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-22T08:37:17.060+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.4 2024-09-22T08:37:17.144 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-22T08:37:17.061+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.5 2024-09-22T08:37:17.144 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-22T08:37:17.061+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.6 2024-09-22T08:37:17.145 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-22T08:37:17.062+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.7 2024-09-22T08:37:17.145 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-22T08:37:17.063+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.8 2024-09-22T08:37:17.145 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-22T08:37:17.063+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.9 2024-09-22T08:37:17.145 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-22T08:37:17.064+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.10 2024-09-22T08:37:17.145 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-22T08:37:17.068+0000 7f14a6c2f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f14a6c2f800 time 2024-09-22T08:37:17.068176+0000 2024-09-22T08:37:17.145 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:37:17.145 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:17.145 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:37:17.145 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f14aa18c748] 2024-09-22T08:37:17.145 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f14aa18c906] 2024-09-22T08:37:17.145 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5571e1efee01] 2024-09-22T08:37:17.145 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5571e1f0de9b] 2024-09-22T08:37:17.145 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5571e1f0ed64] 2024-09-22T08:37:17.145 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-22T08:37:17.146 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f14a8e29590] 2024-09-22T08:37:17.146 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-22T08:37:17.146 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-22T08:37:17.146 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:17.146 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-22T08:37:17.068+0000 7f14a6c2f800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:37:17.146 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f14a6c2f800 thread_name:radosgw-admin 2024-09-22T08:37:17.146 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:17.146 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:37:17.146 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f14a8e3e6f0] 2024-09-22T08:37:17.146 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f14a8e8b99c] 2024-09-22T08:37:17.146 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:37:17.146 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:37:17.146 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f14aa18c7a2] 2024-09-22T08:37:17.146 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f14aa18c906] 2024-09-22T08:37:17.147 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5571e1efee01] 2024-09-22T08:37:17.147 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5571e1f0de9b] 2024-09-22T08:37:17.147 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5571e1f0ed64] 2024-09-22T08:37:17.147 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-22T08:37:17.147 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f14a8e29590] 2024-09-22T08:37:17.147 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-22T08:37:17.147 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-22T08:37:17.147 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:37:17.147 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:17.147 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-22T08:37:17.147 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-22T08:37:17.147 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-22T08:37:17.147 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-22T08:37:17.148 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-22T08:37:17.148 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-22T08:37:17.148 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-22T08:37:17.148 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-22T08:37:17.148 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-22T08:37:17.148 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-22T08:37:17.148 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-22T08:37:17.148 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-22T08:37:17.148 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-22T08:37:17.148 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-22T08:37:17.148 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-22T08:37:17.148 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-22T08:37:17.148 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-22T08:37:17.148 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-22T08:37:17.149 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-22T08:37:17.149 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-22T08:37:17.149 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-22T08:37:17.149 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-22T08:37:17.149 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-22T08:37:17.149 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-22T08:37:17.149 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:37:17.149 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-22T08:37:17.149 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-22T08:37:17.149 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-22T08:37:17.149 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-22T08:37:17.149 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-22T08:37:17.149 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-22T08:37:17.149 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-22T08:37:17.149 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-22T08:37:17.149 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-22T08:37:17.150 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-22T08:37:17.150 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-22T08:37:17.150 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-22T08:37:17.150 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-22T08:37:17.150 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-22T08:37:17.150 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-22T08:37:17.150 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-22T08:37:17.150 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-22T08:37:17.150 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-22T08:37:17.150 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-22T08:37:17.150 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-22T08:37:17.150 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-22T08:37:17.150 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:37:17.150 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-22T08:37:17.151 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:37:17.151 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-22T08:37:17.151 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-22T08:37:17.151 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-22T08:37:17.151 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-22T08:37:17.151 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-22T08:37:17.151 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-22T08:37:17.151 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-22T08:37:17.151 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-22T08:37:17.151 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-22T08:37:17.151 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-22T08:37:17.152 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-22T08:37:17.152 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-22T08:37:17.152 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-22T08:37:17.152 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-22T08:37:17.152 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-22T08:37:17.152 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-22T08:37:17.152 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-22T08:37:17.152 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-22T08:37:17.152 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:37:17.152 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-22T08:37:17.152 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:37:17.152 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-22T08:37:17.152 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-22T08:37:17.153 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-22T08:37:17.153 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-22T08:37:17.153 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-22T08:37:17.153 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-22T08:37:17.153 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:37:17.153 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-22T08:37:17.153 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-22T08:37:17.153 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:37:17.153 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-22T08:37:17.153 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-22T08:37:17.153 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-22T08:37:17.153 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-22T08:37:17.153 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-22T08:37:17.153 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-22T08:37:17.154 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-22T08:37:17.154 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-22T08:37:17.154 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-22T08:37:17.154 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-22T08:37:17.154 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-22T08:37:17.154 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-22T08:37:17.154 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-22T08:37:17.154 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:37:17.154 INFO:tasks.workunit.client.0.smithi038.stderr: 7f12cb7fe640 / http_manager 2024-09-22T08:37:17.154 INFO:tasks.workunit.client.0.smithi038.stderr: 7f1359fdb640 / http_manager 2024-09-22T08:37:17.154 INFO:tasks.workunit.client.0.smithi038.stderr: 7f135afdd640 / rgw_dt_lg_renew 2024-09-22T08:37:17.154 INFO:tasks.workunit.client.0.smithi038.stderr: 7f1379ffb640 / ms_dispatch 2024-09-22T08:37:17.154 INFO:tasks.workunit.client.0.smithi038.stderr: 7f137b7fe640 / io_context_pool 2024-09-22T08:37:17.154 INFO:tasks.workunit.client.0.smithi038.stderr: 7f1389ffb640 / ms_dispatch 2024-09-22T08:37:17.155 INFO:tasks.workunit.client.0.smithi038.stderr: 7f1390e09640 / ms_dispatch 2024-09-22T08:37:17.155 INFO:tasks.workunit.client.0.smithi038.stderr: 7f139260c640 / io_context_pool 2024-09-22T08:37:17.155 INFO:tasks.workunit.client.0.smithi038.stderr: 7f14a3f18640 / msgr-worker-2 2024-09-22T08:37:17.155 INFO:tasks.workunit.client.0.smithi038.stderr: 7f14a4719640 / msgr-worker-1 2024-09-22T08:37:17.155 INFO:tasks.workunit.client.0.smithi038.stderr: 7f14a4f1a640 / msgr-worker-0 2024-09-22T08:37:17.155 INFO:tasks.workunit.client.0.smithi038.stderr: 7f14a571b640 / io_context_pool 2024-09-22T08:37:17.155 INFO:tasks.workunit.client.0.smithi038.stderr: 7f14a6c2f800 / radosgw-admin 2024-09-22T08:37:17.155 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-22T08:37:17.155 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-22T08:37:17.155 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/log/ceph/ceph-client.admin.141042.log 2024-09-22T08:37:17.155 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-22T08:37:17.155 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-22T08:37:17.155 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-22T08:37:16.797+0000 7f14a6c2f800 5 AuthRegistry(0x5571e312e070) adding con mode: crc 2024-09-22T08:37:17.155 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-22T08:37:16.797+0000 7f14a6c2f800 5 AuthRegistry(0x5571e312e070) adding con mode: secure 2024-09-22T08:37:17.155 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-22T08:37:16.797+0000 7f14a6c2f800 5 AuthRegistry(0x5571e312e070) adding con mode: crc 2024-09-22T08:37:17.156 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-22T08:37:16.797+0000 7f14a6c2f800 5 AuthRegistry(0x5571e312e070) adding con mode: secure 2024-09-22T08:37:17.156 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-22T08:37:16.797+0000 7f14a6c2f800 5 AuthRegistry(0x5571e312e070) adding con mode: crc 2024-09-22T08:37:17.156 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-22T08:37:16.797+0000 7f14a6c2f800 5 AuthRegistry(0x5571e312e070) adding con mode: secure 2024-09-22T08:37:17.156 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-22T08:37:16.797+0000 7f14a6c2f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:17.156 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-22T08:37:16.797+0000 7f14a6c2f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:17.156 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-22T08:37:16.797+0000 7f14a6c2f800 5 asok(0x5571e2f0a0f0) register_command rotate-key hook 0x5571e312e1b8 2024-09-22T08:37:17.156 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-22T08:37:16.797+0000 7f14a6c2f800 10 monclient: _reopen_session rank -1 2024-09-22T08:37:17.156 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-22T08:37:16.797+0000 7f14a6c2f800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T08:37:17.156 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-22T08:37:16.797+0000 7f14a6c2f800 10 monclient(hunting): picked mon.noname-a con 0x5571e2fb54a0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:37:17.156 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-22T08:37:16.797+0000 7f14a6c2f800 10 monclient(hunting): picked mon.noname-c con 0x5571e3070c80 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:37:17.156 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-22T08:37:16.797+0000 7f14a6c2f800 10 monclient(hunting): picked mon.noname-b con 0x5571e3073e40 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:37:17.156 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-22T08:37:16.797+0000 7f14a6c2f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:17.156 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-22T08:37:16.797+0000 7f14a6c2f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:17.157 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-22T08:37:16.797+0000 7f14a6c2f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:17.157 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-22T08:37:16.797+0000 7f14a6c2f800 10 monclient(hunting): _renew_subs 2024-09-22T08:37:17.157 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-22T08:37:16.797+0000 7f14a6c2f800 10 monclient(hunting): authenticate will time out at 2142.036640s 2024-09-22T08:37:17.157 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-22T08:37:16.797+0000 7f14a3f18640 10 monclient(hunting): get_auth_request con 0x5571e3070c80 auth_method 0 2024-09-22T08:37:17.157 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-22T08:37:16.797+0000 7f14a3f18640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:17.157 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-22T08:37:16.797+0000 7f14a3f18640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:17.157 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-22T08:37:16.797+0000 7f14a3f18640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:17.157 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-22T08:37:16.797+0000 7f14a4719640 10 monclient(hunting): get_auth_request con 0x5571e2fb54a0 auth_method 0 2024-09-22T08:37:17.157 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-22T08:37:16.797+0000 7f14a4719640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:17.157 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-22T08:37:16.797+0000 7f14a4719640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:17.157 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-22T08:37:16.797+0000 7f14a4719640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:17.157 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-22T08:37:16.797+0000 7f14a4f1a640 10 monclient(hunting): get_auth_request con 0x5571e3073e40 auth_method 0 2024-09-22T08:37:17.157 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-22T08:37:16.797+0000 7f14a4f1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:17.157 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-22T08:37:16.797+0000 7f14a4f1a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:17.158 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-22T08:37:16.797+0000 7f14a4f1a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:17.158 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-22T08:37:16.797+0000 7f14a3f18640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:37:17.158 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-22T08:37:16.797+0000 7f14a3f18640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:37:17.158 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-22T08:37:16.797+0000 7f14a3f18640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:37:17.158 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-22T08:37:16.797+0000 7f14a4719640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:37:17.158 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-22T08:37:16.797+0000 7f14a4719640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:37:17.158 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-22T08:37:16.797+0000 7f14a4719640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:37:17.158 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-22T08:37:16.797+0000 7f14a4f1a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:37:17.158 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-22T08:37:16.797+0000 7f14a4f1a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:37:17.158 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-22T08:37:16.797+0000 7f14a4f1a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:37:17.158 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-22T08:37:16.797+0000 7f14a3f18640 10 monclient(hunting): handle_auth_done global_id 7415 payload 824 2024-09-22T08:37:17.158 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-22T08:37:16.797+0000 7f14a3f18640 10 monclient: _finish_hunting 0 2024-09-22T08:37:17.158 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-22T08:37:16.797+0000 7f14a3f18640 1 monclient: found mon.noname-c 2024-09-22T08:37:17.159 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-22T08:37:16.797+0000 7f14a3f18640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:37:17.159 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-22T08:37:16.798+0000 7f1390e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:37:17.159 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-22T08:37:16.798+0000 7f1390e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:37:17.159 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-22T08:37:16.798+0000 7f1390e09640 10 monclient: dump: 2024-09-22T08:37:17.159 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:37:17.159 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:37:17.159 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:17.159 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:17.159 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:37:17.159 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:17.159 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:37:17.159 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:37:17.159 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:37:17.159 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:17.160 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-22T08:37:16.798+0000 7f1390e09640 10 monclient: _finish_auth 0 2024-09-22T08:37:17.160 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-22T08:37:16.798+0000 7f1390e09640 10 monclient: _check_auth_tickets 2024-09-22T08:37:17.160 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-22T08:37:16.798+0000 7f1390e09640 10 monclient: handle_config config(0 keys) 2024-09-22T08:37:17.160 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-22T08:37:16.798+0000 7f1390e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:37:17.160 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-22T08:37:16.798+0000 7f1390e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:37:17.160 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-22T08:37:16.798+0000 7f1390e09640 10 monclient: dump: 2024-09-22T08:37:17.160 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:37:17.160 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:37:17.160 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:17.160 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:17.160 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:37:17.160 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:17.160 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:37:17.160 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:37:17.160 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:37:17.161 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:17.161 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-22T08:37:16.798+0000 7f14a6c2f800 5 monclient: authenticate success, global_id 7415 2024-09-22T08:37:17.161 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-22T08:37:16.798+0000 7f14a6c2f800 10 monclient: _renew_subs 2024-09-22T08:37:17.161 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-22T08:37:16.798+0000 7f14a6c2f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:37:17.161 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-22T08:37:16.798+0000 7f139260c640 4 set_mon_vals no callback set 2024-09-22T08:37:17.161 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-22T08:37:16.798+0000 7f14a6c2f800 10 monclient: _renew_subs 2024-09-22T08:37:17.161 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-22T08:37:16.798+0000 7f14a6c2f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:37:17.161 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-22T08:37:16.798+0000 7f14a6c2f800 1 librados: init done 2024-09-22T08:37:17.161 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-22T08:37:16.800+0000 7f1390e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:37:17.161 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-22T08:37:16.800+0000 7f1390e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:37:17.161 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-22T08:37:16.800+0000 7f1390e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:37:17.161 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-22T08:37:16.800+0000 7f14a4719640 10 monclient: get_auth_request con 0x7f138c0775a0 auth_method 0 2024-09-22T08:37:17.161 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-22T08:37:16.800+0000 7f14a4f1a640 10 monclient: get_auth_request con 0x5571e31561b0 auth_method 0 2024-09-22T08:37:17.161 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-22T08:37:16.801+0000 7f14a4719640 10 monclient: get_auth_request con 0x5571e31792b0 auth_method 0 2024-09-22T08:37:17.162 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-22T08:37:16.802+0000 7f14a3f18640 10 monclient: get_auth_request con 0x5571e317d660 auth_method 0 2024-09-22T08:37:17.162 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-22T08:37:16.803+0000 7f14a4f1a640 10 monclient: get_auth_request con 0x5571e317cb90 auth_method 0 2024-09-22T08:37:17.162 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 10 monclient: build_initial_monmap 2024-09-22T08:37:17.162 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 1 build_initial for_mkfs: 0 2024-09-22T08:37:17.162 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 10 monclient: monmap: 2024-09-22T08:37:17.162 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:37:17.162 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:37:17.162 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:37:17.163 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:37:17.163 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:37:17.163 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:17.163 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:37:17.163 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:37:17.163 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:37:17.163 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:17.163 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31857d0) adding auth protocol: cephx 2024-09-22T08:37:17.163 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31857d0) adding auth protocol: cephx 2024-09-22T08:37:17.163 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31857d0) adding auth protocol: cephx 2024-09-22T08:37:17.164 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31857d0) adding con mode: secure 2024-09-22T08:37:17.164 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31857d0) adding con mode: crc 2024-09-22T08:37:17.164 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31857d0) adding con mode: secure 2024-09-22T08:37:17.164 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31857d0) adding con mode: crc 2024-09-22T08:37:17.164 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31857d0) adding con mode: secure 2024-09-22T08:37:17.164 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31857d0) adding con mode: crc 2024-09-22T08:37:17.164 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31857d0) adding con mode: crc 2024-09-22T08:37:17.164 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31857d0) adding con mode: secure 2024-09-22T08:37:17.164 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31857d0) adding con mode: crc 2024-09-22T08:37:17.164 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31857d0) adding con mode: secure 2024-09-22T08:37:17.164 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31857d0) adding con mode: crc 2024-09-22T08:37:17.164 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31857d0) adding con mode: secure 2024-09-22T08:37:17.164 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:17.165 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 asok(0x5571e2f0a0f0) register_command objecter_requests cmddesc objecter_requests hook 0x5571e31891e0 EEXIST 2024-09-22T08:37:17.165 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 10 monclient: init 2024-09-22T08:37:17.165 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e3184788) adding auth protocol: cephx 2024-09-22T08:37:17.165 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e3184788) adding auth protocol: cephx 2024-09-22T08:37:17.165 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e3184788) adding auth protocol: cephx 2024-09-22T08:37:17.165 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e3184788) adding con mode: secure 2024-09-22T08:37:17.165 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e3184788) adding con mode: crc 2024-09-22T08:37:17.165 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e3184788) adding con mode: secure 2024-09-22T08:37:17.165 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e3184788) adding con mode: crc 2024-09-22T08:37:17.165 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e3184788) adding con mode: secure 2024-09-22T08:37:17.165 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e3184788) adding con mode: crc 2024-09-22T08:37:17.165 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e3184788) adding con mode: crc 2024-09-22T08:37:17.165 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e3184788) adding con mode: secure 2024-09-22T08:37:17.165 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e3184788) adding con mode: crc 2024-09-22T08:37:17.166 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e3184788) adding con mode: secure 2024-09-22T08:37:17.166 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e3184788) adding con mode: crc 2024-09-22T08:37:17.166 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-22T08:37:16.804+0000 7f14a6c2f800 5 AuthRegistry(0x5571e3184788) adding con mode: secure 2024-09-22T08:37:17.166 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-22T08:37:16.805+0000 7f14a6c2f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:17.166 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-22T08:37:16.805+0000 7f14a6c2f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:17.166 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-22T08:37:16.805+0000 7f14a6c2f800 5 asok(0x5571e2f0a0f0) register_command rotate-key cmddesc rotate-key hook 0x5571e31848d0 EEXIST 2024-09-22T08:37:17.166 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-22T08:37:16.805+0000 7f14a6c2f800 10 monclient: _reopen_session rank -1 2024-09-22T08:37:17.166 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-22T08:37:16.805+0000 7f14a6c2f800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-22T08:37:17.166 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-22T08:37:16.805+0000 7f14a6c2f800 10 monclient(hunting): picked mon.noname-b con 0x5571e31aced0 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:37:17.166 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-22T08:37:16.805+0000 7f14a6c2f800 10 monclient(hunting): picked mon.noname-c con 0x5571e31af1a0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:37:17.166 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-22T08:37:16.805+0000 7f14a6c2f800 10 monclient(hunting): picked mon.noname-a con 0x5571e31ab6a0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:37:17.166 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-22T08:37:16.805+0000 7f14a6c2f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:17.166 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-22T08:37:16.805+0000 7f14a6c2f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:17.167 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-22T08:37:16.805+0000 7f14a6c2f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:17.167 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-22T08:37:16.805+0000 7f14a6c2f800 10 monclient(hunting): _renew_subs 2024-09-22T08:37:17.167 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-22T08:37:16.805+0000 7f14a6c2f800 10 monclient(hunting): authenticate will time out at 2142.044325s 2024-09-22T08:37:17.167 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-22T08:37:16.805+0000 7f14a4f1a640 10 monclient(hunting): get_auth_request con 0x5571e31af1a0 auth_method 0 2024-09-22T08:37:17.167 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-22T08:37:16.805+0000 7f14a4f1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:17.167 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-22T08:37:16.805+0000 7f14a4f1a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:17.167 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-22T08:37:16.805+0000 7f14a4f1a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:17.167 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-22T08:37:16.805+0000 7f14a3f18640 10 monclient(hunting): get_auth_request con 0x5571e31aced0 auth_method 0 2024-09-22T08:37:17.167 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-22T08:37:16.805+0000 7f14a3f18640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:17.167 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-22T08:37:16.805+0000 7f14a3f18640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:17.167 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-22T08:37:16.805+0000 7f14a3f18640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:17.167 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-22T08:37:16.805+0000 7f14a4719640 10 monclient(hunting): get_auth_request con 0x5571e31ab6a0 auth_method 0 2024-09-22T08:37:17.167 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-22T08:37:16.805+0000 7f14a4719640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:17.167 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-22T08:37:16.805+0000 7f14a4719640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:17.168 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-22T08:37:16.805+0000 7f14a4719640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:17.168 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-22T08:37:16.805+0000 7f14a4f1a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:37:17.168 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-22T08:37:16.805+0000 7f14a4f1a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:37:17.168 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-22T08:37:16.805+0000 7f14a4f1a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:37:17.168 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-22T08:37:16.805+0000 7f14a3f18640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:37:17.168 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-22T08:37:16.805+0000 7f14a3f18640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:37:17.168 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-22T08:37:16.805+0000 7f14a3f18640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:37:17.168 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-22T08:37:16.805+0000 7f14a4719640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:37:17.168 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-22T08:37:16.805+0000 7f14a4719640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:37:17.168 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-22T08:37:16.805+0000 7f14a4719640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:37:17.168 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-22T08:37:16.805+0000 7f14a3f18640 10 monclient(hunting): handle_auth_done global_id 7144 payload 824 2024-09-22T08:37:17.168 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-22T08:37:16.805+0000 7f14a3f18640 10 monclient: _finish_hunting 0 2024-09-22T08:37:17.168 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-22T08:37:16.805+0000 7f14a3f18640 1 monclient: found mon.noname-b 2024-09-22T08:37:17.168 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-22T08:37:16.805+0000 7f14a3f18640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.42:3300/0 2024-09-22T08:37:17.169 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-22T08:37:16.806+0000 7f1389ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:37:17.169 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-22T08:37:16.806+0000 7f1389ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-22T08:37:17.169 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-22T08:37:16.806+0000 7f1389ffb640 10 monclient: dump: 2024-09-22T08:37:17.169 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:37:17.169 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:37:17.169 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:17.169 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:17.169 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:37:17.169 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:17.169 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:37:17.169 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:37:17.169 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:37:17.169 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:17.169 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-22T08:37:16.806+0000 7f1389ffb640 10 monclient: _finish_auth 0 2024-09-22T08:37:17.169 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-22T08:37:16.806+0000 7f1389ffb640 10 monclient: _check_auth_tickets 2024-09-22T08:37:17.170 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-22T08:37:16.806+0000 7f1389ffb640 10 monclient: handle_config config(0 keys) 2024-09-22T08:37:17.170 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-22T08:37:16.806+0000 7f14a6c2f800 5 monclient: authenticate success, global_id 7144 2024-09-22T08:37:17.170 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-22T08:37:16.806+0000 7f14a6c2f800 10 monclient: _renew_subs 2024-09-22T08:37:17.170 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-22T08:37:16.806+0000 7f14a6c2f800 10 monclient: _send_mon_message to mon.b at v2:172.21.15.42:3300/0 2024-09-22T08:37:17.170 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-22T08:37:16.806+0000 7f1389ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:37:17.170 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-22T08:37:16.806+0000 7f1389ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-22T08:37:17.170 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-22T08:37:16.806+0000 7f1389ffb640 10 monclient: dump: 2024-09-22T08:37:17.170 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:37:17.170 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:37:17.170 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:17.170 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:17.170 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:37:17.171 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:17.171 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:37:17.171 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:37:17.171 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:37:17.171 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:17.171 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-22T08:37:16.806+0000 7f14a571b640 4 set_mon_vals no callback set 2024-09-22T08:37:17.171 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-22T08:37:16.806+0000 7f14a6c2f800 10 monclient: _renew_subs 2024-09-22T08:37:17.171 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-22T08:37:16.806+0000 7f14a6c2f800 10 monclient: _send_mon_message to mon.b at v2:172.21.15.42:3300/0 2024-09-22T08:37:17.171 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-22T08:37:16.808+0000 7f1389ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:37:17.171 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-22T08:37:16.808+0000 7f1389ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:37:17.171 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-22T08:37:16.808+0000 7f1389ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:37:17.171 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 10 monclient: get_monmap_and_config 2024-09-22T08:37:17.171 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 10 monclient: build_initial_monmap 2024-09-22T08:37:17.172 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 1 build_initial for_mkfs: 0 2024-09-22T08:37:17.172 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 10 monclient: monmap: 2024-09-22T08:37:17.172 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:37:17.172 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:37:17.172 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:37:17.172 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:37:17.172 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:37:17.172 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:17.172 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:37:17.172 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:37:17.173 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:37:17.173 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:17.173 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-22T08:37:16.808+0000 7f14a4f1a640 10 monclient: get_auth_request con 0x7f137c077480 auth_method 0 2024-09-22T08:37:17.173 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31ccbc0) adding auth protocol: cephx 2024-09-22T08:37:17.173 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31ccbc0) adding auth protocol: cephx 2024-09-22T08:37:17.173 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31ccbc0) adding auth protocol: cephx 2024-09-22T08:37:17.173 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31ccbc0) adding con mode: secure 2024-09-22T08:37:17.173 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31ccbc0) adding con mode: crc 2024-09-22T08:37:17.173 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31ccbc0) adding con mode: secure 2024-09-22T08:37:17.173 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31ccbc0) adding con mode: crc 2024-09-22T08:37:17.173 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31ccbc0) adding con mode: secure 2024-09-22T08:37:17.173 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31ccbc0) adding con mode: crc 2024-09-22T08:37:17.173 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31ccbc0) adding con mode: crc 2024-09-22T08:37:17.174 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31ccbc0) adding con mode: secure 2024-09-22T08:37:17.174 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31ccbc0) adding con mode: crc 2024-09-22T08:37:17.174 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31ccbc0) adding con mode: secure 2024-09-22T08:37:17.174 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31ccbc0) adding con mode: crc 2024-09-22T08:37:17.174 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31ccbc0) adding con mode: secure 2024-09-22T08:37:17.174 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:17.174 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 10 monclient: init 2024-09-22T08:37:17.174 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc41948210) adding auth protocol: cephx 2024-09-22T08:37:17.174 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc41948210) adding auth protocol: cephx 2024-09-22T08:37:17.174 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc41948210) adding auth protocol: cephx 2024-09-22T08:37:17.174 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc41948210) adding con mode: secure 2024-09-22T08:37:17.174 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc41948210) adding con mode: crc 2024-09-22T08:37:17.175 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc41948210) adding con mode: secure 2024-09-22T08:37:17.175 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc41948210) adding con mode: crc 2024-09-22T08:37:17.175 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc41948210) adding con mode: secure 2024-09-22T08:37:17.175 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc41948210) adding con mode: crc 2024-09-22T08:37:17.175 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc41948210) adding con mode: crc 2024-09-22T08:37:17.175 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc41948210) adding con mode: secure 2024-09-22T08:37:17.175 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc41948210) adding con mode: crc 2024-09-22T08:37:17.175 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc41948210) adding con mode: secure 2024-09-22T08:37:17.175 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc41948210) adding con mode: crc 2024-09-22T08:37:17.175 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-22T08:37:16.808+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc41948210) adding con mode: secure 2024-09-22T08:37:17.175 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-22T08:37:16.809+0000 7f14a6c2f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:17.175 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-22T08:37:16.809+0000 7f14a6c2f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:17.175 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-22T08:37:16.809+0000 7f14a6c2f800 5 asok(0x5571e2f0a0f0) register_command rotate-key cmddesc rotate-key hook 0x7ffc41948358 EEXIST 2024-09-22T08:37:17.175 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-22T08:37:16.809+0000 7f14a6c2f800 10 monclient: _reopen_session rank -1 2024-09-22T08:37:17.176 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-22T08:37:16.809+0000 7f14a6c2f800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T08:37:17.176 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-22T08:37:16.809+0000 7f14a6c2f800 10 monclient(hunting): picked mon.noname-a con 0x5571e3201280 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:37:17.176 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-22T08:37:16.809+0000 7f14a6c2f800 10 monclient(hunting): picked mon.noname-c con 0x5571e31d21d0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:37:17.176 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-22T08:37:16.809+0000 7f14a6c2f800 10 monclient(hunting): picked mon.noname-b con 0x5571e31fcb20 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:37:17.176 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-22T08:37:16.809+0000 7f14a6c2f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:17.176 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-22T08:37:16.809+0000 7f14a6c2f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:17.176 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-22T08:37:16.809+0000 7f14a6c2f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:17.176 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-22T08:37:16.809+0000 7f14a6c2f800 10 monclient(hunting): _renew_subs 2024-09-22T08:37:17.176 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-22T08:37:16.809+0000 7f14a6c2f800 10 monclient(hunting): authenticate will time out at 2142.048469s 2024-09-22T08:37:17.176 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-22T08:37:16.809+0000 7f14a3f18640 10 monclient(hunting): get_auth_request con 0x5571e3201280 auth_method 0 2024-09-22T08:37:17.176 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-22T08:37:16.809+0000 7f14a3f18640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:17.176 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-22T08:37:16.809+0000 7f14a3f18640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:17.176 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-22T08:37:16.809+0000 7f14a3f18640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:17.176 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-22T08:37:16.809+0000 7f14a4f1a640 10 monclient(hunting): get_auth_request con 0x5571e31d21d0 auth_method 0 2024-09-22T08:37:17.177 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-22T08:37:16.809+0000 7f14a4f1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:17.177 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-22T08:37:16.809+0000 7f14a4f1a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:17.177 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-22T08:37:16.809+0000 7f14a4f1a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:17.177 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-22T08:37:16.809+0000 7f14a3f18640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:37:17.177 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-22T08:37:16.809+0000 7f14a3f18640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:37:17.177 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-22T08:37:16.809+0000 7f14a3f18640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:37:17.177 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-22T08:37:16.809+0000 7f14a4f1a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:37:17.177 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-22T08:37:16.809+0000 7f14a4f1a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:37:17.177 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-22T08:37:16.809+0000 7f14a4f1a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:37:17.177 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-22T08:37:16.809+0000 7f14a4719640 10 monclient(hunting): get_auth_request con 0x5571e31fcb20 auth_method 0 2024-09-22T08:37:17.177 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-22T08:37:16.809+0000 7f14a4719640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:17.177 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-22T08:37:16.809+0000 7f14a4719640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:17.177 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-22T08:37:16.809+0000 7f14a4719640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:17.177 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-22T08:37:16.809+0000 7f14a3f18640 10 monclient(hunting): handle_auth_done global_id 7893 payload 274 2024-09-22T08:37:17.178 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-22T08:37:16.809+0000 7f14a3f18640 10 monclient: _finish_hunting 0 2024-09-22T08:37:17.178 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-22T08:37:16.809+0000 7f14a3f18640 1 monclient: found mon.noname-a 2024-09-22T08:37:17.178 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-22T08:37:16.809+0000 7f14a3f18640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:37:17.178 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-22T08:37:16.809+0000 7f137b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:37:17.178 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-22T08:37:16.810+0000 7f137b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:37:17.178 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-22T08:37:16.810+0000 7f137b7fe640 10 monclient: dump: 2024-09-22T08:37:17.178 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:37:17.178 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:37:17.178 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:17.178 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:17.178 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:37:17.178 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:17.178 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:37:17.179 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:37:17.179 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:37:17.179 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:17.179 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-22T08:37:16.810+0000 7f137b7fe640 10 monclient: _finish_auth 0 2024-09-22T08:37:17.179 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-22T08:37:16.810+0000 7f137b7fe640 10 monclient: _check_auth_tickets 2024-09-22T08:37:17.179 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 5 monclient: authenticate success, global_id 7893 2024-09-22T08:37:17.179 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-22T08:37:16.810+0000 7f137b7fe640 10 monclient: handle_config config(0 keys) 2024-09-22T08:37:17.179 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 10 monclient: get_monmap_and_config success 2024-09-22T08:37:17.179 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 4 set_mon_vals no callback set 2024-09-22T08:37:17.179 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-22T08:37:16.810+0000 7f137b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:37:17.179 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-22T08:37:16.810+0000 7f137b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:37:17.179 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-22T08:37:16.810+0000 7f137b7fe640 10 monclient: dump: 2024-09-22T08:37:17.179 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:37:17.179 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:37:17.180 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:17.180 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:17.180 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:37:17.180 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:17.180 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:37:17.180 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:37:17.180 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:37:17.180 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:17.180 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 10 monclient: shutdown 2024-09-22T08:37:17.180 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 10 monclient: build_initial_monmap 2024-09-22T08:37:17.180 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 1 build_initial for_mkfs: 0 2024-09-22T08:37:17.180 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 10 monclient: monmap: 2024-09-22T08:37:17.180 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:37:17.180 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:37:17.181 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:37:17.181 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:37:17.181 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:37:17.181 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:17.181 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:37:17.181 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:37:17.181 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:37:17.181 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:17.181 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31f2e50) adding auth protocol: cephx 2024-09-22T08:37:17.181 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31f2e50) adding auth protocol: cephx 2024-09-22T08:37:17.181 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31f2e50) adding auth protocol: cephx 2024-09-22T08:37:17.181 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31f2e50) adding con mode: secure 2024-09-22T08:37:17.181 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31f2e50) adding con mode: crc 2024-09-22T08:37:17.181 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31f2e50) adding con mode: secure 2024-09-22T08:37:17.182 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31f2e50) adding con mode: crc 2024-09-22T08:37:17.182 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31f2e50) adding con mode: secure 2024-09-22T08:37:17.182 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31f2e50) adding con mode: crc 2024-09-22T08:37:17.182 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31f2e50) adding con mode: crc 2024-09-22T08:37:17.182 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31f2e50) adding con mode: secure 2024-09-22T08:37:17.182 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31f2e50) adding con mode: crc 2024-09-22T08:37:17.182 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31f2e50) adding con mode: secure 2024-09-22T08:37:17.182 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31f2e50) adding con mode: crc 2024-09-22T08:37:17.182 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31f2e50) adding con mode: secure 2024-09-22T08:37:17.182 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:17.182 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 1 librados: starting msgr at 2024-09-22T08:37:17.182 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-22T08:37:16.810+0000 7f14a6c2f800 1 librados: starting objecter 2024-09-22T08:37:17.182 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 5 asok(0x5571e2f0a0f0) register_command objecter_requests cmddesc objecter_requests hook 0x5571e31d0190 EEXIST 2024-09-22T08:37:17.182 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 1 librados: setting wanted keys 2024-09-22T08:37:17.183 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 1 librados: calling monclient init 2024-09-22T08:37:17.183 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 10 monclient: init 2024-09-22T08:37:17.183 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31c4c80) adding auth protocol: cephx 2024-09-22T08:37:17.183 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31c4c80) adding auth protocol: cephx 2024-09-22T08:37:17.183 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31c4c80) adding auth protocol: cephx 2024-09-22T08:37:17.183 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31c4c80) adding con mode: secure 2024-09-22T08:37:17.183 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31c4c80) adding con mode: crc 2024-09-22T08:37:17.183 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31c4c80) adding con mode: secure 2024-09-22T08:37:17.183 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31c4c80) adding con mode: crc 2024-09-22T08:37:17.184 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31c4c80) adding con mode: secure 2024-09-22T08:37:17.184 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31c4c80) adding con mode: crc 2024-09-22T08:37:17.184 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31c4c80) adding con mode: crc 2024-09-22T08:37:17.184 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31c4c80) adding con mode: secure 2024-09-22T08:37:17.184 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31c4c80) adding con mode: crc 2024-09-22T08:37:17.184 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31c4c80) adding con mode: secure 2024-09-22T08:37:17.184 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31c4c80) adding con mode: crc 2024-09-22T08:37:17.184 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 5 AuthRegistry(0x5571e31c4c80) adding con mode: secure 2024-09-22T08:37:17.184 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:17.184 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:17.184 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 5 asok(0x5571e2f0a0f0) register_command rotate-key cmddesc rotate-key hook 0x5571e31c4dc8 EEXIST 2024-09-22T08:37:17.184 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 10 monclient: _reopen_session rank -1 2024-09-22T08:37:17.184 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-22T08:37:17.184 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 10 monclient(hunting): picked mon.noname-b con 0x5571e31d21d0 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:37:17.185 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 10 monclient(hunting): picked mon.noname-c con 0x5571e31fcb20 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:37:17.185 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 10 monclient(hunting): picked mon.noname-a con 0x5571e3201280 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:37:17.185 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:17.185 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:17.185 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:17.185 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 10 monclient(hunting): _renew_subs 2024-09-22T08:37:17.185 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-22T08:37:16.811+0000 7f14a6c2f800 10 monclient(hunting): authenticate will time out at 2142.050707s 2024-09-22T08:37:17.185 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-22T08:37:16.811+0000 7f14a4719640 10 monclient(hunting): get_auth_request con 0x5571e3201280 auth_method 0 2024-09-22T08:37:17.185 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-22T08:37:16.811+0000 7f14a4719640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:17.185 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-22T08:37:16.811+0000 7f14a4719640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:17.185 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-22T08:37:16.811+0000 7f14a4719640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:17.185 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-22T08:37:16.811+0000 7f14a4f1a640 10 monclient(hunting): get_auth_request con 0x5571e31fcb20 auth_method 0 2024-09-22T08:37:17.185 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-22T08:37:16.811+0000 7f14a4f1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:17.185 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-22T08:37:16.811+0000 7f14a4f1a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:17.186 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-22T08:37:16.811+0000 7f14a4f1a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:17.186 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-22T08:37:16.811+0000 7f14a4719640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:37:17.186 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-22T08:37:16.811+0000 7f14a4719640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:37:17.186 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-22T08:37:16.811+0000 7f14a4719640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:37:17.186 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-22T08:37:16.811+0000 7f14a4f1a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:37:17.186 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-22T08:37:16.811+0000 7f14a4f1a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:37:17.186 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-22T08:37:16.811+0000 7f14a4f1a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:37:17.186 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-22T08:37:16.812+0000 7f14a3f18640 10 monclient(hunting): get_auth_request con 0x5571e31d21d0 auth_method 0 2024-09-22T08:37:17.186 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-22T08:37:16.812+0000 7f14a3f18640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:17.186 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-22T08:37:16.812+0000 7f14a3f18640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:17.186 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-22T08:37:16.812+0000 7f14a3f18640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:17.186 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-22T08:37:16.812+0000 7f14a4719640 10 monclient(hunting): handle_auth_done global_id 7896 payload 824 2024-09-22T08:37:17.186 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-22T08:37:16.812+0000 7f14a4719640 10 monclient: _finish_hunting 0 2024-09-22T08:37:17.187 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-22T08:37:16.812+0000 7f14a4719640 1 monclient: found mon.noname-a 2024-09-22T08:37:17.187 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-22T08:37:16.812+0000 7f14a4719640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:37:17.187 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-22T08:37:16.812+0000 7f1379ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:37:17.187 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-22T08:37:16.812+0000 7f1379ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:37:17.187 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-22T08:37:16.812+0000 7f1379ffb640 10 monclient: dump: 2024-09-22T08:37:17.187 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:37:17.187 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:37:17.187 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:17.187 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:17.187 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:37:17.187 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:17.187 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:37:17.187 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:37:17.188 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:37:17.188 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:17.188 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-22T08:37:16.812+0000 7f1379ffb640 10 monclient: _finish_auth 0 2024-09-22T08:37:17.188 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-22T08:37:16.812+0000 7f1379ffb640 10 monclient: _check_auth_tickets 2024-09-22T08:37:17.188 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-22T08:37:16.812+0000 7f1379ffb640 10 monclient: handle_config config(0 keys) 2024-09-22T08:37:17.188 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-22T08:37:16.812+0000 7f1379ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:37:17.188 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-22T08:37:16.812+0000 7f1379ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:37:17.188 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-22T08:37:16.812+0000 7f1379ffb640 10 monclient: dump: 2024-09-22T08:37:17.188 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:37:17.188 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:37:17.188 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:17.188 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:17.188 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:37:17.188 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:17.189 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:37:17.189 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:37:17.189 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:37:17.189 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:17.189 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-22T08:37:16.812+0000 7f14a6c2f800 5 monclient: authenticate success, global_id 7896 2024-09-22T08:37:17.189 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-22T08:37:16.812+0000 7f137b7fe640 4 set_mon_vals no callback set 2024-09-22T08:37:17.189 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-22T08:37:16.812+0000 7f14a6c2f800 10 monclient: _renew_subs 2024-09-22T08:37:17.189 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-22T08:37:16.812+0000 7f14a6c2f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:37:17.189 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-22T08:37:16.812+0000 7f14a6c2f800 10 monclient: _renew_subs 2024-09-22T08:37:17.189 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-22T08:37:16.812+0000 7f14a6c2f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:37:17.189 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-22T08:37:16.812+0000 7f14a6c2f800 1 librados: init done 2024-09-22T08:37:17.189 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-22T08:37:16.812+0000 7f14a6c2f800 5 asok(0x5571e2f0a0f0) register_command cr dump hook 0x7f148c07c228 2024-09-22T08:37:17.189 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-22T08:37:16.813+0000 7f14a6c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.189 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-22T08:37:16.814+0000 7f1379ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:37:17.190 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-22T08:37:16.814+0000 7f1379ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:37:17.190 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-22T08:37:16.814+0000 7f1379ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:37:17.190 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-22T08:37:16.815+0000 7f14a3f18640 10 monclient: get_auth_request con 0x7f136c077570 auth_method 0 2024-09-22T08:37:17.190 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-22T08:37:16.815+0000 7f14a4f1a640 10 monclient: get_auth_request con 0x5571e321b2e0 auth_method 0 2024-09-22T08:37:17.190 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-22T08:37:16.815+0000 7f14a6c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:17.190 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-22T08:37:16.815+0000 7f14a6c2f800 20 realm 2024-09-22T08:37:17.190 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-22T08:37:16.815+0000 7f14a6c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.190 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-22T08:37:16.816+0000 7f14a6c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:17.190 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-22T08:37:16.816+0000 7f14a6c2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:17.190 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-22T08:37:16.816+0000 7f14a6c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.190 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-22T08:37:16.816+0000 7f14a6c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:17.190 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-22T08:37:16.816+0000 7f14a6c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.190 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-22T08:37:16.816+0000 7f14a3f18640 10 monclient: get_auth_request con 0x5571e321f460 auth_method 0 2024-09-22T08:37:17.190 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-22T08:37:16.817+0000 7f14a6c2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:17.190 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-22T08:37:16.817+0000 7f14a6c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.191 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-22T08:37:16.817+0000 7f14a4f1a640 10 monclient: get_auth_request con 0x5571e3222ca0 auth_method 0 2024-09-22T08:37:17.191 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-22T08:37:16.817+0000 7f14a6c2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:37:17.191 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-22T08:37:16.817+0000 7f14a6c2f800 20 searching for the correct realm 2024-09-22T08:37:17.191 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-22T08:37:16.818+0000 7f14a4719640 10 monclient: get_auth_request con 0x5571e32279c0 auth_method 0 2024-09-22T08:37:17.191 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-22T08:37:16.819+0000 7f14a3f18640 10 monclient: get_auth_request con 0x7f148c0910c0 auth_method 0 2024-09-22T08:37:17.191 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-22T08:37:16.820+0000 7f14a3f18640 0 -- 172.21.15.38:0/192092855 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f148c0910c0 msgr2=0x7f148c089080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:17.191 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-22T08:37:16.820+0000 7f1379ffb640 1 client.7896.objecter ms_handle_reset 0x7f148c0910c0 session 0x7f148c005040 osd.0 2024-09-22T08:37:17.191 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-22T08:37:16.820+0000 7f1379ffb640 10 monclient: _renew_subs 2024-09-22T08:37:17.191 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-22T08:37:16.820+0000 7f1379ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:37:17.191 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-22T08:37:16.820+0000 7f14a3f18640 10 monclient: get_auth_request con 0x7f136c087090 auth_method 0 2024-09-22T08:37:17.191 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-22T08:37:16.820+0000 7f14a4f1a640 10 monclient: get_auth_request con 0x7f149403a020 auth_method 0 2024-09-22T08:37:17.191 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-22T08:37:16.822+0000 7f14a4719640 10 monclient: get_auth_request con 0x7f148c05ab20 auth_method 0 2024-09-22T08:37:17.191 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-22T08:37:16.823+0000 7f14a3f18640 10 monclient: get_auth_request con 0x7f149406a9c0 auth_method 0 2024-09-22T08:37:17.191 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-22T08:37:16.823+0000 7f14a3f18640 0 -- 172.21.15.38:0/192092855 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f149406a9c0 msgr2=0x7f1494073040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:37:17.192 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-22T08:37:17.024+0000 7f14a3f18640 10 monclient: get_auth_request con 0x7f149406a9c0 auth_method 0 2024-09-22T08:37:17.192 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-22T08:37:17.029+0000 7f1379ffb640 1 client.7896.objecter ms_handle_reset 0x7f149406a9c0 session 0x7f149406a760 osd.3 2024-09-22T08:37:17.192 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-22T08:37:17.029+0000 7f14a3f18640 10 monclient: get_auth_request con 0x7f148c0910c0 auth_method 0 2024-09-22T08:37:17.192 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-22T08:37:17.030+0000 7f14a6c2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:17.192 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-22T08:37:17.030+0000 7f14a6c2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:17.192 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-22T08:37:17.030+0000 7f14a6c2f800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:37:17.192 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-22T08:37:17.030+0000 7f14a6c2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:17.192 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-22T08:37:17.030+0000 7f14a6c2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:17.192 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-22T08:37:17.030+0000 7f14a6c2f800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:37:17.192 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-22T08:37:17.030+0000 7f14a6c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.192 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-22T08:37:17.031+0000 7f14a6c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:17.192 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-22T08:37:17.031+0000 7f14a6c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.192 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-22T08:37:17.031+0000 7f14a6c2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:17.192 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-22T08:37:17.031+0000 7f14a6c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.193 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-22T08:37:17.031+0000 7f14a6c2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:37:17.193 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-22T08:37:17.031+0000 7f14a6c2f800 20 zone default found 2024-09-22T08:37:17.193 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-22T08:37:17.031+0000 7f14a6c2f800 4 Realm: () 2024-09-22T08:37:17.193 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-22T08:37:17.031+0000 7f14a6c2f800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:37:17.193 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-22T08:37:17.031+0000 7f14a6c2f800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:37:17.193 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-22T08:37:17.031+0000 7f14a6c2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:17.193 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-22T08:37:17.031+0000 7f14a6c2f800 20 zonegroup default 2024-09-22T08:37:17.193 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-22T08:37:17.031+0000 7f14a6c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.193 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-22T08:37:17.032+0000 7f14a6c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:17.193 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-22T08:37:17.032+0000 7f14a6c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.193 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-22T08:37:17.032+0000 7f14a6c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:17.194 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-22T08:37:17.032+0000 7f14a6c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.194 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-22T08:37:17.032+0000 7f14a6c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:17.194 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-22T08:37:17.032+0000 7f14a6c2f800 20 started sync module instance, tier type = 2024-09-22T08:37:17.194 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-22T08:37:17.032+0000 7f14a6c2f800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:37:17.194 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-22T08:37:17.042+0000 7f14a6c2f800 20 add_watcher() i=0 2024-09-22T08:37:17.194 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-22T08:37:17.042+0000 7f14a6c2f800 20 add_watcher() i=1 2024-09-22T08:37:17.194 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-22T08:37:17.042+0000 7f14a6c2f800 20 add_watcher() i=2 2024-09-22T08:37:17.194 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-22T08:37:17.042+0000 7f14a6c2f800 20 add_watcher() i=3 2024-09-22T08:37:17.194 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-22T08:37:17.042+0000 7f14a6c2f800 20 add_watcher() i=4 2024-09-22T08:37:17.194 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-22T08:37:17.042+0000 7f14a6c2f800 20 add_watcher() i=5 2024-09-22T08:37:17.194 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-22T08:37:17.042+0000 7f14a6c2f800 20 add_watcher() i=6 2024-09-22T08:37:17.194 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-22T08:37:17.043+0000 7f14a6c2f800 20 add_watcher() i=7 2024-09-22T08:37:17.194 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-22T08:37:17.043+0000 7f14a6c2f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:17.195 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-22T08:37:17.045+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc419486e0) adding auth protocol: cephx 2024-09-22T08:37:17.195 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-22T08:37:17.045+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc419486e0) adding auth protocol: cephx 2024-09-22T08:37:17.195 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-22T08:37:17.045+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc419486e0) adding auth protocol: cephx 2024-09-22T08:37:17.195 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-22T08:37:17.045+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc419486e0) adding con mode: secure 2024-09-22T08:37:17.195 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-22T08:37:17.045+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc419486e0) adding con mode: crc 2024-09-22T08:37:17.195 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-22T08:37:17.045+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc419486e0) adding con mode: secure 2024-09-22T08:37:17.195 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-22T08:37:17.045+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc419486e0) adding con mode: crc 2024-09-22T08:37:17.195 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-22T08:37:17.045+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc419486e0) adding con mode: secure 2024-09-22T08:37:17.195 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-22T08:37:17.045+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc419486e0) adding con mode: crc 2024-09-22T08:37:17.195 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-22T08:37:17.045+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc419486e0) adding con mode: crc 2024-09-22T08:37:17.195 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-22T08:37:17.045+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc419486e0) adding con mode: secure 2024-09-22T08:37:17.195 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-22T08:37:17.045+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc419486e0) adding con mode: crc 2024-09-22T08:37:17.195 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-22T08:37:17.045+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc419486e0) adding con mode: secure 2024-09-22T08:37:17.195 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-22T08:37:17.045+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc419486e0) adding con mode: crc 2024-09-22T08:37:17.196 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-22T08:37:17.045+0000 7f14a6c2f800 5 AuthRegistry(0x7ffc419486e0) adding con mode: secure 2024-09-22T08:37:17.196 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-22T08:37:17.045+0000 7f135afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:17.196 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-22T08:37:17.046+0000 7f14a6c2f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:17.196 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-22T08:37:17.046+0000 7f14a6c2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:17.196 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-22T08:37:17.046+0000 7f14a6c2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:17.196 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-22T08:37:17.046+0000 7f14a6c2f800 5 asok(0x5571e2f0a0f0) register_command cache list hook 0x5571e31f7800 2024-09-22T08:37:17.196 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-22T08:37:17.046+0000 7f14a6c2f800 5 asok(0x5571e2f0a0f0) register_command cache inspect hook 0x5571e31f7800 2024-09-22T08:37:17.196 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-22T08:37:17.046+0000 7f14a6c2f800 5 asok(0x5571e2f0a0f0) register_command cache erase hook 0x5571e31f7800 2024-09-22T08:37:17.196 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-22T08:37:17.046+0000 7f14a6c2f800 5 asok(0x5571e2f0a0f0) register_command cache zap hook 0x5571e31f7800 2024-09-22T08:37:17.196 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-22T08:37:17.046+0000 7f14a6c2f800 5 note: GC not initialized 2024-09-22T08:37:17.196 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-22T08:37:17.046+0000 7f1359fdb640 20 reqs_thread_entry: start 2024-09-22T08:37:17.196 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-22T08:37:17.046+0000 7f14a6c2f800 5 asok(0x5571e2f0a0f0) register_command sync trace show hook 0x7f148c081020 2024-09-22T08:37:17.196 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-22T08:37:17.046+0000 7f14a6c2f800 5 asok(0x5571e2f0a0f0) register_command sync trace history hook 0x7f148c081020 2024-09-22T08:37:17.196 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-22T08:37:17.046+0000 7f14a6c2f800 5 asok(0x5571e2f0a0f0) register_command sync trace active hook 0x7f148c081020 2024-09-22T08:37:17.197 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-22T08:37:17.046+0000 7f14a6c2f800 5 asok(0x5571e2f0a0f0) register_command sync trace active_short hook 0x7f148c081020 2024-09-22T08:37:17.197 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-22T08:37:17.046+0000 7f14a6c2f800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:17.197 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-22T08:37:17.046+0000 7f14a6c2f800 20 Filter name: none 2024-09-22T08:37:17.197 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-22T08:37:17.046+0000 7f12cb7fe640 20 reqs_thread_entry: start 2024-09-22T08:37:17.197 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-22T08:37:17.046+0000 7f14a6c2f800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-22T08:37:17.197 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-22T08:37:17.046+0000 7f14a6c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.197 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-22T08:37:17.047+0000 7f14a6c2f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:37:17.197 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-22T08:37:17.047+0000 7f14a6c2f800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-22T08:37:17.197 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-22T08:37:17.047+0000 7f14a6c2f800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-22T08:37:17.197 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-22T08:37:17.047+0000 7f14a6c2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 : miss 2024-09-22T08:37:17.197 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-22T08:37:17.047+0000 7f14a6c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.197 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-22T08:37:17.047+0000 7f14a6c2f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:37:17.197 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-22T08:37:17.047+0000 7f14a6c2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 info.flags=0x17 2024-09-22T08:37:17.197 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-22T08:37:17.047+0000 7f14a6c2f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 to cache LRU end 2024-09-22T08:37:17.198 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-22T08:37:17.047+0000 7f14a6c2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:37:17.198 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-22T08:37:17.047+0000 7f14a6c2f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:17.198 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-22T08:37:17.047+0000 7f14a6c2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 2024-09-22T08:37:17.198 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-22T08:37:17.053+0000 7f14a6c2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 info.flags=0x17 2024-09-22T08:37:17.198 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-22T08:37:17.053+0000 7f14a6c2f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 to cache LRU end 2024-09-22T08:37:17.198 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-22T08:37:17.053+0000 7f14a6c2f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:17.198 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-22T08:37:17.053+0000 7f14a6c2f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39, ofs0, ns] 2024-09-22T08:37:17.198 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-22T08:37:17.053+0000 7f137b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497120 cookie 93947630377024 notifier 7896 bl.length()=931 2024-09-22T08:37:17.198 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-22T08:37:17.053+0000 7f137b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 info.flags=0x17 2024-09-22T08:37:17.198 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-22T08:37:17.053+0000 7f137b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 to cache LRU end 2024-09-22T08:37:17.198 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-22T08:37:17.053+0000 7f137b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:17.198 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-22T08:37:17.054+0000 7f14a6c2f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.39]): orig_sources= new_sources= 2024-09-22T08:37:17.198 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-22T08:37:17.054+0000 7f14a6c2f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.39]): potential sources added=[] removed=[] 2024-09-22T08:37:17.198 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-22T08:37:17.054+0000 7f14a6c2f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.39]): orig_dests= new_dests= 2024-09-22T08:37:17.199 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-22T08:37:17.054+0000 7f14a6c2f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.39]): potential dests added=[] removed=[] 2024-09-22T08:37:17.199 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-22T08:37:17.058+0000 7f14a6c2f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.0 2024-09-22T08:37:17.199 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-22T08:37:17.058+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.0 2024-09-22T08:37:17.199 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-22T08:37:17.058+0000 7f14a6c2f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.1 2024-09-22T08:37:17.199 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-22T08:37:17.058+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.1 2024-09-22T08:37:17.199 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-22T08:37:17.058+0000 7f14a6c2f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.2 2024-09-22T08:37:17.199 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-22T08:37:17.058+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.2 2024-09-22T08:37:17.199 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-22T08:37:17.058+0000 7f14a6c2f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.3 2024-09-22T08:37:17.199 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-22T08:37:17.058+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.3 2024-09-22T08:37:17.199 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-22T08:37:17.058+0000 7f14a6c2f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.4 2024-09-22T08:37:17.199 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-22T08:37:17.058+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.4 2024-09-22T08:37:17.199 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-22T08:37:17.058+0000 7f14a6c2f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.5 2024-09-22T08:37:17.199 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-22T08:37:17.058+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.5 2024-09-22T08:37:17.200 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-22T08:37:17.058+0000 7f14a6c2f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.6 2024-09-22T08:37:17.200 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-22T08:37:17.058+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.6 2024-09-22T08:37:17.200 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-22T08:37:17.058+0000 7f14a6c2f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.7 2024-09-22T08:37:17.200 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-22T08:37:17.058+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.7 2024-09-22T08:37:17.200 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-22T08:37:17.058+0000 7f14a6c2f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.8 2024-09-22T08:37:17.200 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-22T08:37:17.058+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.8 2024-09-22T08:37:17.200 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-22T08:37:17.059+0000 7f14a6c2f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.9 2024-09-22T08:37:17.200 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-22T08:37:17.059+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.9 2024-09-22T08:37:17.200 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-22T08:37:17.059+0000 7f14a6c2f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.10 2024-09-22T08:37:17.200 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-22T08:37:17.059+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.10 2024-09-22T08:37:17.200 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-22T08:37:17.059+0000 7f14a6c2f800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.11 2024-09-22T08:37:17.200 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-22T08:37:17.059+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1.11 2024-09-22T08:37:17.200 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-22T08:37:17.059+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.0 2024-09-22T08:37:17.200 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-22T08:37:17.059+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1 2024-09-22T08:37:17.201 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-22T08:37:17.059+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.2 2024-09-22T08:37:17.201 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-22T08:37:17.060+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.3 2024-09-22T08:37:17.201 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-22T08:37:17.060+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.4 2024-09-22T08:37:17.201 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-22T08:37:17.061+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.5 2024-09-22T08:37:17.201 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-22T08:37:17.061+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.6 2024-09-22T08:37:17.201 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-22T08:37:17.062+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.7 2024-09-22T08:37:17.201 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-22T08:37:17.063+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.8 2024-09-22T08:37:17.201 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-22T08:37:17.063+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.9 2024-09-22T08:37:17.201 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-22T08:37:17.064+0000 7f14a6c2f800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.10 2024-09-22T08:37:17.201 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-22T08:37:17.068+0000 7f14a6c2f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f14a6c2f800 time 2024-09-22T08:37:17.068176+0000 2024-09-22T08:37:17.201 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:37:17.201 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:17.201 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:37:17.202 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f14aa18c748] 2024-09-22T08:37:17.202 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f14aa18c906] 2024-09-22T08:37:17.202 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5571e1efee01] 2024-09-22T08:37:17.202 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5571e1f0de9b] 2024-09-22T08:37:17.202 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5571e1f0ed64] 2024-09-22T08:37:17.202 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-22T08:37:17.202 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f14a8e29590] 2024-09-22T08:37:17.202 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-22T08:37:17.202 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-22T08:37:17.202 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:17.202 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-22T08:37:17.068+0000 7f14a6c2f800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:37:17.202 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f14a6c2f800 thread_name:radosgw-admin 2024-09-22T08:37:17.202 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:17.202 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:37:17.203 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f14a8e3e6f0] 2024-09-22T08:37:17.203 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f14a8e8b99c] 2024-09-22T08:37:17.203 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:37:17.203 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:37:17.203 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f14aa18c7a2] 2024-09-22T08:37:17.203 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f14aa18c906] 2024-09-22T08:37:17.203 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5571e1efee01] 2024-09-22T08:37:17.203 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5571e1f0de9b] 2024-09-22T08:37:17.203 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5571e1f0ed64] 2024-09-22T08:37:17.203 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-22T08:37:17.203 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f14a8e29590] 2024-09-22T08:37:17.203 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-22T08:37:17.203 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-22T08:37:17.204 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:37:17.204 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:17.204 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-22T08:37:17.204 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-22T08:37:17.204 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-22T08:37:17.204 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-22T08:37:17.204 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-22T08:37:17.204 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-22T08:37:17.204 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-22T08:37:17.205 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-22T08:37:17.205 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-22T08:37:17.205 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-22T08:37:17.205 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-22T08:37:17.205 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-22T08:37:17.205 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-22T08:37:17.205 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-22T08:37:17.205 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-22T08:37:17.205 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-22T08:37:17.205 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-22T08:37:17.205 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-22T08:37:17.205 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-22T08:37:17.205 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-22T08:37:17.205 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-22T08:37:17.205 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-22T08:37:17.206 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-22T08:37:17.206 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-22T08:37:17.206 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:37:17.206 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-22T08:37:17.206 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-22T08:37:17.206 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-22T08:37:17.206 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-22T08:37:17.206 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-22T08:37:17.206 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-22T08:37:17.206 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-22T08:37:17.206 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-22T08:37:17.206 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-22T08:37:17.206 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-22T08:37:17.206 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-22T08:37:17.206 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-22T08:37:17.207 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-22T08:37:17.207 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-22T08:37:17.207 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-22T08:37:17.207 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-22T08:37:17.207 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-22T08:37:17.207 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-22T08:37:17.207 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-22T08:37:17.207 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-22T08:37:17.207 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-22T08:37:17.207 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:37:17.207 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-22T08:37:17.207 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:37:17.207 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-22T08:37:17.207 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-22T08:37:17.207 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-22T08:37:17.207 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-22T08:37:17.208 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-22T08:37:17.208 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-22T08:37:17.208 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-22T08:37:17.208 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-22T08:37:17.208 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-22T08:37:17.208 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-22T08:37:17.208 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-22T08:37:17.208 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-22T08:37:17.208 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-22T08:37:17.208 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-22T08:37:17.208 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-22T08:37:17.208 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-22T08:37:17.208 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-22T08:37:17.208 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-22T08:37:17.208 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:37:17.208 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-22T08:37:17.209 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:37:17.209 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-22T08:37:17.209 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-22T08:37:17.209 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-22T08:37:17.209 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-22T08:37:17.209 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-22T08:37:17.209 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-22T08:37:17.209 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:37:17.209 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-22T08:37:17.209 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-22T08:37:17.209 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:37:17.209 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-22T08:37:17.209 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-22T08:37:17.209 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-22T08:37:17.209 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-22T08:37:17.210 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-22T08:37:17.210 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-22T08:37:17.210 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-22T08:37:17.210 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-22T08:37:17.210 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-22T08:37:17.210 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-22T08:37:17.210 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-22T08:37:17.210 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-22T08:37:17.210 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-22T08:37:17.210 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:37:17.210 INFO:tasks.workunit.client.0.smithi038.stderr: 7f12cb7fe640 / http_manager 2024-09-22T08:37:17.210 INFO:tasks.workunit.client.0.smithi038.stderr: 7f1359fdb640 / http_manager 2024-09-22T08:37:17.210 INFO:tasks.workunit.client.0.smithi038.stderr: 7f135afdd640 / rgw_dt_lg_renew 2024-09-22T08:37:17.210 INFO:tasks.workunit.client.0.smithi038.stderr: 7f1379ffb640 / ms_dispatch 2024-09-22T08:37:17.210 INFO:tasks.workunit.client.0.smithi038.stderr: 7f137b7fe640 / io_context_pool 2024-09-22T08:37:17.211 INFO:tasks.workunit.client.0.smithi038.stderr: 7f1389ffb640 / ms_dispatch 2024-09-22T08:37:17.211 INFO:tasks.workunit.client.0.smithi038.stderr: 7f1390e09640 / ms_dispatch 2024-09-22T08:37:17.211 INFO:tasks.workunit.client.0.smithi038.stderr: 7f139260c640 / io_context_pool 2024-09-22T08:37:17.211 INFO:tasks.workunit.client.0.smithi038.stderr: 7f14a3f18640 / msgr-worker-2 2024-09-22T08:37:17.211 INFO:tasks.workunit.client.0.smithi038.stderr: 7f14a4719640 / msgr-worker-1 2024-09-22T08:37:17.211 INFO:tasks.workunit.client.0.smithi038.stderr: 7f14a4f1a640 / msgr-worker-0 2024-09-22T08:37:17.211 INFO:tasks.workunit.client.0.smithi038.stderr: 7f14a571b640 / io_context_pool 2024-09-22T08:37:17.211 INFO:tasks.workunit.client.0.smithi038.stderr: 7f14a6c2f800 / radosgw-admin 2024-09-22T08:37:17.211 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-22T08:37:17.211 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-22T08:37:17.211 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/lib/ceph/crash/2024-09-22T08:37:17.069802Z_80139db0-f2aa-41b9-a943-6bdb897a7893/log 2024-09-22T08:37:17.211 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-22T08:37:17.211 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-22T08:37:17.213 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:17.213 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:17.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.147+0000 7f0080528800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.149+0000 7f0080528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:17.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.149+0000 7f0080528800 20 realm 2024-09-22T08:37:17.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.149+0000 7f0080528800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.149+0000 7f0080528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:17.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.149+0000 7f0080528800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:17.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.149+0000 7f0080528800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.150+0000 7f0080528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:17.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.150+0000 7f0080528800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.150+0000 7f0080528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:17.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.150+0000 7f0080528800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.151+0000 7f0080528800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:37:17.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.151+0000 7f0080528800 20 searching for the correct realm 2024-09-22T08:37:17.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.153+0000 7f0073ad5640 0 -- 172.21.15.38:0/1649865078 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f006409f1d0 msgr2=0x7f00640606b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:17.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.157+0000 7f0073ad5640 0 -- 172.21.15.38:0/1649865078 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f006c042490 msgr2=0x7f006c051400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:17.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.364+0000 7f0080528800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:17.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.364+0000 7f0080528800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:17.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.364+0000 7f0080528800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:37:17.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.364+0000 7f0080528800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:17.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.364+0000 7f0080528800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:17.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.364+0000 7f0080528800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:37:17.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.364+0000 7f0080528800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.365+0000 7f0080528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:17.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.365+0000 7f0080528800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.365+0000 7f0080528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:17.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.365+0000 7f0080528800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.366+0000 7f0080528800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:37:17.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.366+0000 7f0080528800 20 zone default found 2024-09-22T08:37:17.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.366+0000 7f0080528800 4 Realm: () 2024-09-22T08:37:17.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.366+0000 7f0080528800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:37:17.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.366+0000 7f0080528800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:37:17.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.366+0000 7f0080528800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:17.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.366+0000 7f0080528800 20 zonegroup default 2024-09-22T08:37:17.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.366+0000 7f0080528800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.366+0000 7f0080528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:17.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.366+0000 7f0080528800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.367+0000 7f0080528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:17.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.367+0000 7f0080528800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.367+0000 7f0080528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:17.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.367+0000 7f0080528800 20 started sync module instance, tier type = 2024-09-22T08:37:17.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.367+0000 7f0080528800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:37:17.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.376+0000 7f0080528800 20 add_watcher() i=0 2024-09-22T08:37:17.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.376+0000 7f0080528800 20 add_watcher() i=1 2024-09-22T08:37:17.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.376+0000 7f0080528800 20 add_watcher() i=2 2024-09-22T08:37:17.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.376+0000 7f0080528800 20 add_watcher() i=3 2024-09-22T08:37:17.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.376+0000 7f0080528800 20 add_watcher() i=4 2024-09-22T08:37:17.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.376+0000 7f0080528800 20 add_watcher() i=5 2024-09-22T08:37:17.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.376+0000 7f0080528800 20 add_watcher() i=6 2024-09-22T08:37:17.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.377+0000 7f0080528800 20 add_watcher() i=7 2024-09-22T08:37:17.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.377+0000 7f0080528800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:17.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.379+0000 7eff32fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:17.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.379+0000 7f0080528800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:17.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.379+0000 7f0080528800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:17.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.379+0000 7f0080528800 5 note: GC not initialized 2024-09-22T08:37:17.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.380+0000 7eff31fdb640 20 reqs_thread_entry: start 2024-09-22T08:37:17.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.380+0000 7f0080528800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:17.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.380+0000 7f0080528800 20 Filter name: none 2024-09-22T08:37:17.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.380+0000 7efea37fe640 20 reqs_thread_entry: start 2024-09-22T08:37:17.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.380+0000 7f0080528800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.380+0000 7f0080528800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:37:17.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.380+0000 7f0080528800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.381+0000 7f0080528800 20 rados_obj.operate() r=0 bl.length=451 2024-09-22T08:37:17.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.381+0000 7f0080528800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:37:17.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.381+0000 7f0080528800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.381+0000 7f0080528800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:37:17.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.382+0000 7f0080528800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.382+0000 7f0080528800 20 rados_obj.operate() r=0 bl.length=451 2024-09-22T08:37:17.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.382+0000 7f0080528800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:37:17.385 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.383+0000 7eff32fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:17.387 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.386+0000 7f0080528800 20 remove_watcher() i=0 2024-09-22T08:37:17.387 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.386+0000 7f0080528800 2 removed watcher, disabling cache 2024-09-22T08:37:17.388 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.387+0000 7f0080528800 20 remove_watcher() i=1 2024-09-22T08:37:17.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.388+0000 7f0080528800 20 remove_watcher() i=2 2024-09-22T08:37:17.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.389+0000 7f0080528800 20 remove_watcher() i=3 2024-09-22T08:37:17.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.390+0000 7f0080528800 20 remove_watcher() i=4 2024-09-22T08:37:17.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.391+0000 7f0080528800 20 remove_watcher() i=5 2024-09-22T08:37:17.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.392+0000 7f0080528800 20 remove_watcher() i=6 2024-09-22T08:37:17.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.393+0000 7f0080528800 20 remove_watcher() i=7 2024-09-22T08:37:17.405 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:17.405 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:37:17.405 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-change-reshard-state id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:37:17.405 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:17.407 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:17.407 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:17.413 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:17.413 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:17.457 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:37:17.489 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:17.489 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:17.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.527+0000 7f122760e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.529+0000 7f122760e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:17.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.529+0000 7f122760e800 20 realm 2024-09-22T08:37:17.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.529+0000 7f122760e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.529+0000 7f122760e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:17.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.529+0000 7f122760e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:17.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.529+0000 7f122760e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.529+0000 7f122760e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:17.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.529+0000 7f122760e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.530+0000 7f122760e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:17.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.530+0000 7f122760e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.531+0000 7f122760e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:37:17.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.531+0000 7f122760e800 20 searching for the correct realm 2024-09-22T08:37:17.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.534+0000 7f122356c640 0 -- 172.21.15.38:0/3868813068 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7f1214018040 msgr2=0x7f121403d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:17.741 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.740+0000 7f1222d6b640 0 -- 172.21.15.38:0/3868813068 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x55b1a82f96e0 msgr2=0x55b1a82fbb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:17.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.744+0000 7f122760e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:17.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.744+0000 7f122760e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:17.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.744+0000 7f122760e800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:37:17.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.744+0000 7f122760e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:17.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.744+0000 7f122760e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:17.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.744+0000 7f122760e800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:37:17.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.744+0000 7f122760e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.744+0000 7f122760e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:17.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.744+0000 7f122760e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.745+0000 7f122760e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:17.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.745+0000 7f122760e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.745+0000 7f122760e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:37:17.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.745+0000 7f122760e800 20 zone default found 2024-09-22T08:37:17.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.745+0000 7f122760e800 4 Realm: () 2024-09-22T08:37:17.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.745+0000 7f122760e800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:37:17.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.745+0000 7f122760e800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:37:17.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.745+0000 7f122760e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:17.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.745+0000 7f122760e800 20 zonegroup default 2024-09-22T08:37:17.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.745+0000 7f122760e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.746+0000 7f122760e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:17.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.746+0000 7f122760e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.746+0000 7f122760e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:17.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.746+0000 7f122760e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.746+0000 7f122760e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:17.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.746+0000 7f122760e800 20 started sync module instance, tier type = 2024-09-22T08:37:17.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.746+0000 7f122760e800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:37:17.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.756+0000 7f122760e800 20 add_watcher() i=0 2024-09-22T08:37:17.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.756+0000 7f122760e800 20 add_watcher() i=1 2024-09-22T08:37:17.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.756+0000 7f122760e800 20 add_watcher() i=2 2024-09-22T08:37:17.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.756+0000 7f122760e800 20 add_watcher() i=3 2024-09-22T08:37:17.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.756+0000 7f122760e800 20 add_watcher() i=4 2024-09-22T08:37:17.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.756+0000 7f122760e800 20 add_watcher() i=5 2024-09-22T08:37:17.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.756+0000 7f122760e800 20 add_watcher() i=6 2024-09-22T08:37:17.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.758+0000 7f122760e800 20 add_watcher() i=7 2024-09-22T08:37:17.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.758+0000 7f122760e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:17.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.759+0000 7f10d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:17.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.760+0000 7f122760e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:17.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.760+0000 7f122760e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:17.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.760+0000 7f122760e800 5 note: GC not initialized 2024-09-22T08:37:17.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.760+0000 7f10d8fe1640 20 reqs_thread_entry: start 2024-09-22T08:37:17.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.760+0000 7f122760e800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:17.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.760+0000 7f122760e800 20 Filter name: none 2024-09-22T08:37:17.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.760+0000 7f10d1ffb640 20 reqs_thread_entry: start 2024-09-22T08:37:17.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.760+0000 7f122760e800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-22T08:37:17.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.760+0000 7f122760e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.761+0000 7f122760e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:37:17.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.761+0000 7f122760e800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-22T08:37:17.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.761+0000 7f122760e800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-22T08:37:17.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.761+0000 7f122760e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 : miss 2024-09-22T08:37:17.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.761+0000 7f122760e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:17.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.762+0000 7f122760e800 20 rados_obj.operate() r=0 bl.length=451 2024-09-22T08:37:17.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.762+0000 7f122760e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 info.flags=0x17 2024-09-22T08:37:17.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.762+0000 7f122760e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 to cache LRU end 2024-09-22T08:37:17.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.762+0000 7f122760e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:37:17.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.762+0000 7f122760e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:17.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.762+0000 7f122760e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 2024-09-22T08:37:17.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.763+0000 7f122760e800 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 to be held by another RGW process; skipping for now 2024-09-22T08:37:17.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.764+0000 7f10d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:17.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.766+0000 7f122760e800 20 remove_watcher() i=0 2024-09-22T08:37:17.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.766+0000 7f122760e800 2 removed watcher, disabling cache 2024-09-22T08:37:17.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.767+0000 7f122760e800 20 remove_watcher() i=1 2024-09-22T08:37:17.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.768+0000 7f122760e800 20 remove_watcher() i=2 2024-09-22T08:37:17.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.770+0000 7f122760e800 20 remove_watcher() i=3 2024-09-22T08:37:17.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.771+0000 7f122760e800 20 remove_watcher() i=4 2024-09-22T08:37:17.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.772+0000 7f122760e800 20 remove_watcher() i=5 2024-09-22T08:37:17.774 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.773+0000 7f122760e800 20 remove_watcher() i=6 2024-09-22T08:37:17.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:17.774+0000 7f122760e800 20 remove_watcher() i=7 2024-09-22T08:37:17.786 INFO:tasks.workunit.client.0.smithi038.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-22T08:37:47.806 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:37:47.843 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:47.843 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:47.889 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:47.888+0000 7f5a75d25800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:47.889+0000 7f5a75d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:47.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:47.889+0000 7f5a75d25800 20 realm 2024-09-22T08:37:47.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:47.889+0000 7f5a75d25800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:47.890+0000 7f5a75d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:47.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:47.890+0000 7f5a75d25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:47.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:47.890+0000 7f5a75d25800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.892 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:47.890+0000 7f5a75d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:47.892 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:47.890+0000 7f5a75d25800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.892 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:47.891+0000 7f5a75d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:47.892 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:47.891+0000 7f5a75d25800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:47.892+0000 7f5a75d25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:37:47.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:47.892+0000 7f5a75d25800 20 searching for the correct realm 2024-09-22T08:37:47.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:47.894+0000 7f5a711ad640 0 -- 172.21.15.38:0/3839830942 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f5a6806de30 msgr2=0x7f5a6806c8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:47.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:47.898+0000 7f5a711ad640 0 -- 172.21.15.38:0/3839830942 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f5a640a78b0 msgr2=0x7f5a640e5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:48.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.106+0000 7f5a75d25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:48.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.106+0000 7f5a75d25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:48.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.106+0000 7f5a75d25800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:37:48.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.106+0000 7f5a75d25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:48.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.106+0000 7f5a75d25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:48.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.106+0000 7f5a75d25800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:37:48.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.106+0000 7f5a75d25800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.106+0000 7f5a75d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:48.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.106+0000 7f5a75d25800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.106+0000 7f5a75d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:48.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.106+0000 7f5a75d25800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.107+0000 7f5a75d25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:37:48.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.107+0000 7f5a75d25800 20 zone default found 2024-09-22T08:37:48.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.107+0000 7f5a75d25800 4 Realm: () 2024-09-22T08:37:48.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.107+0000 7f5a75d25800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:37:48.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.107+0000 7f5a75d25800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:37:48.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.107+0000 7f5a75d25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:48.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.107+0000 7f5a75d25800 20 zonegroup default 2024-09-22T08:37:48.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.107+0000 7f5a75d25800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.107+0000 7f5a75d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:48.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.107+0000 7f5a75d25800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.108+0000 7f5a75d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:48.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.108+0000 7f5a75d25800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.108+0000 7f5a75d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:48.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.108+0000 7f5a75d25800 20 started sync module instance, tier type = 2024-09-22T08:37:48.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.108+0000 7f5a75d25800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:37:48.120 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.119+0000 7f5a75d25800 20 add_watcher() i=0 2024-09-22T08:37:48.120 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.119+0000 7f5a75d25800 20 add_watcher() i=1 2024-09-22T08:37:48.120 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.119+0000 7f5a75d25800 20 add_watcher() i=2 2024-09-22T08:37:48.121 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.119+0000 7f5a75d25800 20 add_watcher() i=3 2024-09-22T08:37:48.121 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.119+0000 7f5a75d25800 20 add_watcher() i=4 2024-09-22T08:37:48.121 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.119+0000 7f5a75d25800 20 add_watcher() i=5 2024-09-22T08:37:48.121 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.119+0000 7f5a75d25800 20 add_watcher() i=6 2024-09-22T08:37:48.121 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.120+0000 7f5a75d25800 20 add_watcher() i=7 2024-09-22T08:37:48.122 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.120+0000 7f5a75d25800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:48.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.123+0000 7f59237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:48.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.123+0000 7f5a75d25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:48.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.123+0000 7f5a75d25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:48.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.123+0000 7f5a75d25800 5 note: GC not initialized 2024-09-22T08:37:48.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.123+0000 7f59227fc640 20 reqs_thread_entry: start 2024-09-22T08:37:48.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.123+0000 7f5a75d25800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:48.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.123+0000 7f5a75d25800 20 Filter name: none 2024-09-22T08:37:48.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.124+0000 7f5893fff640 20 reqs_thread_entry: start 2024-09-22T08:37:48.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.124+0000 7f5a75d25800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-22T08:37:48.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.124+0000 7f5a75d25800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.126 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.124+0000 7f5a75d25800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:37:48.126 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.124+0000 7f5a75d25800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-22T08:37:48.126 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.124+0000 7f5a75d25800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-22T08:37:48.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.124+0000 7f5a75d25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 : miss 2024-09-22T08:37:48.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.124+0000 7f5a75d25800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.125+0000 7f5a75d25800 20 rados_obj.operate() r=0 bl.length=451 2024-09-22T08:37:48.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.125+0000 7f5a75d25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 info.flags=0x17 2024-09-22T08:37:48.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.125+0000 7f5a75d25800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 to cache LRU end 2024-09-22T08:37:48.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.125+0000 7f5a75d25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:37:48.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.125+0000 7f5a75d25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:48.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.125+0000 7f5a75d25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 2024-09-22T08:37:48.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.126+0000 7f5a75d25800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-22T08:37:48.135 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.134+0000 7f5a75d25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 info.flags=0x17 2024-09-22T08:37:48.135 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.134+0000 7f5a75d25800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 to cache LRU end 2024-09-22T08:37:48.135 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.134+0000 7f5a75d25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:48.135 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.134+0000 7f5a75d25800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39, ofs0, ns] 2024-09-22T08:37:48.136 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.134+0000 7f5954ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497121 cookie 94274274433888 notifier 7472 bl.length()=931 2024-09-22T08:37:48.136 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.134+0000 7f5954ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 info.flags=0x17 2024-09-22T08:37:48.136 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.134+0000 7f5954ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 to cache LRU end 2024-09-22T08:37:48.136 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.134+0000 7f5954ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:48.136 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.135+0000 7f5a75d25800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.39]): orig_sources= new_sources= 2024-09-22T08:37:48.136 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.135+0000 7f5a75d25800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.39]): potential sources added=[] removed=[] 2024-09-22T08:37:48.136 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.135+0000 7f5a75d25800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.39]): orig_dests= new_dests= 2024-09-22T08:37:48.136 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.135+0000 7f5a75d25800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.39]): potential dests added=[] removed=[] 2024-09-22T08:37:48.142 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.141+0000 7f5a75d25800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.2.0 2024-09-22T08:37:48.142 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.141+0000 7f5a75d25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.2.0 2024-09-22T08:37:48.142 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.141+0000 7f5a75d25800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.2.1 2024-09-22T08:37:48.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.141+0000 7f5a75d25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.2.1 2024-09-22T08:37:48.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.141+0000 7f5a75d25800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.2.2 2024-09-22T08:37:48.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.141+0000 7f5a75d25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.2.2 2024-09-22T08:37:48.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.141+0000 7f5a75d25800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.2.3 2024-09-22T08:37:48.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.141+0000 7f5a75d25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.2.3 2024-09-22T08:37:48.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.141+0000 7f5a75d25800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.2.4 2024-09-22T08:37:48.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.141+0000 7f5a75d25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.2.4 2024-09-22T08:37:48.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.141+0000 7f5a75d25800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.2.5 2024-09-22T08:37:48.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.141+0000 7f5a75d25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.2.5 2024-09-22T08:37:48.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.141+0000 7f5a75d25800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.2.6 2024-09-22T08:37:48.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.141+0000 7f5a75d25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.2.6 2024-09-22T08:37:48.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.141+0000 7f5a75d25800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.2.7 2024-09-22T08:37:48.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.141+0000 7f5a75d25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.2.7 2024-09-22T08:37:48.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.141+0000 7f5a75d25800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.2.8 2024-09-22T08:37:48.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.141+0000 7f5a75d25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.2.8 2024-09-22T08:37:48.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.141+0000 7f5a75d25800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.2.9 2024-09-22T08:37:48.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.141+0000 7f5a75d25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.2.9 2024-09-22T08:37:48.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.141+0000 7f5a75d25800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.2.10 2024-09-22T08:37:48.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.141+0000 7f5a75d25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.2.10 2024-09-22T08:37:48.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.141+0000 7f5a75d25800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.2.11 2024-09-22T08:37:48.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.141+0000 7f5a75d25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.2.11 2024-09-22T08:37:48.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.141+0000 7f5a75d25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.0 2024-09-22T08:37:48.145 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.141+0000 7f5a75d25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1 2024-09-22T08:37:48.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.142+0000 7f5a75d25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.2 2024-09-22T08:37:48.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.142+0000 7f5a75d25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.3 2024-09-22T08:37:48.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.143+0000 7f5a75d25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.4 2024-09-22T08:37:48.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.143+0000 7f5a75d25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.5 2024-09-22T08:37:48.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.144+0000 7f5a75d25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.6 2024-09-22T08:37:48.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.144+0000 7f5a75d25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.7 2024-09-22T08:37:48.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.145+0000 7f5a75d25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.8 2024-09-22T08:37:48.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.145+0000 7f5a75d25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.9 2024-09-22T08:37:48.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.146+0000 7f5a75d25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.10 2024-09-22T08:37:48.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.149+0000 7f5a75d25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 : hit (requested=0x17, cached=0x17) 2024-09-22T08:37:48.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.149+0000 7f5a75d25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 2024-09-22T08:37:48.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.151+0000 7f5a75d25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 info.flags=0x17 2024-09-22T08:37:48.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.151+0000 7f5a75d25800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 to cache LRU end 2024-09-22T08:37:48.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.151+0000 7f5a75d25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:48.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.151+0000 7f5a75d25800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39, ofs0, ns] 2024-09-22T08:37:48.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.151+0000 7f5954ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497122 cookie 94274274433888 notifier 7472 bl.length()=931 2024-09-22T08:37:48.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.151+0000 7f5954ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 info.flags=0x17 2024-09-22T08:37:48.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.151+0000 7f5954ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 to cache LRU end 2024-09-22T08:37:48.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.151+0000 7f5954ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:48.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.151+0000 7f5a75d25800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.39]): orig_sources= new_sources= 2024-09-22T08:37:48.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.151+0000 7f5a75d25800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.39]): potential sources added=[] removed=[] 2024-09-22T08:37:48.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.151+0000 7f5a75d25800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.39]): orig_dests= new_dests= 2024-09-22T08:37:48.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.151+0000 7f5a75d25800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.39]): potential dests added=[] removed=[] 2024-09-22T08:37:48.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.154+0000 7f5a75d25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.0 2024-09-22T08:37:48.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.154+0000 7f5a75d25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.1 2024-09-22T08:37:48.156 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.155+0000 7f5a75d25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.2 2024-09-22T08:37:48.156 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.155+0000 7f5a75d25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.3 2024-09-22T08:37:48.156 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.156+0000 7f5a75d25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.4 2024-09-22T08:37:48.157 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.156+0000 7f5a75d25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.5 2024-09-22T08:37:48.157 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.156+0000 7f5a75d25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.6 2024-09-22T08:37:48.158 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.157+0000 7f5a75d25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.7 2024-09-22T08:37:48.158 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.157+0000 7f5a75d25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.8 2024-09-22T08:37:48.159 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.157+0000 7f5a75d25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.9 2024-09-22T08:37:48.159 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.158+0000 7f5a75d25800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.39.10 2024-09-22T08:37:48.159 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.158+0000 7f5a75d25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 : hit (requested=0x17, cached=0x17) 2024-09-22T08:37:48.159 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.158+0000 7f5a75d25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 2024-09-22T08:37:48.160 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.159+0000 7f5a75d25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 info.flags=0x17 2024-09-22T08:37:48.161 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.159+0000 7f5a75d25800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 to cache LRU end 2024-09-22T08:37:48.161 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.159+0000 7f5a75d25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:48.161 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.159+0000 7f5a75d25800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39, ofs0, ns] 2024-09-22T08:37:48.161 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.160+0000 7f5954ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497123 cookie 94274274433888 notifier 7472 bl.length()=899 2024-09-22T08:37:48.161 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.160+0000 7f5954ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 info.flags=0x17 2024-09-22T08:37:48.161 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.160+0000 7f5954ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 to cache LRU end 2024-09-22T08:37:48.161 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.160+0000 7f5954ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T08:37:48.161 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.160+0000 7f5a75d25800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.39]): orig_sources= new_sources= 2024-09-22T08:37:48.162 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.160+0000 7f5a75d25800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.39]): potential sources added=[] removed=[] 2024-09-22T08:37:48.162 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.160+0000 7f5a75d25800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.39]): orig_dests= new_dests= 2024-09-22T08:37:48.162 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.160+0000 7f5a75d25800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c62f9d7b-f6b6-404a-90de-de5607499115.4584.39]): potential dests added=[] removed=[] 2024-09-22T08:37:48.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.163+0000 7f5a75d25800 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-22T08:37:48.166 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.165+0000 7f59237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:48.169 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.168+0000 7f5a75d25800 20 remove_watcher() i=0 2024-09-22T08:37:48.169 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.168+0000 7f5a75d25800 2 removed watcher, disabling cache 2024-09-22T08:37:48.170 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.169+0000 7f5a75d25800 20 remove_watcher() i=1 2024-09-22T08:37:48.171 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.170+0000 7f5a75d25800 20 remove_watcher() i=2 2024-09-22T08:37:48.172 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.171+0000 7f5a75d25800 20 remove_watcher() i=3 2024-09-22T08:37:48.173 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.172+0000 7f5a75d25800 20 remove_watcher() i=4 2024-09-22T08:37:48.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.173+0000 7f5a75d25800 20 remove_watcher() i=5 2024-09-22T08:37:48.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.174+0000 7f5a75d25800 20 remove_watcher() i=6 2024-09-22T08:37:48.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.176+0000 7f5a75d25800 20 remove_watcher() i=7 2024-09-22T08:37:48.190 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-22T08:37:48.220 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:48.220 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:48.261 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.260+0000 7f906ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.262+0000 7f906ed2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:48.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.262+0000 7f906ed2a800 20 realm 2024-09-22T08:37:48.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.262+0000 7f906ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.262+0000 7f906ed2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:48.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.262+0000 7f906ed2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:48.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.262+0000 7f906ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.262+0000 7f906ed2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:48.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.262+0000 7f906ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.263+0000 7f906ed2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:48.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.263+0000 7f906ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.264+0000 7f906ed2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:37:48.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.264+0000 7f906ed2a800 20 searching for the correct realm 2024-09-22T08:37:48.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.265+0000 7f906aa17640 0 -- 172.21.15.38:0/244385422 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x55a1d8323e00 msgr2=0x55a1d8326250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:37:48.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.269+0000 7f906b218640 0 -- 172.21.15.38:0/244385422 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x55a1d8317d60 msgr2=0x55a1d831a1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:48.278 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.277+0000 7f906ed2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:48.278 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.277+0000 7f906ed2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:48.278 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.277+0000 7f906ed2a800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:37:48.278 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.277+0000 7f906ed2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:48.278 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.277+0000 7f906ed2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:48.278 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.277+0000 7f906ed2a800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:37:48.278 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.277+0000 7f906ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.277+0000 7f906ed2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:48.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.277+0000 7f906ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.277+0000 7f906ed2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:48.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.277+0000 7f906ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.280 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.278+0000 7f906ed2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:37:48.280 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.278+0000 7f906ed2a800 20 zone default found 2024-09-22T08:37:48.280 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.278+0000 7f906ed2a800 4 Realm: () 2024-09-22T08:37:48.280 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.278+0000 7f906ed2a800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:37:48.280 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.278+0000 7f906ed2a800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:37:48.280 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.278+0000 7f906ed2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:48.280 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.278+0000 7f906ed2a800 20 zonegroup default 2024-09-22T08:37:48.280 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.278+0000 7f906ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.280 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.278+0000 7f906ed2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:48.280 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.278+0000 7f906ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.280 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.278+0000 7f906ed2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:48.280 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.278+0000 7f906ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.280 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.278+0000 7f906ed2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:48.280 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.278+0000 7f906ed2a800 20 started sync module instance, tier type = 2024-09-22T08:37:48.280 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.278+0000 7f906ed2a800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:37:48.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.288+0000 7f906ed2a800 20 add_watcher() i=0 2024-09-22T08:37:48.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.288+0000 7f906ed2a800 20 add_watcher() i=1 2024-09-22T08:37:48.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.288+0000 7f906ed2a800 20 add_watcher() i=2 2024-09-22T08:37:48.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.288+0000 7f906ed2a800 20 add_watcher() i=3 2024-09-22T08:37:48.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.288+0000 7f906ed2a800 20 add_watcher() i=4 2024-09-22T08:37:48.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.288+0000 7f906ed2a800 20 add_watcher() i=5 2024-09-22T08:37:48.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.288+0000 7f906ed2a800 20 add_watcher() i=6 2024-09-22T08:37:48.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.289+0000 7f906ed2a800 20 add_watcher() i=7 2024-09-22T08:37:48.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.289+0000 7f906ed2a800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:48.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.291+0000 7f8f217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:48.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.291+0000 7f906ed2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:48.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.291+0000 7f906ed2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:48.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.291+0000 7f906ed2a800 5 note: GC not initialized 2024-09-22T08:37:48.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.291+0000 7f8e9bfff640 20 reqs_thread_entry: start 2024-09-22T08:37:48.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.291+0000 7f906ed2a800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:48.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.292+0000 7f906ed2a800 20 Filter name: none 2024-09-22T08:37:48.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.292+0000 7f8e99ffb640 20 reqs_thread_entry: start 2024-09-22T08:37:48.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.292+0000 7f906ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.292+0000 7f906ed2a800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:37:48.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.292+0000 7f906ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.293+0000 7f906ed2a800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:37:48.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.293+0000 7f906ed2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:37:48.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.293+0000 7f906ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.293+0000 7f906ed2a800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:37:48.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.293+0000 7f906ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.293+0000 7f906ed2a800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:37:48.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.293+0000 7f906ed2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:37:48.296 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.295+0000 7f8f217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:48.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.298+0000 7f906ed2a800 20 remove_watcher() i=0 2024-09-22T08:37:48.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.298+0000 7f906ed2a800 2 removed watcher, disabling cache 2024-09-22T08:37:48.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.299+0000 7f906ed2a800 20 remove_watcher() i=1 2024-09-22T08:37:48.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.299+0000 7f906ed2a800 20 remove_watcher() i=2 2024-09-22T08:37:48.302 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.301+0000 7f906ed2a800 20 remove_watcher() i=3 2024-09-22T08:37:48.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.302+0000 7f906ed2a800 20 remove_watcher() i=4 2024-09-22T08:37:48.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.303+0000 7f906ed2a800 20 remove_watcher() i=5 2024-09-22T08:37:48.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.304+0000 7f906ed2a800 20 remove_watcher() i=6 2024-09-22T08:37:48.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.305+0000 7f906ed2a800 20 remove_watcher() i=7 2024-09-22T08:37:48.318 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:48.318 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:37:48.318 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-change-reshard-state id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.39 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-22T08:37:48.318 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:48.320 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:48.320 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:48.323 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:48.323 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:48.366 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:48.366 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:48.395 INFO:tasks.workunit.client.0.smithi038.stderr: test: logrecord could be stopped after reshard failed 2024-09-22T08:37:48.397 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T08:37:48.426 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:48.426 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:48.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.465+0000 7f08d2d19800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.466+0000 7f08d2d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:48.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.466+0000 7f08d2d19800 20 realm 2024-09-22T08:37:48.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.466+0000 7f08d2d19800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.467+0000 7f08d2d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:48.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.467+0000 7f08d2d19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:48.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.467+0000 7f08d2d19800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.467+0000 7f08d2d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:48.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.467+0000 7f08d2d19800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.469 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.468+0000 7f08d2d19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:48.469 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.468+0000 7f08d2d19800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.469 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.468+0000 7f08d2d19800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:37:48.469 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.468+0000 7f08d2d19800 20 searching for the correct realm 2024-09-22T08:37:48.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.471+0000 7f08d1004640 0 -- 172.21.15.38:0/2761098942 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7f08c402e950 msgr2=0x7f08c401d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:48.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.676+0000 7f08d0803640 0 -- 172.21.15.38:0/2761098942 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x563e1a3c2e90 msgr2=0x563e1a3c52e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:48.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.680+0000 7f08d2d19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:48.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.680+0000 7f08d2d19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:48.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.680+0000 7f08d2d19800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:37:48.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.680+0000 7f08d2d19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:48.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.680+0000 7f08d2d19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:48.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.680+0000 7f08d2d19800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:37:48.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.680+0000 7f08d2d19800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.680+0000 7f08d2d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:48.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.680+0000 7f08d2d19800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.681+0000 7f08d2d19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:48.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.681+0000 7f08d2d19800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.681+0000 7f08d2d19800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:37:48.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.681+0000 7f08d2d19800 20 zone default found 2024-09-22T08:37:48.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.681+0000 7f08d2d19800 4 Realm: () 2024-09-22T08:37:48.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.681+0000 7f08d2d19800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:37:48.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.681+0000 7f08d2d19800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:37:48.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.681+0000 7f08d2d19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:48.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.681+0000 7f08d2d19800 20 zonegroup default 2024-09-22T08:37:48.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.681+0000 7f08d2d19800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.681+0000 7f08d2d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:48.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.681+0000 7f08d2d19800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.682+0000 7f08d2d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:48.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.682+0000 7f08d2d19800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.682+0000 7f08d2d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:48.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.682+0000 7f08d2d19800 20 started sync module instance, tier type = 2024-09-22T08:37:48.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.682+0000 7f08d2d19800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:37:48.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.692+0000 7f08d2d19800 20 add_watcher() i=0 2024-09-22T08:37:48.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.692+0000 7f08d2d19800 20 add_watcher() i=1 2024-09-22T08:37:48.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.692+0000 7f08d2d19800 20 add_watcher() i=2 2024-09-22T08:37:48.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.692+0000 7f08d2d19800 20 add_watcher() i=3 2024-09-22T08:37:48.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.692+0000 7f08d2d19800 20 add_watcher() i=4 2024-09-22T08:37:48.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.692+0000 7f08d2d19800 20 add_watcher() i=5 2024-09-22T08:37:48.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.692+0000 7f08d2d19800 20 add_watcher() i=6 2024-09-22T08:37:48.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.693+0000 7f08d2d19800 20 add_watcher() i=7 2024-09-22T08:37:48.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.693+0000 7f08d2d19800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:48.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.695+0000 7f07877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:48.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.695+0000 7f08d2d19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:48.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.695+0000 7f08d2d19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:48.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.695+0000 7f08d2d19800 5 note: GC not initialized 2024-09-22T08:37:48.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.695+0000 7f07867e4640 20 reqs_thread_entry: start 2024-09-22T08:37:48.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.696+0000 7f08d2d19800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:48.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.696+0000 7f08d2d19800 20 Filter name: none 2024-09-22T08:37:48.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.696+0000 7f077ffff640 20 reqs_thread_entry: start 2024-09-22T08:37:48.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.696+0000 7f08d2d19800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.696+0000 7f08d2d19800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:37:48.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.696+0000 7f08d2d19800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.697+0000 7f08d2d19800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T08:37:48.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.697+0000 7f08d2d19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:37:48.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.697+0000 7f08d2d19800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.697+0000 7f08d2d19800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:37:48.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.697+0000 7f08d2d19800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.698+0000 7f08d2d19800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T08:37:48.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.698+0000 7f08d2d19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:37:48.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.699+0000 7f07877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:48.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.701+0000 7f08d2d19800 20 remove_watcher() i=0 2024-09-22T08:37:48.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.701+0000 7f08d2d19800 2 removed watcher, disabling cache 2024-09-22T08:37:48.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.702+0000 7f08d2d19800 20 remove_watcher() i=1 2024-09-22T08:37:48.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.704+0000 7f08d2d19800 20 remove_watcher() i=2 2024-09-22T08:37:48.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.705+0000 7f08d2d19800 20 remove_watcher() i=3 2024-09-22T08:37:48.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.706+0000 7f08d2d19800 20 remove_watcher() i=4 2024-09-22T08:37:48.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.707+0000 7f08d2d19800 20 remove_watcher() i=5 2024-09-22T08:37:48.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.708+0000 7f08d2d19800 20 remove_watcher() i=6 2024-09-22T08:37:48.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.709+0000 7f08d2d19800 20 remove_watcher() i=7 2024-09-22T08:37:48.722 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:48.722 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:37:48.722 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: a-bucket id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-22T08:37:48.722 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:48.723 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T08:37:48.753 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:48.753 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:48.791 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.790+0000 7fb033ebb800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.792+0000 7fb033ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:48.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.792+0000 7fb033ebb800 20 realm 2024-09-22T08:37:48.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.792+0000 7fb033ebb800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.793+0000 7fb033ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:48.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.793+0000 7fb033ebb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:48.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.793+0000 7fb033ebb800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.793+0000 7fb033ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:48.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.793+0000 7fb033ebb800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.794+0000 7fb033ebb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:48.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.794+0000 7fb033ebb800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.794+0000 7fb033ebb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:37:48.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.794+0000 7fb033ebb800 20 searching for the correct realm 2024-09-22T08:37:48.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:48.797+0000 7fb0321a6640 0 -- 172.21.15.38:0/4025984498 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7fb024074070 msgr2=0x7fb024067f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:49.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.003+0000 7fb0321a6640 0 -- 172.21.15.38:0/4025984498 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x564a1500e620 msgr2=0x564a15010ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:49.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.007+0000 7fb033ebb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:49.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.007+0000 7fb033ebb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:49.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.007+0000 7fb033ebb800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:37:49.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.007+0000 7fb033ebb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:49.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.007+0000 7fb033ebb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:49.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.007+0000 7fb033ebb800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:37:49.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.007+0000 7fb033ebb800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.008+0000 7fb033ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.008+0000 7fb033ebb800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.008+0000 7fb033ebb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:49.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.008+0000 7fb033ebb800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.008+0000 7fb033ebb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:37:49.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.008+0000 7fb033ebb800 20 zone default found 2024-09-22T08:37:49.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.008+0000 7fb033ebb800 4 Realm: () 2024-09-22T08:37:49.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.008+0000 7fb033ebb800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:37:49.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.008+0000 7fb033ebb800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:37:49.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.008+0000 7fb033ebb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:49.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.008+0000 7fb033ebb800 20 zonegroup default 2024-09-22T08:37:49.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.008+0000 7fb033ebb800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.009+0000 7fb033ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.009+0000 7fb033ebb800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.009+0000 7fb033ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.009+0000 7fb033ebb800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.010+0000 7fb033ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.010+0000 7fb033ebb800 20 started sync module instance, tier type = 2024-09-22T08:37:49.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.010+0000 7fb033ebb800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:37:49.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.020+0000 7fb033ebb800 20 add_watcher() i=0 2024-09-22T08:37:49.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.020+0000 7fb033ebb800 20 add_watcher() i=1 2024-09-22T08:37:49.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.020+0000 7fb033ebb800 20 add_watcher() i=2 2024-09-22T08:37:49.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.020+0000 7fb033ebb800 20 add_watcher() i=3 2024-09-22T08:37:49.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.020+0000 7fb033ebb800 20 add_watcher() i=4 2024-09-22T08:37:49.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.020+0000 7fb033ebb800 20 add_watcher() i=5 2024-09-22T08:37:49.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.020+0000 7fb033ebb800 20 add_watcher() i=6 2024-09-22T08:37:49.022 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.021+0000 7fb033ebb800 20 add_watcher() i=7 2024-09-22T08:37:49.022 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.021+0000 7fb033ebb800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:49.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.023+0000 7faee37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:49.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.024+0000 7fb033ebb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:49.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.024+0000 7fb033ebb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:49.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.024+0000 7fb033ebb800 5 note: GC not initialized 2024-09-22T08:37:49.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.024+0000 7faee27fc640 20 reqs_thread_entry: start 2024-09-22T08:37:49.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.024+0000 7fb033ebb800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:49.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.024+0000 7fb033ebb800 20 Filter name: none 2024-09-22T08:37:49.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.024+0000 7fae53fff640 20 reqs_thread_entry: start 2024-09-22T08:37:49.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.024+0000 7fb033ebb800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.025+0000 7fb033ebb800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:37:49.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.025+0000 7fb033ebb800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.025+0000 7fb033ebb800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T08:37:49.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.025+0000 7fb033ebb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:37:49.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.025+0000 7fb033ebb800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.026+0000 7fb033ebb800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:37:49.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.026+0000 7fb033ebb800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.026+0000 7fb033ebb800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T08:37:49.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.026+0000 7fb033ebb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:37:49.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.028+0000 7faee37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:49.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.030+0000 7fb033ebb800 20 remove_watcher() i=0 2024-09-22T08:37:49.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.030+0000 7fb033ebb800 2 removed watcher, disabling cache 2024-09-22T08:37:49.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.031+0000 7fb033ebb800 20 remove_watcher() i=1 2024-09-22T08:37:49.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.033+0000 7fb033ebb800 20 remove_watcher() i=2 2024-09-22T08:37:49.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.034+0000 7fb033ebb800 20 remove_watcher() i=3 2024-09-22T08:37:49.036 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.035+0000 7fb033ebb800 20 remove_watcher() i=4 2024-09-22T08:37:49.037 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.036+0000 7fb033ebb800 20 remove_watcher() i=5 2024-09-22T08:37:49.038 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.037+0000 7fb033ebb800 20 remove_watcher() i=6 2024-09-22T08:37:49.039 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.038+0000 7fb033ebb800 20 remove_watcher() i=7 2024-09-22T08:37:49.052 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-22T08:37:49.087 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:49.087 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:49.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.126+0000 7f609732c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.128+0000 7f609732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.128+0000 7f609732c800 20 realm 2024-09-22T08:37:49.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.128+0000 7f609732c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.128+0000 7f609732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.128+0000 7f609732c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:49.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.128+0000 7f609732c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.128+0000 7f609732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.128+0000 7f609732c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.131 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.129+0000 7f609732c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:49.131 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.129+0000 7f609732c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.131 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.130+0000 7f609732c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:37:49.131 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.130+0000 7f609732c800 20 searching for the correct realm 2024-09-22T08:37:49.133 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.132+0000 7f609273d640 0 -- 172.21.15.38:0/756920128 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f607c01dbb0 msgr2=0x7f607c0443d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:49.137 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.136+0000 7f609273d640 0 -- 172.21.15.38:0/756920128 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f60840a1290 msgr2=0x7f6084089fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:37:49.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.343+0000 7f609732c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:49.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.343+0000 7f609732c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:49.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.343+0000 7f609732c800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:37:49.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.343+0000 7f609732c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:49.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.343+0000 7f609732c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:49.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.343+0000 7f609732c800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:37:49.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.343+0000 7f609732c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.343+0000 7f609732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.343+0000 7f609732c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.343+0000 7f609732c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:49.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.343+0000 7f609732c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.344+0000 7f609732c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:37:49.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.344+0000 7f609732c800 20 zone default found 2024-09-22T08:37:49.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.344+0000 7f609732c800 4 Realm: () 2024-09-22T08:37:49.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.344+0000 7f609732c800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:37:49.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.344+0000 7f609732c800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:37:49.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.344+0000 7f609732c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:49.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.344+0000 7f609732c800 20 zonegroup default 2024-09-22T08:37:49.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.344+0000 7f609732c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.344+0000 7f609732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.344+0000 7f609732c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.345+0000 7f609732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.345+0000 7f609732c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.345+0000 7f609732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.345+0000 7f609732c800 20 started sync module instance, tier type = 2024-09-22T08:37:49.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.345+0000 7f609732c800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:37:49.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.355+0000 7f609732c800 20 add_watcher() i=0 2024-09-22T08:37:49.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.355+0000 7f609732c800 20 add_watcher() i=1 2024-09-22T08:37:49.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.355+0000 7f609732c800 20 add_watcher() i=2 2024-09-22T08:37:49.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.355+0000 7f609732c800 20 add_watcher() i=3 2024-09-22T08:37:49.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.355+0000 7f609732c800 20 add_watcher() i=4 2024-09-22T08:37:49.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.355+0000 7f609732c800 20 add_watcher() i=5 2024-09-22T08:37:49.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.355+0000 7f609732c800 20 add_watcher() i=6 2024-09-22T08:37:49.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.356+0000 7f609732c800 20 add_watcher() i=7 2024-09-22T08:37:49.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.356+0000 7f609732c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:49.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.358+0000 7f5f49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:49.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.359+0000 7f609732c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:49.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.359+0000 7f609732c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:49.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.359+0000 7f609732c800 5 note: GC not initialized 2024-09-22T08:37:49.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.359+0000 7f5f48fe1640 20 reqs_thread_entry: start 2024-09-22T08:37:49.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.359+0000 7f609732c800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:49.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.359+0000 7f609732c800 20 Filter name: none 2024-09-22T08:37:49.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.359+0000 7f5f41ffb640 20 reqs_thread_entry: start 2024-09-22T08:37:49.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.359+0000 7f609732c800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:37:49.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.359+0000 7f609732c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.360+0000 7f609732c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:37:49.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.360+0000 7f609732c800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:37:49.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.360+0000 7f609732c800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:37:49.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.360+0000 7f609732c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 : miss 2024-09-22T08:37:49.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.360+0000 7f609732c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.360+0000 7f609732c800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T08:37:49.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.360+0000 7f609732c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:37:49.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.360+0000 7f609732c800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:37:49.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.360+0000 7f609732c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:37:49.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.360+0000 7f609732c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:37:49.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.361+0000 7f609732c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 2024-09-22T08:37:49.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.367+0000 7f609732c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:37:49.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.367+0000 7f609732c800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:37:49.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.367+0000 7f609732c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:37:49.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.367+0000 7f609732c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17, ofs0, ns] 2024-09-22T08:37:49.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.367+0000 7f5f767fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497034 cookie 93862976887248 notifier 8022 bl.length()=827 2024-09-22T08:37:49.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.367+0000 7f5f767fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:37:49.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.367+0000 7f5f767fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:37:49.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.367+0000 7f5f767fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:37:49.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.368+0000 7f609732c800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_sources= new_sources= 2024-09-22T08:37:49.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.368+0000 7f609732c800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential sources added=[] removed=[] 2024-09-22T08:37:49.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.368+0000 7f609732c800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_dests= new_dests= 2024-09-22T08:37:49.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.368+0000 7f609732c800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential dests added=[] removed=[] 2024-09-22T08:37:49.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.0 2024-09-22T08:37:49.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.0 2024-09-22T08:37:49.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.1 2024-09-22T08:37:49.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.1 2024-09-22T08:37:49.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.2 2024-09-22T08:37:49.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.2 2024-09-22T08:37:49.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.3 2024-09-22T08:37:49.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.3 2024-09-22T08:37:49.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.4 2024-09-22T08:37:49.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.4 2024-09-22T08:37:49.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.5 2024-09-22T08:37:49.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.5 2024-09-22T08:37:49.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.6 2024-09-22T08:37:49.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.6 2024-09-22T08:37:49.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.7 2024-09-22T08:37:49.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.7 2024-09-22T08:37:49.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.8 2024-09-22T08:37:49.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.8 2024-09-22T08:37:49.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.9 2024-09-22T08:37:49.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.9 2024-09-22T08:37:49.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.10 2024-09-22T08:37:49.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.10 2024-09-22T08:37:49.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.11 2024-09-22T08:37:49.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.11 2024-09-22T08:37:49.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.12 2024-09-22T08:37:49.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.12 2024-09-22T08:37:49.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.13 2024-09-22T08:37:49.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.13 2024-09-22T08:37:49.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.0 2024-09-22T08:37:49.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.0 2024-09-22T08:37:49.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.374+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.1 2024-09-22T08:37:49.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.374+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.1 2024-09-22T08:37:49.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.374+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.2 2024-09-22T08:37:49.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.374+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.2 2024-09-22T08:37:49.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.375+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.3 2024-09-22T08:37:49.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.375+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.3 2024-09-22T08:37:49.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.375+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.4 2024-09-22T08:37:49.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.375+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.4 2024-09-22T08:37:49.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.376+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.5 2024-09-22T08:37:49.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.376+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.5 2024-09-22T08:37:49.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.377+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.6 2024-09-22T08:37:49.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.377+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.6 2024-09-22T08:37:49.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.377+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.7 2024-09-22T08:37:49.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.377+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.7 2024-09-22T08:37:49.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.378+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.8 2024-09-22T08:37:49.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.378+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.8 2024-09-22T08:37:49.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.378+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.9 2024-09-22T08:37:49.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.378+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.9 2024-09-22T08:37:49.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.379+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.10 2024-09-22T08:37:49.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.379+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.10 2024-09-22T08:37:49.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.379+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.11 2024-09-22T08:37:49.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.379+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.11 2024-09-22T08:37:49.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.380+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.12 2024-09-22T08:37:49.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.380+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.12 2024-09-22T08:37:49.383 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f609732c800 time 2024-09-22T08:37:49.383656+0000 2024-09-22T08:37:49.383 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:37:49.384 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:37:49.384 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f609898c748] 2024-09-22T08:37:49.384 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f609898c906] 2024-09-22T08:37:49.384 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555e2c6eee01] 2024-09-22T08:37:49.384 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x555e2c6fde9b] 2024-09-22T08:37:49.384 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x555e2c6fed64] 2024-09-22T08:37:49.384 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-22T08:37:49.385 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f6097629590] 2024-09-22T08:37:49.385 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-22T08:37:49.385 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-22T08:37:49.385 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.383+0000 7f609732c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f609732c800 time 2024-09-22T08:37:49.383656+0000 2024-09-22T08:37:49.385 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:37:49.385 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:49.385 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:37:49.385 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f609898c748] 2024-09-22T08:37:49.385 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f609898c906] 2024-09-22T08:37:49.385 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555e2c6eee01] 2024-09-22T08:37:49.385 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x555e2c6fde9b] 2024-09-22T08:37:49.385 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x555e2c6fed64] 2024-09-22T08:37:49.385 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-22T08:37:49.385 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f6097629590] 2024-09-22T08:37:49.386 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-22T08:37:49.386 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-22T08:37:49.386 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:49.386 INFO:tasks.workunit.client.0.smithi038.stderr:*** Caught signal (Aborted) ** 2024-09-22T08:37:49.386 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f609732c800 thread_name:radosgw-admin 2024-09-22T08:37:49.399 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:37:49.400 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f609763e6f0] 2024-09-22T08:37:49.400 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f609768b99c] 2024-09-22T08:37:49.400 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:37:49.400 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:37:49.400 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f609898c7a2] 2024-09-22T08:37:49.400 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f609898c906] 2024-09-22T08:37:49.400 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555e2c6eee01] 2024-09-22T08:37:49.400 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x555e2c6fde9b] 2024-09-22T08:37:49.400 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x555e2c6fed64] 2024-09-22T08:37:49.400 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-22T08:37:49.400 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f6097629590] 2024-09-22T08:37:49.400 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-22T08:37:49.400 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-22T08:37:49.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.384+0000 7f609732c800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:37:49.401 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f609732c800 thread_name:radosgw-admin 2024-09-22T08:37:49.401 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:49.401 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:37:49.401 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f609763e6f0] 2024-09-22T08:37:49.401 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f609768b99c] 2024-09-22T08:37:49.401 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:37:49.401 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:37:49.401 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f609898c7a2] 2024-09-22T08:37:49.401 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f609898c906] 2024-09-22T08:37:49.401 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555e2c6eee01] 2024-09-22T08:37:49.402 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x555e2c6fde9b] 2024-09-22T08:37:49.402 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x555e2c6fed64] 2024-09-22T08:37:49.402 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-22T08:37:49.402 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f6097629590] 2024-09-22T08:37:49.402 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-22T08:37:49.402 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-22T08:37:49.402 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:37:49.402 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:49.402 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-22T08:37:49.402 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-22T08:37:49.109+0000 7f609732c800 10 monclient(hunting): picked mon.noname-b con 0x555e2d581610 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:37:49.402 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-22T08:37:49.109+0000 7f609732c800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:49.403 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-22T08:37:49.109+0000 7f609732c800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:49.403 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-22T08:37:49.109+0000 7f609732c800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:49.403 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-22T08:37:49.109+0000 7f609732c800 10 monclient(hunting): _renew_subs 2024-09-22T08:37:49.403 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-22T08:37:49.109+0000 7f609732c800 10 monclient(hunting): authenticate will time out at 2174.348673s 2024-09-22T08:37:49.403 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-22T08:37:49.109+0000 7f609273d640 10 monclient(hunting): get_auth_request con 0x555e2d498df0 auth_method 0 2024-09-22T08:37:49.403 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-22T08:37:49.109+0000 7f609273d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:49.403 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-22T08:37:49.109+0000 7f609273d640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:49.403 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-22T08:37:49.109+0000 7f609273d640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:49.403 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-22T08:37:49.109+0000 7f6092f3e640 10 monclient(hunting): get_auth_request con 0x555e2d492980 auth_method 0 2024-09-22T08:37:49.403 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-22T08:37:49.109+0000 7f6092f3e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:49.403 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-22T08:37:49.109+0000 7f6092f3e640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:49.403 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-22T08:37:49.109+0000 7f6092f3e640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:49.403 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-22T08:37:49.109+0000 7f609273d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:37:49.403 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-22T08:37:49.109+0000 7f609273d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:37:49.404 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-22T08:37:49.109+0000 7f609273d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:37:49.404 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-22T08:37:49.109+0000 7f6092f3e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:37:49.404 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-22T08:37:49.109+0000 7f6092f3e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:37:49.404 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-22T08:37:49.109+0000 7f6092f3e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:37:49.404 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-22T08:37:49.109+0000 7f609373f640 10 monclient(hunting): get_auth_request con 0x555e2d581610 auth_method 0 2024-09-22T08:37:49.404 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-22T08:37:49.110+0000 7f609373f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:49.404 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-22T08:37:49.110+0000 7f609373f640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:49.404 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-22T08:37:49.110+0000 7f609373f640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:49.404 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-22T08:37:49.110+0000 7f6092f3e640 10 monclient(hunting): handle_auth_done global_id 7529 payload 824 2024-09-22T08:37:49.404 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-22T08:37:49.110+0000 7f6092f3e640 10 monclient: _finish_hunting 0 2024-09-22T08:37:49.404 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-22T08:37:49.110+0000 7f6092f3e640 1 monclient: found mon.noname-c 2024-09-22T08:37:49.404 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-22T08:37:49.110+0000 7f6092f3e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:37:49.404 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-22T08:37:49.110+0000 7f5f7f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:37:49.404 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-22T08:37:49.110+0000 7f5f7f606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:37:49.405 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-22T08:37:49.110+0000 7f5f7f606640 10 monclient: dump: 2024-09-22T08:37:49.405 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:37:49.405 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:37:49.405 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:49.405 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:49.405 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:37:49.405 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:49.405 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:37:49.405 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:37:49.405 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:37:49.405 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:49.405 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-22T08:37:49.110+0000 7f5f7f606640 10 monclient: _finish_auth 0 2024-09-22T08:37:49.405 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-22T08:37:49.110+0000 7f5f7f606640 10 monclient: _check_auth_tickets 2024-09-22T08:37:49.405 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-22T08:37:49.110+0000 7f609732c800 5 monclient: authenticate success, global_id 7529 2024-09-22T08:37:49.406 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-22T08:37:49.110+0000 7f609732c800 10 monclient: _renew_subs 2024-09-22T08:37:49.406 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-22T08:37:49.110+0000 7f609732c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:37:49.406 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-22T08:37:49.110+0000 7f5f7f606640 10 monclient: handle_config config(0 keys) 2024-09-22T08:37:49.406 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-22T08:37:49.110+0000 7f5f7f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:37:49.406 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-22T08:37:49.110+0000 7f5f7f606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:37:49.406 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-22T08:37:49.110+0000 7f5f7f606640 10 monclient: dump: 2024-09-22T08:37:49.406 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:37:49.406 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:37:49.406 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:49.406 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:49.406 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:37:49.406 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:49.406 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:37:49.407 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:37:49.407 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:37:49.407 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:49.407 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-22T08:37:49.110+0000 7f5f80e09640 4 set_mon_vals no callback set 2024-09-22T08:37:49.407 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-22T08:37:49.110+0000 7f609732c800 10 monclient: _renew_subs 2024-09-22T08:37:49.407 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-22T08:37:49.110+0000 7f609732c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:37:49.407 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-22T08:37:49.110+0000 7f609732c800 1 librados: init done 2024-09-22T08:37:49.407 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-22T08:37:49.112+0000 7f5f7f606640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:37:49.407 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-22T08:37:49.112+0000 7f5f7f606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:37:49.407 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-22T08:37:49.112+0000 7f5f7f606640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:37:49.407 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-22T08:37:49.113+0000 7f609273d640 10 monclient: get_auth_request con 0x7f5f78077570 auth_method 0 2024-09-22T08:37:49.407 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-22T08:37:49.113+0000 7f609373f640 10 monclient: get_auth_request con 0x555e2d5993f0 auth_method 0 2024-09-22T08:37:49.407 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-22T08:37:49.114+0000 7f6092f3e640 10 monclient: get_auth_request con 0x555e2d59c5d0 auth_method 0 2024-09-22T08:37:49.407 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-22T08:37:49.114+0000 7f609273d640 10 monclient: get_auth_request con 0x555e2d5a07c0 auth_method 0 2024-09-22T08:37:49.408 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-22T08:37:49.115+0000 7f609373f640 10 monclient: get_auth_request con 0x555e2d59fe50 auth_method 0 2024-09-22T08:37:49.408 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-22T08:37:49.116+0000 7f609732c800 10 monclient: build_initial_monmap 2024-09-22T08:37:49.408 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-22T08:37:49.116+0000 7f609732c800 1 build_initial for_mkfs: 0 2024-09-22T08:37:49.408 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-22T08:37:49.116+0000 7f609732c800 10 monclient: monmap: 2024-09-22T08:37:49.408 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:37:49.408 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:37:49.408 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:37:49.408 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:37:49.408 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:37:49.408 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:49.408 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:37:49.408 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:37:49.408 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:37:49.408 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:49.408 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-22T08:37:49.116+0000 7f609732c800 5 AuthRegistry(0x555e2d5a8880) adding auth protocol: cephx 2024-09-22T08:37:49.409 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-22T08:37:49.116+0000 7f609732c800 5 AuthRegistry(0x555e2d5a8880) adding auth protocol: cephx 2024-09-22T08:37:49.409 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-22T08:37:49.116+0000 7f609732c800 5 AuthRegistry(0x555e2d5a8880) adding auth protocol: cephx 2024-09-22T08:37:49.409 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-22T08:37:49.116+0000 7f609732c800 5 AuthRegistry(0x555e2d5a8880) adding con mode: secure 2024-09-22T08:37:49.409 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-22T08:37:49.116+0000 7f609732c800 5 AuthRegistry(0x555e2d5a8880) adding con mode: crc 2024-09-22T08:37:49.409 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-22T08:37:49.116+0000 7f609732c800 5 AuthRegistry(0x555e2d5a8880) adding con mode: secure 2024-09-22T08:37:49.409 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-22T08:37:49.116+0000 7f609732c800 5 AuthRegistry(0x555e2d5a8880) adding con mode: crc 2024-09-22T08:37:49.409 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-22T08:37:49.116+0000 7f609732c800 5 AuthRegistry(0x555e2d5a8880) adding con mode: secure 2024-09-22T08:37:49.409 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-22T08:37:49.116+0000 7f609732c800 5 AuthRegistry(0x555e2d5a8880) adding con mode: crc 2024-09-22T08:37:49.409 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-22T08:37:49.116+0000 7f609732c800 5 AuthRegistry(0x555e2d5a8880) adding con mode: crc 2024-09-22T08:37:49.409 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-22T08:37:49.116+0000 7f609732c800 5 AuthRegistry(0x555e2d5a8880) adding con mode: secure 2024-09-22T08:37:49.409 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-22T08:37:49.116+0000 7f609732c800 5 AuthRegistry(0x555e2d5a8880) adding con mode: crc 2024-09-22T08:37:49.409 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-22T08:37:49.116+0000 7f609732c800 5 AuthRegistry(0x555e2d5a8880) adding con mode: secure 2024-09-22T08:37:49.409 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-22T08:37:49.116+0000 7f609732c800 5 AuthRegistry(0x555e2d5a8880) adding con mode: crc 2024-09-22T08:37:49.410 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-22T08:37:49.116+0000 7f609732c800 5 AuthRegistry(0x555e2d5a8880) adding con mode: secure 2024-09-22T08:37:49.410 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-22T08:37:49.117+0000 7f609732c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:49.410 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-22T08:37:49.117+0000 7f609732c800 5 asok(0x555e2d32f0f0) register_command objecter_requests cmddesc objecter_requests hook 0x555e2d5abcd0 EEXIST 2024-09-22T08:37:49.410 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-22T08:37:49.117+0000 7f609732c800 10 monclient: init 2024-09-22T08:37:49.410 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-22T08:37:49.117+0000 7f609732c800 5 AuthRegistry(0x555e2d5a7778) adding auth protocol: cephx 2024-09-22T08:37:49.410 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-22T08:37:49.117+0000 7f609732c800 5 AuthRegistry(0x555e2d5a7778) adding auth protocol: cephx 2024-09-22T08:37:49.410 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-22T08:37:49.117+0000 7f609732c800 5 AuthRegistry(0x555e2d5a7778) adding auth protocol: cephx 2024-09-22T08:37:49.410 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-22T08:37:49.117+0000 7f609732c800 5 AuthRegistry(0x555e2d5a7778) adding con mode: secure 2024-09-22T08:37:49.410 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-22T08:37:49.117+0000 7f609732c800 5 AuthRegistry(0x555e2d5a7778) adding con mode: crc 2024-09-22T08:37:49.410 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-22T08:37:49.117+0000 7f609732c800 5 AuthRegistry(0x555e2d5a7778) adding con mode: secure 2024-09-22T08:37:49.410 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-22T08:37:49.117+0000 7f609732c800 5 AuthRegistry(0x555e2d5a7778) adding con mode: crc 2024-09-22T08:37:49.410 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-22T08:37:49.117+0000 7f609732c800 5 AuthRegistry(0x555e2d5a7778) adding con mode: secure 2024-09-22T08:37:49.410 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-22T08:37:49.117+0000 7f609732c800 5 AuthRegistry(0x555e2d5a7778) adding con mode: crc 2024-09-22T08:37:49.410 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-22T08:37:49.117+0000 7f609732c800 5 AuthRegistry(0x555e2d5a7778) adding con mode: crc 2024-09-22T08:37:49.411 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-22T08:37:49.117+0000 7f609732c800 5 AuthRegistry(0x555e2d5a7778) adding con mode: secure 2024-09-22T08:37:49.411 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-22T08:37:49.117+0000 7f609732c800 5 AuthRegistry(0x555e2d5a7778) adding con mode: crc 2024-09-22T08:37:49.411 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-22T08:37:49.117+0000 7f609732c800 5 AuthRegistry(0x555e2d5a7778) adding con mode: secure 2024-09-22T08:37:49.411 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-22T08:37:49.117+0000 7f609732c800 5 AuthRegistry(0x555e2d5a7778) adding con mode: crc 2024-09-22T08:37:49.411 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-22T08:37:49.117+0000 7f609732c800 5 AuthRegistry(0x555e2d5a7778) adding con mode: secure 2024-09-22T08:37:49.411 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-22T08:37:49.117+0000 7f609732c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:49.411 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-22T08:37:49.117+0000 7f609732c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:49.411 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-22T08:37:49.117+0000 7f609732c800 5 asok(0x555e2d32f0f0) register_command rotate-key cmddesc rotate-key hook 0x555e2d5a78c0 EEXIST 2024-09-22T08:37:49.411 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-22T08:37:49.117+0000 7f609732c800 10 monclient: _reopen_session rank -1 2024-09-22T08:37:49.411 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-22T08:37:49.117+0000 7f609732c800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T08:37:49.411 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-22T08:37:49.117+0000 7f609732c800 10 monclient(hunting): picked mon.noname-b con 0x555e2d5cfff0 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:37:49.411 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-22T08:37:49.117+0000 7f609732c800 10 monclient(hunting): picked mon.noname-a con 0x555e2d5d03d0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:37:49.411 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-22T08:37:49.117+0000 7f609732c800 10 monclient(hunting): picked mon.noname-c con 0x555e2d5ced00 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:37:49.411 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-22T08:37:49.117+0000 7f609732c800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:49.411 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-22T08:37:49.117+0000 7f609732c800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:49.412 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-22T08:37:49.117+0000 7f609732c800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:49.412 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-22T08:37:49.117+0000 7f609732c800 10 monclient(hunting): _renew_subs 2024-09-22T08:37:49.412 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-22T08:37:49.117+0000 7f609732c800 10 monclient(hunting): authenticate will time out at 2174.356813s 2024-09-22T08:37:49.412 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-22T08:37:49.117+0000 7f6092f3e640 10 monclient(hunting): get_auth_request con 0x555e2d5ced00 auth_method 0 2024-09-22T08:37:49.412 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-22T08:37:49.117+0000 7f6092f3e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:49.412 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-22T08:37:49.117+0000 7f6092f3e640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:49.412 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-22T08:37:49.117+0000 7f6092f3e640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:49.412 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-22T08:37:49.117+0000 7f609373f640 10 monclient(hunting): get_auth_request con 0x555e2d5d03d0 auth_method 0 2024-09-22T08:37:49.412 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-22T08:37:49.117+0000 7f609373f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:49.412 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-22T08:37:49.117+0000 7f609373f640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:49.412 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-22T08:37:49.117+0000 7f609373f640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:49.412 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-22T08:37:49.117+0000 7f6092f3e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:37:49.413 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-22T08:37:49.118+0000 7f6092f3e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:37:49.413 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-22T08:37:49.118+0000 7f6092f3e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:37:49.413 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-22T08:37:49.118+0000 7f609273d640 10 monclient(hunting): get_auth_request con 0x555e2d5cfff0 auth_method 0 2024-09-22T08:37:49.413 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-22T08:37:49.118+0000 7f609273d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:49.413 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-22T08:37:49.118+0000 7f609273d640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:49.413 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-22T08:37:49.118+0000 7f609273d640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:49.413 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-22T08:37:49.118+0000 7f609373f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:37:49.413 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-22T08:37:49.118+0000 7f609373f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:37:49.414 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-22T08:37:49.118+0000 7f609373f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:37:49.414 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-22T08:37:49.118+0000 7f609273d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:37:49.414 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-22T08:37:49.118+0000 7f609273d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:37:49.414 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-22T08:37:49.118+0000 7f609273d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:37:49.414 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-22T08:37:49.118+0000 7f6092f3e640 10 monclient(hunting): handle_auth_done global_id 7532 payload 824 2024-09-22T08:37:49.414 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-22T08:37:49.118+0000 7f6092f3e640 10 monclient: _finish_hunting 0 2024-09-22T08:37:49.414 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-22T08:37:49.118+0000 7f6092f3e640 1 monclient: found mon.noname-c 2024-09-22T08:37:49.415 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-22T08:37:49.118+0000 7f6092f3e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:37:49.415 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-22T08:37:49.118+0000 7f5f7ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:37:49.415 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-22T08:37:49.118+0000 7f5f7ce01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:37:49.415 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-22T08:37:49.118+0000 7f5f7ce01640 10 monclient: dump: 2024-09-22T08:37:49.415 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:37:49.415 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:37:49.416 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:49.416 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:49.416 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:37:49.416 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:49.416 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:37:49.416 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:37:49.416 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:37:49.417 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:49.417 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-22T08:37:49.118+0000 7f5f7ce01640 10 monclient: _finish_auth 0 2024-09-22T08:37:49.417 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-22T08:37:49.118+0000 7f5f7ce01640 10 monclient: _check_auth_tickets 2024-09-22T08:37:49.417 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-22T08:37:49.118+0000 7f5f7ce01640 10 monclient: handle_config config(0 keys) 2024-09-22T08:37:49.417 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-22T08:37:49.118+0000 7f5f7ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:37:49.417 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-22T08:37:49.118+0000 7f5f7ce01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:37:49.417 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-22T08:37:49.118+0000 7f5f7ce01640 10 monclient: dump: 2024-09-22T08:37:49.417 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:37:49.417 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:37:49.417 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:49.417 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:49.417 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:37:49.417 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:49.418 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:37:49.418 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:37:49.418 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:37:49.418 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:49.418 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-22T08:37:49.118+0000 7f609732c800 5 monclient: authenticate success, global_id 7532 2024-09-22T08:37:49.418 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-22T08:37:49.118+0000 7f609732c800 10 monclient: _renew_subs 2024-09-22T08:37:49.418 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-22T08:37:49.118+0000 7f609732c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:37:49.418 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-22T08:37:49.118+0000 7f6093f40640 4 set_mon_vals no callback set 2024-09-22T08:37:49.418 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-22T08:37:49.118+0000 7f609732c800 10 monclient: _renew_subs 2024-09-22T08:37:49.418 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-22T08:37:49.118+0000 7f609732c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:37:49.418 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-22T08:37:49.120+0000 7f5f7ce01640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:37:49.418 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-22T08:37:49.120+0000 7f5f7ce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:37:49.418 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-22T08:37:49.120+0000 7f5f7ce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:37:49.419 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-22T08:37:49.120+0000 7f609732c800 10 monclient: get_monmap_and_config 2024-09-22T08:37:49.419 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-22T08:37:49.120+0000 7f609732c800 10 monclient: build_initial_monmap 2024-09-22T08:37:49.419 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-22T08:37:49.120+0000 7f609732c800 1 build_initial for_mkfs: 0 2024-09-22T08:37:49.419 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-22T08:37:49.120+0000 7f609732c800 10 monclient: monmap: 2024-09-22T08:37:49.419 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:37:49.419 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:37:49.419 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:37:49.419 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:37:49.419 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:37:49.419 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:49.419 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:37:49.419 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:37:49.419 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:37:49.420 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:49.420 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-22T08:37:49.120+0000 7f609732c800 5 AuthRegistry(0x555e2d5efee0) adding auth protocol: cephx 2024-09-22T08:37:49.420 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-22T08:37:49.120+0000 7f609732c800 5 AuthRegistry(0x555e2d5efee0) adding auth protocol: cephx 2024-09-22T08:37:49.420 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-22T08:37:49.120+0000 7f609732c800 5 AuthRegistry(0x555e2d5efee0) adding auth protocol: cephx 2024-09-22T08:37:49.420 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-22T08:37:49.120+0000 7f609732c800 5 AuthRegistry(0x555e2d5efee0) adding con mode: secure 2024-09-22T08:37:49.420 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-22T08:37:49.120+0000 7f609732c800 5 AuthRegistry(0x555e2d5efee0) adding con mode: crc 2024-09-22T08:37:49.420 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-22T08:37:49.120+0000 7f609732c800 5 AuthRegistry(0x555e2d5efee0) adding con mode: secure 2024-09-22T08:37:49.420 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-22T08:37:49.120+0000 7f609732c800 5 AuthRegistry(0x555e2d5efee0) adding con mode: crc 2024-09-22T08:37:49.420 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-22T08:37:49.120+0000 7f609732c800 5 AuthRegistry(0x555e2d5efee0) adding con mode: secure 2024-09-22T08:37:49.420 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-22T08:37:49.120+0000 7f609732c800 5 AuthRegistry(0x555e2d5efee0) adding con mode: crc 2024-09-22T08:37:49.420 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-22T08:37:49.120+0000 7f609732c800 5 AuthRegistry(0x555e2d5efee0) adding con mode: crc 2024-09-22T08:37:49.420 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-22T08:37:49.120+0000 7f609732c800 5 AuthRegistry(0x555e2d5efee0) adding con mode: secure 2024-09-22T08:37:49.421 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-22T08:37:49.120+0000 7f609732c800 5 AuthRegistry(0x555e2d5efee0) adding con mode: crc 2024-09-22T08:37:49.421 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-22T08:37:49.120+0000 7f609732c800 5 AuthRegistry(0x555e2d5efee0) adding con mode: secure 2024-09-22T08:37:49.421 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-22T08:37:49.120+0000 7f609732c800 5 AuthRegistry(0x555e2d5efee0) adding con mode: crc 2024-09-22T08:37:49.421 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-22T08:37:49.120+0000 7f609732c800 5 AuthRegistry(0x555e2d5efee0) adding con mode: secure 2024-09-22T08:37:49.421 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-22T08:37:49.120+0000 7f609273d640 10 monclient: get_auth_request con 0x7f5f6c077480 auth_method 0 2024-09-22T08:37:49.421 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-22T08:37:49.120+0000 7f609732c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:49.421 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-22T08:37:49.121+0000 7f609732c800 10 monclient: init 2024-09-22T08:37:49.421 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-22T08:37:49.121+0000 7f609732c800 5 AuthRegistry(0x7ffddbab5cd0) adding auth protocol: cephx 2024-09-22T08:37:49.421 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-22T08:37:49.121+0000 7f609732c800 5 AuthRegistry(0x7ffddbab5cd0) adding auth protocol: cephx 2024-09-22T08:37:49.421 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-22T08:37:49.121+0000 7f609732c800 5 AuthRegistry(0x7ffddbab5cd0) adding auth protocol: cephx 2024-09-22T08:37:49.421 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-22T08:37:49.121+0000 7f609732c800 5 AuthRegistry(0x7ffddbab5cd0) adding con mode: secure 2024-09-22T08:37:49.421 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-22T08:37:49.121+0000 7f609732c800 5 AuthRegistry(0x7ffddbab5cd0) adding con mode: crc 2024-09-22T08:37:49.421 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-22T08:37:49.121+0000 7f609732c800 5 AuthRegistry(0x7ffddbab5cd0) adding con mode: secure 2024-09-22T08:37:49.421 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-22T08:37:49.121+0000 7f609732c800 5 AuthRegistry(0x7ffddbab5cd0) adding con mode: crc 2024-09-22T08:37:49.422 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-22T08:37:49.121+0000 7f609732c800 5 AuthRegistry(0x7ffddbab5cd0) adding con mode: secure 2024-09-22T08:37:49.422 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-22T08:37:49.121+0000 7f609732c800 5 AuthRegistry(0x7ffddbab5cd0) adding con mode: crc 2024-09-22T08:37:49.422 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-22T08:37:49.121+0000 7f609732c800 5 AuthRegistry(0x7ffddbab5cd0) adding con mode: crc 2024-09-22T08:37:49.422 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-22T08:37:49.121+0000 7f609732c800 5 AuthRegistry(0x7ffddbab5cd0) adding con mode: secure 2024-09-22T08:37:49.422 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-22T08:37:49.121+0000 7f609732c800 5 AuthRegistry(0x7ffddbab5cd0) adding con mode: crc 2024-09-22T08:37:49.422 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-22T08:37:49.121+0000 7f609732c800 5 AuthRegistry(0x7ffddbab5cd0) adding con mode: secure 2024-09-22T08:37:49.422 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-22T08:37:49.121+0000 7f609732c800 5 AuthRegistry(0x7ffddbab5cd0) adding con mode: crc 2024-09-22T08:37:49.422 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-22T08:37:49.121+0000 7f609732c800 5 AuthRegistry(0x7ffddbab5cd0) adding con mode: secure 2024-09-22T08:37:49.422 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-22T08:37:49.121+0000 7f609732c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:49.422 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-22T08:37:49.121+0000 7f609732c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:49.422 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-22T08:37:49.121+0000 7f609732c800 5 asok(0x555e2d32f0f0) register_command rotate-key cmddesc rotate-key hook 0x7ffddbab5e18 EEXIST 2024-09-22T08:37:49.422 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-22T08:37:49.121+0000 7f609732c800 10 monclient: _reopen_session rank -1 2024-09-22T08:37:49.422 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-22T08:37:49.121+0000 7f609732c800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T08:37:49.423 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-22T08:37:49.121+0000 7f609732c800 10 monclient(hunting): picked mon.noname-b con 0x555e2d624580 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:37:49.423 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-22T08:37:49.121+0000 7f609732c800 10 monclient(hunting): picked mon.noname-a con 0x555e2d5f54d0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:37:49.423 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-22T08:37:49.121+0000 7f609732c800 10 monclient(hunting): picked mon.noname-c con 0x555e2d61fe20 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:37:49.423 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-22T08:37:49.121+0000 7f609732c800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:49.423 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-22T08:37:49.121+0000 7f609732c800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:49.423 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-22T08:37:49.121+0000 7f609732c800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:49.423 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-22T08:37:49.121+0000 7f609732c800 10 monclient(hunting): _renew_subs 2024-09-22T08:37:49.423 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-22T08:37:49.121+0000 7f609732c800 10 monclient(hunting): authenticate will time out at 2174.360636s 2024-09-22T08:37:49.423 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-22T08:37:49.121+0000 7f609373f640 10 monclient(hunting): get_auth_request con 0x555e2d5f54d0 auth_method 0 2024-09-22T08:37:49.423 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-22T08:37:49.121+0000 7f609373f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:49.423 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-22T08:37:49.121+0000 7f609373f640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:49.423 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-22T08:37:49.121+0000 7f609373f640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:49.423 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-22T08:37:49.121+0000 7f6092f3e640 10 monclient(hunting): get_auth_request con 0x555e2d61fe20 auth_method 0 2024-09-22T08:37:49.423 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-22T08:37:49.121+0000 7f6092f3e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:49.423 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-22T08:37:49.121+0000 7f6092f3e640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:49.424 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-22T08:37:49.121+0000 7f6092f3e640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:49.424 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-22T08:37:49.121+0000 7f609373f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:37:49.424 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-22T08:37:49.121+0000 7f609373f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:37:49.424 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-22T08:37:49.121+0000 7f609373f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:37:49.424 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-22T08:37:49.121+0000 7f609273d640 10 monclient(hunting): get_auth_request con 0x555e2d624580 auth_method 0 2024-09-22T08:37:49.424 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-22T08:37:49.121+0000 7f609273d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:49.424 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-22T08:37:49.121+0000 7f609273d640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:49.424 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-22T08:37:49.121+0000 7f609273d640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:49.424 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-22T08:37:49.121+0000 7f6092f3e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:37:49.424 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-22T08:37:49.121+0000 7f6092f3e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:37:49.424 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-22T08:37:49.121+0000 7f6092f3e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:37:49.424 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-22T08:37:49.121+0000 7f609273d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:37:49.424 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-22T08:37:49.121+0000 7f609273d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:37:49.424 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-22T08:37:49.121+0000 7f609273d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:37:49.425 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-22T08:37:49.121+0000 7f609373f640 10 monclient(hunting): handle_auth_done global_id 8019 payload 274 2024-09-22T08:37:49.425 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-22T08:37:49.121+0000 7f609373f640 10 monclient: _finish_hunting 0 2024-09-22T08:37:49.425 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-22T08:37:49.121+0000 7f609373f640 1 monclient: found mon.noname-a 2024-09-22T08:37:49.425 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-22T08:37:49.121+0000 7f609373f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:37:49.425 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-22T08:37:49.122+0000 7f5f767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:37:49.425 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-22T08:37:49.122+0000 7f5f767fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:37:49.425 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-22T08:37:49.122+0000 7f5f767fc640 10 monclient: dump: 2024-09-22T08:37:49.425 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:37:49.425 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:37:49.425 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:49.425 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:49.425 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:37:49.425 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:49.425 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:37:49.425 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:37:49.426 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:37:49.426 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:49.426 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-22T08:37:49.122+0000 7f5f767fc640 10 monclient: _finish_auth 0 2024-09-22T08:37:49.426 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-22T08:37:49.122+0000 7f5f767fc640 10 monclient: _check_auth_tickets 2024-09-22T08:37:49.426 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-22T08:37:49.122+0000 7f5f767fc640 10 monclient: handle_config config(0 keys) 2024-09-22T08:37:49.426 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-22T08:37:49.122+0000 7f609732c800 5 monclient: authenticate success, global_id 8019 2024-09-22T08:37:49.426 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-22T08:37:49.122+0000 7f609732c800 10 monclient: get_monmap_and_config success 2024-09-22T08:37:49.426 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-22T08:37:49.122+0000 7f5f767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:37:49.426 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-22T08:37:49.122+0000 7f609732c800 4 set_mon_vals no callback set 2024-09-22T08:37:49.426 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-22T08:37:49.122+0000 7f5f767fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:37:49.426 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-22T08:37:49.122+0000 7f5f767fc640 10 monclient: dump: 2024-09-22T08:37:49.426 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:37:49.426 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:37:49.426 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:49.427 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:49.427 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:37:49.427 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:49.427 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:37:49.427 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:37:49.427 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:37:49.427 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:49.427 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-22T08:37:49.122+0000 7f609732c800 10 monclient: shutdown 2024-09-22T08:37:49.427 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-22T08:37:49.122+0000 7f609732c800 10 monclient: build_initial_monmap 2024-09-22T08:37:49.427 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-22T08:37:49.122+0000 7f609732c800 1 build_initial for_mkfs: 0 2024-09-22T08:37:49.427 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-22T08:37:49.122+0000 7f609732c800 10 monclient: monmap: 2024-09-22T08:37:49.427 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:37:49.427 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:37:49.427 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:37:49.427 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:37:49.427 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:37:49.428 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:49.428 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:37:49.428 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:37:49.428 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:37:49.428 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:49.428 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-22T08:37:49.122+0000 7f609732c800 5 AuthRegistry(0x555e2d616aa0) adding auth protocol: cephx 2024-09-22T08:37:49.428 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-22T08:37:49.122+0000 7f609732c800 5 AuthRegistry(0x555e2d616aa0) adding auth protocol: cephx 2024-09-22T08:37:49.428 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-22T08:37:49.122+0000 7f609732c800 5 AuthRegistry(0x555e2d616aa0) adding auth protocol: cephx 2024-09-22T08:37:49.428 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-22T08:37:49.122+0000 7f609732c800 5 AuthRegistry(0x555e2d616aa0) adding con mode: secure 2024-09-22T08:37:49.428 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-22T08:37:49.122+0000 7f609732c800 5 AuthRegistry(0x555e2d616aa0) adding con mode: crc 2024-09-22T08:37:49.428 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-22T08:37:49.122+0000 7f609732c800 5 AuthRegistry(0x555e2d616aa0) adding con mode: secure 2024-09-22T08:37:49.428 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-22T08:37:49.122+0000 7f609732c800 5 AuthRegistry(0x555e2d616aa0) adding con mode: crc 2024-09-22T08:37:49.428 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-22T08:37:49.122+0000 7f609732c800 5 AuthRegistry(0x555e2d616aa0) adding con mode: secure 2024-09-22T08:37:49.428 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-22T08:37:49.122+0000 7f609732c800 5 AuthRegistry(0x555e2d616aa0) adding con mode: crc 2024-09-22T08:37:49.429 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-22T08:37:49.122+0000 7f609732c800 5 AuthRegistry(0x555e2d616aa0) adding con mode: crc 2024-09-22T08:37:49.429 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-22T08:37:49.122+0000 7f609732c800 5 AuthRegistry(0x555e2d616aa0) adding con mode: secure 2024-09-22T08:37:49.429 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-22T08:37:49.122+0000 7f609732c800 5 AuthRegistry(0x555e2d616aa0) adding con mode: crc 2024-09-22T08:37:49.429 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-22T08:37:49.122+0000 7f609732c800 5 AuthRegistry(0x555e2d616aa0) adding con mode: secure 2024-09-22T08:37:49.429 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-22T08:37:49.122+0000 7f609732c800 5 AuthRegistry(0x555e2d616aa0) adding con mode: crc 2024-09-22T08:37:49.429 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-22T08:37:49.122+0000 7f609732c800 5 AuthRegistry(0x555e2d616aa0) adding con mode: secure 2024-09-22T08:37:49.429 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-22T08:37:49.123+0000 7f609732c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:49.429 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-22T08:37:49.123+0000 7f609732c800 1 librados: starting msgr at 2024-09-22T08:37:49.429 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-22T08:37:49.123+0000 7f609732c800 1 librados: starting objecter 2024-09-22T08:37:49.429 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-22T08:37:49.123+0000 7f609732c800 5 asok(0x555e2d32f0f0) register_command objecter_requests cmddesc objecter_requests hook 0x555e2d620280 EEXIST 2024-09-22T08:37:49.429 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-22T08:37:49.123+0000 7f609732c800 1 librados: setting wanted keys 2024-09-22T08:37:49.429 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-22T08:37:49.123+0000 7f609732c800 1 librados: calling monclient init 2024-09-22T08:37:49.429 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-22T08:37:49.123+0000 7f609732c800 10 monclient: init 2024-09-22T08:37:49.430 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-22T08:37:49.123+0000 7f609732c800 5 AuthRegistry(0x555e2d5e48b0) adding auth protocol: cephx 2024-09-22T08:37:49.430 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-22T08:37:49.123+0000 7f609732c800 5 AuthRegistry(0x555e2d5e48b0) adding auth protocol: cephx 2024-09-22T08:37:49.430 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-22T08:37:49.123+0000 7f609732c800 5 AuthRegistry(0x555e2d5e48b0) adding auth protocol: cephx 2024-09-22T08:37:49.430 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-22T08:37:49.123+0000 7f609732c800 5 AuthRegistry(0x555e2d5e48b0) adding con mode: secure 2024-09-22T08:37:49.430 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-22T08:37:49.123+0000 7f609732c800 5 AuthRegistry(0x555e2d5e48b0) adding con mode: crc 2024-09-22T08:37:49.430 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-22T08:37:49.123+0000 7f609732c800 5 AuthRegistry(0x555e2d5e48b0) adding con mode: secure 2024-09-22T08:37:49.430 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-22T08:37:49.123+0000 7f609732c800 5 AuthRegistry(0x555e2d5e48b0) adding con mode: crc 2024-09-22T08:37:49.430 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-22T08:37:49.123+0000 7f609732c800 5 AuthRegistry(0x555e2d5e48b0) adding con mode: secure 2024-09-22T08:37:49.430 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-22T08:37:49.123+0000 7f609732c800 5 AuthRegistry(0x555e2d5e48b0) adding con mode: crc 2024-09-22T08:37:49.430 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-22T08:37:49.123+0000 7f609732c800 5 AuthRegistry(0x555e2d5e48b0) adding con mode: crc 2024-09-22T08:37:49.430 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-22T08:37:49.123+0000 7f609732c800 5 AuthRegistry(0x555e2d5e48b0) adding con mode: secure 2024-09-22T08:37:49.430 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-22T08:37:49.123+0000 7f609732c800 5 AuthRegistry(0x555e2d5e48b0) adding con mode: crc 2024-09-22T08:37:49.430 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-22T08:37:49.123+0000 7f609732c800 5 AuthRegistry(0x555e2d5e48b0) adding con mode: secure 2024-09-22T08:37:49.430 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-22T08:37:49.123+0000 7f609732c800 5 AuthRegistry(0x555e2d5e48b0) adding con mode: crc 2024-09-22T08:37:49.431 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-22T08:37:49.123+0000 7f609732c800 5 AuthRegistry(0x555e2d5e48b0) adding con mode: secure 2024-09-22T08:37:49.431 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-22T08:37:49.123+0000 7f609732c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:49.431 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-22T08:37:49.124+0000 7f609732c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:49.431 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-22T08:37:49.124+0000 7f609732c800 5 asok(0x555e2d32f0f0) register_command rotate-key cmddesc rotate-key hook 0x555e2d5e49f8 EEXIST 2024-09-22T08:37:49.431 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-22T08:37:49.124+0000 7f609732c800 10 monclient: _reopen_session rank -1 2024-09-22T08:37:49.431 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-22T08:37:49.124+0000 7f609732c800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T08:37:49.431 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-22T08:37:49.124+0000 7f609732c800 10 monclient(hunting): picked mon.noname-c con 0x555e2d5f54d0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:37:49.431 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-22T08:37:49.124+0000 7f609732c800 10 monclient(hunting): picked mon.noname-a con 0x555e2d61fe20 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:37:49.431 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-22T08:37:49.124+0000 7f609732c800 10 monclient(hunting): picked mon.noname-b con 0x555e2d624580 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:37:49.431 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-22T08:37:49.124+0000 7f609732c800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:49.431 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-22T08:37:49.124+0000 7f609732c800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:49.431 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-22T08:37:49.124+0000 7f609732c800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:49.432 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-22T08:37:49.124+0000 7f609732c800 10 monclient(hunting): _renew_subs 2024-09-22T08:37:49.432 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-22T08:37:49.124+0000 7f609732c800 10 monclient(hunting): authenticate will time out at 2174.363171s 2024-09-22T08:37:49.432 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-22T08:37:49.124+0000 7f609373f640 10 monclient(hunting): get_auth_request con 0x555e2d61fe20 auth_method 0 2024-09-22T08:37:49.432 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-22T08:37:49.124+0000 7f609373f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:49.432 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-22T08:37:49.124+0000 7f609373f640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:49.432 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-22T08:37:49.124+0000 7f609373f640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:49.432 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-22T08:37:49.124+0000 7f609273d640 10 monclient(hunting): get_auth_request con 0x555e2d5f54d0 auth_method 0 2024-09-22T08:37:49.432 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-22T08:37:49.124+0000 7f609273d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:49.432 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-22T08:37:49.124+0000 7f609273d640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:49.432 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-22T08:37:49.124+0000 7f609273d640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:49.432 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-22T08:37:49.124+0000 7f609373f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:37:49.432 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-22T08:37:49.124+0000 7f609373f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:37:49.432 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-22T08:37:49.124+0000 7f609373f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:37:49.432 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-22T08:37:49.124+0000 7f609273d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:37:49.432 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-22T08:37:49.124+0000 7f609273d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:37:49.432 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-22T08:37:49.124+0000 7f609273d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:37:49.433 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-22T08:37:49.124+0000 7f609373f640 10 monclient(hunting): handle_auth_done global_id 8022 payload 824 2024-09-22T08:37:49.433 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-22T08:37:49.124+0000 7f609373f640 10 monclient: _finish_hunting 0 2024-09-22T08:37:49.433 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-22T08:37:49.124+0000 7f609373f640 1 monclient: found mon.noname-a 2024-09-22T08:37:49.433 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-22T08:37:49.124+0000 7f609373f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:37:49.433 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-22T08:37:49.124+0000 7f6092f3e640 10 monclient: get_auth_request con 0x555e2d624580 auth_method 0 2024-09-22T08:37:49.433 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-22T08:37:49.124+0000 7f5f74ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:37:49.433 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-22T08:37:49.124+0000 7f5f74ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:37:49.433 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-22T08:37:49.124+0000 7f5f74ff9640 10 monclient: dump: 2024-09-22T08:37:49.433 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:37:49.433 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:37:49.433 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:49.433 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:49.433 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:37:49.433 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:49.434 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:37:49.434 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:37:49.434 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:37:49.434 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:49.434 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-22T08:37:49.124+0000 7f5f74ff9640 10 monclient: _finish_auth 0 2024-09-22T08:37:49.434 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-22T08:37:49.124+0000 7f5f74ff9640 10 monclient: _check_auth_tickets 2024-09-22T08:37:49.434 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-22T08:37:49.124+0000 7f5f74ff9640 10 monclient: handle_config config(0 keys) 2024-09-22T08:37:49.434 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-22T08:37:49.124+0000 7f5f74ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:37:49.434 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-22T08:37:49.124+0000 7f5f74ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:37:49.434 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-22T08:37:49.124+0000 7f5f74ff9640 10 monclient: dump: 2024-09-22T08:37:49.434 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:37:49.434 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:37:49.434 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:49.434 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:49.435 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:37:49.435 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:49.435 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:37:49.435 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:37:49.435 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:37:49.435 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:49.435 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-22T08:37:49.124+0000 7f5f767fc640 4 set_mon_vals no callback set 2024-09-22T08:37:49.435 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-22T08:37:49.125+0000 7f609732c800 5 monclient: authenticate success, global_id 8022 2024-09-22T08:37:49.435 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-22T08:37:49.125+0000 7f609732c800 10 monclient: _renew_subs 2024-09-22T08:37:49.435 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-22T08:37:49.125+0000 7f609732c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:37:49.435 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-22T08:37:49.125+0000 7f609732c800 10 monclient: _renew_subs 2024-09-22T08:37:49.435 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-22T08:37:49.125+0000 7f609732c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:37:49.435 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-22T08:37:49.125+0000 7f609732c800 1 librados: init done 2024-09-22T08:37:49.436 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-22T08:37:49.125+0000 7f609732c800 5 asok(0x555e2d32f0f0) register_command cr dump hook 0x555e2d61a798 2024-09-22T08:37:49.436 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-22T08:37:49.126+0000 7f609732c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.436 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-22T08:37:49.127+0000 7f5f74ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:37:49.436 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-22T08:37:49.127+0000 7f5f74ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:37:49.436 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-22T08:37:49.127+0000 7f5f74ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:37:49.436 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-22T08:37:49.127+0000 7f609273d640 10 monclient: get_auth_request con 0x7f5f5c077570 auth_method 0 2024-09-22T08:37:49.436 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-22T08:37:49.127+0000 7f6092f3e640 10 monclient: get_auth_request con 0x555e2d63e5d0 auth_method 0 2024-09-22T08:37:49.436 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-22T08:37:49.128+0000 7f609732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.436 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-22T08:37:49.128+0000 7f609732c800 20 realm 2024-09-22T08:37:49.436 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-22T08:37:49.128+0000 7f609732c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.436 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-22T08:37:49.128+0000 7f609732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.436 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-22T08:37:49.128+0000 7f609732c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:49.436 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-22T08:37:49.128+0000 7f609732c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.436 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-22T08:37:49.128+0000 7f609732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.437 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-22T08:37:49.128+0000 7f609732c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.437 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-22T08:37:49.128+0000 7f609273d640 10 monclient: get_auth_request con 0x555e2d6429b0 auth_method 0 2024-09-22T08:37:49.437 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-22T08:37:49.129+0000 7f609732c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:49.437 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-22T08:37:49.129+0000 7f609732c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.437 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-22T08:37:49.129+0000 7f609373f640 10 monclient: get_auth_request con 0x555e2d6460b0 auth_method 0 2024-09-22T08:37:49.437 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-22T08:37:49.130+0000 7f609732c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:37:49.437 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-22T08:37:49.130+0000 7f609732c800 20 searching for the correct realm 2024-09-22T08:37:49.437 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-22T08:37:49.130+0000 7f6092f3e640 10 monclient: get_auth_request con 0x555e2d64ae70 auth_method 0 2024-09-22T08:37:49.437 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-22T08:37:49.132+0000 7f609273d640 10 monclient: get_auth_request con 0x7f607c01dbb0 auth_method 0 2024-09-22T08:37:49.437 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-22T08:37:49.132+0000 7f609273d640 0 -- 172.21.15.38:0/756920128 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f607c01dbb0 msgr2=0x7f607c0443d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:49.437 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-22T08:37:49.132+0000 7f5f74ff9640 1 client.8022.objecter ms_handle_reset 0x7f607c01dbb0 session 0x7f607c00dd40 osd.0 2024-09-22T08:37:49.438 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-22T08:37:49.132+0000 7f5f74ff9640 10 monclient: _renew_subs 2024-09-22T08:37:49.438 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-22T08:37:49.132+0000 7f5f74ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:37:49.438 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-22T08:37:49.132+0000 7f609273d640 10 monclient: get_auth_request con 0x7f5f5c087090 auth_method 0 2024-09-22T08:37:49.438 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-22T08:37:49.134+0000 7f609373f640 10 monclient: get_auth_request con 0x7f608406adf0 auth_method 0 2024-09-22T08:37:49.438 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-22T08:37:49.136+0000 7f6092f3e640 10 monclient: get_auth_request con 0x7f607c045440 auth_method 0 2024-09-22T08:37:49.438 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-22T08:37:49.136+0000 7f609273d640 0 -- 172.21.15.38:0/756920128 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f60840a1290 msgr2=0x7f6084089fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:37:49.438 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-22T08:37:49.337+0000 7f609273d640 10 monclient: get_auth_request con 0x7f60840a1290 auth_method 0 2024-09-22T08:37:49.438 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-22T08:37:49.343+0000 7f609732c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:49.438 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-22T08:37:49.343+0000 7f609732c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:49.438 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-22T08:37:49.343+0000 7f609732c800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:37:49.438 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-22T08:37:49.343+0000 7f609732c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:49.439 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-22T08:37:49.343+0000 7f609732c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:49.439 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-22T08:37:49.343+0000 7f609732c800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:37:49.439 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-22T08:37:49.343+0000 7f609732c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.439 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-22T08:37:49.343+0000 7f609732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.439 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-22T08:37:49.343+0000 7f609732c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.439 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-22T08:37:49.343+0000 7f609732c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:49.440 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-22T08:37:49.343+0000 7f609732c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.440 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-22T08:37:49.344+0000 7f609732c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:37:49.440 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-22T08:37:49.344+0000 7f609732c800 20 zone default found 2024-09-22T08:37:49.440 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-22T08:37:49.344+0000 7f609732c800 4 Realm: () 2024-09-22T08:37:49.440 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-22T08:37:49.344+0000 7f609732c800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:37:49.440 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-22T08:37:49.344+0000 7f609732c800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:37:49.441 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-22T08:37:49.344+0000 7f609732c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:49.441 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-22T08:37:49.344+0000 7f609732c800 20 zonegroup default 2024-09-22T08:37:49.441 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-22T08:37:49.344+0000 7f609732c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.441 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-22T08:37:49.344+0000 7f609732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.441 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-22T08:37:49.344+0000 7f609732c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.441 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-22T08:37:49.345+0000 7f609732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.441 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-22T08:37:49.345+0000 7f609732c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.441 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-22T08:37:49.345+0000 7f609732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.441 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-22T08:37:49.345+0000 7f609732c800 20 started sync module instance, tier type = 2024-09-22T08:37:49.442 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-22T08:37:49.345+0000 7f609732c800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:37:49.442 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-22T08:37:49.355+0000 7f609732c800 20 add_watcher() i=0 2024-09-22T08:37:49.442 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-22T08:37:49.355+0000 7f609732c800 20 add_watcher() i=1 2024-09-22T08:37:49.442 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-22T08:37:49.355+0000 7f609732c800 20 add_watcher() i=2 2024-09-22T08:37:49.442 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-22T08:37:49.355+0000 7f609732c800 20 add_watcher() i=3 2024-09-22T08:37:49.442 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-22T08:37:49.355+0000 7f609732c800 20 add_watcher() i=4 2024-09-22T08:37:49.442 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-22T08:37:49.355+0000 7f609732c800 20 add_watcher() i=5 2024-09-22T08:37:49.442 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-22T08:37:49.355+0000 7f609732c800 20 add_watcher() i=6 2024-09-22T08:37:49.442 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-22T08:37:49.356+0000 7f609732c800 20 add_watcher() i=7 2024-09-22T08:37:49.443 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-22T08:37:49.356+0000 7f609732c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:49.443 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-22T08:37:49.358+0000 7f609732c800 5 AuthRegistry(0x7ffddbab61a0) adding auth protocol: cephx 2024-09-22T08:37:49.443 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-22T08:37:49.358+0000 7f609732c800 5 AuthRegistry(0x7ffddbab61a0) adding auth protocol: cephx 2024-09-22T08:37:49.443 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-22T08:37:49.358+0000 7f609732c800 5 AuthRegistry(0x7ffddbab61a0) adding auth protocol: cephx 2024-09-22T08:37:49.443 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-22T08:37:49.358+0000 7f609732c800 5 AuthRegistry(0x7ffddbab61a0) adding con mode: secure 2024-09-22T08:37:49.443 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-22T08:37:49.358+0000 7f609732c800 5 AuthRegistry(0x7ffddbab61a0) adding con mode: crc 2024-09-22T08:37:49.443 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-22T08:37:49.358+0000 7f609732c800 5 AuthRegistry(0x7ffddbab61a0) adding con mode: secure 2024-09-22T08:37:49.443 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-22T08:37:49.358+0000 7f609732c800 5 AuthRegistry(0x7ffddbab61a0) adding con mode: crc 2024-09-22T08:37:49.444 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-22T08:37:49.358+0000 7f609732c800 5 AuthRegistry(0x7ffddbab61a0) adding con mode: secure 2024-09-22T08:37:49.444 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-22T08:37:49.358+0000 7f609732c800 5 AuthRegistry(0x7ffddbab61a0) adding con mode: crc 2024-09-22T08:37:49.444 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-22T08:37:49.358+0000 7f609732c800 5 AuthRegistry(0x7ffddbab61a0) adding con mode: crc 2024-09-22T08:37:49.444 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-22T08:37:49.358+0000 7f5f49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:49.444 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-22T08:37:49.358+0000 7f609732c800 5 AuthRegistry(0x7ffddbab61a0) adding con mode: secure 2024-09-22T08:37:49.444 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-22T08:37:49.358+0000 7f609732c800 5 AuthRegistry(0x7ffddbab61a0) adding con mode: crc 2024-09-22T08:37:49.444 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-22T08:37:49.358+0000 7f609732c800 5 AuthRegistry(0x7ffddbab61a0) adding con mode: secure 2024-09-22T08:37:49.444 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-22T08:37:49.358+0000 7f609732c800 5 AuthRegistry(0x7ffddbab61a0) adding con mode: crc 2024-09-22T08:37:49.445 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-22T08:37:49.358+0000 7f609732c800 5 AuthRegistry(0x7ffddbab61a0) adding con mode: secure 2024-09-22T08:37:49.445 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-22T08:37:49.359+0000 7f609732c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:49.445 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-22T08:37:49.359+0000 7f609732c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:49.445 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-22T08:37:49.359+0000 7f609732c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:49.445 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-22T08:37:49.359+0000 7f609732c800 5 asok(0x555e2d32f0f0) register_command cache list hook 0x555e2d615090 2024-09-22T08:37:49.445 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-22T08:37:49.359+0000 7f609732c800 5 asok(0x555e2d32f0f0) register_command cache inspect hook 0x555e2d615090 2024-09-22T08:37:49.445 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-22T08:37:49.359+0000 7f609732c800 5 asok(0x555e2d32f0f0) register_command cache erase hook 0x555e2d615090 2024-09-22T08:37:49.445 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-22T08:37:49.359+0000 7f609732c800 5 asok(0x555e2d32f0f0) register_command cache zap hook 0x555e2d615090 2024-09-22T08:37:49.446 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-22T08:37:49.359+0000 7f609732c800 5 note: GC not initialized 2024-09-22T08:37:49.446 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-22T08:37:49.359+0000 7f5f48fe1640 20 reqs_thread_entry: start 2024-09-22T08:37:49.446 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-22T08:37:49.359+0000 7f609732c800 5 asok(0x555e2d32f0f0) register_command sync trace show hook 0x7f608c04dbb0 2024-09-22T08:37:49.446 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-22T08:37:49.359+0000 7f609732c800 5 asok(0x555e2d32f0f0) register_command sync trace history hook 0x7f608c04dbb0 2024-09-22T08:37:49.446 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-22T08:37:49.359+0000 7f609732c800 5 asok(0x555e2d32f0f0) register_command sync trace active hook 0x7f608c04dbb0 2024-09-22T08:37:49.446 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-22T08:37:49.359+0000 7f609732c800 5 asok(0x555e2d32f0f0) register_command sync trace active_short hook 0x7f608c04dbb0 2024-09-22T08:37:49.446 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-22T08:37:49.359+0000 7f609732c800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:49.446 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-22T08:37:49.359+0000 7f609732c800 20 Filter name: none 2024-09-22T08:37:49.446 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-22T08:37:49.359+0000 7f5f41ffb640 20 reqs_thread_entry: start 2024-09-22T08:37:49.447 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-22T08:37:49.359+0000 7f609732c800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:37:49.447 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-22T08:37:49.359+0000 7f609732c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.447 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-22T08:37:49.360+0000 7f609732c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:37:49.447 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-22T08:37:49.360+0000 7f609732c800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:37:49.447 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-22T08:37:49.360+0000 7f609732c800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:37:49.447 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-22T08:37:49.360+0000 7f609732c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 : miss 2024-09-22T08:37:49.447 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-22T08:37:49.360+0000 7f609732c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.447 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-22T08:37:49.360+0000 7f609732c800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T08:37:49.447 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-22T08:37:49.360+0000 7f609732c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:37:49.447 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-22T08:37:49.360+0000 7f609732c800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:37:49.447 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-22T08:37:49.360+0000 7f609732c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:37:49.447 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-22T08:37:49.360+0000 7f609732c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:37:49.447 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-22T08:37:49.361+0000 7f609732c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 2024-09-22T08:37:49.447 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-22T08:37:49.367+0000 7f609732c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:37:49.448 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-22T08:37:49.367+0000 7f609732c800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:37:49.448 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-22T08:37:49.367+0000 7f609732c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:37:49.448 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-22T08:37:49.367+0000 7f609732c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17, ofs0, ns] 2024-09-22T08:37:49.448 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-22T08:37:49.367+0000 7f5f767fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497034 cookie 93862976887248 notifier 8022 bl.length()=827 2024-09-22T08:37:49.448 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-22T08:37:49.367+0000 7f5f767fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:37:49.448 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-22T08:37:49.367+0000 7f5f767fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:37:49.448 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-22T08:37:49.367+0000 7f5f767fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:37:49.448 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-22T08:37:49.368+0000 7f609732c800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_sources= new_sources= 2024-09-22T08:37:49.448 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-22T08:37:49.368+0000 7f609732c800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential sources added=[] removed=[] 2024-09-22T08:37:49.448 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-22T08:37:49.368+0000 7f609732c800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_dests= new_dests= 2024-09-22T08:37:49.448 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-22T08:37:49.368+0000 7f609732c800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential dests added=[] removed=[] 2024-09-22T08:37:49.448 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.0 2024-09-22T08:37:49.448 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.0 2024-09-22T08:37:49.448 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.1 2024-09-22T08:37:49.448 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.1 2024-09-22T08:37:49.448 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.2 2024-09-22T08:37:49.449 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.2 2024-09-22T08:37:49.449 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.3 2024-09-22T08:37:49.449 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.3 2024-09-22T08:37:49.449 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.4 2024-09-22T08:37:49.449 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.4 2024-09-22T08:37:49.449 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.5 2024-09-22T08:37:49.449 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.5 2024-09-22T08:37:49.449 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.6 2024-09-22T08:37:49.449 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.6 2024-09-22T08:37:49.449 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.7 2024-09-22T08:37:49.449 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.7 2024-09-22T08:37:49.449 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.8 2024-09-22T08:37:49.449 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.8 2024-09-22T08:37:49.449 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.9 2024-09-22T08:37:49.450 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.9 2024-09-22T08:37:49.450 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.10 2024-09-22T08:37:49.450 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.10 2024-09-22T08:37:49.450 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.11 2024-09-22T08:37:49.450 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.11 2024-09-22T08:37:49.450 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.12 2024-09-22T08:37:49.450 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.12 2024-09-22T08:37:49.450 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.13 2024-09-22T08:37:49.450 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.13 2024-09-22T08:37:49.450 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.0 2024-09-22T08:37:49.450 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.0 2024-09-22T08:37:49.450 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-22T08:37:49.374+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.1 2024-09-22T08:37:49.450 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-22T08:37:49.374+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.1 2024-09-22T08:37:49.450 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-22T08:37:49.374+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.2 2024-09-22T08:37:49.451 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-22T08:37:49.374+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.2 2024-09-22T08:37:49.451 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-22T08:37:49.375+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.3 2024-09-22T08:37:49.451 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-22T08:37:49.375+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.3 2024-09-22T08:37:49.451 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-22T08:37:49.375+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.4 2024-09-22T08:37:49.451 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-22T08:37:49.375+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.4 2024-09-22T08:37:49.451 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-22T08:37:49.376+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.5 2024-09-22T08:37:49.451 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-22T08:37:49.376+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.5 2024-09-22T08:37:49.451 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-22T08:37:49.377+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.6 2024-09-22T08:37:49.451 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-22T08:37:49.377+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.6 2024-09-22T08:37:49.451 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-22T08:37:49.377+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.7 2024-09-22T08:37:49.451 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-22T08:37:49.377+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.7 2024-09-22T08:37:49.451 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-22T08:37:49.378+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.8 2024-09-22T08:37:49.451 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-22T08:37:49.378+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.8 2024-09-22T08:37:49.451 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-22T08:37:49.378+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.9 2024-09-22T08:37:49.452 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-22T08:37:49.378+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.9 2024-09-22T08:37:49.452 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-22T08:37:49.379+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.10 2024-09-22T08:37:49.452 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-22T08:37:49.379+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.10 2024-09-22T08:37:49.452 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-22T08:37:49.379+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.11 2024-09-22T08:37:49.452 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-22T08:37:49.379+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.11 2024-09-22T08:37:49.452 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-22T08:37:49.380+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.12 2024-09-22T08:37:49.452 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-22T08:37:49.380+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.12 2024-09-22T08:37:49.452 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-22T08:37:49.383+0000 7f609732c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f609732c800 time 2024-09-22T08:37:49.383656+0000 2024-09-22T08:37:49.452 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:37:49.452 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:49.452 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:37:49.452 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f609898c748] 2024-09-22T08:37:49.452 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f609898c906] 2024-09-22T08:37:49.452 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555e2c6eee01] 2024-09-22T08:37:49.453 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x555e2c6fde9b] 2024-09-22T08:37:49.453 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x555e2c6fed64] 2024-09-22T08:37:49.453 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-22T08:37:49.453 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f6097629590] 2024-09-22T08:37:49.453 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-22T08:37:49.453 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-22T08:37:49.453 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:49.453 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-22T08:37:49.384+0000 7f609732c800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:37:49.453 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f609732c800 thread_name:radosgw-admin 2024-09-22T08:37:49.453 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:49.453 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:37:49.453 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f609763e6f0] 2024-09-22T08:37:49.453 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f609768b99c] 2024-09-22T08:37:49.453 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:37:49.454 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:37:49.454 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f609898c7a2] 2024-09-22T08:37:49.454 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f609898c906] 2024-09-22T08:37:49.454 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555e2c6eee01] 2024-09-22T08:37:49.454 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x555e2c6fde9b] 2024-09-22T08:37:49.454 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x555e2c6fed64] 2024-09-22T08:37:49.454 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-22T08:37:49.454 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f6097629590] 2024-09-22T08:37:49.454 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-22T08:37:49.454 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-22T08:37:49.454 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:37:49.454 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:49.454 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-22T08:37:49.454 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-22T08:37:49.454 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-22T08:37:49.455 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-22T08:37:49.455 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-22T08:37:49.455 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-22T08:37:49.455 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-22T08:37:49.455 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-22T08:37:49.455 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-22T08:37:49.455 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-22T08:37:49.455 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-22T08:37:49.455 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-22T08:37:49.455 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-22T08:37:49.455 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-22T08:37:49.455 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-22T08:37:49.455 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-22T08:37:49.455 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-22T08:37:49.456 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-22T08:37:49.456 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-22T08:37:49.456 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-22T08:37:49.456 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-22T08:37:49.456 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-22T08:37:49.456 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-22T08:37:49.456 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-22T08:37:49.456 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:37:49.456 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-22T08:37:49.456 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-22T08:37:49.456 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-22T08:37:49.456 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-22T08:37:49.456 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-22T08:37:49.456 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-22T08:37:49.456 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-22T08:37:49.457 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-22T08:37:49.457 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-22T08:37:49.457 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-22T08:37:49.457 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-22T08:37:49.457 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-22T08:37:49.457 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-22T08:37:49.457 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-22T08:37:49.457 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-22T08:37:49.457 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-22T08:37:49.457 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-22T08:37:49.457 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-22T08:37:49.457 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-22T08:37:49.457 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-22T08:37:49.457 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-22T08:37:49.458 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:37:49.458 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-22T08:37:49.458 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:37:49.458 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-22T08:37:49.458 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-22T08:37:49.458 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-22T08:37:49.458 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-22T08:37:49.458 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-22T08:37:49.458 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-22T08:37:49.458 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-22T08:37:49.458 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-22T08:37:49.458 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-22T08:37:49.458 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-22T08:37:49.458 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-22T08:37:49.459 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-22T08:37:49.459 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-22T08:37:49.459 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-22T08:37:49.459 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-22T08:37:49.459 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-22T08:37:49.459 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-22T08:37:49.459 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-22T08:37:49.459 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:37:49.459 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-22T08:37:49.459 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:37:49.459 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-22T08:37:49.459 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-22T08:37:49.459 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-22T08:37:49.459 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-22T08:37:49.459 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-22T08:37:49.460 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-22T08:37:49.460 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:37:49.460 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-22T08:37:49.460 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-22T08:37:49.460 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:37:49.460 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-22T08:37:49.460 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-22T08:37:49.460 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-22T08:37:49.460 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-22T08:37:49.460 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-22T08:37:49.460 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-22T08:37:49.460 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-22T08:37:49.460 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-22T08:37:49.460 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-22T08:37:49.460 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-22T08:37:49.461 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-22T08:37:49.461 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-22T08:37:49.461 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-22T08:37:49.461 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:37:49.461 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5f41ffb640 / http_manager 2024-09-22T08:37:49.461 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5f48fe1640 / http_manager 2024-09-22T08:37:49.461 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5f49fe3640 / rgw_dt_lg_renew 2024-09-22T08:37:49.461 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5f74ff9640 / ms_dispatch 2024-09-22T08:37:49.461 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5f767fc640 / io_context_pool 2024-09-22T08:37:49.461 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5f7ce01640 / ms_dispatch 2024-09-22T08:37:49.461 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5f7f606640 / ms_dispatch 2024-09-22T08:37:49.461 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5f80e09640 / io_context_pool 2024-09-22T08:37:49.461 INFO:tasks.workunit.client.0.smithi038.stderr: 7f609273d640 / msgr-worker-2 2024-09-22T08:37:49.461 INFO:tasks.workunit.client.0.smithi038.stderr: 7f6092f3e640 / msgr-worker-1 2024-09-22T08:37:49.462 INFO:tasks.workunit.client.0.smithi038.stderr: 7f609373f640 / msgr-worker-0 2024-09-22T08:37:49.462 INFO:tasks.workunit.client.0.smithi038.stderr: 7f6093f40640 / io_context_pool 2024-09-22T08:37:49.462 INFO:tasks.workunit.client.0.smithi038.stderr: 7f609732c800 / radosgw-admin 2024-09-22T08:37:49.462 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-22T08:37:49.462 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-22T08:37:49.462 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/log/ceph/ceph-client.admin.145165.log 2024-09-22T08:37:49.462 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-22T08:37:49.462 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-22T08:37:49.462 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-22T08:37:49.109+0000 7f609732c800 10 monclient(hunting): picked mon.noname-b con 0x555e2d581610 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:37:49.462 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-22T08:37:49.109+0000 7f609732c800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:49.462 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-22T08:37:49.109+0000 7f609732c800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:49.462 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-22T08:37:49.109+0000 7f609732c800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:49.462 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-22T08:37:49.109+0000 7f609732c800 10 monclient(hunting): _renew_subs 2024-09-22T08:37:49.462 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-22T08:37:49.109+0000 7f609732c800 10 monclient(hunting): authenticate will time out at 2174.348673s 2024-09-22T08:37:49.463 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-22T08:37:49.109+0000 7f609273d640 10 monclient(hunting): get_auth_request con 0x555e2d498df0 auth_method 0 2024-09-22T08:37:49.463 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-22T08:37:49.109+0000 7f609273d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:49.463 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-22T08:37:49.109+0000 7f609273d640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:49.463 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-22T08:37:49.109+0000 7f609273d640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:49.463 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-22T08:37:49.109+0000 7f6092f3e640 10 monclient(hunting): get_auth_request con 0x555e2d492980 auth_method 0 2024-09-22T08:37:49.463 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-22T08:37:49.109+0000 7f6092f3e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:49.463 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-22T08:37:49.109+0000 7f6092f3e640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:49.463 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-22T08:37:49.109+0000 7f6092f3e640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:49.463 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-22T08:37:49.109+0000 7f609273d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:37:49.463 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-22T08:37:49.109+0000 7f609273d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:37:49.463 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-22T08:37:49.109+0000 7f609273d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:37:49.463 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-22T08:37:49.109+0000 7f6092f3e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:37:49.463 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-22T08:37:49.109+0000 7f6092f3e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:37:49.463 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-22T08:37:49.109+0000 7f6092f3e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:37:49.464 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-22T08:37:49.109+0000 7f609373f640 10 monclient(hunting): get_auth_request con 0x555e2d581610 auth_method 0 2024-09-22T08:37:49.464 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-22T08:37:49.110+0000 7f609373f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:49.464 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-22T08:37:49.110+0000 7f609373f640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:49.464 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-22T08:37:49.110+0000 7f609373f640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:49.464 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-22T08:37:49.110+0000 7f6092f3e640 10 monclient(hunting): handle_auth_done global_id 7529 payload 824 2024-09-22T08:37:49.464 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-22T08:37:49.110+0000 7f6092f3e640 10 monclient: _finish_hunting 0 2024-09-22T08:37:49.464 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-22T08:37:49.110+0000 7f6092f3e640 1 monclient: found mon.noname-c 2024-09-22T08:37:49.464 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-22T08:37:49.110+0000 7f6092f3e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:37:49.464 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-22T08:37:49.110+0000 7f5f7f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:37:49.464 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-22T08:37:49.110+0000 7f5f7f606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:37:49.464 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-22T08:37:49.110+0000 7f5f7f606640 10 monclient: dump: 2024-09-22T08:37:49.464 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:37:49.464 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:37:49.464 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:49.465 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:49.465 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:37:49.465 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:49.465 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:37:49.465 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:37:49.465 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:37:49.465 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:49.465 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-22T08:37:49.110+0000 7f5f7f606640 10 monclient: _finish_auth 0 2024-09-22T08:37:49.465 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-22T08:37:49.110+0000 7f5f7f606640 10 monclient: _check_auth_tickets 2024-09-22T08:37:49.465 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-22T08:37:49.110+0000 7f609732c800 5 monclient: authenticate success, global_id 7529 2024-09-22T08:37:49.465 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-22T08:37:49.110+0000 7f609732c800 10 monclient: _renew_subs 2024-09-22T08:37:49.465 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-22T08:37:49.110+0000 7f609732c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:37:49.465 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-22T08:37:49.110+0000 7f5f7f606640 10 monclient: handle_config config(0 keys) 2024-09-22T08:37:49.465 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-22T08:37:49.110+0000 7f5f7f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:37:49.465 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-22T08:37:49.110+0000 7f5f7f606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:37:49.466 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-22T08:37:49.110+0000 7f5f7f606640 10 monclient: dump: 2024-09-22T08:37:49.466 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:37:49.466 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:37:49.466 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:49.466 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:49.466 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:37:49.466 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:49.466 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:37:49.466 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:37:49.466 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:37:49.466 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:49.466 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-22T08:37:49.110+0000 7f5f80e09640 4 set_mon_vals no callback set 2024-09-22T08:37:49.466 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-22T08:37:49.110+0000 7f609732c800 10 monclient: _renew_subs 2024-09-22T08:37:49.467 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-22T08:37:49.110+0000 7f609732c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:37:49.467 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-22T08:37:49.110+0000 7f609732c800 1 librados: init done 2024-09-22T08:37:49.467 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-22T08:37:49.112+0000 7f5f7f606640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:37:49.467 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-22T08:37:49.112+0000 7f5f7f606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:37:49.467 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-22T08:37:49.112+0000 7f5f7f606640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:37:49.467 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-22T08:37:49.113+0000 7f609273d640 10 monclient: get_auth_request con 0x7f5f78077570 auth_method 0 2024-09-22T08:37:49.467 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-22T08:37:49.113+0000 7f609373f640 10 monclient: get_auth_request con 0x555e2d5993f0 auth_method 0 2024-09-22T08:37:49.467 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-22T08:37:49.114+0000 7f6092f3e640 10 monclient: get_auth_request con 0x555e2d59c5d0 auth_method 0 2024-09-22T08:37:49.467 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-22T08:37:49.114+0000 7f609273d640 10 monclient: get_auth_request con 0x555e2d5a07c0 auth_method 0 2024-09-22T08:37:49.467 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-22T08:37:49.115+0000 7f609373f640 10 monclient: get_auth_request con 0x555e2d59fe50 auth_method 0 2024-09-22T08:37:49.467 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-22T08:37:49.116+0000 7f609732c800 10 monclient: build_initial_monmap 2024-09-22T08:37:49.467 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-22T08:37:49.116+0000 7f609732c800 1 build_initial for_mkfs: 0 2024-09-22T08:37:49.467 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-22T08:37:49.116+0000 7f609732c800 10 monclient: monmap: 2024-09-22T08:37:49.467 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:37:49.468 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:37:49.468 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:37:49.468 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:37:49.468 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:37:49.468 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:49.468 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:37:49.468 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:37:49.469 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:37:49.469 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:49.469 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-22T08:37:49.116+0000 7f609732c800 5 AuthRegistry(0x555e2d5a8880) adding auth protocol: cephx 2024-09-22T08:37:49.469 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-22T08:37:49.116+0000 7f609732c800 5 AuthRegistry(0x555e2d5a8880) adding auth protocol: cephx 2024-09-22T08:37:49.469 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-22T08:37:49.116+0000 7f609732c800 5 AuthRegistry(0x555e2d5a8880) adding auth protocol: cephx 2024-09-22T08:37:49.469 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-22T08:37:49.116+0000 7f609732c800 5 AuthRegistry(0x555e2d5a8880) adding con mode: secure 2024-09-22T08:37:49.469 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-22T08:37:49.116+0000 7f609732c800 5 AuthRegistry(0x555e2d5a8880) adding con mode: crc 2024-09-22T08:37:49.470 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-22T08:37:49.116+0000 7f609732c800 5 AuthRegistry(0x555e2d5a8880) adding con mode: secure 2024-09-22T08:37:49.470 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-22T08:37:49.116+0000 7f609732c800 5 AuthRegistry(0x555e2d5a8880) adding con mode: crc 2024-09-22T08:37:49.470 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-22T08:37:49.116+0000 7f609732c800 5 AuthRegistry(0x555e2d5a8880) adding con mode: secure 2024-09-22T08:37:49.470 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-22T08:37:49.116+0000 7f609732c800 5 AuthRegistry(0x555e2d5a8880) adding con mode: crc 2024-09-22T08:37:49.470 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-22T08:37:49.116+0000 7f609732c800 5 AuthRegistry(0x555e2d5a8880) adding con mode: crc 2024-09-22T08:37:49.470 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-22T08:37:49.116+0000 7f609732c800 5 AuthRegistry(0x555e2d5a8880) adding con mode: secure 2024-09-22T08:37:49.471 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-22T08:37:49.116+0000 7f609732c800 5 AuthRegistry(0x555e2d5a8880) adding con mode: crc 2024-09-22T08:37:49.471 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-22T08:37:49.116+0000 7f609732c800 5 AuthRegistry(0x555e2d5a8880) adding con mode: secure 2024-09-22T08:37:49.471 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-22T08:37:49.116+0000 7f609732c800 5 AuthRegistry(0x555e2d5a8880) adding con mode: crc 2024-09-22T08:37:49.471 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-22T08:37:49.116+0000 7f609732c800 5 AuthRegistry(0x555e2d5a8880) adding con mode: secure 2024-09-22T08:37:49.471 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-22T08:37:49.117+0000 7f609732c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:49.471 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-22T08:37:49.117+0000 7f609732c800 5 asok(0x555e2d32f0f0) register_command objecter_requests cmddesc objecter_requests hook 0x555e2d5abcd0 EEXIST 2024-09-22T08:37:49.471 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-22T08:37:49.117+0000 7f609732c800 10 monclient: init 2024-09-22T08:37:49.472 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-22T08:37:49.117+0000 7f609732c800 5 AuthRegistry(0x555e2d5a7778) adding auth protocol: cephx 2024-09-22T08:37:49.472 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-22T08:37:49.117+0000 7f609732c800 5 AuthRegistry(0x555e2d5a7778) adding auth protocol: cephx 2024-09-22T08:37:49.472 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-22T08:37:49.117+0000 7f609732c800 5 AuthRegistry(0x555e2d5a7778) adding auth protocol: cephx 2024-09-22T08:37:49.472 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-22T08:37:49.117+0000 7f609732c800 5 AuthRegistry(0x555e2d5a7778) adding con mode: secure 2024-09-22T08:37:49.472 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-22T08:37:49.117+0000 7f609732c800 5 AuthRegistry(0x555e2d5a7778) adding con mode: crc 2024-09-22T08:37:49.472 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-22T08:37:49.117+0000 7f609732c800 5 AuthRegistry(0x555e2d5a7778) adding con mode: secure 2024-09-22T08:37:49.473 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-22T08:37:49.117+0000 7f609732c800 5 AuthRegistry(0x555e2d5a7778) adding con mode: crc 2024-09-22T08:37:49.473 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-22T08:37:49.117+0000 7f609732c800 5 AuthRegistry(0x555e2d5a7778) adding con mode: secure 2024-09-22T08:37:49.473 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-22T08:37:49.117+0000 7f609732c800 5 AuthRegistry(0x555e2d5a7778) adding con mode: crc 2024-09-22T08:37:49.473 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-22T08:37:49.117+0000 7f609732c800 5 AuthRegistry(0x555e2d5a7778) adding con mode: crc 2024-09-22T08:37:49.473 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-22T08:37:49.117+0000 7f609732c800 5 AuthRegistry(0x555e2d5a7778) adding con mode: secure 2024-09-22T08:37:49.473 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-22T08:37:49.117+0000 7f609732c800 5 AuthRegistry(0x555e2d5a7778) adding con mode: crc 2024-09-22T08:37:49.473 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-22T08:37:49.117+0000 7f609732c800 5 AuthRegistry(0x555e2d5a7778) adding con mode: secure 2024-09-22T08:37:49.474 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-22T08:37:49.117+0000 7f609732c800 5 AuthRegistry(0x555e2d5a7778) adding con mode: crc 2024-09-22T08:37:49.474 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-22T08:37:49.117+0000 7f609732c800 5 AuthRegistry(0x555e2d5a7778) adding con mode: secure 2024-09-22T08:37:49.474 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-22T08:37:49.117+0000 7f609732c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:49.474 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-22T08:37:49.117+0000 7f609732c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:49.474 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-22T08:37:49.117+0000 7f609732c800 5 asok(0x555e2d32f0f0) register_command rotate-key cmddesc rotate-key hook 0x555e2d5a78c0 EEXIST 2024-09-22T08:37:49.474 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-22T08:37:49.117+0000 7f609732c800 10 monclient: _reopen_session rank -1 2024-09-22T08:37:49.475 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-22T08:37:49.117+0000 7f609732c800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T08:37:49.475 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-22T08:37:49.117+0000 7f609732c800 10 monclient(hunting): picked mon.noname-b con 0x555e2d5cfff0 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:37:49.475 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-22T08:37:49.117+0000 7f609732c800 10 monclient(hunting): picked mon.noname-a con 0x555e2d5d03d0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:37:49.475 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-22T08:37:49.117+0000 7f609732c800 10 monclient(hunting): picked mon.noname-c con 0x555e2d5ced00 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:37:49.475 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-22T08:37:49.117+0000 7f609732c800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:49.475 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-22T08:37:49.117+0000 7f609732c800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:49.476 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-22T08:37:49.117+0000 7f609732c800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:49.476 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-22T08:37:49.117+0000 7f609732c800 10 monclient(hunting): _renew_subs 2024-09-22T08:37:49.476 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-22T08:37:49.117+0000 7f609732c800 10 monclient(hunting): authenticate will time out at 2174.356813s 2024-09-22T08:37:49.476 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-22T08:37:49.117+0000 7f6092f3e640 10 monclient(hunting): get_auth_request con 0x555e2d5ced00 auth_method 0 2024-09-22T08:37:49.476 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-22T08:37:49.117+0000 7f6092f3e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:49.476 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-22T08:37:49.117+0000 7f6092f3e640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:49.477 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-22T08:37:49.117+0000 7f6092f3e640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:49.477 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-22T08:37:49.117+0000 7f609373f640 10 monclient(hunting): get_auth_request con 0x555e2d5d03d0 auth_method 0 2024-09-22T08:37:49.477 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-22T08:37:49.117+0000 7f609373f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:49.477 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-22T08:37:49.117+0000 7f609373f640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:49.477 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-22T08:37:49.117+0000 7f609373f640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:49.477 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-22T08:37:49.117+0000 7f6092f3e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:37:49.477 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-22T08:37:49.118+0000 7f6092f3e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:37:49.478 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-22T08:37:49.118+0000 7f6092f3e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:37:49.478 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-22T08:37:49.118+0000 7f609273d640 10 monclient(hunting): get_auth_request con 0x555e2d5cfff0 auth_method 0 2024-09-22T08:37:49.478 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-22T08:37:49.118+0000 7f609273d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:49.478 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-22T08:37:49.118+0000 7f609273d640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:49.478 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-22T08:37:49.118+0000 7f609273d640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:49.479 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-22T08:37:49.118+0000 7f609373f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:37:49.479 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-22T08:37:49.118+0000 7f609373f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:37:49.479 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-22T08:37:49.118+0000 7f609373f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:37:49.479 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-22T08:37:49.118+0000 7f609273d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:37:49.479 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-22T08:37:49.118+0000 7f609273d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:37:49.479 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-22T08:37:49.118+0000 7f609273d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:37:49.479 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-22T08:37:49.118+0000 7f6092f3e640 10 monclient(hunting): handle_auth_done global_id 7532 payload 824 2024-09-22T08:37:49.480 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-22T08:37:49.118+0000 7f6092f3e640 10 monclient: _finish_hunting 0 2024-09-22T08:37:49.480 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-22T08:37:49.118+0000 7f6092f3e640 1 monclient: found mon.noname-c 2024-09-22T08:37:49.480 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-22T08:37:49.118+0000 7f6092f3e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:37:49.480 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-22T08:37:49.118+0000 7f5f7ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:37:49.480 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-22T08:37:49.118+0000 7f5f7ce01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:37:49.480 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-22T08:37:49.118+0000 7f5f7ce01640 10 monclient: dump: 2024-09-22T08:37:49.481 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:37:49.481 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:37:49.481 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:49.481 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:49.481 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:37:49.481 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:49.481 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:37:49.482 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:37:49.482 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:37:49.482 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:49.482 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-22T08:37:49.118+0000 7f5f7ce01640 10 monclient: _finish_auth 0 2024-09-22T08:37:49.482 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-22T08:37:49.118+0000 7f5f7ce01640 10 monclient: _check_auth_tickets 2024-09-22T08:37:49.482 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-22T08:37:49.118+0000 7f5f7ce01640 10 monclient: handle_config config(0 keys) 2024-09-22T08:37:49.483 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-22T08:37:49.118+0000 7f5f7ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:37:49.483 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-22T08:37:49.118+0000 7f5f7ce01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:37:49.483 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-22T08:37:49.118+0000 7f5f7ce01640 10 monclient: dump: 2024-09-22T08:37:49.483 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:37:49.483 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:37:49.483 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:49.484 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:49.484 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:37:49.484 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:49.484 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:37:49.484 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:37:49.484 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:37:49.485 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:49.485 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-22T08:37:49.118+0000 7f609732c800 5 monclient: authenticate success, global_id 7532 2024-09-22T08:37:49.485 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-22T08:37:49.118+0000 7f609732c800 10 monclient: _renew_subs 2024-09-22T08:37:49.485 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-22T08:37:49.118+0000 7f609732c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:37:49.485 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-22T08:37:49.118+0000 7f6093f40640 4 set_mon_vals no callback set 2024-09-22T08:37:49.485 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-22T08:37:49.118+0000 7f609732c800 10 monclient: _renew_subs 2024-09-22T08:37:49.486 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-22T08:37:49.118+0000 7f609732c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:37:49.486 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-22T08:37:49.120+0000 7f5f7ce01640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:37:49.486 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-22T08:37:49.120+0000 7f5f7ce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:37:49.486 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-22T08:37:49.120+0000 7f5f7ce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:37:49.486 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-22T08:37:49.120+0000 7f609732c800 10 monclient: get_monmap_and_config 2024-09-22T08:37:49.486 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-22T08:37:49.120+0000 7f609732c800 10 monclient: build_initial_monmap 2024-09-22T08:37:49.487 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-22T08:37:49.120+0000 7f609732c800 1 build_initial for_mkfs: 0 2024-09-22T08:37:49.487 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-22T08:37:49.120+0000 7f609732c800 10 monclient: monmap: 2024-09-22T08:37:49.487 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:37:49.487 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:37:49.487 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:37:49.487 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:37:49.488 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:37:49.488 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:49.488 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:37:49.488 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:37:49.488 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:37:49.488 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:49.488 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-22T08:37:49.120+0000 7f609732c800 5 AuthRegistry(0x555e2d5efee0) adding auth protocol: cephx 2024-09-22T08:37:49.489 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-22T08:37:49.120+0000 7f609732c800 5 AuthRegistry(0x555e2d5efee0) adding auth protocol: cephx 2024-09-22T08:37:49.489 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-22T08:37:49.120+0000 7f609732c800 5 AuthRegistry(0x555e2d5efee0) adding auth protocol: cephx 2024-09-22T08:37:49.489 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-22T08:37:49.120+0000 7f609732c800 5 AuthRegistry(0x555e2d5efee0) adding con mode: secure 2024-09-22T08:37:49.489 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-22T08:37:49.120+0000 7f609732c800 5 AuthRegistry(0x555e2d5efee0) adding con mode: crc 2024-09-22T08:37:49.489 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-22T08:37:49.120+0000 7f609732c800 5 AuthRegistry(0x555e2d5efee0) adding con mode: secure 2024-09-22T08:37:49.489 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-22T08:37:49.120+0000 7f609732c800 5 AuthRegistry(0x555e2d5efee0) adding con mode: crc 2024-09-22T08:37:49.490 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-22T08:37:49.120+0000 7f609732c800 5 AuthRegistry(0x555e2d5efee0) adding con mode: secure 2024-09-22T08:37:49.490 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-22T08:37:49.120+0000 7f609732c800 5 AuthRegistry(0x555e2d5efee0) adding con mode: crc 2024-09-22T08:37:49.490 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-22T08:37:49.120+0000 7f609732c800 5 AuthRegistry(0x555e2d5efee0) adding con mode: crc 2024-09-22T08:37:49.490 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-22T08:37:49.120+0000 7f609732c800 5 AuthRegistry(0x555e2d5efee0) adding con mode: secure 2024-09-22T08:37:49.490 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-22T08:37:49.120+0000 7f609732c800 5 AuthRegistry(0x555e2d5efee0) adding con mode: crc 2024-09-22T08:37:49.490 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-22T08:37:49.120+0000 7f609732c800 5 AuthRegistry(0x555e2d5efee0) adding con mode: secure 2024-09-22T08:37:49.491 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-22T08:37:49.120+0000 7f609732c800 5 AuthRegistry(0x555e2d5efee0) adding con mode: crc 2024-09-22T08:37:49.491 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-22T08:37:49.120+0000 7f609732c800 5 AuthRegistry(0x555e2d5efee0) adding con mode: secure 2024-09-22T08:37:49.491 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-22T08:37:49.120+0000 7f609273d640 10 monclient: get_auth_request con 0x7f5f6c077480 auth_method 0 2024-09-22T08:37:49.491 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-22T08:37:49.120+0000 7f609732c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:49.491 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-22T08:37:49.121+0000 7f609732c800 10 monclient: init 2024-09-22T08:37:49.491 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-22T08:37:49.121+0000 7f609732c800 5 AuthRegistry(0x7ffddbab5cd0) adding auth protocol: cephx 2024-09-22T08:37:49.492 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-22T08:37:49.121+0000 7f609732c800 5 AuthRegistry(0x7ffddbab5cd0) adding auth protocol: cephx 2024-09-22T08:37:49.492 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-22T08:37:49.121+0000 7f609732c800 5 AuthRegistry(0x7ffddbab5cd0) adding auth protocol: cephx 2024-09-22T08:37:49.492 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-22T08:37:49.121+0000 7f609732c800 5 AuthRegistry(0x7ffddbab5cd0) adding con mode: secure 2024-09-22T08:37:49.492 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-22T08:37:49.121+0000 7f609732c800 5 AuthRegistry(0x7ffddbab5cd0) adding con mode: crc 2024-09-22T08:37:49.492 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-22T08:37:49.121+0000 7f609732c800 5 AuthRegistry(0x7ffddbab5cd0) adding con mode: secure 2024-09-22T08:37:49.492 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-22T08:37:49.121+0000 7f609732c800 5 AuthRegistry(0x7ffddbab5cd0) adding con mode: crc 2024-09-22T08:37:49.493 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-22T08:37:49.121+0000 7f609732c800 5 AuthRegistry(0x7ffddbab5cd0) adding con mode: secure 2024-09-22T08:37:49.493 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-22T08:37:49.121+0000 7f609732c800 5 AuthRegistry(0x7ffddbab5cd0) adding con mode: crc 2024-09-22T08:37:49.493 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-22T08:37:49.121+0000 7f609732c800 5 AuthRegistry(0x7ffddbab5cd0) adding con mode: crc 2024-09-22T08:37:49.493 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-22T08:37:49.121+0000 7f609732c800 5 AuthRegistry(0x7ffddbab5cd0) adding con mode: secure 2024-09-22T08:37:49.493 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-22T08:37:49.121+0000 7f609732c800 5 AuthRegistry(0x7ffddbab5cd0) adding con mode: crc 2024-09-22T08:37:49.493 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-22T08:37:49.121+0000 7f609732c800 5 AuthRegistry(0x7ffddbab5cd0) adding con mode: secure 2024-09-22T08:37:49.493 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-22T08:37:49.121+0000 7f609732c800 5 AuthRegistry(0x7ffddbab5cd0) adding con mode: crc 2024-09-22T08:37:49.494 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-22T08:37:49.121+0000 7f609732c800 5 AuthRegistry(0x7ffddbab5cd0) adding con mode: secure 2024-09-22T08:37:49.494 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-22T08:37:49.121+0000 7f609732c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:49.494 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-22T08:37:49.121+0000 7f609732c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:49.494 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-22T08:37:49.121+0000 7f609732c800 5 asok(0x555e2d32f0f0) register_command rotate-key cmddesc rotate-key hook 0x7ffddbab5e18 EEXIST 2024-09-22T08:37:49.494 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-22T08:37:49.121+0000 7f609732c800 10 monclient: _reopen_session rank -1 2024-09-22T08:37:49.495 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-22T08:37:49.121+0000 7f609732c800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T08:37:49.495 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-22T08:37:49.121+0000 7f609732c800 10 monclient(hunting): picked mon.noname-b con 0x555e2d624580 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:37:49.495 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-22T08:37:49.121+0000 7f609732c800 10 monclient(hunting): picked mon.noname-a con 0x555e2d5f54d0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:37:49.495 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-22T08:37:49.121+0000 7f609732c800 10 monclient(hunting): picked mon.noname-c con 0x555e2d61fe20 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:37:49.495 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-22T08:37:49.121+0000 7f609732c800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:49.495 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-22T08:37:49.121+0000 7f609732c800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:49.496 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-22T08:37:49.121+0000 7f609732c800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:49.496 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-22T08:37:49.121+0000 7f609732c800 10 monclient(hunting): _renew_subs 2024-09-22T08:37:49.496 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-22T08:37:49.121+0000 7f609732c800 10 monclient(hunting): authenticate will time out at 2174.360636s 2024-09-22T08:37:49.496 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-22T08:37:49.121+0000 7f609373f640 10 monclient(hunting): get_auth_request con 0x555e2d5f54d0 auth_method 0 2024-09-22T08:37:49.496 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-22T08:37:49.121+0000 7f609373f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:49.496 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-22T08:37:49.121+0000 7f609373f640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:49.497 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-22T08:37:49.121+0000 7f609373f640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:49.497 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-22T08:37:49.121+0000 7f6092f3e640 10 monclient(hunting): get_auth_request con 0x555e2d61fe20 auth_method 0 2024-09-22T08:37:49.497 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-22T08:37:49.121+0000 7f6092f3e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:49.497 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-22T08:37:49.121+0000 7f6092f3e640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:49.497 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-22T08:37:49.121+0000 7f6092f3e640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:49.497 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-22T08:37:49.121+0000 7f609373f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:37:49.498 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-22T08:37:49.121+0000 7f609373f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:37:49.498 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-22T08:37:49.121+0000 7f609373f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:37:49.498 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-22T08:37:49.121+0000 7f609273d640 10 monclient(hunting): get_auth_request con 0x555e2d624580 auth_method 0 2024-09-22T08:37:49.498 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-22T08:37:49.121+0000 7f609273d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:49.498 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-22T08:37:49.121+0000 7f609273d640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:49.498 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-22T08:37:49.121+0000 7f609273d640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:49.498 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-22T08:37:49.121+0000 7f6092f3e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:37:49.499 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-22T08:37:49.121+0000 7f6092f3e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:37:49.499 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-22T08:37:49.121+0000 7f6092f3e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:37:49.499 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-22T08:37:49.121+0000 7f609273d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:37:49.499 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-22T08:37:49.121+0000 7f609273d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:37:49.499 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-22T08:37:49.121+0000 7f609273d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:37:49.500 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-22T08:37:49.121+0000 7f609373f640 10 monclient(hunting): handle_auth_done global_id 8019 payload 274 2024-09-22T08:37:49.500 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-22T08:37:49.121+0000 7f609373f640 10 monclient: _finish_hunting 0 2024-09-22T08:37:49.500 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-22T08:37:49.121+0000 7f609373f640 1 monclient: found mon.noname-a 2024-09-22T08:37:49.500 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-22T08:37:49.121+0000 7f609373f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:37:49.500 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-22T08:37:49.122+0000 7f5f767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:37:49.500 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-22T08:37:49.122+0000 7f5f767fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:37:49.500 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-22T08:37:49.122+0000 7f5f767fc640 10 monclient: dump: 2024-09-22T08:37:49.501 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:37:49.501 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:37:49.501 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:49.501 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:49.501 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:37:49.502 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:49.502 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:37:49.502 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:37:49.502 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:37:49.502 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:49.503 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-22T08:37:49.122+0000 7f5f767fc640 10 monclient: _finish_auth 0 2024-09-22T08:37:49.503 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-22T08:37:49.122+0000 7f5f767fc640 10 monclient: _check_auth_tickets 2024-09-22T08:37:49.503 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-22T08:37:49.122+0000 7f5f767fc640 10 monclient: handle_config config(0 keys) 2024-09-22T08:37:49.503 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-22T08:37:49.122+0000 7f609732c800 5 monclient: authenticate success, global_id 8019 2024-09-22T08:37:49.503 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-22T08:37:49.122+0000 7f609732c800 10 monclient: get_monmap_and_config success 2024-09-22T08:37:49.503 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-22T08:37:49.122+0000 7f5f767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:37:49.504 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-22T08:37:49.122+0000 7f609732c800 4 set_mon_vals no callback set 2024-09-22T08:37:49.504 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-22T08:37:49.122+0000 7f5f767fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:37:49.504 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-22T08:37:49.122+0000 7f5f767fc640 10 monclient: dump: 2024-09-22T08:37:49.504 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:37:49.504 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:37:49.504 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:49.504 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:49.504 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:37:49.505 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:49.505 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:37:49.505 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:37:49.505 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:37:49.505 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:49.505 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-22T08:37:49.122+0000 7f609732c800 10 monclient: shutdown 2024-09-22T08:37:49.506 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-22T08:37:49.122+0000 7f609732c800 10 monclient: build_initial_monmap 2024-09-22T08:37:49.506 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-22T08:37:49.122+0000 7f609732c800 1 build_initial for_mkfs: 0 2024-09-22T08:37:49.506 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-22T08:37:49.122+0000 7f609732c800 10 monclient: monmap: 2024-09-22T08:37:49.506 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:37:49.506 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:37:49.506 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:37:49.507 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:37:49.507 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:37:49.507 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:49.507 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:37:49.507 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:37:49.507 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:37:49.507 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:49.507 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-22T08:37:49.122+0000 7f609732c800 5 AuthRegistry(0x555e2d616aa0) adding auth protocol: cephx 2024-09-22T08:37:49.508 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-22T08:37:49.122+0000 7f609732c800 5 AuthRegistry(0x555e2d616aa0) adding auth protocol: cephx 2024-09-22T08:37:49.508 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-22T08:37:49.122+0000 7f609732c800 5 AuthRegistry(0x555e2d616aa0) adding auth protocol: cephx 2024-09-22T08:37:49.508 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-22T08:37:49.122+0000 7f609732c800 5 AuthRegistry(0x555e2d616aa0) adding con mode: secure 2024-09-22T08:37:49.508 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-22T08:37:49.122+0000 7f609732c800 5 AuthRegistry(0x555e2d616aa0) adding con mode: crc 2024-09-22T08:37:49.508 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-22T08:37:49.122+0000 7f609732c800 5 AuthRegistry(0x555e2d616aa0) adding con mode: secure 2024-09-22T08:37:49.508 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-22T08:37:49.122+0000 7f609732c800 5 AuthRegistry(0x555e2d616aa0) adding con mode: crc 2024-09-22T08:37:49.508 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-22T08:37:49.122+0000 7f609732c800 5 AuthRegistry(0x555e2d616aa0) adding con mode: secure 2024-09-22T08:37:49.508 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-22T08:37:49.122+0000 7f609732c800 5 AuthRegistry(0x555e2d616aa0) adding con mode: crc 2024-09-22T08:37:49.508 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-22T08:37:49.122+0000 7f609732c800 5 AuthRegistry(0x555e2d616aa0) adding con mode: crc 2024-09-22T08:37:49.509 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-22T08:37:49.122+0000 7f609732c800 5 AuthRegistry(0x555e2d616aa0) adding con mode: secure 2024-09-22T08:37:49.509 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-22T08:37:49.122+0000 7f609732c800 5 AuthRegistry(0x555e2d616aa0) adding con mode: crc 2024-09-22T08:37:49.509 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-22T08:37:49.122+0000 7f609732c800 5 AuthRegistry(0x555e2d616aa0) adding con mode: secure 2024-09-22T08:37:49.509 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-22T08:37:49.122+0000 7f609732c800 5 AuthRegistry(0x555e2d616aa0) adding con mode: crc 2024-09-22T08:37:49.509 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-22T08:37:49.122+0000 7f609732c800 5 AuthRegistry(0x555e2d616aa0) adding con mode: secure 2024-09-22T08:37:49.509 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-22T08:37:49.123+0000 7f609732c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:49.509 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-22T08:37:49.123+0000 7f609732c800 1 librados: starting msgr at 2024-09-22T08:37:49.509 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-22T08:37:49.123+0000 7f609732c800 1 librados: starting objecter 2024-09-22T08:37:49.509 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-22T08:37:49.123+0000 7f609732c800 5 asok(0x555e2d32f0f0) register_command objecter_requests cmddesc objecter_requests hook 0x555e2d620280 EEXIST 2024-09-22T08:37:49.509 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-22T08:37:49.123+0000 7f609732c800 1 librados: setting wanted keys 2024-09-22T08:37:49.509 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-22T08:37:49.123+0000 7f609732c800 1 librados: calling monclient init 2024-09-22T08:37:49.509 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-22T08:37:49.123+0000 7f609732c800 10 monclient: init 2024-09-22T08:37:49.509 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-22T08:37:49.123+0000 7f609732c800 5 AuthRegistry(0x555e2d5e48b0) adding auth protocol: cephx 2024-09-22T08:37:49.510 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-22T08:37:49.123+0000 7f609732c800 5 AuthRegistry(0x555e2d5e48b0) adding auth protocol: cephx 2024-09-22T08:37:49.510 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-22T08:37:49.123+0000 7f609732c800 5 AuthRegistry(0x555e2d5e48b0) adding auth protocol: cephx 2024-09-22T08:37:49.510 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-22T08:37:49.123+0000 7f609732c800 5 AuthRegistry(0x555e2d5e48b0) adding con mode: secure 2024-09-22T08:37:49.510 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-22T08:37:49.123+0000 7f609732c800 5 AuthRegistry(0x555e2d5e48b0) adding con mode: crc 2024-09-22T08:37:49.510 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-22T08:37:49.123+0000 7f609732c800 5 AuthRegistry(0x555e2d5e48b0) adding con mode: secure 2024-09-22T08:37:49.510 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-22T08:37:49.123+0000 7f609732c800 5 AuthRegistry(0x555e2d5e48b0) adding con mode: crc 2024-09-22T08:37:49.510 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-22T08:37:49.123+0000 7f609732c800 5 AuthRegistry(0x555e2d5e48b0) adding con mode: secure 2024-09-22T08:37:49.510 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-22T08:37:49.123+0000 7f609732c800 5 AuthRegistry(0x555e2d5e48b0) adding con mode: crc 2024-09-22T08:37:49.510 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-22T08:37:49.123+0000 7f609732c800 5 AuthRegistry(0x555e2d5e48b0) adding con mode: crc 2024-09-22T08:37:49.510 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-22T08:37:49.123+0000 7f609732c800 5 AuthRegistry(0x555e2d5e48b0) adding con mode: secure 2024-09-22T08:37:49.510 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-22T08:37:49.123+0000 7f609732c800 5 AuthRegistry(0x555e2d5e48b0) adding con mode: crc 2024-09-22T08:37:49.510 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-22T08:37:49.123+0000 7f609732c800 5 AuthRegistry(0x555e2d5e48b0) adding con mode: secure 2024-09-22T08:37:49.510 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-22T08:37:49.123+0000 7f609732c800 5 AuthRegistry(0x555e2d5e48b0) adding con mode: crc 2024-09-22T08:37:49.510 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-22T08:37:49.123+0000 7f609732c800 5 AuthRegistry(0x555e2d5e48b0) adding con mode: secure 2024-09-22T08:37:49.511 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-22T08:37:49.123+0000 7f609732c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:49.511 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-22T08:37:49.124+0000 7f609732c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:49.511 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-22T08:37:49.124+0000 7f609732c800 5 asok(0x555e2d32f0f0) register_command rotate-key cmddesc rotate-key hook 0x555e2d5e49f8 EEXIST 2024-09-22T08:37:49.511 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-22T08:37:49.124+0000 7f609732c800 10 monclient: _reopen_session rank -1 2024-09-22T08:37:49.511 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-22T08:37:49.124+0000 7f609732c800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T08:37:49.511 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-22T08:37:49.124+0000 7f609732c800 10 monclient(hunting): picked mon.noname-c con 0x555e2d5f54d0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:37:49.511 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-22T08:37:49.124+0000 7f609732c800 10 monclient(hunting): picked mon.noname-a con 0x555e2d61fe20 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:37:49.511 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-22T08:37:49.124+0000 7f609732c800 10 monclient(hunting): picked mon.noname-b con 0x555e2d624580 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:37:49.511 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-22T08:37:49.124+0000 7f609732c800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:49.511 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-22T08:37:49.124+0000 7f609732c800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:49.511 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-22T08:37:49.124+0000 7f609732c800 10 monclient(hunting): start opening mon connection 2024-09-22T08:37:49.511 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-22T08:37:49.124+0000 7f609732c800 10 monclient(hunting): _renew_subs 2024-09-22T08:37:49.511 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-22T08:37:49.124+0000 7f609732c800 10 monclient(hunting): authenticate will time out at 2174.363171s 2024-09-22T08:37:49.511 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-22T08:37:49.124+0000 7f609373f640 10 monclient(hunting): get_auth_request con 0x555e2d61fe20 auth_method 0 2024-09-22T08:37:49.512 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-22T08:37:49.124+0000 7f609373f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:49.512 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-22T08:37:49.124+0000 7f609373f640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:49.512 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-22T08:37:49.124+0000 7f609373f640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:49.512 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-22T08:37:49.124+0000 7f609273d640 10 monclient(hunting): get_auth_request con 0x555e2d5f54d0 auth_method 0 2024-09-22T08:37:49.512 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-22T08:37:49.124+0000 7f609273d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:37:49.512 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-22T08:37:49.124+0000 7f609273d640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:37:49.512 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-22T08:37:49.124+0000 7f609273d640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:37:49.512 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-22T08:37:49.124+0000 7f609373f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:37:49.512 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-22T08:37:49.124+0000 7f609373f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:37:49.512 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-22T08:37:49.124+0000 7f609373f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:37:49.512 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-22T08:37:49.124+0000 7f609273d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:37:49.512 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-22T08:37:49.124+0000 7f609273d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:37:49.512 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-22T08:37:49.124+0000 7f609273d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:37:49.512 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-22T08:37:49.124+0000 7f609373f640 10 monclient(hunting): handle_auth_done global_id 8022 payload 824 2024-09-22T08:37:49.513 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-22T08:37:49.124+0000 7f609373f640 10 monclient: _finish_hunting 0 2024-09-22T08:37:49.513 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-22T08:37:49.124+0000 7f609373f640 1 monclient: found mon.noname-a 2024-09-22T08:37:49.513 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-22T08:37:49.124+0000 7f609373f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:37:49.513 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-22T08:37:49.124+0000 7f6092f3e640 10 monclient: get_auth_request con 0x555e2d624580 auth_method 0 2024-09-22T08:37:49.513 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-22T08:37:49.124+0000 7f5f74ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:37:49.513 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-22T08:37:49.124+0000 7f5f74ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:37:49.513 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-22T08:37:49.124+0000 7f5f74ff9640 10 monclient: dump: 2024-09-22T08:37:49.513 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:37:49.513 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:37:49.513 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:49.513 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:49.513 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:37:49.513 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:49.513 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:37:49.513 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:37:49.514 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:37:49.514 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:49.514 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-22T08:37:49.124+0000 7f5f74ff9640 10 monclient: _finish_auth 0 2024-09-22T08:37:49.514 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-22T08:37:49.124+0000 7f5f74ff9640 10 monclient: _check_auth_tickets 2024-09-22T08:37:49.514 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-22T08:37:49.124+0000 7f5f74ff9640 10 monclient: handle_config config(0 keys) 2024-09-22T08:37:49.514 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-22T08:37:49.124+0000 7f5f74ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:37:49.514 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-22T08:37:49.124+0000 7f5f74ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:37:49.514 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-22T08:37:49.124+0000 7f5f74ff9640 10 monclient: dump: 2024-09-22T08:37:49.514 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:37:49.514 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:37:49.514 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:49.514 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:37:49.514 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:37:49.515 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:37:49.515 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:37:49.515 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:37:49.515 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:37:49.515 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:49.515 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-22T08:37:49.124+0000 7f5f767fc640 4 set_mon_vals no callback set 2024-09-22T08:37:49.515 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-22T08:37:49.125+0000 7f609732c800 5 monclient: authenticate success, global_id 8022 2024-09-22T08:37:49.515 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-22T08:37:49.125+0000 7f609732c800 10 monclient: _renew_subs 2024-09-22T08:37:49.515 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-22T08:37:49.125+0000 7f609732c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:37:49.515 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-22T08:37:49.125+0000 7f609732c800 10 monclient: _renew_subs 2024-09-22T08:37:49.515 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-22T08:37:49.125+0000 7f609732c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:37:49.515 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-22T08:37:49.125+0000 7f609732c800 1 librados: init done 2024-09-22T08:37:49.515 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-22T08:37:49.125+0000 7f609732c800 5 asok(0x555e2d32f0f0) register_command cr dump hook 0x555e2d61a798 2024-09-22T08:37:49.515 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-22T08:37:49.126+0000 7f609732c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.515 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-22T08:37:49.127+0000 7f5f74ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:37:49.516 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-22T08:37:49.127+0000 7f5f74ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:37:49.516 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-22T08:37:49.127+0000 7f5f74ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:37:49.516 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-22T08:37:49.127+0000 7f609273d640 10 monclient: get_auth_request con 0x7f5f5c077570 auth_method 0 2024-09-22T08:37:49.516 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-22T08:37:49.127+0000 7f6092f3e640 10 monclient: get_auth_request con 0x555e2d63e5d0 auth_method 0 2024-09-22T08:37:49.516 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-22T08:37:49.128+0000 7f609732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.516 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-22T08:37:49.128+0000 7f609732c800 20 realm 2024-09-22T08:37:49.516 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-22T08:37:49.128+0000 7f609732c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.516 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-22T08:37:49.128+0000 7f609732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.516 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-22T08:37:49.128+0000 7f609732c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:49.516 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-22T08:37:49.128+0000 7f609732c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.516 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-22T08:37:49.128+0000 7f609732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.516 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-22T08:37:49.128+0000 7f609732c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.516 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-22T08:37:49.128+0000 7f609273d640 10 monclient: get_auth_request con 0x555e2d6429b0 auth_method 0 2024-09-22T08:37:49.516 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-22T08:37:49.129+0000 7f609732c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:49.516 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-22T08:37:49.129+0000 7f609732c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.517 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-22T08:37:49.129+0000 7f609373f640 10 monclient: get_auth_request con 0x555e2d6460b0 auth_method 0 2024-09-22T08:37:49.517 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-22T08:37:49.130+0000 7f609732c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:37:49.517 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-22T08:37:49.130+0000 7f609732c800 20 searching for the correct realm 2024-09-22T08:37:49.517 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-22T08:37:49.130+0000 7f6092f3e640 10 monclient: get_auth_request con 0x555e2d64ae70 auth_method 0 2024-09-22T08:37:49.517 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-22T08:37:49.132+0000 7f609273d640 10 monclient: get_auth_request con 0x7f607c01dbb0 auth_method 0 2024-09-22T08:37:49.517 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-22T08:37:49.132+0000 7f609273d640 0 -- 172.21.15.38:0/756920128 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f607c01dbb0 msgr2=0x7f607c0443d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:49.517 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-22T08:37:49.132+0000 7f5f74ff9640 1 client.8022.objecter ms_handle_reset 0x7f607c01dbb0 session 0x7f607c00dd40 osd.0 2024-09-22T08:37:49.517 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-22T08:37:49.132+0000 7f5f74ff9640 10 monclient: _renew_subs 2024-09-22T08:37:49.517 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-22T08:37:49.132+0000 7f5f74ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:37:49.517 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-22T08:37:49.132+0000 7f609273d640 10 monclient: get_auth_request con 0x7f5f5c087090 auth_method 0 2024-09-22T08:37:49.517 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-22T08:37:49.134+0000 7f609373f640 10 monclient: get_auth_request con 0x7f608406adf0 auth_method 0 2024-09-22T08:37:49.517 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-22T08:37:49.136+0000 7f6092f3e640 10 monclient: get_auth_request con 0x7f607c045440 auth_method 0 2024-09-22T08:37:49.517 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-22T08:37:49.136+0000 7f609273d640 0 -- 172.21.15.38:0/756920128 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f60840a1290 msgr2=0x7f6084089fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:37:49.518 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-22T08:37:49.337+0000 7f609273d640 10 monclient: get_auth_request con 0x7f60840a1290 auth_method 0 2024-09-22T08:37:49.518 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-22T08:37:49.343+0000 7f609732c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:49.518 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-22T08:37:49.343+0000 7f609732c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:49.518 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-22T08:37:49.343+0000 7f609732c800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:37:49.518 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-22T08:37:49.343+0000 7f609732c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:49.518 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-22T08:37:49.343+0000 7f609732c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:49.518 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-22T08:37:49.343+0000 7f609732c800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:37:49.518 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-22T08:37:49.343+0000 7f609732c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.518 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-22T08:37:49.343+0000 7f609732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.518 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-22T08:37:49.343+0000 7f609732c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.518 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-22T08:37:49.343+0000 7f609732c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:49.518 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-22T08:37:49.343+0000 7f609732c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.518 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-22T08:37:49.344+0000 7f609732c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:37:49.518 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-22T08:37:49.344+0000 7f609732c800 20 zone default found 2024-09-22T08:37:49.519 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-22T08:37:49.344+0000 7f609732c800 4 Realm: () 2024-09-22T08:37:49.519 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-22T08:37:49.344+0000 7f609732c800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:37:49.519 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-22T08:37:49.344+0000 7f609732c800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:37:49.519 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-22T08:37:49.344+0000 7f609732c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:49.519 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-22T08:37:49.344+0000 7f609732c800 20 zonegroup default 2024-09-22T08:37:49.519 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-22T08:37:49.344+0000 7f609732c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.519 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-22T08:37:49.344+0000 7f609732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.519 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-22T08:37:49.344+0000 7f609732c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.519 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-22T08:37:49.345+0000 7f609732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.519 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-22T08:37:49.345+0000 7f609732c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.519 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-22T08:37:49.345+0000 7f609732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.519 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-22T08:37:49.345+0000 7f609732c800 20 started sync module instance, tier type = 2024-09-22T08:37:49.519 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-22T08:37:49.345+0000 7f609732c800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:37:49.519 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-22T08:37:49.355+0000 7f609732c800 20 add_watcher() i=0 2024-09-22T08:37:49.520 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-22T08:37:49.355+0000 7f609732c800 20 add_watcher() i=1 2024-09-22T08:37:49.520 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-22T08:37:49.355+0000 7f609732c800 20 add_watcher() i=2 2024-09-22T08:37:49.520 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-22T08:37:49.355+0000 7f609732c800 20 add_watcher() i=3 2024-09-22T08:37:49.520 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-22T08:37:49.355+0000 7f609732c800 20 add_watcher() i=4 2024-09-22T08:37:49.520 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-22T08:37:49.355+0000 7f609732c800 20 add_watcher() i=5 2024-09-22T08:37:49.520 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-22T08:37:49.355+0000 7f609732c800 20 add_watcher() i=6 2024-09-22T08:37:49.520 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-22T08:37:49.356+0000 7f609732c800 20 add_watcher() i=7 2024-09-22T08:37:49.520 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-22T08:37:49.356+0000 7f609732c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:49.520 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-22T08:37:49.358+0000 7f609732c800 5 AuthRegistry(0x7ffddbab61a0) adding auth protocol: cephx 2024-09-22T08:37:49.520 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-22T08:37:49.358+0000 7f609732c800 5 AuthRegistry(0x7ffddbab61a0) adding auth protocol: cephx 2024-09-22T08:37:49.520 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-22T08:37:49.358+0000 7f609732c800 5 AuthRegistry(0x7ffddbab61a0) adding auth protocol: cephx 2024-09-22T08:37:49.520 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-22T08:37:49.358+0000 7f609732c800 5 AuthRegistry(0x7ffddbab61a0) adding con mode: secure 2024-09-22T08:37:49.520 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-22T08:37:49.358+0000 7f609732c800 5 AuthRegistry(0x7ffddbab61a0) adding con mode: crc 2024-09-22T08:37:49.521 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-22T08:37:49.358+0000 7f609732c800 5 AuthRegistry(0x7ffddbab61a0) adding con mode: secure 2024-09-22T08:37:49.521 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-22T08:37:49.358+0000 7f609732c800 5 AuthRegistry(0x7ffddbab61a0) adding con mode: crc 2024-09-22T08:37:49.521 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-22T08:37:49.358+0000 7f609732c800 5 AuthRegistry(0x7ffddbab61a0) adding con mode: secure 2024-09-22T08:37:49.521 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-22T08:37:49.358+0000 7f609732c800 5 AuthRegistry(0x7ffddbab61a0) adding con mode: crc 2024-09-22T08:37:49.521 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-22T08:37:49.358+0000 7f609732c800 5 AuthRegistry(0x7ffddbab61a0) adding con mode: crc 2024-09-22T08:37:49.521 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-22T08:37:49.358+0000 7f5f49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:49.521 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-22T08:37:49.358+0000 7f609732c800 5 AuthRegistry(0x7ffddbab61a0) adding con mode: secure 2024-09-22T08:37:49.521 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-22T08:37:49.358+0000 7f609732c800 5 AuthRegistry(0x7ffddbab61a0) adding con mode: crc 2024-09-22T08:37:49.521 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-22T08:37:49.358+0000 7f609732c800 5 AuthRegistry(0x7ffddbab61a0) adding con mode: secure 2024-09-22T08:37:49.521 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-22T08:37:49.358+0000 7f609732c800 5 AuthRegistry(0x7ffddbab61a0) adding con mode: crc 2024-09-22T08:37:49.521 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-22T08:37:49.358+0000 7f609732c800 5 AuthRegistry(0x7ffddbab61a0) adding con mode: secure 2024-09-22T08:37:49.521 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-22T08:37:49.359+0000 7f609732c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:37:49.521 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-22T08:37:49.359+0000 7f609732c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:49.522 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-22T08:37:49.359+0000 7f609732c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:49.522 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-22T08:37:49.359+0000 7f609732c800 5 asok(0x555e2d32f0f0) register_command cache list hook 0x555e2d615090 2024-09-22T08:37:49.522 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-22T08:37:49.359+0000 7f609732c800 5 asok(0x555e2d32f0f0) register_command cache inspect hook 0x555e2d615090 2024-09-22T08:37:49.522 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-22T08:37:49.359+0000 7f609732c800 5 asok(0x555e2d32f0f0) register_command cache erase hook 0x555e2d615090 2024-09-22T08:37:49.522 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-22T08:37:49.359+0000 7f609732c800 5 asok(0x555e2d32f0f0) register_command cache zap hook 0x555e2d615090 2024-09-22T08:37:49.522 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-22T08:37:49.359+0000 7f609732c800 5 note: GC not initialized 2024-09-22T08:37:49.522 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-22T08:37:49.359+0000 7f5f48fe1640 20 reqs_thread_entry: start 2024-09-22T08:37:49.522 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-22T08:37:49.359+0000 7f609732c800 5 asok(0x555e2d32f0f0) register_command sync trace show hook 0x7f608c04dbb0 2024-09-22T08:37:49.522 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-22T08:37:49.359+0000 7f609732c800 5 asok(0x555e2d32f0f0) register_command sync trace history hook 0x7f608c04dbb0 2024-09-22T08:37:49.522 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-22T08:37:49.359+0000 7f609732c800 5 asok(0x555e2d32f0f0) register_command sync trace active hook 0x7f608c04dbb0 2024-09-22T08:37:49.522 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-22T08:37:49.359+0000 7f609732c800 5 asok(0x555e2d32f0f0) register_command sync trace active_short hook 0x7f608c04dbb0 2024-09-22T08:37:49.522 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-22T08:37:49.359+0000 7f609732c800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:49.522 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-22T08:37:49.359+0000 7f609732c800 20 Filter name: none 2024-09-22T08:37:49.523 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-22T08:37:49.359+0000 7f5f41ffb640 20 reqs_thread_entry: start 2024-09-22T08:37:49.523 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-22T08:37:49.359+0000 7f609732c800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:37:49.523 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-22T08:37:49.359+0000 7f609732c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.523 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-22T08:37:49.360+0000 7f609732c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:37:49.523 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-22T08:37:49.360+0000 7f609732c800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:37:49.523 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-22T08:37:49.360+0000 7f609732c800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:37:49.523 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-22T08:37:49.360+0000 7f609732c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 : miss 2024-09-22T08:37:49.523 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-22T08:37:49.360+0000 7f609732c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.523 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-22T08:37:49.360+0000 7f609732c800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T08:37:49.523 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-22T08:37:49.360+0000 7f609732c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:37:49.523 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-22T08:37:49.360+0000 7f609732c800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:37:49.523 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-22T08:37:49.360+0000 7f609732c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:37:49.523 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-22T08:37:49.360+0000 7f609732c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:37:49.523 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-22T08:37:49.361+0000 7f609732c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 2024-09-22T08:37:49.524 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-22T08:37:49.367+0000 7f609732c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:37:49.524 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-22T08:37:49.367+0000 7f609732c800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:37:49.524 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-22T08:37:49.367+0000 7f609732c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:37:49.524 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-22T08:37:49.367+0000 7f609732c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17, ofs0, ns] 2024-09-22T08:37:49.524 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-22T08:37:49.367+0000 7f5f767fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497034 cookie 93862976887248 notifier 8022 bl.length()=827 2024-09-22T08:37:49.524 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-22T08:37:49.367+0000 7f5f767fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:37:49.524 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-22T08:37:49.367+0000 7f5f767fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:37:49.524 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-22T08:37:49.367+0000 7f5f767fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:37:49.524 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-22T08:37:49.368+0000 7f609732c800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_sources= new_sources= 2024-09-22T08:37:49.524 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-22T08:37:49.368+0000 7f609732c800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential sources added=[] removed=[] 2024-09-22T08:37:49.524 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-22T08:37:49.368+0000 7f609732c800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_dests= new_dests= 2024-09-22T08:37:49.524 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-22T08:37:49.368+0000 7f609732c800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential dests added=[] removed=[] 2024-09-22T08:37:49.524 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.0 2024-09-22T08:37:49.525 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.0 2024-09-22T08:37:49.525 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.1 2024-09-22T08:37:49.525 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.1 2024-09-22T08:37:49.525 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.2 2024-09-22T08:37:49.525 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.2 2024-09-22T08:37:49.525 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.3 2024-09-22T08:37:49.525 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.3 2024-09-22T08:37:49.525 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.4 2024-09-22T08:37:49.525 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.4 2024-09-22T08:37:49.525 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.5 2024-09-22T08:37:49.525 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.5 2024-09-22T08:37:49.525 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.6 2024-09-22T08:37:49.525 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.6 2024-09-22T08:37:49.525 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.7 2024-09-22T08:37:49.526 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.7 2024-09-22T08:37:49.526 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.8 2024-09-22T08:37:49.526 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.8 2024-09-22T08:37:49.526 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.9 2024-09-22T08:37:49.526 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.9 2024-09-22T08:37:49.526 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.10 2024-09-22T08:37:49.526 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.10 2024-09-22T08:37:49.526 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.11 2024-09-22T08:37:49.526 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.11 2024-09-22T08:37:49.526 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.12 2024-09-22T08:37:49.526 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.12 2024-09-22T08:37:49.526 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.13 2024-09-22T08:37:49.526 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.13 2024-09-22T08:37:49.527 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-22T08:37:49.373+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.0 2024-09-22T08:37:49.527 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-22T08:37:49.373+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.0 2024-09-22T08:37:49.527 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-22T08:37:49.374+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.1 2024-09-22T08:37:49.527 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-22T08:37:49.374+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.1 2024-09-22T08:37:49.527 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-22T08:37:49.374+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.2 2024-09-22T08:37:49.527 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-22T08:37:49.374+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.2 2024-09-22T08:37:49.527 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-22T08:37:49.375+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.3 2024-09-22T08:37:49.527 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-22T08:37:49.375+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.3 2024-09-22T08:37:49.527 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-22T08:37:49.375+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.4 2024-09-22T08:37:49.527 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-22T08:37:49.375+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.4 2024-09-22T08:37:49.527 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-22T08:37:49.376+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.5 2024-09-22T08:37:49.527 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-22T08:37:49.376+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.5 2024-09-22T08:37:49.527 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-22T08:37:49.377+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.6 2024-09-22T08:37:49.527 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-22T08:37:49.377+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.6 2024-09-22T08:37:49.528 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-22T08:37:49.377+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.7 2024-09-22T08:37:49.528 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-22T08:37:49.377+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.7 2024-09-22T08:37:49.528 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-22T08:37:49.378+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.8 2024-09-22T08:37:49.528 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-22T08:37:49.378+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.8 2024-09-22T08:37:49.528 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-22T08:37:49.378+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.9 2024-09-22T08:37:49.528 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-22T08:37:49.378+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.9 2024-09-22T08:37:49.528 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-22T08:37:49.379+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.10 2024-09-22T08:37:49.528 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-22T08:37:49.379+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.10 2024-09-22T08:37:49.528 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-22T08:37:49.379+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.11 2024-09-22T08:37:49.528 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-22T08:37:49.379+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.11 2024-09-22T08:37:49.528 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-22T08:37:49.380+0000 7f609732c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.12 2024-09-22T08:37:49.528 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-22T08:37:49.380+0000 7f609732c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.12 2024-09-22T08:37:49.528 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-22T08:37:49.383+0000 7f609732c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f609732c800 time 2024-09-22T08:37:49.383656+0000 2024-09-22T08:37:49.528 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:37:49.528 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:49.529 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:37:49.529 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f609898c748] 2024-09-22T08:37:49.529 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f609898c906] 2024-09-22T08:37:49.529 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555e2c6eee01] 2024-09-22T08:37:49.529 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x555e2c6fde9b] 2024-09-22T08:37:49.529 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x555e2c6fed64] 2024-09-22T08:37:49.529 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-22T08:37:49.529 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f6097629590] 2024-09-22T08:37:49.529 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-22T08:37:49.529 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-22T08:37:49.529 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:49.529 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-22T08:37:49.384+0000 7f609732c800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:37:49.529 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f609732c800 thread_name:radosgw-admin 2024-09-22T08:37:49.529 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:49.530 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:37:49.530 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f609763e6f0] 2024-09-22T08:37:49.530 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f609768b99c] 2024-09-22T08:37:49.530 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:37:49.530 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:37:49.530 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f609898c7a2] 2024-09-22T08:37:49.530 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f609898c906] 2024-09-22T08:37:49.530 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555e2c6eee01] 2024-09-22T08:37:49.530 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x555e2c6fde9b] 2024-09-22T08:37:49.530 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x555e2c6fed64] 2024-09-22T08:37:49.530 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-22T08:37:49.530 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f6097629590] 2024-09-22T08:37:49.530 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-22T08:37:49.531 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-22T08:37:49.531 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:37:49.531 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:37:49.531 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-22T08:37:49.531 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-22T08:37:49.531 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-22T08:37:49.531 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-22T08:37:49.531 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-22T08:37:49.531 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-22T08:37:49.531 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-22T08:37:49.531 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-22T08:37:49.531 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-22T08:37:49.531 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-22T08:37:49.531 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-22T08:37:49.531 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-22T08:37:49.532 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-22T08:37:49.532 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-22T08:37:49.532 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-22T08:37:49.532 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-22T08:37:49.532 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-22T08:37:49.532 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-22T08:37:49.532 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-22T08:37:49.532 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-22T08:37:49.532 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-22T08:37:49.532 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-22T08:37:49.532 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-22T08:37:49.532 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-22T08:37:49.532 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:37:49.532 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-22T08:37:49.532 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-22T08:37:49.533 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-22T08:37:49.533 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-22T08:37:49.533 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-22T08:37:49.533 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-22T08:37:49.533 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-22T08:37:49.533 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-22T08:37:49.533 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-22T08:37:49.533 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-22T08:37:49.533 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-22T08:37:49.533 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-22T08:37:49.533 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-22T08:37:49.533 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-22T08:37:49.533 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-22T08:37:49.533 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-22T08:37:49.534 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-22T08:37:49.534 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-22T08:37:49.534 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-22T08:37:49.534 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-22T08:37:49.534 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-22T08:37:49.534 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:37:49.534 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-22T08:37:49.534 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:37:49.534 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-22T08:37:49.534 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-22T08:37:49.534 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-22T08:37:49.534 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-22T08:37:49.534 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-22T08:37:49.534 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-22T08:37:49.535 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-22T08:37:49.535 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-22T08:37:49.535 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-22T08:37:49.535 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-22T08:37:49.535 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-22T08:37:49.535 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-22T08:37:49.535 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-22T08:37:49.535 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-22T08:37:49.535 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-22T08:37:49.535 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-22T08:37:49.535 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-22T08:37:49.535 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-22T08:37:49.535 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:37:49.535 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-22T08:37:49.536 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:37:49.536 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-22T08:37:49.536 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-22T08:37:49.536 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-22T08:37:49.536 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-22T08:37:49.536 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-22T08:37:49.536 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-22T08:37:49.536 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:37:49.536 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-22T08:37:49.536 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-22T08:37:49.536 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:37:49.536 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-22T08:37:49.536 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-22T08:37:49.536 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-22T08:37:49.536 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-22T08:37:49.537 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-22T08:37:49.537 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-22T08:37:49.537 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-22T08:37:49.537 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-22T08:37:49.537 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-22T08:37:49.537 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-22T08:37:49.537 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-22T08:37:49.537 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-22T08:37:49.537 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-22T08:37:49.537 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:37:49.537 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5f41ffb640 / http_manager 2024-09-22T08:37:49.537 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5f48fe1640 / http_manager 2024-09-22T08:37:49.537 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5f49fe3640 / rgw_dt_lg_renew 2024-09-22T08:37:49.538 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5f74ff9640 / ms_dispatch 2024-09-22T08:37:49.538 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5f767fc640 / io_context_pool 2024-09-22T08:37:49.538 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5f7ce01640 / ms_dispatch 2024-09-22T08:37:49.538 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5f7f606640 / ms_dispatch 2024-09-22T08:37:49.538 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5f80e09640 / io_context_pool 2024-09-22T08:37:49.538 INFO:tasks.workunit.client.0.smithi038.stderr: 7f609273d640 / msgr-worker-2 2024-09-22T08:37:49.538 INFO:tasks.workunit.client.0.smithi038.stderr: 7f6092f3e640 / msgr-worker-1 2024-09-22T08:37:49.538 INFO:tasks.workunit.client.0.smithi038.stderr: 7f609373f640 / msgr-worker-0 2024-09-22T08:37:49.538 INFO:tasks.workunit.client.0.smithi038.stderr: 7f6093f40640 / io_context_pool 2024-09-22T08:37:49.538 INFO:tasks.workunit.client.0.smithi038.stderr: 7f609732c800 / radosgw-admin 2024-09-22T08:37:49.538 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-22T08:37:49.538 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-22T08:37:49.539 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/lib/ceph/crash/2024-09-22T08:37:49.385317Z_36271539-9306-426c-971b-9e203f4e185c/log 2024-09-22T08:37:49.539 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-22T08:37:49.539 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T08:37:49.540 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:49.540 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:49.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.463+0000 7f9160d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.465+0000 7f9160d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.465+0000 7f9160d2c800 20 realm 2024-09-22T08:37:49.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.465+0000 7f9160d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.465+0000 7f9160d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.465+0000 7f9160d2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:49.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.465+0000 7f9160d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.465+0000 7f9160d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.465+0000 7f9160d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.466+0000 7f9160d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:49.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.466+0000 7f9160d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.467+0000 7f9160d2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:37:49.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.467+0000 7f9160d2c800 20 searching for the correct realm 2024-09-22T08:37:49.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.469+0000 7f915ca4f640 0 -- 172.21.15.38:0/3286913612 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x5590903dd540 msgr2=0x5590903dfa00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:49.542 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.473+0000 7f915c24e640 0 -- 172.21.15.38:0/3286913612 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f914c060410 msgr2=0x7f914c069fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:37:49.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.681+0000 7f9160d2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:49.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.681+0000 7f9160d2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:49.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.681+0000 7f9160d2c800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:37:49.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.681+0000 7f9160d2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:49.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.681+0000 7f9160d2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:49.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.681+0000 7f9160d2c800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:37:49.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.681+0000 7f9160d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.681+0000 7f9160d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.681+0000 7f9160d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.682+0000 7f9160d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:49.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.682+0000 7f9160d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.682+0000 7f9160d2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:37:49.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.682+0000 7f9160d2c800 20 zone default found 2024-09-22T08:37:49.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.682+0000 7f9160d2c800 4 Realm: () 2024-09-22T08:37:49.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.682+0000 7f9160d2c800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:37:49.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.682+0000 7f9160d2c800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:37:49.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.682+0000 7f9160d2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:49.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.682+0000 7f9160d2c800 20 zonegroup default 2024-09-22T08:37:49.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.682+0000 7f9160d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.682+0000 7f9160d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.682+0000 7f9160d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.683+0000 7f9160d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.683+0000 7f9160d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.683+0000 7f9160d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.683+0000 7f9160d2c800 20 started sync module instance, tier type = 2024-09-22T08:37:49.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.683+0000 7f9160d2c800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:37:49.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.694+0000 7f9160d2c800 20 add_watcher() i=0 2024-09-22T08:37:49.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.694+0000 7f9160d2c800 20 add_watcher() i=1 2024-09-22T08:37:49.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.694+0000 7f9160d2c800 20 add_watcher() i=2 2024-09-22T08:37:49.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.694+0000 7f9160d2c800 20 add_watcher() i=3 2024-09-22T08:37:49.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.694+0000 7f9160d2c800 20 add_watcher() i=4 2024-09-22T08:37:49.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.694+0000 7f9160d2c800 20 add_watcher() i=5 2024-09-22T08:37:49.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.694+0000 7f9160d2c800 20 add_watcher() i=6 2024-09-22T08:37:49.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.696+0000 7f9160d2c800 20 add_watcher() i=7 2024-09-22T08:37:49.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.696+0000 7f9160d2c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:49.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.697+0000 7f90137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:49.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.698+0000 7f9160d2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:49.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.698+0000 7f9160d2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:49.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.698+0000 7f9160d2c800 5 note: GC not initialized 2024-09-22T08:37:49.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.698+0000 7f90127e4640 20 reqs_thread_entry: start 2024-09-22T08:37:49.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.698+0000 7f9160d2c800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:49.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.698+0000 7f9160d2c800 20 Filter name: none 2024-09-22T08:37:49.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.698+0000 7f900b7fe640 20 reqs_thread_entry: start 2024-09-22T08:37:49.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.698+0000 7f9160d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.699+0000 7f9160d2c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:37:49.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.699+0000 7f9160d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.699+0000 7f9160d2c800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T08:37:49.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.699+0000 7f9160d2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:37:49.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.699+0000 7f9160d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.700+0000 7f9160d2c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:37:49.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.700+0000 7f9160d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.700+0000 7f9160d2c800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T08:37:49.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.700+0000 7f9160d2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:37:49.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.702+0000 7f90137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:49.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.705+0000 7f9160d2c800 20 remove_watcher() i=0 2024-09-22T08:37:49.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.705+0000 7f9160d2c800 2 removed watcher, disabling cache 2024-09-22T08:37:49.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.706+0000 7f9160d2c800 20 remove_watcher() i=1 2024-09-22T08:37:49.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.707+0000 7f9160d2c800 20 remove_watcher() i=2 2024-09-22T08:37:49.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.708+0000 7f9160d2c800 20 remove_watcher() i=3 2024-09-22T08:37:49.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.709+0000 7f9160d2c800 20 remove_watcher() i=4 2024-09-22T08:37:49.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.711+0000 7f9160d2c800 20 remove_watcher() i=5 2024-09-22T08:37:49.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.713+0000 7f9160d2c800 20 remove_watcher() i=6 2024-09-22T08:37:49.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.715+0000 7f9160d2c800 20 remove_watcher() i=7 2024-09-22T08:37:49.730 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:37:49.730 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:37:49.738 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-22T08:37:49.767 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:49.767 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:49.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.806+0000 7fd085440800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.808+0000 7fd085440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.808+0000 7fd085440800 20 realm 2024-09-22T08:37:49.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.808+0000 7fd085440800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.808+0000 7fd085440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.808+0000 7fd085440800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:49.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.808+0000 7fd085440800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.808+0000 7fd085440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.808+0000 7fd085440800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.809+0000 7fd085440800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:49.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.809+0000 7fd085440800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.810+0000 7fd085440800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:37:49.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.810+0000 7fd085440800 20 searching for the correct realm 2024-09-22T08:37:49.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:49.813+0000 7fd08372b640 0 -- 172.21.15.38:0/2720200322 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7fd074057b40 msgr2=0x7fd074064940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:50.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.019+0000 7fd082f2a640 0 -- 172.21.15.38:0/2720200322 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x55f0e2ed27e0 msgr2=0x55f0e2ed4ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:50.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.024+0000 7fd085440800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:50.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.024+0000 7fd085440800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:50.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.024+0000 7fd085440800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:37:50.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.024+0000 7fd085440800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:50.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.024+0000 7fd085440800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:50.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.024+0000 7fd085440800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:37:50.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.024+0000 7fd085440800 20 rados->read ofs=0 len=0 2024-09-22T08:37:50.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.024+0000 7fd085440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:50.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.024+0000 7fd085440800 20 rados->read ofs=0 len=0 2024-09-22T08:37:50.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.024+0000 7fd085440800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:50.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.024+0000 7fd085440800 20 rados->read ofs=0 len=0 2024-09-22T08:37:50.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.025+0000 7fd085440800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:37:50.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.025+0000 7fd085440800 20 zone default found 2024-09-22T08:37:50.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.025+0000 7fd085440800 4 Realm: () 2024-09-22T08:37:50.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.025+0000 7fd085440800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:37:50.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.025+0000 7fd085440800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:37:50.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.025+0000 7fd085440800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:50.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.025+0000 7fd085440800 20 zonegroup default 2024-09-22T08:37:50.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.025+0000 7fd085440800 20 rados->read ofs=0 len=0 2024-09-22T08:37:50.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.025+0000 7fd085440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:50.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.025+0000 7fd085440800 20 rados->read ofs=0 len=0 2024-09-22T08:37:50.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.025+0000 7fd085440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:50.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.025+0000 7fd085440800 20 rados->read ofs=0 len=0 2024-09-22T08:37:50.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.025+0000 7fd085440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:50.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.026+0000 7fd085440800 20 started sync module instance, tier type = 2024-09-22T08:37:50.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.026+0000 7fd085440800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:37:50.037 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.036+0000 7fd085440800 20 add_watcher() i=0 2024-09-22T08:37:50.037 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.036+0000 7fd085440800 20 add_watcher() i=1 2024-09-22T08:37:50.038 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.036+0000 7fd085440800 20 add_watcher() i=2 2024-09-22T08:37:50.038 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.036+0000 7fd085440800 20 add_watcher() i=3 2024-09-22T08:37:50.038 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.036+0000 7fd085440800 20 add_watcher() i=4 2024-09-22T08:37:50.038 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.036+0000 7fd085440800 20 add_watcher() i=5 2024-09-22T08:37:50.038 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.036+0000 7fd085440800 20 add_watcher() i=6 2024-09-22T08:37:50.039 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.037+0000 7fd085440800 20 add_watcher() i=7 2024-09-22T08:37:50.039 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.037+0000 7fd085440800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:50.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.039+0000 7fcf39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:50.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.040+0000 7fd085440800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:50.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.040+0000 7fd085440800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:50.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.040+0000 7fd085440800 5 note: GC not initialized 2024-09-22T08:37:50.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.040+0000 7fcf38fe1640 20 reqs_thread_entry: start 2024-09-22T08:37:50.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.040+0000 7fd085440800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:50.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.040+0000 7fd085440800 20 Filter name: none 2024-09-22T08:37:50.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.040+0000 7fcf31ffb640 20 reqs_thread_entry: start 2024-09-22T08:37:50.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.040+0000 7fd085440800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:37:50.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.040+0000 7fd085440800 20 rados->read ofs=0 len=0 2024-09-22T08:37:50.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.041+0000 7fd085440800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:37:50.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.041+0000 7fd085440800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:37:50.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.041+0000 7fd085440800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:37:50.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.041+0000 7fd085440800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 : miss 2024-09-22T08:37:50.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.041+0000 7fd085440800 20 rados->read ofs=0 len=0 2024-09-22T08:37:50.045 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.041+0000 7fd085440800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T08:37:50.045 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.041+0000 7fd085440800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:37:50.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.041+0000 7fd085440800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:37:50.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.041+0000 7fd085440800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:37:50.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.041+0000 7fd085440800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:37:50.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.041+0000 7fd085440800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 2024-09-22T08:37:50.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.041+0000 7fd085440800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.0 2024-09-22T08:37:50.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.041+0000 7fd085440800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.0 2024-09-22T08:37:50.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.042+0000 7fd085440800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.1 2024-09-22T08:37:50.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.042+0000 7fd085440800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.1 2024-09-22T08:37:50.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.042+0000 7fd085440800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.2 2024-09-22T08:37:50.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.042+0000 7fd085440800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.2 2024-09-22T08:37:50.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.043+0000 7fd085440800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.3 2024-09-22T08:37:50.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.043+0000 7fd085440800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.3 2024-09-22T08:37:50.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.043+0000 7fd085440800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.4 2024-09-22T08:37:50.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.043+0000 7fd085440800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.4 2024-09-22T08:37:50.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.044+0000 7fd085440800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.5 2024-09-22T08:37:50.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.044+0000 7fd085440800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.5 2024-09-22T08:37:50.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.044+0000 7fd085440800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.6 2024-09-22T08:37:50.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.044+0000 7fd085440800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.6 2024-09-22T08:37:50.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.044+0000 7fd085440800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.7 2024-09-22T08:37:50.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.044+0000 7fd085440800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.7 2024-09-22T08:37:50.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.045+0000 7fd085440800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.8 2024-09-22T08:37:50.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.045+0000 7fd085440800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.8 2024-09-22T08:37:50.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.045+0000 7fd085440800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.9 2024-09-22T08:37:50.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.045+0000 7fd085440800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.9 2024-09-22T08:37:50.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.046+0000 7fd085440800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.10 2024-09-22T08:37:50.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.046+0000 7fd085440800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.10 2024-09-22T08:37:50.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.046+0000 7fd085440800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.11 2024-09-22T08:37:50.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.046+0000 7fd085440800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.11 2024-09-22T08:37:50.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.046+0000 7fd085440800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.12 2024-09-22T08:37:50.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.046+0000 7fd085440800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.12 2024-09-22T08:37:50.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.048+0000 7fcf39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:50.051 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.050+0000 7fd085440800 20 remove_watcher() i=0 2024-09-22T08:37:50.051 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.050+0000 7fd085440800 2 removed watcher, disabling cache 2024-09-22T08:37:50.053 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.052+0000 7fd085440800 20 remove_watcher() i=1 2024-09-22T08:37:50.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.053+0000 7fd085440800 20 remove_watcher() i=2 2024-09-22T08:37:50.055 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.054+0000 7fd085440800 20 remove_watcher() i=3 2024-09-22T08:37:50.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.055+0000 7fd085440800 20 remove_watcher() i=4 2024-09-22T08:37:50.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.056+0000 7fd085440800 20 remove_watcher() i=5 2024-09-22T08:37:50.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.057+0000 7fd085440800 20 remove_watcher() i=6 2024-09-22T08:37:50.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:37:50.059+0000 7fd085440800 20 remove_watcher() i=7 2024-09-22T08:38:20.091 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T08:38:20.125 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:20.125 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:20.171 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.170+0000 7f9b45f0c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:20.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.173+0000 7f9b45f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:20.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.173+0000 7f9b45f0c800 20 realm 2024-09-22T08:38:20.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.173+0000 7f9b45f0c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:20.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.173+0000 7f9b45f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:20.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.173+0000 7f9b45f0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:20.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.173+0000 7f9b45f0c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:20.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.173+0000 7f9b45f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:20.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.173+0000 7f9b45f0c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:20.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.174+0000 7f9b45f0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:20.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.174+0000 7f9b45f0c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:20.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.175+0000 7f9b45f0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:38:20.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.175+0000 7f9b45f0c800 20 searching for the correct realm 2024-09-22T08:38:20.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.177+0000 7f9b431f5640 0 -- 172.21.15.38:0/3053833660 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f9b38018070 msgr2=0x7f9b38075a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:38:20.384 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.383+0000 7f9b431f5640 0 -- 172.21.15.38:0/3053833660 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f9b340ad3b0 msgr2=0x7f9b340d0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:20.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.591+0000 7f9b45f0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:20.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.591+0000 7f9b45f0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:20.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.591+0000 7f9b45f0c800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:38:20.593 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.591+0000 7f9b45f0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:20.593 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.591+0000 7f9b45f0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:20.593 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.591+0000 7f9b45f0c800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:38:20.593 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.591+0000 7f9b45f0c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:20.594 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.591+0000 7f9b45f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:20.594 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.591+0000 7f9b45f0c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:20.594 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.592+0000 7f9b45f0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:20.594 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.592+0000 7f9b45f0c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:20.594 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.592+0000 7f9b45f0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:38:20.594 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.592+0000 7f9b45f0c800 20 zone default found 2024-09-22T08:38:20.594 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.592+0000 7f9b45f0c800 4 Realm: () 2024-09-22T08:38:20.594 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.592+0000 7f9b45f0c800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:38:20.594 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.592+0000 7f9b45f0c800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:38:20.594 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.592+0000 7f9b45f0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:20.594 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.592+0000 7f9b45f0c800 20 zonegroup default 2024-09-22T08:38:20.594 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.592+0000 7f9b45f0c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:20.594 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.593+0000 7f9b45f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:20.595 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.593+0000 7f9b45f0c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:20.595 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.593+0000 7f9b45f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:20.595 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.593+0000 7f9b45f0c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:20.595 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.594+0000 7f9b45f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:20.595 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.594+0000 7f9b45f0c800 20 started sync module instance, tier type = 2024-09-22T08:38:20.595 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.594+0000 7f9b45f0c800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:38:20.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.607+0000 7f9b45f0c800 20 add_watcher() i=0 2024-09-22T08:38:20.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.607+0000 7f9b45f0c800 20 add_watcher() i=1 2024-09-22T08:38:20.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.607+0000 7f9b45f0c800 20 add_watcher() i=2 2024-09-22T08:38:20.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.607+0000 7f9b45f0c800 20 add_watcher() i=3 2024-09-22T08:38:20.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.607+0000 7f9b45f0c800 20 add_watcher() i=4 2024-09-22T08:38:20.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.607+0000 7f9b45f0c800 20 add_watcher() i=5 2024-09-22T08:38:20.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.607+0000 7f9b45f0c800 20 add_watcher() i=6 2024-09-22T08:38:20.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.608+0000 7f9b45f0c800 20 add_watcher() i=7 2024-09-22T08:38:20.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.608+0000 7f9b45f0c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:20.611 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.610+0000 7f99f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:20.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.611+0000 7f9b45f0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:20.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.611+0000 7f9b45f0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:20.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.611+0000 7f9b45f0c800 5 note: GC not initialized 2024-09-22T08:38:20.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.611+0000 7f99f8fe1640 20 reqs_thread_entry: start 2024-09-22T08:38:20.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.611+0000 7f9b45f0c800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:20.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.611+0000 7f9b45f0c800 20 Filter name: none 2024-09-22T08:38:20.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.611+0000 7f99727fc640 20 reqs_thread_entry: start 2024-09-22T08:38:20.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.612+0000 7f9b45f0c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:20.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.612+0000 7f9b45f0c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:38:20.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.612+0000 7f9b45f0c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:20.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.612+0000 7f9b45f0c800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T08:38:20.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.613+0000 7f9b45f0c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:38:20.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.613+0000 7f9b45f0c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:20.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.613+0000 7f9b45f0c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:38:20.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.613+0000 7f9b45f0c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:20.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.613+0000 7f9b45f0c800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T08:38:20.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.613+0000 7f9b45f0c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:38:20.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.616+0000 7f99f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:20.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.618+0000 7f9b45f0c800 20 remove_watcher() i=0 2024-09-22T08:38:20.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.618+0000 7f9b45f0c800 2 removed watcher, disabling cache 2024-09-22T08:38:20.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.620+0000 7f9b45f0c800 20 remove_watcher() i=1 2024-09-22T08:38:20.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.621+0000 7f9b45f0c800 20 remove_watcher() i=2 2024-09-22T08:38:20.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.622+0000 7f9b45f0c800 20 remove_watcher() i=3 2024-09-22T08:38:20.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.624+0000 7f9b45f0c800 20 remove_watcher() i=4 2024-09-22T08:38:20.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.625+0000 7f9b45f0c800 20 remove_watcher() i=5 2024-09-22T08:38:20.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.626+0000 7f9b45f0c800 20 remove_watcher() i=6 2024-09-22T08:38:20.629 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.628+0000 7f9b45f0c800 20 remove_watcher() i=7 2024-09-22T08:38:20.645 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:38:20.645 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:38:20.669 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-22T08:38:20.699 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:20.699 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:20.741 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.739+0000 7fb3a032e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:20.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.741+0000 7fb3a032e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:20.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.741+0000 7fb3a032e800 20 realm 2024-09-22T08:38:20.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.741+0000 7fb3a032e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:20.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.741+0000 7fb3a032e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:20.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.741+0000 7fb3a032e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:20.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.741+0000 7fb3a032e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:20.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.742+0000 7fb3a032e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:20.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.742+0000 7fb3a032e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:20.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.742+0000 7fb3a032e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:20.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.742+0000 7fb3a032e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:20.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.743+0000 7fb3a032e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:38:20.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.743+0000 7fb3a032e800 20 searching for the correct realm 2024-09-22T08:38:20.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.746+0000 7fb39bf64640 0 -- 172.21.15.38:0/453049562 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x5637caa8c770 msgr2=0x5637caa8ec30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:20.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.749+0000 7fb39b763640 0 -- 172.21.15.38:0/453049562 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fb38c094920 msgr2=0x7fb38c065410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:38:20.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.957+0000 7fb3a032e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:20.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.957+0000 7fb3a032e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:20.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.957+0000 7fb3a032e800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:38:20.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.957+0000 7fb3a032e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:20.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.957+0000 7fb3a032e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:20.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.957+0000 7fb3a032e800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:38:20.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.957+0000 7fb3a032e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:20.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.957+0000 7fb3a032e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:20.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.957+0000 7fb3a032e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:20.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.957+0000 7fb3a032e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:20.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.957+0000 7fb3a032e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:20.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.958+0000 7fb3a032e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:38:20.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.958+0000 7fb3a032e800 20 zone default found 2024-09-22T08:38:20.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.958+0000 7fb3a032e800 4 Realm: () 2024-09-22T08:38:20.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.958+0000 7fb3a032e800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:38:20.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.958+0000 7fb3a032e800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:38:20.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.958+0000 7fb3a032e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:20.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.958+0000 7fb3a032e800 20 zonegroup default 2024-09-22T08:38:20.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.958+0000 7fb3a032e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:20.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.958+0000 7fb3a032e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:20.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.958+0000 7fb3a032e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:20.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.959+0000 7fb3a032e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:20.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.959+0000 7fb3a032e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:20.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.959+0000 7fb3a032e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:20.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.959+0000 7fb3a032e800 20 started sync module instance, tier type = 2024-09-22T08:38:20.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.959+0000 7fb3a032e800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:38:20.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.970+0000 7fb3a032e800 20 add_watcher() i=0 2024-09-22T08:38:20.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.970+0000 7fb3a032e800 20 add_watcher() i=1 2024-09-22T08:38:20.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.970+0000 7fb3a032e800 20 add_watcher() i=2 2024-09-22T08:38:20.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.970+0000 7fb3a032e800 20 add_watcher() i=3 2024-09-22T08:38:20.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.970+0000 7fb3a032e800 20 add_watcher() i=4 2024-09-22T08:38:20.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.970+0000 7fb3a032e800 20 add_watcher() i=5 2024-09-22T08:38:20.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.970+0000 7fb3a032e800 20 add_watcher() i=6 2024-09-22T08:38:20.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.971+0000 7fb3a032e800 20 add_watcher() i=7 2024-09-22T08:38:20.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.971+0000 7fb3a032e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:20.973 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.972+0000 7fb251fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:20.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.973+0000 7fb3a032e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:20.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.973+0000 7fb3a032e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:20.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.973+0000 7fb3a032e800 5 note: GC not initialized 2024-09-22T08:38:20.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.973+0000 7fb250fe1640 20 reqs_thread_entry: start 2024-09-22T08:38:20.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.973+0000 7fb3a032e800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:20.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.973+0000 7fb3a032e800 20 Filter name: none 2024-09-22T08:38:20.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.973+0000 7fb1ca7fc640 20 reqs_thread_entry: start 2024-09-22T08:38:20.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.973+0000 7fb3a032e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:38:20.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.973+0000 7fb3a032e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:20.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.974+0000 7fb3a032e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:38:20.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.974+0000 7fb3a032e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:38:20.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.974+0000 7fb3a032e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:38:20.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.974+0000 7fb3a032e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 : miss 2024-09-22T08:38:20.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.974+0000 7fb3a032e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:20.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.974+0000 7fb3a032e800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T08:38:20.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.974+0000 7fb3a032e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:38:20.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.974+0000 7fb3a032e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:38:20.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.974+0000 7fb3a032e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:38:20.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.974+0000 7fb3a032e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:38:20.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.974+0000 7fb3a032e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 2024-09-22T08:38:20.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.974+0000 7fb3a032e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.0 2024-09-22T08:38:20.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.974+0000 7fb3a032e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.0 2024-09-22T08:38:20.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.975+0000 7fb3a032e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.1 2024-09-22T08:38:20.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.975+0000 7fb3a032e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.1 2024-09-22T08:38:20.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.975+0000 7fb3a032e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.2 2024-09-22T08:38:20.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.975+0000 7fb3a032e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.2 2024-09-22T08:38:20.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.976+0000 7fb3a032e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.3 2024-09-22T08:38:20.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.976+0000 7fb3a032e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.3 2024-09-22T08:38:20.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.976+0000 7fb3a032e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.4 2024-09-22T08:38:20.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.976+0000 7fb3a032e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.4 2024-09-22T08:38:20.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.976+0000 7fb3a032e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.5 2024-09-22T08:38:20.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.976+0000 7fb3a032e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.5 2024-09-22T08:38:20.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.977+0000 7fb3a032e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.6 2024-09-22T08:38:20.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.977+0000 7fb3a032e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.6 2024-09-22T08:38:20.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.977+0000 7fb3a032e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.7 2024-09-22T08:38:20.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.977+0000 7fb3a032e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.7 2024-09-22T08:38:20.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.978+0000 7fb3a032e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.8 2024-09-22T08:38:20.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.978+0000 7fb3a032e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.8 2024-09-22T08:38:20.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.978+0000 7fb3a032e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.9 2024-09-22T08:38:20.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.978+0000 7fb3a032e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.9 2024-09-22T08:38:20.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.978+0000 7fb3a032e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.10 2024-09-22T08:38:20.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.978+0000 7fb3a032e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.10 2024-09-22T08:38:20.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.979+0000 7fb3a032e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.11 2024-09-22T08:38:20.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.979+0000 7fb3a032e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.11 2024-09-22T08:38:20.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.979+0000 7fb3a032e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.12 2024-09-22T08:38:20.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.979+0000 7fb3a032e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.12 2024-09-22T08:38:20.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.980+0000 7fb251fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:20.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.983+0000 7fb3a032e800 20 remove_watcher() i=0 2024-09-22T08:38:20.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.983+0000 7fb3a032e800 2 removed watcher, disabling cache 2024-09-22T08:38:20.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.984+0000 7fb3a032e800 20 remove_watcher() i=1 2024-09-22T08:38:20.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.985+0000 7fb3a032e800 20 remove_watcher() i=2 2024-09-22T08:38:20.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.987+0000 7fb3a032e800 20 remove_watcher() i=3 2024-09-22T08:38:20.989 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.988+0000 7fb3a032e800 20 remove_watcher() i=4 2024-09-22T08:38:20.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.989+0000 7fb3a032e800 20 remove_watcher() i=5 2024-09-22T08:38:20.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.990+0000 7fb3a032e800 20 remove_watcher() i=6 2024-09-22T08:38:20.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:20.991+0000 7fb3a032e800 20 remove_watcher() i=7 2024-09-22T08:38:21.006 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T08:38:21.036 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:21.036 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:21.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.075+0000 7fd7f4c16800 20 rados->read ofs=0 len=0 2024-09-22T08:38:21.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.076+0000 7fd7f4c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:21.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.076+0000 7fd7f4c16800 20 realm 2024-09-22T08:38:21.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.076+0000 7fd7f4c16800 20 rados->read ofs=0 len=0 2024-09-22T08:38:21.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.077+0000 7fd7f4c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:21.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.077+0000 7fd7f4c16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:21.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.077+0000 7fd7f4c16800 20 rados->read ofs=0 len=0 2024-09-22T08:38:21.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.077+0000 7fd7f4c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:21.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.077+0000 7fd7f4c16800 20 rados->read ofs=0 len=0 2024-09-22T08:38:21.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.078+0000 7fd7f4c16800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:21.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.078+0000 7fd7f4c16800 20 rados->read ofs=0 len=0 2024-09-22T08:38:21.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.078+0000 7fd7f4c16800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:38:21.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.078+0000 7fd7f4c16800 20 searching for the correct realm 2024-09-22T08:38:21.082 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.081+0000 7fd7f03e7640 0 -- 172.21.15.38:0/2382372545 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x562158fc6990 msgr2=0x562158fc8e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:21.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.084+0000 7fd7efbe6640 0 -- 172.21.15.38:0/2382372545 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fd7e0037450 msgr2=0x7fd7e0037890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:21.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.291+0000 7fd7f4c16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:21.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.291+0000 7fd7f4c16800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:21.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.291+0000 7fd7f4c16800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:38:21.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.291+0000 7fd7f4c16800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:21.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.291+0000 7fd7f4c16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:21.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.291+0000 7fd7f4c16800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:38:21.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.291+0000 7fd7f4c16800 20 rados->read ofs=0 len=0 2024-09-22T08:38:21.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.291+0000 7fd7f4c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:21.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.291+0000 7fd7f4c16800 20 rados->read ofs=0 len=0 2024-09-22T08:38:21.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.292+0000 7fd7f4c16800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:21.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.292+0000 7fd7f4c16800 20 rados->read ofs=0 len=0 2024-09-22T08:38:21.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.292+0000 7fd7f4c16800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:38:21.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.292+0000 7fd7f4c16800 20 zone default found 2024-09-22T08:38:21.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.292+0000 7fd7f4c16800 4 Realm: () 2024-09-22T08:38:21.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.292+0000 7fd7f4c16800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:38:21.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.292+0000 7fd7f4c16800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:38:21.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.292+0000 7fd7f4c16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:21.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.292+0000 7fd7f4c16800 20 zonegroup default 2024-09-22T08:38:21.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.292+0000 7fd7f4c16800 20 rados->read ofs=0 len=0 2024-09-22T08:38:21.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.293+0000 7fd7f4c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:21.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.293+0000 7fd7f4c16800 20 rados->read ofs=0 len=0 2024-09-22T08:38:21.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.293+0000 7fd7f4c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:21.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.293+0000 7fd7f4c16800 20 rados->read ofs=0 len=0 2024-09-22T08:38:21.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.293+0000 7fd7f4c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:21.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.293+0000 7fd7f4c16800 20 started sync module instance, tier type = 2024-09-22T08:38:21.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.293+0000 7fd7f4c16800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:38:21.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.304+0000 7fd7f4c16800 20 add_watcher() i=0 2024-09-22T08:38:21.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.304+0000 7fd7f4c16800 20 add_watcher() i=1 2024-09-22T08:38:21.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.304+0000 7fd7f4c16800 20 add_watcher() i=2 2024-09-22T08:38:21.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.304+0000 7fd7f4c16800 20 add_watcher() i=3 2024-09-22T08:38:21.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.304+0000 7fd7f4c16800 20 add_watcher() i=4 2024-09-22T08:38:21.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.304+0000 7fd7f4c16800 20 add_watcher() i=5 2024-09-22T08:38:21.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.304+0000 7fd7f4c16800 20 add_watcher() i=6 2024-09-22T08:38:21.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.306+0000 7fd7f4c16800 20 add_watcher() i=7 2024-09-22T08:38:21.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.306+0000 7fd7f4c16800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:21.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.307+0000 7fd6a77de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:21.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.308+0000 7fd7f4c16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:21.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.308+0000 7fd7f4c16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:21.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.308+0000 7fd7f4c16800 5 note: GC not initialized 2024-09-22T08:38:21.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.308+0000 7fd6a67dc640 20 reqs_thread_entry: start 2024-09-22T08:38:21.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.308+0000 7fd7f4c16800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:21.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.308+0000 7fd7f4c16800 20 Filter name: none 2024-09-22T08:38:21.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.308+0000 7fd69f7fe640 20 reqs_thread_entry: start 2024-09-22T08:38:21.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.308+0000 7fd7f4c16800 20 rados->read ofs=0 len=0 2024-09-22T08:38:21.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.309+0000 7fd7f4c16800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:38:21.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.309+0000 7fd7f4c16800 20 rados->read ofs=0 len=0 2024-09-22T08:38:21.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.309+0000 7fd7f4c16800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T08:38:21.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.309+0000 7fd7f4c16800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:38:21.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.309+0000 7fd7f4c16800 20 rados->read ofs=0 len=0 2024-09-22T08:38:21.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.310+0000 7fd7f4c16800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:38:21.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.310+0000 7fd7f4c16800 20 rados->read ofs=0 len=0 2024-09-22T08:38:21.312 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.310+0000 7fd7f4c16800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T08:38:21.312 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.310+0000 7fd7f4c16800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:38:21.313 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.312+0000 7fd6a77de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:21.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.314+0000 7fd7f4c16800 20 remove_watcher() i=0 2024-09-22T08:38:21.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.314+0000 7fd7f4c16800 2 removed watcher, disabling cache 2024-09-22T08:38:21.316 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.315+0000 7fd7f4c16800 20 remove_watcher() i=1 2024-09-22T08:38:21.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.317+0000 7fd7f4c16800 20 remove_watcher() i=2 2024-09-22T08:38:21.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.318+0000 7fd7f4c16800 20 remove_watcher() i=3 2024-09-22T08:38:21.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.319+0000 7fd7f4c16800 20 remove_watcher() i=4 2024-09-22T08:38:21.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.320+0000 7fd7f4c16800 20 remove_watcher() i=5 2024-09-22T08:38:21.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.321+0000 7fd7f4c16800 20 remove_watcher() i=6 2024-09-22T08:38:21.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.323+0000 7fd7f4c16800 20 remove_watcher() i=7 2024-09-22T08:38:21.336 INFO:tasks.workunit.client.0.smithi038.stderr: test: duplicated entries should be purged before reshard 2024-09-22T08:38:21.338 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T08:38:21.368 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:21.368 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:21.407 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.406+0000 7f0f6952c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:21.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.408+0000 7f0f6952c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:21.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.408+0000 7f0f6952c800 20 realm 2024-09-22T08:38:21.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.408+0000 7f0f6952c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:21.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.409+0000 7f0f6952c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:21.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.409+0000 7f0f6952c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:21.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.409+0000 7f0f6952c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:21.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.409+0000 7f0f6952c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:21.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.409+0000 7f0f6952c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:21.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.410+0000 7f0f6952c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:21.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.410+0000 7f0f6952c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:21.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.410+0000 7f0f6952c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:38:21.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.410+0000 7f0f6952c800 20 searching for the correct realm 2024-09-22T08:38:21.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.413+0000 7f0f64a4e640 0 -- 172.21.15.38:0/3787413642 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f0f500bf070 msgr2=0x7f0f50057ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:21.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.417+0000 7f0f64a4e640 0 -- 172.21.15.38:0/3787413642 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f0f60018070 msgr2=0x7f0f60008410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:21.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.623+0000 7f0f6952c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:21.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.623+0000 7f0f6952c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:21.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.623+0000 7f0f6952c800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:38:21.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.623+0000 7f0f6952c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:21.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.623+0000 7f0f6952c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:21.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.623+0000 7f0f6952c800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:38:21.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.623+0000 7f0f6952c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:21.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.624+0000 7f0f6952c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:21.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.624+0000 7f0f6952c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:21.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.624+0000 7f0f6952c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:21.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.624+0000 7f0f6952c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:21.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.624+0000 7f0f6952c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:38:21.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.624+0000 7f0f6952c800 20 zone default found 2024-09-22T08:38:21.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.624+0000 7f0f6952c800 4 Realm: () 2024-09-22T08:38:21.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.624+0000 7f0f6952c800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:38:21.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.624+0000 7f0f6952c800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:38:21.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.624+0000 7f0f6952c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:21.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.624+0000 7f0f6952c800 20 zonegroup default 2024-09-22T08:38:21.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.624+0000 7f0f6952c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:21.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.625+0000 7f0f6952c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:21.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.625+0000 7f0f6952c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:21.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.625+0000 7f0f6952c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:21.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.625+0000 7f0f6952c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:21.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.625+0000 7f0f6952c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:21.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.625+0000 7f0f6952c800 20 started sync module instance, tier type = 2024-09-22T08:38:21.628 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.625+0000 7f0f6952c800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:38:21.637 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.636+0000 7f0f6952c800 20 add_watcher() i=0 2024-09-22T08:38:21.637 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.636+0000 7f0f6952c800 20 add_watcher() i=1 2024-09-22T08:38:21.637 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.636+0000 7f0f6952c800 20 add_watcher() i=2 2024-09-22T08:38:21.637 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.636+0000 7f0f6952c800 20 add_watcher() i=3 2024-09-22T08:38:21.637 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.636+0000 7f0f6952c800 20 add_watcher() i=4 2024-09-22T08:38:21.637 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.636+0000 7f0f6952c800 20 add_watcher() i=5 2024-09-22T08:38:21.637 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.636+0000 7f0f6952c800 20 add_watcher() i=6 2024-09-22T08:38:21.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.637+0000 7f0f6952c800 20 add_watcher() i=7 2024-09-22T08:38:21.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.637+0000 7f0f6952c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:21.639 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.638+0000 7f0e1b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:21.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.639+0000 7f0f6952c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:21.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.639+0000 7f0f6952c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:21.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.639+0000 7f0f6952c800 5 note: GC not initialized 2024-09-22T08:38:21.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.639+0000 7f0e1a7e4640 20 reqs_thread_entry: start 2024-09-22T08:38:21.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.639+0000 7f0f6952c800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:21.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.639+0000 7f0f6952c800 20 Filter name: none 2024-09-22T08:38:21.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.639+0000 7f0d8bfff640 20 reqs_thread_entry: start 2024-09-22T08:38:21.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.639+0000 7f0f6952c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:21.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.640+0000 7f0f6952c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:38:21.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.640+0000 7f0f6952c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:21.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.640+0000 7f0f6952c800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T08:38:21.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.640+0000 7f0f6952c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:38:21.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.640+0000 7f0f6952c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:21.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.641+0000 7f0f6952c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:38:21.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.641+0000 7f0f6952c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:21.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.641+0000 7f0f6952c800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T08:38:21.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.641+0000 7f0f6952c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:38:21.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.643+0000 7f0e1b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:21.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.646+0000 7f0f6952c800 20 remove_watcher() i=0 2024-09-22T08:38:21.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.646+0000 7f0f6952c800 2 removed watcher, disabling cache 2024-09-22T08:38:21.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.647+0000 7f0f6952c800 20 remove_watcher() i=1 2024-09-22T08:38:21.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.648+0000 7f0f6952c800 20 remove_watcher() i=2 2024-09-22T08:38:21.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.649+0000 7f0f6952c800 20 remove_watcher() i=3 2024-09-22T08:38:21.651 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.650+0000 7f0f6952c800 20 remove_watcher() i=4 2024-09-22T08:38:21.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.651+0000 7f0f6952c800 20 remove_watcher() i=5 2024-09-22T08:38:21.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.652+0000 7f0f6952c800 20 remove_watcher() i=6 2024-09-22T08:38:21.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.653+0000 7f0f6952c800 20 remove_watcher() i=7 2024-09-22T08:38:21.666 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:21.666 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:38:21.666 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: a-bucket id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 num_objects: 10 size_kb: 1 num_shards: 13 2024-09-22T08:38:21.666 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:21.667 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-22T08:38:21.702 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:21.703 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:21.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.741+0000 7f44ef175800 20 rados->read ofs=0 len=0 2024-09-22T08:38:21.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.743+0000 7f44ef175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:21.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.743+0000 7f44ef175800 20 realm 2024-09-22T08:38:21.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.743+0000 7f44ef175800 20 rados->read ofs=0 len=0 2024-09-22T08:38:21.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.744+0000 7f44ef175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:21.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.744+0000 7f44ef175800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:21.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.744+0000 7f44ef175800 20 rados->read ofs=0 len=0 2024-09-22T08:38:21.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.744+0000 7f44ef175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:21.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.744+0000 7f44ef175800 20 rados->read ofs=0 len=0 2024-09-22T08:38:21.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.745+0000 7f44ef175800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:21.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.745+0000 7f44ef175800 20 rados->read ofs=0 len=0 2024-09-22T08:38:21.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.745+0000 7f44ef175800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:38:21.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.745+0000 7f44ef175800 20 searching for the correct realm 2024-09-22T08:38:21.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.747+0000 7f44ec45e640 0 -- 172.21.15.38:0/3578622760 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f44d4017070 msgr2=0x7f44d4076bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:38:21.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:21.953+0000 7f44ec45e640 0 -- 172.21.15.38:0/3578622760 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f44dc0713f0 msgr2=0x7f44dc071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:38:22.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.161+0000 7f44ef175800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:22.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.161+0000 7f44ef175800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:22.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.161+0000 7f44ef175800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:38:22.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.161+0000 7f44ef175800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:22.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.161+0000 7f44ef175800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:22.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.161+0000 7f44ef175800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:38:22.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.161+0000 7f44ef175800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.162+0000 7f44ef175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:22.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.162+0000 7f44ef175800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.162+0000 7f44ef175800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:22.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.162+0000 7f44ef175800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.162+0000 7f44ef175800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:38:22.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.162+0000 7f44ef175800 20 zone default found 2024-09-22T08:38:22.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.162+0000 7f44ef175800 4 Realm: () 2024-09-22T08:38:22.165 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.162+0000 7f44ef175800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:38:22.165 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.162+0000 7f44ef175800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:38:22.165 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.162+0000 7f44ef175800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:22.165 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.162+0000 7f44ef175800 20 zonegroup default 2024-09-22T08:38:22.165 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.162+0000 7f44ef175800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.165 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.163+0000 7f44ef175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:22.165 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.163+0000 7f44ef175800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.165 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.163+0000 7f44ef175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:22.165 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.163+0000 7f44ef175800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.166 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.164+0000 7f44ef175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:22.166 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.164+0000 7f44ef175800 20 started sync module instance, tier type = 2024-09-22T08:38:22.166 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.164+0000 7f44ef175800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:38:22.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.174+0000 7f44ef175800 20 add_watcher() i=0 2024-09-22T08:38:22.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.174+0000 7f44ef175800 20 add_watcher() i=1 2024-09-22T08:38:22.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.174+0000 7f44ef175800 20 add_watcher() i=2 2024-09-22T08:38:22.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.174+0000 7f44ef175800 20 add_watcher() i=3 2024-09-22T08:38:22.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.174+0000 7f44ef175800 20 add_watcher() i=4 2024-09-22T08:38:22.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.174+0000 7f44ef175800 20 add_watcher() i=5 2024-09-22T08:38:22.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.174+0000 7f44ef175800 20 add_watcher() i=6 2024-09-22T08:38:22.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.175+0000 7f44ef175800 20 add_watcher() i=7 2024-09-22T08:38:22.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.175+0000 7f44ef175800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:22.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.177+0000 7f43a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:22.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.178+0000 7f44ef175800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:22.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.178+0000 7f44ef175800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:22.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.178+0000 7f44ef175800 5 note: GC not initialized 2024-09-22T08:38:22.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.178+0000 7f43a1fe3640 20 reqs_thread_entry: start 2024-09-22T08:38:22.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.178+0000 7f44ef175800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:22.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.178+0000 7f44ef175800 20 Filter name: none 2024-09-22T08:38:22.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.178+0000 7f43137fe640 20 reqs_thread_entry: start 2024-09-22T08:38:22.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.179+0000 7f44ef175800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:38:22.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.179+0000 7f44ef175800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.179+0000 7f44ef175800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:38:22.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.179+0000 7f44ef175800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:38:22.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.179+0000 7f44ef175800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:38:22.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.179+0000 7f44ef175800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 : miss 2024-09-22T08:38:22.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.179+0000 7f44ef175800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.180+0000 7f44ef175800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T08:38:22.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.180+0000 7f44ef175800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:38:22.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.180+0000 7f44ef175800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:38:22.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.180+0000 7f44ef175800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:38:22.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.180+0000 7f44ef175800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:38:22.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.180+0000 7f44ef175800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 2024-09-22T08:38:22.187 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.186+0000 7f44ef175800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:38:22.187 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.186+0000 7f44ef175800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:38:22.187 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.186+0000 7f44ef175800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:38:22.187 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.186+0000 7f44ef175800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17, ofs0, ns] 2024-09-22T08:38:22.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.186+0000 7f43c3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497036 cookie 94763874628688 notifier 7664 bl.length()=827 2024-09-22T08:38:22.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.186+0000 7f43c3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:38:22.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.186+0000 7f43c3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:38:22.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.186+0000 7f43c3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:38:22.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.187+0000 7f44ef175800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_sources= new_sources= 2024-09-22T08:38:22.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.187+0000 7f44ef175800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential sources added=[] removed=[] 2024-09-22T08:38:22.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.187+0000 7f44ef175800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_dests= new_dests= 2024-09-22T08:38:22.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.187+0000 7f44ef175800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential dests added=[] removed=[] 2024-09-22T08:38:22.193 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f44ef175800 time 2024-09-22T08:38:22.193423+0000 2024-09-22T08:38:22.193 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:38:22.194 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:38:22.194 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f44f278c748] 2024-09-22T08:38:22.194 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f44f278c906] 2024-09-22T08:38:22.194 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562fede3de01] 2024-09-22T08:38:22.194 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562fede4dd0a] 2024-09-22T08:38:22.194 INFO:tasks.workunit.client.0.smithi038.stderr: 5: main() 2024-09-22T08:38:22.194 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f44f1429590] 2024-09-22T08:38:22.194 INFO:tasks.workunit.client.0.smithi038.stderr: 7: __libc_start_main() 2024-09-22T08:38:22.194 INFO:tasks.workunit.client.0.smithi038.stderr: 8: _start() 2024-09-22T08:38:22.195 INFO:tasks.workunit.client.0.smithi038.stderr:*** Caught signal (Aborted) ** 2024-09-22T08:38:22.195 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f44ef175800 thread_name:radosgw-admin 2024-09-22T08:38:22.195 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.193+0000 7f44ef175800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f44ef175800 time 2024-09-22T08:38:22.193423+0000 2024-09-22T08:38:22.195 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:38:22.195 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:22.195 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:38:22.195 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f44f278c748] 2024-09-22T08:38:22.195 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f44f278c906] 2024-09-22T08:38:22.195 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562fede3de01] 2024-09-22T08:38:22.195 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562fede4dd0a] 2024-09-22T08:38:22.195 INFO:tasks.workunit.client.0.smithi038.stderr: 5: main() 2024-09-22T08:38:22.195 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f44f1429590] 2024-09-22T08:38:22.195 INFO:tasks.workunit.client.0.smithi038.stderr: 7: __libc_start_main() 2024-09-22T08:38:22.195 INFO:tasks.workunit.client.0.smithi038.stderr: 8: _start() 2024-09-22T08:38:22.196 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:22.207 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:38:22.207 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f44f143e6f0] 2024-09-22T08:38:22.207 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f44f148b99c] 2024-09-22T08:38:22.208 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:38:22.208 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:38:22.208 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f44f278c7a2] 2024-09-22T08:38:22.208 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f44f278c906] 2024-09-22T08:38:22.208 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562fede3de01] 2024-09-22T08:38:22.208 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562fede4dd0a] 2024-09-22T08:38:22.208 INFO:tasks.workunit.client.0.smithi038.stderr: 9: main() 2024-09-22T08:38:22.208 INFO:tasks.workunit.client.0.smithi038.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f44f1429590] 2024-09-22T08:38:22.208 INFO:tasks.workunit.client.0.smithi038.stderr: 11: __libc_start_main() 2024-09-22T08:38:22.208 INFO:tasks.workunit.client.0.smithi038.stderr: 12: _start() 2024-09-22T08:38:22.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.194+0000 7f44ef175800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:38:22.208 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f44ef175800 thread_name:radosgw-admin 2024-09-22T08:38:22.208 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:22.208 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:38:22.209 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f44f143e6f0] 2024-09-22T08:38:22.209 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f44f148b99c] 2024-09-22T08:38:22.209 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:38:22.209 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:38:22.209 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f44f278c7a2] 2024-09-22T08:38:22.209 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f44f278c906] 2024-09-22T08:38:22.209 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562fede3de01] 2024-09-22T08:38:22.209 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562fede4dd0a] 2024-09-22T08:38:22.209 INFO:tasks.workunit.client.0.smithi038.stderr: 9: main() 2024-09-22T08:38:22.209 INFO:tasks.workunit.client.0.smithi038.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f44f1429590] 2024-09-22T08:38:22.209 INFO:tasks.workunit.client.0.smithi038.stderr: 11: __libc_start_main() 2024-09-22T08:38:22.209 INFO:tasks.workunit.client.0.smithi038.stderr: 12: _start() 2024-09-22T08:38:22.209 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:38:22.209 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:22.210 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-22T08:38:22.210 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-22T08:38:21.723+0000 7f43dae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:22.210 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-22T08:38:21.723+0000 7f43dae0d640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:38:22.210 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-22T08:38:21.723+0000 7f43dae0d640 10 monclient: dump: 2024-09-22T08:38:22.210 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:38:22.210 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:38:22.210 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:22.210 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:22.210 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:22.210 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:22.210 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:38:22.210 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:38:22.210 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:38:22.210 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:22.211 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-22T08:38:21.723+0000 7f43dae0d640 10 monclient: _finish_auth 0 2024-09-22T08:38:22.211 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-22T08:38:21.723+0000 7f43dae0d640 10 monclient: _check_auth_tickets 2024-09-22T08:38:22.211 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-22T08:38:21.723+0000 7f43dae0d640 10 monclient: handle_config config(0 keys) 2024-09-22T08:38:22.211 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-22T08:38:21.723+0000 7f43dae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:22.211 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-22T08:38:21.723+0000 7f43dae0d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:38:22.211 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-22T08:38:21.723+0000 7f43dae0d640 10 monclient: dump: 2024-09-22T08:38:22.211 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:38:22.211 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:38:22.211 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:22.211 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:22.211 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:22.211 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:22.211 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:38:22.211 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:38:22.211 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:38:22.212 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:22.212 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-22T08:38:21.723+0000 7f44ef175800 5 monclient: authenticate success, global_id 7652 2024-09-22T08:38:22.212 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-22T08:38:21.723+0000 7f44ef175800 10 monclient: get_monmap_and_config success 2024-09-22T08:38:22.212 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-22T08:38:21.723+0000 7f44ef175800 4 set_mon_vals no callback set 2024-09-22T08:38:22.212 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-22T08:38:21.724+0000 7f44ef175800 10 monclient: shutdown 2024-09-22T08:38:22.212 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 asok(0x562feee3a0f0) unregister_commands rotate-key 2024-09-22T08:38:22.212 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-22T08:38:21.724+0000 7f44ef175800 10 monclient: build_initial_monmap 2024-09-22T08:38:22.212 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-22T08:38:21.724+0000 7f44ef175800 1 build_initial for_mkfs: 0 2024-09-22T08:38:22.212 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-22T08:38:21.724+0000 7f44ef175800 10 monclient: monmap: 2024-09-22T08:38:22.212 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:38:22.212 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:38:22.212 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:38:22.212 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:38:22.212 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:38:22.212 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:22.213 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:38:22.213 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:38:22.213 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:38:22.213 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:22.213 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef089ae0) adding auth protocol: cephx 2024-09-22T08:38:22.213 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef089ae0) adding auth protocol: cephx 2024-09-22T08:38:22.213 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef089ae0) adding auth protocol: cephx 2024-09-22T08:38:22.213 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef089ae0) adding con mode: secure 2024-09-22T08:38:22.213 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef089ae0) adding con mode: crc 2024-09-22T08:38:22.213 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef089ae0) adding con mode: secure 2024-09-22T08:38:22.213 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef089ae0) adding con mode: crc 2024-09-22T08:38:22.213 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef089ae0) adding con mode: secure 2024-09-22T08:38:22.213 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef089ae0) adding con mode: crc 2024-09-22T08:38:22.213 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef089ae0) adding con mode: crc 2024-09-22T08:38:22.214 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef089ae0) adding con mode: secure 2024-09-22T08:38:22.214 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef089ae0) adding con mode: crc 2024-09-22T08:38:22.214 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef089ae0) adding con mode: secure 2024-09-22T08:38:22.214 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef089ae0) adding con mode: crc 2024-09-22T08:38:22.214 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef089ae0) adding con mode: secure 2024-09-22T08:38:22.214 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-22T08:38:21.724+0000 7f44ef175800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:22.214 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-22T08:38:21.724+0000 7f44ef175800 1 librados: starting msgr at 2024-09-22T08:38:22.214 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-22T08:38:21.724+0000 7f44ef175800 1 librados: starting objecter 2024-09-22T08:38:22.214 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 asok(0x562feee3a0f0) register_command objecter_requests hook 0x562fef08c6d0 2024-09-22T08:38:22.214 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-22T08:38:21.724+0000 7f44ef175800 1 librados: setting wanted keys 2024-09-22T08:38:22.214 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-22T08:38:21.724+0000 7f44ef175800 1 librados: calling monclient init 2024-09-22T08:38:22.214 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-22T08:38:21.724+0000 7f44ef175800 10 monclient: init 2024-09-22T08:38:22.214 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef05ad60) adding auth protocol: cephx 2024-09-22T08:38:22.214 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef05ad60) adding auth protocol: cephx 2024-09-22T08:38:22.215 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef05ad60) adding auth protocol: cephx 2024-09-22T08:38:22.215 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef05ad60) adding con mode: secure 2024-09-22T08:38:22.215 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef05ad60) adding con mode: crc 2024-09-22T08:38:22.215 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef05ad60) adding con mode: secure 2024-09-22T08:38:22.215 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef05ad60) adding con mode: crc 2024-09-22T08:38:22.215 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef05ad60) adding con mode: secure 2024-09-22T08:38:22.215 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef05ad60) adding con mode: crc 2024-09-22T08:38:22.215 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef05ad60) adding con mode: crc 2024-09-22T08:38:22.215 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef05ad60) adding con mode: secure 2024-09-22T08:38:22.215 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef05ad60) adding con mode: crc 2024-09-22T08:38:22.215 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef05ad60) adding con mode: secure 2024-09-22T08:38:22.215 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef05ad60) adding con mode: crc 2024-09-22T08:38:22.215 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef05ad60) adding con mode: secure 2024-09-22T08:38:22.215 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-22T08:38:21.725+0000 7f44ef175800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:22.215 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-22T08:38:21.725+0000 7f44ef175800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:22.216 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-22T08:38:21.725+0000 7f44ef175800 5 asok(0x562feee3a0f0) register_command rotate-key hook 0x562fef05aea8 2024-09-22T08:38:22.216 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-22T08:38:21.725+0000 7f44ef175800 10 monclient: _reopen_session rank -1 2024-09-22T08:38:22.216 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-22T08:38:21.725+0000 7f44ef175800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T08:38:22.216 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-22T08:38:21.725+0000 7f44ef175800 10 monclient(hunting): picked mon.noname-b con 0x562feef07bd0 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:38:22.216 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-22T08:38:21.725+0000 7f44ef175800 10 monclient(hunting): picked mon.noname-a con 0x562feef11640 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:38:22.216 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-22T08:38:21.725+0000 7f44ef175800 10 monclient(hunting): picked mon.noname-c con 0x562feef9dbd0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:38:22.216 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-22T08:38:21.725+0000 7f44ef175800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:22.216 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-22T08:38:21.725+0000 7f44ef175800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:22.216 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-22T08:38:21.725+0000 7f44ef175800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:22.216 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-22T08:38:21.725+0000 7f44ef175800 10 monclient(hunting): _renew_subs 2024-09-22T08:38:22.216 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-22T08:38:21.725+0000 7f44ef175800 10 monclient(hunting): authenticate will time out at 2206.964362s 2024-09-22T08:38:22.216 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-22T08:38:21.725+0000 7f44ec45e640 10 monclient(hunting): get_auth_request con 0x562feef11640 auth_method 0 2024-09-22T08:38:22.216 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-22T08:38:21.725+0000 7f44ec45e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:22.216 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-22T08:38:21.725+0000 7f44ec45e640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:22.216 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-22T08:38:21.725+0000 7f44ec45e640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:22.217 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-22T08:38:21.725+0000 7f44ed460640 10 monclient(hunting): get_auth_request con 0x562feef9dbd0 auth_method 0 2024-09-22T08:38:22.217 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-22T08:38:21.725+0000 7f44ed460640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:22.217 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-22T08:38:21.725+0000 7f44ed460640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:22.217 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-22T08:38:21.725+0000 7f44ed460640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:22.217 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-22T08:38:21.725+0000 7f44ec45e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:22.217 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-22T08:38:21.725+0000 7f44ec45e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:22.217 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-22T08:38:21.725+0000 7f44ec45e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:22.217 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-22T08:38:21.725+0000 7f44ed460640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:22.217 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-22T08:38:21.725+0000 7f44ed460640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:22.217 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-22T08:38:21.725+0000 7f44ed460640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:22.217 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-22T08:38:21.725+0000 7f44ec45e640 10 monclient(hunting): handle_auth_done global_id 8139 payload 824 2024-09-22T08:38:22.217 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-22T08:38:21.725+0000 7f44ec45e640 10 monclient: _finish_hunting 0 2024-09-22T08:38:22.217 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-22T08:38:21.725+0000 7f44ec45e640 1 monclient: found mon.noname-a 2024-09-22T08:38:22.217 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-22T08:38:21.725+0000 7f44ec45e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:38:22.217 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-22T08:38:21.726+0000 7f43d960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:22.218 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-22T08:38:21.726+0000 7f43d960a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:38:22.218 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-22T08:38:21.726+0000 7f43d960a640 10 monclient: dump: 2024-09-22T08:38:22.218 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:38:22.218 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:38:22.218 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:22.218 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:22.218 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:22.218 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:22.218 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:38:22.218 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:38:22.218 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:38:22.218 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:22.218 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-22T08:38:21.726+0000 7f43d960a640 10 monclient: _finish_auth 0 2024-09-22T08:38:22.218 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-22T08:38:21.726+0000 7f43d960a640 10 monclient: _check_auth_tickets 2024-09-22T08:38:22.218 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-22T08:38:21.726+0000 7f44ef175800 5 monclient: authenticate success, global_id 8139 2024-09-22T08:38:22.219 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-22T08:38:21.726+0000 7f44ef175800 10 monclient: _renew_subs 2024-09-22T08:38:22.219 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-22T08:38:21.726+0000 7f44ef175800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:38:22.219 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-22T08:38:21.726+0000 7f43d960a640 10 monclient: handle_config config(0 keys) 2024-09-22T08:38:22.219 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-22T08:38:21.726+0000 7f43d960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:22.219 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-22T08:38:21.726+0000 7f43d960a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:38:22.219 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-22T08:38:21.726+0000 7f43d960a640 10 monclient: dump: 2024-09-22T08:38:22.219 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:38:22.219 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:38:22.219 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:22.219 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:22.219 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:22.219 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:22.219 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:38:22.219 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:38:22.219 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:38:22.220 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:22.220 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-22T08:38:21.726+0000 7f43dae0d640 4 set_mon_vals no callback set 2024-09-22T08:38:22.220 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-22T08:38:21.726+0000 7f44ef175800 10 monclient: _renew_subs 2024-09-22T08:38:22.220 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-22T08:38:21.726+0000 7f44ef175800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:38:22.220 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-22T08:38:21.726+0000 7f44ef175800 1 librados: init done 2024-09-22T08:38:22.220 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-22T08:38:21.728+0000 7f43d960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:38:22.220 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-22T08:38:21.728+0000 7f43d960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:38:22.220 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-22T08:38:21.728+0000 7f43d960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:38:22.220 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-22T08:38:21.728+0000 7f44ecc5f640 10 monclient: get_auth_request con 0x7f43d40775a0 auth_method 0 2024-09-22T08:38:22.220 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-22T08:38:21.728+0000 7f44ed460640 10 monclient: get_auth_request con 0x562fef0a35c0 auth_method 0 2024-09-22T08:38:22.220 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-22T08:38:21.729+0000 7f44ecc5f640 10 monclient: get_auth_request con 0x562fef0a67a0 auth_method 0 2024-09-22T08:38:22.220 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-22T08:38:21.730+0000 7f44ec45e640 10 monclient: get_auth_request con 0x562fef0aa990 auth_method 0 2024-09-22T08:38:22.220 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-22T08:38:21.731+0000 7f44ed460640 10 monclient: get_auth_request con 0x562fef0aa020 auth_method 0 2024-09-22T08:38:22.220 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-22T08:38:21.732+0000 7f44ef175800 10 monclient: build_initial_monmap 2024-09-22T08:38:22.220 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-22T08:38:21.732+0000 7f44ef175800 1 build_initial for_mkfs: 0 2024-09-22T08:38:22.221 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-22T08:38:21.732+0000 7f44ef175800 10 monclient: monmap: 2024-09-22T08:38:22.221 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:38:22.221 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:38:22.221 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:38:22.221 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:38:22.221 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:38:22.221 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:22.221 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:38:22.221 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:38:22.221 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:38:22.221 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:22.221 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b2bc0) adding auth protocol: cephx 2024-09-22T08:38:22.221 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b2bc0) adding auth protocol: cephx 2024-09-22T08:38:22.221 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b2bc0) adding auth protocol: cephx 2024-09-22T08:38:22.221 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b2bc0) adding con mode: secure 2024-09-22T08:38:22.222 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b2bc0) adding con mode: crc 2024-09-22T08:38:22.222 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b2bc0) adding con mode: secure 2024-09-22T08:38:22.222 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b2bc0) adding con mode: crc 2024-09-22T08:38:22.222 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b2bc0) adding con mode: secure 2024-09-22T08:38:22.222 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b2bc0) adding con mode: crc 2024-09-22T08:38:22.222 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b2bc0) adding con mode: crc 2024-09-22T08:38:22.222 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b2bc0) adding con mode: secure 2024-09-22T08:38:22.222 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b2bc0) adding con mode: crc 2024-09-22T08:38:22.222 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b2bc0) adding con mode: secure 2024-09-22T08:38:22.222 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b2bc0) adding con mode: crc 2024-09-22T08:38:22.222 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b2bc0) adding con mode: secure 2024-09-22T08:38:22.222 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-22T08:38:21.732+0000 7f44ef175800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:22.222 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 asok(0x562feee3a0f0) register_command objecter_requests cmddesc objecter_requests hook 0x562fef0b6010 EEXIST 2024-09-22T08:38:22.222 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-22T08:38:21.732+0000 7f44ef175800 10 monclient: init 2024-09-22T08:38:22.223 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b19c8) adding auth protocol: cephx 2024-09-22T08:38:22.223 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b19c8) adding auth protocol: cephx 2024-09-22T08:38:22.223 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b19c8) adding auth protocol: cephx 2024-09-22T08:38:22.223 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b19c8) adding con mode: secure 2024-09-22T08:38:22.223 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b19c8) adding con mode: crc 2024-09-22T08:38:22.223 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b19c8) adding con mode: secure 2024-09-22T08:38:22.223 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b19c8) adding con mode: crc 2024-09-22T08:38:22.223 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b19c8) adding con mode: secure 2024-09-22T08:38:22.223 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b19c8) adding con mode: crc 2024-09-22T08:38:22.223 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b19c8) adding con mode: crc 2024-09-22T08:38:22.223 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b19c8) adding con mode: secure 2024-09-22T08:38:22.223 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b19c8) adding con mode: crc 2024-09-22T08:38:22.223 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b19c8) adding con mode: secure 2024-09-22T08:38:22.223 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b19c8) adding con mode: crc 2024-09-22T08:38:22.223 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b19c8) adding con mode: secure 2024-09-22T08:38:22.224 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-22T08:38:21.732+0000 7f44ef175800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:22.224 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-22T08:38:21.733+0000 7f44ef175800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:22.224 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-22T08:38:21.733+0000 7f44ef175800 5 asok(0x562feee3a0f0) register_command rotate-key cmddesc rotate-key hook 0x562fef0b1b10 EEXIST 2024-09-22T08:38:22.224 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-22T08:38:21.733+0000 7f44ef175800 10 monclient: _reopen_session rank -1 2024-09-22T08:38:22.224 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-22T08:38:21.733+0000 7f44ef175800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-22T08:38:22.224 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-22T08:38:21.733+0000 7f44ef175800 10 monclient(hunting): picked mon.noname-c con 0x562fef0da330 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:38:22.224 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-22T08:38:21.733+0000 7f44ef175800 10 monclient(hunting): picked mon.noname-b con 0x562fef0da710 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:38:22.224 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-22T08:38:21.733+0000 7f44ef175800 10 monclient(hunting): picked mon.noname-a con 0x562fef0d9040 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:38:22.224 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-22T08:38:21.733+0000 7f44ef175800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:22.224 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-22T08:38:21.733+0000 7f44ef175800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:22.224 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-22T08:38:21.733+0000 7f44ef175800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:22.224 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-22T08:38:21.733+0000 7f44ef175800 10 monclient(hunting): _renew_subs 2024-09-22T08:38:22.224 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-22T08:38:21.733+0000 7f44ef175800 10 monclient(hunting): authenticate will time out at 2206.972305s 2024-09-22T08:38:22.224 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-22T08:38:21.733+0000 7f44ec45e640 10 monclient(hunting): get_auth_request con 0x562fef0da330 auth_method 0 2024-09-22T08:38:22.224 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-22T08:38:21.733+0000 7f44ec45e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:22.224 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-22T08:38:21.733+0000 7f44ec45e640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:22.225 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-22T08:38:21.733+0000 7f44ec45e640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:22.225 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-22T08:38:21.733+0000 7f44ecc5f640 10 monclient(hunting): get_auth_request con 0x562fef0d9040 auth_method 0 2024-09-22T08:38:22.225 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-22T08:38:21.733+0000 7f44ecc5f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:22.225 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-22T08:38:21.733+0000 7f44ecc5f640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:22.225 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-22T08:38:21.733+0000 7f44ecc5f640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:22.225 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-22T08:38:21.733+0000 7f44ec45e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:22.225 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-22T08:38:21.733+0000 7f44ec45e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:22.225 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-22T08:38:21.733+0000 7f44ec45e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:22.225 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-22T08:38:21.733+0000 7f44ed460640 10 monclient(hunting): get_auth_request con 0x562fef0da710 auth_method 0 2024-09-22T08:38:22.225 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-22T08:38:21.733+0000 7f44ed460640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:22.225 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-22T08:38:21.733+0000 7f44ed460640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:22.225 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-22T08:38:21.733+0000 7f44ed460640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:22.225 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-22T08:38:21.733+0000 7f44ecc5f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:22.225 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-22T08:38:21.733+0000 7f44ecc5f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:22.225 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-22T08:38:21.733+0000 7f44ecc5f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:22.226 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-22T08:38:21.733+0000 7f44ed460640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:22.226 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-22T08:38:21.733+0000 7f44ed460640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:22.226 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-22T08:38:21.733+0000 7f44ed460640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:22.226 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-22T08:38:21.733+0000 7f44ec45e640 10 monclient(hunting): handle_auth_done global_id 7658 payload 824 2024-09-22T08:38:22.226 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-22T08:38:21.733+0000 7f44ec45e640 10 monclient: _finish_hunting 0 2024-09-22T08:38:22.226 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-22T08:38:21.733+0000 7f44ec45e640 1 monclient: found mon.noname-c 2024-09-22T08:38:22.226 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-22T08:38:21.733+0000 7f44ec45e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:38:22.226 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-22T08:38:21.733+0000 7f43d27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:22.226 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-22T08:38:21.733+0000 7f43d27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:38:22.226 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-22T08:38:21.733+0000 7f43d27fc640 10 monclient: dump: 2024-09-22T08:38:22.226 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:38:22.226 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:38:22.226 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:22.226 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:22.227 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:22.227 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:22.227 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:38:22.227 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:38:22.227 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:38:22.227 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:22.227 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-22T08:38:21.733+0000 7f43d27fc640 10 monclient: _finish_auth 0 2024-09-22T08:38:22.227 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-22T08:38:21.733+0000 7f43d27fc640 10 monclient: _check_auth_tickets 2024-09-22T08:38:22.227 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-22T08:38:21.733+0000 7f43d27fc640 10 monclient: handle_config config(0 keys) 2024-09-22T08:38:22.227 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-22T08:38:21.733+0000 7f43d27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:22.227 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-22T08:38:21.733+0000 7f43d27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:38:22.227 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-22T08:38:21.733+0000 7f43d27fc640 10 monclient: dump: 2024-09-22T08:38:22.227 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:38:22.227 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:38:22.227 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:22.228 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:22.228 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:22.228 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:22.228 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:38:22.228 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:38:22.228 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:38:22.228 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:22.228 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-22T08:38:21.733+0000 7f44ef175800 5 monclient: authenticate success, global_id 7658 2024-09-22T08:38:22.228 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-22T08:38:21.733+0000 7f44ef175800 10 monclient: _renew_subs 2024-09-22T08:38:22.228 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-22T08:38:21.733+0000 7f44ef175800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:38:22.228 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-22T08:38:21.733+0000 7f44edc61640 4 set_mon_vals no callback set 2024-09-22T08:38:22.228 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-22T08:38:21.734+0000 7f44ef175800 10 monclient: _renew_subs 2024-09-22T08:38:22.228 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-22T08:38:21.734+0000 7f44ef175800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:38:22.228 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-22T08:38:21.735+0000 7f43d27fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:38:22.228 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-22T08:38:21.735+0000 7f43d27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:38:22.229 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-22T08:38:21.735+0000 7f43d27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:38:22.229 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-22T08:38:21.735+0000 7f44ed460640 10 monclient: get_auth_request con 0x7f43c4077480 auth_method 0 2024-09-22T08:38:22.229 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-22T08:38:21.736+0000 7f44ef175800 10 monclient: get_monmap_and_config 2024-09-22T08:38:22.229 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-22T08:38:21.736+0000 7f44ef175800 10 monclient: build_initial_monmap 2024-09-22T08:38:22.229 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-22T08:38:21.736+0000 7f44ef175800 1 build_initial for_mkfs: 0 2024-09-22T08:38:22.229 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-22T08:38:21.736+0000 7f44ef175800 10 monclient: monmap: 2024-09-22T08:38:22.229 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:38:22.229 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:38:22.229 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:38:22.229 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:38:22.229 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:38:22.229 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:22.229 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:38:22.229 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:38:22.229 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:38:22.230 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:22.230 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x562fef0fa060) adding auth protocol: cephx 2024-09-22T08:38:22.230 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x562fef0fa060) adding auth protocol: cephx 2024-09-22T08:38:22.230 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x562fef0fa060) adding auth protocol: cephx 2024-09-22T08:38:22.230 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x562fef0fa060) adding con mode: secure 2024-09-22T08:38:22.230 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x562fef0fa060) adding con mode: crc 2024-09-22T08:38:22.230 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x562fef0fa060) adding con mode: secure 2024-09-22T08:38:22.230 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x562fef0fa060) adding con mode: crc 2024-09-22T08:38:22.230 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x562fef0fa060) adding con mode: secure 2024-09-22T08:38:22.230 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x562fef0fa060) adding con mode: crc 2024-09-22T08:38:22.230 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x562fef0fa060) adding con mode: crc 2024-09-22T08:38:22.230 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x562fef0fa060) adding con mode: secure 2024-09-22T08:38:22.230 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x562fef0fa060) adding con mode: crc 2024-09-22T08:38:22.230 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x562fef0fa060) adding con mode: secure 2024-09-22T08:38:22.230 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x562fef0fa060) adding con mode: crc 2024-09-22T08:38:22.231 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x562fef0fa060) adding con mode: secure 2024-09-22T08:38:22.231 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-22T08:38:21.736+0000 7f44ef175800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:22.231 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-22T08:38:21.736+0000 7f44ef175800 10 monclient: init 2024-09-22T08:38:22.231 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01b8e0) adding auth protocol: cephx 2024-09-22T08:38:22.231 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01b8e0) adding auth protocol: cephx 2024-09-22T08:38:22.231 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01b8e0) adding auth protocol: cephx 2024-09-22T08:38:22.231 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01b8e0) adding con mode: secure 2024-09-22T08:38:22.231 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01b8e0) adding con mode: crc 2024-09-22T08:38:22.231 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01b8e0) adding con mode: secure 2024-09-22T08:38:22.231 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01b8e0) adding con mode: crc 2024-09-22T08:38:22.231 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01b8e0) adding con mode: secure 2024-09-22T08:38:22.231 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01b8e0) adding con mode: crc 2024-09-22T08:38:22.231 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01b8e0) adding con mode: crc 2024-09-22T08:38:22.231 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01b8e0) adding con mode: secure 2024-09-22T08:38:22.231 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01b8e0) adding con mode: crc 2024-09-22T08:38:22.232 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01b8e0) adding con mode: secure 2024-09-22T08:38:22.232 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01b8e0) adding con mode: crc 2024-09-22T08:38:22.232 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01b8e0) adding con mode: secure 2024-09-22T08:38:22.232 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-22T08:38:21.736+0000 7f44ef175800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:22.232 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-22T08:38:21.736+0000 7f44ef175800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:22.232 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 asok(0x562feee3a0f0) register_command rotate-key cmddesc rotate-key hook 0x7ffeaf01ba28 EEXIST 2024-09-22T08:38:22.232 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-22T08:38:21.736+0000 7f44ef175800 10 monclient: _reopen_session rank -1 2024-09-22T08:38:22.232 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-22T08:38:21.736+0000 7f44ef175800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T08:38:22.232 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-22T08:38:21.737+0000 7f44ef175800 10 monclient(hunting): picked mon.noname-a con 0x562fef12e700 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:38:22.232 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-22T08:38:21.737+0000 7f44ef175800 10 monclient(hunting): picked mon.noname-b con 0x562fef0ff650 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:38:22.232 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-22T08:38:21.737+0000 7f44ef175800 10 monclient(hunting): picked mon.noname-c con 0x562fef129fa0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:38:22.232 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-22T08:38:21.737+0000 7f44ef175800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:22.232 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-22T08:38:21.737+0000 7f44ef175800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:22.232 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-22T08:38:21.737+0000 7f44ef175800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:22.232 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-22T08:38:21.737+0000 7f44ef175800 10 monclient(hunting): _renew_subs 2024-09-22T08:38:22.233 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-22T08:38:21.737+0000 7f44ef175800 10 monclient(hunting): authenticate will time out at 2206.976058s 2024-09-22T08:38:22.233 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-22T08:38:21.737+0000 7f44ec45e640 10 monclient(hunting): get_auth_request con 0x562fef12e700 auth_method 0 2024-09-22T08:38:22.233 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-22T08:38:21.737+0000 7f44ec45e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:22.233 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-22T08:38:21.737+0000 7f44ec45e640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:22.233 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-22T08:38:21.737+0000 7f44ec45e640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:22.233 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-22T08:38:21.737+0000 7f44ecc5f640 10 monclient(hunting): get_auth_request con 0x562fef129fa0 auth_method 0 2024-09-22T08:38:22.233 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-22T08:38:21.737+0000 7f44ecc5f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:22.233 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-22T08:38:21.737+0000 7f44ecc5f640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:22.233 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-22T08:38:21.737+0000 7f44ecc5f640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:22.233 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-22T08:38:21.737+0000 7f44ec45e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:22.233 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-22T08:38:21.737+0000 7f44ec45e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:22.233 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-22T08:38:21.737+0000 7f44ec45e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:22.234 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-22T08:38:21.737+0000 7f44ecc5f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:22.234 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-22T08:38:21.737+0000 7f44ecc5f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:22.234 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-22T08:38:21.737+0000 7f44ecc5f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:22.234 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-22T08:38:21.737+0000 7f44ed460640 10 monclient(hunting): get_auth_request con 0x562fef0ff650 auth_method 0 2024-09-22T08:38:22.234 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-22T08:38:21.737+0000 7f44ed460640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:22.234 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-22T08:38:21.737+0000 7f44ed460640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:22.234 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-22T08:38:21.737+0000 7f44ed460640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:22.234 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-22T08:38:21.737+0000 7f44ec45e640 10 monclient(hunting): handle_auth_done global_id 8145 payload 274 2024-09-22T08:38:22.234 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-22T08:38:21.737+0000 7f44ec45e640 10 monclient: _finish_hunting 0 2024-09-22T08:38:22.234 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-22T08:38:21.737+0000 7f44ec45e640 1 monclient: found mon.noname-a 2024-09-22T08:38:22.234 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-22T08:38:21.737+0000 7f44ec45e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:38:22.234 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-22T08:38:21.737+0000 7f43c3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:22.234 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-22T08:38:21.737+0000 7f43c3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:38:22.235 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-22T08:38:21.737+0000 7f43c3fff640 10 monclient: dump: 2024-09-22T08:38:22.235 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:38:22.235 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:38:22.235 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:22.235 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:22.235 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:22.235 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:22.235 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:38:22.235 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:38:22.235 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:38:22.235 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:22.235 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-22T08:38:21.737+0000 7f43c3fff640 10 monclient: _finish_auth 0 2024-09-22T08:38:22.235 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-22T08:38:21.737+0000 7f43c3fff640 10 monclient: _check_auth_tickets 2024-09-22T08:38:22.235 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-22T08:38:21.737+0000 7f43c3fff640 10 monclient: handle_config config(0 keys) 2024-09-22T08:38:22.235 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-22T08:38:21.737+0000 7f43c3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:22.236 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-22T08:38:21.737+0000 7f43c3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:38:22.236 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-22T08:38:21.737+0000 7f43c3fff640 10 monclient: dump: 2024-09-22T08:38:22.236 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:38:22.236 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:38:22.236 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:22.236 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:22.236 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:22.236 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:22.236 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:38:22.236 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:38:22.236 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:38:22.236 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:22.236 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-22T08:38:21.737+0000 7f44ef175800 5 monclient: authenticate success, global_id 8145 2024-09-22T08:38:22.236 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-22T08:38:21.737+0000 7f44ef175800 10 monclient: get_monmap_and_config success 2024-09-22T08:38:22.236 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-22T08:38:21.737+0000 7f44ef175800 4 set_mon_vals no callback set 2024-09-22T08:38:22.237 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-22T08:38:21.738+0000 7f44ef175800 10 monclient: shutdown 2024-09-22T08:38:22.237 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-22T08:38:21.738+0000 7f44ef175800 10 monclient: build_initial_monmap 2024-09-22T08:38:22.237 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-22T08:38:21.738+0000 7f44ef175800 1 build_initial for_mkfs: 0 2024-09-22T08:38:22.237 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-22T08:38:21.738+0000 7f44ef175800 10 monclient: monmap: 2024-09-22T08:38:22.237 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:38:22.237 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:38:22.237 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:38:22.237 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:38:22.237 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:38:22.237 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:22.237 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:38:22.237 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:38:22.237 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:38:22.237 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:22.237 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef1202d0) adding auth protocol: cephx 2024-09-22T08:38:22.237 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef1202d0) adding auth protocol: cephx 2024-09-22T08:38:22.238 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef1202d0) adding auth protocol: cephx 2024-09-22T08:38:22.238 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef1202d0) adding con mode: secure 2024-09-22T08:38:22.238 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef1202d0) adding con mode: crc 2024-09-22T08:38:22.238 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef1202d0) adding con mode: secure 2024-09-22T08:38:22.238 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef1202d0) adding con mode: crc 2024-09-22T08:38:22.238 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef1202d0) adding con mode: secure 2024-09-22T08:38:22.238 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef1202d0) adding con mode: crc 2024-09-22T08:38:22.238 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef1202d0) adding con mode: crc 2024-09-22T08:38:22.238 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef1202d0) adding con mode: secure 2024-09-22T08:38:22.238 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef1202d0) adding con mode: crc 2024-09-22T08:38:22.238 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef1202d0) adding con mode: secure 2024-09-22T08:38:22.238 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef1202d0) adding con mode: crc 2024-09-22T08:38:22.238 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef1202d0) adding con mode: secure 2024-09-22T08:38:22.238 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-22T08:38:21.738+0000 7f44ef175800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:22.238 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-22T08:38:21.738+0000 7f44ef175800 1 librados: starting msgr at 2024-09-22T08:38:22.239 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-22T08:38:21.738+0000 7f44ef175800 1 librados: starting objecter 2024-09-22T08:38:22.239 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 asok(0x562feee3a0f0) register_command objecter_requests cmddesc objecter_requests hook 0x562fef0dac20 EEXIST 2024-09-22T08:38:22.239 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-22T08:38:21.738+0000 7f44ef175800 1 librados: setting wanted keys 2024-09-22T08:38:22.239 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-22T08:38:21.738+0000 7f44ef175800 1 librados: calling monclient init 2024-09-22T08:38:22.239 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-22T08:38:21.738+0000 7f44ef175800 10 monclient: init 2024-09-22T08:38:22.239 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef0eebf0) adding auth protocol: cephx 2024-09-22T08:38:22.239 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef0eebf0) adding auth protocol: cephx 2024-09-22T08:38:22.239 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef0eebf0) adding auth protocol: cephx 2024-09-22T08:38:22.239 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef0eebf0) adding con mode: secure 2024-09-22T08:38:22.239 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef0eebf0) adding con mode: crc 2024-09-22T08:38:22.239 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef0eebf0) adding con mode: secure 2024-09-22T08:38:22.239 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef0eebf0) adding con mode: crc 2024-09-22T08:38:22.239 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef0eebf0) adding con mode: secure 2024-09-22T08:38:22.239 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef0eebf0) adding con mode: crc 2024-09-22T08:38:22.239 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef0eebf0) adding con mode: crc 2024-09-22T08:38:22.240 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef0eebf0) adding con mode: secure 2024-09-22T08:38:22.240 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef0eebf0) adding con mode: crc 2024-09-22T08:38:22.240 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef0eebf0) adding con mode: secure 2024-09-22T08:38:22.240 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef0eebf0) adding con mode: crc 2024-09-22T08:38:22.240 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef0eebf0) adding con mode: secure 2024-09-22T08:38:22.240 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-22T08:38:21.738+0000 7f44ef175800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:22.240 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-22T08:38:21.739+0000 7f44ef175800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:22.240 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-22T08:38:21.739+0000 7f44ef175800 5 asok(0x562feee3a0f0) register_command rotate-key cmddesc rotate-key hook 0x562fef0eed38 EEXIST 2024-09-22T08:38:22.240 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-22T08:38:21.739+0000 7f44ef175800 10 monclient: _reopen_session rank -1 2024-09-22T08:38:22.240 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-22T08:38:21.739+0000 7f44ef175800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-22T08:38:22.240 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-22T08:38:21.739+0000 7f44ef175800 10 monclient(hunting): picked mon.noname-b con 0x562fef0ff650 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:38:22.240 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-22T08:38:21.739+0000 7f44ef175800 10 monclient(hunting): picked mon.noname-c con 0x562fef129fa0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:38:22.240 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-22T08:38:21.739+0000 7f44ef175800 10 monclient(hunting): picked mon.noname-a con 0x562fef12e700 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:38:22.240 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-22T08:38:21.739+0000 7f44ef175800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:22.240 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-22T08:38:21.739+0000 7f44ef175800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:22.241 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-22T08:38:21.739+0000 7f44ef175800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:22.241 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-22T08:38:21.739+0000 7f44ef175800 10 monclient(hunting): _renew_subs 2024-09-22T08:38:22.241 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-22T08:38:21.739+0000 7f44ef175800 10 monclient(hunting): authenticate will time out at 2206.978309s 2024-09-22T08:38:22.241 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-22T08:38:21.739+0000 7f44ed460640 10 monclient(hunting): get_auth_request con 0x562fef129fa0 auth_method 0 2024-09-22T08:38:22.241 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-22T08:38:21.739+0000 7f44ed460640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:22.241 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-22T08:38:21.739+0000 7f44ed460640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:22.241 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-22T08:38:21.739+0000 7f44ed460640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:22.241 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-22T08:38:21.739+0000 7f44ecc5f640 10 monclient(hunting): get_auth_request con 0x562fef12e700 auth_method 0 2024-09-22T08:38:22.241 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-22T08:38:21.739+0000 7f44ecc5f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:22.241 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-22T08:38:21.739+0000 7f44ecc5f640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:22.241 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-22T08:38:21.739+0000 7f44ecc5f640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:22.241 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-22T08:38:21.739+0000 7f44ecc5f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:22.241 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-22T08:38:21.739+0000 7f44ecc5f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:22.241 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-22T08:38:21.739+0000 7f44ecc5f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:22.241 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-22T08:38:21.739+0000 7f44ed460640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:22.242 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-22T08:38:21.739+0000 7f44ed460640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:22.242 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-22T08:38:21.739+0000 7f44ed460640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:22.242 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-22T08:38:21.739+0000 7f44ec45e640 10 monclient(hunting): get_auth_request con 0x562fef0ff650 auth_method 0 2024-09-22T08:38:22.242 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-22T08:38:21.739+0000 7f44ec45e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:22.242 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-22T08:38:21.739+0000 7f44ec45e640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:22.242 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-22T08:38:21.739+0000 7f44ec45e640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:22.242 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-22T08:38:21.739+0000 7f44ed460640 10 monclient(hunting): handle_auth_done global_id 7664 payload 824 2024-09-22T08:38:22.242 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-22T08:38:21.739+0000 7f44ed460640 10 monclient: _finish_hunting 0 2024-09-22T08:38:22.242 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-22T08:38:21.739+0000 7f44ed460640 1 monclient: found mon.noname-c 2024-09-22T08:38:22.242 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-22T08:38:21.739+0000 7f44ed460640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:38:22.242 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-22T08:38:21.739+0000 7f43c27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:22.242 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-22T08:38:21.739+0000 7f43c27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:38:22.242 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-22T08:38:21.739+0000 7f43c27fc640 10 monclient: dump: 2024-09-22T08:38:22.242 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:38:22.243 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:38:22.243 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:22.243 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:22.243 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:22.243 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:22.243 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:38:22.243 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:38:22.243 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:38:22.243 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:22.243 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-22T08:38:21.739+0000 7f43c27fc640 10 monclient: _finish_auth 0 2024-09-22T08:38:22.243 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-22T08:38:21.739+0000 7f43c27fc640 10 monclient: _check_auth_tickets 2024-09-22T08:38:22.243 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-22T08:38:21.739+0000 7f43c27fc640 10 monclient: handle_config config(0 keys) 2024-09-22T08:38:22.243 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-22T08:38:21.739+0000 7f43c27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:22.243 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-22T08:38:21.740+0000 7f43c27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:38:22.244 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-22T08:38:21.740+0000 7f43c27fc640 10 monclient: dump: 2024-09-22T08:38:22.244 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:38:22.244 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:38:22.244 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:22.244 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:22.244 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:22.244 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:22.244 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:38:22.244 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:38:22.244 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:38:22.244 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:22.244 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-22T08:38:21.740+0000 7f44ef175800 5 monclient: authenticate success, global_id 7664 2024-09-22T08:38:22.244 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-22T08:38:21.740+0000 7f44ef175800 10 monclient: _renew_subs 2024-09-22T08:38:22.244 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-22T08:38:21.740+0000 7f43c3fff640 4 set_mon_vals no callback set 2024-09-22T08:38:22.244 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-22T08:38:21.740+0000 7f44ef175800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:38:22.245 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-22T08:38:21.740+0000 7f44ef175800 10 monclient: _renew_subs 2024-09-22T08:38:22.245 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-22T08:38:21.740+0000 7f44ef175800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:38:22.245 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-22T08:38:21.740+0000 7f44ef175800 1 librados: init done 2024-09-22T08:38:22.245 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-22T08:38:21.740+0000 7f44ef175800 5 asok(0x562feee3a0f0) register_command cr dump hook 0x562fef11b9d8 2024-09-22T08:38:22.245 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-22T08:38:21.741+0000 7f44ef175800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.245 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-22T08:38:21.742+0000 7f43c27fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:38:22.245 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-22T08:38:21.742+0000 7f43c27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:38:22.245 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-22T08:38:21.742+0000 7f43c27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:38:22.245 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-22T08:38:21.743+0000 7f44ec45e640 10 monclient: get_auth_request con 0x7f43b80775a0 auth_method 0 2024-09-22T08:38:22.245 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-22T08:38:21.743+0000 7f44ecc5f640 10 monclient: get_auth_request con 0x562fef1488e0 auth_method 0 2024-09-22T08:38:22.245 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-22T08:38:21.743+0000 7f44ef175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:22.245 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-22T08:38:21.743+0000 7f44ef175800 20 realm 2024-09-22T08:38:22.245 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-22T08:38:21.743+0000 7f44ef175800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.245 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-22T08:38:21.744+0000 7f44ef175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:22.245 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-22T08:38:21.744+0000 7f44ef175800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:22.246 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-22T08:38:21.744+0000 7f44ef175800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.246 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-22T08:38:21.744+0000 7f44ef175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:22.246 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-22T08:38:21.744+0000 7f44ef175800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.246 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-22T08:38:21.744+0000 7f44ec45e640 10 monclient: get_auth_request con 0x562fef14cac0 auth_method 0 2024-09-22T08:38:22.246 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-22T08:38:21.745+0000 7f44ef175800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:22.246 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-22T08:38:21.745+0000 7f44ef175800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.246 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-22T08:38:21.745+0000 7f44ed460640 10 monclient: get_auth_request con 0x562fef150300 auth_method 0 2024-09-22T08:38:22.246 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-22T08:38:21.745+0000 7f44ef175800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:38:22.246 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-22T08:38:21.745+0000 7f44ef175800 20 searching for the correct realm 2024-09-22T08:38:22.246 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-22T08:38:21.746+0000 7f44ecc5f640 10 monclient: get_auth_request con 0x562fef1550a0 auth_method 0 2024-09-22T08:38:22.246 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-22T08:38:21.747+0000 7f44ec45e640 10 monclient: get_auth_request con 0x7f44d4017070 auth_method 0 2024-09-22T08:38:22.246 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-22T08:38:21.747+0000 7f44ec45e640 0 -- 172.21.15.38:0/3578622760 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f44d4017070 msgr2=0x7f44d4076bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:38:22.246 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-22T08:38:21.948+0000 7f44ec45e640 10 monclient: get_auth_request con 0x7f44d4017070 auth_method 0 2024-09-22T08:38:22.246 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-22T08:38:21.950+0000 7f44ed460640 10 monclient: get_auth_request con 0x7f44dc065b20 auth_method 0 2024-09-22T08:38:22.246 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-22T08:38:21.952+0000 7f44ecc5f640 10 monclient: get_auth_request con 0x7f44d4088b40 auth_method 0 2024-09-22T08:38:22.247 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-22T08:38:21.953+0000 7f44ec45e640 0 -- 172.21.15.38:0/3578622760 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f44dc0713f0 msgr2=0x7f44dc071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:38:22.247 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-22T08:38:22.154+0000 7f44ec45e640 10 monclient: get_auth_request con 0x7f44dc0713f0 auth_method 0 2024-09-22T08:38:22.247 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-22T08:38:22.161+0000 7f44ef175800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:22.247 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-22T08:38:22.161+0000 7f44ef175800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:22.247 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-22T08:38:22.161+0000 7f44ef175800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:38:22.247 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-22T08:38:22.161+0000 7f44ef175800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:22.247 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-22T08:38:22.161+0000 7f44ef175800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:22.247 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-22T08:38:22.161+0000 7f44ef175800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:38:22.247 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-22T08:38:22.161+0000 7f44ef175800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.247 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-22T08:38:22.162+0000 7f44ef175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:22.247 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-22T08:38:22.162+0000 7f44ef175800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.247 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-22T08:38:22.162+0000 7f44ef175800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:22.247 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-22T08:38:22.162+0000 7f44ef175800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.247 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-22T08:38:22.162+0000 7f44ef175800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:38:22.247 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-22T08:38:22.162+0000 7f44ef175800 20 zone default found 2024-09-22T08:38:22.248 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-22T08:38:22.162+0000 7f44ef175800 4 Realm: () 2024-09-22T08:38:22.248 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-22T08:38:22.162+0000 7f44ef175800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:38:22.248 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-22T08:38:22.162+0000 7f44ef175800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:38:22.248 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-22T08:38:22.162+0000 7f44ef175800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:22.248 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-22T08:38:22.162+0000 7f44ef175800 20 zonegroup default 2024-09-22T08:38:22.248 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-22T08:38:22.162+0000 7f44ef175800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.248 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-22T08:38:22.163+0000 7f44ef175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:22.248 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-22T08:38:22.163+0000 7f44ef175800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.248 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-22T08:38:22.163+0000 7f44ef175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:22.248 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-22T08:38:22.163+0000 7f44ef175800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.248 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-22T08:38:22.164+0000 7f44ef175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:22.248 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-22T08:38:22.164+0000 7f44ef175800 20 started sync module instance, tier type = 2024-09-22T08:38:22.248 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-22T08:38:22.164+0000 7f44ef175800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:38:22.248 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-22T08:38:22.174+0000 7f44ef175800 20 add_watcher() i=0 2024-09-22T08:38:22.249 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-22T08:38:22.174+0000 7f44ef175800 20 add_watcher() i=1 2024-09-22T08:38:22.249 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-22T08:38:22.174+0000 7f44ef175800 20 add_watcher() i=2 2024-09-22T08:38:22.249 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-22T08:38:22.174+0000 7f44ef175800 20 add_watcher() i=3 2024-09-22T08:38:22.249 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-22T08:38:22.174+0000 7f44ef175800 20 add_watcher() i=4 2024-09-22T08:38:22.249 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-22T08:38:22.174+0000 7f44ef175800 20 add_watcher() i=5 2024-09-22T08:38:22.249 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-22T08:38:22.174+0000 7f44ef175800 20 add_watcher() i=6 2024-09-22T08:38:22.249 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-22T08:38:22.175+0000 7f44ef175800 20 add_watcher() i=7 2024-09-22T08:38:22.249 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-22T08:38:22.175+0000 7f44ef175800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:22.249 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-22T08:38:22.177+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01bdb0) adding auth protocol: cephx 2024-09-22T08:38:22.249 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-22T08:38:22.177+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01bdb0) adding auth protocol: cephx 2024-09-22T08:38:22.249 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-22T08:38:22.177+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01bdb0) adding auth protocol: cephx 2024-09-22T08:38:22.249 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-22T08:38:22.177+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01bdb0) adding con mode: secure 2024-09-22T08:38:22.249 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-22T08:38:22.177+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01bdb0) adding con mode: crc 2024-09-22T08:38:22.249 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-22T08:38:22.177+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01bdb0) adding con mode: secure 2024-09-22T08:38:22.249 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-22T08:38:22.177+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01bdb0) adding con mode: crc 2024-09-22T08:38:22.250 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-22T08:38:22.177+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01bdb0) adding con mode: secure 2024-09-22T08:38:22.250 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-22T08:38:22.177+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01bdb0) adding con mode: crc 2024-09-22T08:38:22.250 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-22T08:38:22.177+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01bdb0) adding con mode: crc 2024-09-22T08:38:22.250 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-22T08:38:22.177+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01bdb0) adding con mode: secure 2024-09-22T08:38:22.250 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-22T08:38:22.177+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01bdb0) adding con mode: crc 2024-09-22T08:38:22.250 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-22T08:38:22.177+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01bdb0) adding con mode: secure 2024-09-22T08:38:22.250 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-22T08:38:22.177+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01bdb0) adding con mode: crc 2024-09-22T08:38:22.250 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-22T08:38:22.177+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01bdb0) adding con mode: secure 2024-09-22T08:38:22.250 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-22T08:38:22.177+0000 7f43a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:22.250 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-22T08:38:22.178+0000 7f44ef175800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:22.250 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-22T08:38:22.178+0000 7f44ef175800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:22.250 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-22T08:38:22.178+0000 7f44ef175800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:22.250 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-22T08:38:22.178+0000 7f44ef175800 5 asok(0x562feee3a0f0) register_command cache list hook 0x562fef0fc100 2024-09-22T08:38:22.250 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-22T08:38:22.178+0000 7f44ef175800 5 asok(0x562feee3a0f0) register_command cache inspect hook 0x562fef0fc100 2024-09-22T08:38:22.250 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-22T08:38:22.178+0000 7f44ef175800 5 asok(0x562feee3a0f0) register_command cache erase hook 0x562fef0fc100 2024-09-22T08:38:22.251 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-22T08:38:22.178+0000 7f44ef175800 5 asok(0x562feee3a0f0) register_command cache zap hook 0x562fef0fc100 2024-09-22T08:38:22.251 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-22T08:38:22.178+0000 7f44ef175800 5 note: GC not initialized 2024-09-22T08:38:22.251 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-22T08:38:22.178+0000 7f43a1fe3640 20 reqs_thread_entry: start 2024-09-22T08:38:22.251 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-22T08:38:22.178+0000 7f44ef175800 5 asok(0x562feee3a0f0) register_command sync trace show hook 0x7f44d4087070 2024-09-22T08:38:22.251 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-22T08:38:22.178+0000 7f44ef175800 5 asok(0x562feee3a0f0) register_command sync trace history hook 0x7f44d4087070 2024-09-22T08:38:22.251 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-22T08:38:22.178+0000 7f44ef175800 5 asok(0x562feee3a0f0) register_command sync trace active hook 0x7f44d4087070 2024-09-22T08:38:22.251 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-22T08:38:22.178+0000 7f44ef175800 5 asok(0x562feee3a0f0) register_command sync trace active_short hook 0x7f44d4087070 2024-09-22T08:38:22.251 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-22T08:38:22.178+0000 7f44ef175800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:22.251 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-22T08:38:22.178+0000 7f44ef175800 20 Filter name: none 2024-09-22T08:38:22.251 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-22T08:38:22.178+0000 7f43137fe640 20 reqs_thread_entry: start 2024-09-22T08:38:22.251 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-22T08:38:22.179+0000 7f44ef175800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:38:22.251 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-22T08:38:22.179+0000 7f44ef175800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.251 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-22T08:38:22.179+0000 7f44ef175800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:38:22.251 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-22T08:38:22.179+0000 7f44ef175800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:38:22.251 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-22T08:38:22.179+0000 7f44ef175800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:38:22.252 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-22T08:38:22.179+0000 7f44ef175800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 : miss 2024-09-22T08:38:22.252 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-22T08:38:22.179+0000 7f44ef175800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.252 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-22T08:38:22.180+0000 7f44ef175800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T08:38:22.252 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-22T08:38:22.180+0000 7f44ef175800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:38:22.252 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-22T08:38:22.180+0000 7f44ef175800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:38:22.252 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-22T08:38:22.180+0000 7f44ef175800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:38:22.252 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-22T08:38:22.180+0000 7f44ef175800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:38:22.252 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-22T08:38:22.180+0000 7f44ef175800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 2024-09-22T08:38:22.252 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-22T08:38:22.186+0000 7f44ef175800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:38:22.252 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-22T08:38:22.186+0000 7f44ef175800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:38:22.252 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-22T08:38:22.186+0000 7f44ef175800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:38:22.252 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-22T08:38:22.186+0000 7f44ef175800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17, ofs0, ns] 2024-09-22T08:38:22.252 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-22T08:38:22.186+0000 7f43c3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497036 cookie 94763874628688 notifier 7664 bl.length()=827 2024-09-22T08:38:22.253 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-22T08:38:22.186+0000 7f43c3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:38:22.253 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-22T08:38:22.186+0000 7f43c3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:38:22.253 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-22T08:38:22.186+0000 7f43c3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:38:22.253 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-22T08:38:22.187+0000 7f44ef175800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_sources= new_sources= 2024-09-22T08:38:22.253 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-22T08:38:22.187+0000 7f44ef175800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential sources added=[] removed=[] 2024-09-22T08:38:22.253 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-22T08:38:22.187+0000 7f44ef175800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_dests= new_dests= 2024-09-22T08:38:22.253 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-22T08:38:22.187+0000 7f44ef175800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential dests added=[] removed=[] 2024-09-22T08:38:22.253 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-22T08:38:22.193+0000 7f44ef175800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f44ef175800 time 2024-09-22T08:38:22.193423+0000 2024-09-22T08:38:22.253 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:38:22.253 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:22.253 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:38:22.253 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f44f278c748] 2024-09-22T08:38:22.253 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f44f278c906] 2024-09-22T08:38:22.253 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562fede3de01] 2024-09-22T08:38:22.254 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562fede4dd0a] 2024-09-22T08:38:22.254 INFO:tasks.workunit.client.0.smithi038.stderr: 5: main() 2024-09-22T08:38:22.254 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f44f1429590] 2024-09-22T08:38:22.254 INFO:tasks.workunit.client.0.smithi038.stderr: 7: __libc_start_main() 2024-09-22T08:38:22.254 INFO:tasks.workunit.client.0.smithi038.stderr: 8: _start() 2024-09-22T08:38:22.254 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:22.254 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-22T08:38:22.194+0000 7f44ef175800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:38:22.254 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f44ef175800 thread_name:radosgw-admin 2024-09-22T08:38:22.254 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:22.254 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:38:22.254 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f44f143e6f0] 2024-09-22T08:38:22.254 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f44f148b99c] 2024-09-22T08:38:22.254 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:38:22.254 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:38:22.255 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f44f278c7a2] 2024-09-22T08:38:22.255 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f44f278c906] 2024-09-22T08:38:22.255 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562fede3de01] 2024-09-22T08:38:22.255 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562fede4dd0a] 2024-09-22T08:38:22.255 INFO:tasks.workunit.client.0.smithi038.stderr: 9: main() 2024-09-22T08:38:22.255 INFO:tasks.workunit.client.0.smithi038.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f44f1429590] 2024-09-22T08:38:22.255 INFO:tasks.workunit.client.0.smithi038.stderr: 11: __libc_start_main() 2024-09-22T08:38:22.255 INFO:tasks.workunit.client.0.smithi038.stderr: 12: _start() 2024-09-22T08:38:22.255 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:38:22.255 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:22.255 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-22T08:38:22.255 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-22T08:38:22.255 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-22T08:38:22.255 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-22T08:38:22.255 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-22T08:38:22.256 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-22T08:38:22.256 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-22T08:38:22.256 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-22T08:38:22.256 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-22T08:38:22.257 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-22T08:38:22.257 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-22T08:38:22.257 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-22T08:38:22.257 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-22T08:38:22.257 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-22T08:38:22.257 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-22T08:38:22.257 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-22T08:38:22.258 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-22T08:38:22.258 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-22T08:38:22.258 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-22T08:38:22.258 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-22T08:38:22.258 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-22T08:38:22.258 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-22T08:38:22.258 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-22T08:38:22.258 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-22T08:38:22.258 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:38:22.258 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-22T08:38:22.258 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-22T08:38:22.258 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-22T08:38:22.258 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-22T08:38:22.258 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-22T08:38:22.258 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-22T08:38:22.259 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-22T08:38:22.259 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-22T08:38:22.259 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-22T08:38:22.259 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-22T08:38:22.259 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-22T08:38:22.259 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-22T08:38:22.259 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-22T08:38:22.259 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-22T08:38:22.259 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-22T08:38:22.259 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-22T08:38:22.259 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-22T08:38:22.259 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-22T08:38:22.259 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-22T08:38:22.259 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-22T08:38:22.259 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-22T08:38:22.260 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:38:22.260 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-22T08:38:22.260 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:38:22.260 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-22T08:38:22.260 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-22T08:38:22.260 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-22T08:38:22.260 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-22T08:38:22.260 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-22T08:38:22.260 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-22T08:38:22.260 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-22T08:38:22.260 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-22T08:38:22.260 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-22T08:38:22.260 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-22T08:38:22.260 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-22T08:38:22.260 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-22T08:38:22.261 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-22T08:38:22.261 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-22T08:38:22.261 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-22T08:38:22.261 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-22T08:38:22.261 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-22T08:38:22.261 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-22T08:38:22.261 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:38:22.261 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-22T08:38:22.261 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:38:22.261 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-22T08:38:22.261 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-22T08:38:22.261 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-22T08:38:22.261 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-22T08:38:22.262 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-22T08:38:22.262 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-22T08:38:22.262 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:38:22.262 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-22T08:38:22.262 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-22T08:38:22.262 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:38:22.262 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-22T08:38:22.262 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-22T08:38:22.262 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-22T08:38:22.262 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-22T08:38:22.262 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-22T08:38:22.262 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-22T08:38:22.262 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-22T08:38:22.263 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-22T08:38:22.263 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-22T08:38:22.263 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-22T08:38:22.263 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-22T08:38:22.263 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-22T08:38:22.263 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-22T08:38:22.263 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:38:22.263 INFO:tasks.workunit.client.0.smithi038.stderr: 7f43137fe640 / http_manager 2024-09-22T08:38:22.263 INFO:tasks.workunit.client.0.smithi038.stderr: 7f43a1fe3640 / http_manager 2024-09-22T08:38:22.263 INFO:tasks.workunit.client.0.smithi038.stderr: 7f43a2fe5640 / rgw_dt_lg_renew 2024-09-22T08:38:22.263 INFO:tasks.workunit.client.0.smithi038.stderr: 7f43c27fc640 / ms_dispatch 2024-09-22T08:38:22.263 INFO:tasks.workunit.client.0.smithi038.stderr: 7f43c3fff640 / io_context_pool 2024-09-22T08:38:22.263 INFO:tasks.workunit.client.0.smithi038.stderr: 7f43d27fc640 / ms_dispatch 2024-09-22T08:38:22.263 INFO:tasks.workunit.client.0.smithi038.stderr: 7f43d960a640 / ms_dispatch 2024-09-22T08:38:22.264 INFO:tasks.workunit.client.0.smithi038.stderr: 7f43dae0d640 / io_context_pool 2024-09-22T08:38:22.264 INFO:tasks.workunit.client.0.smithi038.stderr: 7f44ec45e640 / msgr-worker-2 2024-09-22T08:38:22.264 INFO:tasks.workunit.client.0.smithi038.stderr: 7f44ecc5f640 / msgr-worker-1 2024-09-22T08:38:22.264 INFO:tasks.workunit.client.0.smithi038.stderr: 7f44ed460640 / msgr-worker-0 2024-09-22T08:38:22.264 INFO:tasks.workunit.client.0.smithi038.stderr: 7f44edc61640 / io_context_pool 2024-09-22T08:38:22.264 INFO:tasks.workunit.client.0.smithi038.stderr: 7f44ef175800 / radosgw-admin 2024-09-22T08:38:22.264 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-22T08:38:22.264 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-22T08:38:22.264 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/log/ceph/ceph-client.admin.149288.log 2024-09-22T08:38:22.264 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-22T08:38:22.264 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-22T08:38:22.264 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-22T08:38:21.723+0000 7f43dae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:22.264 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-22T08:38:21.723+0000 7f43dae0d640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:38:22.264 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-22T08:38:21.723+0000 7f43dae0d640 10 monclient: dump: 2024-09-22T08:38:22.264 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:38:22.265 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:38:22.265 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:22.265 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:22.265 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:22.265 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:22.265 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:38:22.265 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:38:22.265 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:38:22.265 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:22.265 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-22T08:38:21.723+0000 7f43dae0d640 10 monclient: _finish_auth 0 2024-09-22T08:38:22.265 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-22T08:38:21.723+0000 7f43dae0d640 10 monclient: _check_auth_tickets 2024-09-22T08:38:22.265 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-22T08:38:21.723+0000 7f43dae0d640 10 monclient: handle_config config(0 keys) 2024-09-22T08:38:22.265 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-22T08:38:21.723+0000 7f43dae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:22.265 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-22T08:38:21.723+0000 7f43dae0d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:38:22.265 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-22T08:38:21.723+0000 7f43dae0d640 10 monclient: dump: 2024-09-22T08:38:22.266 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:38:22.266 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:38:22.266 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:22.266 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:22.266 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:22.266 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:22.266 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:38:22.266 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:38:22.266 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:38:22.266 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:22.266 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-22T08:38:21.723+0000 7f44ef175800 5 monclient: authenticate success, global_id 7652 2024-09-22T08:38:22.266 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-22T08:38:21.723+0000 7f44ef175800 10 monclient: get_monmap_and_config success 2024-09-22T08:38:22.266 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-22T08:38:21.723+0000 7f44ef175800 4 set_mon_vals no callback set 2024-09-22T08:38:22.266 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-22T08:38:21.724+0000 7f44ef175800 10 monclient: shutdown 2024-09-22T08:38:22.267 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 asok(0x562feee3a0f0) unregister_commands rotate-key 2024-09-22T08:38:22.267 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-22T08:38:21.724+0000 7f44ef175800 10 monclient: build_initial_monmap 2024-09-22T08:38:22.267 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-22T08:38:21.724+0000 7f44ef175800 1 build_initial for_mkfs: 0 2024-09-22T08:38:22.267 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-22T08:38:21.724+0000 7f44ef175800 10 monclient: monmap: 2024-09-22T08:38:22.267 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:38:22.267 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:38:22.267 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:38:22.267 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:38:22.267 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:38:22.267 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:22.267 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:38:22.267 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:38:22.267 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:38:22.267 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:22.267 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef089ae0) adding auth protocol: cephx 2024-09-22T08:38:22.268 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef089ae0) adding auth protocol: cephx 2024-09-22T08:38:22.268 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef089ae0) adding auth protocol: cephx 2024-09-22T08:38:22.268 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef089ae0) adding con mode: secure 2024-09-22T08:38:22.268 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef089ae0) adding con mode: crc 2024-09-22T08:38:22.268 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef089ae0) adding con mode: secure 2024-09-22T08:38:22.268 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef089ae0) adding con mode: crc 2024-09-22T08:38:22.268 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef089ae0) adding con mode: secure 2024-09-22T08:38:22.268 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef089ae0) adding con mode: crc 2024-09-22T08:38:22.268 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef089ae0) adding con mode: crc 2024-09-22T08:38:22.268 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef089ae0) adding con mode: secure 2024-09-22T08:38:22.268 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef089ae0) adding con mode: crc 2024-09-22T08:38:22.268 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef089ae0) adding con mode: secure 2024-09-22T08:38:22.268 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef089ae0) adding con mode: crc 2024-09-22T08:38:22.268 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef089ae0) adding con mode: secure 2024-09-22T08:38:22.268 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-22T08:38:21.724+0000 7f44ef175800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:22.269 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-22T08:38:21.724+0000 7f44ef175800 1 librados: starting msgr at 2024-09-22T08:38:22.269 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-22T08:38:21.724+0000 7f44ef175800 1 librados: starting objecter 2024-09-22T08:38:22.269 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 asok(0x562feee3a0f0) register_command objecter_requests hook 0x562fef08c6d0 2024-09-22T08:38:22.269 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-22T08:38:21.724+0000 7f44ef175800 1 librados: setting wanted keys 2024-09-22T08:38:22.269 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-22T08:38:21.724+0000 7f44ef175800 1 librados: calling monclient init 2024-09-22T08:38:22.269 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-22T08:38:21.724+0000 7f44ef175800 10 monclient: init 2024-09-22T08:38:22.269 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef05ad60) adding auth protocol: cephx 2024-09-22T08:38:22.269 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef05ad60) adding auth protocol: cephx 2024-09-22T08:38:22.269 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef05ad60) adding auth protocol: cephx 2024-09-22T08:38:22.269 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef05ad60) adding con mode: secure 2024-09-22T08:38:22.269 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef05ad60) adding con mode: crc 2024-09-22T08:38:22.269 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef05ad60) adding con mode: secure 2024-09-22T08:38:22.269 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef05ad60) adding con mode: crc 2024-09-22T08:38:22.269 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef05ad60) adding con mode: secure 2024-09-22T08:38:22.269 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef05ad60) adding con mode: crc 2024-09-22T08:38:22.269 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef05ad60) adding con mode: crc 2024-09-22T08:38:22.270 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef05ad60) adding con mode: secure 2024-09-22T08:38:22.270 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef05ad60) adding con mode: crc 2024-09-22T08:38:22.270 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef05ad60) adding con mode: secure 2024-09-22T08:38:22.270 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef05ad60) adding con mode: crc 2024-09-22T08:38:22.270 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-22T08:38:21.724+0000 7f44ef175800 5 AuthRegistry(0x562fef05ad60) adding con mode: secure 2024-09-22T08:38:22.270 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-22T08:38:21.725+0000 7f44ef175800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:22.270 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-22T08:38:21.725+0000 7f44ef175800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:22.270 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-22T08:38:21.725+0000 7f44ef175800 5 asok(0x562feee3a0f0) register_command rotate-key hook 0x562fef05aea8 2024-09-22T08:38:22.270 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-22T08:38:21.725+0000 7f44ef175800 10 monclient: _reopen_session rank -1 2024-09-22T08:38:22.270 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-22T08:38:21.725+0000 7f44ef175800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T08:38:22.270 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-22T08:38:21.725+0000 7f44ef175800 10 monclient(hunting): picked mon.noname-b con 0x562feef07bd0 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:38:22.270 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-22T08:38:21.725+0000 7f44ef175800 10 monclient(hunting): picked mon.noname-a con 0x562feef11640 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:38:22.270 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-22T08:38:21.725+0000 7f44ef175800 10 monclient(hunting): picked mon.noname-c con 0x562feef9dbd0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:38:22.271 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-22T08:38:21.725+0000 7f44ef175800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:22.271 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-22T08:38:21.725+0000 7f44ef175800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:22.271 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-22T08:38:21.725+0000 7f44ef175800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:22.271 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-22T08:38:21.725+0000 7f44ef175800 10 monclient(hunting): _renew_subs 2024-09-22T08:38:22.271 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-22T08:38:21.725+0000 7f44ef175800 10 monclient(hunting): authenticate will time out at 2206.964362s 2024-09-22T08:38:22.271 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-22T08:38:21.725+0000 7f44ec45e640 10 monclient(hunting): get_auth_request con 0x562feef11640 auth_method 0 2024-09-22T08:38:22.271 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-22T08:38:21.725+0000 7f44ec45e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:22.271 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-22T08:38:21.725+0000 7f44ec45e640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:22.271 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-22T08:38:21.725+0000 7f44ec45e640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:22.271 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-22T08:38:21.725+0000 7f44ed460640 10 monclient(hunting): get_auth_request con 0x562feef9dbd0 auth_method 0 2024-09-22T08:38:22.271 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-22T08:38:21.725+0000 7f44ed460640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:22.271 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-22T08:38:21.725+0000 7f44ed460640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:22.271 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-22T08:38:21.725+0000 7f44ed460640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:22.271 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-22T08:38:21.725+0000 7f44ec45e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:22.271 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-22T08:38:21.725+0000 7f44ec45e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:22.272 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-22T08:38:21.725+0000 7f44ec45e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:22.272 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-22T08:38:21.725+0000 7f44ed460640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:22.272 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-22T08:38:21.725+0000 7f44ed460640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:22.272 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-22T08:38:21.725+0000 7f44ed460640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:22.272 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-22T08:38:21.725+0000 7f44ec45e640 10 monclient(hunting): handle_auth_done global_id 8139 payload 824 2024-09-22T08:38:22.272 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-22T08:38:21.725+0000 7f44ec45e640 10 monclient: _finish_hunting 0 2024-09-22T08:38:22.272 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-22T08:38:21.725+0000 7f44ec45e640 1 monclient: found mon.noname-a 2024-09-22T08:38:22.272 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-22T08:38:21.725+0000 7f44ec45e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:38:22.272 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-22T08:38:21.726+0000 7f43d960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:22.272 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-22T08:38:21.726+0000 7f43d960a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:38:22.272 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-22T08:38:21.726+0000 7f43d960a640 10 monclient: dump: 2024-09-22T08:38:22.272 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:38:22.272 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:38:22.272 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:22.272 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:22.273 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:22.273 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:22.273 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:38:22.273 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:38:22.273 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:38:22.273 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:22.273 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-22T08:38:21.726+0000 7f43d960a640 10 monclient: _finish_auth 0 2024-09-22T08:38:22.273 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-22T08:38:21.726+0000 7f43d960a640 10 monclient: _check_auth_tickets 2024-09-22T08:38:22.273 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-22T08:38:21.726+0000 7f44ef175800 5 monclient: authenticate success, global_id 8139 2024-09-22T08:38:22.273 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-22T08:38:21.726+0000 7f44ef175800 10 monclient: _renew_subs 2024-09-22T08:38:22.273 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-22T08:38:21.726+0000 7f44ef175800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:38:22.273 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-22T08:38:21.726+0000 7f43d960a640 10 monclient: handle_config config(0 keys) 2024-09-22T08:38:22.273 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-22T08:38:21.726+0000 7f43d960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:22.273 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-22T08:38:21.726+0000 7f43d960a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:38:22.273 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-22T08:38:21.726+0000 7f43d960a640 10 monclient: dump: 2024-09-22T08:38:22.274 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:38:22.274 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:38:22.274 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:22.274 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:22.274 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:22.274 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:22.274 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:38:22.274 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:38:22.274 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:38:22.274 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:22.274 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-22T08:38:21.726+0000 7f43dae0d640 4 set_mon_vals no callback set 2024-09-22T08:38:22.274 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-22T08:38:21.726+0000 7f44ef175800 10 monclient: _renew_subs 2024-09-22T08:38:22.274 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-22T08:38:21.726+0000 7f44ef175800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:38:22.274 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-22T08:38:21.726+0000 7f44ef175800 1 librados: init done 2024-09-22T08:38:22.275 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-22T08:38:21.728+0000 7f43d960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:38:22.275 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-22T08:38:21.728+0000 7f43d960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:38:22.275 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-22T08:38:21.728+0000 7f43d960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:38:22.275 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-22T08:38:21.728+0000 7f44ecc5f640 10 monclient: get_auth_request con 0x7f43d40775a0 auth_method 0 2024-09-22T08:38:22.275 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-22T08:38:21.728+0000 7f44ed460640 10 monclient: get_auth_request con 0x562fef0a35c0 auth_method 0 2024-09-22T08:38:22.275 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-22T08:38:21.729+0000 7f44ecc5f640 10 monclient: get_auth_request con 0x562fef0a67a0 auth_method 0 2024-09-22T08:38:22.275 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-22T08:38:21.730+0000 7f44ec45e640 10 monclient: get_auth_request con 0x562fef0aa990 auth_method 0 2024-09-22T08:38:22.275 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-22T08:38:21.731+0000 7f44ed460640 10 monclient: get_auth_request con 0x562fef0aa020 auth_method 0 2024-09-22T08:38:22.275 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-22T08:38:21.732+0000 7f44ef175800 10 monclient: build_initial_monmap 2024-09-22T08:38:22.275 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-22T08:38:21.732+0000 7f44ef175800 1 build_initial for_mkfs: 0 2024-09-22T08:38:22.275 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-22T08:38:21.732+0000 7f44ef175800 10 monclient: monmap: 2024-09-22T08:38:22.275 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:38:22.275 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:38:22.275 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:38:22.275 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:38:22.276 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:38:22.276 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:22.276 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:38:22.276 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:38:22.276 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:38:22.276 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:22.276 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b2bc0) adding auth protocol: cephx 2024-09-22T08:38:22.276 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b2bc0) adding auth protocol: cephx 2024-09-22T08:38:22.276 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b2bc0) adding auth protocol: cephx 2024-09-22T08:38:22.276 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b2bc0) adding con mode: secure 2024-09-22T08:38:22.276 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b2bc0) adding con mode: crc 2024-09-22T08:38:22.276 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b2bc0) adding con mode: secure 2024-09-22T08:38:22.276 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b2bc0) adding con mode: crc 2024-09-22T08:38:22.276 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b2bc0) adding con mode: secure 2024-09-22T08:38:22.276 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b2bc0) adding con mode: crc 2024-09-22T08:38:22.277 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b2bc0) adding con mode: crc 2024-09-22T08:38:22.277 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b2bc0) adding con mode: secure 2024-09-22T08:38:22.277 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b2bc0) adding con mode: crc 2024-09-22T08:38:22.277 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b2bc0) adding con mode: secure 2024-09-22T08:38:22.277 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b2bc0) adding con mode: crc 2024-09-22T08:38:22.277 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b2bc0) adding con mode: secure 2024-09-22T08:38:22.277 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-22T08:38:21.732+0000 7f44ef175800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:22.277 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 asok(0x562feee3a0f0) register_command objecter_requests cmddesc objecter_requests hook 0x562fef0b6010 EEXIST 2024-09-22T08:38:22.277 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-22T08:38:21.732+0000 7f44ef175800 10 monclient: init 2024-09-22T08:38:22.277 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b19c8) adding auth protocol: cephx 2024-09-22T08:38:22.277 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b19c8) adding auth protocol: cephx 2024-09-22T08:38:22.277 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b19c8) adding auth protocol: cephx 2024-09-22T08:38:22.277 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b19c8) adding con mode: secure 2024-09-22T08:38:22.277 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b19c8) adding con mode: crc 2024-09-22T08:38:22.277 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b19c8) adding con mode: secure 2024-09-22T08:38:22.278 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b19c8) adding con mode: crc 2024-09-22T08:38:22.278 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b19c8) adding con mode: secure 2024-09-22T08:38:22.278 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b19c8) adding con mode: crc 2024-09-22T08:38:22.278 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b19c8) adding con mode: crc 2024-09-22T08:38:22.278 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b19c8) adding con mode: secure 2024-09-22T08:38:22.278 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b19c8) adding con mode: crc 2024-09-22T08:38:22.278 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b19c8) adding con mode: secure 2024-09-22T08:38:22.278 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b19c8) adding con mode: crc 2024-09-22T08:38:22.278 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-22T08:38:21.732+0000 7f44ef175800 5 AuthRegistry(0x562fef0b19c8) adding con mode: secure 2024-09-22T08:38:22.278 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-22T08:38:21.732+0000 7f44ef175800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:22.278 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-22T08:38:21.733+0000 7f44ef175800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:22.278 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-22T08:38:21.733+0000 7f44ef175800 5 asok(0x562feee3a0f0) register_command rotate-key cmddesc rotate-key hook 0x562fef0b1b10 EEXIST 2024-09-22T08:38:22.278 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-22T08:38:21.733+0000 7f44ef175800 10 monclient: _reopen_session rank -1 2024-09-22T08:38:22.278 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-22T08:38:21.733+0000 7f44ef175800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-22T08:38:22.279 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-22T08:38:21.733+0000 7f44ef175800 10 monclient(hunting): picked mon.noname-c con 0x562fef0da330 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:38:22.279 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-22T08:38:21.733+0000 7f44ef175800 10 monclient(hunting): picked mon.noname-b con 0x562fef0da710 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:38:22.279 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-22T08:38:21.733+0000 7f44ef175800 10 monclient(hunting): picked mon.noname-a con 0x562fef0d9040 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:38:22.279 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-22T08:38:21.733+0000 7f44ef175800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:22.279 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-22T08:38:21.733+0000 7f44ef175800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:22.279 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-22T08:38:21.733+0000 7f44ef175800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:22.279 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-22T08:38:21.733+0000 7f44ef175800 10 monclient(hunting): _renew_subs 2024-09-22T08:38:22.279 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-22T08:38:21.733+0000 7f44ef175800 10 monclient(hunting): authenticate will time out at 2206.972305s 2024-09-22T08:38:22.279 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-22T08:38:21.733+0000 7f44ec45e640 10 monclient(hunting): get_auth_request con 0x562fef0da330 auth_method 0 2024-09-22T08:38:22.279 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-22T08:38:21.733+0000 7f44ec45e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:22.279 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-22T08:38:21.733+0000 7f44ec45e640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:22.279 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-22T08:38:21.733+0000 7f44ec45e640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:22.279 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-22T08:38:21.733+0000 7f44ecc5f640 10 monclient(hunting): get_auth_request con 0x562fef0d9040 auth_method 0 2024-09-22T08:38:22.279 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-22T08:38:21.733+0000 7f44ecc5f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:22.279 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-22T08:38:21.733+0000 7f44ecc5f640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:22.280 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-22T08:38:21.733+0000 7f44ecc5f640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:22.280 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-22T08:38:21.733+0000 7f44ec45e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:22.280 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-22T08:38:21.733+0000 7f44ec45e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:22.280 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-22T08:38:21.733+0000 7f44ec45e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:22.280 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-22T08:38:21.733+0000 7f44ed460640 10 monclient(hunting): get_auth_request con 0x562fef0da710 auth_method 0 2024-09-22T08:38:22.280 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-22T08:38:21.733+0000 7f44ed460640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:22.280 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-22T08:38:21.733+0000 7f44ed460640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:22.280 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-22T08:38:21.733+0000 7f44ed460640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:22.280 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-22T08:38:21.733+0000 7f44ecc5f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:22.280 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-22T08:38:21.733+0000 7f44ecc5f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:22.280 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-22T08:38:21.733+0000 7f44ecc5f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:22.280 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-22T08:38:21.733+0000 7f44ed460640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:22.280 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-22T08:38:21.733+0000 7f44ed460640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:22.280 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-22T08:38:21.733+0000 7f44ed460640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:22.280 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-22T08:38:21.733+0000 7f44ec45e640 10 monclient(hunting): handle_auth_done global_id 7658 payload 824 2024-09-22T08:38:22.281 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-22T08:38:21.733+0000 7f44ec45e640 10 monclient: _finish_hunting 0 2024-09-22T08:38:22.281 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-22T08:38:21.733+0000 7f44ec45e640 1 monclient: found mon.noname-c 2024-09-22T08:38:22.281 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-22T08:38:21.733+0000 7f44ec45e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:38:22.281 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-22T08:38:21.733+0000 7f43d27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:22.281 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-22T08:38:21.733+0000 7f43d27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:38:22.281 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-22T08:38:21.733+0000 7f43d27fc640 10 monclient: dump: 2024-09-22T08:38:22.281 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:38:22.281 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:38:22.281 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:22.281 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:22.281 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:22.281 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:22.281 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:38:22.281 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:38:22.282 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:38:22.282 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:22.282 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-22T08:38:21.733+0000 7f43d27fc640 10 monclient: _finish_auth 0 2024-09-22T08:38:22.282 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-22T08:38:21.733+0000 7f43d27fc640 10 monclient: _check_auth_tickets 2024-09-22T08:38:22.282 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-22T08:38:21.733+0000 7f43d27fc640 10 monclient: handle_config config(0 keys) 2024-09-22T08:38:22.282 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-22T08:38:21.733+0000 7f43d27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:22.282 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-22T08:38:21.733+0000 7f43d27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:38:22.282 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-22T08:38:21.733+0000 7f43d27fc640 10 monclient: dump: 2024-09-22T08:38:22.282 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:38:22.282 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:38:22.282 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:22.282 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:22.282 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:22.282 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:22.283 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:38:22.283 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:38:22.283 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:38:22.283 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:22.283 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-22T08:38:21.733+0000 7f44ef175800 5 monclient: authenticate success, global_id 7658 2024-09-22T08:38:22.283 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-22T08:38:21.733+0000 7f44ef175800 10 monclient: _renew_subs 2024-09-22T08:38:22.283 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-22T08:38:21.733+0000 7f44ef175800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:38:22.283 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-22T08:38:21.733+0000 7f44edc61640 4 set_mon_vals no callback set 2024-09-22T08:38:22.283 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-22T08:38:21.734+0000 7f44ef175800 10 monclient: _renew_subs 2024-09-22T08:38:22.283 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-22T08:38:21.734+0000 7f44ef175800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:38:22.283 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-22T08:38:21.735+0000 7f43d27fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:38:22.283 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-22T08:38:21.735+0000 7f43d27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:38:22.283 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-22T08:38:21.735+0000 7f43d27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:38:22.283 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-22T08:38:21.735+0000 7f44ed460640 10 monclient: get_auth_request con 0x7f43c4077480 auth_method 0 2024-09-22T08:38:22.284 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-22T08:38:21.736+0000 7f44ef175800 10 monclient: get_monmap_and_config 2024-09-22T08:38:22.284 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-22T08:38:21.736+0000 7f44ef175800 10 monclient: build_initial_monmap 2024-09-22T08:38:22.284 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-22T08:38:21.736+0000 7f44ef175800 1 build_initial for_mkfs: 0 2024-09-22T08:38:22.284 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-22T08:38:21.736+0000 7f44ef175800 10 monclient: monmap: 2024-09-22T08:38:22.284 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:38:22.284 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:38:22.284 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:38:22.284 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:38:22.284 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:38:22.284 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:22.284 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:38:22.284 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:38:22.284 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:38:22.284 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:22.284 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x562fef0fa060) adding auth protocol: cephx 2024-09-22T08:38:22.284 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x562fef0fa060) adding auth protocol: cephx 2024-09-22T08:38:22.285 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x562fef0fa060) adding auth protocol: cephx 2024-09-22T08:38:22.285 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x562fef0fa060) adding con mode: secure 2024-09-22T08:38:22.285 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x562fef0fa060) adding con mode: crc 2024-09-22T08:38:22.285 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x562fef0fa060) adding con mode: secure 2024-09-22T08:38:22.285 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x562fef0fa060) adding con mode: crc 2024-09-22T08:38:22.285 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x562fef0fa060) adding con mode: secure 2024-09-22T08:38:22.285 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x562fef0fa060) adding con mode: crc 2024-09-22T08:38:22.285 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x562fef0fa060) adding con mode: crc 2024-09-22T08:38:22.285 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x562fef0fa060) adding con mode: secure 2024-09-22T08:38:22.285 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x562fef0fa060) adding con mode: crc 2024-09-22T08:38:22.285 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x562fef0fa060) adding con mode: secure 2024-09-22T08:38:22.285 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x562fef0fa060) adding con mode: crc 2024-09-22T08:38:22.285 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x562fef0fa060) adding con mode: secure 2024-09-22T08:38:22.285 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-22T08:38:21.736+0000 7f44ef175800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:22.286 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-22T08:38:21.736+0000 7f44ef175800 10 monclient: init 2024-09-22T08:38:22.286 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01b8e0) adding auth protocol: cephx 2024-09-22T08:38:22.286 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01b8e0) adding auth protocol: cephx 2024-09-22T08:38:22.286 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01b8e0) adding auth protocol: cephx 2024-09-22T08:38:22.286 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01b8e0) adding con mode: secure 2024-09-22T08:38:22.286 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01b8e0) adding con mode: crc 2024-09-22T08:38:22.286 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01b8e0) adding con mode: secure 2024-09-22T08:38:22.286 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01b8e0) adding con mode: crc 2024-09-22T08:38:22.286 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01b8e0) adding con mode: secure 2024-09-22T08:38:22.286 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01b8e0) adding con mode: crc 2024-09-22T08:38:22.286 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01b8e0) adding con mode: crc 2024-09-22T08:38:22.286 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01b8e0) adding con mode: secure 2024-09-22T08:38:22.286 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01b8e0) adding con mode: crc 2024-09-22T08:38:22.286 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01b8e0) adding con mode: secure 2024-09-22T08:38:22.287 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01b8e0) adding con mode: crc 2024-09-22T08:38:22.287 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01b8e0) adding con mode: secure 2024-09-22T08:38:22.287 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-22T08:38:21.736+0000 7f44ef175800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:22.287 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-22T08:38:21.736+0000 7f44ef175800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:22.287 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-22T08:38:21.736+0000 7f44ef175800 5 asok(0x562feee3a0f0) register_command rotate-key cmddesc rotate-key hook 0x7ffeaf01ba28 EEXIST 2024-09-22T08:38:22.287 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-22T08:38:21.736+0000 7f44ef175800 10 monclient: _reopen_session rank -1 2024-09-22T08:38:22.287 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-22T08:38:21.736+0000 7f44ef175800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T08:38:22.287 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-22T08:38:21.737+0000 7f44ef175800 10 monclient(hunting): picked mon.noname-a con 0x562fef12e700 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:38:22.287 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-22T08:38:21.737+0000 7f44ef175800 10 monclient(hunting): picked mon.noname-b con 0x562fef0ff650 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:38:22.287 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-22T08:38:21.737+0000 7f44ef175800 10 monclient(hunting): picked mon.noname-c con 0x562fef129fa0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:38:22.287 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-22T08:38:21.737+0000 7f44ef175800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:22.287 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-22T08:38:21.737+0000 7f44ef175800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:22.287 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-22T08:38:21.737+0000 7f44ef175800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:22.287 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-22T08:38:21.737+0000 7f44ef175800 10 monclient(hunting): _renew_subs 2024-09-22T08:38:22.288 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-22T08:38:21.737+0000 7f44ef175800 10 monclient(hunting): authenticate will time out at 2206.976058s 2024-09-22T08:38:22.288 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-22T08:38:21.737+0000 7f44ec45e640 10 monclient(hunting): get_auth_request con 0x562fef12e700 auth_method 0 2024-09-22T08:38:22.288 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-22T08:38:21.737+0000 7f44ec45e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:22.288 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-22T08:38:21.737+0000 7f44ec45e640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:22.288 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-22T08:38:21.737+0000 7f44ec45e640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:22.288 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-22T08:38:21.737+0000 7f44ecc5f640 10 monclient(hunting): get_auth_request con 0x562fef129fa0 auth_method 0 2024-09-22T08:38:22.288 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-22T08:38:21.737+0000 7f44ecc5f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:22.288 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-22T08:38:21.737+0000 7f44ecc5f640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:22.288 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-22T08:38:21.737+0000 7f44ecc5f640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:22.288 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-22T08:38:21.737+0000 7f44ec45e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:22.288 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-22T08:38:21.737+0000 7f44ec45e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:22.288 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-22T08:38:21.737+0000 7f44ec45e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:22.288 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-22T08:38:21.737+0000 7f44ecc5f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:22.288 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-22T08:38:21.737+0000 7f44ecc5f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:22.288 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-22T08:38:21.737+0000 7f44ecc5f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:22.289 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-22T08:38:21.737+0000 7f44ed460640 10 monclient(hunting): get_auth_request con 0x562fef0ff650 auth_method 0 2024-09-22T08:38:22.289 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-22T08:38:21.737+0000 7f44ed460640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:22.289 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-22T08:38:21.737+0000 7f44ed460640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:22.289 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-22T08:38:21.737+0000 7f44ed460640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:22.289 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-22T08:38:21.737+0000 7f44ec45e640 10 monclient(hunting): handle_auth_done global_id 8145 payload 274 2024-09-22T08:38:22.289 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-22T08:38:21.737+0000 7f44ec45e640 10 monclient: _finish_hunting 0 2024-09-22T08:38:22.289 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-22T08:38:21.737+0000 7f44ec45e640 1 monclient: found mon.noname-a 2024-09-22T08:38:22.289 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-22T08:38:21.737+0000 7f44ec45e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:38:22.289 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-22T08:38:21.737+0000 7f43c3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:22.289 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-22T08:38:21.737+0000 7f43c3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:38:22.289 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-22T08:38:21.737+0000 7f43c3fff640 10 monclient: dump: 2024-09-22T08:38:22.289 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:38:22.289 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:38:22.290 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:22.290 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:22.290 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:22.290 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:22.290 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:38:22.290 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:38:22.290 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:38:22.290 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:22.290 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-22T08:38:21.737+0000 7f43c3fff640 10 monclient: _finish_auth 0 2024-09-22T08:38:22.290 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-22T08:38:21.737+0000 7f43c3fff640 10 monclient: _check_auth_tickets 2024-09-22T08:38:22.290 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-22T08:38:21.737+0000 7f43c3fff640 10 monclient: handle_config config(0 keys) 2024-09-22T08:38:22.290 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-22T08:38:21.737+0000 7f43c3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:22.290 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-22T08:38:21.737+0000 7f43c3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:38:22.290 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-22T08:38:21.737+0000 7f43c3fff640 10 monclient: dump: 2024-09-22T08:38:22.290 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:38:22.291 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:38:22.291 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:22.291 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:22.291 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:22.291 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:22.291 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:38:22.291 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:38:22.291 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:38:22.291 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:22.291 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-22T08:38:21.737+0000 7f44ef175800 5 monclient: authenticate success, global_id 8145 2024-09-22T08:38:22.291 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-22T08:38:21.737+0000 7f44ef175800 10 monclient: get_monmap_and_config success 2024-09-22T08:38:22.291 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-22T08:38:21.737+0000 7f44ef175800 4 set_mon_vals no callback set 2024-09-22T08:38:22.291 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-22T08:38:21.738+0000 7f44ef175800 10 monclient: shutdown 2024-09-22T08:38:22.291 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-22T08:38:21.738+0000 7f44ef175800 10 monclient: build_initial_monmap 2024-09-22T08:38:22.292 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-22T08:38:21.738+0000 7f44ef175800 1 build_initial for_mkfs: 0 2024-09-22T08:38:22.292 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-22T08:38:21.738+0000 7f44ef175800 10 monclient: monmap: 2024-09-22T08:38:22.292 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:38:22.292 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:38:22.292 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:38:22.292 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:38:22.292 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:38:22.292 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:22.292 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:38:22.292 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:38:22.292 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:38:22.292 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:22.292 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef1202d0) adding auth protocol: cephx 2024-09-22T08:38:22.292 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef1202d0) adding auth protocol: cephx 2024-09-22T08:38:22.292 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef1202d0) adding auth protocol: cephx 2024-09-22T08:38:22.293 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef1202d0) adding con mode: secure 2024-09-22T08:38:22.293 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef1202d0) adding con mode: crc 2024-09-22T08:38:22.293 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef1202d0) adding con mode: secure 2024-09-22T08:38:22.293 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef1202d0) adding con mode: crc 2024-09-22T08:38:22.293 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef1202d0) adding con mode: secure 2024-09-22T08:38:22.293 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef1202d0) adding con mode: crc 2024-09-22T08:38:22.293 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef1202d0) adding con mode: crc 2024-09-22T08:38:22.293 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef1202d0) adding con mode: secure 2024-09-22T08:38:22.293 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef1202d0) adding con mode: crc 2024-09-22T08:38:22.293 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef1202d0) adding con mode: secure 2024-09-22T08:38:22.293 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef1202d0) adding con mode: crc 2024-09-22T08:38:22.293 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef1202d0) adding con mode: secure 2024-09-22T08:38:22.293 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-22T08:38:21.738+0000 7f44ef175800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:22.293 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-22T08:38:21.738+0000 7f44ef175800 1 librados: starting msgr at 2024-09-22T08:38:22.293 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-22T08:38:21.738+0000 7f44ef175800 1 librados: starting objecter 2024-09-22T08:38:22.294 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 asok(0x562feee3a0f0) register_command objecter_requests cmddesc objecter_requests hook 0x562fef0dac20 EEXIST 2024-09-22T08:38:22.294 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-22T08:38:21.738+0000 7f44ef175800 1 librados: setting wanted keys 2024-09-22T08:38:22.294 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-22T08:38:21.738+0000 7f44ef175800 1 librados: calling monclient init 2024-09-22T08:38:22.294 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-22T08:38:21.738+0000 7f44ef175800 10 monclient: init 2024-09-22T08:38:22.294 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef0eebf0) adding auth protocol: cephx 2024-09-22T08:38:22.294 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef0eebf0) adding auth protocol: cephx 2024-09-22T08:38:22.294 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef0eebf0) adding auth protocol: cephx 2024-09-22T08:38:22.294 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef0eebf0) adding con mode: secure 2024-09-22T08:38:22.294 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef0eebf0) adding con mode: crc 2024-09-22T08:38:22.294 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef0eebf0) adding con mode: secure 2024-09-22T08:38:22.294 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef0eebf0) adding con mode: crc 2024-09-22T08:38:22.294 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef0eebf0) adding con mode: secure 2024-09-22T08:38:22.294 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef0eebf0) adding con mode: crc 2024-09-22T08:38:22.294 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef0eebf0) adding con mode: crc 2024-09-22T08:38:22.295 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef0eebf0) adding con mode: secure 2024-09-22T08:38:22.295 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef0eebf0) adding con mode: crc 2024-09-22T08:38:22.295 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef0eebf0) adding con mode: secure 2024-09-22T08:38:22.295 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef0eebf0) adding con mode: crc 2024-09-22T08:38:22.295 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-22T08:38:21.738+0000 7f44ef175800 5 AuthRegistry(0x562fef0eebf0) adding con mode: secure 2024-09-22T08:38:22.295 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-22T08:38:21.738+0000 7f44ef175800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:22.295 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-22T08:38:21.739+0000 7f44ef175800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:22.295 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-22T08:38:21.739+0000 7f44ef175800 5 asok(0x562feee3a0f0) register_command rotate-key cmddesc rotate-key hook 0x562fef0eed38 EEXIST 2024-09-22T08:38:22.295 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-22T08:38:21.739+0000 7f44ef175800 10 monclient: _reopen_session rank -1 2024-09-22T08:38:22.295 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-22T08:38:21.739+0000 7f44ef175800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-22T08:38:22.295 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-22T08:38:21.739+0000 7f44ef175800 10 monclient(hunting): picked mon.noname-b con 0x562fef0ff650 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:38:22.295 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-22T08:38:21.739+0000 7f44ef175800 10 monclient(hunting): picked mon.noname-c con 0x562fef129fa0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:38:22.295 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-22T08:38:21.739+0000 7f44ef175800 10 monclient(hunting): picked mon.noname-a con 0x562fef12e700 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:38:22.295 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-22T08:38:21.739+0000 7f44ef175800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:22.296 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-22T08:38:21.739+0000 7f44ef175800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:22.296 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-22T08:38:21.739+0000 7f44ef175800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:22.296 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-22T08:38:21.739+0000 7f44ef175800 10 monclient(hunting): _renew_subs 2024-09-22T08:38:22.296 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-22T08:38:21.739+0000 7f44ef175800 10 monclient(hunting): authenticate will time out at 2206.978309s 2024-09-22T08:38:22.296 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-22T08:38:21.739+0000 7f44ed460640 10 monclient(hunting): get_auth_request con 0x562fef129fa0 auth_method 0 2024-09-22T08:38:22.296 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-22T08:38:21.739+0000 7f44ed460640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:22.296 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-22T08:38:21.739+0000 7f44ed460640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:22.296 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-22T08:38:21.739+0000 7f44ed460640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:22.296 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-22T08:38:21.739+0000 7f44ecc5f640 10 monclient(hunting): get_auth_request con 0x562fef12e700 auth_method 0 2024-09-22T08:38:22.296 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-22T08:38:21.739+0000 7f44ecc5f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:22.296 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-22T08:38:21.739+0000 7f44ecc5f640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:22.296 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-22T08:38:21.739+0000 7f44ecc5f640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:22.296 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-22T08:38:21.739+0000 7f44ecc5f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:22.296 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-22T08:38:21.739+0000 7f44ecc5f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:22.296 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-22T08:38:21.739+0000 7f44ecc5f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:22.297 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-22T08:38:21.739+0000 7f44ed460640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:22.297 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-22T08:38:21.739+0000 7f44ed460640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:22.297 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-22T08:38:21.739+0000 7f44ed460640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:22.297 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-22T08:38:21.739+0000 7f44ec45e640 10 monclient(hunting): get_auth_request con 0x562fef0ff650 auth_method 0 2024-09-22T08:38:22.297 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-22T08:38:21.739+0000 7f44ec45e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:22.297 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-22T08:38:21.739+0000 7f44ec45e640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:22.297 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-22T08:38:21.739+0000 7f44ec45e640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:22.297 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-22T08:38:21.739+0000 7f44ed460640 10 monclient(hunting): handle_auth_done global_id 7664 payload 824 2024-09-22T08:38:22.297 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-22T08:38:21.739+0000 7f44ed460640 10 monclient: _finish_hunting 0 2024-09-22T08:38:22.297 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-22T08:38:21.739+0000 7f44ed460640 1 monclient: found mon.noname-c 2024-09-22T08:38:22.297 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-22T08:38:21.739+0000 7f44ed460640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:38:22.297 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-22T08:38:21.739+0000 7f43c27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:22.297 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-22T08:38:21.739+0000 7f43c27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:38:22.297 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-22T08:38:21.739+0000 7f43c27fc640 10 monclient: dump: 2024-09-22T08:38:22.297 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:38:22.298 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:38:22.298 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:22.298 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:22.298 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:22.298 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:22.298 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:38:22.298 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:38:22.298 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:38:22.298 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:22.298 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-22T08:38:21.739+0000 7f43c27fc640 10 monclient: _finish_auth 0 2024-09-22T08:38:22.298 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-22T08:38:21.739+0000 7f43c27fc640 10 monclient: _check_auth_tickets 2024-09-22T08:38:22.298 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-22T08:38:21.739+0000 7f43c27fc640 10 monclient: handle_config config(0 keys) 2024-09-22T08:38:22.298 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-22T08:38:21.739+0000 7f43c27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:22.298 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-22T08:38:21.740+0000 7f43c27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:38:22.299 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-22T08:38:21.740+0000 7f43c27fc640 10 monclient: dump: 2024-09-22T08:38:22.299 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:38:22.299 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:38:22.299 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:22.299 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:22.299 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:22.299 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:22.299 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:38:22.299 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:38:22.299 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:38:22.299 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:22.299 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-22T08:38:21.740+0000 7f44ef175800 5 monclient: authenticate success, global_id 7664 2024-09-22T08:38:22.299 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-22T08:38:21.740+0000 7f44ef175800 10 monclient: _renew_subs 2024-09-22T08:38:22.299 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-22T08:38:21.740+0000 7f43c3fff640 4 set_mon_vals no callback set 2024-09-22T08:38:22.299 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-22T08:38:21.740+0000 7f44ef175800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:38:22.299 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-22T08:38:21.740+0000 7f44ef175800 10 monclient: _renew_subs 2024-09-22T08:38:22.300 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-22T08:38:21.740+0000 7f44ef175800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:38:22.300 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-22T08:38:21.740+0000 7f44ef175800 1 librados: init done 2024-09-22T08:38:22.300 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-22T08:38:21.740+0000 7f44ef175800 5 asok(0x562feee3a0f0) register_command cr dump hook 0x562fef11b9d8 2024-09-22T08:38:22.300 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-22T08:38:21.741+0000 7f44ef175800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.300 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-22T08:38:21.742+0000 7f43c27fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:38:22.300 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-22T08:38:21.742+0000 7f43c27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:38:22.300 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-22T08:38:21.742+0000 7f43c27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:38:22.300 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-22T08:38:21.743+0000 7f44ec45e640 10 monclient: get_auth_request con 0x7f43b80775a0 auth_method 0 2024-09-22T08:38:22.300 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-22T08:38:21.743+0000 7f44ecc5f640 10 monclient: get_auth_request con 0x562fef1488e0 auth_method 0 2024-09-22T08:38:22.300 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-22T08:38:21.743+0000 7f44ef175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:22.300 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-22T08:38:21.743+0000 7f44ef175800 20 realm 2024-09-22T08:38:22.300 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-22T08:38:21.743+0000 7f44ef175800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.300 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-22T08:38:21.744+0000 7f44ef175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:22.300 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-22T08:38:21.744+0000 7f44ef175800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:22.300 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-22T08:38:21.744+0000 7f44ef175800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.301 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-22T08:38:21.744+0000 7f44ef175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:22.301 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-22T08:38:21.744+0000 7f44ef175800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.301 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-22T08:38:21.744+0000 7f44ec45e640 10 monclient: get_auth_request con 0x562fef14cac0 auth_method 0 2024-09-22T08:38:22.301 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-22T08:38:21.745+0000 7f44ef175800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:22.301 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-22T08:38:21.745+0000 7f44ef175800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.301 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-22T08:38:21.745+0000 7f44ed460640 10 monclient: get_auth_request con 0x562fef150300 auth_method 0 2024-09-22T08:38:22.301 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-22T08:38:21.745+0000 7f44ef175800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:38:22.301 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-22T08:38:21.745+0000 7f44ef175800 20 searching for the correct realm 2024-09-22T08:38:22.301 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-22T08:38:21.746+0000 7f44ecc5f640 10 monclient: get_auth_request con 0x562fef1550a0 auth_method 0 2024-09-22T08:38:22.301 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-22T08:38:21.747+0000 7f44ec45e640 10 monclient: get_auth_request con 0x7f44d4017070 auth_method 0 2024-09-22T08:38:22.301 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-22T08:38:21.747+0000 7f44ec45e640 0 -- 172.21.15.38:0/3578622760 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f44d4017070 msgr2=0x7f44d4076bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:38:22.301 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-22T08:38:21.948+0000 7f44ec45e640 10 monclient: get_auth_request con 0x7f44d4017070 auth_method 0 2024-09-22T08:38:22.301 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-22T08:38:21.950+0000 7f44ed460640 10 monclient: get_auth_request con 0x7f44dc065b20 auth_method 0 2024-09-22T08:38:22.301 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-22T08:38:21.952+0000 7f44ecc5f640 10 monclient: get_auth_request con 0x7f44d4088b40 auth_method 0 2024-09-22T08:38:22.301 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-22T08:38:21.953+0000 7f44ec45e640 0 -- 172.21.15.38:0/3578622760 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f44dc0713f0 msgr2=0x7f44dc071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:38:22.302 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-22T08:38:22.154+0000 7f44ec45e640 10 monclient: get_auth_request con 0x7f44dc0713f0 auth_method 0 2024-09-22T08:38:22.302 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-22T08:38:22.161+0000 7f44ef175800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:22.302 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-22T08:38:22.161+0000 7f44ef175800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:22.302 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-22T08:38:22.161+0000 7f44ef175800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:38:22.302 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-22T08:38:22.161+0000 7f44ef175800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:22.302 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-22T08:38:22.161+0000 7f44ef175800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:22.302 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-22T08:38:22.161+0000 7f44ef175800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:38:22.302 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-22T08:38:22.161+0000 7f44ef175800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.302 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-22T08:38:22.162+0000 7f44ef175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:22.302 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-22T08:38:22.162+0000 7f44ef175800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.302 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-22T08:38:22.162+0000 7f44ef175800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:22.302 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-22T08:38:22.162+0000 7f44ef175800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.302 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-22T08:38:22.162+0000 7f44ef175800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:38:22.302 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-22T08:38:22.162+0000 7f44ef175800 20 zone default found 2024-09-22T08:38:22.303 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-22T08:38:22.162+0000 7f44ef175800 4 Realm: () 2024-09-22T08:38:22.303 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-22T08:38:22.162+0000 7f44ef175800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:38:22.303 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-22T08:38:22.162+0000 7f44ef175800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:38:22.303 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-22T08:38:22.162+0000 7f44ef175800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:22.303 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-22T08:38:22.162+0000 7f44ef175800 20 zonegroup default 2024-09-22T08:38:22.303 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-22T08:38:22.162+0000 7f44ef175800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.303 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-22T08:38:22.163+0000 7f44ef175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:22.303 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-22T08:38:22.163+0000 7f44ef175800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.303 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-22T08:38:22.163+0000 7f44ef175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:22.303 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-22T08:38:22.163+0000 7f44ef175800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.303 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-22T08:38:22.164+0000 7f44ef175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:22.303 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-22T08:38:22.164+0000 7f44ef175800 20 started sync module instance, tier type = 2024-09-22T08:38:22.303 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-22T08:38:22.164+0000 7f44ef175800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:38:22.303 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-22T08:38:22.174+0000 7f44ef175800 20 add_watcher() i=0 2024-09-22T08:38:22.303 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-22T08:38:22.174+0000 7f44ef175800 20 add_watcher() i=1 2024-09-22T08:38:22.304 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-22T08:38:22.174+0000 7f44ef175800 20 add_watcher() i=2 2024-09-22T08:38:22.304 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-22T08:38:22.174+0000 7f44ef175800 20 add_watcher() i=3 2024-09-22T08:38:22.304 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-22T08:38:22.174+0000 7f44ef175800 20 add_watcher() i=4 2024-09-22T08:38:22.304 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-22T08:38:22.174+0000 7f44ef175800 20 add_watcher() i=5 2024-09-22T08:38:22.304 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-22T08:38:22.174+0000 7f44ef175800 20 add_watcher() i=6 2024-09-22T08:38:22.304 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-22T08:38:22.175+0000 7f44ef175800 20 add_watcher() i=7 2024-09-22T08:38:22.304 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-22T08:38:22.175+0000 7f44ef175800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:22.304 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-22T08:38:22.177+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01bdb0) adding auth protocol: cephx 2024-09-22T08:38:22.304 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-22T08:38:22.177+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01bdb0) adding auth protocol: cephx 2024-09-22T08:38:22.304 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-22T08:38:22.177+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01bdb0) adding auth protocol: cephx 2024-09-22T08:38:22.304 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-22T08:38:22.177+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01bdb0) adding con mode: secure 2024-09-22T08:38:22.304 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-22T08:38:22.177+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01bdb0) adding con mode: crc 2024-09-22T08:38:22.304 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-22T08:38:22.177+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01bdb0) adding con mode: secure 2024-09-22T08:38:22.304 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-22T08:38:22.177+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01bdb0) adding con mode: crc 2024-09-22T08:38:22.304 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-22T08:38:22.177+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01bdb0) adding con mode: secure 2024-09-22T08:38:22.305 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-22T08:38:22.177+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01bdb0) adding con mode: crc 2024-09-22T08:38:22.305 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-22T08:38:22.177+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01bdb0) adding con mode: crc 2024-09-22T08:38:22.305 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-22T08:38:22.177+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01bdb0) adding con mode: secure 2024-09-22T08:38:22.305 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-22T08:38:22.177+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01bdb0) adding con mode: crc 2024-09-22T08:38:22.305 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-22T08:38:22.177+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01bdb0) adding con mode: secure 2024-09-22T08:38:22.305 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-22T08:38:22.177+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01bdb0) adding con mode: crc 2024-09-22T08:38:22.305 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-22T08:38:22.177+0000 7f44ef175800 5 AuthRegistry(0x7ffeaf01bdb0) adding con mode: secure 2024-09-22T08:38:22.305 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-22T08:38:22.177+0000 7f43a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:22.305 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-22T08:38:22.178+0000 7f44ef175800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:22.305 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-22T08:38:22.178+0000 7f44ef175800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:22.305 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-22T08:38:22.178+0000 7f44ef175800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:22.305 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-22T08:38:22.178+0000 7f44ef175800 5 asok(0x562feee3a0f0) register_command cache list hook 0x562fef0fc100 2024-09-22T08:38:22.305 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-22T08:38:22.178+0000 7f44ef175800 5 asok(0x562feee3a0f0) register_command cache inspect hook 0x562fef0fc100 2024-09-22T08:38:22.305 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-22T08:38:22.178+0000 7f44ef175800 5 asok(0x562feee3a0f0) register_command cache erase hook 0x562fef0fc100 2024-09-22T08:38:22.305 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-22T08:38:22.178+0000 7f44ef175800 5 asok(0x562feee3a0f0) register_command cache zap hook 0x562fef0fc100 2024-09-22T08:38:22.305 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-22T08:38:22.178+0000 7f44ef175800 5 note: GC not initialized 2024-09-22T08:38:22.306 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-22T08:38:22.178+0000 7f43a1fe3640 20 reqs_thread_entry: start 2024-09-22T08:38:22.306 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-22T08:38:22.178+0000 7f44ef175800 5 asok(0x562feee3a0f0) register_command sync trace show hook 0x7f44d4087070 2024-09-22T08:38:22.306 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-22T08:38:22.178+0000 7f44ef175800 5 asok(0x562feee3a0f0) register_command sync trace history hook 0x7f44d4087070 2024-09-22T08:38:22.306 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-22T08:38:22.178+0000 7f44ef175800 5 asok(0x562feee3a0f0) register_command sync trace active hook 0x7f44d4087070 2024-09-22T08:38:22.306 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-22T08:38:22.178+0000 7f44ef175800 5 asok(0x562feee3a0f0) register_command sync trace active_short hook 0x7f44d4087070 2024-09-22T08:38:22.306 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-22T08:38:22.178+0000 7f44ef175800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:22.306 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-22T08:38:22.178+0000 7f44ef175800 20 Filter name: none 2024-09-22T08:38:22.306 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-22T08:38:22.178+0000 7f43137fe640 20 reqs_thread_entry: start 2024-09-22T08:38:22.306 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-22T08:38:22.179+0000 7f44ef175800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:38:22.306 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-22T08:38:22.179+0000 7f44ef175800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.306 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-22T08:38:22.179+0000 7f44ef175800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:38:22.306 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-22T08:38:22.179+0000 7f44ef175800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:38:22.306 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-22T08:38:22.179+0000 7f44ef175800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:38:22.306 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-22T08:38:22.179+0000 7f44ef175800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 : miss 2024-09-22T08:38:22.307 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-22T08:38:22.179+0000 7f44ef175800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.307 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-22T08:38:22.180+0000 7f44ef175800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T08:38:22.307 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-22T08:38:22.180+0000 7f44ef175800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:38:22.307 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-22T08:38:22.180+0000 7f44ef175800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:38:22.307 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-22T08:38:22.180+0000 7f44ef175800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:38:22.307 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-22T08:38:22.180+0000 7f44ef175800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:38:22.307 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-22T08:38:22.180+0000 7f44ef175800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 2024-09-22T08:38:22.307 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-22T08:38:22.186+0000 7f44ef175800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:38:22.307 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-22T08:38:22.186+0000 7f44ef175800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:38:22.307 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-22T08:38:22.186+0000 7f44ef175800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:38:22.307 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-22T08:38:22.186+0000 7f44ef175800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17, ofs0, ns] 2024-09-22T08:38:22.307 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-22T08:38:22.186+0000 7f43c3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497036 cookie 94763874628688 notifier 7664 bl.length()=827 2024-09-22T08:38:22.307 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-22T08:38:22.186+0000 7f43c3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:38:22.307 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-22T08:38:22.186+0000 7f43c3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:38:22.307 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-22T08:38:22.186+0000 7f43c3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:38:22.308 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-22T08:38:22.187+0000 7f44ef175800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_sources= new_sources= 2024-09-22T08:38:22.308 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-22T08:38:22.187+0000 7f44ef175800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential sources added=[] removed=[] 2024-09-22T08:38:22.308 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-22T08:38:22.187+0000 7f44ef175800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_dests= new_dests= 2024-09-22T08:38:22.308 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-22T08:38:22.187+0000 7f44ef175800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential dests added=[] removed=[] 2024-09-22T08:38:22.308 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-22T08:38:22.193+0000 7f44ef175800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f44ef175800 time 2024-09-22T08:38:22.193423+0000 2024-09-22T08:38:22.308 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:38:22.308 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:22.308 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:38:22.308 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f44f278c748] 2024-09-22T08:38:22.308 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f44f278c906] 2024-09-22T08:38:22.308 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562fede3de01] 2024-09-22T08:38:22.308 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562fede4dd0a] 2024-09-22T08:38:22.308 INFO:tasks.workunit.client.0.smithi038.stderr: 5: main() 2024-09-22T08:38:22.308 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f44f1429590] 2024-09-22T08:38:22.309 INFO:tasks.workunit.client.0.smithi038.stderr: 7: __libc_start_main() 2024-09-22T08:38:22.309 INFO:tasks.workunit.client.0.smithi038.stderr: 8: _start() 2024-09-22T08:38:22.309 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:22.309 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-22T08:38:22.194+0000 7f44ef175800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:38:22.309 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f44ef175800 thread_name:radosgw-admin 2024-09-22T08:38:22.309 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:22.309 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:38:22.309 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f44f143e6f0] 2024-09-22T08:38:22.309 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f44f148b99c] 2024-09-22T08:38:22.309 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:38:22.309 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:38:22.309 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f44f278c7a2] 2024-09-22T08:38:22.309 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f44f278c906] 2024-09-22T08:38:22.309 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562fede3de01] 2024-09-22T08:38:22.309 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562fede4dd0a] 2024-09-22T08:38:22.309 INFO:tasks.workunit.client.0.smithi038.stderr: 9: main() 2024-09-22T08:38:22.310 INFO:tasks.workunit.client.0.smithi038.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f44f1429590] 2024-09-22T08:38:22.310 INFO:tasks.workunit.client.0.smithi038.stderr: 11: __libc_start_main() 2024-09-22T08:38:22.310 INFO:tasks.workunit.client.0.smithi038.stderr: 12: _start() 2024-09-22T08:38:22.310 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:38:22.310 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:22.310 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-22T08:38:22.310 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-22T08:38:22.310 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-22T08:38:22.310 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-22T08:38:22.310 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-22T08:38:22.310 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-22T08:38:22.310 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-22T08:38:22.310 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-22T08:38:22.310 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-22T08:38:22.311 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-22T08:38:22.311 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-22T08:38:22.311 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-22T08:38:22.311 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-22T08:38:22.311 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-22T08:38:22.311 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-22T08:38:22.311 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-22T08:38:22.311 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-22T08:38:22.311 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-22T08:38:22.311 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-22T08:38:22.311 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-22T08:38:22.311 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-22T08:38:22.311 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-22T08:38:22.311 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-22T08:38:22.311 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-22T08:38:22.311 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:38:22.312 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-22T08:38:22.312 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-22T08:38:22.312 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-22T08:38:22.312 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-22T08:38:22.312 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-22T08:38:22.312 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-22T08:38:22.312 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-22T08:38:22.312 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-22T08:38:22.312 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-22T08:38:22.312 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-22T08:38:22.312 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-22T08:38:22.312 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-22T08:38:22.312 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-22T08:38:22.312 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-22T08:38:22.312 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-22T08:38:22.313 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-22T08:38:22.313 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-22T08:38:22.313 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-22T08:38:22.313 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-22T08:38:22.313 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-22T08:38:22.313 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-22T08:38:22.313 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:38:22.313 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-22T08:38:22.313 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:38:22.313 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-22T08:38:22.313 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-22T08:38:22.313 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-22T08:38:22.313 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-22T08:38:22.313 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-22T08:38:22.313 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-22T08:38:22.314 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-22T08:38:22.314 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-22T08:38:22.314 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-22T08:38:22.314 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-22T08:38:22.314 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-22T08:38:22.314 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-22T08:38:22.314 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-22T08:38:22.314 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-22T08:38:22.314 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-22T08:38:22.314 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-22T08:38:22.314 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-22T08:38:22.314 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-22T08:38:22.314 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:38:22.314 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-22T08:38:22.314 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:38:22.315 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-22T08:38:22.315 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-22T08:38:22.315 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-22T08:38:22.315 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-22T08:38:22.315 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-22T08:38:22.315 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-22T08:38:22.315 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:38:22.315 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-22T08:38:22.315 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-22T08:38:22.315 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:38:22.315 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-22T08:38:22.315 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-22T08:38:22.315 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-22T08:38:22.315 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-22T08:38:22.315 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-22T08:38:22.316 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-22T08:38:22.316 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-22T08:38:22.316 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-22T08:38:22.316 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-22T08:38:22.316 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-22T08:38:22.316 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-22T08:38:22.316 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-22T08:38:22.316 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-22T08:38:22.316 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:38:22.316 INFO:tasks.workunit.client.0.smithi038.stderr: 7f43137fe640 / http_manager 2024-09-22T08:38:22.316 INFO:tasks.workunit.client.0.smithi038.stderr: 7f43a1fe3640 / http_manager 2024-09-22T08:38:22.316 INFO:tasks.workunit.client.0.smithi038.stderr: 7f43a2fe5640 / rgw_dt_lg_renew 2024-09-22T08:38:22.316 INFO:tasks.workunit.client.0.smithi038.stderr: 7f43c27fc640 / ms_dispatch 2024-09-22T08:38:22.316 INFO:tasks.workunit.client.0.smithi038.stderr: 7f43c3fff640 / io_context_pool 2024-09-22T08:38:22.316 INFO:tasks.workunit.client.0.smithi038.stderr: 7f43d27fc640 / ms_dispatch 2024-09-22T08:38:22.316 INFO:tasks.workunit.client.0.smithi038.stderr: 7f43d960a640 / ms_dispatch 2024-09-22T08:38:22.317 INFO:tasks.workunit.client.0.smithi038.stderr: 7f43dae0d640 / io_context_pool 2024-09-22T08:38:22.317 INFO:tasks.workunit.client.0.smithi038.stderr: 7f44ec45e640 / msgr-worker-2 2024-09-22T08:38:22.317 INFO:tasks.workunit.client.0.smithi038.stderr: 7f44ecc5f640 / msgr-worker-1 2024-09-22T08:38:22.317 INFO:tasks.workunit.client.0.smithi038.stderr: 7f44ed460640 / msgr-worker-0 2024-09-22T08:38:22.317 INFO:tasks.workunit.client.0.smithi038.stderr: 7f44edc61640 / io_context_pool 2024-09-22T08:38:22.317 INFO:tasks.workunit.client.0.smithi038.stderr: 7f44ef175800 / radosgw-admin 2024-09-22T08:38:22.317 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-22T08:38:22.317 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-22T08:38:22.317 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/lib/ceph/crash/2024-09-22T08:38:22.194891Z_2cfcfa9a-a7ee-400c-a5d7-3ce0de25877b/log 2024-09-22T08:38:22.317 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-22T08:38:22.317 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T08:38:22.319 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:22.319 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:22.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.275+0000 7f6ae4133800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.277+0000 7f6ae4133800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:22.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.277+0000 7f6ae4133800 20 realm 2024-09-22T08:38:22.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.277+0000 7f6ae4133800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.277+0000 7f6ae4133800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:22.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.277+0000 7f6ae4133800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:22.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.277+0000 7f6ae4133800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.277+0000 7f6ae4133800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:22.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.277+0000 7f6ae4133800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.278+0000 7f6ae4133800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:22.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.278+0000 7f6ae4133800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.278+0000 7f6ae4133800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:38:22.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.278+0000 7f6ae4133800 20 searching for the correct realm 2024-09-22T08:38:22.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.281+0000 7f6adfe76640 0 -- 172.21.15.38:0/2343164424 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x560b1fc72200 msgr2=0x560b1fc746c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:38:22.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.285+0000 7f6ad7675640 0 -- 172.21.15.38:0/2343164424 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f6ad003c430 msgr2=0x7f6ad003c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:22.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.492+0000 7f6ae4133800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:22.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.492+0000 7f6ae4133800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:22.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.492+0000 7f6ae4133800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:38:22.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.492+0000 7f6ae4133800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:22.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.492+0000 7f6ae4133800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:22.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.492+0000 7f6ae4133800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:38:22.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.492+0000 7f6ae4133800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.493+0000 7f6ae4133800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:22.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.493+0000 7f6ae4133800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.496 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.493+0000 7f6ae4133800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:22.496 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.493+0000 7f6ae4133800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.496 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.494+0000 7f6ae4133800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:38:22.496 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.494+0000 7f6ae4133800 20 zone default found 2024-09-22T08:38:22.496 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.494+0000 7f6ae4133800 4 Realm: () 2024-09-22T08:38:22.496 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.494+0000 7f6ae4133800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:38:22.496 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.494+0000 7f6ae4133800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:38:22.496 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.494+0000 7f6ae4133800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:22.496 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.494+0000 7f6ae4133800 20 zonegroup default 2024-09-22T08:38:22.496 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.494+0000 7f6ae4133800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.496 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.494+0000 7f6ae4133800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:22.496 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.494+0000 7f6ae4133800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.496 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.494+0000 7f6ae4133800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:22.496 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.494+0000 7f6ae4133800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.497 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.495+0000 7f6ae4133800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:22.497 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.495+0000 7f6ae4133800 20 started sync module instance, tier type = 2024-09-22T08:38:22.497 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.495+0000 7f6ae4133800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:38:22.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.505+0000 7f6ae4133800 20 add_watcher() i=0 2024-09-22T08:38:22.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.505+0000 7f6ae4133800 20 add_watcher() i=1 2024-09-22T08:38:22.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.505+0000 7f6ae4133800 20 add_watcher() i=2 2024-09-22T08:38:22.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.505+0000 7f6ae4133800 20 add_watcher() i=3 2024-09-22T08:38:22.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.505+0000 7f6ae4133800 20 add_watcher() i=4 2024-09-22T08:38:22.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.505+0000 7f6ae4133800 20 add_watcher() i=5 2024-09-22T08:38:22.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.505+0000 7f6ae4133800 20 add_watcher() i=6 2024-09-22T08:38:22.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.506+0000 7f6ae4133800 20 add_watcher() i=7 2024-09-22T08:38:22.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.506+0000 7f6ae4133800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:22.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.509+0000 7f6995fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:22.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.509+0000 7f6ae4133800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:22.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.509+0000 7f6ae4133800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:22.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.509+0000 7f6ae4133800 5 note: GC not initialized 2024-09-22T08:38:22.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.509+0000 7f6994fe1640 20 reqs_thread_entry: start 2024-09-22T08:38:22.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.509+0000 7f6ae4133800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:22.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.509+0000 7f6ae4133800 20 Filter name: none 2024-09-22T08:38:22.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.509+0000 7f690e7fc640 20 reqs_thread_entry: start 2024-09-22T08:38:22.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.510+0000 7f6ae4133800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.510+0000 7f6ae4133800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:38:22.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.510+0000 7f6ae4133800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.511+0000 7f6ae4133800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T08:38:22.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.511+0000 7f6ae4133800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:38:22.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.511+0000 7f6ae4133800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.511+0000 7f6ae4133800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:38:22.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.511+0000 7f6ae4133800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.513 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.512+0000 7f6ae4133800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T08:38:22.513 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.512+0000 7f6ae4133800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:38:22.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.513+0000 7f6995fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:22.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.516+0000 7f6ae4133800 20 remove_watcher() i=0 2024-09-22T08:38:22.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.516+0000 7f6ae4133800 2 removed watcher, disabling cache 2024-09-22T08:38:22.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.517+0000 7f6ae4133800 20 remove_watcher() i=1 2024-09-22T08:38:22.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.519+0000 7f6ae4133800 20 remove_watcher() i=2 2024-09-22T08:38:22.521 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.520+0000 7f6ae4133800 20 remove_watcher() i=3 2024-09-22T08:38:22.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.521+0000 7f6ae4133800 20 remove_watcher() i=4 2024-09-22T08:38:22.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.522+0000 7f6ae4133800 20 remove_watcher() i=5 2024-09-22T08:38:22.524 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.524+0000 7f6ae4133800 20 remove_watcher() i=6 2024-09-22T08:38:22.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.525+0000 7f6ae4133800 20 remove_watcher() i=7 2024-09-22T08:38:22.539 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:38:22.539 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:38:22.548 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-22T08:38:22.579 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:22.579 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:22.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.618+0000 7fb285340800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.619+0000 7fb285340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:22.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.620+0000 7fb285340800 20 realm 2024-09-22T08:38:22.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.620+0000 7fb285340800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.620+0000 7fb285340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:22.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.620+0000 7fb285340800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:22.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.620+0000 7fb285340800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.620+0000 7fb285340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:22.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.620+0000 7fb285340800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.621+0000 7fb285340800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:22.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.621+0000 7fb285340800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.622+0000 7fb285340800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:38:22.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.622+0000 7fb285340800 20 searching for the correct realm 2024-09-22T08:38:22.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.622+0000 7fb2810c0640 0 -- 172.21.15.38:0/51411407 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x55a6e91af700 msgr2=0x55a6e91b1bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:22.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.827+0000 7fb2818c1640 0 -- 172.21.15.38:0/51411407 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7fb27406a070 msgr2=0x7fb2740a4410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:22.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.836+0000 7fb285340800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:22.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.836+0000 7fb285340800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:22.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.836+0000 7fb285340800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:38:22.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.836+0000 7fb285340800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:22.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.836+0000 7fb285340800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:22.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.836+0000 7fb285340800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:38:22.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.836+0000 7fb285340800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.836+0000 7fb285340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:22.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.836+0000 7fb285340800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.836+0000 7fb285340800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:22.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.836+0000 7fb285340800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.837+0000 7fb285340800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:38:22.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.837+0000 7fb285340800 20 zone default found 2024-09-22T08:38:22.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.837+0000 7fb285340800 4 Realm: () 2024-09-22T08:38:22.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.837+0000 7fb285340800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:38:22.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.837+0000 7fb285340800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:38:22.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.837+0000 7fb285340800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:22.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.837+0000 7fb285340800 20 zonegroup default 2024-09-22T08:38:22.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.837+0000 7fb285340800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.837+0000 7fb285340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:22.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.837+0000 7fb285340800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.838+0000 7fb285340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:22.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.838+0000 7fb285340800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.838+0000 7fb285340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:22.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.838+0000 7fb285340800 20 started sync module instance, tier type = 2024-09-22T08:38:22.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.838+0000 7fb285340800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:38:22.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.848+0000 7fb285340800 20 add_watcher() i=0 2024-09-22T08:38:22.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.848+0000 7fb285340800 20 add_watcher() i=1 2024-09-22T08:38:22.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.848+0000 7fb285340800 20 add_watcher() i=2 2024-09-22T08:38:22.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.848+0000 7fb285340800 20 add_watcher() i=3 2024-09-22T08:38:22.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.848+0000 7fb285340800 20 add_watcher() i=4 2024-09-22T08:38:22.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.848+0000 7fb285340800 20 add_watcher() i=5 2024-09-22T08:38:22.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.848+0000 7fb285340800 20 add_watcher() i=6 2024-09-22T08:38:22.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.849+0000 7fb285340800 20 add_watcher() i=7 2024-09-22T08:38:22.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.849+0000 7fb285340800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:22.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.851+0000 7fb137fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:22.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.851+0000 7fb285340800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:22.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.851+0000 7fb285340800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:22.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.851+0000 7fb285340800 5 note: GC not initialized 2024-09-22T08:38:22.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.852+0000 7fb136fe5640 20 reqs_thread_entry: start 2024-09-22T08:38:22.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.852+0000 7fb285340800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:22.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.852+0000 7fb285340800 20 Filter name: none 2024-09-22T08:38:22.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.852+0000 7fb134fe1640 20 reqs_thread_entry: start 2024-09-22T08:38:22.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.852+0000 7fb285340800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:38:22.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.852+0000 7fb285340800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.852+0000 7fb285340800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:38:22.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.852+0000 7fb285340800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:38:22.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.852+0000 7fb285340800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:38:22.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.852+0000 7fb285340800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 : miss 2024-09-22T08:38:22.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.852+0000 7fb285340800 20 rados->read ofs=0 len=0 2024-09-22T08:38:22.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.853+0000 7fb285340800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T08:38:22.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.853+0000 7fb285340800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:38:22.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.853+0000 7fb285340800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:38:22.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.853+0000 7fb285340800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:38:22.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.853+0000 7fb285340800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:38:22.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.853+0000 7fb285340800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 2024-09-22T08:38:22.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.853+0000 7fb285340800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.0 2024-09-22T08:38:22.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.853+0000 7fb285340800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.0 2024-09-22T08:38:22.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.853+0000 7fb285340800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.1 2024-09-22T08:38:22.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.853+0000 7fb285340800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.1 2024-09-22T08:38:22.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.854+0000 7fb285340800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.2 2024-09-22T08:38:22.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.854+0000 7fb285340800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.2 2024-09-22T08:38:22.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.854+0000 7fb285340800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.3 2024-09-22T08:38:22.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.854+0000 7fb285340800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.3 2024-09-22T08:38:22.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.854+0000 7fb285340800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.4 2024-09-22T08:38:22.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.854+0000 7fb285340800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.4 2024-09-22T08:38:22.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.855+0000 7fb285340800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.5 2024-09-22T08:38:22.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.855+0000 7fb285340800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.5 2024-09-22T08:38:22.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.855+0000 7fb285340800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.6 2024-09-22T08:38:22.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.855+0000 7fb285340800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.6 2024-09-22T08:38:22.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.855+0000 7fb285340800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.7 2024-09-22T08:38:22.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.855+0000 7fb285340800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.7 2024-09-22T08:38:22.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.856+0000 7fb285340800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.8 2024-09-22T08:38:22.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.856+0000 7fb285340800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.8 2024-09-22T08:38:22.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.856+0000 7fb285340800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.9 2024-09-22T08:38:22.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.856+0000 7fb285340800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.9 2024-09-22T08:38:22.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.857+0000 7fb285340800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.10 2024-09-22T08:38:22.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.857+0000 7fb285340800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.10 2024-09-22T08:38:22.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.857+0000 7fb285340800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.11 2024-09-22T08:38:22.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.857+0000 7fb285340800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.11 2024-09-22T08:38:22.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.858+0000 7fb285340800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.12 2024-09-22T08:38:22.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.858+0000 7fb285340800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.12 2024-09-22T08:38:22.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.859+0000 7fb137fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:22.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.861+0000 7fb285340800 20 remove_watcher() i=0 2024-09-22T08:38:22.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.861+0000 7fb285340800 2 removed watcher, disabling cache 2024-09-22T08:38:22.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.862+0000 7fb285340800 20 remove_watcher() i=1 2024-09-22T08:38:22.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.863+0000 7fb285340800 20 remove_watcher() i=2 2024-09-22T08:38:22.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.865+0000 7fb285340800 20 remove_watcher() i=3 2024-09-22T08:38:22.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.866+0000 7fb285340800 20 remove_watcher() i=4 2024-09-22T08:38:22.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.867+0000 7fb285340800 20 remove_watcher() i=5 2024-09-22T08:38:22.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.868+0000 7fb285340800 20 remove_watcher() i=6 2024-09-22T08:38:22.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:22.870+0000 7fb285340800 20 remove_watcher() i=7 2024-09-22T08:38:52.909 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-22T08:38:52.948 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:52.948 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:52.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:52.993+0000 7fec03f23800 20 rados->read ofs=0 len=0 2024-09-22T08:38:52.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:52.994+0000 7fec03f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:52.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:52.994+0000 7fec03f23800 20 realm 2024-09-22T08:38:52.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:52.994+0000 7fec03f23800 20 rados->read ofs=0 len=0 2024-09-22T08:38:52.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:52.995+0000 7fec03f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:52.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:52.995+0000 7fec03f23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:52.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:52.995+0000 7fec03f23800 20 rados->read ofs=0 len=0 2024-09-22T08:38:52.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:52.995+0000 7fec03f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:52.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:52.995+0000 7fec03f23800 20 rados->read ofs=0 len=0 2024-09-22T08:38:52.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:52.996+0000 7fec03f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:52.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:52.996+0000 7fec03f23800 20 rados->read ofs=0 len=0 2024-09-22T08:38:52.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:52.996+0000 7fec03f23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:38:52.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:52.996+0000 7fec03f23800 20 searching for the correct realm 2024-09-22T08:38:53.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:52.999+0000 7febff40b640 0 -- 172.21.15.38:0/1606833508 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7febf4026030 msgr2=0x7febf40613f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:53.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.003+0000 7febff40b640 0 -- 172.21.15.38:0/1606833508 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7febf0099910 msgr2=0x7febf008b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:53.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.212+0000 7fec03f23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:53.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.212+0000 7fec03f23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:53.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.212+0000 7fec03f23800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:38:53.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.212+0000 7fec03f23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:53.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.212+0000 7fec03f23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:53.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.212+0000 7fec03f23800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:38:53.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.212+0000 7fec03f23800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.212+0000 7fec03f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:53.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.212+0000 7fec03f23800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.212+0000 7fec03f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:53.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.212+0000 7fec03f23800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.213+0000 7fec03f23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:38:53.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.213+0000 7fec03f23800 20 zone default found 2024-09-22T08:38:53.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.213+0000 7fec03f23800 4 Realm: () 2024-09-22T08:38:53.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.213+0000 7fec03f23800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:38:53.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.213+0000 7fec03f23800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:38:53.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.213+0000 7fec03f23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:53.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.213+0000 7fec03f23800 20 zonegroup default 2024-09-22T08:38:53.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.213+0000 7fec03f23800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.213+0000 7fec03f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:53.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.213+0000 7fec03f23800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.214+0000 7fec03f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:53.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.214+0000 7fec03f23800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.214+0000 7fec03f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:53.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.214+0000 7fec03f23800 20 started sync module instance, tier type = 2024-09-22T08:38:53.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.214+0000 7fec03f23800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:38:53.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.225+0000 7fec03f23800 20 add_watcher() i=0 2024-09-22T08:38:53.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.225+0000 7fec03f23800 20 add_watcher() i=1 2024-09-22T08:38:53.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.225+0000 7fec03f23800 20 add_watcher() i=2 2024-09-22T08:38:53.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.225+0000 7fec03f23800 20 add_watcher() i=3 2024-09-22T08:38:53.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.225+0000 7fec03f23800 20 add_watcher() i=4 2024-09-22T08:38:53.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.225+0000 7fec03f23800 20 add_watcher() i=5 2024-09-22T08:38:53.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.225+0000 7fec03f23800 20 add_watcher() i=6 2024-09-22T08:38:53.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.226+0000 7fec03f23800 20 add_watcher() i=7 2024-09-22T08:38:53.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.226+0000 7fec03f23800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:53.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.228+0000 7feab5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:53.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.229+0000 7fec03f23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:53.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.229+0000 7fec03f23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:53.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.229+0000 7fec03f23800 5 note: GC not initialized 2024-09-22T08:38:53.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.229+0000 7feab4fe1640 20 reqs_thread_entry: start 2024-09-22T08:38:53.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.229+0000 7fec03f23800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:53.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.229+0000 7fec03f23800 20 Filter name: none 2024-09-22T08:38:53.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.229+0000 7fea2e7fc640 20 reqs_thread_entry: start 2024-09-22T08:38:53.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.229+0000 7fec03f23800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:38:53.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.229+0000 7fec03f23800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.230+0000 7fec03f23800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:38:53.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.230+0000 7fec03f23800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:38:53.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.230+0000 7fec03f23800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:38:53.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.230+0000 7fec03f23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 : miss 2024-09-22T08:38:53.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.230+0000 7fec03f23800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.230+0000 7fec03f23800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T08:38:53.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.230+0000 7fec03f23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:38:53.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.230+0000 7fec03f23800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:38:53.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.230+0000 7fec03f23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:38:53.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.230+0000 7fec03f23800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:38:53.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.230+0000 7fec03f23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 2024-09-22T08:38:53.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.232+0000 7fec03f23800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-22T08:38:53.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.240+0000 7fec03f23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:38:53.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.240+0000 7fec03f23800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:38:53.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.240+0000 7fec03f23800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:38:53.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.240+0000 7fec03f23800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17, ofs0, ns] 2024-09-22T08:38:53.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.240+0000 7feade7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497037 cookie 94429165795104 notifier 8202 bl.length()=827 2024-09-22T08:38:53.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.240+0000 7feade7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:38:53.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.240+0000 7feade7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:38:53.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.240+0000 7feade7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:38:53.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.241+0000 7fec03f23800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_sources= new_sources= 2024-09-22T08:38:53.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.241+0000 7fec03f23800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential sources added=[] removed=[] 2024-09-22T08:38:53.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.241+0000 7fec03f23800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_dests= new_dests= 2024-09-22T08:38:53.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.241+0000 7fec03f23800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential dests added=[] removed=[] 2024-09-22T08:38:53.245 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fec03f23800 time 2024-09-22T08:38:53.245710+0000 2024-09-22T08:38:53.245 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:38:53.246 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:38:53.246 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fec0558c748] 2024-09-22T08:38:53.247 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fec0558c906] 2024-09-22T08:38:53.247 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e1ff996e01] 2024-09-22T08:38:53.247 INFO:tasks.workunit.client.0.smithi038.stderr: 4: radosgw-admin(+0xd8186c) [0x55e1ffea986c] 2024-09-22T08:38:53.247 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e1ff9a6c9d] 2024-09-22T08:38:53.247 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-22T08:38:53.247 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fec04229590] 2024-09-22T08:38:53.247 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-22T08:38:53.247 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-22T08:38:53.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.245+0000 7fec03f23800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fec03f23800 time 2024-09-22T08:38:53.245710+0000 2024-09-22T08:38:53.247 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:38:53.248 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:53.248 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:38:53.248 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fec0558c748] 2024-09-22T08:38:53.248 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fec0558c906] 2024-09-22T08:38:53.248 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e1ff996e01] 2024-09-22T08:38:53.248 INFO:tasks.workunit.client.0.smithi038.stderr: 4: radosgw-admin(+0xd8186c) [0x55e1ffea986c] 2024-09-22T08:38:53.248 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e1ff9a6c9d] 2024-09-22T08:38:53.248 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-22T08:38:53.249 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fec04229590] 2024-09-22T08:38:53.249 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-22T08:38:53.249 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-22T08:38:53.249 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:53.249 INFO:tasks.workunit.client.0.smithi038.stderr:*** Caught signal (Aborted) ** 2024-09-22T08:38:53.249 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7fec03f23800 thread_name:radosgw-admin 2024-09-22T08:38:53.264 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:38:53.264 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fec0423e6f0] 2024-09-22T08:38:53.264 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fec0428b99c] 2024-09-22T08:38:53.264 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:38:53.264 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:38:53.265 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fec0558c7a2] 2024-09-22T08:38:53.265 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fec0558c906] 2024-09-22T08:38:53.265 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e1ff996e01] 2024-09-22T08:38:53.265 INFO:tasks.workunit.client.0.smithi038.stderr: 8: radosgw-admin(+0xd8186c) [0x55e1ffea986c] 2024-09-22T08:38:53.265 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e1ff9a6c9d] 2024-09-22T08:38:53.265 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-22T08:38:53.265 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fec04229590] 2024-09-22T08:38:53.265 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-22T08:38:53.265 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-22T08:38:53.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.246+0000 7fec03f23800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:38:53.265 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7fec03f23800 thread_name:radosgw-admin 2024-09-22T08:38:53.265 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:53.265 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:38:53.266 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fec0423e6f0] 2024-09-22T08:38:53.266 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fec0428b99c] 2024-09-22T08:38:53.266 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:38:53.266 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:38:53.266 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fec0558c7a2] 2024-09-22T08:38:53.266 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fec0558c906] 2024-09-22T08:38:53.266 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e1ff996e01] 2024-09-22T08:38:53.266 INFO:tasks.workunit.client.0.smithi038.stderr: 8: radosgw-admin(+0xd8186c) [0x55e1ffea986c] 2024-09-22T08:38:53.266 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e1ff9a6c9d] 2024-09-22T08:38:53.266 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-22T08:38:53.266 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fec04229590] 2024-09-22T08:38:53.266 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-22T08:38:53.266 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-22T08:38:53.266 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:38:53.266 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:53.267 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-22T08:38:53.267 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-22T08:38:52.973+0000 7fec03f23800 10 monclient: shutdown 2024-09-22T08:38:53.267 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-22T08:38:52.973+0000 7fec03f23800 5 asok(0x55e200b010f0) unregister_commands rotate-key 2024-09-22T08:38:53.267 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-22T08:38:52.973+0000 7fec03f23800 10 monclient: build_initial_monmap 2024-09-22T08:38:53.267 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-22T08:38:52.973+0000 7fec03f23800 1 build_initial for_mkfs: 0 2024-09-22T08:38:53.267 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-22T08:38:52.973+0000 7fec03f23800 10 monclient: monmap: 2024-09-22T08:38:53.267 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:38:53.267 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:38:53.267 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:38:53.267 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:38:53.267 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:38:53.267 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:53.267 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:38:53.267 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:38:53.268 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:38:53.268 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:53.268 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-22T08:38:52.973+0000 7fec03f23800 5 AuthRegistry(0x55e200d28720) adding auth protocol: cephx 2024-09-22T08:38:53.268 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-22T08:38:52.973+0000 7fec03f23800 5 AuthRegistry(0x55e200d28720) adding auth protocol: cephx 2024-09-22T08:38:53.268 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-22T08:38:52.973+0000 7fec03f23800 5 AuthRegistry(0x55e200d28720) adding auth protocol: cephx 2024-09-22T08:38:53.268 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-22T08:38:52.973+0000 7fec03f23800 5 AuthRegistry(0x55e200d28720) adding con mode: secure 2024-09-22T08:38:53.268 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-22T08:38:52.973+0000 7fec03f23800 5 AuthRegistry(0x55e200d28720) adding con mode: crc 2024-09-22T08:38:53.268 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-22T08:38:52.973+0000 7fec03f23800 5 AuthRegistry(0x55e200d28720) adding con mode: secure 2024-09-22T08:38:53.268 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-22T08:38:52.973+0000 7fec03f23800 5 AuthRegistry(0x55e200d28720) adding con mode: crc 2024-09-22T08:38:53.268 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-22T08:38:52.973+0000 7fec03f23800 5 AuthRegistry(0x55e200d28720) adding con mode: secure 2024-09-22T08:38:53.268 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-22T08:38:52.973+0000 7fec03f23800 5 AuthRegistry(0x55e200d28720) adding con mode: crc 2024-09-22T08:38:53.268 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-22T08:38:52.973+0000 7fec03f23800 5 AuthRegistry(0x55e200d28720) adding con mode: crc 2024-09-22T08:38:53.268 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-22T08:38:52.973+0000 7fec03f23800 5 AuthRegistry(0x55e200d28720) adding con mode: secure 2024-09-22T08:38:53.268 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-22T08:38:52.973+0000 7fec03f23800 5 AuthRegistry(0x55e200d28720) adding con mode: crc 2024-09-22T08:38:53.269 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-22T08:38:52.973+0000 7fec03f23800 5 AuthRegistry(0x55e200d28720) adding con mode: secure 2024-09-22T08:38:53.269 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-22T08:38:52.973+0000 7fec03f23800 5 AuthRegistry(0x55e200d28720) adding con mode: crc 2024-09-22T08:38:53.269 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-22T08:38:52.973+0000 7fec03f23800 5 AuthRegistry(0x55e200d28720) adding con mode: secure 2024-09-22T08:38:53.269 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-22T08:38:52.973+0000 7fec03f23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:53.269 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-22T08:38:52.973+0000 7fec03f23800 1 librados: starting msgr at 2024-09-22T08:38:53.269 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-22T08:38:52.973+0000 7fec03f23800 1 librados: starting objecter 2024-09-22T08:38:53.269 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-22T08:38:52.973+0000 7fec03f23800 5 asok(0x55e200b010f0) register_command objecter_requests hook 0x55e200d28220 2024-09-22T08:38:53.269 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-22T08:38:52.974+0000 7fec03f23800 1 librados: setting wanted keys 2024-09-22T08:38:53.269 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-22T08:38:52.974+0000 7fec03f23800 1 librados: calling monclient init 2024-09-22T08:38:53.269 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-22T08:38:52.974+0000 7fec03f23800 10 monclient: init 2024-09-22T08:38:53.269 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-22T08:38:52.974+0000 7fec03f23800 5 AuthRegistry(0x55e200d22fe0) adding auth protocol: cephx 2024-09-22T08:38:53.269 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-22T08:38:52.974+0000 7fec03f23800 5 AuthRegistry(0x55e200d22fe0) adding auth protocol: cephx 2024-09-22T08:38:53.269 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-22T08:38:52.974+0000 7fec03f23800 5 AuthRegistry(0x55e200d22fe0) adding auth protocol: cephx 2024-09-22T08:38:53.269 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-22T08:38:52.974+0000 7fec03f23800 5 AuthRegistry(0x55e200d22fe0) adding con mode: secure 2024-09-22T08:38:53.269 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-22T08:38:52.974+0000 7fec03f23800 5 AuthRegistry(0x55e200d22fe0) adding con mode: crc 2024-09-22T08:38:53.270 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-22T08:38:52.974+0000 7fec03f23800 5 AuthRegistry(0x55e200d22fe0) adding con mode: secure 2024-09-22T08:38:53.270 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-22T08:38:52.974+0000 7fec03f23800 5 AuthRegistry(0x55e200d22fe0) adding con mode: crc 2024-09-22T08:38:53.270 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-22T08:38:52.974+0000 7fec03f23800 5 AuthRegistry(0x55e200d22fe0) adding con mode: secure 2024-09-22T08:38:53.270 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-22T08:38:52.974+0000 7fec03f23800 5 AuthRegistry(0x55e200d22fe0) adding con mode: crc 2024-09-22T08:38:53.270 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-22T08:38:52.974+0000 7fec03f23800 5 AuthRegistry(0x55e200d22fe0) adding con mode: crc 2024-09-22T08:38:53.270 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-22T08:38:52.974+0000 7fec03f23800 5 AuthRegistry(0x55e200d22fe0) adding con mode: secure 2024-09-22T08:38:53.270 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-22T08:38:52.974+0000 7fec03f23800 5 AuthRegistry(0x55e200d22fe0) adding con mode: crc 2024-09-22T08:38:53.270 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-22T08:38:52.974+0000 7fec03f23800 5 AuthRegistry(0x55e200d22fe0) adding con mode: secure 2024-09-22T08:38:53.270 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-22T08:38:52.974+0000 7fec03f23800 5 AuthRegistry(0x55e200d22fe0) adding con mode: crc 2024-09-22T08:38:53.270 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-22T08:38:52.974+0000 7fec03f23800 5 AuthRegistry(0x55e200d22fe0) adding con mode: secure 2024-09-22T08:38:53.270 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-22T08:38:52.974+0000 7fec03f23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:53.270 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-22T08:38:52.974+0000 7fec03f23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:53.270 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-22T08:38:52.974+0000 7fec03f23800 5 asok(0x55e200b010f0) register_command rotate-key hook 0x55e200d23128 2024-09-22T08:38:53.270 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-22T08:38:52.974+0000 7fec03f23800 10 monclient: _reopen_session rank -1 2024-09-22T08:38:53.270 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-22T08:38:52.974+0000 7fec03f23800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T08:38:53.271 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-22T08:38:52.974+0000 7fec03f23800 10 monclient(hunting): picked mon.noname-b con 0x55e200bcf620 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:38:53.271 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-22T08:38:52.974+0000 7fec03f23800 10 monclient(hunting): picked mon.noname-a con 0x55e200bd8520 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:38:53.271 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-22T08:38:52.974+0000 7fec03f23800 10 monclient(hunting): picked mon.noname-c con 0x55e200c69000 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:38:53.271 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-22T08:38:52.974+0000 7fec03f23800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:53.271 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-22T08:38:52.974+0000 7fec03f23800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:53.271 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-22T08:38:52.974+0000 7fec03f23800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:53.271 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-22T08:38:52.974+0000 7fec03f23800 10 monclient(hunting): _renew_subs 2024-09-22T08:38:53.271 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-22T08:38:52.974+0000 7fec03f23800 10 monclient(hunting): authenticate will time out at 2238.213620s 2024-09-22T08:38:53.271 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-22T08:38:52.974+0000 7fec0040d640 10 monclient(hunting): get_auth_request con 0x55e200c69000 auth_method 0 2024-09-22T08:38:53.271 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-22T08:38:52.974+0000 7fec0040d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:53.271 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-22T08:38:52.974+0000 7fec0040d640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:53.271 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-22T08:38:52.974+0000 7fec0040d640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:53.271 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-22T08:38:52.974+0000 7febff40b640 10 monclient(hunting): get_auth_request con 0x55e200bd8520 auth_method 0 2024-09-22T08:38:53.271 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-22T08:38:52.974+0000 7febff40b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:53.271 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-22T08:38:52.974+0000 7febff40b640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:53.272 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-22T08:38:52.974+0000 7febff40b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:53.272 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-22T08:38:52.974+0000 7febffc0c640 10 monclient(hunting): get_auth_request con 0x55e200bcf620 auth_method 0 2024-09-22T08:38:53.272 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-22T08:38:52.974+0000 7febffc0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:53.272 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-22T08:38:52.974+0000 7febffc0c640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:53.272 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-22T08:38:52.974+0000 7febffc0c640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:53.272 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-22T08:38:52.974+0000 7febff40b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:53.272 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-22T08:38:52.974+0000 7febff40b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:53.272 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-22T08:38:52.974+0000 7febff40b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:53.272 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-22T08:38:52.974+0000 7fec0040d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:53.272 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-22T08:38:52.974+0000 7fec0040d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:53.272 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-22T08:38:52.974+0000 7fec0040d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:53.272 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-22T08:38:52.974+0000 7febffc0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:53.272 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-22T08:38:52.974+0000 7febffc0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:53.272 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-22T08:38:52.974+0000 7febffc0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:53.273 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-22T08:38:52.975+0000 7febff40b640 10 monclient(hunting): handle_auth_done global_id 8193 payload 824 2024-09-22T08:38:53.273 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-22T08:38:52.975+0000 7febff40b640 10 monclient: _finish_hunting 0 2024-09-22T08:38:53.273 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-22T08:38:52.975+0000 7febff40b640 1 monclient: found mon.noname-a 2024-09-22T08:38:53.273 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-22T08:38:52.975+0000 7febff40b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:38:53.273 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-22T08:38:52.975+0000 7feae7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:53.273 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-22T08:38:52.975+0000 7feae7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:38:53.273 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-22T08:38:52.975+0000 7feae7fff640 10 monclient: dump: 2024-09-22T08:38:53.273 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:38:53.273 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:38:53.273 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:53.273 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:53.273 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:53.273 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:53.273 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:38:53.273 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:38:53.274 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:38:53.274 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:53.274 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-22T08:38:52.975+0000 7feae7fff640 10 monclient: _finish_auth 0 2024-09-22T08:38:53.274 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-22T08:38:52.975+0000 7feae7fff640 10 monclient: _check_auth_tickets 2024-09-22T08:38:53.274 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-22T08:38:52.975+0000 7fec03f23800 5 monclient: authenticate success, global_id 8193 2024-09-22T08:38:53.274 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-22T08:38:52.975+0000 7fec03f23800 10 monclient: _renew_subs 2024-09-22T08:38:53.274 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-22T08:38:52.975+0000 7fec03f23800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:38:53.274 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-22T08:38:52.975+0000 7feae7fff640 10 monclient: handle_config config(0 keys) 2024-09-22T08:38:53.274 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-22T08:38:52.975+0000 7feae7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:53.274 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-22T08:38:52.975+0000 7feae7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:38:53.274 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-22T08:38:52.975+0000 7feae7fff640 10 monclient: dump: 2024-09-22T08:38:53.274 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:38:53.274 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:38:53.275 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:53.275 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:53.275 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:53.275 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:53.275 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:38:53.275 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:38:53.275 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:38:53.275 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:53.275 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-22T08:38:52.975+0000 7feaede0b640 4 set_mon_vals no callback set 2024-09-22T08:38:53.275 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-22T08:38:52.975+0000 7fec03f23800 10 monclient: _renew_subs 2024-09-22T08:38:53.275 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-22T08:38:52.975+0000 7fec03f23800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:38:53.275 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-22T08:38:52.975+0000 7fec03f23800 1 librados: init done 2024-09-22T08:38:53.275 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-22T08:38:52.977+0000 7feae7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:38:53.275 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-22T08:38:52.977+0000 7feae7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:38:53.276 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-22T08:38:52.977+0000 7feae7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:38:53.276 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-22T08:38:52.977+0000 7febffc0c640 10 monclient: get_auth_request con 0x7feae8077570 auth_method 0 2024-09-22T08:38:53.276 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-22T08:38:52.978+0000 7fec0040d640 10 monclient: get_auth_request con 0x55e200d4b8d0 auth_method 0 2024-09-22T08:38:53.276 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-22T08:38:52.979+0000 7febffc0c640 10 monclient: get_auth_request con 0x55e200d6e400 auth_method 0 2024-09-22T08:38:53.276 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-22T08:38:52.980+0000 7febff40b640 10 monclient: get_auth_request con 0x55e200d72760 auth_method 0 2024-09-22T08:38:53.276 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-22T08:38:52.981+0000 7fec0040d640 10 monclient: get_auth_request con 0x55e200d71cb0 auth_method 0 2024-09-22T08:38:53.276 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-22T08:38:52.982+0000 7fec03f23800 10 monclient: build_initial_monmap 2024-09-22T08:38:53.276 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-22T08:38:52.982+0000 7fec03f23800 1 build_initial for_mkfs: 0 2024-09-22T08:38:53.276 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-22T08:38:52.982+0000 7fec03f23800 10 monclient: monmap: 2024-09-22T08:38:53.276 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:38:53.276 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:38:53.276 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:38:53.276 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:38:53.276 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:38:53.276 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:53.276 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:38:53.277 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:38:53.277 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:38:53.277 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:53.277 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d7a830) adding auth protocol: cephx 2024-09-22T08:38:53.277 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d7a830) adding auth protocol: cephx 2024-09-22T08:38:53.277 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d7a830) adding auth protocol: cephx 2024-09-22T08:38:53.277 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d7a830) adding con mode: secure 2024-09-22T08:38:53.277 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d7a830) adding con mode: crc 2024-09-22T08:38:53.277 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d7a830) adding con mode: secure 2024-09-22T08:38:53.277 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d7a830) adding con mode: crc 2024-09-22T08:38:53.277 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d7a830) adding con mode: secure 2024-09-22T08:38:53.277 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d7a830) adding con mode: crc 2024-09-22T08:38:53.277 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d7a830) adding con mode: crc 2024-09-22T08:38:53.277 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d7a830) adding con mode: secure 2024-09-22T08:38:53.278 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d7a830) adding con mode: crc 2024-09-22T08:38:53.278 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d7a830) adding con mode: secure 2024-09-22T08:38:53.278 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d7a830) adding con mode: crc 2024-09-22T08:38:53.278 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d7a830) adding con mode: secure 2024-09-22T08:38:53.278 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-22T08:38:52.982+0000 7fec03f23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:53.278 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 asok(0x55e200b010f0) register_command objecter_requests cmddesc objecter_requests hook 0x55e200d7e220 EEXIST 2024-09-22T08:38:53.278 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-22T08:38:52.982+0000 7fec03f23800 10 monclient: init 2024-09-22T08:38:53.278 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d79778) adding auth protocol: cephx 2024-09-22T08:38:53.278 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d79778) adding auth protocol: cephx 2024-09-22T08:38:53.278 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d79778) adding auth protocol: cephx 2024-09-22T08:38:53.278 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d79778) adding con mode: secure 2024-09-22T08:38:53.278 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d79778) adding con mode: crc 2024-09-22T08:38:53.278 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d79778) adding con mode: secure 2024-09-22T08:38:53.278 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d79778) adding con mode: crc 2024-09-22T08:38:53.278 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d79778) adding con mode: secure 2024-09-22T08:38:53.279 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d79778) adding con mode: crc 2024-09-22T08:38:53.279 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d79778) adding con mode: crc 2024-09-22T08:38:53.279 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d79778) adding con mode: secure 2024-09-22T08:38:53.279 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d79778) adding con mode: crc 2024-09-22T08:38:53.279 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d79778) adding con mode: secure 2024-09-22T08:38:53.279 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d79778) adding con mode: crc 2024-09-22T08:38:53.279 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d79778) adding con mode: secure 2024-09-22T08:38:53.279 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-22T08:38:52.983+0000 7fec03f23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:53.279 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-22T08:38:52.983+0000 7fec03f23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:53.279 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-22T08:38:52.983+0000 7fec03f23800 5 asok(0x55e200b010f0) register_command rotate-key cmddesc rotate-key hook 0x55e200d798c0 EEXIST 2024-09-22T08:38:53.279 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-22T08:38:52.983+0000 7fec03f23800 10 monclient: _reopen_session rank -1 2024-09-22T08:38:53.279 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-22T08:38:52.983+0000 7fec03f23800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-22T08:38:53.279 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-22T08:38:52.983+0000 7fec03f23800 10 monclient(hunting): picked mon.noname-b con 0x55e200da1f10 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:38:53.279 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-22T08:38:52.983+0000 7fec03f23800 10 monclient(hunting): picked mon.noname-c con 0x55e200da41e0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:38:53.280 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-22T08:38:52.983+0000 7fec03f23800 10 monclient(hunting): picked mon.noname-a con 0x55e200da06e0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:38:53.280 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-22T08:38:52.983+0000 7fec03f23800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:53.280 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-22T08:38:52.983+0000 7fec03f23800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:53.280 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-22T08:38:52.983+0000 7fec03f23800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:53.280 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-22T08:38:52.983+0000 7fec03f23800 10 monclient(hunting): _renew_subs 2024-09-22T08:38:53.280 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-22T08:38:52.983+0000 7fec03f23800 10 monclient(hunting): authenticate will time out at 2238.222443s 2024-09-22T08:38:53.280 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-22T08:38:52.983+0000 7fec0040d640 10 monclient(hunting): get_auth_request con 0x55e200da41e0 auth_method 0 2024-09-22T08:38:53.280 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-22T08:38:52.983+0000 7fec0040d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:53.280 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-22T08:38:52.983+0000 7fec0040d640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:53.280 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-22T08:38:52.983+0000 7fec0040d640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:53.280 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-22T08:38:52.983+0000 7febffc0c640 10 monclient(hunting): get_auth_request con 0x55e200da06e0 auth_method 0 2024-09-22T08:38:53.280 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-22T08:38:52.983+0000 7febffc0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:53.280 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-22T08:38:52.983+0000 7febffc0c640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:53.280 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-22T08:38:52.983+0000 7febffc0c640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:53.280 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-22T08:38:52.983+0000 7febff40b640 10 monclient(hunting): get_auth_request con 0x55e200da1f10 auth_method 0 2024-09-22T08:38:53.281 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-22T08:38:52.983+0000 7febff40b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:53.281 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-22T08:38:52.983+0000 7febff40b640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:53.281 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-22T08:38:52.983+0000 7febff40b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:53.281 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-22T08:38:52.983+0000 7fec0040d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:53.281 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-22T08:38:52.983+0000 7fec0040d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:53.281 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-22T08:38:52.983+0000 7fec0040d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:53.281 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-22T08:38:52.983+0000 7febffc0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:53.281 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-22T08:38:52.983+0000 7febffc0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:53.281 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-22T08:38:52.983+0000 7febffc0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:53.281 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-22T08:38:52.983+0000 7febff40b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:53.281 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-22T08:38:52.983+0000 7febff40b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:53.281 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-22T08:38:52.983+0000 7febff40b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:53.281 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-22T08:38:52.983+0000 7fec0040d640 10 monclient(hunting): handle_auth_done global_id 7709 payload 824 2024-09-22T08:38:53.281 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-22T08:38:52.983+0000 7fec0040d640 10 monclient: _finish_hunting 0 2024-09-22T08:38:53.281 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-22T08:38:52.983+0000 7fec0040d640 1 monclient: found mon.noname-c 2024-09-22T08:38:53.282 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-22T08:38:52.983+0000 7fec0040d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:38:53.282 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-22T08:38:52.984+0000 7feae57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:53.282 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-22T08:38:52.984+0000 7feae57fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:38:53.282 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-22T08:38:52.984+0000 7feae57fa640 10 monclient: dump: 2024-09-22T08:38:53.282 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:38:53.282 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:38:53.282 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:53.282 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:53.282 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:53.282 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:53.282 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:38:53.282 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:38:53.282 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:38:53.282 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:53.282 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-22T08:38:52.984+0000 7feae57fa640 10 monclient: _finish_auth 0 2024-09-22T08:38:53.283 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-22T08:38:52.984+0000 7feae57fa640 10 monclient: _check_auth_tickets 2024-09-22T08:38:53.283 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-22T08:38:52.984+0000 7feae57fa640 10 monclient: handle_config config(0 keys) 2024-09-22T08:38:53.283 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-22T08:38:52.984+0000 7feae57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:53.283 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-22T08:38:52.984+0000 7feae57fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:38:53.283 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-22T08:38:52.984+0000 7feae57fa640 10 monclient: dump: 2024-09-22T08:38:53.283 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:38:53.283 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:38:53.283 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:53.283 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:53.283 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:53.283 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:53.283 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:38:53.283 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:38:53.283 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:38:53.284 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:53.284 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-22T08:38:52.984+0000 7fec03f23800 5 monclient: authenticate success, global_id 7709 2024-09-22T08:38:53.284 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-22T08:38:52.984+0000 7fec03f23800 10 monclient: _renew_subs 2024-09-22T08:38:53.284 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-22T08:38:52.984+0000 7fec03f23800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:38:53.284 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-22T08:38:52.984+0000 7fec00c0e640 4 set_mon_vals no callback set 2024-09-22T08:38:53.284 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-22T08:38:52.984+0000 7fec03f23800 10 monclient: _renew_subs 2024-09-22T08:38:53.284 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-22T08:38:52.984+0000 7fec03f23800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:38:53.284 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-22T08:38:52.986+0000 7feae57fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:38:53.284 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-22T08:38:52.986+0000 7feae57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:38:53.284 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-22T08:38:52.986+0000 7feae57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:38:53.284 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-22T08:38:52.986+0000 7febff40b640 10 monclient: get_auth_request con 0x7fead8077480 auth_method 0 2024-09-22T08:38:53.284 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-22T08:38:52.987+0000 7fec03f23800 10 monclient: get_monmap_and_config 2024-09-22T08:38:53.284 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-22T08:38:52.987+0000 7fec03f23800 10 monclient: build_initial_monmap 2024-09-22T08:38:53.284 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-22T08:38:52.987+0000 7fec03f23800 1 build_initial for_mkfs: 0 2024-09-22T08:38:53.284 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-22T08:38:52.987+0000 7fec03f23800 10 monclient: monmap: 2024-09-22T08:38:53.285 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:38:53.285 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:38:53.285 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:38:53.285 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:38:53.285 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:38:53.285 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:53.285 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:38:53.285 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:38:53.285 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:38:53.285 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:53.285 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x55e200dc1dc0) adding auth protocol: cephx 2024-09-22T08:38:53.285 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x55e200dc1dc0) adding auth protocol: cephx 2024-09-22T08:38:53.285 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x55e200dc1dc0) adding auth protocol: cephx 2024-09-22T08:38:53.285 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x55e200dc1dc0) adding con mode: secure 2024-09-22T08:38:53.286 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x55e200dc1dc0) adding con mode: crc 2024-09-22T08:38:53.286 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x55e200dc1dc0) adding con mode: secure 2024-09-22T08:38:53.286 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x55e200dc1dc0) adding con mode: crc 2024-09-22T08:38:53.286 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x55e200dc1dc0) adding con mode: secure 2024-09-22T08:38:53.286 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x55e200dc1dc0) adding con mode: crc 2024-09-22T08:38:53.286 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x55e200dc1dc0) adding con mode: crc 2024-09-22T08:38:53.286 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x55e200dc1dc0) adding con mode: secure 2024-09-22T08:38:53.286 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x55e200dc1dc0) adding con mode: crc 2024-09-22T08:38:53.286 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x55e200dc1dc0) adding con mode: secure 2024-09-22T08:38:53.286 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x55e200dc1dc0) adding con mode: crc 2024-09-22T08:38:53.286 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x55e200dc1dc0) adding con mode: secure 2024-09-22T08:38:53.286 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-22T08:38:52.987+0000 7fec03f23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:53.286 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-22T08:38:52.987+0000 7fec03f23800 10 monclient: init 2024-09-22T08:38:53.287 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb1cd0) adding auth protocol: cephx 2024-09-22T08:38:53.287 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb1cd0) adding auth protocol: cephx 2024-09-22T08:38:53.287 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb1cd0) adding auth protocol: cephx 2024-09-22T08:38:53.287 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb1cd0) adding con mode: secure 2024-09-22T08:38:53.287 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb1cd0) adding con mode: crc 2024-09-22T08:38:53.287 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb1cd0) adding con mode: secure 2024-09-22T08:38:53.287 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb1cd0) adding con mode: crc 2024-09-22T08:38:53.287 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb1cd0) adding con mode: secure 2024-09-22T08:38:53.287 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb1cd0) adding con mode: crc 2024-09-22T08:38:53.287 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb1cd0) adding con mode: crc 2024-09-22T08:38:53.287 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb1cd0) adding con mode: secure 2024-09-22T08:38:53.287 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb1cd0) adding con mode: crc 2024-09-22T08:38:53.287 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb1cd0) adding con mode: secure 2024-09-22T08:38:53.287 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb1cd0) adding con mode: crc 2024-09-22T08:38:53.287 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb1cd0) adding con mode: secure 2024-09-22T08:38:53.288 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-22T08:38:52.987+0000 7fec03f23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:53.288 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-22T08:38:52.987+0000 7fec03f23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:53.288 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-22T08:38:52.988+0000 7fec03f23800 5 asok(0x55e200b010f0) register_command rotate-key cmddesc rotate-key hook 0x7ffe20fb1e18 EEXIST 2024-09-22T08:38:53.288 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-22T08:38:52.988+0000 7fec03f23800 10 monclient: _reopen_session rank -1 2024-09-22T08:38:53.288 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-22T08:38:52.988+0000 7fec03f23800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T08:38:53.288 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-22T08:38:52.988+0000 7fec03f23800 10 monclient(hunting): picked mon.noname-a con 0x55e200df6460 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:38:53.288 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-22T08:38:52.988+0000 7fec03f23800 10 monclient(hunting): picked mon.noname-c con 0x55e200dc73b0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:38:53.288 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-22T08:38:52.988+0000 7fec03f23800 10 monclient(hunting): picked mon.noname-b con 0x55e200df1d00 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:38:53.288 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-22T08:38:52.988+0000 7fec03f23800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:53.288 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-22T08:38:52.988+0000 7fec03f23800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:53.288 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-22T08:38:52.988+0000 7fec03f23800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:53.288 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-22T08:38:52.988+0000 7fec03f23800 10 monclient(hunting): _renew_subs 2024-09-22T08:38:53.288 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-22T08:38:52.988+0000 7fec03f23800 10 monclient(hunting): authenticate will time out at 2238.227092s 2024-09-22T08:38:53.288 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-22T08:38:52.988+0000 7febff40b640 10 monclient(hunting): get_auth_request con 0x55e200df6460 auth_method 0 2024-09-22T08:38:53.288 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-22T08:38:52.988+0000 7febff40b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:53.288 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-22T08:38:52.988+0000 7febff40b640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:53.289 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-22T08:38:52.988+0000 7febff40b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:53.289 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-22T08:38:52.988+0000 7fec0040d640 10 monclient(hunting): get_auth_request con 0x55e200dc73b0 auth_method 0 2024-09-22T08:38:53.289 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-22T08:38:52.988+0000 7fec0040d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:53.289 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-22T08:38:52.988+0000 7fec0040d640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:53.289 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-22T08:38:52.988+0000 7fec0040d640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:53.289 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-22T08:38:52.988+0000 7febff40b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:53.289 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-22T08:38:52.988+0000 7febff40b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:53.289 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-22T08:38:52.988+0000 7febff40b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:53.289 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-22T08:38:52.988+0000 7febffc0c640 10 monclient(hunting): get_auth_request con 0x55e200df1d00 auth_method 0 2024-09-22T08:38:53.289 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-22T08:38:52.988+0000 7febffc0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:53.289 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-22T08:38:52.988+0000 7febffc0c640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:53.289 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-22T08:38:52.988+0000 7febffc0c640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:53.289 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-22T08:38:52.988+0000 7fec0040d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:53.289 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-22T08:38:52.988+0000 7fec0040d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:53.290 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-22T08:38:52.988+0000 7fec0040d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:53.290 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-22T08:38:52.988+0000 7febffc0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:53.290 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-22T08:38:52.988+0000 7febffc0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:53.290 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-22T08:38:52.988+0000 7febffc0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:53.290 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-22T08:38:52.988+0000 7febff40b640 10 monclient(hunting): handle_auth_done global_id 8199 payload 274 2024-09-22T08:38:53.290 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-22T08:38:52.988+0000 7febff40b640 10 monclient: _finish_hunting 0 2024-09-22T08:38:53.290 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-22T08:38:52.988+0000 7febff40b640 1 monclient: found mon.noname-a 2024-09-22T08:38:53.290 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-22T08:38:52.988+0000 7febff40b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:38:53.290 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-22T08:38:52.988+0000 7feadeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:53.290 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-22T08:38:52.988+0000 7feadeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:38:53.290 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-22T08:38:52.988+0000 7feadeffd640 10 monclient: dump: 2024-09-22T08:38:53.290 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:38:53.290 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:38:53.291 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:53.291 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:53.291 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:53.291 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:53.291 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:38:53.291 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:38:53.291 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:38:53.291 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:53.291 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-22T08:38:52.988+0000 7feadeffd640 10 monclient: _finish_auth 0 2024-09-22T08:38:53.291 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-22T08:38:52.988+0000 7feadeffd640 10 monclient: _check_auth_tickets 2024-09-22T08:38:53.291 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-22T08:38:52.988+0000 7feadeffd640 10 monclient: handle_config config(0 keys) 2024-09-22T08:38:53.291 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-22T08:38:52.988+0000 7fec03f23800 5 monclient: authenticate success, global_id 8199 2024-09-22T08:38:53.291 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-22T08:38:52.988+0000 7fec03f23800 10 monclient: get_monmap_and_config success 2024-09-22T08:38:53.292 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-22T08:38:52.988+0000 7fec03f23800 4 set_mon_vals no callback set 2024-09-22T08:38:53.292 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-22T08:38:52.988+0000 7feadeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:53.292 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-22T08:38:52.988+0000 7feadeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:38:53.292 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-22T08:38:52.988+0000 7feadeffd640 10 monclient: dump: 2024-09-22T08:38:53.292 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:38:53.292 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:38:53.292 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:53.292 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:53.292 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:53.292 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:53.292 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:38:53.292 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:38:53.292 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:38:53.292 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:53.292 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-22T08:38:52.989+0000 7fec03f23800 10 monclient: shutdown 2024-09-22T08:38:53.293 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-22T08:38:52.989+0000 7fec03f23800 10 monclient: build_initial_monmap 2024-09-22T08:38:53.293 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-22T08:38:52.989+0000 7fec03f23800 1 build_initial for_mkfs: 0 2024-09-22T08:38:53.293 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-22T08:38:52.989+0000 7fec03f23800 10 monclient: monmap: 2024-09-22T08:38:53.293 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:38:53.293 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:38:53.293 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:38:53.293 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:38:53.293 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:38:53.293 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:53.293 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:38:53.293 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:38:53.293 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:38:53.293 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:53.293 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-22T08:38:52.989+0000 7fec03f23800 5 AuthRegistry(0x55e200de8030) adding auth protocol: cephx 2024-09-22T08:38:53.294 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-22T08:38:52.989+0000 7fec03f23800 5 AuthRegistry(0x55e200de8030) adding auth protocol: cephx 2024-09-22T08:38:53.294 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-22T08:38:52.989+0000 7fec03f23800 5 AuthRegistry(0x55e200de8030) adding auth protocol: cephx 2024-09-22T08:38:53.294 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-22T08:38:52.989+0000 7fec03f23800 5 AuthRegistry(0x55e200de8030) adding con mode: secure 2024-09-22T08:38:53.294 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-22T08:38:52.989+0000 7fec03f23800 5 AuthRegistry(0x55e200de8030) adding con mode: crc 2024-09-22T08:38:53.294 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-22T08:38:52.989+0000 7fec03f23800 5 AuthRegistry(0x55e200de8030) adding con mode: secure 2024-09-22T08:38:53.294 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-22T08:38:52.989+0000 7fec03f23800 5 AuthRegistry(0x55e200de8030) adding con mode: crc 2024-09-22T08:38:53.294 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-22T08:38:52.989+0000 7fec03f23800 5 AuthRegistry(0x55e200de8030) adding con mode: secure 2024-09-22T08:38:53.294 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-22T08:38:52.989+0000 7fec03f23800 5 AuthRegistry(0x55e200de8030) adding con mode: crc 2024-09-22T08:38:53.294 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-22T08:38:52.989+0000 7fec03f23800 5 AuthRegistry(0x55e200de8030) adding con mode: crc 2024-09-22T08:38:53.294 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-22T08:38:52.989+0000 7fec03f23800 5 AuthRegistry(0x55e200de8030) adding con mode: secure 2024-09-22T08:38:53.294 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-22T08:38:52.989+0000 7fec03f23800 5 AuthRegistry(0x55e200de8030) adding con mode: crc 2024-09-22T08:38:53.294 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-22T08:38:52.989+0000 7fec03f23800 5 AuthRegistry(0x55e200de8030) adding con mode: secure 2024-09-22T08:38:53.294 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-22T08:38:52.989+0000 7fec03f23800 5 AuthRegistry(0x55e200de8030) adding con mode: crc 2024-09-22T08:38:53.294 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-22T08:38:52.989+0000 7fec03f23800 5 AuthRegistry(0x55e200de8030) adding con mode: secure 2024-09-22T08:38:53.295 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-22T08:38:52.989+0000 7fec03f23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:53.295 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-22T08:38:52.989+0000 7fec03f23800 1 librados: starting msgr at 2024-09-22T08:38:53.295 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-22T08:38:52.989+0000 7fec03f23800 1 librados: starting objecter 2024-09-22T08:38:53.295 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-22T08:38:52.989+0000 7fec03f23800 5 asok(0x55e200b010f0) register_command objecter_requests cmddesc objecter_requests hook 0x55e200dc5300 EEXIST 2024-09-22T08:38:53.295 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-22T08:38:52.990+0000 7fec03f23800 1 librados: setting wanted keys 2024-09-22T08:38:53.295 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-22T08:38:52.990+0000 7fec03f23800 1 librados: calling monclient init 2024-09-22T08:38:53.295 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-22T08:38:52.990+0000 7fec03f23800 10 monclient: init 2024-09-22T08:38:53.295 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-22T08:38:52.990+0000 7fec03f23800 5 AuthRegistry(0x55e200db9cc0) adding auth protocol: cephx 2024-09-22T08:38:53.295 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-22T08:38:52.990+0000 7fec03f23800 5 AuthRegistry(0x55e200db9cc0) adding auth protocol: cephx 2024-09-22T08:38:53.295 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-22T08:38:52.990+0000 7fec03f23800 5 AuthRegistry(0x55e200db9cc0) adding auth protocol: cephx 2024-09-22T08:38:53.295 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-22T08:38:52.990+0000 7fec03f23800 5 AuthRegistry(0x55e200db9cc0) adding con mode: secure 2024-09-22T08:38:53.295 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-22T08:38:52.990+0000 7fec03f23800 5 AuthRegistry(0x55e200db9cc0) adding con mode: crc 2024-09-22T08:38:53.295 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-22T08:38:52.990+0000 7fec03f23800 5 AuthRegistry(0x55e200db9cc0) adding con mode: secure 2024-09-22T08:38:53.295 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-22T08:38:52.990+0000 7fec03f23800 5 AuthRegistry(0x55e200db9cc0) adding con mode: crc 2024-09-22T08:38:53.295 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-22T08:38:52.990+0000 7fec03f23800 5 AuthRegistry(0x55e200db9cc0) adding con mode: secure 2024-09-22T08:38:53.296 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-22T08:38:52.990+0000 7fec03f23800 5 AuthRegistry(0x55e200db9cc0) adding con mode: crc 2024-09-22T08:38:53.296 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-22T08:38:52.990+0000 7fec03f23800 5 AuthRegistry(0x55e200db9cc0) adding con mode: crc 2024-09-22T08:38:53.296 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-22T08:38:52.990+0000 7fec03f23800 5 AuthRegistry(0x55e200db9cc0) adding con mode: secure 2024-09-22T08:38:53.296 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-22T08:38:52.990+0000 7fec03f23800 5 AuthRegistry(0x55e200db9cc0) adding con mode: crc 2024-09-22T08:38:53.296 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-22T08:38:52.990+0000 7fec03f23800 5 AuthRegistry(0x55e200db9cc0) adding con mode: secure 2024-09-22T08:38:53.296 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-22T08:38:52.990+0000 7fec03f23800 5 AuthRegistry(0x55e200db9cc0) adding con mode: crc 2024-09-22T08:38:53.296 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-22T08:38:52.990+0000 7fec03f23800 5 AuthRegistry(0x55e200db9cc0) adding con mode: secure 2024-09-22T08:38:53.296 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-22T08:38:52.990+0000 7fec03f23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:53.296 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-22T08:38:52.990+0000 7fec03f23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:53.296 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-22T08:38:52.990+0000 7fec03f23800 5 asok(0x55e200b010f0) register_command rotate-key cmddesc rotate-key hook 0x55e200db9e08 EEXIST 2024-09-22T08:38:53.296 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-22T08:38:52.990+0000 7fec03f23800 10 monclient: _reopen_session rank -1 2024-09-22T08:38:53.296 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-22T08:38:52.990+0000 7fec03f23800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T08:38:53.296 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-22T08:38:52.990+0000 7fec03f23800 10 monclient(hunting): picked mon.noname-b con 0x55e200dc73b0 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:38:53.296 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-22T08:38:52.990+0000 7fec03f23800 10 monclient(hunting): picked mon.noname-a con 0x55e200df1d00 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:38:53.296 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-22T08:38:52.990+0000 7fec03f23800 10 monclient(hunting): picked mon.noname-c con 0x55e200df6460 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:38:53.297 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-22T08:38:52.990+0000 7fec03f23800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:53.297 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-22T08:38:52.990+0000 7fec03f23800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:53.297 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-22T08:38:52.990+0000 7fec03f23800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:53.297 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-22T08:38:52.990+0000 7fec03f23800 10 monclient(hunting): _renew_subs 2024-09-22T08:38:53.297 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-22T08:38:52.990+0000 7fec03f23800 10 monclient(hunting): authenticate will time out at 2238.229667s 2024-09-22T08:38:53.297 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-22T08:38:52.990+0000 7fec0040d640 10 monclient(hunting): get_auth_request con 0x55e200df1d00 auth_method 0 2024-09-22T08:38:53.297 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-22T08:38:52.990+0000 7fec0040d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:53.297 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-22T08:38:52.990+0000 7fec0040d640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:53.297 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-22T08:38:52.990+0000 7fec0040d640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:53.297 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-22T08:38:52.990+0000 7febffc0c640 10 monclient(hunting): get_auth_request con 0x55e200df6460 auth_method 0 2024-09-22T08:38:53.297 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-22T08:38:52.990+0000 7febffc0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:53.297 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-22T08:38:52.990+0000 7febffc0c640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:53.297 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-22T08:38:52.990+0000 7febffc0c640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:53.297 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-22T08:38:52.990+0000 7fec0040d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:53.297 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-22T08:38:52.990+0000 7fec0040d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:53.298 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-22T08:38:52.990+0000 7fec0040d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:53.298 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-22T08:38:52.990+0000 7febffc0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:53.298 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-22T08:38:52.990+0000 7febffc0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:53.298 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-22T08:38:52.990+0000 7febffc0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:53.298 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-22T08:38:52.990+0000 7fec0040d640 10 monclient(hunting): handle_auth_done global_id 8202 payload 824 2024-09-22T08:38:53.298 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-22T08:38:52.991+0000 7fec0040d640 10 monclient: _finish_hunting 0 2024-09-22T08:38:53.298 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-22T08:38:52.991+0000 7fec0040d640 1 monclient: found mon.noname-a 2024-09-22T08:38:53.298 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-22T08:38:52.991+0000 7fec0040d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:38:53.298 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-22T08:38:52.991+0000 7febff40b640 10 monclient: get_auth_request con 0x55e200dc73b0 auth_method 0 2024-09-22T08:38:53.298 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-22T08:38:52.991+0000 7feadd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:53.298 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-22T08:38:52.991+0000 7feadd7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:38:53.298 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-22T08:38:52.991+0000 7feadd7fa640 10 monclient: dump: 2024-09-22T08:38:53.298 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:38:53.298 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:38:53.299 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:53.299 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:53.299 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:53.299 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:53.299 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:38:53.299 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:38:53.299 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:38:53.299 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:53.299 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-22T08:38:52.991+0000 7feadd7fa640 10 monclient: _finish_auth 0 2024-09-22T08:38:53.299 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-22T08:38:52.991+0000 7feadd7fa640 10 monclient: _check_auth_tickets 2024-09-22T08:38:53.299 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-22T08:38:52.991+0000 7fec03f23800 5 monclient: authenticate success, global_id 8202 2024-09-22T08:38:53.299 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-22T08:38:52.991+0000 7fec03f23800 10 monclient: _renew_subs 2024-09-22T08:38:53.299 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-22T08:38:52.991+0000 7fec03f23800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:38:53.299 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-22T08:38:52.991+0000 7feadd7fa640 10 monclient: handle_config config(0 keys) 2024-09-22T08:38:53.300 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-22T08:38:52.991+0000 7feadd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:53.300 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-22T08:38:52.991+0000 7feadd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:38:53.300 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-22T08:38:52.991+0000 7feadd7fa640 10 monclient: dump: 2024-09-22T08:38:53.300 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:38:53.300 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:38:53.300 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:53.300 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:53.300 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:53.300 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:53.300 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:38:53.300 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:38:53.300 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:38:53.300 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:53.300 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-22T08:38:52.991+0000 7feadeffd640 4 set_mon_vals no callback set 2024-09-22T08:38:53.300 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-22T08:38:52.991+0000 7fec03f23800 10 monclient: _renew_subs 2024-09-22T08:38:53.301 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-22T08:38:52.991+0000 7fec03f23800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:38:53.301 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-22T08:38:52.991+0000 7fec03f23800 1 librados: init done 2024-09-22T08:38:53.301 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-22T08:38:52.991+0000 7fec03f23800 5 asok(0x55e200b010f0) register_command cr dump hook 0x55e200de4018 2024-09-22T08:38:53.301 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-22T08:38:52.993+0000 7fec03f23800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.301 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-22T08:38:52.993+0000 7feadd7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:38:53.301 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-22T08:38:52.993+0000 7feadd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:38:53.301 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-22T08:38:52.993+0000 7feadd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:38:53.301 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-22T08:38:52.993+0000 7febff40b640 10 monclient: get_auth_request con 0x7feac8077570 auth_method 0 2024-09-22T08:38:53.301 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-22T08:38:52.994+0000 7febffc0c640 10 monclient: get_auth_request con 0x55e200e103f0 auth_method 0 2024-09-22T08:38:53.301 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-22T08:38:52.994+0000 7fec03f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:53.301 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-22T08:38:52.994+0000 7fec03f23800 20 realm 2024-09-22T08:38:53.301 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-22T08:38:52.994+0000 7fec03f23800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.301 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-22T08:38:52.995+0000 7fec03f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:53.301 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-22T08:38:52.995+0000 7fec03f23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:53.301 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-22T08:38:52.995+0000 7fec03f23800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.302 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-22T08:38:52.995+0000 7fec03f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:53.302 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-22T08:38:52.995+0000 7fec03f23800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.302 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-22T08:38:52.995+0000 7febff40b640 10 monclient: get_auth_request con 0x55e200e147f0 auth_method 0 2024-09-22T08:38:53.302 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-22T08:38:52.996+0000 7fec03f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:53.302 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-22T08:38:52.996+0000 7fec03f23800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.302 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-22T08:38:52.996+0000 7fec0040d640 10 monclient: get_auth_request con 0x55e200e17ef0 auth_method 0 2024-09-22T08:38:53.302 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-22T08:38:52.996+0000 7fec03f23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:38:53.302 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-22T08:38:52.996+0000 7fec03f23800 20 searching for the correct realm 2024-09-22T08:38:53.302 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-22T08:38:52.997+0000 7febffc0c640 10 monclient: get_auth_request con 0x55e200e1cc70 auth_method 0 2024-09-22T08:38:53.302 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-22T08:38:52.998+0000 7febff40b640 10 monclient: get_auth_request con 0x7febf4026030 auth_method 0 2024-09-22T08:38:53.302 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-22T08:38:52.999+0000 7febff40b640 0 -- 172.21.15.38:0/1606833508 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7febf4026030 msgr2=0x7febf40613f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:53.302 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-22T08:38:52.999+0000 7feadd7fa640 1 client.8202.objecter ms_handle_reset 0x7febf4026030 session 0x7febf4082040 osd.0 2024-09-22T08:38:53.302 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-22T08:38:52.999+0000 7feadd7fa640 10 monclient: _renew_subs 2024-09-22T08:38:53.302 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-22T08:38:52.999+0000 7feadd7fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:38:53.303 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-22T08:38:52.999+0000 7febff40b640 10 monclient: get_auth_request con 0x7feac8087010 auth_method 0 2024-09-22T08:38:53.303 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-22T08:38:53.000+0000 7fec0040d640 10 monclient: get_auth_request con 0x7febf007f040 auth_method 0 2024-09-22T08:38:53.303 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-22T08:38:53.002+0000 7febffc0c640 10 monclient: get_auth_request con 0x7febf40692f0 auth_method 0 2024-09-22T08:38:53.303 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-22T08:38:53.003+0000 7febff40b640 10 monclient: get_auth_request con 0x7febf0099910 auth_method 0 2024-09-22T08:38:53.303 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-22T08:38:53.003+0000 7febff40b640 0 -- 172.21.15.38:0/1606833508 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7febf0099910 msgr2=0x7febf008b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:53.303 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-22T08:38:53.205+0000 7febff40b640 10 monclient: get_auth_request con 0x7febf0099910 auth_method 0 2024-09-22T08:38:53.303 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-22T08:38:53.212+0000 7fec03f23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:53.303 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-22T08:38:53.212+0000 7fec03f23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:53.303 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-22T08:38:53.212+0000 7fec03f23800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:38:53.303 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-22T08:38:53.212+0000 7fec03f23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:53.303 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-22T08:38:53.212+0000 7fec03f23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:53.303 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-22T08:38:53.212+0000 7fec03f23800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:38:53.303 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-22T08:38:53.212+0000 7fec03f23800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.303 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-22T08:38:53.212+0000 7fec03f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:53.304 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-22T08:38:53.212+0000 7fec03f23800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.304 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-22T08:38:53.212+0000 7fec03f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:53.304 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-22T08:38:53.212+0000 7fec03f23800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.304 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-22T08:38:53.213+0000 7fec03f23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:38:53.304 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-22T08:38:53.213+0000 7fec03f23800 20 zone default found 2024-09-22T08:38:53.304 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-22T08:38:53.213+0000 7fec03f23800 4 Realm: () 2024-09-22T08:38:53.304 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-22T08:38:53.213+0000 7fec03f23800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:38:53.304 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-22T08:38:53.213+0000 7fec03f23800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:38:53.304 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-22T08:38:53.213+0000 7fec03f23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:53.304 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-22T08:38:53.213+0000 7fec03f23800 20 zonegroup default 2024-09-22T08:38:53.304 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-22T08:38:53.213+0000 7fec03f23800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.304 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-22T08:38:53.213+0000 7fec03f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:53.304 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-22T08:38:53.213+0000 7fec03f23800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.304 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-22T08:38:53.214+0000 7fec03f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:53.305 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-22T08:38:53.214+0000 7fec03f23800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.305 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-22T08:38:53.214+0000 7fec03f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:53.305 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-22T08:38:53.214+0000 7fec03f23800 20 started sync module instance, tier type = 2024-09-22T08:38:53.305 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-22T08:38:53.214+0000 7fec03f23800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:38:53.305 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-22T08:38:53.225+0000 7fec03f23800 20 add_watcher() i=0 2024-09-22T08:38:53.305 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-22T08:38:53.225+0000 7fec03f23800 20 add_watcher() i=1 2024-09-22T08:38:53.305 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-22T08:38:53.225+0000 7fec03f23800 20 add_watcher() i=2 2024-09-22T08:38:53.305 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-22T08:38:53.225+0000 7fec03f23800 20 add_watcher() i=3 2024-09-22T08:38:53.305 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-22T08:38:53.225+0000 7fec03f23800 20 add_watcher() i=4 2024-09-22T08:38:53.305 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-22T08:38:53.225+0000 7fec03f23800 20 add_watcher() i=5 2024-09-22T08:38:53.305 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-22T08:38:53.225+0000 7fec03f23800 20 add_watcher() i=6 2024-09-22T08:38:53.305 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-22T08:38:53.226+0000 7fec03f23800 20 add_watcher() i=7 2024-09-22T08:38:53.305 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-22T08:38:53.226+0000 7fec03f23800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:53.305 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-22T08:38:53.228+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb21a0) adding auth protocol: cephx 2024-09-22T08:38:53.305 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-22T08:38:53.228+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb21a0) adding auth protocol: cephx 2024-09-22T08:38:53.306 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-22T08:38:53.228+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb21a0) adding auth protocol: cephx 2024-09-22T08:38:53.306 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-22T08:38:53.228+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb21a0) adding con mode: secure 2024-09-22T08:38:53.306 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-22T08:38:53.228+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb21a0) adding con mode: crc 2024-09-22T08:38:53.306 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-22T08:38:53.228+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb21a0) adding con mode: secure 2024-09-22T08:38:53.306 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-22T08:38:53.228+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb21a0) adding con mode: crc 2024-09-22T08:38:53.306 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-22T08:38:53.228+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb21a0) adding con mode: secure 2024-09-22T08:38:53.306 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-22T08:38:53.228+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb21a0) adding con mode: crc 2024-09-22T08:38:53.306 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-22T08:38:53.228+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb21a0) adding con mode: crc 2024-09-22T08:38:53.306 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-22T08:38:53.228+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb21a0) adding con mode: secure 2024-09-22T08:38:53.306 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-22T08:38:53.228+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb21a0) adding con mode: crc 2024-09-22T08:38:53.306 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-22T08:38:53.228+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb21a0) adding con mode: secure 2024-09-22T08:38:53.306 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-22T08:38:53.228+0000 7feab5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:53.306 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-22T08:38:53.228+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb21a0) adding con mode: crc 2024-09-22T08:38:53.306 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-22T08:38:53.228+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb21a0) adding con mode: secure 2024-09-22T08:38:53.306 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-22T08:38:53.229+0000 7fec03f23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:53.307 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-22T08:38:53.229+0000 7fec03f23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:53.307 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-22T08:38:53.229+0000 7fec03f23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:53.307 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-22T08:38:53.229+0000 7fec03f23800 5 asok(0x55e200b010f0) register_command cache list hook 0x55e200deedd0 2024-09-22T08:38:53.307 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-22T08:38:53.229+0000 7fec03f23800 5 asok(0x55e200b010f0) register_command cache inspect hook 0x55e200deedd0 2024-09-22T08:38:53.307 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-22T08:38:53.229+0000 7fec03f23800 5 asok(0x55e200b010f0) register_command cache erase hook 0x55e200deedd0 2024-09-22T08:38:53.307 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-22T08:38:53.229+0000 7fec03f23800 5 asok(0x55e200b010f0) register_command cache zap hook 0x55e200deedd0 2024-09-22T08:38:53.307 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-22T08:38:53.229+0000 7fec03f23800 5 note: GC not initialized 2024-09-22T08:38:53.307 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-22T08:38:53.229+0000 7feab4fe1640 20 reqs_thread_entry: start 2024-09-22T08:38:53.307 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-22T08:38:53.229+0000 7fec03f23800 5 asok(0x55e200b010f0) register_command sync trace show hook 0x7febf8004e20 2024-09-22T08:38:53.307 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-22T08:38:53.229+0000 7fec03f23800 5 asok(0x55e200b010f0) register_command sync trace history hook 0x7febf8004e20 2024-09-22T08:38:53.307 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-22T08:38:53.229+0000 7fec03f23800 5 asok(0x55e200b010f0) register_command sync trace active hook 0x7febf8004e20 2024-09-22T08:38:53.307 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-22T08:38:53.229+0000 7fec03f23800 5 asok(0x55e200b010f0) register_command sync trace active_short hook 0x7febf8004e20 2024-09-22T08:38:53.307 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-22T08:38:53.229+0000 7fec03f23800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:53.307 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-22T08:38:53.229+0000 7fec03f23800 20 Filter name: none 2024-09-22T08:38:53.307 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-22T08:38:53.229+0000 7fea2e7fc640 20 reqs_thread_entry: start 2024-09-22T08:38:53.308 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-22T08:38:53.229+0000 7fec03f23800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:38:53.308 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-22T08:38:53.229+0000 7fec03f23800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.308 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-22T08:38:53.230+0000 7fec03f23800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:38:53.308 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-22T08:38:53.230+0000 7fec03f23800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:38:53.308 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-22T08:38:53.230+0000 7fec03f23800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:38:53.308 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-22T08:38:53.230+0000 7fec03f23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 : miss 2024-09-22T08:38:53.308 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-22T08:38:53.230+0000 7fec03f23800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.308 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-22T08:38:53.230+0000 7fec03f23800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T08:38:53.308 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-22T08:38:53.230+0000 7fec03f23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:38:53.308 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-22T08:38:53.230+0000 7fec03f23800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:38:53.308 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-22T08:38:53.230+0000 7fec03f23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:38:53.308 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-22T08:38:53.230+0000 7fec03f23800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:38:53.308 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-22T08:38:53.230+0000 7fec03f23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 2024-09-22T08:38:53.308 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-22T08:38:53.232+0000 7fec03f23800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-22T08:38:53.308 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-22T08:38:53.240+0000 7fec03f23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:38:53.309 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-22T08:38:53.240+0000 7fec03f23800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:38:53.309 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-22T08:38:53.240+0000 7fec03f23800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:38:53.309 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-22T08:38:53.240+0000 7fec03f23800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17, ofs0, ns] 2024-09-22T08:38:53.309 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-22T08:38:53.240+0000 7feade7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497037 cookie 94429165795104 notifier 8202 bl.length()=827 2024-09-22T08:38:53.309 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-22T08:38:53.240+0000 7feade7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:38:53.309 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-22T08:38:53.240+0000 7feade7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:38:53.309 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-22T08:38:53.240+0000 7feade7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:38:53.309 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-22T08:38:53.241+0000 7fec03f23800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_sources= new_sources= 2024-09-22T08:38:53.309 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-22T08:38:53.241+0000 7fec03f23800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential sources added=[] removed=[] 2024-09-22T08:38:53.309 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-22T08:38:53.241+0000 7fec03f23800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_dests= new_dests= 2024-09-22T08:38:53.309 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-22T08:38:53.241+0000 7fec03f23800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential dests added=[] removed=[] 2024-09-22T08:38:53.309 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-22T08:38:53.245+0000 7fec03f23800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fec03f23800 time 2024-09-22T08:38:53.245710+0000 2024-09-22T08:38:53.309 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:38:53.309 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:53.309 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:38:53.310 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fec0558c748] 2024-09-22T08:38:53.310 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fec0558c906] 2024-09-22T08:38:53.310 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e1ff996e01] 2024-09-22T08:38:53.310 INFO:tasks.workunit.client.0.smithi038.stderr: 4: radosgw-admin(+0xd8186c) [0x55e1ffea986c] 2024-09-22T08:38:53.310 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e1ff9a6c9d] 2024-09-22T08:38:53.310 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-22T08:38:53.310 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fec04229590] 2024-09-22T08:38:53.310 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-22T08:38:53.310 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-22T08:38:53.310 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:53.310 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-22T08:38:53.246+0000 7fec03f23800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:38:53.310 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7fec03f23800 thread_name:radosgw-admin 2024-09-22T08:38:53.310 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:53.310 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:38:53.311 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fec0423e6f0] 2024-09-22T08:38:53.311 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fec0428b99c] 2024-09-22T08:38:53.311 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:38:53.311 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:38:53.311 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fec0558c7a2] 2024-09-22T08:38:53.311 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fec0558c906] 2024-09-22T08:38:53.311 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e1ff996e01] 2024-09-22T08:38:53.311 INFO:tasks.workunit.client.0.smithi038.stderr: 8: radosgw-admin(+0xd8186c) [0x55e1ffea986c] 2024-09-22T08:38:53.311 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e1ff9a6c9d] 2024-09-22T08:38:53.311 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-22T08:38:53.311 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fec04229590] 2024-09-22T08:38:53.311 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-22T08:38:53.311 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-22T08:38:53.311 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:38:53.311 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:53.312 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-22T08:38:53.312 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-22T08:38:53.312 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-22T08:38:53.312 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-22T08:38:53.312 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-22T08:38:53.312 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-22T08:38:53.312 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-22T08:38:53.312 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-22T08:38:53.312 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-22T08:38:53.312 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-22T08:38:53.312 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-22T08:38:53.312 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-22T08:38:53.312 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-22T08:38:53.312 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-22T08:38:53.312 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-22T08:38:53.312 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-22T08:38:53.313 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-22T08:38:53.313 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-22T08:38:53.313 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-22T08:38:53.313 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-22T08:38:53.313 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-22T08:38:53.313 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-22T08:38:53.313 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-22T08:38:53.313 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-22T08:38:53.313 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:38:53.313 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-22T08:38:53.313 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-22T08:38:53.313 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-22T08:38:53.313 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-22T08:38:53.313 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-22T08:38:53.313 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-22T08:38:53.314 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-22T08:38:53.314 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-22T08:38:53.314 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-22T08:38:53.314 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-22T08:38:53.314 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-22T08:38:53.314 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-22T08:38:53.314 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-22T08:38:53.314 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-22T08:38:53.314 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-22T08:38:53.314 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-22T08:38:53.314 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-22T08:38:53.314 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-22T08:38:53.314 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-22T08:38:53.315 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-22T08:38:53.315 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-22T08:38:53.315 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:38:53.315 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-22T08:38:53.315 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:38:53.315 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-22T08:38:53.315 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-22T08:38:53.315 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-22T08:38:53.315 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-22T08:38:53.315 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-22T08:38:53.315 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-22T08:38:53.315 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-22T08:38:53.315 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-22T08:38:53.315 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-22T08:38:53.316 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-22T08:38:53.316 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-22T08:38:53.316 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-22T08:38:53.316 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-22T08:38:53.316 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-22T08:38:53.316 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-22T08:38:53.316 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-22T08:38:53.316 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-22T08:38:53.316 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-22T08:38:53.316 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:38:53.316 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-22T08:38:53.316 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:38:53.316 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-22T08:38:53.316 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-22T08:38:53.317 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-22T08:38:53.317 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-22T08:38:53.317 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-22T08:38:53.317 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-22T08:38:53.317 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:38:53.317 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-22T08:38:53.317 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-22T08:38:53.317 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:38:53.317 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-22T08:38:53.317 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-22T08:38:53.317 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-22T08:38:53.317 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-22T08:38:53.317 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-22T08:38:53.317 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-22T08:38:53.317 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-22T08:38:53.318 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-22T08:38:53.318 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-22T08:38:53.318 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-22T08:38:53.318 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-22T08:38:53.318 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-22T08:38:53.318 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-22T08:38:53.318 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:38:53.318 INFO:tasks.workunit.client.0.smithi038.stderr: 7fea2e7fc640 / http_manager 2024-09-22T08:38:53.318 INFO:tasks.workunit.client.0.smithi038.stderr: 7feab4fe1640 / http_manager 2024-09-22T08:38:53.318 INFO:tasks.workunit.client.0.smithi038.stderr: 7feab5fe3640 / rgw_dt_lg_renew 2024-09-22T08:38:53.318 INFO:tasks.workunit.client.0.smithi038.stderr: 7feadd7fa640 / ms_dispatch 2024-09-22T08:38:53.318 INFO:tasks.workunit.client.0.smithi038.stderr: 7feade7fc640 / io_context_pool 2024-09-22T08:38:53.318 INFO:tasks.workunit.client.0.smithi038.stderr: 7feadeffd640 / io_context_pool 2024-09-22T08:38:53.319 INFO:tasks.workunit.client.0.smithi038.stderr: 7feae57fa640 / ms_dispatch 2024-09-22T08:38:53.319 INFO:tasks.workunit.client.0.smithi038.stderr: 7feae7fff640 / ms_dispatch 2024-09-22T08:38:53.319 INFO:tasks.workunit.client.0.smithi038.stderr: 7feaede0b640 / io_context_pool 2024-09-22T08:38:53.319 INFO:tasks.workunit.client.0.smithi038.stderr: 7febff40b640 / msgr-worker-2 2024-09-22T08:38:53.319 INFO:tasks.workunit.client.0.smithi038.stderr: 7febffc0c640 / msgr-worker-1 2024-09-22T08:38:53.319 INFO:tasks.workunit.client.0.smithi038.stderr: 7fec0040d640 / msgr-worker-0 2024-09-22T08:38:53.319 INFO:tasks.workunit.client.0.smithi038.stderr: 7fec00c0e640 / io_context_pool 2024-09-22T08:38:53.319 INFO:tasks.workunit.client.0.smithi038.stderr: 7fec03f23800 / radosgw-admin 2024-09-22T08:38:53.319 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-22T08:38:53.319 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-22T08:38:53.319 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/log/ceph/ceph-client.admin.151055.log 2024-09-22T08:38:53.319 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-22T08:38:53.319 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-22T08:38:53.319 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-22T08:38:52.973+0000 7fec03f23800 10 monclient: shutdown 2024-09-22T08:38:53.320 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-22T08:38:52.973+0000 7fec03f23800 5 asok(0x55e200b010f0) unregister_commands rotate-key 2024-09-22T08:38:53.320 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-22T08:38:52.973+0000 7fec03f23800 10 monclient: build_initial_monmap 2024-09-22T08:38:53.320 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-22T08:38:52.973+0000 7fec03f23800 1 build_initial for_mkfs: 0 2024-09-22T08:38:53.320 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-22T08:38:52.973+0000 7fec03f23800 10 monclient: monmap: 2024-09-22T08:38:53.320 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:38:53.320 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:38:53.320 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:38:53.320 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:38:53.320 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:38:53.320 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:53.320 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:38:53.320 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:38:53.320 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:38:53.320 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:53.320 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-22T08:38:52.973+0000 7fec03f23800 5 AuthRegistry(0x55e200d28720) adding auth protocol: cephx 2024-09-22T08:38:53.321 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-22T08:38:52.973+0000 7fec03f23800 5 AuthRegistry(0x55e200d28720) adding auth protocol: cephx 2024-09-22T08:38:53.321 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-22T08:38:52.973+0000 7fec03f23800 5 AuthRegistry(0x55e200d28720) adding auth protocol: cephx 2024-09-22T08:38:53.321 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-22T08:38:52.973+0000 7fec03f23800 5 AuthRegistry(0x55e200d28720) adding con mode: secure 2024-09-22T08:38:53.321 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-22T08:38:52.973+0000 7fec03f23800 5 AuthRegistry(0x55e200d28720) adding con mode: crc 2024-09-22T08:38:53.321 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-22T08:38:52.973+0000 7fec03f23800 5 AuthRegistry(0x55e200d28720) adding con mode: secure 2024-09-22T08:38:53.321 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-22T08:38:52.973+0000 7fec03f23800 5 AuthRegistry(0x55e200d28720) adding con mode: crc 2024-09-22T08:38:53.321 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-22T08:38:52.973+0000 7fec03f23800 5 AuthRegistry(0x55e200d28720) adding con mode: secure 2024-09-22T08:38:53.321 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-22T08:38:52.973+0000 7fec03f23800 5 AuthRegistry(0x55e200d28720) adding con mode: crc 2024-09-22T08:38:53.321 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-22T08:38:52.973+0000 7fec03f23800 5 AuthRegistry(0x55e200d28720) adding con mode: crc 2024-09-22T08:38:53.321 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-22T08:38:52.973+0000 7fec03f23800 5 AuthRegistry(0x55e200d28720) adding con mode: secure 2024-09-22T08:38:53.321 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-22T08:38:52.973+0000 7fec03f23800 5 AuthRegistry(0x55e200d28720) adding con mode: crc 2024-09-22T08:38:53.321 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-22T08:38:52.973+0000 7fec03f23800 5 AuthRegistry(0x55e200d28720) adding con mode: secure 2024-09-22T08:38:53.321 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-22T08:38:52.973+0000 7fec03f23800 5 AuthRegistry(0x55e200d28720) adding con mode: crc 2024-09-22T08:38:53.321 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-22T08:38:52.973+0000 7fec03f23800 5 AuthRegistry(0x55e200d28720) adding con mode: secure 2024-09-22T08:38:53.322 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-22T08:38:52.973+0000 7fec03f23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:53.322 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-22T08:38:52.973+0000 7fec03f23800 1 librados: starting msgr at 2024-09-22T08:38:53.322 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-22T08:38:52.973+0000 7fec03f23800 1 librados: starting objecter 2024-09-22T08:38:53.322 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-22T08:38:52.973+0000 7fec03f23800 5 asok(0x55e200b010f0) register_command objecter_requests hook 0x55e200d28220 2024-09-22T08:38:53.322 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-22T08:38:52.974+0000 7fec03f23800 1 librados: setting wanted keys 2024-09-22T08:38:53.322 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-22T08:38:52.974+0000 7fec03f23800 1 librados: calling monclient init 2024-09-22T08:38:53.322 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-22T08:38:52.974+0000 7fec03f23800 10 monclient: init 2024-09-22T08:38:53.322 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-22T08:38:52.974+0000 7fec03f23800 5 AuthRegistry(0x55e200d22fe0) adding auth protocol: cephx 2024-09-22T08:38:53.322 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-22T08:38:52.974+0000 7fec03f23800 5 AuthRegistry(0x55e200d22fe0) adding auth protocol: cephx 2024-09-22T08:38:53.322 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-22T08:38:52.974+0000 7fec03f23800 5 AuthRegistry(0x55e200d22fe0) adding auth protocol: cephx 2024-09-22T08:38:53.322 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-22T08:38:52.974+0000 7fec03f23800 5 AuthRegistry(0x55e200d22fe0) adding con mode: secure 2024-09-22T08:38:53.322 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-22T08:38:52.974+0000 7fec03f23800 5 AuthRegistry(0x55e200d22fe0) adding con mode: crc 2024-09-22T08:38:53.322 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-22T08:38:52.974+0000 7fec03f23800 5 AuthRegistry(0x55e200d22fe0) adding con mode: secure 2024-09-22T08:38:53.322 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-22T08:38:52.974+0000 7fec03f23800 5 AuthRegistry(0x55e200d22fe0) adding con mode: crc 2024-09-22T08:38:53.322 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-22T08:38:52.974+0000 7fec03f23800 5 AuthRegistry(0x55e200d22fe0) adding con mode: secure 2024-09-22T08:38:53.323 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-22T08:38:52.974+0000 7fec03f23800 5 AuthRegistry(0x55e200d22fe0) adding con mode: crc 2024-09-22T08:38:53.323 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-22T08:38:52.974+0000 7fec03f23800 5 AuthRegistry(0x55e200d22fe0) adding con mode: crc 2024-09-22T08:38:53.323 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-22T08:38:52.974+0000 7fec03f23800 5 AuthRegistry(0x55e200d22fe0) adding con mode: secure 2024-09-22T08:38:53.323 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-22T08:38:52.974+0000 7fec03f23800 5 AuthRegistry(0x55e200d22fe0) adding con mode: crc 2024-09-22T08:38:53.323 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-22T08:38:52.974+0000 7fec03f23800 5 AuthRegistry(0x55e200d22fe0) adding con mode: secure 2024-09-22T08:38:53.323 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-22T08:38:52.974+0000 7fec03f23800 5 AuthRegistry(0x55e200d22fe0) adding con mode: crc 2024-09-22T08:38:53.323 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-22T08:38:52.974+0000 7fec03f23800 5 AuthRegistry(0x55e200d22fe0) adding con mode: secure 2024-09-22T08:38:53.323 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-22T08:38:52.974+0000 7fec03f23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:53.323 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-22T08:38:52.974+0000 7fec03f23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:53.323 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-22T08:38:52.974+0000 7fec03f23800 5 asok(0x55e200b010f0) register_command rotate-key hook 0x55e200d23128 2024-09-22T08:38:53.323 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-22T08:38:52.974+0000 7fec03f23800 10 monclient: _reopen_session rank -1 2024-09-22T08:38:53.323 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-22T08:38:52.974+0000 7fec03f23800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T08:38:53.323 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-22T08:38:52.974+0000 7fec03f23800 10 monclient(hunting): picked mon.noname-b con 0x55e200bcf620 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:38:53.323 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-22T08:38:52.974+0000 7fec03f23800 10 monclient(hunting): picked mon.noname-a con 0x55e200bd8520 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:38:53.324 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-22T08:38:52.974+0000 7fec03f23800 10 monclient(hunting): picked mon.noname-c con 0x55e200c69000 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:38:53.324 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-22T08:38:52.974+0000 7fec03f23800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:53.324 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-22T08:38:52.974+0000 7fec03f23800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:53.324 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-22T08:38:52.974+0000 7fec03f23800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:53.324 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-22T08:38:52.974+0000 7fec03f23800 10 monclient(hunting): _renew_subs 2024-09-22T08:38:53.324 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-22T08:38:52.974+0000 7fec03f23800 10 monclient(hunting): authenticate will time out at 2238.213620s 2024-09-22T08:38:53.324 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-22T08:38:52.974+0000 7fec0040d640 10 monclient(hunting): get_auth_request con 0x55e200c69000 auth_method 0 2024-09-22T08:38:53.324 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-22T08:38:52.974+0000 7fec0040d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:53.324 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-22T08:38:52.974+0000 7fec0040d640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:53.324 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-22T08:38:52.974+0000 7fec0040d640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:53.324 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-22T08:38:52.974+0000 7febff40b640 10 monclient(hunting): get_auth_request con 0x55e200bd8520 auth_method 0 2024-09-22T08:38:53.324 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-22T08:38:52.974+0000 7febff40b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:53.324 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-22T08:38:52.974+0000 7febff40b640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:53.324 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-22T08:38:52.974+0000 7febff40b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:53.325 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-22T08:38:52.974+0000 7febffc0c640 10 monclient(hunting): get_auth_request con 0x55e200bcf620 auth_method 0 2024-09-22T08:38:53.325 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-22T08:38:52.974+0000 7febffc0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:53.325 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-22T08:38:52.974+0000 7febffc0c640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:53.325 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-22T08:38:52.974+0000 7febffc0c640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:53.325 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-22T08:38:52.974+0000 7febff40b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:53.325 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-22T08:38:52.974+0000 7febff40b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:53.325 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-22T08:38:52.974+0000 7febff40b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:53.325 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-22T08:38:52.974+0000 7fec0040d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:53.325 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-22T08:38:52.974+0000 7fec0040d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:53.325 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-22T08:38:52.974+0000 7fec0040d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:53.325 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-22T08:38:52.974+0000 7febffc0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:53.325 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-22T08:38:52.974+0000 7febffc0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:53.325 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-22T08:38:52.974+0000 7febffc0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:53.325 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-22T08:38:52.975+0000 7febff40b640 10 monclient(hunting): handle_auth_done global_id 8193 payload 824 2024-09-22T08:38:53.326 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-22T08:38:52.975+0000 7febff40b640 10 monclient: _finish_hunting 0 2024-09-22T08:38:53.326 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-22T08:38:52.975+0000 7febff40b640 1 monclient: found mon.noname-a 2024-09-22T08:38:53.326 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-22T08:38:52.975+0000 7febff40b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:38:53.326 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-22T08:38:52.975+0000 7feae7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:53.326 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-22T08:38:52.975+0000 7feae7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:38:53.326 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-22T08:38:52.975+0000 7feae7fff640 10 monclient: dump: 2024-09-22T08:38:53.326 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:38:53.326 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:38:53.326 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:53.326 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:53.326 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:53.326 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:53.326 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:38:53.327 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:38:53.327 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:38:53.327 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:53.327 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-22T08:38:52.975+0000 7feae7fff640 10 monclient: _finish_auth 0 2024-09-22T08:38:53.327 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-22T08:38:52.975+0000 7feae7fff640 10 monclient: _check_auth_tickets 2024-09-22T08:38:53.327 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-22T08:38:52.975+0000 7fec03f23800 5 monclient: authenticate success, global_id 8193 2024-09-22T08:38:53.327 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-22T08:38:52.975+0000 7fec03f23800 10 monclient: _renew_subs 2024-09-22T08:38:53.327 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-22T08:38:52.975+0000 7fec03f23800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:38:53.327 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-22T08:38:52.975+0000 7feae7fff640 10 monclient: handle_config config(0 keys) 2024-09-22T08:38:53.327 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-22T08:38:52.975+0000 7feae7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:53.327 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-22T08:38:52.975+0000 7feae7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:38:53.327 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-22T08:38:52.975+0000 7feae7fff640 10 monclient: dump: 2024-09-22T08:38:53.327 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:38:53.327 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:38:53.328 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:53.328 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:53.328 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:53.328 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:53.328 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:38:53.328 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:38:53.328 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:38:53.328 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:53.328 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-22T08:38:52.975+0000 7feaede0b640 4 set_mon_vals no callback set 2024-09-22T08:38:53.328 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-22T08:38:52.975+0000 7fec03f23800 10 monclient: _renew_subs 2024-09-22T08:38:53.328 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-22T08:38:52.975+0000 7fec03f23800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:38:53.328 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-22T08:38:52.975+0000 7fec03f23800 1 librados: init done 2024-09-22T08:38:53.328 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-22T08:38:52.977+0000 7feae7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:38:53.328 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-22T08:38:52.977+0000 7feae7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:38:53.328 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-22T08:38:52.977+0000 7feae7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:38:53.329 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-22T08:38:52.977+0000 7febffc0c640 10 monclient: get_auth_request con 0x7feae8077570 auth_method 0 2024-09-22T08:38:53.329 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-22T08:38:52.978+0000 7fec0040d640 10 monclient: get_auth_request con 0x55e200d4b8d0 auth_method 0 2024-09-22T08:38:53.329 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-22T08:38:52.979+0000 7febffc0c640 10 monclient: get_auth_request con 0x55e200d6e400 auth_method 0 2024-09-22T08:38:53.329 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-22T08:38:52.980+0000 7febff40b640 10 monclient: get_auth_request con 0x55e200d72760 auth_method 0 2024-09-22T08:38:53.329 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-22T08:38:52.981+0000 7fec0040d640 10 monclient: get_auth_request con 0x55e200d71cb0 auth_method 0 2024-09-22T08:38:53.329 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-22T08:38:52.982+0000 7fec03f23800 10 monclient: build_initial_monmap 2024-09-22T08:38:53.329 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-22T08:38:52.982+0000 7fec03f23800 1 build_initial for_mkfs: 0 2024-09-22T08:38:53.329 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-22T08:38:52.982+0000 7fec03f23800 10 monclient: monmap: 2024-09-22T08:38:53.329 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:38:53.329 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:38:53.329 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:38:53.329 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:38:53.329 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:38:53.329 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:53.330 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:38:53.330 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:38:53.330 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:38:53.330 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:53.330 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d7a830) adding auth protocol: cephx 2024-09-22T08:38:53.330 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d7a830) adding auth protocol: cephx 2024-09-22T08:38:53.330 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d7a830) adding auth protocol: cephx 2024-09-22T08:38:53.330 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d7a830) adding con mode: secure 2024-09-22T08:38:53.330 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d7a830) adding con mode: crc 2024-09-22T08:38:53.330 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d7a830) adding con mode: secure 2024-09-22T08:38:53.330 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d7a830) adding con mode: crc 2024-09-22T08:38:53.330 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d7a830) adding con mode: secure 2024-09-22T08:38:53.330 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d7a830) adding con mode: crc 2024-09-22T08:38:53.330 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d7a830) adding con mode: crc 2024-09-22T08:38:53.330 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d7a830) adding con mode: secure 2024-09-22T08:38:53.331 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d7a830) adding con mode: crc 2024-09-22T08:38:53.331 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d7a830) adding con mode: secure 2024-09-22T08:38:53.331 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d7a830) adding con mode: crc 2024-09-22T08:38:53.331 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d7a830) adding con mode: secure 2024-09-22T08:38:53.331 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-22T08:38:52.982+0000 7fec03f23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:53.331 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 asok(0x55e200b010f0) register_command objecter_requests cmddesc objecter_requests hook 0x55e200d7e220 EEXIST 2024-09-22T08:38:53.331 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-22T08:38:52.982+0000 7fec03f23800 10 monclient: init 2024-09-22T08:38:53.331 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d79778) adding auth protocol: cephx 2024-09-22T08:38:53.331 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d79778) adding auth protocol: cephx 2024-09-22T08:38:53.331 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d79778) adding auth protocol: cephx 2024-09-22T08:38:53.331 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d79778) adding con mode: secure 2024-09-22T08:38:53.331 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d79778) adding con mode: crc 2024-09-22T08:38:53.331 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d79778) adding con mode: secure 2024-09-22T08:38:53.332 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d79778) adding con mode: crc 2024-09-22T08:38:53.332 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d79778) adding con mode: secure 2024-09-22T08:38:53.332 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d79778) adding con mode: crc 2024-09-22T08:38:53.332 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d79778) adding con mode: crc 2024-09-22T08:38:53.332 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d79778) adding con mode: secure 2024-09-22T08:38:53.332 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d79778) adding con mode: crc 2024-09-22T08:38:53.332 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d79778) adding con mode: secure 2024-09-22T08:38:53.332 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d79778) adding con mode: crc 2024-09-22T08:38:53.332 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-22T08:38:52.982+0000 7fec03f23800 5 AuthRegistry(0x55e200d79778) adding con mode: secure 2024-09-22T08:38:53.332 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-22T08:38:52.983+0000 7fec03f23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:53.332 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-22T08:38:52.983+0000 7fec03f23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:53.332 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-22T08:38:52.983+0000 7fec03f23800 5 asok(0x55e200b010f0) register_command rotate-key cmddesc rotate-key hook 0x55e200d798c0 EEXIST 2024-09-22T08:38:53.332 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-22T08:38:52.983+0000 7fec03f23800 10 monclient: _reopen_session rank -1 2024-09-22T08:38:53.332 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-22T08:38:52.983+0000 7fec03f23800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-22T08:38:53.332 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-22T08:38:52.983+0000 7fec03f23800 10 monclient(hunting): picked mon.noname-b con 0x55e200da1f10 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:38:53.332 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-22T08:38:52.983+0000 7fec03f23800 10 monclient(hunting): picked mon.noname-c con 0x55e200da41e0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:38:53.333 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-22T08:38:52.983+0000 7fec03f23800 10 monclient(hunting): picked mon.noname-a con 0x55e200da06e0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:38:53.333 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-22T08:38:52.983+0000 7fec03f23800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:53.333 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-22T08:38:52.983+0000 7fec03f23800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:53.333 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-22T08:38:52.983+0000 7fec03f23800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:53.333 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-22T08:38:52.983+0000 7fec03f23800 10 monclient(hunting): _renew_subs 2024-09-22T08:38:53.333 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-22T08:38:52.983+0000 7fec03f23800 10 monclient(hunting): authenticate will time out at 2238.222443s 2024-09-22T08:38:53.333 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-22T08:38:52.983+0000 7fec0040d640 10 monclient(hunting): get_auth_request con 0x55e200da41e0 auth_method 0 2024-09-22T08:38:53.333 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-22T08:38:52.983+0000 7fec0040d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:53.333 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-22T08:38:52.983+0000 7fec0040d640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:53.333 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-22T08:38:52.983+0000 7fec0040d640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:53.333 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-22T08:38:52.983+0000 7febffc0c640 10 monclient(hunting): get_auth_request con 0x55e200da06e0 auth_method 0 2024-09-22T08:38:53.333 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-22T08:38:52.983+0000 7febffc0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:53.334 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-22T08:38:52.983+0000 7febffc0c640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:53.334 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-22T08:38:52.983+0000 7febffc0c640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:53.334 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-22T08:38:52.983+0000 7febff40b640 10 monclient(hunting): get_auth_request con 0x55e200da1f10 auth_method 0 2024-09-22T08:38:53.334 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-22T08:38:52.983+0000 7febff40b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:53.334 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-22T08:38:52.983+0000 7febff40b640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:53.334 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-22T08:38:52.983+0000 7febff40b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:53.334 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-22T08:38:52.983+0000 7fec0040d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:53.334 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-22T08:38:52.983+0000 7fec0040d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:53.334 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-22T08:38:52.983+0000 7fec0040d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:53.334 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-22T08:38:52.983+0000 7febffc0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:53.334 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-22T08:38:52.983+0000 7febffc0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:53.334 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-22T08:38:52.983+0000 7febffc0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:53.335 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-22T08:38:52.983+0000 7febff40b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:53.335 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-22T08:38:52.983+0000 7febff40b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:53.335 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-22T08:38:52.983+0000 7febff40b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:53.335 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-22T08:38:52.983+0000 7fec0040d640 10 monclient(hunting): handle_auth_done global_id 7709 payload 824 2024-09-22T08:38:53.335 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-22T08:38:52.983+0000 7fec0040d640 10 monclient: _finish_hunting 0 2024-09-22T08:38:53.335 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-22T08:38:52.983+0000 7fec0040d640 1 monclient: found mon.noname-c 2024-09-22T08:38:53.335 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-22T08:38:52.983+0000 7fec0040d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-22T08:38:53.335 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-22T08:38:52.984+0000 7feae57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:53.335 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-22T08:38:52.984+0000 7feae57fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:38:53.335 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-22T08:38:52.984+0000 7feae57fa640 10 monclient: dump: 2024-09-22T08:38:53.335 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:38:53.335 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:38:53.335 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:53.336 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:53.336 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:53.336 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:53.336 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:38:53.336 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:38:53.336 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:38:53.336 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:53.336 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-22T08:38:52.984+0000 7feae57fa640 10 monclient: _finish_auth 0 2024-09-22T08:38:53.336 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-22T08:38:52.984+0000 7feae57fa640 10 monclient: _check_auth_tickets 2024-09-22T08:38:53.336 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-22T08:38:52.984+0000 7feae57fa640 10 monclient: handle_config config(0 keys) 2024-09-22T08:38:53.336 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-22T08:38:52.984+0000 7feae57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:53.336 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-22T08:38:52.984+0000 7feae57fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:38:53.336 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-22T08:38:52.984+0000 7feae57fa640 10 monclient: dump: 2024-09-22T08:38:53.336 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:38:53.337 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:38:53.337 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:53.337 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:53.337 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:53.337 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:53.337 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:38:53.337 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:38:53.337 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:38:53.337 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:53.337 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-22T08:38:52.984+0000 7fec03f23800 5 monclient: authenticate success, global_id 7709 2024-09-22T08:38:53.337 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-22T08:38:52.984+0000 7fec03f23800 10 monclient: _renew_subs 2024-09-22T08:38:53.337 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-22T08:38:52.984+0000 7fec03f23800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:38:53.337 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-22T08:38:52.984+0000 7fec00c0e640 4 set_mon_vals no callback set 2024-09-22T08:38:53.337 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-22T08:38:52.984+0000 7fec03f23800 10 monclient: _renew_subs 2024-09-22T08:38:53.337 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-22T08:38:52.984+0000 7fec03f23800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-22T08:38:53.338 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-22T08:38:52.986+0000 7feae57fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:38:53.338 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-22T08:38:52.986+0000 7feae57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:38:53.338 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-22T08:38:52.986+0000 7feae57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:38:53.338 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-22T08:38:52.986+0000 7febff40b640 10 monclient: get_auth_request con 0x7fead8077480 auth_method 0 2024-09-22T08:38:53.338 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-22T08:38:52.987+0000 7fec03f23800 10 monclient: get_monmap_and_config 2024-09-22T08:38:53.338 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-22T08:38:52.987+0000 7fec03f23800 10 monclient: build_initial_monmap 2024-09-22T08:38:53.338 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-22T08:38:52.987+0000 7fec03f23800 1 build_initial for_mkfs: 0 2024-09-22T08:38:53.338 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-22T08:38:52.987+0000 7fec03f23800 10 monclient: monmap: 2024-09-22T08:38:53.338 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:38:53.338 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:38:53.338 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:38:53.338 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:38:53.338 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:38:53.339 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:53.339 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:38:53.339 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:38:53.339 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:38:53.339 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:53.339 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x55e200dc1dc0) adding auth protocol: cephx 2024-09-22T08:38:53.339 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x55e200dc1dc0) adding auth protocol: cephx 2024-09-22T08:38:53.339 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x55e200dc1dc0) adding auth protocol: cephx 2024-09-22T08:38:53.339 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x55e200dc1dc0) adding con mode: secure 2024-09-22T08:38:53.339 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x55e200dc1dc0) adding con mode: crc 2024-09-22T08:38:53.339 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x55e200dc1dc0) adding con mode: secure 2024-09-22T08:38:53.339 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x55e200dc1dc0) adding con mode: crc 2024-09-22T08:38:53.339 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x55e200dc1dc0) adding con mode: secure 2024-09-22T08:38:53.339 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x55e200dc1dc0) adding con mode: crc 2024-09-22T08:38:53.340 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x55e200dc1dc0) adding con mode: crc 2024-09-22T08:38:53.340 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x55e200dc1dc0) adding con mode: secure 2024-09-22T08:38:53.340 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x55e200dc1dc0) adding con mode: crc 2024-09-22T08:38:53.340 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x55e200dc1dc0) adding con mode: secure 2024-09-22T08:38:53.340 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x55e200dc1dc0) adding con mode: crc 2024-09-22T08:38:53.340 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x55e200dc1dc0) adding con mode: secure 2024-09-22T08:38:53.340 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-22T08:38:52.987+0000 7fec03f23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:53.340 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-22T08:38:52.987+0000 7fec03f23800 10 monclient: init 2024-09-22T08:38:53.340 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb1cd0) adding auth protocol: cephx 2024-09-22T08:38:53.340 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb1cd0) adding auth protocol: cephx 2024-09-22T08:38:53.340 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb1cd0) adding auth protocol: cephx 2024-09-22T08:38:53.340 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb1cd0) adding con mode: secure 2024-09-22T08:38:53.340 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb1cd0) adding con mode: crc 2024-09-22T08:38:53.340 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb1cd0) adding con mode: secure 2024-09-22T08:38:53.340 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb1cd0) adding con mode: crc 2024-09-22T08:38:53.340 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb1cd0) adding con mode: secure 2024-09-22T08:38:53.341 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb1cd0) adding con mode: crc 2024-09-22T08:38:53.341 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb1cd0) adding con mode: crc 2024-09-22T08:38:53.341 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb1cd0) adding con mode: secure 2024-09-22T08:38:53.341 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb1cd0) adding con mode: crc 2024-09-22T08:38:53.341 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb1cd0) adding con mode: secure 2024-09-22T08:38:53.341 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb1cd0) adding con mode: crc 2024-09-22T08:38:53.341 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-22T08:38:52.987+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb1cd0) adding con mode: secure 2024-09-22T08:38:53.341 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-22T08:38:52.987+0000 7fec03f23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:53.341 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-22T08:38:52.987+0000 7fec03f23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:53.341 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-22T08:38:52.988+0000 7fec03f23800 5 asok(0x55e200b010f0) register_command rotate-key cmddesc rotate-key hook 0x7ffe20fb1e18 EEXIST 2024-09-22T08:38:53.341 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-22T08:38:52.988+0000 7fec03f23800 10 monclient: _reopen_session rank -1 2024-09-22T08:38:53.341 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-22T08:38:52.988+0000 7fec03f23800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T08:38:53.341 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-22T08:38:52.988+0000 7fec03f23800 10 monclient(hunting): picked mon.noname-a con 0x55e200df6460 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:38:53.341 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-22T08:38:52.988+0000 7fec03f23800 10 monclient(hunting): picked mon.noname-c con 0x55e200dc73b0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:38:53.341 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-22T08:38:52.988+0000 7fec03f23800 10 monclient(hunting): picked mon.noname-b con 0x55e200df1d00 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:38:53.341 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-22T08:38:52.988+0000 7fec03f23800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:53.342 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-22T08:38:52.988+0000 7fec03f23800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:53.342 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-22T08:38:52.988+0000 7fec03f23800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:53.342 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-22T08:38:52.988+0000 7fec03f23800 10 monclient(hunting): _renew_subs 2024-09-22T08:38:53.342 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-22T08:38:52.988+0000 7fec03f23800 10 monclient(hunting): authenticate will time out at 2238.227092s 2024-09-22T08:38:53.342 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-22T08:38:52.988+0000 7febff40b640 10 monclient(hunting): get_auth_request con 0x55e200df6460 auth_method 0 2024-09-22T08:38:53.342 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-22T08:38:52.988+0000 7febff40b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:53.342 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-22T08:38:52.988+0000 7febff40b640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:53.342 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-22T08:38:52.988+0000 7febff40b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:53.342 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-22T08:38:52.988+0000 7fec0040d640 10 monclient(hunting): get_auth_request con 0x55e200dc73b0 auth_method 0 2024-09-22T08:38:53.342 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-22T08:38:52.988+0000 7fec0040d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:53.342 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-22T08:38:52.988+0000 7fec0040d640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:53.342 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-22T08:38:52.988+0000 7fec0040d640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:53.342 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-22T08:38:52.988+0000 7febff40b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:53.342 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-22T08:38:52.988+0000 7febff40b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:53.342 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-22T08:38:52.988+0000 7febff40b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:53.343 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-22T08:38:52.988+0000 7febffc0c640 10 monclient(hunting): get_auth_request con 0x55e200df1d00 auth_method 0 2024-09-22T08:38:53.343 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-22T08:38:52.988+0000 7febffc0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:53.343 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-22T08:38:52.988+0000 7febffc0c640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:53.343 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-22T08:38:52.988+0000 7febffc0c640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:53.343 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-22T08:38:52.988+0000 7fec0040d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:53.343 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-22T08:38:52.988+0000 7fec0040d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:53.343 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-22T08:38:52.988+0000 7fec0040d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:53.343 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-22T08:38:52.988+0000 7febffc0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:53.343 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-22T08:38:52.988+0000 7febffc0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:53.343 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-22T08:38:52.988+0000 7febffc0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:53.343 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-22T08:38:52.988+0000 7febff40b640 10 monclient(hunting): handle_auth_done global_id 8199 payload 274 2024-09-22T08:38:53.343 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-22T08:38:52.988+0000 7febff40b640 10 monclient: _finish_hunting 0 2024-09-22T08:38:53.343 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-22T08:38:52.988+0000 7febff40b640 1 monclient: found mon.noname-a 2024-09-22T08:38:53.343 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-22T08:38:52.988+0000 7febff40b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:38:53.343 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-22T08:38:52.988+0000 7feadeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:53.344 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-22T08:38:52.988+0000 7feadeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:38:53.344 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-22T08:38:52.988+0000 7feadeffd640 10 monclient: dump: 2024-09-22T08:38:53.344 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:38:53.344 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:38:53.344 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:53.344 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:53.344 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:53.344 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:53.344 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:38:53.344 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:38:53.344 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:38:53.344 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:53.345 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-22T08:38:52.988+0000 7feadeffd640 10 monclient: _finish_auth 0 2024-09-22T08:38:53.345 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-22T08:38:52.988+0000 7feadeffd640 10 monclient: _check_auth_tickets 2024-09-22T08:38:53.345 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-22T08:38:52.988+0000 7feadeffd640 10 monclient: handle_config config(0 keys) 2024-09-22T08:38:53.345 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-22T08:38:52.988+0000 7fec03f23800 5 monclient: authenticate success, global_id 8199 2024-09-22T08:38:53.345 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-22T08:38:52.988+0000 7fec03f23800 10 monclient: get_monmap_and_config success 2024-09-22T08:38:53.345 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-22T08:38:52.988+0000 7fec03f23800 4 set_mon_vals no callback set 2024-09-22T08:38:53.345 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-22T08:38:52.988+0000 7feadeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:53.345 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-22T08:38:52.988+0000 7feadeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:38:53.345 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-22T08:38:52.988+0000 7feadeffd640 10 monclient: dump: 2024-09-22T08:38:53.345 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:38:53.345 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:38:53.345 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:53.345 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:53.345 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:53.345 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:53.346 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:38:53.346 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:38:53.346 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:38:53.346 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:53.346 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-22T08:38:52.989+0000 7fec03f23800 10 monclient: shutdown 2024-09-22T08:38:53.346 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-22T08:38:52.989+0000 7fec03f23800 10 monclient: build_initial_monmap 2024-09-22T08:38:53.346 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-22T08:38:52.989+0000 7fec03f23800 1 build_initial for_mkfs: 0 2024-09-22T08:38:53.346 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-22T08:38:52.989+0000 7fec03f23800 10 monclient: monmap: 2024-09-22T08:38:53.346 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:38:53.346 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:38:53.346 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:38:53.346 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:38:53.346 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:38:53.347 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:53.347 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:38:53.347 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:38:53.347 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:38:53.347 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:53.347 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-22T08:38:52.989+0000 7fec03f23800 5 AuthRegistry(0x55e200de8030) adding auth protocol: cephx 2024-09-22T08:38:53.347 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-22T08:38:52.989+0000 7fec03f23800 5 AuthRegistry(0x55e200de8030) adding auth protocol: cephx 2024-09-22T08:38:53.347 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-22T08:38:52.989+0000 7fec03f23800 5 AuthRegistry(0x55e200de8030) adding auth protocol: cephx 2024-09-22T08:38:53.347 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-22T08:38:52.989+0000 7fec03f23800 5 AuthRegistry(0x55e200de8030) adding con mode: secure 2024-09-22T08:38:53.347 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-22T08:38:52.989+0000 7fec03f23800 5 AuthRegistry(0x55e200de8030) adding con mode: crc 2024-09-22T08:38:53.347 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-22T08:38:52.989+0000 7fec03f23800 5 AuthRegistry(0x55e200de8030) adding con mode: secure 2024-09-22T08:38:53.347 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-22T08:38:52.989+0000 7fec03f23800 5 AuthRegistry(0x55e200de8030) adding con mode: crc 2024-09-22T08:38:53.347 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-22T08:38:52.989+0000 7fec03f23800 5 AuthRegistry(0x55e200de8030) adding con mode: secure 2024-09-22T08:38:53.347 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-22T08:38:52.989+0000 7fec03f23800 5 AuthRegistry(0x55e200de8030) adding con mode: crc 2024-09-22T08:38:53.347 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-22T08:38:52.989+0000 7fec03f23800 5 AuthRegistry(0x55e200de8030) adding con mode: crc 2024-09-22T08:38:53.348 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-22T08:38:52.989+0000 7fec03f23800 5 AuthRegistry(0x55e200de8030) adding con mode: secure 2024-09-22T08:38:53.348 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-22T08:38:52.989+0000 7fec03f23800 5 AuthRegistry(0x55e200de8030) adding con mode: crc 2024-09-22T08:38:53.348 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-22T08:38:52.989+0000 7fec03f23800 5 AuthRegistry(0x55e200de8030) adding con mode: secure 2024-09-22T08:38:53.348 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-22T08:38:52.989+0000 7fec03f23800 5 AuthRegistry(0x55e200de8030) adding con mode: crc 2024-09-22T08:38:53.348 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-22T08:38:52.989+0000 7fec03f23800 5 AuthRegistry(0x55e200de8030) adding con mode: secure 2024-09-22T08:38:53.348 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-22T08:38:52.989+0000 7fec03f23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:53.348 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-22T08:38:52.989+0000 7fec03f23800 1 librados: starting msgr at 2024-09-22T08:38:53.348 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-22T08:38:52.989+0000 7fec03f23800 1 librados: starting objecter 2024-09-22T08:38:53.348 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-22T08:38:52.989+0000 7fec03f23800 5 asok(0x55e200b010f0) register_command objecter_requests cmddesc objecter_requests hook 0x55e200dc5300 EEXIST 2024-09-22T08:38:53.348 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-22T08:38:52.990+0000 7fec03f23800 1 librados: setting wanted keys 2024-09-22T08:38:53.348 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-22T08:38:52.990+0000 7fec03f23800 1 librados: calling monclient init 2024-09-22T08:38:53.348 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-22T08:38:52.990+0000 7fec03f23800 10 monclient: init 2024-09-22T08:38:53.348 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-22T08:38:52.990+0000 7fec03f23800 5 AuthRegistry(0x55e200db9cc0) adding auth protocol: cephx 2024-09-22T08:38:53.348 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-22T08:38:52.990+0000 7fec03f23800 5 AuthRegistry(0x55e200db9cc0) adding auth protocol: cephx 2024-09-22T08:38:53.348 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-22T08:38:52.990+0000 7fec03f23800 5 AuthRegistry(0x55e200db9cc0) adding auth protocol: cephx 2024-09-22T08:38:53.348 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-22T08:38:52.990+0000 7fec03f23800 5 AuthRegistry(0x55e200db9cc0) adding con mode: secure 2024-09-22T08:38:53.349 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-22T08:38:52.990+0000 7fec03f23800 5 AuthRegistry(0x55e200db9cc0) adding con mode: crc 2024-09-22T08:38:53.349 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-22T08:38:52.990+0000 7fec03f23800 5 AuthRegistry(0x55e200db9cc0) adding con mode: secure 2024-09-22T08:38:53.349 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-22T08:38:52.990+0000 7fec03f23800 5 AuthRegistry(0x55e200db9cc0) adding con mode: crc 2024-09-22T08:38:53.349 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-22T08:38:52.990+0000 7fec03f23800 5 AuthRegistry(0x55e200db9cc0) adding con mode: secure 2024-09-22T08:38:53.349 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-22T08:38:52.990+0000 7fec03f23800 5 AuthRegistry(0x55e200db9cc0) adding con mode: crc 2024-09-22T08:38:53.349 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-22T08:38:52.990+0000 7fec03f23800 5 AuthRegistry(0x55e200db9cc0) adding con mode: crc 2024-09-22T08:38:53.349 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-22T08:38:52.990+0000 7fec03f23800 5 AuthRegistry(0x55e200db9cc0) adding con mode: secure 2024-09-22T08:38:53.349 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-22T08:38:52.990+0000 7fec03f23800 5 AuthRegistry(0x55e200db9cc0) adding con mode: crc 2024-09-22T08:38:53.349 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-22T08:38:52.990+0000 7fec03f23800 5 AuthRegistry(0x55e200db9cc0) adding con mode: secure 2024-09-22T08:38:53.349 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-22T08:38:52.990+0000 7fec03f23800 5 AuthRegistry(0x55e200db9cc0) adding con mode: crc 2024-09-22T08:38:53.349 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-22T08:38:52.990+0000 7fec03f23800 5 AuthRegistry(0x55e200db9cc0) adding con mode: secure 2024-09-22T08:38:53.349 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-22T08:38:52.990+0000 7fec03f23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:53.349 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-22T08:38:52.990+0000 7fec03f23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:53.349 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-22T08:38:52.990+0000 7fec03f23800 5 asok(0x55e200b010f0) register_command rotate-key cmddesc rotate-key hook 0x55e200db9e08 EEXIST 2024-09-22T08:38:53.349 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-22T08:38:52.990+0000 7fec03f23800 10 monclient: _reopen_session rank -1 2024-09-22T08:38:53.349 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-22T08:38:52.990+0000 7fec03f23800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T08:38:53.350 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-22T08:38:52.990+0000 7fec03f23800 10 monclient(hunting): picked mon.noname-b con 0x55e200dc73b0 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:38:53.350 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-22T08:38:52.990+0000 7fec03f23800 10 monclient(hunting): picked mon.noname-a con 0x55e200df1d00 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:38:53.350 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-22T08:38:52.990+0000 7fec03f23800 10 monclient(hunting): picked mon.noname-c con 0x55e200df6460 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:38:53.350 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-22T08:38:52.990+0000 7fec03f23800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:53.350 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-22T08:38:52.990+0000 7fec03f23800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:53.350 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-22T08:38:52.990+0000 7fec03f23800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:53.350 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-22T08:38:52.990+0000 7fec03f23800 10 monclient(hunting): _renew_subs 2024-09-22T08:38:53.350 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-22T08:38:52.990+0000 7fec03f23800 10 monclient(hunting): authenticate will time out at 2238.229667s 2024-09-22T08:38:53.350 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-22T08:38:52.990+0000 7fec0040d640 10 monclient(hunting): get_auth_request con 0x55e200df1d00 auth_method 0 2024-09-22T08:38:53.350 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-22T08:38:52.990+0000 7fec0040d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:53.350 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-22T08:38:52.990+0000 7fec0040d640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:53.350 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-22T08:38:52.990+0000 7fec0040d640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:53.350 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-22T08:38:52.990+0000 7febffc0c640 10 monclient(hunting): get_auth_request con 0x55e200df6460 auth_method 0 2024-09-22T08:38:53.350 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-22T08:38:52.990+0000 7febffc0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:53.350 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-22T08:38:52.990+0000 7febffc0c640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:53.351 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-22T08:38:52.990+0000 7febffc0c640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:53.351 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-22T08:38:52.990+0000 7fec0040d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:53.351 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-22T08:38:52.990+0000 7fec0040d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:53.351 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-22T08:38:52.990+0000 7fec0040d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:53.351 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-22T08:38:52.990+0000 7febffc0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:53.351 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-22T08:38:52.990+0000 7febffc0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:53.351 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-22T08:38:52.990+0000 7febffc0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:53.351 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-22T08:38:52.990+0000 7fec0040d640 10 monclient(hunting): handle_auth_done global_id 8202 payload 824 2024-09-22T08:38:53.351 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-22T08:38:52.991+0000 7fec0040d640 10 monclient: _finish_hunting 0 2024-09-22T08:38:53.351 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-22T08:38:52.991+0000 7fec0040d640 1 monclient: found mon.noname-a 2024-09-22T08:38:53.351 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-22T08:38:52.991+0000 7fec0040d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:38:53.351 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-22T08:38:52.991+0000 7febff40b640 10 monclient: get_auth_request con 0x55e200dc73b0 auth_method 0 2024-09-22T08:38:53.351 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-22T08:38:52.991+0000 7feadd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:53.351 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-22T08:38:52.991+0000 7feadd7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:38:53.351 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-22T08:38:52.991+0000 7feadd7fa640 10 monclient: dump: 2024-09-22T08:38:53.351 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:38:53.352 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:38:53.352 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:53.352 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:53.352 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:53.352 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:53.352 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:38:53.352 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:38:53.352 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:38:53.352 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:53.352 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-22T08:38:52.991+0000 7feadd7fa640 10 monclient: _finish_auth 0 2024-09-22T08:38:53.352 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-22T08:38:52.991+0000 7feadd7fa640 10 monclient: _check_auth_tickets 2024-09-22T08:38:53.352 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-22T08:38:52.991+0000 7fec03f23800 5 monclient: authenticate success, global_id 8202 2024-09-22T08:38:53.352 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-22T08:38:52.991+0000 7fec03f23800 10 monclient: _renew_subs 2024-09-22T08:38:53.352 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-22T08:38:52.991+0000 7fec03f23800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:38:53.353 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-22T08:38:52.991+0000 7feadd7fa640 10 monclient: handle_config config(0 keys) 2024-09-22T08:38:53.353 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-22T08:38:52.991+0000 7feadd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:53.353 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-22T08:38:52.991+0000 7feadd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:38:53.353 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-22T08:38:52.991+0000 7feadd7fa640 10 monclient: dump: 2024-09-22T08:38:53.353 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:38:53.353 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:38:53.353 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:53.353 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:38:53.353 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:53.353 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:38:53.353 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:38:53.354 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:38:53.354 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:38:53.354 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:53.354 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-22T08:38:52.991+0000 7feadeffd640 4 set_mon_vals no callback set 2024-09-22T08:38:53.354 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-22T08:38:52.991+0000 7fec03f23800 10 monclient: _renew_subs 2024-09-22T08:38:53.354 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-22T08:38:52.991+0000 7fec03f23800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:38:53.354 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-22T08:38:52.991+0000 7fec03f23800 1 librados: init done 2024-09-22T08:38:53.354 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-22T08:38:52.991+0000 7fec03f23800 5 asok(0x55e200b010f0) register_command cr dump hook 0x55e200de4018 2024-09-22T08:38:53.354 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-22T08:38:52.993+0000 7fec03f23800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.354 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-22T08:38:52.993+0000 7feadd7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:38:53.354 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-22T08:38:52.993+0000 7feadd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:38:53.354 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-22T08:38:52.993+0000 7feadd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:38:53.354 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-22T08:38:52.993+0000 7febff40b640 10 monclient: get_auth_request con 0x7feac8077570 auth_method 0 2024-09-22T08:38:53.355 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-22T08:38:52.994+0000 7febffc0c640 10 monclient: get_auth_request con 0x55e200e103f0 auth_method 0 2024-09-22T08:38:53.355 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-22T08:38:52.994+0000 7fec03f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:53.355 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-22T08:38:52.994+0000 7fec03f23800 20 realm 2024-09-22T08:38:53.355 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-22T08:38:52.994+0000 7fec03f23800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.355 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-22T08:38:52.995+0000 7fec03f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:53.355 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-22T08:38:52.995+0000 7fec03f23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:53.355 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-22T08:38:52.995+0000 7fec03f23800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.355 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-22T08:38:52.995+0000 7fec03f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:53.355 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-22T08:38:52.995+0000 7fec03f23800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.355 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-22T08:38:52.995+0000 7febff40b640 10 monclient: get_auth_request con 0x55e200e147f0 auth_method 0 2024-09-22T08:38:53.355 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-22T08:38:52.996+0000 7fec03f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:53.355 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-22T08:38:52.996+0000 7fec03f23800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.355 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-22T08:38:52.996+0000 7fec0040d640 10 monclient: get_auth_request con 0x55e200e17ef0 auth_method 0 2024-09-22T08:38:53.355 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-22T08:38:52.996+0000 7fec03f23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:38:53.356 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-22T08:38:52.996+0000 7fec03f23800 20 searching for the correct realm 2024-09-22T08:38:53.356 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-22T08:38:52.997+0000 7febffc0c640 10 monclient: get_auth_request con 0x55e200e1cc70 auth_method 0 2024-09-22T08:38:53.356 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-22T08:38:52.998+0000 7febff40b640 10 monclient: get_auth_request con 0x7febf4026030 auth_method 0 2024-09-22T08:38:53.356 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-22T08:38:52.999+0000 7febff40b640 0 -- 172.21.15.38:0/1606833508 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7febf4026030 msgr2=0x7febf40613f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:53.356 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-22T08:38:52.999+0000 7feadd7fa640 1 client.8202.objecter ms_handle_reset 0x7febf4026030 session 0x7febf4082040 osd.0 2024-09-22T08:38:53.356 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-22T08:38:52.999+0000 7feadd7fa640 10 monclient: _renew_subs 2024-09-22T08:38:53.356 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-22T08:38:52.999+0000 7feadd7fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:38:53.356 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-22T08:38:52.999+0000 7febff40b640 10 monclient: get_auth_request con 0x7feac8087010 auth_method 0 2024-09-22T08:38:53.356 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-22T08:38:53.000+0000 7fec0040d640 10 monclient: get_auth_request con 0x7febf007f040 auth_method 0 2024-09-22T08:38:53.356 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-22T08:38:53.002+0000 7febffc0c640 10 monclient: get_auth_request con 0x7febf40692f0 auth_method 0 2024-09-22T08:38:53.356 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-22T08:38:53.003+0000 7febff40b640 10 monclient: get_auth_request con 0x7febf0099910 auth_method 0 2024-09-22T08:38:53.356 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-22T08:38:53.003+0000 7febff40b640 0 -- 172.21.15.38:0/1606833508 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7febf0099910 msgr2=0x7febf008b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:53.356 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-22T08:38:53.205+0000 7febff40b640 10 monclient: get_auth_request con 0x7febf0099910 auth_method 0 2024-09-22T08:38:53.356 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-22T08:38:53.212+0000 7fec03f23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:53.356 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-22T08:38:53.212+0000 7fec03f23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:53.356 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-22T08:38:53.212+0000 7fec03f23800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:38:53.357 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-22T08:38:53.212+0000 7fec03f23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:53.357 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-22T08:38:53.212+0000 7fec03f23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:53.357 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-22T08:38:53.212+0000 7fec03f23800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:38:53.357 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-22T08:38:53.212+0000 7fec03f23800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.357 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-22T08:38:53.212+0000 7fec03f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:53.357 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-22T08:38:53.212+0000 7fec03f23800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.357 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-22T08:38:53.212+0000 7fec03f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:53.357 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-22T08:38:53.212+0000 7fec03f23800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.357 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-22T08:38:53.213+0000 7fec03f23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:38:53.357 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-22T08:38:53.213+0000 7fec03f23800 20 zone default found 2024-09-22T08:38:53.357 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-22T08:38:53.213+0000 7fec03f23800 4 Realm: () 2024-09-22T08:38:53.357 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-22T08:38:53.213+0000 7fec03f23800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:38:53.357 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-22T08:38:53.213+0000 7fec03f23800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:38:53.357 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-22T08:38:53.213+0000 7fec03f23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:53.358 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-22T08:38:53.213+0000 7fec03f23800 20 zonegroup default 2024-09-22T08:38:53.358 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-22T08:38:53.213+0000 7fec03f23800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.358 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-22T08:38:53.213+0000 7fec03f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:53.358 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-22T08:38:53.213+0000 7fec03f23800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.358 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-22T08:38:53.214+0000 7fec03f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:53.358 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-22T08:38:53.214+0000 7fec03f23800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.358 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-22T08:38:53.214+0000 7fec03f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:53.358 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-22T08:38:53.214+0000 7fec03f23800 20 started sync module instance, tier type = 2024-09-22T08:38:53.358 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-22T08:38:53.214+0000 7fec03f23800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:38:53.358 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-22T08:38:53.225+0000 7fec03f23800 20 add_watcher() i=0 2024-09-22T08:38:53.358 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-22T08:38:53.225+0000 7fec03f23800 20 add_watcher() i=1 2024-09-22T08:38:53.358 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-22T08:38:53.225+0000 7fec03f23800 20 add_watcher() i=2 2024-09-22T08:38:53.358 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-22T08:38:53.225+0000 7fec03f23800 20 add_watcher() i=3 2024-09-22T08:38:53.358 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-22T08:38:53.225+0000 7fec03f23800 20 add_watcher() i=4 2024-09-22T08:38:53.358 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-22T08:38:53.225+0000 7fec03f23800 20 add_watcher() i=5 2024-09-22T08:38:53.359 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-22T08:38:53.225+0000 7fec03f23800 20 add_watcher() i=6 2024-09-22T08:38:53.359 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-22T08:38:53.226+0000 7fec03f23800 20 add_watcher() i=7 2024-09-22T08:38:53.359 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-22T08:38:53.226+0000 7fec03f23800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:53.359 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-22T08:38:53.228+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb21a0) adding auth protocol: cephx 2024-09-22T08:38:53.359 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-22T08:38:53.228+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb21a0) adding auth protocol: cephx 2024-09-22T08:38:53.359 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-22T08:38:53.228+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb21a0) adding auth protocol: cephx 2024-09-22T08:38:53.359 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-22T08:38:53.228+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb21a0) adding con mode: secure 2024-09-22T08:38:53.359 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-22T08:38:53.228+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb21a0) adding con mode: crc 2024-09-22T08:38:53.359 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-22T08:38:53.228+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb21a0) adding con mode: secure 2024-09-22T08:38:53.359 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-22T08:38:53.228+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb21a0) adding con mode: crc 2024-09-22T08:38:53.359 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-22T08:38:53.228+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb21a0) adding con mode: secure 2024-09-22T08:38:53.359 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-22T08:38:53.228+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb21a0) adding con mode: crc 2024-09-22T08:38:53.359 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-22T08:38:53.228+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb21a0) adding con mode: crc 2024-09-22T08:38:53.359 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-22T08:38:53.228+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb21a0) adding con mode: secure 2024-09-22T08:38:53.359 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-22T08:38:53.228+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb21a0) adding con mode: crc 2024-09-22T08:38:53.360 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-22T08:38:53.228+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb21a0) adding con mode: secure 2024-09-22T08:38:53.360 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-22T08:38:53.228+0000 7feab5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:53.360 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-22T08:38:53.228+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb21a0) adding con mode: crc 2024-09-22T08:38:53.360 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-22T08:38:53.228+0000 7fec03f23800 5 AuthRegistry(0x7ffe20fb21a0) adding con mode: secure 2024-09-22T08:38:53.360 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-22T08:38:53.229+0000 7fec03f23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:53.360 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-22T08:38:53.229+0000 7fec03f23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:53.360 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-22T08:38:53.229+0000 7fec03f23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:53.360 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-22T08:38:53.229+0000 7fec03f23800 5 asok(0x55e200b010f0) register_command cache list hook 0x55e200deedd0 2024-09-22T08:38:53.360 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-22T08:38:53.229+0000 7fec03f23800 5 asok(0x55e200b010f0) register_command cache inspect hook 0x55e200deedd0 2024-09-22T08:38:53.360 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-22T08:38:53.229+0000 7fec03f23800 5 asok(0x55e200b010f0) register_command cache erase hook 0x55e200deedd0 2024-09-22T08:38:53.360 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-22T08:38:53.229+0000 7fec03f23800 5 asok(0x55e200b010f0) register_command cache zap hook 0x55e200deedd0 2024-09-22T08:38:53.360 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-22T08:38:53.229+0000 7fec03f23800 5 note: GC not initialized 2024-09-22T08:38:53.360 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-22T08:38:53.229+0000 7feab4fe1640 20 reqs_thread_entry: start 2024-09-22T08:38:53.360 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-22T08:38:53.229+0000 7fec03f23800 5 asok(0x55e200b010f0) register_command sync trace show hook 0x7febf8004e20 2024-09-22T08:38:53.360 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-22T08:38:53.229+0000 7fec03f23800 5 asok(0x55e200b010f0) register_command sync trace history hook 0x7febf8004e20 2024-09-22T08:38:53.361 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-22T08:38:53.229+0000 7fec03f23800 5 asok(0x55e200b010f0) register_command sync trace active hook 0x7febf8004e20 2024-09-22T08:38:53.361 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-22T08:38:53.229+0000 7fec03f23800 5 asok(0x55e200b010f0) register_command sync trace active_short hook 0x7febf8004e20 2024-09-22T08:38:53.361 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-22T08:38:53.229+0000 7fec03f23800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:53.361 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-22T08:38:53.229+0000 7fec03f23800 20 Filter name: none 2024-09-22T08:38:53.361 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-22T08:38:53.229+0000 7fea2e7fc640 20 reqs_thread_entry: start 2024-09-22T08:38:53.361 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-22T08:38:53.229+0000 7fec03f23800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:38:53.361 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-22T08:38:53.229+0000 7fec03f23800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.361 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-22T08:38:53.230+0000 7fec03f23800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:38:53.361 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-22T08:38:53.230+0000 7fec03f23800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:38:53.361 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-22T08:38:53.230+0000 7fec03f23800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:38:53.361 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-22T08:38:53.230+0000 7fec03f23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 : miss 2024-09-22T08:38:53.361 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-22T08:38:53.230+0000 7fec03f23800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.361 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-22T08:38:53.230+0000 7fec03f23800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T08:38:53.361 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-22T08:38:53.230+0000 7fec03f23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:38:53.362 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-22T08:38:53.230+0000 7fec03f23800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:38:53.362 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-22T08:38:53.230+0000 7fec03f23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:38:53.362 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-22T08:38:53.230+0000 7fec03f23800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:38:53.362 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-22T08:38:53.230+0000 7fec03f23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 2024-09-22T08:38:53.362 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-22T08:38:53.232+0000 7fec03f23800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-22T08:38:53.362 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-22T08:38:53.240+0000 7fec03f23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:38:53.362 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-22T08:38:53.240+0000 7fec03f23800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:38:53.362 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-22T08:38:53.240+0000 7fec03f23800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:38:53.362 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-22T08:38:53.240+0000 7fec03f23800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17, ofs0, ns] 2024-09-22T08:38:53.362 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-22T08:38:53.240+0000 7feade7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497037 cookie 94429165795104 notifier 8202 bl.length()=827 2024-09-22T08:38:53.362 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-22T08:38:53.240+0000 7feade7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:38:53.362 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-22T08:38:53.240+0000 7feade7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:38:53.362 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-22T08:38:53.240+0000 7feade7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:38:53.362 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-22T08:38:53.241+0000 7fec03f23800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_sources= new_sources= 2024-09-22T08:38:53.363 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-22T08:38:53.241+0000 7fec03f23800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential sources added=[] removed=[] 2024-09-22T08:38:53.363 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-22T08:38:53.241+0000 7fec03f23800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_dests= new_dests= 2024-09-22T08:38:53.363 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-22T08:38:53.241+0000 7fec03f23800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential dests added=[] removed=[] 2024-09-22T08:38:53.363 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-22T08:38:53.245+0000 7fec03f23800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fec03f23800 time 2024-09-22T08:38:53.245710+0000 2024-09-22T08:38:53.363 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:38:53.363 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:53.363 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:38:53.363 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fec0558c748] 2024-09-22T08:38:53.363 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fec0558c906] 2024-09-22T08:38:53.363 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e1ff996e01] 2024-09-22T08:38:53.363 INFO:tasks.workunit.client.0.smithi038.stderr: 4: radosgw-admin(+0xd8186c) [0x55e1ffea986c] 2024-09-22T08:38:53.363 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e1ff9a6c9d] 2024-09-22T08:38:53.363 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-22T08:38:53.363 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fec04229590] 2024-09-22T08:38:53.363 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-22T08:38:53.364 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-22T08:38:53.364 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:53.364 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-22T08:38:53.246+0000 7fec03f23800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:38:53.364 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7fec03f23800 thread_name:radosgw-admin 2024-09-22T08:38:53.364 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:53.364 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:38:53.364 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fec0423e6f0] 2024-09-22T08:38:53.364 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fec0428b99c] 2024-09-22T08:38:53.364 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:38:53.364 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:38:53.364 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fec0558c7a2] 2024-09-22T08:38:53.364 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fec0558c906] 2024-09-22T08:38:53.364 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e1ff996e01] 2024-09-22T08:38:53.364 INFO:tasks.workunit.client.0.smithi038.stderr: 8: radosgw-admin(+0xd8186c) [0x55e1ffea986c] 2024-09-22T08:38:53.365 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e1ff9a6c9d] 2024-09-22T08:38:53.365 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-22T08:38:53.365 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fec04229590] 2024-09-22T08:38:53.365 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-22T08:38:53.365 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-22T08:38:53.365 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:38:53.365 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:38:53.365 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-22T08:38:53.365 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-22T08:38:53.365 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-22T08:38:53.365 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-22T08:38:53.365 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-22T08:38:53.365 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-22T08:38:53.365 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-22T08:38:53.366 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-22T08:38:53.366 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-22T08:38:53.366 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-22T08:38:53.366 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-22T08:38:53.366 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-22T08:38:53.366 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-22T08:38:53.366 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-22T08:38:53.366 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-22T08:38:53.366 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-22T08:38:53.366 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-22T08:38:53.366 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-22T08:38:53.366 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-22T08:38:53.366 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-22T08:38:53.367 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-22T08:38:53.367 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-22T08:38:53.367 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-22T08:38:53.367 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-22T08:38:53.367 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:38:53.367 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-22T08:38:53.367 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-22T08:38:53.367 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-22T08:38:53.367 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-22T08:38:53.367 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-22T08:38:53.367 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-22T08:38:53.367 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-22T08:38:53.367 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-22T08:38:53.367 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-22T08:38:53.367 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-22T08:38:53.368 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-22T08:38:53.368 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-22T08:38:53.368 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-22T08:38:53.368 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-22T08:38:53.368 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-22T08:38:53.368 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-22T08:38:53.368 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-22T08:38:53.368 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-22T08:38:53.368 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-22T08:38:53.368 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-22T08:38:53.368 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-22T08:38:53.368 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:38:53.368 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-22T08:38:53.368 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:38:53.369 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-22T08:38:53.369 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-22T08:38:53.369 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-22T08:38:53.369 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-22T08:38:53.369 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-22T08:38:53.369 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-22T08:38:53.369 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-22T08:38:53.369 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-22T08:38:53.369 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-22T08:38:53.369 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-22T08:38:53.369 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-22T08:38:53.369 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-22T08:38:53.369 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-22T08:38:53.369 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-22T08:38:53.369 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-22T08:38:53.370 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-22T08:38:53.370 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-22T08:38:53.370 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-22T08:38:53.370 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:38:53.370 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-22T08:38:53.370 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:38:53.370 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-22T08:38:53.370 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-22T08:38:53.370 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-22T08:38:53.370 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-22T08:38:53.370 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-22T08:38:53.370 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-22T08:38:53.370 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:38:53.370 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-22T08:38:53.370 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-22T08:38:53.370 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:38:53.371 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-22T08:38:53.371 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-22T08:38:53.371 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-22T08:38:53.371 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-22T08:38:53.371 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-22T08:38:53.371 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-22T08:38:53.371 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-22T08:38:53.371 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-22T08:38:53.371 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-22T08:38:53.371 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-22T08:38:53.371 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-22T08:38:53.371 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-22T08:38:53.371 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-22T08:38:53.371 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:38:53.371 INFO:tasks.workunit.client.0.smithi038.stderr: 7fea2e7fc640 / http_manager 2024-09-22T08:38:53.372 INFO:tasks.workunit.client.0.smithi038.stderr: 7feab4fe1640 / http_manager 2024-09-22T08:38:53.372 INFO:tasks.workunit.client.0.smithi038.stderr: 7feab5fe3640 / rgw_dt_lg_renew 2024-09-22T08:38:53.372 INFO:tasks.workunit.client.0.smithi038.stderr: 7feadd7fa640 / ms_dispatch 2024-09-22T08:38:53.372 INFO:tasks.workunit.client.0.smithi038.stderr: 7feade7fc640 / io_context_pool 2024-09-22T08:38:53.372 INFO:tasks.workunit.client.0.smithi038.stderr: 7feadeffd640 / io_context_pool 2024-09-22T08:38:53.372 INFO:tasks.workunit.client.0.smithi038.stderr: 7feae57fa640 / ms_dispatch 2024-09-22T08:38:53.372 INFO:tasks.workunit.client.0.smithi038.stderr: 7feae7fff640 / ms_dispatch 2024-09-22T08:38:53.372 INFO:tasks.workunit.client.0.smithi038.stderr: 7feaede0b640 / io_context_pool 2024-09-22T08:38:53.372 INFO:tasks.workunit.client.0.smithi038.stderr: 7febff40b640 / msgr-worker-2 2024-09-22T08:38:53.372 INFO:tasks.workunit.client.0.smithi038.stderr: 7febffc0c640 / msgr-worker-1 2024-09-22T08:38:53.372 INFO:tasks.workunit.client.0.smithi038.stderr: 7fec0040d640 / msgr-worker-0 2024-09-22T08:38:53.372 INFO:tasks.workunit.client.0.smithi038.stderr: 7fec00c0e640 / io_context_pool 2024-09-22T08:38:53.372 INFO:tasks.workunit.client.0.smithi038.stderr: 7fec03f23800 / radosgw-admin 2024-09-22T08:38:53.372 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-22T08:38:53.372 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-22T08:38:53.373 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/lib/ceph/crash/2024-09-22T08:38:53.247449Z_4ddfbf91-8726-41f3-953a-198fe94980ef/log 2024-09-22T08:38:53.373 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-22T08:38:53.373 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-22T08:38:53.374 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:53.374 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:53.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.332+0000 7f5f79d2e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.334+0000 7f5f79d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:53.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.334+0000 7f5f79d2e800 20 realm 2024-09-22T08:38:53.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.334+0000 7f5f79d2e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.334+0000 7f5f79d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:53.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.334+0000 7f5f79d2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:53.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.334+0000 7f5f79d2e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.334+0000 7f5f79d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:53.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.334+0000 7f5f79d2e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.335+0000 7f5f79d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:53.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.335+0000 7f5f79d2e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.336+0000 7f5f79d2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:38:53.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.336+0000 7f5f79d2e800 20 searching for the correct realm 2024-09-22T08:38:53.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.338+0000 7f5f75964640 0 -- 172.21.15.38:0/2755114640 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x563fba75a4e0 msgr2=0x563fba75c9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:53.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.342+0000 7f5f75163640 0 -- 172.21.15.38:0/2755114640 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f5f6804e130 msgr2=0x7f5f68099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:53.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.550+0000 7f5f79d2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:53.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.550+0000 7f5f79d2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:53.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.550+0000 7f5f79d2e800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:38:53.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.550+0000 7f5f79d2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:53.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.550+0000 7f5f79d2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:53.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.550+0000 7f5f79d2e800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:38:53.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.550+0000 7f5f79d2e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.550+0000 7f5f79d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:53.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.550+0000 7f5f79d2e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.550+0000 7f5f79d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:53.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.550+0000 7f5f79d2e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.551+0000 7f5f79d2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:38:53.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.551+0000 7f5f79d2e800 20 zone default found 2024-09-22T08:38:53.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.551+0000 7f5f79d2e800 4 Realm: () 2024-09-22T08:38:53.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.551+0000 7f5f79d2e800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:38:53.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.551+0000 7f5f79d2e800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:38:53.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.551+0000 7f5f79d2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:53.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.551+0000 7f5f79d2e800 20 zonegroup default 2024-09-22T08:38:53.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.551+0000 7f5f79d2e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.551+0000 7f5f79d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:53.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.551+0000 7f5f79d2e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.552+0000 7f5f79d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:53.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.552+0000 7f5f79d2e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.552+0000 7f5f79d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:53.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.552+0000 7f5f79d2e800 20 started sync module instance, tier type = 2024-09-22T08:38:53.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.552+0000 7f5f79d2e800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:38:53.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.562+0000 7f5f79d2e800 20 add_watcher() i=0 2024-09-22T08:38:53.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.562+0000 7f5f79d2e800 20 add_watcher() i=1 2024-09-22T08:38:53.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.562+0000 7f5f79d2e800 20 add_watcher() i=2 2024-09-22T08:38:53.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.562+0000 7f5f79d2e800 20 add_watcher() i=3 2024-09-22T08:38:53.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.562+0000 7f5f79d2e800 20 add_watcher() i=4 2024-09-22T08:38:53.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.562+0000 7f5f79d2e800 20 add_watcher() i=5 2024-09-22T08:38:53.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.562+0000 7f5f79d2e800 20 add_watcher() i=6 2024-09-22T08:38:53.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.564+0000 7f5f79d2e800 20 add_watcher() i=7 2024-09-22T08:38:53.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.564+0000 7f5f79d2e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:53.567 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.566+0000 7f5e277fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:53.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.566+0000 7f5f79d2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:53.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.566+0000 7f5f79d2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:53.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.566+0000 7f5f79d2e800 5 note: GC not initialized 2024-09-22T08:38:53.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.567+0000 7f5e267fc640 20 reqs_thread_entry: start 2024-09-22T08:38:53.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.567+0000 7f5f79d2e800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:53.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.567+0000 7f5f79d2e800 20 Filter name: none 2024-09-22T08:38:53.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.567+0000 7f5d97fff640 20 reqs_thread_entry: start 2024-09-22T08:38:53.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.567+0000 7f5f79d2e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:38:53.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.567+0000 7f5f79d2e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.567+0000 7f5f79d2e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:38:53.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.567+0000 7f5f79d2e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:38:53.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.567+0000 7f5f79d2e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:38:53.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.567+0000 7f5f79d2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 : miss 2024-09-22T08:38:53.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.567+0000 7f5f79d2e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:53.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.568+0000 7f5f79d2e800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T08:38:53.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.568+0000 7f5f79d2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:38:53.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.568+0000 7f5f79d2e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:38:53.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.568+0000 7f5f79d2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:38:53.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.568+0000 7f5f79d2e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:38:53.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.568+0000 7f5f79d2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 2024-09-22T08:38:53.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.568+0000 7f5f79d2e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.0 2024-09-22T08:38:53.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.568+0000 7f5f79d2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.0 2024-09-22T08:38:53.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.569+0000 7f5f79d2e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.1 2024-09-22T08:38:53.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.569+0000 7f5f79d2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.1 2024-09-22T08:38:53.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.569+0000 7f5f79d2e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.2 2024-09-22T08:38:53.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.569+0000 7f5f79d2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.2 2024-09-22T08:38:53.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.569+0000 7f5f79d2e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.3 2024-09-22T08:38:53.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.569+0000 7f5f79d2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.3 2024-09-22T08:38:53.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.570+0000 7f5f79d2e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.4 2024-09-22T08:38:53.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.570+0000 7f5f79d2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.4 2024-09-22T08:38:53.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.570+0000 7f5f79d2e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.5 2024-09-22T08:38:53.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.570+0000 7f5f79d2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.5 2024-09-22T08:38:53.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.571+0000 7f5f79d2e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.6 2024-09-22T08:38:53.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.571+0000 7f5f79d2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.6 2024-09-22T08:38:53.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.571+0000 7f5f79d2e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.7 2024-09-22T08:38:53.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.571+0000 7f5f79d2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.7 2024-09-22T08:38:53.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.572+0000 7f5f79d2e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.8 2024-09-22T08:38:53.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.572+0000 7f5f79d2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.8 2024-09-22T08:38:53.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.572+0000 7f5f79d2e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.9 2024-09-22T08:38:53.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.572+0000 7f5f79d2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.9 2024-09-22T08:38:53.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.572+0000 7f5f79d2e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.10 2024-09-22T08:38:53.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.572+0000 7f5f79d2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.10 2024-09-22T08:38:53.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.573+0000 7f5f79d2e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.11 2024-09-22T08:38:53.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.573+0000 7f5f79d2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.11 2024-09-22T08:38:53.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.573+0000 7f5f79d2e800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.12 2024-09-22T08:38:53.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.573+0000 7f5f79d2e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.12 2024-09-22T08:38:53.576 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.575+0000 7f5e277fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:53.578 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.577+0000 7f5f79d2e800 20 remove_watcher() i=0 2024-09-22T08:38:53.578 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.577+0000 7f5f79d2e800 2 removed watcher, disabling cache 2024-09-22T08:38:53.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.578+0000 7f5f79d2e800 20 remove_watcher() i=1 2024-09-22T08:38:53.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.579+0000 7f5f79d2e800 20 remove_watcher() i=2 2024-09-22T08:38:53.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.580+0000 7f5f79d2e800 20 remove_watcher() i=3 2024-09-22T08:38:53.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.582+0000 7f5f79d2e800 20 remove_watcher() i=4 2024-09-22T08:38:53.584 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.583+0000 7f5f79d2e800 20 remove_watcher() i=5 2024-09-22T08:38:53.585 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.584+0000 7f5f79d2e800 20 remove_watcher() i=6 2024-09-22T08:38:53.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:38:53.585+0000 7f5f79d2e800 20 remove_watcher() i=7 2024-09-22T08:38:53.597 INFO:tasks.workunit.client.0.smithi038.stderr: test: duplicated entries can be purged manually 2024-09-22T08:39:23.625 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T08:39:23.658 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:23.658 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:23.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.703+0000 7fd8cd72a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:23.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.706+0000 7fd8cd72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:23.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.706+0000 7fd8cd72a800 20 realm 2024-09-22T08:39:23.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.706+0000 7fd8cd72a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:23.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.706+0000 7fd8cd72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:23.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.706+0000 7fd8cd72a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:23.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.706+0000 7fd8cd72a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:23.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.706+0000 7fd8cd72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:23.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.706+0000 7fd8cd72a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:23.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.707+0000 7fd8cd72a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:23.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.707+0000 7fd8cd72a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:23.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.708+0000 7fd8cd72a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:23.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.708+0000 7fd8cd72a800 20 searching for the correct realm 2024-09-22T08:39:23.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.711+0000 7fd8c8b60640 0 -- 172.21.15.38:0/2612758710 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7fd8c0021bb0 msgr2=0x7fd8c0066be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:23.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.715+0000 7fd8c8b60640 0 -- 172.21.15.38:0/2612758710 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fd8bc06d070 msgr2=0x7fd8bc0a3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:39:23.925 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.923+0000 7fd8cd72a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:23.925 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.923+0000 7fd8cd72a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:23.925 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.923+0000 7fd8cd72a800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:39:23.925 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.923+0000 7fd8cd72a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:23.925 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.923+0000 7fd8cd72a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:23.925 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.923+0000 7fd8cd72a800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:39:23.925 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.923+0000 7fd8cd72a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:23.925 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.924+0000 7fd8cd72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:23.925 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.924+0000 7fd8cd72a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:23.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.924+0000 7fd8cd72a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:23.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.924+0000 7fd8cd72a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:23.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.924+0000 7fd8cd72a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:23.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.924+0000 7fd8cd72a800 20 zone default found 2024-09-22T08:39:23.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.924+0000 7fd8cd72a800 4 Realm: () 2024-09-22T08:39:23.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.924+0000 7fd8cd72a800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:39:23.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.924+0000 7fd8cd72a800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:39:23.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.924+0000 7fd8cd72a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:23.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.924+0000 7fd8cd72a800 20 zonegroup default 2024-09-22T08:39:23.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.924+0000 7fd8cd72a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:23.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.925+0000 7fd8cd72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:23.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.925+0000 7fd8cd72a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:23.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.926+0000 7fd8cd72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:23.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.926+0000 7fd8cd72a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:23.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.926+0000 7fd8cd72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:23.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.926+0000 7fd8cd72a800 20 started sync module instance, tier type = 2024-09-22T08:39:23.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.926+0000 7fd8cd72a800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:39:23.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.938+0000 7fd8cd72a800 20 add_watcher() i=0 2024-09-22T08:39:23.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.938+0000 7fd8cd72a800 20 add_watcher() i=1 2024-09-22T08:39:23.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.938+0000 7fd8cd72a800 20 add_watcher() i=2 2024-09-22T08:39:23.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.938+0000 7fd8cd72a800 20 add_watcher() i=3 2024-09-22T08:39:23.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.938+0000 7fd8cd72a800 20 add_watcher() i=4 2024-09-22T08:39:23.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.938+0000 7fd8cd72a800 20 add_watcher() i=5 2024-09-22T08:39:23.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.938+0000 7fd8cd72a800 20 add_watcher() i=6 2024-09-22T08:39:23.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.939+0000 7fd8cd72a800 20 add_watcher() i=7 2024-09-22T08:39:23.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.939+0000 7fd8cd72a800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:23.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.941+0000 7fd77ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:23.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.942+0000 7fd8cd72a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:23.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.942+0000 7fd8cd72a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:23.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.942+0000 7fd8cd72a800 5 note: GC not initialized 2024-09-22T08:39:23.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.942+0000 7fd77efe5640 20 reqs_thread_entry: start 2024-09-22T08:39:23.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.942+0000 7fd8cd72a800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:23.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.942+0000 7fd8cd72a800 20 Filter name: none 2024-09-22T08:39:23.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.943+0000 7fd77cfe1640 20 reqs_thread_entry: start 2024-09-22T08:39:23.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.943+0000 7fd8cd72a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:23.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.943+0000 7fd8cd72a800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:39:23.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.943+0000 7fd8cd72a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:23.945 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.943+0000 7fd8cd72a800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T08:39:23.945 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.944+0000 7fd8cd72a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:23.945 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.944+0000 7fd8cd72a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:23.945 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.944+0000 7fd8cd72a800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:39:23.945 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.944+0000 7fd8cd72a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:23.945 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.944+0000 7fd8cd72a800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T08:39:23.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.944+0000 7fd8cd72a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:23.947 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.946+0000 7fd77ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:23.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.949+0000 7fd8cd72a800 20 remove_watcher() i=0 2024-09-22T08:39:23.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.949+0000 7fd8cd72a800 2 removed watcher, disabling cache 2024-09-22T08:39:23.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.950+0000 7fd8cd72a800 20 remove_watcher() i=1 2024-09-22T08:39:23.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.951+0000 7fd8cd72a800 20 remove_watcher() i=2 2024-09-22T08:39:23.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.952+0000 7fd8cd72a800 20 remove_watcher() i=3 2024-09-22T08:39:23.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.954+0000 7fd8cd72a800 20 remove_watcher() i=4 2024-09-22T08:39:23.956 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.955+0000 7fd8cd72a800 20 remove_watcher() i=5 2024-09-22T08:39:23.957 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.956+0000 7fd8cd72a800 20 remove_watcher() i=6 2024-09-22T08:39:23.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:23.957+0000 7fd8cd72a800 20 remove_watcher() i=7 2024-09-22T08:39:23.971 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:23.971 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:39:23.971 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: a-bucket id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 num_objects: 11 size_kb: 1 num_shards: 13 2024-09-22T08:39:23.971 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:23.972 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-22T08:39:24.009 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:24.009 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:24.051 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.050+0000 7f162da16800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.053 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.052+0000 7f162da16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:24.053 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.052+0000 7f162da16800 20 realm 2024-09-22T08:39:24.053 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.052+0000 7f162da16800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.052+0000 7f162da16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:24.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.052+0000 7f162da16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:24.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.052+0000 7f162da16800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.053+0000 7f162da16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:24.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.053+0000 7f162da16800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.053+0000 7f162da16800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:24.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.053+0000 7f162da16800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.055 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.054+0000 7f162da16800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:24.055 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.054+0000 7f162da16800 20 searching for the correct realm 2024-09-22T08:39:24.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.056+0000 7f16291e7640 0 -- 172.21.15.38:0/3162025754 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x56456ba89d60 msgr2=0x56456ba8c220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:39:24.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.061+0000 7f16209e6640 0 -- 172.21.15.38:0/3162025754 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f161c06a070 msgr2=0x7f161c069a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:24.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.268+0000 7f162da16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:24.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.268+0000 7f162da16800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:24.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.268+0000 7f162da16800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:39:24.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.268+0000 7f162da16800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:24.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.268+0000 7f162da16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:24.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.268+0000 7f162da16800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:39:24.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.268+0000 7f162da16800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.268+0000 7f162da16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:24.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.268+0000 7f162da16800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.268+0000 7f162da16800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:24.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.268+0000 7f162da16800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.269+0000 7f162da16800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:24.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.269+0000 7f162da16800 20 zone default found 2024-09-22T08:39:24.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.269+0000 7f162da16800 4 Realm: () 2024-09-22T08:39:24.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.269+0000 7f162da16800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:39:24.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.269+0000 7f162da16800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:39:24.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.269+0000 7f162da16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:24.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.269+0000 7f162da16800 20 zonegroup default 2024-09-22T08:39:24.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.269+0000 7f162da16800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.269+0000 7f162da16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:24.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.269+0000 7f162da16800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.270+0000 7f162da16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:24.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.270+0000 7f162da16800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.270+0000 7f162da16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:24.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.270+0000 7f162da16800 20 started sync module instance, tier type = 2024-09-22T08:39:24.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.270+0000 7f162da16800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:39:24.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.281+0000 7f162da16800 20 add_watcher() i=0 2024-09-22T08:39:24.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.281+0000 7f162da16800 20 add_watcher() i=1 2024-09-22T08:39:24.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.281+0000 7f162da16800 20 add_watcher() i=2 2024-09-22T08:39:24.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.281+0000 7f162da16800 20 add_watcher() i=3 2024-09-22T08:39:24.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.281+0000 7f162da16800 20 add_watcher() i=4 2024-09-22T08:39:24.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.281+0000 7f162da16800 20 add_watcher() i=5 2024-09-22T08:39:24.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.281+0000 7f162da16800 20 add_watcher() i=6 2024-09-22T08:39:24.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.282+0000 7f162da16800 20 add_watcher() i=7 2024-09-22T08:39:24.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.282+0000 7f162da16800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:24.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.285+0000 7f14dffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:24.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.285+0000 7f162da16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:24.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.285+0000 7f162da16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:24.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.285+0000 7f162da16800 5 note: GC not initialized 2024-09-22T08:39:24.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.285+0000 7f14defe5640 20 reqs_thread_entry: start 2024-09-22T08:39:24.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.285+0000 7f162da16800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:24.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.286+0000 7f162da16800 20 Filter name: none 2024-09-22T08:39:24.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.286+0000 7f14dcfe1640 20 reqs_thread_entry: start 2024-09-22T08:39:24.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.286+0000 7f162da16800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:39:24.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.286+0000 7f162da16800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.286+0000 7f162da16800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:39:24.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.286+0000 7f162da16800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:39:24.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.286+0000 7f162da16800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:39:24.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.286+0000 7f162da16800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 : miss 2024-09-22T08:39:24.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.286+0000 7f162da16800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.287+0000 7f162da16800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T08:39:24.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.287+0000 7f162da16800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:39:24.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.287+0000 7f162da16800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:39:24.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.287+0000 7f162da16800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:39:24.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.287+0000 7f162da16800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:39:24.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.287+0000 7f162da16800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 2024-09-22T08:39:24.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.288+0000 7f162da16800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-22T08:39:24.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.298+0000 7f162da16800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:39:24.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.298+0000 7f162da16800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:39:24.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.298+0000 7f162da16800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:39:24.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.298+0000 7f162da16800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17, ofs0, ns] 2024-09-22T08:39:24.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.298+0000 7f14fffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497038 cookie 94856158960432 notifier 8259 bl.length()=827 2024-09-22T08:39:24.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.298+0000 7f14fffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:39:24.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.298+0000 7f14fffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:39:24.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.298+0000 7f14fffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:39:24.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.298+0000 7f162da16800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_sources= new_sources= 2024-09-22T08:39:24.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.298+0000 7f162da16800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential sources added=[] removed=[] 2024-09-22T08:39:24.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.298+0000 7f162da16800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_dests= new_dests= 2024-09-22T08:39:24.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.298+0000 7f162da16800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential dests added=[] removed=[] 2024-09-22T08:39:24.305 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f162da16800 time 2024-09-22T08:39:24.305202+0000 2024-09-22T08:39:24.305 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:39:24.306 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:39:24.306 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f162eb8c748] 2024-09-22T08:39:24.306 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f162eb8c906] 2024-09-22T08:39:24.306 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564568db8e01] 2024-09-22T08:39:24.306 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564568dc8d0a] 2024-09-22T08:39:24.306 INFO:tasks.workunit.client.0.smithi038.stderr: 5: main() 2024-09-22T08:39:24.306 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f162d829590] 2024-09-22T08:39:24.306 INFO:tasks.workunit.client.0.smithi038.stderr: 7: __libc_start_main() 2024-09-22T08:39:24.306 INFO:tasks.workunit.client.0.smithi038.stderr: 8: _start() 2024-09-22T08:39:24.306 INFO:tasks.workunit.client.0.smithi038.stderr:*** Caught signal (Aborted) ** 2024-09-22T08:39:24.307 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f162da16800 thread_name:radosgw-admin 2024-09-22T08:39:24.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.305+0000 7f162da16800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f162da16800 time 2024-09-22T08:39:24.305202+0000 2024-09-22T08:39:24.307 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:39:24.307 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:24.307 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:39:24.307 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f162eb8c748] 2024-09-22T08:39:24.307 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f162eb8c906] 2024-09-22T08:39:24.307 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564568db8e01] 2024-09-22T08:39:24.307 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564568dc8d0a] 2024-09-22T08:39:24.307 INFO:tasks.workunit.client.0.smithi038.stderr: 5: main() 2024-09-22T08:39:24.307 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f162d829590] 2024-09-22T08:39:24.308 INFO:tasks.workunit.client.0.smithi038.stderr: 7: __libc_start_main() 2024-09-22T08:39:24.308 INFO:tasks.workunit.client.0.smithi038.stderr: 8: _start() 2024-09-22T08:39:24.308 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:24.325 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:39:24.325 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f162d83e6f0] 2024-09-22T08:39:24.325 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f162d88b99c] 2024-09-22T08:39:24.325 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:39:24.325 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:39:24.325 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f162eb8c7a2] 2024-09-22T08:39:24.325 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f162eb8c906] 2024-09-22T08:39:24.325 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564568db8e01] 2024-09-22T08:39:24.325 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564568dc8d0a] 2024-09-22T08:39:24.325 INFO:tasks.workunit.client.0.smithi038.stderr: 9: main() 2024-09-22T08:39:24.325 INFO:tasks.workunit.client.0.smithi038.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f162d829590] 2024-09-22T08:39:24.325 INFO:tasks.workunit.client.0.smithi038.stderr: 11: __libc_start_main() 2024-09-22T08:39:24.326 INFO:tasks.workunit.client.0.smithi038.stderr: 12: _start() 2024-09-22T08:39:24.326 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.305+0000 7f162da16800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:39:24.326 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f162da16800 thread_name:radosgw-admin 2024-09-22T08:39:24.326 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:24.326 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:39:24.326 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f162d83e6f0] 2024-09-22T08:39:24.326 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f162d88b99c] 2024-09-22T08:39:24.326 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:39:24.326 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:39:24.326 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f162eb8c7a2] 2024-09-22T08:39:24.326 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f162eb8c906] 2024-09-22T08:39:24.326 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564568db8e01] 2024-09-22T08:39:24.326 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564568dc8d0a] 2024-09-22T08:39:24.327 INFO:tasks.workunit.client.0.smithi038.stderr: 9: main() 2024-09-22T08:39:24.327 INFO:tasks.workunit.client.0.smithi038.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f162d829590] 2024-09-22T08:39:24.327 INFO:tasks.workunit.client.0.smithi038.stderr: 11: __libc_start_main() 2024-09-22T08:39:24.327 INFO:tasks.workunit.client.0.smithi038.stderr: 12: _start() 2024-09-22T08:39:24.327 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:39:24.327 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:24.327 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-22T08:39:24.327 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-22T08:39:24.031+0000 7f162da16800 10 monclient: shutdown 2024-09-22T08:39:24.327 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-22T08:39:24.031+0000 7f162da16800 5 asok(0x56456b76e0f0) unregister_commands rotate-key 2024-09-22T08:39:24.327 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-22T08:39:24.032+0000 7f162da16800 10 monclient: build_initial_monmap 2024-09-22T08:39:24.327 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-22T08:39:24.032+0000 7f162da16800 1 build_initial for_mkfs: 0 2024-09-22T08:39:24.327 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-22T08:39:24.032+0000 7f162da16800 10 monclient: monmap: 2024-09-22T08:39:24.327 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:39:24.328 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:39:24.328 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:39:24.328 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:39:24.328 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:39:24.328 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:39:24.328 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:39:24.328 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:39:24.328 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:39:24.328 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:24.328 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b995630) adding auth protocol: cephx 2024-09-22T08:39:24.328 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b995630) adding auth protocol: cephx 2024-09-22T08:39:24.328 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b995630) adding auth protocol: cephx 2024-09-22T08:39:24.328 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b995630) adding con mode: secure 2024-09-22T08:39:24.328 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b995630) adding con mode: crc 2024-09-22T08:39:24.328 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b995630) adding con mode: secure 2024-09-22T08:39:24.329 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b995630) adding con mode: crc 2024-09-22T08:39:24.329 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b995630) adding con mode: secure 2024-09-22T08:39:24.329 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b995630) adding con mode: crc 2024-09-22T08:39:24.329 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b995630) adding con mode: crc 2024-09-22T08:39:24.329 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b995630) adding con mode: secure 2024-09-22T08:39:24.329 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b995630) adding con mode: crc 2024-09-22T08:39:24.329 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b995630) adding con mode: secure 2024-09-22T08:39:24.329 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b995630) adding con mode: crc 2024-09-22T08:39:24.329 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b995630) adding con mode: secure 2024-09-22T08:39:24.329 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-22T08:39:24.032+0000 7f162da16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:24.329 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-22T08:39:24.032+0000 7f162da16800 1 librados: starting msgr at 2024-09-22T08:39:24.329 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-22T08:39:24.032+0000 7f162da16800 1 librados: starting objecter 2024-09-22T08:39:24.329 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-22T08:39:24.032+0000 7f162da16800 5 asok(0x56456b76e0f0) register_command objecter_requests hook 0x56456b994dd0 2024-09-22T08:39:24.329 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-22T08:39:24.032+0000 7f162da16800 1 librados: setting wanted keys 2024-09-22T08:39:24.329 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-22T08:39:24.032+0000 7f162da16800 1 librados: calling monclient init 2024-09-22T08:39:24.330 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-22T08:39:24.032+0000 7f162da16800 10 monclient: init 2024-09-22T08:39:24.330 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b990070) adding auth protocol: cephx 2024-09-22T08:39:24.330 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b990070) adding auth protocol: cephx 2024-09-22T08:39:24.330 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b990070) adding auth protocol: cephx 2024-09-22T08:39:24.330 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b990070) adding con mode: secure 2024-09-22T08:39:24.330 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b990070) adding con mode: crc 2024-09-22T08:39:24.330 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b990070) adding con mode: secure 2024-09-22T08:39:24.330 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b990070) adding con mode: crc 2024-09-22T08:39:24.330 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b990070) adding con mode: secure 2024-09-22T08:39:24.330 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b990070) adding con mode: crc 2024-09-22T08:39:24.330 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b990070) adding con mode: crc 2024-09-22T08:39:24.330 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b990070) adding con mode: secure 2024-09-22T08:39:24.330 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b990070) adding con mode: crc 2024-09-22T08:39:24.330 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b990070) adding con mode: secure 2024-09-22T08:39:24.331 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b990070) adding con mode: crc 2024-09-22T08:39:24.331 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b990070) adding con mode: secure 2024-09-22T08:39:24.331 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-22T08:39:24.032+0000 7f162da16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:24.331 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-22T08:39:24.032+0000 7f162da16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:24.331 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-22T08:39:24.032+0000 7f162da16800 5 asok(0x56456b76e0f0) register_command rotate-key hook 0x56456b9901b8 2024-09-22T08:39:24.331 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-22T08:39:24.033+0000 7f162da16800 10 monclient: _reopen_session rank -1 2024-09-22T08:39:24.331 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-22T08:39:24.033+0000 7f162da16800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T08:39:24.331 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-22T08:39:24.033+0000 7f162da16800 10 monclient(hunting): picked mon.noname-a con 0x56456b8d2830 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:39:24.331 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-22T08:39:24.033+0000 7f162da16800 10 monclient(hunting): picked mon.noname-c con 0x56456b8d58f0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:39:24.331 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-22T08:39:24.033+0000 7f162da16800 10 monclient(hunting): picked mon.noname-b con 0x56456b8d89e0 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:39:24.331 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-22T08:39:24.033+0000 7f162da16800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:24.331 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-22T08:39:24.033+0000 7f162da16800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:24.331 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-22T08:39:24.033+0000 7f162da16800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:24.331 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-22T08:39:24.033+0000 7f162da16800 10 monclient(hunting): _renew_subs 2024-09-22T08:39:24.332 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-22T08:39:24.033+0000 7f162da16800 10 monclient(hunting): authenticate will time out at 2269.272061s 2024-09-22T08:39:24.332 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-22T08:39:24.033+0000 7f16291e7640 10 monclient(hunting): get_auth_request con 0x56456b8d2830 auth_method 0 2024-09-22T08:39:24.332 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-22T08:39:24.033+0000 7f16291e7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:24.332 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-22T08:39:24.033+0000 7f16291e7640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:24.332 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-22T08:39:24.033+0000 7f16291e7640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:24.332 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-22T08:39:24.033+0000 7f16209e6640 10 monclient(hunting): get_auth_request con 0x56456b8d58f0 auth_method 0 2024-09-22T08:39:24.332 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-22T08:39:24.033+0000 7f16209e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:24.332 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-22T08:39:24.033+0000 7f16209e6640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:24.332 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-22T08:39:24.033+0000 7f16209e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:24.332 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-22T08:39:24.033+0000 7f16291e7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:24.332 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-22T08:39:24.033+0000 7f16291e7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:24.332 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-22T08:39:24.033+0000 7f16291e7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:24.333 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-22T08:39:24.033+0000 7f16209e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:24.333 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-22T08:39:24.033+0000 7f16209e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:24.333 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-22T08:39:24.033+0000 7f16209e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:24.333 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-22T08:39:24.033+0000 7f16299e8640 10 monclient(hunting): get_auth_request con 0x56456b8d89e0 auth_method 0 2024-09-22T08:39:24.333 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-22T08:39:24.033+0000 7f16299e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:24.333 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-22T08:39:24.033+0000 7f16299e8640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:24.333 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-22T08:39:24.033+0000 7f16299e8640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:24.333 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-22T08:39:24.033+0000 7f16299e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:24.333 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-22T08:39:24.033+0000 7f16299e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:24.333 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-22T08:39:24.033+0000 7f16299e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:24.333 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-22T08:39:24.033+0000 7f16291e7640 10 monclient(hunting): handle_auth_done global_id 8250 payload 824 2024-09-22T08:39:24.333 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-22T08:39:24.033+0000 7f16291e7640 10 monclient: _finish_hunting 0 2024-09-22T08:39:24.333 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-22T08:39:24.033+0000 7f16291e7640 1 monclient: found mon.noname-a 2024-09-22T08:39:24.333 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-22T08:39:24.033+0000 7f16291e7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:39:24.334 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-22T08:39:24.033+0000 7f1515e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:24.334 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-22T08:39:24.033+0000 7f1515e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:39:24.334 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-22T08:39:24.033+0000 7f1515e03640 10 monclient: dump: 2024-09-22T08:39:24.334 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:39:24.334 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:39:24.334 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:39:24.334 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:39:24.334 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:24.334 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:39:24.334 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:39:24.335 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:39:24.335 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:39:24.335 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:24.335 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-22T08:39:24.033+0000 7f1515e03640 10 monclient: _finish_auth 0 2024-09-22T08:39:24.335 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-22T08:39:24.033+0000 7f1515e03640 10 monclient: _check_auth_tickets 2024-09-22T08:39:24.335 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-22T08:39:24.033+0000 7f162da16800 5 monclient: authenticate success, global_id 8250 2024-09-22T08:39:24.335 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-22T08:39:24.033+0000 7f162da16800 10 monclient: _renew_subs 2024-09-22T08:39:24.335 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-22T08:39:24.033+0000 7f162da16800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:39:24.335 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-22T08:39:24.033+0000 7f1515e03640 10 monclient: handle_config config(0 keys) 2024-09-22T08:39:24.335 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-22T08:39:24.033+0000 7f1515e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:24.335 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-22T08:39:24.033+0000 7f1515e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:39:24.335 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-22T08:39:24.033+0000 7f1515e03640 10 monclient: dump: 2024-09-22T08:39:24.335 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:39:24.335 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:39:24.335 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:39:24.336 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:39:24.336 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:24.336 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:39:24.336 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:39:24.336 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:39:24.336 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:39:24.336 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:24.336 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-22T08:39:24.033+0000 7f1517606640 4 set_mon_vals no callback set 2024-09-22T08:39:24.336 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-22T08:39:24.033+0000 7f162da16800 10 monclient: _renew_subs 2024-09-22T08:39:24.336 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-22T08:39:24.033+0000 7f162da16800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:39:24.336 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-22T08:39:24.033+0000 7f162da16800 1 librados: init done 2024-09-22T08:39:24.336 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-22T08:39:24.035+0000 7f1515e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:39:24.336 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-22T08:39:24.035+0000 7f1515e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:39:24.336 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-22T08:39:24.035+0000 7f1515e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:39:24.336 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-22T08:39:24.036+0000 7f16209e6640 10 monclient: get_auth_request con 0x7f15100775a0 auth_method 0 2024-09-22T08:39:24.337 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-22T08:39:24.036+0000 7f16299e8640 10 monclient: get_auth_request con 0x56456b9d8600 auth_method 0 2024-09-22T08:39:24.337 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-22T08:39:24.037+0000 7f16291e7640 10 monclient: get_auth_request con 0x56456b9db7e0 auth_method 0 2024-09-22T08:39:24.337 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-22T08:39:24.037+0000 7f16209e6640 10 monclient: get_auth_request con 0x56456b9dfb40 auth_method 0 2024-09-22T08:39:24.337 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-22T08:39:24.039+0000 7f16299e8640 10 monclient: get_auth_request con 0x56456b9df040 auth_method 0 2024-09-22T08:39:24.337 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-22T08:39:24.039+0000 7f162da16800 10 monclient: build_initial_monmap 2024-09-22T08:39:24.337 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-22T08:39:24.039+0000 7f162da16800 1 build_initial for_mkfs: 0 2024-09-22T08:39:24.337 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-22T08:39:24.039+0000 7f162da16800 10 monclient: monmap: 2024-09-22T08:39:24.337 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:39:24.337 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:39:24.337 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:39:24.337 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:39:24.337 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:39:24.337 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:39:24.337 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:39:24.337 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:39:24.338 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:39:24.338 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:24.338 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-22T08:39:24.039+0000 7f162da16800 5 AuthRegistry(0x56456b9e7b60) adding auth protocol: cephx 2024-09-22T08:39:24.338 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-22T08:39:24.039+0000 7f162da16800 5 AuthRegistry(0x56456b9e7b60) adding auth protocol: cephx 2024-09-22T08:39:24.338 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-22T08:39:24.039+0000 7f162da16800 5 AuthRegistry(0x56456b9e7b60) adding auth protocol: cephx 2024-09-22T08:39:24.338 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-22T08:39:24.039+0000 7f162da16800 5 AuthRegistry(0x56456b9e7b60) adding con mode: secure 2024-09-22T08:39:24.338 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-22T08:39:24.039+0000 7f162da16800 5 AuthRegistry(0x56456b9e7b60) adding con mode: crc 2024-09-22T08:39:24.338 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-22T08:39:24.039+0000 7f162da16800 5 AuthRegistry(0x56456b9e7b60) adding con mode: secure 2024-09-22T08:39:24.338 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-22T08:39:24.039+0000 7f162da16800 5 AuthRegistry(0x56456b9e7b60) adding con mode: crc 2024-09-22T08:39:24.338 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-22T08:39:24.039+0000 7f162da16800 5 AuthRegistry(0x56456b9e7b60) adding con mode: secure 2024-09-22T08:39:24.338 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-22T08:39:24.039+0000 7f162da16800 5 AuthRegistry(0x56456b9e7b60) adding con mode: crc 2024-09-22T08:39:24.338 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-22T08:39:24.039+0000 7f162da16800 5 AuthRegistry(0x56456b9e7b60) adding con mode: crc 2024-09-22T08:39:24.338 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-22T08:39:24.039+0000 7f162da16800 5 AuthRegistry(0x56456b9e7b60) adding con mode: secure 2024-09-22T08:39:24.338 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-22T08:39:24.039+0000 7f162da16800 5 AuthRegistry(0x56456b9e7b60) adding con mode: crc 2024-09-22T08:39:24.339 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-22T08:39:24.039+0000 7f162da16800 5 AuthRegistry(0x56456b9e7b60) adding con mode: secure 2024-09-22T08:39:24.339 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-22T08:39:24.039+0000 7f162da16800 5 AuthRegistry(0x56456b9e7b60) adding con mode: crc 2024-09-22T08:39:24.339 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-22T08:39:24.039+0000 7f162da16800 5 AuthRegistry(0x56456b9e7b60) adding con mode: secure 2024-09-22T08:39:24.339 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-22T08:39:24.040+0000 7f162da16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:24.339 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-22T08:39:24.040+0000 7f162da16800 5 asok(0x56456b76e0f0) register_command objecter_requests cmddesc objecter_requests hook 0x56456b9eb520 EEXIST 2024-09-22T08:39:24.339 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-22T08:39:24.040+0000 7f162da16800 10 monclient: init 2024-09-22T08:39:24.339 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-22T08:39:24.040+0000 7f162da16800 5 AuthRegistry(0x56456b9e6ba8) adding auth protocol: cephx 2024-09-22T08:39:24.339 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-22T08:39:24.040+0000 7f162da16800 5 AuthRegistry(0x56456b9e6ba8) adding auth protocol: cephx 2024-09-22T08:39:24.339 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-22T08:39:24.040+0000 7f162da16800 5 AuthRegistry(0x56456b9e6ba8) adding auth protocol: cephx 2024-09-22T08:39:24.339 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-22T08:39:24.040+0000 7f162da16800 5 AuthRegistry(0x56456b9e6ba8) adding con mode: secure 2024-09-22T08:39:24.339 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-22T08:39:24.040+0000 7f162da16800 5 AuthRegistry(0x56456b9e6ba8) adding con mode: crc 2024-09-22T08:39:24.339 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-22T08:39:24.040+0000 7f162da16800 5 AuthRegistry(0x56456b9e6ba8) adding con mode: secure 2024-09-22T08:39:24.339 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-22T08:39:24.040+0000 7f162da16800 5 AuthRegistry(0x56456b9e6ba8) adding con mode: crc 2024-09-22T08:39:24.339 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-22T08:39:24.040+0000 7f162da16800 5 AuthRegistry(0x56456b9e6ba8) adding con mode: secure 2024-09-22T08:39:24.339 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-22T08:39:24.040+0000 7f162da16800 5 AuthRegistry(0x56456b9e6ba8) adding con mode: crc 2024-09-22T08:39:24.340 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-22T08:39:24.040+0000 7f162da16800 5 AuthRegistry(0x56456b9e6ba8) adding con mode: crc 2024-09-22T08:39:24.340 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-22T08:39:24.040+0000 7f162da16800 5 AuthRegistry(0x56456b9e6ba8) adding con mode: secure 2024-09-22T08:39:24.340 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-22T08:39:24.040+0000 7f162da16800 5 AuthRegistry(0x56456b9e6ba8) adding con mode: crc 2024-09-22T08:39:24.340 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-22T08:39:24.040+0000 7f162da16800 5 AuthRegistry(0x56456b9e6ba8) adding con mode: secure 2024-09-22T08:39:24.340 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-22T08:39:24.040+0000 7f162da16800 5 AuthRegistry(0x56456b9e6ba8) adding con mode: crc 2024-09-22T08:39:24.340 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-22T08:39:24.040+0000 7f162da16800 5 AuthRegistry(0x56456b9e6ba8) adding con mode: secure 2024-09-22T08:39:24.340 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-22T08:39:24.040+0000 7f162da16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:24.340 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-22T08:39:24.040+0000 7f162da16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:24.340 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-22T08:39:24.040+0000 7f162da16800 5 asok(0x56456b76e0f0) register_command rotate-key cmddesc rotate-key hook 0x56456b9e6cf0 EEXIST 2024-09-22T08:39:24.340 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-22T08:39:24.040+0000 7f162da16800 10 monclient: _reopen_session rank -1 2024-09-22T08:39:24.340 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-22T08:39:24.040+0000 7f162da16800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T08:39:24.340 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-22T08:39:24.040+0000 7f162da16800 10 monclient(hunting): picked mon.noname-b con 0x56456ba0f210 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:39:24.340 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-22T08:39:24.040+0000 7f162da16800 10 monclient(hunting): picked mon.noname-a con 0x56456ba114e0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:39:24.340 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-22T08:39:24.040+0000 7f162da16800 10 monclient(hunting): picked mon.noname-c con 0x56456ba0d9e0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:39:24.341 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-22T08:39:24.040+0000 7f162da16800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:24.341 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-22T08:39:24.040+0000 7f162da16800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:24.341 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-22T08:39:24.040+0000 7f162da16800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:24.341 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-22T08:39:24.040+0000 7f162da16800 10 monclient(hunting): _renew_subs 2024-09-22T08:39:24.341 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-22T08:39:24.040+0000 7f162da16800 10 monclient(hunting): authenticate will time out at 2269.279951s 2024-09-22T08:39:24.341 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-22T08:39:24.041+0000 7f16299e8640 10 monclient(hunting): get_auth_request con 0x56456ba114e0 auth_method 0 2024-09-22T08:39:24.341 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-22T08:39:24.041+0000 7f16299e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:24.341 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-22T08:39:24.041+0000 7f16299e8640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:24.341 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-22T08:39:24.041+0000 7f16299e8640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:24.341 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-22T08:39:24.041+0000 7f16291e7640 10 monclient(hunting): get_auth_request con 0x56456ba0d9e0 auth_method 0 2024-09-22T08:39:24.341 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-22T08:39:24.041+0000 7f16291e7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:24.341 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-22T08:39:24.041+0000 7f16291e7640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:24.341 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-22T08:39:24.041+0000 7f16291e7640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:24.341 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-22T08:39:24.041+0000 7f16299e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:24.341 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-22T08:39:24.041+0000 7f16299e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:24.342 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-22T08:39:24.041+0000 7f16299e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:24.342 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-22T08:39:24.041+0000 7f16209e6640 10 monclient(hunting): get_auth_request con 0x56456ba0f210 auth_method 0 2024-09-22T08:39:24.342 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-22T08:39:24.041+0000 7f16209e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:24.342 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-22T08:39:24.041+0000 7f16209e6640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:24.342 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-22T08:39:24.041+0000 7f16209e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:24.342 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-22T08:39:24.041+0000 7f16291e7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:24.342 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-22T08:39:24.041+0000 7f16291e7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:24.342 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-22T08:39:24.041+0000 7f16291e7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:24.342 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-22T08:39:24.041+0000 7f16209e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:24.342 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-22T08:39:24.041+0000 7f16209e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:24.342 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-22T08:39:24.041+0000 7f16209e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:24.342 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-22T08:39:24.041+0000 7f16299e8640 10 monclient(hunting): handle_auth_done global_id 8253 payload 824 2024-09-22T08:39:24.342 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-22T08:39:24.041+0000 7f16299e8640 10 monclient: _finish_hunting 0 2024-09-22T08:39:24.342 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-22T08:39:24.041+0000 7f16299e8640 1 monclient: found mon.noname-a 2024-09-22T08:39:24.342 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-22T08:39:24.041+0000 7f16299e8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:39:24.343 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-22T08:39:24.041+0000 7f150effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:24.343 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-22T08:39:24.041+0000 7f150effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:39:24.343 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-22T08:39:24.041+0000 7f150effd640 10 monclient: dump: 2024-09-22T08:39:24.343 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:39:24.343 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:39:24.343 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:39:24.343 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:39:24.343 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:24.343 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:39:24.343 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:39:24.343 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:39:24.343 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:39:24.343 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:24.343 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-22T08:39:24.041+0000 7f150effd640 10 monclient: _finish_auth 0 2024-09-22T08:39:24.343 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-22T08:39:24.041+0000 7f150effd640 10 monclient: _check_auth_tickets 2024-09-22T08:39:24.344 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-22T08:39:24.041+0000 7f150effd640 10 monclient: handle_config config(0 keys) 2024-09-22T08:39:24.344 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-22T08:39:24.041+0000 7f150effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:24.344 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-22T08:39:24.041+0000 7f150effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:39:24.344 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-22T08:39:24.041+0000 7f150effd640 10 monclient: dump: 2024-09-22T08:39:24.344 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:39:24.344 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:39:24.344 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:39:24.344 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:39:24.344 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:24.344 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:39:24.344 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:39:24.345 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:39:24.345 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:39:24.345 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:24.345 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-22T08:39:24.041+0000 7f162da16800 5 monclient: authenticate success, global_id 8253 2024-09-22T08:39:24.345 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-22T08:39:24.041+0000 7f162da16800 10 monclient: _renew_subs 2024-09-22T08:39:24.345 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-22T08:39:24.041+0000 7f162da16800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:39:24.345 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-22T08:39:24.041+0000 7f162a1e9640 4 set_mon_vals no callback set 2024-09-22T08:39:24.345 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-22T08:39:24.041+0000 7f162da16800 10 monclient: _renew_subs 2024-09-22T08:39:24.345 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-22T08:39:24.041+0000 7f162da16800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:39:24.345 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-22T08:39:24.043+0000 7f150effd640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:39:24.345 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-22T08:39:24.043+0000 7f150effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:39:24.345 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-22T08:39:24.043+0000 7f150effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:39:24.345 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-22T08:39:24.044+0000 7f16209e6640 10 monclient: get_auth_request con 0x7f1500077480 auth_method 0 2024-09-22T08:39:24.345 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-22T08:39:24.044+0000 7f162da16800 10 monclient: get_monmap_and_config 2024-09-22T08:39:24.345 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-22T08:39:24.044+0000 7f162da16800 10 monclient: build_initial_monmap 2024-09-22T08:39:24.346 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-22T08:39:24.044+0000 7f162da16800 1 build_initial for_mkfs: 0 2024-09-22T08:39:24.346 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-22T08:39:24.044+0000 7f162da16800 10 monclient: monmap: 2024-09-22T08:39:24.346 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:39:24.346 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:39:24.346 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:39:24.346 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:39:24.346 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:39:24.346 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:39:24.346 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:39:24.346 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:39:24.346 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:39:24.346 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:24.346 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x56456ba2f0f0) adding auth protocol: cephx 2024-09-22T08:39:24.346 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x56456ba2f0f0) adding auth protocol: cephx 2024-09-22T08:39:24.347 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x56456ba2f0f0) adding auth protocol: cephx 2024-09-22T08:39:24.347 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x56456ba2f0f0) adding con mode: secure 2024-09-22T08:39:24.347 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x56456ba2f0f0) adding con mode: crc 2024-09-22T08:39:24.347 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x56456ba2f0f0) adding con mode: secure 2024-09-22T08:39:24.347 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x56456ba2f0f0) adding con mode: crc 2024-09-22T08:39:24.347 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x56456ba2f0f0) adding con mode: secure 2024-09-22T08:39:24.347 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x56456ba2f0f0) adding con mode: crc 2024-09-22T08:39:24.347 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x56456ba2f0f0) adding con mode: crc 2024-09-22T08:39:24.347 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x56456ba2f0f0) adding con mode: secure 2024-09-22T08:39:24.347 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x56456ba2f0f0) adding con mode: crc 2024-09-22T08:39:24.347 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x56456ba2f0f0) adding con mode: secure 2024-09-22T08:39:24.347 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x56456ba2f0f0) adding con mode: crc 2024-09-22T08:39:24.347 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x56456ba2f0f0) adding con mode: secure 2024-09-22T08:39:24.347 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-22T08:39:24.044+0000 7f162da16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:24.347 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-22T08:39:24.044+0000 7f162da16800 10 monclient: init 2024-09-22T08:39:24.348 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaa20) adding auth protocol: cephx 2024-09-22T08:39:24.348 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaa20) adding auth protocol: cephx 2024-09-22T08:39:24.348 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaa20) adding auth protocol: cephx 2024-09-22T08:39:24.348 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaa20) adding con mode: secure 2024-09-22T08:39:24.348 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaa20) adding con mode: crc 2024-09-22T08:39:24.348 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaa20) adding con mode: secure 2024-09-22T08:39:24.348 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaa20) adding con mode: crc 2024-09-22T08:39:24.348 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaa20) adding con mode: secure 2024-09-22T08:39:24.348 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaa20) adding con mode: crc 2024-09-22T08:39:24.348 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaa20) adding con mode: crc 2024-09-22T08:39:24.348 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaa20) adding con mode: secure 2024-09-22T08:39:24.348 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaa20) adding con mode: crc 2024-09-22T08:39:24.348 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaa20) adding con mode: secure 2024-09-22T08:39:24.348 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaa20) adding con mode: crc 2024-09-22T08:39:24.348 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaa20) adding con mode: secure 2024-09-22T08:39:24.349 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-22T08:39:24.045+0000 7f162da16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:24.349 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-22T08:39:24.045+0000 7f162da16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:24.349 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-22T08:39:24.045+0000 7f162da16800 5 asok(0x56456b76e0f0) register_command rotate-key cmddesc rotate-key hook 0x7fff8fbfab68 EEXIST 2024-09-22T08:39:24.349 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-22T08:39:24.045+0000 7f162da16800 10 monclient: _reopen_session rank -1 2024-09-22T08:39:24.349 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-22T08:39:24.045+0000 7f162da16800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T08:39:24.349 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-22T08:39:24.045+0000 7f162da16800 10 monclient(hunting): picked mon.noname-a con 0x56456ba636d0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:39:24.349 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-22T08:39:24.045+0000 7f162da16800 10 monclient(hunting): picked mon.noname-c con 0x56456ba5dc70 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:39:24.349 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-22T08:39:24.045+0000 7f162da16800 10 monclient(hunting): picked mon.noname-b con 0x56456ba33510 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:39:24.349 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-22T08:39:24.045+0000 7f162da16800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:24.349 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-22T08:39:24.045+0000 7f162da16800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:24.349 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-22T08:39:24.045+0000 7f162da16800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:24.349 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-22T08:39:24.045+0000 7f162da16800 10 monclient(hunting): _renew_subs 2024-09-22T08:39:24.349 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-22T08:39:24.045+0000 7f162da16800 10 monclient(hunting): authenticate will time out at 2269.284342s 2024-09-22T08:39:24.349 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-22T08:39:24.045+0000 7f16209e6640 10 monclient(hunting): get_auth_request con 0x56456ba636d0 auth_method 0 2024-09-22T08:39:24.350 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-22T08:39:24.045+0000 7f16209e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:24.350 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-22T08:39:24.045+0000 7f16209e6640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:24.350 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-22T08:39:24.045+0000 7f16209e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:24.350 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-22T08:39:24.045+0000 7f16299e8640 10 monclient(hunting): get_auth_request con 0x56456ba5dc70 auth_method 0 2024-09-22T08:39:24.350 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-22T08:39:24.045+0000 7f16299e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:24.350 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-22T08:39:24.045+0000 7f16299e8640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:24.350 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-22T08:39:24.045+0000 7f16299e8640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:24.350 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-22T08:39:24.045+0000 7f16209e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:24.350 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-22T08:39:24.045+0000 7f16209e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:24.350 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-22T08:39:24.045+0000 7f16209e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:24.350 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-22T08:39:24.045+0000 7f16299e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:24.350 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-22T08:39:24.045+0000 7f16299e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:24.350 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-22T08:39:24.045+0000 7f16299e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:24.350 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-22T08:39:24.045+0000 7f16209e6640 10 monclient(hunting): handle_auth_done global_id 8256 payload 274 2024-09-22T08:39:24.350 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-22T08:39:24.045+0000 7f16209e6640 10 monclient: _finish_hunting 0 2024-09-22T08:39:24.351 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-22T08:39:24.045+0000 7f16209e6640 1 monclient: found mon.noname-a 2024-09-22T08:39:24.351 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-22T08:39:24.045+0000 7f16209e6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:39:24.351 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-22T08:39:24.045+0000 7f16291e7640 10 monclient: get_auth_request con 0x56456ba33510 auth_method 0 2024-09-22T08:39:24.351 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-22T08:39:24.046+0000 7f150cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:24.351 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-22T08:39:24.046+0000 7f150cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:39:24.351 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-22T08:39:24.046+0000 7f150cff9640 10 monclient: dump: 2024-09-22T08:39:24.351 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:39:24.351 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:39:24.351 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:39:24.351 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:39:24.351 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:24.351 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:39:24.351 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:39:24.351 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:39:24.351 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:39:24.352 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:24.352 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-22T08:39:24.046+0000 7f150cff9640 10 monclient: _finish_auth 0 2024-09-22T08:39:24.352 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-22T08:39:24.046+0000 7f150cff9640 10 monclient: _check_auth_tickets 2024-09-22T08:39:24.352 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-22T08:39:24.046+0000 7f162da16800 5 monclient: authenticate success, global_id 8256 2024-09-22T08:39:24.352 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-22T08:39:24.046+0000 7f150cff9640 10 monclient: handle_config config(0 keys) 2024-09-22T08:39:24.352 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-22T08:39:24.046+0000 7f150cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:24.352 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-22T08:39:24.046+0000 7f150cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:39:24.352 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-22T08:39:24.046+0000 7f150cff9640 10 monclient: dump: 2024-09-22T08:39:24.352 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:39:24.352 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:39:24.352 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:39:24.352 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:39:24.352 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:24.352 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:39:24.353 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:39:24.353 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:39:24.353 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:39:24.353 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:24.353 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-22T08:39:24.046+0000 7f162da16800 10 monclient: get_monmap_and_config success 2024-09-22T08:39:24.353 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-22T08:39:24.046+0000 7f162da16800 4 set_mon_vals no callback set 2024-09-22T08:39:24.353 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-22T08:39:24.046+0000 7f162da16800 10 monclient: shutdown 2024-09-22T08:39:24.353 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-22T08:39:24.046+0000 7f162da16800 10 monclient: build_initial_monmap 2024-09-22T08:39:24.353 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-22T08:39:24.046+0000 7f162da16800 1 build_initial for_mkfs: 0 2024-09-22T08:39:24.353 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-22T08:39:24.046+0000 7f162da16800 10 monclient: monmap: 2024-09-22T08:39:24.353 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:39:24.353 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:39:24.353 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:39:24.353 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:39:24.353 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:39:24.353 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:39:24.354 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:39:24.354 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:39:24.354 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:39:24.354 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:24.354 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-22T08:39:24.046+0000 7f162da16800 5 AuthRegistry(0x56456ba5ec30) adding auth protocol: cephx 2024-09-22T08:39:24.354 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-22T08:39:24.046+0000 7f162da16800 5 AuthRegistry(0x56456ba5ec30) adding auth protocol: cephx 2024-09-22T08:39:24.354 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-22T08:39:24.046+0000 7f162da16800 5 AuthRegistry(0x56456ba5ec30) adding auth protocol: cephx 2024-09-22T08:39:24.354 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-22T08:39:24.046+0000 7f162da16800 5 AuthRegistry(0x56456ba5ec30) adding con mode: secure 2024-09-22T08:39:24.354 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-22T08:39:24.046+0000 7f162da16800 5 AuthRegistry(0x56456ba5ec30) adding con mode: crc 2024-09-22T08:39:24.354 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-22T08:39:24.046+0000 7f162da16800 5 AuthRegistry(0x56456ba5ec30) adding con mode: secure 2024-09-22T08:39:24.354 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-22T08:39:24.046+0000 7f162da16800 5 AuthRegistry(0x56456ba5ec30) adding con mode: crc 2024-09-22T08:39:24.354 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-22T08:39:24.046+0000 7f162da16800 5 AuthRegistry(0x56456ba5ec30) adding con mode: secure 2024-09-22T08:39:24.354 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-22T08:39:24.046+0000 7f162da16800 5 AuthRegistry(0x56456ba5ec30) adding con mode: crc 2024-09-22T08:39:24.355 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-22T08:39:24.046+0000 7f162da16800 5 AuthRegistry(0x56456ba5ec30) adding con mode: crc 2024-09-22T08:39:24.355 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-22T08:39:24.046+0000 7f162da16800 5 AuthRegistry(0x56456ba5ec30) adding con mode: secure 2024-09-22T08:39:24.355 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-22T08:39:24.046+0000 7f162da16800 5 AuthRegistry(0x56456ba5ec30) adding con mode: crc 2024-09-22T08:39:24.355 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-22T08:39:24.046+0000 7f162da16800 5 AuthRegistry(0x56456ba5ec30) adding con mode: secure 2024-09-22T08:39:24.355 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-22T08:39:24.046+0000 7f162da16800 5 AuthRegistry(0x56456ba5ec30) adding con mode: crc 2024-09-22T08:39:24.355 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-22T08:39:24.046+0000 7f162da16800 5 AuthRegistry(0x56456ba5ec30) adding con mode: secure 2024-09-22T08:39:24.355 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-22T08:39:24.046+0000 7f162da16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:24.355 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-22T08:39:24.047+0000 7f162da16800 1 librados: starting msgr at 2024-09-22T08:39:24.355 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-22T08:39:24.047+0000 7f162da16800 1 librados: starting objecter 2024-09-22T08:39:24.355 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-22T08:39:24.047+0000 7f162da16800 5 asok(0x56456b76e0f0) register_command objecter_requests cmddesc objecter_requests hook 0x56456ba5d590 EEXIST 2024-09-22T08:39:24.355 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-22T08:39:24.047+0000 7f162da16800 1 librados: setting wanted keys 2024-09-22T08:39:24.356 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-22T08:39:24.047+0000 7f162da16800 1 librados: calling monclient init 2024-09-22T08:39:24.356 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-22T08:39:24.047+0000 7f162da16800 10 monclient: init 2024-09-22T08:39:24.356 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-22T08:39:24.047+0000 7f162da16800 5 AuthRegistry(0x56456ba26fc0) adding auth protocol: cephx 2024-09-22T08:39:24.356 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-22T08:39:24.047+0000 7f162da16800 5 AuthRegistry(0x56456ba26fc0) adding auth protocol: cephx 2024-09-22T08:39:24.356 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-22T08:39:24.047+0000 7f162da16800 5 AuthRegistry(0x56456ba26fc0) adding auth protocol: cephx 2024-09-22T08:39:24.356 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-22T08:39:24.047+0000 7f162da16800 5 AuthRegistry(0x56456ba26fc0) adding con mode: secure 2024-09-22T08:39:24.356 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-22T08:39:24.047+0000 7f162da16800 5 AuthRegistry(0x56456ba26fc0) adding con mode: crc 2024-09-22T08:39:24.356 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-22T08:39:24.047+0000 7f162da16800 5 AuthRegistry(0x56456ba26fc0) adding con mode: secure 2024-09-22T08:39:24.356 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-22T08:39:24.047+0000 7f162da16800 5 AuthRegistry(0x56456ba26fc0) adding con mode: crc 2024-09-22T08:39:24.356 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-22T08:39:24.047+0000 7f162da16800 5 AuthRegistry(0x56456ba26fc0) adding con mode: secure 2024-09-22T08:39:24.356 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-22T08:39:24.047+0000 7f162da16800 5 AuthRegistry(0x56456ba26fc0) adding con mode: crc 2024-09-22T08:39:24.356 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-22T08:39:24.047+0000 7f162da16800 5 AuthRegistry(0x56456ba26fc0) adding con mode: crc 2024-09-22T08:39:24.356 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-22T08:39:24.047+0000 7f162da16800 5 AuthRegistry(0x56456ba26fc0) adding con mode: secure 2024-09-22T08:39:24.356 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-22T08:39:24.047+0000 7f162da16800 5 AuthRegistry(0x56456ba26fc0) adding con mode: crc 2024-09-22T08:39:24.356 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-22T08:39:24.047+0000 7f162da16800 5 AuthRegistry(0x56456ba26fc0) adding con mode: secure 2024-09-22T08:39:24.357 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-22T08:39:24.047+0000 7f162da16800 5 AuthRegistry(0x56456ba26fc0) adding con mode: crc 2024-09-22T08:39:24.357 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-22T08:39:24.047+0000 7f162da16800 5 AuthRegistry(0x56456ba26fc0) adding con mode: secure 2024-09-22T08:39:24.357 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-22T08:39:24.047+0000 7f162da16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:24.357 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-22T08:39:24.047+0000 7f162da16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:24.357 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-22T08:39:24.047+0000 7f162da16800 5 asok(0x56456b76e0f0) register_command rotate-key cmddesc rotate-key hook 0x56456ba27108 EEXIST 2024-09-22T08:39:24.357 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-22T08:39:24.047+0000 7f162da16800 10 monclient: _reopen_session rank -1 2024-09-22T08:39:24.357 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-22T08:39:24.047+0000 7f162da16800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T08:39:24.357 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-22T08:39:24.047+0000 7f162da16800 10 monclient(hunting): picked mon.noname-a con 0x56456ba33510 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:39:24.357 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-22T08:39:24.047+0000 7f162da16800 10 monclient(hunting): picked mon.noname-c con 0x56456ba5dc70 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:39:24.357 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-22T08:39:24.047+0000 7f162da16800 10 monclient(hunting): picked mon.noname-b con 0x56456ba636d0 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:39:24.357 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-22T08:39:24.047+0000 7f162da16800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:24.357 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-22T08:39:24.047+0000 7f162da16800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:24.357 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-22T08:39:24.047+0000 7f162da16800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:24.357 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-22T08:39:24.047+0000 7f162da16800 10 monclient(hunting): _renew_subs 2024-09-22T08:39:24.357 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-22T08:39:24.047+0000 7f162da16800 10 monclient(hunting): authenticate will time out at 2269.286767s 2024-09-22T08:39:24.358 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-22T08:39:24.047+0000 7f16209e6640 10 monclient(hunting): get_auth_request con 0x56456ba33510 auth_method 0 2024-09-22T08:39:24.358 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-22T08:39:24.047+0000 7f16209e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:24.358 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-22T08:39:24.047+0000 7f16209e6640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:24.358 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-22T08:39:24.047+0000 7f16209e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:24.358 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-22T08:39:24.047+0000 7f16299e8640 10 monclient(hunting): get_auth_request con 0x56456ba5dc70 auth_method 0 2024-09-22T08:39:24.358 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-22T08:39:24.047+0000 7f16299e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:24.358 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-22T08:39:24.047+0000 7f16299e8640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:24.358 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-22T08:39:24.047+0000 7f16299e8640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:24.358 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-22T08:39:24.047+0000 7f16209e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:24.358 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-22T08:39:24.047+0000 7f16209e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:24.358 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-22T08:39:24.047+0000 7f16209e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:24.358 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-22T08:39:24.047+0000 7f16299e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:24.358 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-22T08:39:24.047+0000 7f16299e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:24.358 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-22T08:39:24.047+0000 7f16299e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:24.358 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-22T08:39:24.048+0000 7f16291e7640 10 monclient(hunting): get_auth_request con 0x56456ba636d0 auth_method 0 2024-09-22T08:39:24.359 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-22T08:39:24.048+0000 7f16291e7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:24.359 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-22T08:39:24.048+0000 7f16291e7640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:24.359 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-22T08:39:24.048+0000 7f16291e7640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:24.359 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-22T08:39:24.048+0000 7f16291e7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:24.359 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-22T08:39:24.048+0000 7f16291e7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:24.359 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-22T08:39:24.048+0000 7f16291e7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:24.359 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-22T08:39:24.048+0000 7f16209e6640 10 monclient(hunting): handle_auth_done global_id 8259 payload 824 2024-09-22T08:39:24.359 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-22T08:39:24.048+0000 7f16209e6640 10 monclient: _finish_hunting 0 2024-09-22T08:39:24.359 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-22T08:39:24.048+0000 7f16209e6640 1 monclient: found mon.noname-a 2024-09-22T08:39:24.359 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-22T08:39:24.048+0000 7f16209e6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:39:24.359 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-22T08:39:24.048+0000 7f14feffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:24.359 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-22T08:39:24.048+0000 7f14feffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:39:24.359 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-22T08:39:24.048+0000 7f14feffd640 10 monclient: dump: 2024-09-22T08:39:24.359 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:39:24.359 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:39:24.360 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:39:24.360 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:39:24.360 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:24.360 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:39:24.360 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:39:24.360 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:39:24.360 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:39:24.360 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:24.360 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-22T08:39:24.048+0000 7f14feffd640 10 monclient: _finish_auth 0 2024-09-22T08:39:24.360 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-22T08:39:24.048+0000 7f14feffd640 10 monclient: _check_auth_tickets 2024-09-22T08:39:24.360 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-22T08:39:24.048+0000 7f14feffd640 10 monclient: handle_config config(0 keys) 2024-09-22T08:39:24.360 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-22T08:39:24.048+0000 7f14feffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:24.360 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-22T08:39:24.048+0000 7f14feffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:39:24.360 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-22T08:39:24.048+0000 7f14feffd640 10 monclient: dump: 2024-09-22T08:39:24.360 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:39:24.361 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:39:24.361 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:39:24.361 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:39:24.361 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:24.361 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:39:24.361 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:39:24.361 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:39:24.361 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:39:24.361 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:24.361 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-22T08:39:24.048+0000 7f162da16800 5 monclient: authenticate success, global_id 8259 2024-09-22T08:39:24.361 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-22T08:39:24.048+0000 7f150cff9640 4 set_mon_vals no callback set 2024-09-22T08:39:24.361 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-22T08:39:24.048+0000 7f162da16800 10 monclient: _renew_subs 2024-09-22T08:39:24.361 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-22T08:39:24.048+0000 7f162da16800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:39:24.361 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-22T08:39:24.048+0000 7f162da16800 10 monclient: _renew_subs 2024-09-22T08:39:24.361 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-22T08:39:24.048+0000 7f162da16800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:39:24.362 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-22T08:39:24.048+0000 7f162da16800 1 librados: init done 2024-09-22T08:39:24.362 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-22T08:39:24.048+0000 7f162da16800 5 asok(0x56456b76e0f0) register_command cr dump hook 0x56456ba53038 2024-09-22T08:39:24.362 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-22T08:39:24.050+0000 7f162da16800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.362 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-22T08:39:24.051+0000 7f14feffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:39:24.362 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-22T08:39:24.051+0000 7f14feffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:39:24.362 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-22T08:39:24.051+0000 7f14feffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:39:24.362 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-22T08:39:24.051+0000 7f16299e8640 10 monclient: get_auth_request con 0x7f14f4077570 auth_method 0 2024-09-22T08:39:24.362 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-22T08:39:24.051+0000 7f16291e7640 10 monclient: get_auth_request con 0x56456ba7d4f0 auth_method 0 2024-09-22T08:39:24.362 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-22T08:39:24.052+0000 7f162da16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:24.362 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-22T08:39:24.052+0000 7f162da16800 20 realm 2024-09-22T08:39:24.362 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-22T08:39:24.052+0000 7f162da16800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.362 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-22T08:39:24.052+0000 7f162da16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:24.362 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-22T08:39:24.052+0000 7f162da16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:24.362 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-22T08:39:24.052+0000 7f162da16800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.362 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-22T08:39:24.053+0000 7f162da16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:24.363 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-22T08:39:24.053+0000 7f162da16800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.363 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-22T08:39:24.053+0000 7f16209e6640 10 monclient: get_auth_request con 0x56456ba81880 auth_method 0 2024-09-22T08:39:24.363 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-22T08:39:24.053+0000 7f162da16800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:24.363 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-22T08:39:24.053+0000 7f162da16800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.363 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-22T08:39:24.053+0000 7f16299e8640 10 monclient: get_auth_request con 0x56456ba84fa0 auth_method 0 2024-09-22T08:39:24.363 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-22T08:39:24.054+0000 7f162da16800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:24.363 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-22T08:39:24.054+0000 7f162da16800 20 searching for the correct realm 2024-09-22T08:39:24.363 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-22T08:39:24.054+0000 7f16291e7640 10 monclient: get_auth_request con 0x56456ba89d60 auth_method 0 2024-09-22T08:39:24.363 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-22T08:39:24.056+0000 7f16209e6640 10 monclient: get_auth_request con 0x7f1614007e80 auth_method 0 2024-09-22T08:39:24.363 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-22T08:39:24.056+0000 7f16291e7640 0 -- 172.21.15.38:0/3162025754 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x56456ba89d60 msgr2=0x56456ba8c220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:39:24.363 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-22T08:39:24.057+0000 7f14feffd640 1 client.8259.objecter ms_handle_reset 0x56456ba89d60 session 0x56456ba896e0 osd.4 2024-09-22T08:39:24.363 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-22T08:39:24.057+0000 7f14feffd640 10 monclient: _renew_subs 2024-09-22T08:39:24.363 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-22T08:39:24.057+0000 7f14feffd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:39:24.363 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-22T08:39:24.057+0000 7f16291e7640 10 monclient: get_auth_request con 0x7f14f4087090 auth_method 0 2024-09-22T08:39:24.364 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-22T08:39:24.058+0000 7f16299e8640 10 monclient: get_auth_request con 0x7f161c01e060 auth_method 0 2024-09-22T08:39:24.364 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-22T08:39:24.060+0000 7f16291e7640 10 monclient: get_auth_request con 0x7f161409dea0 auth_method 0 2024-09-22T08:39:24.364 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-22T08:39:24.061+0000 7f16209e6640 10 monclient: get_auth_request con 0x7f161c06a070 auth_method 0 2024-09-22T08:39:24.364 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-22T08:39:24.061+0000 7f16209e6640 0 -- 172.21.15.38:0/3162025754 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f161c06a070 msgr2=0x7f161c069a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:24.364 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-22T08:39:24.262+0000 7f16209e6640 10 monclient: get_auth_request con 0x7f161c06a070 auth_method 0 2024-09-22T08:39:24.364 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-22T08:39:24.268+0000 7f162da16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:24.364 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-22T08:39:24.268+0000 7f162da16800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:24.364 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-22T08:39:24.268+0000 7f162da16800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:39:24.364 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-22T08:39:24.268+0000 7f162da16800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:24.364 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-22T08:39:24.268+0000 7f162da16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:24.364 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-22T08:39:24.268+0000 7f162da16800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:39:24.364 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-22T08:39:24.268+0000 7f162da16800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.364 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-22T08:39:24.268+0000 7f162da16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:24.364 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-22T08:39:24.268+0000 7f162da16800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.364 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-22T08:39:24.268+0000 7f162da16800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:24.365 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-22T08:39:24.268+0000 7f162da16800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.365 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-22T08:39:24.269+0000 7f162da16800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:24.365 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-22T08:39:24.269+0000 7f162da16800 20 zone default found 2024-09-22T08:39:24.365 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-22T08:39:24.269+0000 7f162da16800 4 Realm: () 2024-09-22T08:39:24.365 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-22T08:39:24.269+0000 7f162da16800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:39:24.365 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-22T08:39:24.269+0000 7f162da16800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:39:24.365 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-22T08:39:24.269+0000 7f162da16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:24.365 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-22T08:39:24.269+0000 7f162da16800 20 zonegroup default 2024-09-22T08:39:24.365 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-22T08:39:24.269+0000 7f162da16800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.365 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-22T08:39:24.269+0000 7f162da16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:24.366 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-22T08:39:24.269+0000 7f162da16800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.366 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-22T08:39:24.270+0000 7f162da16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:24.366 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-22T08:39:24.270+0000 7f162da16800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.366 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-22T08:39:24.270+0000 7f162da16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:24.366 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-22T08:39:24.270+0000 7f162da16800 20 started sync module instance, tier type = 2024-09-22T08:39:24.366 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-22T08:39:24.270+0000 7f162da16800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:39:24.366 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-22T08:39:24.281+0000 7f162da16800 20 add_watcher() i=0 2024-09-22T08:39:24.366 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-22T08:39:24.281+0000 7f162da16800 20 add_watcher() i=1 2024-09-22T08:39:24.366 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-22T08:39:24.281+0000 7f162da16800 20 add_watcher() i=2 2024-09-22T08:39:24.366 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-22T08:39:24.281+0000 7f162da16800 20 add_watcher() i=3 2024-09-22T08:39:24.366 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-22T08:39:24.281+0000 7f162da16800 20 add_watcher() i=4 2024-09-22T08:39:24.366 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-22T08:39:24.281+0000 7f162da16800 20 add_watcher() i=5 2024-09-22T08:39:24.366 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-22T08:39:24.281+0000 7f162da16800 20 add_watcher() i=6 2024-09-22T08:39:24.367 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-22T08:39:24.282+0000 7f162da16800 20 add_watcher() i=7 2024-09-22T08:39:24.367 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-22T08:39:24.282+0000 7f162da16800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:24.367 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-22T08:39:24.285+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaef0) adding auth protocol: cephx 2024-09-22T08:39:24.367 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-22T08:39:24.285+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaef0) adding auth protocol: cephx 2024-09-22T08:39:24.367 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-22T08:39:24.285+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaef0) adding auth protocol: cephx 2024-09-22T08:39:24.367 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-22T08:39:24.285+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaef0) adding con mode: secure 2024-09-22T08:39:24.367 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-22T08:39:24.285+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaef0) adding con mode: crc 2024-09-22T08:39:24.367 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-22T08:39:24.285+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaef0) adding con mode: secure 2024-09-22T08:39:24.367 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-22T08:39:24.285+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaef0) adding con mode: crc 2024-09-22T08:39:24.367 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-22T08:39:24.285+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaef0) adding con mode: secure 2024-09-22T08:39:24.367 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-22T08:39:24.285+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaef0) adding con mode: crc 2024-09-22T08:39:24.367 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-22T08:39:24.285+0000 7f14dffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:24.367 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-22T08:39:24.285+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaef0) adding con mode: crc 2024-09-22T08:39:24.367 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-22T08:39:24.285+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaef0) adding con mode: secure 2024-09-22T08:39:24.368 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-22T08:39:24.285+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaef0) adding con mode: crc 2024-09-22T08:39:24.368 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-22T08:39:24.285+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaef0) adding con mode: secure 2024-09-22T08:39:24.368 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-22T08:39:24.285+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaef0) adding con mode: crc 2024-09-22T08:39:24.368 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-22T08:39:24.285+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaef0) adding con mode: secure 2024-09-22T08:39:24.368 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-22T08:39:24.285+0000 7f162da16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:24.368 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-22T08:39:24.285+0000 7f162da16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:24.368 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-22T08:39:24.285+0000 7f162da16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:24.368 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-22T08:39:24.285+0000 7f162da16800 5 asok(0x56456b76e0f0) register_command cache list hook 0x56456ba32030 2024-09-22T08:39:24.368 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-22T08:39:24.285+0000 7f162da16800 5 asok(0x56456b76e0f0) register_command cache inspect hook 0x56456ba32030 2024-09-22T08:39:24.368 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-22T08:39:24.285+0000 7f162da16800 5 asok(0x56456b76e0f0) register_command cache erase hook 0x56456ba32030 2024-09-22T08:39:24.368 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-22T08:39:24.285+0000 7f162da16800 5 asok(0x56456b76e0f0) register_command cache zap hook 0x56456ba32030 2024-09-22T08:39:24.368 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-22T08:39:24.285+0000 7f162da16800 5 note: GC not initialized 2024-09-22T08:39:24.368 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-22T08:39:24.285+0000 7f14defe5640 20 reqs_thread_entry: start 2024-09-22T08:39:24.368 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-22T08:39:24.285+0000 7f162da16800 5 asok(0x56456b76e0f0) register_command sync trace show hook 0x7f16140728d0 2024-09-22T08:39:24.368 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-22T08:39:24.285+0000 7f162da16800 5 asok(0x56456b76e0f0) register_command sync trace history hook 0x7f16140728d0 2024-09-22T08:39:24.369 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-22T08:39:24.285+0000 7f162da16800 5 asok(0x56456b76e0f0) register_command sync trace active hook 0x7f16140728d0 2024-09-22T08:39:24.369 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-22T08:39:24.285+0000 7f162da16800 5 asok(0x56456b76e0f0) register_command sync trace active_short hook 0x7f16140728d0 2024-09-22T08:39:24.369 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-22T08:39:24.285+0000 7f162da16800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:24.369 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-22T08:39:24.286+0000 7f162da16800 20 Filter name: none 2024-09-22T08:39:24.369 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-22T08:39:24.286+0000 7f14dcfe1640 20 reqs_thread_entry: start 2024-09-22T08:39:24.369 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-22T08:39:24.286+0000 7f162da16800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:39:24.369 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-22T08:39:24.286+0000 7f162da16800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.369 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-22T08:39:24.286+0000 7f162da16800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:39:24.369 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-22T08:39:24.286+0000 7f162da16800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:39:24.369 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-22T08:39:24.286+0000 7f162da16800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:39:24.369 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-22T08:39:24.286+0000 7f162da16800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 : miss 2024-09-22T08:39:24.369 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-22T08:39:24.286+0000 7f162da16800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.369 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-22T08:39:24.287+0000 7f162da16800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T08:39:24.369 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-22T08:39:24.287+0000 7f162da16800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:39:24.370 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-22T08:39:24.287+0000 7f162da16800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:39:24.370 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-22T08:39:24.287+0000 7f162da16800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:39:24.370 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-22T08:39:24.287+0000 7f162da16800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:39:24.370 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-22T08:39:24.287+0000 7f162da16800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 2024-09-22T08:39:24.370 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-22T08:39:24.288+0000 7f162da16800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-22T08:39:24.370 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-22T08:39:24.298+0000 7f162da16800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:39:24.370 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-22T08:39:24.298+0000 7f162da16800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:39:24.370 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-22T08:39:24.298+0000 7f162da16800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:39:24.370 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-22T08:39:24.298+0000 7f162da16800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17, ofs0, ns] 2024-09-22T08:39:24.370 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-22T08:39:24.298+0000 7f14fffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497038 cookie 94856158960432 notifier 8259 bl.length()=827 2024-09-22T08:39:24.370 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-22T08:39:24.298+0000 7f14fffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:39:24.370 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-22T08:39:24.298+0000 7f14fffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:39:24.370 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-22T08:39:24.298+0000 7f14fffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:39:24.370 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-22T08:39:24.298+0000 7f162da16800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_sources= new_sources= 2024-09-22T08:39:24.371 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-22T08:39:24.298+0000 7f162da16800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential sources added=[] removed=[] 2024-09-22T08:39:24.371 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-22T08:39:24.298+0000 7f162da16800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_dests= new_dests= 2024-09-22T08:39:24.371 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-22T08:39:24.298+0000 7f162da16800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential dests added=[] removed=[] 2024-09-22T08:39:24.371 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-22T08:39:24.305+0000 7f162da16800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f162da16800 time 2024-09-22T08:39:24.305202+0000 2024-09-22T08:39:24.371 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:39:24.371 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:24.371 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:39:24.371 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f162eb8c748] 2024-09-22T08:39:24.371 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f162eb8c906] 2024-09-22T08:39:24.371 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564568db8e01] 2024-09-22T08:39:24.371 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564568dc8d0a] 2024-09-22T08:39:24.371 INFO:tasks.workunit.client.0.smithi038.stderr: 5: main() 2024-09-22T08:39:24.371 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f162d829590] 2024-09-22T08:39:24.372 INFO:tasks.workunit.client.0.smithi038.stderr: 7: __libc_start_main() 2024-09-22T08:39:24.372 INFO:tasks.workunit.client.0.smithi038.stderr: 8: _start() 2024-09-22T08:39:24.372 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:24.372 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-22T08:39:24.305+0000 7f162da16800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:39:24.372 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f162da16800 thread_name:radosgw-admin 2024-09-22T08:39:24.372 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:24.372 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:39:24.372 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f162d83e6f0] 2024-09-22T08:39:24.372 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f162d88b99c] 2024-09-22T08:39:24.372 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:39:24.372 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:39:24.372 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f162eb8c7a2] 2024-09-22T08:39:24.372 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f162eb8c906] 2024-09-22T08:39:24.372 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564568db8e01] 2024-09-22T08:39:24.372 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564568dc8d0a] 2024-09-22T08:39:24.373 INFO:tasks.workunit.client.0.smithi038.stderr: 9: main() 2024-09-22T08:39:24.373 INFO:tasks.workunit.client.0.smithi038.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f162d829590] 2024-09-22T08:39:24.373 INFO:tasks.workunit.client.0.smithi038.stderr: 11: __libc_start_main() 2024-09-22T08:39:24.373 INFO:tasks.workunit.client.0.smithi038.stderr: 12: _start() 2024-09-22T08:39:24.373 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:39:24.373 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:24.373 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-22T08:39:24.373 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-22T08:39:24.373 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-22T08:39:24.373 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-22T08:39:24.373 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-22T08:39:24.373 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-22T08:39:24.373 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-22T08:39:24.373 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-22T08:39:24.373 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-22T08:39:24.374 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-22T08:39:24.374 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-22T08:39:24.374 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-22T08:39:24.374 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-22T08:39:24.374 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-22T08:39:24.374 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-22T08:39:24.374 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-22T08:39:24.374 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-22T08:39:24.374 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-22T08:39:24.374 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-22T08:39:24.374 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-22T08:39:24.374 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-22T08:39:24.374 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-22T08:39:24.374 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-22T08:39:24.374 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-22T08:39:24.375 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:39:24.375 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-22T08:39:24.375 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-22T08:39:24.375 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-22T08:39:24.375 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-22T08:39:24.375 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-22T08:39:24.375 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-22T08:39:24.375 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-22T08:39:24.375 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-22T08:39:24.375 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-22T08:39:24.375 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-22T08:39:24.375 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-22T08:39:24.375 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-22T08:39:24.375 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-22T08:39:24.376 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-22T08:39:24.376 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-22T08:39:24.376 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-22T08:39:24.376 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-22T08:39:24.376 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-22T08:39:24.376 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-22T08:39:24.376 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-22T08:39:24.376 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-22T08:39:24.376 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:39:24.376 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-22T08:39:24.376 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:39:24.376 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-22T08:39:24.376 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-22T08:39:24.377 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-22T08:39:24.377 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-22T08:39:24.377 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-22T08:39:24.377 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-22T08:39:24.377 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-22T08:39:24.377 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-22T08:39:24.377 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-22T08:39:24.377 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-22T08:39:24.377 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-22T08:39:24.377 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-22T08:39:24.377 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-22T08:39:24.377 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-22T08:39:24.377 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-22T08:39:24.377 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-22T08:39:24.377 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-22T08:39:24.378 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-22T08:39:24.378 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:39:24.378 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-22T08:39:24.378 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:39:24.378 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-22T08:39:24.378 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-22T08:39:24.378 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-22T08:39:24.378 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-22T08:39:24.378 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-22T08:39:24.378 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-22T08:39:24.378 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:39:24.378 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-22T08:39:24.378 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-22T08:39:24.378 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:39:24.379 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-22T08:39:24.379 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-22T08:39:24.379 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-22T08:39:24.379 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-22T08:39:24.379 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-22T08:39:24.379 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-22T08:39:24.379 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-22T08:39:24.379 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-22T08:39:24.379 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-22T08:39:24.379 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-22T08:39:24.379 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-22T08:39:24.379 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-22T08:39:24.379 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-22T08:39:24.379 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:39:24.379 INFO:tasks.workunit.client.0.smithi038.stderr: 7f14dcfe1640 / http_manager 2024-09-22T08:39:24.380 INFO:tasks.workunit.client.0.smithi038.stderr: 7f14defe5640 / http_manager 2024-09-22T08:39:24.380 INFO:tasks.workunit.client.0.smithi038.stderr: 7f14dffe7640 / rgw_dt_lg_renew 2024-09-22T08:39:24.380 INFO:tasks.workunit.client.0.smithi038.stderr: 7f14feffd640 / ms_dispatch 2024-09-22T08:39:24.380 INFO:tasks.workunit.client.0.smithi038.stderr: 7f14fffff640 / io_context_pool 2024-09-22T08:39:24.380 INFO:tasks.workunit.client.0.smithi038.stderr: 7f150cff9640 / io_context_pool 2024-09-22T08:39:24.380 INFO:tasks.workunit.client.0.smithi038.stderr: 7f150effd640 / ms_dispatch 2024-09-22T08:39:24.380 INFO:tasks.workunit.client.0.smithi038.stderr: 7f1515e03640 / ms_dispatch 2024-09-22T08:39:24.380 INFO:tasks.workunit.client.0.smithi038.stderr: 7f1517606640 / io_context_pool 2024-09-22T08:39:24.380 INFO:tasks.workunit.client.0.smithi038.stderr: 7f16209e6640 / msgr-worker-2 2024-09-22T08:39:24.380 INFO:tasks.workunit.client.0.smithi038.stderr: 7f16291e7640 / msgr-worker-1 2024-09-22T08:39:24.380 INFO:tasks.workunit.client.0.smithi038.stderr: 7f16299e8640 / msgr-worker-0 2024-09-22T08:39:24.380 INFO:tasks.workunit.client.0.smithi038.stderr: 7f162a1e9640 / io_context_pool 2024-09-22T08:39:24.380 INFO:tasks.workunit.client.0.smithi038.stderr: 7f162da16800 / radosgw-admin 2024-09-22T08:39:24.380 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-22T08:39:24.380 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-22T08:39:24.381 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/log/ceph/ceph-client.admin.152823.log 2024-09-22T08:39:24.381 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-22T08:39:24.381 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-22T08:39:24.381 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-22T08:39:24.031+0000 7f162da16800 10 monclient: shutdown 2024-09-22T08:39:24.381 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-22T08:39:24.031+0000 7f162da16800 5 asok(0x56456b76e0f0) unregister_commands rotate-key 2024-09-22T08:39:24.381 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-22T08:39:24.032+0000 7f162da16800 10 monclient: build_initial_monmap 2024-09-22T08:39:24.381 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-22T08:39:24.032+0000 7f162da16800 1 build_initial for_mkfs: 0 2024-09-22T08:39:24.381 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-22T08:39:24.032+0000 7f162da16800 10 monclient: monmap: 2024-09-22T08:39:24.381 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:39:24.381 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:39:24.381 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:39:24.381 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:39:24.381 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:39:24.381 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:39:24.381 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:39:24.382 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:39:24.382 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:39:24.382 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:24.382 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b995630) adding auth protocol: cephx 2024-09-22T08:39:24.382 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b995630) adding auth protocol: cephx 2024-09-22T08:39:24.382 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b995630) adding auth protocol: cephx 2024-09-22T08:39:24.382 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b995630) adding con mode: secure 2024-09-22T08:39:24.382 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b995630) adding con mode: crc 2024-09-22T08:39:24.382 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b995630) adding con mode: secure 2024-09-22T08:39:24.382 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b995630) adding con mode: crc 2024-09-22T08:39:24.382 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b995630) adding con mode: secure 2024-09-22T08:39:24.382 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b995630) adding con mode: crc 2024-09-22T08:39:24.383 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b995630) adding con mode: crc 2024-09-22T08:39:24.383 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b995630) adding con mode: secure 2024-09-22T08:39:24.383 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b995630) adding con mode: crc 2024-09-22T08:39:24.383 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b995630) adding con mode: secure 2024-09-22T08:39:24.383 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b995630) adding con mode: crc 2024-09-22T08:39:24.383 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b995630) adding con mode: secure 2024-09-22T08:39:24.383 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-22T08:39:24.032+0000 7f162da16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:24.383 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-22T08:39:24.032+0000 7f162da16800 1 librados: starting msgr at 2024-09-22T08:39:24.383 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-22T08:39:24.032+0000 7f162da16800 1 librados: starting objecter 2024-09-22T08:39:24.383 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-22T08:39:24.032+0000 7f162da16800 5 asok(0x56456b76e0f0) register_command objecter_requests hook 0x56456b994dd0 2024-09-22T08:39:24.383 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-22T08:39:24.032+0000 7f162da16800 1 librados: setting wanted keys 2024-09-22T08:39:24.383 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-22T08:39:24.032+0000 7f162da16800 1 librados: calling monclient init 2024-09-22T08:39:24.383 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-22T08:39:24.032+0000 7f162da16800 10 monclient: init 2024-09-22T08:39:24.383 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b990070) adding auth protocol: cephx 2024-09-22T08:39:24.383 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b990070) adding auth protocol: cephx 2024-09-22T08:39:24.384 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b990070) adding auth protocol: cephx 2024-09-22T08:39:24.384 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b990070) adding con mode: secure 2024-09-22T08:39:24.384 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b990070) adding con mode: crc 2024-09-22T08:39:24.384 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b990070) adding con mode: secure 2024-09-22T08:39:24.384 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b990070) adding con mode: crc 2024-09-22T08:39:24.384 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b990070) adding con mode: secure 2024-09-22T08:39:24.384 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b990070) adding con mode: crc 2024-09-22T08:39:24.384 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b990070) adding con mode: crc 2024-09-22T08:39:24.384 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b990070) adding con mode: secure 2024-09-22T08:39:24.384 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b990070) adding con mode: crc 2024-09-22T08:39:24.384 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b990070) adding con mode: secure 2024-09-22T08:39:24.384 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b990070) adding con mode: crc 2024-09-22T08:39:24.384 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-22T08:39:24.032+0000 7f162da16800 5 AuthRegistry(0x56456b990070) adding con mode: secure 2024-09-22T08:39:24.384 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-22T08:39:24.032+0000 7f162da16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:24.384 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-22T08:39:24.032+0000 7f162da16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:24.385 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-22T08:39:24.032+0000 7f162da16800 5 asok(0x56456b76e0f0) register_command rotate-key hook 0x56456b9901b8 2024-09-22T08:39:24.385 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-22T08:39:24.033+0000 7f162da16800 10 monclient: _reopen_session rank -1 2024-09-22T08:39:24.385 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-22T08:39:24.033+0000 7f162da16800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T08:39:24.385 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-22T08:39:24.033+0000 7f162da16800 10 monclient(hunting): picked mon.noname-a con 0x56456b8d2830 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:39:24.385 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-22T08:39:24.033+0000 7f162da16800 10 monclient(hunting): picked mon.noname-c con 0x56456b8d58f0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:39:24.385 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-22T08:39:24.033+0000 7f162da16800 10 monclient(hunting): picked mon.noname-b con 0x56456b8d89e0 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:39:24.385 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-22T08:39:24.033+0000 7f162da16800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:24.385 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-22T08:39:24.033+0000 7f162da16800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:24.385 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-22T08:39:24.033+0000 7f162da16800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:24.385 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-22T08:39:24.033+0000 7f162da16800 10 monclient(hunting): _renew_subs 2024-09-22T08:39:24.385 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-22T08:39:24.033+0000 7f162da16800 10 monclient(hunting): authenticate will time out at 2269.272061s 2024-09-22T08:39:24.385 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-22T08:39:24.033+0000 7f16291e7640 10 monclient(hunting): get_auth_request con 0x56456b8d2830 auth_method 0 2024-09-22T08:39:24.385 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-22T08:39:24.033+0000 7f16291e7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:24.385 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-22T08:39:24.033+0000 7f16291e7640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:24.385 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-22T08:39:24.033+0000 7f16291e7640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:24.386 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-22T08:39:24.033+0000 7f16209e6640 10 monclient(hunting): get_auth_request con 0x56456b8d58f0 auth_method 0 2024-09-22T08:39:24.386 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-22T08:39:24.033+0000 7f16209e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:24.386 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-22T08:39:24.033+0000 7f16209e6640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:24.386 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-22T08:39:24.033+0000 7f16209e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:24.386 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-22T08:39:24.033+0000 7f16291e7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:24.386 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-22T08:39:24.033+0000 7f16291e7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:24.386 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-22T08:39:24.033+0000 7f16291e7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:24.386 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-22T08:39:24.033+0000 7f16209e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:24.386 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-22T08:39:24.033+0000 7f16209e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:24.386 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-22T08:39:24.033+0000 7f16209e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:24.387 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-22T08:39:24.033+0000 7f16299e8640 10 monclient(hunting): get_auth_request con 0x56456b8d89e0 auth_method 0 2024-09-22T08:39:24.387 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-22T08:39:24.033+0000 7f16299e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:24.387 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-22T08:39:24.033+0000 7f16299e8640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:24.387 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-22T08:39:24.033+0000 7f16299e8640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:24.387 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-22T08:39:24.033+0000 7f16299e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:24.387 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-22T08:39:24.033+0000 7f16299e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:24.387 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-22T08:39:24.033+0000 7f16299e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:24.387 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-22T08:39:24.033+0000 7f16291e7640 10 monclient(hunting): handle_auth_done global_id 8250 payload 824 2024-09-22T08:39:24.387 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-22T08:39:24.033+0000 7f16291e7640 10 monclient: _finish_hunting 0 2024-09-22T08:39:24.387 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-22T08:39:24.033+0000 7f16291e7640 1 monclient: found mon.noname-a 2024-09-22T08:39:24.387 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-22T08:39:24.033+0000 7f16291e7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:39:24.387 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-22T08:39:24.033+0000 7f1515e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:24.387 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-22T08:39:24.033+0000 7f1515e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:39:24.387 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-22T08:39:24.033+0000 7f1515e03640 10 monclient: dump: 2024-09-22T08:39:24.388 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:39:24.388 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:39:24.388 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:39:24.388 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:39:24.388 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:24.388 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:39:24.388 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:39:24.388 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:39:24.388 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:39:24.388 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:24.388 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-22T08:39:24.033+0000 7f1515e03640 10 monclient: _finish_auth 0 2024-09-22T08:39:24.388 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-22T08:39:24.033+0000 7f1515e03640 10 monclient: _check_auth_tickets 2024-09-22T08:39:24.388 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-22T08:39:24.033+0000 7f162da16800 5 monclient: authenticate success, global_id 8250 2024-09-22T08:39:24.388 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-22T08:39:24.033+0000 7f162da16800 10 monclient: _renew_subs 2024-09-22T08:39:24.389 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-22T08:39:24.033+0000 7f162da16800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:39:24.389 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-22T08:39:24.033+0000 7f1515e03640 10 monclient: handle_config config(0 keys) 2024-09-22T08:39:24.389 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-22T08:39:24.033+0000 7f1515e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:24.389 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-22T08:39:24.033+0000 7f1515e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:39:24.389 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-22T08:39:24.033+0000 7f1515e03640 10 monclient: dump: 2024-09-22T08:39:24.389 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:39:24.389 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:39:24.389 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:39:24.389 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:39:24.389 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:24.389 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:39:24.389 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:39:24.389 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:39:24.389 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:39:24.389 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:24.390 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-22T08:39:24.033+0000 7f1517606640 4 set_mon_vals no callback set 2024-09-22T08:39:24.390 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-22T08:39:24.033+0000 7f162da16800 10 monclient: _renew_subs 2024-09-22T08:39:24.390 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-22T08:39:24.033+0000 7f162da16800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:39:24.390 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-22T08:39:24.033+0000 7f162da16800 1 librados: init done 2024-09-22T08:39:24.390 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-22T08:39:24.035+0000 7f1515e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:39:24.390 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-22T08:39:24.035+0000 7f1515e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:39:24.390 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-22T08:39:24.035+0000 7f1515e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:39:24.390 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-22T08:39:24.036+0000 7f16209e6640 10 monclient: get_auth_request con 0x7f15100775a0 auth_method 0 2024-09-22T08:39:24.390 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-22T08:39:24.036+0000 7f16299e8640 10 monclient: get_auth_request con 0x56456b9d8600 auth_method 0 2024-09-22T08:39:24.390 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-22T08:39:24.037+0000 7f16291e7640 10 monclient: get_auth_request con 0x56456b9db7e0 auth_method 0 2024-09-22T08:39:24.390 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-22T08:39:24.037+0000 7f16209e6640 10 monclient: get_auth_request con 0x56456b9dfb40 auth_method 0 2024-09-22T08:39:24.390 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-22T08:39:24.039+0000 7f16299e8640 10 monclient: get_auth_request con 0x56456b9df040 auth_method 0 2024-09-22T08:39:24.390 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-22T08:39:24.039+0000 7f162da16800 10 monclient: build_initial_monmap 2024-09-22T08:39:24.390 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-22T08:39:24.039+0000 7f162da16800 1 build_initial for_mkfs: 0 2024-09-22T08:39:24.391 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-22T08:39:24.039+0000 7f162da16800 10 monclient: monmap: 2024-09-22T08:39:24.391 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:39:24.391 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:39:24.391 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:39:24.391 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:39:24.391 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:39:24.391 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:39:24.391 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:39:24.391 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:39:24.391 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:39:24.391 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:24.391 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-22T08:39:24.039+0000 7f162da16800 5 AuthRegistry(0x56456b9e7b60) adding auth protocol: cephx 2024-09-22T08:39:24.391 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-22T08:39:24.039+0000 7f162da16800 5 AuthRegistry(0x56456b9e7b60) adding auth protocol: cephx 2024-09-22T08:39:24.391 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-22T08:39:24.039+0000 7f162da16800 5 AuthRegistry(0x56456b9e7b60) adding auth protocol: cephx 2024-09-22T08:39:24.391 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-22T08:39:24.039+0000 7f162da16800 5 AuthRegistry(0x56456b9e7b60) adding con mode: secure 2024-09-22T08:39:24.392 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-22T08:39:24.039+0000 7f162da16800 5 AuthRegistry(0x56456b9e7b60) adding con mode: crc 2024-09-22T08:39:24.392 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-22T08:39:24.039+0000 7f162da16800 5 AuthRegistry(0x56456b9e7b60) adding con mode: secure 2024-09-22T08:39:24.392 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-22T08:39:24.039+0000 7f162da16800 5 AuthRegistry(0x56456b9e7b60) adding con mode: crc 2024-09-22T08:39:24.392 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-22T08:39:24.039+0000 7f162da16800 5 AuthRegistry(0x56456b9e7b60) adding con mode: secure 2024-09-22T08:39:24.392 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-22T08:39:24.039+0000 7f162da16800 5 AuthRegistry(0x56456b9e7b60) adding con mode: crc 2024-09-22T08:39:24.392 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-22T08:39:24.039+0000 7f162da16800 5 AuthRegistry(0x56456b9e7b60) adding con mode: crc 2024-09-22T08:39:24.392 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-22T08:39:24.039+0000 7f162da16800 5 AuthRegistry(0x56456b9e7b60) adding con mode: secure 2024-09-22T08:39:24.392 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-22T08:39:24.039+0000 7f162da16800 5 AuthRegistry(0x56456b9e7b60) adding con mode: crc 2024-09-22T08:39:24.392 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-22T08:39:24.039+0000 7f162da16800 5 AuthRegistry(0x56456b9e7b60) adding con mode: secure 2024-09-22T08:39:24.392 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-22T08:39:24.039+0000 7f162da16800 5 AuthRegistry(0x56456b9e7b60) adding con mode: crc 2024-09-22T08:39:24.392 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-22T08:39:24.039+0000 7f162da16800 5 AuthRegistry(0x56456b9e7b60) adding con mode: secure 2024-09-22T08:39:24.392 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-22T08:39:24.040+0000 7f162da16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:24.392 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-22T08:39:24.040+0000 7f162da16800 5 asok(0x56456b76e0f0) register_command objecter_requests cmddesc objecter_requests hook 0x56456b9eb520 EEXIST 2024-09-22T08:39:24.392 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-22T08:39:24.040+0000 7f162da16800 10 monclient: init 2024-09-22T08:39:24.393 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-22T08:39:24.040+0000 7f162da16800 5 AuthRegistry(0x56456b9e6ba8) adding auth protocol: cephx 2024-09-22T08:39:24.393 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-22T08:39:24.040+0000 7f162da16800 5 AuthRegistry(0x56456b9e6ba8) adding auth protocol: cephx 2024-09-22T08:39:24.393 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-22T08:39:24.040+0000 7f162da16800 5 AuthRegistry(0x56456b9e6ba8) adding auth protocol: cephx 2024-09-22T08:39:24.393 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-22T08:39:24.040+0000 7f162da16800 5 AuthRegistry(0x56456b9e6ba8) adding con mode: secure 2024-09-22T08:39:24.393 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-22T08:39:24.040+0000 7f162da16800 5 AuthRegistry(0x56456b9e6ba8) adding con mode: crc 2024-09-22T08:39:24.393 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-22T08:39:24.040+0000 7f162da16800 5 AuthRegistry(0x56456b9e6ba8) adding con mode: secure 2024-09-22T08:39:24.393 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-22T08:39:24.040+0000 7f162da16800 5 AuthRegistry(0x56456b9e6ba8) adding con mode: crc 2024-09-22T08:39:24.393 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-22T08:39:24.040+0000 7f162da16800 5 AuthRegistry(0x56456b9e6ba8) adding con mode: secure 2024-09-22T08:39:24.393 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-22T08:39:24.040+0000 7f162da16800 5 AuthRegistry(0x56456b9e6ba8) adding con mode: crc 2024-09-22T08:39:24.393 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-22T08:39:24.040+0000 7f162da16800 5 AuthRegistry(0x56456b9e6ba8) adding con mode: crc 2024-09-22T08:39:24.393 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-22T08:39:24.040+0000 7f162da16800 5 AuthRegistry(0x56456b9e6ba8) adding con mode: secure 2024-09-22T08:39:24.393 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-22T08:39:24.040+0000 7f162da16800 5 AuthRegistry(0x56456b9e6ba8) adding con mode: crc 2024-09-22T08:39:24.393 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-22T08:39:24.040+0000 7f162da16800 5 AuthRegistry(0x56456b9e6ba8) adding con mode: secure 2024-09-22T08:39:24.393 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-22T08:39:24.040+0000 7f162da16800 5 AuthRegistry(0x56456b9e6ba8) adding con mode: crc 2024-09-22T08:39:24.394 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-22T08:39:24.040+0000 7f162da16800 5 AuthRegistry(0x56456b9e6ba8) adding con mode: secure 2024-09-22T08:39:24.394 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-22T08:39:24.040+0000 7f162da16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:24.394 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-22T08:39:24.040+0000 7f162da16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:24.394 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-22T08:39:24.040+0000 7f162da16800 5 asok(0x56456b76e0f0) register_command rotate-key cmddesc rotate-key hook 0x56456b9e6cf0 EEXIST 2024-09-22T08:39:24.394 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-22T08:39:24.040+0000 7f162da16800 10 monclient: _reopen_session rank -1 2024-09-22T08:39:24.394 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-22T08:39:24.040+0000 7f162da16800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T08:39:24.394 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-22T08:39:24.040+0000 7f162da16800 10 monclient(hunting): picked mon.noname-b con 0x56456ba0f210 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:39:24.394 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-22T08:39:24.040+0000 7f162da16800 10 monclient(hunting): picked mon.noname-a con 0x56456ba114e0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:39:24.394 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-22T08:39:24.040+0000 7f162da16800 10 monclient(hunting): picked mon.noname-c con 0x56456ba0d9e0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:39:24.394 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-22T08:39:24.040+0000 7f162da16800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:24.394 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-22T08:39:24.040+0000 7f162da16800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:24.394 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-22T08:39:24.040+0000 7f162da16800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:24.394 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-22T08:39:24.040+0000 7f162da16800 10 monclient(hunting): _renew_subs 2024-09-22T08:39:24.394 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-22T08:39:24.040+0000 7f162da16800 10 monclient(hunting): authenticate will time out at 2269.279951s 2024-09-22T08:39:24.395 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-22T08:39:24.041+0000 7f16299e8640 10 monclient(hunting): get_auth_request con 0x56456ba114e0 auth_method 0 2024-09-22T08:39:24.395 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-22T08:39:24.041+0000 7f16299e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:24.395 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-22T08:39:24.041+0000 7f16299e8640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:24.395 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-22T08:39:24.041+0000 7f16299e8640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:24.395 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-22T08:39:24.041+0000 7f16291e7640 10 monclient(hunting): get_auth_request con 0x56456ba0d9e0 auth_method 0 2024-09-22T08:39:24.395 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-22T08:39:24.041+0000 7f16291e7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:24.395 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-22T08:39:24.041+0000 7f16291e7640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:24.395 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-22T08:39:24.041+0000 7f16291e7640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:24.395 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-22T08:39:24.041+0000 7f16299e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:24.395 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-22T08:39:24.041+0000 7f16299e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:24.395 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-22T08:39:24.041+0000 7f16299e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:24.395 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-22T08:39:24.041+0000 7f16209e6640 10 monclient(hunting): get_auth_request con 0x56456ba0f210 auth_method 0 2024-09-22T08:39:24.395 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-22T08:39:24.041+0000 7f16209e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:24.395 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-22T08:39:24.041+0000 7f16209e6640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:24.395 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-22T08:39:24.041+0000 7f16209e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:24.396 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-22T08:39:24.041+0000 7f16291e7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:24.396 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-22T08:39:24.041+0000 7f16291e7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:24.396 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-22T08:39:24.041+0000 7f16291e7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:24.396 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-22T08:39:24.041+0000 7f16209e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:24.396 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-22T08:39:24.041+0000 7f16209e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:24.396 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-22T08:39:24.041+0000 7f16209e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:24.396 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-22T08:39:24.041+0000 7f16299e8640 10 monclient(hunting): handle_auth_done global_id 8253 payload 824 2024-09-22T08:39:24.396 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-22T08:39:24.041+0000 7f16299e8640 10 monclient: _finish_hunting 0 2024-09-22T08:39:24.396 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-22T08:39:24.041+0000 7f16299e8640 1 monclient: found mon.noname-a 2024-09-22T08:39:24.396 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-22T08:39:24.041+0000 7f16299e8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:39:24.396 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-22T08:39:24.041+0000 7f150effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:24.396 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-22T08:39:24.041+0000 7f150effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:39:24.397 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-22T08:39:24.041+0000 7f150effd640 10 monclient: dump: 2024-09-22T08:39:24.397 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:39:24.397 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:39:24.397 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:39:24.397 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:39:24.397 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:24.397 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:39:24.397 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:39:24.397 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:39:24.397 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:39:24.397 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:24.397 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-22T08:39:24.041+0000 7f150effd640 10 monclient: _finish_auth 0 2024-09-22T08:39:24.398 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-22T08:39:24.041+0000 7f150effd640 10 monclient: _check_auth_tickets 2024-09-22T08:39:24.398 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-22T08:39:24.041+0000 7f150effd640 10 monclient: handle_config config(0 keys) 2024-09-22T08:39:24.398 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-22T08:39:24.041+0000 7f150effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:24.398 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-22T08:39:24.041+0000 7f150effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:39:24.398 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-22T08:39:24.041+0000 7f150effd640 10 monclient: dump: 2024-09-22T08:39:24.398 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:39:24.398 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:39:24.398 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:39:24.398 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:39:24.398 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:24.398 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:39:24.398 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:39:24.398 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:39:24.398 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:39:24.398 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:24.399 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-22T08:39:24.041+0000 7f162da16800 5 monclient: authenticate success, global_id 8253 2024-09-22T08:39:24.399 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-22T08:39:24.041+0000 7f162da16800 10 monclient: _renew_subs 2024-09-22T08:39:24.399 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-22T08:39:24.041+0000 7f162da16800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:39:24.399 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-22T08:39:24.041+0000 7f162a1e9640 4 set_mon_vals no callback set 2024-09-22T08:39:24.399 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-22T08:39:24.041+0000 7f162da16800 10 monclient: _renew_subs 2024-09-22T08:39:24.399 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-22T08:39:24.041+0000 7f162da16800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:39:24.399 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-22T08:39:24.043+0000 7f150effd640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:39:24.399 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-22T08:39:24.043+0000 7f150effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:39:24.399 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-22T08:39:24.043+0000 7f150effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:39:24.399 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-22T08:39:24.044+0000 7f16209e6640 10 monclient: get_auth_request con 0x7f1500077480 auth_method 0 2024-09-22T08:39:24.399 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-22T08:39:24.044+0000 7f162da16800 10 monclient: get_monmap_and_config 2024-09-22T08:39:24.399 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-22T08:39:24.044+0000 7f162da16800 10 monclient: build_initial_monmap 2024-09-22T08:39:24.399 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-22T08:39:24.044+0000 7f162da16800 1 build_initial for_mkfs: 0 2024-09-22T08:39:24.399 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-22T08:39:24.044+0000 7f162da16800 10 monclient: monmap: 2024-09-22T08:39:24.400 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:39:24.400 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:39:24.400 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:39:24.400 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:39:24.400 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:39:24.400 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:39:24.400 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:39:24.400 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:39:24.400 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:39:24.400 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:24.400 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x56456ba2f0f0) adding auth protocol: cephx 2024-09-22T08:39:24.400 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x56456ba2f0f0) adding auth protocol: cephx 2024-09-22T08:39:24.400 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x56456ba2f0f0) adding auth protocol: cephx 2024-09-22T08:39:24.400 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x56456ba2f0f0) adding con mode: secure 2024-09-22T08:39:24.401 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x56456ba2f0f0) adding con mode: crc 2024-09-22T08:39:24.401 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x56456ba2f0f0) adding con mode: secure 2024-09-22T08:39:24.401 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x56456ba2f0f0) adding con mode: crc 2024-09-22T08:39:24.401 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x56456ba2f0f0) adding con mode: secure 2024-09-22T08:39:24.401 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x56456ba2f0f0) adding con mode: crc 2024-09-22T08:39:24.401 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x56456ba2f0f0) adding con mode: crc 2024-09-22T08:39:24.401 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x56456ba2f0f0) adding con mode: secure 2024-09-22T08:39:24.401 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x56456ba2f0f0) adding con mode: crc 2024-09-22T08:39:24.401 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x56456ba2f0f0) adding con mode: secure 2024-09-22T08:39:24.401 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x56456ba2f0f0) adding con mode: crc 2024-09-22T08:39:24.401 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x56456ba2f0f0) adding con mode: secure 2024-09-22T08:39:24.401 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-22T08:39:24.044+0000 7f162da16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:24.401 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-22T08:39:24.044+0000 7f162da16800 10 monclient: init 2024-09-22T08:39:24.402 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaa20) adding auth protocol: cephx 2024-09-22T08:39:24.402 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaa20) adding auth protocol: cephx 2024-09-22T08:39:24.402 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaa20) adding auth protocol: cephx 2024-09-22T08:39:24.402 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaa20) adding con mode: secure 2024-09-22T08:39:24.402 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaa20) adding con mode: crc 2024-09-22T08:39:24.402 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaa20) adding con mode: secure 2024-09-22T08:39:24.402 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaa20) adding con mode: crc 2024-09-22T08:39:24.402 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaa20) adding con mode: secure 2024-09-22T08:39:24.402 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaa20) adding con mode: crc 2024-09-22T08:39:24.402 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaa20) adding con mode: crc 2024-09-22T08:39:24.402 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaa20) adding con mode: secure 2024-09-22T08:39:24.402 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaa20) adding con mode: crc 2024-09-22T08:39:24.402 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaa20) adding con mode: secure 2024-09-22T08:39:24.402 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaa20) adding con mode: crc 2024-09-22T08:39:24.402 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-22T08:39:24.044+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaa20) adding con mode: secure 2024-09-22T08:39:24.403 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-22T08:39:24.045+0000 7f162da16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:24.403 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-22T08:39:24.045+0000 7f162da16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:24.403 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-22T08:39:24.045+0000 7f162da16800 5 asok(0x56456b76e0f0) register_command rotate-key cmddesc rotate-key hook 0x7fff8fbfab68 EEXIST 2024-09-22T08:39:24.403 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-22T08:39:24.045+0000 7f162da16800 10 monclient: _reopen_session rank -1 2024-09-22T08:39:24.403 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-22T08:39:24.045+0000 7f162da16800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T08:39:24.403 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-22T08:39:24.045+0000 7f162da16800 10 monclient(hunting): picked mon.noname-a con 0x56456ba636d0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:39:24.403 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-22T08:39:24.045+0000 7f162da16800 10 monclient(hunting): picked mon.noname-c con 0x56456ba5dc70 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:39:24.403 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-22T08:39:24.045+0000 7f162da16800 10 monclient(hunting): picked mon.noname-b con 0x56456ba33510 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:39:24.403 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-22T08:39:24.045+0000 7f162da16800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:24.403 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-22T08:39:24.045+0000 7f162da16800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:24.403 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-22T08:39:24.045+0000 7f162da16800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:24.403 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-22T08:39:24.045+0000 7f162da16800 10 monclient(hunting): _renew_subs 2024-09-22T08:39:24.403 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-22T08:39:24.045+0000 7f162da16800 10 monclient(hunting): authenticate will time out at 2269.284342s 2024-09-22T08:39:24.403 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-22T08:39:24.045+0000 7f16209e6640 10 monclient(hunting): get_auth_request con 0x56456ba636d0 auth_method 0 2024-09-22T08:39:24.404 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-22T08:39:24.045+0000 7f16209e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:24.404 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-22T08:39:24.045+0000 7f16209e6640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:24.404 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-22T08:39:24.045+0000 7f16209e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:24.404 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-22T08:39:24.045+0000 7f16299e8640 10 monclient(hunting): get_auth_request con 0x56456ba5dc70 auth_method 0 2024-09-22T08:39:24.404 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-22T08:39:24.045+0000 7f16299e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:24.404 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-22T08:39:24.045+0000 7f16299e8640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:24.404 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-22T08:39:24.045+0000 7f16299e8640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:24.404 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-22T08:39:24.045+0000 7f16209e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:24.404 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-22T08:39:24.045+0000 7f16209e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:24.404 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-22T08:39:24.045+0000 7f16209e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:24.404 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-22T08:39:24.045+0000 7f16299e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:24.404 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-22T08:39:24.045+0000 7f16299e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:24.404 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-22T08:39:24.045+0000 7f16299e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:24.404 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-22T08:39:24.045+0000 7f16209e6640 10 monclient(hunting): handle_auth_done global_id 8256 payload 274 2024-09-22T08:39:24.404 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-22T08:39:24.045+0000 7f16209e6640 10 monclient: _finish_hunting 0 2024-09-22T08:39:24.405 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-22T08:39:24.045+0000 7f16209e6640 1 monclient: found mon.noname-a 2024-09-22T08:39:24.405 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-22T08:39:24.045+0000 7f16209e6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:39:24.405 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-22T08:39:24.045+0000 7f16291e7640 10 monclient: get_auth_request con 0x56456ba33510 auth_method 0 2024-09-22T08:39:24.405 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-22T08:39:24.046+0000 7f150cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:24.405 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-22T08:39:24.046+0000 7f150cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:39:24.405 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-22T08:39:24.046+0000 7f150cff9640 10 monclient: dump: 2024-09-22T08:39:24.405 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:39:24.405 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:39:24.405 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:39:24.405 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:39:24.405 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:24.405 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:39:24.405 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:39:24.405 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:39:24.405 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:39:24.405 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:24.406 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-22T08:39:24.046+0000 7f150cff9640 10 monclient: _finish_auth 0 2024-09-22T08:39:24.406 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-22T08:39:24.046+0000 7f150cff9640 10 monclient: _check_auth_tickets 2024-09-22T08:39:24.406 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-22T08:39:24.046+0000 7f162da16800 5 monclient: authenticate success, global_id 8256 2024-09-22T08:39:24.406 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-22T08:39:24.046+0000 7f150cff9640 10 monclient: handle_config config(0 keys) 2024-09-22T08:39:24.406 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-22T08:39:24.046+0000 7f150cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:24.406 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-22T08:39:24.046+0000 7f150cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:39:24.406 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-22T08:39:24.046+0000 7f150cff9640 10 monclient: dump: 2024-09-22T08:39:24.406 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:39:24.406 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:39:24.406 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:39:24.406 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:39:24.406 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:24.406 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:39:24.407 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:39:24.407 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:39:24.407 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:39:24.407 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:24.407 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-22T08:39:24.046+0000 7f162da16800 10 monclient: get_monmap_and_config success 2024-09-22T08:39:24.407 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-22T08:39:24.046+0000 7f162da16800 4 set_mon_vals no callback set 2024-09-22T08:39:24.407 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-22T08:39:24.046+0000 7f162da16800 10 monclient: shutdown 2024-09-22T08:39:24.407 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-22T08:39:24.046+0000 7f162da16800 10 monclient: build_initial_monmap 2024-09-22T08:39:24.407 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-22T08:39:24.046+0000 7f162da16800 1 build_initial for_mkfs: 0 2024-09-22T08:39:24.407 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-22T08:39:24.046+0000 7f162da16800 10 monclient: monmap: 2024-09-22T08:39:24.407 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-22T08:39:24.408 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:39:24.408 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-22T08:39:24.408 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-22T08:39:24.408 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-22T08:39:24.408 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:39:24.408 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-22T08:39:24.408 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.noname-b 2024-09-22T08:39:24.408 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-22T08:39:24.408 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:24.408 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-22T08:39:24.046+0000 7f162da16800 5 AuthRegistry(0x56456ba5ec30) adding auth protocol: cephx 2024-09-22T08:39:24.408 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-22T08:39:24.046+0000 7f162da16800 5 AuthRegistry(0x56456ba5ec30) adding auth protocol: cephx 2024-09-22T08:39:24.408 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-22T08:39:24.046+0000 7f162da16800 5 AuthRegistry(0x56456ba5ec30) adding auth protocol: cephx 2024-09-22T08:39:24.408 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-22T08:39:24.046+0000 7f162da16800 5 AuthRegistry(0x56456ba5ec30) adding con mode: secure 2024-09-22T08:39:24.408 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-22T08:39:24.046+0000 7f162da16800 5 AuthRegistry(0x56456ba5ec30) adding con mode: crc 2024-09-22T08:39:24.408 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-22T08:39:24.046+0000 7f162da16800 5 AuthRegistry(0x56456ba5ec30) adding con mode: secure 2024-09-22T08:39:24.408 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-22T08:39:24.046+0000 7f162da16800 5 AuthRegistry(0x56456ba5ec30) adding con mode: crc 2024-09-22T08:39:24.409 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-22T08:39:24.046+0000 7f162da16800 5 AuthRegistry(0x56456ba5ec30) adding con mode: secure 2024-09-22T08:39:24.409 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-22T08:39:24.046+0000 7f162da16800 5 AuthRegistry(0x56456ba5ec30) adding con mode: crc 2024-09-22T08:39:24.409 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-22T08:39:24.046+0000 7f162da16800 5 AuthRegistry(0x56456ba5ec30) adding con mode: crc 2024-09-22T08:39:24.409 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-22T08:39:24.046+0000 7f162da16800 5 AuthRegistry(0x56456ba5ec30) adding con mode: secure 2024-09-22T08:39:24.409 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-22T08:39:24.046+0000 7f162da16800 5 AuthRegistry(0x56456ba5ec30) adding con mode: crc 2024-09-22T08:39:24.409 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-22T08:39:24.046+0000 7f162da16800 5 AuthRegistry(0x56456ba5ec30) adding con mode: secure 2024-09-22T08:39:24.409 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-22T08:39:24.046+0000 7f162da16800 5 AuthRegistry(0x56456ba5ec30) adding con mode: crc 2024-09-22T08:39:24.409 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-22T08:39:24.046+0000 7f162da16800 5 AuthRegistry(0x56456ba5ec30) adding con mode: secure 2024-09-22T08:39:24.409 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-22T08:39:24.046+0000 7f162da16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:24.409 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-22T08:39:24.047+0000 7f162da16800 1 librados: starting msgr at 2024-09-22T08:39:24.409 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-22T08:39:24.047+0000 7f162da16800 1 librados: starting objecter 2024-09-22T08:39:24.409 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-22T08:39:24.047+0000 7f162da16800 5 asok(0x56456b76e0f0) register_command objecter_requests cmddesc objecter_requests hook 0x56456ba5d590 EEXIST 2024-09-22T08:39:24.409 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-22T08:39:24.047+0000 7f162da16800 1 librados: setting wanted keys 2024-09-22T08:39:24.409 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-22T08:39:24.047+0000 7f162da16800 1 librados: calling monclient init 2024-09-22T08:39:24.410 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-22T08:39:24.047+0000 7f162da16800 10 monclient: init 2024-09-22T08:39:24.410 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-22T08:39:24.047+0000 7f162da16800 5 AuthRegistry(0x56456ba26fc0) adding auth protocol: cephx 2024-09-22T08:39:24.410 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-22T08:39:24.047+0000 7f162da16800 5 AuthRegistry(0x56456ba26fc0) adding auth protocol: cephx 2024-09-22T08:39:24.410 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-22T08:39:24.047+0000 7f162da16800 5 AuthRegistry(0x56456ba26fc0) adding auth protocol: cephx 2024-09-22T08:39:24.410 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-22T08:39:24.047+0000 7f162da16800 5 AuthRegistry(0x56456ba26fc0) adding con mode: secure 2024-09-22T08:39:24.410 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-22T08:39:24.047+0000 7f162da16800 5 AuthRegistry(0x56456ba26fc0) adding con mode: crc 2024-09-22T08:39:24.410 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-22T08:39:24.047+0000 7f162da16800 5 AuthRegistry(0x56456ba26fc0) adding con mode: secure 2024-09-22T08:39:24.410 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-22T08:39:24.047+0000 7f162da16800 5 AuthRegistry(0x56456ba26fc0) adding con mode: crc 2024-09-22T08:39:24.410 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-22T08:39:24.047+0000 7f162da16800 5 AuthRegistry(0x56456ba26fc0) adding con mode: secure 2024-09-22T08:39:24.410 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-22T08:39:24.047+0000 7f162da16800 5 AuthRegistry(0x56456ba26fc0) adding con mode: crc 2024-09-22T08:39:24.410 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-22T08:39:24.047+0000 7f162da16800 5 AuthRegistry(0x56456ba26fc0) adding con mode: crc 2024-09-22T08:39:24.410 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-22T08:39:24.047+0000 7f162da16800 5 AuthRegistry(0x56456ba26fc0) adding con mode: secure 2024-09-22T08:39:24.410 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-22T08:39:24.047+0000 7f162da16800 5 AuthRegistry(0x56456ba26fc0) adding con mode: crc 2024-09-22T08:39:24.410 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-22T08:39:24.047+0000 7f162da16800 5 AuthRegistry(0x56456ba26fc0) adding con mode: secure 2024-09-22T08:39:24.410 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-22T08:39:24.047+0000 7f162da16800 5 AuthRegistry(0x56456ba26fc0) adding con mode: crc 2024-09-22T08:39:24.411 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-22T08:39:24.047+0000 7f162da16800 5 AuthRegistry(0x56456ba26fc0) adding con mode: secure 2024-09-22T08:39:24.411 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-22T08:39:24.047+0000 7f162da16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:24.411 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-22T08:39:24.047+0000 7f162da16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:24.411 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-22T08:39:24.047+0000 7f162da16800 5 asok(0x56456b76e0f0) register_command rotate-key cmddesc rotate-key hook 0x56456ba27108 EEXIST 2024-09-22T08:39:24.411 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-22T08:39:24.047+0000 7f162da16800 10 monclient: _reopen_session rank -1 2024-09-22T08:39:24.411 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-22T08:39:24.047+0000 7f162da16800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T08:39:24.411 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-22T08:39:24.047+0000 7f162da16800 10 monclient(hunting): picked mon.noname-a con 0x56456ba33510 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-22T08:39:24.411 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-22T08:39:24.047+0000 7f162da16800 10 monclient(hunting): picked mon.noname-c con 0x56456ba5dc70 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-22T08:39:24.411 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-22T08:39:24.047+0000 7f162da16800 10 monclient(hunting): picked mon.noname-b con 0x56456ba636d0 addr [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-22T08:39:24.411 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-22T08:39:24.047+0000 7f162da16800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:24.411 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-22T08:39:24.047+0000 7f162da16800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:24.411 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-22T08:39:24.047+0000 7f162da16800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:24.411 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-22T08:39:24.047+0000 7f162da16800 10 monclient(hunting): _renew_subs 2024-09-22T08:39:24.411 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-22T08:39:24.047+0000 7f162da16800 10 monclient(hunting): authenticate will time out at 2269.286767s 2024-09-22T08:39:24.411 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-22T08:39:24.047+0000 7f16209e6640 10 monclient(hunting): get_auth_request con 0x56456ba33510 auth_method 0 2024-09-22T08:39:24.412 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-22T08:39:24.047+0000 7f16209e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:24.412 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-22T08:39:24.047+0000 7f16209e6640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:24.412 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-22T08:39:24.047+0000 7f16209e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:24.412 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-22T08:39:24.047+0000 7f16299e8640 10 monclient(hunting): get_auth_request con 0x56456ba5dc70 auth_method 0 2024-09-22T08:39:24.412 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-22T08:39:24.047+0000 7f16299e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:24.412 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-22T08:39:24.047+0000 7f16299e8640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:24.412 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-22T08:39:24.047+0000 7f16299e8640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:24.412 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-22T08:39:24.047+0000 7f16209e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:24.412 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-22T08:39:24.047+0000 7f16209e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:24.412 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-22T08:39:24.047+0000 7f16209e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:24.412 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-22T08:39:24.047+0000 7f16299e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:24.412 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-22T08:39:24.047+0000 7f16299e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:24.412 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-22T08:39:24.047+0000 7f16299e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:24.412 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-22T08:39:24.048+0000 7f16291e7640 10 monclient(hunting): get_auth_request con 0x56456ba636d0 auth_method 0 2024-09-22T08:39:24.413 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-22T08:39:24.048+0000 7f16291e7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:24.413 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-22T08:39:24.048+0000 7f16291e7640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:24.413 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-22T08:39:24.048+0000 7f16291e7640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:24.413 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-22T08:39:24.048+0000 7f16291e7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:24.413 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-22T08:39:24.048+0000 7f16291e7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:24.413 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-22T08:39:24.048+0000 7f16291e7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:24.413 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-22T08:39:24.048+0000 7f16209e6640 10 monclient(hunting): handle_auth_done global_id 8259 payload 824 2024-09-22T08:39:24.413 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-22T08:39:24.048+0000 7f16209e6640 10 monclient: _finish_hunting 0 2024-09-22T08:39:24.413 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-22T08:39:24.048+0000 7f16209e6640 1 monclient: found mon.noname-a 2024-09-22T08:39:24.413 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-22T08:39:24.048+0000 7f16209e6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-22T08:39:24.413 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-22T08:39:24.048+0000 7f14feffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:24.413 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-22T08:39:24.048+0000 7f14feffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:39:24.413 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-22T08:39:24.048+0000 7f14feffd640 10 monclient: dump: 2024-09-22T08:39:24.413 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:39:24.413 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:39:24.413 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:39:24.414 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:39:24.414 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:24.414 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:39:24.414 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:39:24.414 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:39:24.414 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:39:24.414 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:24.414 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-22T08:39:24.048+0000 7f14feffd640 10 monclient: _finish_auth 0 2024-09-22T08:39:24.414 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-22T08:39:24.048+0000 7f14feffd640 10 monclient: _check_auth_tickets 2024-09-22T08:39:24.414 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-22T08:39:24.048+0000 7f14feffd640 10 monclient: handle_config config(0 keys) 2024-09-22T08:39:24.414 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-22T08:39:24.048+0000 7f14feffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:24.414 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-22T08:39:24.048+0000 7f14feffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:39:24.414 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-22T08:39:24.048+0000 7f14feffd640 10 monclient: dump: 2024-09-22T08:39:24.414 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-22T08:39:24.414 INFO:tasks.workunit.client.0.smithi038.stderr:fsid a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f 2024-09-22T08:39:24.415 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-22T08:13:50.829383+0000 2024-09-22T08:39:24.415 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-22T08:13:50.829383+0000 2024-09-22T08:39:24.415 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:24.415 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-22T08:39:24.415 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-22T08:39:24.415 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-22T08:39:24.415 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-22T08:39:24.415 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:24.415 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-22T08:39:24.048+0000 7f162da16800 5 monclient: authenticate success, global_id 8259 2024-09-22T08:39:24.415 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-22T08:39:24.048+0000 7f150cff9640 4 set_mon_vals no callback set 2024-09-22T08:39:24.415 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-22T08:39:24.048+0000 7f162da16800 10 monclient: _renew_subs 2024-09-22T08:39:24.415 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-22T08:39:24.048+0000 7f162da16800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:39:24.415 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-22T08:39:24.048+0000 7f162da16800 10 monclient: _renew_subs 2024-09-22T08:39:24.416 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-22T08:39:24.048+0000 7f162da16800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:39:24.416 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-22T08:39:24.048+0000 7f162da16800 1 librados: init done 2024-09-22T08:39:24.416 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-22T08:39:24.048+0000 7f162da16800 5 asok(0x56456b76e0f0) register_command cr dump hook 0x56456ba53038 2024-09-22T08:39:24.416 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-22T08:39:24.050+0000 7f162da16800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.416 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-22T08:39:24.051+0000 7f14feffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:39:24.416 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-22T08:39:24.051+0000 7f14feffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:39:24.416 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-22T08:39:24.051+0000 7f14feffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.42:6800/413048707,v1:172.21.15.42:6801/413048707] 2024-09-22T08:39:24.416 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-22T08:39:24.051+0000 7f16299e8640 10 monclient: get_auth_request con 0x7f14f4077570 auth_method 0 2024-09-22T08:39:24.416 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-22T08:39:24.051+0000 7f16291e7640 10 monclient: get_auth_request con 0x56456ba7d4f0 auth_method 0 2024-09-22T08:39:24.416 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-22T08:39:24.052+0000 7f162da16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:24.416 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-22T08:39:24.052+0000 7f162da16800 20 realm 2024-09-22T08:39:24.416 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-22T08:39:24.052+0000 7f162da16800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.416 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-22T08:39:24.052+0000 7f162da16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:24.416 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-22T08:39:24.052+0000 7f162da16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:24.416 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-22T08:39:24.052+0000 7f162da16800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.417 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-22T08:39:24.053+0000 7f162da16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:24.417 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-22T08:39:24.053+0000 7f162da16800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.417 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-22T08:39:24.053+0000 7f16209e6640 10 monclient: get_auth_request con 0x56456ba81880 auth_method 0 2024-09-22T08:39:24.417 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-22T08:39:24.053+0000 7f162da16800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:24.417 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-22T08:39:24.053+0000 7f162da16800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.417 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-22T08:39:24.053+0000 7f16299e8640 10 monclient: get_auth_request con 0x56456ba84fa0 auth_method 0 2024-09-22T08:39:24.417 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-22T08:39:24.054+0000 7f162da16800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:24.417 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-22T08:39:24.054+0000 7f162da16800 20 searching for the correct realm 2024-09-22T08:39:24.417 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-22T08:39:24.054+0000 7f16291e7640 10 monclient: get_auth_request con 0x56456ba89d60 auth_method 0 2024-09-22T08:39:24.417 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-22T08:39:24.056+0000 7f16209e6640 10 monclient: get_auth_request con 0x7f1614007e80 auth_method 0 2024-09-22T08:39:24.418 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-22T08:39:24.056+0000 7f16291e7640 0 -- 172.21.15.38:0/3162025754 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x56456ba89d60 msgr2=0x56456ba8c220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:39:24.418 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-22T08:39:24.057+0000 7f14feffd640 1 client.8259.objecter ms_handle_reset 0x56456ba89d60 session 0x56456ba896e0 osd.4 2024-09-22T08:39:24.418 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-22T08:39:24.057+0000 7f14feffd640 10 monclient: _renew_subs 2024-09-22T08:39:24.418 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-22T08:39:24.057+0000 7f14feffd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-22T08:39:24.418 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-22T08:39:24.057+0000 7f16291e7640 10 monclient: get_auth_request con 0x7f14f4087090 auth_method 0 2024-09-22T08:39:24.418 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-22T08:39:24.058+0000 7f16299e8640 10 monclient: get_auth_request con 0x7f161c01e060 auth_method 0 2024-09-22T08:39:24.418 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-22T08:39:24.060+0000 7f16291e7640 10 monclient: get_auth_request con 0x7f161409dea0 auth_method 0 2024-09-22T08:39:24.418 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-22T08:39:24.061+0000 7f16209e6640 10 monclient: get_auth_request con 0x7f161c06a070 auth_method 0 2024-09-22T08:39:24.418 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-22T08:39:24.061+0000 7f16209e6640 0 -- 172.21.15.38:0/3162025754 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f161c06a070 msgr2=0x7f161c069a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:24.418 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-22T08:39:24.262+0000 7f16209e6640 10 monclient: get_auth_request con 0x7f161c06a070 auth_method 0 2024-09-22T08:39:24.418 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-22T08:39:24.268+0000 7f162da16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:24.418 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-22T08:39:24.268+0000 7f162da16800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:24.418 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-22T08:39:24.268+0000 7f162da16800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:39:24.419 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-22T08:39:24.268+0000 7f162da16800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:24.419 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-22T08:39:24.268+0000 7f162da16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:24.419 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-22T08:39:24.268+0000 7f162da16800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:39:24.419 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-22T08:39:24.268+0000 7f162da16800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.419 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-22T08:39:24.268+0000 7f162da16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:24.419 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-22T08:39:24.268+0000 7f162da16800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.419 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-22T08:39:24.268+0000 7f162da16800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:24.419 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-22T08:39:24.268+0000 7f162da16800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.419 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-22T08:39:24.269+0000 7f162da16800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:24.419 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-22T08:39:24.269+0000 7f162da16800 20 zone default found 2024-09-22T08:39:24.419 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-22T08:39:24.269+0000 7f162da16800 4 Realm: () 2024-09-22T08:39:24.419 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-22T08:39:24.269+0000 7f162da16800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:39:24.419 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-22T08:39:24.269+0000 7f162da16800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:39:24.420 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-22T08:39:24.269+0000 7f162da16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:24.420 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-22T08:39:24.269+0000 7f162da16800 20 zonegroup default 2024-09-22T08:39:24.420 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-22T08:39:24.269+0000 7f162da16800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.420 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-22T08:39:24.269+0000 7f162da16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:24.420 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-22T08:39:24.269+0000 7f162da16800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.420 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-22T08:39:24.270+0000 7f162da16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:24.420 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-22T08:39:24.270+0000 7f162da16800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.420 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-22T08:39:24.270+0000 7f162da16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:24.420 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-22T08:39:24.270+0000 7f162da16800 20 started sync module instance, tier type = 2024-09-22T08:39:24.420 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-22T08:39:24.270+0000 7f162da16800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:39:24.420 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-22T08:39:24.281+0000 7f162da16800 20 add_watcher() i=0 2024-09-22T08:39:24.420 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-22T08:39:24.281+0000 7f162da16800 20 add_watcher() i=1 2024-09-22T08:39:24.420 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-22T08:39:24.281+0000 7f162da16800 20 add_watcher() i=2 2024-09-22T08:39:24.420 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-22T08:39:24.281+0000 7f162da16800 20 add_watcher() i=3 2024-09-22T08:39:24.420 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-22T08:39:24.281+0000 7f162da16800 20 add_watcher() i=4 2024-09-22T08:39:24.420 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-22T08:39:24.281+0000 7f162da16800 20 add_watcher() i=5 2024-09-22T08:39:24.421 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-22T08:39:24.281+0000 7f162da16800 20 add_watcher() i=6 2024-09-22T08:39:24.421 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-22T08:39:24.282+0000 7f162da16800 20 add_watcher() i=7 2024-09-22T08:39:24.421 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-22T08:39:24.282+0000 7f162da16800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:24.421 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-22T08:39:24.285+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaef0) adding auth protocol: cephx 2024-09-22T08:39:24.421 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-22T08:39:24.285+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaef0) adding auth protocol: cephx 2024-09-22T08:39:24.421 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-22T08:39:24.285+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaef0) adding auth protocol: cephx 2024-09-22T08:39:24.421 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-22T08:39:24.285+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaef0) adding con mode: secure 2024-09-22T08:39:24.421 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-22T08:39:24.285+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaef0) adding con mode: crc 2024-09-22T08:39:24.421 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-22T08:39:24.285+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaef0) adding con mode: secure 2024-09-22T08:39:24.421 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-22T08:39:24.285+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaef0) adding con mode: crc 2024-09-22T08:39:24.421 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-22T08:39:24.285+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaef0) adding con mode: secure 2024-09-22T08:39:24.421 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-22T08:39:24.285+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaef0) adding con mode: crc 2024-09-22T08:39:24.421 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-22T08:39:24.285+0000 7f14dffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:24.421 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-22T08:39:24.285+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaef0) adding con mode: crc 2024-09-22T08:39:24.421 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-22T08:39:24.285+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaef0) adding con mode: secure 2024-09-22T08:39:24.422 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-22T08:39:24.285+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaef0) adding con mode: crc 2024-09-22T08:39:24.422 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-22T08:39:24.285+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaef0) adding con mode: secure 2024-09-22T08:39:24.422 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-22T08:39:24.285+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaef0) adding con mode: crc 2024-09-22T08:39:24.422 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-22T08:39:24.285+0000 7f162da16800 5 AuthRegistry(0x7fff8fbfaef0) adding con mode: secure 2024-09-22T08:39:24.422 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-22T08:39:24.285+0000 7f162da16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:24.422 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-22T08:39:24.285+0000 7f162da16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:24.422 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-22T08:39:24.285+0000 7f162da16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:24.422 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-22T08:39:24.285+0000 7f162da16800 5 asok(0x56456b76e0f0) register_command cache list hook 0x56456ba32030 2024-09-22T08:39:24.422 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-22T08:39:24.285+0000 7f162da16800 5 asok(0x56456b76e0f0) register_command cache inspect hook 0x56456ba32030 2024-09-22T08:39:24.422 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-22T08:39:24.285+0000 7f162da16800 5 asok(0x56456b76e0f0) register_command cache erase hook 0x56456ba32030 2024-09-22T08:39:24.422 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-22T08:39:24.285+0000 7f162da16800 5 asok(0x56456b76e0f0) register_command cache zap hook 0x56456ba32030 2024-09-22T08:39:24.422 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-22T08:39:24.285+0000 7f162da16800 5 note: GC not initialized 2024-09-22T08:39:24.422 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-22T08:39:24.285+0000 7f14defe5640 20 reqs_thread_entry: start 2024-09-22T08:39:24.422 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-22T08:39:24.285+0000 7f162da16800 5 asok(0x56456b76e0f0) register_command sync trace show hook 0x7f16140728d0 2024-09-22T08:39:24.423 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-22T08:39:24.285+0000 7f162da16800 5 asok(0x56456b76e0f0) register_command sync trace history hook 0x7f16140728d0 2024-09-22T08:39:24.423 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-22T08:39:24.285+0000 7f162da16800 5 asok(0x56456b76e0f0) register_command sync trace active hook 0x7f16140728d0 2024-09-22T08:39:24.423 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-22T08:39:24.285+0000 7f162da16800 5 asok(0x56456b76e0f0) register_command sync trace active_short hook 0x7f16140728d0 2024-09-22T08:39:24.423 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-22T08:39:24.285+0000 7f162da16800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:24.423 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-22T08:39:24.286+0000 7f162da16800 20 Filter name: none 2024-09-22T08:39:24.423 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-22T08:39:24.286+0000 7f14dcfe1640 20 reqs_thread_entry: start 2024-09-22T08:39:24.423 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-22T08:39:24.286+0000 7f162da16800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:39:24.423 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-22T08:39:24.286+0000 7f162da16800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.423 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-22T08:39:24.286+0000 7f162da16800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:39:24.423 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-22T08:39:24.286+0000 7f162da16800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:39:24.423 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-22T08:39:24.286+0000 7f162da16800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:39:24.423 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-22T08:39:24.286+0000 7f162da16800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 : miss 2024-09-22T08:39:24.423 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-22T08:39:24.286+0000 7f162da16800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.423 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-22T08:39:24.287+0000 7f162da16800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T08:39:24.424 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-22T08:39:24.287+0000 7f162da16800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:39:24.424 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-22T08:39:24.287+0000 7f162da16800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:39:24.424 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-22T08:39:24.287+0000 7f162da16800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:39:24.424 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-22T08:39:24.287+0000 7f162da16800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:39:24.424 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-22T08:39:24.287+0000 7f162da16800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 2024-09-22T08:39:24.424 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-22T08:39:24.288+0000 7f162da16800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-22T08:39:24.424 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-22T08:39:24.298+0000 7f162da16800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:39:24.424 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-22T08:39:24.298+0000 7f162da16800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:39:24.424 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-22T08:39:24.298+0000 7f162da16800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:39:24.424 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-22T08:39:24.298+0000 7f162da16800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17, ofs0, ns] 2024-09-22T08:39:24.424 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-22T08:39:24.298+0000 7f14fffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497038 cookie 94856158960432 notifier 8259 bl.length()=827 2024-09-22T08:39:24.424 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-22T08:39:24.298+0000 7f14fffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:39:24.424 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-22T08:39:24.298+0000 7f14fffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:39:24.424 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-22T08:39:24.298+0000 7f14fffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:39:24.425 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-22T08:39:24.298+0000 7f162da16800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_sources= new_sources= 2024-09-22T08:39:24.425 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-22T08:39:24.298+0000 7f162da16800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential sources added=[] removed=[] 2024-09-22T08:39:24.425 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-22T08:39:24.298+0000 7f162da16800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_dests= new_dests= 2024-09-22T08:39:24.425 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-22T08:39:24.298+0000 7f162da16800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential dests added=[] removed=[] 2024-09-22T08:39:24.425 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-22T08:39:24.305+0000 7f162da16800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f162da16800 time 2024-09-22T08:39:24.305202+0000 2024-09-22T08:39:24.425 INFO:tasks.workunit.client.0.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:39:24.425 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:24.425 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:39:24.425 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f162eb8c748] 2024-09-22T08:39:24.425 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f162eb8c906] 2024-09-22T08:39:24.425 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564568db8e01] 2024-09-22T08:39:24.425 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564568dc8d0a] 2024-09-22T08:39:24.425 INFO:tasks.workunit.client.0.smithi038.stderr: 5: main() 2024-09-22T08:39:24.426 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f162d829590] 2024-09-22T08:39:24.426 INFO:tasks.workunit.client.0.smithi038.stderr: 7: __libc_start_main() 2024-09-22T08:39:24.426 INFO:tasks.workunit.client.0.smithi038.stderr: 8: _start() 2024-09-22T08:39:24.426 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:24.426 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-22T08:39:24.305+0000 7f162da16800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:39:24.426 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f162da16800 thread_name:radosgw-admin 2024-09-22T08:39:24.426 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:24.426 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:39:24.426 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f162d83e6f0] 2024-09-22T08:39:24.426 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f162d88b99c] 2024-09-22T08:39:24.426 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-22T08:39:24.426 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-22T08:39:24.426 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f162eb8c7a2] 2024-09-22T08:39:24.426 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f162eb8c906] 2024-09-22T08:39:24.426 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564568db8e01] 2024-09-22T08:39:24.427 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564568dc8d0a] 2024-09-22T08:39:24.427 INFO:tasks.workunit.client.0.smithi038.stderr: 9: main() 2024-09-22T08:39:24.427 INFO:tasks.workunit.client.0.smithi038.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f162d829590] 2024-09-22T08:39:24.427 INFO:tasks.workunit.client.0.smithi038.stderr: 11: __libc_start_main() 2024-09-22T08:39:24.427 INFO:tasks.workunit.client.0.smithi038.stderr: 12: _start() 2024-09-22T08:39:24.427 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:39:24.427 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:24.427 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-22T08:39:24.427 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-22T08:39:24.427 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-22T08:39:24.427 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-22T08:39:24.427 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-22T08:39:24.427 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-22T08:39:24.427 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-22T08:39:24.428 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-22T08:39:24.428 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-22T08:39:24.428 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-22T08:39:24.428 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-22T08:39:24.428 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-22T08:39:24.428 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-22T08:39:24.428 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-22T08:39:24.428 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-22T08:39:24.428 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-22T08:39:24.428 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-22T08:39:24.429 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-22T08:39:24.429 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-22T08:39:24.429 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-22T08:39:24.429 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-22T08:39:24.429 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-22T08:39:24.429 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-22T08:39:24.429 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-22T08:39:24.429 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:39:24.429 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-22T08:39:24.429 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-22T08:39:24.429 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-22T08:39:24.429 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-22T08:39:24.429 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-22T08:39:24.429 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-22T08:39:24.429 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-22T08:39:24.429 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-22T08:39:24.430 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-22T08:39:24.430 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-22T08:39:24.430 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-22T08:39:24.430 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-22T08:39:24.430 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-22T08:39:24.430 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-22T08:39:24.430 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-22T08:39:24.430 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-22T08:39:24.430 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-22T08:39:24.430 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-22T08:39:24.430 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-22T08:39:24.430 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-22T08:39:24.430 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-22T08:39:24.430 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:39:24.430 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-22T08:39:24.431 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:39:24.431 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-22T08:39:24.431 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-22T08:39:24.431 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-22T08:39:24.431 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-22T08:39:24.431 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-22T08:39:24.431 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-22T08:39:24.431 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-22T08:39:24.431 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-22T08:39:24.431 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-22T08:39:24.431 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-22T08:39:24.431 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-22T08:39:24.431 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-22T08:39:24.431 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-22T08:39:24.431 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-22T08:39:24.432 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-22T08:39:24.432 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-22T08:39:24.432 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-22T08:39:24.432 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-22T08:39:24.432 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:39:24.432 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-22T08:39:24.432 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:39:24.432 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-22T08:39:24.432 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-22T08:39:24.432 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-22T08:39:24.432 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-22T08:39:24.432 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-22T08:39:24.432 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-22T08:39:24.432 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:39:24.433 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-22T08:39:24.433 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-22T08:39:24.433 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:39:24.433 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-22T08:39:24.433 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-22T08:39:24.433 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-22T08:39:24.433 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-22T08:39:24.433 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-22T08:39:24.433 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-22T08:39:24.433 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-22T08:39:24.433 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-22T08:39:24.433 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-22T08:39:24.433 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-22T08:39:24.433 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-22T08:39:24.433 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-22T08:39:24.434 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-22T08:39:24.434 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:39:24.434 INFO:tasks.workunit.client.0.smithi038.stderr: 7f14dcfe1640 / http_manager 2024-09-22T08:39:24.434 INFO:tasks.workunit.client.0.smithi038.stderr: 7f14defe5640 / http_manager 2024-09-22T08:39:24.434 INFO:tasks.workunit.client.0.smithi038.stderr: 7f14dffe7640 / rgw_dt_lg_renew 2024-09-22T08:39:24.434 INFO:tasks.workunit.client.0.smithi038.stderr: 7f14feffd640 / ms_dispatch 2024-09-22T08:39:24.434 INFO:tasks.workunit.client.0.smithi038.stderr: 7f14fffff640 / io_context_pool 2024-09-22T08:39:24.434 INFO:tasks.workunit.client.0.smithi038.stderr: 7f150cff9640 / io_context_pool 2024-09-22T08:39:24.434 INFO:tasks.workunit.client.0.smithi038.stderr: 7f150effd640 / ms_dispatch 2024-09-22T08:39:24.434 INFO:tasks.workunit.client.0.smithi038.stderr: 7f1515e03640 / ms_dispatch 2024-09-22T08:39:24.434 INFO:tasks.workunit.client.0.smithi038.stderr: 7f1517606640 / io_context_pool 2024-09-22T08:39:24.434 INFO:tasks.workunit.client.0.smithi038.stderr: 7f16209e6640 / msgr-worker-2 2024-09-22T08:39:24.434 INFO:tasks.workunit.client.0.smithi038.stderr: 7f16291e7640 / msgr-worker-1 2024-09-22T08:39:24.434 INFO:tasks.workunit.client.0.smithi038.stderr: 7f16299e8640 / msgr-worker-0 2024-09-22T08:39:24.434 INFO:tasks.workunit.client.0.smithi038.stderr: 7f162a1e9640 / io_context_pool 2024-09-22T08:39:24.435 INFO:tasks.workunit.client.0.smithi038.stderr: 7f162da16800 / radosgw-admin 2024-09-22T08:39:24.435 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-22T08:39:24.435 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-22T08:39:24.435 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/lib/ceph/crash/2024-09-22T08:39:24.306645Z_bd13e551-edcc-4822-8523-c82eec658427/log 2024-09-22T08:39:24.435 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-22T08:39:24.435 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T08:39:24.439 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:24.439 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:24.439 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.387+0000 7fef05146800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.439 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.389+0000 7fef05146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:24.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.389+0000 7fef05146800 20 realm 2024-09-22T08:39:24.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.389+0000 7fef05146800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.390+0000 7fef05146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:24.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.390+0000 7fef05146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:24.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.390+0000 7fef05146800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.390+0000 7fef05146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:24.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.390+0000 7fef05146800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.391+0000 7fef05146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:24.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.391+0000 7fef05146800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.391+0000 7fef05146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:24.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.391+0000 7fef05146800 20 searching for the correct realm 2024-09-22T08:39:24.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.392+0000 7fef03438640 0 -- 172.21.15.38:0/1875249773 >> [v2:172.21.15.38:6800/703968303,v1:172.21.15.38:6801/703968303] conn(0x5576d967b530 msgr2=0x5576d967d920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:24.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.396+0000 7fef02436640 0 -- 172.21.15.38:0/1875249773 >> [v2:172.21.15.38:6808/1856522357,v1:172.21.15.38:6809/1856522357] conn(0x5576d9677cc0 msgr2=0x5576d967a0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:24.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.402+0000 7fef05146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:24.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.402+0000 7fef05146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:24.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.402+0000 7fef05146800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:39:24.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.402+0000 7fef05146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:24.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.402+0000 7fef05146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:24.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.402+0000 7fef05146800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:39:24.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.402+0000 7fef05146800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.402+0000 7fef05146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:24.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.402+0000 7fef05146800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.402+0000 7fef05146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:24.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.402+0000 7fef05146800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.403+0000 7fef05146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:24.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.403+0000 7fef05146800 20 zone default found 2024-09-22T08:39:24.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.403+0000 7fef05146800 4 Realm: () 2024-09-22T08:39:24.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.403+0000 7fef05146800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:39:24.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.403+0000 7fef05146800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:39:24.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.403+0000 7fef05146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:24.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.403+0000 7fef05146800 20 zonegroup default 2024-09-22T08:39:24.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.403+0000 7fef05146800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.403+0000 7fef05146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:24.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.403+0000 7fef05146800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.404+0000 7fef05146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:24.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.404+0000 7fef05146800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.405+0000 7fef05146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:24.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.405+0000 7fef05146800 20 started sync module instance, tier type = 2024-09-22T08:39:24.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.405+0000 7fef05146800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:39:24.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.414+0000 7fef05146800 20 add_watcher() i=0 2024-09-22T08:39:24.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.414+0000 7fef05146800 20 add_watcher() i=1 2024-09-22T08:39:24.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.414+0000 7fef05146800 20 add_watcher() i=2 2024-09-22T08:39:24.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.414+0000 7fef05146800 20 add_watcher() i=3 2024-09-22T08:39:24.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.414+0000 7fef05146800 20 add_watcher() i=4 2024-09-22T08:39:24.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.414+0000 7fef05146800 20 add_watcher() i=5 2024-09-22T08:39:24.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.414+0000 7fef05146800 20 add_watcher() i=6 2024-09-22T08:39:24.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.415+0000 7fef05146800 20 add_watcher() i=7 2024-09-22T08:39:24.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.415+0000 7fef05146800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:24.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.417+0000 7fedb97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:24.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.417+0000 7fef05146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:24.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.417+0000 7fef05146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:24.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.418+0000 7fef05146800 5 note: GC not initialized 2024-09-22T08:39:24.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.418+0000 7fed33fff640 20 reqs_thread_entry: start 2024-09-22T08:39:24.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.418+0000 7fef05146800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:24.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.418+0000 7fef05146800 20 Filter name: none 2024-09-22T08:39:24.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.418+0000 7fed31ffb640 20 reqs_thread_entry: start 2024-09-22T08:39:24.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.418+0000 7fef05146800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.418+0000 7fef05146800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:39:24.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.418+0000 7fef05146800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.419+0000 7fef05146800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T08:39:24.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.419+0000 7fef05146800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:24.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.419+0000 7fef05146800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.419+0000 7fef05146800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:39:24.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.419+0000 7fef05146800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.420+0000 7fef05146800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T08:39:24.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.420+0000 7fef05146800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:24.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.422+0000 7fedb97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:24.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.424+0000 7fef05146800 20 remove_watcher() i=0 2024-09-22T08:39:24.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.424+0000 7fef05146800 2 removed watcher, disabling cache 2024-09-22T08:39:24.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.425+0000 7fef05146800 20 remove_watcher() i=1 2024-09-22T08:39:24.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.426+0000 7fef05146800 20 remove_watcher() i=2 2024-09-22T08:39:24.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.427+0000 7fef05146800 20 remove_watcher() i=3 2024-09-22T08:39:24.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.428+0000 7fef05146800 20 remove_watcher() i=4 2024-09-22T08:39:24.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.429+0000 7fef05146800 20 remove_watcher() i=5 2024-09-22T08:39:24.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.430+0000 7fef05146800 20 remove_watcher() i=6 2024-09-22T08:39:24.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.431+0000 7fef05146800 20 remove_watcher() i=7 2024-09-22T08:39:24.446 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:39:24.446 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:39:24.455 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-22T08:39:24.484 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:24.484 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:24.524 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.522+0000 7f430c730800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.524+0000 7f430c730800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:24.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.524+0000 7f430c730800 20 realm 2024-09-22T08:39:24.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.524+0000 7f430c730800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.524+0000 7f430c730800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:24.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.524+0000 7f430c730800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:24.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.524+0000 7f430c730800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.524+0000 7f430c730800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:24.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.524+0000 7f430c730800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.525+0000 7f430c730800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:24.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.525+0000 7f430c730800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.526+0000 7f430c730800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:24.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.526+0000 7f430c730800 20 searching for the correct realm 2024-09-22T08:39:24.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.528+0000 7f4307caf640 0 -- 172.21.15.38:0/323290540 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f42fc08a050 msgr2=0x7f42fc07d410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:24.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.532+0000 7f4307caf640 0 -- 172.21.15.38:0/323290540 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f42f8044bb0 msgr2=0x7f42f80833e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:39:24.741 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.740+0000 7f430c730800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:24.741 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.740+0000 7f430c730800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:24.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.740+0000 7f430c730800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:39:24.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.740+0000 7f430c730800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:24.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.740+0000 7f430c730800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:24.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.740+0000 7f430c730800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:39:24.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.740+0000 7f430c730800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.740+0000 7f430c730800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:24.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.740+0000 7f430c730800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.740+0000 7f430c730800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:24.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.740+0000 7f430c730800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.741+0000 7f430c730800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:24.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.741+0000 7f430c730800 20 zone default found 2024-09-22T08:39:24.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.741+0000 7f430c730800 4 Realm: () 2024-09-22T08:39:24.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.741+0000 7f430c730800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:39:24.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.741+0000 7f430c730800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:39:24.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.741+0000 7f430c730800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:24.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.741+0000 7f430c730800 20 zonegroup default 2024-09-22T08:39:24.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.741+0000 7f430c730800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.741+0000 7f430c730800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:24.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.741+0000 7f430c730800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.742+0000 7f430c730800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:24.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.742+0000 7f430c730800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.742+0000 7f430c730800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:24.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.742+0000 7f430c730800 20 started sync module instance, tier type = 2024-09-22T08:39:24.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.742+0000 7f430c730800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:39:24.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.752+0000 7f430c730800 20 add_watcher() i=0 2024-09-22T08:39:24.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.752+0000 7f430c730800 20 add_watcher() i=1 2024-09-22T08:39:24.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.752+0000 7f430c730800 20 add_watcher() i=2 2024-09-22T08:39:24.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.752+0000 7f430c730800 20 add_watcher() i=3 2024-09-22T08:39:24.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.752+0000 7f430c730800 20 add_watcher() i=4 2024-09-22T08:39:24.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.752+0000 7f430c730800 20 add_watcher() i=5 2024-09-22T08:39:24.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.752+0000 7f430c730800 20 add_watcher() i=6 2024-09-22T08:39:24.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.753+0000 7f430c730800 20 add_watcher() i=7 2024-09-22T08:39:24.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.753+0000 7f430c730800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:24.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.755+0000 7f41befdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:24.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.756+0000 7f430c730800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:24.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.756+0000 7f430c730800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:24.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.756+0000 7f430c730800 5 note: GC not initialized 2024-09-22T08:39:24.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.756+0000 7f41bdfdb640 20 reqs_thread_entry: start 2024-09-22T08:39:24.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.756+0000 7f430c730800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:24.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.756+0000 7f430c730800 20 Filter name: none 2024-09-22T08:39:24.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.756+0000 7f412f7fe640 20 reqs_thread_entry: start 2024-09-22T08:39:24.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.756+0000 7f430c730800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:39:24.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.756+0000 7f430c730800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.757+0000 7f430c730800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:39:24.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.757+0000 7f430c730800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:39:24.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.757+0000 7f430c730800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:39:24.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.757+0000 7f430c730800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 : miss 2024-09-22T08:39:24.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.757+0000 7f430c730800 20 rados->read ofs=0 len=0 2024-09-22T08:39:24.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.757+0000 7f430c730800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T08:39:24.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.757+0000 7f430c730800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:39:24.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.757+0000 7f430c730800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:39:24.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.757+0000 7f430c730800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:39:24.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.757+0000 7f430c730800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:39:24.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.757+0000 7f430c730800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 2024-09-22T08:39:24.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.757+0000 7f430c730800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.0 2024-09-22T08:39:24.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.757+0000 7f430c730800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.0 2024-09-22T08:39:24.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.758+0000 7f430c730800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.1 2024-09-22T08:39:24.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.758+0000 7f430c730800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.1 2024-09-22T08:39:24.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.758+0000 7f430c730800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.2 2024-09-22T08:39:24.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.758+0000 7f430c730800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.2 2024-09-22T08:39:24.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.759+0000 7f430c730800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.3 2024-09-22T08:39:24.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.759+0000 7f430c730800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.3 2024-09-22T08:39:24.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.759+0000 7f430c730800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.4 2024-09-22T08:39:24.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.759+0000 7f430c730800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.4 2024-09-22T08:39:24.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.759+0000 7f430c730800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.5 2024-09-22T08:39:24.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.759+0000 7f430c730800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.5 2024-09-22T08:39:24.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.760+0000 7f430c730800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.6 2024-09-22T08:39:24.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.760+0000 7f430c730800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.6 2024-09-22T08:39:24.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.760+0000 7f430c730800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.7 2024-09-22T08:39:24.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.760+0000 7f430c730800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.7 2024-09-22T08:39:24.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.761+0000 7f430c730800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.8 2024-09-22T08:39:24.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.761+0000 7f430c730800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.8 2024-09-22T08:39:24.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.761+0000 7f430c730800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.9 2024-09-22T08:39:24.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.761+0000 7f430c730800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.9 2024-09-22T08:39:24.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.762+0000 7f430c730800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.10 2024-09-22T08:39:24.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.762+0000 7f430c730800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.10 2024-09-22T08:39:24.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.762+0000 7f430c730800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.11 2024-09-22T08:39:24.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.762+0000 7f430c730800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.11 2024-09-22T08:39:24.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.763+0000 7f430c730800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.12 2024-09-22T08:39:24.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.763+0000 7f430c730800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.12 2024-09-22T08:39:24.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.764+0000 7f41befdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:24.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.766+0000 7f430c730800 20 remove_watcher() i=0 2024-09-22T08:39:24.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.766+0000 7f430c730800 2 removed watcher, disabling cache 2024-09-22T08:39:24.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.768+0000 7f430c730800 20 remove_watcher() i=1 2024-09-22T08:39:24.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.769+0000 7f430c730800 20 remove_watcher() i=2 2024-09-22T08:39:24.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.770+0000 7f430c730800 20 remove_watcher() i=3 2024-09-22T08:39:24.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.771+0000 7f430c730800 20 remove_watcher() i=4 2024-09-22T08:39:24.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.772+0000 7f430c730800 20 remove_watcher() i=5 2024-09-22T08:39:24.774 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.773+0000 7f430c730800 20 remove_watcher() i=6 2024-09-22T08:39:24.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:24.774+0000 7f430c730800 20 remove_watcher() i=7 2024-09-22T08:39:54.803 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-22T08:39:54.837 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:54.837 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:54.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:54.883+0000 7fc5a7d28800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:54.885+0000 7fc5a7d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:54.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:54.885+0000 7fc5a7d28800 20 realm 2024-09-22T08:39:54.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:54.885+0000 7fc5a7d28800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:54.885+0000 7fc5a7d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:54.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:54.885+0000 7fc5a7d28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:54.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:54.885+0000 7fc5a7d28800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:54.886+0000 7fc5a7d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:54.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:54.886+0000 7fc5a7d28800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:54.887+0000 7fc5a7d28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:54.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:54.887+0000 7fc5a7d28800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:54.887+0000 7fc5a7d28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:54.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:54.887+0000 7fc5a7d28800 20 searching for the correct realm 2024-09-22T08:39:54.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:54.890+0000 7fc59bfff640 0 -- 172.21.15.38:0/2357834811 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7fc58c0c7020 msgr2=0x7fc58c0b4e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:39:55.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.096+0000 7fc59bfff640 0 -- 172.21.15.38:0/2357834811 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fc59406adb0 msgr2=0x7fc5940820e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:55.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.304+0000 7fc5a7d28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:55.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.304+0000 7fc5a7d28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:55.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.304+0000 7fc5a7d28800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:39:55.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.304+0000 7fc5a7d28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:55.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.304+0000 7fc5a7d28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:55.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.304+0000 7fc5a7d28800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:39:55.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.304+0000 7fc5a7d28800 20 rados->read ofs=0 len=0 2024-09-22T08:39:55.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.305+0000 7fc5a7d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:55.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.305+0000 7fc5a7d28800 20 rados->read ofs=0 len=0 2024-09-22T08:39:55.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.305+0000 7fc5a7d28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:55.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.305+0000 7fc5a7d28800 20 rados->read ofs=0 len=0 2024-09-22T08:39:55.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.306+0000 7fc5a7d28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:55.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.306+0000 7fc5a7d28800 20 zone default found 2024-09-22T08:39:55.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.306+0000 7fc5a7d28800 4 Realm: () 2024-09-22T08:39:55.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.306+0000 7fc5a7d28800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:39:55.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.306+0000 7fc5a7d28800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:39:55.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.306+0000 7fc5a7d28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:55.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.306+0000 7fc5a7d28800 20 zonegroup default 2024-09-22T08:39:55.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.306+0000 7fc5a7d28800 20 rados->read ofs=0 len=0 2024-09-22T08:39:55.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.306+0000 7fc5a7d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:55.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.306+0000 7fc5a7d28800 20 rados->read ofs=0 len=0 2024-09-22T08:39:55.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.306+0000 7fc5a7d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:55.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.306+0000 7fc5a7d28800 20 rados->read ofs=0 len=0 2024-09-22T08:39:55.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.307+0000 7fc5a7d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:55.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.307+0000 7fc5a7d28800 20 started sync module instance, tier type = 2024-09-22T08:39:55.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.307+0000 7fc5a7d28800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:39:55.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.318+0000 7fc5a7d28800 20 add_watcher() i=0 2024-09-22T08:39:55.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.318+0000 7fc5a7d28800 20 add_watcher() i=1 2024-09-22T08:39:55.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.318+0000 7fc5a7d28800 20 add_watcher() i=2 2024-09-22T08:39:55.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.318+0000 7fc5a7d28800 20 add_watcher() i=3 2024-09-22T08:39:55.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.318+0000 7fc5a7d28800 20 add_watcher() i=4 2024-09-22T08:39:55.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.318+0000 7fc5a7d28800 20 add_watcher() i=5 2024-09-22T08:39:55.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.318+0000 7fc5a7d28800 20 add_watcher() i=6 2024-09-22T08:39:55.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.319+0000 7fc5a7d28800 20 add_watcher() i=7 2024-09-22T08:39:55.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.319+0000 7fc5a7d28800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:55.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.321+0000 7fc459fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:55.323 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.322+0000 7fc5a7d28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:55.323 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.322+0000 7fc5a7d28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:55.323 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.322+0000 7fc5a7d28800 5 note: GC not initialized 2024-09-22T08:39:55.323 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.322+0000 7fc458fe1640 20 reqs_thread_entry: start 2024-09-22T08:39:55.323 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.322+0000 7fc5a7d28800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:55.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.322+0000 7fc5a7d28800 20 Filter name: none 2024-09-22T08:39:55.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.322+0000 7fc3d27fc640 20 reqs_thread_entry: start 2024-09-22T08:39:55.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.322+0000 7fc5a7d28800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:39:55.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.322+0000 7fc5a7d28800 20 rados->read ofs=0 len=0 2024-09-22T08:39:55.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.323+0000 7fc5a7d28800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:39:55.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.323+0000 7fc5a7d28800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:39:55.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.323+0000 7fc5a7d28800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:39:55.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.323+0000 7fc5a7d28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 : miss 2024-09-22T08:39:55.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.323+0000 7fc5a7d28800 20 rados->read ofs=0 len=0 2024-09-22T08:39:55.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.323+0000 7fc5a7d28800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T08:39:55.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.323+0000 7fc5a7d28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:39:55.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.323+0000 7fc5a7d28800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:39:55.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.323+0000 7fc5a7d28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:39:55.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.323+0000 7fc5a7d28800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:39:55.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.323+0000 7fc5a7d28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 2024-09-22T08:39:55.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.328+0000 7fc459fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:55.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.331+0000 7fc5a7d28800 20 remove_watcher() i=0 2024-09-22T08:39:55.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.331+0000 7fc5a7d28800 2 removed watcher, disabling cache 2024-09-22T08:39:55.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.332+0000 7fc5a7d28800 20 remove_watcher() i=1 2024-09-22T08:39:55.334 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.333+0000 7fc5a7d28800 20 remove_watcher() i=2 2024-09-22T08:39:55.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.334+0000 7fc5a7d28800 20 remove_watcher() i=3 2024-09-22T08:39:55.336 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.335+0000 7fc5a7d28800 20 remove_watcher() i=4 2024-09-22T08:39:55.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.336+0000 7fc5a7d28800 20 remove_watcher() i=5 2024-09-22T08:39:55.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.337+0000 7fc5a7d28800 20 remove_watcher() i=6 2024-09-22T08:39:55.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.339+0000 7fc5a7d28800 20 remove_watcher() i=7 2024-09-22T08:39:55.353 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-22T08:39:55.384 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:55.384 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:55.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.423+0000 7fe65b70c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:55.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.425+0000 7fe65b70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:55.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.425+0000 7fe65b70c800 20 realm 2024-09-22T08:39:55.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.425+0000 7fe65b70c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:55.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.425+0000 7fe65b70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:55.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.425+0000 7fe65b70c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:55.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.425+0000 7fe65b70c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:55.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.426+0000 7fe65b70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:55.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.426+0000 7fe65b70c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:55.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.426+0000 7fe65b70c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:55.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.426+0000 7fe65b70c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:55.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.427+0000 7fe65b70c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:55.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.427+0000 7fe65b70c800 20 searching for the correct realm 2024-09-22T08:39:55.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.430+0000 7fe6599f7640 0 -- 172.21.15.38:0/2390527857 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7fe64c064940 msgr2=0x7fe64c080400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:55.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.635+0000 7fe6591f6640 0 -- 172.21.15.38:0/2390527857 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x557907415360 msgr2=0x557907417800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:55.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.640+0000 7fe65b70c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:55.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.640+0000 7fe65b70c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:55.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.640+0000 7fe65b70c800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:39:55.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.640+0000 7fe65b70c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:55.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.640+0000 7fe65b70c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:55.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.640+0000 7fe65b70c800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:39:55.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.640+0000 7fe65b70c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:55.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.640+0000 7fe65b70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:55.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.640+0000 7fe65b70c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:55.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.641+0000 7fe65b70c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:55.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.641+0000 7fe65b70c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:55.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.641+0000 7fe65b70c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:55.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.641+0000 7fe65b70c800 20 zone default found 2024-09-22T08:39:55.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.641+0000 7fe65b70c800 4 Realm: () 2024-09-22T08:39:55.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.641+0000 7fe65b70c800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:39:55.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.641+0000 7fe65b70c800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:39:55.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.641+0000 7fe65b70c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:55.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.641+0000 7fe65b70c800 20 zonegroup default 2024-09-22T08:39:55.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.641+0000 7fe65b70c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:55.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.641+0000 7fe65b70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:55.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.641+0000 7fe65b70c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:55.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.642+0000 7fe65b70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:55.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.642+0000 7fe65b70c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:55.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.642+0000 7fe65b70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:55.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.642+0000 7fe65b70c800 20 started sync module instance, tier type = 2024-09-22T08:39:55.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.642+0000 7fe65b70c800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:39:55.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.652+0000 7fe65b70c800 20 add_watcher() i=0 2024-09-22T08:39:55.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.652+0000 7fe65b70c800 20 add_watcher() i=1 2024-09-22T08:39:55.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.652+0000 7fe65b70c800 20 add_watcher() i=2 2024-09-22T08:39:55.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.652+0000 7fe65b70c800 20 add_watcher() i=3 2024-09-22T08:39:55.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.652+0000 7fe65b70c800 20 add_watcher() i=4 2024-09-22T08:39:55.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.652+0000 7fe65b70c800 20 add_watcher() i=5 2024-09-22T08:39:55.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.652+0000 7fe65b70c800 20 add_watcher() i=6 2024-09-22T08:39:55.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.653+0000 7fe65b70c800 20 add_watcher() i=7 2024-09-22T08:39:55.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.653+0000 7fe65b70c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:55.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.655+0000 7fe50ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:55.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.656+0000 7fe65b70c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:55.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.656+0000 7fe65b70c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:55.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.656+0000 7fe65b70c800 5 note: GC not initialized 2024-09-22T08:39:55.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.656+0000 7fe50efe5640 20 reqs_thread_entry: start 2024-09-22T08:39:55.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.656+0000 7fe65b70c800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:55.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.656+0000 7fe65b70c800 20 Filter name: none 2024-09-22T08:39:55.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.656+0000 7fe50cfe1640 20 reqs_thread_entry: start 2024-09-22T08:39:55.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.656+0000 7fe65b70c800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:39:55.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.656+0000 7fe65b70c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:55.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.657+0000 7fe65b70c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:39:55.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.657+0000 7fe65b70c800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:39:55.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.657+0000 7fe65b70c800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:39:55.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.657+0000 7fe65b70c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 : miss 2024-09-22T08:39:55.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.657+0000 7fe65b70c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:55.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.658+0000 7fe65b70c800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T08:39:55.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.658+0000 7fe65b70c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:39:55.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.658+0000 7fe65b70c800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:39:55.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.658+0000 7fe65b70c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:39:55.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.658+0000 7fe65b70c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:39:55.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.658+0000 7fe65b70c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 2024-09-22T08:39:55.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.658+0000 7fe65b70c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.0 2024-09-22T08:39:55.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.658+0000 7fe65b70c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.0 2024-09-22T08:39:55.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.658+0000 7fe65b70c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.1 2024-09-22T08:39:55.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.658+0000 7fe65b70c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.1 2024-09-22T08:39:55.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.659+0000 7fe65b70c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.2 2024-09-22T08:39:55.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.659+0000 7fe65b70c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.2 2024-09-22T08:39:55.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.659+0000 7fe65b70c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.3 2024-09-22T08:39:55.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.659+0000 7fe65b70c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.3 2024-09-22T08:39:55.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.659+0000 7fe65b70c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.4 2024-09-22T08:39:55.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.659+0000 7fe65b70c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.4 2024-09-22T08:39:55.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.660+0000 7fe65b70c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.5 2024-09-22T08:39:55.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.660+0000 7fe65b70c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.5 2024-09-22T08:39:55.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.660+0000 7fe65b70c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.6 2024-09-22T08:39:55.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.660+0000 7fe65b70c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.6 2024-09-22T08:39:55.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.661+0000 7fe65b70c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.7 2024-09-22T08:39:55.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.661+0000 7fe65b70c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.7 2024-09-22T08:39:55.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.661+0000 7fe65b70c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.8 2024-09-22T08:39:55.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.661+0000 7fe65b70c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.8 2024-09-22T08:39:55.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.661+0000 7fe65b70c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.9 2024-09-22T08:39:55.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.661+0000 7fe65b70c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.9 2024-09-22T08:39:55.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.662+0000 7fe65b70c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.10 2024-09-22T08:39:55.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.662+0000 7fe65b70c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.10 2024-09-22T08:39:55.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.662+0000 7fe65b70c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.11 2024-09-22T08:39:55.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.662+0000 7fe65b70c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.11 2024-09-22T08:39:55.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.662+0000 7fe65b70c800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.12 2024-09-22T08:39:55.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.662+0000 7fe65b70c800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.12 2024-09-22T08:39:55.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.664+0000 7fe50ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:55.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.666+0000 7fe65b70c800 20 remove_watcher() i=0 2024-09-22T08:39:55.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.666+0000 7fe65b70c800 2 removed watcher, disabling cache 2024-09-22T08:39:55.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.667+0000 7fe65b70c800 20 remove_watcher() i=1 2024-09-22T08:39:55.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.668+0000 7fe65b70c800 20 remove_watcher() i=2 2024-09-22T08:39:55.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.669+0000 7fe65b70c800 20 remove_watcher() i=3 2024-09-22T08:39:55.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.671+0000 7fe65b70c800 20 remove_watcher() i=4 2024-09-22T08:39:55.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.672+0000 7fe65b70c800 20 remove_watcher() i=5 2024-09-22T08:39:55.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.673+0000 7fe65b70c800 20 remove_watcher() i=6 2024-09-22T08:39:55.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.674+0000 7fe65b70c800 20 remove_watcher() i=7 2024-09-22T08:39:55.686 INFO:tasks.workunit.client.0.smithi038.stderr:check reshard logrecord successfully 2024-09-22T08:39:55.686 INFO:tasks.workunit.client.0.smithi038.stderr: test: reshard versioned bucket 2024-09-22T08:39:55.688 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket myver 2024-09-22T08:39:55.717 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:55.717 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:55.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.755+0000 7f3a538bb800 20 rados->read ofs=0 len=0 2024-09-22T08:39:55.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.757+0000 7f3a538bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:55.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.757+0000 7f3a538bb800 20 realm 2024-09-22T08:39:55.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.757+0000 7f3a538bb800 20 rados->read ofs=0 len=0 2024-09-22T08:39:55.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.757+0000 7f3a538bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:55.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.757+0000 7f3a538bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:55.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.757+0000 7f3a538bb800 20 rados->read ofs=0 len=0 2024-09-22T08:39:55.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.757+0000 7f3a538bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:55.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.757+0000 7f3a538bb800 20 rados->read ofs=0 len=0 2024-09-22T08:39:55.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.758+0000 7f3a538bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:55.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.758+0000 7f3a538bb800 20 rados->read ofs=0 len=0 2024-09-22T08:39:55.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.759+0000 7f3a538bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:55.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.759+0000 7f3a538bb800 20 searching for the correct realm 2024-09-22T08:39:55.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.761+0000 7f3a50ba4640 0 -- 172.21.15.38:0/1377264576 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f3a3c06dd80 msgr2=0x7f3a3c0a60b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:55.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.765+0000 7f3a50ba4640 0 -- 172.21.15.38:0/1377264576 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f3a4408db20 msgr2=0x7f3a4407f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:55.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.972+0000 7f3a538bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:55.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.972+0000 7f3a538bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:55.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.972+0000 7f3a538bb800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:39:55.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.972+0000 7f3a538bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:55.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.972+0000 7f3a538bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:55.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.972+0000 7f3a538bb800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:39:55.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.973+0000 7f3a538bb800 20 rados->read ofs=0 len=0 2024-09-22T08:39:55.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.973+0000 7f3a538bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:55.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.973+0000 7f3a538bb800 20 rados->read ofs=0 len=0 2024-09-22T08:39:55.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.973+0000 7f3a538bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:55.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.973+0000 7f3a538bb800 20 rados->read ofs=0 len=0 2024-09-22T08:39:55.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.974+0000 7f3a538bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:55.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.974+0000 7f3a538bb800 20 zone default found 2024-09-22T08:39:55.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.974+0000 7f3a538bb800 4 Realm: () 2024-09-22T08:39:55.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.974+0000 7f3a538bb800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:39:55.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.974+0000 7f3a538bb800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:39:55.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.974+0000 7f3a538bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:55.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.974+0000 7f3a538bb800 20 zonegroup default 2024-09-22T08:39:55.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.974+0000 7f3a538bb800 20 rados->read ofs=0 len=0 2024-09-22T08:39:55.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.974+0000 7f3a538bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:55.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.974+0000 7f3a538bb800 20 rados->read ofs=0 len=0 2024-09-22T08:39:55.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.974+0000 7f3a538bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:55.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.974+0000 7f3a538bb800 20 rados->read ofs=0 len=0 2024-09-22T08:39:55.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.975+0000 7f3a538bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:55.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.975+0000 7f3a538bb800 20 started sync module instance, tier type = 2024-09-22T08:39:55.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.975+0000 7f3a538bb800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:39:55.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.985+0000 7f3a538bb800 20 add_watcher() i=0 2024-09-22T08:39:55.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.985+0000 7f3a538bb800 20 add_watcher() i=1 2024-09-22T08:39:55.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.985+0000 7f3a538bb800 20 add_watcher() i=2 2024-09-22T08:39:55.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.985+0000 7f3a538bb800 20 add_watcher() i=3 2024-09-22T08:39:55.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.985+0000 7f3a538bb800 20 add_watcher() i=4 2024-09-22T08:39:55.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.985+0000 7f3a538bb800 20 add_watcher() i=5 2024-09-22T08:39:55.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.985+0000 7f3a538bb800 20 add_watcher() i=6 2024-09-22T08:39:55.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.986+0000 7f3a538bb800 20 add_watcher() i=7 2024-09-22T08:39:55.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.986+0000 7f3a538bb800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:55.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.989+0000 7f39077e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:55.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.989+0000 7f3a538bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:55.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.989+0000 7f3a538bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:55.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.989+0000 7f3a538bb800 5 note: GC not initialized 2024-09-22T08:39:55.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.989+0000 7f39067e4640 20 reqs_thread_entry: start 2024-09-22T08:39:55.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.989+0000 7f3a538bb800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:55.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.989+0000 7f3a538bb800 20 Filter name: none 2024-09-22T08:39:55.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.989+0000 7f3877fff640 20 reqs_thread_entry: start 2024-09-22T08:39:55.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.989+0000 7f3a538bb800 20 rados->read ofs=0 len=0 2024-09-22T08:39:55.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.990+0000 7f3a538bb800 20 rados_obj.operate() r=0 bl.length=173 2024-09-22T08:39:55.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.990+0000 7f3a538bb800 20 rados->read ofs=0 len=0 2024-09-22T08:39:55.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.991+0000 7f3a538bb800 20 rados_obj.operate() r=0 bl.length=395 2024-09-22T08:39:55.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.991+0000 7f3a538bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:55.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.991+0000 7f3a538bb800 20 rados->read ofs=0 len=0 2024-09-22T08:39:55.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.991+0000 7f3a538bb800 20 rados_obj.operate() r=0 bl.length=173 2024-09-22T08:39:55.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.991+0000 7f3a538bb800 20 rados->read ofs=0 len=0 2024-09-22T08:39:55.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.991+0000 7f3a538bb800 20 rados_obj.operate() r=0 bl.length=395 2024-09-22T08:39:55.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.991+0000 7f3a538bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:55.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.993+0000 7f39077e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:55.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.995+0000 7f3a538bb800 20 remove_watcher() i=0 2024-09-22T08:39:55.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.995+0000 7f3a538bb800 2 removed watcher, disabling cache 2024-09-22T08:39:55.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.997+0000 7f3a538bb800 20 remove_watcher() i=1 2024-09-22T08:39:55.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.998+0000 7f3a538bb800 20 remove_watcher() i=2 2024-09-22T08:39:56.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:55.999+0000 7f3a538bb800 20 remove_watcher() i=3 2024-09-22T08:39:56.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.000+0000 7f3a538bb800 20 remove_watcher() i=4 2024-09-22T08:39:56.002 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.001+0000 7f3a538bb800 20 remove_watcher() i=5 2024-09-22T08:39:56.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.003+0000 7f3a538bb800 20 remove_watcher() i=6 2024-09-22T08:39:56.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.004+0000 7f3a538bb800 20 remove_watcher() i=7 2024-09-22T08:39:56.016 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:56.016 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:39:56.016 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: myver id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-22T08:39:56.016 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:56.018 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 12 2024-09-22T08:39:56.050 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:56.050 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:56.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.089+0000 7fde36926800 20 rados->read ofs=0 len=0 2024-09-22T08:39:56.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.091+0000 7fde36926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:56.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.091+0000 7fde36926800 20 realm 2024-09-22T08:39:56.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.091+0000 7fde36926800 20 rados->read ofs=0 len=0 2024-09-22T08:39:56.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.091+0000 7fde36926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:56.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.091+0000 7fde36926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:56.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.091+0000 7fde36926800 20 rados->read ofs=0 len=0 2024-09-22T08:39:56.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.092+0000 7fde36926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:56.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.092+0000 7fde36926800 20 rados->read ofs=0 len=0 2024-09-22T08:39:56.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.092+0000 7fde36926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:56.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.092+0000 7fde36926800 20 rados->read ofs=0 len=0 2024-09-22T08:39:56.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.093+0000 7fde36926800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:56.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.093+0000 7fde36926800 20 searching for the correct realm 2024-09-22T08:39:56.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.095+0000 7fde31dd8640 0 -- 172.21.15.38:0/1147906717 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7fde28036040 msgr2=0x7fde280a69b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:56.100 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.099+0000 7fde31dd8640 0 -- 172.21.15.38:0/1147906717 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fde24034920 msgr2=0x7fde240133f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:56.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.306+0000 7fde36926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:56.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.306+0000 7fde36926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:56.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.306+0000 7fde36926800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:39:56.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.306+0000 7fde36926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:56.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.306+0000 7fde36926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:56.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.306+0000 7fde36926800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:39:56.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.306+0000 7fde36926800 20 rados->read ofs=0 len=0 2024-09-22T08:39:56.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.306+0000 7fde36926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:56.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.306+0000 7fde36926800 20 rados->read ofs=0 len=0 2024-09-22T08:39:56.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.306+0000 7fde36926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:56.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.306+0000 7fde36926800 20 rados->read ofs=0 len=0 2024-09-22T08:39:56.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.307+0000 7fde36926800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:56.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.307+0000 7fde36926800 20 zone default found 2024-09-22T08:39:56.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.307+0000 7fde36926800 4 Realm: () 2024-09-22T08:39:56.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.307+0000 7fde36926800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:39:56.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.307+0000 7fde36926800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:39:56.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.307+0000 7fde36926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:56.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.307+0000 7fde36926800 20 zonegroup default 2024-09-22T08:39:56.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.307+0000 7fde36926800 20 rados->read ofs=0 len=0 2024-09-22T08:39:56.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.307+0000 7fde36926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:56.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.307+0000 7fde36926800 20 rados->read ofs=0 len=0 2024-09-22T08:39:56.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.308+0000 7fde36926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:56.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.308+0000 7fde36926800 20 rados->read ofs=0 len=0 2024-09-22T08:39:56.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.308+0000 7fde36926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:56.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.308+0000 7fde36926800 20 started sync module instance, tier type = 2024-09-22T08:39:56.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.308+0000 7fde36926800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:39:56.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.318+0000 7fde36926800 20 add_watcher() i=0 2024-09-22T08:39:56.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.318+0000 7fde36926800 20 add_watcher() i=1 2024-09-22T08:39:56.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.318+0000 7fde36926800 20 add_watcher() i=2 2024-09-22T08:39:56.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.318+0000 7fde36926800 20 add_watcher() i=3 2024-09-22T08:39:56.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.318+0000 7fde36926800 20 add_watcher() i=4 2024-09-22T08:39:56.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.318+0000 7fde36926800 20 add_watcher() i=5 2024-09-22T08:39:56.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.319+0000 7fde36926800 20 add_watcher() i=6 2024-09-22T08:39:56.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.320+0000 7fde36926800 20 add_watcher() i=7 2024-09-22T08:39:56.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.320+0000 7fde36926800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:56.323 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.322+0000 7fdce8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:56.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.322+0000 7fde36926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:56.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.322+0000 7fde36926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:56.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.322+0000 7fde36926800 5 note: GC not initialized 2024-09-22T08:39:56.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.322+0000 7fdc637fe640 20 reqs_thread_entry: start 2024-09-22T08:39:56.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.322+0000 7fde36926800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:56.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.323+0000 7fde36926800 20 Filter name: none 2024-09-22T08:39:56.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.323+0000 7fdc617fa640 20 reqs_thread_entry: start 2024-09-22T08:39:56.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.323+0000 7fde36926800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-22T08:39:56.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.323+0000 7fde36926800 20 rados->read ofs=0 len=0 2024-09-22T08:39:56.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.323+0000 7fde36926800 20 rados_obj.operate() r=0 bl.length=173 2024-09-22T08:39:56.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.323+0000 7fde36926800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-22T08:39:56.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.323+0000 7fde36926800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-22T08:39:56.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.323+0000 7fde36926800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 : miss 2024-09-22T08:39:56.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.323+0000 7fde36926800 20 rados->read ofs=0 len=0 2024-09-22T08:39:56.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.324+0000 7fde36926800 20 rados_obj.operate() r=0 bl.length=395 2024-09-22T08:39:56.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.324+0000 7fde36926800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 info.flags=0x17 2024-09-22T08:39:56.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.324+0000 7fde36926800 10 adding default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 to cache LRU end 2024-09-22T08:39:56.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.324+0000 7fde36926800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:39:56.326 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.324+0000 7fde36926800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:39:56.326 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.324+0000 7fde36926800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 2024-09-22T08:39:56.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.330+0000 7fde36926800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 info.flags=0x17 2024-09-22T08:39:56.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.330+0000 7fde36926800 10 moving default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 to cache LRU end 2024-09-22T08:39:56.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.330+0000 7fde36926800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:39:56.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.330+0000 7fde36926800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18, ofs0, ns] 2024-09-22T08:39:56.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.330+0000 7fdd157fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497006 cookie 94801108284384 notifier 8379 bl.length()=821 2024-09-22T08:39:56.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.330+0000 7fdd157fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 info.flags=0x17 2024-09-22T08:39:56.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.330+0000 7fdd157fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 to cache LRU end 2024-09-22T08:39:56.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.330+0000 7fdd157fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:39:56.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.331+0000 7fde36926800 20 handle_bi_update(): bucket=:myver[c62f9d7b-f6b6-404a-90de-de5607499115.4584.18]): orig_sources= new_sources= 2024-09-22T08:39:56.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.331+0000 7fde36926800 20 handle_bi_update(): bucket=:myver[c62f9d7b-f6b6-404a-90de-de5607499115.4584.18]): potential sources added=[] removed=[] 2024-09-22T08:39:56.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.331+0000 7fde36926800 20 handle_bi_update(): bucket=:myver[c62f9d7b-f6b6-404a-90de-de5607499115.4584.18]): orig_dests= new_dests= 2024-09-22T08:39:56.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.331+0000 7fde36926800 20 handle_bi_update(): bucket=:myver[c62f9d7b-f6b6-404a-90de-de5607499115.4584.18]): potential dests added=[] removed=[] 2024-09-22T08:39:56.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.336+0000 7fde36926800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.0 2024-09-22T08:39:56.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.336+0000 7fde36926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.0 2024-09-22T08:39:56.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.336+0000 7fde36926800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.1 2024-09-22T08:39:56.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.336+0000 7fde36926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.1 2024-09-22T08:39:56.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.336+0000 7fde36926800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.2 2024-09-22T08:39:56.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.336+0000 7fde36926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.2 2024-09-22T08:39:56.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.336+0000 7fde36926800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.3 2024-09-22T08:39:56.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.336+0000 7fde36926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.3 2024-09-22T08:39:56.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.336+0000 7fde36926800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.4 2024-09-22T08:39:56.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.336+0000 7fde36926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.4 2024-09-22T08:39:56.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.336+0000 7fde36926800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.5 2024-09-22T08:39:56.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.336+0000 7fde36926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.5 2024-09-22T08:39:56.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.336+0000 7fde36926800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.6 2024-09-22T08:39:56.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.336+0000 7fde36926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.6 2024-09-22T08:39:56.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.336+0000 7fde36926800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.7 2024-09-22T08:39:56.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.336+0000 7fde36926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.7 2024-09-22T08:39:56.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.336+0000 7fde36926800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.8 2024-09-22T08:39:56.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.336+0000 7fde36926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.8 2024-09-22T08:39:56.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.336+0000 7fde36926800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.9 2024-09-22T08:39:56.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.336+0000 7fde36926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.9 2024-09-22T08:39:56.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.336+0000 7fde36926800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.10 2024-09-22T08:39:56.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.336+0000 7fde36926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.10 2024-09-22T08:39:56.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.336+0000 7fde36926800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.11 2024-09-22T08:39:56.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.336+0000 7fde36926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.11 2024-09-22T08:39:56.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.336+0000 7fde36926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.0 2024-09-22T08:39:56.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.336+0000 7fde36926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1 2024-09-22T08:39:56.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.337+0000 7fde36926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2 2024-09-22T08:39:56.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.337+0000 7fde36926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3 2024-09-22T08:39:56.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.337+0000 7fde36926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.4 2024-09-22T08:39:56.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.338+0000 7fde36926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.5 2024-09-22T08:39:56.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.338+0000 7fde36926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.6 2024-09-22T08:39:56.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.339+0000 7fde36926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.7 2024-09-22T08:39:56.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.339+0000 7fde36926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.8 2024-09-22T08:39:56.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.340+0000 7fde36926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.9 2024-09-22T08:39:56.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.340+0000 7fde36926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.10 2024-09-22T08:39:56.342 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.341+0000 7fde36926800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 : hit (requested=0x17, cached=0x17) 2024-09-22T08:39:56.342 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.341+0000 7fde36926800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 2024-09-22T08:39:56.343 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.342+0000 7fde36926800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 info.flags=0x17 2024-09-22T08:39:56.343 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.342+0000 7fde36926800 10 moving default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 to cache LRU end 2024-09-22T08:39:56.343 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.342+0000 7fde36926800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:39:56.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.342+0000 7fde36926800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18, ofs0, ns] 2024-09-22T08:39:56.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.343+0000 7fdd157fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497007 cookie 94801108284384 notifier 8379 bl.length()=821 2024-09-22T08:39:56.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.343+0000 7fdd157fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 info.flags=0x17 2024-09-22T08:39:56.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.343+0000 7fdd157fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 to cache LRU end 2024-09-22T08:39:56.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.343+0000 7fdd157fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:39:56.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.343+0000 7fde36926800 20 handle_bi_update(): bucket=:myver[c62f9d7b-f6b6-404a-90de-de5607499115.4584.18]): orig_sources= new_sources= 2024-09-22T08:39:56.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.343+0000 7fde36926800 20 handle_bi_update(): bucket=:myver[c62f9d7b-f6b6-404a-90de-de5607499115.4584.18]): potential sources added=[] removed=[] 2024-09-22T08:39:56.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.343+0000 7fde36926800 20 handle_bi_update(): bucket=:myver[c62f9d7b-f6b6-404a-90de-de5607499115.4584.18]): orig_dests= new_dests= 2024-09-22T08:39:56.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.343+0000 7fde36926800 20 handle_bi_update(): bucket=:myver[c62f9d7b-f6b6-404a-90de-de5607499115.4584.18]): potential dests added=[] removed=[] 2024-09-22T08:39:56.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.346+0000 7fde36926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.0 2024-09-22T08:39:56.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.346+0000 7fde36926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1 2024-09-22T08:39:56.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.346+0000 7fde36926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2 2024-09-22T08:39:56.348 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.347+0000 7fde36926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3 2024-09-22T08:39:56.348 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.347+0000 7fde36926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.4 2024-09-22T08:39:56.348 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.347+0000 7fde36926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.5 2024-09-22T08:39:56.348 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.347+0000 7fde36926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.6 2024-09-22T08:39:56.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.348+0000 7fde36926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.7 2024-09-22T08:39:56.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.348+0000 7fde36926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.8 2024-09-22T08:39:56.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.348+0000 7fde36926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.9 2024-09-22T08:39:56.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.349+0000 7fde36926800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.10 2024-09-22T08:39:56.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.349+0000 7fde36926800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 : hit (requested=0x17, cached=0x17) 2024-09-22T08:39:56.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.349+0000 7fde36926800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 2024-09-22T08:39:56.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.351+0000 7fde36926800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 info.flags=0x17 2024-09-22T08:39:56.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.351+0000 7fde36926800 10 moving default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 to cache LRU end 2024-09-22T08:39:56.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.351+0000 7fde36926800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:39:56.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.351+0000 7fde36926800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18, ofs0, ns] 2024-09-22T08:39:56.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.351+0000 7fdd15ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497008 cookie 94801108284384 notifier 8379 bl.length()=789 2024-09-22T08:39:56.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.351+0000 7fdd15ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 info.flags=0x17 2024-09-22T08:39:56.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.351+0000 7fdd15ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 to cache LRU end 2024-09-22T08:39:56.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.351+0000 7fdd15ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:39:56.353 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.351+0000 7fde36926800 20 handle_bi_update(): bucket=:myver[c62f9d7b-f6b6-404a-90de-de5607499115.4584.18]): orig_sources= new_sources= 2024-09-22T08:39:56.353 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.351+0000 7fde36926800 20 handle_bi_update(): bucket=:myver[c62f9d7b-f6b6-404a-90de-de5607499115.4584.18]): potential sources added=[] removed=[] 2024-09-22T08:39:56.353 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.351+0000 7fde36926800 20 handle_bi_update(): bucket=:myver[c62f9d7b-f6b6-404a-90de-de5607499115.4584.18]): orig_dests= new_dests= 2024-09-22T08:39:56.353 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.351+0000 7fde36926800 20 handle_bi_update(): bucket=:myver[c62f9d7b-f6b6-404a-90de-de5607499115.4584.18]): potential dests added=[] removed=[] 2024-09-22T08:39:56.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.354+0000 7fde36926800 1 execute INFO: reshard of bucket "myver" from 11 shards to 12 shards completed successfully 2024-09-22T08:39:56.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.356+0000 7fdce8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:56.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.358+0000 7fde36926800 20 remove_watcher() i=0 2024-09-22T08:39:56.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.358+0000 7fde36926800 2 removed watcher, disabling cache 2024-09-22T08:39:56.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.359+0000 7fde36926800 20 remove_watcher() i=1 2024-09-22T08:39:56.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.360+0000 7fde36926800 20 remove_watcher() i=2 2024-09-22T08:39:56.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.361+0000 7fde36926800 20 remove_watcher() i=3 2024-09-22T08:39:56.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.362+0000 7fde36926800 20 remove_watcher() i=4 2024-09-22T08:39:56.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.363+0000 7fde36926800 20 remove_watcher() i=5 2024-09-22T08:39:56.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.364+0000 7fde36926800 20 remove_watcher() i=6 2024-09-22T08:39:56.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.365+0000 7fde36926800 20 remove_watcher() i=7 2024-09-22T08:39:56.379 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket myver 2024-09-22T08:39:56.408 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:56.408 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:56.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.446+0000 7f5997f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:56.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.448+0000 7f5997f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:56.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.448+0000 7f5997f2c800 20 realm 2024-09-22T08:39:56.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.448+0000 7f5997f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:56.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.449+0000 7f5997f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:56.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.449+0000 7f5997f2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:56.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.449+0000 7f5997f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:56.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.449+0000 7f5997f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:56.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.449+0000 7f5997f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:56.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.450+0000 7f5997f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:56.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.450+0000 7f5997f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:56.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.450+0000 7f5997f2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:56.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.450+0000 7f5997f2c800 20 searching for the correct realm 2024-09-22T08:39:56.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.452+0000 7f599333d640 0 -- 172.21.15.38:0/2416782469 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f5988046420 msgr2=0x7f5988046840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:56.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.658+0000 7f5993b3e640 0 -- 172.21.15.38:0/2416782469 >> [v2:172.21.15.42:6826/1437467409,v1:172.21.15.42:6827/1437467409] conn(0x7f5988058b40 msgr2=0x7f59880563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:56.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.866+0000 7f5997f2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:56.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.866+0000 7f5997f2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:56.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.866+0000 7f5997f2c800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:39:56.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.866+0000 7f5997f2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:56.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.866+0000 7f5997f2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:56.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.866+0000 7f5997f2c800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:39:56.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.866+0000 7f5997f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:56.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.867+0000 7f5997f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:56.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.867+0000 7f5997f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:56.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.867+0000 7f5997f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:56.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.867+0000 7f5997f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:56.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.867+0000 7f5997f2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:56.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.868+0000 7f5997f2c800 20 zone default found 2024-09-22T08:39:56.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.868+0000 7f5997f2c800 4 Realm: () 2024-09-22T08:39:56.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.868+0000 7f5997f2c800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:39:56.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.868+0000 7f5997f2c800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:39:56.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.868+0000 7f5997f2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:56.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.868+0000 7f5997f2c800 20 zonegroup default 2024-09-22T08:39:56.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.868+0000 7f5997f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:56.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.868+0000 7f5997f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:56.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.868+0000 7f5997f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:56.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.868+0000 7f5997f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:56.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.868+0000 7f5997f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:56.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.869+0000 7f5997f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:56.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.869+0000 7f5997f2c800 20 started sync module instance, tier type = 2024-09-22T08:39:56.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.869+0000 7f5997f2c800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:39:56.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.879+0000 7f5997f2c800 20 add_watcher() i=0 2024-09-22T08:39:56.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.879+0000 7f5997f2c800 20 add_watcher() i=1 2024-09-22T08:39:56.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.879+0000 7f5997f2c800 20 add_watcher() i=2 2024-09-22T08:39:56.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.879+0000 7f5997f2c800 20 add_watcher() i=3 2024-09-22T08:39:56.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.879+0000 7f5997f2c800 20 add_watcher() i=4 2024-09-22T08:39:56.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.879+0000 7f5997f2c800 20 add_watcher() i=5 2024-09-22T08:39:56.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.879+0000 7f5997f2c800 20 add_watcher() i=6 2024-09-22T08:39:56.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.880+0000 7f5997f2c800 20 add_watcher() i=7 2024-09-22T08:39:56.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.880+0000 7f5997f2c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:56.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.882+0000 7f5849fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:56.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.882+0000 7f5997f2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:56.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.882+0000 7f5997f2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:56.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.882+0000 7f5997f2c800 5 note: GC not initialized 2024-09-22T08:39:56.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.883+0000 7f5848fe1640 20 reqs_thread_entry: start 2024-09-22T08:39:56.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.883+0000 7f5997f2c800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:56.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.883+0000 7f5997f2c800 20 Filter name: none 2024-09-22T08:39:56.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.883+0000 7f57c27fc640 20 reqs_thread_entry: start 2024-09-22T08:39:56.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.883+0000 7f5997f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:56.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.884+0000 7f5997f2c800 20 rados_obj.operate() r=0 bl.length=173 2024-09-22T08:39:56.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.884+0000 7f5997f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:56.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.884+0000 7f5997f2c800 20 rados_obj.operate() r=0 bl.length=395 2024-09-22T08:39:56.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.884+0000 7f5997f2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:56.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.884+0000 7f5997f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:56.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.885+0000 7f5997f2c800 20 rados_obj.operate() r=0 bl.length=173 2024-09-22T08:39:56.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.885+0000 7f5997f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:56.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.885+0000 7f5997f2c800 20 rados_obj.operate() r=0 bl.length=395 2024-09-22T08:39:56.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.885+0000 7f5997f2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:56.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.887+0000 7f5849fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:56.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.889+0000 7f5997f2c800 20 remove_watcher() i=0 2024-09-22T08:39:56.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.890+0000 7f5997f2c800 2 removed watcher, disabling cache 2024-09-22T08:39:56.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.891+0000 7f5997f2c800 20 remove_watcher() i=1 2024-09-22T08:39:56.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.892+0000 7f5997f2c800 20 remove_watcher() i=2 2024-09-22T08:39:56.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.893+0000 7f5997f2c800 20 remove_watcher() i=3 2024-09-22T08:39:56.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.894+0000 7f5997f2c800 20 remove_watcher() i=4 2024-09-22T08:39:56.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.895+0000 7f5997f2c800 20 remove_watcher() i=5 2024-09-22T08:39:56.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.896+0000 7f5997f2c800 20 remove_watcher() i=6 2024-09-22T08:39:56.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:56.898+0000 7f5997f2c800 20 remove_watcher() i=7 2024-09-22T08:39:56.910 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:56.910 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:39:56.910 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: myver id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-22T08:39:56.911 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:56.913 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:39:56.913 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:39:56.916 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:39:56.916 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:39:56.957 INFO:tasks.workunit.client.0.smithi038.stderr: test: reshard removes olh entries with empty name 2024-09-22T08:39:56.959 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:39:56.959 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:39:57.007 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:39:57.007 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:39:57.051 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T08:39:57.080 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:57.081 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:57.120 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.119+0000 7fcf35d26800 20 rados->read ofs=0 len=0 2024-09-22T08:39:57.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.121+0000 7fcf35d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:57.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.122+0000 7fcf35d26800 20 realm 2024-09-22T08:39:57.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.122+0000 7fcf35d26800 20 rados->read ofs=0 len=0 2024-09-22T08:39:57.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.122+0000 7fcf35d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:57.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.122+0000 7fcf35d26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:57.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.122+0000 7fcf35d26800 20 rados->read ofs=0 len=0 2024-09-22T08:39:57.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.122+0000 7fcf35d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:57.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.122+0000 7fcf35d26800 20 rados->read ofs=0 len=0 2024-09-22T08:39:57.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.123+0000 7fcf35d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:57.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.123+0000 7fcf35d26800 20 rados->read ofs=0 len=0 2024-09-22T08:39:57.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.123+0000 7fcf35d26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:57.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.123+0000 7fcf35d26800 20 searching for the correct realm 2024-09-22T08:39:57.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.126+0000 7fcf2bfff640 0 -- 172.21.15.38:0/1691271674 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7fcf1c06b020 msgr2=0x7fcf1c04ded0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:57.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.129+0000 7fcf2bfff640 0 -- 172.21.15.38:0/1691271674 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fcf240273f0 msgr2=0x7fcf24027870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:57.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.337+0000 7fcf35d26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:57.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.337+0000 7fcf35d26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:57.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.337+0000 7fcf35d26800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:39:57.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.337+0000 7fcf35d26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:57.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.337+0000 7fcf35d26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:57.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.337+0000 7fcf35d26800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:39:57.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.337+0000 7fcf35d26800 20 rados->read ofs=0 len=0 2024-09-22T08:39:57.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.338+0000 7fcf35d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:57.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.338+0000 7fcf35d26800 20 rados->read ofs=0 len=0 2024-09-22T08:39:57.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.338+0000 7fcf35d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:57.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.338+0000 7fcf35d26800 20 rados->read ofs=0 len=0 2024-09-22T08:39:57.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.338+0000 7fcf35d26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:57.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.338+0000 7fcf35d26800 20 zone default found 2024-09-22T08:39:57.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.338+0000 7fcf35d26800 4 Realm: () 2024-09-22T08:39:57.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.338+0000 7fcf35d26800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:39:57.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.338+0000 7fcf35d26800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:39:57.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.338+0000 7fcf35d26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:57.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.338+0000 7fcf35d26800 20 zonegroup default 2024-09-22T08:39:57.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.338+0000 7fcf35d26800 20 rados->read ofs=0 len=0 2024-09-22T08:39:57.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.339+0000 7fcf35d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:57.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.339+0000 7fcf35d26800 20 rados->read ofs=0 len=0 2024-09-22T08:39:57.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.339+0000 7fcf35d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:57.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.339+0000 7fcf35d26800 20 rados->read ofs=0 len=0 2024-09-22T08:39:57.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.339+0000 7fcf35d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:57.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.339+0000 7fcf35d26800 20 started sync module instance, tier type = 2024-09-22T08:39:57.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.339+0000 7fcf35d26800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:39:57.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.350+0000 7fcf35d26800 20 add_watcher() i=0 2024-09-22T08:39:57.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.350+0000 7fcf35d26800 20 add_watcher() i=1 2024-09-22T08:39:57.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.350+0000 7fcf35d26800 20 add_watcher() i=2 2024-09-22T08:39:57.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.350+0000 7fcf35d26800 20 add_watcher() i=3 2024-09-22T08:39:57.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.350+0000 7fcf35d26800 20 add_watcher() i=4 2024-09-22T08:39:57.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.350+0000 7fcf35d26800 20 add_watcher() i=5 2024-09-22T08:39:57.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.350+0000 7fcf35d26800 20 add_watcher() i=6 2024-09-22T08:39:57.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.351+0000 7fcf35d26800 20 add_watcher() i=7 2024-09-22T08:39:57.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.351+0000 7fcf35d26800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:57.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.353+0000 7fcde37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:57.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.353+0000 7fcf35d26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:57.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.353+0000 7fcf35d26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:57.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.353+0000 7fcf35d26800 5 note: GC not initialized 2024-09-22T08:39:57.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.354+0000 7fcde27fc640 20 reqs_thread_entry: start 2024-09-22T08:39:57.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.354+0000 7fcf35d26800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:57.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.354+0000 7fcf35d26800 20 Filter name: none 2024-09-22T08:39:57.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.354+0000 7fcd53fff640 20 reqs_thread_entry: start 2024-09-22T08:39:57.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.354+0000 7fcf35d26800 20 rados->read ofs=0 len=0 2024-09-22T08:39:57.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.354+0000 7fcf35d26800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:39:57.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.354+0000 7fcf35d26800 20 rados->read ofs=0 len=0 2024-09-22T08:39:57.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.355+0000 7fcf35d26800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T08:39:57.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.355+0000 7fcf35d26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:57.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.355+0000 7fcf35d26800 20 rados->read ofs=0 len=0 2024-09-22T08:39:57.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.355+0000 7fcf35d26800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:39:57.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.355+0000 7fcf35d26800 20 rados->read ofs=0 len=0 2024-09-22T08:39:57.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.356+0000 7fcf35d26800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T08:39:57.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.356+0000 7fcf35d26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:57.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.358+0000 7fcde37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:57.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.360+0000 7fcf35d26800 20 remove_watcher() i=0 2024-09-22T08:39:57.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.360+0000 7fcf35d26800 2 removed watcher, disabling cache 2024-09-22T08:39:57.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.361+0000 7fcf35d26800 20 remove_watcher() i=1 2024-09-22T08:39:57.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.363+0000 7fcf35d26800 20 remove_watcher() i=2 2024-09-22T08:39:57.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.364+0000 7fcf35d26800 20 remove_watcher() i=3 2024-09-22T08:39:57.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.365+0000 7fcf35d26800 20 remove_watcher() i=4 2024-09-22T08:39:57.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.366+0000 7fcf35d26800 20 remove_watcher() i=5 2024-09-22T08:39:57.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.367+0000 7fcf35d26800 20 remove_watcher() i=6 2024-09-22T08:39:57.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.368+0000 7fcf35d26800 20 remove_watcher() i=7 2024-09-22T08:39:57.381 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:57.381 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:39:57.381 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: a-bucket id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 num_objects: 0 size_kb: 0 num_shards: 13 2024-09-22T08:39:57.381 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:57.382 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-22T08:39:57.412 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:57.412 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:57.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.450+0000 7f2106b32800 20 rados->read ofs=0 len=0 2024-09-22T08:39:57.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.452+0000 7f2106b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:57.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.452+0000 7f2106b32800 20 realm 2024-09-22T08:39:57.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.452+0000 7f2106b32800 20 rados->read ofs=0 len=0 2024-09-22T08:39:57.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.452+0000 7f2106b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:57.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.452+0000 7f2106b32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:57.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.452+0000 7f2106b32800 20 rados->read ofs=0 len=0 2024-09-22T08:39:57.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.453+0000 7f2106b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:57.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.453+0000 7f2106b32800 20 rados->read ofs=0 len=0 2024-09-22T08:39:57.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.454+0000 7f2106b32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:57.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.454+0000 7f2106b32800 20 rados->read ofs=0 len=0 2024-09-22T08:39:57.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.454+0000 7f2106b32800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:57.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.454+0000 7f2106b32800 20 searching for the correct realm 2024-09-22T08:39:57.458 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.457+0000 7f2101fbb640 0 -- 172.21.15.38:0/3220273620 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f20f8049060 msgr2=0x7f20f8075630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:57.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.460+0000 7f2101fbb640 0 -- 172.21.15.38:0/3220273620 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f20f4069f80 msgr2=0x7f20f406f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:57.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.667+0000 7f2106b32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:57.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.667+0000 7f2106b32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:57.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.667+0000 7f2106b32800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:39:57.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.667+0000 7f2106b32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:57.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.667+0000 7f2106b32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:57.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.667+0000 7f2106b32800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:39:57.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.667+0000 7f2106b32800 20 rados->read ofs=0 len=0 2024-09-22T08:39:57.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.668+0000 7f2106b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:57.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.668+0000 7f2106b32800 20 rados->read ofs=0 len=0 2024-09-22T08:39:57.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.668+0000 7f2106b32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:57.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.668+0000 7f2106b32800 20 rados->read ofs=0 len=0 2024-09-22T08:39:57.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.668+0000 7f2106b32800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:57.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.668+0000 7f2106b32800 20 zone default found 2024-09-22T08:39:57.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.668+0000 7f2106b32800 4 Realm: () 2024-09-22T08:39:57.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.668+0000 7f2106b32800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:39:57.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.668+0000 7f2106b32800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:39:57.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.668+0000 7f2106b32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:57.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.668+0000 7f2106b32800 20 zonegroup default 2024-09-22T08:39:57.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.668+0000 7f2106b32800 20 rados->read ofs=0 len=0 2024-09-22T08:39:57.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.669+0000 7f2106b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:57.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.669+0000 7f2106b32800 20 rados->read ofs=0 len=0 2024-09-22T08:39:57.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.669+0000 7f2106b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:57.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.669+0000 7f2106b32800 20 rados->read ofs=0 len=0 2024-09-22T08:39:57.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.669+0000 7f2106b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:57.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.669+0000 7f2106b32800 20 started sync module instance, tier type = 2024-09-22T08:39:57.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.669+0000 7f2106b32800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:39:57.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.679+0000 7f2106b32800 20 add_watcher() i=0 2024-09-22T08:39:57.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.679+0000 7f2106b32800 20 add_watcher() i=1 2024-09-22T08:39:57.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.679+0000 7f2106b32800 20 add_watcher() i=2 2024-09-22T08:39:57.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.679+0000 7f2106b32800 20 add_watcher() i=3 2024-09-22T08:39:57.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.679+0000 7f2106b32800 20 add_watcher() i=4 2024-09-22T08:39:57.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.679+0000 7f2106b32800 20 add_watcher() i=5 2024-09-22T08:39:57.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.679+0000 7f2106b32800 20 add_watcher() i=6 2024-09-22T08:39:57.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.680+0000 7f2106b32800 20 add_watcher() i=7 2024-09-22T08:39:57.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.680+0000 7f2106b32800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:57.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.682+0000 7f1fb8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:57.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.683+0000 7f2106b32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:57.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.683+0000 7f2106b32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:57.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.683+0000 7f2106b32800 5 note: GC not initialized 2024-09-22T08:39:57.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.683+0000 7f1f337fe640 20 reqs_thread_entry: start 2024-09-22T08:39:57.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.683+0000 7f2106b32800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:57.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.683+0000 7f2106b32800 20 Filter name: none 2024-09-22T08:39:57.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.683+0000 7f1f317fa640 20 reqs_thread_entry: start 2024-09-22T08:39:57.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.683+0000 7f2106b32800 20 rados->read ofs=0 len=0 2024-09-22T08:39:57.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.684+0000 7f2106b32800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:39:57.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.684+0000 7f2106b32800 20 rados->read ofs=0 len=0 2024-09-22T08:39:57.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.684+0000 7f2106b32800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T08:39:57.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.684+0000 7f2106b32800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:57.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.685+0000 7f1fb8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:57.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.687+0000 7f2106b32800 20 remove_watcher() i=0 2024-09-22T08:39:57.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.687+0000 7f2106b32800 2 removed watcher, disabling cache 2024-09-22T08:39:57.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.688+0000 7f2106b32800 20 remove_watcher() i=1 2024-09-22T08:39:57.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.690+0000 7f2106b32800 20 remove_watcher() i=2 2024-09-22T08:39:57.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.691+0000 7f2106b32800 20 remove_watcher() i=3 2024-09-22T08:39:57.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.692+0000 7f2106b32800 20 remove_watcher() i=4 2024-09-22T08:39:57.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.693+0000 7f2106b32800 20 remove_watcher() i=5 2024-09-22T08:39:57.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.694+0000 7f2106b32800 20 remove_watcher() i=6 2024-09-22T08:39:57.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.695+0000 7f2106b32800 20 remove_watcher() i=7 2024-09-22T08:39:57.708 INFO:tasks.workunit.client.0.smithi038.stderr:rados -p default.rgw.buckets.index setomapval .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-22T08:39:57.734 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:57.735 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:57.751 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-22T08:39:57.780 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:57.780 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:57.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.818+0000 7ff705346800 20 rados->read ofs=0 len=0 2024-09-22T08:39:57.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.820+0000 7ff705346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:57.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.820+0000 7ff705346800 20 realm 2024-09-22T08:39:57.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.820+0000 7ff705346800 20 rados->read ofs=0 len=0 2024-09-22T08:39:57.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.820+0000 7ff705346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:57.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.820+0000 7ff705346800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:57.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.820+0000 7ff705346800 20 rados->read ofs=0 len=0 2024-09-22T08:39:57.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.820+0000 7ff705346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:57.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.820+0000 7ff705346800 20 rados->read ofs=0 len=0 2024-09-22T08:39:57.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.821+0000 7ff705346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:57.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.821+0000 7ff705346800 20 rados->read ofs=0 len=0 2024-09-22T08:39:57.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.822+0000 7ff705346800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:57.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.822+0000 7ff705346800 20 searching for the correct realm 2024-09-22T08:39:57.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:57.824+0000 7ff70262f640 0 -- 172.21.15.38:0/2145850269 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7ff6f8043040 msgr2=0x7ff6f8042440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:58.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.030+0000 7ff702e30640 0 -- 172.21.15.38:0/2145850269 >> [v2:172.21.15.42:6826/1437467409,v1:172.21.15.42:6827/1437467409] conn(0x7ff6f8037400 msgr2=0x7ff6f8037860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:39:58.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.239+0000 7ff705346800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:58.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.239+0000 7ff705346800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:58.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.239+0000 7ff705346800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:39:58.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.239+0000 7ff705346800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:58.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.239+0000 7ff705346800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:58.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.239+0000 7ff705346800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:39:58.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.239+0000 7ff705346800 20 rados->read ofs=0 len=0 2024-09-22T08:39:58.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.239+0000 7ff705346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:58.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.239+0000 7ff705346800 20 rados->read ofs=0 len=0 2024-09-22T08:39:58.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.240+0000 7ff705346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:58.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.240+0000 7ff705346800 20 rados->read ofs=0 len=0 2024-09-22T08:39:58.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.240+0000 7ff705346800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:58.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.240+0000 7ff705346800 20 zone default found 2024-09-22T08:39:58.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.240+0000 7ff705346800 4 Realm: () 2024-09-22T08:39:58.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.240+0000 7ff705346800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:39:58.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.240+0000 7ff705346800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:39:58.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.240+0000 7ff705346800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:58.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.240+0000 7ff705346800 20 zonegroup default 2024-09-22T08:39:58.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.240+0000 7ff705346800 20 rados->read ofs=0 len=0 2024-09-22T08:39:58.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.240+0000 7ff705346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:58.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.240+0000 7ff705346800 20 rados->read ofs=0 len=0 2024-09-22T08:39:58.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.241+0000 7ff705346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:58.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.241+0000 7ff705346800 20 rados->read ofs=0 len=0 2024-09-22T08:39:58.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.241+0000 7ff705346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:58.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.241+0000 7ff705346800 20 started sync module instance, tier type = 2024-09-22T08:39:58.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.241+0000 7ff705346800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:39:58.253 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.252+0000 7ff705346800 20 add_watcher() i=0 2024-09-22T08:39:58.253 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.252+0000 7ff705346800 20 add_watcher() i=1 2024-09-22T08:39:58.253 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.252+0000 7ff705346800 20 add_watcher() i=2 2024-09-22T08:39:58.253 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.252+0000 7ff705346800 20 add_watcher() i=3 2024-09-22T08:39:58.253 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.252+0000 7ff705346800 20 add_watcher() i=4 2024-09-22T08:39:58.253 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.252+0000 7ff705346800 20 add_watcher() i=5 2024-09-22T08:39:58.253 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.252+0000 7ff705346800 20 add_watcher() i=6 2024-09-22T08:39:58.254 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.253+0000 7ff705346800 20 add_watcher() i=7 2024-09-22T08:39:58.254 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.253+0000 7ff705346800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:58.256 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.255+0000 7ff5b97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:58.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.256+0000 7ff705346800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:58.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.256+0000 7ff705346800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:58.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.256+0000 7ff705346800 5 note: GC not initialized 2024-09-22T08:39:58.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.256+0000 7ff533fff640 20 reqs_thread_entry: start 2024-09-22T08:39:58.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.256+0000 7ff705346800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:58.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.256+0000 7ff705346800 20 Filter name: none 2024-09-22T08:39:58.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.256+0000 7ff531ffb640 20 reqs_thread_entry: start 2024-09-22T08:39:58.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.256+0000 7ff705346800 20 rados->read ofs=0 len=0 2024-09-22T08:39:58.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.256+0000 7ff705346800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:39:58.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.257+0000 7ff705346800 20 rados->read ofs=0 len=0 2024-09-22T08:39:58.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.257+0000 7ff705346800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T08:39:58.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.257+0000 7ff705346800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:58.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.257+0000 7ff705346800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-22T08:39:58.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.257+0000 7ff705346800 20 INFO: main: starting shard=0 2024-09-22T08:39:58.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.257+0000 7ff705346800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.0 2024-09-22T08:39:58.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.257+0000 7ff705346800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.0 2024-09-22T08:39:58.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.258+0000 7ff705346800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-22T08:39:58.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.258+0000 7ff705346800 20 INFO: main: starting shard=1 2024-09-22T08:39:58.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.258+0000 7ff705346800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.1 2024-09-22T08:39:58.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.258+0000 7ff705346800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.1 2024-09-22T08:39:58.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.258+0000 7ff705346800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:39:58.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.258+0000 7ff705346800 20 INFO: main: starting shard=2 2024-09-22T08:39:58.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.258+0000 7ff705346800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.2 2024-09-22T08:39:58.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.258+0000 7ff705346800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.2 2024-09-22T08:39:58.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.259+0000 7ff705346800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:39:58.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.259+0000 7ff705346800 20 INFO: main: starting shard=3 2024-09-22T08:39:58.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.259+0000 7ff705346800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.3 2024-09-22T08:39:58.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.259+0000 7ff705346800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.3 2024-09-22T08:39:58.261 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.259+0000 7ff705346800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:39:58.261 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.259+0000 7ff705346800 20 INFO: main: starting shard=4 2024-09-22T08:39:58.261 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.259+0000 7ff705346800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.4 2024-09-22T08:39:58.262 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.259+0000 7ff705346800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.4 2024-09-22T08:39:58.262 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.260+0000 7ff705346800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:39:58.262 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.260+0000 7ff705346800 20 INFO: main: starting shard=5 2024-09-22T08:39:58.262 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.260+0000 7ff705346800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.5 2024-09-22T08:39:58.262 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.260+0000 7ff705346800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.5 2024-09-22T08:39:58.262 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.260+0000 7ff705346800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:39:58.262 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.260+0000 7ff705346800 20 INFO: main: starting shard=6 2024-09-22T08:39:58.262 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.260+0000 7ff705346800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.6 2024-09-22T08:39:58.262 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.260+0000 7ff705346800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.6 2024-09-22T08:39:58.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.261+0000 7ff705346800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:39:58.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.261+0000 7ff705346800 20 INFO: main: starting shard=7 2024-09-22T08:39:58.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.261+0000 7ff705346800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.7 2024-09-22T08:39:58.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.261+0000 7ff705346800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.7 2024-09-22T08:39:58.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.262+0000 7ff705346800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:39:58.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.262+0000 7ff705346800 20 INFO: main: starting shard=8 2024-09-22T08:39:58.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.262+0000 7ff705346800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.8 2024-09-22T08:39:58.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.262+0000 7ff705346800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.8 2024-09-22T08:39:58.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.262+0000 7ff705346800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:39:58.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.262+0000 7ff705346800 20 INFO: main: starting shard=9 2024-09-22T08:39:58.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.262+0000 7ff705346800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.9 2024-09-22T08:39:58.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.262+0000 7ff705346800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.9 2024-09-22T08:39:58.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.263+0000 7ff705346800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:39:58.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.263+0000 7ff705346800 20 INFO: main: starting shard=10 2024-09-22T08:39:58.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.263+0000 7ff705346800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.10 2024-09-22T08:39:58.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.263+0000 7ff705346800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.10 2024-09-22T08:39:58.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.263+0000 7ff705346800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:39:58.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.263+0000 7ff705346800 20 INFO: main: starting shard=11 2024-09-22T08:39:58.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.263+0000 7ff705346800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.11 2024-09-22T08:39:58.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.263+0000 7ff705346800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.11 2024-09-22T08:39:58.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.264+0000 7ff705346800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:39:58.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.264+0000 7ff705346800 20 INFO: main: starting shard=12 2024-09-22T08:39:58.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.264+0000 7ff705346800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.12 2024-09-22T08:39:58.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.264+0000 7ff705346800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.12 2024-09-22T08:39:58.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.265+0000 7ff705346800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:39:58.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.265+0000 7ff705346800 20 INFO: main: done 2024-09-22T08:39:58.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.266+0000 7ff5b97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:58.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.268+0000 7ff705346800 20 remove_watcher() i=0 2024-09-22T08:39:58.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.268+0000 7ff705346800 2 removed watcher, disabling cache 2024-09-22T08:39:58.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.269+0000 7ff705346800 20 remove_watcher() i=1 2024-09-22T08:39:58.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.270+0000 7ff705346800 20 remove_watcher() i=2 2024-09-22T08:39:58.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.271+0000 7ff705346800 20 remove_watcher() i=3 2024-09-22T08:39:58.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.272+0000 7ff705346800 20 remove_watcher() i=4 2024-09-22T08:39:58.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.273+0000 7ff705346800 20 remove_watcher() i=5 2024-09-22T08:39:58.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.274+0000 7ff705346800 20 remove_watcher() i=6 2024-09-22T08:39:58.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.276+0000 7ff705346800 20 remove_watcher() i=7 2024-09-22T08:39:58.290 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-22T08:39:58.323 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:58.323 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:58.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.362+0000 7f6beae10800 20 rados->read ofs=0 len=0 2024-09-22T08:39:58.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.363+0000 7f6beae10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:58.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.363+0000 7f6beae10800 20 realm 2024-09-22T08:39:58.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.363+0000 7f6beae10800 20 rados->read ofs=0 len=0 2024-09-22T08:39:58.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.363+0000 7f6beae10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:58.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.363+0000 7f6beae10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:58.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.363+0000 7f6beae10800 20 rados->read ofs=0 len=0 2024-09-22T08:39:58.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.364+0000 7f6beae10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:58.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.364+0000 7f6beae10800 20 rados->read ofs=0 len=0 2024-09-22T08:39:58.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.364+0000 7f6beae10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:58.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.364+0000 7f6beae10800 20 rados->read ofs=0 len=0 2024-09-22T08:39:58.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.365+0000 7f6beae10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:58.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.365+0000 7f6beae10800 20 searching for the correct realm 2024-09-22T08:39:58.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.368+0000 7f6be6dbd640 0 -- 172.21.15.38:0/2029948999 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7f6bd8061070 msgr2=0x7f6bd80aa130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:58.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.573+0000 7f6be65bc640 0 -- 172.21.15.38:0/2029948999 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x55eb25faf9d0 msgr2=0x55eb25fb1e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:58.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.578+0000 7f6beae10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:58.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.578+0000 7f6beae10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:58.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.578+0000 7f6beae10800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:39:58.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.578+0000 7f6beae10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:58.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.578+0000 7f6beae10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:58.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.578+0000 7f6beae10800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:39:58.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.578+0000 7f6beae10800 20 rados->read ofs=0 len=0 2024-09-22T08:39:58.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.578+0000 7f6beae10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:58.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.578+0000 7f6beae10800 20 rados->read ofs=0 len=0 2024-09-22T08:39:58.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.579+0000 7f6beae10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:58.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.579+0000 7f6beae10800 20 rados->read ofs=0 len=0 2024-09-22T08:39:58.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.579+0000 7f6beae10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:58.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.579+0000 7f6beae10800 20 zone default found 2024-09-22T08:39:58.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.579+0000 7f6beae10800 4 Realm: () 2024-09-22T08:39:58.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.579+0000 7f6beae10800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:39:58.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.579+0000 7f6beae10800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:39:58.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.579+0000 7f6beae10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:58.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.579+0000 7f6beae10800 20 zonegroup default 2024-09-22T08:39:58.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.579+0000 7f6beae10800 20 rados->read ofs=0 len=0 2024-09-22T08:39:58.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.579+0000 7f6beae10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:58.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.579+0000 7f6beae10800 20 rados->read ofs=0 len=0 2024-09-22T08:39:58.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.580+0000 7f6beae10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:58.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.580+0000 7f6beae10800 20 rados->read ofs=0 len=0 2024-09-22T08:39:58.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.580+0000 7f6beae10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:58.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.580+0000 7f6beae10800 20 started sync module instance, tier type = 2024-09-22T08:39:58.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.580+0000 7f6beae10800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:39:58.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.590+0000 7f6beae10800 20 add_watcher() i=0 2024-09-22T08:39:58.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.590+0000 7f6beae10800 20 add_watcher() i=1 2024-09-22T08:39:58.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.590+0000 7f6beae10800 20 add_watcher() i=2 2024-09-22T08:39:58.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.590+0000 7f6beae10800 20 add_watcher() i=3 2024-09-22T08:39:58.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.590+0000 7f6beae10800 20 add_watcher() i=4 2024-09-22T08:39:58.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.590+0000 7f6beae10800 20 add_watcher() i=5 2024-09-22T08:39:58.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.590+0000 7f6beae10800 20 add_watcher() i=6 2024-09-22T08:39:58.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.592+0000 7f6beae10800 20 add_watcher() i=7 2024-09-22T08:39:58.593 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.592+0000 7f6beae10800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:58.594 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.593+0000 7f6a9cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:58.595 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.594+0000 7f6beae10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:58.595 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.594+0000 7f6beae10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:58.595 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.594+0000 7f6beae10800 5 note: GC not initialized 2024-09-22T08:39:58.595 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.594+0000 7f6a177fe640 20 reqs_thread_entry: start 2024-09-22T08:39:58.595 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.594+0000 7f6beae10800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:58.596 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.594+0000 7f6beae10800 20 Filter name: none 2024-09-22T08:39:58.596 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.594+0000 7f6a157fa640 20 reqs_thread_entry: start 2024-09-22T08:39:58.596 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.594+0000 7f6beae10800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:39:58.596 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.594+0000 7f6beae10800 20 rados->read ofs=0 len=0 2024-09-22T08:39:58.596 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.595+0000 7f6beae10800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:39:58.596 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.595+0000 7f6beae10800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:39:58.596 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.595+0000 7f6beae10800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:39:58.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.595+0000 7f6beae10800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 : miss 2024-09-22T08:39:58.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.595+0000 7f6beae10800 20 rados->read ofs=0 len=0 2024-09-22T08:39:58.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.595+0000 7f6beae10800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T08:39:58.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.595+0000 7f6beae10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:39:58.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.595+0000 7f6beae10800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:39:58.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.595+0000 7f6beae10800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:39:58.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.595+0000 7f6beae10800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:39:58.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.595+0000 7f6beae10800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 2024-09-22T08:39:58.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.600+0000 7f6beae10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:39:58.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.600+0000 7f6beae10800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:39:58.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.600+0000 7f6beae10800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:39:58.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.600+0000 7f6beae10800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17, ofs0, ns] 2024-09-22T08:39:58.602 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.600+0000 7f6ac97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497040 cookie 94468442948832 notifier 7949 bl.length()=827 2024-09-22T08:39:58.602 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.600+0000 7f6ac97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:39:58.602 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.600+0000 7f6ac97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:39:58.602 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.600+0000 7f6ac97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:39:58.602 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.600+0000 7f6beae10800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_sources= new_sources= 2024-09-22T08:39:58.602 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.600+0000 7f6beae10800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential sources added=[] removed=[] 2024-09-22T08:39:58.602 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.600+0000 7f6beae10800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_dests= new_dests= 2024-09-22T08:39:58.602 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.600+0000 7f6beae10800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential dests added=[] removed=[] 2024-09-22T08:39:58.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.606+0000 7f6beae10800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.0 2024-09-22T08:39:58.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.606+0000 7f6beae10800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.0 2024-09-22T08:39:58.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.606+0000 7f6beae10800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.0 2024-09-22T08:39:58.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.606+0000 7f6beae10800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.0 2024-09-22T08:39:58.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.607+0000 7f6beae10800 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-22T08:39:58.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.607+0000 7f6beae10800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.1 2024-09-22T08:39:58.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.607+0000 7f6beae10800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.1 2024-09-22T08:39:58.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.607+0000 7f6beae10800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.2 2024-09-22T08:39:58.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.607+0000 7f6beae10800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.2 2024-09-22T08:39:58.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.608+0000 7f6beae10800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.3 2024-09-22T08:39:58.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.608+0000 7f6beae10800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.3 2024-09-22T08:39:58.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.608+0000 7f6beae10800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.4 2024-09-22T08:39:58.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.608+0000 7f6beae10800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.4 2024-09-22T08:39:58.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.608+0000 7f6beae10800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.5 2024-09-22T08:39:58.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.608+0000 7f6beae10800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.5 2024-09-22T08:39:58.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.609+0000 7f6beae10800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.6 2024-09-22T08:39:58.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.609+0000 7f6beae10800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.6 2024-09-22T08:39:58.611 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.610+0000 7f6beae10800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.7 2024-09-22T08:39:58.611 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.610+0000 7f6beae10800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.7 2024-09-22T08:39:58.611 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.611+0000 7f6beae10800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.8 2024-09-22T08:39:58.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.611+0000 7f6beae10800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.8 2024-09-22T08:39:58.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.611+0000 7f6beae10800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.9 2024-09-22T08:39:58.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.611+0000 7f6beae10800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.9 2024-09-22T08:39:58.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.611+0000 7f6beae10800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.10 2024-09-22T08:39:58.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.611+0000 7f6beae10800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.10 2024-09-22T08:39:58.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.613+0000 7f6beae10800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.11 2024-09-22T08:39:58.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.613+0000 7f6beae10800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.11 2024-09-22T08:39:58.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.613+0000 7f6beae10800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.12 2024-09-22T08:39:58.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.613+0000 7f6beae10800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.12 2024-09-22T08:39:58.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.614+0000 7f6beae10800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 : hit (requested=0x17, cached=0x17) 2024-09-22T08:39:58.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.614+0000 7f6beae10800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 2024-09-22T08:39:58.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.616+0000 7f6beae10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:39:58.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.616+0000 7f6beae10800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:39:58.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.616+0000 7f6beae10800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:39:58.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.616+0000 7f6beae10800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17, ofs0, ns] 2024-09-22T08:39:58.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.616+0000 7f6ac97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497041 cookie 94468442948832 notifier 7949 bl.length()=827 2024-09-22T08:39:58.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.616+0000 7f6ac97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:39:58.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.616+0000 7f6ac97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:39:58.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.616+0000 7f6ac97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:39:58.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.616+0000 7f6beae10800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_sources= new_sources= 2024-09-22T08:39:58.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.616+0000 7f6beae10800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential sources added=[] removed=[] 2024-09-22T08:39:58.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.616+0000 7f6beae10800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_dests= new_dests= 2024-09-22T08:39:58.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.616+0000 7f6beae10800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential dests added=[] removed=[] 2024-09-22T08:39:58.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.619+0000 7f6beae10800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.0 2024-09-22T08:39:58.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.619+0000 7f6beae10800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.0 2024-09-22T08:39:58.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.620+0000 7f6beae10800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.1 2024-09-22T08:39:58.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.620+0000 7f6beae10800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.1 2024-09-22T08:39:58.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.620+0000 7f6beae10800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.2 2024-09-22T08:39:58.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.620+0000 7f6beae10800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.2 2024-09-22T08:39:58.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.621+0000 7f6beae10800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.3 2024-09-22T08:39:58.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.621+0000 7f6beae10800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.3 2024-09-22T08:39:58.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.621+0000 7f6beae10800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.4 2024-09-22T08:39:58.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.621+0000 7f6beae10800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.4 2024-09-22T08:39:58.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.621+0000 7f6beae10800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.5 2024-09-22T08:39:58.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.621+0000 7f6beae10800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.5 2024-09-22T08:39:58.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.621+0000 7f6beae10800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.6 2024-09-22T08:39:58.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.621+0000 7f6beae10800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.6 2024-09-22T08:39:58.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.622+0000 7f6beae10800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.7 2024-09-22T08:39:58.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.622+0000 7f6beae10800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.7 2024-09-22T08:39:58.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.622+0000 7f6beae10800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.8 2024-09-22T08:39:58.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.622+0000 7f6beae10800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.8 2024-09-22T08:39:58.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.622+0000 7f6beae10800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.9 2024-09-22T08:39:58.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.622+0000 7f6beae10800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.9 2024-09-22T08:39:58.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.623+0000 7f6beae10800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.10 2024-09-22T08:39:58.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.623+0000 7f6beae10800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.10 2024-09-22T08:39:58.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.623+0000 7f6beae10800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.11 2024-09-22T08:39:58.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.623+0000 7f6beae10800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.11 2024-09-22T08:39:58.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.623+0000 7f6beae10800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.12 2024-09-22T08:39:58.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.623+0000 7f6beae10800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.2.12 2024-09-22T08:39:58.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.624+0000 7f6beae10800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 : hit (requested=0x17, cached=0x17) 2024-09-22T08:39:58.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.624+0000 7f6beae10800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 2024-09-22T08:39:58.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.625+0000 7f6beae10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:39:58.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.625+0000 7f6beae10800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:39:58.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.625+0000 7f6beae10800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:39:58.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.625+0000 7f6beae10800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17, ofs0, ns] 2024-09-22T08:39:58.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.626+0000 7f6ac97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497042 cookie 94468442948832 notifier 7949 bl.length()=795 2024-09-22T08:39:58.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.626+0000 7f6ac97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 info.flags=0x17 2024-09-22T08:39:58.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.626+0000 7f6ac97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.17 to cache LRU end 2024-09-22T08:39:58.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.626+0000 7f6ac97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:39:58.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.626+0000 7f6beae10800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_sources= new_sources= 2024-09-22T08:39:58.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.626+0000 7f6beae10800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential sources added=[] removed=[] 2024-09-22T08:39:58.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.626+0000 7f6beae10800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): orig_dests= new_dests= 2024-09-22T08:39:58.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.626+0000 7f6beae10800 20 handle_bi_update(): bucket=:a-bucket[c62f9d7b-f6b6-404a-90de-de5607499115.4584.17]): potential dests added=[] removed=[] 2024-09-22T08:39:58.630 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.629+0000 7f6beae10800 1 execute INFO: reshard of bucket "a-bucket" from 13 shards to 1 shards completed successfully 2024-09-22T08:39:58.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.631+0000 7f6a9cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:58.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.633+0000 7f6beae10800 20 remove_watcher() i=0 2024-09-22T08:39:58.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.633+0000 7f6beae10800 2 removed watcher, disabling cache 2024-09-22T08:39:58.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.635+0000 7f6beae10800 20 remove_watcher() i=1 2024-09-22T08:39:58.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.636+0000 7f6beae10800 20 remove_watcher() i=2 2024-09-22T08:39:58.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.637+0000 7f6beae10800 20 remove_watcher() i=3 2024-09-22T08:39:58.639 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.638+0000 7f6beae10800 20 remove_watcher() i=4 2024-09-22T08:39:58.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.639+0000 7f6beae10800 20 remove_watcher() i=5 2024-09-22T08:39:58.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.640+0000 7f6beae10800 20 remove_watcher() i=6 2024-09-22T08:39:58.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.641+0000 7f6beae10800 20 remove_watcher() i=7 2024-09-22T08:39:58.654 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-22T08:39:58.683 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:58.683 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:58.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.722+0000 7fda10c13800 20 rados->read ofs=0 len=0 2024-09-22T08:39:58.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.724+0000 7fda10c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:58.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.724+0000 7fda10c13800 20 realm 2024-09-22T08:39:58.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.724+0000 7fda10c13800 20 rados->read ofs=0 len=0 2024-09-22T08:39:58.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.724+0000 7fda10c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:58.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.724+0000 7fda10c13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:58.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.724+0000 7fda10c13800 20 rados->read ofs=0 len=0 2024-09-22T08:39:58.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.724+0000 7fda10c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:58.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.724+0000 7fda10c13800 20 rados->read ofs=0 len=0 2024-09-22T08:39:58.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.725+0000 7fda10c13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:58.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.725+0000 7fda10c13800 20 rados->read ofs=0 len=0 2024-09-22T08:39:58.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.726+0000 7fda10c13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:58.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.726+0000 7fda10c13800 20 searching for the correct realm 2024-09-22T08:39:58.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.729+0000 7fda0cb49640 0 -- 172.21.15.38:0/769358535 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7fd9fc022070 msgr2=0x7fd9fc068c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:58.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.935+0000 7fda0c348640 0 -- 172.21.15.38:0/769358535 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x55ca2bc1d5e0 msgr2=0x55ca2bc1fa10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:58.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.940+0000 7fda10c13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:58.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.940+0000 7fda10c13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:58.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.940+0000 7fda10c13800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:39:58.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.940+0000 7fda10c13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:58.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.940+0000 7fda10c13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:58.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.940+0000 7fda10c13800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:39:58.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.940+0000 7fda10c13800 20 rados->read ofs=0 len=0 2024-09-22T08:39:58.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.940+0000 7fda10c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:58.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.940+0000 7fda10c13800 20 rados->read ofs=0 len=0 2024-09-22T08:39:58.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.941+0000 7fda10c13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:58.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.941+0000 7fda10c13800 20 rados->read ofs=0 len=0 2024-09-22T08:39:58.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.941+0000 7fda10c13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:58.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.941+0000 7fda10c13800 20 zone default found 2024-09-22T08:39:58.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.941+0000 7fda10c13800 4 Realm: () 2024-09-22T08:39:58.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.941+0000 7fda10c13800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:39:58.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.941+0000 7fda10c13800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:39:58.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.941+0000 7fda10c13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:58.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.941+0000 7fda10c13800 20 zonegroup default 2024-09-22T08:39:58.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.941+0000 7fda10c13800 20 rados->read ofs=0 len=0 2024-09-22T08:39:58.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.942+0000 7fda10c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:58.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.942+0000 7fda10c13800 20 rados->read ofs=0 len=0 2024-09-22T08:39:58.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.942+0000 7fda10c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:58.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.942+0000 7fda10c13800 20 rados->read ofs=0 len=0 2024-09-22T08:39:58.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.942+0000 7fda10c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:58.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.942+0000 7fda10c13800 20 started sync module instance, tier type = 2024-09-22T08:39:58.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.942+0000 7fda10c13800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:39:58.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.952+0000 7fda10c13800 20 add_watcher() i=0 2024-09-22T08:39:58.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.952+0000 7fda10c13800 20 add_watcher() i=1 2024-09-22T08:39:58.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.953+0000 7fda10c13800 20 add_watcher() i=2 2024-09-22T08:39:58.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.953+0000 7fda10c13800 20 add_watcher() i=3 2024-09-22T08:39:58.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.953+0000 7fda10c13800 20 add_watcher() i=4 2024-09-22T08:39:58.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.953+0000 7fda10c13800 20 add_watcher() i=5 2024-09-22T08:39:58.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.953+0000 7fda10c13800 20 add_watcher() i=6 2024-09-22T08:39:58.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.954+0000 7fda10c13800 20 add_watcher() i=7 2024-09-22T08:39:58.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.954+0000 7fda10c13800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:58.957 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.956+0000 7fd8c2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:58.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.957+0000 7fda10c13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:58.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.957+0000 7fda10c13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:58.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.957+0000 7fda10c13800 5 note: GC not initialized 2024-09-22T08:39:58.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.957+0000 7fd8c1fdb640 20 reqs_thread_entry: start 2024-09-22T08:39:58.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.957+0000 7fda10c13800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:58.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.957+0000 7fda10c13800 20 Filter name: none 2024-09-22T08:39:58.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.957+0000 7fd8337fe640 20 reqs_thread_entry: start 2024-09-22T08:39:58.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.957+0000 7fda10c13800 20 rados->read ofs=0 len=0 2024-09-22T08:39:58.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.958+0000 7fda10c13800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T08:39:58.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.958+0000 7fda10c13800 20 rados->read ofs=0 len=0 2024-09-22T08:39:58.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.958+0000 7fda10c13800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T08:39:58.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.958+0000 7fda10c13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:58.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.958+0000 7fda10c13800 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-22T08:39:58.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.958+0000 7fda10c13800 20 INFO: main: starting shard=0 2024-09-22T08:39:58.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.958+0000 7fda10c13800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.0 2024-09-22T08:39:58.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.958+0000 7fda10c13800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.17.3.0 2024-09-22T08:39:58.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.959+0000 7fda10c13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:39:58.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.959+0000 7fda10c13800 20 INFO: main: done 2024-09-22T08:39:58.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.960+0000 7fd8c2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:58.963 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.962+0000 7fda10c13800 20 remove_watcher() i=0 2024-09-22T08:39:58.963 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.962+0000 7fda10c13800 2 removed watcher, disabling cache 2024-09-22T08:39:58.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.963+0000 7fda10c13800 20 remove_watcher() i=1 2024-09-22T08:39:58.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.965+0000 7fda10c13800 20 remove_watcher() i=2 2024-09-22T08:39:58.967 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.966+0000 7fda10c13800 20 remove_watcher() i=3 2024-09-22T08:39:58.968 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.967+0000 7fda10c13800 20 remove_watcher() i=4 2024-09-22T08:39:58.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.968+0000 7fda10c13800 20 remove_watcher() i=5 2024-09-22T08:39:58.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.969+0000 7fda10c13800 20 remove_watcher() i=6 2024-09-22T08:39:58.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:58.971+0000 7fda10c13800 20 remove_watcher() i=7 2024-09-22T08:39:58.983 INFO:tasks.workunit.client.0.smithi038.stderr: test: PUT succeeds during reshard 2024-09-22T08:39:58.984 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket myver 2024-09-22T08:39:59.013 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:59.013 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:59.053 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.052+0000 7f7480e94800 20 rados->read ofs=0 len=0 2024-09-22T08:39:59.055 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.054+0000 7f7480e94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:59.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.054+0000 7f7480e94800 20 realm 2024-09-22T08:39:59.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.054+0000 7f7480e94800 20 rados->read ofs=0 len=0 2024-09-22T08:39:59.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.055+0000 7f7480e94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:59.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.055+0000 7f7480e94800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:59.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.055+0000 7f7480e94800 20 rados->read ofs=0 len=0 2024-09-22T08:39:59.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.055+0000 7f7480e94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:59.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.055+0000 7f7480e94800 20 rados->read ofs=0 len=0 2024-09-22T08:39:59.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.055+0000 7f7480e94800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:59.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.055+0000 7f7480e94800 20 rados->read ofs=0 len=0 2024-09-22T08:39:59.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.056+0000 7f7480e94800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:59.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.056+0000 7f7480e94800 20 searching for the correct realm 2024-09-22T08:39:59.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.059+0000 7f747e17d640 0 -- 172.21.15.38:0/3952666275 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f7474075790 msgr2=0x7f7474060b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:59.065 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.062+0000 7f747e17d640 0 -- 172.21.15.38:0/3952666275 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f7470054910 msgr2=0x7f747002e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:59.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.269+0000 7f7480e94800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:59.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.269+0000 7f7480e94800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:59.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.269+0000 7f7480e94800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:39:59.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.269+0000 7f7480e94800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:59.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.269+0000 7f7480e94800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:59.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.269+0000 7f7480e94800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:39:59.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.269+0000 7f7480e94800 20 rados->read ofs=0 len=0 2024-09-22T08:39:59.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.270+0000 7f7480e94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:59.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.270+0000 7f7480e94800 20 rados->read ofs=0 len=0 2024-09-22T08:39:59.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.270+0000 7f7480e94800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:59.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.270+0000 7f7480e94800 20 rados->read ofs=0 len=0 2024-09-22T08:39:59.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.270+0000 7f7480e94800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:59.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.270+0000 7f7480e94800 20 zone default found 2024-09-22T08:39:59.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.270+0000 7f7480e94800 4 Realm: () 2024-09-22T08:39:59.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.270+0000 7f7480e94800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:39:59.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.270+0000 7f7480e94800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:39:59.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.270+0000 7f7480e94800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:59.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.270+0000 7f7480e94800 20 zonegroup default 2024-09-22T08:39:59.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.270+0000 7f7480e94800 20 rados->read ofs=0 len=0 2024-09-22T08:39:59.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.271+0000 7f7480e94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:59.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.271+0000 7f7480e94800 20 rados->read ofs=0 len=0 2024-09-22T08:39:59.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.271+0000 7f7480e94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:59.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.271+0000 7f7480e94800 20 rados->read ofs=0 len=0 2024-09-22T08:39:59.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.272+0000 7f7480e94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:59.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.272+0000 7f7480e94800 20 started sync module instance, tier type = 2024-09-22T08:39:59.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.272+0000 7f7480e94800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:39:59.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.282+0000 7f7480e94800 20 add_watcher() i=0 2024-09-22T08:39:59.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.282+0000 7f7480e94800 20 add_watcher() i=1 2024-09-22T08:39:59.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.282+0000 7f7480e94800 20 add_watcher() i=2 2024-09-22T08:39:59.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.282+0000 7f7480e94800 20 add_watcher() i=3 2024-09-22T08:39:59.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.282+0000 7f7480e94800 20 add_watcher() i=4 2024-09-22T08:39:59.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.282+0000 7f7480e94800 20 add_watcher() i=5 2024-09-22T08:39:59.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.282+0000 7f7480e94800 20 add_watcher() i=6 2024-09-22T08:39:59.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.283+0000 7f7480e94800 20 add_watcher() i=7 2024-09-22T08:39:59.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.283+0000 7f7480e94800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:59.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.286+0000 7f73357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:59.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.286+0000 7f7480e94800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:59.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.286+0000 7f7480e94800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:59.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.286+0000 7f7480e94800 5 note: GC not initialized 2024-09-22T08:39:59.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.286+0000 7f72affff640 20 reqs_thread_entry: start 2024-09-22T08:39:59.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.287+0000 7f7480e94800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:59.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.287+0000 7f7480e94800 20 Filter name: none 2024-09-22T08:39:59.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.287+0000 7f72adffb640 20 reqs_thread_entry: start 2024-09-22T08:39:59.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.287+0000 7f7480e94800 20 rados->read ofs=0 len=0 2024-09-22T08:39:59.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.287+0000 7f7480e94800 20 rados_obj.operate() r=0 bl.length=173 2024-09-22T08:39:59.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.287+0000 7f7480e94800 20 rados->read ofs=0 len=0 2024-09-22T08:39:59.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.288+0000 7f7480e94800 20 rados_obj.operate() r=0 bl.length=395 2024-09-22T08:39:59.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.288+0000 7f7480e94800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:59.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.288+0000 7f7480e94800 20 rados->read ofs=0 len=0 2024-09-22T08:39:59.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.288+0000 7f7480e94800 20 rados_obj.operate() r=0 bl.length=173 2024-09-22T08:39:59.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.288+0000 7f7480e94800 20 rados->read ofs=0 len=0 2024-09-22T08:39:59.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.289+0000 7f7480e94800 20 rados_obj.operate() r=0 bl.length=395 2024-09-22T08:39:59.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.289+0000 7f7480e94800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:59.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.291+0000 7f73357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:59.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.293+0000 7f7480e94800 20 remove_watcher() i=0 2024-09-22T08:39:59.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.293+0000 7f7480e94800 2 removed watcher, disabling cache 2024-09-22T08:39:59.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.294+0000 7f7480e94800 20 remove_watcher() i=1 2024-09-22T08:39:59.296 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.295+0000 7f7480e94800 20 remove_watcher() i=2 2024-09-22T08:39:59.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.297+0000 7f7480e94800 20 remove_watcher() i=3 2024-09-22T08:39:59.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.298+0000 7f7480e94800 20 remove_watcher() i=4 2024-09-22T08:39:59.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.299+0000 7f7480e94800 20 remove_watcher() i=5 2024-09-22T08:39:59.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.300+0000 7f7480e94800 20 remove_watcher() i=6 2024-09-22T08:39:59.302 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.302+0000 7f7480e94800 20 remove_watcher() i=7 2024-09-22T08:39:59.314 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:59.314 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-22T08:39:59.314 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: myver id: c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-22T08:39:59.314 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:39:59.315 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 13 2024-09-22T08:39:59.350 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:59.350 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:59.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.389+0000 7f00fdd46800 20 rados->read ofs=0 len=0 2024-09-22T08:39:59.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.391+0000 7f00fdd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:59.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.391+0000 7f00fdd46800 20 realm 2024-09-22T08:39:59.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.391+0000 7f00fdd46800 20 rados->read ofs=0 len=0 2024-09-22T08:39:59.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.391+0000 7f00fdd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:59.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.391+0000 7f00fdd46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:59.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.391+0000 7f00fdd46800 20 rados->read ofs=0 len=0 2024-09-22T08:39:59.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.391+0000 7f00fdd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:59.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.391+0000 7f00fdd46800 20 rados->read ofs=0 len=0 2024-09-22T08:39:59.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.392+0000 7f00fdd46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:59.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.392+0000 7f00fdd46800 20 rados->read ofs=0 len=0 2024-09-22T08:39:59.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.393+0000 7f00fdd46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:59.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.393+0000 7f00fdd46800 20 searching for the correct realm 2024-09-22T08:39:59.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.396+0000 7f00fb837640 0 -- 172.21.15.38:0/1249331296 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x55b2a57e1410 msgr2=0x55b2a57e38d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:59.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.399+0000 7f00fb036640 0 -- 172.21.15.38:0/1249331296 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f00ec072fd0 msgr2=0x7f00ec0288c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:59.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.606+0000 7f00fdd46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:59.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.606+0000 7f00fdd46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:59.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.606+0000 7f00fdd46800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:39:59.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.606+0000 7f00fdd46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:59.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.606+0000 7f00fdd46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:59.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.606+0000 7f00fdd46800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:39:59.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.606+0000 7f00fdd46800 20 rados->read ofs=0 len=0 2024-09-22T08:39:59.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.607+0000 7f00fdd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:59.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.607+0000 7f00fdd46800 20 rados->read ofs=0 len=0 2024-09-22T08:39:59.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.607+0000 7f00fdd46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:59.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.607+0000 7f00fdd46800 20 rados->read ofs=0 len=0 2024-09-22T08:39:59.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.608+0000 7f00fdd46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:59.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.608+0000 7f00fdd46800 20 zone default found 2024-09-22T08:39:59.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.608+0000 7f00fdd46800 4 Realm: () 2024-09-22T08:39:59.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.608+0000 7f00fdd46800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:39:59.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.608+0000 7f00fdd46800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:39:59.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.608+0000 7f00fdd46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:59.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.608+0000 7f00fdd46800 20 zonegroup default 2024-09-22T08:39:59.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.608+0000 7f00fdd46800 20 rados->read ofs=0 len=0 2024-09-22T08:39:59.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.608+0000 7f00fdd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:59.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.608+0000 7f00fdd46800 20 rados->read ofs=0 len=0 2024-09-22T08:39:59.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.608+0000 7f00fdd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:59.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.608+0000 7f00fdd46800 20 rados->read ofs=0 len=0 2024-09-22T08:39:59.611 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.609+0000 7f00fdd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:59.611 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.609+0000 7f00fdd46800 20 started sync module instance, tier type = 2024-09-22T08:39:59.611 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.609+0000 7f00fdd46800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:39:59.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.619+0000 7f00fdd46800 20 add_watcher() i=0 2024-09-22T08:39:59.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.619+0000 7f00fdd46800 20 add_watcher() i=1 2024-09-22T08:39:59.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.619+0000 7f00fdd46800 20 add_watcher() i=2 2024-09-22T08:39:59.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.619+0000 7f00fdd46800 20 add_watcher() i=3 2024-09-22T08:39:59.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.619+0000 7f00fdd46800 20 add_watcher() i=4 2024-09-22T08:39:59.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.619+0000 7f00fdd46800 20 add_watcher() i=5 2024-09-22T08:39:59.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.619+0000 7f00fdd46800 20 add_watcher() i=6 2024-09-22T08:39:59.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.620+0000 7f00fdd46800 20 add_watcher() i=7 2024-09-22T08:39:59.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.620+0000 7f00fdd46800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:59.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.622+0000 7effb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:59.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.622+0000 7f00fdd46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:59.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.622+0000 7f00fdd46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:59.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.622+0000 7f00fdd46800 5 note: GC not initialized 2024-09-22T08:39:59.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.623+0000 7effb0fe1640 20 reqs_thread_entry: start 2024-09-22T08:39:59.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.623+0000 7f00fdd46800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:59.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.623+0000 7f00fdd46800 20 Filter name: none 2024-09-22T08:39:59.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.623+0000 7eff2a7fc640 20 reqs_thread_entry: start 2024-09-22T08:39:59.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.623+0000 7f00fdd46800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-22T08:39:59.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.623+0000 7f00fdd46800 20 rados->read ofs=0 len=0 2024-09-22T08:39:59.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.624+0000 7f00fdd46800 20 rados_obj.operate() r=0 bl.length=173 2024-09-22T08:39:59.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.624+0000 7f00fdd46800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-22T08:39:59.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.624+0000 7f00fdd46800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-22T08:39:59.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.624+0000 7f00fdd46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 : miss 2024-09-22T08:39:59.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.624+0000 7f00fdd46800 20 rados->read ofs=0 len=0 2024-09-22T08:39:59.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.624+0000 7f00fdd46800 20 rados_obj.operate() r=0 bl.length=395 2024-09-22T08:39:59.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.624+0000 7f00fdd46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 info.flags=0x17 2024-09-22T08:39:59.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.624+0000 7f00fdd46800 10 adding default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 to cache LRU end 2024-09-22T08:39:59.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.624+0000 7f00fdd46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:39:59.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.624+0000 7f00fdd46800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:39:59.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.624+0000 7f00fdd46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 2024-09-22T08:39:59.631 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.630+0000 7f00fdd46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 info.flags=0x17 2024-09-22T08:39:59.631 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.630+0000 7f00fdd46800 10 moving default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 to cache LRU end 2024-09-22T08:39:59.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.630+0000 7f00fdd46800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:39:59.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.630+0000 7f00fdd46800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18, ofs0, ns] 2024-09-22T08:39:59.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.631+0000 7effda7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497009 cookie 94225769055120 notifier 8541 bl.length()=821 2024-09-22T08:39:59.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.631+0000 7effda7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 info.flags=0x17 2024-09-22T08:39:59.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.631+0000 7effda7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 to cache LRU end 2024-09-22T08:39:59.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.631+0000 7effda7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:39:59.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.631+0000 7f00fdd46800 20 handle_bi_update(): bucket=:myver[c62f9d7b-f6b6-404a-90de-de5607499115.4584.18]): orig_sources= new_sources= 2024-09-22T08:39:59.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.631+0000 7f00fdd46800 20 handle_bi_update(): bucket=:myver[c62f9d7b-f6b6-404a-90de-de5607499115.4584.18]): potential sources added=[] removed=[] 2024-09-22T08:39:59.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.631+0000 7f00fdd46800 20 handle_bi_update(): bucket=:myver[c62f9d7b-f6b6-404a-90de-de5607499115.4584.18]): orig_dests= new_dests= 2024-09-22T08:39:59.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.631+0000 7f00fdd46800 20 handle_bi_update(): bucket=:myver[c62f9d7b-f6b6-404a-90de-de5607499115.4584.18]): potential dests added=[] removed=[] 2024-09-22T08:39:59.639 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:39:59.638+0000 7f00fdd46800 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-22T08:40:00.320 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:40:00.320 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:40:00.339 INFO:tasks.workunit.client.0.smithi038.stderr:put object successful 2024-09-22T08:40:04.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.638+0000 7f00fdd46800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.0 2024-09-22T08:40:04.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.638+0000 7f00fdd46800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.0 2024-09-22T08:40:04.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.638+0000 7f00fdd46800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.1 2024-09-22T08:40:04.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.638+0000 7f00fdd46800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.1 2024-09-22T08:40:04.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.638+0000 7f00fdd46800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.2 2024-09-22T08:40:04.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.638+0000 7f00fdd46800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.2 2024-09-22T08:40:04.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.638+0000 7f00fdd46800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.3 2024-09-22T08:40:04.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.638+0000 7f00fdd46800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.3 2024-09-22T08:40:04.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.638+0000 7f00fdd46800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.4 2024-09-22T08:40:04.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.638+0000 7f00fdd46800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.4 2024-09-22T08:40:04.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.638+0000 7f00fdd46800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.5 2024-09-22T08:40:04.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.638+0000 7f00fdd46800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.5 2024-09-22T08:40:04.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.638+0000 7f00fdd46800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.6 2024-09-22T08:40:04.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.638+0000 7f00fdd46800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.6 2024-09-22T08:40:04.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.638+0000 7f00fdd46800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.7 2024-09-22T08:40:04.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.638+0000 7f00fdd46800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.7 2024-09-22T08:40:04.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.638+0000 7f00fdd46800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.8 2024-09-22T08:40:04.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.638+0000 7f00fdd46800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.8 2024-09-22T08:40:04.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.638+0000 7f00fdd46800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.9 2024-09-22T08:40:04.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.638+0000 7f00fdd46800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.9 2024-09-22T08:40:04.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.638+0000 7f00fdd46800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.10 2024-09-22T08:40:04.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.638+0000 7f00fdd46800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.10 2024-09-22T08:40:04.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.638+0000 7f00fdd46800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.11 2024-09-22T08:40:04.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.638+0000 7f00fdd46800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.11 2024-09-22T08:40:04.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.638+0000 7f00fdd46800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.12 2024-09-22T08:40:04.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.638+0000 7f00fdd46800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.12 2024-09-22T08:40:04.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.638+0000 7f00fdd46800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.0 2024-09-22T08:40:04.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.638+0000 7f00fdd46800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.0 2024-09-22T08:40:04.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.639+0000 7f00fdd46800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.1 2024-09-22T08:40:04.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.639+0000 7f00fdd46800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.1 2024-09-22T08:40:04.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.640+0000 7f00fdd46800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.2 2024-09-22T08:40:04.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.640+0000 7f00fdd46800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.2 2024-09-22T08:40:04.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.640+0000 7f00fdd46800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.3 2024-09-22T08:40:04.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.640+0000 7f00fdd46800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.3 2024-09-22T08:40:04.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.641+0000 7f00fdd46800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.4 2024-09-22T08:40:04.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.641+0000 7f00fdd46800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.4 2024-09-22T08:40:04.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.642+0000 7f00fdd46800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.5 2024-09-22T08:40:04.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.642+0000 7f00fdd46800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.5 2024-09-22T08:40:04.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.642+0000 7f00fdd46800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.6 2024-09-22T08:40:04.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.642+0000 7f00fdd46800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.6 2024-09-22T08:40:04.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.643+0000 7f00fdd46800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.7 2024-09-22T08:40:04.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.643+0000 7f00fdd46800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.7 2024-09-22T08:40:04.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.644+0000 7f00fdd46800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.8 2024-09-22T08:40:04.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.644+0000 7f00fdd46800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.8 2024-09-22T08:40:04.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.644+0000 7f00fdd46800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.9 2024-09-22T08:40:04.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.644+0000 7f00fdd46800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.9 2024-09-22T08:40:04.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.645+0000 7f00fdd46800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.10 2024-09-22T08:40:04.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.645+0000 7f00fdd46800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.10 2024-09-22T08:40:04.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.646+0000 7f00fdd46800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.11 2024-09-22T08:40:04.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.646+0000 7f00fdd46800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.11 2024-09-22T08:40:04.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.648+0000 7f00fdd46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 : hit (requested=0x17, cached=0x17) 2024-09-22T08:40:04.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.648+0000 7f00fdd46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 2024-09-22T08:40:04.651 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.650+0000 7f00fdd46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 info.flags=0x17 2024-09-22T08:40:04.651 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.650+0000 7f00fdd46800 10 moving default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 to cache LRU end 2024-09-22T08:40:04.651 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.650+0000 7f00fdd46800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:40:04.651 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.650+0000 7f00fdd46800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18, ofs0, ns] 2024-09-22T08:40:04.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.651+0000 7effda7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497010 cookie 94225769055120 notifier 8541 bl.length()=821 2024-09-22T08:40:04.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.651+0000 7effda7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 info.flags=0x17 2024-09-22T08:40:04.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.651+0000 7effda7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 to cache LRU end 2024-09-22T08:40:04.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.651+0000 7effda7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:40:04.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.651+0000 7f00fdd46800 20 handle_bi_update(): bucket=:myver[c62f9d7b-f6b6-404a-90de-de5607499115.4584.18]): orig_sources= new_sources= 2024-09-22T08:40:04.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.651+0000 7f00fdd46800 20 handle_bi_update(): bucket=:myver[c62f9d7b-f6b6-404a-90de-de5607499115.4584.18]): potential sources added=[] removed=[] 2024-09-22T08:40:04.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.651+0000 7f00fdd46800 20 handle_bi_update(): bucket=:myver[c62f9d7b-f6b6-404a-90de-de5607499115.4584.18]): orig_dests= new_dests= 2024-09-22T08:40:04.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.651+0000 7f00fdd46800 20 handle_bi_update(): bucket=:myver[c62f9d7b-f6b6-404a-90de-de5607499115.4584.18]): potential dests added=[] removed=[] 2024-09-22T08:40:04.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.655+0000 7f00fdd46800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.0 2024-09-22T08:40:04.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.655+0000 7f00fdd46800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.0 2024-09-22T08:40:04.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.655+0000 7f00fdd46800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.1 2024-09-22T08:40:04.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.655+0000 7f00fdd46800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.1 2024-09-22T08:40:04.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.655+0000 7f00fdd46800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.2 2024-09-22T08:40:04.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.655+0000 7f00fdd46800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.2 2024-09-22T08:40:04.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.656+0000 7f00fdd46800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.3 2024-09-22T08:40:04.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.656+0000 7f00fdd46800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.3 2024-09-22T08:40:04.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.656+0000 7f00fdd46800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.4 2024-09-22T08:40:04.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.656+0000 7f00fdd46800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.4 2024-09-22T08:40:04.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.657+0000 7f00fdd46800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.5 2024-09-22T08:40:04.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.657+0000 7f00fdd46800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.5 2024-09-22T08:40:04.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.657+0000 7f00fdd46800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.6 2024-09-22T08:40:04.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.657+0000 7f00fdd46800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.6 2024-09-22T08:40:04.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.658+0000 7f00fdd46800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.7 2024-09-22T08:40:04.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.658+0000 7f00fdd46800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.7 2024-09-22T08:40:04.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.658+0000 7f00fdd46800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.8 2024-09-22T08:40:04.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.658+0000 7f00fdd46800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.8 2024-09-22T08:40:04.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.658+0000 7f00fdd46800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.9 2024-09-22T08:40:04.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.658+0000 7f00fdd46800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.9 2024-09-22T08:40:04.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.659+0000 7f00fdd46800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.10 2024-09-22T08:40:04.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.659+0000 7f00fdd46800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.10 2024-09-22T08:40:04.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.659+0000 7f00fdd46800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.11 2024-09-22T08:40:04.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.659+0000 7f00fdd46800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.1.11 2024-09-22T08:40:04.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.661+0000 7f00fdd46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 : hit (requested=0x17, cached=0x17) 2024-09-22T08:40:04.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.661+0000 7f00fdd46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 2024-09-22T08:40:04.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.663+0000 7f00fdd46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 info.flags=0x17 2024-09-22T08:40:04.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.663+0000 7f00fdd46800 10 moving default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 to cache LRU end 2024-09-22T08:40:04.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.663+0000 7f00fdd46800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:40:04.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.663+0000 7f00fdd46800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18, ofs0, ns] 2024-09-22T08:40:04.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.663+0000 7effda7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497011 cookie 94225769055120 notifier 8541 bl.length()=789 2024-09-22T08:40:04.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.663+0000 7effda7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 info.flags=0x17 2024-09-22T08:40:04.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.663+0000 7effda7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 to cache LRU end 2024-09-22T08:40:04.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.663+0000 7effda7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:40:04.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.664+0000 7f00fdd46800 20 handle_bi_update(): bucket=:myver[c62f9d7b-f6b6-404a-90de-de5607499115.4584.18]): orig_sources= new_sources= 2024-09-22T08:40:04.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.664+0000 7f00fdd46800 20 handle_bi_update(): bucket=:myver[c62f9d7b-f6b6-404a-90de-de5607499115.4584.18]): potential sources added=[] removed=[] 2024-09-22T08:40:04.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.664+0000 7f00fdd46800 20 handle_bi_update(): bucket=:myver[c62f9d7b-f6b6-404a-90de-de5607499115.4584.18]): orig_dests= new_dests= 2024-09-22T08:40:04.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.664+0000 7f00fdd46800 20 handle_bi_update(): bucket=:myver[c62f9d7b-f6b6-404a-90de-de5607499115.4584.18]): potential dests added=[] removed=[] 2024-09-22T08:40:04.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.667+0000 7f00fdd46800 1 execute INFO: reshard of bucket "myver" from 12 shards to 13 shards completed successfully 2024-09-22T08:40:04.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.669+0000 7effb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:04.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.672+0000 7f00fdd46800 20 remove_watcher() i=0 2024-09-22T08:40:04.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.672+0000 7f00fdd46800 2 removed watcher, disabling cache 2024-09-22T08:40:04.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.673+0000 7f00fdd46800 20 remove_watcher() i=1 2024-09-22T08:40:04.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.674+0000 7f00fdd46800 20 remove_watcher() i=2 2024-09-22T08:40:04.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.675+0000 7f00fdd46800 20 remove_watcher() i=3 2024-09-22T08:40:04.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.677+0000 7f00fdd46800 20 remove_watcher() i=4 2024-09-22T08:40:04.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.679+0000 7f00fdd46800 20 remove_watcher() i=5 2024-09-22T08:40:04.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.680+0000 7f00fdd46800 20 remove_watcher() i=6 2024-09-22T08:40:04.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:04.682+0000 7f00fdd46800 20 remove_watcher() i=7 2024-09-22T08:40:05.342 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-22T08:40:05.342 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:40:05.345 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:40:05.345 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:40:05.351 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:40:05.351 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:40:05.395 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:40:05.395 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:40:05.410 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:40:05.410 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:40:05.415 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:40:05.415 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:40:05.429 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:40:05.429 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:40:05.433 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:40:05.433 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:40:05.447 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:40:05.447 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:40:05.452 INFO:tasks.workunit.client.0.smithi038.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-22T08:40:05.887 INFO:tasks.workunit.client.0.smithi038.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-22T08:40:07.309 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:40:07.309 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:40:07.361 INFO:tasks.workunit.client.0.smithi038.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-22T08:40:07.363 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-22T08:40:07.401 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:40:07.401 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:40:07.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.445+0000 7fc270332800 20 rados->read ofs=0 len=0 2024-09-22T08:40:07.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.447+0000 7fc270332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:07.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.447+0000 7fc270332800 20 realm 2024-09-22T08:40:07.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.447+0000 7fc270332800 20 rados->read ofs=0 len=0 2024-09-22T08:40:07.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.447+0000 7fc270332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:07.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.447+0000 7fc270332800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:40:07.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.447+0000 7fc270332800 20 rados->read ofs=0 len=0 2024-09-22T08:40:07.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.447+0000 7fc270332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:07.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.447+0000 7fc270332800 20 rados->read ofs=0 len=0 2024-09-22T08:40:07.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.448+0000 7fc270332800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:07.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.448+0000 7fc270332800 20 rados->read ofs=0 len=0 2024-09-22T08:40:07.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.449+0000 7fc270332800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:40:07.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.449+0000 7fc270332800 20 searching for the correct realm 2024-09-22T08:40:07.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.452+0000 7fc26b7bb640 0 -- 172.21.15.38:0/3630355947 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7fc260073020 msgr2=0x7fc2600a9f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:40:07.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.456+0000 7fc26b7bb640 0 -- 172.21.15.38:0/3630355947 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fc25c042910 msgr2=0x7fc25c0333f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:40:07.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.664+0000 7fc270332800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:40:07.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.664+0000 7fc270332800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:40:07.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.664+0000 7fc270332800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:40:07.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.664+0000 7fc270332800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:40:07.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.664+0000 7fc270332800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:40:07.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.664+0000 7fc270332800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:40:07.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.664+0000 7fc270332800 20 rados->read ofs=0 len=0 2024-09-22T08:40:07.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.664+0000 7fc270332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:07.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.664+0000 7fc270332800 20 rados->read ofs=0 len=0 2024-09-22T08:40:07.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.665+0000 7fc270332800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:07.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.665+0000 7fc270332800 20 rados->read ofs=0 len=0 2024-09-22T08:40:07.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.665+0000 7fc270332800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:40:07.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.665+0000 7fc270332800 20 zone default found 2024-09-22T08:40:07.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.665+0000 7fc270332800 4 Realm: () 2024-09-22T08:40:07.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.665+0000 7fc270332800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:40:07.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.665+0000 7fc270332800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:40:07.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.665+0000 7fc270332800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:40:07.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.665+0000 7fc270332800 20 zonegroup default 2024-09-22T08:40:07.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.665+0000 7fc270332800 20 rados->read ofs=0 len=0 2024-09-22T08:40:07.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.666+0000 7fc270332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:07.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.666+0000 7fc270332800 20 rados->read ofs=0 len=0 2024-09-22T08:40:07.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.666+0000 7fc270332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:07.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.666+0000 7fc270332800 20 rados->read ofs=0 len=0 2024-09-22T08:40:07.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.666+0000 7fc270332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:07.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.666+0000 7fc270332800 20 started sync module instance, tier type = 2024-09-22T08:40:07.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.666+0000 7fc270332800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:40:07.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.677+0000 7fc270332800 20 add_watcher() i=0 2024-09-22T08:40:07.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.677+0000 7fc270332800 20 add_watcher() i=1 2024-09-22T08:40:07.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.677+0000 7fc270332800 20 add_watcher() i=2 2024-09-22T08:40:07.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.677+0000 7fc270332800 20 add_watcher() i=3 2024-09-22T08:40:07.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.678+0000 7fc270332800 20 add_watcher() i=4 2024-09-22T08:40:07.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.678+0000 7fc270332800 20 add_watcher() i=5 2024-09-22T08:40:07.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.678+0000 7fc270332800 20 add_watcher() i=6 2024-09-22T08:40:07.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.679+0000 7fc270332800 20 add_watcher() i=7 2024-09-22T08:40:07.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.679+0000 7fc270332800 2 all 8 watchers are set, enabling cache 2024-09-22T08:40:07.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.681+0000 7fc121fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:07.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.681+0000 7fc270332800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:40:07.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.681+0000 7fc270332800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:40:07.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.681+0000 7fc270332800 5 note: GC not initialized 2024-09-22T08:40:07.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.681+0000 7fc120fe1640 20 reqs_thread_entry: start 2024-09-22T08:40:07.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.682+0000 7fc270332800 20 init_complete bucket index max shards: 11 2024-09-22T08:40:07.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.682+0000 7fc270332800 20 Filter name: none 2024-09-22T08:40:07.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.682+0000 7fc09a7fc640 20 reqs_thread_entry: start 2024-09-22T08:40:07.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.682+0000 7fc270332800 20 rados->read ofs=0 len=0 2024-09-22T08:40:07.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.682+0000 7fc270332800 20 rados_obj.operate() r=0 bl.length=173 2024-09-22T08:40:07.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.682+0000 7fc270332800 20 rados->read ofs=0 len=0 2024-09-22T08:40:07.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.683+0000 7fc270332800 20 rados_obj.operate() r=0 bl.length=395 2024-09-22T08:40:07.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.683+0000 7fc270332800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:40:07.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.683+0000 7fc270332800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-22T08:40:07.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.683+0000 7fc270332800 20 INFO: main: starting shard=0 2024-09-22T08:40:07.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.683+0000 7fc270332800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.0 2024-09-22T08:40:07.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.683+0000 7fc270332800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.0 2024-09-22T08:40:07.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.684+0000 7fc270332800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:40:07.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.684+0000 7fc270332800 20 INFO: main: starting shard=1 2024-09-22T08:40:07.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.684+0000 7fc270332800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.1 2024-09-22T08:40:07.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.684+0000 7fc270332800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.1 2024-09-22T08:40:07.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.684+0000 7fc270332800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:40:07.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.684+0000 7fc270332800 20 INFO: main: starting shard=2 2024-09-22T08:40:07.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.684+0000 7fc270332800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.2 2024-09-22T08:40:07.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.684+0000 7fc270332800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.2 2024-09-22T08:40:07.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.685+0000 7fc270332800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:40:07.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.685+0000 7fc270332800 20 INFO: main: starting shard=3 2024-09-22T08:40:07.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.685+0000 7fc270332800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.3 2024-09-22T08:40:07.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.685+0000 7fc270332800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.3 2024-09-22T08:40:07.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.686+0000 7fc270332800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:40:07.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.686+0000 7fc270332800 20 INFO: main: starting shard=4 2024-09-22T08:40:07.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.686+0000 7fc270332800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.4 2024-09-22T08:40:07.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.686+0000 7fc270332800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.4 2024-09-22T08:40:07.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.686+0000 7fc270332800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:40:07.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.686+0000 7fc270332800 20 INFO: main: starting shard=5 2024-09-22T08:40:07.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.686+0000 7fc270332800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.5 2024-09-22T08:40:07.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.686+0000 7fc270332800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.5 2024-09-22T08:40:07.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.687+0000 7fc270332800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-22T08:40:07.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.687+0000 7fc270332800 20 INFO: main: starting shard=6 2024-09-22T08:40:07.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.687+0000 7fc270332800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.6 2024-09-22T08:40:07.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.687+0000 7fc270332800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.6 2024-09-22T08:40:07.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.688+0000 7fc270332800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:40:07.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.688+0000 7fc270332800 20 INFO: main: starting shard=7 2024-09-22T08:40:07.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.688+0000 7fc270332800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.7 2024-09-22T08:40:07.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.688+0000 7fc270332800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.7 2024-09-22T08:40:07.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.688+0000 7fc270332800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:40:07.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.688+0000 7fc270332800 20 INFO: main: starting shard=8 2024-09-22T08:40:07.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.688+0000 7fc270332800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.8 2024-09-22T08:40:07.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.688+0000 7fc270332800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.8 2024-09-22T08:40:07.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.689+0000 7fc270332800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:40:07.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.689+0000 7fc270332800 20 INFO: main: starting shard=9 2024-09-22T08:40:07.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.689+0000 7fc270332800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.9 2024-09-22T08:40:07.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.689+0000 7fc270332800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.9 2024-09-22T08:40:07.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.689+0000 7fc270332800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:40:07.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.689+0000 7fc270332800 20 INFO: main: starting shard=10 2024-09-22T08:40:07.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.689+0000 7fc270332800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.10 2024-09-22T08:40:07.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.689+0000 7fc270332800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.10 2024-09-22T08:40:07.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.690+0000 7fc270332800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:40:07.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.690+0000 7fc270332800 20 INFO: main: starting shard=11 2024-09-22T08:40:07.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.690+0000 7fc270332800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.11 2024-09-22T08:40:07.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.690+0000 7fc270332800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.11 2024-09-22T08:40:07.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.691+0000 7fc270332800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:40:07.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.691+0000 7fc270332800 20 INFO: main: starting shard=12 2024-09-22T08:40:07.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.691+0000 7fc270332800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.12 2024-09-22T08:40:07.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.691+0000 7fc270332800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.12 2024-09-22T08:40:07.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.691+0000 7fc270332800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:40:07.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.691+0000 7fc270332800 20 INFO: main: done 2024-09-22T08:40:07.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.692+0000 7fc121fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:07.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.694+0000 7fc270332800 20 remove_watcher() i=0 2024-09-22T08:40:07.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.694+0000 7fc270332800 2 removed watcher, disabling cache 2024-09-22T08:40:07.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.696+0000 7fc270332800 20 remove_watcher() i=1 2024-09-22T08:40:07.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.697+0000 7fc270332800 20 remove_watcher() i=2 2024-09-22T08:40:07.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.698+0000 7fc270332800 20 remove_watcher() i=3 2024-09-22T08:40:07.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.699+0000 7fc270332800 20 remove_watcher() i=4 2024-09-22T08:40:07.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.701+0000 7fc270332800 20 remove_watcher() i=5 2024-09-22T08:40:07.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.702+0000 7fc270332800 20 remove_watcher() i=6 2024-09-22T08:40:07.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.703+0000 7fc270332800 20 remove_watcher() i=7 2024-09-22T08:40:07.718 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:40:07.718 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:40:07.723 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:40:07.723 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:40:07.771 INFO:tasks.workunit.client.0.smithi038.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-22T08:40:07.773 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-22T08:40:07.805 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:40:07.805 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:40:07.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.844+0000 7ff8d9f32800 20 rados->read ofs=0 len=0 2024-09-22T08:40:07.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.846+0000 7ff8d9f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:07.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.846+0000 7ff8d9f32800 20 realm 2024-09-22T08:40:07.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.846+0000 7ff8d9f32800 20 rados->read ofs=0 len=0 2024-09-22T08:40:07.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.846+0000 7ff8d9f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:07.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.846+0000 7ff8d9f32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:40:07.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.846+0000 7ff8d9f32800 20 rados->read ofs=0 len=0 2024-09-22T08:40:07.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.847+0000 7ff8d9f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:07.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.847+0000 7ff8d9f32800 20 rados->read ofs=0 len=0 2024-09-22T08:40:07.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.847+0000 7ff8d9f32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:07.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.847+0000 7ff8d9f32800 20 rados->read ofs=0 len=0 2024-09-22T08:40:07.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.848+0000 7ff8d9f32800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:40:07.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.848+0000 7ff8d9f32800 20 searching for the correct realm 2024-09-22T08:40:07.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:07.850+0000 7ff8d53bb640 0 -- 172.21.15.38:0/2372886050 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7ff8c0045030 msgr2=0x7ff8c0047950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:40:08.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.056+0000 7ff8d53bb640 0 -- 172.21.15.38:0/2372886050 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7ff8c8048710 msgr2=0x7ff8c8048df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:40:08.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.265+0000 7ff8d9f32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:40:08.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.265+0000 7ff8d9f32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:40:08.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.265+0000 7ff8d9f32800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:40:08.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.265+0000 7ff8d9f32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:40:08.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.265+0000 7ff8d9f32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:40:08.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.265+0000 7ff8d9f32800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:40:08.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.265+0000 7ff8d9f32800 20 rados->read ofs=0 len=0 2024-09-22T08:40:08.267 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.265+0000 7ff8d9f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:08.267 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.265+0000 7ff8d9f32800 20 rados->read ofs=0 len=0 2024-09-22T08:40:08.267 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.265+0000 7ff8d9f32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:08.267 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.265+0000 7ff8d9f32800 20 rados->read ofs=0 len=0 2024-09-22T08:40:08.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.266+0000 7ff8d9f32800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:40:08.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.266+0000 7ff8d9f32800 20 zone default found 2024-09-22T08:40:08.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.266+0000 7ff8d9f32800 4 Realm: () 2024-09-22T08:40:08.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.266+0000 7ff8d9f32800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:40:08.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.266+0000 7ff8d9f32800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:40:08.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.266+0000 7ff8d9f32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:40:08.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.266+0000 7ff8d9f32800 20 zonegroup default 2024-09-22T08:40:08.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.266+0000 7ff8d9f32800 20 rados->read ofs=0 len=0 2024-09-22T08:40:08.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.267+0000 7ff8d9f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:08.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.267+0000 7ff8d9f32800 20 rados->read ofs=0 len=0 2024-09-22T08:40:08.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.267+0000 7ff8d9f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:08.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.267+0000 7ff8d9f32800 20 rados->read ofs=0 len=0 2024-09-22T08:40:08.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.267+0000 7ff8d9f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:08.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.267+0000 7ff8d9f32800 20 started sync module instance, tier type = 2024-09-22T08:40:08.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.267+0000 7ff8d9f32800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:40:08.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.278+0000 7ff8d9f32800 20 add_watcher() i=0 2024-09-22T08:40:08.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.278+0000 7ff8d9f32800 20 add_watcher() i=1 2024-09-22T08:40:08.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.278+0000 7ff8d9f32800 20 add_watcher() i=2 2024-09-22T08:40:08.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.278+0000 7ff8d9f32800 20 add_watcher() i=3 2024-09-22T08:40:08.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.278+0000 7ff8d9f32800 20 add_watcher() i=4 2024-09-22T08:40:08.280 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.278+0000 7ff8d9f32800 20 add_watcher() i=5 2024-09-22T08:40:08.280 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.278+0000 7ff8d9f32800 20 add_watcher() i=6 2024-09-22T08:40:08.281 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.280+0000 7ff8d9f32800 20 add_watcher() i=7 2024-09-22T08:40:08.281 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.280+0000 7ff8d9f32800 2 all 8 watchers are set, enabling cache 2024-09-22T08:40:08.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.282+0000 7ff7877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:08.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.282+0000 7ff8d9f32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:40:08.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.282+0000 7ff8d9f32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:40:08.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.282+0000 7ff8d9f32800 5 note: GC not initialized 2024-09-22T08:40:08.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.283+0000 7ff7867fc640 20 reqs_thread_entry: start 2024-09-22T08:40:08.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.283+0000 7ff8d9f32800 20 init_complete bucket index max shards: 11 2024-09-22T08:40:08.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.283+0000 7ff8d9f32800 20 Filter name: none 2024-09-22T08:40:08.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.283+0000 7ff6f7fff640 20 reqs_thread_entry: start 2024-09-22T08:40:08.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.283+0000 7ff8d9f32800 20 rados->read ofs=0 len=0 2024-09-22T08:40:08.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.284+0000 7ff8d9f32800 20 rados_obj.operate() r=0 bl.length=173 2024-09-22T08:40:08.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.284+0000 7ff8d9f32800 20 rados->read ofs=0 len=0 2024-09-22T08:40:08.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.284+0000 7ff8d9f32800 20 rados_obj.operate() r=0 bl.length=395 2024-09-22T08:40:08.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.284+0000 7ff8d9f32800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:40:08.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.284+0000 7ff8d9f32800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-22T08:40:08.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.284+0000 7ff8d9f32800 20 INFO: main: starting shard=0 2024-09-22T08:40:08.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.284+0000 7ff8d9f32800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.0 2024-09-22T08:40:08.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.284+0000 7ff8d9f32800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.0 2024-09-22T08:40:08.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.285+0000 7ff8d9f32800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:40:08.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.285+0000 7ff8d9f32800 20 INFO: main: starting shard=1 2024-09-22T08:40:08.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.285+0000 7ff8d9f32800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.1 2024-09-22T08:40:08.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.285+0000 7ff8d9f32800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.1 2024-09-22T08:40:08.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.285+0000 7ff8d9f32800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:40:08.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.286+0000 7ff8d9f32800 20 INFO: main: starting shard=2 2024-09-22T08:40:08.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.286+0000 7ff8d9f32800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.2 2024-09-22T08:40:08.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.286+0000 7ff8d9f32800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.2 2024-09-22T08:40:08.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.286+0000 7ff8d9f32800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:40:08.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.286+0000 7ff8d9f32800 20 INFO: main: starting shard=3 2024-09-22T08:40:08.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.286+0000 7ff8d9f32800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.3 2024-09-22T08:40:08.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.286+0000 7ff8d9f32800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.3 2024-09-22T08:40:08.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.287+0000 7ff8d9f32800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:40:08.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.287+0000 7ff8d9f32800 20 INFO: main: starting shard=4 2024-09-22T08:40:08.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.287+0000 7ff8d9f32800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.4 2024-09-22T08:40:08.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.287+0000 7ff8d9f32800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.4 2024-09-22T08:40:08.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.288+0000 7ff8d9f32800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:40:08.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.288+0000 7ff8d9f32800 20 INFO: main: starting shard=5 2024-09-22T08:40:08.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.288+0000 7ff8d9f32800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.5 2024-09-22T08:40:08.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.288+0000 7ff8d9f32800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.5 2024-09-22T08:40:08.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.288+0000 7ff8d9f32800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:40:08.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.288+0000 7ff8d9f32800 20 INFO: main: starting shard=6 2024-09-22T08:40:08.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.288+0000 7ff8d9f32800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.6 2024-09-22T08:40:08.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.288+0000 7ff8d9f32800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.6 2024-09-22T08:40:08.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.289+0000 7ff8d9f32800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:40:08.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.289+0000 7ff8d9f32800 20 INFO: main: starting shard=7 2024-09-22T08:40:08.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.289+0000 7ff8d9f32800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.7 2024-09-22T08:40:08.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.289+0000 7ff8d9f32800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.7 2024-09-22T08:40:08.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.290+0000 7ff8d9f32800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:40:08.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.290+0000 7ff8d9f32800 20 INFO: main: starting shard=8 2024-09-22T08:40:08.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.290+0000 7ff8d9f32800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.8 2024-09-22T08:40:08.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.290+0000 7ff8d9f32800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.8 2024-09-22T08:40:08.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.290+0000 7ff8d9f32800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:40:08.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.290+0000 7ff8d9f32800 20 INFO: main: starting shard=9 2024-09-22T08:40:08.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.290+0000 7ff8d9f32800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.9 2024-09-22T08:40:08.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.290+0000 7ff8d9f32800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.9 2024-09-22T08:40:08.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.291+0000 7ff8d9f32800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-22T08:40:08.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.291+0000 7ff8d9f32800 20 INFO: main: starting shard=10 2024-09-22T08:40:08.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.291+0000 7ff8d9f32800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.10 2024-09-22T08:40:08.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.291+0000 7ff8d9f32800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.10 2024-09-22T08:40:08.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.292+0000 7ff8d9f32800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:40:08.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.292+0000 7ff8d9f32800 20 INFO: main: starting shard=11 2024-09-22T08:40:08.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.292+0000 7ff8d9f32800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.11 2024-09-22T08:40:08.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.292+0000 7ff8d9f32800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.11 2024-09-22T08:40:08.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.292+0000 7ff8d9f32800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:40:08.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.292+0000 7ff8d9f32800 20 INFO: main: starting shard=12 2024-09-22T08:40:08.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.292+0000 7ff8d9f32800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.12 2024-09-22T08:40:08.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.292+0000 7ff8d9f32800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.12 2024-09-22T08:40:08.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.293+0000 7ff8d9f32800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:40:08.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.293+0000 7ff8d9f32800 20 INFO: main: done 2024-09-22T08:40:08.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.294+0000 7ff7877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:08.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.297+0000 7ff8d9f32800 20 remove_watcher() i=0 2024-09-22T08:40:08.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.297+0000 7ff8d9f32800 2 removed watcher, disabling cache 2024-09-22T08:40:08.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.298+0000 7ff8d9f32800 20 remove_watcher() i=1 2024-09-22T08:40:08.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.299+0000 7ff8d9f32800 20 remove_watcher() i=2 2024-09-22T08:40:08.302 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.301+0000 7ff8d9f32800 20 remove_watcher() i=3 2024-09-22T08:40:08.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.302+0000 7ff8d9f32800 20 remove_watcher() i=4 2024-09-22T08:40:08.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.303+0000 7ff8d9f32800 20 remove_watcher() i=5 2024-09-22T08:40:08.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.305+0000 7ff8d9f32800 20 remove_watcher() i=6 2024-09-22T08:40:08.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.306+0000 7ff8d9f32800 20 remove_watcher() i=7 2024-09-22T08:40:08.322 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:40:08.322 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:40:08.326 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:40:08.326 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:40:08.374 INFO:tasks.workunit.client.0.smithi038.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-22T08:40:08.376 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-22T08:40:08.410 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:40:08.410 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:40:08.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.653+0000 7fc3c1616800 20 rados->read ofs=0 len=0 2024-09-22T08:40:08.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.656+0000 7fc3c1616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:08.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.656+0000 7fc3c1616800 20 realm 2024-09-22T08:40:08.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.656+0000 7fc3c1616800 20 rados->read ofs=0 len=0 2024-09-22T08:40:08.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.656+0000 7fc3c1616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:08.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.656+0000 7fc3c1616800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:40:08.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.656+0000 7fc3c1616800 20 rados->read ofs=0 len=0 2024-09-22T08:40:08.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.656+0000 7fc3c1616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:08.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.656+0000 7fc3c1616800 20 rados->read ofs=0 len=0 2024-09-22T08:40:08.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.657+0000 7fc3c1616800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:08.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.657+0000 7fc3c1616800 20 rados->read ofs=0 len=0 2024-09-22T08:40:08.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.658+0000 7fc3c1616800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:40:08.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.658+0000 7fc3c1616800 20 searching for the correct realm 2024-09-22T08:40:08.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.660+0000 7fc3bc5e6640 0 -- 172.21.15.38:0/1438544808 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7fc3b0020060 msgr2=0x7fc3b0060440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:40:08.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:08.865+0000 7fc3bc5e6640 0 -- 172.21.15.38:0/1438544808 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fc3ac044410 msgr2=0x7fc3ac044890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:40:09.074 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.073+0000 7fc3c1616800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:40:09.074 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.073+0000 7fc3c1616800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:40:09.074 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.073+0000 7fc3c1616800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:40:09.075 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.073+0000 7fc3c1616800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:40:09.075 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.073+0000 7fc3c1616800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:40:09.075 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.073+0000 7fc3c1616800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:40:09.075 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.073+0000 7fc3c1616800 20 rados->read ofs=0 len=0 2024-09-22T08:40:09.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.074+0000 7fc3c1616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:09.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.074+0000 7fc3c1616800 20 rados->read ofs=0 len=0 2024-09-22T08:40:09.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.074+0000 7fc3c1616800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:09.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.074+0000 7fc3c1616800 20 rados->read ofs=0 len=0 2024-09-22T08:40:09.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.074+0000 7fc3c1616800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:40:09.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.074+0000 7fc3c1616800 20 zone default found 2024-09-22T08:40:09.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.074+0000 7fc3c1616800 4 Realm: () 2024-09-22T08:40:09.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.074+0000 7fc3c1616800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:40:09.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.074+0000 7fc3c1616800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:40:09.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.074+0000 7fc3c1616800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:40:09.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.074+0000 7fc3c1616800 20 zonegroup default 2024-09-22T08:40:09.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.074+0000 7fc3c1616800 20 rados->read ofs=0 len=0 2024-09-22T08:40:09.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.075+0000 7fc3c1616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:09.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.075+0000 7fc3c1616800 20 rados->read ofs=0 len=0 2024-09-22T08:40:09.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.075+0000 7fc3c1616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:09.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.075+0000 7fc3c1616800 20 rados->read ofs=0 len=0 2024-09-22T08:40:09.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.076+0000 7fc3c1616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:09.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.076+0000 7fc3c1616800 20 started sync module instance, tier type = 2024-09-22T08:40:09.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.076+0000 7fc3c1616800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:40:09.088 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.087+0000 7fc3c1616800 20 add_watcher() i=0 2024-09-22T08:40:09.088 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.087+0000 7fc3c1616800 20 add_watcher() i=1 2024-09-22T08:40:09.088 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.087+0000 7fc3c1616800 20 add_watcher() i=2 2024-09-22T08:40:09.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.087+0000 7fc3c1616800 20 add_watcher() i=3 2024-09-22T08:40:09.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.087+0000 7fc3c1616800 20 add_watcher() i=4 2024-09-22T08:40:09.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.087+0000 7fc3c1616800 20 add_watcher() i=5 2024-09-22T08:40:09.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.087+0000 7fc3c1616800 20 add_watcher() i=6 2024-09-22T08:40:09.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.089+0000 7fc3c1616800 20 add_watcher() i=7 2024-09-22T08:40:09.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.089+0000 7fc3c1616800 2 all 8 watchers are set, enabling cache 2024-09-22T08:40:09.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.091+0000 7fc2737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:09.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.091+0000 7fc3c1616800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:40:09.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.091+0000 7fc3c1616800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:40:09.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.091+0000 7fc3c1616800 5 note: GC not initialized 2024-09-22T08:40:09.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.092+0000 7fc2727e4640 20 reqs_thread_entry: start 2024-09-22T08:40:09.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.092+0000 7fc3c1616800 20 init_complete bucket index max shards: 11 2024-09-22T08:40:09.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.092+0000 7fc3c1616800 20 Filter name: none 2024-09-22T08:40:09.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.092+0000 7fc26b7fe640 20 reqs_thread_entry: start 2024-09-22T08:40:09.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.092+0000 7fc3c1616800 20 rados->read ofs=0 len=0 2024-09-22T08:40:09.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.092+0000 7fc3c1616800 20 rados_obj.operate() r=0 bl.length=173 2024-09-22T08:40:09.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.092+0000 7fc3c1616800 20 rados->read ofs=0 len=0 2024-09-22T08:40:09.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.093+0000 7fc3c1616800 20 rados_obj.operate() r=0 bl.length=395 2024-09-22T08:40:09.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.093+0000 7fc3c1616800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:40:09.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.093+0000 7fc3c1616800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-22T08:40:09.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.093+0000 7fc3c1616800 20 INFO: main: starting shard=0 2024-09-22T08:40:09.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.093+0000 7fc3c1616800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.0 2024-09-22T08:40:09.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.093+0000 7fc3c1616800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.0 2024-09-22T08:40:09.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.094+0000 7fc3c1616800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-22T08:40:09.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.094+0000 7fc3c1616800 20 INFO: main: starting shard=1 2024-09-22T08:40:09.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.094+0000 7fc3c1616800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.1 2024-09-22T08:40:09.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.094+0000 7fc3c1616800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.1 2024-09-22T08:40:09.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.094+0000 7fc3c1616800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:40:09.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.094+0000 7fc3c1616800 20 INFO: main: starting shard=2 2024-09-22T08:40:09.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.094+0000 7fc3c1616800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.2 2024-09-22T08:40:09.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.094+0000 7fc3c1616800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.2 2024-09-22T08:40:09.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.095+0000 7fc3c1616800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:40:09.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.095+0000 7fc3c1616800 20 INFO: main: starting shard=3 2024-09-22T08:40:09.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.095+0000 7fc3c1616800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.3 2024-09-22T08:40:09.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.095+0000 7fc3c1616800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.3 2024-09-22T08:40:09.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.096+0000 7fc3c1616800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:40:09.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.096+0000 7fc3c1616800 20 INFO: main: starting shard=4 2024-09-22T08:40:09.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.096+0000 7fc3c1616800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.4 2024-09-22T08:40:09.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.096+0000 7fc3c1616800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.4 2024-09-22T08:40:09.098 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.096+0000 7fc3c1616800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:40:09.098 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.096+0000 7fc3c1616800 20 INFO: main: starting shard=5 2024-09-22T08:40:09.098 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.096+0000 7fc3c1616800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.5 2024-09-22T08:40:09.098 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.096+0000 7fc3c1616800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.5 2024-09-22T08:40:09.098 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.097+0000 7fc3c1616800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:40:09.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.097+0000 7fc3c1616800 20 INFO: main: starting shard=6 2024-09-22T08:40:09.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.097+0000 7fc3c1616800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.6 2024-09-22T08:40:09.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.097+0000 7fc3c1616800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.6 2024-09-22T08:40:09.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.098+0000 7fc3c1616800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:40:09.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.098+0000 7fc3c1616800 20 INFO: main: starting shard=7 2024-09-22T08:40:09.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.098+0000 7fc3c1616800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.7 2024-09-22T08:40:09.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.098+0000 7fc3c1616800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.7 2024-09-22T08:40:09.100 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.099+0000 7fc3c1616800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:40:09.100 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.099+0000 7fc3c1616800 20 INFO: main: starting shard=8 2024-09-22T08:40:09.100 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.099+0000 7fc3c1616800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.8 2024-09-22T08:40:09.100 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.099+0000 7fc3c1616800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.8 2024-09-22T08:40:09.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.099+0000 7fc3c1616800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:40:09.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.099+0000 7fc3c1616800 20 INFO: main: starting shard=9 2024-09-22T08:40:09.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.099+0000 7fc3c1616800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.9 2024-09-22T08:40:09.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.099+0000 7fc3c1616800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.9 2024-09-22T08:40:09.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.100+0000 7fc3c1616800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:40:09.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.100+0000 7fc3c1616800 20 INFO: main: starting shard=10 2024-09-22T08:40:09.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.100+0000 7fc3c1616800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.10 2024-09-22T08:40:09.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.100+0000 7fc3c1616800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.10 2024-09-22T08:40:09.102 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.100+0000 7fc3c1616800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:40:09.102 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.100+0000 7fc3c1616800 20 INFO: main: starting shard=11 2024-09-22T08:40:09.102 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.100+0000 7fc3c1616800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.11 2024-09-22T08:40:09.102 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.100+0000 7fc3c1616800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.11 2024-09-22T08:40:09.102 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.101+0000 7fc3c1616800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:40:09.102 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.101+0000 7fc3c1616800 20 INFO: main: starting shard=12 2024-09-22T08:40:09.103 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.101+0000 7fc3c1616800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.12 2024-09-22T08:40:09.103 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.101+0000 7fc3c1616800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.12 2024-09-22T08:40:09.103 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.101+0000 7fc3c1616800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:40:09.103 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.101+0000 7fc3c1616800 20 INFO: main: done 2024-09-22T08:40:09.103 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.102+0000 7fc2737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:09.106 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.105+0000 7fc3c1616800 20 remove_watcher() i=0 2024-09-22T08:40:09.106 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.105+0000 7fc3c1616800 2 removed watcher, disabling cache 2024-09-22T08:40:09.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.107+0000 7fc3c1616800 20 remove_watcher() i=1 2024-09-22T08:40:09.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.108+0000 7fc3c1616800 20 remove_watcher() i=2 2024-09-22T08:40:09.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.109+0000 7fc3c1616800 20 remove_watcher() i=3 2024-09-22T08:40:09.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.110+0000 7fc3c1616800 20 remove_watcher() i=4 2024-09-22T08:40:09.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.112+0000 7fc3c1616800 20 remove_watcher() i=5 2024-09-22T08:40:09.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.113+0000 7fc3c1616800 20 remove_watcher() i=6 2024-09-22T08:40:09.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:09.114+0000 7fc3c1616800 20 remove_watcher() i=7 2024-09-22T08:40:09.131 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:40:09.131 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:40:09.135 INFO:tasks.workunit.client.0.smithi038.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-22T08:40:09.564 INFO:tasks.workunit.client.0.smithi038.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-22T08:40:09.981 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-22T08:40:10.013 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:40:10.013 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:40:10.053 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.052+0000 7f4377a87800 20 rados->read ofs=0 len=0 2024-09-22T08:40:10.055 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.054+0000 7f4377a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:10.055 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.054+0000 7f4377a87800 20 realm 2024-09-22T08:40:10.055 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.054+0000 7f4377a87800 20 rados->read ofs=0 len=0 2024-09-22T08:40:10.055 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.054+0000 7f4377a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:10.055 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.054+0000 7f4377a87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:40:10.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.054+0000 7f4377a87800 20 rados->read ofs=0 len=0 2024-09-22T08:40:10.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.054+0000 7f4377a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:10.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.054+0000 7f4377a87800 20 rados->read ofs=0 len=0 2024-09-22T08:40:10.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.055+0000 7f4377a87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:10.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.055+0000 7f4377a87800 20 rados->read ofs=0 len=0 2024-09-22T08:40:10.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.056+0000 7f4377a87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:40:10.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.056+0000 7f4377a87800 20 searching for the correct realm 2024-09-22T08:40:10.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.059+0000 7f4375d72640 0 -- 172.21.15.38:0/3575090861 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7f436801f070 msgr2=0x7f4368062030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:40:10.267 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.266+0000 7f4375571640 0 -- 172.21.15.38:0/3575090861 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x55ac05aeaf20 msgr2=0x55ac05aed360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:40:10.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.271+0000 7f4377a87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:40:10.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.271+0000 7f4377a87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:40:10.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.271+0000 7f4377a87800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:40:10.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.271+0000 7f4377a87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:40:10.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.271+0000 7f4377a87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:40:10.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.271+0000 7f4377a87800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:40:10.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.271+0000 7f4377a87800 20 rados->read ofs=0 len=0 2024-09-22T08:40:10.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.271+0000 7f4377a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:10.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.271+0000 7f4377a87800 20 rados->read ofs=0 len=0 2024-09-22T08:40:10.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.272+0000 7f4377a87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:10.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.272+0000 7f4377a87800 20 rados->read ofs=0 len=0 2024-09-22T08:40:10.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.272+0000 7f4377a87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:40:10.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.272+0000 7f4377a87800 20 zone default found 2024-09-22T08:40:10.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.272+0000 7f4377a87800 4 Realm: () 2024-09-22T08:40:10.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.272+0000 7f4377a87800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:40:10.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.272+0000 7f4377a87800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:40:10.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.272+0000 7f4377a87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:40:10.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.272+0000 7f4377a87800 20 zonegroup default 2024-09-22T08:40:10.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.272+0000 7f4377a87800 20 rados->read ofs=0 len=0 2024-09-22T08:40:10.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.272+0000 7f4377a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:10.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.272+0000 7f4377a87800 20 rados->read ofs=0 len=0 2024-09-22T08:40:10.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.273+0000 7f4377a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:10.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.273+0000 7f4377a87800 20 rados->read ofs=0 len=0 2024-09-22T08:40:10.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.273+0000 7f4377a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:10.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.273+0000 7f4377a87800 20 started sync module instance, tier type = 2024-09-22T08:40:10.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.273+0000 7f4377a87800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:40:10.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.283+0000 7f4377a87800 20 add_watcher() i=0 2024-09-22T08:40:10.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.283+0000 7f4377a87800 20 add_watcher() i=1 2024-09-22T08:40:10.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.283+0000 7f4377a87800 20 add_watcher() i=2 2024-09-22T08:40:10.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.283+0000 7f4377a87800 20 add_watcher() i=3 2024-09-22T08:40:10.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.283+0000 7f4377a87800 20 add_watcher() i=4 2024-09-22T08:40:10.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.283+0000 7f4377a87800 20 add_watcher() i=5 2024-09-22T08:40:10.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.283+0000 7f4377a87800 20 add_watcher() i=6 2024-09-22T08:40:10.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.285+0000 7f4377a87800 20 add_watcher() i=7 2024-09-22T08:40:10.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.285+0000 7f4377a87800 2 all 8 watchers are set, enabling cache 2024-09-22T08:40:10.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.287+0000 7f422b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:10.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.287+0000 7f4377a87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:40:10.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.287+0000 7f4377a87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:40:10.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.287+0000 7f4377a87800 5 note: GC not initialized 2024-09-22T08:40:10.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.287+0000 7f422a7e4640 20 reqs_thread_entry: start 2024-09-22T08:40:10.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.287+0000 7f4377a87800 20 init_complete bucket index max shards: 11 2024-09-22T08:40:10.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.288+0000 7f4377a87800 20 Filter name: none 2024-09-22T08:40:10.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.288+0000 7f419bfff640 20 reqs_thread_entry: start 2024-09-22T08:40:10.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.288+0000 7f4377a87800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-22T08:40:10.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.288+0000 7f4377a87800 20 rados->read ofs=0 len=0 2024-09-22T08:40:10.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.288+0000 7f4377a87800 20 rados_obj.operate() r=0 bl.length=173 2024-09-22T08:40:10.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.288+0000 7f4377a87800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-22T08:40:10.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.288+0000 7f4377a87800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-22T08:40:10.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.288+0000 7f4377a87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 : miss 2024-09-22T08:40:10.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.288+0000 7f4377a87800 20 rados->read ofs=0 len=0 2024-09-22T08:40:10.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.289+0000 7f4377a87800 20 rados_obj.operate() r=0 bl.length=395 2024-09-22T08:40:10.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.289+0000 7f4377a87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 info.flags=0x17 2024-09-22T08:40:10.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.289+0000 7f4377a87800 10 adding default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 to cache LRU end 2024-09-22T08:40:10.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.289+0000 7f4377a87800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:40:10.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.289+0000 7f4377a87800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:40:10.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.289+0000 7f4377a87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 2024-09-22T08:40:10.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.297+0000 7f4377a87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 info.flags=0x17 2024-09-22T08:40:10.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.297+0000 7f4377a87800 10 moving default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 to cache LRU end 2024-09-22T08:40:10.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.297+0000 7f4377a87800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:40:10.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.297+0000 7f4377a87800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18, ofs0, ns] 2024-09-22T08:40:10.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.297+0000 7f4258ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497012 cookie 94197318135712 notifier 8087 bl.length()=821 2024-09-22T08:40:10.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.297+0000 7f4258ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 info.flags=0x17 2024-09-22T08:40:10.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.297+0000 7f4258ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 to cache LRU end 2024-09-22T08:40:10.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.297+0000 7f4258ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:40:10.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.298+0000 7f4377a87800 20 handle_bi_update(): bucket=:myver[c62f9d7b-f6b6-404a-90de-de5607499115.4584.18]): orig_sources= new_sources= 2024-09-22T08:40:10.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.298+0000 7f4377a87800 20 handle_bi_update(): bucket=:myver[c62f9d7b-f6b6-404a-90de-de5607499115.4584.18]): potential sources added=[] removed=[] 2024-09-22T08:40:10.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.298+0000 7f4377a87800 20 handle_bi_update(): bucket=:myver[c62f9d7b-f6b6-404a-90de-de5607499115.4584.18]): orig_dests= new_dests= 2024-09-22T08:40:10.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.298+0000 7f4377a87800 20 handle_bi_update(): bucket=:myver[c62f9d7b-f6b6-404a-90de-de5607499115.4584.18]): potential dests added=[] removed=[] 2024-09-22T08:40:10.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.304+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.0 2024-09-22T08:40:10.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.304+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.0 2024-09-22T08:40:10.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.304+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.1 2024-09-22T08:40:10.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.304+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.1 2024-09-22T08:40:10.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.304+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.2 2024-09-22T08:40:10.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.304+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.2 2024-09-22T08:40:10.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.304+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.3 2024-09-22T08:40:10.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.304+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.3 2024-09-22T08:40:10.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.304+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.4 2024-09-22T08:40:10.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.304+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.4 2024-09-22T08:40:10.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.304+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.5 2024-09-22T08:40:10.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.304+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.5 2024-09-22T08:40:10.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.304+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.6 2024-09-22T08:40:10.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.304+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.6 2024-09-22T08:40:10.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.304+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.7 2024-09-22T08:40:10.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.304+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.7 2024-09-22T08:40:10.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.304+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.8 2024-09-22T08:40:10.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.304+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.8 2024-09-22T08:40:10.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.304+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.9 2024-09-22T08:40:10.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.304+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.9 2024-09-22T08:40:10.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.304+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.10 2024-09-22T08:40:10.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.304+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.10 2024-09-22T08:40:10.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.304+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.11 2024-09-22T08:40:10.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.304+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.11 2024-09-22T08:40:10.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.304+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.12 2024-09-22T08:40:10.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.304+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.12 2024-09-22T08:40:10.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.304+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.13 2024-09-22T08:40:10.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.304+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.13 2024-09-22T08:40:10.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.304+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.14 2024-09-22T08:40:10.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.304+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.14 2024-09-22T08:40:10.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.304+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.15 2024-09-22T08:40:10.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.304+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.15 2024-09-22T08:40:10.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.304+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.16 2024-09-22T08:40:10.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.304+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.16 2024-09-22T08:40:10.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.304+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.0 2024-09-22T08:40:10.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.304+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.0 2024-09-22T08:40:10.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.305+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.1 2024-09-22T08:40:10.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.305+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.1 2024-09-22T08:40:10.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.306+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.2 2024-09-22T08:40:10.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.306+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.2 2024-09-22T08:40:10.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.306+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.3 2024-09-22T08:40:10.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.306+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.3 2024-09-22T08:40:10.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.307+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.4 2024-09-22T08:40:10.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.307+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.4 2024-09-22T08:40:10.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.308+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.5 2024-09-22T08:40:10.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.308+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.5 2024-09-22T08:40:10.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.308+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.6 2024-09-22T08:40:10.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.308+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.6 2024-09-22T08:40:10.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.309+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.7 2024-09-22T08:40:10.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.309+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.7 2024-09-22T08:40:10.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.310+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.8 2024-09-22T08:40:10.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.310+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.8 2024-09-22T08:40:10.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.310+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.9 2024-09-22T08:40:10.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.310+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.9 2024-09-22T08:40:10.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.311+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.10 2024-09-22T08:40:10.312 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.311+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.10 2024-09-22T08:40:10.312 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.311+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.11 2024-09-22T08:40:10.312 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.311+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.11 2024-09-22T08:40:10.313 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.312+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.12 2024-09-22T08:40:10.313 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.312+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.12 2024-09-22T08:40:10.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.314+0000 7f4377a87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 : hit (requested=0x17, cached=0x17) 2024-09-22T08:40:10.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.314+0000 7f4377a87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 2024-09-22T08:40:10.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.316+0000 7f4377a87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 info.flags=0x17 2024-09-22T08:40:10.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.316+0000 7f4377a87800 10 moving default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 to cache LRU end 2024-09-22T08:40:10.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.316+0000 7f4377a87800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:40:10.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.316+0000 7f4377a87800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18, ofs0, ns] 2024-09-22T08:40:10.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.316+0000 7f4247fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497013 cookie 94197318135712 notifier 8087 bl.length()=821 2024-09-22T08:40:10.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.316+0000 7f4247fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 info.flags=0x17 2024-09-22T08:40:10.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.316+0000 7f4247fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 to cache LRU end 2024-09-22T08:40:10.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.316+0000 7f4247fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:40:10.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.316+0000 7f4377a87800 20 handle_bi_update(): bucket=:myver[c62f9d7b-f6b6-404a-90de-de5607499115.4584.18]): orig_sources= new_sources= 2024-09-22T08:40:10.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.316+0000 7f4377a87800 20 handle_bi_update(): bucket=:myver[c62f9d7b-f6b6-404a-90de-de5607499115.4584.18]): potential sources added=[] removed=[] 2024-09-22T08:40:10.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.316+0000 7f4377a87800 20 handle_bi_update(): bucket=:myver[c62f9d7b-f6b6-404a-90de-de5607499115.4584.18]): orig_dests= new_dests= 2024-09-22T08:40:10.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.316+0000 7f4377a87800 20 handle_bi_update(): bucket=:myver[c62f9d7b-f6b6-404a-90de-de5607499115.4584.18]): potential dests added=[] removed=[] 2024-09-22T08:40:10.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.319+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.0 2024-09-22T08:40:10.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.319+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.0 2024-09-22T08:40:10.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.320+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.1 2024-09-22T08:40:10.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.320+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.1 2024-09-22T08:40:10.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.320+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.2 2024-09-22T08:40:10.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.320+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.2 2024-09-22T08:40:10.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.320+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.3 2024-09-22T08:40:10.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.320+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.3 2024-09-22T08:40:10.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.321+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.4 2024-09-22T08:40:10.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.321+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.4 2024-09-22T08:40:10.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.321+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.5 2024-09-22T08:40:10.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.321+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.5 2024-09-22T08:40:10.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.321+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.6 2024-09-22T08:40:10.323 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.321+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.6 2024-09-22T08:40:10.323 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.322+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.7 2024-09-22T08:40:10.323 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.322+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.7 2024-09-22T08:40:10.323 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.322+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.8 2024-09-22T08:40:10.323 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.322+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.8 2024-09-22T08:40:10.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.322+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.9 2024-09-22T08:40:10.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.322+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.9 2024-09-22T08:40:10.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.323+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.10 2024-09-22T08:40:10.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.323+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.10 2024-09-22T08:40:10.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.323+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.11 2024-09-22T08:40:10.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.323+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.11 2024-09-22T08:40:10.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.323+0000 7f4377a87800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.12 2024-09-22T08:40:10.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.323+0000 7f4377a87800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.2.12 2024-09-22T08:40:10.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.324+0000 7f4377a87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 : hit (requested=0x17, cached=0x17) 2024-09-22T08:40:10.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.324+0000 7f4377a87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 2024-09-22T08:40:10.326 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.325+0000 7f4377a87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 info.flags=0x17 2024-09-22T08:40:10.326 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.325+0000 7f4377a87800 10 moving default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 to cache LRU end 2024-09-22T08:40:10.326 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.325+0000 7f4377a87800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:40:10.326 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.325+0000 7f4377a87800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18, ofs0, ns] 2024-09-22T08:40:10.327 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.326+0000 7f4258ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497014 cookie 94197318135712 notifier 8087 bl.length()=789 2024-09-22T08:40:10.327 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.326+0000 7f4258ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 info.flags=0x17 2024-09-22T08:40:10.327 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.326+0000 7f4258ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 to cache LRU end 2024-09-22T08:40:10.327 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.326+0000 7f4258ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:40:10.327 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.326+0000 7f4377a87800 20 handle_bi_update(): bucket=:myver[c62f9d7b-f6b6-404a-90de-de5607499115.4584.18]): orig_sources= new_sources= 2024-09-22T08:40:10.327 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.326+0000 7f4377a87800 20 handle_bi_update(): bucket=:myver[c62f9d7b-f6b6-404a-90de-de5607499115.4584.18]): potential sources added=[] removed=[] 2024-09-22T08:40:10.327 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.326+0000 7f4377a87800 20 handle_bi_update(): bucket=:myver[c62f9d7b-f6b6-404a-90de-de5607499115.4584.18]): orig_dests= new_dests= 2024-09-22T08:40:10.327 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.326+0000 7f4377a87800 20 handle_bi_update(): bucket=:myver[c62f9d7b-f6b6-404a-90de-de5607499115.4584.18]): potential dests added=[] removed=[] 2024-09-22T08:40:10.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.329+0000 7f4377a87800 1 execute INFO: reshard of bucket "myver" from 13 shards to 17 shards completed successfully 2024-09-22T08:40:10.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.331+0000 7f422b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:10.334 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.333+0000 7f4377a87800 20 remove_watcher() i=0 2024-09-22T08:40:10.334 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.333+0000 7f4377a87800 2 removed watcher, disabling cache 2024-09-22T08:40:10.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.334+0000 7f4377a87800 20 remove_watcher() i=1 2024-09-22T08:40:10.336 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.335+0000 7f4377a87800 20 remove_watcher() i=2 2024-09-22T08:40:10.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.336+0000 7f4377a87800 20 remove_watcher() i=3 2024-09-22T08:40:10.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.337+0000 7f4377a87800 20 remove_watcher() i=4 2024-09-22T08:40:10.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.338+0000 7f4377a87800 20 remove_watcher() i=5 2024-09-22T08:40:10.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.339+0000 7f4377a87800 20 remove_watcher() i=6 2024-09-22T08:40:10.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.340+0000 7f4377a87800 20 remove_watcher() i=7 2024-09-22T08:40:10.355 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-22T08:40:10.391 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:40:10.391 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:40:10.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.430+0000 7f0e14ab7800 20 rados->read ofs=0 len=0 2024-09-22T08:40:10.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.431+0000 7f0e14ab7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:10.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.431+0000 7f0e14ab7800 20 realm 2024-09-22T08:40:10.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.431+0000 7f0e14ab7800 20 rados->read ofs=0 len=0 2024-09-22T08:40:10.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.431+0000 7f0e14ab7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:10.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.431+0000 7f0e14ab7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:40:10.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.431+0000 7f0e14ab7800 20 rados->read ofs=0 len=0 2024-09-22T08:40:10.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.431+0000 7f0e14ab7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:10.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.431+0000 7f0e14ab7800 20 rados->read ofs=0 len=0 2024-09-22T08:40:10.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.432+0000 7f0e14ab7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:10.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.432+0000 7f0e14ab7800 20 rados->read ofs=0 len=0 2024-09-22T08:40:10.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.433+0000 7f0e14ab7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:40:10.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.433+0000 7f0e14ab7800 20 searching for the correct realm 2024-09-22T08:40:10.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.435+0000 7f0e12da2640 0 -- 172.21.15.38:0/1656852061 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7f0e0402c040 msgr2=0x7f0e0402d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:40:10.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.641+0000 7f0e125a1640 0 -- 172.21.15.38:0/1656852061 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x556a36cabf40 msgr2=0x556a36cae3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:40:10.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.645+0000 7f0e14ab7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:40:10.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.645+0000 7f0e14ab7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:40:10.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.645+0000 7f0e14ab7800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:40:10.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.645+0000 7f0e14ab7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:40:10.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.645+0000 7f0e14ab7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:40:10.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.645+0000 7f0e14ab7800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:40:10.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.645+0000 7f0e14ab7800 20 rados->read ofs=0 len=0 2024-09-22T08:40:10.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.646+0000 7f0e14ab7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:10.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.646+0000 7f0e14ab7800 20 rados->read ofs=0 len=0 2024-09-22T08:40:10.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.646+0000 7f0e14ab7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:10.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.646+0000 7f0e14ab7800 20 rados->read ofs=0 len=0 2024-09-22T08:40:10.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.647+0000 7f0e14ab7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:40:10.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.647+0000 7f0e14ab7800 20 zone default found 2024-09-22T08:40:10.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.647+0000 7f0e14ab7800 4 Realm: () 2024-09-22T08:40:10.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.647+0000 7f0e14ab7800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:40:10.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.647+0000 7f0e14ab7800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:40:10.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.647+0000 7f0e14ab7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:40:10.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.647+0000 7f0e14ab7800 20 zonegroup default 2024-09-22T08:40:10.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.647+0000 7f0e14ab7800 20 rados->read ofs=0 len=0 2024-09-22T08:40:10.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.647+0000 7f0e14ab7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:10.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.647+0000 7f0e14ab7800 20 rados->read ofs=0 len=0 2024-09-22T08:40:10.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.648+0000 7f0e14ab7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:10.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.648+0000 7f0e14ab7800 20 rados->read ofs=0 len=0 2024-09-22T08:40:10.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.648+0000 7f0e14ab7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:10.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.648+0000 7f0e14ab7800 20 started sync module instance, tier type = 2024-09-22T08:40:10.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.648+0000 7f0e14ab7800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:40:10.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.658+0000 7f0e14ab7800 20 add_watcher() i=0 2024-09-22T08:40:10.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.658+0000 7f0e14ab7800 20 add_watcher() i=1 2024-09-22T08:40:10.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.658+0000 7f0e14ab7800 20 add_watcher() i=2 2024-09-22T08:40:10.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.658+0000 7f0e14ab7800 20 add_watcher() i=3 2024-09-22T08:40:10.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.658+0000 7f0e14ab7800 20 add_watcher() i=4 2024-09-22T08:40:10.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.658+0000 7f0e14ab7800 20 add_watcher() i=5 2024-09-22T08:40:10.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.658+0000 7f0e14ab7800 20 add_watcher() i=6 2024-09-22T08:40:10.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.659+0000 7f0e14ab7800 20 add_watcher() i=7 2024-09-22T08:40:10.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.659+0000 7f0e14ab7800 2 all 8 watchers are set, enabling cache 2024-09-22T08:40:10.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.662+0000 7f0cc97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:10.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.662+0000 7f0e14ab7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:40:10.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.662+0000 7f0e14ab7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:40:10.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.662+0000 7f0e14ab7800 5 note: GC not initialized 2024-09-22T08:40:10.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.662+0000 7f0cc37fe640 20 reqs_thread_entry: start 2024-09-22T08:40:10.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.662+0000 7f0e14ab7800 20 init_complete bucket index max shards: 11 2024-09-22T08:40:10.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.662+0000 7f0e14ab7800 20 Filter name: none 2024-09-22T08:40:10.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.662+0000 7f0cc17fa640 20 reqs_thread_entry: start 2024-09-22T08:40:10.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.662+0000 7f0e14ab7800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-22T08:40:10.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.663+0000 7f0e14ab7800 20 rados->read ofs=0 len=0 2024-09-22T08:40:10.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.663+0000 7f0e14ab7800 20 rados_obj.operate() r=0 bl.length=173 2024-09-22T08:40:10.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.663+0000 7f0e14ab7800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-22T08:40:10.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.663+0000 7f0e14ab7800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-22T08:40:10.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.663+0000 7f0e14ab7800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 : miss 2024-09-22T08:40:10.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.663+0000 7f0e14ab7800 20 rados->read ofs=0 len=0 2024-09-22T08:40:10.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.664+0000 7f0e14ab7800 20 rados_obj.operate() r=0 bl.length=395 2024-09-22T08:40:10.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.664+0000 7f0e14ab7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 info.flags=0x17 2024-09-22T08:40:10.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.664+0000 7f0e14ab7800 10 adding default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 to cache LRU end 2024-09-22T08:40:10.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.664+0000 7f0e14ab7800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:40:10.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.664+0000 7f0e14ab7800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T08:40:10.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.664+0000 7f0e14ab7800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:c62f9d7b-f6b6-404a-90de-de5607499115.4584.18 2024-09-22T08:40:10.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.664+0000 7f0e14ab7800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.0 2024-09-22T08:40:10.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.664+0000 7f0e14ab7800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.0 2024-09-22T08:40:10.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.665+0000 7f0e14ab7800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-22T08:40:10.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.665+0000 7f0e14ab7800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.1 2024-09-22T08:40:10.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.665+0000 7f0e14ab7800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.1 2024-09-22T08:40:10.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.665+0000 7f0e14ab7800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-22T08:40:10.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.665+0000 7f0e14ab7800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.2 2024-09-22T08:40:10.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.665+0000 7f0e14ab7800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.2 2024-09-22T08:40:10.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.666+0000 7f0e14ab7800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-22T08:40:10.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.666+0000 7f0e14ab7800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.3 2024-09-22T08:40:10.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.666+0000 7f0e14ab7800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.3 2024-09-22T08:40:10.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.666+0000 7f0e14ab7800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-22T08:40:10.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.666+0000 7f0e14ab7800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.4 2024-09-22T08:40:10.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.666+0000 7f0e14ab7800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.4 2024-09-22T08:40:10.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.667+0000 7f0e14ab7800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-22T08:40:10.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.667+0000 7f0e14ab7800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.5 2024-09-22T08:40:10.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.667+0000 7f0e14ab7800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.5 2024-09-22T08:40:10.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.667+0000 7f0e14ab7800 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-22T08:40:10.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.667+0000 7f0e14ab7800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.6 2024-09-22T08:40:10.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.667+0000 7f0e14ab7800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.6 2024-09-22T08:40:10.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.668+0000 7f0e14ab7800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-22T08:40:10.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.668+0000 7f0e14ab7800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.7 2024-09-22T08:40:10.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.668+0000 7f0e14ab7800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.7 2024-09-22T08:40:10.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.669+0000 7f0e14ab7800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-22T08:40:10.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.669+0000 7f0e14ab7800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.8 2024-09-22T08:40:10.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.669+0000 7f0e14ab7800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.8 2024-09-22T08:40:10.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.669+0000 7f0e14ab7800 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-22T08:40:10.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.669+0000 7f0e14ab7800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.9 2024-09-22T08:40:10.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.669+0000 7f0e14ab7800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.9 2024-09-22T08:40:10.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.670+0000 7f0e14ab7800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.10 2024-09-22T08:40:10.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.670+0000 7f0e14ab7800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.10 2024-09-22T08:40:10.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.670+0000 7f0e14ab7800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-22T08:40:10.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.670+0000 7f0e14ab7800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.11 2024-09-22T08:40:10.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.670+0000 7f0e14ab7800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.11 2024-09-22T08:40:10.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.671+0000 7f0e14ab7800 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-22T08:40:10.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.671+0000 7f0e14ab7800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.12 2024-09-22T08:40:10.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.671+0000 7f0e14ab7800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.12 2024-09-22T08:40:10.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.672+0000 7f0e14ab7800 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-22T08:40:10.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.672+0000 7f0e14ab7800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.13 2024-09-22T08:40:10.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.672+0000 7f0e14ab7800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.13 2024-09-22T08:40:10.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.672+0000 7f0e14ab7800 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-22T08:40:10.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.672+0000 7f0e14ab7800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.14 2024-09-22T08:40:10.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.672+0000 7f0e14ab7800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.14 2024-09-22T08:40:10.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.673+0000 7f0e14ab7800 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-22T08:40:10.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.673+0000 7f0e14ab7800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.15 2024-09-22T08:40:10.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.673+0000 7f0e14ab7800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.15 2024-09-22T08:40:10.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.673+0000 7f0e14ab7800 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-22T08:40:10.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.673+0000 7f0e14ab7800 10 bucket_obj is .dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.16 2024-09-22T08:40:10.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.673+0000 7f0e14ab7800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.16 2024-09-22T08:40:10.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.674+0000 7f0e14ab7800 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-22T08:40:10.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.674+0000 7f0e14ab7800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.9 2024-09-22T08:40:10.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.675+0000 7f0e14ab7800 20 get_obj_state: octx=0x556a36a1f0f0 obj=myver:x state=0x556a36ceb858 s->prefetch_data=0 2024-09-22T08:40:10.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.675+0000 7f0e14ab7800 20 get_obj_state: setting s->obj_tag to 45t1i034men6s5sjhipo4o8zmbq75jjs 2024-09-22T08:40:10.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.675+0000 7f0e14ab7800 20 get_obj_state_impl: setting s->olh_tag to 0tmw9zmysaiw2ora3ufw5scenqbaygvn 2024-09-22T08:40:10.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.675+0000 7f0e14ab7800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=0tmw9zmysaiw2ora3ufw5scenqbaygvn 2024-09-22T08:40:10.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.677+0000 7f0e14ab7800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.9 2024-09-22T08:40:10.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.678+0000 7f0e14ab7800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.9 2024-09-22T08:40:10.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.679+0000 7f0e14ab7800 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-22T08:40:10.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.679+0000 7f0e14ab7800 20 olh_log_entry: epoch=2 op=3 key=x[r0UNsq4kukOTIvXl6KplX7sC7DBlWGq] 2024-09-22T08:40:10.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.679+0000 7f0e14ab7800 20 get_obj_state: octx=0x556a36a1f0f0 obj=myver:_:r0UNsq4kukOTIvXl6KplX7sC7DBlWGq_x state=0x556a36ceab08 s->prefetch_data=0 2024-09-22T08:40:10.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.679+0000 7f0e14ab7800 10 manifest: total_size = 12 2024-09-22T08:40:10.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.679+0000 7f0e14ab7800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.12178424188980718189 2024-09-22T08:40:10.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.679+0000 7f0e14ab7800 20 get_obj_state: octx=0x556a36a1f0f0 obj=myver:_:r0UNsq4kukOTIvXl6KplX7sC7DBlWGq_x state=0x556a36ceab08 s->prefetch_data=0 2024-09-22T08:40:10.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.679+0000 7f0e14ab7800 20 prepare_atomic_modification: state is not atomic. state=0x556a36ceab08 2024-09-22T08:40:10.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.679+0000 7f0e14ab7800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.9 2024-09-22T08:40:10.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.684+0000 7f0cf57fa640 20 handle_completion(): completion ok for obj=x[r0UNsq4kukOTIvXl6KplX7sC7DBlWGq] 2024-09-22T08:40:10.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.684+0000 7f0e14ab7800 20 get_obj_state: octx=0x556a36a1f0f0 obj=myver:x state=0x556a36ceb858 s->prefetch_data=0 2024-09-22T08:40:10.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.684+0000 7f0e14ab7800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=0tmw9zmysaiw2ora3ufw5scenqbaygvn 2024-09-22T08:40:10.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.687+0000 7f0e14ab7800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.9 2024-09-22T08:40:10.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.688+0000 7f0e14ab7800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.9 2024-09-22T08:40:10.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.688+0000 7f0e14ab7800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.9 2024-09-22T08:40:10.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.689+0000 7f0e14ab7800 20 get_obj_state: octx=0x556a36a1f0f0 obj=myver:y state=0x556a36ceb858 s->prefetch_data=0 2024-09-22T08:40:10.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.689+0000 7f0e14ab7800 20 get_obj_state: setting s->obj_tag to x7l33t322oll1z32prglecxa7ksng6um 2024-09-22T08:40:10.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.689+0000 7f0e14ab7800 20 get_obj_state_impl: setting s->olh_tag to rbtok107hrernrhdpeez2zznudd1ugy4 2024-09-22T08:40:10.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.689+0000 7f0e14ab7800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=rbtok107hrernrhdpeez2zznudd1ugy4 2024-09-22T08:40:10.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.690+0000 7f0e14ab7800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.9 2024-09-22T08:40:10.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.692+0000 7f0e14ab7800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.9 2024-09-22T08:40:10.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.692+0000 7f0e14ab7800 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-22T08:40:10.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.692+0000 7f0e14ab7800 20 olh_log_entry: epoch=2 op=3 key=y[GCjaoYBzBDH0aOPbN1nWlUOhE1pB0PC] 2024-09-22T08:40:10.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.692+0000 7f0e14ab7800 20 get_obj_state: octx=0x556a36a1f0f0 obj=myver:_:GCjaoYBzBDH0aOPbN1nWlUOhE1pB0PC_y state=0x556a36ce8ae8 s->prefetch_data=0 2024-09-22T08:40:10.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.693+0000 7f0e14ab7800 10 manifest: total_size = 12 2024-09-22T08:40:10.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.693+0000 7f0e14ab7800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.11826446470249450996 2024-09-22T08:40:10.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.693+0000 7f0e14ab7800 20 get_obj_state: octx=0x556a36a1f0f0 obj=myver:_:GCjaoYBzBDH0aOPbN1nWlUOhE1pB0PC_y state=0x556a36ce8ae8 s->prefetch_data=0 2024-09-22T08:40:10.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.693+0000 7f0e14ab7800 20 prepare_atomic_modification: state is not atomic. state=0x556a36ce8ae8 2024-09-22T08:40:10.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.693+0000 7f0e14ab7800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.9 2024-09-22T08:40:10.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.697+0000 7f0e14ab7800 20 get_obj_state: octx=0x556a36a1f0f0 obj=myver:y state=0x556a36ceb858 s->prefetch_data=0 2024-09-22T08:40:10.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.697+0000 7f0e14ab7800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=rbtok107hrernrhdpeez2zznudd1ugy4 2024-09-22T08:40:10.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.697+0000 7f0cf5ffb640 20 handle_completion(): completion ok for obj=y[GCjaoYBzBDH0aOPbN1nWlUOhE1pB0PC] 2024-09-22T08:40:10.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.699+0000 7f0e14ab7800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.9 2024-09-22T08:40:10.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.700+0000 7f0e14ab7800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.9 2024-09-22T08:40:10.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.701+0000 7f0e14ab7800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.9 2024-09-22T08:40:10.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.701+0000 7f0e14ab7800 20 get_obj_state: octx=0x556a36a1f0f0 obj=myver:z state=0x556a36d268c8 s->prefetch_data=0 2024-09-22T08:40:10.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.702+0000 7f0e14ab7800 20 get_obj_state: setting s->obj_tag to xnoikp0wpid5kxplf4a0meveql2hsm60 2024-09-22T08:40:10.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.702+0000 7f0e14ab7800 20 get_obj_state_impl: setting s->olh_tag to scw2hzm3ivjr74fx38hal5qmaae4wkjt 2024-09-22T08:40:10.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.702+0000 7f0e14ab7800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=scw2hzm3ivjr74fx38hal5qmaae4wkjt 2024-09-22T08:40:10.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.703+0000 7f0e14ab7800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.9 2024-09-22T08:40:10.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.705+0000 7f0e14ab7800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.9 2024-09-22T08:40:10.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.706+0000 7f0e14ab7800 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-22T08:40:10.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.706+0000 7f0e14ab7800 20 olh_log_entry: epoch=2 op=3 key=z[ez.GsgA-WP8J.1bWFwcwgt.VXdfJZyE] 2024-09-22T08:40:10.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.706+0000 7f0e14ab7800 20 get_obj_state: octx=0x556a36a1f0f0 obj=myver:_:ez.GsgA-WP8J.1bWFwcwgt.VXdfJZyE_z state=0x556a36cec868 s->prefetch_data=0 2024-09-22T08:40:10.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.706+0000 7f0e14ab7800 10 manifest: total_size = 9 2024-09-22T08:40:10.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.706+0000 7f0e14ab7800 20 get_obj_state: setting s->obj_tag to c62f9d7b-f6b6-404a-90de-de5607499115.4584.7877640098357362386 2024-09-22T08:40:10.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.706+0000 7f0e14ab7800 20 get_obj_state: octx=0x556a36a1f0f0 obj=myver:_:ez.GsgA-WP8J.1bWFwcwgt.VXdfJZyE_z state=0x556a36cec868 s->prefetch_data=0 2024-09-22T08:40:10.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.706+0000 7f0e14ab7800 20 prepare_atomic_modification: state is not atomic. state=0x556a36cec868 2024-09-22T08:40:10.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.706+0000 7f0e14ab7800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.9 2024-09-22T08:40:10.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.710+0000 7f0cf5ffb640 20 handle_completion(): completion ok for obj=z[ez.GsgA-WP8J.1bWFwcwgt.VXdfJZyE] 2024-09-22T08:40:10.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.710+0000 7f0e14ab7800 20 get_obj_state: octx=0x556a36a1f0f0 obj=myver:z state=0x556a36d268c8 s->prefetch_data=0 2024-09-22T08:40:10.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.710+0000 7f0e14ab7800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=scw2hzm3ivjr74fx38hal5qmaae4wkjt 2024-09-22T08:40:10.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.712+0000 7f0e14ab7800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.9 2024-09-22T08:40:10.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.714+0000 7f0e14ab7800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.18.3.9 2024-09-22T08:40:10.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.714+0000 7f0e14ab7800 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-22T08:40:10.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.714+0000 7f0e14ab7800 1 NOTICE: finished all shards (3 entries removed) 2024-09-22T08:40:10.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.715+0000 7f0cc97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:10.718 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.718+0000 7f0e14ab7800 20 remove_watcher() i=0 2024-09-22T08:40:10.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.718+0000 7f0e14ab7800 2 removed watcher, disabling cache 2024-09-22T08:40:10.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.719+0000 7f0e14ab7800 20 remove_watcher() i=1 2024-09-22T08:40:10.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.720+0000 7f0e14ab7800 20 remove_watcher() i=2 2024-09-22T08:40:10.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.721+0000 7f0e14ab7800 20 remove_watcher() i=3 2024-09-22T08:40:10.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.722+0000 7f0e14ab7800 20 remove_watcher() i=4 2024-09-22T08:40:10.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.723+0000 7f0e14ab7800 20 remove_watcher() i=5 2024-09-22T08:40:10.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.724+0000 7f0e14ab7800 20 remove_watcher() i=6 2024-09-22T08:40:10.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.726+0000 7f0e14ab7800 20 remove_watcher() i=7 2024-09-22T08:40:10.740 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:40:10.741 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:40:10.745 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:40:10.745 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:40:10.789 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket myver 2024-09-22T08:40:10.818 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:40:10.818 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:40:10.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.856+0000 7f0465820800 20 rados->read ofs=0 len=0 2024-09-22T08:40:10.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.858+0000 7f0465820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:10.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.858+0000 7f0465820800 20 realm 2024-09-22T08:40:10.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.858+0000 7f0465820800 20 rados->read ofs=0 len=0 2024-09-22T08:40:10.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.858+0000 7f0465820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:10.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.858+0000 7f0465820800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:40:10.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.858+0000 7f0465820800 20 rados->read ofs=0 len=0 2024-09-22T08:40:10.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.858+0000 7f0465820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:10.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.858+0000 7f0465820800 20 rados->read ofs=0 len=0 2024-09-22T08:40:10.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.859+0000 7f0465820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:10.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.859+0000 7f0465820800 20 rados->read ofs=0 len=0 2024-09-22T08:40:10.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.860+0000 7f0465820800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:40:10.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.860+0000 7f0465820800 20 searching for the correct realm 2024-09-22T08:40:10.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.862+0000 7f046330a640 0 -- 172.21.15.38:0/733350462 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x55f862a06f90 msgr2=0x55f862a09450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:40:10.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:10.866+0000 7f0462b09640 0 -- 172.21.15.38:0/733350462 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f045402c3c0 msgr2=0x7f045402c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:40:11.075 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.074+0000 7f0465820800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:40:11.075 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.074+0000 7f0465820800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:40:11.075 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.074+0000 7f0465820800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:40:11.075 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.074+0000 7f0465820800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:40:11.075 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.074+0000 7f0465820800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:40:11.075 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.074+0000 7f0465820800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:40:11.075 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.074+0000 7f0465820800 20 rados->read ofs=0 len=0 2024-09-22T08:40:11.075 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.074+0000 7f0465820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:11.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.074+0000 7f0465820800 20 rados->read ofs=0 len=0 2024-09-22T08:40:11.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.074+0000 7f0465820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:11.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.074+0000 7f0465820800 20 rados->read ofs=0 len=0 2024-09-22T08:40:11.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.075+0000 7f0465820800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:40:11.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.075+0000 7f0465820800 20 zone default found 2024-09-22T08:40:11.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.075+0000 7f0465820800 4 Realm: () 2024-09-22T08:40:11.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.075+0000 7f0465820800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:40:11.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.075+0000 7f0465820800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:40:11.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.075+0000 7f0465820800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:40:11.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.075+0000 7f0465820800 20 zonegroup default 2024-09-22T08:40:11.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.075+0000 7f0465820800 20 rados->read ofs=0 len=0 2024-09-22T08:40:11.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.075+0000 7f0465820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:11.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.075+0000 7f0465820800 20 rados->read ofs=0 len=0 2024-09-22T08:40:11.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.076+0000 7f0465820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:11.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.076+0000 7f0465820800 20 rados->read ofs=0 len=0 2024-09-22T08:40:11.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.076+0000 7f0465820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:11.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.076+0000 7f0465820800 20 started sync module instance, tier type = 2024-09-22T08:40:11.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.076+0000 7f0465820800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:40:11.086 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.085+0000 7f0465820800 20 add_watcher() i=0 2024-09-22T08:40:11.086 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.085+0000 7f0465820800 20 add_watcher() i=1 2024-09-22T08:40:11.086 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.085+0000 7f0465820800 20 add_watcher() i=2 2024-09-22T08:40:11.086 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.085+0000 7f0465820800 20 add_watcher() i=3 2024-09-22T08:40:11.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.085+0000 7f0465820800 20 add_watcher() i=4 2024-09-22T08:40:11.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.085+0000 7f0465820800 20 add_watcher() i=5 2024-09-22T08:40:11.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.085+0000 7f0465820800 20 add_watcher() i=6 2024-09-22T08:40:11.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.086+0000 7f0465820800 20 add_watcher() i=7 2024-09-22T08:40:11.088 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.087+0000 7f0465820800 2 all 8 watchers are set, enabling cache 2024-09-22T08:40:11.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.088+0000 7f0319fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:11.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.089+0000 7f0465820800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:40:11.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.089+0000 7f0465820800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:40:11.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.089+0000 7f0465820800 5 note: GC not initialized 2024-09-22T08:40:11.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.089+0000 7f0318fe1640 20 reqs_thread_entry: start 2024-09-22T08:40:11.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.089+0000 7f0465820800 20 init_complete bucket index max shards: 11 2024-09-22T08:40:11.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.089+0000 7f0465820800 20 Filter name: none 2024-09-22T08:40:11.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.089+0000 7f02927fc640 20 reqs_thread_entry: start 2024-09-22T08:40:11.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.089+0000 7f0465820800 20 rados->read ofs=0 len=0 2024-09-22T08:40:11.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.090+0000 7f0465820800 20 rados_obj.operate() r=0 bl.length=173 2024-09-22T08:40:11.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.090+0000 7f0465820800 20 rados->read ofs=0 len=0 2024-09-22T08:40:11.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.090+0000 7f0465820800 20 rados_obj.operate() r=0 bl.length=395 2024-09-22T08:40:11.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.090+0000 7f0465820800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:40:11.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.090+0000 7f0465820800 20 rados->read ofs=0 len=0 2024-09-22T08:40:11.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.091+0000 7f0465820800 20 rados_obj.operate() r=0 bl.length=173 2024-09-22T08:40:11.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.091+0000 7f0465820800 20 rados->read ofs=0 len=0 2024-09-22T08:40:11.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.091+0000 7f0465820800 20 rados_obj.operate() r=0 bl.length=395 2024-09-22T08:40:11.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.091+0000 7f0465820800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:40:11.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.094+0000 7f0319fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:11.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.096+0000 7f0465820800 20 remove_watcher() i=0 2024-09-22T08:40:11.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.096+0000 7f0465820800 2 removed watcher, disabling cache 2024-09-22T08:40:11.098 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.097+0000 7f0465820800 20 remove_watcher() i=1 2024-09-22T08:40:11.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.098+0000 7f0465820800 20 remove_watcher() i=2 2024-09-22T08:40:11.100 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.099+0000 7f0465820800 20 remove_watcher() i=3 2024-09-22T08:40:11.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.100+0000 7f0465820800 20 remove_watcher() i=4 2024-09-22T08:40:11.102 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.101+0000 7f0465820800 20 remove_watcher() i=5 2024-09-22T08:40:11.103 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.102+0000 7f0465820800 20 remove_watcher() i=6 2024-09-22T08:40:11.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:40:11.103+0000 7f0465820800 20 remove_watcher() i=7 2024-09-22T08:40:11.115 INFO:tasks.workunit.client.0.smithi038.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-22T08:40:11.115 INFO:tasks.workunit.client.0.smithi038.stderr:Deleting bucket a-bucket 2024-09-22T08:40:11.117 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:40:11.117 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:40:11.121 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:40:11.121 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:40:11.134 INFO:tasks.workunit.client.0.smithi038.stderr:Deleting bucket myver 2024-09-22T08:40:11.135 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:40:11.136 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:40:11.179 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:40:11.179 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:40:11.217 INFO:tasks.workunit.client.0.smithi038.stderr:Completed resharding tests 2024-09-22T08:40:11.217 INFO:tasks.workunit.client.0.smithi038.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-22T08:40:11.217 INFO:tasks.workunit.client.0.smithi038.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-22T08:40:11.217 INFO:tasks.workunit.client.0.smithi038.stdout:connected to https://localhost:443 2024-09-22T08:40:11.298 INFO:tasks.workunit.client.0.smithi038.stderr:+ deactivate 2024-09-22T08:40:11.298 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-22T08:40:11.298 INFO:tasks.workunit.client.0.smithi038.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-22T08:40:11.298 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-09-22T08:40:11.298 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-22T08:40:11.298 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -n '' ']' 2024-09-22T08:40:11.298 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-22T08:40:11.298 INFO:tasks.workunit.client.0.smithi038.stderr:+ hash -r 2024-09-22T08:40:11.298 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -n '' ']' 2024-09-22T08:40:11.298 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset VIRTUAL_ENV 2024-09-22T08:40:11.298 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-22T08:40:11.298 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset -f deactivate 2024-09-22T08:40:11.298 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo OK. 2024-09-22T08:40:11.299 INFO:tasks.workunit.client.0.smithi038.stdout:OK. 2024-09-22T08:40:11.300 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:40:11.300 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:40:11.380 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-22T08:40:11.380 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-22T08:40:11.814 DEBUG:teuthology.parallel:result is None 2024-09-22T08:40:11.815 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T08:40:11.854 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T08:40:11.854 DEBUG:teuthology.orchestra.run.smithi038:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-22T08:40:11.923 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T08:40:11.923 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-22T08:40:11.953 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-22T08:40:11.953 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-22T08:40:11.953 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-22T08:40:11.954 DEBUG:teuthology.orchestra.run.smithi038:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-22T08:40:11.994 INFO:teuthology.orchestra.run.smithi038.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-22T08:40:16.383 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-22T08:40:16.383 DEBUG:teuthology.orchestra.run.smithi038:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-22T08:40:18.519 INFO:teuthology.orchestra.run.smithi038.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required RPM packages. Installing via sudo. 2024-09-22T08:40:19.123 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:28:28 ago on Sun 22 Sep 2024 08:11:51 AM UTC. 2024-09-22T08:40:19.269 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-22T08:40:19.270 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-22T08:40:19.270 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2024-09-22T08:40:19.270 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-22T08:40:19.270 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-09-22T08:40:19.270 INFO:teuthology.orchestra.run.smithi038.stdout: java-1.8.0-openjdk x86_64 1:1.8.0.362.b09-4.el9 appstream 426 k 2024-09-22T08:40:19.270 INFO:teuthology.orchestra.run.smithi038.stdout: java-1.8.0-openjdk-devel x86_64 1:1.8.0.362.b09-4.el9 appstream 9.3 M 2024-09-22T08:40:19.270 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2024-09-22T08:40:19.270 INFO:teuthology.orchestra.run.smithi038.stdout: java-1.8.0-openjdk-headless x86_64 1:1.8.0.362.b09-4.el9 appstream 32 M 2024-09-22T08:40:19.271 INFO:teuthology.orchestra.run.smithi038.stdout:Installing weak dependencies: 2024-09-22T08:40:19.271 INFO:teuthology.orchestra.run.smithi038.stdout: gtk2 x86_64 2.24.33-8.el9 appstream 3.5 M 2024-09-22T08:40:19.271 INFO:teuthology.orchestra.run.smithi038.stdout: libcanberra-gtk2 x86_64 0.30-27.el9 appstream 26 k 2024-09-22T08:40:19.271 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:40:19.271 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-09-22T08:40:19.271 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-22T08:40:19.271 INFO:teuthology.orchestra.run.smithi038.stdout:Install 5 Packages 2024-09-22T08:40:19.271 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:40:19.271 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 46 M 2024-09-22T08:40:19.272 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 166 M 2024-09-22T08:40:19.272 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-09-22T08:40:19.443 INFO:teuthology.orchestra.run.smithi038.stdout:(1/5): java-1.8.0-openjdk-1.8.0.362.b09-4.el9.x 2.8 MB/s | 426 kB 00:00 2024-09-22T08:40:19.543 INFO:teuthology.orchestra.run.smithi038.stdout:(2/5): gtk2-2.24.33-8.el9.x86_64.rpm 14 MB/s | 3.5 MB 00:00 2024-09-22T08:40:19.593 INFO:teuthology.orchestra.run.smithi038.stdout:(3/5): libcanberra-gtk2-0.30-27.el9.x86_64.rpm 517 kB/s | 26 kB 00:00 2024-09-22T08:40:19.768 INFO:teuthology.orchestra.run.smithi038.stdout:(4/5): java-1.8.0-openjdk-devel-1.8.0.362.b09-4 20 MB/s | 9.3 MB 00:00 2024-09-22T08:40:20.385 INFO:teuthology.orchestra.run.smithi038.stdout:(5/5): java-1.8.0-openjdk-headless-1.8.0.362.b0 34 MB/s | 32 MB 00:00 2024-09-22T08:40:20.385 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:40:20.385 INFO:teuthology.orchestra.run.smithi038.stdout:Total 41 MB/s | 46 MB 00:01 2024-09-22T08:40:20.827 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-09-22T08:40:20.850 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-09-22T08:40:20.850 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-09-22T08:40:21.354 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-09-22T08:40:21.354 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-09-22T08:40:21.888 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 1/1 2024-09-22T08:40:22.043 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-09-22T08:40:22.247 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcanberra-gtk2-0.30-27.el9.x86_64 1/5 2024-09-22T08:40:22.903 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : gtk2-2.24.33-8.el9.x86_64 2/5 2024-09-22T08:40:22.946 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-22T08:40:23.199 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-22T08:40:23.230 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-22T08:40:23.473 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-22T08:40:23.510 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-22T08:40:23.518 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-22T08:40:23.528 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 5/5 2024-09-22T08:40:23.571 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 5/5 2024-09-22T08:40:26.763 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-22T08:40:26.763 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : gtk2-2.24.33-8.el9.x86_64 1/5 2024-09-22T08:40:26.763 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2/5 2024-09-22T08:40:26.763 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 3/5 2024-09-22T08:40:26.763 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 4/5 2024-09-22T08:40:27.165 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcanberra-gtk2-0.30-27.el9.x86_64 5/5 2024-09-22T08:40:27.165 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:40:27.166 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-09-22T08:40:27.166 INFO:teuthology.orchestra.run.smithi038.stdout: gtk2-2.24.33-8.el9.x86_64 2024-09-22T08:40:27.166 INFO:teuthology.orchestra.run.smithi038.stdout: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2024-09-22T08:40:27.166 INFO:teuthology.orchestra.run.smithi038.stdout: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_64 2024-09-22T08:40:27.166 INFO:teuthology.orchestra.run.smithi038.stdout: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x86_64 2024-09-22T08:40:27.166 INFO:teuthology.orchestra.run.smithi038.stdout: libcanberra-gtk2-0.30-27.el9.x86_64 2024-09-22T08:40:27.166 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:40:27.166 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-22T08:40:27.580 INFO:teuthology.orchestra.run.smithi038.stdout: Gradle will be installed under /opt/gradle 2024-09-22T08:40:27.660 INFO:teuthology.orchestra.run.smithi038.stderr:--2024-09-22 08:40:27-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-22T08:40:27.817 INFO:teuthology.orchestra.run.smithi038.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.73.101, 104.16.72.101, 2606:4700::6810:4865, ... 2024-09-22T08:40:27.830 INFO:teuthology.orchestra.run.smithi038.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.73.101|:443... connected. 2024-09-22T08:40:27.927 INFO:teuthology.orchestra.run.smithi038.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-22T08:40:27.928 INFO:teuthology.orchestra.run.smithi038.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-22T08:40:27.928 INFO:teuthology.orchestra.run.smithi038.stderr:--2024-09-22 08:40:27-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-22T08:40:27.928 INFO:teuthology.orchestra.run.smithi038.stderr:Resolving github.com (github.com)... 140.82.112.3 2024-09-22T08:40:27.936 INFO:teuthology.orchestra.run.smithi038.stderr:Connecting to github.com (github.com)|140.82.112.3|:443... connected. 2024-09-22T08:40:28.075 INFO:teuthology.orchestra.run.smithi038.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-22T08:40:28.076 INFO:teuthology.orchestra.run.smithi038.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240922%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240922T084028Z&X-Amz-Expires=300&X-Amz-Signature=9afe18ec46e584bee1889cf29bb4f1a50ef9565091aec171d7f9d11e0e8779f9&X-Amz-SignedHeaders=host&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-22T08:40:28.076 INFO:teuthology.orchestra.run.smithi038.stderr:--2024-09-22 08:40:28-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240922%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240922T084028Z&X-Amz-Expires=300&X-Amz-Signature=9afe18ec46e584bee1889cf29bb4f1a50ef9565091aec171d7f9d11e0e8779f9&X-Amz-SignedHeaders=host&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-22T08:40:28.113 INFO:teuthology.orchestra.run.smithi038.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.109.133, 185.199.108.133, 185.199.111.133, ... 2024-09-22T08:40:28.125 INFO:teuthology.orchestra.run.smithi038.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.109.133|:443... connected. 2024-09-22T08:40:28.204 INFO:teuthology.orchestra.run.smithi038.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-22T08:40:28.204 INFO:teuthology.orchestra.run.smithi038.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-22T08:40:28.204 INFO:teuthology.orchestra.run.smithi038.stderr:Saving to: ‘gradle-6.0.1-bin.zip’ 2024-09-22T08:40:28.205 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-09-22T08:40:28.228 INFO:teuthology.orchestra.run.smithi038.stderr: 0K .......... .......... .......... .......... .......... 0% 2.04M 45s 2024-09-22T08:40:28.231 INFO:teuthology.orchestra.run.smithi038.stderr: 50K .......... .......... .......... .......... .......... 0% 16.5M 25s 2024-09-22T08:40:28.239 INFO:teuthology.orchestra.run.smithi038.stderr: 100K .......... .......... .......... .......... .......... 0% 5.55M 22s 2024-09-22T08:40:28.243 INFO:teuthology.orchestra.run.smithi038.stderr: 150K .......... .......... .......... .......... .......... 0% 16.0M 18s 2024-09-22T08:40:28.244 INFO:teuthology.orchestra.run.smithi038.stderr: 200K .......... .......... .......... .......... .......... 0% 40.4M 15s 2024-09-22T08:40:28.251 INFO:teuthology.orchestra.run.smithi038.stderr: 250K .......... .......... .......... .......... .......... 0% 6.98M 15s 2024-09-22T08:40:28.252 INFO:teuthology.orchestra.run.smithi038.stderr: 300K .......... .......... .......... .......... .......... 0% 43.5M 13s 2024-09-22T08:40:28.254 INFO:teuthology.orchestra.run.smithi038.stderr: 350K .......... .......... .......... .......... .......... 0% 29.5M 12s 2024-09-22T08:40:28.256 INFO:teuthology.orchestra.run.smithi038.stderr: 400K .......... .......... .......... .......... .......... 0% 31.9M 11s 2024-09-22T08:40:28.256 INFO:teuthology.orchestra.run.smithi038.stderr: 450K .......... .......... .......... .......... .......... 0% 72.0M 10s 2024-09-22T08:40:28.258 INFO:teuthology.orchestra.run.smithi038.stderr: 500K .......... .......... .......... .......... .......... 0% 57.5M 9s 2024-09-22T08:40:28.258 INFO:teuthology.orchestra.run.smithi038.stderr: 550K .......... .......... .......... .......... .......... 0% 69.7M 8s 2024-09-22T08:40:29.756 INFO:teuthology.orchestra.run.smithi038.stderr: 600K .......... .......... .......... .......... .......... 0% 8.09M 8s 2024-09-22T08:40:29.756 INFO:teuthology.orchestra.run.smithi038.stderr: 650K .......... .......... .......... .......... .......... 0% 61.6M 8s 2024-09-22T08:40:29.756 INFO:teuthology.orchestra.run.smithi038.stderr: 700K .......... .......... .......... .......... .......... 0% 208M 7s 2024-09-22T08:40:29.756 INFO:teuthology.orchestra.run.smithi038.stderr: 750K .......... .......... .......... .......... .......... 0% 47.0M 7s 2024-09-22T08:40:29.756 INFO:teuthology.orchestra.run.smithi038.stderr: 800K .......... .......... .......... .......... .......... 0% 230M 7s 2024-09-22T08:40:29.756 INFO:teuthology.orchestra.run.smithi038.stderr: 850K .......... .......... .......... .......... .......... 0% 52.9M 6s 2024-09-22T08:40:29.756 INFO:teuthology.orchestra.run.smithi038.stderr: 900K .......... .......... .......... .......... .......... 1% 226M 6s 2024-09-22T08:40:29.756 INFO:teuthology.orchestra.run.smithi038.stderr: 950K .......... .......... .......... .......... .......... 1% 78.9M 6s 2024-09-22T08:40:29.756 INFO:teuthology.orchestra.run.smithi038.stderr: 1000K .......... .......... .......... .......... .......... 1% 75.1M 6s 2024-09-22T08:40:29.756 INFO:teuthology.orchestra.run.smithi038.stderr: 1050K .......... .......... .......... .......... .......... 1% 171M 5s 2024-09-22T08:40:29.756 INFO:teuthology.orchestra.run.smithi038.stderr: 1100K .......... .......... .......... .......... .......... 1% 87.5M 5s 2024-09-22T08:40:29.756 INFO:teuthology.orchestra.run.smithi038.stderr: 1150K .......... .......... .......... .......... .......... 1% 225M 5s 2024-09-22T08:40:29.757 INFO:teuthology.orchestra.run.smithi038.stderr: 1200K .......... .......... .......... .......... .......... 1% 9.95M 5s 2024-09-22T08:40:29.757 INFO:teuthology.orchestra.run.smithi038.stderr: 1250K .......... .......... .......... .......... .......... 1% 58.5M 5s 2024-09-22T08:40:29.757 INFO:teuthology.orchestra.run.smithi038.stderr: 1300K .......... .......... .......... .......... .......... 1% 198M 5s 2024-09-22T08:40:29.757 INFO:teuthology.orchestra.run.smithi038.stderr: 1350K .......... .......... .......... .......... .......... 1% 101M 5s 2024-09-22T08:40:29.757 INFO:teuthology.orchestra.run.smithi038.stderr: 1400K .......... .......... .......... .......... .......... 1% 264M 5s 2024-09-22T08:40:29.757 INFO:teuthology.orchestra.run.smithi038.stderr: 1450K .......... .......... .......... .......... .......... 1% 110M 4s 2024-09-22T08:40:29.757 INFO:teuthology.orchestra.run.smithi038.stderr: 1500K .......... .......... .......... .......... .......... 1% 109M 4s 2024-09-22T08:40:29.757 INFO:teuthology.orchestra.run.smithi038.stderr: 1550K .......... .......... .......... .......... .......... 1% 151M 4s 2024-09-22T08:40:29.757 INFO:teuthology.orchestra.run.smithi038.stderr: 1600K .......... .......... .......... .......... .......... 1% 235M 4s 2024-09-22T08:40:29.757 INFO:teuthology.orchestra.run.smithi038.stderr: 1650K .......... .......... .......... .......... .......... 1% 125M 4s 2024-09-22T08:40:29.757 INFO:teuthology.orchestra.run.smithi038.stderr: 1700K .......... .......... .......... .......... .......... 1% 140M 4s 2024-09-22T08:40:29.757 INFO:teuthology.orchestra.run.smithi038.stderr: 1750K .......... .......... .......... .......... .......... 1% 131M 4s 2024-09-22T08:40:29.757 INFO:teuthology.orchestra.run.smithi038.stderr: 1800K .......... .......... .......... .......... .......... 1% 152M 4s 2024-09-22T08:40:29.757 INFO:teuthology.orchestra.run.smithi038.stderr: 1850K .......... .......... .......... .......... .......... 2% 281M 4s 2024-09-22T08:40:29.758 INFO:teuthology.orchestra.run.smithi038.stderr: 1900K .......... .......... .......... .......... .......... 2% 106M 4s 2024-09-22T08:40:29.758 INFO:teuthology.orchestra.run.smithi038.stderr: 1950K .......... .......... .......... .......... .......... 2% 172M 3s 2024-09-22T08:40:29.758 INFO:teuthology.orchestra.run.smithi038.stderr: 2000K .......... .......... .......... .......... .......... 2% 263M 3s 2024-09-22T08:40:29.758 INFO:teuthology.orchestra.run.smithi038.stderr: 2050K .......... .......... .......... .......... .......... 2% 273M 3s 2024-09-22T08:40:29.758 INFO:teuthology.orchestra.run.smithi038.stderr: 2100K .......... .......... .......... .......... .......... 2% 153M 3s 2024-09-22T08:40:29.758 INFO:teuthology.orchestra.run.smithi038.stderr: 2150K .......... .......... .......... .......... .......... 2% 161M 3s 2024-09-22T08:40:29.758 INFO:teuthology.orchestra.run.smithi038.stderr: 2200K .......... .......... .......... .......... .......... 2% 193M 3s 2024-09-22T08:40:29.758 INFO:teuthology.orchestra.run.smithi038.stderr: 2250K .......... .......... .......... .......... .......... 2% 199M 3s 2024-09-22T08:40:29.758 INFO:teuthology.orchestra.run.smithi038.stderr: 2300K .......... .......... .......... .......... .......... 2% 204M 3s 2024-09-22T08:40:29.758 INFO:teuthology.orchestra.run.smithi038.stderr: 2350K .......... .......... .......... .......... .......... 2% 212M 3s 2024-09-22T08:40:29.758 INFO:teuthology.orchestra.run.smithi038.stderr: 2400K .......... .......... .......... .......... .......... 2% 12.5M 3s 2024-09-22T08:40:29.758 INFO:teuthology.orchestra.run.smithi038.stderr: 2450K .......... .......... .......... .......... .......... 2% 263M 3s 2024-09-22T08:40:29.758 INFO:teuthology.orchestra.run.smithi038.stderr: 2500K .......... .......... .......... .......... .......... 2% 57.4M 3s 2024-09-22T08:40:29.758 INFO:teuthology.orchestra.run.smithi038.stderr: 2550K .......... .......... .......... .......... .......... 2% 223M 3s 2024-09-22T08:40:29.758 INFO:teuthology.orchestra.run.smithi038.stderr: 2600K .......... .......... .......... .......... .......... 2% 293M 3s 2024-09-22T08:40:29.759 INFO:teuthology.orchestra.run.smithi038.stderr: 2650K .......... .......... .......... .......... .......... 2% 250M 3s 2024-09-22T08:40:29.759 INFO:teuthology.orchestra.run.smithi038.stderr: 2700K .......... .......... .......... .......... .......... 2% 289M 3s 2024-09-22T08:40:29.759 INFO:teuthology.orchestra.run.smithi038.stderr: 2750K .......... .......... .......... .......... .......... 3% 208M 3s 2024-09-22T08:40:29.759 INFO:teuthology.orchestra.run.smithi038.stderr: 2800K .......... .......... .......... .......... .......... 3% 275M 3s 2024-09-22T08:40:29.759 INFO:teuthology.orchestra.run.smithi038.stderr: 2850K .......... .......... .......... .......... .......... 3% 252M 3s 2024-09-22T08:40:29.759 INFO:teuthology.orchestra.run.smithi038.stderr: 2900K .......... .......... .......... .......... .......... 3% 282M 3s 2024-09-22T08:40:29.759 INFO:teuthology.orchestra.run.smithi038.stderr: 2950K .......... .......... .......... .......... .......... 3% 229M 3s 2024-09-22T08:40:29.759 INFO:teuthology.orchestra.run.smithi038.stderr: 3000K .......... .......... .......... .......... .......... 3% 257M 2s 2024-09-22T08:40:29.759 INFO:teuthology.orchestra.run.smithi038.stderr: 3050K .......... .......... .......... .......... .......... 3% 184M 2s 2024-09-22T08:40:29.759 INFO:teuthology.orchestra.run.smithi038.stderr: 3100K .......... .......... .......... .......... .......... 3% 247M 2s 2024-09-22T08:40:29.759 INFO:teuthology.orchestra.run.smithi038.stderr: 3150K .......... .......... .......... .......... .......... 3% 215M 2s 2024-09-22T08:40:29.759 INFO:teuthology.orchestra.run.smithi038.stderr: 3200K .......... .......... .......... .......... .......... 3% 250M 2s 2024-09-22T08:40:29.759 INFO:teuthology.orchestra.run.smithi038.stderr: 3250K .......... .......... .......... .......... .......... 3% 250M 2s 2024-09-22T08:40:29.759 INFO:teuthology.orchestra.run.smithi038.stderr: 3300K .......... .......... .......... .......... .......... 3% 255M 2s 2024-09-22T08:40:29.760 INFO:teuthology.orchestra.run.smithi038.stderr: 3350K .......... .......... .......... .......... .......... 3% 240M 2s 2024-09-22T08:40:29.760 INFO:teuthology.orchestra.run.smithi038.stderr: 3400K .......... .......... .......... .......... .......... 3% 271M 2s 2024-09-22T08:40:29.760 INFO:teuthology.orchestra.run.smithi038.stderr: 3450K .......... .......... .......... .......... .......... 3% 288M 2s 2024-09-22T08:40:29.760 INFO:teuthology.orchestra.run.smithi038.stderr: 3500K .......... .......... .......... .......... .......... 3% 284M 2s 2024-09-22T08:40:29.760 INFO:teuthology.orchestra.run.smithi038.stderr: 3550K .......... .......... .......... .......... .......... 3% 268M 2s 2024-09-22T08:40:29.760 INFO:teuthology.orchestra.run.smithi038.stderr: 3600K .......... .......... .......... .......... .......... 3% 309M 2s 2024-09-22T08:40:29.760 INFO:teuthology.orchestra.run.smithi038.stderr: 3650K .......... .......... .......... .......... .......... 3% 278M 2s 2024-09-22T08:40:29.760 INFO:teuthology.orchestra.run.smithi038.stderr: 3700K .......... .......... .......... .......... .......... 4% 322M 2s 2024-09-22T08:40:29.760 INFO:teuthology.orchestra.run.smithi038.stderr: 3750K .......... .......... .......... .......... .......... 4% 259M 2s 2024-09-22T08:40:29.760 INFO:teuthology.orchestra.run.smithi038.stderr: 3800K .......... .......... .......... .......... .......... 4% 328M 2s 2024-09-22T08:40:29.760 INFO:teuthology.orchestra.run.smithi038.stderr: 3850K .......... .......... .......... .......... .......... 4% 277M 2s 2024-09-22T08:40:29.760 INFO:teuthology.orchestra.run.smithi038.stderr: 3900K .......... .......... .......... .......... .......... 4% 304M 2s 2024-09-22T08:40:29.760 INFO:teuthology.orchestra.run.smithi038.stderr: 3950K .......... .......... .......... .......... .......... 4% 273M 2s 2024-09-22T08:40:29.760 INFO:teuthology.orchestra.run.smithi038.stderr: 4000K .......... .......... .......... .......... .......... 4% 320M 2s 2024-09-22T08:40:29.760 INFO:teuthology.orchestra.run.smithi038.stderr: 4050K .......... .......... .......... .......... .......... 4% 329M 2s 2024-09-22T08:40:29.761 INFO:teuthology.orchestra.run.smithi038.stderr: 4100K .......... .......... .......... .......... .......... 4% 304M 2s 2024-09-22T08:40:29.761 INFO:teuthology.orchestra.run.smithi038.stderr: 4150K .......... .......... .......... .......... .......... 4% 263M 2s 2024-09-22T08:40:29.761 INFO:teuthology.orchestra.run.smithi038.stderr: 4200K .......... .......... .......... .......... .......... 4% 270M 2s 2024-09-22T08:40:29.761 INFO:teuthology.orchestra.run.smithi038.stderr: 4250K .......... .......... .......... .......... .......... 4% 304M 2s 2024-09-22T08:40:29.761 INFO:teuthology.orchestra.run.smithi038.stderr: 4300K .......... .......... .......... .......... .......... 4% 302M 2s 2024-09-22T08:40:29.761 INFO:teuthology.orchestra.run.smithi038.stderr: 4350K .......... .......... .......... .......... .......... 4% 266M 2s 2024-09-22T08:40:29.761 INFO:teuthology.orchestra.run.smithi038.stderr: 4400K .......... .......... .......... .......... .......... 4% 325M 2s 2024-09-22T08:40:29.761 INFO:teuthology.orchestra.run.smithi038.stderr: 4450K .......... .......... .......... .......... .......... 4% 320M 2s 2024-09-22T08:40:29.761 INFO:teuthology.orchestra.run.smithi038.stderr: 4500K .......... .......... .......... .......... .......... 4% 309M 2s 2024-09-22T08:40:29.761 INFO:teuthology.orchestra.run.smithi038.stderr: 4550K .......... .......... .......... .......... .......... 4% 282M 2s 2024-09-22T08:40:29.761 INFO:teuthology.orchestra.run.smithi038.stderr: 4600K .......... .......... .......... .......... .......... 5% 326M 2s 2024-09-22T08:40:29.761 INFO:teuthology.orchestra.run.smithi038.stderr: 4650K .......... .......... .......... .......... .......... 5% 332M 2s 2024-09-22T08:40:29.761 INFO:teuthology.orchestra.run.smithi038.stderr: 4700K .......... .......... .......... .......... .......... 5% 307M 2s 2024-09-22T08:40:29.761 INFO:teuthology.orchestra.run.smithi038.stderr: 4750K .......... .......... .......... .......... .......... 5% 264M 2s 2024-09-22T08:40:29.761 INFO:teuthology.orchestra.run.smithi038.stderr: 4800K .......... .......... .......... .......... .......... 5% 20.3M 2s 2024-09-22T08:40:29.761 INFO:teuthology.orchestra.run.smithi038.stderr: 4850K .......... .......... .......... .......... .......... 5% 262M 2s 2024-09-22T08:40:29.761 INFO:teuthology.orchestra.run.smithi038.stderr: 4900K .......... .......... .......... .......... .......... 5% 302M 2s 2024-09-22T08:40:29.762 INFO:teuthology.orchestra.run.smithi038.stderr: 4950K .......... .......... .......... .......... .......... 5% 273M 2s 2024-09-22T08:40:29.762 INFO:teuthology.orchestra.run.smithi038.stderr: 5000K .......... .......... .......... .......... .......... 5% 312M 2s 2024-09-22T08:40:29.762 INFO:teuthology.orchestra.run.smithi038.stderr: 5050K .......... .......... .......... .......... .......... 5% 128M 2s 2024-09-22T08:40:29.762 INFO:teuthology.orchestra.run.smithi038.stderr: 5100K .......... .......... .......... .......... .......... 5% 286M 2s 2024-09-22T08:40:29.762 INFO:teuthology.orchestra.run.smithi038.stderr: 5150K .......... .......... .......... .......... .......... 5% 276M 2s 2024-09-22T08:40:29.762 INFO:teuthology.orchestra.run.smithi038.stderr: 5200K .......... .......... .......... .......... .......... 5% 316M 2s 2024-09-22T08:40:29.762 INFO:teuthology.orchestra.run.smithi038.stderr: 5250K .......... .......... .......... .......... .......... 5% 291M 2s 2024-09-22T08:40:29.762 INFO:teuthology.orchestra.run.smithi038.stderr: 5300K .......... .......... .......... .......... .......... 5% 294M 2s 2024-09-22T08:40:29.762 INFO:teuthology.orchestra.run.smithi038.stderr: 5350K .......... .......... .......... .......... .......... 5% 245M 2s 2024-09-22T08:40:29.762 INFO:teuthology.orchestra.run.smithi038.stderr: 5400K .......... .......... .......... .......... .......... 5% 304M 2s 2024-09-22T08:40:29.762 INFO:teuthology.orchestra.run.smithi038.stderr: 5450K .......... .......... .......... .......... .......... 5% 303M 2s 2024-09-22T08:40:29.762 INFO:teuthology.orchestra.run.smithi038.stderr: 5500K .......... .......... .......... .......... .......... 5% 303M 2s 2024-09-22T08:40:29.762 INFO:teuthology.orchestra.run.smithi038.stderr: 5550K .......... .......... .......... .......... .......... 6% 240M 1s 2024-09-22T08:40:29.762 INFO:teuthology.orchestra.run.smithi038.stderr: 5600K .......... .......... .......... .......... .......... 6% 324M 1s 2024-09-22T08:40:29.762 INFO:teuthology.orchestra.run.smithi038.stderr: 5650K .......... .......... .......... .......... .......... 6% 321M 1s 2024-09-22T08:40:29.763 INFO:teuthology.orchestra.run.smithi038.stderr: 5700K .......... .......... .......... .......... .......... 6% 305M 1s 2024-09-22T08:40:29.763 INFO:teuthology.orchestra.run.smithi038.stderr: 5750K .......... .......... .......... .......... .......... 6% 238M 1s 2024-09-22T08:40:29.763 INFO:teuthology.orchestra.run.smithi038.stderr: 5800K .......... .......... .......... .......... .......... 6% 315M 1s 2024-09-22T08:40:29.763 INFO:teuthology.orchestra.run.smithi038.stderr: 5850K .......... .......... .......... .......... .......... 6% 293M 1s 2024-09-22T08:40:29.763 INFO:teuthology.orchestra.run.smithi038.stderr: 5900K .......... .......... .......... .......... .......... 6% 312M 1s 2024-09-22T08:40:29.763 INFO:teuthology.orchestra.run.smithi038.stderr: 5950K .......... .......... .......... .......... .......... 6% 308M 1s 2024-09-22T08:40:29.763 INFO:teuthology.orchestra.run.smithi038.stderr: 6000K .......... .......... .......... .......... .......... 6% 315M 1s 2024-09-22T08:40:29.763 INFO:teuthology.orchestra.run.smithi038.stderr: 6050K .......... .......... .......... .......... .......... 6% 326M 1s 2024-09-22T08:40:29.763 INFO:teuthology.orchestra.run.smithi038.stderr: 6100K .......... .......... .......... .......... .......... 6% 309M 1s 2024-09-22T08:40:29.763 INFO:teuthology.orchestra.run.smithi038.stderr: 6150K .......... .......... .......... .......... .......... 6% 259M 1s 2024-09-22T08:40:29.763 INFO:teuthology.orchestra.run.smithi038.stderr: 6200K .......... .......... .......... .......... .......... 6% 312M 1s 2024-09-22T08:40:29.763 INFO:teuthology.orchestra.run.smithi038.stderr: 6250K .......... .......... .......... .......... .......... 6% 313M 1s 2024-09-22T08:40:29.763 INFO:teuthology.orchestra.run.smithi038.stderr: 6300K .......... .......... .......... .......... .......... 6% 315M 1s 2024-09-22T08:40:29.763 INFO:teuthology.orchestra.run.smithi038.stderr: 6350K .......... .......... .......... .......... .......... 6% 270M 1s 2024-09-22T08:40:29.764 INFO:teuthology.orchestra.run.smithi038.stderr: 6400K .......... .......... .......... .......... .......... 6% 299M 1s 2024-09-22T08:40:29.764 INFO:teuthology.orchestra.run.smithi038.stderr: 6450K .......... .......... .......... .......... .......... 6% 287M 1s 2024-09-22T08:40:29.764 INFO:teuthology.orchestra.run.smithi038.stderr: 6500K .......... .......... .......... .......... .......... 7% 272M 1s 2024-09-22T08:40:29.764 INFO:teuthology.orchestra.run.smithi038.stderr: 6550K .......... .......... .......... .......... .......... 7% 261M 1s 2024-09-22T08:40:29.764 INFO:teuthology.orchestra.run.smithi038.stderr: 6600K .......... .......... .......... .......... .......... 7% 317M 1s 2024-09-22T08:40:29.764 INFO:teuthology.orchestra.run.smithi038.stderr: 6650K .......... .......... .......... .......... .......... 7% 308M 1s 2024-09-22T08:40:29.764 INFO:teuthology.orchestra.run.smithi038.stderr: 6700K .......... .......... .......... .......... .......... 7% 308M 1s 2024-09-22T08:40:29.764 INFO:teuthology.orchestra.run.smithi038.stderr: 6750K .......... .......... .......... .......... .......... 7% 265M 1s 2024-09-22T08:40:29.765 INFO:teuthology.orchestra.run.smithi038.stderr: 6800K .......... .......... .......... .......... .......... 7% 309M 1s 2024-09-22T08:40:29.765 INFO:teuthology.orchestra.run.smithi038.stderr: 6850K .......... .......... .......... .......... .......... 7% 303M 1s 2024-09-22T08:40:29.766 INFO:teuthology.orchestra.run.smithi038.stderr: 6900K .......... .......... .......... .......... .......... 7% 288M 1s 2024-09-22T08:40:29.766 INFO:teuthology.orchestra.run.smithi038.stderr: 6950K .......... .......... .......... .......... .......... 7% 259M 1s 2024-09-22T08:40:29.766 INFO:teuthology.orchestra.run.smithi038.stderr: 7000K .......... .......... .......... .......... .......... 7% 320M 1s 2024-09-22T08:40:29.766 INFO:teuthology.orchestra.run.smithi038.stderr: 7050K .......... .......... .......... .......... .......... 7% 304M 1s 2024-09-22T08:40:29.766 INFO:teuthology.orchestra.run.smithi038.stderr: 7100K .......... .......... .......... .......... .......... 7% 321M 1s 2024-09-22T08:40:29.766 INFO:teuthology.orchestra.run.smithi038.stderr: 7150K .......... .......... .......... .......... .......... 7% 274M 1s 2024-09-22T08:40:29.766 INFO:teuthology.orchestra.run.smithi038.stderr: 7200K .......... .......... .......... .......... .......... 7% 322M 1s 2024-09-22T08:40:29.766 INFO:teuthology.orchestra.run.smithi038.stderr: 7250K .......... .......... .......... .......... .......... 7% 325M 1s 2024-09-22T08:40:29.766 INFO:teuthology.orchestra.run.smithi038.stderr: 7300K .......... .......... .......... .......... .......... 7% 333M 1s 2024-09-22T08:40:29.766 INFO:teuthology.orchestra.run.smithi038.stderr: 7350K .......... .......... .......... .......... .......... 7% 297M 1s 2024-09-22T08:40:29.766 INFO:teuthology.orchestra.run.smithi038.stderr: 7400K .......... .......... .......... .......... .......... 8% 347M 1s 2024-09-22T08:40:29.766 INFO:teuthology.orchestra.run.smithi038.stderr: 7450K .......... .......... .......... .......... .......... 8% 336M 1s 2024-09-22T08:40:29.766 INFO:teuthology.orchestra.run.smithi038.stderr: 7500K .......... .......... .......... .......... .......... 8% 346M 1s 2024-09-22T08:40:29.767 INFO:teuthology.orchestra.run.smithi038.stderr: 7550K .......... .......... .......... .......... .......... 8% 279M 1s 2024-09-22T08:40:29.767 INFO:teuthology.orchestra.run.smithi038.stderr: 7600K .......... .......... .......... .......... .......... 8% 30.5M 1s 2024-09-22T08:40:29.767 INFO:teuthology.orchestra.run.smithi038.stderr: 7650K .......... .......... .......... .......... .......... 8% 74.2M 1s 2024-09-22T08:40:29.767 INFO:teuthology.orchestra.run.smithi038.stderr: 7700K .......... .......... .......... .......... .......... 8% 261M 1s 2024-09-22T08:40:29.767 INFO:teuthology.orchestra.run.smithi038.stderr: 7750K .......... .......... .......... .......... .......... 8% 206M 1s 2024-09-22T08:40:29.767 INFO:teuthology.orchestra.run.smithi038.stderr: 7800K .......... .......... .......... .......... .......... 8% 313M 1s 2024-09-22T08:40:29.767 INFO:teuthology.orchestra.run.smithi038.stderr: 7850K .......... .......... .......... .......... .......... 8% 324M 1s 2024-09-22T08:40:29.767 INFO:teuthology.orchestra.run.smithi038.stderr: 7900K .......... .......... .......... .......... .......... 8% 341M 1s 2024-09-22T08:40:29.767 INFO:teuthology.orchestra.run.smithi038.stderr: 7950K .......... .......... .......... .......... .......... 8% 240M 1s 2024-09-22T08:40:29.767 INFO:teuthology.orchestra.run.smithi038.stderr: 8000K .......... .......... .......... .......... .......... 8% 301M 1s 2024-09-22T08:40:29.767 INFO:teuthology.orchestra.run.smithi038.stderr: 8050K .......... .......... .......... .......... .......... 8% 319M 1s 2024-09-22T08:40:29.767 INFO:teuthology.orchestra.run.smithi038.stderr: 8100K .......... .......... .......... .......... .......... 8% 313M 1s 2024-09-22T08:40:29.767 INFO:teuthology.orchestra.run.smithi038.stderr: 8150K .......... .......... .......... .......... .......... 8% 298M 1s 2024-09-22T08:40:29.767 INFO:teuthology.orchestra.run.smithi038.stderr: 8200K .......... .......... .......... .......... .......... 8% 317M 1s 2024-09-22T08:40:29.767 INFO:teuthology.orchestra.run.smithi038.stderr: 8250K .......... .......... .......... .......... .......... 8% 338M 1s 2024-09-22T08:40:29.767 INFO:teuthology.orchestra.run.smithi038.stderr: 8300K .......... .......... .......... .......... .......... 8% 280M 1s 2024-09-22T08:40:29.768 INFO:teuthology.orchestra.run.smithi038.stderr: 8350K .......... .......... .......... .......... .......... 9% 285M 1s 2024-09-22T08:40:29.768 INFO:teuthology.orchestra.run.smithi038.stderr: 8400K .......... .......... .......... .......... .......... 9% 320M 1s 2024-09-22T08:40:29.768 INFO:teuthology.orchestra.run.smithi038.stderr: 8450K .......... .......... .......... .......... .......... 9% 300M 1s 2024-09-22T08:40:29.768 INFO:teuthology.orchestra.run.smithi038.stderr: 8500K .......... .......... .......... .......... .......... 9% 311M 1s 2024-09-22T08:40:29.768 INFO:teuthology.orchestra.run.smithi038.stderr: 8550K .......... .......... .......... .......... .......... 9% 294M 1s 2024-09-22T08:40:29.768 INFO:teuthology.orchestra.run.smithi038.stderr: 8600K .......... .......... .......... .......... .......... 9% 321M 1s 2024-09-22T08:40:29.768 INFO:teuthology.orchestra.run.smithi038.stderr: 8650K .......... .......... .......... .......... .......... 9% 332M 1s 2024-09-22T08:40:29.768 INFO:teuthology.orchestra.run.smithi038.stderr: 8700K .......... .......... .......... .......... .......... 9% 319M 1s 2024-09-22T08:40:29.768 INFO:teuthology.orchestra.run.smithi038.stderr: 8750K .......... .......... .......... .......... .......... 9% 277M 1s 2024-09-22T08:40:29.768 INFO:teuthology.orchestra.run.smithi038.stderr: 8800K .......... .......... .......... .......... .......... 9% 326M 1s 2024-09-22T08:40:29.768 INFO:teuthology.orchestra.run.smithi038.stderr: 8850K .......... .......... .......... .......... .......... 9% 320M 1s 2024-09-22T08:40:29.768 INFO:teuthology.orchestra.run.smithi038.stderr: 8900K .......... .......... .......... .......... .......... 9% 340M 1s 2024-09-22T08:40:29.768 INFO:teuthology.orchestra.run.smithi038.stderr: 8950K .......... .......... .......... .......... .......... 9% 285M 1s 2024-09-22T08:40:29.768 INFO:teuthology.orchestra.run.smithi038.stderr: 9000K .......... .......... .......... .......... .......... 9% 313M 1s 2024-09-22T08:40:29.768 INFO:teuthology.orchestra.run.smithi038.stderr: 9050K .......... .......... .......... .......... .......... 9% 342M 1s 2024-09-22T08:40:29.768 INFO:teuthology.orchestra.run.smithi038.stderr: 9100K .......... .......... .......... .......... .......... 9% 278M 1s 2024-09-22T08:40:29.768 INFO:teuthology.orchestra.run.smithi038.stderr: 9150K .......... .......... .......... .......... .......... 9% 208M 1s 2024-09-22T08:40:29.769 INFO:teuthology.orchestra.run.smithi038.stderr: 9200K .......... .......... .......... .......... .......... 9% 317M 1s 2024-09-22T08:40:29.769 INFO:teuthology.orchestra.run.smithi038.stderr: 9250K .......... .......... .......... .......... .......... 10% 273M 1s 2024-09-22T08:40:29.769 INFO:teuthology.orchestra.run.smithi038.stderr: 9300K .......... .......... .......... .......... .......... 10% 283M 1s 2024-09-22T08:40:29.769 INFO:teuthology.orchestra.run.smithi038.stderr: 9350K .......... .......... .......... .......... .......... 10% 249M 1s 2024-09-22T08:40:29.769 INFO:teuthology.orchestra.run.smithi038.stderr: 9400K .......... .......... .......... .......... .......... 10% 289M 1s 2024-09-22T08:40:29.769 INFO:teuthology.orchestra.run.smithi038.stderr: 9450K .......... .......... .......... .......... .......... 10% 342M 1s 2024-09-22T08:40:29.769 INFO:teuthology.orchestra.run.smithi038.stderr: 9500K .......... .......... .......... .......... .......... 10% 315M 1s 2024-09-22T08:40:29.769 INFO:teuthology.orchestra.run.smithi038.stderr: 9550K .......... .......... .......... .......... .......... 10% 208M 1s 2024-09-22T08:40:29.769 INFO:teuthology.orchestra.run.smithi038.stderr: 9600K .......... .......... .......... .......... .......... 10% 312M 1s 2024-09-22T08:40:29.769 INFO:teuthology.orchestra.run.smithi038.stderr: 9650K .......... .......... .......... .......... .......... 10% 274M 1s 2024-09-22T08:40:29.769 INFO:teuthology.orchestra.run.smithi038.stderr: 9700K .......... .......... .......... .......... .......... 10% 311M 1s 2024-09-22T08:40:29.769 INFO:teuthology.orchestra.run.smithi038.stderr: 9750K .......... .......... .......... .......... .......... 10% 271M 1s 2024-09-22T08:40:29.769 INFO:teuthology.orchestra.run.smithi038.stderr: 9800K .......... .......... .......... .......... .......... 10% 312M 1s 2024-09-22T08:40:29.769 INFO:teuthology.orchestra.run.smithi038.stderr: 9850K .......... .......... .......... .......... .......... 10% 326M 1s 2024-09-22T08:40:29.769 INFO:teuthology.orchestra.run.smithi038.stderr: 9900K .......... .......... .......... .......... .......... 10% 325M 1s 2024-09-22T08:40:29.769 INFO:teuthology.orchestra.run.smithi038.stderr: 9950K .......... .......... .......... .......... .......... 10% 255M 1s 2024-09-22T08:40:29.770 INFO:teuthology.orchestra.run.smithi038.stderr: 10000K .......... .......... .......... .......... .......... 10% 325M 1s 2024-09-22T08:40:29.770 INFO:teuthology.orchestra.run.smithi038.stderr: 10050K .......... .......... .......... .......... .......... 10% 307M 1s 2024-09-22T08:40:29.770 INFO:teuthology.orchestra.run.smithi038.stderr: 10100K .......... .......... .......... .......... .......... 10% 305M 1s 2024-09-22T08:40:29.770 INFO:teuthology.orchestra.run.smithi038.stderr: 10150K .......... .......... .......... .......... .......... 10% 294M 1s 2024-09-22T08:40:29.770 INFO:teuthology.orchestra.run.smithi038.stderr: 10200K .......... .......... .......... .......... .......... 11% 293M 1s 2024-09-22T08:40:29.770 INFO:teuthology.orchestra.run.smithi038.stderr: 10250K .......... .......... .......... .......... .......... 11% 365M 1s 2024-09-22T08:40:29.770 INFO:teuthology.orchestra.run.smithi038.stderr: 10300K .......... .......... .......... .......... .......... 11% 264M 1s 2024-09-22T08:40:29.770 INFO:teuthology.orchestra.run.smithi038.stderr: 10350K .......... .......... .......... .......... .......... 11% 119M 1s 2024-09-22T08:40:29.770 INFO:teuthology.orchestra.run.smithi038.stderr: 10400K .......... .......... .......... .......... .......... 11% 26.0M 1s 2024-09-22T08:40:29.770 INFO:teuthology.orchestra.run.smithi038.stderr: 10450K .......... .......... .......... .......... .......... 11% 298M 1s 2024-09-22T08:40:29.770 INFO:teuthology.orchestra.run.smithi038.stderr: 10500K .......... .......... .......... .......... .......... 11% 286M 1s 2024-09-22T08:40:29.770 INFO:teuthology.orchestra.run.smithi038.stderr: 10550K .......... .......... .......... .......... .......... 11% 332M 1s 2024-09-22T08:40:29.770 INFO:teuthology.orchestra.run.smithi038.stderr: 10600K .......... .......... .......... .......... .......... 11% 322M 1s 2024-09-22T08:40:29.770 INFO:teuthology.orchestra.run.smithi038.stderr: 10650K .......... .......... .......... .......... .......... 11% 316M 1s 2024-09-22T08:40:29.770 INFO:teuthology.orchestra.run.smithi038.stderr: 10700K .......... .......... .......... .......... .......... 11% 272M 1s 2024-09-22T08:40:29.770 INFO:teuthology.orchestra.run.smithi038.stderr: 10750K .......... .......... .......... .......... .......... 11% 281M 1s 2024-09-22T08:40:29.771 INFO:teuthology.orchestra.run.smithi038.stderr: 10800K .......... .......... .......... .......... .......... 11% 300M 1s 2024-09-22T08:40:29.771 INFO:teuthology.orchestra.run.smithi038.stderr: 10850K .......... .......... .......... .......... .......... 11% 282M 1s 2024-09-22T08:40:29.771 INFO:teuthology.orchestra.run.smithi038.stderr: 10900K .......... .......... .......... .......... .......... 11% 229M 1s 2024-09-22T08:40:29.771 INFO:teuthology.orchestra.run.smithi038.stderr: 10950K .......... .......... .......... .......... .......... 11% 272M 1s 2024-09-22T08:40:29.771 INFO:teuthology.orchestra.run.smithi038.stderr: 11000K .......... .......... .......... .......... .......... 11% 304M 1s 2024-09-22T08:40:29.771 INFO:teuthology.orchestra.run.smithi038.stderr: 11050K .......... .......... .......... .......... .......... 11% 305M 1s 2024-09-22T08:40:29.771 INFO:teuthology.orchestra.run.smithi038.stderr: 11100K .......... .......... .......... .......... .......... 12% 280M 1s 2024-09-22T08:40:29.771 INFO:teuthology.orchestra.run.smithi038.stderr: 11150K .......... .......... .......... .......... .......... 12% 308M 1s 2024-09-22T08:40:29.771 INFO:teuthology.orchestra.run.smithi038.stderr: 11200K .......... .......... .......... .......... .......... 12% 325M 1s 2024-09-22T08:40:29.771 INFO:teuthology.orchestra.run.smithi038.stderr: 11250K .......... .......... .......... .......... .......... 12% 325M 1s 2024-09-22T08:40:29.771 INFO:teuthology.orchestra.run.smithi038.stderr: 11300K .......... .......... .......... .......... .......... 12% 281M 1s 2024-09-22T08:40:29.771 INFO:teuthology.orchestra.run.smithi038.stderr: 11350K .......... .......... .......... .......... .......... 12% 308M 1s 2024-09-22T08:40:29.771 INFO:teuthology.orchestra.run.smithi038.stderr: 11400K .......... .......... .......... .......... .......... 12% 324M 1s 2024-09-22T08:40:29.771 INFO:teuthology.orchestra.run.smithi038.stderr: 11450K .......... .......... .......... .......... .......... 12% 326M 1s 2024-09-22T08:40:29.771 INFO:teuthology.orchestra.run.smithi038.stderr: 11500K .......... .......... .......... .......... .......... 12% 282M 1s 2024-09-22T08:40:29.771 INFO:teuthology.orchestra.run.smithi038.stderr: 11550K .......... .......... .......... .......... .......... 12% 310M 1s 2024-09-22T08:40:29.772 INFO:teuthology.orchestra.run.smithi038.stderr: 11600K .......... .......... .......... .......... .......... 12% 311M 1s 2024-09-22T08:40:29.772 INFO:teuthology.orchestra.run.smithi038.stderr: 11650K .......... .......... .......... .......... .......... 12% 311M 1s 2024-09-22T08:40:29.772 INFO:teuthology.orchestra.run.smithi038.stderr: 11700K .......... .......... .......... .......... .......... 12% 299M 1s 2024-09-22T08:40:29.772 INFO:teuthology.orchestra.run.smithi038.stderr: 11750K .......... .......... .......... .......... .......... 12% 309M 1s 2024-09-22T08:40:29.772 INFO:teuthology.orchestra.run.smithi038.stderr: 11800K .......... .......... .......... .......... .......... 12% 184M 1s 2024-09-22T08:40:29.772 INFO:teuthology.orchestra.run.smithi038.stderr: 11850K .......... .......... .......... .......... .......... 12% 343M 1s 2024-09-22T08:40:29.772 INFO:teuthology.orchestra.run.smithi038.stderr: 11900K .......... .......... .......... .......... .......... 12% 270M 1s 2024-09-22T08:40:29.772 INFO:teuthology.orchestra.run.smithi038.stderr: 11950K .......... .......... .......... .......... .......... 12% 302M 1s 2024-09-22T08:40:29.772 INFO:teuthology.orchestra.run.smithi038.stderr: 12000K .......... .......... .......... .......... .......... 12% 331M 1s 2024-09-22T08:40:29.772 INFO:teuthology.orchestra.run.smithi038.stderr: 12050K .......... .......... .......... .......... .......... 13% 311M 1s 2024-09-22T08:40:29.772 INFO:teuthology.orchestra.run.smithi038.stderr: 12100K .......... .......... .......... .......... .......... 13% 272M 1s 2024-09-22T08:40:29.772 INFO:teuthology.orchestra.run.smithi038.stderr: 12150K .......... .......... .......... .......... .......... 13% 330M 1s 2024-09-22T08:40:29.772 INFO:teuthology.orchestra.run.smithi038.stderr: 12200K .......... .......... .......... .......... .......... 13% 316M 1s 2024-09-22T08:40:29.772 INFO:teuthology.orchestra.run.smithi038.stderr: 12250K .......... .......... .......... .......... .......... 13% 227M 1s 2024-09-22T08:40:29.773 INFO:teuthology.orchestra.run.smithi038.stderr: 12300K .......... .......... .......... .......... .......... 13% 284M 1s 2024-09-22T08:40:29.773 INFO:teuthology.orchestra.run.smithi038.stderr: 12350K .......... .......... .......... .......... .......... 13% 329M 1s 2024-09-22T08:40:29.773 INFO:teuthology.orchestra.run.smithi038.stderr: 12400K .......... .......... .......... .......... .......... 13% 247M 1s 2024-09-22T08:40:29.773 INFO:teuthology.orchestra.run.smithi038.stderr: 12450K .......... .......... .......... .......... .......... 13% 293M 1s 2024-09-22T08:40:29.773 INFO:teuthology.orchestra.run.smithi038.stderr: 12500K .......... .......... .......... .......... .......... 13% 265M 1s 2024-09-22T08:40:29.773 INFO:teuthology.orchestra.run.smithi038.stderr: 12550K .......... .......... .......... .......... .......... 13% 301M 1s 2024-09-22T08:40:29.773 INFO:teuthology.orchestra.run.smithi038.stderr: 12600K .......... .......... .......... .......... .......... 13% 168M 1s 2024-09-22T08:40:29.773 INFO:teuthology.orchestra.run.smithi038.stderr: 12650K .......... .......... .......... .......... .......... 13% 322M 1s 2024-09-22T08:40:29.773 INFO:teuthology.orchestra.run.smithi038.stderr: 12700K .......... .......... .......... .......... .......... 13% 238M 1s 2024-09-22T08:40:29.773 INFO:teuthology.orchestra.run.smithi038.stderr: 12750K .......... .......... .......... .......... .......... 13% 295M 1s 2024-09-22T08:40:29.773 INFO:teuthology.orchestra.run.smithi038.stderr: 12800K .......... .......... .......... .......... .......... 13% 327M 1s 2024-09-22T08:40:29.773 INFO:teuthology.orchestra.run.smithi038.stderr: 12850K .......... .......... .......... .......... .......... 13% 322M 1s 2024-09-22T08:40:29.773 INFO:teuthology.orchestra.run.smithi038.stderr: 12900K .......... .......... .......... .......... .......... 13% 292M 1s 2024-09-22T08:40:29.773 INFO:teuthology.orchestra.run.smithi038.stderr: 12950K .......... .......... .......... .......... .......... 13% 326M 1s 2024-09-22T08:40:29.773 INFO:teuthology.orchestra.run.smithi038.stderr: 13000K .......... .......... .......... .......... .......... 14% 336M 1s 2024-09-22T08:40:29.773 INFO:teuthology.orchestra.run.smithi038.stderr: 13050K .......... .......... .......... .......... .......... 14% 340M 1s 2024-09-22T08:40:29.774 INFO:teuthology.orchestra.run.smithi038.stderr: 13100K .......... .......... .......... .......... .......... 14% 279M 1s 2024-09-22T08:40:29.774 INFO:teuthology.orchestra.run.smithi038.stderr: 13150K .......... .......... .......... .......... .......... 14% 336M 1s 2024-09-22T08:40:29.774 INFO:teuthology.orchestra.run.smithi038.stderr: 13200K .......... .......... .......... .......... .......... 14% 156M 1s 2024-09-22T08:40:29.774 INFO:teuthology.orchestra.run.smithi038.stderr: 13250K .......... .......... .......... .......... .......... 14% 252M 1s 2024-09-22T08:40:29.774 INFO:teuthology.orchestra.run.smithi038.stderr: 13300K .......... .......... .......... .......... .......... 14% 269M 1s 2024-09-22T08:40:29.774 INFO:teuthology.orchestra.run.smithi038.stderr: 13350K .......... .......... .......... .......... .......... 14% 336M 1s 2024-09-22T08:40:29.774 INFO:teuthology.orchestra.run.smithi038.stderr: 13400K .......... .......... .......... .......... .......... 14% 362M 1s 2024-09-22T08:40:29.774 INFO:teuthology.orchestra.run.smithi038.stderr: 13450K .......... .......... .......... .......... .......... 14% 39.0M 1s 2024-09-22T08:40:29.774 INFO:teuthology.orchestra.run.smithi038.stderr: 13500K .......... .......... .......... .......... .......... 14% 232M 1s 2024-09-22T08:40:29.774 INFO:teuthology.orchestra.run.smithi038.stderr: 13550K .......... .......... .......... .......... .......... 14% 338M 1s 2024-09-22T08:40:29.774 INFO:teuthology.orchestra.run.smithi038.stderr: 13600K .......... .......... .......... .......... .......... 14% 188M 1s 2024-09-22T08:40:29.774 INFO:teuthology.orchestra.run.smithi038.stderr: 13650K .......... .......... .......... .......... .......... 14% 306M 1s 2024-09-22T08:40:29.774 INFO:teuthology.orchestra.run.smithi038.stderr: 13700K .......... .......... .......... .......... .......... 14% 311M 1s 2024-09-22T08:40:29.774 INFO:teuthology.orchestra.run.smithi038.stderr: 13750K .......... .......... .......... .......... .......... 14% 363M 1s 2024-09-22T08:40:29.774 INFO:teuthology.orchestra.run.smithi038.stderr: 13800K .......... .......... .......... .......... .......... 14% 270M 1s 2024-09-22T08:40:29.775 INFO:teuthology.orchestra.run.smithi038.stderr: 13850K .......... .......... .......... .......... .......... 14% 349M 1s 2024-09-22T08:40:29.775 INFO:teuthology.orchestra.run.smithi038.stderr: 13900K .......... .......... .......... .......... .......... 15% 296M 1s 2024-09-22T08:40:29.775 INFO:teuthology.orchestra.run.smithi038.stderr: 13950K .......... .......... .......... .......... .......... 15% 255M 1s 2024-09-22T08:40:29.775 INFO:teuthology.orchestra.run.smithi038.stderr: 14000K .......... .......... .......... .......... .......... 15% 312M 1s 2024-09-22T08:40:29.775 INFO:teuthology.orchestra.run.smithi038.stderr: 14050K .......... .......... .......... .......... .......... 15% 244M 1s 2024-09-22T08:40:29.775 INFO:teuthology.orchestra.run.smithi038.stderr: 14100K .......... .......... .......... .......... .......... 15% 305M 1s 2024-09-22T08:40:29.775 INFO:teuthology.orchestra.run.smithi038.stderr: 14150K .......... .......... .......... .......... .......... 15% 359M 1s 2024-09-22T08:40:29.775 INFO:teuthology.orchestra.run.smithi038.stderr: 14200K .......... .......... .......... .......... .......... 15% 353M 1s 2024-09-22T08:40:29.775 INFO:teuthology.orchestra.run.smithi038.stderr: 14250K .......... .......... .......... .......... .......... 15% 328M 1s 2024-09-22T08:40:29.775 INFO:teuthology.orchestra.run.smithi038.stderr: 14300K .......... .......... .......... .......... .......... 15% 295M 1s 2024-09-22T08:40:29.775 INFO:teuthology.orchestra.run.smithi038.stderr: 14350K .......... .......... .......... .......... .......... 15% 160M 1s 2024-09-22T08:40:29.775 INFO:teuthology.orchestra.run.smithi038.stderr: 14400K .......... .......... .......... .......... .......... 15% 300M 1s 2024-09-22T08:40:29.775 INFO:teuthology.orchestra.run.smithi038.stderr: 14450K .......... .......... .......... .......... .......... 15% 285M 1s 2024-09-22T08:40:29.775 INFO:teuthology.orchestra.run.smithi038.stderr: 14500K .......... .......... .......... .......... .......... 15% 307M 1s 2024-09-22T08:40:29.776 INFO:teuthology.orchestra.run.smithi038.stderr: 14550K .......... .......... .......... .......... .......... 15% 246M 1s 2024-09-22T08:40:29.776 INFO:teuthology.orchestra.run.smithi038.stderr: 14600K .......... .......... .......... .......... .......... 15% 332M 1s 2024-09-22T08:40:29.776 INFO:teuthology.orchestra.run.smithi038.stderr: 14650K .......... .......... .......... .......... .......... 15% 348M 1s 2024-09-22T08:40:29.776 INFO:teuthology.orchestra.run.smithi038.stderr: 14700K .......... .......... .......... .......... .......... 15% 280M 1s 2024-09-22T08:40:29.776 INFO:teuthology.orchestra.run.smithi038.stderr: 14750K .......... .......... .......... .......... .......... 15% 351M 1s 2024-09-22T08:40:29.776 INFO:teuthology.orchestra.run.smithi038.stderr: 14800K .......... .......... .......... .......... .......... 15% 152M 1s 2024-09-22T08:40:29.776 INFO:teuthology.orchestra.run.smithi038.stderr: 14850K .......... .......... .......... .......... .......... 16% 328M 1s 2024-09-22T08:40:29.776 INFO:teuthology.orchestra.run.smithi038.stderr: 14900K .......... .......... .......... .......... .......... 16% 310M 1s 2024-09-22T08:40:29.776 INFO:teuthology.orchestra.run.smithi038.stderr: 14950K .......... .......... .......... .......... .......... 16% 356M 1s 2024-09-22T08:40:29.776 INFO:teuthology.orchestra.run.smithi038.stderr: 15000K .......... .......... .......... .......... .......... 16% 363M 1s 2024-09-22T08:40:29.776 INFO:teuthology.orchestra.run.smithi038.stderr: 15050K .......... .......... .......... .......... .......... 16% 268M 1s 2024-09-22T08:40:29.776 INFO:teuthology.orchestra.run.smithi038.stderr: 15100K .......... .......... .......... .......... .......... 16% 259M 1s 2024-09-22T08:40:29.776 INFO:teuthology.orchestra.run.smithi038.stderr: 15150K .......... .......... .......... .......... .......... 16% 359M 1s 2024-09-22T08:40:29.776 INFO:teuthology.orchestra.run.smithi038.stderr: 15200K .......... .......... .......... .......... .......... 16% 330M 1s 2024-09-22T08:40:29.776 INFO:teuthology.orchestra.run.smithi038.stderr: 15250K .......... .......... .......... .......... .......... 16% 356M 1s 2024-09-22T08:40:29.776 INFO:teuthology.orchestra.run.smithi038.stderr: 15300K .......... .......... .......... .......... .......... 16% 324M 1s 2024-09-22T08:40:29.776 INFO:teuthology.orchestra.run.smithi038.stderr: 15350K .......... .......... .......... .......... .......... 16% 111M 1s 2024-09-22T08:40:29.777 INFO:teuthology.orchestra.run.smithi038.stderr: 15400K .......... .......... .......... .......... .......... 16% 347M 1s 2024-09-22T08:40:29.777 INFO:teuthology.orchestra.run.smithi038.stderr: 15450K .......... .......... .......... .......... .......... 16% 365M 1s 2024-09-22T08:40:29.777 INFO:teuthology.orchestra.run.smithi038.stderr: 15500K .......... .......... .......... .......... .......... 16% 293M 1s 2024-09-22T08:40:29.777 INFO:teuthology.orchestra.run.smithi038.stderr: 15550K .......... .......... .......... .......... .......... 16% 372M 1s 2024-09-22T08:40:29.777 INFO:teuthology.orchestra.run.smithi038.stderr: 15600K .......... .......... .......... .......... .......... 16% 364M 1s 2024-09-22T08:40:29.777 INFO:teuthology.orchestra.run.smithi038.stderr: 15650K .......... .......... .......... .......... .......... 16% 285M 1s 2024-09-22T08:40:29.777 INFO:teuthology.orchestra.run.smithi038.stderr: 15700K .......... .......... .......... .......... .......... 16% 293M 1s 2024-09-22T08:40:29.777 INFO:teuthology.orchestra.run.smithi038.stderr: 15750K .......... .......... .......... .......... .......... 17% 311M 1s 2024-09-22T08:40:29.777 INFO:teuthology.orchestra.run.smithi038.stderr: 15800K .......... .......... .......... .......... .......... 17% 197M 1s 2024-09-22T08:40:29.777 INFO:teuthology.orchestra.run.smithi038.stderr: 15850K .......... .......... .......... .......... .......... 17% 290M 1s 2024-09-22T08:40:29.777 INFO:teuthology.orchestra.run.smithi038.stderr: 15900K .......... .......... .......... .......... .......... 17% 266M 1s 2024-09-22T08:40:29.777 INFO:teuthology.orchestra.run.smithi038.stderr: 15950K .......... .......... .......... .......... .......... 17% 337M 1s 2024-09-22T08:40:29.777 INFO:teuthology.orchestra.run.smithi038.stderr: 16000K .......... .......... .......... .......... .......... 17% 360M 1s 2024-09-22T08:40:29.777 INFO:teuthology.orchestra.run.smithi038.stderr: 16050K .......... .......... .......... .......... .......... 17% 374M 1s 2024-09-22T08:40:29.777 INFO:teuthology.orchestra.run.smithi038.stderr: 16100K .......... .......... .......... .......... .......... 17% 334M 1s 2024-09-22T08:40:29.777 INFO:teuthology.orchestra.run.smithi038.stderr: 16150K .......... .......... .......... .......... .......... 17% 58.3M 1s 2024-09-22T08:40:29.778 INFO:teuthology.orchestra.run.smithi038.stderr: 16200K .......... .......... .......... .......... .......... 17% 290M 1s 2024-09-22T08:40:29.778 INFO:teuthology.orchestra.run.smithi038.stderr: 16250K .......... .......... .......... .......... .......... 17% 348M 1s 2024-09-22T08:40:29.778 INFO:teuthology.orchestra.run.smithi038.stderr: 16300K .......... .......... .......... .......... .......... 17% 302M 1s 2024-09-22T08:40:29.778 INFO:teuthology.orchestra.run.smithi038.stderr: 16350K .......... .......... .......... .......... .......... 17% 375M 1s 2024-09-22T08:40:29.778 INFO:teuthology.orchestra.run.smithi038.stderr: 16400K .......... .......... .......... .......... .......... 17% 348M 1s 2024-09-22T08:40:29.778 INFO:teuthology.orchestra.run.smithi038.stderr: 16450K .......... .......... .......... .......... .......... 17% 38.2M 1s 2024-09-22T08:40:29.778 INFO:teuthology.orchestra.run.smithi038.stderr: 16500K .......... .......... .......... .......... .......... 17% 312M 1s 2024-09-22T08:40:29.778 INFO:teuthology.orchestra.run.smithi038.stderr: 16550K .......... .......... .......... .......... .......... 17% 340M 1s 2024-09-22T08:40:29.778 INFO:teuthology.orchestra.run.smithi038.stderr: 16600K .......... .......... .......... .......... .......... 17% 362M 1s 2024-09-22T08:40:29.778 INFO:teuthology.orchestra.run.smithi038.stderr: 16650K .......... .......... .......... .......... .......... 17% 378M 1s 2024-09-22T08:40:29.778 INFO:teuthology.orchestra.run.smithi038.stderr: 16700K .......... .......... .......... .......... .......... 18% 111M 1s 2024-09-22T08:40:29.778 INFO:teuthology.orchestra.run.smithi038.stderr: 16750K .......... .......... .......... .......... .......... 18% 352M 1s 2024-09-22T08:40:29.778 INFO:teuthology.orchestra.run.smithi038.stderr: 16800K .......... .......... .......... .......... .......... 18% 353M 1s 2024-09-22T08:40:29.778 INFO:teuthology.orchestra.run.smithi038.stderr: 16850K .......... .......... .......... .......... .......... 18% 338M 1s 2024-09-22T08:40:29.778 INFO:teuthology.orchestra.run.smithi038.stderr: 16900K .......... .......... .......... .......... .......... 18% 325M 1s 2024-09-22T08:40:29.779 INFO:teuthology.orchestra.run.smithi038.stderr: 16950K .......... .......... .......... .......... .......... 18% 346M 1s 2024-09-22T08:40:29.779 INFO:teuthology.orchestra.run.smithi038.stderr: 17000K .......... .......... .......... .......... .......... 18% 351M 1s 2024-09-22T08:40:29.779 INFO:teuthology.orchestra.run.smithi038.stderr: 17050K .......... .......... .......... .......... .......... 18% 356M 1s 2024-09-22T08:40:29.779 INFO:teuthology.orchestra.run.smithi038.stderr: 17100K .......... .......... .......... .......... .......... 18% 296M 1s 2024-09-22T08:40:29.779 INFO:teuthology.orchestra.run.smithi038.stderr: 17150K .......... .......... .......... .......... .......... 18% 354M 1s 2024-09-22T08:40:29.779 INFO:teuthology.orchestra.run.smithi038.stderr: 17200K .......... .......... .......... .......... .......... 18% 357M 1s 2024-09-22T08:40:29.779 INFO:teuthology.orchestra.run.smithi038.stderr: 17250K .......... .......... .......... .......... .......... 18% 380M 1s 2024-09-22T08:40:29.779 INFO:teuthology.orchestra.run.smithi038.stderr: 17300K .......... .......... .......... .......... .......... 18% 318M 1s 2024-09-22T08:40:29.779 INFO:teuthology.orchestra.run.smithi038.stderr: 17350K .......... .......... .......... .......... .......... 18% 344M 1s 2024-09-22T08:40:29.779 INFO:teuthology.orchestra.run.smithi038.stderr: 17400K .......... .......... .......... .......... .......... 18% 288M 1s 2024-09-22T08:40:29.779 INFO:teuthology.orchestra.run.smithi038.stderr: 17450K .......... .......... .......... .......... .......... 18% 368M 1s 2024-09-22T08:40:29.779 INFO:teuthology.orchestra.run.smithi038.stderr: 17500K .......... .......... .......... .......... .......... 18% 279M 1s 2024-09-22T08:40:29.779 INFO:teuthology.orchestra.run.smithi038.stderr: 17550K .......... .......... .......... .......... .......... 18% 330M 1s 2024-09-22T08:40:29.779 INFO:teuthology.orchestra.run.smithi038.stderr: 17600K .......... .......... .......... .......... .......... 18% 364M 1s 2024-09-22T08:40:29.780 INFO:teuthology.orchestra.run.smithi038.stderr: 17650K .......... .......... .......... .......... .......... 19% 266M 1s 2024-09-22T08:40:29.780 INFO:teuthology.orchestra.run.smithi038.stderr: 17700K .......... .......... .......... .......... .......... 19% 315M 1s 2024-09-22T08:40:29.780 INFO:teuthology.orchestra.run.smithi038.stderr: 17750K .......... .......... .......... .......... .......... 19% 352M 1s 2024-09-22T08:40:29.780 INFO:teuthology.orchestra.run.smithi038.stderr: 17800K .......... .......... .......... .......... .......... 19% 313M 1s 2024-09-22T08:40:29.780 INFO:teuthology.orchestra.run.smithi038.stderr: 17850K .......... .......... .......... .......... .......... 19% 136M 1s 2024-09-22T08:40:29.780 INFO:teuthology.orchestra.run.smithi038.stderr: 17900K .......... .......... .......... .......... .......... 19% 207M 1s 2024-09-22T08:40:29.780 INFO:teuthology.orchestra.run.smithi038.stderr: 17950K .......... .......... .......... .......... .......... 19% 368M 1s 2024-09-22T08:40:29.780 INFO:teuthology.orchestra.run.smithi038.stderr: 18000K .......... .......... .......... .......... .......... 19% 332M 1s 2024-09-22T08:40:29.780 INFO:teuthology.orchestra.run.smithi038.stderr: 18050K .......... .......... .......... .......... .......... 19% 359M 1s 2024-09-22T08:40:29.780 INFO:teuthology.orchestra.run.smithi038.stderr: 18100K .......... .......... .......... .......... .......... 19% 301M 1s 2024-09-22T08:40:29.780 INFO:teuthology.orchestra.run.smithi038.stderr: 18150K .......... .......... .......... .......... .......... 19% 325M 1s 2024-09-22T08:40:29.780 INFO:teuthology.orchestra.run.smithi038.stderr: 18200K .......... .......... .......... .......... .......... 19% 334M 1s 2024-09-22T08:40:29.780 INFO:teuthology.orchestra.run.smithi038.stderr: 18250K .......... .......... .......... .......... .......... 19% 263M 1s 2024-09-22T08:40:29.780 INFO:teuthology.orchestra.run.smithi038.stderr: 18300K .......... .......... .......... .......... .......... 19% 335M 1s 2024-09-22T08:40:29.780 INFO:teuthology.orchestra.run.smithi038.stderr: 18350K .......... .......... .......... .......... .......... 19% 154M 1s 2024-09-22T08:40:29.780 INFO:teuthology.orchestra.run.smithi038.stderr: 18400K .......... .......... .......... .......... .......... 19% 186M 1s 2024-09-22T08:40:29.781 INFO:teuthology.orchestra.run.smithi038.stderr: 18450K .......... .......... .......... .......... .......... 19% 265M 1s 2024-09-22T08:40:29.781 INFO:teuthology.orchestra.run.smithi038.stderr: 18500K .......... .......... .......... .......... .......... 19% 329M 1s 2024-09-22T08:40:29.781 INFO:teuthology.orchestra.run.smithi038.stderr: 18550K .......... .......... .......... .......... .......... 20% 306M 1s 2024-09-22T08:40:29.781 INFO:teuthology.orchestra.run.smithi038.stderr: 18600K .......... .......... .......... .......... .......... 20% 262M 1s 2024-09-22T08:40:29.781 INFO:teuthology.orchestra.run.smithi038.stderr: 18650K .......... .......... .......... .......... .......... 20% 304M 1s 2024-09-22T08:40:29.781 INFO:teuthology.orchestra.run.smithi038.stderr: 18700K .......... .......... .......... .......... .......... 20% 266M 1s 2024-09-22T08:40:29.781 INFO:teuthology.orchestra.run.smithi038.stderr: 18750K .......... .......... .......... .......... .......... 20% 344M 1s 2024-09-22T08:40:29.781 INFO:teuthology.orchestra.run.smithi038.stderr: 18800K .......... .......... .......... .......... .......... 20% 365M 1s 2024-09-22T08:40:29.781 INFO:teuthology.orchestra.run.smithi038.stderr: 18850K .......... .......... .......... .......... .......... 20% 375M 1s 2024-09-22T08:40:29.781 INFO:teuthology.orchestra.run.smithi038.stderr: 18900K .......... .......... .......... .......... .......... 20% 326M 1s 2024-09-22T08:40:29.781 INFO:teuthology.orchestra.run.smithi038.stderr: 18950K .......... .......... .......... .......... .......... 20% 353M 1s 2024-09-22T08:40:29.781 INFO:teuthology.orchestra.run.smithi038.stderr: 19000K .......... .......... .......... .......... .......... 20% 359M 1s 2024-09-22T08:40:29.781 INFO:teuthology.orchestra.run.smithi038.stderr: 19050K .......... .......... .......... .......... .......... 20% 374M 1s 2024-09-22T08:40:29.781 INFO:teuthology.orchestra.run.smithi038.stderr: 19100K .......... .......... .......... .......... .......... 20% 63.4M 1s 2024-09-22T08:40:29.781 INFO:teuthology.orchestra.run.smithi038.stderr: 19150K .......... .......... .......... .......... .......... 20% 268M 1s 2024-09-22T08:40:29.781 INFO:teuthology.orchestra.run.smithi038.stderr: 19200K .......... .......... .......... .......... .......... 20% 294M 1s 2024-09-22T08:40:29.782 INFO:teuthology.orchestra.run.smithi038.stderr: 19250K .......... .......... .......... .......... .......... 20% 236M 1s 2024-09-22T08:40:29.782 INFO:teuthology.orchestra.run.smithi038.stderr: 19300K .......... .......... .......... .......... .......... 20% 260M 1s 2024-09-22T08:40:29.782 INFO:teuthology.orchestra.run.smithi038.stderr: 19350K .......... .......... .......... .......... .......... 20% 375M 1s 2024-09-22T08:40:29.782 INFO:teuthology.orchestra.run.smithi038.stderr: 19400K .......... .......... .......... .......... .......... 20% 31.0M 1s 2024-09-22T08:40:29.782 INFO:teuthology.orchestra.run.smithi038.stderr: 19450K .......... .......... .......... .......... .......... 20% 302M 1s 2024-09-22T08:40:29.782 INFO:teuthology.orchestra.run.smithi038.stderr: 19500K .......... .......... .......... .......... .......... 21% 297M 1s 2024-09-22T08:40:29.782 INFO:teuthology.orchestra.run.smithi038.stderr: 19550K .......... .......... .......... .......... .......... 21% 368M 1s 2024-09-22T08:40:29.782 INFO:teuthology.orchestra.run.smithi038.stderr: 19600K .......... .......... .......... .......... .......... 21% 374M 1s 2024-09-22T08:40:29.782 INFO:teuthology.orchestra.run.smithi038.stderr: 19650K .......... .......... .......... .......... .......... 21% 357M 1s 2024-09-22T08:40:29.782 INFO:teuthology.orchestra.run.smithi038.stderr: 19700K .......... .......... .......... .......... .......... 21% 296M 1s 2024-09-22T08:40:29.782 INFO:teuthology.orchestra.run.smithi038.stderr: 19750K .......... .......... .......... .......... .......... 21% 375M 1s 2024-09-22T08:40:29.782 INFO:teuthology.orchestra.run.smithi038.stderr: 19800K .......... .......... .......... .......... .......... 21% 379M 1s 2024-09-22T08:40:29.782 INFO:teuthology.orchestra.run.smithi038.stderr: 19850K .......... .......... .......... .......... .......... 21% 145M 1s 2024-09-22T08:40:29.782 INFO:teuthology.orchestra.run.smithi038.stderr: 19900K .......... .......... .......... .......... .......... 21% 266M 1s 2024-09-22T08:40:29.783 INFO:teuthology.orchestra.run.smithi038.stderr: 19950K .......... .......... .......... .......... .......... 21% 245M 1s 2024-09-22T08:40:29.783 INFO:teuthology.orchestra.run.smithi038.stderr: 20000K .......... .......... .......... .......... .......... 21% 283M 1s 2024-09-22T08:40:29.783 INFO:teuthology.orchestra.run.smithi038.stderr: 20050K .......... .......... .......... .......... .......... 21% 366M 1s 2024-09-22T08:40:29.783 INFO:teuthology.orchestra.run.smithi038.stderr: 20100K .......... .......... .......... .......... .......... 21% 318M 1s 2024-09-22T08:40:29.783 INFO:teuthology.orchestra.run.smithi038.stderr: 20150K .......... .......... .......... .......... .......... 21% 267M 1s 2024-09-22T08:40:29.783 INFO:teuthology.orchestra.run.smithi038.stderr: 20200K .......... .......... .......... .......... .......... 21% 280M 1s 2024-09-22T08:40:29.783 INFO:teuthology.orchestra.run.smithi038.stderr: 20250K .......... .......... .......... .......... .......... 21% 354M 1s 2024-09-22T08:40:29.783 INFO:teuthology.orchestra.run.smithi038.stderr: 20300K .......... .......... .......... .......... .......... 21% 296M 1s 2024-09-22T08:40:29.783 INFO:teuthology.orchestra.run.smithi038.stderr: 20350K .......... .......... .......... .......... .......... 21% 370M 1s 2024-09-22T08:40:29.783 INFO:teuthology.orchestra.run.smithi038.stderr: 20400K .......... .......... .......... .......... .......... 22% 358M 1s 2024-09-22T08:40:29.783 INFO:teuthology.orchestra.run.smithi038.stderr: 20450K .......... .......... .......... .......... .......... 22% 342M 1s 2024-09-22T08:40:29.783 INFO:teuthology.orchestra.run.smithi038.stderr: 20500K .......... .......... .......... .......... .......... 22% 409M 1s 2024-09-22T08:40:29.783 INFO:teuthology.orchestra.run.smithi038.stderr: 20550K .......... .......... .......... .......... .......... 22% 352M 1s 2024-09-22T08:40:29.783 INFO:teuthology.orchestra.run.smithi038.stderr: 20600K .......... .......... .......... .......... .......... 22% 380M 1s 2024-09-22T08:40:29.783 INFO:teuthology.orchestra.run.smithi038.stderr: 20650K .......... .......... .......... .......... .......... 22% 365M 1s 2024-09-22T08:40:29.783 INFO:teuthology.orchestra.run.smithi038.stderr: 20700K .......... .......... .......... .......... .......... 22% 376M 1s 2024-09-22T08:40:29.783 INFO:teuthology.orchestra.run.smithi038.stderr: 20750K .......... .......... .......... .......... .......... 22% 308M 1s 2024-09-22T08:40:29.784 INFO:teuthology.orchestra.run.smithi038.stderr: 20800K .......... .......... .......... .......... .......... 22% 345M 1s 2024-09-22T08:40:29.784 INFO:teuthology.orchestra.run.smithi038.stderr: 20850K .......... .......... .......... .......... .......... 22% 367M 1s 2024-09-22T08:40:29.784 INFO:teuthology.orchestra.run.smithi038.stderr: 20900K .......... .......... .......... .......... .......... 22% 367M 1s 2024-09-22T08:40:29.784 INFO:teuthology.orchestra.run.smithi038.stderr: 20950K .......... .......... .......... .......... .......... 22% 337M 1s 2024-09-22T08:40:29.784 INFO:teuthology.orchestra.run.smithi038.stderr: 21000K .......... .......... .......... .......... .......... 22% 360M 1s 2024-09-22T08:40:29.784 INFO:teuthology.orchestra.run.smithi038.stderr: 21050K .......... .......... .......... .......... .......... 22% 373M 1s 2024-09-22T08:40:29.784 INFO:teuthology.orchestra.run.smithi038.stderr: 21100K .......... .......... .......... .......... .......... 22% 367M 1s 2024-09-22T08:40:29.784 INFO:teuthology.orchestra.run.smithi038.stderr: 21150K .......... .......... .......... .......... .......... 22% 310M 1s 2024-09-22T08:40:29.784 INFO:teuthology.orchestra.run.smithi038.stderr: 21200K .......... .......... .......... .......... .......... 22% 376M 1s 2024-09-22T08:40:29.784 INFO:teuthology.orchestra.run.smithi038.stderr: 21250K .......... .......... .......... .......... .......... 22% 372M 1s 2024-09-22T08:40:29.784 INFO:teuthology.orchestra.run.smithi038.stderr: 21300K .......... .......... .......... .......... .......... 22% 362M 1s 2024-09-22T08:40:29.784 INFO:teuthology.orchestra.run.smithi038.stderr: 21350K .......... .......... .......... .......... .......... 23% 101M 1s 2024-09-22T08:40:29.784 INFO:teuthology.orchestra.run.smithi038.stderr: 21400K .......... .......... .......... .......... .......... 23% 357M 1s 2024-09-22T08:40:29.784 INFO:teuthology.orchestra.run.smithi038.stderr: 21450K .......... .......... .......... .......... .......... 23% 383M 1s 2024-09-22T08:40:29.785 INFO:teuthology.orchestra.run.smithi038.stderr: 21500K .......... .......... .......... .......... .......... 23% 220M 1s 2024-09-22T08:40:29.785 INFO:teuthology.orchestra.run.smithi038.stderr: 21550K .......... .......... .......... .......... .......... 23% 293M 1s 2024-09-22T08:40:29.785 INFO:teuthology.orchestra.run.smithi038.stderr: 21600K .......... .......... .......... .......... .......... 23% 349M 1s 2024-09-22T08:40:29.785 INFO:teuthology.orchestra.run.smithi038.stderr: 21650K .......... .......... .......... .......... .......... 23% 371M 1s 2024-09-22T08:40:29.785 INFO:teuthology.orchestra.run.smithi038.stderr: 21700K .......... .......... .......... .......... .......... 23% 378M 1s 2024-09-22T08:40:29.785 INFO:teuthology.orchestra.run.smithi038.stderr: 21750K .......... .......... .......... .......... .......... 23% 235M 1s 2024-09-22T08:40:29.785 INFO:teuthology.orchestra.run.smithi038.stderr: 21800K .......... .......... .......... .......... .......... 23% 356M 1s 2024-09-22T08:40:29.785 INFO:teuthology.orchestra.run.smithi038.stderr: 21850K .......... .......... .......... .......... .......... 23% 370M 1s 2024-09-22T08:40:29.785 INFO:teuthology.orchestra.run.smithi038.stderr: 21900K .......... .......... .......... .......... .......... 23% 335M 1s 2024-09-22T08:40:29.785 INFO:teuthology.orchestra.run.smithi038.stderr: 21950K .......... .......... .......... .......... .......... 23% 236M 1s 2024-09-22T08:40:29.785 INFO:teuthology.orchestra.run.smithi038.stderr: 22000K .......... .......... .......... .......... .......... 23% 183M 1s 2024-09-22T08:40:29.785 INFO:teuthology.orchestra.run.smithi038.stderr: 22050K .......... .......... .......... .......... .......... 23% 364M 1s 2024-09-22T08:40:29.785 INFO:teuthology.orchestra.run.smithi038.stderr: 22100K .......... .......... .......... .......... .......... 23% 79.8M 1s 2024-09-22T08:40:29.785 INFO:teuthology.orchestra.run.smithi038.stderr: 22150K .......... .......... .......... .......... .......... 23% 307M 1s 2024-09-22T08:40:29.786 INFO:teuthology.orchestra.run.smithi038.stderr: 22200K .......... .......... .......... .......... .......... 23% 353M 1s 2024-09-22T08:40:29.786 INFO:teuthology.orchestra.run.smithi038.stderr: 22250K .......... .......... .......... .......... .......... 24% 124M 1s 2024-09-22T08:40:29.786 INFO:teuthology.orchestra.run.smithi038.stderr: 22300K .......... .......... .......... .......... .......... 24% 355M 1s 2024-09-22T08:40:29.786 INFO:teuthology.orchestra.run.smithi038.stderr: 22350K .......... .......... .......... .......... .......... 24% 31.4M 1s 2024-09-22T08:40:29.786 INFO:teuthology.orchestra.run.smithi038.stderr: 22400K .......... .......... .......... .......... .......... 24% 332M 1s 2024-09-22T08:40:29.786 INFO:teuthology.orchestra.run.smithi038.stderr: 22450K .......... .......... .......... .......... .......... 24% 378M 1s 2024-09-22T08:40:29.786 INFO:teuthology.orchestra.run.smithi038.stderr: 22500K .......... .......... .......... .......... .......... 24% 187M 1s 2024-09-22T08:40:29.786 INFO:teuthology.orchestra.run.smithi038.stderr: 22550K .......... .......... .......... .......... .......... 24% 327M 1s 2024-09-22T08:40:29.786 INFO:teuthology.orchestra.run.smithi038.stderr: 22600K .......... .......... .......... .......... .......... 24% 361M 1s 2024-09-22T08:40:29.786 INFO:teuthology.orchestra.run.smithi038.stderr: 22650K .......... .......... .......... .......... .......... 24% 375M 1s 2024-09-22T08:40:29.786 INFO:teuthology.orchestra.run.smithi038.stderr: 22700K .......... .......... .......... .......... .......... 24% 355M 1s 2024-09-22T08:40:29.786 INFO:teuthology.orchestra.run.smithi038.stderr: 22750K .......... .......... .......... .......... .......... 24% 317M 1s 2024-09-22T08:40:29.786 INFO:teuthology.orchestra.run.smithi038.stderr: 22800K .......... .......... .......... .......... .......... 24% 249M 1s 2024-09-22T08:40:29.786 INFO:teuthology.orchestra.run.smithi038.stderr: 22850K .......... .......... .......... .......... .......... 24% 327M 1s 2024-09-22T08:40:29.787 INFO:teuthology.orchestra.run.smithi038.stderr: 22900K .......... .......... .......... .......... .......... 24% 373M 1s 2024-09-22T08:40:29.787 INFO:teuthology.orchestra.run.smithi038.stderr: 22950K .......... .......... .......... .......... .......... 24% 270M 0s 2024-09-22T08:40:29.787 INFO:teuthology.orchestra.run.smithi038.stderr: 23000K .......... .......... .......... .......... .......... 24% 302M 0s 2024-09-22T08:40:29.787 INFO:teuthology.orchestra.run.smithi038.stderr: 23050K .......... .......... .......... .......... .......... 24% 355M 0s 2024-09-22T08:40:29.787 INFO:teuthology.orchestra.run.smithi038.stderr: 23100K .......... .......... .......... .......... .......... 24% 218M 0s 2024-09-22T08:40:29.787 INFO:teuthology.orchestra.run.smithi038.stderr: 23150K .......... .......... .......... .......... .......... 24% 312M 0s 2024-09-22T08:40:29.787 INFO:teuthology.orchestra.run.smithi038.stderr: 23200K .......... .......... .......... .......... .......... 25% 367M 0s 2024-09-22T08:40:29.787 INFO:teuthology.orchestra.run.smithi038.stderr: 23250K .......... .......... .......... .......... .......... 25% 254M 0s 2024-09-22T08:40:29.787 INFO:teuthology.orchestra.run.smithi038.stderr: 23300K .......... .......... .......... .......... .......... 25% 297M 0s 2024-09-22T08:40:29.787 INFO:teuthology.orchestra.run.smithi038.stderr: 23350K .......... .......... .......... .......... .......... 25% 330M 0s 2024-09-22T08:40:29.787 INFO:teuthology.orchestra.run.smithi038.stderr: 23400K .......... .......... .......... .......... .......... 25% 353M 0s 2024-09-22T08:40:29.787 INFO:teuthology.orchestra.run.smithi038.stderr: 23450K .......... .......... .......... .......... .......... 25% 364M 0s 2024-09-22T08:40:29.787 INFO:teuthology.orchestra.run.smithi038.stderr: 23500K .......... .......... .......... .......... .......... 25% 374M 0s 2024-09-22T08:40:29.787 INFO:teuthology.orchestra.run.smithi038.stderr: 23550K .......... .......... .......... .......... .......... 25% 86.0M 0s 2024-09-22T08:40:29.788 INFO:teuthology.orchestra.run.smithi038.stderr: 23600K .......... .......... .......... .......... .......... 25% 299M 0s 2024-09-22T08:40:29.788 INFO:teuthology.orchestra.run.smithi038.stderr: 23650K .......... .......... .......... .......... .......... 25% 352M 0s 2024-09-22T08:40:29.788 INFO:teuthology.orchestra.run.smithi038.stderr: 23700K .......... .......... .......... .......... .......... 25% 363M 0s 2024-09-22T08:40:29.788 INFO:teuthology.orchestra.run.smithi038.stderr: 23750K .......... .......... .......... .......... .......... 25% 320M 0s 2024-09-22T08:40:29.788 INFO:teuthology.orchestra.run.smithi038.stderr: 23800K .......... .......... .......... .......... .......... 25% 377M 0s 2024-09-22T08:40:29.788 INFO:teuthology.orchestra.run.smithi038.stderr: 23850K .......... .......... .......... .......... .......... 25% 368M 0s 2024-09-22T08:40:29.788 INFO:teuthology.orchestra.run.smithi038.stderr: 23900K .......... .......... .......... .......... .......... 25% 360M 0s 2024-09-22T08:40:29.788 INFO:teuthology.orchestra.run.smithi038.stderr: 23950K .......... .......... .......... .......... .......... 25% 300M 0s 2024-09-22T08:40:29.788 INFO:teuthology.orchestra.run.smithi038.stderr: 24000K .......... .......... .......... .......... .......... 25% 359M 0s 2024-09-22T08:40:29.788 INFO:teuthology.orchestra.run.smithi038.stderr: 24050K .......... .......... .......... .......... .......... 25% 352M 0s 2024-09-22T08:40:29.788 INFO:teuthology.orchestra.run.smithi038.stderr: 24100K .......... .......... .......... .......... .......... 25% 383M 0s 2024-09-22T08:40:29.788 INFO:teuthology.orchestra.run.smithi038.stderr: 24150K .......... .......... .......... .......... .......... 26% 332M 0s 2024-09-22T08:40:29.788 INFO:teuthology.orchestra.run.smithi038.stderr: 24200K .......... .......... .......... .......... .......... 26% 380M 0s 2024-09-22T08:40:29.788 INFO:teuthology.orchestra.run.smithi038.stderr: 24250K .......... .......... .......... .......... .......... 26% 383M 0s 2024-09-22T08:40:29.788 INFO:teuthology.orchestra.run.smithi038.stderr: 24300K .......... .......... .......... .......... .......... 26% 371M 0s 2024-09-22T08:40:29.788 INFO:teuthology.orchestra.run.smithi038.stderr: 24350K .......... .......... .......... .......... .......... 26% 294M 0s 2024-09-22T08:40:29.789 INFO:teuthology.orchestra.run.smithi038.stderr: 24400K .......... .......... .......... .......... .......... 26% 377M 0s 2024-09-22T08:40:29.789 INFO:teuthology.orchestra.run.smithi038.stderr: 24450K .......... .......... .......... .......... .......... 26% 377M 0s 2024-09-22T08:40:29.789 INFO:teuthology.orchestra.run.smithi038.stderr: 24500K .......... .......... .......... .......... .......... 26% 360M 0s 2024-09-22T08:40:29.789 INFO:teuthology.orchestra.run.smithi038.stderr: 24550K .......... .......... .......... .......... .......... 26% 327M 0s 2024-09-22T08:40:29.789 INFO:teuthology.orchestra.run.smithi038.stderr: 24600K .......... .......... .......... .......... .......... 26% 369M 0s 2024-09-22T08:40:29.789 INFO:teuthology.orchestra.run.smithi038.stderr: 24650K .......... .......... .......... .......... .......... 26% 381M 0s 2024-09-22T08:40:29.789 INFO:teuthology.orchestra.run.smithi038.stderr: 24700K .......... .......... .......... .......... .......... 26% 300M 0s 2024-09-22T08:40:29.789 INFO:teuthology.orchestra.run.smithi038.stderr: 24750K .......... .......... .......... .......... .......... 26% 276M 0s 2024-09-22T08:40:29.789 INFO:teuthology.orchestra.run.smithi038.stderr: 24800K .......... .......... .......... .......... .......... 26% 367M 0s 2024-09-22T08:40:29.789 INFO:teuthology.orchestra.run.smithi038.stderr: 24850K .......... .......... .......... .......... .......... 26% 243M 0s 2024-09-22T08:40:29.789 INFO:teuthology.orchestra.run.smithi038.stderr: 24900K .......... .......... .......... .......... .......... 26% 269M 0s 2024-09-22T08:40:29.789 INFO:teuthology.orchestra.run.smithi038.stderr: 24950K .......... .......... .......... .......... .......... 26% 321M 0s 2024-09-22T08:40:29.789 INFO:teuthology.orchestra.run.smithi038.stderr: 25000K .......... .......... .......... .......... .......... 26% 344M 0s 2024-09-22T08:40:29.789 INFO:teuthology.orchestra.run.smithi038.stderr: 25050K .......... .......... .......... .......... .......... 27% 316M 0s 2024-09-22T08:40:29.789 INFO:teuthology.orchestra.run.smithi038.stderr: 25100K .......... .......... .......... .......... .......... 27% 75.9M 0s 2024-09-22T08:40:29.789 INFO:teuthology.orchestra.run.smithi038.stderr: 25150K .......... .......... .......... .......... .......... 27% 290M 0s 2024-09-22T08:40:29.790 INFO:teuthology.orchestra.run.smithi038.stderr: 25200K .......... .......... .......... .......... .......... 27% 173M 0s 2024-09-22T08:40:29.790 INFO:teuthology.orchestra.run.smithi038.stderr: 25250K .......... .......... .......... .......... .......... 27% 357M 0s 2024-09-22T08:40:29.790 INFO:teuthology.orchestra.run.smithi038.stderr: 25300K .......... .......... .......... .......... .......... 27% 362M 0s 2024-09-22T08:40:29.790 INFO:teuthology.orchestra.run.smithi038.stderr: 25350K .......... .......... .......... .......... .......... 27% 49.9M 0s 2024-09-22T08:40:29.790 INFO:teuthology.orchestra.run.smithi038.stderr: 25400K .......... .......... .......... .......... .......... 27% 68.4M 0s 2024-09-22T08:40:29.790 INFO:teuthology.orchestra.run.smithi038.stderr: 25450K .......... .......... .......... .......... .......... 27% 352M 0s 2024-09-22T08:40:29.790 INFO:teuthology.orchestra.run.smithi038.stderr: 25500K .......... .......... .......... .......... .......... 27% 150M 0s 2024-09-22T08:40:29.790 INFO:teuthology.orchestra.run.smithi038.stderr: 25550K .......... .......... .......... .......... .......... 27% 304M 0s 2024-09-22T08:40:29.790 INFO:teuthology.orchestra.run.smithi038.stderr: 25600K .......... .......... .......... .......... .......... 27% 348M 0s 2024-09-22T08:40:29.790 INFO:teuthology.orchestra.run.smithi038.stderr: 25650K .......... .......... .......... .......... .......... 27% 369M 0s 2024-09-22T08:40:29.790 INFO:teuthology.orchestra.run.smithi038.stderr: 25700K .......... .......... .......... .......... .......... 27% 370M 0s 2024-09-22T08:40:29.790 INFO:teuthology.orchestra.run.smithi038.stderr: 25750K .......... .......... .......... .......... .......... 27% 331M 0s 2024-09-22T08:40:29.790 INFO:teuthology.orchestra.run.smithi038.stderr: 25800K .......... .......... .......... .......... .......... 27% 287M 0s 2024-09-22T08:40:29.790 INFO:teuthology.orchestra.run.smithi038.stderr: 25850K .......... .......... .......... .......... .......... 27% 352M 0s 2024-09-22T08:40:29.791 INFO:teuthology.orchestra.run.smithi038.stderr: 25900K .......... .......... .......... .......... .......... 27% 366M 0s 2024-09-22T08:40:29.791 INFO:teuthology.orchestra.run.smithi038.stderr: 25950K .......... .......... .......... .......... .......... 27% 255M 0s 2024-09-22T08:40:29.791 INFO:teuthology.orchestra.run.smithi038.stderr: 26000K .......... .......... .......... .......... .......... 28% 334M 0s 2024-09-22T08:40:29.791 INFO:teuthology.orchestra.run.smithi038.stderr: 26050K .......... .......... .......... .......... .......... 28% 163M 0s 2024-09-22T08:40:29.791 INFO:teuthology.orchestra.run.smithi038.stderr: 26100K .......... .......... .......... .......... .......... 28% 240M 0s 2024-09-22T08:40:29.791 INFO:teuthology.orchestra.run.smithi038.stderr: 26150K .......... .......... .......... .......... .......... 28% 263M 0s 2024-09-22T08:40:29.791 INFO:teuthology.orchestra.run.smithi038.stderr: 26200K .......... .......... .......... .......... .......... 28% 341M 0s 2024-09-22T08:40:29.791 INFO:teuthology.orchestra.run.smithi038.stderr: 26250K .......... .......... .......... .......... .......... 28% 359M 0s 2024-09-22T08:40:29.791 INFO:teuthology.orchestra.run.smithi038.stderr: 26300K .......... .......... .......... .......... .......... 28% 170M 0s 2024-09-22T08:40:29.791 INFO:teuthology.orchestra.run.smithi038.stderr: 26350K .......... .......... .......... .......... .......... 28% 301M 0s 2024-09-22T08:40:29.791 INFO:teuthology.orchestra.run.smithi038.stderr: 26400K .......... .......... .......... .......... .......... 28% 361M 0s 2024-09-22T08:40:29.791 INFO:teuthology.orchestra.run.smithi038.stderr: 26450K .......... .......... .......... .......... .......... 28% 375M 0s 2024-09-22T08:40:29.791 INFO:teuthology.orchestra.run.smithi038.stderr: 26500K .......... .......... .......... .......... .......... 28% 344M 0s 2024-09-22T08:40:29.791 INFO:teuthology.orchestra.run.smithi038.stderr: 26550K .......... .......... .......... .......... .......... 28% 119M 0s 2024-09-22T08:40:29.792 INFO:teuthology.orchestra.run.smithi038.stderr: 26600K .......... .......... .......... .......... .......... 28% 360M 0s 2024-09-22T08:40:29.792 INFO:teuthology.orchestra.run.smithi038.stderr: 26650K .......... .......... .......... .......... .......... 28% 374M 0s 2024-09-22T08:40:29.792 INFO:teuthology.orchestra.run.smithi038.stderr: 26700K .......... .......... .......... .......... .......... 28% 369M 0s 2024-09-22T08:40:29.792 INFO:teuthology.orchestra.run.smithi038.stderr: 26750K .......... .......... .......... .......... .......... 28% 302M 0s 2024-09-22T08:40:29.792 INFO:teuthology.orchestra.run.smithi038.stderr: 26800K .......... .......... .......... .......... .......... 28% 370M 0s 2024-09-22T08:40:29.792 INFO:teuthology.orchestra.run.smithi038.stderr: 26850K .......... .......... .......... .......... .......... 28% 369M 0s 2024-09-22T08:40:29.792 INFO:teuthology.orchestra.run.smithi038.stderr: 26900K .......... .......... .......... .......... .......... 29% 368M 0s 2024-09-22T08:40:29.792 INFO:teuthology.orchestra.run.smithi038.stderr: 26950K .......... .......... .......... .......... .......... 29% 321M 0s 2024-09-22T08:40:29.792 INFO:teuthology.orchestra.run.smithi038.stderr: 27000K .......... .......... .......... .......... .......... 29% 372M 0s 2024-09-22T08:40:29.792 INFO:teuthology.orchestra.run.smithi038.stderr: 27050K .......... .......... .......... .......... .......... 29% 385M 0s 2024-09-22T08:40:29.792 INFO:teuthology.orchestra.run.smithi038.stderr: 27100K .......... .......... .......... .......... .......... 29% 377M 0s 2024-09-22T08:40:29.792 INFO:teuthology.orchestra.run.smithi038.stderr: 27150K .......... .......... .......... .......... .......... 29% 296M 0s 2024-09-22T08:40:29.792 INFO:teuthology.orchestra.run.smithi038.stderr: 27200K .......... .......... .......... .......... .......... 29% 384M 0s 2024-09-22T08:40:29.792 INFO:teuthology.orchestra.run.smithi038.stderr: 27250K .......... .......... .......... .......... .......... 29% 304M 0s 2024-09-22T08:40:29.792 INFO:teuthology.orchestra.run.smithi038.stderr: 27300K .......... .......... .......... .......... .......... 29% 287M 0s 2024-09-22T08:40:29.793 INFO:teuthology.orchestra.run.smithi038.stderr: 27350K .......... .......... .......... .......... .......... 29% 327M 0s 2024-09-22T08:40:29.793 INFO:teuthology.orchestra.run.smithi038.stderr: 27400K .......... .......... .......... .......... .......... 29% 368M 0s 2024-09-22T08:40:29.793 INFO:teuthology.orchestra.run.smithi038.stderr: 27450K .......... .......... .......... .......... .......... 29% 354M 0s 2024-09-22T08:40:29.793 INFO:teuthology.orchestra.run.smithi038.stderr: 27500K .......... .......... .......... .......... .......... 29% 360M 0s 2024-09-22T08:40:29.793 INFO:teuthology.orchestra.run.smithi038.stderr: 27550K .......... .......... .......... .......... .......... 29% 315M 0s 2024-09-22T08:40:29.793 INFO:teuthology.orchestra.run.smithi038.stderr: 27600K .......... .......... .......... .......... .......... 29% 376M 0s 2024-09-22T08:40:29.793 INFO:teuthology.orchestra.run.smithi038.stderr: 27650K .......... .......... .......... .......... .......... 29% 303M 0s 2024-09-22T08:40:29.793 INFO:teuthology.orchestra.run.smithi038.stderr: 27700K .......... .......... .......... .......... .......... 29% 319M 0s 2024-09-22T08:40:29.793 INFO:teuthology.orchestra.run.smithi038.stderr: 27750K .......... .......... .......... .......... .......... 29% 347M 0s 2024-09-22T08:40:29.793 INFO:teuthology.orchestra.run.smithi038.stderr: 27800K .......... .......... .......... .......... .......... 29% 336M 0s 2024-09-22T08:40:29.793 INFO:teuthology.orchestra.run.smithi038.stderr: 27850K .......... .......... .......... .......... .......... 30% 319M 0s 2024-09-22T08:40:29.793 INFO:teuthology.orchestra.run.smithi038.stderr: 27900K .......... .......... .......... .......... .......... 30% 291M 0s 2024-09-22T08:40:29.793 INFO:teuthology.orchestra.run.smithi038.stderr: 27950K .......... .......... .......... .......... .......... 30% 292M 0s 2024-09-22T08:40:29.793 INFO:teuthology.orchestra.run.smithi038.stderr: 28000K .......... .......... .......... .......... .......... 30% 380M 0s 2024-09-22T08:40:29.793 INFO:teuthology.orchestra.run.smithi038.stderr: 28050K .......... .......... .......... .......... .......... 30% 303M 0s 2024-09-22T08:40:29.794 INFO:teuthology.orchestra.run.smithi038.stderr: 28100K .......... .......... .......... .......... .......... 30% 374M 0s 2024-09-22T08:40:29.794 INFO:teuthology.orchestra.run.smithi038.stderr: 28150K .......... .......... .......... .......... .......... 30% 102M 0s 2024-09-22T08:40:29.794 INFO:teuthology.orchestra.run.smithi038.stderr: 28200K .......... .......... .......... .......... .......... 30% 115M 0s 2024-09-22T08:40:29.794 INFO:teuthology.orchestra.run.smithi038.stderr: 28250K .......... .......... .......... .......... .......... 30% 251M 0s 2024-09-22T08:40:29.794 INFO:teuthology.orchestra.run.smithi038.stderr: 28300K .......... .......... .......... .......... .......... 30% 244M 0s 2024-09-22T08:40:29.794 INFO:teuthology.orchestra.run.smithi038.stderr: 28350K .......... .......... .......... .......... .......... 30% 311M 0s 2024-09-22T08:40:29.794 INFO:teuthology.orchestra.run.smithi038.stderr: 28400K .......... .......... .......... .......... .......... 30% 66.9M 0s 2024-09-22T08:40:29.794 INFO:teuthology.orchestra.run.smithi038.stderr: 28450K .......... .......... .......... .......... .......... 30% 64.4M 0s 2024-09-22T08:40:29.794 INFO:teuthology.orchestra.run.smithi038.stderr: 28500K .......... .......... .......... .......... .......... 30% 246M 0s 2024-09-22T08:40:29.794 INFO:teuthology.orchestra.run.smithi038.stderr: 28550K .......... .......... .......... .......... .......... 30% 108M 0s 2024-09-22T08:40:29.794 INFO:teuthology.orchestra.run.smithi038.stderr: 28600K .......... .......... .......... .......... .......... 30% 370M 0s 2024-09-22T08:40:29.794 INFO:teuthology.orchestra.run.smithi038.stderr: 28650K .......... .......... .......... .......... .......... 30% 381M 0s 2024-09-22T08:40:29.794 INFO:teuthology.orchestra.run.smithi038.stderr: 28700K .......... .......... .......... .......... .......... 30% 387M 0s 2024-09-22T08:40:29.794 INFO:teuthology.orchestra.run.smithi038.stderr: 28750K .......... .......... .......... .......... .......... 31% 163M 0s 2024-09-22T08:40:29.795 INFO:teuthology.orchestra.run.smithi038.stderr: 28800K .......... .......... .......... .......... .......... 31% 374M 0s 2024-09-22T08:40:29.795 INFO:teuthology.orchestra.run.smithi038.stderr: 28850K .......... .......... .......... .......... .......... 31% 368M 0s 2024-09-22T08:40:29.795 INFO:teuthology.orchestra.run.smithi038.stderr: 28900K .......... .......... .......... .......... .......... 31% 353M 0s 2024-09-22T08:40:29.795 INFO:teuthology.orchestra.run.smithi038.stderr: 28950K .......... .......... .......... .......... .......... 31% 349M 0s 2024-09-22T08:40:29.795 INFO:teuthology.orchestra.run.smithi038.stderr: 29000K .......... .......... .......... .......... .......... 31% 342M 0s 2024-09-22T08:40:29.795 INFO:teuthology.orchestra.run.smithi038.stderr: 29050K .......... .......... .......... .......... .......... 31% 296M 0s 2024-09-22T08:40:29.795 INFO:teuthology.orchestra.run.smithi038.stderr: 29100K .......... .......... .......... .......... .......... 31% 369M 0s 2024-09-22T08:40:29.795 INFO:teuthology.orchestra.run.smithi038.stderr: 29150K .......... .......... .......... .......... .......... 31% 125M 0s 2024-09-22T08:40:29.795 INFO:teuthology.orchestra.run.smithi038.stderr: 29200K .......... .......... .......... .......... .......... 31% 352M 0s 2024-09-22T08:40:29.795 INFO:teuthology.orchestra.run.smithi038.stderr: 29250K .......... .......... .......... .......... .......... 31% 380M 0s 2024-09-22T08:40:29.795 INFO:teuthology.orchestra.run.smithi038.stderr: 29300K .......... .......... .......... .......... .......... 31% 182M 0s 2024-09-22T08:40:29.795 INFO:teuthology.orchestra.run.smithi038.stderr: 29350K .......... .......... .......... .......... .......... 31% 238M 0s 2024-09-22T08:40:29.795 INFO:teuthology.orchestra.run.smithi038.stderr: 29400K .......... .......... .......... .......... .......... 31% 315M 0s 2024-09-22T08:40:29.795 INFO:teuthology.orchestra.run.smithi038.stderr: 29450K .......... .......... .......... .......... .......... 31% 352M 0s 2024-09-22T08:40:29.795 INFO:teuthology.orchestra.run.smithi038.stderr: 29500K .......... .......... .......... .......... .......... 31% 380M 0s 2024-09-22T08:40:29.796 INFO:teuthology.orchestra.run.smithi038.stderr: 29550K .......... .......... .......... .......... .......... 31% 157M 0s 2024-09-22T08:40:29.796 INFO:teuthology.orchestra.run.smithi038.stderr: 29600K .......... .......... .......... .......... .......... 31% 338M 0s 2024-09-22T08:40:29.796 INFO:teuthology.orchestra.run.smithi038.stderr: 29650K .......... .......... .......... .......... .......... 31% 380M 0s 2024-09-22T08:40:29.796 INFO:teuthology.orchestra.run.smithi038.stderr: 29700K .......... .......... .......... .......... .......... 32% 200M 0s 2024-09-22T08:40:29.796 INFO:teuthology.orchestra.run.smithi038.stderr: 29750K .......... .......... .......... .......... .......... 32% 282M 0s 2024-09-22T08:40:29.796 INFO:teuthology.orchestra.run.smithi038.stderr: 29800K .......... .......... .......... .......... .......... 32% 364M 0s 2024-09-22T08:40:29.796 INFO:teuthology.orchestra.run.smithi038.stderr: 29850K .......... .......... .......... .......... .......... 32% 315M 0s 2024-09-22T08:40:29.796 INFO:teuthology.orchestra.run.smithi038.stderr: 29900K .......... .......... .......... .......... .......... 32% 335M 0s 2024-09-22T08:40:29.796 INFO:teuthology.orchestra.run.smithi038.stderr: 29950K .......... .......... .......... .......... .......... 32% 274M 0s 2024-09-22T08:40:29.796 INFO:teuthology.orchestra.run.smithi038.stderr: 30000K .......... .......... .......... .......... .......... 32% 373M 0s 2024-09-22T08:40:29.796 INFO:teuthology.orchestra.run.smithi038.stderr: 30050K .......... .......... .......... .......... .......... 32% 371M 0s 2024-09-22T08:40:29.796 INFO:teuthology.orchestra.run.smithi038.stderr: 30100K .......... .......... .......... .......... .......... 32% 373M 0s 2024-09-22T08:40:29.796 INFO:teuthology.orchestra.run.smithi038.stderr: 30150K .......... .......... .......... .......... .......... 32% 339M 0s 2024-09-22T08:40:29.796 INFO:teuthology.orchestra.run.smithi038.stderr: 30200K .......... .......... .......... .......... .......... 32% 361M 0s 2024-09-22T08:40:29.796 INFO:teuthology.orchestra.run.smithi038.stderr: 30250K .......... .......... .......... .......... .......... 32% 374M 0s 2024-09-22T08:40:29.797 INFO:teuthology.orchestra.run.smithi038.stderr: 30300K .......... .......... .......... .......... .......... 32% 371M 0s 2024-09-22T08:40:29.797 INFO:teuthology.orchestra.run.smithi038.stderr: 30350K .......... .......... .......... .......... .......... 32% 188M 0s 2024-09-22T08:40:29.797 INFO:teuthology.orchestra.run.smithi038.stderr: 30400K .......... .......... .......... .......... .......... 32% 371M 0s 2024-09-22T08:40:29.797 INFO:teuthology.orchestra.run.smithi038.stderr: 30450K .......... .......... .......... .......... .......... 32% 374M 0s 2024-09-22T08:40:29.797 INFO:teuthology.orchestra.run.smithi038.stderr: 30500K .......... .......... .......... .......... .......... 32% 370M 0s 2024-09-22T08:40:29.797 INFO:teuthology.orchestra.run.smithi038.stderr: 30550K .......... .......... .......... .......... .......... 32% 327M 0s 2024-09-22T08:40:29.797 INFO:teuthology.orchestra.run.smithi038.stderr: 30600K .......... .......... .......... .......... .......... 32% 378M 0s 2024-09-22T08:40:29.797 INFO:teuthology.orchestra.run.smithi038.stderr: 30650K .......... .......... .......... .......... .......... 33% 364M 0s 2024-09-22T08:40:29.797 INFO:teuthology.orchestra.run.smithi038.stderr: 30700K .......... .......... .......... .......... .......... 33% 364M 0s 2024-09-22T08:40:29.797 INFO:teuthology.orchestra.run.smithi038.stderr: 30750K .......... .......... .......... .......... .......... 33% 399M 0s 2024-09-22T08:40:29.797 INFO:teuthology.orchestra.run.smithi038.stderr: 30800K .......... .......... .......... .......... .......... 33% 342M 0s 2024-09-22T08:40:29.797 INFO:teuthology.orchestra.run.smithi038.stderr: 30850K .......... .......... .......... .......... .......... 33% 403M 0s 2024-09-22T08:40:29.797 INFO:teuthology.orchestra.run.smithi038.stderr: 30900K .......... .......... .......... .......... .......... 33% 399M 0s 2024-09-22T08:40:29.797 INFO:teuthology.orchestra.run.smithi038.stderr: 30950K .......... .......... .......... .......... .......... 33% 396M 0s 2024-09-22T08:40:29.797 INFO:teuthology.orchestra.run.smithi038.stderr: 31000K .......... .......... .......... .......... .......... 33% 338M 0s 2024-09-22T08:40:29.798 INFO:teuthology.orchestra.run.smithi038.stderr: 31050K .......... .......... .......... .......... .......... 33% 406M 0s 2024-09-22T08:40:29.798 INFO:teuthology.orchestra.run.smithi038.stderr: 31100K .......... .......... .......... .......... .......... 33% 406M 0s 2024-09-22T08:40:29.798 INFO:teuthology.orchestra.run.smithi038.stderr: 31150K .......... .......... .......... .......... .......... 33% 97.3M 0s 2024-09-22T08:40:29.798 INFO:teuthology.orchestra.run.smithi038.stderr: 31200K .......... .......... .......... .......... .......... 33% 318M 0s 2024-09-22T08:40:29.798 INFO:teuthology.orchestra.run.smithi038.stderr: 31250K .......... .......... .......... .......... .......... 33% 346M 0s 2024-09-22T08:40:29.798 INFO:teuthology.orchestra.run.smithi038.stderr: 31300K .......... .......... .......... .......... .......... 33% 271M 0s 2024-09-22T08:40:29.798 INFO:teuthology.orchestra.run.smithi038.stderr: 31350K .......... .......... .......... .......... .......... 33% 193M 0s 2024-09-22T08:40:29.798 INFO:teuthology.orchestra.run.smithi038.stderr: 31400K .......... .......... .......... .......... .......... 33% 169M 0s 2024-09-22T08:40:29.798 INFO:teuthology.orchestra.run.smithi038.stderr: 31450K .......... .......... .......... .......... .......... 33% 90.8M 0s 2024-09-22T08:40:29.798 INFO:teuthology.orchestra.run.smithi038.stderr: 31500K .......... .......... .......... .......... .......... 33% 307M 0s 2024-09-22T08:40:29.798 INFO:teuthology.orchestra.run.smithi038.stderr: 31550K .......... .......... .......... .......... .......... 34% 61.8M 0s 2024-09-22T08:40:29.798 INFO:teuthology.orchestra.run.smithi038.stderr: 31600K .......... .......... .......... .......... .......... 34% 65.8M 0s 2024-09-22T08:40:29.798 INFO:teuthology.orchestra.run.smithi038.stderr: 31650K .......... .......... .......... .......... .......... 34% 392M 0s 2024-09-22T08:40:29.798 INFO:teuthology.orchestra.run.smithi038.stderr: 31700K .......... .......... .......... .......... .......... 34% 149M 0s 2024-09-22T08:40:29.798 INFO:teuthology.orchestra.run.smithi038.stderr: 31750K .......... .......... .......... .......... .......... 34% 297M 0s 2024-09-22T08:40:29.799 INFO:teuthology.orchestra.run.smithi038.stderr: 31800K .......... .......... .......... .......... .......... 34% 356M 0s 2024-09-22T08:40:29.799 INFO:teuthology.orchestra.run.smithi038.stderr: 31850K .......... .......... .......... .......... .......... 34% 352M 0s 2024-09-22T08:40:29.799 INFO:teuthology.orchestra.run.smithi038.stderr: 31900K .......... .......... .......... .......... .......... 34% 375M 0s 2024-09-22T08:40:29.799 INFO:teuthology.orchestra.run.smithi038.stderr: 31950K .......... .......... .......... .......... .......... 34% 322M 0s 2024-09-22T08:40:29.799 INFO:teuthology.orchestra.run.smithi038.stderr: 32000K .......... .......... .......... .......... .......... 34% 370M 0s 2024-09-22T08:40:29.799 INFO:teuthology.orchestra.run.smithi038.stderr: 32050K .......... .......... .......... .......... .......... 34% 374M 0s 2024-09-22T08:40:29.799 INFO:teuthology.orchestra.run.smithi038.stderr: 32100K .......... .......... .......... .......... .......... 34% 378M 0s 2024-09-22T08:40:29.799 INFO:teuthology.orchestra.run.smithi038.stderr: 32150K .......... .......... .......... .......... .......... 34% 128M 0s 2024-09-22T08:40:29.799 INFO:teuthology.orchestra.run.smithi038.stderr: 32200K .......... .......... .......... .......... .......... 34% 379M 0s 2024-09-22T08:40:29.799 INFO:teuthology.orchestra.run.smithi038.stderr: 32250K .......... .......... .......... .......... .......... 34% 383M 0s 2024-09-22T08:40:29.799 INFO:teuthology.orchestra.run.smithi038.stderr: 32300K .......... .......... .......... .......... .......... 34% 218M 0s 2024-09-22T08:40:29.799 INFO:teuthology.orchestra.run.smithi038.stderr: 32350K .......... .......... .......... .......... .......... 34% 242M 0s 2024-09-22T08:40:29.799 INFO:teuthology.orchestra.run.smithi038.stderr: 32400K .......... .......... .......... .......... .......... 34% 299M 0s 2024-09-22T08:40:29.800 INFO:teuthology.orchestra.run.smithi038.stderr: 32450K .......... .......... .......... .......... .......... 34% 303M 0s 2024-09-22T08:40:29.800 INFO:teuthology.orchestra.run.smithi038.stderr: 32500K .......... .......... .......... .......... .......... 35% 381M 0s 2024-09-22T08:40:29.800 INFO:teuthology.orchestra.run.smithi038.stderr: 32550K .......... .......... .......... .......... .......... 35% 145M 0s 2024-09-22T08:40:29.800 INFO:teuthology.orchestra.run.smithi038.stderr: 32600K .......... .......... .......... .......... .......... 35% 373M 0s 2024-09-22T08:40:29.800 INFO:teuthology.orchestra.run.smithi038.stderr: 32650K .......... .......... .......... .......... .......... 35% 388M 0s 2024-09-22T08:40:29.800 INFO:teuthology.orchestra.run.smithi038.stderr: 32700K .......... .......... .......... .......... .......... 35% 233M 0s 2024-09-22T08:40:29.800 INFO:teuthology.orchestra.run.smithi038.stderr: 32750K .......... .......... .......... .......... .......... 35% 310M 0s 2024-09-22T08:40:29.800 INFO:teuthology.orchestra.run.smithi038.stderr: 32800K .......... .......... .......... .......... .......... 35% 378M 0s 2024-09-22T08:40:29.800 INFO:teuthology.orchestra.run.smithi038.stderr: 32850K .......... .......... .......... .......... .......... 35% 228M 0s 2024-09-22T08:40:29.800 INFO:teuthology.orchestra.run.smithi038.stderr: 32900K .......... .......... .......... .......... .......... 35% 374M 0s 2024-09-22T08:40:29.801 INFO:teuthology.orchestra.run.smithi038.stderr: 32950K .......... .......... .......... .......... .......... 35% 338M 0s 2024-09-22T08:40:29.801 INFO:teuthology.orchestra.run.smithi038.stderr: 33000K .......... .......... .......... .......... .......... 35% 363M 0s 2024-09-22T08:40:29.801 INFO:teuthology.orchestra.run.smithi038.stderr: 33050K .......... .......... .......... .......... .......... 35% 292M 0s 2024-09-22T08:40:29.801 INFO:teuthology.orchestra.run.smithi038.stderr: 33100K .......... .......... .......... .......... .......... 35% 348M 0s 2024-09-22T08:40:29.801 INFO:teuthology.orchestra.run.smithi038.stderr: 33150K .......... .......... .......... .......... .......... 35% 261M 0s 2024-09-22T08:40:29.801 INFO:teuthology.orchestra.run.smithi038.stderr: 33200K .......... .......... .......... .......... .......... 35% 370M 0s 2024-09-22T08:40:29.801 INFO:teuthology.orchestra.run.smithi038.stderr: 33250K .......... .......... .......... .......... .......... 35% 372M 0s 2024-09-22T08:40:29.801 INFO:teuthology.orchestra.run.smithi038.stderr: 33300K .......... .......... .......... .......... .......... 35% 385M 0s 2024-09-22T08:40:29.801 INFO:teuthology.orchestra.run.smithi038.stderr: 33350K .......... .......... .......... .......... .......... 35% 328M 0s 2024-09-22T08:40:29.802 INFO:teuthology.orchestra.run.smithi038.stderr: 33400K .......... .......... .......... .......... .......... 36% 380M 0s 2024-09-22T08:40:29.802 INFO:teuthology.orchestra.run.smithi038.stderr: 33450K .......... .......... .......... .......... .......... 36% 378M 0s 2024-09-22T08:40:29.802 INFO:teuthology.orchestra.run.smithi038.stderr: 33500K .......... .......... .......... .......... .......... 36% 379M 0s 2024-09-22T08:40:29.802 INFO:teuthology.orchestra.run.smithi038.stderr: 33550K .......... .......... .......... .......... .......... 36% 315M 0s 2024-09-22T08:40:29.802 INFO:teuthology.orchestra.run.smithi038.stderr: 33600K .......... .......... .......... .......... .......... 36% 373M 0s 2024-09-22T08:40:29.802 INFO:teuthology.orchestra.run.smithi038.stderr: 33650K .......... .......... .......... .......... .......... 36% 385M 0s 2024-09-22T08:40:29.802 INFO:teuthology.orchestra.run.smithi038.stderr: 33700K .......... .......... .......... .......... .......... 36% 235M 0s 2024-09-22T08:40:29.802 INFO:teuthology.orchestra.run.smithi038.stderr: 33750K .......... .......... .......... .......... .......... 36% 333M 0s 2024-09-22T08:40:29.802 INFO:teuthology.orchestra.run.smithi038.stderr: 33800K .......... .......... .......... .......... .......... 36% 379M 0s 2024-09-22T08:40:29.802 INFO:teuthology.orchestra.run.smithi038.stderr: 33850K .......... .......... .......... .......... .......... 36% 384M 0s 2024-09-22T08:40:29.802 INFO:teuthology.orchestra.run.smithi038.stderr: 33900K .......... .......... .......... .......... .......... 36% 381M 0s 2024-09-22T08:40:29.802 INFO:teuthology.orchestra.run.smithi038.stderr: 33950K .......... .......... .......... .......... .......... 36% 315M 0s 2024-09-22T08:40:29.802 INFO:teuthology.orchestra.run.smithi038.stderr: 34000K .......... .......... .......... .......... .......... 36% 382M 0s 2024-09-22T08:40:29.803 INFO:teuthology.orchestra.run.smithi038.stderr: 34050K .......... .......... .......... .......... .......... 36% 358M 0s 2024-09-22T08:40:29.803 INFO:teuthology.orchestra.run.smithi038.stderr: 34100K .......... .......... .......... .......... .......... 36% 385M 0s 2024-09-22T08:40:29.803 INFO:teuthology.orchestra.run.smithi038.stderr: 34150K .......... .......... .......... .......... .......... 36% 351M 0s 2024-09-22T08:40:29.803 INFO:teuthology.orchestra.run.smithi038.stderr: 34200K .......... .......... .......... .......... .......... 36% 169M 0s 2024-09-22T08:40:29.803 INFO:teuthology.orchestra.run.smithi038.stderr: 34250K .......... .......... .......... .......... .......... 36% 224M 0s 2024-09-22T08:40:29.803 INFO:teuthology.orchestra.run.smithi038.stderr: 34300K .......... .......... .......... .......... .......... 36% 241M 0s 2024-09-22T08:40:29.803 INFO:teuthology.orchestra.run.smithi038.stderr: 34350K .......... .......... .......... .......... .......... 37% 317M 0s 2024-09-22T08:40:29.803 INFO:teuthology.orchestra.run.smithi038.stderr: 34400K .......... .......... .......... .......... .......... 37% 148M 0s 2024-09-22T08:40:29.803 INFO:teuthology.orchestra.run.smithi038.stderr: 34450K .......... .......... .......... .......... .......... 37% 279M 0s 2024-09-22T08:40:29.803 INFO:teuthology.orchestra.run.smithi038.stderr: 34500K .......... .......... .......... .......... .......... 37% 91.3M 0s 2024-09-22T08:40:29.803 INFO:teuthology.orchestra.run.smithi038.stderr: 34550K .......... .......... .......... .......... .......... 37% 268M 0s 2024-09-22T08:40:29.803 INFO:teuthology.orchestra.run.smithi038.stderr: 34600K .......... .......... .......... .......... .......... 37% 65.3M 0s 2024-09-22T08:40:29.803 INFO:teuthology.orchestra.run.smithi038.stderr: 34650K .......... .......... .......... .......... .......... 37% 100M 0s 2024-09-22T08:40:29.803 INFO:teuthology.orchestra.run.smithi038.stderr: 34700K .......... .......... .......... .......... .......... 37% 67.9M 0s 2024-09-22T08:40:29.803 INFO:teuthology.orchestra.run.smithi038.stderr: 34750K .......... .......... .......... .......... .......... 37% 233M 0s 2024-09-22T08:40:29.804 INFO:teuthology.orchestra.run.smithi038.stderr: 34800K .......... .......... .......... .......... .......... 37% 356M 0s 2024-09-22T08:40:29.804 INFO:teuthology.orchestra.run.smithi038.stderr: 34850K .......... .......... .......... .......... .......... 37% 373M 0s 2024-09-22T08:40:29.804 INFO:teuthology.orchestra.run.smithi038.stderr: 34900K .......... .......... .......... .......... .......... 37% 365M 0s 2024-09-22T08:40:29.804 INFO:teuthology.orchestra.run.smithi038.stderr: 34950K .......... .......... .......... .......... .......... 37% 315M 0s 2024-09-22T08:40:29.804 INFO:teuthology.orchestra.run.smithi038.stderr: 35000K .......... .......... .......... .......... .......... 37% 356M 0s 2024-09-22T08:40:29.804 INFO:teuthology.orchestra.run.smithi038.stderr: 35050K .......... .......... .......... .......... .......... 37% 363M 0s 2024-09-22T08:40:29.804 INFO:teuthology.orchestra.run.smithi038.stderr: 35100K .......... .......... .......... .......... .......... 37% 368M 0s 2024-09-22T08:40:29.804 INFO:teuthology.orchestra.run.smithi038.stderr: 35150K .......... .......... .......... .......... .......... 37% 324M 0s 2024-09-22T08:40:29.804 INFO:teuthology.orchestra.run.smithi038.stderr: 35200K .......... .......... .......... .......... .......... 37% 370M 0s 2024-09-22T08:40:29.804 INFO:teuthology.orchestra.run.smithi038.stderr: 35250K .......... .......... .......... .......... .......... 37% 393M 0s 2024-09-22T08:40:29.804 INFO:teuthology.orchestra.run.smithi038.stderr: 35300K .......... .......... .......... .......... .......... 38% 347M 0s 2024-09-22T08:40:29.804 INFO:teuthology.orchestra.run.smithi038.stderr: 35350K .......... .......... .......... .......... .......... 38% 123M 0s 2024-09-22T08:40:29.804 INFO:teuthology.orchestra.run.smithi038.stderr: 35400K .......... .......... .......... .......... .......... 38% 370M 0s 2024-09-22T08:40:29.804 INFO:teuthology.orchestra.run.smithi038.stderr: 35450K .......... .......... .......... .......... .......... 38% 387M 0s 2024-09-22T08:40:29.804 INFO:teuthology.orchestra.run.smithi038.stderr: 35500K .......... .......... .......... .......... .......... 38% 177M 0s 2024-09-22T08:40:29.805 INFO:teuthology.orchestra.run.smithi038.stderr: 35550K .......... .......... .......... .......... .......... 38% 281M 0s 2024-09-22T08:40:29.805 INFO:teuthology.orchestra.run.smithi038.stderr: 35600K .......... .......... .......... .......... .......... 38% 272M 0s 2024-09-22T08:40:29.805 INFO:teuthology.orchestra.run.smithi038.stderr: 35650K .......... .......... .......... .......... .......... 38% 108M 0s 2024-09-22T08:40:29.805 INFO:teuthology.orchestra.run.smithi038.stderr: 35700K .......... .......... .......... .......... .......... 38% 250M 0s 2024-09-22T08:40:29.805 INFO:teuthology.orchestra.run.smithi038.stderr: 35750K .......... .......... .......... .......... .......... 38% 271M 0s 2024-09-22T08:40:29.805 INFO:teuthology.orchestra.run.smithi038.stderr: 35800K .......... .......... .......... .......... .......... 38% 299M 0s 2024-09-22T08:40:29.805 INFO:teuthology.orchestra.run.smithi038.stderr: 35850K .......... .......... .......... .......... .......... 38% 359M 0s 2024-09-22T08:40:29.805 INFO:teuthology.orchestra.run.smithi038.stderr: 35900K .......... .......... .......... .......... .......... 38% 346M 0s 2024-09-22T08:40:29.805 INFO:teuthology.orchestra.run.smithi038.stderr: 35950K .......... .......... .......... .......... .......... 38% 302M 0s 2024-09-22T08:40:29.805 INFO:teuthology.orchestra.run.smithi038.stderr: 36000K .......... .......... .......... .......... .......... 38% 368M 0s 2024-09-22T08:40:29.805 INFO:teuthology.orchestra.run.smithi038.stderr: 36050K .......... .......... .......... .......... .......... 38% 357M 0s 2024-09-22T08:40:29.805 INFO:teuthology.orchestra.run.smithi038.stderr: 36100K .......... .......... .......... .......... .......... 38% 365M 0s 2024-09-22T08:40:29.805 INFO:teuthology.orchestra.run.smithi038.stderr: 36150K .......... .......... .......... .......... .......... 38% 353M 0s 2024-09-22T08:40:29.805 INFO:teuthology.orchestra.run.smithi038.stderr: 36200K .......... .......... .......... .......... .......... 39% 366M 0s 2024-09-22T08:40:29.806 INFO:teuthology.orchestra.run.smithi038.stderr: 36250K .......... .......... .......... .......... .......... 39% 368M 0s 2024-09-22T08:40:29.806 INFO:teuthology.orchestra.run.smithi038.stderr: 36300K .......... .......... .......... .......... .......... 39% 381M 0s 2024-09-22T08:40:29.806 INFO:teuthology.orchestra.run.smithi038.stderr: 36350K .......... .......... .......... .......... .......... 39% 296M 0s 2024-09-22T08:40:29.806 INFO:teuthology.orchestra.run.smithi038.stderr: 36400K .......... .......... .......... .......... .......... 39% 354M 0s 2024-09-22T08:40:29.806 INFO:teuthology.orchestra.run.smithi038.stderr: 36450K .......... .......... .......... .......... .......... 39% 379M 0s 2024-09-22T08:40:29.806 INFO:teuthology.orchestra.run.smithi038.stderr: 36500K .......... .......... .......... .......... .......... 39% 367M 0s 2024-09-22T08:40:29.806 INFO:teuthology.orchestra.run.smithi038.stderr: 36550K .......... .......... .......... .......... .......... 39% 332M 0s 2024-09-22T08:40:29.806 INFO:teuthology.orchestra.run.smithi038.stderr: 36600K .......... .......... .......... .......... .......... 39% 363M 0s 2024-09-22T08:40:29.806 INFO:teuthology.orchestra.run.smithi038.stderr: 36650K .......... .......... .......... .......... .......... 39% 386M 0s 2024-09-22T08:40:29.806 INFO:teuthology.orchestra.run.smithi038.stderr: 36700K .......... .......... .......... .......... .......... 39% 383M 0s 2024-09-22T08:40:29.806 INFO:teuthology.orchestra.run.smithi038.stderr: 36750K .......... .......... .......... .......... .......... 39% 277M 0s 2024-09-22T08:40:29.806 INFO:teuthology.orchestra.run.smithi038.stderr: 36800K .......... .......... .......... .......... .......... 39% 326M 0s 2024-09-22T08:40:29.806 INFO:teuthology.orchestra.run.smithi038.stderr: 36850K .......... .......... .......... .......... .......... 39% 326M 0s 2024-09-22T08:40:29.806 INFO:teuthology.orchestra.run.smithi038.stderr: 36900K .......... .......... .......... .......... .......... 39% 330M 0s 2024-09-22T08:40:29.807 INFO:teuthology.orchestra.run.smithi038.stderr: 36950K .......... .......... .......... .......... .......... 39% 310M 0s 2024-09-22T08:40:29.807 INFO:teuthology.orchestra.run.smithi038.stderr: 37000K .......... .......... .......... .......... .......... 39% 330M 0s 2024-09-22T08:40:29.807 INFO:teuthology.orchestra.run.smithi038.stderr: 37050K .......... .......... .......... .......... .......... 39% 385M 0s 2024-09-22T08:40:29.807 INFO:teuthology.orchestra.run.smithi038.stderr: 37100K .......... .......... .......... .......... .......... 39% 362M 0s 2024-09-22T08:40:29.807 INFO:teuthology.orchestra.run.smithi038.stderr: 37150K .......... .......... .......... .......... .......... 40% 269M 0s 2024-09-22T08:40:29.807 INFO:teuthology.orchestra.run.smithi038.stderr: 37200K .......... .......... .......... .......... .......... 40% 330M 0s 2024-09-22T08:40:29.807 INFO:teuthology.orchestra.run.smithi038.stderr: 37250K .......... .......... .......... .......... .......... 40% 385M 0s 2024-09-22T08:40:29.807 INFO:teuthology.orchestra.run.smithi038.stderr: 37300K .......... .......... .......... .......... .......... 40% 264M 0s 2024-09-22T08:40:29.807 INFO:teuthology.orchestra.run.smithi038.stderr: 37350K .......... .......... .......... .......... .......... 40% 241M 0s 2024-09-22T08:40:29.807 INFO:teuthology.orchestra.run.smithi038.stderr: 37400K .......... .......... .......... .......... .......... 40% 366M 0s 2024-09-22T08:40:29.807 INFO:teuthology.orchestra.run.smithi038.stderr: 37450K .......... .......... .......... .......... .......... 40% 315M 0s 2024-09-22T08:40:29.807 INFO:teuthology.orchestra.run.smithi038.stderr: 37500K .......... .......... .......... .......... .......... 40% 363M 0s 2024-09-22T08:40:29.807 INFO:teuthology.orchestra.run.smithi038.stderr: 37550K .......... .......... .......... .......... .......... 40% 114M 0s 2024-09-22T08:40:29.807 INFO:teuthology.orchestra.run.smithi038.stderr: 37600K .......... .......... .......... .......... .......... 40% 351M 0s 2024-09-22T08:40:29.807 INFO:teuthology.orchestra.run.smithi038.stderr: 37650K .......... .......... .......... .......... .......... 40% 43.8M 0s 2024-09-22T08:40:29.807 INFO:teuthology.orchestra.run.smithi038.stderr: 37700K .......... .......... .......... .......... .......... 40% 254M 0s 2024-09-22T08:40:29.808 INFO:teuthology.orchestra.run.smithi038.stderr: 37750K .......... .......... .......... .......... .......... 40% 64.1M 0s 2024-09-22T08:40:29.808 INFO:teuthology.orchestra.run.smithi038.stderr: 37800K .......... .......... .......... .......... .......... 40% 349M 0s 2024-09-22T08:40:29.808 INFO:teuthology.orchestra.run.smithi038.stderr: 37850K .......... .......... .......... .......... .......... 40% 361M 0s 2024-09-22T08:40:29.808 INFO:teuthology.orchestra.run.smithi038.stderr: 37900K .......... .......... .......... .......... .......... 40% 199M 0s 2024-09-22T08:40:29.808 INFO:teuthology.orchestra.run.smithi038.stderr: 37950K .......... .......... .......... .......... .......... 40% 115M 0s 2024-09-22T08:40:29.808 INFO:teuthology.orchestra.run.smithi038.stderr: 38000K .......... .......... .......... .......... .......... 40% 363M 0s 2024-09-22T08:40:29.808 INFO:teuthology.orchestra.run.smithi038.stderr: 38050K .......... .......... .......... .......... .......... 41% 354M 0s 2024-09-22T08:40:29.808 INFO:teuthology.orchestra.run.smithi038.stderr: 38100K .......... .......... .......... .......... .......... 41% 371M 0s 2024-09-22T08:40:29.808 INFO:teuthology.orchestra.run.smithi038.stderr: 38150K .......... .......... .......... .......... .......... 41% 343M 0s 2024-09-22T08:40:29.808 INFO:teuthology.orchestra.run.smithi038.stderr: 38200K .......... .......... .......... .......... .......... 41% 379M 0s 2024-09-22T08:40:29.808 INFO:teuthology.orchestra.run.smithi038.stderr: 38250K .......... .......... .......... .......... .......... 41% 360M 0s 2024-09-22T08:40:29.808 INFO:teuthology.orchestra.run.smithi038.stderr: 38300K .......... .......... .......... .......... .......... 41% 337M 0s 2024-09-22T08:40:29.808 INFO:teuthology.orchestra.run.smithi038.stderr: 38350K .......... .......... .......... .......... .......... 41% 325M 0s 2024-09-22T08:40:29.808 INFO:teuthology.orchestra.run.smithi038.stderr: 38400K .......... .......... .......... .......... .......... 41% 203M 0s 2024-09-22T08:40:29.808 INFO:teuthology.orchestra.run.smithi038.stderr: 38450K .......... .......... .......... .......... .......... 41% 250M 0s 2024-09-22T08:40:29.809 INFO:teuthology.orchestra.run.smithi038.stderr: 38500K .......... .......... .......... .......... .......... 41% 359M 0s 2024-09-22T08:40:29.809 INFO:teuthology.orchestra.run.smithi038.stderr: 38550K .......... .......... .......... .......... .......... 41% 221M 0s 2024-09-22T08:40:29.809 INFO:teuthology.orchestra.run.smithi038.stderr: 38600K .......... .......... .......... .......... .......... 41% 354M 0s 2024-09-22T08:40:29.809 INFO:teuthology.orchestra.run.smithi038.stderr: 38650K .......... .......... .......... .......... .......... 41% 336M 0s 2024-09-22T08:40:29.809 INFO:teuthology.orchestra.run.smithi038.stderr: 38700K .......... .......... .......... .......... .......... 41% 147M 0s 2024-09-22T08:40:29.809 INFO:teuthology.orchestra.run.smithi038.stderr: 38750K .......... .......... .......... .......... .......... 41% 242M 0s 2024-09-22T08:40:29.809 INFO:teuthology.orchestra.run.smithi038.stderr: 38800K .......... .......... .......... .......... .......... 41% 388M 0s 2024-09-22T08:40:29.809 INFO:teuthology.orchestra.run.smithi038.stderr: 38850K .......... .......... .......... .......... .......... 41% 266M 0s 2024-09-22T08:40:29.809 INFO:teuthology.orchestra.run.smithi038.stderr: 38900K .......... .......... .......... .......... .......... 41% 155M 0s 2024-09-22T08:40:29.809 INFO:teuthology.orchestra.run.smithi038.stderr: 38950K .......... .......... .......... .......... .......... 41% 151M 0s 2024-09-22T08:40:29.809 INFO:teuthology.orchestra.run.smithi038.stderr: 39000K .......... .......... .......... .......... .......... 42% 372M 0s 2024-09-22T08:40:29.809 INFO:teuthology.orchestra.run.smithi038.stderr: 39050K .......... .......... .......... .......... .......... 42% 364M 0s 2024-09-22T08:40:29.809 INFO:teuthology.orchestra.run.smithi038.stderr: 39100K .......... .......... .......... .......... .......... 42% 381M 0s 2024-09-22T08:40:29.809 INFO:teuthology.orchestra.run.smithi038.stderr: 39150K .......... .......... .......... .......... .......... 42% 298M 0s 2024-09-22T08:40:29.809 INFO:teuthology.orchestra.run.smithi038.stderr: 39200K .......... .......... .......... .......... .......... 42% 374M 0s 2024-09-22T08:40:29.810 INFO:teuthology.orchestra.run.smithi038.stderr: 39250K .......... .......... .......... .......... .......... 42% 368M 0s 2024-09-22T08:40:29.810 INFO:teuthology.orchestra.run.smithi038.stderr: 39300K .......... .......... .......... .......... .......... 42% 335M 0s 2024-09-22T08:40:29.810 INFO:teuthology.orchestra.run.smithi038.stderr: 39350K .......... .......... .......... .......... .......... 42% 323M 0s 2024-09-22T08:40:29.810 INFO:teuthology.orchestra.run.smithi038.stderr: 39400K .......... .......... .......... .......... .......... 42% 368M 0s 2024-09-22T08:40:29.810 INFO:teuthology.orchestra.run.smithi038.stderr: 39450K .......... .......... .......... .......... .......... 42% 383M 0s 2024-09-22T08:40:29.810 INFO:teuthology.orchestra.run.smithi038.stderr: 39500K .......... .......... .......... .......... .......... 42% 360M 0s 2024-09-22T08:40:29.810 INFO:teuthology.orchestra.run.smithi038.stderr: 39550K .......... .......... .......... .......... .......... 42% 308M 0s 2024-09-22T08:40:29.810 INFO:teuthology.orchestra.run.smithi038.stderr: 39600K .......... .......... .......... .......... .......... 42% 378M 0s 2024-09-22T08:40:29.810 INFO:teuthology.orchestra.run.smithi038.stderr: 39650K .......... .......... .......... .......... .......... 42% 378M 0s 2024-09-22T08:40:29.810 INFO:teuthology.orchestra.run.smithi038.stderr: 39700K .......... .......... .......... .......... .......... 42% 327M 0s 2024-09-22T08:40:29.810 INFO:teuthology.orchestra.run.smithi038.stderr: 39750K .......... .......... .......... .......... .......... 42% 327M 0s 2024-09-22T08:40:29.810 INFO:teuthology.orchestra.run.smithi038.stderr: 39800K .......... .......... .......... .......... .......... 42% 312M 0s 2024-09-22T08:40:29.810 INFO:teuthology.orchestra.run.smithi038.stderr: 39850K .......... .......... .......... .......... .......... 42% 284M 0s 2024-09-22T08:40:29.810 INFO:teuthology.orchestra.run.smithi038.stderr: 39900K .......... .......... .......... .......... .......... 43% 307M 0s 2024-09-22T08:40:29.811 INFO:teuthology.orchestra.run.smithi038.stderr: 39950K .......... .......... .......... .......... .......... 43% 281M 0s 2024-09-22T08:40:29.811 INFO:teuthology.orchestra.run.smithi038.stderr: 40000K .......... .......... .......... .......... .......... 43% 220M 0s 2024-09-22T08:40:29.811 INFO:teuthology.orchestra.run.smithi038.stderr: 40050K .......... .......... .......... .......... .......... 43% 174M 0s 2024-09-22T08:40:29.811 INFO:teuthology.orchestra.run.smithi038.stderr: 40100K .......... .......... .......... .......... .......... 43% 232M 0s 2024-09-22T08:40:29.811 INFO:teuthology.orchestra.run.smithi038.stderr: 40150K .......... .......... .......... .......... .......... 43% 289M 0s 2024-09-22T08:40:29.811 INFO:teuthology.orchestra.run.smithi038.stderr: 40200K .......... .......... .......... .......... .......... 43% 362M 0s 2024-09-22T08:40:29.811 INFO:teuthology.orchestra.run.smithi038.stderr: 40250K .......... .......... .......... .......... .......... 43% 355M 0s 2024-09-22T08:40:29.811 INFO:teuthology.orchestra.run.smithi038.stderr: 40300K .......... .......... .......... .......... .......... 43% 363M 0s 2024-09-22T08:40:29.811 INFO:teuthology.orchestra.run.smithi038.stderr: 40350K .......... .......... .......... .......... .......... 43% 314M 0s 2024-09-22T08:40:29.811 INFO:teuthology.orchestra.run.smithi038.stderr: 40400K .......... .......... .......... .......... .......... 43% 361M 0s 2024-09-22T08:40:29.811 INFO:teuthology.orchestra.run.smithi038.stderr: 40450K .......... .......... .......... .......... .......... 43% 357M 0s 2024-09-22T08:40:29.811 INFO:teuthology.orchestra.run.smithi038.stderr: 40500K .......... .......... .......... .......... .......... 43% 368M 0s 2024-09-22T08:40:29.811 INFO:teuthology.orchestra.run.smithi038.stderr: 40550K .......... .......... .......... .......... .......... 43% 335M 0s 2024-09-22T08:40:29.812 INFO:teuthology.orchestra.run.smithi038.stderr: 40600K .......... .......... .......... .......... .......... 43% 380M 0s 2024-09-22T08:40:29.812 INFO:teuthology.orchestra.run.smithi038.stderr: 40650K .......... .......... .......... .......... .......... 43% 387M 0s 2024-09-22T08:40:29.812 INFO:teuthology.orchestra.run.smithi038.stderr: 40700K .......... .......... .......... .......... .......... 43% 65.4M 0s 2024-09-22T08:40:29.812 INFO:teuthology.orchestra.run.smithi038.stderr: 40750K .......... .......... .......... .......... .......... 43% 102M 0s 2024-09-22T08:40:29.812 INFO:teuthology.orchestra.run.smithi038.stderr: 40800K .......... .......... .......... .......... .......... 43% 77.5M 0s 2024-09-22T08:40:29.812 INFO:teuthology.orchestra.run.smithi038.stderr: 40850K .......... .......... .......... .......... .......... 44% 351M 0s 2024-09-22T08:40:29.812 INFO:teuthology.orchestra.run.smithi038.stderr: 40900K .......... .......... .......... .......... .......... 44% 353M 0s 2024-09-22T08:40:29.812 INFO:teuthology.orchestra.run.smithi038.stderr: 40950K .......... .......... .......... .......... .......... 44% 184M 0s 2024-09-22T08:40:29.812 INFO:teuthology.orchestra.run.smithi038.stderr: 41000K .......... .......... .......... .......... .......... 44% 151M 0s 2024-09-22T08:40:29.812 INFO:teuthology.orchestra.run.smithi038.stderr: 41050K .......... .......... .......... .......... .......... 44% 231M 0s 2024-09-22T08:40:29.812 INFO:teuthology.orchestra.run.smithi038.stderr: 41100K .......... .......... .......... .......... .......... 44% 307M 0s 2024-09-22T08:40:29.812 INFO:teuthology.orchestra.run.smithi038.stderr: 41150K .......... .......... .......... .......... .......... 44% 247M 0s 2024-09-22T08:40:29.812 INFO:teuthology.orchestra.run.smithi038.stderr: 41200K .......... .......... .......... .......... .......... 44% 269M 0s 2024-09-22T08:40:29.813 INFO:teuthology.orchestra.run.smithi038.stderr: 41250K .......... .......... .......... .......... .......... 44% 347M 0s 2024-09-22T08:40:29.813 INFO:teuthology.orchestra.run.smithi038.stderr: 41300K .......... .......... .......... .......... .......... 44% 309M 0s 2024-09-22T08:40:29.813 INFO:teuthology.orchestra.run.smithi038.stderr: 41350K .......... .......... .......... .......... .......... 44% 342M 0s 2024-09-22T08:40:29.813 INFO:teuthology.orchestra.run.smithi038.stderr: 41400K .......... .......... .......... .......... .......... 44% 296M 0s 2024-09-22T08:40:29.813 INFO:teuthology.orchestra.run.smithi038.stderr: 41450K .......... .......... .......... .......... .......... 44% 363M 0s 2024-09-22T08:40:29.813 INFO:teuthology.orchestra.run.smithi038.stderr: 41500K .......... .......... .......... .......... .......... 44% 308M 0s 2024-09-22T08:40:29.813 INFO:teuthology.orchestra.run.smithi038.stderr: 41550K .......... .......... .......... .......... .......... 44% 303M 0s 2024-09-22T08:40:29.813 INFO:teuthology.orchestra.run.smithi038.stderr: 41600K .......... .......... .......... .......... .......... 44% 375M 0s 2024-09-22T08:40:29.813 INFO:teuthology.orchestra.run.smithi038.stderr: 41650K .......... .......... .......... .......... .......... 44% 230M 0s 2024-09-22T08:40:29.813 INFO:teuthology.orchestra.run.smithi038.stderr: 41700K .......... .......... .......... .......... .......... 44% 297M 0s 2024-09-22T08:40:29.813 INFO:teuthology.orchestra.run.smithi038.stderr: 41750K .......... .......... .......... .......... .......... 44% 160M 0s 2024-09-22T08:40:29.813 INFO:teuthology.orchestra.run.smithi038.stderr: 41800K .......... .......... .......... .......... .......... 45% 368M 0s 2024-09-22T08:40:29.813 INFO:teuthology.orchestra.run.smithi038.stderr: 41850K .......... .......... .......... .......... .......... 45% 209M 0s 2024-09-22T08:40:29.813 INFO:teuthology.orchestra.run.smithi038.stderr: 41900K .......... .......... .......... .......... .......... 45% 363M 0s 2024-09-22T08:40:29.813 INFO:teuthology.orchestra.run.smithi038.stderr: 41950K .......... .......... .......... .......... .......... 45% 225M 0s 2024-09-22T08:40:29.814 INFO:teuthology.orchestra.run.smithi038.stderr: 42000K .......... .......... .......... .......... .......... 45% 110M 0s 2024-09-22T08:40:29.814 INFO:teuthology.orchestra.run.smithi038.stderr: 42050K .......... .......... .......... .......... .......... 45% 352M 0s 2024-09-22T08:40:29.814 INFO:teuthology.orchestra.run.smithi038.stderr: 42100K .......... .......... .......... .......... .......... 45% 368M 0s 2024-09-22T08:40:29.814 INFO:teuthology.orchestra.run.smithi038.stderr: 42150K .......... .......... .......... .......... .......... 45% 336M 0s 2024-09-22T08:40:29.814 INFO:teuthology.orchestra.run.smithi038.stderr: 42200K .......... .......... .......... .......... .......... 45% 357M 0s 2024-09-22T08:40:29.814 INFO:teuthology.orchestra.run.smithi038.stderr: 42250K .......... .......... .......... .......... .......... 45% 354M 0s 2024-09-22T08:40:29.814 INFO:teuthology.orchestra.run.smithi038.stderr: 42300K .......... .......... .......... .......... .......... 45% 232M 0s 2024-09-22T08:40:29.814 INFO:teuthology.orchestra.run.smithi038.stderr: 42350K .......... .......... .......... .......... .......... 45% 257M 0s 2024-09-22T08:40:29.814 INFO:teuthology.orchestra.run.smithi038.stderr: 42400K .......... .......... .......... .......... .......... 45% 304M 0s 2024-09-22T08:40:29.814 INFO:teuthology.orchestra.run.smithi038.stderr: 42450K .......... .......... .......... .......... .......... 45% 287M 0s 2024-09-22T08:40:29.814 INFO:teuthology.orchestra.run.smithi038.stderr: 42500K .......... .......... .......... .......... .......... 45% 322M 0s 2024-09-22T08:40:29.814 INFO:teuthology.orchestra.run.smithi038.stderr: 42550K .......... .......... .......... .......... .......... 45% 277M 0s 2024-09-22T08:40:29.815 INFO:teuthology.orchestra.run.smithi038.stderr: 42600K .......... .......... .......... .......... .......... 45% 311M 0s 2024-09-22T08:40:29.815 INFO:teuthology.orchestra.run.smithi038.stderr: 42650K .......... .......... .......... .......... .......... 45% 290M 0s 2024-09-22T08:40:29.815 INFO:teuthology.orchestra.run.smithi038.stderr: 42700K .......... .......... .......... .......... .......... 46% 344M 0s 2024-09-22T08:40:29.815 INFO:teuthology.orchestra.run.smithi038.stderr: 42750K .......... .......... .......... .......... .......... 46% 302M 0s 2024-09-22T08:40:29.815 INFO:teuthology.orchestra.run.smithi038.stderr: 42800K .......... .......... .......... .......... .......... 46% 366M 0s 2024-09-22T08:40:29.815 INFO:teuthology.orchestra.run.smithi038.stderr: 42850K .......... .......... .......... .......... .......... 46% 372M 0s 2024-09-22T08:40:29.815 INFO:teuthology.orchestra.run.smithi038.stderr: 42900K .......... .......... .......... .......... .......... 46% 370M 0s 2024-09-22T08:40:29.815 INFO:teuthology.orchestra.run.smithi038.stderr: 42950K .......... .......... .......... .......... .......... 46% 311M 0s 2024-09-22T08:40:29.815 INFO:teuthology.orchestra.run.smithi038.stderr: 43000K .......... .......... .......... .......... .......... 46% 357M 0s 2024-09-22T08:40:29.815 INFO:teuthology.orchestra.run.smithi038.stderr: 43050K .......... .......... .......... .......... .......... 46% 362M 0s 2024-09-22T08:40:29.815 INFO:teuthology.orchestra.run.smithi038.stderr: 43100K .......... .......... .......... .......... .......... 46% 350M 0s 2024-09-22T08:40:29.815 INFO:teuthology.orchestra.run.smithi038.stderr: 43150K .......... .......... .......... .......... .......... 46% 235M 0s 2024-09-22T08:40:29.815 INFO:teuthology.orchestra.run.smithi038.stderr: 43200K .......... .......... .......... .......... .......... 46% 292M 0s 2024-09-22T08:40:29.815 INFO:teuthology.orchestra.run.smithi038.stderr: 43250K .......... .......... .......... .......... .......... 46% 298M 0s 2024-09-22T08:40:29.815 INFO:teuthology.orchestra.run.smithi038.stderr: 43300K .......... .......... .......... .......... .......... 46% 338M 0s 2024-09-22T08:40:29.816 INFO:teuthology.orchestra.run.smithi038.stderr: 43350K .......... .......... .......... .......... .......... 46% 366M 0s 2024-09-22T08:40:29.816 INFO:teuthology.orchestra.run.smithi038.stderr: 43400K .......... .......... .......... .......... .......... 46% 356M 0s 2024-09-22T08:40:29.816 INFO:teuthology.orchestra.run.smithi038.stderr: 43450K .......... .......... .......... .......... .......... 46% 334M 0s 2024-09-22T08:40:29.816 INFO:teuthology.orchestra.run.smithi038.stderr: 43500K .......... .......... .......... .......... .......... 46% 316M 0s 2024-09-22T08:40:29.816 INFO:teuthology.orchestra.run.smithi038.stderr: 43550K .......... .......... .......... .......... .......... 46% 366M 0s 2024-09-22T08:40:29.816 INFO:teuthology.orchestra.run.smithi038.stderr: 43600K .......... .......... .......... .......... .......... 46% 55.2M 0s 2024-09-22T08:40:29.816 INFO:teuthology.orchestra.run.smithi038.stderr: 43650K .......... .......... .......... .......... .......... 47% 203M 0s 2024-09-22T08:40:29.816 INFO:teuthology.orchestra.run.smithi038.stderr: 43700K .......... .......... .......... .......... .......... 47% 338M 0s 2024-09-22T08:40:29.816 INFO:teuthology.orchestra.run.smithi038.stderr: 43750K .......... .......... .......... .......... .......... 47% 337M 0s 2024-09-22T08:40:29.816 INFO:teuthology.orchestra.run.smithi038.stderr: 43800K .......... .......... .......... .......... .......... 47% 243M 0s 2024-09-22T08:40:29.816 INFO:teuthology.orchestra.run.smithi038.stderr: 43850K .......... .......... .......... .......... .......... 47% 361M 0s 2024-09-22T08:40:29.816 INFO:teuthology.orchestra.run.smithi038.stderr: 43900K .......... .......... .......... .......... .......... 47% 96.9M 0s 2024-09-22T08:40:29.816 INFO:teuthology.orchestra.run.smithi038.stderr: 43950K .......... .......... .......... .......... .......... 47% 114M 0s 2024-09-22T08:40:29.816 INFO:teuthology.orchestra.run.smithi038.stderr: 44000K .......... .......... .......... .......... .......... 47% 340M 0s 2024-09-22T08:40:29.817 INFO:teuthology.orchestra.run.smithi038.stderr: 44050K .......... .......... .......... .......... .......... 47% 267M 0s 2024-09-22T08:40:29.817 INFO:teuthology.orchestra.run.smithi038.stderr: 44100K .......... .......... .......... .......... .......... 47% 167M 0s 2024-09-22T08:40:29.817 INFO:teuthology.orchestra.run.smithi038.stderr: 44150K .......... .......... .......... .......... .......... 47% 213M 0s 2024-09-22T08:40:29.817 INFO:teuthology.orchestra.run.smithi038.stderr: 44200K .......... .......... .......... .......... .......... 47% 332M 0s 2024-09-22T08:40:29.817 INFO:teuthology.orchestra.run.smithi038.stderr: 44250K .......... .......... .......... .......... .......... 47% 284M 0s 2024-09-22T08:40:29.817 INFO:teuthology.orchestra.run.smithi038.stderr: 44300K .......... .......... .......... .......... .......... 47% 226M 0s 2024-09-22T08:40:29.817 INFO:teuthology.orchestra.run.smithi038.stderr: 44350K .......... .......... .......... .......... .......... 47% 261M 0s 2024-09-22T08:40:29.817 INFO:teuthology.orchestra.run.smithi038.stderr: 44400K .......... .......... .......... .......... .......... 47% 359M 0s 2024-09-22T08:40:29.817 INFO:teuthology.orchestra.run.smithi038.stderr: 44450K .......... .......... .......... .......... .......... 47% 263M 0s 2024-09-22T08:40:29.817 INFO:teuthology.orchestra.run.smithi038.stderr: 44500K .......... .......... .......... .......... .......... 47% 357M 0s 2024-09-22T08:40:29.817 INFO:teuthology.orchestra.run.smithi038.stderr: 44550K .......... .......... .......... .......... .......... 48% 321M 0s 2024-09-22T08:40:29.817 INFO:teuthology.orchestra.run.smithi038.stderr: 44600K .......... .......... .......... .......... .......... 48% 357M 0s 2024-09-22T08:40:29.817 INFO:teuthology.orchestra.run.smithi038.stderr: 44650K .......... .......... .......... .......... .......... 48% 348M 0s 2024-09-22T08:40:29.817 INFO:teuthology.orchestra.run.smithi038.stderr: 44700K .......... .......... .......... .......... .......... 48% 352M 0s 2024-09-22T08:40:29.817 INFO:teuthology.orchestra.run.smithi038.stderr: 44750K .......... .......... .......... .......... .......... 48% 310M 0s 2024-09-22T08:40:29.818 INFO:teuthology.orchestra.run.smithi038.stderr: 44800K .......... .......... .......... .......... .......... 48% 302M 0s 2024-09-22T08:40:29.818 INFO:teuthology.orchestra.run.smithi038.stderr: 44850K .......... .......... .......... .......... .......... 48% 361M 0s 2024-09-22T08:40:29.818 INFO:teuthology.orchestra.run.smithi038.stderr: 44900K .......... .......... .......... .......... .......... 48% 102M 0s 2024-09-22T08:40:29.818 INFO:teuthology.orchestra.run.smithi038.stderr: 44950K .......... .......... .......... .......... .......... 48% 312M 0s 2024-09-22T08:40:29.818 INFO:teuthology.orchestra.run.smithi038.stderr: 45000K .......... .......... .......... .......... .......... 48% 342M 0s 2024-09-22T08:40:29.818 INFO:teuthology.orchestra.run.smithi038.stderr: 45050K .......... .......... .......... .......... .......... 48% 384M 0s 2024-09-22T08:40:29.818 INFO:teuthology.orchestra.run.smithi038.stderr: 45100K .......... .......... .......... .......... .......... 48% 107M 0s 2024-09-22T08:40:29.818 INFO:teuthology.orchestra.run.smithi038.stderr: 45150K .......... .......... .......... .......... .......... 48% 294M 0s 2024-09-22T08:40:29.818 INFO:teuthology.orchestra.run.smithi038.stderr: 45200K .......... .......... .......... .......... .......... 48% 355M 0s 2024-09-22T08:40:29.818 INFO:teuthology.orchestra.run.smithi038.stderr: 45250K .......... .......... .......... .......... .......... 48% 369M 0s 2024-09-22T08:40:29.818 INFO:teuthology.orchestra.run.smithi038.stderr: 45300K .......... .......... .......... .......... .......... 48% 382M 0s 2024-09-22T08:40:29.818 INFO:teuthology.orchestra.run.smithi038.stderr: 45350K .......... .......... .......... .......... .......... 48% 297M 0s 2024-09-22T08:40:29.818 INFO:teuthology.orchestra.run.smithi038.stderr: 45400K .......... .......... .......... .......... .......... 48% 243M 0s 2024-09-22T08:40:29.818 INFO:teuthology.orchestra.run.smithi038.stderr: 45450K .......... .......... .......... .......... .......... 48% 346M 0s 2024-09-22T08:40:29.819 INFO:teuthology.orchestra.run.smithi038.stderr: 45500K .......... .......... .......... .......... .......... 49% 354M 0s 2024-09-22T08:40:29.819 INFO:teuthology.orchestra.run.smithi038.stderr: 45550K .......... .......... .......... .......... .......... 49% 310M 0s 2024-09-22T08:40:29.819 INFO:teuthology.orchestra.run.smithi038.stderr: 45600K .......... .......... .......... .......... .......... 49% 240M 0s 2024-09-22T08:40:29.819 INFO:teuthology.orchestra.run.smithi038.stderr: 45650K .......... .......... .......... .......... .......... 49% 364M 0s 2024-09-22T08:40:29.819 INFO:teuthology.orchestra.run.smithi038.stderr: 45700K .......... .......... .......... .......... .......... 49% 259M 0s 2024-09-22T08:40:29.819 INFO:teuthology.orchestra.run.smithi038.stderr: 45750K .......... .......... .......... .......... .......... 49% 315M 0s 2024-09-22T08:40:29.819 INFO:teuthology.orchestra.run.smithi038.stderr: 45800K .......... .......... .......... .......... .......... 49% 367M 0s 2024-09-22T08:40:29.819 INFO:teuthology.orchestra.run.smithi038.stderr: 45850K .......... .......... .......... .......... .......... 49% 205M 0s 2024-09-22T08:40:29.819 INFO:teuthology.orchestra.run.smithi038.stderr: 45900K .......... .......... .......... .......... .......... 49% 283M 0s 2024-09-22T08:40:29.819 INFO:teuthology.orchestra.run.smithi038.stderr: 45950K .......... .......... .......... .......... .......... 49% 299M 0s 2024-09-22T08:40:29.819 INFO:teuthology.orchestra.run.smithi038.stderr: 46000K .......... .......... .......... .......... .......... 49% 383M 0s 2024-09-22T08:40:29.819 INFO:teuthology.orchestra.run.smithi038.stderr: 46050K .......... .......... .......... .......... .......... 49% 369M 0s 2024-09-22T08:40:29.819 INFO:teuthology.orchestra.run.smithi038.stderr: 46100K .......... .......... .......... .......... .......... 49% 181M 0s 2024-09-22T08:40:29.819 INFO:teuthology.orchestra.run.smithi038.stderr: 46150K .......... .......... .......... .......... .......... 49% 316M 0s 2024-09-22T08:40:29.819 INFO:teuthology.orchestra.run.smithi038.stderr: 46200K .......... .......... .......... .......... .......... 49% 342M 0s 2024-09-22T08:40:29.820 INFO:teuthology.orchestra.run.smithi038.stderr: 46250K .......... .......... .......... .......... .......... 49% 333M 0s 2024-09-22T08:40:29.820 INFO:teuthology.orchestra.run.smithi038.stderr: 46300K .......... .......... .......... .......... .......... 49% 358M 0s 2024-09-22T08:40:29.820 INFO:teuthology.orchestra.run.smithi038.stderr: 46350K .......... .......... .......... .......... .......... 49% 304M 0s 2024-09-22T08:40:29.820 INFO:teuthology.orchestra.run.smithi038.stderr: 46400K .......... .......... .......... .......... .......... 49% 365M 0s 2024-09-22T08:40:29.820 INFO:teuthology.orchestra.run.smithi038.stderr: 46450K .......... .......... .......... .......... .......... 50% 211M 0s 2024-09-22T08:40:29.820 INFO:teuthology.orchestra.run.smithi038.stderr: 46500K .......... .......... .......... .......... .......... 50% 364M 0s 2024-09-22T08:40:29.820 INFO:teuthology.orchestra.run.smithi038.stderr: 46550K .......... .......... .......... .......... .......... 50% 341M 0s 2024-09-22T08:40:29.820 INFO:teuthology.orchestra.run.smithi038.stderr: 46600K .......... .......... .......... .......... .......... 50% 68.0M 0s 2024-09-22T08:40:29.820 INFO:teuthology.orchestra.run.smithi038.stderr: 46650K .......... .......... .......... .......... .......... 50% 358M 0s 2024-09-22T08:40:29.820 INFO:teuthology.orchestra.run.smithi038.stderr: 46700K .......... .......... .......... .......... .......... 50% 369M 0s 2024-09-22T08:40:29.820 INFO:teuthology.orchestra.run.smithi038.stderr: 46750K .......... .......... .......... .......... .......... 50% 285M 0s 2024-09-22T08:40:29.820 INFO:teuthology.orchestra.run.smithi038.stderr: 46800K .......... .......... .......... .......... .......... 50% 248M 0s 2024-09-22T08:40:29.820 INFO:teuthology.orchestra.run.smithi038.stderr: 46850K .......... .......... .......... .......... .......... 50% 353M 0s 2024-09-22T08:40:29.820 INFO:teuthology.orchestra.run.smithi038.stderr: 46900K .......... .......... .......... .......... .......... 50% 87.0M 0s 2024-09-22T08:40:29.821 INFO:teuthology.orchestra.run.smithi038.stderr: 46950K .......... .......... .......... .......... .......... 50% 216M 0s 2024-09-22T08:40:29.821 INFO:teuthology.orchestra.run.smithi038.stderr: 47000K .......... .......... .......... .......... .......... 50% 134M 0s 2024-09-22T08:40:29.821 INFO:teuthology.orchestra.run.smithi038.stderr: 47050K .......... .......... .......... .......... .......... 50% 364M 0s 2024-09-22T08:40:29.821 INFO:teuthology.orchestra.run.smithi038.stderr: 47100K .......... .......... .......... .......... .......... 50% 362M 0s 2024-09-22T08:40:29.821 INFO:teuthology.orchestra.run.smithi038.stderr: 47150K .......... .......... .......... .......... .......... 50% 261M 0s 2024-09-22T08:40:29.821 INFO:teuthology.orchestra.run.smithi038.stderr: 47200K .......... .......... .......... .......... .......... 50% 359M 0s 2024-09-22T08:40:29.821 INFO:teuthology.orchestra.run.smithi038.stderr: 47250K .......... .......... .......... .......... .......... 50% 141M 0s 2024-09-22T08:40:29.821 INFO:teuthology.orchestra.run.smithi038.stderr: 47300K .......... .......... .......... .......... .......... 50% 223M 0s 2024-09-22T08:40:29.821 INFO:teuthology.orchestra.run.smithi038.stderr: 47350K .......... .......... .......... .......... .......... 51% 319M 0s 2024-09-22T08:40:29.821 INFO:teuthology.orchestra.run.smithi038.stderr: 47400K .......... .......... .......... .......... .......... 51% 389M 0s 2024-09-22T08:40:29.821 INFO:teuthology.orchestra.run.smithi038.stderr: 47450K .......... .......... .......... .......... .......... 51% 192M 0s 2024-09-22T08:40:29.821 INFO:teuthology.orchestra.run.smithi038.stderr: 47500K .......... .......... .......... .......... .......... 51% 288M 0s 2024-09-22T08:40:29.821 INFO:teuthology.orchestra.run.smithi038.stderr: 47550K .......... .......... .......... .......... .......... 51% 283M 0s 2024-09-22T08:40:29.821 INFO:teuthology.orchestra.run.smithi038.stderr: 47600K .......... .......... .......... .......... .......... 51% 219M 0s 2024-09-22T08:40:29.821 INFO:teuthology.orchestra.run.smithi038.stderr: 47650K .......... .......... .......... .......... .......... 51% 286M 0s 2024-09-22T08:40:29.821 INFO:teuthology.orchestra.run.smithi038.stderr: 47700K .......... .......... .......... .......... .......... 51% 380M 0s 2024-09-22T08:40:29.822 INFO:teuthology.orchestra.run.smithi038.stderr: 47750K .......... .......... .......... .......... .......... 51% 270M 0s 2024-09-22T08:40:29.822 INFO:teuthology.orchestra.run.smithi038.stderr: 47800K .......... .......... .......... .......... .......... 51% 353M 0s 2024-09-22T08:40:29.822 INFO:teuthology.orchestra.run.smithi038.stderr: 47850K .......... .......... .......... .......... .......... 51% 387M 0s 2024-09-22T08:40:29.822 INFO:teuthology.orchestra.run.smithi038.stderr: 47900K .......... .......... .......... .......... .......... 51% 376M 0s 2024-09-22T08:40:29.822 INFO:teuthology.orchestra.run.smithi038.stderr: 47950K .......... .......... .......... .......... .......... 51% 116M 0s 2024-09-22T08:40:29.822 INFO:teuthology.orchestra.run.smithi038.stderr: 48000K .......... .......... .......... .......... .......... 51% 357M 0s 2024-09-22T08:40:29.822 INFO:teuthology.orchestra.run.smithi038.stderr: 48050K .......... .......... .......... .......... .......... 51% 110M 0s 2024-09-22T08:40:29.822 INFO:teuthology.orchestra.run.smithi038.stderr: 48100K .......... .......... .......... .......... .......... 51% 333M 0s 2024-09-22T08:40:29.822 INFO:teuthology.orchestra.run.smithi038.stderr: 48150K .......... .......... .......... .......... .......... 51% 339M 0s 2024-09-22T08:40:29.822 INFO:teuthology.orchestra.run.smithi038.stderr: 48200K .......... .......... .......... .......... .......... 51% 357M 0s 2024-09-22T08:40:29.822 INFO:teuthology.orchestra.run.smithi038.stderr: 48250K .......... .......... .......... .......... .......... 51% 373M 0s 2024-09-22T08:40:29.822 INFO:teuthology.orchestra.run.smithi038.stderr: 48300K .......... .......... .......... .......... .......... 52% 350M 0s 2024-09-22T08:40:29.822 INFO:teuthology.orchestra.run.smithi038.stderr: 48350K .......... .......... .......... .......... .......... 52% 306M 0s 2024-09-22T08:40:29.822 INFO:teuthology.orchestra.run.smithi038.stderr: 48400K .......... .......... .......... .......... .......... 52% 367M 0s 2024-09-22T08:40:29.822 INFO:teuthology.orchestra.run.smithi038.stderr: 48450K .......... .......... .......... .......... .......... 52% 114M 0s 2024-09-22T08:40:29.823 INFO:teuthology.orchestra.run.smithi038.stderr: 48500K .......... .......... .......... .......... .......... 52% 363M 0s 2024-09-22T08:40:29.823 INFO:teuthology.orchestra.run.smithi038.stderr: 48550K .......... .......... .......... .......... .......... 52% 316M 0s 2024-09-22T08:40:29.823 INFO:teuthology.orchestra.run.smithi038.stderr: 48600K .......... .......... .......... .......... .......... 52% 375M 0s 2024-09-22T08:40:29.823 INFO:teuthology.orchestra.run.smithi038.stderr: 48650K .......... .......... .......... .......... .......... 52% 372M 0s 2024-09-22T08:40:29.823 INFO:teuthology.orchestra.run.smithi038.stderr: 48700K .......... .......... .......... .......... .......... 52% 377M 0s 2024-09-22T08:40:29.823 INFO:teuthology.orchestra.run.smithi038.stderr: 48750K .......... .......... .......... .......... .......... 52% 313M 0s 2024-09-22T08:40:29.823 INFO:teuthology.orchestra.run.smithi038.stderr: 48800K .......... .......... .......... .......... .......... 52% 387M 0s 2024-09-22T08:40:29.823 INFO:teuthology.orchestra.run.smithi038.stderr: 48850K .......... .......... .......... .......... .......... 52% 236M 0s 2024-09-22T08:40:29.823 INFO:teuthology.orchestra.run.smithi038.stderr: 48900K .......... .......... .......... .......... .......... 52% 361M 0s 2024-09-22T08:40:29.823 INFO:teuthology.orchestra.run.smithi038.stderr: 48950K .......... .......... .......... .......... .......... 52% 331M 0s 2024-09-22T08:40:29.823 INFO:teuthology.orchestra.run.smithi038.stderr: 49000K .......... .......... .......... .......... .......... 52% 379M 0s 2024-09-22T08:40:29.823 INFO:teuthology.orchestra.run.smithi038.stderr: 49050K .......... .......... .......... .......... .......... 52% 144M 0s 2024-09-22T08:40:29.823 INFO:teuthology.orchestra.run.smithi038.stderr: 49100K .......... .......... .......... .......... .......... 52% 358M 0s 2024-09-22T08:40:29.823 INFO:teuthology.orchestra.run.smithi038.stderr: 49150K .......... .......... .......... .......... .......... 52% 239M 0s 2024-09-22T08:40:29.824 INFO:teuthology.orchestra.run.smithi038.stderr: 49200K .......... .......... .......... .......... .......... 53% 292M 0s 2024-09-22T08:40:29.824 INFO:teuthology.orchestra.run.smithi038.stderr: 49250K .......... .......... .......... .......... .......... 53% 364M 0s 2024-09-22T08:40:29.824 INFO:teuthology.orchestra.run.smithi038.stderr: 49300K .......... .......... .......... .......... .......... 53% 364M 0s 2024-09-22T08:40:29.824 INFO:teuthology.orchestra.run.smithi038.stderr: 49350K .......... .......... .......... .......... .......... 53% 333M 0s 2024-09-22T08:40:29.824 INFO:teuthology.orchestra.run.smithi038.stderr: 49400K .......... .......... .......... .......... .......... 53% 367M 0s 2024-09-22T08:40:29.824 INFO:teuthology.orchestra.run.smithi038.stderr: 49450K .......... .......... .......... .......... .......... 53% 346M 0s 2024-09-22T08:40:29.824 INFO:teuthology.orchestra.run.smithi038.stderr: 49500K .......... .......... .......... .......... .......... 53% 351M 0s 2024-09-22T08:40:29.824 INFO:teuthology.orchestra.run.smithi038.stderr: 49550K .......... .......... .......... .......... .......... 53% 288M 0s 2024-09-22T08:40:29.824 INFO:teuthology.orchestra.run.smithi038.stderr: 49600K .......... .......... .......... .......... .......... 53% 66.3M 0s 2024-09-22T08:40:29.824 INFO:teuthology.orchestra.run.smithi038.stderr: 49650K .......... .......... .......... .......... .......... 53% 340M 0s 2024-09-22T08:40:29.824 INFO:teuthology.orchestra.run.smithi038.stderr: 49700K .......... .......... .......... .......... .......... 53% 367M 0s 2024-09-22T08:40:29.824 INFO:teuthology.orchestra.run.smithi038.stderr: 49750K .......... .......... .......... .......... .......... 53% 337M 0s 2024-09-22T08:40:29.824 INFO:teuthology.orchestra.run.smithi038.stderr: 49800K .......... .......... .......... .......... .......... 53% 380M 0s 2024-09-22T08:40:29.824 INFO:teuthology.orchestra.run.smithi038.stderr: 49850K .......... .......... .......... .......... .......... 53% 242M 0s 2024-09-22T08:40:29.825 INFO:teuthology.orchestra.run.smithi038.stderr: 49900K .......... .......... .......... .......... .......... 53% 112M 0s 2024-09-22T08:40:29.825 INFO:teuthology.orchestra.run.smithi038.stderr: 49950K .......... .......... .......... .......... .......... 53% 153M 0s 2024-09-22T08:40:29.825 INFO:teuthology.orchestra.run.smithi038.stderr: 50000K .......... .......... .......... .......... .......... 53% 374M 0s 2024-09-22T08:40:29.825 INFO:teuthology.orchestra.run.smithi038.stderr: 50050K .......... .......... .......... .......... .......... 53% 248M 0s 2024-09-22T08:40:29.825 INFO:teuthology.orchestra.run.smithi038.stderr: 50100K .......... .......... .......... .......... .......... 53% 159M 0s 2024-09-22T08:40:29.825 INFO:teuthology.orchestra.run.smithi038.stderr: 50150K .......... .......... .......... .......... .......... 54% 223M 0s 2024-09-22T08:40:29.825 INFO:teuthology.orchestra.run.smithi038.stderr: 50200K .......... .......... .......... .......... .......... 54% 353M 0s 2024-09-22T08:40:29.825 INFO:teuthology.orchestra.run.smithi038.stderr: 50250K .......... .......... .......... .......... .......... 54% 315M 0s 2024-09-22T08:40:29.825 INFO:teuthology.orchestra.run.smithi038.stderr: 50300K .......... .......... .......... .......... .......... 54% 354M 0s 2024-09-22T08:40:29.825 INFO:teuthology.orchestra.run.smithi038.stderr: 50350K .......... .......... .......... .......... .......... 54% 231M 0s 2024-09-22T08:40:29.825 INFO:teuthology.orchestra.run.smithi038.stderr: 50400K .......... .......... .......... .......... .......... 54% 106M 0s 2024-09-22T08:40:29.825 INFO:teuthology.orchestra.run.smithi038.stderr: 50450K .......... .......... .......... .......... .......... 54% 284M 0s 2024-09-22T08:40:29.825 INFO:teuthology.orchestra.run.smithi038.stderr: 50500K .......... .......... .......... .......... .......... 54% 307M 0s 2024-09-22T08:40:29.825 INFO:teuthology.orchestra.run.smithi038.stderr: 50550K .......... .......... .......... .......... .......... 54% 314M 0s 2024-09-22T08:40:29.825 INFO:teuthology.orchestra.run.smithi038.stderr: 50600K .......... .......... .......... .......... .......... 54% 347M 0s 2024-09-22T08:40:29.825 INFO:teuthology.orchestra.run.smithi038.stderr: 50650K .......... .......... .......... .......... .......... 54% 310M 0s 2024-09-22T08:40:29.826 INFO:teuthology.orchestra.run.smithi038.stderr: 50700K .......... .......... .......... .......... .......... 54% 369M 0s 2024-09-22T08:40:29.826 INFO:teuthology.orchestra.run.smithi038.stderr: 50750K .......... .......... .......... .......... .......... 54% 302M 0s 2024-09-22T08:40:29.826 INFO:teuthology.orchestra.run.smithi038.stderr: 50800K .......... .......... .......... .......... .......... 54% 330M 0s 2024-09-22T08:40:29.826 INFO:teuthology.orchestra.run.smithi038.stderr: 50850K .......... .......... .......... .......... .......... 54% 77.1M 0s 2024-09-22T08:40:29.826 INFO:teuthology.orchestra.run.smithi038.stderr: 50900K .......... .......... .......... .......... .......... 54% 289M 0s 2024-09-22T08:40:29.826 INFO:teuthology.orchestra.run.smithi038.stderr: 50950K .......... .......... .......... .......... .......... 54% 322M 0s 2024-09-22T08:40:29.826 INFO:teuthology.orchestra.run.smithi038.stderr: 51000K .......... .......... .......... .......... .......... 54% 381M 0s 2024-09-22T08:40:29.826 INFO:teuthology.orchestra.run.smithi038.stderr: 51050K .......... .......... .......... .......... .......... 55% 150M 0s 2024-09-22T08:40:29.826 INFO:teuthology.orchestra.run.smithi038.stderr: 51100K .......... .......... .......... .......... .......... 55% 356M 0s 2024-09-22T08:40:29.826 INFO:teuthology.orchestra.run.smithi038.stderr: 51150K .......... .......... .......... .......... .......... 55% 323M 0s 2024-09-22T08:40:29.826 INFO:teuthology.orchestra.run.smithi038.stderr: 51200K .......... .......... .......... .......... .......... 55% 362M 0s 2024-09-22T08:40:29.826 INFO:teuthology.orchestra.run.smithi038.stderr: 51250K .......... .......... .......... .......... .......... 55% 387M 0s 2024-09-22T08:40:29.826 INFO:teuthology.orchestra.run.smithi038.stderr: 51300K .......... .......... .......... .......... .......... 55% 305M 0s 2024-09-22T08:40:29.826 INFO:teuthology.orchestra.run.smithi038.stderr: 51350K .......... .......... .......... .......... .......... 55% 365M 0s 2024-09-22T08:40:29.827 INFO:teuthology.orchestra.run.smithi038.stderr: 51400K .......... .......... .......... .......... .......... 55% 358M 0s 2024-09-22T08:40:29.827 INFO:teuthology.orchestra.run.smithi038.stderr: 51450K .......... .......... .......... .......... .......... 55% 370M 0s 2024-09-22T08:40:29.827 INFO:teuthology.orchestra.run.smithi038.stderr: 51500K .......... .......... .......... .......... .......... 55% 151M 0s 2024-09-22T08:40:29.827 INFO:teuthology.orchestra.run.smithi038.stderr: 51550K .......... .......... .......... .......... .......... 55% 296M 0s 2024-09-22T08:40:29.827 INFO:teuthology.orchestra.run.smithi038.stderr: 51600K .......... .......... .......... .......... .......... 55% 357M 0s 2024-09-22T08:40:29.827 INFO:teuthology.orchestra.run.smithi038.stderr: 51650K .......... .......... .......... .......... .......... 55% 275M 0s 2024-09-22T08:40:29.827 INFO:teuthology.orchestra.run.smithi038.stderr: 51700K .......... .......... .......... .......... .......... 55% 282M 0s 2024-09-22T08:40:29.827 INFO:teuthology.orchestra.run.smithi038.stderr: 51750K .......... .......... .......... .......... .......... 55% 378M 0s 2024-09-22T08:40:29.827 INFO:teuthology.orchestra.run.smithi038.stderr: 51800K .......... .......... .......... .......... .......... 55% 314M 0s 2024-09-22T08:40:29.827 INFO:teuthology.orchestra.run.smithi038.stderr: 51850K .......... .......... .......... .......... .......... 55% 286M 0s 2024-09-22T08:40:29.827 INFO:teuthology.orchestra.run.smithi038.stderr: 51900K .......... .......... .......... .......... .......... 55% 283M 0s 2024-09-22T08:40:29.827 INFO:teuthology.orchestra.run.smithi038.stderr: 51950K .......... .......... .......... .......... .......... 55% 355M 0s 2024-09-22T08:40:29.827 INFO:teuthology.orchestra.run.smithi038.stderr: 52000K .......... .......... .......... .......... .......... 56% 340M 0s 2024-09-22T08:40:29.827 INFO:teuthology.orchestra.run.smithi038.stderr: 52050K .......... .......... .......... .......... .......... 56% 365M 0s 2024-09-22T08:40:29.827 INFO:teuthology.orchestra.run.smithi038.stderr: 52100K .......... .......... .......... .......... .......... 56% 312M 0s 2024-09-22T08:40:29.828 INFO:teuthology.orchestra.run.smithi038.stderr: 52150K .......... .......... .......... .......... .......... 56% 362M 0s 2024-09-22T08:40:29.828 INFO:teuthology.orchestra.run.smithi038.stderr: 52200K .......... .......... .......... .......... .......... 56% 182M 0s 2024-09-22T08:40:29.828 INFO:teuthology.orchestra.run.smithi038.stderr: 52250K .......... .......... .......... .......... .......... 56% 368M 0s 2024-09-22T08:40:29.828 INFO:teuthology.orchestra.run.smithi038.stderr: 52300K .......... .......... .......... .......... .......... 56% 291M 0s 2024-09-22T08:40:29.828 INFO:teuthology.orchestra.run.smithi038.stderr: 52350K .......... .......... .......... .......... .......... 56% 365M 0s 2024-09-22T08:40:29.828 INFO:teuthology.orchestra.run.smithi038.stderr: 52400K .......... .......... .......... .......... .......... 56% 366M 0s 2024-09-22T08:40:29.828 INFO:teuthology.orchestra.run.smithi038.stderr: 52450K .......... .......... .......... .......... .......... 56% 357M 0s 2024-09-22T08:40:29.828 INFO:teuthology.orchestra.run.smithi038.stderr: 52500K .......... .......... .......... .......... .......... 56% 333M 0s 2024-09-22T08:40:29.828 INFO:teuthology.orchestra.run.smithi038.stderr: 52550K .......... .......... .......... .......... .......... 56% 298M 0s 2024-09-22T08:40:29.828 INFO:teuthology.orchestra.run.smithi038.stderr: 52600K .......... .......... .......... .......... .......... 56% 369M 0s 2024-09-22T08:40:29.828 INFO:teuthology.orchestra.run.smithi038.stderr: 52650K .......... .......... .......... .......... .......... 56% 72.6M 0s 2024-09-22T08:40:29.828 INFO:teuthology.orchestra.run.smithi038.stderr: 52700K .......... .......... .......... .......... .......... 56% 158M 0s 2024-09-22T08:40:29.828 INFO:teuthology.orchestra.run.smithi038.stderr: 52750K .......... .......... .......... .......... .......... 56% 321M 0s 2024-09-22T08:40:29.828 INFO:teuthology.orchestra.run.smithi038.stderr: 52800K .......... .......... .......... .......... .......... 56% 334M 0s 2024-09-22T08:40:29.828 INFO:teuthology.orchestra.run.smithi038.stderr: 52850K .......... .......... .......... .......... .......... 56% 330M 0s 2024-09-22T08:40:29.829 INFO:teuthology.orchestra.run.smithi038.stderr: 52900K .......... .......... .......... .......... .......... 56% 311M 0s 2024-09-22T08:40:29.829 INFO:teuthology.orchestra.run.smithi038.stderr: 52950K .......... .......... .......... .......... .......... 57% 169M 0s 2024-09-22T08:40:29.829 INFO:teuthology.orchestra.run.smithi038.stderr: 53000K .......... .......... .......... .......... .......... 57% 249M 0s 2024-09-22T08:40:29.829 INFO:teuthology.orchestra.run.smithi038.stderr: 53050K .......... .......... .......... .......... .......... 57% 338M 0s 2024-09-22T08:40:29.829 INFO:teuthology.orchestra.run.smithi038.stderr: 53100K .......... .......... .......... .......... .......... 57% 145M 0s 2024-09-22T08:40:29.829 INFO:teuthology.orchestra.run.smithi038.stderr: 53150K .......... .......... .......... .......... .......... 57% 270M 0s 2024-09-22T08:40:29.829 INFO:teuthology.orchestra.run.smithi038.stderr: 53200K .......... .......... .......... .......... .......... 57% 152M 0s 2024-09-22T08:40:29.829 INFO:teuthology.orchestra.run.smithi038.stderr: 53250K .......... .......... .......... .......... .......... 57% 366M 0s 2024-09-22T08:40:29.829 INFO:teuthology.orchestra.run.smithi038.stderr: 53300K .......... .......... .......... .......... .......... 57% 321M 0s 2024-09-22T08:40:29.829 INFO:teuthology.orchestra.run.smithi038.stderr: 53350K .......... .......... .......... .......... .......... 57% 240M 0s 2024-09-22T08:40:29.829 INFO:teuthology.orchestra.run.smithi038.stderr: 53400K .......... .......... .......... .......... .......... 57% 234M 0s 2024-09-22T08:40:29.829 INFO:teuthology.orchestra.run.smithi038.stderr: 53450K .......... .......... .......... .......... .......... 57% 379M 0s 2024-09-22T08:40:29.829 INFO:teuthology.orchestra.run.smithi038.stderr: 53500K .......... .......... .......... .......... .......... 57% 134M 0s 2024-09-22T08:40:29.829 INFO:teuthology.orchestra.run.smithi038.stderr: 53550K .......... .......... .......... .......... .......... 57% 205M 0s 2024-09-22T08:40:29.829 INFO:teuthology.orchestra.run.smithi038.stderr: 53600K .......... .......... .......... .......... .......... 57% 288M 0s 2024-09-22T08:40:29.830 INFO:teuthology.orchestra.run.smithi038.stderr: 53650K .......... .......... .......... .......... .......... 57% 359M 0s 2024-09-22T08:40:29.830 INFO:teuthology.orchestra.run.smithi038.stderr: 53700K .......... .......... .......... .......... .......... 57% 323M 0s 2024-09-22T08:40:29.830 INFO:teuthology.orchestra.run.smithi038.stderr: 53750K .......... .......... .......... .......... .......... 57% 334M 0s 2024-09-22T08:40:29.830 INFO:teuthology.orchestra.run.smithi038.stderr: 53800K .......... .......... .......... .......... .......... 57% 262M 0s 2024-09-22T08:40:29.830 INFO:teuthology.orchestra.run.smithi038.stderr: 53850K .......... .......... .......... .......... .......... 58% 316M 0s 2024-09-22T08:40:29.830 INFO:teuthology.orchestra.run.smithi038.stderr: 53900K .......... .......... .......... .......... .......... 58% 84.9M 0s 2024-09-22T08:40:29.830 INFO:teuthology.orchestra.run.smithi038.stderr: 53950K .......... .......... .......... .......... .......... 58% 299M 0s 2024-09-22T08:40:29.830 INFO:teuthology.orchestra.run.smithi038.stderr: 54000K .......... .......... .......... .......... .......... 58% 207M 0s 2024-09-22T08:40:29.830 INFO:teuthology.orchestra.run.smithi038.stderr: 54050K .......... .......... .......... .......... .......... 58% 173M 0s 2024-09-22T08:40:29.830 INFO:teuthology.orchestra.run.smithi038.stderr: 54100K .......... .......... .......... .......... .......... 58% 319M 0s 2024-09-22T08:40:29.830 INFO:teuthology.orchestra.run.smithi038.stderr: 54150K .......... .......... .......... .......... .......... 58% 355M 0s 2024-09-22T08:40:29.830 INFO:teuthology.orchestra.run.smithi038.stderr: 54200K .......... .......... .......... .......... .......... 58% 350M 0s 2024-09-22T08:40:29.830 INFO:teuthology.orchestra.run.smithi038.stderr: 54250K .......... .......... .......... .......... .......... 58% 355M 0s 2024-09-22T08:40:29.830 INFO:teuthology.orchestra.run.smithi038.stderr: 54300K .......... .......... .......... .......... .......... 58% 278M 0s 2024-09-22T08:40:29.831 INFO:teuthology.orchestra.run.smithi038.stderr: 54350K .......... .......... .......... .......... .......... 58% 345M 0s 2024-09-22T08:40:29.831 INFO:teuthology.orchestra.run.smithi038.stderr: 54400K .......... .......... .......... .......... .......... 58% 271M 0s 2024-09-22T08:40:29.831 INFO:teuthology.orchestra.run.smithi038.stderr: 54450K .......... .......... .......... .......... .......... 58% 302M 0s 2024-09-22T08:40:29.831 INFO:teuthology.orchestra.run.smithi038.stderr: 54500K .......... .......... .......... .......... .......... 58% 181M 0s 2024-09-22T08:40:29.831 INFO:teuthology.orchestra.run.smithi038.stderr: 54550K .......... .......... .......... .......... .......... 58% 366M 0s 2024-09-22T08:40:29.831 INFO:teuthology.orchestra.run.smithi038.stderr: 54600K .......... .......... .......... .......... .......... 58% 371M 0s 2024-09-22T08:40:29.831 INFO:teuthology.orchestra.run.smithi038.stderr: 54650K .......... .......... .......... .......... .......... 58% 359M 0s 2024-09-22T08:40:29.831 INFO:teuthology.orchestra.run.smithi038.stderr: 54700K .......... .......... .......... .......... .......... 58% 303M 0s 2024-09-22T08:40:29.831 INFO:teuthology.orchestra.run.smithi038.stderr: 54750K .......... .......... .......... .......... .......... 58% 374M 0s 2024-09-22T08:40:29.831 INFO:teuthology.orchestra.run.smithi038.stderr: 54800K .......... .......... .......... .......... .......... 59% 341M 0s 2024-09-22T08:40:29.831 INFO:teuthology.orchestra.run.smithi038.stderr: 54850K .......... .......... .......... .......... .......... 59% 306M 0s 2024-09-22T08:40:29.831 INFO:teuthology.orchestra.run.smithi038.stderr: 54900K .......... .......... .......... .......... .......... 59% 131M 0s 2024-09-22T08:40:29.831 INFO:teuthology.orchestra.run.smithi038.stderr: 54950K .......... .......... .......... .......... .......... 59% 364M 0s 2024-09-22T08:40:29.831 INFO:teuthology.orchestra.run.smithi038.stderr: 55000K .......... .......... .......... .......... .......... 59% 376M 0s 2024-09-22T08:40:29.831 INFO:teuthology.orchestra.run.smithi038.stderr: 55050K .......... .......... .......... .......... .......... 59% 370M 0s 2024-09-22T08:40:29.832 INFO:teuthology.orchestra.run.smithi038.stderr: 55100K .......... .......... .......... .......... .......... 59% 282M 0s 2024-09-22T08:40:29.832 INFO:teuthology.orchestra.run.smithi038.stderr: 55150K .......... .......... .......... .......... .......... 59% 373M 0s 2024-09-22T08:40:29.832 INFO:teuthology.orchestra.run.smithi038.stderr: 55200K .......... .......... .......... .......... .......... 59% 368M 0s 2024-09-22T08:40:29.832 INFO:teuthology.orchestra.run.smithi038.stderr: 55250K .......... .......... .......... .......... .......... 59% 357M 0s 2024-09-22T08:40:29.832 INFO:teuthology.orchestra.run.smithi038.stderr: 55300K .......... .......... .......... .......... .......... 59% 331M 0s 2024-09-22T08:40:29.832 INFO:teuthology.orchestra.run.smithi038.stderr: 55350K .......... .......... .......... .......... .......... 59% 302M 0s 2024-09-22T08:40:29.832 INFO:teuthology.orchestra.run.smithi038.stderr: 55400K .......... .......... .......... .......... .......... 59% 356M 0s 2024-09-22T08:40:29.832 INFO:teuthology.orchestra.run.smithi038.stderr: 55450K .......... .......... .......... .......... .......... 59% 347M 0s 2024-09-22T08:40:29.832 INFO:teuthology.orchestra.run.smithi038.stderr: 55500K .......... .......... .......... .......... .......... 59% 299M 0s 2024-09-22T08:40:29.832 INFO:teuthology.orchestra.run.smithi038.stderr: 55550K .......... .......... .......... .......... .......... 59% 342M 0s 2024-09-22T08:40:29.832 INFO:teuthology.orchestra.run.smithi038.stderr: 55600K .......... .......... .......... .......... .......... 59% 378M 0s 2024-09-22T08:40:29.832 INFO:teuthology.orchestra.run.smithi038.stderr: 55650K .......... .......... .......... .......... .......... 59% 78.6M 0s 2024-09-22T08:40:29.832 INFO:teuthology.orchestra.run.smithi038.stderr: 55700K .......... .......... .......... .......... .......... 60% 311M 0s 2024-09-22T08:40:29.832 INFO:teuthology.orchestra.run.smithi038.stderr: 55750K .......... .......... .......... .......... .......... 60% 129M 0s 2024-09-22T08:40:29.832 INFO:teuthology.orchestra.run.smithi038.stderr: 55800K .......... .......... .......... .......... .......... 60% 294M 0s 2024-09-22T08:40:29.833 INFO:teuthology.orchestra.run.smithi038.stderr: 55850K .......... .......... .......... .......... .......... 60% 344M 0s 2024-09-22T08:40:29.833 INFO:teuthology.orchestra.run.smithi038.stderr: 55900K .......... .......... .......... .......... .......... 60% 305M 0s 2024-09-22T08:40:29.833 INFO:teuthology.orchestra.run.smithi038.stderr: 55950K .......... .......... .......... .......... .......... 60% 206M 0s 2024-09-22T08:40:29.833 INFO:teuthology.orchestra.run.smithi038.stderr: 56000K .......... .......... .......... .......... .......... 60% 275M 0s 2024-09-22T08:40:29.833 INFO:teuthology.orchestra.run.smithi038.stderr: 56050K .......... .......... .......... .......... .......... 60% 374M 0s 2024-09-22T08:40:29.833 INFO:teuthology.orchestra.run.smithi038.stderr: 56100K .......... .......... .......... .......... .......... 60% 270M 0s 2024-09-22T08:40:29.833 INFO:teuthology.orchestra.run.smithi038.stderr: 56150K .......... .......... .......... .......... .......... 60% 293M 0s 2024-09-22T08:40:29.833 INFO:teuthology.orchestra.run.smithi038.stderr: 56200K .......... .......... .......... .......... .......... 60% 302M 0s 2024-09-22T08:40:29.833 INFO:teuthology.orchestra.run.smithi038.stderr: 56250K .......... .......... .......... .......... .......... 60% 354M 0s 2024-09-22T08:40:29.833 INFO:teuthology.orchestra.run.smithi038.stderr: 56300K .......... .......... .......... .......... .......... 60% 114M 0s 2024-09-22T08:40:29.833 INFO:teuthology.orchestra.run.smithi038.stderr: 56350K .......... .......... .......... .......... .......... 60% 230M 0s 2024-09-22T08:40:29.833 INFO:teuthology.orchestra.run.smithi038.stderr: 56400K .......... .......... .......... .......... .......... 60% 345M 0s 2024-09-22T08:40:29.833 INFO:teuthology.orchestra.run.smithi038.stderr: 56450K .......... .......... .......... .......... .......... 60% 104M 0s 2024-09-22T08:40:29.833 INFO:teuthology.orchestra.run.smithi038.stderr: 56500K .......... .......... .......... .......... .......... 60% 309M 0s 2024-09-22T08:40:29.833 INFO:teuthology.orchestra.run.smithi038.stderr: 56550K .......... .......... .......... .......... .......... 60% 365M 0s 2024-09-22T08:40:29.834 INFO:teuthology.orchestra.run.smithi038.stderr: 56600K .......... .......... .......... .......... .......... 60% 361M 0s 2024-09-22T08:40:29.834 INFO:teuthology.orchestra.run.smithi038.stderr: 56650K .......... .......... .......... .......... .......... 61% 213M 0s 2024-09-22T08:40:29.834 INFO:teuthology.orchestra.run.smithi038.stderr: 56700K .......... .......... .......... .......... .......... 61% 276M 0s 2024-09-22T08:40:29.834 INFO:teuthology.orchestra.run.smithi038.stderr: 56750K .......... .......... .......... .......... .......... 61% 376M 0s 2024-09-22T08:40:29.834 INFO:teuthology.orchestra.run.smithi038.stderr: 56800K .......... .......... .......... .......... .......... 61% 342M 0s 2024-09-22T08:40:29.834 INFO:teuthology.orchestra.run.smithi038.stderr: 56850K .......... .......... .......... .......... .......... 61% 362M 0s 2024-09-22T08:40:29.834 INFO:teuthology.orchestra.run.smithi038.stderr: 56900K .......... .......... .......... .......... .......... 61% 174M 0s 2024-09-22T08:40:29.834 INFO:teuthology.orchestra.run.smithi038.stderr: 56950K .......... .......... .......... .......... .......... 61% 361M 0s 2024-09-22T08:40:29.834 INFO:teuthology.orchestra.run.smithi038.stderr: 57000K .......... .......... .......... .......... .......... 61% 89.5M 0s 2024-09-22T08:40:29.834 INFO:teuthology.orchestra.run.smithi038.stderr: 57050K .......... .......... .......... .......... .......... 61% 219M 0s 2024-09-22T08:40:29.834 INFO:teuthology.orchestra.run.smithi038.stderr: 57100K .......... .......... .......... .......... .......... 61% 69.6M 0s 2024-09-22T08:40:29.834 INFO:teuthology.orchestra.run.smithi038.stderr: 57150K .......... .......... .......... .......... .......... 61% 354M 0s 2024-09-22T08:40:29.834 INFO:teuthology.orchestra.run.smithi038.stderr: 57200K .......... .......... .......... .......... .......... 61% 370M 0s 2024-09-22T08:40:29.834 INFO:teuthology.orchestra.run.smithi038.stderr: 57250K .......... .......... .......... .......... .......... 61% 332M 0s 2024-09-22T08:40:29.835 INFO:teuthology.orchestra.run.smithi038.stderr: 57300K .......... .......... .......... .......... .......... 61% 321M 0s 2024-09-22T08:40:29.835 INFO:teuthology.orchestra.run.smithi038.stderr: 57350K .......... .......... .......... .......... .......... 61% 366M 0s 2024-09-22T08:40:29.835 INFO:teuthology.orchestra.run.smithi038.stderr: 57400K .......... .......... .......... .......... .......... 61% 360M 0s 2024-09-22T08:40:29.835 INFO:teuthology.orchestra.run.smithi038.stderr: 57450K .......... .......... .......... .......... .......... 61% 372M 0s 2024-09-22T08:40:29.835 INFO:teuthology.orchestra.run.smithi038.stderr: 57500K .......... .......... .......... .......... .......... 61% 288M 0s 2024-09-22T08:40:29.835 INFO:teuthology.orchestra.run.smithi038.stderr: 57550K .......... .......... .......... .......... .......... 62% 329M 0s 2024-09-22T08:40:29.835 INFO:teuthology.orchestra.run.smithi038.stderr: 57600K .......... .......... .......... .......... .......... 62% 282M 0s 2024-09-22T08:40:29.835 INFO:teuthology.orchestra.run.smithi038.stderr: 57650K .......... .......... .......... .......... .......... 62% 279M 0s 2024-09-22T08:40:29.835 INFO:teuthology.orchestra.run.smithi038.stderr: 57700K .......... .......... .......... .......... .......... 62% 269M 0s 2024-09-22T08:40:29.835 INFO:teuthology.orchestra.run.smithi038.stderr: 57750K .......... .......... .......... .......... .......... 62% 300M 0s 2024-09-22T08:40:29.835 INFO:teuthology.orchestra.run.smithi038.stderr: 57800K .......... .......... .......... .......... .......... 62% 375M 0s 2024-09-22T08:40:29.835 INFO:teuthology.orchestra.run.smithi038.stderr: 57850K .......... .......... .......... .......... .......... 62% 323M 0s 2024-09-22T08:40:29.835 INFO:teuthology.orchestra.run.smithi038.stderr: 57900K .......... .......... .......... .......... .......... 62% 247M 0s 2024-09-22T08:40:29.835 INFO:teuthology.orchestra.run.smithi038.stderr: 57950K .......... .......... .......... .......... .......... 62% 371M 0s 2024-09-22T08:40:29.835 INFO:teuthology.orchestra.run.smithi038.stderr: 58000K .......... .......... .......... .......... .......... 62% 366M 0s 2024-09-22T08:40:29.836 INFO:teuthology.orchestra.run.smithi038.stderr: 58050K .......... .......... .......... .......... .......... 62% 363M 0s 2024-09-22T08:40:29.836 INFO:teuthology.orchestra.run.smithi038.stderr: 58100K .......... .......... .......... .......... .......... 62% 329M 0s 2024-09-22T08:40:29.836 INFO:teuthology.orchestra.run.smithi038.stderr: 58150K .......... .......... .......... .......... .......... 62% 366M 0s 2024-09-22T08:40:29.836 INFO:teuthology.orchestra.run.smithi038.stderr: 58200K .......... .......... .......... .......... .......... 62% 359M 0s 2024-09-22T08:40:29.836 INFO:teuthology.orchestra.run.smithi038.stderr: 58250K .......... .......... .......... .......... .......... 62% 352M 0s 2024-09-22T08:40:29.836 INFO:teuthology.orchestra.run.smithi038.stderr: 58300K .......... .......... .......... .......... .......... 62% 314M 0s 2024-09-22T08:40:29.836 INFO:teuthology.orchestra.run.smithi038.stderr: 58350K .......... .......... .......... .......... .......... 62% 282M 0s 2024-09-22T08:40:29.836 INFO:teuthology.orchestra.run.smithi038.stderr: 58400K .......... .......... .......... .......... .......... 62% 349M 0s 2024-09-22T08:40:29.836 INFO:teuthology.orchestra.run.smithi038.stderr: 58450K .......... .......... .......... .......... .......... 62% 364M 0s 2024-09-22T08:40:29.836 INFO:teuthology.orchestra.run.smithi038.stderr: 58500K .......... .......... .......... .......... .......... 63% 332M 0s 2024-09-22T08:40:29.836 INFO:teuthology.orchestra.run.smithi038.stderr: 58550K .......... .......... .......... .......... .......... 63% 365M 0s 2024-09-22T08:40:29.836 INFO:teuthology.orchestra.run.smithi038.stderr: 58600K .......... .......... .......... .......... .......... 63% 349M 0s 2024-09-22T08:40:29.836 INFO:teuthology.orchestra.run.smithi038.stderr: 58650K .......... .......... .......... .......... .......... 63% 82.4M 0s 2024-09-22T08:40:29.836 INFO:teuthology.orchestra.run.smithi038.stderr: 58700K .......... .......... .......... .......... .......... 63% 296M 0s 2024-09-22T08:40:29.836 INFO:teuthology.orchestra.run.smithi038.stderr: 58750K .......... .......... .......... .......... .......... 63% 349M 0s 2024-09-22T08:40:29.837 INFO:teuthology.orchestra.run.smithi038.stderr: 58800K .......... .......... .......... .......... .......... 63% 144M 0s 2024-09-22T08:40:29.837 INFO:teuthology.orchestra.run.smithi038.stderr: 58850K .......... .......... .......... .......... .......... 63% 350M 0s 2024-09-22T08:40:29.837 INFO:teuthology.orchestra.run.smithi038.stderr: 58900K .......... .......... .......... .......... .......... 63% 325M 0s 2024-09-22T08:40:29.837 INFO:teuthology.orchestra.run.smithi038.stderr: 58950K .......... .......... .......... .......... .......... 63% 191M 0s 2024-09-22T08:40:29.837 INFO:teuthology.orchestra.run.smithi038.stderr: 59000K .......... .......... .......... .......... .......... 63% 254M 0s 2024-09-22T08:40:29.837 INFO:teuthology.orchestra.run.smithi038.stderr: 59050K .......... .......... .......... .......... .......... 63% 364M 0s 2024-09-22T08:40:29.837 INFO:teuthology.orchestra.run.smithi038.stderr: 59100K .......... .......... .......... .......... .......... 63% 254M 0s 2024-09-22T08:40:29.837 INFO:teuthology.orchestra.run.smithi038.stderr: 59150K .......... .......... .......... .......... .......... 63% 290M 0s 2024-09-22T08:40:29.837 INFO:teuthology.orchestra.run.smithi038.stderr: 59200K .......... .......... .......... .......... .......... 63% 349M 0s 2024-09-22T08:40:29.837 INFO:teuthology.orchestra.run.smithi038.stderr: 59250K .......... .......... .......... .......... .......... 63% 308M 0s 2024-09-22T08:40:29.837 INFO:teuthology.orchestra.run.smithi038.stderr: 59300K .......... .......... .......... .......... .......... 63% 303M 0s 2024-09-22T08:40:29.837 INFO:teuthology.orchestra.run.smithi038.stderr: 59350K .......... .......... .......... .......... .......... 63% 267M 0s 2024-09-22T08:40:29.837 INFO:teuthology.orchestra.run.smithi038.stderr: 59400K .......... .......... .......... .......... .......... 63% 240M 0s 2024-09-22T08:40:29.837 INFO:teuthology.orchestra.run.smithi038.stderr: 59450K .......... .......... .......... .......... .......... 64% 246M 0s 2024-09-22T08:40:29.837 INFO:teuthology.orchestra.run.smithi038.stderr: 59500K .......... .......... .......... .......... .......... 64% 80.3M 0s 2024-09-22T08:40:29.838 INFO:teuthology.orchestra.run.smithi038.stderr: 59550K .......... .......... .......... .......... .......... 64% 316M 0s 2024-09-22T08:40:29.838 INFO:teuthology.orchestra.run.smithi038.stderr: 59600K .......... .......... .......... .......... .......... 64% 361M 0s 2024-09-22T08:40:29.838 INFO:teuthology.orchestra.run.smithi038.stderr: 59650K .......... .......... .......... .......... .......... 64% 212M 0s 2024-09-22T08:40:29.838 INFO:teuthology.orchestra.run.smithi038.stderr: 59700K .......... .......... .......... .......... .......... 64% 202M 0s 2024-09-22T08:40:29.838 INFO:teuthology.orchestra.run.smithi038.stderr: 59750K .......... .......... .......... .......... .......... 64% 334M 0s 2024-09-22T08:40:29.838 INFO:teuthology.orchestra.run.smithi038.stderr: 59800K .......... .......... .......... .......... .......... 64% 343M 0s 2024-09-22T08:40:29.838 INFO:teuthology.orchestra.run.smithi038.stderr: 59850K .......... .......... .......... .......... .......... 64% 362M 0s 2024-09-22T08:40:29.838 INFO:teuthology.orchestra.run.smithi038.stderr: 59900K .......... .......... .......... .......... .......... 64% 300M 0s 2024-09-22T08:40:29.838 INFO:teuthology.orchestra.run.smithi038.stderr: 59950K .......... .......... .......... .......... .......... 64% 360M 0s 2024-09-22T08:40:29.838 INFO:teuthology.orchestra.run.smithi038.stderr: 60000K .......... .......... .......... .......... .......... 64% 294M 0s 2024-09-22T08:40:29.838 INFO:teuthology.orchestra.run.smithi038.stderr: 60050K .......... .......... .......... .......... .......... 64% 129M 0s 2024-09-22T08:40:29.838 INFO:teuthology.orchestra.run.smithi038.stderr: 60100K .......... .......... .......... .......... .......... 64% 78.9M 0s 2024-09-22T08:40:29.838 INFO:teuthology.orchestra.run.smithi038.stderr: 60150K .......... .......... .......... .......... .......... 64% 85.8M 0s 2024-09-22T08:40:29.839 INFO:teuthology.orchestra.run.smithi038.stderr: 60200K .......... .......... .......... .......... .......... 64% 285M 0s 2024-09-22T08:40:29.839 INFO:teuthology.orchestra.run.smithi038.stderr: 60250K .......... .......... .......... .......... .......... 64% 299M 0s 2024-09-22T08:40:29.839 INFO:teuthology.orchestra.run.smithi038.stderr: 60300K .......... .......... .......... .......... .......... 64% 293M 0s 2024-09-22T08:40:29.839 INFO:teuthology.orchestra.run.smithi038.stderr: 60350K .......... .......... .......... .......... .......... 65% 112M 0s 2024-09-22T08:40:29.839 INFO:teuthology.orchestra.run.smithi038.stderr: 60400K .......... .......... .......... .......... .......... 65% 288M 0s 2024-09-22T08:40:29.839 INFO:teuthology.orchestra.run.smithi038.stderr: 60450K .......... .......... .......... .......... .......... 65% 327M 0s 2024-09-22T08:40:29.839 INFO:teuthology.orchestra.run.smithi038.stderr: 60500K .......... .......... .......... .......... .......... 65% 332M 0s 2024-09-22T08:40:29.839 INFO:teuthology.orchestra.run.smithi038.stderr: 60550K .......... .......... .......... .......... .......... 65% 344M 0s 2024-09-22T08:40:29.839 INFO:teuthology.orchestra.run.smithi038.stderr: 60600K .......... .......... .......... .......... .......... 65% 345M 0s 2024-09-22T08:40:29.839 INFO:teuthology.orchestra.run.smithi038.stderr: 60650K .......... .......... .......... .......... .......... 65% 356M 0s 2024-09-22T08:40:29.839 INFO:teuthology.orchestra.run.smithi038.stderr: 60700K .......... .......... .......... .......... .......... 65% 298M 0s 2024-09-22T08:40:29.839 INFO:teuthology.orchestra.run.smithi038.stderr: 60750K .......... .......... .......... .......... .......... 65% 351M 0s 2024-09-22T08:40:29.839 INFO:teuthology.orchestra.run.smithi038.stderr: 60800K .......... .......... .......... .......... .......... 65% 371M 0s 2024-09-22T08:40:29.839 INFO:teuthology.orchestra.run.smithi038.stderr: 60850K .......... .......... .......... .......... .......... 65% 350M 0s 2024-09-22T08:40:29.839 INFO:teuthology.orchestra.run.smithi038.stderr: 60900K .......... .......... .......... .......... .......... 65% 306M 0s 2024-09-22T08:40:29.840 INFO:teuthology.orchestra.run.smithi038.stderr: 60950K .......... .......... .......... .......... .......... 65% 368M 0s 2024-09-22T08:40:29.840 INFO:teuthology.orchestra.run.smithi038.stderr: 61000K .......... .......... .......... .......... .......... 65% 353M 0s 2024-09-22T08:40:29.840 INFO:teuthology.orchestra.run.smithi038.stderr: 61050K .......... .......... .......... .......... .......... 65% 367M 0s 2024-09-22T08:40:29.840 INFO:teuthology.orchestra.run.smithi038.stderr: 61100K .......... .......... .......... .......... .......... 65% 300M 0s 2024-09-22T08:40:29.840 INFO:teuthology.orchestra.run.smithi038.stderr: 61150K .......... .......... .......... .......... .......... 65% 360M 0s 2024-09-22T08:40:29.840 INFO:teuthology.orchestra.run.smithi038.stderr: 61200K .......... .......... .......... .......... .......... 65% 367M 0s 2024-09-22T08:40:29.840 INFO:teuthology.orchestra.run.smithi038.stderr: 61250K .......... .......... .......... .......... .......... 65% 350M 0s 2024-09-22T08:40:29.840 INFO:teuthology.orchestra.run.smithi038.stderr: 61300K .......... .......... .......... .......... .......... 66% 320M 0s 2024-09-22T08:40:29.840 INFO:teuthology.orchestra.run.smithi038.stderr: 61350K .......... .......... .......... .......... .......... 66% 357M 0s 2024-09-22T08:40:29.840 INFO:teuthology.orchestra.run.smithi038.stderr: 61400K .......... .......... .......... .......... .......... 66% 323M 0s 2024-09-22T08:40:29.840 INFO:teuthology.orchestra.run.smithi038.stderr: 61450K .......... .......... .......... .......... .......... 66% 407M 0s 2024-09-22T08:40:29.840 INFO:teuthology.orchestra.run.smithi038.stderr: 61500K .......... .......... .......... .......... .......... 66% 318M 0s 2024-09-22T08:40:29.840 INFO:teuthology.orchestra.run.smithi038.stderr: 61550K .......... .......... .......... .......... .......... 66% 381M 0s 2024-09-22T08:40:29.840 INFO:teuthology.orchestra.run.smithi038.stderr: 61600K .......... .......... .......... .......... .......... 66% 111M 0s 2024-09-22T08:40:29.840 INFO:teuthology.orchestra.run.smithi038.stderr: 61650K .......... .......... .......... .......... .......... 66% 300M 0s 2024-09-22T08:40:29.841 INFO:teuthology.orchestra.run.smithi038.stderr: 61700K .......... .......... .......... .......... .......... 66% 278M 0s 2024-09-22T08:40:29.841 INFO:teuthology.orchestra.run.smithi038.stderr: 61750K .......... .......... .......... .......... .......... 66% 341M 0s 2024-09-22T08:40:29.841 INFO:teuthology.orchestra.run.smithi038.stderr: 61800K .......... .......... .......... .......... .......... 66% 343M 0s 2024-09-22T08:40:29.841 INFO:teuthology.orchestra.run.smithi038.stderr: 61850K .......... .......... .......... .......... .......... 66% 327M 0s 2024-09-22T08:40:29.841 INFO:teuthology.orchestra.run.smithi038.stderr: 61900K .......... .......... .......... .......... .......... 66% 313M 0s 2024-09-22T08:40:29.841 INFO:teuthology.orchestra.run.smithi038.stderr: 61950K .......... .......... .......... .......... .......... 66% 182M 0s 2024-09-22T08:40:29.841 INFO:teuthology.orchestra.run.smithi038.stderr: 62000K .......... .......... .......... .......... .......... 66% 221M 0s 2024-09-22T08:40:29.841 INFO:teuthology.orchestra.run.smithi038.stderr: 62050K .......... .......... .......... .......... .......... 66% 247M 0s 2024-09-22T08:40:29.841 INFO:teuthology.orchestra.run.smithi038.stderr: 62100K .......... .......... .......... .......... .......... 66% 326M 0s 2024-09-22T08:40:29.841 INFO:teuthology.orchestra.run.smithi038.stderr: 62150K .......... .......... .......... .......... .......... 66% 125M 0s 2024-09-22T08:40:29.841 INFO:teuthology.orchestra.run.smithi038.stderr: 62200K .......... .......... .......... .......... .......... 67% 353M 0s 2024-09-22T08:40:29.841 INFO:teuthology.orchestra.run.smithi038.stderr: 62250K .......... .......... .......... .......... .......... 67% 359M 0s 2024-09-22T08:40:29.841 INFO:teuthology.orchestra.run.smithi038.stderr: 62300K .......... .......... .......... .......... .......... 67% 300M 0s 2024-09-22T08:40:29.841 INFO:teuthology.orchestra.run.smithi038.stderr: 62350K .......... .......... .......... .......... .......... 67% 374M 0s 2024-09-22T08:40:29.841 INFO:teuthology.orchestra.run.smithi038.stderr: 62400K .......... .......... .......... .......... .......... 67% 350M 0s 2024-09-22T08:40:29.842 INFO:teuthology.orchestra.run.smithi038.stderr: 62450K .......... .......... .......... .......... .......... 67% 363M 0s 2024-09-22T08:40:29.842 INFO:teuthology.orchestra.run.smithi038.stderr: 62500K .......... .......... .......... .......... .......... 67% 327M 0s 2024-09-22T08:40:29.842 INFO:teuthology.orchestra.run.smithi038.stderr: 62550K .......... .......... .......... .......... .......... 67% 375M 0s 2024-09-22T08:40:29.842 INFO:teuthology.orchestra.run.smithi038.stderr: 62600K .......... .......... .......... .......... .......... 67% 81.2M 0s 2024-09-22T08:40:29.842 INFO:teuthology.orchestra.run.smithi038.stderr: 62650K .......... .......... .......... .......... .......... 67% 354M 0s 2024-09-22T08:40:29.842 INFO:teuthology.orchestra.run.smithi038.stderr: 62700K .......... .......... .......... .......... .......... 67% 309M 0s 2024-09-22T08:40:29.842 INFO:teuthology.orchestra.run.smithi038.stderr: 62750K .......... .......... .......... .......... .......... 67% 93.4M 0s 2024-09-22T08:40:29.842 INFO:teuthology.orchestra.run.smithi038.stderr: 62800K .......... .......... .......... .......... .......... 67% 338M 0s 2024-09-22T08:40:29.842 INFO:teuthology.orchestra.run.smithi038.stderr: 62850K .......... .......... .......... .......... .......... 67% 353M 0s 2024-09-22T08:40:29.842 INFO:teuthology.orchestra.run.smithi038.stderr: 62900K .......... .......... .......... .......... .......... 67% 324M 0s 2024-09-22T08:40:29.842 INFO:teuthology.orchestra.run.smithi038.stderr: 62950K .......... .......... .......... .......... .......... 67% 364M 0s 2024-09-22T08:40:29.842 INFO:teuthology.orchestra.run.smithi038.stderr: 63000K .......... .......... .......... .......... .......... 67% 372M 0s 2024-09-22T08:40:29.842 INFO:teuthology.orchestra.run.smithi038.stderr: 63050K .......... .......... .......... .......... .......... 67% 367M 0s 2024-09-22T08:40:29.842 INFO:teuthology.orchestra.run.smithi038.stderr: 63100K .......... .......... .......... .......... .......... 67% 298M 0s 2024-09-22T08:40:29.843 INFO:teuthology.orchestra.run.smithi038.stderr: 63150K .......... .......... .......... .......... .......... 68% 88.9M 0s 2024-09-22T08:40:29.843 INFO:teuthology.orchestra.run.smithi038.stderr: 63200K .......... .......... .......... .......... .......... 68% 96.9M 0s 2024-09-22T08:40:29.843 INFO:teuthology.orchestra.run.smithi038.stderr: 63250K .......... .......... .......... .......... .......... 68% 267M 0s 2024-09-22T08:40:29.843 INFO:teuthology.orchestra.run.smithi038.stderr: 63300K .......... .......... .......... .......... .......... 68% 324M 0s 2024-09-22T08:40:29.843 INFO:teuthology.orchestra.run.smithi038.stderr: 63350K .......... .......... .......... .......... .......... 68% 264M 0s 2024-09-22T08:40:29.843 INFO:teuthology.orchestra.run.smithi038.stderr: 63400K .......... .......... .......... .......... .......... 68% 133M 0s 2024-09-22T08:40:29.843 INFO:teuthology.orchestra.run.smithi038.stderr: 63450K .......... .......... .......... .......... .......... 68% 314M 0s 2024-09-22T08:40:29.843 INFO:teuthology.orchestra.run.smithi038.stderr: 63500K .......... .......... .......... .......... .......... 68% 237M 0s 2024-09-22T08:40:29.843 INFO:teuthology.orchestra.run.smithi038.stderr: 63550K .......... .......... .......... .......... .......... 68% 313M 0s 2024-09-22T08:40:29.843 INFO:teuthology.orchestra.run.smithi038.stderr: 63600K .......... .......... .......... .......... .......... 68% 344M 0s 2024-09-22T08:40:29.843 INFO:teuthology.orchestra.run.smithi038.stderr: 63650K .......... .......... .......... .......... .......... 68% 358M 0s 2024-09-22T08:40:29.843 INFO:teuthology.orchestra.run.smithi038.stderr: 63700K .......... .......... .......... .......... .......... 68% 322M 0s 2024-09-22T08:40:29.843 INFO:teuthology.orchestra.run.smithi038.stderr: 63750K .......... .......... .......... .......... .......... 68% 357M 0s 2024-09-22T08:40:29.843 INFO:teuthology.orchestra.run.smithi038.stderr: 63800K .......... .......... .......... .......... .......... 68% 279M 0s 2024-09-22T08:40:29.843 INFO:teuthology.orchestra.run.smithi038.stderr: 63850K .......... .......... .......... .......... .......... 68% 347M 0s 2024-09-22T08:40:29.844 INFO:teuthology.orchestra.run.smithi038.stderr: 63900K .......... .......... .......... .......... .......... 68% 296M 0s 2024-09-22T08:40:29.844 INFO:teuthology.orchestra.run.smithi038.stderr: 63950K .......... .......... .......... .......... .......... 68% 353M 0s 2024-09-22T08:40:29.844 INFO:teuthology.orchestra.run.smithi038.stderr: 64000K .......... .......... .......... .......... .......... 68% 352M 0s 2024-09-22T08:40:29.844 INFO:teuthology.orchestra.run.smithi038.stderr: 64050K .......... .......... .......... .......... .......... 68% 372M 0s 2024-09-22T08:40:29.844 INFO:teuthology.orchestra.run.smithi038.stderr: 64100K .......... .......... .......... .......... .......... 69% 307M 0s 2024-09-22T08:40:29.844 INFO:teuthology.orchestra.run.smithi038.stderr: 64150K .......... .......... .......... .......... .......... 69% 354M 0s 2024-09-22T08:40:29.844 INFO:teuthology.orchestra.run.smithi038.stderr: 64200K .......... .......... .......... .......... .......... 69% 380M 0s 2024-09-22T08:40:29.844 INFO:teuthology.orchestra.run.smithi038.stderr: 64250K .......... .......... .......... .......... .......... 69% 356M 0s 2024-09-22T08:40:29.844 INFO:teuthology.orchestra.run.smithi038.stderr: 64300K .......... .......... .......... .......... .......... 69% 285M 0s 2024-09-22T08:40:29.844 INFO:teuthology.orchestra.run.smithi038.stderr: 64350K .......... .......... .......... .......... .......... 69% 311M 0s 2024-09-22T08:40:29.844 INFO:teuthology.orchestra.run.smithi038.stderr: 64400K .......... .......... .......... .......... .......... 69% 226M 0s 2024-09-22T08:40:29.844 INFO:teuthology.orchestra.run.smithi038.stderr: 64450K .......... .......... .......... .......... .......... 69% 287M 0s 2024-09-22T08:40:29.844 INFO:teuthology.orchestra.run.smithi038.stderr: 64500K .......... .......... .......... .......... .......... 69% 374M 0s 2024-09-22T08:40:29.844 INFO:teuthology.orchestra.run.smithi038.stderr: 64550K .......... .......... .......... .......... .......... 69% 93.4M 0s 2024-09-22T08:40:29.844 INFO:teuthology.orchestra.run.smithi038.stderr: 64600K .......... .......... .......... .......... .......... 69% 217M 0s 2024-09-22T08:40:29.845 INFO:teuthology.orchestra.run.smithi038.stderr: 64650K .......... .......... .......... .......... .......... 69% 364M 0s 2024-09-22T08:40:29.845 INFO:teuthology.orchestra.run.smithi038.stderr: 64700K .......... .......... .......... .......... .......... 69% 372M 0s 2024-09-22T08:40:29.845 INFO:teuthology.orchestra.run.smithi038.stderr: 64750K .......... .......... .......... .......... .......... 69% 372M 0s 2024-09-22T08:40:29.845 INFO:teuthology.orchestra.run.smithi038.stderr: 64800K .......... .......... .......... .......... .......... 69% 298M 0s 2024-09-22T08:40:29.845 INFO:teuthology.orchestra.run.smithi038.stderr: 64850K .......... .......... .......... .......... .......... 69% 378M 0s 2024-09-22T08:40:29.845 INFO:teuthology.orchestra.run.smithi038.stderr: 64900K .......... .......... .......... .......... .......... 69% 380M 0s 2024-09-22T08:40:29.845 INFO:teuthology.orchestra.run.smithi038.stderr: 64950K .......... .......... .......... .......... .......... 69% 217M 0s 2024-09-22T08:40:29.845 INFO:teuthology.orchestra.run.smithi038.stderr: 65000K .......... .......... .......... .......... .......... 70% 316M 0s 2024-09-22T08:40:29.845 INFO:teuthology.orchestra.run.smithi038.stderr: 65050K .......... .......... .......... .......... .......... 70% 367M 0s 2024-09-22T08:40:29.845 INFO:teuthology.orchestra.run.smithi038.stderr: 65100K .......... .......... .......... .......... .......... 70% 255M 0s 2024-09-22T08:40:29.845 INFO:teuthology.orchestra.run.smithi038.stderr: 65150K .......... .......... .......... .......... .......... 70% 239M 0s 2024-09-22T08:40:29.845 INFO:teuthology.orchestra.run.smithi038.stderr: 65200K .......... .......... .......... .......... .......... 70% 284M 0s 2024-09-22T08:40:29.845 INFO:teuthology.orchestra.run.smithi038.stderr: 65250K .......... .......... .......... .......... .......... 70% 127M 0s 2024-09-22T08:40:29.845 INFO:teuthology.orchestra.run.smithi038.stderr: 65300K .......... .......... .......... .......... .......... 70% 318M 0s 2024-09-22T08:40:29.846 INFO:teuthology.orchestra.run.smithi038.stderr: 65350K .......... .......... .......... .......... .......... 70% 367M 0s 2024-09-22T08:40:29.846 INFO:teuthology.orchestra.run.smithi038.stderr: 65400K .......... .......... .......... .......... .......... 70% 350M 0s 2024-09-22T08:40:29.846 INFO:teuthology.orchestra.run.smithi038.stderr: 65450K .......... .......... .......... .......... .......... 70% 364M 0s 2024-09-22T08:40:29.846 INFO:teuthology.orchestra.run.smithi038.stderr: 65500K .......... .......... .......... .......... .......... 70% 294M 0s 2024-09-22T08:40:29.846 INFO:teuthology.orchestra.run.smithi038.stderr: 65550K .......... .......... .......... .......... .......... 70% 79.3M 0s 2024-09-22T08:40:29.846 INFO:teuthology.orchestra.run.smithi038.stderr: 65600K .......... .......... .......... .......... .......... 70% 287M 0s 2024-09-22T08:40:29.846 INFO:teuthology.orchestra.run.smithi038.stderr: 65650K .......... .......... .......... .......... .......... 70% 364M 0s 2024-09-22T08:40:29.846 INFO:teuthology.orchestra.run.smithi038.stderr: 65700K .......... .......... .......... .......... .......... 70% 307M 0s 2024-09-22T08:40:29.846 INFO:teuthology.orchestra.run.smithi038.stderr: 65750K .......... .......... .......... .......... .......... 70% 378M 0s 2024-09-22T08:40:29.846 INFO:teuthology.orchestra.run.smithi038.stderr: 65800K .......... .......... .......... .......... .......... 70% 148M 0s 2024-09-22T08:40:29.846 INFO:teuthology.orchestra.run.smithi038.stderr: 65850K .......... .......... .......... .......... .......... 70% 274M 0s 2024-09-22T08:40:29.846 INFO:teuthology.orchestra.run.smithi038.stderr: 65900K .......... .......... .......... .......... .......... 70% 283M 0s 2024-09-22T08:40:29.846 INFO:teuthology.orchestra.run.smithi038.stderr: 65950K .......... .......... .......... .......... .......... 71% 231M 0s 2024-09-22T08:40:29.846 INFO:teuthology.orchestra.run.smithi038.stderr: 66000K .......... .......... .......... .......... .......... 71% 295M 0s 2024-09-22T08:40:29.846 INFO:teuthology.orchestra.run.smithi038.stderr: 66050K .......... .......... .......... .......... .......... 71% 358M 0s 2024-09-22T08:40:29.847 INFO:teuthology.orchestra.run.smithi038.stderr: 66100K .......... .......... .......... .......... .......... 71% 345M 0s 2024-09-22T08:40:29.847 INFO:teuthology.orchestra.run.smithi038.stderr: 66150K .......... .......... .......... .......... .......... 71% 131M 0s 2024-09-22T08:40:29.847 INFO:teuthology.orchestra.run.smithi038.stderr: 66200K .......... .......... .......... .......... .......... 71% 269M 0s 2024-09-22T08:40:29.847 INFO:teuthology.orchestra.run.smithi038.stderr: 66250K .......... .......... .......... .......... .......... 71% 145M 0s 2024-09-22T08:40:29.847 INFO:teuthology.orchestra.run.smithi038.stderr: 66300K .......... .......... .......... .......... .......... 71% 199M 0s 2024-09-22T08:40:29.847 INFO:teuthology.orchestra.run.smithi038.stderr: 66350K .......... .......... .......... .......... .......... 71% 331M 0s 2024-09-22T08:40:29.847 INFO:teuthology.orchestra.run.smithi038.stderr: 66400K .......... .......... .......... .......... .......... 71% 356M 0s 2024-09-22T08:40:29.847 INFO:teuthology.orchestra.run.smithi038.stderr: 66450K .......... .......... .......... .......... .......... 71% 104M 0s 2024-09-22T08:40:29.847 INFO:teuthology.orchestra.run.smithi038.stderr: 66500K .......... .......... .......... .......... .......... 71% 282M 0s 2024-09-22T08:40:29.847 INFO:teuthology.orchestra.run.smithi038.stderr: 66550K .......... .......... .......... .......... .......... 71% 305M 0s 2024-09-22T08:40:29.847 INFO:teuthology.orchestra.run.smithi038.stderr: 66600K .......... .......... .......... .......... .......... 71% 315M 0s 2024-09-22T08:40:29.847 INFO:teuthology.orchestra.run.smithi038.stderr: 66650K .......... .......... .......... .......... .......... 71% 235M 0s 2024-09-22T08:40:29.847 INFO:teuthology.orchestra.run.smithi038.stderr: 66700K .......... .......... .......... .......... .......... 71% 216M 0s 2024-09-22T08:40:29.847 INFO:teuthology.orchestra.run.smithi038.stderr: 66750K .......... .......... .......... .......... .......... 71% 361M 0s 2024-09-22T08:40:29.848 INFO:teuthology.orchestra.run.smithi038.stderr: 66800K .......... .......... .......... .......... .......... 71% 371M 0s 2024-09-22T08:40:29.848 INFO:teuthology.orchestra.run.smithi038.stderr: 66850K .......... .......... .......... .......... .......... 72% 364M 0s 2024-09-22T08:40:29.848 INFO:teuthology.orchestra.run.smithi038.stderr: 66900K .......... .......... .......... .......... .......... 72% 221M 0s 2024-09-22T08:40:29.848 INFO:teuthology.orchestra.run.smithi038.stderr: 66950K .......... .......... .......... .......... .......... 72% 348M 0s 2024-09-22T08:40:29.848 INFO:teuthology.orchestra.run.smithi038.stderr: 67000K .......... .......... .......... .......... .......... 72% 290M 0s 2024-09-22T08:40:29.848 INFO:teuthology.orchestra.run.smithi038.stderr: 67050K .......... .......... .......... .......... .......... 72% 352M 0s 2024-09-22T08:40:29.848 INFO:teuthology.orchestra.run.smithi038.stderr: 67100K .......... .......... .......... .......... .......... 72% 247M 0s 2024-09-22T08:40:29.848 INFO:teuthology.orchestra.run.smithi038.stderr: 67150K .......... .......... .......... .......... .......... 72% 348M 0s 2024-09-22T08:40:29.848 INFO:teuthology.orchestra.run.smithi038.stderr: 67200K .......... .......... .......... .......... .......... 72% 303M 0s 2024-09-22T08:40:29.848 INFO:teuthology.orchestra.run.smithi038.stderr: 67250K .......... .......... .......... .......... .......... 72% 290M 0s 2024-09-22T08:40:29.848 INFO:teuthology.orchestra.run.smithi038.stderr: 67300K .......... .......... .......... .......... .......... 72% 326M 0s 2024-09-22T08:40:29.848 INFO:teuthology.orchestra.run.smithi038.stderr: 67350K .......... .......... .......... .......... .......... 72% 352M 0s 2024-09-22T08:40:29.848 INFO:teuthology.orchestra.run.smithi038.stderr: 67400K .......... .......... .......... .......... .......... 72% 202M 0s 2024-09-22T08:40:29.848 INFO:teuthology.orchestra.run.smithi038.stderr: 67450K .......... .......... .......... .......... .......... 72% 329M 0s 2024-09-22T08:40:29.848 INFO:teuthology.orchestra.run.smithi038.stderr: 67500K .......... .......... .......... .......... .......... 72% 310M 0s 2024-09-22T08:40:29.848 INFO:teuthology.orchestra.run.smithi038.stderr: 67550K .......... .......... .......... .......... .......... 72% 95.4M 0s 2024-09-22T08:40:29.848 INFO:teuthology.orchestra.run.smithi038.stderr: 67600K .......... .......... .......... .......... .......... 72% 355M 0s 2024-09-22T08:40:29.849 INFO:teuthology.orchestra.run.smithi038.stderr: 67650K .......... .......... .......... .......... .......... 72% 365M 0s 2024-09-22T08:40:29.849 INFO:teuthology.orchestra.run.smithi038.stderr: 67700K .......... .......... .......... .......... .......... 72% 324M 0s 2024-09-22T08:40:29.849 INFO:teuthology.orchestra.run.smithi038.stderr: 67750K .......... .......... .......... .......... .......... 72% 339M 0s 2024-09-22T08:40:29.849 INFO:teuthology.orchestra.run.smithi038.stderr: 67800K .......... .......... .......... .......... .......... 73% 358M 0s 2024-09-22T08:40:29.849 INFO:teuthology.orchestra.run.smithi038.stderr: 67850K .......... .......... .......... .......... .......... 73% 376M 0s 2024-09-22T08:40:29.849 INFO:teuthology.orchestra.run.smithi038.stderr: 67900K .......... .......... .......... .......... .......... 73% 191M 0s 2024-09-22T08:40:29.849 INFO:teuthology.orchestra.run.smithi038.stderr: 67950K .......... .......... .......... .......... .......... 73% 353M 0s 2024-09-22T08:40:29.849 INFO:teuthology.orchestra.run.smithi038.stderr: 68000K .......... .......... .......... .......... .......... 73% 352M 0s 2024-09-22T08:40:29.849 INFO:teuthology.orchestra.run.smithi038.stderr: 68050K .......... .......... .......... .......... .......... 73% 351M 0s 2024-09-22T08:40:29.849 INFO:teuthology.orchestra.run.smithi038.stderr: 68100K .......... .......... .......... .......... .......... 73% 305M 0s 2024-09-22T08:40:29.849 INFO:teuthology.orchestra.run.smithi038.stderr: 68150K .......... .......... .......... .......... .......... 73% 373M 0s 2024-09-22T08:40:29.849 INFO:teuthology.orchestra.run.smithi038.stderr: 68200K .......... .......... .......... .......... .......... 73% 367M 0s 2024-09-22T08:40:29.849 INFO:teuthology.orchestra.run.smithi038.stderr: 68250K .......... .......... .......... .......... .......... 73% 281M 0s 2024-09-22T08:40:29.849 INFO:teuthology.orchestra.run.smithi038.stderr: 68300K .......... .......... .......... .......... .......... 73% 122M 0s 2024-09-22T08:40:29.849 INFO:teuthology.orchestra.run.smithi038.stderr: 68350K .......... .......... .......... .......... .......... 73% 335M 0s 2024-09-22T08:40:29.849 INFO:teuthology.orchestra.run.smithi038.stderr: 68400K .......... .......... .......... .......... .......... 73% 363M 0s 2024-09-22T08:40:29.850 INFO:teuthology.orchestra.run.smithi038.stderr: 68450K .......... .......... .......... .......... .......... 73% 289M 0s 2024-09-22T08:40:29.850 INFO:teuthology.orchestra.run.smithi038.stderr: 68500K .......... .......... .......... .......... .......... 73% 322M 0s 2024-09-22T08:40:29.850 INFO:teuthology.orchestra.run.smithi038.stderr: 68550K .......... .......... .......... .......... .......... 73% 80.3M 0s 2024-09-22T08:40:29.850 INFO:teuthology.orchestra.run.smithi038.stderr: 68600K .......... .......... .......... .......... .......... 73% 218M 0s 2024-09-22T08:40:29.850 INFO:teuthology.orchestra.run.smithi038.stderr: 68650K .......... .......... .......... .......... .......... 73% 272M 0s 2024-09-22T08:40:29.850 INFO:teuthology.orchestra.run.smithi038.stderr: 68700K .......... .......... .......... .......... .......... 74% 299M 0s 2024-09-22T08:40:29.850 INFO:teuthology.orchestra.run.smithi038.stderr: 68750K .......... .......... .......... .......... .......... 74% 372M 0s 2024-09-22T08:40:29.850 INFO:teuthology.orchestra.run.smithi038.stderr: 68800K .......... .......... .......... .......... .......... 74% 166M 0s 2024-09-22T08:40:29.850 INFO:teuthology.orchestra.run.smithi038.stderr: 68850K .......... .......... .......... .......... .......... 74% 283M 0s 2024-09-22T08:40:29.850 INFO:teuthology.orchestra.run.smithi038.stderr: 68900K .......... .......... .......... .......... .......... 74% 282M 0s 2024-09-22T08:40:29.850 INFO:teuthology.orchestra.run.smithi038.stderr: 68950K .......... .......... .......... .......... .......... 74% 359M 0s 2024-09-22T08:40:29.850 INFO:teuthology.orchestra.run.smithi038.stderr: 69000K .......... .......... .......... .......... .......... 74% 362M 0s 2024-09-22T08:40:29.850 INFO:teuthology.orchestra.run.smithi038.stderr: 69050K .......... .......... .......... .......... .......... 74% 186M 0s 2024-09-22T08:40:29.850 INFO:teuthology.orchestra.run.smithi038.stderr: 69100K .......... .......... .......... .......... .......... 74% 171M 0s 2024-09-22T08:40:29.850 INFO:teuthology.orchestra.run.smithi038.stderr: 69150K .......... .......... .......... .......... .......... 74% 293M 0s 2024-09-22T08:40:29.851 INFO:teuthology.orchestra.run.smithi038.stderr: 69200K .......... .......... .......... .......... .......... 74% 358M 0s 2024-09-22T08:40:29.851 INFO:teuthology.orchestra.run.smithi038.stderr: 69250K .......... .......... .......... .......... .......... 74% 369M 0s 2024-09-22T08:40:29.851 INFO:teuthology.orchestra.run.smithi038.stderr: 69300K .......... .......... .......... .......... .......... 74% 119M 0s 2024-09-22T08:40:29.851 INFO:teuthology.orchestra.run.smithi038.stderr: 69350K .......... .......... .......... .......... .......... 74% 378M 0s 2024-09-22T08:40:29.851 INFO:teuthology.orchestra.run.smithi038.stderr: 69400K .......... .......... .......... .......... .......... 74% 249M 0s 2024-09-22T08:40:29.851 INFO:teuthology.orchestra.run.smithi038.stderr: 69450K .......... .......... .......... .......... .......... 74% 362M 0s 2024-09-22T08:40:29.851 INFO:teuthology.orchestra.run.smithi038.stderr: 69500K .......... .......... .......... .......... .......... 74% 134M 0s 2024-09-22T08:40:29.851 INFO:teuthology.orchestra.run.smithi038.stderr: 69550K .......... .......... .......... .......... .......... 74% 365M 0s 2024-09-22T08:40:29.851 INFO:teuthology.orchestra.run.smithi038.stderr: 69600K .......... .......... .......... .......... .......... 74% 364M 0s 2024-09-22T08:40:29.851 INFO:teuthology.orchestra.run.smithi038.stderr: 69650K .......... .......... .......... .......... .......... 75% 155M 0s 2024-09-22T08:40:29.851 INFO:teuthology.orchestra.run.smithi038.stderr: 69700K .......... .......... .......... .......... .......... 75% 198M 0s 2024-09-22T08:40:29.851 INFO:teuthology.orchestra.run.smithi038.stderr: 69750K .......... .......... .......... .......... .......... 75% 346M 0s 2024-09-22T08:40:29.851 INFO:teuthology.orchestra.run.smithi038.stderr: 69800K .......... .......... .......... .......... .......... 75% 348M 0s 2024-09-22T08:40:29.851 INFO:teuthology.orchestra.run.smithi038.stderr: 69850K .......... .......... .......... .......... .......... 75% 283M 0s 2024-09-22T08:40:29.851 INFO:teuthology.orchestra.run.smithi038.stderr: 69900K .......... .......... .......... .......... .......... 75% 213M 0s 2024-09-22T08:40:29.852 INFO:teuthology.orchestra.run.smithi038.stderr: 69950K .......... .......... .......... .......... .......... 75% 356M 0s 2024-09-22T08:40:29.852 INFO:teuthology.orchestra.run.smithi038.stderr: 70000K .......... .......... .......... .......... .......... 75% 236M 0s 2024-09-22T08:40:29.852 INFO:teuthology.orchestra.run.smithi038.stderr: 70050K .......... .......... .......... .......... .......... 75% 332M 0s 2024-09-22T08:40:29.852 INFO:teuthology.orchestra.run.smithi038.stderr: 70100K .......... .......... .......... .......... .......... 75% 326M 0s 2024-09-22T08:40:29.852 INFO:teuthology.orchestra.run.smithi038.stderr: 70150K .......... .......... .......... .......... .......... 75% 309M 0s 2024-09-22T08:40:29.852 INFO:teuthology.orchestra.run.smithi038.stderr: 70200K .......... .......... .......... .......... .......... 75% 243M 0s 2024-09-22T08:40:29.852 INFO:teuthology.orchestra.run.smithi038.stderr: 70250K .......... .......... .......... .......... .......... 75% 314M 0s 2024-09-22T08:40:29.852 INFO:teuthology.orchestra.run.smithi038.stderr: 70300K .......... .......... .......... .......... .......... 75% 292M 0s 2024-09-22T08:40:29.852 INFO:teuthology.orchestra.run.smithi038.stderr: 70350K .......... .......... .......... .......... .......... 75% 377M 0s 2024-09-22T08:40:29.852 INFO:teuthology.orchestra.run.smithi038.stderr: 70400K .......... .......... .......... .......... .......... 75% 251M 0s 2024-09-22T08:40:29.852 INFO:teuthology.orchestra.run.smithi038.stderr: 70450K .......... .......... .......... .......... .......... 75% 353M 0s 2024-09-22T08:40:29.852 INFO:teuthology.orchestra.run.smithi038.stderr: 70500K .......... .......... .......... .......... .......... 75% 329M 0s 2024-09-22T08:40:29.852 INFO:teuthology.orchestra.run.smithi038.stderr: 70550K .......... .......... .......... .......... .......... 75% 77.5M 0s 2024-09-22T08:40:29.852 INFO:teuthology.orchestra.run.smithi038.stderr: 70600K .......... .......... .......... .......... .......... 76% 349M 0s 2024-09-22T08:40:29.852 INFO:teuthology.orchestra.run.smithi038.stderr: 70650K .......... .......... .......... .......... .......... 76% 216M 0s 2024-09-22T08:40:29.852 INFO:teuthology.orchestra.run.smithi038.stderr: 70700K .......... .......... .......... .......... .......... 76% 298M 0s 2024-09-22T08:40:29.853 INFO:teuthology.orchestra.run.smithi038.stderr: 70750K .......... .......... .......... .......... .......... 76% 380M 0s 2024-09-22T08:40:29.853 INFO:teuthology.orchestra.run.smithi038.stderr: 70800K .......... .......... .......... .......... .......... 76% 368M 0s 2024-09-22T08:40:29.853 INFO:teuthology.orchestra.run.smithi038.stderr: 70850K .......... .......... .......... .......... .......... 76% 363M 0s 2024-09-22T08:40:29.853 INFO:teuthology.orchestra.run.smithi038.stderr: 70900K .......... .......... .......... .......... .......... 76% 216M 0s 2024-09-22T08:40:29.853 INFO:teuthology.orchestra.run.smithi038.stderr: 70950K .......... .......... .......... .......... .......... 76% 298M 0s 2024-09-22T08:40:29.853 INFO:teuthology.orchestra.run.smithi038.stderr: 71000K .......... .......... .......... .......... .......... 76% 363M 0s 2024-09-22T08:40:29.853 INFO:teuthology.orchestra.run.smithi038.stderr: 71050K .......... .......... .......... .......... .......... 76% 244M 0s 2024-09-22T08:40:29.853 INFO:teuthology.orchestra.run.smithi038.stderr: 71100K .......... .......... .......... .......... .......... 76% 255M 0s 2024-09-22T08:40:29.853 INFO:teuthology.orchestra.run.smithi038.stderr: 71150K .......... .......... .......... .......... .......... 76% 262M 0s 2024-09-22T08:40:29.853 INFO:teuthology.orchestra.run.smithi038.stderr: 71200K .......... .......... .......... .......... .......... 76% 360M 0s 2024-09-22T08:40:29.853 INFO:teuthology.orchestra.run.smithi038.stderr: 71250K .......... .......... .......... .......... .......... 76% 384M 0s 2024-09-22T08:40:29.853 INFO:teuthology.orchestra.run.smithi038.stderr: 71300K .......... .......... .......... .......... .......... 76% 313M 0s 2024-09-22T08:40:29.853 INFO:teuthology.orchestra.run.smithi038.stderr: 71350K .......... .......... .......... .......... .......... 76% 362M 0s 2024-09-22T08:40:29.853 INFO:teuthology.orchestra.run.smithi038.stderr: 71400K .......... .......... .......... .......... .......... 76% 359M 0s 2024-09-22T08:40:29.853 INFO:teuthology.orchestra.run.smithi038.stderr: 71450K .......... .......... .......... .......... .......... 76% 364M 0s 2024-09-22T08:40:29.853 INFO:teuthology.orchestra.run.smithi038.stderr: 71500K .......... .......... .......... .......... .......... 77% 299M 0s 2024-09-22T08:40:29.854 INFO:teuthology.orchestra.run.smithi038.stderr: 71550K .......... .......... .......... .......... .......... 77% 373M 0s 2024-09-22T08:40:29.854 INFO:teuthology.orchestra.run.smithi038.stderr: 71600K .......... .......... .......... .......... .......... 77% 99.4M 0s 2024-09-22T08:40:29.854 INFO:teuthology.orchestra.run.smithi038.stderr: 71650K .......... .......... .......... .......... .......... 77% 130M 0s 2024-09-22T08:40:29.854 INFO:teuthology.orchestra.run.smithi038.stderr: 71700K .......... .......... .......... .......... .......... 77% 354M 0s 2024-09-22T08:40:29.854 INFO:teuthology.orchestra.run.smithi038.stderr: 71750K .......... .......... .......... .......... .......... 77% 322M 0s 2024-09-22T08:40:29.854 INFO:teuthology.orchestra.run.smithi038.stderr: 71800K .......... .......... .......... .......... .......... 77% 159M 0s 2024-09-22T08:40:29.854 INFO:teuthology.orchestra.run.smithi038.stderr: 71850K .......... .......... .......... .......... .......... 77% 255M 0s 2024-09-22T08:40:29.854 INFO:teuthology.orchestra.run.smithi038.stderr: 71900K .......... .......... .......... .......... .......... 77% 175M 0s 2024-09-22T08:40:29.854 INFO:teuthology.orchestra.run.smithi038.stderr: 71950K .......... .......... .......... .......... .......... 77% 291M 0s 2024-09-22T08:40:29.854 INFO:teuthology.orchestra.run.smithi038.stderr: 72000K .......... .......... .......... .......... .......... 77% 367M 0s 2024-09-22T08:40:29.854 INFO:teuthology.orchestra.run.smithi038.stderr: 72050K .......... .......... .......... .......... .......... 77% 357M 0s 2024-09-22T08:40:29.854 INFO:teuthology.orchestra.run.smithi038.stderr: 72100K .......... .......... .......... .......... .......... 77% 319M 0s 2024-09-22T08:40:29.854 INFO:teuthology.orchestra.run.smithi038.stderr: 72150K .......... .......... .......... .......... .......... 77% 338M 0s 2024-09-22T08:40:29.854 INFO:teuthology.orchestra.run.smithi038.stderr: 72200K .......... .......... .......... .......... .......... 77% 152M 0s 2024-09-22T08:40:29.855 INFO:teuthology.orchestra.run.smithi038.stderr: 72250K .......... .......... .......... .......... .......... 77% 334M 0s 2024-09-22T08:40:29.855 INFO:teuthology.orchestra.run.smithi038.stderr: 72300K .......... .......... .......... .......... .......... 77% 169M 0s 2024-09-22T08:40:29.855 INFO:teuthology.orchestra.run.smithi038.stderr: 72350K .......... .......... .......... .......... .......... 77% 330M 0s 2024-09-22T08:40:29.855 INFO:teuthology.orchestra.run.smithi038.stderr: 72400K .......... .......... .......... .......... .......... 77% 374M 0s 2024-09-22T08:40:29.855 INFO:teuthology.orchestra.run.smithi038.stderr: 72450K .......... .......... .......... .......... .......... 78% 155M 0s 2024-09-22T08:40:29.855 INFO:teuthology.orchestra.run.smithi038.stderr: 72500K .......... .......... .......... .......... .......... 78% 205M 0s 2024-09-22T08:40:29.855 INFO:teuthology.orchestra.run.smithi038.stderr: 72550K .......... .......... .......... .......... .......... 78% 310M 0s 2024-09-22T08:40:29.855 INFO:teuthology.orchestra.run.smithi038.stderr: 72600K .......... .......... .......... .......... .......... 78% 364M 0s 2024-09-22T08:40:29.855 INFO:teuthology.orchestra.run.smithi038.stderr: 72650K .......... .......... .......... .......... .......... 78% 330M 0s 2024-09-22T08:40:29.855 INFO:teuthology.orchestra.run.smithi038.stderr: 72700K .......... .......... .......... .......... .......... 78% 284M 0s 2024-09-22T08:40:29.855 INFO:teuthology.orchestra.run.smithi038.stderr: 72750K .......... .......... .......... .......... .......... 78% 229M 0s 2024-09-22T08:40:29.855 INFO:teuthology.orchestra.run.smithi038.stderr: 72800K .......... .......... .......... .......... .......... 78% 165M 0s 2024-09-22T08:40:29.855 INFO:teuthology.orchestra.run.smithi038.stderr: 72850K .......... .......... .......... .......... .......... 78% 351M 0s 2024-09-22T08:40:29.856 INFO:teuthology.orchestra.run.smithi038.stderr: 72900K .......... .......... .......... .......... .......... 78% 131M 0s 2024-09-22T08:40:29.856 INFO:teuthology.orchestra.run.smithi038.stderr: 72950K .......... .......... .......... .......... .......... 78% 347M 0s 2024-09-22T08:40:29.856 INFO:teuthology.orchestra.run.smithi038.stderr: 73000K .......... .......... .......... .......... .......... 78% 353M 0s 2024-09-22T08:40:29.856 INFO:teuthology.orchestra.run.smithi038.stderr: 73050K .......... .......... .......... .......... .......... 78% 346M 0s 2024-09-22T08:40:29.856 INFO:teuthology.orchestra.run.smithi038.stderr: 73100K .......... .......... .......... .......... .......... 78% 294M 0s 2024-09-22T08:40:29.856 INFO:teuthology.orchestra.run.smithi038.stderr: 73150K .......... .......... .......... .......... .......... 78% 373M 0s 2024-09-22T08:40:29.856 INFO:teuthology.orchestra.run.smithi038.stderr: 73200K .......... .......... .......... .......... .......... 78% 227M 0s 2024-09-22T08:40:29.856 INFO:teuthology.orchestra.run.smithi038.stderr: 73250K .......... .......... .......... .......... .......... 78% 283M 0s 2024-09-22T08:40:29.856 INFO:teuthology.orchestra.run.smithi038.stderr: 73300K .......... .......... .......... .......... .......... 78% 330M 0s 2024-09-22T08:40:29.856 INFO:teuthology.orchestra.run.smithi038.stderr: 73350K .......... .......... .......... .......... .......... 79% 300M 0s 2024-09-22T08:40:29.856 INFO:teuthology.orchestra.run.smithi038.stderr: 73400K .......... .......... .......... .......... .......... 79% 321M 0s 2024-09-22T08:40:29.856 INFO:teuthology.orchestra.run.smithi038.stderr: 73450K .......... .......... .......... .......... .......... 79% 304M 0s 2024-09-22T08:40:29.856 INFO:teuthology.orchestra.run.smithi038.stderr: 73500K .......... .......... .......... .......... .......... 79% 196M 0s 2024-09-22T08:40:29.856 INFO:teuthology.orchestra.run.smithi038.stderr: 73550K .......... .......... .......... .......... .......... 79% 348M 0s 2024-09-22T08:40:29.857 INFO:teuthology.orchestra.run.smithi038.stderr: 73600K .......... .......... .......... .......... .......... 79% 59.0M 0s 2024-09-22T08:40:29.857 INFO:teuthology.orchestra.run.smithi038.stderr: 73650K .......... .......... .......... .......... .......... 79% 273M 0s 2024-09-22T08:40:29.857 INFO:teuthology.orchestra.run.smithi038.stderr: 73700K .......... .......... .......... .......... .......... 79% 306M 0s 2024-09-22T08:40:29.857 INFO:teuthology.orchestra.run.smithi038.stderr: 73750K .......... .......... .......... .......... .......... 79% 375M 0s 2024-09-22T08:40:29.857 INFO:teuthology.orchestra.run.smithi038.stderr: 73800K .......... .......... .......... .......... .......... 79% 372M 0s 2024-09-22T08:40:29.857 INFO:teuthology.orchestra.run.smithi038.stderr: 73850K .......... .......... .......... .......... .......... 79% 367M 0s 2024-09-22T08:40:29.857 INFO:teuthology.orchestra.run.smithi038.stderr: 73900K .......... .......... .......... .......... .......... 79% 303M 0s 2024-09-22T08:40:29.857 INFO:teuthology.orchestra.run.smithi038.stderr: 73950K .......... .......... .......... .......... .......... 79% 356M 0s 2024-09-22T08:40:29.857 INFO:teuthology.orchestra.run.smithi038.stderr: 74000K .......... .......... .......... .......... .......... 79% 335M 0s 2024-09-22T08:40:29.857 INFO:teuthology.orchestra.run.smithi038.stderr: 74050K .......... .......... .......... .......... .......... 79% 361M 0s 2024-09-22T08:40:29.857 INFO:teuthology.orchestra.run.smithi038.stderr: 74100K .......... .......... .......... .......... .......... 79% 320M 0s 2024-09-22T08:40:29.857 INFO:teuthology.orchestra.run.smithi038.stderr: 74150K .......... .......... .......... .......... .......... 79% 364M 0s 2024-09-22T08:40:29.857 INFO:teuthology.orchestra.run.smithi038.stderr: 74200K .......... .......... .......... .......... .......... 79% 350M 0s 2024-09-22T08:40:29.857 INFO:teuthology.orchestra.run.smithi038.stderr: 74250K .......... .......... .......... .......... .......... 79% 380M 0s 2024-09-22T08:40:29.857 INFO:teuthology.orchestra.run.smithi038.stderr: 74300K .......... .......... .......... .......... .......... 80% 212M 0s 2024-09-22T08:40:29.858 INFO:teuthology.orchestra.run.smithi038.stderr: 74350K .......... .......... .......... .......... .......... 80% 361M 0s 2024-09-22T08:40:29.858 INFO:teuthology.orchestra.run.smithi038.stderr: 74400K .......... .......... .......... .......... .......... 80% 351M 0s 2024-09-22T08:40:29.858 INFO:teuthology.orchestra.run.smithi038.stderr: 74450K .......... .......... .......... .......... .......... 80% 367M 0s 2024-09-22T08:40:29.858 INFO:teuthology.orchestra.run.smithi038.stderr: 74500K .......... .......... .......... .......... .......... 80% 324M 0s 2024-09-22T08:40:29.858 INFO:teuthology.orchestra.run.smithi038.stderr: 74550K .......... .......... .......... .......... .......... 80% 363M 0s 2024-09-22T08:40:29.858 INFO:teuthology.orchestra.run.smithi038.stderr: 74600K .......... .......... .......... .......... .......... 80% 362M 0s 2024-09-22T08:40:29.858 INFO:teuthology.orchestra.run.smithi038.stderr: 74650K .......... .......... .......... .......... .......... 80% 153M 0s 2024-09-22T08:40:29.858 INFO:teuthology.orchestra.run.smithi038.stderr: 74700K .......... .......... .......... .......... .......... 80% 185M 0s 2024-09-22T08:40:29.858 INFO:teuthology.orchestra.run.smithi038.stderr: 74750K .......... .......... .......... .......... .......... 80% 309M 0s 2024-09-22T08:40:29.858 INFO:teuthology.orchestra.run.smithi038.stderr: 74800K .......... .......... .......... .......... .......... 80% 358M 0s 2024-09-22T08:40:29.858 INFO:teuthology.orchestra.run.smithi038.stderr: 74850K .......... .......... .......... .......... .......... 80% 99.5M 0s 2024-09-22T08:40:29.858 INFO:teuthology.orchestra.run.smithi038.stderr: 74900K .......... .......... .......... .......... .......... 80% 256M 0s 2024-09-22T08:40:29.858 INFO:teuthology.orchestra.run.smithi038.stderr: 74950K .......... .......... .......... .......... .......... 80% 363M 0s 2024-09-22T08:40:29.858 INFO:teuthology.orchestra.run.smithi038.stderr: 75000K .......... .......... .......... .......... .......... 80% 113M 0s 2024-09-22T08:40:29.859 INFO:teuthology.orchestra.run.smithi038.stderr: 75050K .......... .......... .......... .......... .......... 80% 330M 0s 2024-09-22T08:40:29.859 INFO:teuthology.orchestra.run.smithi038.stderr: 75100K .......... .......... .......... .......... .......... 80% 275M 0s 2024-09-22T08:40:29.859 INFO:teuthology.orchestra.run.smithi038.stderr: 75150K .......... .......... .......... .......... .......... 80% 371M 0s 2024-09-22T08:40:29.859 INFO:teuthology.orchestra.run.smithi038.stderr: 75200K .......... .......... .......... .......... .......... 81% 363M 0s 2024-09-22T08:40:29.859 INFO:teuthology.orchestra.run.smithi038.stderr: 75250K .......... .......... .......... .......... .......... 81% 380M 0s 2024-09-22T08:40:29.859 INFO:teuthology.orchestra.run.smithi038.stderr: 75300K .......... .......... .......... .......... .......... 81% 316M 0s 2024-09-22T08:40:29.859 INFO:teuthology.orchestra.run.smithi038.stderr: 75350K .......... .......... .......... .......... .......... 81% 196M 0s 2024-09-22T08:40:29.859 INFO:teuthology.orchestra.run.smithi038.stderr: 75400K .......... .......... .......... .......... .......... 81% 376M 0s 2024-09-22T08:40:29.859 INFO:teuthology.orchestra.run.smithi038.stderr: 75450K .......... .......... .......... .......... .......... 81% 129M 0s 2024-09-22T08:40:29.859 INFO:teuthology.orchestra.run.smithi038.stderr: 75500K .......... .......... .......... .......... .......... 81% 302M 0s 2024-09-22T08:40:29.859 INFO:teuthology.orchestra.run.smithi038.stderr: 75550K .......... .......... .......... .......... .......... 81% 259M 0s 2024-09-22T08:40:29.859 INFO:teuthology.orchestra.run.smithi038.stderr: 75600K .......... .......... .......... .......... .......... 81% 239M 0s 2024-09-22T08:40:29.860 INFO:teuthology.orchestra.run.smithi038.stderr: 75650K .......... .......... .......... .......... .......... 81% 353M 0s 2024-09-22T08:40:29.860 INFO:teuthology.orchestra.run.smithi038.stderr: 75700K .......... .......... .......... .......... .......... 81% 323M 0s 2024-09-22T08:40:29.860 INFO:teuthology.orchestra.run.smithi038.stderr: 75750K .......... .......... .......... .......... .......... 81% 367M 0s 2024-09-22T08:40:29.860 INFO:teuthology.orchestra.run.smithi038.stderr: 75800K .......... .......... .......... .......... .......... 81% 370M 0s 2024-09-22T08:40:29.860 INFO:teuthology.orchestra.run.smithi038.stderr: 75850K .......... .......... .......... .......... .......... 81% 362M 0s 2024-09-22T08:40:29.860 INFO:teuthology.orchestra.run.smithi038.stderr: 75900K .......... .......... .......... .......... .......... 81% 160M 0s 2024-09-22T08:40:29.860 INFO:teuthology.orchestra.run.smithi038.stderr: 75950K .......... .......... .......... .......... .......... 81% 82.4M 0s 2024-09-22T08:40:29.860 INFO:teuthology.orchestra.run.smithi038.stderr: 76000K .......... .......... .......... .......... .......... 81% 334M 0s 2024-09-22T08:40:29.860 INFO:teuthology.orchestra.run.smithi038.stderr: 76050K .......... .......... .......... .......... .......... 81% 374M 0s 2024-09-22T08:40:29.860 INFO:teuthology.orchestra.run.smithi038.stderr: 76100K .......... .......... .......... .......... .......... 81% 323M 0s 2024-09-22T08:40:29.860 INFO:teuthology.orchestra.run.smithi038.stderr: 76150K .......... .......... .......... .......... .......... 82% 360M 0s 2024-09-22T08:40:29.860 INFO:teuthology.orchestra.run.smithi038.stderr: 76200K .......... .......... .......... .......... .......... 82% 357M 0s 2024-09-22T08:40:29.861 INFO:teuthology.orchestra.run.smithi038.stderr: 76250K .......... .......... .......... .......... .......... 82% 362M 0s 2024-09-22T08:40:29.861 INFO:teuthology.orchestra.run.smithi038.stderr: 76300K .......... .......... .......... .......... .......... 82% 304M 0s 2024-09-22T08:40:29.861 INFO:teuthology.orchestra.run.smithi038.stderr: 76350K .......... .......... .......... .......... .......... 82% 355M 0s 2024-09-22T08:40:29.861 INFO:teuthology.orchestra.run.smithi038.stderr: 76400K .......... .......... .......... .......... .......... 82% 380M 0s 2024-09-22T08:40:29.861 INFO:teuthology.orchestra.run.smithi038.stderr: 76450K .......... .......... .......... .......... .......... 82% 166M 0s 2024-09-22T08:40:29.861 INFO:teuthology.orchestra.run.smithi038.stderr: 76500K .......... .......... .......... .......... .......... 82% 323M 0s 2024-09-22T08:40:29.861 INFO:teuthology.orchestra.run.smithi038.stderr: 76550K .......... .......... .......... .......... .......... 82% 357M 0s 2024-09-22T08:40:29.861 INFO:teuthology.orchestra.run.smithi038.stderr: 76600K .......... .......... .......... .......... .......... 82% 368M 0s 2024-09-22T08:40:29.861 INFO:teuthology.orchestra.run.smithi038.stderr: 76650K .......... .......... .......... .......... .......... 82% 62.9M 0s 2024-09-22T08:40:29.861 INFO:teuthology.orchestra.run.smithi038.stderr: 76700K .......... .......... .......... .......... .......... 82% 259M 0s 2024-09-22T08:40:29.861 INFO:teuthology.orchestra.run.smithi038.stderr: 76750K .......... .......... .......... .......... .......... 82% 279M 0s 2024-09-22T08:40:29.861 INFO:teuthology.orchestra.run.smithi038.stderr: 76800K .......... .......... .......... .......... .......... 82% 146M 0s 2024-09-22T08:40:29.861 INFO:teuthology.orchestra.run.smithi038.stderr: 76850K .......... .......... .......... .......... .......... 82% 327M 0s 2024-09-22T08:40:29.861 INFO:teuthology.orchestra.run.smithi038.stderr: 76900K .......... .......... .......... .......... .......... 82% 319M 0s 2024-09-22T08:40:29.861 INFO:teuthology.orchestra.run.smithi038.stderr: 76950K .......... .......... .......... .......... .......... 82% 369M 0s 2024-09-22T08:40:29.861 INFO:teuthology.orchestra.run.smithi038.stderr: 77000K .......... .......... .......... .......... .......... 82% 354M 0s 2024-09-22T08:40:29.862 INFO:teuthology.orchestra.run.smithi038.stderr: 77050K .......... .......... .......... .......... .......... 82% 357M 0s 2024-09-22T08:40:29.862 INFO:teuthology.orchestra.run.smithi038.stderr: 77100K .......... .......... .......... .......... .......... 83% 299M 0s 2024-09-22T08:40:29.862 INFO:teuthology.orchestra.run.smithi038.stderr: 77150K .......... .......... .......... .......... .......... 83% 369M 0s 2024-09-22T08:40:29.862 INFO:teuthology.orchestra.run.smithi038.stderr: 77200K .......... .......... .......... .......... .......... 83% 358M 0s 2024-09-22T08:40:29.862 INFO:teuthology.orchestra.run.smithi038.stderr: 77250K .......... .......... .......... .......... .......... 83% 348M 0s 2024-09-22T08:40:29.862 INFO:teuthology.orchestra.run.smithi038.stderr: 77300K .......... .......... .......... .......... .......... 83% 330M 0s 2024-09-22T08:40:29.862 INFO:teuthology.orchestra.run.smithi038.stderr: 77350K .......... .......... .......... .......... .......... 83% 164M 0s 2024-09-22T08:40:29.862 INFO:teuthology.orchestra.run.smithi038.stderr: 77400K .......... .......... .......... .......... .......... 83% 347M 0s 2024-09-22T08:40:29.862 INFO:teuthology.orchestra.run.smithi038.stderr: 77450K .......... .......... .......... .......... .......... 83% 360M 0s 2024-09-22T08:40:29.862 INFO:teuthology.orchestra.run.smithi038.stderr: 77500K .......... .......... .......... .......... .......... 83% 302M 0s 2024-09-22T08:40:29.862 INFO:teuthology.orchestra.run.smithi038.stderr: 77550K .......... .......... .......... .......... .......... 83% 369M 0s 2024-09-22T08:40:29.862 INFO:teuthology.orchestra.run.smithi038.stderr: 77600K .......... .......... .......... .......... .......... 83% 361M 0s 2024-09-22T08:40:29.862 INFO:teuthology.orchestra.run.smithi038.stderr: 77650K .......... .......... .......... .......... .......... 83% 338M 0s 2024-09-22T08:40:29.862 INFO:teuthology.orchestra.run.smithi038.stderr: 77700K .......... .......... .......... .......... .......... 83% 283M 0s 2024-09-22T08:40:29.863 INFO:teuthology.orchestra.run.smithi038.stderr: 77750K .......... .......... .......... .......... .......... 83% 314M 0s 2024-09-22T08:40:29.863 INFO:teuthology.orchestra.run.smithi038.stderr: 77800K .......... .......... .......... .......... .......... 83% 338M 0s 2024-09-22T08:40:29.863 INFO:teuthology.orchestra.run.smithi038.stderr: 77850K .......... .......... .......... .......... .......... 83% 316M 0s 2024-09-22T08:40:29.863 INFO:teuthology.orchestra.run.smithi038.stderr: 77900K .......... .......... .......... .......... .......... 83% 164M 0s 2024-09-22T08:40:29.863 INFO:teuthology.orchestra.run.smithi038.stderr: 77950K .......... .......... .......... .......... .......... 83% 137M 0s 2024-09-22T08:40:29.863 INFO:teuthology.orchestra.run.smithi038.stderr: 78000K .......... .......... .......... .......... .......... 84% 334M 0s 2024-09-22T08:40:29.863 INFO:teuthology.orchestra.run.smithi038.stderr: 78050K .......... .......... .......... .......... .......... 84% 90.8M 0s 2024-09-22T08:40:29.863 INFO:teuthology.orchestra.run.smithi038.stderr: 78100K .......... .......... .......... .......... .......... 84% 253M 0s 2024-09-22T08:40:29.863 INFO:teuthology.orchestra.run.smithi038.stderr: 78150K .......... .......... .......... .......... .......... 84% 354M 0s 2024-09-22T08:40:29.863 INFO:teuthology.orchestra.run.smithi038.stderr: 78200K .......... .......... .......... .......... .......... 84% 359M 0s 2024-09-22T08:40:29.863 INFO:teuthology.orchestra.run.smithi038.stderr: 78250K .......... .......... .......... .......... .......... 84% 372M 0s 2024-09-22T08:40:29.863 INFO:teuthology.orchestra.run.smithi038.stderr: 78300K .......... .......... .......... .......... .......... 84% 303M 0s 2024-09-22T08:40:29.863 INFO:teuthology.orchestra.run.smithi038.stderr: 78350K .......... .......... .......... .......... .......... 84% 368M 0s 2024-09-22T08:40:29.863 INFO:teuthology.orchestra.run.smithi038.stderr: 78400K .......... .......... .......... .......... .......... 84% 372M 0s 2024-09-22T08:40:29.863 INFO:teuthology.orchestra.run.smithi038.stderr: 78450K .......... .......... .......... .......... .......... 84% 366M 0s 2024-09-22T08:40:29.864 INFO:teuthology.orchestra.run.smithi038.stderr: 78500K .......... .......... .......... .......... .......... 84% 176M 0s 2024-09-22T08:40:29.864 INFO:teuthology.orchestra.run.smithi038.stderr: 78550K .......... .......... .......... .......... .......... 84% 191M 0s 2024-09-22T08:40:29.864 INFO:teuthology.orchestra.run.smithi038.stderr: 78600K .......... .......... .......... .......... .......... 84% 354M 0s 2024-09-22T08:40:29.864 INFO:teuthology.orchestra.run.smithi038.stderr: 78650K .......... .......... .......... .......... .......... 84% 323M 0s 2024-09-22T08:40:29.864 INFO:teuthology.orchestra.run.smithi038.stderr: 78700K .......... .......... .......... .......... .......... 84% 207M 0s 2024-09-22T08:40:29.864 INFO:teuthology.orchestra.run.smithi038.stderr: 78750K .......... .......... .......... .......... .......... 84% 208M 0s 2024-09-22T08:40:29.864 INFO:teuthology.orchestra.run.smithi038.stderr: 78800K .......... .......... .......... .......... .......... 84% 353M 0s 2024-09-22T08:40:29.864 INFO:teuthology.orchestra.run.smithi038.stderr: 78850K .......... .......... .......... .......... .......... 84% 344M 0s 2024-09-22T08:40:29.864 INFO:teuthology.orchestra.run.smithi038.stderr: 78900K .......... .......... .......... .......... .......... 84% 316M 0s 2024-09-22T08:40:29.864 INFO:teuthology.orchestra.run.smithi038.stderr: 78950K .......... .......... .......... .......... .......... 85% 368M 0s 2024-09-22T08:40:29.864 INFO:teuthology.orchestra.run.smithi038.stderr: 79000K .......... .......... .......... .......... .......... 85% 75.9M 0s 2024-09-22T08:40:29.864 INFO:teuthology.orchestra.run.smithi038.stderr: 79050K .......... .......... .......... .......... .......... 85% 354M 0s 2024-09-22T08:40:29.864 INFO:teuthology.orchestra.run.smithi038.stderr: 79100K .......... .......... .......... .......... .......... 85% 260M 0s 2024-09-22T08:40:29.864 INFO:teuthology.orchestra.run.smithi038.stderr: 79150K .......... .......... .......... .......... .......... 85% 310M 0s 2024-09-22T08:40:29.864 INFO:teuthology.orchestra.run.smithi038.stderr: 79200K .......... .......... .......... .......... .......... 85% 324M 0s 2024-09-22T08:40:29.865 INFO:teuthology.orchestra.run.smithi038.stderr: 79250K .......... .......... .......... .......... .......... 85% 291M 0s 2024-09-22T08:40:29.865 INFO:teuthology.orchestra.run.smithi038.stderr: 79300K .......... .......... .......... .......... .......... 85% 270M 0s 2024-09-22T08:40:29.865 INFO:teuthology.orchestra.run.smithi038.stderr: 79350K .......... .......... .......... .......... .......... 85% 360M 0s 2024-09-22T08:40:29.865 INFO:teuthology.orchestra.run.smithi038.stderr: 79400K .......... .......... .......... .......... .......... 85% 375M 0s 2024-09-22T08:40:29.865 INFO:teuthology.orchestra.run.smithi038.stderr: 79450K .......... .......... .......... .......... .......... 85% 156M 0s 2024-09-22T08:40:29.865 INFO:teuthology.orchestra.run.smithi038.stderr: 79500K .......... .......... .......... .......... .......... 85% 264M 0s 2024-09-22T08:40:29.865 INFO:teuthology.orchestra.run.smithi038.stderr: 79550K .......... .......... .......... .......... .......... 85% 310M 0s 2024-09-22T08:40:29.865 INFO:teuthology.orchestra.run.smithi038.stderr: 79600K .......... .......... .......... .......... .......... 85% 362M 0s 2024-09-22T08:40:29.865 INFO:teuthology.orchestra.run.smithi038.stderr: 79650K .......... .......... .......... .......... .......... 85% 382M 0s 2024-09-22T08:40:29.865 INFO:teuthology.orchestra.run.smithi038.stderr: 79700K .......... .......... .......... .......... .......... 85% 103M 0s 2024-09-22T08:40:29.865 INFO:teuthology.orchestra.run.smithi038.stderr: 79750K .......... .......... .......... .......... .......... 85% 175M 0s 2024-09-22T08:40:29.865 INFO:teuthology.orchestra.run.smithi038.stderr: 79800K .......... .......... .......... .......... .......... 85% 99.2M 0s 2024-09-22T08:40:29.865 INFO:teuthology.orchestra.run.smithi038.stderr: 79850K .......... .......... .......... .......... .......... 86% 332M 0s 2024-09-22T08:40:29.865 INFO:teuthology.orchestra.run.smithi038.stderr: 79900K .......... .......... .......... .......... .......... 86% 290M 0s 2024-09-22T08:40:29.865 INFO:teuthology.orchestra.run.smithi038.stderr: 79950K .......... .......... .......... .......... .......... 86% 368M 0s 2024-09-22T08:40:29.866 INFO:teuthology.orchestra.run.smithi038.stderr: 80000K .......... .......... .......... .......... .......... 86% 356M 0s 2024-09-22T08:40:29.866 INFO:teuthology.orchestra.run.smithi038.stderr: 80050K .......... .......... .......... .......... .......... 86% 356M 0s 2024-09-22T08:40:29.866 INFO:teuthology.orchestra.run.smithi038.stderr: 80100K .......... .......... .......... .......... .......... 86% 331M 0s 2024-09-22T08:40:29.866 INFO:teuthology.orchestra.run.smithi038.stderr: 80150K .......... .......... .......... .......... .......... 86% 358M 0s 2024-09-22T08:40:29.866 INFO:teuthology.orchestra.run.smithi038.stderr: 80200K .......... .......... .......... .......... .......... 86% 344M 0s 2024-09-22T08:40:29.866 INFO:teuthology.orchestra.run.smithi038.stderr: 80250K .......... .......... .......... .......... .......... 86% 360M 0s 2024-09-22T08:40:29.866 INFO:teuthology.orchestra.run.smithi038.stderr: 80300K .......... .......... .......... .......... .......... 86% 290M 0s 2024-09-22T08:40:29.866 INFO:teuthology.orchestra.run.smithi038.stderr: 80350K .......... .......... .......... .......... .......... 86% 363M 0s 2024-09-22T08:40:29.866 INFO:teuthology.orchestra.run.smithi038.stderr: 80400K .......... .......... .......... .......... .......... 86% 358M 0s 2024-09-22T08:40:29.866 INFO:teuthology.orchestra.run.smithi038.stderr: 80450K .......... .......... .......... .......... .......... 86% 142M 0s 2024-09-22T08:40:29.866 INFO:teuthology.orchestra.run.smithi038.stderr: 80500K .......... .......... .......... .......... .......... 86% 317M 0s 2024-09-22T08:40:29.866 INFO:teuthology.orchestra.run.smithi038.stderr: 80550K .......... .......... .......... .......... .......... 86% 366M 0s 2024-09-22T08:40:29.866 INFO:teuthology.orchestra.run.smithi038.stderr: 80600K .......... .......... .......... .......... .......... 86% 346M 0s 2024-09-22T08:40:29.866 INFO:teuthology.orchestra.run.smithi038.stderr: 80650K .......... .......... .......... .......... .......... 86% 366M 0s 2024-09-22T08:40:29.867 INFO:teuthology.orchestra.run.smithi038.stderr: 80700K .......... .......... .......... .......... .......... 86% 260M 0s 2024-09-22T08:40:29.867 INFO:teuthology.orchestra.run.smithi038.stderr: 80750K .......... .......... .......... .......... .......... 86% 367M 0s 2024-09-22T08:40:29.867 INFO:teuthology.orchestra.run.smithi038.stderr: 80800K .......... .......... .......... .......... .......... 87% 306M 0s 2024-09-22T08:40:29.867 INFO:teuthology.orchestra.run.smithi038.stderr: 80850K .......... .......... .......... .......... .......... 87% 297M 0s 2024-09-22T08:40:29.867 INFO:teuthology.orchestra.run.smithi038.stderr: 80900K .......... .......... .......... .......... .......... 87% 319M 0s 2024-09-22T08:40:29.867 INFO:teuthology.orchestra.run.smithi038.stderr: 80950K .......... .......... .......... .......... .......... 87% 318M 0s 2024-09-22T08:40:29.867 INFO:teuthology.orchestra.run.smithi038.stderr: 81000K .......... .......... .......... .......... .......... 87% 354M 0s 2024-09-22T08:40:29.867 INFO:teuthology.orchestra.run.smithi038.stderr: 81050K .......... .......... .......... .......... .......... 87% 291M 0s 2024-09-22T08:40:29.867 INFO:teuthology.orchestra.run.smithi038.stderr: 81100K .......... .......... .......... .......... .......... 87% 69.4M 0s 2024-09-22T08:40:29.867 INFO:teuthology.orchestra.run.smithi038.stderr: 81150K .......... .......... .......... .......... .......... 87% 346M 0s 2024-09-22T08:40:29.867 INFO:teuthology.orchestra.run.smithi038.stderr: 81200K .......... .......... .......... .......... .......... 87% 357M 0s 2024-09-22T08:40:29.867 INFO:teuthology.orchestra.run.smithi038.stderr: 81250K .......... .......... .......... .......... .......... 87% 365M 0s 2024-09-22T08:40:29.867 INFO:teuthology.orchestra.run.smithi038.stderr: 81300K .......... .......... .......... .......... .......... 87% 310M 0s 2024-09-22T08:40:29.867 INFO:teuthology.orchestra.run.smithi038.stderr: 81350K .......... .......... .......... .......... .......... 87% 369M 0s 2024-09-22T08:40:29.867 INFO:teuthology.orchestra.run.smithi038.stderr: 81400K .......... .......... .......... .......... .......... 87% 349M 0s 2024-09-22T08:40:29.867 INFO:teuthology.orchestra.run.smithi038.stderr: 81450K .......... .......... .......... .......... .......... 87% 363M 0s 2024-09-22T08:40:29.867 INFO:teuthology.orchestra.run.smithi038.stderr: 81500K .......... .......... .......... .......... .......... 87% 316M 0s 2024-09-22T08:40:29.868 INFO:teuthology.orchestra.run.smithi038.stderr: 81550K .......... .......... .......... .......... .......... 87% 351M 0s 2024-09-22T08:40:29.868 INFO:teuthology.orchestra.run.smithi038.stderr: 81600K .......... .......... .......... .......... .......... 87% 182M 0s 2024-09-22T08:40:29.868 INFO:teuthology.orchestra.run.smithi038.stderr: 81650K .......... .......... .......... .......... .......... 87% 254M 0s 2024-09-22T08:40:29.868 INFO:teuthology.orchestra.run.smithi038.stderr: 81700K .......... .......... .......... .......... .......... 87% 307M 0s 2024-09-22T08:40:29.868 INFO:teuthology.orchestra.run.smithi038.stderr: 81750K .......... .......... .......... .......... .......... 88% 366M 0s 2024-09-22T08:40:29.868 INFO:teuthology.orchestra.run.smithi038.stderr: 81800K .......... .......... .......... .......... .......... 88% 239M 0s 2024-09-22T08:40:29.868 INFO:teuthology.orchestra.run.smithi038.stderr: 81850K .......... .......... .......... .......... .......... 88% 176M 0s 2024-09-22T08:40:29.868 INFO:teuthology.orchestra.run.smithi038.stderr: 81900K .......... .......... .......... .......... .......... 88% 235M 0s 2024-09-22T08:40:29.868 INFO:teuthology.orchestra.run.smithi038.stderr: 81950K .......... .......... .......... .......... .......... 88% 189M 0s 2024-09-22T08:40:29.868 INFO:teuthology.orchestra.run.smithi038.stderr: 82000K .......... .......... .......... .......... .......... 88% 120M 0s 2024-09-22T08:40:29.868 INFO:teuthology.orchestra.run.smithi038.stderr: 82050K .......... .......... .......... .......... .......... 88% 323M 0s 2024-09-22T08:40:29.868 INFO:teuthology.orchestra.run.smithi038.stderr: 82100K .......... .......... .......... .......... .......... 88% 325M 0s 2024-09-22T08:40:29.868 INFO:teuthology.orchestra.run.smithi038.stderr: 82150K .......... .......... .......... .......... .......... 88% 224M 0s 2024-09-22T08:40:29.868 INFO:teuthology.orchestra.run.smithi038.stderr: 82200K .......... .......... .......... .......... .......... 88% 216M 0s 2024-09-22T08:40:29.868 INFO:teuthology.orchestra.run.smithi038.stderr: 82250K .......... .......... .......... .......... .......... 88% 296M 0s 2024-09-22T08:40:29.868 INFO:teuthology.orchestra.run.smithi038.stderr: 82300K .......... .......... .......... .......... .......... 88% 250M 0s 2024-09-22T08:40:29.869 INFO:teuthology.orchestra.run.smithi038.stderr: 82350K .......... .......... .......... .......... .......... 88% 331M 0s 2024-09-22T08:40:29.869 INFO:teuthology.orchestra.run.smithi038.stderr: 82400K .......... .......... .......... .......... .......... 88% 372M 0s 2024-09-22T08:40:29.869 INFO:teuthology.orchestra.run.smithi038.stderr: 82450K .......... .......... .......... .......... .......... 88% 170M 0s 2024-09-22T08:40:29.869 INFO:teuthology.orchestra.run.smithi038.stderr: 82500K .......... .......... .......... .......... .......... 88% 304M 0s 2024-09-22T08:40:29.869 INFO:teuthology.orchestra.run.smithi038.stderr: 82550K .......... .......... .......... .......... .......... 88% 347M 0s 2024-09-22T08:40:29.869 INFO:teuthology.orchestra.run.smithi038.stderr: 82600K .......... .......... .......... .......... .......... 88% 231M 0s 2024-09-22T08:40:29.869 INFO:teuthology.orchestra.run.smithi038.stderr: 82650K .......... .......... .......... .......... .......... 89% 192M 0s 2024-09-22T08:40:29.869 INFO:teuthology.orchestra.run.smithi038.stderr: 82700K .......... .......... .......... .......... .......... 89% 294M 0s 2024-09-22T08:40:29.869 INFO:teuthology.orchestra.run.smithi038.stderr: 82750K .......... .......... .......... .......... .......... 89% 159M 0s 2024-09-22T08:40:29.869 INFO:teuthology.orchestra.run.smithi038.stderr: 82800K .......... .......... .......... .......... .......... 89% 361M 0s 2024-09-22T08:40:29.869 INFO:teuthology.orchestra.run.smithi038.stderr: 82850K .......... .......... .......... .......... .......... 89% 207M 0s 2024-09-22T08:40:29.869 INFO:teuthology.orchestra.run.smithi038.stderr: 82900K .......... .......... .......... .......... .......... 89% 62.1M 0s 2024-09-22T08:40:29.869 INFO:teuthology.orchestra.run.smithi038.stderr: 82950K .......... .......... .......... .......... .......... 89% 339M 0s 2024-09-22T08:40:29.869 INFO:teuthology.orchestra.run.smithi038.stderr: 83000K .......... .......... .......... .......... .......... 89% 348M 0s 2024-09-22T08:40:29.869 INFO:teuthology.orchestra.run.smithi038.stderr: 83050K .......... .......... .......... .......... .......... 89% 314M 0s 2024-09-22T08:40:29.869 INFO:teuthology.orchestra.run.smithi038.stderr: 83100K .......... .......... .......... .......... .......... 89% 302M 0s 2024-09-22T08:40:29.870 INFO:teuthology.orchestra.run.smithi038.stderr: 83150K .......... .......... .......... .......... .......... 89% 369M 0s 2024-09-22T08:40:29.870 INFO:teuthology.orchestra.run.smithi038.stderr: 83200K .......... .......... .......... .......... .......... 89% 373M 0s 2024-09-22T08:40:29.870 INFO:teuthology.orchestra.run.smithi038.stderr: 83250K .......... .......... .......... .......... .......... 89% 350M 0s 2024-09-22T08:40:29.870 INFO:teuthology.orchestra.run.smithi038.stderr: 83300K .......... .......... .......... .......... .......... 89% 321M 0s 2024-09-22T08:40:29.870 INFO:teuthology.orchestra.run.smithi038.stderr: 83350K .......... .......... .......... .......... .......... 89% 377M 0s 2024-09-22T08:40:29.870 INFO:teuthology.orchestra.run.smithi038.stderr: 83400K .......... .......... .......... .......... .......... 89% 380M 0s 2024-09-22T08:40:29.870 INFO:teuthology.orchestra.run.smithi038.stderr: 83450K .......... .......... .......... .......... .......... 89% 371M 0s 2024-09-22T08:40:29.870 INFO:teuthology.orchestra.run.smithi038.stderr: 83500K .......... .......... .......... .......... .......... 89% 250M 0s 2024-09-22T08:40:29.870 INFO:teuthology.orchestra.run.smithi038.stderr: 83550K .......... .......... .......... .......... .......... 89% 338M 0s 2024-09-22T08:40:29.870 INFO:teuthology.orchestra.run.smithi038.stderr: 83600K .......... .......... .......... .......... .......... 90% 354M 0s 2024-09-22T08:40:29.870 INFO:teuthology.orchestra.run.smithi038.stderr: 83650K .......... .......... .......... .......... .......... 90% 360M 0s 2024-09-22T08:40:29.870 INFO:teuthology.orchestra.run.smithi038.stderr: 83700K .......... .......... .......... .......... .......... 90% 309M 0s 2024-09-22T08:40:29.870 INFO:teuthology.orchestra.run.smithi038.stderr: 83750K .......... .......... .......... .......... .......... 90% 347M 0s 2024-09-22T08:40:29.870 INFO:teuthology.orchestra.run.smithi038.stderr: 83800K .......... .......... .......... .......... .......... 90% 330M 0s 2024-09-22T08:40:29.871 INFO:teuthology.orchestra.run.smithi038.stderr: 83850K .......... .......... .......... .......... .......... 90% 333M 0s 2024-09-22T08:40:29.871 INFO:teuthology.orchestra.run.smithi038.stderr: 83900K .......... .......... .......... .......... .......... 90% 296M 0s 2024-09-22T08:40:29.871 INFO:teuthology.orchestra.run.smithi038.stderr: 83950K .......... .......... .......... .......... .......... 90% 329M 0s 2024-09-22T08:40:29.871 INFO:teuthology.orchestra.run.smithi038.stderr: 84000K .......... .......... .......... .......... .......... 90% 344M 0s 2024-09-22T08:40:29.871 INFO:teuthology.orchestra.run.smithi038.stderr: 84050K .......... .......... .......... .......... .......... 90% 310M 0s 2024-09-22T08:40:29.871 INFO:teuthology.orchestra.run.smithi038.stderr: 84100K .......... .......... .......... .......... .......... 90% 42.7M 0s 2024-09-22T08:40:29.871 INFO:teuthology.orchestra.run.smithi038.stderr: 84150K .......... .......... .......... .......... .......... 90% 303M 0s 2024-09-22T08:40:29.871 INFO:teuthology.orchestra.run.smithi038.stderr: 84200K .......... .......... .......... .......... .......... 90% 314M 0s 2024-09-22T08:40:29.871 INFO:teuthology.orchestra.run.smithi038.stderr: 84250K .......... .......... .......... .......... .......... 90% 337M 0s 2024-09-22T08:40:29.871 INFO:teuthology.orchestra.run.smithi038.stderr: 84300K .......... .......... .......... .......... .......... 90% 276M 0s 2024-09-22T08:40:29.871 INFO:teuthology.orchestra.run.smithi038.stderr: 84350K .......... .......... .......... .......... .......... 90% 355M 0s 2024-09-22T08:40:29.871 INFO:teuthology.orchestra.run.smithi038.stderr: 84400K .......... .......... .......... .......... .......... 90% 355M 0s 2024-09-22T08:40:29.871 INFO:teuthology.orchestra.run.smithi038.stderr: 84450K .......... .......... .......... .......... .......... 90% 369M 0s 2024-09-22T08:40:29.871 INFO:teuthology.orchestra.run.smithi038.stderr: 84500K .......... .......... .......... .......... .......... 91% 335M 0s 2024-09-22T08:40:29.872 INFO:teuthology.orchestra.run.smithi038.stderr: 84550K .......... .......... .......... .......... .......... 91% 361M 0s 2024-09-22T08:40:29.872 INFO:teuthology.orchestra.run.smithi038.stderr: 84600K .......... .......... .......... .......... .......... 91% 365M 0s 2024-09-22T08:40:29.872 INFO:teuthology.orchestra.run.smithi038.stderr: 84650K .......... .......... .......... .......... .......... 91% 345M 0s 2024-09-22T08:40:29.872 INFO:teuthology.orchestra.run.smithi038.stderr: 84700K .......... .......... .......... .......... .......... 91% 299M 0s 2024-09-22T08:40:29.872 INFO:teuthology.orchestra.run.smithi038.stderr: 84750K .......... .......... .......... .......... .......... 91% 373M 0s 2024-09-22T08:40:29.872 INFO:teuthology.orchestra.run.smithi038.stderr: 84800K .......... .......... .......... .......... .......... 91% 358M 0s 2024-09-22T08:40:29.872 INFO:teuthology.orchestra.run.smithi038.stderr: 84850K .......... .......... .......... .......... .......... 91% 376M 0s 2024-09-22T08:40:29.872 INFO:teuthology.orchestra.run.smithi038.stderr: 84900K .......... .......... .......... .......... .......... 91% 308M 0s 2024-09-22T08:40:29.872 INFO:teuthology.orchestra.run.smithi038.stderr: 84950K .......... .......... .......... .......... .......... 91% 372M 0s 2024-09-22T08:40:29.872 INFO:teuthology.orchestra.run.smithi038.stderr: 85000K .......... .......... .......... .......... .......... 91% 98.7M 0s 2024-09-22T08:40:29.872 INFO:teuthology.orchestra.run.smithi038.stderr: 85050K .......... .......... .......... .......... .......... 91% 279M 0s 2024-09-22T08:40:29.872 INFO:teuthology.orchestra.run.smithi038.stderr: 85100K .......... .......... .......... .......... .......... 91% 307M 0s 2024-09-22T08:40:29.872 INFO:teuthology.orchestra.run.smithi038.stderr: 85150K .......... .......... .......... .......... .......... 91% 341M 0s 2024-09-22T08:40:29.872 INFO:teuthology.orchestra.run.smithi038.stderr: 85200K .......... .......... .......... .......... .......... 91% 164M 0s 2024-09-22T08:40:29.872 INFO:teuthology.orchestra.run.smithi038.stderr: 85250K .......... .......... .......... .......... .......... 91% 344M 0s 2024-09-22T08:40:29.873 INFO:teuthology.orchestra.run.smithi038.stderr: 85300K .......... .......... .......... .......... .......... 91% 277M 0s 2024-09-22T08:40:29.873 INFO:teuthology.orchestra.run.smithi038.stderr: 85350K .......... .......... .......... .......... .......... 91% 321M 0s 2024-09-22T08:40:29.873 INFO:teuthology.orchestra.run.smithi038.stderr: 85400K .......... .......... .......... .......... .......... 91% 350M 0s 2024-09-22T08:40:29.873 INFO:teuthology.orchestra.run.smithi038.stderr: 85450K .......... .......... .......... .......... .......... 92% 222M 0s 2024-09-22T08:40:29.873 INFO:teuthology.orchestra.run.smithi038.stderr: 85500K .......... .......... .......... .......... .......... 92% 260M 0s 2024-09-22T08:40:29.873 INFO:teuthology.orchestra.run.smithi038.stderr: 85550K .......... .......... .......... .......... .......... 92% 320M 0s 2024-09-22T08:40:29.873 INFO:teuthology.orchestra.run.smithi038.stderr: 85600K .......... .......... .......... .......... .......... 92% 378M 0s 2024-09-22T08:40:29.873 INFO:teuthology.orchestra.run.smithi038.stderr: 85650K .......... .......... .......... .......... .......... 92% 344M 0s 2024-09-22T08:40:29.873 INFO:teuthology.orchestra.run.smithi038.stderr: 85700K .......... .......... .......... .......... .......... 92% 200M 0s 2024-09-22T08:40:29.873 INFO:teuthology.orchestra.run.smithi038.stderr: 85750K .......... .......... .......... .......... .......... 92% 217M 0s 2024-09-22T08:40:29.873 INFO:teuthology.orchestra.run.smithi038.stderr: 85800K .......... .......... .......... .......... .......... 92% 156M 0s 2024-09-22T08:40:29.873 INFO:teuthology.orchestra.run.smithi038.stderr: 85850K .......... .......... .......... .......... .......... 92% 304M 0s 2024-09-22T08:40:29.873 INFO:teuthology.orchestra.run.smithi038.stderr: 85900K .......... .......... .......... .......... .......... 92% 311M 0s 2024-09-22T08:40:29.873 INFO:teuthology.orchestra.run.smithi038.stderr: 85950K .......... .......... .......... .......... .......... 92% 64.1M 0s 2024-09-22T08:40:29.874 INFO:teuthology.orchestra.run.smithi038.stderr: 86000K .......... .......... .......... .......... .......... 92% 156M 0s 2024-09-22T08:40:29.874 INFO:teuthology.orchestra.run.smithi038.stderr: 86050K .......... .......... .......... .......... .......... 92% 346M 0s 2024-09-22T08:40:29.874 INFO:teuthology.orchestra.run.smithi038.stderr: 86100K .......... .......... .......... .......... .......... 92% 333M 0s 2024-09-22T08:40:29.874 INFO:teuthology.orchestra.run.smithi038.stderr: 86150K .......... .......... .......... .......... .......... 92% 318M 0s 2024-09-22T08:40:29.874 INFO:teuthology.orchestra.run.smithi038.stderr: 86200K .......... .......... .......... .......... .......... 92% 349M 0s 2024-09-22T08:40:29.874 INFO:teuthology.orchestra.run.smithi038.stderr: 86250K .......... .......... .......... .......... .......... 92% 364M 0s 2024-09-22T08:40:29.874 INFO:teuthology.orchestra.run.smithi038.stderr: 86300K .......... .......... .......... .......... .......... 92% 285M 0s 2024-09-22T08:40:29.874 INFO:teuthology.orchestra.run.smithi038.stderr: 86350K .......... .......... .......... .......... .......... 93% 371M 0s 2024-09-22T08:40:29.874 INFO:teuthology.orchestra.run.smithi038.stderr: 86400K .......... .......... .......... .......... .......... 93% 181M 0s 2024-09-22T08:40:29.874 INFO:teuthology.orchestra.run.smithi038.stderr: 86450K .......... .......... .......... .......... .......... 93% 330M 0s 2024-09-22T08:40:29.874 INFO:teuthology.orchestra.run.smithi038.stderr: 86500K .......... .......... .......... .......... .......... 93% 290M 0s 2024-09-22T08:40:29.874 INFO:teuthology.orchestra.run.smithi038.stderr: 86550K .......... .......... .......... .......... .......... 93% 326M 0s 2024-09-22T08:40:29.874 INFO:teuthology.orchestra.run.smithi038.stderr: 86600K .......... .......... .......... .......... .......... 93% 311M 0s 2024-09-22T08:40:29.874 INFO:teuthology.orchestra.run.smithi038.stderr: 86650K .......... .......... .......... .......... .......... 93% 291M 0s 2024-09-22T08:40:29.874 INFO:teuthology.orchestra.run.smithi038.stderr: 86700K .......... .......... .......... .......... .......... 93% 272M 0s 2024-09-22T08:40:29.875 INFO:teuthology.orchestra.run.smithi038.stderr: 86750K .......... .......... .......... .......... .......... 93% 203M 0s 2024-09-22T08:40:29.875 INFO:teuthology.orchestra.run.smithi038.stderr: 86800K .......... .......... .......... .......... .......... 93% 359M 0s 2024-09-22T08:40:29.875 INFO:teuthology.orchestra.run.smithi038.stderr: 86850K .......... .......... .......... .......... .......... 93% 344M 0s 2024-09-22T08:40:29.875 INFO:teuthology.orchestra.run.smithi038.stderr: 86900K .......... .......... .......... .......... .......... 93% 328M 0s 2024-09-22T08:40:29.875 INFO:teuthology.orchestra.run.smithi038.stderr: 86950K .......... .......... .......... .......... .......... 93% 359M 0s 2024-09-22T08:40:29.875 INFO:teuthology.orchestra.run.smithi038.stderr: 87000K .......... .......... .......... .......... .......... 93% 346M 0s 2024-09-22T08:40:29.875 INFO:teuthology.orchestra.run.smithi038.stderr: 87050K .......... .......... .......... .......... .......... 93% 376M 0s 2024-09-22T08:40:29.875 INFO:teuthology.orchestra.run.smithi038.stderr: 87100K .......... .......... .......... .......... .......... 93% 316M 0s 2024-09-22T08:40:29.875 INFO:teuthology.orchestra.run.smithi038.stderr: 87150K .......... .......... .......... .......... .......... 93% 70.7M 0s 2024-09-22T08:40:29.875 INFO:teuthology.orchestra.run.smithi038.stderr: 87200K .......... .......... .......... .......... .......... 93% 129M 0s 2024-09-22T08:40:29.875 INFO:teuthology.orchestra.run.smithi038.stderr: 87250K .......... .......... .......... .......... .......... 93% 349M 0s 2024-09-22T08:40:29.875 INFO:teuthology.orchestra.run.smithi038.stderr: 87300K .......... .......... .......... .......... .......... 94% 152M 0s 2024-09-22T08:40:29.875 INFO:teuthology.orchestra.run.smithi038.stderr: 87350K .......... .......... .......... .......... .......... 94% 336M 0s 2024-09-22T08:40:29.875 INFO:teuthology.orchestra.run.smithi038.stderr: 87400K .......... .......... .......... .......... .......... 94% 351M 0s 2024-09-22T08:40:29.875 INFO:teuthology.orchestra.run.smithi038.stderr: 87450K .......... .......... .......... .......... .......... 94% 364M 0s 2024-09-22T08:40:29.876 INFO:teuthology.orchestra.run.smithi038.stderr: 87500K .......... .......... .......... .......... .......... 94% 308M 0s 2024-09-22T08:40:29.876 INFO:teuthology.orchestra.run.smithi038.stderr: 87550K .......... .......... .......... .......... .......... 94% 360M 0s 2024-09-22T08:40:29.876 INFO:teuthology.orchestra.run.smithi038.stderr: 87600K .......... .......... .......... .......... .......... 94% 361M 0s 2024-09-22T08:40:29.876 INFO:teuthology.orchestra.run.smithi038.stderr: 87650K .......... .......... .......... .......... .......... 94% 336M 0s 2024-09-22T08:40:29.876 INFO:teuthology.orchestra.run.smithi038.stderr: 87700K .......... .......... .......... .......... .......... 94% 318M 0s 2024-09-22T08:40:29.876 INFO:teuthology.orchestra.run.smithi038.stderr: 87750K .......... .......... .......... .......... .......... 94% 363M 0s 2024-09-22T08:40:29.876 INFO:teuthology.orchestra.run.smithi038.stderr: 87800K .......... .......... .......... .......... .......... 94% 362M 0s 2024-09-22T08:40:29.876 INFO:teuthology.orchestra.run.smithi038.stderr: 87850K .......... .......... .......... .......... .......... 94% 368M 0s 2024-09-22T08:40:29.876 INFO:teuthology.orchestra.run.smithi038.stderr: 87900K .......... .......... .......... .......... .......... 94% 319M 0s 2024-09-22T08:40:29.876 INFO:teuthology.orchestra.run.smithi038.stderr: 87950K .......... .......... .......... .......... .......... 94% 382M 0s 2024-09-22T08:40:29.876 INFO:teuthology.orchestra.run.smithi038.stderr: 88000K .......... .......... .......... .......... .......... 94% 145M 0s 2024-09-22T08:40:29.876 INFO:teuthology.orchestra.run.smithi038.stderr: 88050K .......... .......... .......... .......... .......... 94% 364M 0s 2024-09-22T08:40:29.876 INFO:teuthology.orchestra.run.smithi038.stderr: 88100K .......... .......... .......... .......... .......... 94% 164M 0s 2024-09-22T08:40:29.876 INFO:teuthology.orchestra.run.smithi038.stderr: 88150K .......... .......... .......... .......... .......... 94% 349M 0s 2024-09-22T08:40:29.876 INFO:teuthology.orchestra.run.smithi038.stderr: 88200K .......... .......... .......... .......... .......... 94% 321M 0s 2024-09-22T08:40:29.876 INFO:teuthology.orchestra.run.smithi038.stderr: 88250K .......... .......... .......... .......... .......... 95% 315M 0s 2024-09-22T08:40:29.876 INFO:teuthology.orchestra.run.smithi038.stderr: 88300K .......... .......... .......... .......... .......... 95% 279M 0s 2024-09-22T08:40:29.877 INFO:teuthology.orchestra.run.smithi038.stderr: 88350K .......... .......... .......... .......... .......... 95% 219M 0s 2024-09-22T08:40:29.877 INFO:teuthology.orchestra.run.smithi038.stderr: 88400K .......... .......... .......... .......... .......... 95% 296M 0s 2024-09-22T08:40:29.877 INFO:teuthology.orchestra.run.smithi038.stderr: 88450K .......... .......... .......... .......... .......... 95% 352M 0s 2024-09-22T08:40:29.877 INFO:teuthology.orchestra.run.smithi038.stderr: 88500K .......... .......... .......... .......... .......... 95% 331M 0s 2024-09-22T08:40:29.877 INFO:teuthology.orchestra.run.smithi038.stderr: 88550K .......... .......... .......... .......... .......... 95% 363M 0s 2024-09-22T08:40:29.877 INFO:teuthology.orchestra.run.smithi038.stderr: 88600K .......... .......... .......... .......... .......... 95% 229M 0s 2024-09-22T08:40:29.877 INFO:teuthology.orchestra.run.smithi038.stderr: 88650K .......... .......... .......... .......... .......... 95% 359M 0s 2024-09-22T08:40:29.877 INFO:teuthology.orchestra.run.smithi038.stderr: 88700K .......... .......... .......... .......... .......... 95% 309M 0s 2024-09-22T08:40:29.877 INFO:teuthology.orchestra.run.smithi038.stderr: 88750K .......... .......... .......... .......... .......... 95% 135M 0s 2024-09-22T08:40:29.877 INFO:teuthology.orchestra.run.smithi038.stderr: 88800K .......... .......... .......... .......... .......... 95% 355M 0s 2024-09-22T08:40:29.877 INFO:teuthology.orchestra.run.smithi038.stderr: 88850K .......... .......... .......... .......... .......... 95% 353M 0s 2024-09-22T08:40:29.877 INFO:teuthology.orchestra.run.smithi038.stderr: 88900K .......... .......... .......... .......... .......... 95% 239M 0s 2024-09-22T08:40:29.877 INFO:teuthology.orchestra.run.smithi038.stderr: 88950K .......... .......... .......... .......... .......... 95% 56.1M 0s 2024-09-22T08:40:29.877 INFO:teuthology.orchestra.run.smithi038.stderr: 89000K .......... .......... .......... .......... .......... 95% 344M 0s 2024-09-22T08:40:29.877 INFO:teuthology.orchestra.run.smithi038.stderr: 89050K .......... .......... .......... .......... .......... 95% 281M 0s 2024-09-22T08:40:29.877 INFO:teuthology.orchestra.run.smithi038.stderr: 89100K .......... .......... .......... .......... .......... 95% 130M 0s 2024-09-22T08:40:29.878 INFO:teuthology.orchestra.run.smithi038.stderr: 89150K .......... .......... .......... .......... .......... 96% 363M 0s 2024-09-22T08:40:29.878 INFO:teuthology.orchestra.run.smithi038.stderr: 89200K .......... .......... .......... .......... .......... 96% 349M 0s 2024-09-22T08:40:29.878 INFO:teuthology.orchestra.run.smithi038.stderr: 89250K .......... .......... .......... .......... .......... 96% 350M 0s 2024-09-22T08:40:29.878 INFO:teuthology.orchestra.run.smithi038.stderr: 89300K .......... .......... .......... .......... .......... 96% 318M 0s 2024-09-22T08:40:29.878 INFO:teuthology.orchestra.run.smithi038.stderr: 89350K .......... .......... .......... .......... .......... 96% 366M 0s 2024-09-22T08:40:29.878 INFO:teuthology.orchestra.run.smithi038.stderr: 89400K .......... .......... .......... .......... .......... 96% 372M 0s 2024-09-22T08:40:29.878 INFO:teuthology.orchestra.run.smithi038.stderr: 89450K .......... .......... .......... .......... .......... 96% 350M 0s 2024-09-22T08:40:29.878 INFO:teuthology.orchestra.run.smithi038.stderr: 89500K .......... .......... .......... .......... .......... 96% 298M 0s 2024-09-22T08:40:29.878 INFO:teuthology.orchestra.run.smithi038.stderr: 89550K .......... .......... .......... .......... .......... 96% 259M 0s 2024-09-22T08:40:29.878 INFO:teuthology.orchestra.run.smithi038.stderr: 89600K .......... .......... .......... .......... .......... 96% 322M 0s 2024-09-22T08:40:29.878 INFO:teuthology.orchestra.run.smithi038.stderr: 89650K .......... .......... .......... .......... .......... 96% 262M 0s 2024-09-22T08:40:29.878 INFO:teuthology.orchestra.run.smithi038.stderr: 89700K .......... .......... .......... .......... .......... 96% 300M 0s 2024-09-22T08:40:29.878 INFO:teuthology.orchestra.run.smithi038.stderr: 89750K .......... .......... .......... .......... .......... 96% 363M 0s 2024-09-22T08:40:29.878 INFO:teuthology.orchestra.run.smithi038.stderr: 89800K .......... .......... .......... .......... .......... 96% 365M 0s 2024-09-22T08:40:29.878 INFO:teuthology.orchestra.run.smithi038.stderr: 89850K .......... .......... .......... .......... .......... 96% 346M 0s 2024-09-22T08:40:29.878 INFO:teuthology.orchestra.run.smithi038.stderr: 89900K .......... .......... .......... .......... .......... 96% 301M 0s 2024-09-22T08:40:29.879 INFO:teuthology.orchestra.run.smithi038.stderr: 89950K .......... .......... .......... .......... .......... 96% 366M 0s 2024-09-22T08:40:29.879 INFO:teuthology.orchestra.run.smithi038.stderr: 90000K .......... .......... .......... .......... .......... 96% 154M 0s 2024-09-22T08:40:29.879 INFO:teuthology.orchestra.run.smithi038.stderr: 90050K .......... .......... .......... .......... .......... 96% 346M 0s 2024-09-22T08:40:29.879 INFO:teuthology.orchestra.run.smithi038.stderr: 90100K .......... .......... .......... .......... .......... 97% 60.2M 0s 2024-09-22T08:40:29.879 INFO:teuthology.orchestra.run.smithi038.stderr: 90150K .......... .......... .......... .......... .......... 97% 341M 0s 2024-09-22T08:40:29.879 INFO:teuthology.orchestra.run.smithi038.stderr: 90200K .......... .......... .......... .......... .......... 97% 335M 0s 2024-09-22T08:40:29.879 INFO:teuthology.orchestra.run.smithi038.stderr: 90250K .......... .......... .......... .......... .......... 97% 347M 0s 2024-09-22T08:40:29.879 INFO:teuthology.orchestra.run.smithi038.stderr: 90300K .......... .......... .......... .......... .......... 97% 310M 0s 2024-09-22T08:40:29.879 INFO:teuthology.orchestra.run.smithi038.stderr: 90350K .......... .......... .......... .......... .......... 97% 183M 0s 2024-09-22T08:40:29.879 INFO:teuthology.orchestra.run.smithi038.stderr: 90400K .......... .......... .......... .......... .......... 97% 216M 0s 2024-09-22T08:40:29.879 INFO:teuthology.orchestra.run.smithi038.stderr: 90450K .......... .......... .......... .......... .......... 97% 351M 0s 2024-09-22T08:40:29.879 INFO:teuthology.orchestra.run.smithi038.stderr: 90500K .......... .......... .......... .......... .......... 97% 313M 0s 2024-09-22T08:40:29.879 INFO:teuthology.orchestra.run.smithi038.stderr: 90550K .......... .......... .......... .......... .......... 97% 341M 0s 2024-09-22T08:40:29.879 INFO:teuthology.orchestra.run.smithi038.stderr: 90600K .......... .......... .......... .......... .......... 97% 357M 0s 2024-09-22T08:40:29.879 INFO:teuthology.orchestra.run.smithi038.stderr: 90650K .......... .......... .......... .......... .......... 97% 366M 0s 2024-09-22T08:40:29.879 INFO:teuthology.orchestra.run.smithi038.stderr: 90700K .......... .......... .......... .......... .......... 97% 297M 0s 2024-09-22T08:40:29.880 INFO:teuthology.orchestra.run.smithi038.stderr: 90750K .......... .......... .......... .......... .......... 97% 377M 0s 2024-09-22T08:40:29.880 INFO:teuthology.orchestra.run.smithi038.stderr: 90800K .......... .......... .......... .......... .......... 97% 376M 0s 2024-09-22T08:40:29.880 INFO:teuthology.orchestra.run.smithi038.stderr: 90850K .......... .......... .......... .......... .......... 97% 314M 0s 2024-09-22T08:40:29.880 INFO:teuthology.orchestra.run.smithi038.stderr: 90900K .......... .......... .......... .......... .......... 97% 263M 0s 2024-09-22T08:40:29.880 INFO:teuthology.orchestra.run.smithi038.stderr: 90950K .......... .......... .......... .......... .......... 97% 372M 0s 2024-09-22T08:40:29.880 INFO:teuthology.orchestra.run.smithi038.stderr: 91000K .......... .......... .......... .......... .......... 98% 150M 0s 2024-09-22T08:40:29.880 INFO:teuthology.orchestra.run.smithi038.stderr: 91050K .......... .......... .......... .......... .......... 98% 303M 0s 2024-09-22T08:40:29.880 INFO:teuthology.orchestra.run.smithi038.stderr: 91100K .......... .......... .......... .......... .......... 98% 271M 0s 2024-09-22T08:40:29.880 INFO:teuthology.orchestra.run.smithi038.stderr: 91150K .......... .......... .......... .......... .......... 98% 138M 0s 2024-09-22T08:40:29.880 INFO:teuthology.orchestra.run.smithi038.stderr: 91200K .......... .......... .......... .......... .......... 98% 253M 0s 2024-09-22T08:40:29.880 INFO:teuthology.orchestra.run.smithi038.stderr: 91250K .......... .......... .......... .......... .......... 98% 328M 0s 2024-09-22T08:40:29.880 INFO:teuthology.orchestra.run.smithi038.stderr: 91300K .......... .......... .......... .......... .......... 98% 326M 0s 2024-09-22T08:40:29.880 INFO:teuthology.orchestra.run.smithi038.stderr: 91350K .......... .......... .......... .......... .......... 98% 349M 0s 2024-09-22T08:40:29.880 INFO:teuthology.orchestra.run.smithi038.stderr: 91400K .......... .......... .......... .......... .......... 98% 342M 0s 2024-09-22T08:40:29.880 INFO:teuthology.orchestra.run.smithi038.stderr: 91450K .......... .......... .......... .......... .......... 98% 367M 0s 2024-09-22T08:40:29.881 INFO:teuthology.orchestra.run.smithi038.stderr: 91500K .......... .......... .......... .......... .......... 98% 297M 0s 2024-09-22T08:40:29.881 INFO:teuthology.orchestra.run.smithi038.stderr: 91550K .......... .......... .......... .......... .......... 98% 345M 0s 2024-09-22T08:40:29.881 INFO:teuthology.orchestra.run.smithi038.stderr: 91600K .......... .......... .......... .......... .......... 98% 358M 0s 2024-09-22T08:40:29.881 INFO:teuthology.orchestra.run.smithi038.stderr: 91650K .......... .......... .......... .......... .......... 98% 365M 0s 2024-09-22T08:40:29.881 INFO:teuthology.orchestra.run.smithi038.stderr: 91700K .......... .......... .......... .......... .......... 98% 338M 0s 2024-09-22T08:40:29.881 INFO:teuthology.orchestra.run.smithi038.stderr: 91750K .......... .......... .......... .......... .......... 98% 321M 0s 2024-09-22T08:40:29.881 INFO:teuthology.orchestra.run.smithi038.stderr: 91800K .......... .......... .......... .......... .......... 98% 147M 0s 2024-09-22T08:40:29.881 INFO:teuthology.orchestra.run.smithi038.stderr: 91850K .......... .......... .......... .......... .......... 98% 347M 0s 2024-09-22T08:40:29.881 INFO:teuthology.orchestra.run.smithi038.stderr: 91900K .......... .......... .......... .......... .......... 98% 290M 0s 2024-09-22T08:40:29.881 INFO:teuthology.orchestra.run.smithi038.stderr: 91950K .......... .......... .......... .......... .......... 99% 380M 0s 2024-09-22T08:40:29.881 INFO:teuthology.orchestra.run.smithi038.stderr: 92000K .......... .......... .......... .......... .......... 99% 51.4M 0s 2024-09-22T08:40:29.881 INFO:teuthology.orchestra.run.smithi038.stderr: 92050K .......... .......... .......... .......... .......... 99% 332M 0s 2024-09-22T08:40:29.881 INFO:teuthology.orchestra.run.smithi038.stderr: 92100K .......... .......... .......... .......... .......... 99% 303M 0s 2024-09-22T08:40:29.881 INFO:teuthology.orchestra.run.smithi038.stderr: 92150K .......... .......... .......... .......... .......... 99% 404M 0s 2024-09-22T08:40:29.881 INFO:teuthology.orchestra.run.smithi038.stderr: 92200K .......... .......... .......... .......... .......... 99% 176M 0s 2024-09-22T08:40:29.882 INFO:teuthology.orchestra.run.smithi038.stderr: 92250K .......... .......... .......... .......... .......... 99% 237M 0s 2024-09-22T08:40:29.882 INFO:teuthology.orchestra.run.smithi038.stderr: 92300K .......... .......... .......... .......... .......... 99% 257M 0s 2024-09-22T08:40:29.882 INFO:teuthology.orchestra.run.smithi038.stderr: 92350K .......... .......... .......... .......... .......... 99% 241M 0s 2024-09-22T08:40:29.882 INFO:teuthology.orchestra.run.smithi038.stderr: 92400K .......... .......... .......... .......... .......... 99% 297M 0s 2024-09-22T08:40:29.882 INFO:teuthology.orchestra.run.smithi038.stderr: 92450K .......... .......... .......... .......... .......... 99% 345M 0s 2024-09-22T08:40:29.882 INFO:teuthology.orchestra.run.smithi038.stderr: 92500K .......... .......... .......... .......... .......... 99% 375M 0s 2024-09-22T08:40:29.882 INFO:teuthology.orchestra.run.smithi038.stderr: 92550K .......... .......... .......... .......... .......... 99% 334M 0s 2024-09-22T08:40:29.882 INFO:teuthology.orchestra.run.smithi038.stderr: 92600K .......... .......... .......... .......... .......... 99% 377M 0s 2024-09-22T08:40:29.882 INFO:teuthology.orchestra.run.smithi038.stderr: 92650K .......... .......... .......... .......... .......... 99% 378M 0s 2024-09-22T08:40:29.882 INFO:teuthology.orchestra.run.smithi038.stderr: 92700K .......... .......... .......... .......... .......... 99% 336M 0s 2024-09-22T08:40:29.882 INFO:teuthology.orchestra.run.smithi038.stderr: 92750K .......... .......... .......... .......... .......... 99% 207M 0s 2024-09-22T08:40:29.882 INFO:teuthology.orchestra.run.smithi038.stderr: 92800K .......... .......... .......... .......... .......... 99% 370M 0s 2024-09-22T08:40:29.882 INFO:teuthology.orchestra.run.smithi038.stderr: 92850K .......... .......... .......... .......... .......... 99% 387M 0s 2024-09-22T08:40:29.882 INFO:teuthology.orchestra.run.smithi038.stderr: 92900K 100% 134G=0.4s 2024-09-22T08:40:29.882 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-09-22T08:40:29.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22 08:40:28 (209 MB/s) - ‘gradle-6.0.1-bin.zip’ saved [95129672/95129672] 2024-09-22T08:40:29.883 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-09-22T08:40:29.917 INFO:teuthology.orchestra.run.smithi038.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-22T08:40:29.917 INFO:teuthology.orchestra.run.smithi038.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-22T08:40:29.917 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-22T08:40:29.917 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-22T08:40:29.917 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-22T08:40:29.917 INFO:teuthology.orchestra.run.smithi038.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-22T08:40:29.917 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-22T08:40:29.917 INFO:teuthology.orchestra.run.smithi038.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-22T08:40:29.917 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-22T08:40:29.917 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-22T08:40:29.917 INFO:teuthology.orchestra.run.smithi038.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-22T08:40:29.917 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-22T08:40:29.918 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-22T08:40:29.918 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-22T08:40:29.918 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-22T08:40:29.918 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-22T08:40:29.918 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-22T08:40:29.918 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-22T08:40:29.918 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-22T08:40:29.918 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-22T08:40:29.918 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-22T08:40:29.918 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-22T08:40:29.918 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-22T08:40:29.918 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-22T08:40:29.918 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-22T08:40:29.918 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-22T08:40:29.918 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-22T08:40:29.919 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-22T08:40:29.919 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-22T08:40:29.919 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-22T08:40:29.919 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-22T08:40:29.919 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-22T08:40:29.919 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-22T08:40:29.919 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-22T08:40:29.919 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-22T08:40:29.919 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-22T08:40:29.919 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-22T08:40:29.919 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-22T08:40:29.919 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-22T08:40:29.919 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-22T08:40:29.919 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-22T08:40:29.919 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-22T08:40:29.920 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-22T08:40:29.920 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-22T08:40:29.920 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-22T08:40:29.920 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-22T08:40:29.920 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-22T08:40:29.920 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-22T08:40:29.920 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-22T08:40:29.920 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-22T08:40:29.920 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-22T08:40:29.920 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-22T08:40:29.920 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-22T08:40:29.920 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-22T08:40:29.920 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-22T08:40:29.920 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-22T08:40:29.920 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-22T08:40:29.921 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-22T08:40:29.921 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-22T08:40:29.921 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-22T08:40:29.921 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-22T08:40:29.921 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-22T08:40:29.921 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-22T08:40:29.921 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-22T08:40:29.921 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-22T08:40:29.921 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-22T08:40:29.921 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-22T08:40:29.921 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-22T08:40:29.921 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-22T08:40:29.921 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-22T08:40:29.921 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-22T08:40:29.921 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-22T08:40:29.922 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-22T08:40:29.922 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-22T08:40:29.922 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-22T08:40:29.922 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-22T08:40:29.922 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-22T08:40:29.922 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-22T08:40:29.922 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-22T08:40:29.922 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-22T08:40:29.922 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-22T08:40:29.922 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-22T08:40:29.922 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-22T08:40:29.922 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-22T08:40:29.922 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-22T08:40:29.922 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-22T08:40:29.922 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-22T08:40:29.922 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-22T08:40:29.923 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-22T08:40:29.923 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-22T08:40:29.923 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-22T08:40:29.923 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-22T08:40:29.923 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-22T08:40:29.923 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-22T08:40:29.923 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-22T08:40:29.923 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-22T08:40:29.923 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-22T08:40:29.923 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-22T08:40:29.923 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-22T08:40:29.923 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-22T08:40:29.923 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-22T08:40:29.923 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-22T08:40:29.923 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-22T08:40:29.923 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-22T08:40:29.924 INFO:teuthology.orchestra.run.smithi038.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-22T08:40:29.924 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-22T08:40:29.924 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-22T08:40:29.924 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-22T08:40:29.924 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-22T08:40:29.924 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-22T08:40:29.924 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-22T08:40:29.924 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-22T08:40:29.924 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-22T08:40:29.924 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-22T08:40:29.924 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-22T08:40:29.924 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-22T08:40:29.924 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-22T08:40:29.924 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-22T08:40:29.924 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-22T08:40:29.925 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-22T08:40:29.925 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-22T08:40:29.925 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-22T08:40:29.925 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-22T08:40:29.925 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-22T08:40:29.925 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-22T08:40:29.925 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-22T08:40:29.925 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-22T08:40:29.925 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-22T08:40:29.925 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-22T08:40:29.925 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-22T08:40:29.925 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-22T08:40:29.925 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-22T08:40:29.925 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-22T08:40:29.925 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-22T08:40:29.925 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-22T08:40:29.926 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-22T08:40:29.926 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-22T08:40:29.926 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-22T08:40:29.926 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-22T08:40:29.926 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-22T08:40:29.926 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-22T08:40:29.926 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-22T08:40:29.926 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-22T08:40:29.926 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-22T08:40:29.926 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-22T08:40:29.926 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-22T08:40:29.926 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-22T08:40:29.926 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-22T08:40:29.926 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-22T08:40:29.927 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-22T08:40:29.927 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-22T08:40:29.927 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-22T08:40:29.927 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-22T08:40:29.927 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-22T08:40:29.927 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-22T08:40:29.927 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-22T08:40:29.927 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-22T08:40:29.927 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-22T08:40:29.927 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-22T08:40:29.927 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-22T08:40:29.927 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-22T08:40:29.927 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-22T08:40:29.927 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-22T08:40:29.927 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-22T08:40:29.928 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-22T08:40:29.928 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-22T08:40:29.928 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-22T08:40:29.928 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-22T08:40:29.928 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-22T08:40:29.928 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-22T08:40:29.928 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-22T08:40:29.928 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-22T08:40:29.928 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-22T08:40:29.928 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-22T08:40:29.928 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-22T08:40:29.928 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-22T08:40:29.928 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-22T08:40:29.928 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-22T08:40:29.929 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-22T08:40:29.929 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-22T08:40:29.929 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-22T08:40:29.929 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-22T08:40:29.929 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-22T08:40:29.929 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-22T08:40:29.929 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-22T08:40:29.929 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-22T08:40:29.929 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-22T08:40:29.929 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-22T08:40:29.929 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-22T08:40:29.929 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-22T08:40:29.929 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-22T08:40:29.929 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-22T08:40:29.929 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-22T08:40:29.930 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-22T08:40:29.930 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-22T08:40:29.930 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-22T08:40:29.930 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-22T08:40:29.930 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-22T08:40:29.930 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-22T08:40:29.930 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-22T08:40:29.930 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-22T08:40:29.930 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-22T08:40:29.930 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-22T08:40:29.930 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-22T08:40:29.930 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-22T08:40:29.930 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-22T08:40:29.930 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-22T08:40:29.931 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-22T08:40:29.931 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-22T08:40:29.931 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-22T08:40:29.931 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-22T08:40:29.931 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-22T08:40:29.931 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-22T08:40:29.931 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-22T08:40:29.931 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-22T08:40:29.931 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-22T08:40:29.931 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-22T08:40:29.931 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-22T08:40:29.931 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-22T08:40:29.931 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-22T08:40:29.931 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-22T08:40:29.932 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-22T08:40:29.932 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-22T08:40:29.932 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-22T08:40:29.932 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-22T08:40:29.932 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-22T08:40:29.932 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-22T08:40:29.932 INFO:teuthology.orchestra.run.smithi038.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2024-09-22T08:40:29.932 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:40:29.932 INFO:teuthology.orchestra.run.smithi038.stdout:Welcome to Gradle 6.0.1! 2024-09-22T08:40:29.932 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:40:29.932 INFO:teuthology.orchestra.run.smithi038.stdout:Here are the highlights of this release: 2024-09-22T08:40:29.932 INFO:teuthology.orchestra.run.smithi038.stdout: - Substantial improvements in dependency management, including 2024-09-22T08:40:29.932 INFO:teuthology.orchestra.run.smithi038.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-22T08:40:29.932 INFO:teuthology.orchestra.run.smithi038.stdout: - Advanced control of transitive versions 2024-09-22T08:40:29.932 INFO:teuthology.orchestra.run.smithi038.stdout: - Support for optional features and dependencies 2024-09-22T08:40:29.933 INFO:teuthology.orchestra.run.smithi038.stdout: - Rules to tweak published metadata 2024-09-22T08:40:29.933 INFO:teuthology.orchestra.run.smithi038.stdout: - Support for Java 13 2024-09-22T08:40:29.933 INFO:teuthology.orchestra.run.smithi038.stdout: - Faster incremental Java and Groovy compilation 2024-09-22T08:40:29.933 INFO:teuthology.orchestra.run.smithi038.stdout: - New Zinc compiler for Scala 2024-09-22T08:40:29.933 INFO:teuthology.orchestra.run.smithi038.stdout: - VS2019 support 2024-09-22T08:40:29.933 INFO:teuthology.orchestra.run.smithi038.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-22T08:40:29.933 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:40:29.933 INFO:teuthology.orchestra.run.smithi038.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-22T08:40:29.933 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:40:29.933 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:40:29.933 INFO:teuthology.orchestra.run.smithi038.stdout:------------------------------------------------------------ 2024-09-22T08:40:29.933 INFO:teuthology.orchestra.run.smithi038.stdout:Gradle 6.0.1 2024-09-22T08:40:29.933 INFO:teuthology.orchestra.run.smithi038.stdout:------------------------------------------------------------ 2024-09-22T08:40:29.933 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:40:29.933 INFO:teuthology.orchestra.run.smithi038.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-22T08:40:29.934 INFO:teuthology.orchestra.run.smithi038.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-22T08:40:29.934 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:40:29.934 INFO:teuthology.orchestra.run.smithi038.stdout:Kotlin: 1.3.50 2024-09-22T08:40:29.934 INFO:teuthology.orchestra.run.smithi038.stdout:Groovy: 2.5.8 2024-09-22T08:40:29.934 INFO:teuthology.orchestra.run.smithi038.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-22T08:40:29.934 INFO:teuthology.orchestra.run.smithi038.stdout:JVM: 11.0.20.1 (Red Hat, Inc. 11.0.20.1+1-LTS) 2024-09-22T08:40:29.934 INFO:teuthology.orchestra.run.smithi038.stdout:OS: Linux 5.14.0-508.el9.x86_64 amd64 2024-09-22T08:40:29.934 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:40:29.934 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-22T08:40:29.934 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-22T08:40:29.934 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi038.front.sepia.ceph.com 2024-09-22T08:40:29.934 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-22T08:40:29.935 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi042.front.sepia.ceph.com 2024-09-22T08:40:29.935 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-22T08:40:31.341 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-22T08:40:31.341 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-22T08:40:31.341 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'DEKCZBFWWWQNIMOULNLB', 'access_secret': 'DdvhgWKRn/9NgcOF00NiHt+DYqYf4MA/57fluXypQ87orTmvz+tOlQ==', 'region': 'mexico', 'endpoint': 'smithi038.front.sepia.ceph.com:443', 'port': 443, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': True, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi038.front.sepia.ceph.com'} 2024-09-22T08:40:31.341 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-22T08:40:31.341 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'DEKCZBFWWWQNIMOULNLB', '--secret', 'DdvhgWKRn/9NgcOF00NiHt+DYqYf4MA/57fluXypQ87orTmvz+tOlQ==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-22T08:40:31.341 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key DEKCZBFWWWQNIMOULNLB --secret DdvhgWKRn/9NgcOF00NiHt+DYqYf4MA/57fluXypQ87orTmvz+tOlQ== --email tester.client.0_test@test.test --cluster ceph 2024-09-22T08:40:31.416 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:40:31.416 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:40:31.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:31.453+0000 7fd93ad20800 20 rados->read ofs=0 len=0 2024-09-22T08:40:31.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:31.455+0000 7fd93ad20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:31.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:31.455+0000 7fd93ad20800 20 realm 2024-09-22T08:40:31.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:31.455+0000 7fd93ad20800 20 rados->read ofs=0 len=0 2024-09-22T08:40:31.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:31.455+0000 7fd93ad20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:31.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:31.455+0000 7fd93ad20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:40:31.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:31.455+0000 7fd93ad20800 20 rados->read ofs=0 len=0 2024-09-22T08:40:31.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:31.455+0000 7fd93ad20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:31.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:31.455+0000 7fd93ad20800 20 rados->read ofs=0 len=0 2024-09-22T08:40:31.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:31.456+0000 7fd93ad20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:31.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:31.456+0000 7fd93ad20800 20 rados->read ofs=0 len=0 2024-09-22T08:40:31.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:31.457+0000 7fd93ad20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:40:31.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:31.457+0000 7fd93ad20800 20 searching for the correct realm 2024-09-22T08:40:31.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:31.459+0000 7fd936267640 0 -- 172.21.15.38:0/1343670463 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7fd92c053940 msgr2=0x7fd92c008430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:40:31.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:31.665+0000 7fd936267640 0 -- 172.21.15.38:0/1343670463 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fd9280d6040 msgr2=0x7fd9280a5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:40:31.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:31.873+0000 7fd93ad20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:40:31.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:31.873+0000 7fd93ad20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:40:31.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:31.873+0000 7fd93ad20800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:40:31.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:31.873+0000 7fd93ad20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:40:31.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:31.873+0000 7fd93ad20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:40:31.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:31.873+0000 7fd93ad20800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:40:31.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:31.873+0000 7fd93ad20800 20 rados->read ofs=0 len=0 2024-09-22T08:40:31.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:31.873+0000 7fd93ad20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:31.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:31.873+0000 7fd93ad20800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.076+0000 7fd93ad20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:32.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.076+0000 7fd93ad20800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.076+0000 7fd93ad20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:40:32.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.076+0000 7fd93ad20800 20 zone default found 2024-09-22T08:40:32.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.076+0000 7fd93ad20800 4 Realm: () 2024-09-22T08:40:32.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.076+0000 7fd93ad20800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:40:32.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.076+0000 7fd93ad20800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:40:32.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.076+0000 7fd93ad20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:40:32.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.076+0000 7fd93ad20800 20 zonegroup default 2024-09-22T08:40:32.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.076+0000 7fd93ad20800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.077+0000 7fd93ad20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.077+0000 7fd93ad20800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.077+0000 7fd93ad20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.077+0000 7fd93ad20800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.078+0000 7fd93ad20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.078+0000 7fd93ad20800 20 started sync module instance, tier type = 2024-09-22T08:40:32.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.078+0000 7fd93ad20800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:40:32.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.090+0000 7fd93ad20800 20 add_watcher() i=0 2024-09-22T08:40:32.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.090+0000 7fd93ad20800 20 add_watcher() i=1 2024-09-22T08:40:32.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.090+0000 7fd93ad20800 20 add_watcher() i=2 2024-09-22T08:40:32.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.090+0000 7fd93ad20800 20 add_watcher() i=3 2024-09-22T08:40:32.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.090+0000 7fd93ad20800 20 add_watcher() i=4 2024-09-22T08:40:32.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.090+0000 7fd93ad20800 20 add_watcher() i=5 2024-09-22T08:40:32.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.090+0000 7fd93ad20800 20 add_watcher() i=6 2024-09-22T08:40:32.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.092+0000 7fd93ad20800 20 add_watcher() i=7 2024-09-22T08:40:32.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.092+0000 7fd93ad20800 2 all 8 watchers are set, enabling cache 2024-09-22T08:40:32.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.094+0000 7fd7edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:32.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.094+0000 7fd93ad20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:40:32.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.094+0000 7fd93ad20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:40:32.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.094+0000 7fd93ad20800 5 note: GC not initialized 2024-09-22T08:40:32.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.094+0000 7fd7ecfe1640 20 reqs_thread_entry: start 2024-09-22T08:40:32.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.095+0000 7fd93ad20800 20 init_complete bucket index max shards: 11 2024-09-22T08:40:32.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.095+0000 7fd93ad20800 20 Filter name: none 2024-09-22T08:40:32.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.095+0000 7fd7e5ffb640 20 reqs_thread_entry: start 2024-09-22T08:40:32.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.095+0000 7fd93ad20800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-22T08:40:32.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.095+0000 7fd93ad20800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.095+0000 7fd93ad20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.095+0000 7fd93ad20800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-22T08:40:32.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.095+0000 7fd93ad20800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-22T08:40:32.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.095+0000 7fd93ad20800 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-22T08:40:32.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.095+0000 7fd93ad20800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.096+0000 7fd93ad20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.096+0000 7fd93ad20800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-22T08:40:32.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.096+0000 7fd93ad20800 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-22T08:40:32.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.096+0000 7fd93ad20800 10 cache get: name=default.rgw.meta+users.keys+DEKCZBFWWWQNIMOULNLB : miss 2024-09-22T08:40:32.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.096+0000 7fd93ad20800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.096+0000 7fd93ad20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.096+0000 7fd93ad20800 10 cache put: name=default.rgw.meta+users.keys+DEKCZBFWWWQNIMOULNLB info.flags=0x0 2024-09-22T08:40:32.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.096+0000 7fd93ad20800 10 adding default.rgw.meta+users.keys+DEKCZBFWWWQNIMOULNLB to cache LRU end 2024-09-22T08:40:32.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.096+0000 7fd93ad20800 10 cache get: name=default.rgw.meta+users.keys+DEKCZBFWWWQNIMOULNLB : hit (negative entry) 2024-09-22T08:40:32.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.096+0000 7fd93ad20800 10 cache get: name=default.rgw.meta+users.keys+DEKCZBFWWWQNIMOULNLB : hit (negative entry) 2024-09-22T08:40:32.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.098+0000 7fd93ad20800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-22T08:40:32.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.098+0000 7fd93ad20800 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-22T08:40:32.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.098+0000 7fd93ad20800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-22T08:40:32.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.098+0000 7fd81a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497035 cookie 94092751795440 notifier 8700 bl.length()=670 2024-09-22T08:40:32.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.098+0000 7fd81a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-22T08:40:32.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.098+0000 7fd81a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-22T08:40:32.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.100+0000 7fd93ad20800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-22T08:40:32.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.100+0000 7fd93ad20800 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-22T08:40:32.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.100+0000 7fd93ad20800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-22T08:40:32.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.100+0000 7fd81a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497017 cookie 94092751788112 notifier 8700 bl.length()=200 2024-09-22T08:40:32.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.100+0000 7fd81a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-22T08:40:32.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.100+0000 7fd81a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-22T08:40:32.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.102+0000 7fd93ad20800 10 cache put: name=default.rgw.meta+users.keys+DEKCZBFWWWQNIMOULNLB info.flags=0x7 2024-09-22T08:40:32.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.102+0000 7fd93ad20800 10 moving default.rgw.meta+users.keys+DEKCZBFWWWQNIMOULNLB to cache LRU end 2024-09-22T08:40:32.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.102+0000 7fd93ad20800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:DEKCZBFWWWQNIMOULNLB, ofs0, ns] 2024-09-22T08:40:32.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.103+0000 7fd81a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497126 cookie 94092751790240 notifier 8700 bl.length()=189 2024-09-22T08:40:32.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.103+0000 7fd81a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+DEKCZBFWWWQNIMOULNLB info.flags=0x7 2024-09-22T08:40:32.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.103+0000 7fd81a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+DEKCZBFWWWQNIMOULNLB to cache LRU end 2024-09-22T08:40:32.105 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-22T08:40:32.105 INFO:teuthology.orchestra.run.smithi038.stdout: "user_id": "tester.client.0", 2024-09-22T08:40:32.106 INFO:teuthology.orchestra.run.smithi038.stdout: "display_name": "Ms. tester.client.0", 2024-09-22T08:40:32.106 INFO:teuthology.orchestra.run.smithi038.stdout: "email": "tester.client.0_test@test.test", 2024-09-22T08:40:32.106 INFO:teuthology.orchestra.run.smithi038.stdout: "suspended": 0, 2024-09-22T08:40:32.106 INFO:teuthology.orchestra.run.smithi038.stdout: "max_buckets": 1000, 2024-09-22T08:40:32.106 INFO:teuthology.orchestra.run.smithi038.stdout: "subusers": [], 2024-09-22T08:40:32.106 INFO:teuthology.orchestra.run.smithi038.stdout: "keys": [ 2024-09-22T08:40:32.106 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-22T08:40:32.106 INFO:teuthology.orchestra.run.smithi038.stdout: "user": "tester.client.0", 2024-09-22T08:40:32.106 INFO:teuthology.orchestra.run.smithi038.stdout: "access_key": "DEKCZBFWWWQNIMOULNLB", 2024-09-22T08:40:32.106 INFO:teuthology.orchestra.run.smithi038.stdout: "secret_key": "DdvhgWKRn/9NgcOF00NiHt+DYqYf4MA/57fluXypQ87orTmvz+tOlQ==", 2024-09-22T08:40:32.106 INFO:teuthology.orchestra.run.smithi038.stdout: "active": true, 2024-09-22T08:40:32.106 INFO:teuthology.orchestra.run.smithi038.stdout: "create_date": "2024-09-22T08:40:32.098323Z" 2024-09-22T08:40:32.107 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-22T08:40:32.107 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-22T08:40:32.107 INFO:teuthology.orchestra.run.smithi038.stdout: "swift_keys": [], 2024-09-22T08:40:32.107 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": [], 2024-09-22T08:40:32.107 INFO:teuthology.orchestra.run.smithi038.stdout: "op_mask": "read, write, delete", 2024-09-22T08:40:32.107 INFO:teuthology.orchestra.run.smithi038.stdout: "default_placement": "", 2024-09-22T08:40:32.107 INFO:teuthology.orchestra.run.smithi038.stdout: "default_storage_class": "", 2024-09-22T08:40:32.107 INFO:teuthology.orchestra.run.smithi038.stdout: "placement_tags": [], 2024-09-22T08:40:32.107 INFO:teuthology.orchestra.run.smithi038.stdout: "bucket_quota": { 2024-09-22T08:40:32.107 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-22T08:40:32.107 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-22T08:40:32.107 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-22T08:40:32.107 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-22T08:40:32.107 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-22T08:40:32.108 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-22T08:40:32.108 INFO:teuthology.orchestra.run.smithi038.stdout: "user_quota": { 2024-09-22T08:40:32.108 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-22T08:40:32.108 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-22T08:40:32.108 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-22T08:40:32.108 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-22T08:40:32.108 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-22T08:40:32.108 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-22T08:40:32.108 INFO:teuthology.orchestra.run.smithi038.stdout: "temp_url_keys": [], 2024-09-22T08:40:32.108 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "rgw", 2024-09-22T08:40:32.108 INFO:teuthology.orchestra.run.smithi038.stdout: "mfa_ids": [], 2024-09-22T08:40:32.108 INFO:teuthology.orchestra.run.smithi038.stdout: "account_id": "", 2024-09-22T08:40:32.108 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-22T08:40:32.108 INFO:teuthology.orchestra.run.smithi038.stdout: "create_date": "2024-09-22T08:40:32.098312Z", 2024-09-22T08:40:32.108 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-22T08:40:32.109 INFO:teuthology.orchestra.run.smithi038.stdout: "group_ids": [] 2024-09-22T08:40:32.109 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-22T08:40:32.109 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:40:32.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.104+0000 7fd7edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:32.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.107+0000 7fd93ad20800 20 remove_watcher() i=0 2024-09-22T08:40:32.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.107+0000 7fd93ad20800 2 removed watcher, disabling cache 2024-09-22T08:40:32.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.108+0000 7fd93ad20800 20 remove_watcher() i=1 2024-09-22T08:40:32.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.110+0000 7fd93ad20800 20 remove_watcher() i=2 2024-09-22T08:40:32.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.111+0000 7fd93ad20800 20 remove_watcher() i=3 2024-09-22T08:40:32.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.113+0000 7fd93ad20800 20 remove_watcher() i=4 2024-09-22T08:40:32.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.115+0000 7fd93ad20800 20 remove_watcher() i=5 2024-09-22T08:40:32.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.118+0000 7fd93ad20800 20 remove_watcher() i=6 2024-09-22T08:40:32.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.120+0000 7fd93ad20800 20 remove_watcher() i=7 2024-09-22T08:40:32.137 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-22T08:40:32.137 DEBUG:teuthology.orchestra.run.smithi038:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-22T08:40:32.172 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-22T08:40:32.172 DEBUG:teuthology.orchestra.run.smithi038:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-22T08:40:32.242 DEBUG:teuthology.orchestra.run.smithi038:> radosgw-admin gc process --include-all 2024-09-22T08:40:32.338 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:40:32.338 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:40:32.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.376+0000 7fc801d3e800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.378+0000 7fc801d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.378+0000 7fc801d3e800 20 realm 2024-09-22T08:40:32.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.378+0000 7fc801d3e800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.378+0000 7fc801d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.378+0000 7fc801d3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:40:32.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.378+0000 7fc801d3e800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.378+0000 7fc801d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.378+0000 7fc801d3e800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.379+0000 7fc801d3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:32.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.379+0000 7fc801d3e800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.380+0000 7fc801d3e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:40:32.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.380+0000 7fc801d3e800 20 searching for the correct realm 2024-09-22T08:40:32.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.383+0000 7fc7fe2c1640 0 -- 172.21.15.38:0/198644873 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7fc7f0007390 msgr2=0x7fc7f0057940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:40:32.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.590+0000 7fc7fe2c1640 0 -- 172.21.15.38:0/198644873 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x55f0ecc24b40 msgr2=0x55f0ecc26fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:40:32.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.595+0000 7fc801d3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:40:32.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.595+0000 7fc801d3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:40:32.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.595+0000 7fc801d3e800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:40:32.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.595+0000 7fc801d3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:40:32.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.595+0000 7fc801d3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:40:32.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.595+0000 7fc801d3e800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:40:32.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.595+0000 7fc801d3e800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.595+0000 7fc801d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.595+0000 7fc801d3e800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.596+0000 7fc801d3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:32.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.596+0000 7fc801d3e800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.596+0000 7fc801d3e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:40:32.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.596+0000 7fc801d3e800 20 zone default found 2024-09-22T08:40:32.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.596+0000 7fc801d3e800 4 Realm: () 2024-09-22T08:40:32.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.596+0000 7fc801d3e800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:40:32.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.596+0000 7fc801d3e800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:40:32.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.596+0000 7fc801d3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:40:32.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.596+0000 7fc801d3e800 20 zonegroup default 2024-09-22T08:40:32.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.596+0000 7fc801d3e800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.596+0000 7fc801d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.596+0000 7fc801d3e800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.597+0000 7fc801d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.597+0000 7fc801d3e800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.597+0000 7fc801d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.597+0000 7fc801d3e800 20 started sync module instance, tier type = 2024-09-22T08:40:32.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.597+0000 7fc801d3e800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:40:32.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.608+0000 7fc801d3e800 20 add_watcher() i=0 2024-09-22T08:40:32.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.608+0000 7fc801d3e800 20 add_watcher() i=1 2024-09-22T08:40:32.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.608+0000 7fc801d3e800 20 add_watcher() i=2 2024-09-22T08:40:32.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.608+0000 7fc801d3e800 20 add_watcher() i=3 2024-09-22T08:40:32.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.608+0000 7fc801d3e800 20 add_watcher() i=4 2024-09-22T08:40:32.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.608+0000 7fc801d3e800 20 add_watcher() i=5 2024-09-22T08:40:32.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.608+0000 7fc801d3e800 20 add_watcher() i=6 2024-09-22T08:40:32.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.610+0000 7fc801d3e800 20 add_watcher() i=7 2024-09-22T08:40:32.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.610+0000 7fc801d3e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:40:32.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.611+0000 7fc6af7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:32.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.611+0000 7fc801d3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:40:32.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.611+0000 7fc801d3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:40:32.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.650+0000 7fc6ae7fc640 20 reqs_thread_entry: start 2024-09-22T08:40:32.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.650+0000 7fc801d3e800 20 init_complete bucket index max shards: 11 2024-09-22T08:40:32.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.650+0000 7fc801d3e800 20 Filter name: none 2024-09-22T08:40:32.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.650+0000 7fc801d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-22T08:40:32.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.650+0000 7fc61ffff640 20 reqs_thread_entry: start 2024-09-22T08:40:32.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.652+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.652+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:32.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.653+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.654+0000 7fc801d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-22T08:40:32.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.655+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.655+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:32.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.656+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:40:32.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.656+0000 7fc801d3e800 20 garbage collection: RGWGC::process iterating over entry tag='_XWAy8pxoscMM6eV0DfVPtMaysTzlDU0', time=2024-09-22T10:31:23.300331+0000, chain.objs.size()=1 2024-09-22T08:40:32.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.656+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.15__shadow_.TmqC36-OfZaQKegMhj5zvmBmgcB3wKf_0 2024-09-22T08:40:32.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.657+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:40:32.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.659+0000 7fc801d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-22T08:40:32.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.660+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.661+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:32.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.661+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T08:40:32.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.661+0000 7fc801d3e800 20 garbage collection: RGWGC::process iterating over entry tag='_zNHX_JNE9WSQ5QWLivi9U4mNjahuWLk', time=2024-09-22T10:31:23.313770+0000, chain.objs.size()=2 2024-09-22T08:40:32.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.661+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.15__shadow_.I4pK2q3BUuhI1-0PWC5Kgb_gB_M11f5_0 2024-09-22T08:40:32.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.661+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.15__shadow_.I4pK2q3BUuhI1-0PWC5Kgb_gB_M11f5_1 2024-09-22T08:40:32.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.661+0000 7fc801d3e800 20 garbage collection: RGWGC::process iterating over entry tag='_F8LXLIvsWqyCpIveHvVnIar7AMXqhk9', time=2024-09-22T10:31:23.377746+0000, chain.objs.size()=3 2024-09-22T08:40:32.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.661+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__shadow_.YCka_L-Tr7dz1716e_mHMS5sRK-d1Oq_0 2024-09-22T08:40:32.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.661+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__shadow_.YCka_L-Tr7dz1716e_mHMS5sRK-d1Oq_1 2024-09-22T08:40:32.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.661+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__shadow_.YCka_L-Tr7dz1716e_mHMS5sRK-d1Oq_2 2024-09-22T08:40:32.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.664+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:40:32.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.667+0000 7fc801d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-22T08:40:32.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.669+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.669+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:32.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.669+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.671+0000 7fc801d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-22T08:40:32.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.672+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.673+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:32.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.673+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T08:40:32.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.673+0000 7fc801d3e800 20 garbage collection: RGWGC::process iterating over entry tag='_35o-ldkK-ip7OHeeE6aBwLgpHZcAiC-', time=2024-09-22T10:31:23.305776+0000, chain.objs.size()=1 2024-09-22T08:40:32.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.673+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.15__shadow_.vONc14FV0dTtbb1ojoTL8OI_R8pe4BG_1 2024-09-22T08:40:32.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.673+0000 7fc801d3e800 20 garbage collection: RGWGC::process iterating over entry tag='_YSRJQVmi30twWeM0Am8OL-EN74DwLtU', time=2024-09-22T10:31:23.419349+0000, chain.objs.size()=2 2024-09-22T08:40:32.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.673+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__shadow_.RctwBgm5sUrXyqAzDH3tzSChtjPiCpN_1 2024-09-22T08:40:32.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.673+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__shadow_.RctwBgm5sUrXyqAzDH3tzSChtjPiCpN_2 2024-09-22T08:40:32.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.675+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:40:32.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.677+0000 7fc801d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-22T08:40:32.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.679+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.679+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:32.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.680+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.681+0000 7fc801d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-22T08:40:32.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.682+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.683+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:32.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.683+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.684+0000 7fc801d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-22T08:40:32.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.686+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.687+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:32.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.687+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:40:32.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.687+0000 7fc801d3e800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.13214161529353111916', time=2024-09-22T10:31:23.385997+0000, chain.objs.size()=3 2024-09-22T08:40:32.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.687+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__multipart_foo-STANDARD.2~E7xfIldHSeOrvgjtD_RSDZHpOwzuGLF.1 2024-09-22T08:40:32.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.687+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__multipart_foo-STANDARD.2~E7xfIldHSeOrvgjtD_RSDZHpOwzuGLF.2 2024-09-22T08:40:32.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.687+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__multipart_foo-STANDARD.2~E7xfIldHSeOrvgjtD_RSDZHpOwzuGLF.3 2024-09-22T08:40:32.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.689+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:40:32.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.691+0000 7fc801d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-22T08:40:32.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.693+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.693+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:32.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.693+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T08:40:32.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.693+0000 7fc801d3e800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.2619650540564678229', time=2024-09-22T10:31:23.255095+0000, chain.objs.size()=4 2024-09-22T08:40:32.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.693+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.10__multipart_foo.2~XSHNRkr5HvA6wwhuNOemg9NBklVsR_n.1 2024-09-22T08:40:32.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.693+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.10__multipart_foo.2~XSHNRkr5HvA6wwhuNOemg9NBklVsR_n.2 2024-09-22T08:40:32.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.693+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.10__multipart_foo.2~XSHNRkr5HvA6wwhuNOemg9NBklVsR_n.3 2024-09-22T08:40:32.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.693+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.10__multipart_foo.2~XSHNRkr5HvA6wwhuNOemg9NBklVsR_n.4 2024-09-22T08:40:32.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.693+0000 7fc801d3e800 20 garbage collection: RGWGC::process iterating over entry tag='_4p0YB5H0H4irKoD71H7FS7MWltXa6qD', time=2024-09-22T10:31:23.369699+0000, chain.objs.size()=2 2024-09-22T08:40:32.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.694+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__shadow_._IWqfdiv7OXZYt9NmT0lX7q0QDy1rzZ_1 2024-09-22T08:40:32.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.694+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__shadow_._IWqfdiv7OXZYt9NmT0lX7q0QDy1rzZ_2 2024-09-22T08:40:32.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.696+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:40:32.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.698+0000 7fc801d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-22T08:40:32.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.700+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.700+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:32.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.700+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.702+0000 7fc801d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-22T08:40:32.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.703+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.703+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:32.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.704+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.705+0000 7fc801d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-22T08:40:32.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.706+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.707+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:32.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.707+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:40:32.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.707+0000 7fc801d3e800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.14991517335492591333', time=2024-09-22T10:31:23.373813+0000, chain.objs.size()=5 2024-09-22T08:40:32.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.707+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__multipart_foo-FROZEN.2~85-BmylZYymbNKqB5Ll5Qdr3TlnTwIt.1 2024-09-22T08:40:32.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.707+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__shadow_foo-FROZEN.2~85-BmylZYymbNKqB5Ll5Qdr3TlnTwIt.1_1 2024-09-22T08:40:32.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.707+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__multipart_foo-FROZEN.2~85-BmylZYymbNKqB5Ll5Qdr3TlnTwIt.2 2024-09-22T08:40:32.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.707+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__shadow_foo-FROZEN.2~85-BmylZYymbNKqB5Ll5Qdr3TlnTwIt.2_1 2024-09-22T08:40:32.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.707+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__multipart_foo-FROZEN.2~85-BmylZYymbNKqB5Ll5Qdr3TlnTwIt.3 2024-09-22T08:40:32.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.709+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:40:32.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.711+0000 7fc801d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-22T08:40:32.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.712+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.713+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:32.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.713+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.714+0000 7fc801d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-22T08:40:32.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.715+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.716+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:32.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.716+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:40:32.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.716+0000 7fc801d3e800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.15712378366824766092', time=2024-09-22T10:31:23.460423+0000, chain.objs.size()=5 2024-09-22T08:40:32.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.716+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.14__multipart_foo-FROZEN.2~LjyQqH9WeIcfrdiOUl6eMLhJRmcb3pc.1 2024-09-22T08:40:32.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.716+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.14__shadow_foo-FROZEN.2~LjyQqH9WeIcfrdiOUl6eMLhJRmcb3pc.1_1 2024-09-22T08:40:32.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.716+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.14__multipart_foo-FROZEN.2~LjyQqH9WeIcfrdiOUl6eMLhJRmcb3pc.2 2024-09-22T08:40:32.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.716+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.14__shadow_foo-FROZEN.2~LjyQqH9WeIcfrdiOUl6eMLhJRmcb3pc.2_1 2024-09-22T08:40:32.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.716+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.14__multipart_foo-FROZEN.2~LjyQqH9WeIcfrdiOUl6eMLhJRmcb3pc.3 2024-09-22T08:40:32.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.719+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:40:32.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.722+0000 7fc801d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-22T08:40:32.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.723+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.723+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:32.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.724+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:40:32.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.724+0000 7fc801d3e800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.17125991950678117014', time=2024-09-22T10:31:23.468313+0000, chain.objs.size()=5 2024-09-22T08:40:32.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.724+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.14__multipart_foo-LUKEWARM.2~Nn3_TvZ4g8Xr48HqygV-Zo4FwZmGYlC.1 2024-09-22T08:40:32.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.724+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.14__shadow_foo-LUKEWARM.2~Nn3_TvZ4g8Xr48HqygV-Zo4FwZmGYlC.1_1 2024-09-22T08:40:32.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.724+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.14__multipart_foo-LUKEWARM.2~Nn3_TvZ4g8Xr48HqygV-Zo4FwZmGYlC.2 2024-09-22T08:40:32.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.724+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.14__shadow_foo-LUKEWARM.2~Nn3_TvZ4g8Xr48HqygV-Zo4FwZmGYlC.2_1 2024-09-22T08:40:32.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.724+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.14__multipart_foo-LUKEWARM.2~Nn3_TvZ4g8Xr48HqygV-Zo4FwZmGYlC.3 2024-09-22T08:40:32.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.726+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:40:32.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.728+0000 7fc801d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-22T08:40:32.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.730+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.731+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:32.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.732+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T08:40:32.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.732+0000 7fc801d3e800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.1488808610722313733', time=2024-09-22T10:31:23.280470+0000, chain.objs.size()=4 2024-09-22T08:40:32.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.732+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.9__multipart_foo.2~c-Q3A65IzOVRXlbhE-qhOJyht1ITTPg.1 2024-09-22T08:40:32.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.732+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.9__multipart_foo.2~c-Q3A65IzOVRXlbhE-qhOJyht1ITTPg.2 2024-09-22T08:40:32.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.732+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.9__multipart_foo.2~c-Q3A65IzOVRXlbhE-qhOJyht1ITTPg.3 2024-09-22T08:40:32.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.732+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.9__multipart_foo.2~c-Q3A65IzOVRXlbhE-qhOJyht1ITTPg.4 2024-09-22T08:40:32.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.732+0000 7fc801d3e800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.15885863959000960366', time=2024-09-22T10:31:23.488420+0000, chain.objs.size()=3 2024-09-22T08:40:32.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.732+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.13__shadow_.TOocScgjAqQY4Jlt7Cn2ink2YK5g0Oz_0 2024-09-22T08:40:32.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.732+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.13__shadow_.TOocScgjAqQY4Jlt7Cn2ink2YK5g0Oz_1 2024-09-22T08:40:32.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.732+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.13__shadow_.TOocScgjAqQY4Jlt7Cn2ink2YK5g0Oz_2 2024-09-22T08:40:32.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.734+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:40:32.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.737+0000 7fc801d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-22T08:40:32.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.738+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.739+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:32.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.739+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:40:32.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.739+0000 7fc801d3e800 20 garbage collection: RGWGC::process iterating over entry tag='_rPegUd2v8PTbWOqQKA5whv5zX8xDQSi', time=2024-09-22T10:31:23.365325+0000, chain.objs.size()=1 2024-09-22T08:40:32.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.739+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__shadow_.PI6hGwwHpPkbi-9-srX6gHNAs6PQyzP_0 2024-09-22T08:40:32.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.740+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:40:32.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.743+0000 7fc801d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-22T08:40:32.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.744+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.745+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:32.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.745+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:40:32.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.745+0000 7fc801d3e800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.13405366920868247854', time=2024-09-22T10:31:23.427017+0000, chain.objs.size()=3 2024-09-22T08:40:32.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.745+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__multipart_foo-STANDARD.2~E7xfIldHSeOrvgjtD_RSDZHpOwzuGLF.1 2024-09-22T08:40:32.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.745+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__multipart_foo-STANDARD.2~E7xfIldHSeOrvgjtD_RSDZHpOwzuGLF.2 2024-09-22T08:40:32.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.745+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__multipart_foo-STANDARD.2~E7xfIldHSeOrvgjtD_RSDZHpOwzuGLF.3 2024-09-22T08:40:32.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.747+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:40:32.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.749+0000 7fc801d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-22T08:40:32.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.750+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.750+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:32.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.751+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:40:32.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.751+0000 7fc801d3e800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.256126293028723002', time=2024-09-22T10:31:23.336261+0000, chain.objs.size()=2 2024-09-22T08:40:32.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.751+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.15__shadow_.BnmZKFMUl_1ILVMYPyePFBWdeD_I215_0 2024-09-22T08:40:32.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.751+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.15__shadow_.BnmZKFMUl_1ILVMYPyePFBWdeD_I215_1 2024-09-22T08:40:32.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.752+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:40:32.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.754+0000 7fc801d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-22T08:40:32.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.755+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.756+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:32.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.756+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T08:40:32.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.756+0000 7fc801d3e800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.11480861774467150027', time=2024-09-22T10:31:23.439428+0000, chain.objs.size()=5 2024-09-22T08:40:32.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.756+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__multipart_foo-FROZEN.2~85-BmylZYymbNKqB5Ll5Qdr3TlnTwIt.1 2024-09-22T08:40:32.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.756+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__shadow_foo-FROZEN.2~85-BmylZYymbNKqB5Ll5Qdr3TlnTwIt.1_1 2024-09-22T08:40:32.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.756+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__multipart_foo-FROZEN.2~85-BmylZYymbNKqB5Ll5Qdr3TlnTwIt.2 2024-09-22T08:40:32.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.756+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__shadow_foo-FROZEN.2~85-BmylZYymbNKqB5Ll5Qdr3TlnTwIt.2_1 2024-09-22T08:40:32.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.756+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__multipart_foo-FROZEN.2~85-BmylZYymbNKqB5Ll5Qdr3TlnTwIt.3 2024-09-22T08:40:32.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.756+0000 7fc801d3e800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.12362179486956355936', time=2024-09-22T10:31:23.495175+0000, chain.objs.size()=3 2024-09-22T08:40:32.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.756+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.13__shadow_.4YhObRU_m3LfSNvajkUt63CyiTi__nW_0 2024-09-22T08:40:32.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.756+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.13__shadow_.4YhObRU_m3LfSNvajkUt63CyiTi__nW_1 2024-09-22T08:40:32.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.756+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.13__shadow_.4YhObRU_m3LfSNvajkUt63CyiTi__nW_2 2024-09-22T08:40:32.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.759+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:40:32.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.761+0000 7fc801d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-22T08:40:32.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.762+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.763+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:32.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.763+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:40:32.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.763+0000 7fc801d3e800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.9315201185618748351', time=2024-09-22T10:31:23.231781+0000, chain.objs.size()=4 2024-09-22T08:40:32.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.763+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.12__multipart_foo.2~_BF4iAJF-6e7Ucrabjm34mrLJbRHSFU.1 2024-09-22T08:40:32.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.763+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.12__multipart_foo.2~_BF4iAJF-6e7Ucrabjm34mrLJbRHSFU.2 2024-09-22T08:40:32.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.763+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.12__multipart_foo.2~_BF4iAJF-6e7Ucrabjm34mrLJbRHSFU.3 2024-09-22T08:40:32.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.763+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.12__multipart_foo.2~_BF4iAJF-6e7Ucrabjm34mrLJbRHSFU.4 2024-09-22T08:40:32.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.765+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:40:32.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.768+0000 7fc801d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-22T08:40:32.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.769+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.769+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:32.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.769+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.771+0000 7fc801d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-22T08:40:32.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.772+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.772+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:32.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.773+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.774+0000 7fc801d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-22T08:40:32.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.775+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.775+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:32.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.776+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:40:32.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.776+0000 7fc801d3e800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.8183557636807237596', time=2024-09-22T10:31:23.309799+0000, chain.objs.size()=2 2024-09-22T08:40:32.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.776+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.15__shadow_.eWg3VnHvcOu-puZvOwgz1c_qHzjTosl_0 2024-09-22T08:40:32.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.776+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.15__shadow_.eWg3VnHvcOu-puZvOwgz1c_qHzjTosl_1 2024-09-22T08:40:32.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.777+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:40:32.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.779+0000 7fc801d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-22T08:40:32.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.781+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.781+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:32.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.782+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T08:40:32.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.782+0000 7fc801d3e800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.14985139845414418464', time=2024-09-22T10:31:23.210820+0000, chain.objs.size()=4 2024-09-22T08:40:32.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.782+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.11__multipart_foo.2~Qdoj6MbR16WKKUuXkhPwc_ElJK79vww.1 2024-09-22T08:40:32.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.782+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.11__multipart_foo.2~Qdoj6MbR16WKKUuXkhPwc_ElJK79vww.2 2024-09-22T08:40:32.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.782+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.11__multipart_foo.2~Qdoj6MbR16WKKUuXkhPwc_ElJK79vww.3 2024-09-22T08:40:32.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.782+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.11__multipart_foo.2~Qdoj6MbR16WKKUuXkhPwc_ElJK79vww.4 2024-09-22T08:40:32.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.782+0000 7fc801d3e800 20 garbage collection: RGWGC::process iterating over entry tag='_D_YzSapRUyDUfZjQ1Bp-1OdcQPGqltM', time=2024-09-22T10:31:23.317690+0000, chain.objs.size()=2 2024-09-22T08:40:32.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.782+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.15__shadow_.jB20MdoqW-SzLokuXBZ9i2HKl47vroY_0 2024-09-22T08:40:32.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.782+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.15__shadow_.jB20MdoqW-SzLokuXBZ9i2HKl47vroY_1 2024-09-22T08:40:32.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.784+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:40:32.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.786+0000 7fc801d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-22T08:40:32.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.787+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.788+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:32.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.788+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T08:40:32.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.788+0000 7fc801d3e800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.14795832951674874818', time=2024-09-22T10:31:23.328836+0000, chain.objs.size()=2 2024-09-22T08:40:32.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.788+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.15__shadow_.BnmZKFMUl_1ILVMYPyePFBWdeD_I215_0 2024-09-22T08:40:32.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.788+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.15__shadow_.BnmZKFMUl_1ILVMYPyePFBWdeD_I215_1 2024-09-22T08:40:32.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.788+0000 7fc801d3e800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.17614334060530338602', time=2024-09-22T10:31:23.430945+0000, chain.objs.size()=5 2024-09-22T08:40:32.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.788+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__multipart_foo-LUKEWARM.2~tN0VPYqC8uOQ80M3f5t4uBmqy4MkSDK.1 2024-09-22T08:40:32.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.788+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__shadow_foo-LUKEWARM.2~tN0VPYqC8uOQ80M3f5t4uBmqy4MkSDK.1_1 2024-09-22T08:40:32.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.788+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__multipart_foo-LUKEWARM.2~tN0VPYqC8uOQ80M3f5t4uBmqy4MkSDK.2 2024-09-22T08:40:32.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.788+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__shadow_foo-LUKEWARM.2~tN0VPYqC8uOQ80M3f5t4uBmqy4MkSDK.2_1 2024-09-22T08:40:32.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.788+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__multipart_foo-LUKEWARM.2~tN0VPYqC8uOQ80M3f5t4uBmqy4MkSDK.3 2024-09-22T08:40:32.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.790+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:40:32.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.792+0000 7fc801d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-22T08:40:32.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.794+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.794+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:32.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.795+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T08:40:32.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.795+0000 7fc801d3e800 20 garbage collection: RGWGC::process iterating over entry tag='_nsxot1ayzVLVuF5T94XyrbnyV_aC2gU', time=2024-09-22T10:31:23.340279+0000, chain.objs.size()=1 2024-09-22T08:40:32.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.795+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.15__shadow_.-McLHgJzujgAjshbwAgv0L-xLtJN83-_0 2024-09-22T08:40:32.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.795+0000 7fc801d3e800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.6821188475424177117', time=2024-09-22T10:31:23.464358+0000, chain.objs.size()=3 2024-09-22T08:40:32.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.795+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.14__multipart_foo-STANDARD.2~QnU2kMzAdk4M7iyl9B_m8nwdWtobLUM.1 2024-09-22T08:40:32.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.795+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.14__multipart_foo-STANDARD.2~QnU2kMzAdk4M7iyl9B_m8nwdWtobLUM.2 2024-09-22T08:40:32.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.795+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.14__multipart_foo-STANDARD.2~QnU2kMzAdk4M7iyl9B_m8nwdWtobLUM.3 2024-09-22T08:40:32.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.796+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:40:32.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.798+0000 7fc801d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-22T08:40:32.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.799+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.800+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:32.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.801+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-22T08:40:32.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.801+0000 7fc801d3e800 20 garbage collection: RGWGC::process iterating over entry tag='_m1xvS4rjkgQJPPDk0Url48Xg4Dc4RiA', time=2024-09-22T10:31:23.324912+0000, chain.objs.size()=1 2024-09-22T08:40:32.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.801+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.15__shadow_.BKiehYpzBqMbZVqr-cVVSQZgXEcMXI2_1 2024-09-22T08:40:32.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.801+0000 7fc801d3e800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.3232254132714075106', time=2024-09-22T10:31:23.344764+0000, chain.objs.size()=2 2024-09-22T08:40:32.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.801+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.15__shadow_.eWg3VnHvcOu-puZvOwgz1c_qHzjTosl_0 2024-09-22T08:40:32.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.801+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.15__shadow_.eWg3VnHvcOu-puZvOwgz1c_qHzjTosl_1 2024-09-22T08:40:32.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.801+0000 7fc801d3e800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.8488745022955541935', time=2024-09-22T10:31:23.423064+0000, chain.objs.size()=5 2024-09-22T08:40:32.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.801+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__multipart_foo-LUKEWARM.2~tN0VPYqC8uOQ80M3f5t4uBmqy4MkSDK.1 2024-09-22T08:40:32.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.801+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__shadow_foo-LUKEWARM.2~tN0VPYqC8uOQ80M3f5t4uBmqy4MkSDK.1_1 2024-09-22T08:40:32.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.801+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__multipart_foo-LUKEWARM.2~tN0VPYqC8uOQ80M3f5t4uBmqy4MkSDK.2 2024-09-22T08:40:32.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.801+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__shadow_foo-LUKEWARM.2~tN0VPYqC8uOQ80M3f5t4uBmqy4MkSDK.2_1 2024-09-22T08:40:32.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.801+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__multipart_foo-LUKEWARM.2~tN0VPYqC8uOQ80M3f5t4uBmqy4MkSDK.3 2024-09-22T08:40:32.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.801+0000 7fc801d3e800 20 garbage collection: RGWGC::process iterating over entry tag='_okxa-p9dsVaGHezslLRAvCjIIKZuT1_', time=2024-09-22T10:31:23.435397+0000, chain.objs.size()=1 2024-09-22T08:40:32.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.801+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__shadow_.9pHz2JDuxBcjWbzkXfsfku4Ym2KD86k_0 2024-09-22T08:40:32.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.803+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:40:32.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.805+0000 7fc801d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-22T08:40:32.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.808+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.808+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:32.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.809+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.810+0000 7fc801d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-22T08:40:32.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.811+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.812+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:32.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.812+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.813+0000 7fc801d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-22T08:40:32.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.815+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.815+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:32.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.816+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:40:32.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.816+0000 7fc801d3e800 20 garbage collection: RGWGC::process iterating over entry tag='_zazS380yU0wyTlG1uUCeGkkFOc6MrPQ', time=2024-09-22T10:31:23.381681+0000, chain.objs.size()=3 2024-09-22T08:40:32.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.816+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__shadow_.mC7O2lzEYLEsO64hA49nOutPr70CuYy_0 2024-09-22T08:40:32.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.816+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__shadow_.mC7O2lzEYLEsO64hA49nOutPr70CuYy_1 2024-09-22T08:40:32.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.816+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.16__shadow_.mC7O2lzEYLEsO64hA49nOutPr70CuYy_2 2024-09-22T08:40:32.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.819+0000 7fc801d3e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:40:32.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.822+0000 7fc801d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-22T08:40:32.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.823+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.823+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:32.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.824+0000 7fc801d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:32.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.825+0000 7fc6af7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:32.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.828+0000 7fc801d3e800 20 remove_watcher() i=0 2024-09-22T08:40:32.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.828+0000 7fc801d3e800 2 removed watcher, disabling cache 2024-09-22T08:40:32.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.829+0000 7fc801d3e800 20 remove_watcher() i=1 2024-09-22T08:40:32.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.830+0000 7fc801d3e800 20 remove_watcher() i=2 2024-09-22T08:40:32.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.831+0000 7fc801d3e800 20 remove_watcher() i=3 2024-09-22T08:40:32.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.832+0000 7fc801d3e800 20 remove_watcher() i=4 2024-09-22T08:40:32.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.833+0000 7fc801d3e800 20 remove_watcher() i=5 2024-09-22T08:40:32.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.834+0000 7fc801d3e800 20 remove_watcher() i=6 2024-09-22T08:40:32.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.835+0000 7fc801d3e800 20 remove_watcher() i=7 2024-09-22T08:40:32.848 DEBUG:teuthology.orchestra.run.smithi038:> radosgw-admin gc process --include-all 2024-09-22T08:40:32.902 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:40:32.902 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:40:32.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.939+0000 7f4d3ee2f800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.940+0000 7f4d3ee2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.940+0000 7f4d3ee2f800 20 realm 2024-09-22T08:40:32.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.940+0000 7f4d3ee2f800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.941+0000 7f4d3ee2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.941+0000 7f4d3ee2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:40:32.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.941+0000 7f4d3ee2f800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.941+0000 7f4d3ee2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.941+0000 7f4d3ee2f800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.942+0000 7f4d3ee2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:32.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.942+0000 7f4d3ee2f800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.942+0000 7f4d3ee2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:40:32.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.942+0000 7f4d3ee2f800 20 searching for the correct realm 2024-09-22T08:40:32.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.945+0000 7f4d37fff640 0 -- 172.21.15.38:0/1465745298 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f4d28048760 msgr2=0x7f4d28060440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:40:32.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:32.948+0000 7f4d37fff640 0 -- 172.21.15.38:0/1465745298 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f4d3004a3f0 msgr2=0x7f4d3004a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:40:33.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.155+0000 7f4d3ee2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:40:33.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.155+0000 7f4d3ee2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:40:33.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.155+0000 7f4d3ee2f800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:40:33.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.155+0000 7f4d3ee2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:40:33.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.155+0000 7f4d3ee2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:40:33.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.155+0000 7f4d3ee2f800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:40:33.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.155+0000 7f4d3ee2f800 20 rados->read ofs=0 len=0 2024-09-22T08:40:33.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.156+0000 7f4d3ee2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:33.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.156+0000 7f4d3ee2f800 20 rados->read ofs=0 len=0 2024-09-22T08:40:33.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.156+0000 7f4d3ee2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:33.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.156+0000 7f4d3ee2f800 20 rados->read ofs=0 len=0 2024-09-22T08:40:33.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.156+0000 7f4d3ee2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:40:33.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.156+0000 7f4d3ee2f800 20 zone default found 2024-09-22T08:40:33.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.156+0000 7f4d3ee2f800 4 Realm: () 2024-09-22T08:40:33.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.156+0000 7f4d3ee2f800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:40:33.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.156+0000 7f4d3ee2f800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:40:33.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.156+0000 7f4d3ee2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:40:33.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.156+0000 7f4d3ee2f800 20 zonegroup default 2024-09-22T08:40:33.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.156+0000 7f4d3ee2f800 20 rados->read ofs=0 len=0 2024-09-22T08:40:33.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.157+0000 7f4d3ee2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:33.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.157+0000 7f4d3ee2f800 20 rados->read ofs=0 len=0 2024-09-22T08:40:33.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.157+0000 7f4d3ee2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:33.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.157+0000 7f4d3ee2f800 20 rados->read ofs=0 len=0 2024-09-22T08:40:33.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.157+0000 7f4d3ee2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:33.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.157+0000 7f4d3ee2f800 20 started sync module instance, tier type = 2024-09-22T08:40:33.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.157+0000 7f4d3ee2f800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:40:33.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.167+0000 7f4d3ee2f800 20 add_watcher() i=0 2024-09-22T08:40:33.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.167+0000 7f4d3ee2f800 20 add_watcher() i=1 2024-09-22T08:40:33.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.167+0000 7f4d3ee2f800 20 add_watcher() i=2 2024-09-22T08:40:33.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.167+0000 7f4d3ee2f800 20 add_watcher() i=3 2024-09-22T08:40:33.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.167+0000 7f4d3ee2f800 20 add_watcher() i=4 2024-09-22T08:40:33.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.167+0000 7f4d3ee2f800 20 add_watcher() i=5 2024-09-22T08:40:33.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.167+0000 7f4d3ee2f800 20 add_watcher() i=6 2024-09-22T08:40:33.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.168+0000 7f4d3ee2f800 20 add_watcher() i=7 2024-09-22T08:40:33.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.168+0000 7f4d3ee2f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:40:33.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.170+0000 7f4bf37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:33.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.170+0000 7f4d3ee2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:40:33.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.170+0000 7f4d3ee2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:40:33.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.206+0000 7f4bf27e4640 20 reqs_thread_entry: start 2024-09-22T08:40:33.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.206+0000 7f4d3ee2f800 20 init_complete bucket index max shards: 11 2024-09-22T08:40:33.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.207+0000 7f4d3ee2f800 20 Filter name: none 2024-09-22T08:40:33.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.207+0000 7f4beb7fe640 20 reqs_thread_entry: start 2024-09-22T08:40:33.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.207+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-22T08:40:33.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.209+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.210+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:33.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.210+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.211+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-22T08:40:33.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.213+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.213+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:33.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.213+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.214+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-22T08:40:33.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.216+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.216+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:33.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.217+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.218+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-22T08:40:33.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.219+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.219+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:33.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.219+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.220+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-22T08:40:33.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.222+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.222+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:33.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.222+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.223+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-22T08:40:33.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.225+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.225+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:33.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.226+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.227+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-22T08:40:33.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.229+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.229+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:33.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.229+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.230+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-22T08:40:33.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.232+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.232+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:33.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.232+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.233+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-22T08:40:33.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.235+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.235+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:33.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.235+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.236+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-22T08:40:33.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.238+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.238+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:33.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.238+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.239+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-22T08:40:33.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.241+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.241+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:33.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.241+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.243+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-22T08:40:33.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.244+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.245+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:33.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.245+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.246+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-22T08:40:33.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.247+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.247+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:33.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.248+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.249+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-22T08:40:33.252 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.250+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.250+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:33.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.251+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.253+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-22T08:40:33.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.254+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.254+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:33.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.254+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.255+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-22T08:40:33.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.256+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.257+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:33.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.257+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.258+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-22T08:40:33.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.260+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.260+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:33.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.260+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.262+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-22T08:40:33.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.263+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.264+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:33.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.264+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.265+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-22T08:40:33.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.266+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.267+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:33.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.267+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.268+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-22T08:40:33.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.270+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.270+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:33.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.270+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.271+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-22T08:40:33.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.273+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.273+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:33.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.273+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.275+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-22T08:40:33.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.276+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.277+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:33.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.277+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.278+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-22T08:40:33.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.279+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.280+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:33.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.280+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.281+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-22T08:40:33.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.282+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.283+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:33.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.283+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.284+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-22T08:40:33.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.285+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.286+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:33.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.286+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.287+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-22T08:40:33.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.288+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.289+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:33.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.289+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.290+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-22T08:40:33.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.291+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.292+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:33.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.293+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.295+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-22T08:40:33.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.295+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.295+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:33.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.296+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.297+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-22T08:40:33.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.298+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.298+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:33.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.299+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.300+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-22T08:40:33.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.301+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.302+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:33.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.302+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.303+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-22T08:40:33.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.304+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.304+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:33.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.305+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.305+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-22T08:40:33.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.307+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.307+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:40:33.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.307+0000 7f4d3ee2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:40:33.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.309+0000 7f4bf37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:33.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.311+0000 7f4d3ee2f800 20 remove_watcher() i=0 2024-09-22T08:40:33.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.311+0000 7f4d3ee2f800 2 removed watcher, disabling cache 2024-09-22T08:40:33.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.312+0000 7f4d3ee2f800 20 remove_watcher() i=1 2024-09-22T08:40:33.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.313+0000 7f4d3ee2f800 20 remove_watcher() i=2 2024-09-22T08:40:33.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.314+0000 7f4d3ee2f800 20 remove_watcher() i=3 2024-09-22T08:40:33.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.315+0000 7f4d3ee2f800 20 remove_watcher() i=4 2024-09-22T08:40:33.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.316+0000 7f4d3ee2f800 20 remove_watcher() i=5 2024-09-22T08:40:33.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.317+0000 7f4d3ee2f800 20 remove_watcher() i=6 2024-09-22T08:40:33.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:40:33.318+0000 7f4d3ee2f800 20 remove_watcher() i=7 2024-09-22T08:40:33.331 DEBUG:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-22T08:40:33.831 INFO:teuthology.orchestra.run.smithi038.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-22T08:40:37.531 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :clean UP-TO-DATE 2024-09-22T08:40:55.830 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :compileJava 2024-09-22T08:40:55.830 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :processResources 2024-09-22T08:40:55.831 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :classes 2024-09-22T08:40:56.630 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:40:56.630 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :compileTestJava 2024-09-22T08:40:56.631 INFO:teuthology.orchestra.run.smithi038.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-22T08:40:56.631 INFO:teuthology.orchestra.run.smithi038.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-22T08:40:56.632 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:40:56.632 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :processTestResources NO-SOURCE 2024-09-22T08:40:56.632 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :testClasses 2024-09-22T08:41:02.730 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:02.730 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :test 2024-09-22T08:41:02.730 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:02.730 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-22T08:41:03.430 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:03.430 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-22T08:41:03.630 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:03.630 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-22T08:41:03.730 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:03.730 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-22T08:41:03.930 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:03.930 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-22T08:41:04.430 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:04.430 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-22T08:41:04.630 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:04.630 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-22T08:41:04.630 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:04.631 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-22T08:41:04.730 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:04.730 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-22T08:41:04.730 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:04.730 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-22T08:41:04.930 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:04.930 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-22T08:41:05.330 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:05.330 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-22T08:41:05.630 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:05.630 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-22T08:41:05.830 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:05.830 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-22T08:41:05.830 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22 08:41:05,785 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-22T08:41:10.030 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:10.030 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-22T08:41:10.330 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:10.330 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-22T08:41:10.330 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:10.330 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-22T08:41:10.530 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:10.530 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-22T08:41:10.630 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:10.630 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-22T08:41:10.930 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:10.930 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-22T08:41:11.430 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:11.430 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-22T08:41:11.630 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:11.630 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-22T08:41:11.730 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:11.730 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-22T08:41:11.830 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:11.830 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-22T08:41:14.130 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:14.130 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-22T08:41:14.330 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:14.330 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-22T08:41:14.930 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:14.930 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-22T08:41:15.130 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:15.130 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-22T08:41:15.430 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:15.430 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-22T08:41:15.630 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:15.630 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-22T08:41:22.230 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:22.230 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-22T08:41:22.530 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:22.530 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-22T08:41:23.330 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:23.330 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-22T08:41:23.630 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:23.630 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-22T08:41:24.030 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:24.030 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-22T08:41:24.230 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:24.230 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-22T08:41:24.530 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:24.530 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-22T08:41:24.830 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:24.830 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-22T08:41:24.830 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:24.830 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-22T08:41:25.030 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:25.030 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-22T08:41:25.030 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:25.030 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-22T08:41:25.230 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:25.230 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-22T08:41:25.330 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:25.330 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-22T08:41:25.530 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:25.530 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-22T08:41:25.530 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:25.531 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-22T08:41:25.730 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:25.730 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-22T08:41:25.730 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:25.730 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-22T08:41:25.930 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:25.930 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-22T08:41:25.930 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:25.930 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-22T08:41:26.130 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:26.130 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-22T08:41:26.230 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:26.230 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-22T08:41:26.430 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:26.430 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-22T08:41:26.930 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:26.930 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-22T08:41:27.230 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:27.230 INFO:teuthology.orchestra.run.smithi038.stdout:---------------------------------------------------------------------- 2024-09-22T08:41:27.230 INFO:teuthology.orchestra.run.smithi038.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-22T08:41:27.230 INFO:teuthology.orchestra.run.smithi038.stdout:---------------------------------------------------------------------- 2024-09-22T08:41:27.230 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:27.231 INFO:teuthology.orchestra.run.smithi038.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-22T08:41:27.231 INFO:teuthology.orchestra.run.smithi038.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-22T08:41:27.231 INFO:teuthology.orchestra.run.smithi038.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-22T08:41:27.231 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:27.231 INFO:teuthology.orchestra.run.smithi038.stdout:BUILD SUCCESSFUL in 53s 2024-09-22T08:41:27.231 INFO:teuthology.orchestra.run.smithi038.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-22T08:41:27.548 DEBUG:teuthology.orchestra.run.smithi038:> radosgw-admin gc process --include-all 2024-09-22T08:41:27.602 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:41:27.603 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:41:27.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:27.640+0000 7fc7ccf23800 20 rados->read ofs=0 len=0 2024-09-22T08:41:27.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:27.642+0000 7fc7ccf23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:27.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:27.642+0000 7fc7ccf23800 20 realm 2024-09-22T08:41:27.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:27.642+0000 7fc7ccf23800 20 rados->read ofs=0 len=0 2024-09-22T08:41:27.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:27.642+0000 7fc7ccf23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:27.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:27.642+0000 7fc7ccf23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:41:27.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:27.642+0000 7fc7ccf23800 20 rados->read ofs=0 len=0 2024-09-22T08:41:27.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:27.643+0000 7fc7ccf23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:27.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:27.643+0000 7fc7ccf23800 20 rados->read ofs=0 len=0 2024-09-22T08:41:27.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:27.643+0000 7fc7ccf23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:27.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:27.643+0000 7fc7ccf23800 20 rados->read ofs=0 len=0 2024-09-22T08:41:27.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:27.644+0000 7fc7ccf23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:41:27.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:27.644+0000 7fc7ccf23800 20 searching for the correct realm 2024-09-22T08:41:27.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:27.646+0000 7fc7c840b640 0 -- 172.21.15.38:0/1868450636 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7fc7bc02b070 msgr2=0x7fc7bc045940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:27.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:27.853+0000 7fc7c840b640 0 -- 172.21.15.38:0/1868450636 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fc7b8091bd0 msgr2=0x7fc7b80aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:41:28.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.060+0000 7fc7ccf23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:41:28.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.060+0000 7fc7ccf23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:41:28.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.060+0000 7fc7ccf23800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:41:28.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.060+0000 7fc7ccf23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:41:28.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.060+0000 7fc7ccf23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:41:28.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.060+0000 7fc7ccf23800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:41:28.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.060+0000 7fc7ccf23800 20 rados->read ofs=0 len=0 2024-09-22T08:41:28.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.061+0000 7fc7ccf23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:28.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.061+0000 7fc7ccf23800 20 rados->read ofs=0 len=0 2024-09-22T08:41:28.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.061+0000 7fc7ccf23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:28.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.061+0000 7fc7ccf23800 20 rados->read ofs=0 len=0 2024-09-22T08:41:28.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.062+0000 7fc7ccf23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:41:28.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.062+0000 7fc7ccf23800 20 zone default found 2024-09-22T08:41:28.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.062+0000 7fc7ccf23800 4 Realm: () 2024-09-22T08:41:28.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.062+0000 7fc7ccf23800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:41:28.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.062+0000 7fc7ccf23800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:41:28.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.062+0000 7fc7ccf23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:41:28.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.062+0000 7fc7ccf23800 20 zonegroup default 2024-09-22T08:41:28.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.062+0000 7fc7ccf23800 20 rados->read ofs=0 len=0 2024-09-22T08:41:28.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.062+0000 7fc7ccf23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:28.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.062+0000 7fc7ccf23800 20 rados->read ofs=0 len=0 2024-09-22T08:41:28.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.062+0000 7fc7ccf23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:28.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.062+0000 7fc7ccf23800 20 rados->read ofs=0 len=0 2024-09-22T08:41:28.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.063+0000 7fc7ccf23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:28.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.063+0000 7fc7ccf23800 20 started sync module instance, tier type = 2024-09-22T08:41:28.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.063+0000 7fc7ccf23800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:41:28.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.074+0000 7fc7ccf23800 20 add_watcher() i=0 2024-09-22T08:41:28.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.074+0000 7fc7ccf23800 20 add_watcher() i=1 2024-09-22T08:41:28.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.074+0000 7fc7ccf23800 20 add_watcher() i=2 2024-09-22T08:41:28.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.074+0000 7fc7ccf23800 20 add_watcher() i=3 2024-09-22T08:41:28.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.074+0000 7fc7ccf23800 20 add_watcher() i=4 2024-09-22T08:41:28.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.074+0000 7fc7ccf23800 20 add_watcher() i=5 2024-09-22T08:41:28.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.074+0000 7fc7ccf23800 20 add_watcher() i=6 2024-09-22T08:41:28.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.075+0000 7fc7ccf23800 20 add_watcher() i=7 2024-09-22T08:41:28.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.075+0000 7fc7ccf23800 2 all 8 watchers are set, enabling cache 2024-09-22T08:41:28.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.077+0000 7fc67f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:28.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.077+0000 7fc7ccf23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:41:28.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.077+0000 7fc7ccf23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:41:28.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.119+0000 7fc67e7e4640 20 reqs_thread_entry: start 2024-09-22T08:41:28.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.119+0000 7fc7ccf23800 20 init_complete bucket index max shards: 11 2024-09-22T08:41:28.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.119+0000 7fc7ccf23800 20 Filter name: none 2024-09-22T08:41:28.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.119+0000 7fc6777fe640 20 reqs_thread_entry: start 2024-09-22T08:41:28.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.119+0000 7fc7ccf23800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-22T08:41:28.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.121+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.121+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:28.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.122+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:41:28.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.122+0000 7fc7ccf23800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.1354418354490423549', time=2024-09-22T10:41:06.989626+0000, chain.objs.size()=9 2024-09-22T08:41:28.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.122+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__multipart_key1.2~0lOyAHWRYfKxKJ8aQ-7uUkBmFjYEJGo.1 2024-09-22T08:41:28.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.122+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__shadow_key1.2~0lOyAHWRYfKxKJ8aQ-7uUkBmFjYEJGo.1_1 2024-09-22T08:41:28.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.122+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__multipart_key1.2~0lOyAHWRYfKxKJ8aQ-7uUkBmFjYEJGo.2 2024-09-22T08:41:28.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.122+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__shadow_key1.2~0lOyAHWRYfKxKJ8aQ-7uUkBmFjYEJGo.2_1 2024-09-22T08:41:28.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.122+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__multipart_key1.2~0lOyAHWRYfKxKJ8aQ-7uUkBmFjYEJGo.3 2024-09-22T08:41:28.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.122+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__shadow_key1.2~0lOyAHWRYfKxKJ8aQ-7uUkBmFjYEJGo.3_1 2024-09-22T08:41:28.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.122+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__multipart_key1.2~0lOyAHWRYfKxKJ8aQ-7uUkBmFjYEJGo.4 2024-09-22T08:41:28.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.122+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__shadow_key1.2~0lOyAHWRYfKxKJ8aQ-7uUkBmFjYEJGo.4_1 2024-09-22T08:41:28.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.123+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__multipart_key1.2~0lOyAHWRYfKxKJ8aQ-7uUkBmFjYEJGo.5 2024-09-22T08:41:28.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.126+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:41:28.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.128+0000 7fc7ccf23800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-22T08:41:28.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.130+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.130+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:28.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.131+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:41:28.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.131+0000 7fc7ccf23800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.13015494224455984475', time=2024-09-22T10:41:20.383012+0000, chain.objs.size()=21 2024-09-22T08:41:28.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.131+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~tlvEUIJWpoYJoSSTf6QAnzWHnINVnIb.1 2024-09-22T08:41:28.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.131+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~tlvEUIJWpoYJoSSTf6QAnzWHnINVnIb.1_1 2024-09-22T08:41:28.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.131+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~tlvEUIJWpoYJoSSTf6QAnzWHnINVnIb.2 2024-09-22T08:41:28.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.131+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~tlvEUIJWpoYJoSSTf6QAnzWHnINVnIb.2_1 2024-09-22T08:41:28.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.131+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~tlvEUIJWpoYJoSSTf6QAnzWHnINVnIb.3 2024-09-22T08:41:28.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.131+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~tlvEUIJWpoYJoSSTf6QAnzWHnINVnIb.3_1 2024-09-22T08:41:28.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.131+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~tlvEUIJWpoYJoSSTf6QAnzWHnINVnIb.4 2024-09-22T08:41:28.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.131+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~tlvEUIJWpoYJoSSTf6QAnzWHnINVnIb.4_1 2024-09-22T08:41:28.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.131+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~tlvEUIJWpoYJoSSTf6QAnzWHnINVnIb.5 2024-09-22T08:41:28.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.131+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~tlvEUIJWpoYJoSSTf6QAnzWHnINVnIb.5_1 2024-09-22T08:41:28.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.131+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~tlvEUIJWpoYJoSSTf6QAnzWHnINVnIb.6 2024-09-22T08:41:28.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.131+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~tlvEUIJWpoYJoSSTf6QAnzWHnINVnIb.6_1 2024-09-22T08:41:28.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.134+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~tlvEUIJWpoYJoSSTf6QAnzWHnINVnIb.7 2024-09-22T08:41:28.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.134+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~tlvEUIJWpoYJoSSTf6QAnzWHnINVnIb.7_1 2024-09-22T08:41:28.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.134+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~tlvEUIJWpoYJoSSTf6QAnzWHnINVnIb.8 2024-09-22T08:41:28.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.134+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~tlvEUIJWpoYJoSSTf6QAnzWHnINVnIb.8_1 2024-09-22T08:41:28.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.134+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~tlvEUIJWpoYJoSSTf6QAnzWHnINVnIb.9 2024-09-22T08:41:28.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.134+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~tlvEUIJWpoYJoSSTf6QAnzWHnINVnIb.9_1 2024-09-22T08:41:28.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.134+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~tlvEUIJWpoYJoSSTf6QAnzWHnINVnIb.10 2024-09-22T08:41:28.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.134+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~tlvEUIJWpoYJoSSTf6QAnzWHnINVnIb.10_1 2024-09-22T08:41:28.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.134+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~tlvEUIJWpoYJoSSTf6QAnzWHnINVnIb.11 2024-09-22T08:41:28.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.137+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:41:28.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.140+0000 7fc7ccf23800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-22T08:41:28.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.142+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.142+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:28.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.142+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.143+0000 7fc7ccf23800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-22T08:41:28.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.145+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.145+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:28.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.145+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:41:28.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.145+0000 7fc7ccf23800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.14948667745698652330', time=2024-09-22T10:41:05.368730+0000, chain.objs.size()=9 2024-09-22T08:41:28.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.145+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.44__multipart_key1.2~Y74yTGc3K_Dl3sP2GE_nfoKof7w5hPM.1 2024-09-22T08:41:28.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.145+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.44__shadow_key1.2~Y74yTGc3K_Dl3sP2GE_nfoKof7w5hPM.1_1 2024-09-22T08:41:28.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.145+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.44__multipart_key1.2~Y74yTGc3K_Dl3sP2GE_nfoKof7w5hPM.2 2024-09-22T08:41:28.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.145+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.44__shadow_key1.2~Y74yTGc3K_Dl3sP2GE_nfoKof7w5hPM.2_1 2024-09-22T08:41:28.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.145+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.44__multipart_key1.2~Y74yTGc3K_Dl3sP2GE_nfoKof7w5hPM.3 2024-09-22T08:41:28.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.145+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.44__shadow_key1.2~Y74yTGc3K_Dl3sP2GE_nfoKof7w5hPM.3_1 2024-09-22T08:41:28.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.145+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.44__multipart_key1.2~Y74yTGc3K_Dl3sP2GE_nfoKof7w5hPM.4 2024-09-22T08:41:28.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.145+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.44__shadow_key1.2~Y74yTGc3K_Dl3sP2GE_nfoKof7w5hPM.4_1 2024-09-22T08:41:28.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.145+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.44__multipart_key1.2~Y74yTGc3K_Dl3sP2GE_nfoKof7w5hPM.5 2024-09-22T08:41:28.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.147+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:41:28.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.149+0000 7fc7ccf23800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-22T08:41:28.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.151+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.151+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:28.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.152+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.154+0000 7fc7ccf23800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-22T08:41:28.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.155+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.155+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:28.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.156+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:41:28.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.156+0000 7fc7ccf23800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.10266564175940294697', time=2024-09-22T10:41:23.402739+0000, chain.objs.size()=9 2024-09-22T08:41:28.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.156+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.56__multipart_key1.2~annzMxemrsXWS1o7gpsTdF9mcT-gqdH.1 2024-09-22T08:41:28.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.156+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.56__shadow_key1.2~annzMxemrsXWS1o7gpsTdF9mcT-gqdH.1_1 2024-09-22T08:41:28.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.156+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.56__multipart_key1.2~annzMxemrsXWS1o7gpsTdF9mcT-gqdH.2 2024-09-22T08:41:28.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.156+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.56__shadow_key1.2~annzMxemrsXWS1o7gpsTdF9mcT-gqdH.2_1 2024-09-22T08:41:28.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.156+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.56__multipart_key1.2~annzMxemrsXWS1o7gpsTdF9mcT-gqdH.3 2024-09-22T08:41:28.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.156+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.56__shadow_key1.2~annzMxemrsXWS1o7gpsTdF9mcT-gqdH.3_1 2024-09-22T08:41:28.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.156+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.56__multipart_key1.2~annzMxemrsXWS1o7gpsTdF9mcT-gqdH.4 2024-09-22T08:41:28.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.156+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.56__shadow_key1.2~annzMxemrsXWS1o7gpsTdF9mcT-gqdH.4_1 2024-09-22T08:41:28.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.156+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.56__multipart_key1.2~annzMxemrsXWS1o7gpsTdF9mcT-gqdH.5 2024-09-22T08:41:28.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.160+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:41:28.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.162+0000 7fc7ccf23800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-22T08:41:28.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.164+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.165+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:28.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.165+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:41:28.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.165+0000 7fc7ccf23800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.14597301540606413217', time=2024-09-22T10:41:18.395270+0000, chain.objs.size()=21 2024-09-22T08:41:28.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.165+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~_QiDIyu6yKSlk5n0buzF-Sgwj_ubEAJ.1 2024-09-22T08:41:28.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.165+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~_QiDIyu6yKSlk5n0buzF-Sgwj_ubEAJ.1_1 2024-09-22T08:41:28.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.165+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~_QiDIyu6yKSlk5n0buzF-Sgwj_ubEAJ.2 2024-09-22T08:41:28.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.165+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~_QiDIyu6yKSlk5n0buzF-Sgwj_ubEAJ.2_1 2024-09-22T08:41:28.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.165+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~_QiDIyu6yKSlk5n0buzF-Sgwj_ubEAJ.3 2024-09-22T08:41:28.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.165+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~_QiDIyu6yKSlk5n0buzF-Sgwj_ubEAJ.3_1 2024-09-22T08:41:28.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.165+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~_QiDIyu6yKSlk5n0buzF-Sgwj_ubEAJ.4 2024-09-22T08:41:28.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.165+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~_QiDIyu6yKSlk5n0buzF-Sgwj_ubEAJ.4_1 2024-09-22T08:41:28.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.165+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~_QiDIyu6yKSlk5n0buzF-Sgwj_ubEAJ.5 2024-09-22T08:41:28.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.165+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~_QiDIyu6yKSlk5n0buzF-Sgwj_ubEAJ.5_1 2024-09-22T08:41:28.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.166+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~_QiDIyu6yKSlk5n0buzF-Sgwj_ubEAJ.6 2024-09-22T08:41:28.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.166+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~_QiDIyu6yKSlk5n0buzF-Sgwj_ubEAJ.6_1 2024-09-22T08:41:28.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.169+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~_QiDIyu6yKSlk5n0buzF-Sgwj_ubEAJ.7 2024-09-22T08:41:28.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.169+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~_QiDIyu6yKSlk5n0buzF-Sgwj_ubEAJ.7_1 2024-09-22T08:41:28.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.169+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~_QiDIyu6yKSlk5n0buzF-Sgwj_ubEAJ.8 2024-09-22T08:41:28.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.169+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~_QiDIyu6yKSlk5n0buzF-Sgwj_ubEAJ.8_1 2024-09-22T08:41:28.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.169+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~_QiDIyu6yKSlk5n0buzF-Sgwj_ubEAJ.9 2024-09-22T08:41:28.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.169+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~_QiDIyu6yKSlk5n0buzF-Sgwj_ubEAJ.9_1 2024-09-22T08:41:28.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.169+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~_QiDIyu6yKSlk5n0buzF-Sgwj_ubEAJ.10 2024-09-22T08:41:28.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.169+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~_QiDIyu6yKSlk5n0buzF-Sgwj_ubEAJ.10_1 2024-09-22T08:41:28.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.169+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~_QiDIyu6yKSlk5n0buzF-Sgwj_ubEAJ.11 2024-09-22T08:41:28.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.172+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:41:28.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.175+0000 7fc7ccf23800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-22T08:41:28.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.176+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.177+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:28.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.177+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T08:41:28.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.177+0000 7fc7ccf23800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.16347631042805721574', time=2024-09-22T10:41:04.465577+0000, chain.objs.size()=9 2024-09-22T08:41:28.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.177+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.42__multipart_key1.2~NE-XG3JmfXXmB5URmU9Habxy90SIRj8.1 2024-09-22T08:41:28.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.177+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.42__shadow_key1.2~NE-XG3JmfXXmB5URmU9Habxy90SIRj8.1_1 2024-09-22T08:41:28.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.177+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.42__multipart_key1.2~NE-XG3JmfXXmB5URmU9Habxy90SIRj8.2 2024-09-22T08:41:28.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.177+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.42__shadow_key1.2~NE-XG3JmfXXmB5URmU9Habxy90SIRj8.2_1 2024-09-22T08:41:28.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.177+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.42__multipart_key1.2~NE-XG3JmfXXmB5URmU9Habxy90SIRj8.3 2024-09-22T08:41:28.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.177+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.42__shadow_key1.2~NE-XG3JmfXXmB5URmU9Habxy90SIRj8.3_1 2024-09-22T08:41:28.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.177+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.42__multipart_key1.2~NE-XG3JmfXXmB5URmU9Habxy90SIRj8.4 2024-09-22T08:41:28.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.177+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.42__shadow_key1.2~NE-XG3JmfXXmB5URmU9Habxy90SIRj8.4_1 2024-09-22T08:41:28.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.177+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.42__multipart_key1.2~NE-XG3JmfXXmB5URmU9Habxy90SIRj8.5 2024-09-22T08:41:28.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.177+0000 7fc7ccf23800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.3891926588255205743', time=2024-09-22T10:41:26.988320+0000, chain.objs.size()=21 2024-09-22T08:41:28.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.177+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.66__multipart_key1.2~m4_kA6Bs5mvus01SRS0uwHWBJ7Jpbah.1 2024-09-22T08:41:28.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.177+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.66__shadow_key1.2~m4_kA6Bs5mvus01SRS0uwHWBJ7Jpbah.1_1 2024-09-22T08:41:28.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.177+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.66__multipart_key1.2~m4_kA6Bs5mvus01SRS0uwHWBJ7Jpbah.2 2024-09-22T08:41:28.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.180+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.66__shadow_key1.2~m4_kA6Bs5mvus01SRS0uwHWBJ7Jpbah.2_1 2024-09-22T08:41:28.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.180+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.66__multipart_key1.2~m4_kA6Bs5mvus01SRS0uwHWBJ7Jpbah.3 2024-09-22T08:41:28.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.180+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.66__shadow_key1.2~m4_kA6Bs5mvus01SRS0uwHWBJ7Jpbah.3_1 2024-09-22T08:41:28.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.180+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.66__multipart_key1.2~m4_kA6Bs5mvus01SRS0uwHWBJ7Jpbah.4 2024-09-22T08:41:28.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.180+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.66__shadow_key1.2~m4_kA6Bs5mvus01SRS0uwHWBJ7Jpbah.4_1 2024-09-22T08:41:28.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.181+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.66__multipart_key1.2~m4_kA6Bs5mvus01SRS0uwHWBJ7Jpbah.5 2024-09-22T08:41:28.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.181+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.66__shadow_key1.2~m4_kA6Bs5mvus01SRS0uwHWBJ7Jpbah.5_1 2024-09-22T08:41:28.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.181+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.66__multipart_key1.2~m4_kA6Bs5mvus01SRS0uwHWBJ7Jpbah.6 2024-09-22T08:41:28.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.181+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.66__shadow_key1.2~m4_kA6Bs5mvus01SRS0uwHWBJ7Jpbah.6_1 2024-09-22T08:41:28.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.181+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.66__multipart_key1.2~m4_kA6Bs5mvus01SRS0uwHWBJ7Jpbah.7 2024-09-22T08:41:28.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.181+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.66__shadow_key1.2~m4_kA6Bs5mvus01SRS0uwHWBJ7Jpbah.7_1 2024-09-22T08:41:28.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.184+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.66__multipart_key1.2~m4_kA6Bs5mvus01SRS0uwHWBJ7Jpbah.8 2024-09-22T08:41:28.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.184+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.66__shadow_key1.2~m4_kA6Bs5mvus01SRS0uwHWBJ7Jpbah.8_1 2024-09-22T08:41:28.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.184+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.66__multipart_key1.2~m4_kA6Bs5mvus01SRS0uwHWBJ7Jpbah.9 2024-09-22T08:41:28.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.184+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.66__shadow_key1.2~m4_kA6Bs5mvus01SRS0uwHWBJ7Jpbah.9_1 2024-09-22T08:41:28.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.184+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.66__multipart_key1.2~m4_kA6Bs5mvus01SRS0uwHWBJ7Jpbah.10 2024-09-22T08:41:28.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.184+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.66__shadow_key1.2~m4_kA6Bs5mvus01SRS0uwHWBJ7Jpbah.10_1 2024-09-22T08:41:28.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.184+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.66__multipart_key1.2~m4_kA6Bs5mvus01SRS0uwHWBJ7Jpbah.11 2024-09-22T08:41:28.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.188+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:41:28.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.191+0000 7fc7ccf23800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-22T08:41:28.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.192+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.193+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:28.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.193+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:41:28.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.193+0000 7fc7ccf23800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.12586825998195192589', time=2024-09-22T10:41:14.993819+0000, chain.objs.size()=9 2024-09-22T08:41:28.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.193+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.53__multipart_file2.mpg.2~mvzYPphK3Hfp3V9j2kLDV9y1V4KMtMB.1 2024-09-22T08:41:28.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.193+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.53__shadow_file2.mpg.2~mvzYPphK3Hfp3V9j2kLDV9y1V4KMtMB.1_1 2024-09-22T08:41:28.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.193+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.53__multipart_file2.mpg.2~mvzYPphK3Hfp3V9j2kLDV9y1V4KMtMB.2 2024-09-22T08:41:28.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.193+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.53__shadow_file2.mpg.2~mvzYPphK3Hfp3V9j2kLDV9y1V4KMtMB.2_1 2024-09-22T08:41:28.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.193+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.53__multipart_file2.mpg.2~mvzYPphK3Hfp3V9j2kLDV9y1V4KMtMB.3 2024-09-22T08:41:28.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.193+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.53__shadow_file2.mpg.2~mvzYPphK3Hfp3V9j2kLDV9y1V4KMtMB.3_1 2024-09-22T08:41:28.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.193+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.53__multipart_file2.mpg.2~mvzYPphK3Hfp3V9j2kLDV9y1V4KMtMB.4 2024-09-22T08:41:28.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.193+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.53__shadow_file2.mpg.2~mvzYPphK3Hfp3V9j2kLDV9y1V4KMtMB.4_1 2024-09-22T08:41:28.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.193+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.53__multipart_file2.mpg.2~mvzYPphK3Hfp3V9j2kLDV9y1V4KMtMB.5 2024-09-22T08:41:28.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.196+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:41:28.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.198+0000 7fc7ccf23800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-22T08:41:28.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.199+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.200+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:28.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.200+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.202+0000 7fc7ccf23800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-22T08:41:28.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.203+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.204+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:28.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.204+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:41:28.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.204+0000 7fc7ccf23800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.15616101111109862466', time=2024-09-22T10:41:14.147096+0000, chain.objs.size()=9 2024-09-22T08:41:28.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.204+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.52__multipart_key1.2~4IccYDRAz3OyzPXpAI0di7V4FLlbyX7.1 2024-09-22T08:41:28.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.204+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.52__shadow_key1.2~4IccYDRAz3OyzPXpAI0di7V4FLlbyX7.1_1 2024-09-22T08:41:28.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.204+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.52__multipart_key1.2~4IccYDRAz3OyzPXpAI0di7V4FLlbyX7.2 2024-09-22T08:41:28.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.204+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.52__shadow_key1.2~4IccYDRAz3OyzPXpAI0di7V4FLlbyX7.2_1 2024-09-22T08:41:28.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.204+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.52__multipart_key1.2~4IccYDRAz3OyzPXpAI0di7V4FLlbyX7.3 2024-09-22T08:41:28.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.204+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.52__shadow_key1.2~4IccYDRAz3OyzPXpAI0di7V4FLlbyX7.3_1 2024-09-22T08:41:28.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.204+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.52__multipart_key1.2~4IccYDRAz3OyzPXpAI0di7V4FLlbyX7.4 2024-09-22T08:41:28.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.204+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.52__shadow_key1.2~4IccYDRAz3OyzPXpAI0di7V4FLlbyX7.4_1 2024-09-22T08:41:28.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.204+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.52__multipart_key1.2~4IccYDRAz3OyzPXpAI0di7V4FLlbyX7.5 2024-09-22T08:41:28.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.208+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:41:28.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.210+0000 7fc7ccf23800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-22T08:41:28.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.212+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.212+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:28.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.212+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.213+0000 7fc7ccf23800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-22T08:41:28.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.215+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.215+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:28.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.215+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.216+0000 7fc7ccf23800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-22T08:41:28.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.218+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.218+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:28.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.219+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.220+0000 7fc7ccf23800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-22T08:41:28.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.221+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.222+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:28.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.222+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-22T08:41:28.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.222+0000 7fc7ccf23800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.13347705002533828799', time=2024-09-22T10:41:08.947527+0000, chain.objs.size()=7 2024-09-22T08:41:28.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.222+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__multipart_key1.2~RAoLKm84-jaF9V68GzNdTgFtcwv6PS0.1 2024-09-22T08:41:28.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.222+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__shadow_key1.2~RAoLKm84-jaF9V68GzNdTgFtcwv6PS0.1_1 2024-09-22T08:41:28.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.222+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__shadow_key1.2~RAoLKm84-jaF9V68GzNdTgFtcwv6PS0.1_2 2024-09-22T08:41:28.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.222+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__multipart_key1.2~RAoLKm84-jaF9V68GzNdTgFtcwv6PS0.2 2024-09-22T08:41:28.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.222+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__shadow_key1.2~RAoLKm84-jaF9V68GzNdTgFtcwv6PS0.2_1 2024-09-22T08:41:28.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.222+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__shadow_key1.2~RAoLKm84-jaF9V68GzNdTgFtcwv6PS0.2_2 2024-09-22T08:41:28.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.222+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__multipart_key1.2~RAoLKm84-jaF9V68GzNdTgFtcwv6PS0.3 2024-09-22T08:41:28.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.222+0000 7fc7ccf23800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.17401653284376311615', time=2024-09-22T10:41:22.174235+0000, chain.objs.size()=16 2024-09-22T08:41:28.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.222+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~ld2BTJMaS9AYSwRKHv5lp5zhrCqMZgZ.1 2024-09-22T08:41:28.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.222+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~ld2BTJMaS9AYSwRKHv5lp5zhrCqMZgZ.1_1 2024-09-22T08:41:28.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.222+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~ld2BTJMaS9AYSwRKHv5lp5zhrCqMZgZ.1_2 2024-09-22T08:41:28.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.222+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~ld2BTJMaS9AYSwRKHv5lp5zhrCqMZgZ.2 2024-09-22T08:41:28.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.222+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~ld2BTJMaS9AYSwRKHv5lp5zhrCqMZgZ.2_1 2024-09-22T08:41:28.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.225+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~ld2BTJMaS9AYSwRKHv5lp5zhrCqMZgZ.2_2 2024-09-22T08:41:28.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.225+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~ld2BTJMaS9AYSwRKHv5lp5zhrCqMZgZ.3 2024-09-22T08:41:28.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.225+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~ld2BTJMaS9AYSwRKHv5lp5zhrCqMZgZ.3_1 2024-09-22T08:41:28.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.226+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~ld2BTJMaS9AYSwRKHv5lp5zhrCqMZgZ.3_2 2024-09-22T08:41:28.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.226+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~ld2BTJMaS9AYSwRKHv5lp5zhrCqMZgZ.4 2024-09-22T08:41:28.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.226+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~ld2BTJMaS9AYSwRKHv5lp5zhrCqMZgZ.4_1 2024-09-22T08:41:28.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.226+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~ld2BTJMaS9AYSwRKHv5lp5zhrCqMZgZ.4_2 2024-09-22T08:41:28.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.226+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~ld2BTJMaS9AYSwRKHv5lp5zhrCqMZgZ.5 2024-09-22T08:41:28.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.226+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~ld2BTJMaS9AYSwRKHv5lp5zhrCqMZgZ.5_1 2024-09-22T08:41:28.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.226+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~ld2BTJMaS9AYSwRKHv5lp5zhrCqMZgZ.5_2 2024-09-22T08:41:28.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.226+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~ld2BTJMaS9AYSwRKHv5lp5zhrCqMZgZ.6 2024-09-22T08:41:28.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.229+0000 7fc7ccf23800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.7603687670357266972', time=2024-09-22T10:41:22.314060+0000, chain.objs.size()=16 2024-09-22T08:41:28.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.229+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~UgOF--Lgw6i26YyEh-Ryx2P5BfV1dlD.1 2024-09-22T08:41:28.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.229+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~UgOF--Lgw6i26YyEh-Ryx2P5BfV1dlD.1_1 2024-09-22T08:41:28.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.229+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~UgOF--Lgw6i26YyEh-Ryx2P5BfV1dlD.1_2 2024-09-22T08:41:28.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.230+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~UgOF--Lgw6i26YyEh-Ryx2P5BfV1dlD.2 2024-09-22T08:41:28.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.230+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~UgOF--Lgw6i26YyEh-Ryx2P5BfV1dlD.2_1 2024-09-22T08:41:28.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.230+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~UgOF--Lgw6i26YyEh-Ryx2P5BfV1dlD.2_2 2024-09-22T08:41:28.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.230+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~UgOF--Lgw6i26YyEh-Ryx2P5BfV1dlD.3 2024-09-22T08:41:28.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.230+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~UgOF--Lgw6i26YyEh-Ryx2P5BfV1dlD.3_1 2024-09-22T08:41:28.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.230+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~UgOF--Lgw6i26YyEh-Ryx2P5BfV1dlD.3_2 2024-09-22T08:41:28.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.230+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~UgOF--Lgw6i26YyEh-Ryx2P5BfV1dlD.4 2024-09-22T08:41:28.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.230+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~UgOF--Lgw6i26YyEh-Ryx2P5BfV1dlD.4_1 2024-09-22T08:41:28.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.230+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~UgOF--Lgw6i26YyEh-Ryx2P5BfV1dlD.4_2 2024-09-22T08:41:28.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.231+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~UgOF--Lgw6i26YyEh-Ryx2P5BfV1dlD.5 2024-09-22T08:41:28.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.233+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~UgOF--Lgw6i26YyEh-Ryx2P5BfV1dlD.5_1 2024-09-22T08:41:28.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.234+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~UgOF--Lgw6i26YyEh-Ryx2P5BfV1dlD.5_2 2024-09-22T08:41:28.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.235+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~UgOF--Lgw6i26YyEh-Ryx2P5BfV1dlD.6 2024-09-22T08:41:28.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.237+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:41:28.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.240+0000 7fc7ccf23800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-22T08:41:28.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.242+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.242+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:28.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.243+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:41:28.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.243+0000 7fc7ccf23800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.3456671200709512333', time=2024-09-22T10:41:20.974393+0000, chain.objs.size()=19 2024-09-22T08:41:28.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.243+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~ZIMu3S5VPXKocmK1XiUbaTuxVFSmPLU.1 2024-09-22T08:41:28.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.243+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~ZIMu3S5VPXKocmK1XiUbaTuxVFSmPLU.1_1 2024-09-22T08:41:28.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.243+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~ZIMu3S5VPXKocmK1XiUbaTuxVFSmPLU.2 2024-09-22T08:41:28.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.243+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~ZIMu3S5VPXKocmK1XiUbaTuxVFSmPLU.2_1 2024-09-22T08:41:28.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.243+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~ZIMu3S5VPXKocmK1XiUbaTuxVFSmPLU.3 2024-09-22T08:41:28.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.243+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~ZIMu3S5VPXKocmK1XiUbaTuxVFSmPLU.3_1 2024-09-22T08:41:28.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.243+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~ZIMu3S5VPXKocmK1XiUbaTuxVFSmPLU.4 2024-09-22T08:41:28.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.243+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~ZIMu3S5VPXKocmK1XiUbaTuxVFSmPLU.4_1 2024-09-22T08:41:28.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.243+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~ZIMu3S5VPXKocmK1XiUbaTuxVFSmPLU.5 2024-09-22T08:41:28.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.243+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~ZIMu3S5VPXKocmK1XiUbaTuxVFSmPLU.5_1 2024-09-22T08:41:28.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.243+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~ZIMu3S5VPXKocmK1XiUbaTuxVFSmPLU.6 2024-09-22T08:41:28.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.243+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~ZIMu3S5VPXKocmK1XiUbaTuxVFSmPLU.6_1 2024-09-22T08:41:28.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.247+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~ZIMu3S5VPXKocmK1XiUbaTuxVFSmPLU.7 2024-09-22T08:41:28.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.247+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~ZIMu3S5VPXKocmK1XiUbaTuxVFSmPLU.7_1 2024-09-22T08:41:28.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.247+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~ZIMu3S5VPXKocmK1XiUbaTuxVFSmPLU.8 2024-09-22T08:41:28.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.247+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~ZIMu3S5VPXKocmK1XiUbaTuxVFSmPLU.8_1 2024-09-22T08:41:28.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.247+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~ZIMu3S5VPXKocmK1XiUbaTuxVFSmPLU.9 2024-09-22T08:41:28.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.247+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~ZIMu3S5VPXKocmK1XiUbaTuxVFSmPLU.9_1 2024-09-22T08:41:28.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.247+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~ZIMu3S5VPXKocmK1XiUbaTuxVFSmPLU.10 2024-09-22T08:41:28.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.249+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:41:28.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.252+0000 7fc7ccf23800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-22T08:41:28.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.253+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.254+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:28.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.254+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:41:28.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.254+0000 7fc7ccf23800 20 garbage collection: RGWGC::process iterating over entry tag='2~O0RMJ05lTrHHozdQduVPbCti_YWoGNZ', time=2024-09-22T10:41:03.372021+0000, chain.objs.size()=9 2024-09-22T08:41:28.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.254+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.40__multipart_key1.2~O0RMJ05lTrHHozdQduVPbCti_YWoGNZ.1 2024-09-22T08:41:28.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.254+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.40__shadow_key1.2~O0RMJ05lTrHHozdQduVPbCti_YWoGNZ.1_1 2024-09-22T08:41:28.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.254+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.40__multipart_key1.2~O0RMJ05lTrHHozdQduVPbCti_YWoGNZ.2 2024-09-22T08:41:28.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.254+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.40__shadow_key1.2~O0RMJ05lTrHHozdQduVPbCti_YWoGNZ.2_1 2024-09-22T08:41:28.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.254+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.40__multipart_key1.2~O0RMJ05lTrHHozdQduVPbCti_YWoGNZ.3 2024-09-22T08:41:28.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.254+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.40__shadow_key1.2~O0RMJ05lTrHHozdQduVPbCti_YWoGNZ.3_1 2024-09-22T08:41:28.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.254+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.40__multipart_key1.2~O0RMJ05lTrHHozdQduVPbCti_YWoGNZ.4 2024-09-22T08:41:28.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.254+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.40__shadow_key1.2~O0RMJ05lTrHHozdQduVPbCti_YWoGNZ.4_1 2024-09-22T08:41:28.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.254+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.40__multipart_key1.2~O0RMJ05lTrHHozdQduVPbCti_YWoGNZ.5 2024-09-22T08:41:28.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.258+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:41:28.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.260+0000 7fc7ccf23800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-22T08:41:28.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.262+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.262+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:28.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.262+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.263+0000 7fc7ccf23800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-22T08:41:28.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.265+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.265+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:28.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.265+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:41:28.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.265+0000 7fc7ccf23800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.10159450046671273968', time=2024-09-22T10:41:11.497236+0000, chain.objs.size()=9 2024-09-22T08:41:28.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.265+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.51__multipart_key1.2~ZNslPBJyYwJQatcDQq2c2DZbLZnNbfD.1 2024-09-22T08:41:28.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.265+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.51__shadow_key1.2~ZNslPBJyYwJQatcDQq2c2DZbLZnNbfD.1_1 2024-09-22T08:41:28.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.265+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.51__multipart_key1.2~ZNslPBJyYwJQatcDQq2c2DZbLZnNbfD.2 2024-09-22T08:41:28.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.265+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.51__shadow_key1.2~ZNslPBJyYwJQatcDQq2c2DZbLZnNbfD.2_1 2024-09-22T08:41:28.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.265+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.51__multipart_key1.2~ZNslPBJyYwJQatcDQq2c2DZbLZnNbfD.3 2024-09-22T08:41:28.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.265+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.51__shadow_key1.2~ZNslPBJyYwJQatcDQq2c2DZbLZnNbfD.3_1 2024-09-22T08:41:28.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.265+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.51__multipart_key1.2~ZNslPBJyYwJQatcDQq2c2DZbLZnNbfD.4 2024-09-22T08:41:28.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.265+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.51__shadow_key1.2~ZNslPBJyYwJQatcDQq2c2DZbLZnNbfD.4_1 2024-09-22T08:41:28.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.265+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.51__multipart_key1.2~ZNslPBJyYwJQatcDQq2c2DZbLZnNbfD.5 2024-09-22T08:41:28.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.268+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:41:28.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.270+0000 7fc7ccf23800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-22T08:41:28.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.271+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.272+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:28.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.272+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T08:41:28.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.272+0000 7fc7ccf23800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.11849894319022053822', time=2024-09-22T10:41:09.911987+0000, chain.objs.size()=7 2024-09-22T08:41:28.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.272+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__multipart_key1.2~jddV8i6_FBFFm6DvpyjiyBcVPfdKL7A.1 2024-09-22T08:41:28.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.272+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__shadow_key1.2~jddV8i6_FBFFm6DvpyjiyBcVPfdKL7A.1_1 2024-09-22T08:41:28.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.272+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__shadow_key1.2~jddV8i6_FBFFm6DvpyjiyBcVPfdKL7A.1_2 2024-09-22T08:41:28.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.272+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__multipart_key1.2~jddV8i6_FBFFm6DvpyjiyBcVPfdKL7A.2 2024-09-22T08:41:28.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.272+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__shadow_key1.2~jddV8i6_FBFFm6DvpyjiyBcVPfdKL7A.2_1 2024-09-22T08:41:28.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.272+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__shadow_key1.2~jddV8i6_FBFFm6DvpyjiyBcVPfdKL7A.2_2 2024-09-22T08:41:28.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.272+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__multipart_key1.2~jddV8i6_FBFFm6DvpyjiyBcVPfdKL7A.3 2024-09-22T08:41:28.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.272+0000 7fc7ccf23800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.18163943628160243908', time=2024-09-22T10:41:10.053134+0000, chain.objs.size()=5 2024-09-22T08:41:28.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.272+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.46__shadow_.nvXXgXDw2EbXqvT_I5ZTryxfAg9-RLN_1 2024-09-22T08:41:28.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.272+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.46__shadow_.nvXXgXDw2EbXqvT_I5ZTryxfAg9-RLN_2 2024-09-22T08:41:28.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.272+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.46__shadow_.nvXXgXDw2EbXqvT_I5ZTryxfAg9-RLN_3 2024-09-22T08:41:28.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.272+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.46__shadow_.nvXXgXDw2EbXqvT_I5ZTryxfAg9-RLN_4 2024-09-22T08:41:28.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.272+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.46__shadow_.nvXXgXDw2EbXqvT_I5ZTryxfAg9-RLN_5 2024-09-22T08:41:28.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.277+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:41:28.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.280+0000 7fc7ccf23800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-22T08:41:28.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.281+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.282+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:28.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.282+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:41:28.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.282+0000 7fc7ccf23800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.17471183477782465031', time=2024-09-22T10:41:24.049117+0000, chain.objs.size()=9 2024-09-22T08:41:28.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.282+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.57__multipart_key1.2~DiNKqdw3M8vCCt2zwjPuYolkUe8jJ-2.1 2024-09-22T08:41:28.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.282+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.57__shadow_key1.2~DiNKqdw3M8vCCt2zwjPuYolkUe8jJ-2.1_1 2024-09-22T08:41:28.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.282+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.57__multipart_key1.2~DiNKqdw3M8vCCt2zwjPuYolkUe8jJ-2.2 2024-09-22T08:41:28.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.283+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.57__shadow_key1.2~DiNKqdw3M8vCCt2zwjPuYolkUe8jJ-2.2_1 2024-09-22T08:41:28.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.283+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.57__multipart_key1.2~DiNKqdw3M8vCCt2zwjPuYolkUe8jJ-2.3 2024-09-22T08:41:28.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.283+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.57__shadow_key1.2~DiNKqdw3M8vCCt2zwjPuYolkUe8jJ-2.3_1 2024-09-22T08:41:28.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.283+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.57__multipart_key1.2~DiNKqdw3M8vCCt2zwjPuYolkUe8jJ-2.4 2024-09-22T08:41:28.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.283+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.57__shadow_key1.2~DiNKqdw3M8vCCt2zwjPuYolkUe8jJ-2.4_1 2024-09-22T08:41:28.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.283+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.57__multipart_key1.2~DiNKqdw3M8vCCt2zwjPuYolkUe8jJ-2.5 2024-09-22T08:41:28.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.286+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:41:28.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.288+0000 7fc7ccf23800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-22T08:41:28.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.289+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.290+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:28.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.290+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:41:28.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.290+0000 7fc7ccf23800 20 garbage collection: RGWGC::process iterating over entry tag='2~9sWXXkSDPkpMJk_vicd1oxLV2u7xpqw', time=2024-09-22T10:41:15.505432+0000, chain.objs.size()=5 2024-09-22T08:41:28.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.290+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.54__multipart_key1.2~9sWXXkSDPkpMJk_vicd1oxLV2u7xpqw.7 2024-09-22T08:41:28.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.290+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.54__shadow_key1.2~9sWXXkSDPkpMJk_vicd1oxLV2u7xpqw.7_1 2024-09-22T08:41:28.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.290+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.54__multipart_key1.2~9sWXXkSDPkpMJk_vicd1oxLV2u7xpqw.10 2024-09-22T08:41:28.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.290+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.54__shadow_key1.2~9sWXXkSDPkpMJk_vicd1oxLV2u7xpqw.10_1 2024-09-22T08:41:28.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.290+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.54__multipart_key1.2~9sWXXkSDPkpMJk_vicd1oxLV2u7xpqw.13 2024-09-22T08:41:28.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.292+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:41:28.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.294+0000 7fc7ccf23800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-22T08:41:28.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.296+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.296+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:28.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.297+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:41:28.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.297+0000 7fc7ccf23800 20 garbage collection: RGWGC::process iterating over entry tag='2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha', time=2024-09-22T10:41:24.694561+0000, chain.objs.size()=92 2024-09-22T08:41:28.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.297+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.1 2024-09-22T08:41:28.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.297+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.2 2024-09-22T08:41:28.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.297+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.3 2024-09-22T08:41:28.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.297+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.4 2024-09-22T08:41:28.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.297+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.5 2024-09-22T08:41:28.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.297+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.6 2024-09-22T08:41:28.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.297+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.7 2024-09-22T08:41:28.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.297+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.8 2024-09-22T08:41:28.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.297+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.9 2024-09-22T08:41:28.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.297+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.10 2024-09-22T08:41:28.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.297+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.11 2024-09-22T08:41:28.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.297+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.12 2024-09-22T08:41:28.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.298+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.13 2024-09-22T08:41:28.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.299+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.14 2024-09-22T08:41:28.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.299+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.15 2024-09-22T08:41:28.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.299+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.16 2024-09-22T08:41:28.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.299+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.17 2024-09-22T08:41:28.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.299+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.18 2024-09-22T08:41:28.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.299+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.19 2024-09-22T08:41:28.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.300+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.20 2024-09-22T08:41:28.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.300+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.21 2024-09-22T08:41:28.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.300+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.22 2024-09-22T08:41:28.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.300+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.23 2024-09-22T08:41:28.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.301+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.24 2024-09-22T08:41:28.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.301+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.25 2024-09-22T08:41:28.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.301+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.26 2024-09-22T08:41:28.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.302+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.27 2024-09-22T08:41:28.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.302+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.28 2024-09-22T08:41:28.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.302+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.29 2024-09-22T08:41:28.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.302+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.30 2024-09-22T08:41:28.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.302+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.31 2024-09-22T08:41:28.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.302+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.32 2024-09-22T08:41:28.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.302+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.33 2024-09-22T08:41:28.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.303+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.34 2024-09-22T08:41:28.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.303+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.35 2024-09-22T08:41:28.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.303+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.36 2024-09-22T08:41:28.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.304+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.37 2024-09-22T08:41:28.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.304+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.38 2024-09-22T08:41:28.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.304+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.39 2024-09-22T08:41:28.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.304+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.40 2024-09-22T08:41:28.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.304+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.41 2024-09-22T08:41:28.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.304+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.42 2024-09-22T08:41:28.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.304+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.43 2024-09-22T08:41:28.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.305+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.44 2024-09-22T08:41:28.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.305+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.45 2024-09-22T08:41:28.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.305+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.46 2024-09-22T08:41:28.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.305+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.47 2024-09-22T08:41:28.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.305+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.48 2024-09-22T08:41:28.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.306+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.49 2024-09-22T08:41:28.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.306+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.50 2024-09-22T08:41:28.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.306+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.51 2024-09-22T08:41:28.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.306+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.52 2024-09-22T08:41:28.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.307+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.53 2024-09-22T08:41:28.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.307+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.54 2024-09-22T08:41:28.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.307+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.55 2024-09-22T08:41:28.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.307+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.56 2024-09-22T08:41:28.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.307+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.57 2024-09-22T08:41:28.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.307+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.58 2024-09-22T08:41:28.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.307+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.59 2024-09-22T08:41:28.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.309+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.60 2024-09-22T08:41:28.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.309+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.61 2024-09-22T08:41:28.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.309+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.62 2024-09-22T08:41:28.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.309+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.63 2024-09-22T08:41:28.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.309+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.64 2024-09-22T08:41:28.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.309+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.65 2024-09-22T08:41:28.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.309+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.66 2024-09-22T08:41:28.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.309+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.67 2024-09-22T08:41:28.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.309+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.68 2024-09-22T08:41:28.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.309+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.69 2024-09-22T08:41:28.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.309+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.70 2024-09-22T08:41:28.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.311+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.71 2024-09-22T08:41:28.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.311+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.72 2024-09-22T08:41:28.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.311+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.73 2024-09-22T08:41:28.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.312+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.74 2024-09-22T08:41:28.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.312+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.75 2024-09-22T08:41:28.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.312+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.76 2024-09-22T08:41:28.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.312+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.77 2024-09-22T08:41:28.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.312+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.78 2024-09-22T08:41:28.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.312+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.79 2024-09-22T08:41:28.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.312+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.80 2024-09-22T08:41:28.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.312+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.81 2024-09-22T08:41:28.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.312+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.82 2024-09-22T08:41:28.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.313+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.83 2024-09-22T08:41:28.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.313+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.84 2024-09-22T08:41:28.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.314+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.85 2024-09-22T08:41:28.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.314+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.86 2024-09-22T08:41:28.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.314+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.87 2024-09-22T08:41:28.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.314+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.88 2024-09-22T08:41:28.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.314+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.89 2024-09-22T08:41:28.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.314+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.90 2024-09-22T08:41:28.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.314+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.91 2024-09-22T08:41:28.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.314+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.58__multipart_key1.2~CANFUPS6V4OQ37WkAPRlh1-QNABx5Ha.92 2024-09-22T08:41:28.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.317+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:41:28.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.319+0000 7fc7ccf23800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-22T08:41:28.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.320+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.321+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:28.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.321+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:41:28.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.321+0000 7fc7ccf23800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.11281200305710243542', time=2024-09-22T10:41:08.534728+0000, chain.objs.size()=9 2024-09-22T08:41:28.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.321+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__multipart_key1.2~XH1cYI4xbjCnJcaMjFcOq2ATJw2BKly.1 2024-09-22T08:41:28.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.321+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__shadow_key1.2~XH1cYI4xbjCnJcaMjFcOq2ATJw2BKly.1_1 2024-09-22T08:41:28.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.321+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__multipart_key1.2~XH1cYI4xbjCnJcaMjFcOq2ATJw2BKly.2 2024-09-22T08:41:28.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.321+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__shadow_key1.2~XH1cYI4xbjCnJcaMjFcOq2ATJw2BKly.2_1 2024-09-22T08:41:28.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.321+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__multipart_key1.2~XH1cYI4xbjCnJcaMjFcOq2ATJw2BKly.3 2024-09-22T08:41:28.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.321+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__shadow_key1.2~XH1cYI4xbjCnJcaMjFcOq2ATJw2BKly.3_1 2024-09-22T08:41:28.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.321+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__multipart_key1.2~XH1cYI4xbjCnJcaMjFcOq2ATJw2BKly.4 2024-09-22T08:41:28.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.321+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__shadow_key1.2~XH1cYI4xbjCnJcaMjFcOq2ATJw2BKly.4_1 2024-09-22T08:41:28.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.321+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__multipart_key1.2~XH1cYI4xbjCnJcaMjFcOq2ATJw2BKly.5 2024-09-22T08:41:28.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.325+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:41:28.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.327+0000 7fc7ccf23800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-22T08:41:28.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.328+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.328+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:28.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.329+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T08:41:28.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.329+0000 7fc7ccf23800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.13373229950252198568', time=2024-09-22T10:41:05.494574+0000, chain.objs.size()=9 2024-09-22T08:41:28.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.329+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.44__multipart_key1.2~Y74yTGc3K_Dl3sP2GE_nfoKof7w5hPM.1 2024-09-22T08:41:28.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.329+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.44__shadow_key1.2~Y74yTGc3K_Dl3sP2GE_nfoKof7w5hPM.1_1 2024-09-22T08:41:28.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.329+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.44__multipart_key1.2~Y74yTGc3K_Dl3sP2GE_nfoKof7w5hPM.2 2024-09-22T08:41:28.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.329+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.44__shadow_key1.2~Y74yTGc3K_Dl3sP2GE_nfoKof7w5hPM.2_1 2024-09-22T08:41:28.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.329+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.44__multipart_key1.2~Y74yTGc3K_Dl3sP2GE_nfoKof7w5hPM.3 2024-09-22T08:41:28.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.329+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.44__shadow_key1.2~Y74yTGc3K_Dl3sP2GE_nfoKof7w5hPM.3_1 2024-09-22T08:41:28.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.329+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.44__multipart_key1.2~Y74yTGc3K_Dl3sP2GE_nfoKof7w5hPM.4 2024-09-22T08:41:28.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.329+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.44__shadow_key1.2~Y74yTGc3K_Dl3sP2GE_nfoKof7w5hPM.4_1 2024-09-22T08:41:28.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.329+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.44__multipart_key1.2~Y74yTGc3K_Dl3sP2GE_nfoKof7w5hPM.5 2024-09-22T08:41:28.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.329+0000 7fc7ccf23800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.2877000092801506315', time=2024-09-22T10:41:10.177386+0000, chain.objs.size()=7 2024-09-22T08:41:28.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.329+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__multipart_key1.2~3UyH5J4Hsvfal3kiL6bSIWSaJ529bRR.1 2024-09-22T08:41:28.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.329+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__shadow_key1.2~3UyH5J4Hsvfal3kiL6bSIWSaJ529bRR.1_1 2024-09-22T08:41:28.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.329+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__shadow_key1.2~3UyH5J4Hsvfal3kiL6bSIWSaJ529bRR.1_2 2024-09-22T08:41:28.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.332+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__multipart_key1.2~3UyH5J4Hsvfal3kiL6bSIWSaJ529bRR.2 2024-09-22T08:41:28.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.332+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__shadow_key1.2~3UyH5J4Hsvfal3kiL6bSIWSaJ529bRR.2_1 2024-09-22T08:41:28.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.332+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__shadow_key1.2~3UyH5J4Hsvfal3kiL6bSIWSaJ529bRR.2_2 2024-09-22T08:41:28.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.332+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__multipart_key1.2~3UyH5J4Hsvfal3kiL6bSIWSaJ529bRR.3 2024-09-22T08:41:28.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.334+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:41:28.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.337+0000 7fc7ccf23800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-22T08:41:28.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.338+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.339+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:28.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.339+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.340+0000 7fc7ccf23800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-22T08:41:28.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.341+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.342+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:28.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.342+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.343+0000 7fc7ccf23800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-22T08:41:28.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.344+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.345+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:28.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.345+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:41:28.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.345+0000 7fc7ccf23800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.7986932821738576550', time=2024-09-22T10:41:14.982801+0000, chain.objs.size()=9 2024-09-22T08:41:28.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.345+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.53__multipart_file.mpg.2~t6u1yFHtieu4-hcNi0xwg7asVAcpOyv.1 2024-09-22T08:41:28.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.345+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.53__shadow_file.mpg.2~t6u1yFHtieu4-hcNi0xwg7asVAcpOyv.1_1 2024-09-22T08:41:28.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.345+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.53__multipart_file.mpg.2~t6u1yFHtieu4-hcNi0xwg7asVAcpOyv.2 2024-09-22T08:41:28.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.345+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.53__shadow_file.mpg.2~t6u1yFHtieu4-hcNi0xwg7asVAcpOyv.2_1 2024-09-22T08:41:28.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.345+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.53__multipart_file.mpg.2~t6u1yFHtieu4-hcNi0xwg7asVAcpOyv.3 2024-09-22T08:41:28.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.345+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.53__shadow_file.mpg.2~t6u1yFHtieu4-hcNi0xwg7asVAcpOyv.3_1 2024-09-22T08:41:28.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.345+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.53__multipart_file.mpg.2~t6u1yFHtieu4-hcNi0xwg7asVAcpOyv.4 2024-09-22T08:41:28.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.345+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.53__shadow_file.mpg.2~t6u1yFHtieu4-hcNi0xwg7asVAcpOyv.4_1 2024-09-22T08:41:28.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.345+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.53__multipart_file.mpg.2~t6u1yFHtieu4-hcNi0xwg7asVAcpOyv.5 2024-09-22T08:41:28.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.348+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:41:28.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.350+0000 7fc7ccf23800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-22T08:41:28.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.352+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.352+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:28.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.352+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.353+0000 7fc7ccf23800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-22T08:41:28.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.355+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.356+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:28.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.356+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:41:28.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.356+0000 7fc7ccf23800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.6574398842198027730', time=2024-09-22T10:41:21.632975+0000, chain.objs.size()=16 2024-09-22T08:41:28.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.356+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~zOnwhANTdETZ4vtP7iMa1DbipakQ9wz.1 2024-09-22T08:41:28.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.356+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~zOnwhANTdETZ4vtP7iMa1DbipakQ9wz.1_1 2024-09-22T08:41:28.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.356+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~zOnwhANTdETZ4vtP7iMa1DbipakQ9wz.1_2 2024-09-22T08:41:28.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.356+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~zOnwhANTdETZ4vtP7iMa1DbipakQ9wz.2 2024-09-22T08:41:28.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.356+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~zOnwhANTdETZ4vtP7iMa1DbipakQ9wz.2_1 2024-09-22T08:41:28.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.356+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~zOnwhANTdETZ4vtP7iMa1DbipakQ9wz.2_2 2024-09-22T08:41:28.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.356+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~zOnwhANTdETZ4vtP7iMa1DbipakQ9wz.3 2024-09-22T08:41:28.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.356+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~zOnwhANTdETZ4vtP7iMa1DbipakQ9wz.3_1 2024-09-22T08:41:28.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.356+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~zOnwhANTdETZ4vtP7iMa1DbipakQ9wz.3_2 2024-09-22T08:41:28.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.356+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~zOnwhANTdETZ4vtP7iMa1DbipakQ9wz.4 2024-09-22T08:41:28.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.356+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~zOnwhANTdETZ4vtP7iMa1DbipakQ9wz.4_1 2024-09-22T08:41:28.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.356+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~zOnwhANTdETZ4vtP7iMa1DbipakQ9wz.4_2 2024-09-22T08:41:28.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.360+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~zOnwhANTdETZ4vtP7iMa1DbipakQ9wz.5 2024-09-22T08:41:28.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.360+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~zOnwhANTdETZ4vtP7iMa1DbipakQ9wz.5_1 2024-09-22T08:41:28.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.360+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__shadow_key1.2~zOnwhANTdETZ4vtP7iMa1DbipakQ9wz.5_2 2024-09-22T08:41:28.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.360+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.55__multipart_key1.2~zOnwhANTdETZ4vtP7iMa1DbipakQ9wz.6 2024-09-22T08:41:28.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.362+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:41:28.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.365+0000 7fc7ccf23800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-22T08:41:28.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.366+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.366+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:28.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.367+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.368+0000 7fc7ccf23800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-22T08:41:28.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.369+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.370+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:28.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.370+0000 7fc7ccf23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:41:28.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.370+0000 7fc7ccf23800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.11421700958798965173', time=2024-09-22T10:41:08.109716+0000, chain.objs.size()=9 2024-09-22T08:41:28.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.370+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__multipart_key1.2~8xzc9TJJmfU12V8tVQNPWuVNM8FgKW4.1 2024-09-22T08:41:28.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.370+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__shadow_key1.2~8xzc9TJJmfU12V8tVQNPWuVNM8FgKW4.1_1 2024-09-22T08:41:28.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.370+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__multipart_key1.2~8xzc9TJJmfU12V8tVQNPWuVNM8FgKW4.2 2024-09-22T08:41:28.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.370+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__shadow_key1.2~8xzc9TJJmfU12V8tVQNPWuVNM8FgKW4.2_1 2024-09-22T08:41:28.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.370+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__multipart_key1.2~8xzc9TJJmfU12V8tVQNPWuVNM8FgKW4.3 2024-09-22T08:41:28.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.370+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__shadow_key1.2~8xzc9TJJmfU12V8tVQNPWuVNM8FgKW4.3_1 2024-09-22T08:41:28.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.370+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__multipart_key1.2~8xzc9TJJmfU12V8tVQNPWuVNM8FgKW4.4 2024-09-22T08:41:28.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.370+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__shadow_key1.2~8xzc9TJJmfU12V8tVQNPWuVNM8FgKW4.4_1 2024-09-22T08:41:28.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.370+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.47__multipart_key1.2~8xzc9TJJmfU12V8tVQNPWuVNM8FgKW4.5 2024-09-22T08:41:28.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.374+0000 7fc7ccf23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:41:28.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.377+0000 7fc67f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:28.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.379+0000 7fc7ccf23800 20 remove_watcher() i=0 2024-09-22T08:41:28.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.379+0000 7fc7ccf23800 2 removed watcher, disabling cache 2024-09-22T08:41:28.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.380+0000 7fc7ccf23800 20 remove_watcher() i=1 2024-09-22T08:41:28.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.381+0000 7fc7ccf23800 20 remove_watcher() i=2 2024-09-22T08:41:28.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.382+0000 7fc7ccf23800 20 remove_watcher() i=3 2024-09-22T08:41:28.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.384+0000 7fc7ccf23800 20 remove_watcher() i=4 2024-09-22T08:41:28.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.385+0000 7fc7ccf23800 20 remove_watcher() i=5 2024-09-22T08:41:28.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.385+0000 7fc7ccf23800 20 remove_watcher() i=6 2024-09-22T08:41:28.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.386+0000 7fc7ccf23800 20 remove_watcher() i=7 2024-09-22T08:41:28.400 DEBUG:teuthology.orchestra.run.smithi038:> radosgw-admin gc process --include-all 2024-09-22T08:41:28.454 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:41:28.454 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:41:28.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.492+0000 7fd4d740f800 20 rados->read ofs=0 len=0 2024-09-22T08:41:28.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.494+0000 7fd4d740f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:28.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.494+0000 7fd4d740f800 20 realm 2024-09-22T08:41:28.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.494+0000 7fd4d740f800 20 rados->read ofs=0 len=0 2024-09-22T08:41:28.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.494+0000 7fd4d740f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:28.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.494+0000 7fd4d740f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:41:28.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.494+0000 7fd4d740f800 20 rados->read ofs=0 len=0 2024-09-22T08:41:28.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.494+0000 7fd4d740f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:28.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.494+0000 7fd4d740f800 20 rados->read ofs=0 len=0 2024-09-22T08:41:28.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.495+0000 7fd4d740f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:28.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.495+0000 7fd4d740f800 20 rados->read ofs=0 len=0 2024-09-22T08:41:28.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.496+0000 7fd4d740f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:41:28.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.496+0000 7fd4d740f800 20 searching for the correct realm 2024-09-22T08:41:28.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.498+0000 7fd4d2321640 0 -- 172.21.15.38:0/68336857 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7fd4c8028040 msgr2=0x7fd4c8044950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:41:28.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.702+0000 7fd4d2321640 0 -- 172.21.15.38:0/68336857 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fd4c406b030 msgr2=0x7fd4c40cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:41:28.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.910+0000 7fd4d740f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:41:28.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.910+0000 7fd4d740f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:41:28.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.910+0000 7fd4d740f800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:41:28.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.910+0000 7fd4d740f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:41:28.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.910+0000 7fd4d740f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:41:28.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.910+0000 7fd4d740f800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:41:28.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.910+0000 7fd4d740f800 20 rados->read ofs=0 len=0 2024-09-22T08:41:28.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.910+0000 7fd4d740f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:28.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.910+0000 7fd4d740f800 20 rados->read ofs=0 len=0 2024-09-22T08:41:28.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.910+0000 7fd4d740f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:28.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.910+0000 7fd4d740f800 20 rados->read ofs=0 len=0 2024-09-22T08:41:28.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.911+0000 7fd4d740f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:41:28.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.911+0000 7fd4d740f800 20 zone default found 2024-09-22T08:41:28.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.911+0000 7fd4d740f800 4 Realm: () 2024-09-22T08:41:28.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.911+0000 7fd4d740f800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:41:28.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.911+0000 7fd4d740f800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:41:28.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.911+0000 7fd4d740f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:41:28.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.911+0000 7fd4d740f800 20 zonegroup default 2024-09-22T08:41:28.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.911+0000 7fd4d740f800 20 rados->read ofs=0 len=0 2024-09-22T08:41:28.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.911+0000 7fd4d740f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:28.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.911+0000 7fd4d740f800 20 rados->read ofs=0 len=0 2024-09-22T08:41:28.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.911+0000 7fd4d740f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:28.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.911+0000 7fd4d740f800 20 rados->read ofs=0 len=0 2024-09-22T08:41:28.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.912+0000 7fd4d740f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:28.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.912+0000 7fd4d740f800 20 started sync module instance, tier type = 2024-09-22T08:41:28.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.912+0000 7fd4d740f800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:41:28.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.922+0000 7fd4d740f800 20 add_watcher() i=0 2024-09-22T08:41:28.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.922+0000 7fd4d740f800 20 add_watcher() i=1 2024-09-22T08:41:28.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.922+0000 7fd4d740f800 20 add_watcher() i=2 2024-09-22T08:41:28.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.922+0000 7fd4d740f800 20 add_watcher() i=3 2024-09-22T08:41:28.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.922+0000 7fd4d740f800 20 add_watcher() i=4 2024-09-22T08:41:28.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.922+0000 7fd4d740f800 20 add_watcher() i=5 2024-09-22T08:41:28.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.922+0000 7fd4d740f800 20 add_watcher() i=6 2024-09-22T08:41:28.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.924+0000 7fd4d740f800 20 add_watcher() i=7 2024-09-22T08:41:28.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.924+0000 7fd4d740f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:41:28.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.925+0000 7fd3897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:28.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.925+0000 7fd4d740f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:41:28.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.925+0000 7fd4d740f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:41:28.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.967+0000 7fd303fff640 20 reqs_thread_entry: start 2024-09-22T08:41:28.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.967+0000 7fd4d740f800 20 init_complete bucket index max shards: 11 2024-09-22T08:41:28.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.967+0000 7fd4d740f800 20 Filter name: none 2024-09-22T08:41:28.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.967+0000 7fd301ffb640 20 reqs_thread_entry: start 2024-09-22T08:41:28.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.967+0000 7fd4d740f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-22T08:41:28.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.969+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.969+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:28.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.970+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.971+0000 7fd4d740f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-22T08:41:28.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.972+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.973+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:28.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.973+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.974+0000 7fd4d740f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-22T08:41:28.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.976+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.976+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:28.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.977+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.978+0000 7fd4d740f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-22T08:41:28.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.980+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.980+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:28.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.980+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.981+0000 7fd4d740f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-22T08:41:28.985 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.983+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.986 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.984+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:28.986 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.984+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.985+0000 7fd4d740f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-22T08:41:28.989 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.987+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.989 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.987+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:28.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.988+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.989+0000 7fd4d740f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-22T08:41:28.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.990+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.991+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:28.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.992+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.993+0000 7fd4d740f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-22T08:41:28.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.995+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.995+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:28.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.995+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:28.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.996+0000 7fd4d740f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-22T08:41:29.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.998+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:28.999+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.000+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.001+0000 7fd4d740f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-22T08:41:29.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.002+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.003+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.003+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.004+0000 7fd4d740f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-22T08:41:29.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.005+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.006+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.006+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.007+0000 7fd4d740f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-22T08:41:29.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.008+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.009+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.010+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.011+0000 7fd4d740f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-22T08:41:29.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.013+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.013+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.013+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.014+0000 7fd4d740f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-22T08:41:29.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.015+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.016+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.016+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.017+0000 7fd4d740f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-22T08:41:29.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.019+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.019+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.019+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.020+0000 7fd4d740f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-22T08:41:29.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.022+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.022+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.023+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.024+0000 7fd4d740f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-22T08:41:29.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.025+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.025+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.026+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.027+0000 7fd4d740f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-22T08:41:29.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.028+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.029+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.029+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.030+0000 7fd4d740f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-22T08:41:29.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.031+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.032+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.032+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.033+0000 7fd4d740f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-22T08:41:29.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.034+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.034+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.035+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.037+0000 7fd4d740f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-22T08:41:29.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.037+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.038+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.038+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.039+0000 7fd4d740f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-22T08:41:29.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.040+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.041+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.041+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.042+0000 7fd4d740f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-22T08:41:29.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.043+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.044+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.044+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.045+0000 7fd4d740f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-22T08:41:29.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.047+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.047+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.048+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.048+0000 7fd4d740f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-22T08:41:29.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.050+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.050+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.050+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.051+0000 7fd4d740f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-22T08:41:29.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.053+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.053+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.053+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.054+0000 7fd4d740f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-22T08:41:29.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.056+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.057+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.057+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.058+0000 7fd4d740f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-22T08:41:29.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.060+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.060+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.060+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.061+0000 7fd4d740f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-22T08:41:29.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.063+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.063+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.063+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.064+0000 7fd4d740f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-22T08:41:29.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.066+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.066+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.066+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.067+0000 7fd4d740f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-22T08:41:29.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.069+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.069+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.070+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.071+0000 7fd4d740f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-22T08:41:29.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.072+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.073+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.073+0000 7fd4d740f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.075+0000 7fd3897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:29.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.077+0000 7fd4d740f800 20 remove_watcher() i=0 2024-09-22T08:41:29.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.077+0000 7fd4d740f800 2 removed watcher, disabling cache 2024-09-22T08:41:29.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.079+0000 7fd4d740f800 20 remove_watcher() i=1 2024-09-22T08:41:29.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.080+0000 7fd4d740f800 20 remove_watcher() i=2 2024-09-22T08:41:29.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.081+0000 7fd4d740f800 20 remove_watcher() i=3 2024-09-22T08:41:29.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.082+0000 7fd4d740f800 20 remove_watcher() i=4 2024-09-22T08:41:29.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.083+0000 7fd4d740f800 20 remove_watcher() i=5 2024-09-22T08:41:29.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.084+0000 7fd4d740f800 20 remove_watcher() i=6 2024-09-22T08:41:29.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.085+0000 7fd4d740f800 20 remove_watcher() i=7 2024-09-22T08:41:29.099 DEBUG:teuthology.orchestra.run.smithi038:> radosgw-admin gc process --include-all 2024-09-22T08:41:29.152 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:41:29.153 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:41:29.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.191+0000 7f250a73d800 20 rados->read ofs=0 len=0 2024-09-22T08:41:29.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.192+0000 7f250a73d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:29.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.192+0000 7f250a73d800 20 realm 2024-09-22T08:41:29.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.192+0000 7f250a73d800 20 rados->read ofs=0 len=0 2024-09-22T08:41:29.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.193+0000 7f250a73d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:29.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.193+0000 7f250a73d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:41:29.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.193+0000 7f250a73d800 20 rados->read ofs=0 len=0 2024-09-22T08:41:29.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.193+0000 7f250a73d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:29.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.193+0000 7f250a73d800 20 rados->read ofs=0 len=0 2024-09-22T08:41:29.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.194+0000 7f250a73d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:29.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.194+0000 7f250a73d800 20 rados->read ofs=0 len=0 2024-09-22T08:41:29.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.194+0000 7f250a73d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:41:29.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.194+0000 7f250a73d800 20 searching for the correct realm 2024-09-22T08:41:29.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.197+0000 7f2506c2b640 0 -- 172.21.15.38:0/2692204481 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7f24f8061040 msgr2=0x7f24f80a4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:29.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.402+0000 7f250642a640 0 -- 172.21.15.38:0/2692204481 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x5634b5129dd0 msgr2=0x5634b512c290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:29.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.407+0000 7f250a73d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:41:29.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.407+0000 7f250a73d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:41:29.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.407+0000 7f250a73d800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:41:29.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.407+0000 7f250a73d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:41:29.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.407+0000 7f250a73d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:41:29.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.407+0000 7f250a73d800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:41:29.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.407+0000 7f250a73d800 20 rados->read ofs=0 len=0 2024-09-22T08:41:29.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.407+0000 7f250a73d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:29.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.407+0000 7f250a73d800 20 rados->read ofs=0 len=0 2024-09-22T08:41:29.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.407+0000 7f250a73d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:29.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.407+0000 7f250a73d800 20 rados->read ofs=0 len=0 2024-09-22T08:41:29.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.408+0000 7f250a73d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:41:29.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.408+0000 7f250a73d800 20 zone default found 2024-09-22T08:41:29.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.408+0000 7f250a73d800 4 Realm: () 2024-09-22T08:41:29.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.408+0000 7f250a73d800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:41:29.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.408+0000 7f250a73d800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:41:29.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.408+0000 7f250a73d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:41:29.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.408+0000 7f250a73d800 20 zonegroup default 2024-09-22T08:41:29.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.408+0000 7f250a73d800 20 rados->read ofs=0 len=0 2024-09-22T08:41:29.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.409+0000 7f250a73d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:29.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.409+0000 7f250a73d800 20 rados->read ofs=0 len=0 2024-09-22T08:41:29.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.409+0000 7f250a73d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:29.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.409+0000 7f250a73d800 20 rados->read ofs=0 len=0 2024-09-22T08:41:29.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.409+0000 7f250a73d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:29.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.409+0000 7f250a73d800 20 started sync module instance, tier type = 2024-09-22T08:41:29.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.409+0000 7f250a73d800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:41:29.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.417+0000 7f250a73d800 20 add_watcher() i=0 2024-09-22T08:41:29.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.417+0000 7f250a73d800 20 add_watcher() i=1 2024-09-22T08:41:29.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.417+0000 7f250a73d800 20 add_watcher() i=2 2024-09-22T08:41:29.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.417+0000 7f250a73d800 20 add_watcher() i=3 2024-09-22T08:41:29.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.417+0000 7f250a73d800 20 add_watcher() i=4 2024-09-22T08:41:29.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.417+0000 7f250a73d800 20 add_watcher() i=5 2024-09-22T08:41:29.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.418+0000 7f250a73d800 20 add_watcher() i=6 2024-09-22T08:41:29.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.418+0000 7f250a73d800 20 add_watcher() i=7 2024-09-22T08:41:29.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.418+0000 7f250a73d800 2 all 8 watchers are set, enabling cache 2024-09-22T08:41:29.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.423+0000 7f23bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:29.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.423+0000 7f250a73d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:41:29.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.423+0000 7f250a73d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:41:29.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.461+0000 7f23377fe640 20 reqs_thread_entry: start 2024-09-22T08:41:29.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.461+0000 7f250a73d800 20 init_complete bucket index max shards: 11 2024-09-22T08:41:29.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.461+0000 7f250a73d800 20 Filter name: none 2024-09-22T08:41:29.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.461+0000 7f23357fa640 20 reqs_thread_entry: start 2024-09-22T08:41:29.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.461+0000 7f250a73d800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-22T08:41:29.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.462+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.462+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.462+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.463+0000 7f250a73d800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-22T08:41:29.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.465+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.465+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.466+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.467+0000 7f250a73d800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-22T08:41:29.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.469+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.469+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.469+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.470+0000 7f250a73d800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-22T08:41:29.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.472+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.472+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.473+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.474+0000 7f250a73d800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-22T08:41:29.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.475+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.476+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.476+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.478+0000 7f250a73d800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-22T08:41:29.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.478+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.479+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.479+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.480+0000 7f250a73d800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-22T08:41:29.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.482+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.482+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.482+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.483+0000 7f250a73d800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-22T08:41:29.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.484+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.485+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.485+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.486+0000 7f250a73d800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-22T08:41:29.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.487+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.488+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.488+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.489+0000 7f250a73d800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-22T08:41:29.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.490+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.491+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.491+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.492+0000 7f250a73d800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-22T08:41:29.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.493+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.494+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.494+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.495+0000 7f250a73d800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-22T08:41:29.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.497+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.497+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.497+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.498+0000 7f250a73d800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-22T08:41:29.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.499+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.500+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.500+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.501+0000 7f250a73d800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-22T08:41:29.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.503+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.503+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.504+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.505+0000 7f250a73d800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-22T08:41:29.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.506+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.506+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.507+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.508+0000 7f250a73d800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-22T08:41:29.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.509+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.510+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.510+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.511+0000 7f250a73d800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-22T08:41:29.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.513+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.513+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.514+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.515+0000 7f250a73d800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-22T08:41:29.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.516+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.516+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.517+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.518+0000 7f250a73d800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-22T08:41:29.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.519+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.520+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.520+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.521+0000 7f250a73d800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-22T08:41:29.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.523+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.523+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.524+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.525+0000 7f250a73d800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-22T08:41:29.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.526+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.527+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.527+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.528+0000 7f250a73d800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-22T08:41:29.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.529+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.530+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.530+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.532+0000 7f250a73d800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-22T08:41:29.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.533+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.533+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.533+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.535+0000 7f250a73d800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-22T08:41:29.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.536+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.536+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.537+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.537+0000 7f250a73d800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-22T08:41:29.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.540+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.540+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.540+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.540+0000 7f250a73d800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-22T08:41:29.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.542+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.543+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.543+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.544+0000 7f250a73d800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-22T08:41:29.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.546+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.546+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.546+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.547+0000 7f250a73d800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-22T08:41:29.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.549+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.549+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.549+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.551+0000 7f250a73d800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-22T08:41:29.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.553+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.553+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.553+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.556 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.554+0000 7f250a73d800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-22T08:41:29.557 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.555+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.557 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.556+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.556+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.557+0000 7f250a73d800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-22T08:41:29.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.558+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.560+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.560+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.561+0000 7f250a73d800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-22T08:41:29.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.562+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.562+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:29.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.563+0000 7f250a73d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:29.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.564+0000 7f23bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:29.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.566+0000 7f250a73d800 20 remove_watcher() i=0 2024-09-22T08:41:29.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.566+0000 7f250a73d800 2 removed watcher, disabling cache 2024-09-22T08:41:29.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.567+0000 7f250a73d800 20 remove_watcher() i=1 2024-09-22T08:41:29.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.568+0000 7f250a73d800 20 remove_watcher() i=2 2024-09-22T08:41:29.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.569+0000 7f250a73d800 20 remove_watcher() i=3 2024-09-22T08:41:29.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.570+0000 7f250a73d800 20 remove_watcher() i=4 2024-09-22T08:41:29.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.571+0000 7f250a73d800 20 remove_watcher() i=5 2024-09-22T08:41:29.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.573+0000 7f250a73d800 20 remove_watcher() i=6 2024-09-22T08:41:29.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.575+0000 7f250a73d800 20 remove_watcher() i=7 2024-09-22T08:41:29.588 DEBUG:teuthology.orchestra.run.smithi038:> radosgw-admin gc process --include-all 2024-09-22T08:41:29.641 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:41:29.641 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:41:29.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.678+0000 7fd002326800 20 rados->read ofs=0 len=0 2024-09-22T08:41:29.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.680+0000 7fd002326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:29.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.680+0000 7fd002326800 20 realm 2024-09-22T08:41:29.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.680+0000 7fd002326800 20 rados->read ofs=0 len=0 2024-09-22T08:41:29.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.680+0000 7fd002326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:29.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.680+0000 7fd002326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:41:29.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.680+0000 7fd002326800 20 rados->read ofs=0 len=0 2024-09-22T08:41:29.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.680+0000 7fd002326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:29.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.680+0000 7fd002326800 20 rados->read ofs=0 len=0 2024-09-22T08:41:29.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.681+0000 7fd002326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:29.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.681+0000 7fd002326800 20 rados->read ofs=0 len=0 2024-09-22T08:41:29.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.682+0000 7fd002326800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:41:29.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.682+0000 7fd002326800 20 searching for the correct realm 2024-09-22T08:41:29.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.684+0000 7fcffd708640 0 -- 172.21.15.38:0/3082859237 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7fcff401f060 msgr2=0x7fcff4076100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:41:29.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:29.888+0000 7fcffd708640 0 -- 172.21.15.38:0/3082859237 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fcff0070050 msgr2=0x7fcff0059030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:41:30.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.095+0000 7fd002326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:41:30.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.095+0000 7fd002326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:41:30.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.095+0000 7fd002326800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:41:30.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.095+0000 7fd002326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:41:30.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.095+0000 7fd002326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:41:30.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.095+0000 7fd002326800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:41:30.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.095+0000 7fd002326800 20 rados->read ofs=0 len=0 2024-09-22T08:41:30.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.095+0000 7fd002326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:30.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.095+0000 7fd002326800 20 rados->read ofs=0 len=0 2024-09-22T08:41:30.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.095+0000 7fd002326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:30.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.095+0000 7fd002326800 20 rados->read ofs=0 len=0 2024-09-22T08:41:30.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.096+0000 7fd002326800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:41:30.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.096+0000 7fd002326800 20 zone default found 2024-09-22T08:41:30.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.096+0000 7fd002326800 4 Realm: () 2024-09-22T08:41:30.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.096+0000 7fd002326800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:41:30.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.096+0000 7fd002326800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:41:30.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.096+0000 7fd002326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:41:30.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.096+0000 7fd002326800 20 zonegroup default 2024-09-22T08:41:30.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.096+0000 7fd002326800 20 rados->read ofs=0 len=0 2024-09-22T08:41:30.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.096+0000 7fd002326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:30.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.096+0000 7fd002326800 20 rados->read ofs=0 len=0 2024-09-22T08:41:30.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.097+0000 7fd002326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:30.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.097+0000 7fd002326800 20 rados->read ofs=0 len=0 2024-09-22T08:41:30.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.097+0000 7fd002326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:30.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.097+0000 7fd002326800 20 started sync module instance, tier type = 2024-09-22T08:41:30.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.097+0000 7fd002326800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:41:30.108 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.106+0000 7fd002326800 20 add_watcher() i=0 2024-09-22T08:41:30.108 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.106+0000 7fd002326800 20 add_watcher() i=1 2024-09-22T08:41:30.108 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.106+0000 7fd002326800 20 add_watcher() i=2 2024-09-22T08:41:30.108 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.106+0000 7fd002326800 20 add_watcher() i=3 2024-09-22T08:41:30.108 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.106+0000 7fd002326800 20 add_watcher() i=4 2024-09-22T08:41:30.108 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.106+0000 7fd002326800 20 add_watcher() i=5 2024-09-22T08:41:30.108 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.106+0000 7fd002326800 20 add_watcher() i=6 2024-09-22T08:41:30.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.108+0000 7fd002326800 20 add_watcher() i=7 2024-09-22T08:41:30.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.108+0000 7fd002326800 2 all 8 watchers are set, enabling cache 2024-09-22T08:41:30.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.109+0000 7fceaffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:30.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.109+0000 7fd002326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:41:30.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.109+0000 7fd002326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:41:30.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.148+0000 7fceaeffd640 20 reqs_thread_entry: start 2024-09-22T08:41:30.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.148+0000 7fd002326800 20 init_complete bucket index max shards: 11 2024-09-22T08:41:30.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.148+0000 7fd002326800 20 Filter name: none 2024-09-22T08:41:30.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.148+0000 7fceacff9640 20 reqs_thread_entry: start 2024-09-22T08:41:30.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.148+0000 7fd002326800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-22T08:41:30.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.149+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.149+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:30.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.150+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.151+0000 7fd002326800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-22T08:41:30.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.153+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.154+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:30.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.154+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.154+0000 7fd002326800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-22T08:41:30.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.156+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.156+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:30.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.156+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.157+0000 7fd002326800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-22T08:41:30.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.159+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.159+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:30.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.159+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.161+0000 7fd002326800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-22T08:41:30.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.163+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.163+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:30.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.164+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.164+0000 7fd002326800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-22T08:41:30.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.166+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.166+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:30.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.166+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.167+0000 7fd002326800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-22T08:41:30.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.169+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.169+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:30.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.169+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.171+0000 7fd002326800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-22T08:41:30.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.172+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.174+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:30.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.174+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.174+0000 7fd002326800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-22T08:41:30.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.176+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.176+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:30.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.176+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.178+0000 7fd002326800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-22T08:41:30.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.178+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.180+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:30.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.180+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.181+0000 7fd002326800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-22T08:41:30.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.182+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.183+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:30.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.183+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.183+0000 7fd002326800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-22T08:41:30.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.186+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.186+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:30.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.186+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.187+0000 7fd002326800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-22T08:41:30.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.189+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.189+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:30.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.190+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.190+0000 7fd002326800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-22T08:41:30.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.192+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.192+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:30.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.193+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.194+0000 7fd002326800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-22T08:41:30.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.196+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.196+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:30.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.197+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.198+0000 7fd002326800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-22T08:41:30.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.199+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.200+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:30.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.200+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.201+0000 7fd002326800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-22T08:41:30.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.202+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.203+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:30.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.203+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.204+0000 7fd002326800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-22T08:41:30.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.206+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.206+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:30.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.206+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.207+0000 7fd002326800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-22T08:41:30.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.208+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.209+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:30.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.209+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.210+0000 7fd002326800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-22T08:41:30.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.212+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.212+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:30.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.213+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.213+0000 7fd002326800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-22T08:41:30.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.215+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.215+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:30.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.215+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.216+0000 7fd002326800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-22T08:41:30.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.218+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.218+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:30.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.219+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.220+0000 7fd002326800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-22T08:41:30.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.220+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.220+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:30.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.222+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.223+0000 7fd002326800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-22T08:41:30.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.224+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.224+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:30.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.225+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.226+0000 7fd002326800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-22T08:41:30.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.227+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.228+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:30.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.228+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.229+0000 7fd002326800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-22T08:41:30.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.230+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.231+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:30.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.231+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.232+0000 7fd002326800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-22T08:41:30.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.233+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.234+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:30.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.234+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.235+0000 7fd002326800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-22T08:41:30.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.236+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.237+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:30.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.237+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.239+0000 7fd002326800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-22T08:41:30.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.240+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.241+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:30.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.241+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.242+0000 7fd002326800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-22T08:41:30.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.243+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.244+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:30.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.244+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.245+0000 7fd002326800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-22T08:41:30.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.246+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.246+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:30.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.247+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.248+0000 7fd002326800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-22T08:41:30.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.249+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.250+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:30.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.250+0000 7fd002326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:30.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.252+0000 7fceaffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:30.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.254+0000 7fd002326800 20 remove_watcher() i=0 2024-09-22T08:41:30.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.254+0000 7fd002326800 2 removed watcher, disabling cache 2024-09-22T08:41:30.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.255+0000 7fd002326800 20 remove_watcher() i=1 2024-09-22T08:41:30.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.256+0000 7fd002326800 20 remove_watcher() i=2 2024-09-22T08:41:30.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.257+0000 7fd002326800 20 remove_watcher() i=3 2024-09-22T08:41:30.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.258+0000 7fd002326800 20 remove_watcher() i=4 2024-09-22T08:41:30.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.259+0000 7fd002326800 20 remove_watcher() i=5 2024-09-22T08:41:30.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.260+0000 7fd002326800 20 remove_watcher() i=6 2024-09-22T08:41:30.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:30.261+0000 7fd002326800 20 remove_watcher() i=7 2024-09-22T08:41:30.274 DEBUG:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-22T08:41:30.881 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :clean 2024-09-22T08:41:31.679 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :compileJava 2024-09-22T08:41:31.679 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :processResources 2024-09-22T08:41:31.679 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :classes 2024-09-22T08:41:32.079 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:32.079 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :compileTestJava 2024-09-22T08:41:32.079 INFO:teuthology.orchestra.run.smithi038.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-22T08:41:32.079 INFO:teuthology.orchestra.run.smithi038.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-22T08:41:32.080 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:32.081 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :processTestResources NO-SOURCE 2024-09-22T08:41:32.081 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :testClasses 2024-09-22T08:41:34.080 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:34.080 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :test 2024-09-22T08:41:34.080 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:34.080 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Bucket tests STANDARD_OUT 2024-09-22T08:41:34.080 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22 08:41:33,454 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-22T08:41:34.081 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:34.081 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-22T08:41:34.081 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:34.081 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-22T08:41:34.081 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:34.081 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-22T08:41:34.081 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:34.081 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-22T08:41:34.279 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:34.279 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-22T08:41:34.279 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:34.279 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-22T08:41:34.479 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:34.479 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-22T08:41:34.479 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:34.479 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-22T08:41:34.578 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:34.578 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-22T08:41:34.678 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:34.679 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-22T08:41:34.878 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:34.879 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-22T08:41:34.978 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:34.978 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-22T08:41:35.078 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:35.079 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-22T08:41:35.079 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:35.079 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-22T08:41:35.478 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:35.479 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-22T08:41:35.479 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:35.479 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-22T08:41:35.678 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:35.678 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-22T08:41:35.778 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:35.778 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-22T08:41:35.823 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:35.823 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------- 2024-09-22T08:41:35.823 INFO:teuthology.orchestra.run.smithi038.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-22T08:41:35.823 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------- 2024-09-22T08:41:35.823 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:35.823 INFO:teuthology.orchestra.run.smithi038.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-22T08:41:35.823 INFO:teuthology.orchestra.run.smithi038.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-22T08:41:35.823 INFO:teuthology.orchestra.run.smithi038.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-22T08:41:35.823 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:35.823 INFO:teuthology.orchestra.run.smithi038.stdout:BUILD SUCCESSFUL in 5s 2024-09-22T08:41:35.823 INFO:teuthology.orchestra.run.smithi038.stdout:5 actionable tasks: 5 executed 2024-09-22T08:41:35.828 DEBUG:teuthology.orchestra.run.smithi038:> radosgw-admin gc process --include-all 2024-09-22T08:41:35.882 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:41:35.882 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:41:35.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:35.920+0000 7fdb4e73e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:35.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:35.922+0000 7fdb4e73e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:35.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:35.922+0000 7fdb4e73e800 20 realm 2024-09-22T08:41:35.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:35.922+0000 7fdb4e73e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:35.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:35.923+0000 7fdb4e73e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:35.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:35.923+0000 7fdb4e73e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:41:35.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:35.923+0000 7fdb4e73e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:35.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:35.923+0000 7fdb4e73e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:35.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:35.923+0000 7fdb4e73e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:35.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:35.924+0000 7fdb4e73e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:35.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:35.924+0000 7fdb4e73e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:35.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:35.924+0000 7fdb4e73e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:41:35.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:35.924+0000 7fdb4e73e800 20 searching for the correct realm 2024-09-22T08:41:35.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:35.927+0000 7fdb49cec640 0 -- 172.21.15.38:0/287755148 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7fdb4009a060 msgr2=0x7fdb40056a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:35.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:35.930+0000 7fdb49cec640 0 -- 172.21.15.38:0/287755148 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fdb3c00b040 msgr2=0x7fdb3c0653f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:36.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.137+0000 7fdb4e73e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:41:36.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.137+0000 7fdb4e73e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:41:36.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.137+0000 7fdb4e73e800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:41:36.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.137+0000 7fdb4e73e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:41:36.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.137+0000 7fdb4e73e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:41:36.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.137+0000 7fdb4e73e800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:41:36.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.137+0000 7fdb4e73e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:36.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.137+0000 7fdb4e73e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:36.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.137+0000 7fdb4e73e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:36.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.137+0000 7fdb4e73e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:36.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.137+0000 7fdb4e73e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:36.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.138+0000 7fdb4e73e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:41:36.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.138+0000 7fdb4e73e800 20 zone default found 2024-09-22T08:41:36.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.138+0000 7fdb4e73e800 4 Realm: () 2024-09-22T08:41:36.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.138+0000 7fdb4e73e800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:41:36.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.138+0000 7fdb4e73e800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:41:36.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.138+0000 7fdb4e73e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:41:36.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.138+0000 7fdb4e73e800 20 zonegroup default 2024-09-22T08:41:36.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.138+0000 7fdb4e73e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:36.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.138+0000 7fdb4e73e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:36.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.138+0000 7fdb4e73e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:36.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.138+0000 7fdb4e73e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:36.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.138+0000 7fdb4e73e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:36.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.139+0000 7fdb4e73e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:36.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.139+0000 7fdb4e73e800 20 started sync module instance, tier type = 2024-09-22T08:41:36.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.139+0000 7fdb4e73e800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:41:36.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.150+0000 7fdb4e73e800 20 add_watcher() i=0 2024-09-22T08:41:36.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.150+0000 7fdb4e73e800 20 add_watcher() i=1 2024-09-22T08:41:36.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.150+0000 7fdb4e73e800 20 add_watcher() i=2 2024-09-22T08:41:36.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.150+0000 7fdb4e73e800 20 add_watcher() i=3 2024-09-22T08:41:36.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.150+0000 7fdb4e73e800 20 add_watcher() i=4 2024-09-22T08:41:36.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.150+0000 7fdb4e73e800 20 add_watcher() i=5 2024-09-22T08:41:36.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.150+0000 7fdb4e73e800 20 add_watcher() i=6 2024-09-22T08:41:36.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.151+0000 7fdb4e73e800 20 add_watcher() i=7 2024-09-22T08:41:36.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.151+0000 7fdb4e73e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:41:36.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.153+0000 7fda00fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:36.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.153+0000 7fdb4e73e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:41:36.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.153+0000 7fdb4e73e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:41:36.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.192+0000 7fd97b7fe640 20 reqs_thread_entry: start 2024-09-22T08:41:36.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.192+0000 7fdb4e73e800 20 init_complete bucket index max shards: 11 2024-09-22T08:41:36.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.193+0000 7fdb4e73e800 20 Filter name: none 2024-09-22T08:41:36.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.193+0000 7fd9797fa640 20 reqs_thread_entry: start 2024-09-22T08:41:36.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.193+0000 7fdb4e73e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-22T08:41:36.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.194+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.195+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.195+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.196+0000 7fdb4e73e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-22T08:41:36.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.198+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.198+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.198+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.199+0000 7fdb4e73e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-22T08:41:36.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.201+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.202+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.202+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.204+0000 7fdb4e73e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-22T08:41:36.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.205+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.205+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.206+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.207+0000 7fdb4e73e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-22T08:41:36.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.208+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.209+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.209+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.211+0000 7fdb4e73e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-22T08:41:36.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.212+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.213+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.213+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.215+0000 7fdb4e73e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-22T08:41:36.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.216+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.217+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.217+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.218+0000 7fdb4e73e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-22T08:41:36.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.220+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.220+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.220+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.221+0000 7fdb4e73e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-22T08:41:36.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.223+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.223+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.223+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.225+0000 7fdb4e73e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-22T08:41:36.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.226+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.226+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.227+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.228+0000 7fdb4e73e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-22T08:41:36.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.229+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.230+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.230+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.231+0000 7fdb4e73e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-22T08:41:36.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.232+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.233+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.233+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.234+0000 7fdb4e73e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-22T08:41:36.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.235+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.236+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.236+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.237+0000 7fdb4e73e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-22T08:41:36.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.238+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.239+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.239+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.240+0000 7fdb4e73e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-22T08:41:36.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.241+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.242+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.242+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.243+0000 7fdb4e73e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-22T08:41:36.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.245+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.245+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.246+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.247+0000 7fdb4e73e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-22T08:41:36.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.248+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.249+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.250+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.252 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.251+0000 7fdb4e73e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-22T08:41:36.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.252+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.253+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.253+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.254+0000 7fdb4e73e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-22T08:41:36.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.255+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.256+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.256+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.257+0000 7fdb4e73e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-22T08:41:36.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.258+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.259+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.259+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.260+0000 7fdb4e73e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-22T08:41:36.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.261+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.262+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.262+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.263+0000 7fdb4e73e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-22T08:41:36.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.265+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.265+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.265+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.266+0000 7fdb4e73e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-22T08:41:36.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.268+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.269+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.269+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.270+0000 7fdb4e73e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-22T08:41:36.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.271+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.272+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.272+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.273+0000 7fdb4e73e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-22T08:41:36.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.275+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.275+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.276+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.277+0000 7fdb4e73e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-22T08:41:36.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.278+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.278+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.279+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.280+0000 7fdb4e73e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-22T08:41:36.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.281+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.282+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.282+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.283+0000 7fdb4e73e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-22T08:41:36.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.284+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.285+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.285+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.286+0000 7fdb4e73e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-22T08:41:36.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.287+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.288+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.288+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.289+0000 7fdb4e73e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-22T08:41:36.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.290+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.291+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.291+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.292+0000 7fdb4e73e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-22T08:41:36.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.294+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.294+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.294+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.295+0000 7fdb4e73e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-22T08:41:36.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.297+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.297+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.297+0000 7fdb4e73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.299+0000 7fda00fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:36.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.301+0000 7fdb4e73e800 20 remove_watcher() i=0 2024-09-22T08:41:36.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.301+0000 7fdb4e73e800 2 removed watcher, disabling cache 2024-09-22T08:41:36.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.302+0000 7fdb4e73e800 20 remove_watcher() i=1 2024-09-22T08:41:36.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.303+0000 7fdb4e73e800 20 remove_watcher() i=2 2024-09-22T08:41:36.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.304+0000 7fdb4e73e800 20 remove_watcher() i=3 2024-09-22T08:41:36.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.305+0000 7fdb4e73e800 20 remove_watcher() i=4 2024-09-22T08:41:36.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.307+0000 7fdb4e73e800 20 remove_watcher() i=5 2024-09-22T08:41:36.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.308+0000 7fdb4e73e800 20 remove_watcher() i=6 2024-09-22T08:41:36.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.309+0000 7fdb4e73e800 20 remove_watcher() i=7 2024-09-22T08:41:36.322 DEBUG:teuthology.orchestra.run.smithi038:> radosgw-admin gc process --include-all 2024-09-22T08:41:36.375 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:41:36.375 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:41:36.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.414+0000 7fe7e5b2c800 20 rados->read ofs=0 len=0 2024-09-22T08:41:36.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.415+0000 7fe7e5b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:36.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.415+0000 7fe7e5b2c800 20 realm 2024-09-22T08:41:36.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.416+0000 7fe7e5b2c800 20 rados->read ofs=0 len=0 2024-09-22T08:41:36.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.416+0000 7fe7e5b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:36.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.416+0000 7fe7e5b2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:41:36.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.416+0000 7fe7e5b2c800 20 rados->read ofs=0 len=0 2024-09-22T08:41:36.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.416+0000 7fe7e5b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:36.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.416+0000 7fe7e5b2c800 20 rados->read ofs=0 len=0 2024-09-22T08:41:36.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.417+0000 7fe7e5b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:36.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.417+0000 7fe7e5b2c800 20 rados->read ofs=0 len=0 2024-09-22T08:41:36.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.417+0000 7fe7e5b2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:41:36.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.417+0000 7fe7e5b2c800 20 searching for the correct realm 2024-09-22T08:41:36.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.420+0000 7fe7e104e640 0 -- 172.21.15.38:0/1121179229 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7fe7d80abd90 msgr2=0x7fe7d80b4a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:36.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.423+0000 7fe7e104e640 0 -- 172.21.15.38:0/1121179229 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fe7d404a040 msgr2=0x7fe7d404a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:36.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.629+0000 7fe7e5b2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:41:36.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.629+0000 7fe7e5b2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:41:36.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.629+0000 7fe7e5b2c800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:41:36.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.629+0000 7fe7e5b2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:41:36.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.629+0000 7fe7e5b2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:41:36.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.629+0000 7fe7e5b2c800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:41:36.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.629+0000 7fe7e5b2c800 20 rados->read ofs=0 len=0 2024-09-22T08:41:36.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.630+0000 7fe7e5b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:36.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.630+0000 7fe7e5b2c800 20 rados->read ofs=0 len=0 2024-09-22T08:41:36.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.630+0000 7fe7e5b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:36.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.630+0000 7fe7e5b2c800 20 rados->read ofs=0 len=0 2024-09-22T08:41:36.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.630+0000 7fe7e5b2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:41:36.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.631+0000 7fe7e5b2c800 20 zone default found 2024-09-22T08:41:36.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.631+0000 7fe7e5b2c800 4 Realm: () 2024-09-22T08:41:36.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.631+0000 7fe7e5b2c800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:41:36.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.631+0000 7fe7e5b2c800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:41:36.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.631+0000 7fe7e5b2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:41:36.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.631+0000 7fe7e5b2c800 20 zonegroup default 2024-09-22T08:41:36.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.631+0000 7fe7e5b2c800 20 rados->read ofs=0 len=0 2024-09-22T08:41:36.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.631+0000 7fe7e5b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:36.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.631+0000 7fe7e5b2c800 20 rados->read ofs=0 len=0 2024-09-22T08:41:36.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.631+0000 7fe7e5b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:36.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.631+0000 7fe7e5b2c800 20 rados->read ofs=0 len=0 2024-09-22T08:41:36.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.632+0000 7fe7e5b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:36.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.632+0000 7fe7e5b2c800 20 started sync module instance, tier type = 2024-09-22T08:41:36.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.632+0000 7fe7e5b2c800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:41:36.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.640+0000 7fe7e5b2c800 20 add_watcher() i=0 2024-09-22T08:41:36.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.640+0000 7fe7e5b2c800 20 add_watcher() i=1 2024-09-22T08:41:36.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.640+0000 7fe7e5b2c800 20 add_watcher() i=2 2024-09-22T08:41:36.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.640+0000 7fe7e5b2c800 20 add_watcher() i=3 2024-09-22T08:41:36.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.640+0000 7fe7e5b2c800 20 add_watcher() i=4 2024-09-22T08:41:36.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.640+0000 7fe7e5b2c800 20 add_watcher() i=5 2024-09-22T08:41:36.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.640+0000 7fe7e5b2c800 20 add_watcher() i=6 2024-09-22T08:41:36.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.641+0000 7fe7e5b2c800 20 add_watcher() i=7 2024-09-22T08:41:36.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.641+0000 7fe7e5b2c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:41:36.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.643+0000 7fe6937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:36.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.644+0000 7fe7e5b2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:41:36.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.644+0000 7fe7e5b2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:41:36.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.681+0000 7fe6927fc640 20 reqs_thread_entry: start 2024-09-22T08:41:36.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.681+0000 7fe7e5b2c800 20 init_complete bucket index max shards: 11 2024-09-22T08:41:36.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.682+0000 7fe7e5b2c800 20 Filter name: none 2024-09-22T08:41:36.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.682+0000 7fe607fff640 20 reqs_thread_entry: start 2024-09-22T08:41:36.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.682+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-22T08:41:36.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.683+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.684+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.684+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.686+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-22T08:41:36.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.687+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.687+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.688+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.689+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-22T08:41:36.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.690+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.691+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.691+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.692+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-22T08:41:36.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.693+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.694+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.694+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.695+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-22T08:41:36.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.696+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.696+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.697+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.698+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-22T08:41:36.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.699+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.699+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.700+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.701+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-22T08:41:36.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.702+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.703+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.703+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.704+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-22T08:41:36.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.705+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.706+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.706+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.707+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-22T08:41:36.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.709+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.709+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.709+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.711+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-22T08:41:36.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.713+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.713+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.714+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.715+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-22T08:41:36.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.716+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.716+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.717+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.718+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-22T08:41:36.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.719+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.719+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.720+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.721+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-22T08:41:36.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.723+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.723+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.723+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.724+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-22T08:41:36.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.726+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.726+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.727+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.727+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-22T08:41:36.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.729+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.729+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.730+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.731+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-22T08:41:36.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.732+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.732+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.733+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.734+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-22T08:41:36.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.735+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.735+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.736+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.737+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-22T08:41:36.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.738+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.738+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.739+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.740+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-22T08:41:36.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.741+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.741+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.742+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.743+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-22T08:41:36.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.744+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.744+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.745+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.745+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-22T08:41:36.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.747+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.747+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.748+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.749+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-22T08:41:36.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.750+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.751+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.751+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.752+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-22T08:41:36.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.753+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.754+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.754+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.755+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-22T08:41:36.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.756+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.756+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.757+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.758+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-22T08:41:36.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.760+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.760+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.760+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.762+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-22T08:41:36.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.763+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.764+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.764+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.766+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-22T08:41:36.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.767+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.768+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.768+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.769+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-22T08:41:36.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.770+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.771+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.771+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.772+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-22T08:41:36.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.773+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.774+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.774+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.775+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-22T08:41:36.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.776+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.776+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.777+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.778+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-22T08:41:36.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.779+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.780+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.780+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.781+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-22T08:41:36.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.783+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.784+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:36.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.784+0000 7fe7e5b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:36.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.786+0000 7fe6937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:36.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.788+0000 7fe7e5b2c800 20 remove_watcher() i=0 2024-09-22T08:41:36.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.788+0000 7fe7e5b2c800 2 removed watcher, disabling cache 2024-09-22T08:41:36.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.789+0000 7fe7e5b2c800 20 remove_watcher() i=1 2024-09-22T08:41:36.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.790+0000 7fe7e5b2c800 20 remove_watcher() i=2 2024-09-22T08:41:36.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.791+0000 7fe7e5b2c800 20 remove_watcher() i=3 2024-09-22T08:41:36.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.792+0000 7fe7e5b2c800 20 remove_watcher() i=4 2024-09-22T08:41:36.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.793+0000 7fe7e5b2c800 20 remove_watcher() i=5 2024-09-22T08:41:36.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.794+0000 7fe7e5b2c800 20 remove_watcher() i=6 2024-09-22T08:41:36.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.795+0000 7fe7e5b2c800 20 remove_watcher() i=7 2024-09-22T08:41:36.808 DEBUG:teuthology.orchestra.run.smithi038:> radosgw-admin gc process --include-all 2024-09-22T08:41:36.861 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:41:36.861 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:41:36.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.899+0000 7f41e3e14800 20 rados->read ofs=0 len=0 2024-09-22T08:41:36.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.901+0000 7f41e3e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:36.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.901+0000 7f41e3e14800 20 realm 2024-09-22T08:41:36.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.901+0000 7f41e3e14800 20 rados->read ofs=0 len=0 2024-09-22T08:41:36.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.901+0000 7f41e3e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:36.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.901+0000 7f41e3e14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:41:36.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.901+0000 7f41e3e14800 20 rados->read ofs=0 len=0 2024-09-22T08:41:36.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.901+0000 7f41e3e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:36.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.901+0000 7f41e3e14800 20 rados->read ofs=0 len=0 2024-09-22T08:41:36.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.902+0000 7f41e3e14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:36.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.902+0000 7f41e3e14800 20 rados->read ofs=0 len=0 2024-09-22T08:41:36.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.902+0000 7f41e3e14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:41:36.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.902+0000 7f41e3e14800 20 searching for the correct realm 2024-09-22T08:41:36.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:36.904+0000 7f41deddf640 0 -- 172.21.15.38:0/677887948 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f41d403d060 msgr2=0x7f41d4087400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:37.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.109+0000 7f41deddf640 0 -- 172.21.15.38:0/677887948 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f41d006a610 msgr2=0x7f41d00831c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:37.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.317+0000 7f41e3e14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:41:37.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.317+0000 7f41e3e14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:41:37.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.317+0000 7f41e3e14800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:41:37.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.317+0000 7f41e3e14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:41:37.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.317+0000 7f41e3e14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:41:37.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.317+0000 7f41e3e14800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:41:37.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.317+0000 7f41e3e14800 20 rados->read ofs=0 len=0 2024-09-22T08:41:37.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.317+0000 7f41e3e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:37.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.317+0000 7f41e3e14800 20 rados->read ofs=0 len=0 2024-09-22T08:41:37.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.318+0000 7f41e3e14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:37.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.318+0000 7f41e3e14800 20 rados->read ofs=0 len=0 2024-09-22T08:41:37.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.318+0000 7f41e3e14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:41:37.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.318+0000 7f41e3e14800 20 zone default found 2024-09-22T08:41:37.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.318+0000 7f41e3e14800 4 Realm: () 2024-09-22T08:41:37.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.318+0000 7f41e3e14800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:41:37.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.318+0000 7f41e3e14800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:41:37.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.318+0000 7f41e3e14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:41:37.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.318+0000 7f41e3e14800 20 zonegroup default 2024-09-22T08:41:37.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.318+0000 7f41e3e14800 20 rados->read ofs=0 len=0 2024-09-22T08:41:37.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.318+0000 7f41e3e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:37.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.319+0000 7f41e3e14800 20 rados->read ofs=0 len=0 2024-09-22T08:41:37.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.319+0000 7f41e3e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:37.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.319+0000 7f41e3e14800 20 rados->read ofs=0 len=0 2024-09-22T08:41:37.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.319+0000 7f41e3e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:37.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.319+0000 7f41e3e14800 20 started sync module instance, tier type = 2024-09-22T08:41:37.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.319+0000 7f41e3e14800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:41:37.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.329+0000 7f41e3e14800 20 add_watcher() i=0 2024-09-22T08:41:37.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.329+0000 7f41e3e14800 20 add_watcher() i=1 2024-09-22T08:41:37.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.329+0000 7f41e3e14800 20 add_watcher() i=2 2024-09-22T08:41:37.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.329+0000 7f41e3e14800 20 add_watcher() i=3 2024-09-22T08:41:37.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.329+0000 7f41e3e14800 20 add_watcher() i=4 2024-09-22T08:41:37.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.329+0000 7f41e3e14800 20 add_watcher() i=5 2024-09-22T08:41:37.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.329+0000 7f41e3e14800 20 add_watcher() i=6 2024-09-22T08:41:37.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.330+0000 7f41e3e14800 20 add_watcher() i=7 2024-09-22T08:41:37.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.330+0000 7f41e3e14800 2 all 8 watchers are set, enabling cache 2024-09-22T08:41:37.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.332+0000 7f4095fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:37.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.332+0000 7f41e3e14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:41:37.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.332+0000 7f41e3e14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:41:37.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.371+0000 7f4094fe1640 20 reqs_thread_entry: start 2024-09-22T08:41:37.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.371+0000 7f41e3e14800 20 init_complete bucket index max shards: 11 2024-09-22T08:41:37.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.371+0000 7f41e3e14800 20 Filter name: none 2024-09-22T08:41:37.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.371+0000 7f400e7fc640 20 reqs_thread_entry: start 2024-09-22T08:41:37.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.371+0000 7f41e3e14800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-22T08:41:37.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.372+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.373+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:37.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.373+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.374+0000 7f41e3e14800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-22T08:41:37.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.375+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.376+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:37.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.376+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.378+0000 7f41e3e14800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-22T08:41:37.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.379+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.380+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:37.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.380+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.381+0000 7f41e3e14800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-22T08:41:37.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.383+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.383+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:37.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.384+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.385+0000 7f41e3e14800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-22T08:41:37.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.386+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.387+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:37.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.387+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.388+0000 7f41e3e14800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-22T08:41:37.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.390+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.390+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:37.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.390+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.391+0000 7f41e3e14800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-22T08:41:37.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.393+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.393+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:37.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.394+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.395+0000 7f41e3e14800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-22T08:41:37.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.396+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.397+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:37.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.397+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.398+0000 7f41e3e14800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-22T08:41:37.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.399+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.400+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:37.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.400+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.401+0000 7f41e3e14800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-22T08:41:37.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.402+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.403+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:37.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.403+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.404+0000 7f41e3e14800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-22T08:41:37.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.406+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.406+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:37.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.407+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.407+0000 7f41e3e14800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-22T08:41:37.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.409+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.410+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:37.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.410+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.411+0000 7f41e3e14800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-22T08:41:37.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.413+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.413+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:37.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.413+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.414+0000 7f41e3e14800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-22T08:41:37.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.416+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.416+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:37.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.417+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.419+0000 7f41e3e14800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-22T08:41:37.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.420+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.420+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:37.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.421+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.422+0000 7f41e3e14800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-22T08:41:37.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.423+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.423+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:37.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.424+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.425+0000 7f41e3e14800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-22T08:41:37.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.426+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.427+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:37.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.427+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.428+0000 7f41e3e14800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-22T08:41:37.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.430+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.430+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:37.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.431+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.432+0000 7f41e3e14800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-22T08:41:37.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.433+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.434+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:37.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.434+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.435+0000 7f41e3e14800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-22T08:41:37.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.437+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.437+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:37.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.437+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.438+0000 7f41e3e14800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-22T08:41:37.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.440+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.440+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:37.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.440+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.441+0000 7f41e3e14800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-22T08:41:37.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.443+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.443+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:37.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.444+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.445+0000 7f41e3e14800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-22T08:41:37.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.446+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.446+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:37.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.447+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.448+0000 7f41e3e14800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-22T08:41:37.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.449+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.450+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:37.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.450+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.451+0000 7f41e3e14800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-22T08:41:37.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.452+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.453+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:37.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.453+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.454+0000 7f41e3e14800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-22T08:41:37.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.456+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.456+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:37.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.456+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.458+0000 7f41e3e14800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-22T08:41:37.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.459+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.460+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:37.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.460+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.461+0000 7f41e3e14800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-22T08:41:37.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.463+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.463+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:37.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.463+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.464+0000 7f41e3e14800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-22T08:41:37.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.466+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.466+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:37.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.466+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.467+0000 7f41e3e14800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-22T08:41:37.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.469+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.469+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:37.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.469+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.471+0000 7f41e3e14800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-22T08:41:37.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.472+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.472+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:37.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.473+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.474+0000 7f41e3e14800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-22T08:41:37.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.475+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.475+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:37.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.476+0000 7f41e3e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:37.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.478+0000 7f4095fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:37.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.480+0000 7f41e3e14800 20 remove_watcher() i=0 2024-09-22T08:41:37.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.480+0000 7f41e3e14800 2 removed watcher, disabling cache 2024-09-22T08:41:37.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.481+0000 7f41e3e14800 20 remove_watcher() i=1 2024-09-22T08:41:37.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.482+0000 7f41e3e14800 20 remove_watcher() i=2 2024-09-22T08:41:37.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.483+0000 7f41e3e14800 20 remove_watcher() i=3 2024-09-22T08:41:37.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.484+0000 7f41e3e14800 20 remove_watcher() i=4 2024-09-22T08:41:37.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.485+0000 7f41e3e14800 20 remove_watcher() i=5 2024-09-22T08:41:37.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.486+0000 7f41e3e14800 20 remove_watcher() i=6 2024-09-22T08:41:37.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.487+0000 7f41e3e14800 20 remove_watcher() i=7 2024-09-22T08:41:37.499 DEBUG:teuthology.orchestra.run.smithi038:> radosgw-admin gc process --include-all 2024-09-22T08:41:37.551 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:41:37.552 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:41:37.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.590+0000 7fe8280bb800 20 rados->read ofs=0 len=0 2024-09-22T08:41:37.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.592+0000 7fe8280bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:37.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.592+0000 7fe8280bb800 20 realm 2024-09-22T08:41:37.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.592+0000 7fe8280bb800 20 rados->read ofs=0 len=0 2024-09-22T08:41:37.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.592+0000 7fe8280bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:37.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.592+0000 7fe8280bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:41:37.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.592+0000 7fe8280bb800 20 rados->read ofs=0 len=0 2024-09-22T08:41:37.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.592+0000 7fe8280bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:37.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.592+0000 7fe8280bb800 20 rados->read ofs=0 len=0 2024-09-22T08:41:37.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.593+0000 7fe8280bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:37.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.593+0000 7fe8280bb800 20 rados->read ofs=0 len=0 2024-09-22T08:41:37.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.594+0000 7fe8280bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:41:37.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.594+0000 7fe8280bb800 20 searching for the correct realm 2024-09-22T08:41:37.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.596+0000 7fe8253a4640 0 -- 172.21.15.38:0/4108967054 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7fe81c013030 msgr2=0x7fe81c0689a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:37.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:37.802+0000 7fe8253a4640 0 -- 172.21.15.38:0/4108967054 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fe81803f970 msgr2=0x7fe81803c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:41:38.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.010+0000 7fe8280bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:41:38.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.010+0000 7fe8280bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:41:38.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.010+0000 7fe8280bb800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:41:38.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.010+0000 7fe8280bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:41:38.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.010+0000 7fe8280bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:41:38.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.010+0000 7fe8280bb800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:41:38.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.010+0000 7fe8280bb800 20 rados->read ofs=0 len=0 2024-09-22T08:41:38.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.010+0000 7fe8280bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:38.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.010+0000 7fe8280bb800 20 rados->read ofs=0 len=0 2024-09-22T08:41:38.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.011+0000 7fe8280bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:38.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.011+0000 7fe8280bb800 20 rados->read ofs=0 len=0 2024-09-22T08:41:38.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.011+0000 7fe8280bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:41:38.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.011+0000 7fe8280bb800 20 zone default found 2024-09-22T08:41:38.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.011+0000 7fe8280bb800 4 Realm: () 2024-09-22T08:41:38.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.011+0000 7fe8280bb800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:41:38.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.011+0000 7fe8280bb800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:41:38.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.011+0000 7fe8280bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:41:38.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.011+0000 7fe8280bb800 20 zonegroup default 2024-09-22T08:41:38.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.011+0000 7fe8280bb800 20 rados->read ofs=0 len=0 2024-09-22T08:41:38.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.011+0000 7fe8280bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:38.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.012+0000 7fe8280bb800 20 rados->read ofs=0 len=0 2024-09-22T08:41:38.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.012+0000 7fe8280bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:38.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.012+0000 7fe8280bb800 20 rados->read ofs=0 len=0 2024-09-22T08:41:38.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.012+0000 7fe8280bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:38.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.012+0000 7fe8280bb800 20 started sync module instance, tier type = 2024-09-22T08:41:38.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.012+0000 7fe8280bb800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:41:38.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.022+0000 7fe8280bb800 20 add_watcher() i=0 2024-09-22T08:41:38.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.022+0000 7fe8280bb800 20 add_watcher() i=1 2024-09-22T08:41:38.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.022+0000 7fe8280bb800 20 add_watcher() i=2 2024-09-22T08:41:38.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.022+0000 7fe8280bb800 20 add_watcher() i=3 2024-09-22T08:41:38.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.022+0000 7fe8280bb800 20 add_watcher() i=4 2024-09-22T08:41:38.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.022+0000 7fe8280bb800 20 add_watcher() i=5 2024-09-22T08:41:38.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.022+0000 7fe8280bb800 20 add_watcher() i=6 2024-09-22T08:41:38.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.024+0000 7fe8280bb800 20 add_watcher() i=7 2024-09-22T08:41:38.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.024+0000 7fe8280bb800 2 all 8 watchers are set, enabling cache 2024-09-22T08:41:38.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.026+0000 7fe6dbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:38.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.026+0000 7fe8280bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:41:38.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.026+0000 7fe8280bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:41:38.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.067+0000 7fe6dafe5640 20 reqs_thread_entry: start 2024-09-22T08:41:38.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.067+0000 7fe8280bb800 20 init_complete bucket index max shards: 11 2024-09-22T08:41:38.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.067+0000 7fe8280bb800 20 Filter name: none 2024-09-22T08:41:38.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.067+0000 7fe6d8fe1640 20 reqs_thread_entry: start 2024-09-22T08:41:38.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.067+0000 7fe8280bb800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-22T08:41:38.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.069+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.069+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:38.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.070+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.071+0000 7fe8280bb800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-22T08:41:38.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.072+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.073+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:38.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.073+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.075+0000 7fe8280bb800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-22T08:41:38.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.076+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.077+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:38.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.077+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.078+0000 7fe8280bb800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-22T08:41:38.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.080+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.080+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:38.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.081+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.082+0000 7fe8280bb800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-22T08:41:38.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.083+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.083+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:38.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.084+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.085+0000 7fe8280bb800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-22T08:41:38.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.086+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.087+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:38.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.087+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.088+0000 7fe8280bb800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-22T08:41:38.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.089+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.090+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:38.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.090+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.091+0000 7fe8280bb800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-22T08:41:38.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.092+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.093+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:38.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.094+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.095+0000 7fe8280bb800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-22T08:41:38.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.096+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.096+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:38.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.097+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.098+0000 7fe8280bb800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-22T08:41:38.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.099+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.100+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:38.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.100+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.101+0000 7fe8280bb800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-22T08:41:38.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.103+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.103+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:38.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.103+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.105+0000 7fe8280bb800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-22T08:41:38.107 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.106+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.108 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.107+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:38.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.108+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.109+0000 7fe8280bb800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-22T08:41:38.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.110+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.111+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:38.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.112+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.113+0000 7fe8280bb800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-22T08:41:38.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.114+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.115+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:38.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.115+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.116+0000 7fe8280bb800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-22T08:41:38.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.117+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.118+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:38.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.118+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.119+0000 7fe8280bb800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-22T08:41:38.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.120+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.121+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:38.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.121+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.122+0000 7fe8280bb800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-22T08:41:38.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.123+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.124+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:38.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.124+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.125+0000 7fe8280bb800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-22T08:41:38.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.127+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.127+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:38.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.127+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.128+0000 7fe8280bb800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-22T08:41:38.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.130+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.130+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:38.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.131+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.132+0000 7fe8280bb800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-22T08:41:38.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.133+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.134+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:38.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.134+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.135+0000 7fe8280bb800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-22T08:41:38.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.137+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.137+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:38.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.138+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.139+0000 7fe8280bb800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-22T08:41:38.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.141+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.141+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:38.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.141+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.142+0000 7fe8280bb800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-22T08:41:38.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.144+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.144+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:38.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.144+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.145+0000 7fe8280bb800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-22T08:41:38.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.147+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.147+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:38.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.147+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.148+0000 7fe8280bb800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-22T08:41:38.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.150+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.150+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:38.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.150+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.151+0000 7fe8280bb800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-22T08:41:38.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.153+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.153+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:38.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.153+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.154+0000 7fe8280bb800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-22T08:41:38.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.155+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.156+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:38.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.156+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.157+0000 7fe8280bb800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-22T08:41:38.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.158+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.159+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:38.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.159+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.160+0000 7fe8280bb800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-22T08:41:38.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.162+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.162+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:38.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.162+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.163+0000 7fe8280bb800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-22T08:41:38.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.165+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.165+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:38.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.165+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.166+0000 7fe8280bb800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-22T08:41:38.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.168+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.169+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:38.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.169+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.170+0000 7fe8280bb800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-22T08:41:38.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.172+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.172+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:41:38.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.173+0000 7fe8280bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:41:38.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.174+0000 7fe6dbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:38.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.177+0000 7fe8280bb800 20 remove_watcher() i=0 2024-09-22T08:41:38.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.177+0000 7fe8280bb800 2 removed watcher, disabling cache 2024-09-22T08:41:38.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.178+0000 7fe8280bb800 20 remove_watcher() i=1 2024-09-22T08:41:38.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.179+0000 7fe8280bb800 20 remove_watcher() i=2 2024-09-22T08:41:38.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.180+0000 7fe8280bb800 20 remove_watcher() i=3 2024-09-22T08:41:38.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.181+0000 7fe8280bb800 20 remove_watcher() i=4 2024-09-22T08:41:38.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.182+0000 7fe8280bb800 20 remove_watcher() i=5 2024-09-22T08:41:38.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.183+0000 7fe8280bb800 20 remove_watcher() i=6 2024-09-22T08:41:38.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:41:38.184+0000 7fe8280bb800 20 remove_watcher() i=7 2024-09-22T08:41:38.197 DEBUG:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-22T08:41:38.812 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :clean 2024-09-22T08:41:39.510 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :compileJava 2024-09-22T08:41:39.511 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :processResources 2024-09-22T08:41:39.511 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :classes 2024-09-22T08:41:40.011 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:40.011 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :compileTestJava 2024-09-22T08:41:40.011 INFO:teuthology.orchestra.run.smithi038.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-22T08:41:40.012 INFO:teuthology.orchestra.run.smithi038.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-22T08:41:40.012 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:40.012 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :processTestResources NO-SOURCE 2024-09-22T08:41:40.013 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :testClasses 2024-09-22T08:41:42.011 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:42.011 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :test 2024-09-22T08:41:42.012 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:42.012 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests STANDARD_OUT 2024-09-22T08:41:42.012 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22 08:41:41,354 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-22T08:41:42.012 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:42.012 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-22T08:41:42.012 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:42.012 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-22T08:41:42.111 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:42.111 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-22T08:41:42.111 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:42.111 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-22T08:41:42.311 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:42.311 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-22T08:41:42.311 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:42.311 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-22T08:41:42.510 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:42.511 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-22T08:41:43.710 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:43.711 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-22T08:41:43.910 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:43.911 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-22T08:41:44.010 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:44.011 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-22T08:41:44.210 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:44.210 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-22T08:41:44.310 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:44.311 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-22T08:41:44.511 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:44.511 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-22T08:41:44.511 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:44.511 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-22T08:41:44.611 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:44.611 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-22T08:41:44.611 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:44.611 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-22T08:41:44.810 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:44.810 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-22T08:41:45.010 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:45.011 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-22T08:41:45.210 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:45.211 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-22T08:41:45.310 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:45.311 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-22T08:41:45.510 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:45.511 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-22T08:41:45.611 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:45.611 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-22T08:41:45.811 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:45.811 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-22T08:41:45.811 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:45.811 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-22T08:41:46.010 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:46.010 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-22T08:41:46.111 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:46.111 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-22T08:41:46.310 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:46.310 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-22T08:41:46.410 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:46.411 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-22T08:41:46.611 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:46.611 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-22T08:41:46.611 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:46.611 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-22T08:41:46.810 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:46.811 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-22T08:41:46.910 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:46.911 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-22T08:41:47.110 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:47.110 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-22T08:41:47.711 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:47.711 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-22T08:41:48.010 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:48.011 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-22T08:41:51.810 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:51.810 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-22T08:41:52.211 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:52.211 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-22T08:41:52.211 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:52.211 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-22T08:41:52.410 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:52.411 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-22T08:41:52.411 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:52.411 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-22T08:41:52.710 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:52.710 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-22T08:41:53.110 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:53.110 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-22T08:41:53.311 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:53.311 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-22T08:41:53.311 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:53.311 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-22T08:41:53.418 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:53.418 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-22T08:41:54.110 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:54.110 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-22T08:41:54.310 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:54.310 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-22T08:41:54.710 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:54.711 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-22T08:41:54.910 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:54.911 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-22T08:41:55.310 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:55.310 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-22T08:41:55.710 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:55.710 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-22T08:41:58.410 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:58.411 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-22T08:41:58.610 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:58.611 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-22T08:41:59.510 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:59.511 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-22T08:41:59.710 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:41:59.711 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-22T08:42:00.110 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:00.111 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-22T08:42:00.310 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:00.311 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-22T08:42:00.810 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:00.811 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-22T08:42:01.410 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:01.411 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-22T08:42:01.411 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:01.411 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-22T08:42:01.510 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:01.510 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-22T08:42:01.610 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:01.610 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-22T08:42:01.810 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:01.811 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-22T08:42:01.811 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:01.811 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-22T08:42:02.010 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:02.011 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-22T08:42:02.110 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:02.110 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-22T08:42:02.311 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:02.311 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-22T08:42:02.311 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:02.311 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-22T08:42:02.510 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:02.511 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-22T08:42:02.610 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:02.611 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-22T08:42:02.811 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:02.811 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-22T08:42:02.811 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:02.811 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-22T08:42:03.010 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:03.011 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-22T08:42:03.110 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:03.110 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-22T08:42:03.310 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:03.310 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-22T08:42:03.410 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:03.410 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-22T08:42:03.610 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:03.610 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-22T08:42:03.710 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:03.710 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-22T08:42:03.910 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:03.910 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-22T08:42:04.010 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:04.010 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-22T08:42:04.210 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:04.211 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-22T08:42:04.310 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:04.310 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-22T08:42:04.510 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:04.510 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-22T08:42:04.511 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:04.511 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-22T08:42:04.811 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:04.811 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-22T08:42:04.811 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:04.811 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-22T08:42:05.110 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:05.110 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-22T08:42:05.111 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:05.111 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-22T08:42:05.410 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:05.411 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-22T08:42:05.411 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:05.411 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-22T08:42:05.710 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:05.711 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-22T08:42:05.711 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:05.711 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-22T08:42:05.910 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:05.910 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-22T08:42:06.010 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:06.011 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-22T08:42:06.210 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:06.210 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-22T08:42:06.310 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:06.310 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-22T08:42:06.510 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:06.510 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-22T08:42:06.610 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:06.610 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-22T08:42:06.810 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:06.811 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-22T08:42:06.910 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:06.910 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-22T08:42:07.110 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:07.111 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-22T08:42:07.210 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:07.211 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-22T08:42:07.410 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:07.410 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-22T08:42:07.510 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:07.510 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-22T08:42:07.710 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:07.710 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-22T08:42:07.711 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:07.711 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-22T08:42:08.010 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:08.011 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-22T08:42:08.011 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:08.011 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-22T08:42:08.310 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:08.311 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-22T08:42:08.311 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:08.311 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-22T08:42:08.510 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:08.510 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-22T08:42:08.610 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:08.610 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-22T08:42:08.810 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:08.810 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-22T08:42:08.910 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:08.910 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-22T08:42:09.110 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:09.110 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-22T08:42:09.210 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:09.210 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-22T08:42:09.410 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:09.410 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-22T08:42:09.411 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:09.411 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-22T08:42:09.610 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:09.610 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-22T08:42:09.710 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:09.711 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-22T08:42:09.910 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:09.911 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-22T08:42:09.911 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:09.911 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-22T08:42:10.110 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:10.110 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-22T08:42:10.211 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:10.211 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-22T08:42:10.410 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:10.411 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-22T08:42:10.510 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:10.510 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-22T08:42:10.710 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:10.711 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-22T08:42:10.810 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:10.810 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-22T08:42:10.910 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:10.911 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-22T08:42:10.911 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:10.911 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-22T08:42:11.110 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:11.110 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-22T08:42:11.210 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:11.211 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-22T08:42:11.410 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:11.410 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-22T08:42:11.510 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:11.510 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-22T08:42:11.710 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:11.711 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-22T08:42:11.711 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:11.711 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-22T08:42:11.910 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:11.910 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-22T08:42:12.210 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:12.211 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-22T08:42:12.410 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:12.410 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-22T08:42:12.810 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:12.810 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-22T08:42:12.991 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:12.991 INFO:teuthology.orchestra.run.smithi038.stdout:---------------------------------------------------------------------- 2024-09-22T08:42:12.992 INFO:teuthology.orchestra.run.smithi038.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-22T08:42:12.992 INFO:teuthology.orchestra.run.smithi038.stdout:---------------------------------------------------------------------- 2024-09-22T08:42:12.992 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:12.992 INFO:teuthology.orchestra.run.smithi038.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-22T08:42:12.992 INFO:teuthology.orchestra.run.smithi038.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-22T08:42:12.992 INFO:teuthology.orchestra.run.smithi038.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-22T08:42:12.992 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:12.992 INFO:teuthology.orchestra.run.smithi038.stdout:BUILD SUCCESSFUL in 34s 2024-09-22T08:42:12.992 INFO:teuthology.orchestra.run.smithi038.stdout:5 actionable tasks: 5 executed 2024-09-22T08:42:13.006 DEBUG:teuthology.orchestra.run.smithi038:> radosgw-admin gc process --include-all 2024-09-22T08:42:13.060 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:13.060 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:13.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.099+0000 7fb8c6932800 20 rados->read ofs=0 len=0 2024-09-22T08:42:13.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.101+0000 7fb8c6932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:13.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.101+0000 7fb8c6932800 20 realm 2024-09-22T08:42:13.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.101+0000 7fb8c6932800 20 rados->read ofs=0 len=0 2024-09-22T08:42:13.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.101+0000 7fb8c6932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:13.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.101+0000 7fb8c6932800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:13.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.101+0000 7fb8c6932800 20 rados->read ofs=0 len=0 2024-09-22T08:42:13.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.101+0000 7fb8c6932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:13.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.101+0000 7fb8c6932800 20 rados->read ofs=0 len=0 2024-09-22T08:42:13.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.102+0000 7fb8c6932800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:13.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.102+0000 7fb8c6932800 20 rados->read ofs=0 len=0 2024-09-22T08:42:13.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.103+0000 7fb8c6932800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:13.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.103+0000 7fb8c6932800 20 searching for the correct realm 2024-09-22T08:42:13.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.105+0000 7fb8c25bc640 0 -- 172.21.15.38:0/2982759412 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x558a0a21b5f0 msgr2=0x558a0a21dab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:13.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.108+0000 7fb8c1dbb640 0 -- 172.21.15.38:0/2982759412 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fb8b4069bc0 msgr2=0x7fb8b406acc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:13.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.315+0000 7fb8c6932800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:13.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.315+0000 7fb8c6932800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:13.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.315+0000 7fb8c6932800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:42:13.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.315+0000 7fb8c6932800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:13.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.315+0000 7fb8c6932800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:13.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.315+0000 7fb8c6932800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:42:13.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.315+0000 7fb8c6932800 20 rados->read ofs=0 len=0 2024-09-22T08:42:13.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.316+0000 7fb8c6932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:13.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.316+0000 7fb8c6932800 20 rados->read ofs=0 len=0 2024-09-22T08:42:13.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.316+0000 7fb8c6932800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:13.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.316+0000 7fb8c6932800 20 rados->read ofs=0 len=0 2024-09-22T08:42:13.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.316+0000 7fb8c6932800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:13.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.316+0000 7fb8c6932800 20 zone default found 2024-09-22T08:42:13.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.316+0000 7fb8c6932800 4 Realm: () 2024-09-22T08:42:13.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.316+0000 7fb8c6932800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:42:13.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.316+0000 7fb8c6932800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:42:13.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.316+0000 7fb8c6932800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:13.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.316+0000 7fb8c6932800 20 zonegroup default 2024-09-22T08:42:13.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.316+0000 7fb8c6932800 20 rados->read ofs=0 len=0 2024-09-22T08:42:13.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.317+0000 7fb8c6932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:13.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.317+0000 7fb8c6932800 20 rados->read ofs=0 len=0 2024-09-22T08:42:13.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.317+0000 7fb8c6932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:13.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.317+0000 7fb8c6932800 20 rados->read ofs=0 len=0 2024-09-22T08:42:13.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.317+0000 7fb8c6932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:13.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.317+0000 7fb8c6932800 20 started sync module instance, tier type = 2024-09-22T08:42:13.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.318+0000 7fb8c6932800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:42:13.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.327+0000 7fb8c6932800 20 add_watcher() i=0 2024-09-22T08:42:13.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.327+0000 7fb8c6932800 20 add_watcher() i=1 2024-09-22T08:42:13.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.327+0000 7fb8c6932800 20 add_watcher() i=2 2024-09-22T08:42:13.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.327+0000 7fb8c6932800 20 add_watcher() i=3 2024-09-22T08:42:13.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.327+0000 7fb8c6932800 20 add_watcher() i=4 2024-09-22T08:42:13.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.327+0000 7fb8c6932800 20 add_watcher() i=5 2024-09-22T08:42:13.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.327+0000 7fb8c6932800 20 add_watcher() i=6 2024-09-22T08:42:13.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.328+0000 7fb8c6932800 20 add_watcher() i=7 2024-09-22T08:42:13.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.328+0000 7fb8c6932800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:13.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.330+0000 7fb7797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:13.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.330+0000 7fb8c6932800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:13.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.330+0000 7fb8c6932800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:13.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.368+0000 7fb7737fe640 20 reqs_thread_entry: start 2024-09-22T08:42:13.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.368+0000 7fb8c6932800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:13.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.368+0000 7fb8c6932800 20 Filter name: none 2024-09-22T08:42:13.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.368+0000 7fb7717fa640 20 reqs_thread_entry: start 2024-09-22T08:42:13.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.368+0000 7fb8c6932800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-22T08:42:13.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.370+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.370+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:13.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.371+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:42:13.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.371+0000 7fb8c6932800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.4472988400276671773', time=2024-09-22T10:42:12.819121+0000, chain.objs.size()=9 2024-09-22T08:42:13.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.371+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.144__multipart_key1/data/file.mpg.2~kxy997I6-5irnVGW-JMDeGy6iloJuEG.1 2024-09-22T08:42:13.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.371+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.144__shadow_key1/data/file.mpg.2~kxy997I6-5irnVGW-JMDeGy6iloJuEG.1_1 2024-09-22T08:42:13.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.371+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.144__multipart_key1/data/file.mpg.2~kxy997I6-5irnVGW-JMDeGy6iloJuEG.2 2024-09-22T08:42:13.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.371+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.144__shadow_key1/data/file.mpg.2~kxy997I6-5irnVGW-JMDeGy6iloJuEG.2_1 2024-09-22T08:42:13.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.371+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.144__multipart_key1/data/file.mpg.2~kxy997I6-5irnVGW-JMDeGy6iloJuEG.3 2024-09-22T08:42:13.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.371+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.144__shadow_key1/data/file.mpg.2~kxy997I6-5irnVGW-JMDeGy6iloJuEG.3_1 2024-09-22T08:42:13.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.371+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.144__multipart_key1/data/file.mpg.2~kxy997I6-5irnVGW-JMDeGy6iloJuEG.4 2024-09-22T08:42:13.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.371+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.144__shadow_key1/data/file.mpg.2~kxy997I6-5irnVGW-JMDeGy6iloJuEG.4_1 2024-09-22T08:42:13.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.371+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.144__multipart_key1/data/file.mpg.2~kxy997I6-5irnVGW-JMDeGy6iloJuEG.5 2024-09-22T08:42:13.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.374+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:42:13.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.376+0000 7fb8c6932800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-22T08:42:13.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.378+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.379+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:13.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.379+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-22T08:42:13.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.379+0000 7fb8c6932800 20 garbage collection: RGWGC::process iterating over entry tag='2~8YfUiOxdpATPiB0s8Bh6m8zq0qhgfi6', time=2024-09-22T10:41:43.652526+0000, chain.objs.size()=9 2024-09-22T08:42:13.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.379+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.79__multipart_key1.2~8YfUiOxdpATPiB0s8Bh6m8zq0qhgfi6.1 2024-09-22T08:42:13.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.379+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.79__shadow_key1.2~8YfUiOxdpATPiB0s8Bh6m8zq0qhgfi6.1_1 2024-09-22T08:42:13.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.379+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.79__multipart_key1.2~8YfUiOxdpATPiB0s8Bh6m8zq0qhgfi6.2 2024-09-22T08:42:13.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.379+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.79__shadow_key1.2~8YfUiOxdpATPiB0s8Bh6m8zq0qhgfi6.2_1 2024-09-22T08:42:13.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.379+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.79__multipart_key1.2~8YfUiOxdpATPiB0s8Bh6m8zq0qhgfi6.3 2024-09-22T08:42:13.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.379+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.79__shadow_key1.2~8YfUiOxdpATPiB0s8Bh6m8zq0qhgfi6.3_1 2024-09-22T08:42:13.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.379+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.79__multipart_key1.2~8YfUiOxdpATPiB0s8Bh6m8zq0qhgfi6.4 2024-09-22T08:42:13.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.379+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.79__shadow_key1.2~8YfUiOxdpATPiB0s8Bh6m8zq0qhgfi6.4_1 2024-09-22T08:42:13.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.379+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.79__multipart_key1.2~8YfUiOxdpATPiB0s8Bh6m8zq0qhgfi6.5 2024-09-22T08:42:13.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.379+0000 7fb8c6932800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.1263822042786710918', time=2024-09-22T10:41:47.762873+0000, chain.objs.size()=9 2024-09-22T08:42:13.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.379+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.91__multipart_key1.2~LfYFJ7hH89k8djSWvd5L1zRo0JWa8Un.1 2024-09-22T08:42:13.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.379+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.91__shadow_key1.2~LfYFJ7hH89k8djSWvd5L1zRo0JWa8Un.1_1 2024-09-22T08:42:13.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.379+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.91__multipart_key1.2~LfYFJ7hH89k8djSWvd5L1zRo0JWa8Un.2 2024-09-22T08:42:13.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.382+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.91__shadow_key1.2~LfYFJ7hH89k8djSWvd5L1zRo0JWa8Un.2_1 2024-09-22T08:42:13.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.382+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.91__multipart_key1.2~LfYFJ7hH89k8djSWvd5L1zRo0JWa8Un.3 2024-09-22T08:42:13.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.382+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.91__shadow_key1.2~LfYFJ7hH89k8djSWvd5L1zRo0JWa8Un.3_1 2024-09-22T08:42:13.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.383+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.91__multipart_key1.2~LfYFJ7hH89k8djSWvd5L1zRo0JWa8Un.4 2024-09-22T08:42:13.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.383+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.91__shadow_key1.2~LfYFJ7hH89k8djSWvd5L1zRo0JWa8Un.4_1 2024-09-22T08:42:13.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.384+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.91__multipart_key1.2~LfYFJ7hH89k8djSWvd5L1zRo0JWa8Un.5 2024-09-22T08:42:13.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.384+0000 7fb8c6932800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.8153069972309215388', time=2024-09-22T10:41:51.996873+0000, chain.objs.size()=7 2024-09-22T08:42:13.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.384+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__multipart_key1.2~EoZKb5-wKjERA3HCSrRoM3d1I0_GHhb.1 2024-09-22T08:42:13.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.384+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__shadow_key1.2~EoZKb5-wKjERA3HCSrRoM3d1I0_GHhb.1_1 2024-09-22T08:42:13.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.384+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__shadow_key1.2~EoZKb5-wKjERA3HCSrRoM3d1I0_GHhb.1_2 2024-09-22T08:42:13.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.384+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__multipart_key1.2~EoZKb5-wKjERA3HCSrRoM3d1I0_GHhb.2 2024-09-22T08:42:13.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.384+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__shadow_key1.2~EoZKb5-wKjERA3HCSrRoM3d1I0_GHhb.2_1 2024-09-22T08:42:13.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.384+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__shadow_key1.2~EoZKb5-wKjERA3HCSrRoM3d1I0_GHhb.2_2 2024-09-22T08:42:13.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.384+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__multipart_key1.2~EoZKb5-wKjERA3HCSrRoM3d1I0_GHhb.3 2024-09-22T08:42:13.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.388+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:42:13.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.390+0000 7fb8c6932800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-22T08:42:13.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.391+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.392+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:13.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.392+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.393+0000 7fb8c6932800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-22T08:42:13.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.394+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.395+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:13.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.395+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.396+0000 7fb8c6932800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-22T08:42:13.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.397+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.398+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:13.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.398+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.399+0000 7fb8c6932800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-22T08:42:13.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.400+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.401+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:13.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.402+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.403+0000 7fb8c6932800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-22T08:42:13.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.405+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.405+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:13.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.406+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.407+0000 7fb8c6932800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-22T08:42:13.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.408+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.409+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:13.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.409+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:42:13.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.409+0000 7fb8c6932800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.1545294791886135335', time=2024-09-22T10:42:12.275510+0000, chain.objs.size()=9 2024-09-22T08:42:13.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.409+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.143__multipart_key1.2~8GP3xQrfbi8vbcnAnnM4kt4zJfwFSdF.1 2024-09-22T08:42:13.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.409+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.143__shadow_key1.2~8GP3xQrfbi8vbcnAnnM4kt4zJfwFSdF.1_1 2024-09-22T08:42:13.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.409+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.143__multipart_key1.2~8GP3xQrfbi8vbcnAnnM4kt4zJfwFSdF.2 2024-09-22T08:42:13.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.409+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.143__shadow_key1.2~8GP3xQrfbi8vbcnAnnM4kt4zJfwFSdF.2_1 2024-09-22T08:42:13.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.409+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.143__multipart_key1.2~8GP3xQrfbi8vbcnAnnM4kt4zJfwFSdF.3 2024-09-22T08:42:13.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.409+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.143__shadow_key1.2~8GP3xQrfbi8vbcnAnnM4kt4zJfwFSdF.3_1 2024-09-22T08:42:13.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.409+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.143__multipart_key1.2~8GP3xQrfbi8vbcnAnnM4kt4zJfwFSdF.4 2024-09-22T08:42:13.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.409+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.143__shadow_key1.2~8GP3xQrfbi8vbcnAnnM4kt4zJfwFSdF.4_1 2024-09-22T08:42:13.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.409+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.143__multipart_key1.2~8GP3xQrfbi8vbcnAnnM4kt4zJfwFSdF.5 2024-09-22T08:42:13.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.413+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:42:13.416 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.415+0000 7fb8c6932800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-22T08:42:13.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.417+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.417+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:13.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.417+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T08:42:13.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.417+0000 7fb8c6932800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.10392353712184919778', time=2024-09-22T10:41:51.875633+0000, chain.objs.size()=5 2024-09-22T08:42:13.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.417+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.93__shadow_.lX5S_0hO6_Tshx9ZHtTnPVtAf6TUAQ9_1 2024-09-22T08:42:13.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.417+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.93__shadow_.lX5S_0hO6_Tshx9ZHtTnPVtAf6TUAQ9_2 2024-09-22T08:42:13.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.417+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.93__shadow_.lX5S_0hO6_Tshx9ZHtTnPVtAf6TUAQ9_3 2024-09-22T08:42:13.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.417+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.93__shadow_.lX5S_0hO6_Tshx9ZHtTnPVtAf6TUAQ9_4 2024-09-22T08:42:13.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.417+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.93__shadow_.lX5S_0hO6_Tshx9ZHtTnPVtAf6TUAQ9_5 2024-09-22T08:42:13.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.417+0000 7fb8c6932800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.11154664165163093963', time=2024-09-22T10:41:54.712073+0000, chain.objs.size()=9 2024-09-22T08:42:13.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.418+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.100__multipart_file2.mpg.2~ZxLgGBkvtb_IL1PxPO2sKTo3eYAPPlP.1 2024-09-22T08:42:13.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.418+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.100__shadow_file2.mpg.2~ZxLgGBkvtb_IL1PxPO2sKTo3eYAPPlP.1_1 2024-09-22T08:42:13.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.418+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.100__multipart_file2.mpg.2~ZxLgGBkvtb_IL1PxPO2sKTo3eYAPPlP.2 2024-09-22T08:42:13.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.418+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.100__shadow_file2.mpg.2~ZxLgGBkvtb_IL1PxPO2sKTo3eYAPPlP.2_1 2024-09-22T08:42:13.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.418+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.100__multipart_file2.mpg.2~ZxLgGBkvtb_IL1PxPO2sKTo3eYAPPlP.3 2024-09-22T08:42:13.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.418+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.100__shadow_file2.mpg.2~ZxLgGBkvtb_IL1PxPO2sKTo3eYAPPlP.3_1 2024-09-22T08:42:13.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.418+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.100__multipart_file2.mpg.2~ZxLgGBkvtb_IL1PxPO2sKTo3eYAPPlP.4 2024-09-22T08:42:13.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.421+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.100__shadow_file2.mpg.2~ZxLgGBkvtb_IL1PxPO2sKTo3eYAPPlP.4_1 2024-09-22T08:42:13.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.421+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.100__multipart_file2.mpg.2~ZxLgGBkvtb_IL1PxPO2sKTo3eYAPPlP.5 2024-09-22T08:42:13.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.423+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:42:13.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.426+0000 7fb8c6932800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-22T08:42:13.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.427+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.428+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:13.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.428+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T08:42:13.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.428+0000 7fb8c6932800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.4291418802492226438', time=2024-09-22T10:41:56.437212+0000, chain.objs.size()=9 2024-09-22T08:42:13.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.428+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__multipart_key1.2~Mu4UJIlEZUA5vWVX-oOTqQqRF_OrpE6.1 2024-09-22T08:42:13.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.428+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__shadow_key1.2~Mu4UJIlEZUA5vWVX-oOTqQqRF_OrpE6.1_1 2024-09-22T08:42:13.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.428+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__multipart_key1.2~Mu4UJIlEZUA5vWVX-oOTqQqRF_OrpE6.2 2024-09-22T08:42:13.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.428+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__shadow_key1.2~Mu4UJIlEZUA5vWVX-oOTqQqRF_OrpE6.2_1 2024-09-22T08:42:13.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.428+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__multipart_key1.2~Mu4UJIlEZUA5vWVX-oOTqQqRF_OrpE6.3 2024-09-22T08:42:13.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.428+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__shadow_key1.2~Mu4UJIlEZUA5vWVX-oOTqQqRF_OrpE6.3_1 2024-09-22T08:42:13.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.428+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__multipart_key1.2~Mu4UJIlEZUA5vWVX-oOTqQqRF_OrpE6.4 2024-09-22T08:42:13.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.428+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__shadow_key1.2~Mu4UJIlEZUA5vWVX-oOTqQqRF_OrpE6.4_1 2024-09-22T08:42:13.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.428+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__multipart_key1.2~Mu4UJIlEZUA5vWVX-oOTqQqRF_OrpE6.5 2024-09-22T08:42:13.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.428+0000 7fb8c6932800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.3532659726848408609', time=2024-09-22T10:41:58.291296+0000, chain.objs.size()=7 2024-09-22T08:42:13.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.428+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__multipart_key1.2~7OcpQfVJXZrIYBxlehRBVZSB7uf48po.1 2024-09-22T08:42:13.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.428+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__shadow_key1.2~7OcpQfVJXZrIYBxlehRBVZSB7uf48po.1_1 2024-09-22T08:42:13.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.428+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__shadow_key1.2~7OcpQfVJXZrIYBxlehRBVZSB7uf48po.1_2 2024-09-22T08:42:13.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.431+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__multipart_key1.2~7OcpQfVJXZrIYBxlehRBVZSB7uf48po.2 2024-09-22T08:42:13.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.431+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__shadow_key1.2~7OcpQfVJXZrIYBxlehRBVZSB7uf48po.2_1 2024-09-22T08:42:13.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.432+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__shadow_key1.2~7OcpQfVJXZrIYBxlehRBVZSB7uf48po.2_2 2024-09-22T08:42:13.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.432+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__multipart_key1.2~7OcpQfVJXZrIYBxlehRBVZSB7uf48po.3 2024-09-22T08:42:13.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.434+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:42:13.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.437+0000 7fb8c6932800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-22T08:42:13.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.438+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.438+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:13.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.439+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.440+0000 7fb8c6932800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-22T08:42:13.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.441+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.441+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:13.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.442+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.443+0000 7fb8c6932800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-22T08:42:13.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.444+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.445+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:13.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.445+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.446+0000 7fb8c6932800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-22T08:42:13.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.447+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.448+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:13.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.448+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.449+0000 7fb8c6932800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-22T08:42:13.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.450+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.451+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:13.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.451+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.452+0000 7fb8c6932800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-22T08:42:13.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.453+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.454+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:13.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.454+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:42:13.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.454+0000 7fb8c6932800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.6706706922793096885', time=2024-09-22T10:41:53.120406+0000, chain.objs.size()=9 2024-09-22T08:42:13.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.454+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.98__multipart_key1.2~4LdrOu8kjtrGdX57_HCf0l7sgEFDpfb.1 2024-09-22T08:42:13.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.454+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.98__shadow_key1.2~4LdrOu8kjtrGdX57_HCf0l7sgEFDpfb.1_1 2024-09-22T08:42:13.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.454+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.98__multipart_key1.2~4LdrOu8kjtrGdX57_HCf0l7sgEFDpfb.2 2024-09-22T08:42:13.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.454+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.98__shadow_key1.2~4LdrOu8kjtrGdX57_HCf0l7sgEFDpfb.2_1 2024-09-22T08:42:13.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.454+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.98__multipart_key1.2~4LdrOu8kjtrGdX57_HCf0l7sgEFDpfb.3 2024-09-22T08:42:13.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.454+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.98__shadow_key1.2~4LdrOu8kjtrGdX57_HCf0l7sgEFDpfb.3_1 2024-09-22T08:42:13.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.454+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.98__multipart_key1.2~4LdrOu8kjtrGdX57_HCf0l7sgEFDpfb.4 2024-09-22T08:42:13.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.454+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.98__shadow_key1.2~4LdrOu8kjtrGdX57_HCf0l7sgEFDpfb.4_1 2024-09-22T08:42:13.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.454+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.98__multipart_key1.2~4LdrOu8kjtrGdX57_HCf0l7sgEFDpfb.5 2024-09-22T08:42:13.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.457+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:42:13.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.459+0000 7fb8c6932800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-22T08:42:13.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.461+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.461+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:13.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.462+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T08:42:13.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.462+0000 7fb8c6932800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.2537146910371063585', time=2024-09-22T10:41:50.524837+0000, chain.objs.size()=9 2024-09-22T08:42:13.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.462+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__multipart_key1.2~_KjWum5yxOlmiALlzzPdyB2zPJv4DO4.1 2024-09-22T08:42:13.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.462+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__shadow_key1.2~_KjWum5yxOlmiALlzzPdyB2zPJv4DO4.1_1 2024-09-22T08:42:13.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.462+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__multipart_key1.2~_KjWum5yxOlmiALlzzPdyB2zPJv4DO4.2 2024-09-22T08:42:13.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.462+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__shadow_key1.2~_KjWum5yxOlmiALlzzPdyB2zPJv4DO4.2_1 2024-09-22T08:42:13.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.462+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__multipart_key1.2~_KjWum5yxOlmiALlzzPdyB2zPJv4DO4.3 2024-09-22T08:42:13.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.462+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__shadow_key1.2~_KjWum5yxOlmiALlzzPdyB2zPJv4DO4.3_1 2024-09-22T08:42:13.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.462+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__multipart_key1.2~_KjWum5yxOlmiALlzzPdyB2zPJv4DO4.4 2024-09-22T08:42:13.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.462+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__shadow_key1.2~_KjWum5yxOlmiALlzzPdyB2zPJv4DO4.4_1 2024-09-22T08:42:13.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.462+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__multipart_key1.2~_KjWum5yxOlmiALlzzPdyB2zPJv4DO4.5 2024-09-22T08:42:13.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.462+0000 7fb8c6932800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.257772004230974952', time=2024-09-22T10:41:59.510343+0000, chain.objs.size()=9 2024-09-22T08:42:13.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.462+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.103__multipart_key1.2~KZbkeQ-VQlWpH-6wW5kdLD9Sx3w4Hue.1 2024-09-22T08:42:13.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.462+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.103__shadow_key1.2~KZbkeQ-VQlWpH-6wW5kdLD9Sx3w4Hue.1_1 2024-09-22T08:42:13.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.462+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.103__multipart_key1.2~KZbkeQ-VQlWpH-6wW5kdLD9Sx3w4Hue.2 2024-09-22T08:42:13.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.465+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.103__shadow_key1.2~KZbkeQ-VQlWpH-6wW5kdLD9Sx3w4Hue.2_1 2024-09-22T08:42:13.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.465+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.103__multipart_key1.2~KZbkeQ-VQlWpH-6wW5kdLD9Sx3w4Hue.3 2024-09-22T08:42:13.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.465+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.103__shadow_key1.2~KZbkeQ-VQlWpH-6wW5kdLD9Sx3w4Hue.3_1 2024-09-22T08:42:13.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.465+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.103__multipart_key1.2~KZbkeQ-VQlWpH-6wW5kdLD9Sx3w4Hue.4 2024-09-22T08:42:13.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.465+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.103__shadow_key1.2~KZbkeQ-VQlWpH-6wW5kdLD9Sx3w4Hue.4_1 2024-09-22T08:42:13.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.465+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.103__multipart_key1.2~KZbkeQ-VQlWpH-6wW5kdLD9Sx3w4Hue.5 2024-09-22T08:42:13.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.468+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:42:13.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.470+0000 7fb8c6932800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-22T08:42:13.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.472+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.472+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:13.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.472+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T08:42:13.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.472+0000 7fb8c6932800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.17982057591889031311', time=2024-09-22T10:41:51.735682+0000, chain.objs.size()=7 2024-09-22T08:42:13.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.472+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__multipart_key1.2~wJVc6lhhxfTYudmQRQOnCK0qHRnaMZt.1 2024-09-22T08:42:13.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.472+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__shadow_key1.2~wJVc6lhhxfTYudmQRQOnCK0qHRnaMZt.1_1 2024-09-22T08:42:13.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.472+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__shadow_key1.2~wJVc6lhhxfTYudmQRQOnCK0qHRnaMZt.1_2 2024-09-22T08:42:13.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.472+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__multipart_key1.2~wJVc6lhhxfTYudmQRQOnCK0qHRnaMZt.2 2024-09-22T08:42:13.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.472+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__shadow_key1.2~wJVc6lhhxfTYudmQRQOnCK0qHRnaMZt.2_1 2024-09-22T08:42:13.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.472+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__shadow_key1.2~wJVc6lhhxfTYudmQRQOnCK0qHRnaMZt.2_2 2024-09-22T08:42:13.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.472+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__multipart_key1.2~wJVc6lhhxfTYudmQRQOnCK0qHRnaMZt.3 2024-09-22T08:42:13.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.472+0000 7fb8c6932800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.4419721229949579364', time=2024-09-22T10:41:56.803123+0000, chain.objs.size()=9 2024-09-22T08:42:13.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.472+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__multipart_key1.2~RKNqg65gazfdpFzZfqFgbqqJzkePAog.1 2024-09-22T08:42:13.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.472+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__shadow_key1.2~RKNqg65gazfdpFzZfqFgbqqJzkePAog.1_1 2024-09-22T08:42:13.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.472+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__multipart_key1.2~RKNqg65gazfdpFzZfqFgbqqJzkePAog.2 2024-09-22T08:42:13.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.472+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__shadow_key1.2~RKNqg65gazfdpFzZfqFgbqqJzkePAog.2_1 2024-09-22T08:42:13.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.472+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__multipart_key1.2~RKNqg65gazfdpFzZfqFgbqqJzkePAog.3 2024-09-22T08:42:13.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.475+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__shadow_key1.2~RKNqg65gazfdpFzZfqFgbqqJzkePAog.3_1 2024-09-22T08:42:13.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.476+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__multipart_key1.2~RKNqg65gazfdpFzZfqFgbqqJzkePAog.4 2024-09-22T08:42:13.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.476+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__shadow_key1.2~RKNqg65gazfdpFzZfqFgbqqJzkePAog.4_1 2024-09-22T08:42:13.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.476+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__multipart_key1.2~RKNqg65gazfdpFzZfqFgbqqJzkePAog.5 2024-09-22T08:42:13.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.478+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:42:13.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.480+0000 7fb8c6932800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-22T08:42:13.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.481+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.482+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:13.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.483+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-22T08:42:13.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.483+0000 7fb8c6932800 20 garbage collection: RGWGC::process iterating over entry tag='2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH', time=2024-09-22T10:42:00.974349+0000, chain.objs.size()=105 2024-09-22T08:42:13.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.483+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.1 2024-09-22T08:42:13.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.483+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.2 2024-09-22T08:42:13.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.483+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.3 2024-09-22T08:42:13.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.483+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.4 2024-09-22T08:42:13.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.483+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.5 2024-09-22T08:42:13.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.483+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.6 2024-09-22T08:42:13.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.483+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.7 2024-09-22T08:42:13.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.483+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.8 2024-09-22T08:42:13.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.483+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.9 2024-09-22T08:42:13.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.483+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.10 2024-09-22T08:42:13.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.483+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.11 2024-09-22T08:42:13.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.483+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.12 2024-09-22T08:42:13.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.485+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.13 2024-09-22T08:42:13.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.485+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.14 2024-09-22T08:42:13.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.485+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.15 2024-09-22T08:42:13.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.485+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.16 2024-09-22T08:42:13.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.485+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.17 2024-09-22T08:42:13.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.486+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.18 2024-09-22T08:42:13.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.486+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.19 2024-09-22T08:42:13.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.486+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.20 2024-09-22T08:42:13.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.486+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.21 2024-09-22T08:42:13.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.486+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.22 2024-09-22T08:42:13.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.486+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.23 2024-09-22T08:42:13.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.487+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.24 2024-09-22T08:42:13.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.487+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.25 2024-09-22T08:42:13.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.487+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.26 2024-09-22T08:42:13.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.487+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.27 2024-09-22T08:42:13.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.488+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.28 2024-09-22T08:42:13.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.488+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.29 2024-09-22T08:42:13.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.488+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.30 2024-09-22T08:42:13.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.488+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.31 2024-09-22T08:42:13.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.488+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.32 2024-09-22T08:42:13.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.488+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.33 2024-09-22T08:42:13.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.488+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.34 2024-09-22T08:42:13.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.489+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.35 2024-09-22T08:42:13.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.489+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.36 2024-09-22T08:42:13.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.490+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.37 2024-09-22T08:42:13.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.490+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.38 2024-09-22T08:42:13.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.490+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.39 2024-09-22T08:42:13.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.490+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.40 2024-09-22T08:42:13.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.490+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.41 2024-09-22T08:42:13.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.490+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.42 2024-09-22T08:42:13.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.490+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.43 2024-09-22T08:42:13.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.490+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.44 2024-09-22T08:42:13.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.491+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.45 2024-09-22T08:42:13.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.491+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.46 2024-09-22T08:42:13.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.492+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.47 2024-09-22T08:42:13.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.492+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.48 2024-09-22T08:42:13.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.493+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.49 2024-09-22T08:42:13.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.493+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.50 2024-09-22T08:42:13.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.493+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.51 2024-09-22T08:42:13.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.493+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.52 2024-09-22T08:42:13.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.493+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.53 2024-09-22T08:42:13.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.493+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.54 2024-09-22T08:42:13.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.493+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.55 2024-09-22T08:42:13.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.493+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.56 2024-09-22T08:42:13.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.493+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.57 2024-09-22T08:42:13.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.493+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.58 2024-09-22T08:42:13.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.493+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.59 2024-09-22T08:42:13.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.495+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.60 2024-09-22T08:42:13.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.495+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.61 2024-09-22T08:42:13.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.495+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.62 2024-09-22T08:42:13.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.495+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.63 2024-09-22T08:42:13.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.495+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.64 2024-09-22T08:42:13.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.495+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.65 2024-09-22T08:42:13.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.495+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.66 2024-09-22T08:42:13.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.495+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.67 2024-09-22T08:42:13.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.495+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.68 2024-09-22T08:42:13.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.495+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.69 2024-09-22T08:42:13.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.495+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.70 2024-09-22T08:42:13.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.497+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.71 2024-09-22T08:42:13.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.498+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.72 2024-09-22T08:42:13.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.498+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.73 2024-09-22T08:42:13.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.498+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.74 2024-09-22T08:42:13.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.498+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.75 2024-09-22T08:42:13.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.498+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.76 2024-09-22T08:42:13.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.498+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.77 2024-09-22T08:42:13.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.498+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.78 2024-09-22T08:42:13.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.499+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.79 2024-09-22T08:42:13.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.499+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.80 2024-09-22T08:42:13.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.499+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.81 2024-09-22T08:42:13.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.499+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.82 2024-09-22T08:42:13.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.500+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.83 2024-09-22T08:42:13.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.500+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.84 2024-09-22T08:42:13.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.501+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.85 2024-09-22T08:42:13.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.501+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.86 2024-09-22T08:42:13.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.501+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.87 2024-09-22T08:42:13.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.501+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.88 2024-09-22T08:42:13.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.501+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.89 2024-09-22T08:42:13.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.501+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.90 2024-09-22T08:42:13.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.501+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.91 2024-09-22T08:42:13.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.502+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.92 2024-09-22T08:42:13.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.502+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.93 2024-09-22T08:42:13.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.504+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.94 2024-09-22T08:42:13.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.504+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.95 2024-09-22T08:42:13.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.504+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.96 2024-09-22T08:42:13.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.504+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.97 2024-09-22T08:42:13.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.504+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.98 2024-09-22T08:42:13.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.504+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.99 2024-09-22T08:42:13.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.504+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.100 2024-09-22T08:42:13.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.504+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.101 2024-09-22T08:42:13.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.504+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.102 2024-09-22T08:42:13.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.504+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.103 2024-09-22T08:42:13.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.504+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.104 2024-09-22T08:42:13.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.505+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.105 2024-09-22T08:42:13.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.506+0000 7fb8c6932800 20 garbage collection: RGWGC::process iterating over entry tag='2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH', time=2024-09-22T10:42:01.007828+0000, chain.objs.size()=10 2024-09-22T08:42:13.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.506+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.106 2024-09-22T08:42:13.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.506+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.107 2024-09-22T08:42:13.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.506+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.108 2024-09-22T08:42:13.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.507+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.109 2024-09-22T08:42:13.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.507+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.110 2024-09-22T08:42:13.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.507+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.111 2024-09-22T08:42:13.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.507+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.112 2024-09-22T08:42:13.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.507+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.113 2024-09-22T08:42:13.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.507+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.114 2024-09-22T08:42:13.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.507+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.115 2024-09-22T08:42:13.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.507+0000 7fb8c6932800 20 garbage collection: RGWGC::process iterating over entry tag='2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH', time=2024-09-22T10:42:01.027436+0000, chain.objs.size()=8 2024-09-22T08:42:13.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.507+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.116 2024-09-22T08:42:13.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.507+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.117 2024-09-22T08:42:13.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.509+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.118 2024-09-22T08:42:13.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.509+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.119 2024-09-22T08:42:13.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.509+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.120 2024-09-22T08:42:13.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.509+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.121 2024-09-22T08:42:13.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.509+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.122 2024-09-22T08:42:13.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.509+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.123 2024-09-22T08:42:13.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.509+0000 7fb8c6932800 20 garbage collection: RGWGC::process iterating over entry tag='2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH', time=2024-09-22T10:42:01.046892+0000, chain.objs.size()=4 2024-09-22T08:42:13.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.509+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.124 2024-09-22T08:42:13.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.509+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.125 2024-09-22T08:42:13.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.510+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.126 2024-09-22T08:42:13.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.510+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.127 2024-09-22T08:42:13.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.510+0000 7fb8c6932800 20 garbage collection: RGWGC::process iterating over entry tag='2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH', time=2024-09-22T10:42:01.074795+0000, chain.objs.size()=11 2024-09-22T08:42:13.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.510+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.128 2024-09-22T08:42:13.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.510+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.129 2024-09-22T08:42:13.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.511+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.130 2024-09-22T08:42:13.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.511+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.131 2024-09-22T08:42:13.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.511+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.132 2024-09-22T08:42:13.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.512+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.133 2024-09-22T08:42:13.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.512+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.134 2024-09-22T08:42:13.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.513+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.135 2024-09-22T08:42:13.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.513+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.136 2024-09-22T08:42:13.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.513+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.137 2024-09-22T08:42:13.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.513+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.138 2024-09-22T08:42:13.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.513+0000 7fb8c6932800 20 garbage collection: RGWGC::process iterating over entry tag='2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH', time=2024-09-22T10:42:01.101563+0000, chain.objs.size()=10 2024-09-22T08:42:13.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.513+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.139 2024-09-22T08:42:13.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.513+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.140 2024-09-22T08:42:13.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.513+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.141 2024-09-22T08:42:13.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.513+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.142 2024-09-22T08:42:13.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.513+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.143 2024-09-22T08:42:13.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.513+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.144 2024-09-22T08:42:13.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.513+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.145 2024-09-22T08:42:13.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.515+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.146 2024-09-22T08:42:13.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.515+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.147 2024-09-22T08:42:13.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.515+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.148 2024-09-22T08:42:13.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.515+0000 7fb8c6932800 20 garbage collection: RGWGC::process iterating over entry tag='2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH', time=2024-09-22T10:42:01.125611+0000, chain.objs.size()=7 2024-09-22T08:42:13.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.515+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.149 2024-09-22T08:42:13.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.515+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.150 2024-09-22T08:42:13.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.516+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.151 2024-09-22T08:42:13.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.516+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.152 2024-09-22T08:42:13.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.516+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.153 2024-09-22T08:42:13.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.516+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.154 2024-09-22T08:42:13.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.516+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.155 2024-09-22T08:42:13.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.516+0000 7fb8c6932800 20 garbage collection: RGWGC::process iterating over entry tag='2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH', time=2024-09-22T10:42:01.142259+0000, chain.objs.size()=6 2024-09-22T08:42:13.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.516+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.156 2024-09-22T08:42:13.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.516+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.157 2024-09-22T08:42:13.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.516+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.158 2024-09-22T08:42:13.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.517+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.159 2024-09-22T08:42:13.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.517+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.160 2024-09-22T08:42:13.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.517+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.161 2024-09-22T08:42:13.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.517+0000 7fb8c6932800 20 garbage collection: RGWGC::process iterating over entry tag='2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH', time=2024-09-22T10:42:01.171191+0000, chain.objs.size()=10 2024-09-22T08:42:13.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.517+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.162 2024-09-22T08:42:13.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.518+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.163 2024-09-22T08:42:13.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.518+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.164 2024-09-22T08:42:13.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.519+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.165 2024-09-22T08:42:13.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.519+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.166 2024-09-22T08:42:13.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.519+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.167 2024-09-22T08:42:13.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.519+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.168 2024-09-22T08:42:13.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.519+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.169 2024-09-22T08:42:13.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.519+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.170 2024-09-22T08:42:13.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.519+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.171 2024-09-22T08:42:13.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.519+0000 7fb8c6932800 20 garbage collection: RGWGC::process iterating over entry tag='2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH', time=2024-09-22T10:42:01.201521+0000, chain.objs.size()=10 2024-09-22T08:42:13.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.519+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.172 2024-09-22T08:42:13.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.519+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.173 2024-09-22T08:42:13.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.520+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.174 2024-09-22T08:42:13.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.520+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.175 2024-09-22T08:42:13.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.521+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.176 2024-09-22T08:42:13.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.521+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.177 2024-09-22T08:42:13.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.521+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.178 2024-09-22T08:42:13.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.521+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.179 2024-09-22T08:42:13.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.521+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.180 2024-09-22T08:42:13.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.521+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.181 2024-09-22T08:42:13.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.521+0000 7fb8c6932800 20 garbage collection: RGWGC::process iterating over entry tag='2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH', time=2024-09-22T10:42:01.229143+0000, chain.objs.size()=9 2024-09-22T08:42:13.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.521+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.182 2024-09-22T08:42:13.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.522+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.183 2024-09-22T08:42:13.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.522+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.184 2024-09-22T08:42:13.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.522+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.185 2024-09-22T08:42:13.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.522+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.186 2024-09-22T08:42:13.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.524+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.187 2024-09-22T08:42:13.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.524+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.188 2024-09-22T08:42:13.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.524+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.189 2024-09-22T08:42:13.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.524+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.190 2024-09-22T08:42:13.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.524+0000 7fb8c6932800 20 garbage collection: RGWGC::process iterating over entry tag='2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH', time=2024-09-22T10:42:01.250984+0000, chain.objs.size()=7 2024-09-22T08:42:13.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.524+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.191 2024-09-22T08:42:13.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.524+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.192 2024-09-22T08:42:13.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.524+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.193 2024-09-22T08:42:13.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.524+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.194 2024-09-22T08:42:13.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.524+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.195 2024-09-22T08:42:13.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.524+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.196 2024-09-22T08:42:13.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.524+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.197 2024-09-22T08:42:13.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.525+0000 7fb8c6932800 20 garbage collection: RGWGC::process iterating over entry tag='2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH', time=2024-09-22T10:42:01.276634+0000, chain.objs.size()=10 2024-09-22T08:42:13.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.525+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.198 2024-09-22T08:42:13.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.526+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.199 2024-09-22T08:42:13.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.526+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.200 2024-09-22T08:42:13.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.526+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.201 2024-09-22T08:42:13.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.526+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.202 2024-09-22T08:42:13.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.526+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.203 2024-09-22T08:42:13.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.526+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.204 2024-09-22T08:42:13.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.526+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.205 2024-09-22T08:42:13.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.526+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.206 2024-09-22T08:42:13.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.526+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.207 2024-09-22T08:42:13.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.526+0000 7fb8c6932800 20 garbage collection: RGWGC::process iterating over entry tag='2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH', time=2024-09-22T10:42:01.287214+0000, chain.objs.size()=5 2024-09-22T08:42:13.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.526+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.208 2024-09-22T08:42:13.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.527+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.209 2024-09-22T08:42:13.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.527+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.210 2024-09-22T08:42:13.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.528+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.211 2024-09-22T08:42:13.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.528+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.105__multipart_key1.2~xw-2WN34IoFfO7l1HDH9i4E9POJFlnH.212 2024-09-22T08:42:13.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.530+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:42:13.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.532+0000 7fb8c6932800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-22T08:42:13.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.534+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.534+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:13.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.535+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:42:13.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.535+0000 7fb8c6932800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.12646166647698828922', time=2024-09-22T10:41:57.413702+0000, chain.objs.size()=7 2024-09-22T08:42:13.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.535+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__multipart_key1.2~gbmf9LoKgOIJCecWZldCO1YcxqmnMYU.1 2024-09-22T08:42:13.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.535+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__shadow_key1.2~gbmf9LoKgOIJCecWZldCO1YcxqmnMYU.1_1 2024-09-22T08:42:13.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.535+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__shadow_key1.2~gbmf9LoKgOIJCecWZldCO1YcxqmnMYU.1_2 2024-09-22T08:42:13.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.535+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__multipart_key1.2~gbmf9LoKgOIJCecWZldCO1YcxqmnMYU.2 2024-09-22T08:42:13.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.535+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__shadow_key1.2~gbmf9LoKgOIJCecWZldCO1YcxqmnMYU.2_1 2024-09-22T08:42:13.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.535+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__shadow_key1.2~gbmf9LoKgOIJCecWZldCO1YcxqmnMYU.2_2 2024-09-22T08:42:13.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.535+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__multipart_key1.2~gbmf9LoKgOIJCecWZldCO1YcxqmnMYU.3 2024-09-22T08:42:13.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.537+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:42:13.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.540+0000 7fb8c6932800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-22T08:42:13.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.541+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.542+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:13.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.542+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.543+0000 7fb8c6932800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-22T08:42:13.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.544+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.545+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:13.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.545+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.546+0000 7fb8c6932800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-22T08:42:13.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.548+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.548+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:13.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.549+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T08:42:13.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.549+0000 7fb8c6932800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.6131023965894098340', time=2024-09-22T10:41:47.885515+0000, chain.objs.size()=9 2024-09-22T08:42:13.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.549+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.91__multipart_key1.2~LfYFJ7hH89k8djSWvd5L1zRo0JWa8Un.1 2024-09-22T08:42:13.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.549+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.91__shadow_key1.2~LfYFJ7hH89k8djSWvd5L1zRo0JWa8Un.1_1 2024-09-22T08:42:13.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.549+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.91__multipart_key1.2~LfYFJ7hH89k8djSWvd5L1zRo0JWa8Un.2 2024-09-22T08:42:13.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.549+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.91__shadow_key1.2~LfYFJ7hH89k8djSWvd5L1zRo0JWa8Un.2_1 2024-09-22T08:42:13.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.549+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.91__multipart_key1.2~LfYFJ7hH89k8djSWvd5L1zRo0JWa8Un.3 2024-09-22T08:42:13.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.549+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.91__shadow_key1.2~LfYFJ7hH89k8djSWvd5L1zRo0JWa8Un.3_1 2024-09-22T08:42:13.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.549+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.91__multipart_key1.2~LfYFJ7hH89k8djSWvd5L1zRo0JWa8Un.4 2024-09-22T08:42:13.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.549+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.91__shadow_key1.2~LfYFJ7hH89k8djSWvd5L1zRo0JWa8Un.4_1 2024-09-22T08:42:13.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.549+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.91__multipart_key1.2~LfYFJ7hH89k8djSWvd5L1zRo0JWa8Un.5 2024-09-22T08:42:13.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.549+0000 7fb8c6932800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.17605936186993345714', time=2024-09-22T10:41:58.430609+0000, chain.objs.size()=7 2024-09-22T08:42:13.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.549+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__multipart_key1.2~CkTCNWQjpTaK_MxtkRGC6wA65ol-w4I.1 2024-09-22T08:42:13.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.549+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__shadow_key1.2~CkTCNWQjpTaK_MxtkRGC6wA65ol-w4I.1_1 2024-09-22T08:42:13.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.549+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__shadow_key1.2~CkTCNWQjpTaK_MxtkRGC6wA65ol-w4I.1_2 2024-09-22T08:42:13.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.552+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__multipart_key1.2~CkTCNWQjpTaK_MxtkRGC6wA65ol-w4I.2 2024-09-22T08:42:13.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.552+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__shadow_key1.2~CkTCNWQjpTaK_MxtkRGC6wA65ol-w4I.2_1 2024-09-22T08:42:13.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.552+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__shadow_key1.2~CkTCNWQjpTaK_MxtkRGC6wA65ol-w4I.2_2 2024-09-22T08:42:13.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.552+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__multipart_key1.2~CkTCNWQjpTaK_MxtkRGC6wA65ol-w4I.3 2024-09-22T08:42:13.556 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.555+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:42:13.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.557+0000 7fb8c6932800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-22T08:42:13.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.558+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.559+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:13.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.559+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T08:42:13.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.559+0000 7fb8c6932800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.16874691170625104281', time=2024-09-22T10:41:51.328953+0000, chain.objs.size()=7 2024-09-22T08:42:13.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.559+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__multipart_key1.2~A_vD3NxrGDN9MnFywjDFNlmzG1niFr_.1 2024-09-22T08:42:13.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.559+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__shadow_key1.2~A_vD3NxrGDN9MnFywjDFNlmzG1niFr_.1_1 2024-09-22T08:42:13.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.559+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__shadow_key1.2~A_vD3NxrGDN9MnFywjDFNlmzG1niFr_.1_2 2024-09-22T08:42:13.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.559+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__multipart_key1.2~A_vD3NxrGDN9MnFywjDFNlmzG1niFr_.2 2024-09-22T08:42:13.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.559+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__shadow_key1.2~A_vD3NxrGDN9MnFywjDFNlmzG1niFr_.2_1 2024-09-22T08:42:13.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.559+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__shadow_key1.2~A_vD3NxrGDN9MnFywjDFNlmzG1niFr_.2_2 2024-09-22T08:42:13.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.559+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__multipart_key1.2~A_vD3NxrGDN9MnFywjDFNlmzG1niFr_.3 2024-09-22T08:42:13.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.559+0000 7fb8c6932800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.13409039979873272096', time=2024-09-22T10:41:54.112903+0000, chain.objs.size()=9 2024-09-22T08:42:13.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.559+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.99__multipart_key1.2~HHInDFT41ZfM1QNCOUCTTaHc2PV1Kyy.1 2024-09-22T08:42:13.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.559+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.99__shadow_key1.2~HHInDFT41ZfM1QNCOUCTTaHc2PV1Kyy.1_1 2024-09-22T08:42:13.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.559+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.99__multipart_key1.2~HHInDFT41ZfM1QNCOUCTTaHc2PV1Kyy.2 2024-09-22T08:42:13.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.559+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.99__shadow_key1.2~HHInDFT41ZfM1QNCOUCTTaHc2PV1Kyy.2_1 2024-09-22T08:42:13.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.559+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.99__multipart_key1.2~HHInDFT41ZfM1QNCOUCTTaHc2PV1Kyy.3 2024-09-22T08:42:13.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.562+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.99__shadow_key1.2~HHInDFT41ZfM1QNCOUCTTaHc2PV1Kyy.3_1 2024-09-22T08:42:13.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.562+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.99__multipart_key1.2~HHInDFT41ZfM1QNCOUCTTaHc2PV1Kyy.4 2024-09-22T08:42:13.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.562+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.99__shadow_key1.2~HHInDFT41ZfM1QNCOUCTTaHc2PV1Kyy.4_1 2024-09-22T08:42:13.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.563+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.99__multipart_key1.2~HHInDFT41ZfM1QNCOUCTTaHc2PV1Kyy.5 2024-09-22T08:42:13.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.565+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:42:13.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.567+0000 7fb8c6932800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-22T08:42:13.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.568+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.569+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:13.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.569+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T08:42:13.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.569+0000 7fb8c6932800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.1585364953448605592', time=2024-09-22T10:41:45.067693+0000, chain.objs.size()=2 2024-09-22T08:42:13.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.569+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.83__shadow_.EM3qHd1GJk9YojnpEcH5xYahuwbcack_1 2024-09-22T08:42:13.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.569+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.83__shadow_.EM3qHd1GJk9YojnpEcH5xYahuwbcack_2 2024-09-22T08:42:13.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.570+0000 7fb8c6932800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.7639997315958747756', time=2024-09-22T10:41:50.926774+0000, chain.objs.size()=9 2024-09-22T08:42:13.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.570+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__multipart_key1.2~OqBVa9p3KaXepNvjYrDCyGWqAL0miWg.1 2024-09-22T08:42:13.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.570+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__shadow_key1.2~OqBVa9p3KaXepNvjYrDCyGWqAL0miWg.1_1 2024-09-22T08:42:13.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.570+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__multipart_key1.2~OqBVa9p3KaXepNvjYrDCyGWqAL0miWg.2 2024-09-22T08:42:13.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.570+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__shadow_key1.2~OqBVa9p3KaXepNvjYrDCyGWqAL0miWg.2_1 2024-09-22T08:42:13.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.570+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__multipart_key1.2~OqBVa9p3KaXepNvjYrDCyGWqAL0miWg.3 2024-09-22T08:42:13.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.570+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__shadow_key1.2~OqBVa9p3KaXepNvjYrDCyGWqAL0miWg.3_1 2024-09-22T08:42:13.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.570+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__multipart_key1.2~OqBVa9p3KaXepNvjYrDCyGWqAL0miWg.4 2024-09-22T08:42:13.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.570+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__shadow_key1.2~OqBVa9p3KaXepNvjYrDCyGWqAL0miWg.4_1 2024-09-22T08:42:13.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.570+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__multipart_key1.2~OqBVa9p3KaXepNvjYrDCyGWqAL0miWg.5 2024-09-22T08:42:13.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.573+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:42:13.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.576+0000 7fb8c6932800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-22T08:42:13.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.577+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.578+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:13.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.578+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:42:13.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.578+0000 7fb8c6932800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.11675295157665892798', time=2024-09-22T10:41:49.972377+0000, chain.objs.size()=9 2024-09-22T08:42:13.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.578+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__multipart_key1.2~xyVoOX9TSYDZCao_oKt_u_QQEplE4k-.1 2024-09-22T08:42:13.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.578+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__shadow_key1.2~xyVoOX9TSYDZCao_oKt_u_QQEplE4k-.1_1 2024-09-22T08:42:13.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.578+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__multipart_key1.2~xyVoOX9TSYDZCao_oKt_u_QQEplE4k-.2 2024-09-22T08:42:13.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.578+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__shadow_key1.2~xyVoOX9TSYDZCao_oKt_u_QQEplE4k-.2_1 2024-09-22T08:42:13.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.578+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__multipart_key1.2~xyVoOX9TSYDZCao_oKt_u_QQEplE4k-.3 2024-09-22T08:42:13.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.578+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__shadow_key1.2~xyVoOX9TSYDZCao_oKt_u_QQEplE4k-.3_1 2024-09-22T08:42:13.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.578+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__multipart_key1.2~xyVoOX9TSYDZCao_oKt_u_QQEplE4k-.4 2024-09-22T08:42:13.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.578+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__shadow_key1.2~xyVoOX9TSYDZCao_oKt_u_QQEplE4k-.4_1 2024-09-22T08:42:13.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.578+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.94__multipart_key1.2~xyVoOX9TSYDZCao_oKt_u_QQEplE4k-.5 2024-09-22T08:42:13.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.581+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:42:13.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.584+0000 7fb8c6932800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-22T08:42:13.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.585+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.585+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:13.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.586+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:42:13.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.586+0000 7fb8c6932800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.2408686708202929202', time=2024-09-22T10:41:57.110673+0000, chain.objs.size()=9 2024-09-22T08:42:13.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.586+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__multipart_key1.2~rQ4k2q-dfwaezZut-glMqLdKG4GqEzC.1 2024-09-22T08:42:13.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.586+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__shadow_key1.2~rQ4k2q-dfwaezZut-glMqLdKG4GqEzC.1_1 2024-09-22T08:42:13.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.586+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__multipart_key1.2~rQ4k2q-dfwaezZut-glMqLdKG4GqEzC.2 2024-09-22T08:42:13.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.586+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__shadow_key1.2~rQ4k2q-dfwaezZut-glMqLdKG4GqEzC.2_1 2024-09-22T08:42:13.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.586+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__multipart_key1.2~rQ4k2q-dfwaezZut-glMqLdKG4GqEzC.3 2024-09-22T08:42:13.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.586+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__shadow_key1.2~rQ4k2q-dfwaezZut-glMqLdKG4GqEzC.3_1 2024-09-22T08:42:13.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.586+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__multipart_key1.2~rQ4k2q-dfwaezZut-glMqLdKG4GqEzC.4 2024-09-22T08:42:13.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.586+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__shadow_key1.2~rQ4k2q-dfwaezZut-glMqLdKG4GqEzC.4_1 2024-09-22T08:42:13.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.586+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.102__multipart_key1.2~rQ4k2q-dfwaezZut-glMqLdKG4GqEzC.5 2024-09-22T08:42:13.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.589+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:42:13.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.591+0000 7fb8c6932800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-22T08:42:13.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.592+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.593+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:13.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.593+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T08:42:13.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.593+0000 7fb8c6932800 20 garbage collection: RGWGC::process iterating over entry tag='2~EzR7H58Qw_ZVr2MGRxhFFAqYCiLHyRe', time=2024-09-22T10:41:55.596188+0000, chain.objs.size()=9 2024-09-22T08:42:13.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.593+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.101__multipart_key1.2~EzR7H58Qw_ZVr2MGRxhFFAqYCiLHyRe.7 2024-09-22T08:42:13.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.593+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.101__shadow_key1.2~EzR7H58Qw_ZVr2MGRxhFFAqYCiLHyRe.7_1 2024-09-22T08:42:13.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.593+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.101__multipart_key1.2~EzR7H58Qw_ZVr2MGRxhFFAqYCiLHyRe.8 2024-09-22T08:42:13.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.593+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.101__shadow_key1.2~EzR7H58Qw_ZVr2MGRxhFFAqYCiLHyRe.8_1 2024-09-22T08:42:13.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.593+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.101__multipart_key1.2~EzR7H58Qw_ZVr2MGRxhFFAqYCiLHyRe.9 2024-09-22T08:42:13.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.593+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.101__shadow_key1.2~EzR7H58Qw_ZVr2MGRxhFFAqYCiLHyRe.9_1 2024-09-22T08:42:13.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.593+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.101__multipart_key1.2~EzR7H58Qw_ZVr2MGRxhFFAqYCiLHyRe.10 2024-09-22T08:42:13.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.593+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.101__shadow_key1.2~EzR7H58Qw_ZVr2MGRxhFFAqYCiLHyRe.10_1 2024-09-22T08:42:13.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.593+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.101__multipart_key1.2~EzR7H58Qw_ZVr2MGRxhFFAqYCiLHyRe.11 2024-09-22T08:42:13.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.593+0000 7fb8c6932800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.1974795264767534165', time=2024-09-22T10:42:00.183699+0000, chain.objs.size()=9 2024-09-22T08:42:13.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.593+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.104__multipart_key1.2~NLfm2FExTiv5nMrvXbW6eWtIAPs-eyL.1 2024-09-22T08:42:13.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.593+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.104__shadow_key1.2~NLfm2FExTiv5nMrvXbW6eWtIAPs-eyL.1_1 2024-09-22T08:42:13.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.593+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.104__multipart_key1.2~NLfm2FExTiv5nMrvXbW6eWtIAPs-eyL.2 2024-09-22T08:42:13.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.597+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.104__shadow_key1.2~NLfm2FExTiv5nMrvXbW6eWtIAPs-eyL.2_1 2024-09-22T08:42:13.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.597+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.104__multipart_key1.2~NLfm2FExTiv5nMrvXbW6eWtIAPs-eyL.3 2024-09-22T08:42:13.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.597+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.104__shadow_key1.2~NLfm2FExTiv5nMrvXbW6eWtIAPs-eyL.3_1 2024-09-22T08:42:13.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.597+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.104__multipart_key1.2~NLfm2FExTiv5nMrvXbW6eWtIAPs-eyL.4 2024-09-22T08:42:13.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.597+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.104__shadow_key1.2~NLfm2FExTiv5nMrvXbW6eWtIAPs-eyL.4_1 2024-09-22T08:42:13.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.597+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.104__multipart_key1.2~NLfm2FExTiv5nMrvXbW6eWtIAPs-eyL.5 2024-09-22T08:42:13.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.600+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:42:13.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.602+0000 7fb8c6932800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-22T08:42:13.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.603+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.604+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:13.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.604+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.605+0000 7fb8c6932800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-22T08:42:13.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.607+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.607+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:13.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.607+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:42:13.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.607+0000 7fb8c6932800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.2135283883551285525', time=2024-09-22T10:41:54.702513+0000, chain.objs.size()=9 2024-09-22T08:42:13.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.607+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.100__multipart_file.mpg.2~65ZltCsNSPFmYwHz99ssfTbgiAu0ly1.1 2024-09-22T08:42:13.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.607+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.100__shadow_file.mpg.2~65ZltCsNSPFmYwHz99ssfTbgiAu0ly1.1_1 2024-09-22T08:42:13.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.607+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.100__multipart_file.mpg.2~65ZltCsNSPFmYwHz99ssfTbgiAu0ly1.2 2024-09-22T08:42:13.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.607+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.100__shadow_file.mpg.2~65ZltCsNSPFmYwHz99ssfTbgiAu0ly1.2_1 2024-09-22T08:42:13.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.607+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.100__multipart_file.mpg.2~65ZltCsNSPFmYwHz99ssfTbgiAu0ly1.3 2024-09-22T08:42:13.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.607+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.100__shadow_file.mpg.2~65ZltCsNSPFmYwHz99ssfTbgiAu0ly1.3_1 2024-09-22T08:42:13.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.607+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.100__multipart_file.mpg.2~65ZltCsNSPFmYwHz99ssfTbgiAu0ly1.4 2024-09-22T08:42:13.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.607+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.100__shadow_file.mpg.2~65ZltCsNSPFmYwHz99ssfTbgiAu0ly1.4_1 2024-09-22T08:42:13.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.607+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.100__multipart_file.mpg.2~65ZltCsNSPFmYwHz99ssfTbgiAu0ly1.5 2024-09-22T08:42:13.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.610+0000 7fb8c6932800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:42:13.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.613+0000 7fb8c6932800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-22T08:42:13.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.614+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.615+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:13.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.615+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.616+0000 7fb8c6932800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-22T08:42:13.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.617+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.618+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:13.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.618+0000 7fb8c6932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:13.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.620+0000 7fb7797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:13.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.622+0000 7fb8c6932800 20 remove_watcher() i=0 2024-09-22T08:42:13.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.622+0000 7fb8c6932800 2 removed watcher, disabling cache 2024-09-22T08:42:13.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.623+0000 7fb8c6932800 20 remove_watcher() i=1 2024-09-22T08:42:13.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.624+0000 7fb8c6932800 20 remove_watcher() i=2 2024-09-22T08:42:13.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.625+0000 7fb8c6932800 20 remove_watcher() i=3 2024-09-22T08:42:13.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.626+0000 7fb8c6932800 20 remove_watcher() i=4 2024-09-22T08:42:13.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.627+0000 7fb8c6932800 20 remove_watcher() i=5 2024-09-22T08:42:13.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.628+0000 7fb8c6932800 20 remove_watcher() i=6 2024-09-22T08:42:13.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.629+0000 7fb8c6932800 20 remove_watcher() i=7 2024-09-22T08:42:13.642 DEBUG:teuthology.orchestra.run.smithi038:> radosgw-admin gc process --include-all 2024-09-22T08:42:13.695 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:13.695 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:13.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.733+0000 7f8d378bb800 20 rados->read ofs=0 len=0 2024-09-22T08:42:13.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.735+0000 7f8d378bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:13.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.735+0000 7f8d378bb800 20 realm 2024-09-22T08:42:13.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.735+0000 7f8d378bb800 20 rados->read ofs=0 len=0 2024-09-22T08:42:13.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.735+0000 7f8d378bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:13.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.735+0000 7f8d378bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:13.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.735+0000 7f8d378bb800 20 rados->read ofs=0 len=0 2024-09-22T08:42:13.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.735+0000 7f8d378bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:13.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.735+0000 7f8d378bb800 20 rados->read ofs=0 len=0 2024-09-22T08:42:13.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.736+0000 7f8d378bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:13.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.736+0000 7f8d378bb800 20 rados->read ofs=0 len=0 2024-09-22T08:42:13.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.737+0000 7f8d378bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:13.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.737+0000 7f8d378bb800 20 searching for the correct realm 2024-09-22T08:42:13.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.739+0000 7f8d34ba4640 0 -- 172.21.15.38:0/151972897 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f8d20068830 msgr2=0x7f8d200672a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:13.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.742+0000 7f8d34ba4640 0 -- 172.21.15.38:0/151972897 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f8d28084940 msgr2=0x7f8d28056470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:13.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.949+0000 7f8d378bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:13.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.949+0000 7f8d378bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:13.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.949+0000 7f8d378bb800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:42:13.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.949+0000 7f8d378bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:13.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.949+0000 7f8d378bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:13.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.949+0000 7f8d378bb800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:42:13.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.949+0000 7f8d378bb800 20 rados->read ofs=0 len=0 2024-09-22T08:42:13.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.949+0000 7f8d378bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:13.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.949+0000 7f8d378bb800 20 rados->read ofs=0 len=0 2024-09-22T08:42:13.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.949+0000 7f8d378bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:13.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.949+0000 7f8d378bb800 20 rados->read ofs=0 len=0 2024-09-22T08:42:13.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.950+0000 7f8d378bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:13.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.950+0000 7f8d378bb800 20 zone default found 2024-09-22T08:42:13.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.950+0000 7f8d378bb800 4 Realm: () 2024-09-22T08:42:13.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.950+0000 7f8d378bb800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:42:13.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.950+0000 7f8d378bb800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:42:13.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.950+0000 7f8d378bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:13.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.950+0000 7f8d378bb800 20 zonegroup default 2024-09-22T08:42:13.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.950+0000 7f8d378bb800 20 rados->read ofs=0 len=0 2024-09-22T08:42:13.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.950+0000 7f8d378bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:13.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.950+0000 7f8d378bb800 20 rados->read ofs=0 len=0 2024-09-22T08:42:13.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.950+0000 7f8d378bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:13.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.950+0000 7f8d378bb800 20 rados->read ofs=0 len=0 2024-09-22T08:42:13.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.951+0000 7f8d378bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:13.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.951+0000 7f8d378bb800 20 started sync module instance, tier type = 2024-09-22T08:42:13.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.951+0000 7f8d378bb800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:42:13.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.960+0000 7f8d378bb800 20 add_watcher() i=0 2024-09-22T08:42:13.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.960+0000 7f8d378bb800 20 add_watcher() i=1 2024-09-22T08:42:13.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.960+0000 7f8d378bb800 20 add_watcher() i=2 2024-09-22T08:42:13.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.960+0000 7f8d378bb800 20 add_watcher() i=3 2024-09-22T08:42:13.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.960+0000 7f8d378bb800 20 add_watcher() i=4 2024-09-22T08:42:13.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.960+0000 7f8d378bb800 20 add_watcher() i=5 2024-09-22T08:42:13.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.960+0000 7f8d378bb800 20 add_watcher() i=6 2024-09-22T08:42:13.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.961+0000 7f8d378bb800 20 add_watcher() i=7 2024-09-22T08:42:13.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.961+0000 7f8d378bb800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:13.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.962+0000 7f8beb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:13.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.963+0000 7f8d378bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:13.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:13.963+0000 7f8d378bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:14.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.000+0000 7f8bea7e4640 20 reqs_thread_entry: start 2024-09-22T08:42:14.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.000+0000 7f8d378bb800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:14.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.000+0000 7f8d378bb800 20 Filter name: none 2024-09-22T08:42:14.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.000+0000 7f8b5bfff640 20 reqs_thread_entry: start 2024-09-22T08:42:14.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.000+0000 7f8d378bb800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-22T08:42:14.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.002+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.002+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:14.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.002+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.004+0000 7f8d378bb800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-22T08:42:14.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.006+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.006+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:14.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.006+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.007+0000 7f8d378bb800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-22T08:42:14.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.009+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.009+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:14.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.010+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.011+0000 7f8d378bb800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-22T08:42:14.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.012+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.013+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:14.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.013+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.014+0000 7f8d378bb800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-22T08:42:14.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.015+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.016+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:14.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.016+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.017+0000 7f8d378bb800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-22T08:42:14.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.019+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.019+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:14.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.020+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.021+0000 7f8d378bb800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-22T08:42:14.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.022+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.022+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:14.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.023+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.024+0000 7f8d378bb800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-22T08:42:14.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.025+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.026+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:14.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.026+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.027+0000 7f8d378bb800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-22T08:42:14.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.028+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.029+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:14.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.029+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.030+0000 7f8d378bb800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-22T08:42:14.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.032+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.032+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:14.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.032+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.033+0000 7f8d378bb800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-22T08:42:14.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.035+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.035+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:14.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.036+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.037+0000 7f8d378bb800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-22T08:42:14.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.038+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.038+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:14.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.039+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.040+0000 7f8d378bb800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-22T08:42:14.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.041+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.041+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:14.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.042+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.043+0000 7f8d378bb800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-22T08:42:14.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.044+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.044+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:14.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.045+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.046+0000 7f8d378bb800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-22T08:42:14.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.047+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.047+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:14.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.048+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.049+0000 7f8d378bb800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-22T08:42:14.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.050+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.050+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:14.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.050+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.051+0000 7f8d378bb800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-22T08:42:14.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.053+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.053+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:14.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.053+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.055+0000 7f8d378bb800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-22T08:42:14.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.056+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.056+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:14.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.056+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.057+0000 7f8d378bb800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-22T08:42:14.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.058+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.059+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:14.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.059+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.060+0000 7f8d378bb800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-22T08:42:14.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.062+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.062+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:14.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.063+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.064+0000 7f8d378bb800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-22T08:42:14.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.065+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.066+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:14.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.066+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.067+0000 7f8d378bb800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-22T08:42:14.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.068+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.069+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:14.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.069+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.070+0000 7f8d378bb800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-22T08:42:14.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.072+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.072+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:14.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.072+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.073+0000 7f8d378bb800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-22T08:42:14.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.075+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.075+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:14.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.076+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.077+0000 7f8d378bb800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-22T08:42:14.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.078+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.079+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:14.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.079+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.080+0000 7f8d378bb800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-22T08:42:14.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.081+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.082+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:14.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.082+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.083+0000 7f8d378bb800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-22T08:42:14.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.084+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.085+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:14.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.085+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.086+0000 7f8d378bb800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-22T08:42:14.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.087+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.088+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:14.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.088+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.089+0000 7f8d378bb800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-22T08:42:14.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.091+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.092+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:14.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.092+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.093+0000 7f8d378bb800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-22T08:42:14.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.094+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.094+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:14.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.095+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.096+0000 7f8d378bb800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-22T08:42:14.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.097+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.098+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:14.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.098+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.099+0000 7f8d378bb800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-22T08:42:14.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.100+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.100+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:42:14.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.101+0000 7f8d378bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:42:14.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.103+0000 7f8beb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:14.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.105+0000 7f8d378bb800 20 remove_watcher() i=0 2024-09-22T08:42:14.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.105+0000 7f8d378bb800 2 removed watcher, disabling cache 2024-09-22T08:42:14.107 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.106+0000 7f8d378bb800 20 remove_watcher() i=1 2024-09-22T08:42:14.108 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.107+0000 7f8d378bb800 20 remove_watcher() i=2 2024-09-22T08:42:14.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.108+0000 7f8d378bb800 20 remove_watcher() i=3 2024-09-22T08:42:14.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.109+0000 7f8d378bb800 20 remove_watcher() i=4 2024-09-22T08:42:14.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.110+0000 7f8d378bb800 20 remove_watcher() i=5 2024-09-22T08:42:14.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.111+0000 7f8d378bb800 20 remove_watcher() i=6 2024-09-22T08:42:14.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:14.112+0000 7f8d378bb800 20 remove_watcher() i=7 2024-09-22T08:42:14.124 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-22T08:42:14.138 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-22T08:42:14.139 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-22T08:42:14.139 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-22T08:42:14.139 DEBUG:teuthology.orchestra.run.smithi038:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-22T08:42:14.168 INFO:teuthology.orchestra.run.smithi038.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-22T08:42:15.015 INFO:tasks.s3tests:Creating rgw users... 2024-09-22T08:42:15.016 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW11111111111111111 --account-name Mr.RGW11111111111111111 --email RGW11111111111111111+test@test.test 2024-09-22T08:42:15.118 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:15.118 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:15.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.152+0000 7f72c151f800 20 rados->read ofs=0 len=0 2024-09-22T08:42:15.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.153+0000 7f72c151f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:15.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.153+0000 7f72c151f800 20 realm 2024-09-22T08:42:15.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.154+0000 7f72c151f800 20 rados->read ofs=0 len=0 2024-09-22T08:42:15.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.154+0000 7f72c151f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:15.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.154+0000 7f72c151f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:15.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.154+0000 7f72c151f800 20 rados->read ofs=0 len=0 2024-09-22T08:42:15.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.154+0000 7f72c151f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:15.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.154+0000 7f72c151f800 20 rados->read ofs=0 len=0 2024-09-22T08:42:15.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.155+0000 7f72c151f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:15.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.155+0000 7f72c151f800 20 rados->read ofs=0 len=0 2024-09-22T08:42:15.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.156+0000 7f72c151f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:15.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.156+0000 7f72c151f800 20 searching for the correct realm 2024-09-22T08:42:15.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.158+0000 7f72bc991640 0 -- 172.21.15.38:0/2233034138 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f72b4080410 msgr2=0x7f72b4080830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:15.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.162+0000 7f72bc991640 0 -- 172.21.15.38:0/2233034138 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f72b0085560 msgr2=0x7f72b0078460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:15.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.369+0000 7f72c151f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:15.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.369+0000 7f72c151f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:15.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.369+0000 7f72c151f800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:42:15.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.369+0000 7f72c151f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:15.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.369+0000 7f72c151f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:15.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.369+0000 7f72c151f800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:42:15.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.369+0000 7f72c151f800 20 rados->read ofs=0 len=0 2024-09-22T08:42:15.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.369+0000 7f72c151f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:15.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.369+0000 7f72c151f800 20 rados->read ofs=0 len=0 2024-09-22T08:42:15.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.369+0000 7f72c151f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:15.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.369+0000 7f72c151f800 20 rados->read ofs=0 len=0 2024-09-22T08:42:15.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.370+0000 7f72c151f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:15.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.370+0000 7f72c151f800 20 zone default found 2024-09-22T08:42:15.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.370+0000 7f72c151f800 4 Realm: () 2024-09-22T08:42:15.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.370+0000 7f72c151f800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:42:15.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.370+0000 7f72c151f800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:42:15.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.370+0000 7f72c151f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:15.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.370+0000 7f72c151f800 20 zonegroup default 2024-09-22T08:42:15.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.370+0000 7f72c151f800 20 rados->read ofs=0 len=0 2024-09-22T08:42:15.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.370+0000 7f72c151f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:15.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.370+0000 7f72c151f800 20 rados->read ofs=0 len=0 2024-09-22T08:42:15.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.371+0000 7f72c151f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:15.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.371+0000 7f72c151f800 20 rados->read ofs=0 len=0 2024-09-22T08:42:15.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.371+0000 7f72c151f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:15.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.371+0000 7f72c151f800 20 started sync module instance, tier type = 2024-09-22T08:42:15.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.371+0000 7f72c151f800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:42:15.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.382+0000 7f72c151f800 20 add_watcher() i=0 2024-09-22T08:42:15.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.382+0000 7f72c151f800 20 add_watcher() i=1 2024-09-22T08:42:15.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.382+0000 7f72c151f800 20 add_watcher() i=2 2024-09-22T08:42:15.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.382+0000 7f72c151f800 20 add_watcher() i=3 2024-09-22T08:42:15.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.382+0000 7f72c151f800 20 add_watcher() i=4 2024-09-22T08:42:15.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.382+0000 7f72c151f800 20 add_watcher() i=5 2024-09-22T08:42:15.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.382+0000 7f72c151f800 20 add_watcher() i=6 2024-09-22T08:42:15.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.383+0000 7f72c151f800 20 add_watcher() i=7 2024-09-22T08:42:15.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.383+0000 7f72c151f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:15.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.385+0000 7f7173fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:15.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.385+0000 7f72c151f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:15.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.385+0000 7f72c151f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:15.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.385+0000 7f72c151f800 5 note: GC not initialized 2024-09-22T08:42:15.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.385+0000 7f7172fe5640 20 reqs_thread_entry: start 2024-09-22T08:42:15.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.385+0000 7f72c151f800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:15.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.385+0000 7f72c151f800 20 Filter name: none 2024-09-22T08:42:15.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.386+0000 7f7170fe1640 20 reqs_thread_entry: start 2024-09-22T08:42:15.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.386+0000 7f72c151f800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 : miss 2024-09-22T08:42:15.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.386+0000 7f72c151f800 20 rados->read ofs=0 len=0 2024-09-22T08:42:15.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.386+0000 7f72c151f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:15.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.386+0000 7f72c151f800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x0 2024-09-22T08:42:15.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.386+0000 7f72c151f800 10 adding default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-22T08:42:15.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.386+0000 7f72c151f800 20 failed to read name.$Mr.RGW11111111111111111 with: (2) No such file or directory 2024-09-22T08:42:15.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.386+0000 7f72c151f800 10 cache get: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test : miss 2024-09-22T08:42:15.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.386+0000 7f72c151f800 20 rados->read ofs=0 len=0 2024-09-22T08:42:15.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.386+0000 7f72c151f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:15.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.386+0000 7f72c151f800 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x0 2024-09-22T08:42:15.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.386+0000 7f72c151f800 10 adding default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-22T08:42:15.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.386+0000 7f72c151f800 20 failed to read rgw11111111111111111+test@test.test with: (2) No such file or directory 2024-09-22T08:42:15.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.388+0000 7f72c151f800 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-22T08:42:15.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.388+0000 7f72c151f800 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-22T08:42:15.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.388+0000 7f72c151f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW11111111111111111, ofs0, ns] 2024-09-22T08:42:15.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.389+0000 7f71a0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497229 cookie 94275933301312 notifier 8348 bl.length()=384 2024-09-22T08:42:15.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.389+0000 7f71a0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-22T08:42:15.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.389+0000 7f71a0ff9640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-22T08:42:15.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.390+0000 7f72c151f800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-22T08:42:15.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.390+0000 7f72c151f800 10 moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-22T08:42:15.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.390+0000 7f72c151f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW11111111111111111, ofs0, ns] 2024-09-22T08:42:15.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.391+0000 7f718ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497230 cookie 94275933310320 notifier 8348 bl.length()=225 2024-09-22T08:42:15.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.391+0000 7f718ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-22T08:42:15.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.391+0000 7f718ffff640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-22T08:42:15.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.392+0000 7f72c151f800 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-22T08:42:15.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.392+0000 7f72c151f800 10 moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-22T08:42:15.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.392+0000 7f72c151f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw11111111111111111+test@test.test, ofs0, ns] 2024-09-22T08:42:15.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.393+0000 7f718ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497072 cookie 94275933296176 notifier 8348 bl.length()=234 2024-09-22T08:42:15.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.393+0000 7f718ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-22T08:42:15.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.393+0000 7f718ffff640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-22T08:42:15.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.394+0000 7f7173fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:15.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.397+0000 7f72c151f800 20 remove_watcher() i=0 2024-09-22T08:42:15.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.397+0000 7f72c151f800 2 removed watcher, disabling cache 2024-09-22T08:42:15.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.398+0000 7f72c151f800 20 remove_watcher() i=1 2024-09-22T08:42:15.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.399+0000 7f72c151f800 20 remove_watcher() i=2 2024-09-22T08:42:15.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.400+0000 7f72c151f800 20 remove_watcher() i=3 2024-09-22T08:42:15.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.402+0000 7f72c151f800 20 remove_watcher() i=4 2024-09-22T08:42:15.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.403+0000 7f72c151f800 20 remove_watcher() i=5 2024-09-22T08:42:15.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.404+0000 7f72c151f800 20 remove_watcher() i=6 2024-09-22T08:42:15.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.406+0000 7f72c151f800 20 remove_watcher() i=7 2024-09-22T08:42:15.417 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-22T08:42:15.417 INFO:teuthology.orchestra.run.smithi038.stdout: "id": "RGW11111111111111111", 2024-09-22T08:42:15.417 INFO:teuthology.orchestra.run.smithi038.stdout: "tenant": "", 2024-09-22T08:42:15.417 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "Mr.RGW11111111111111111", 2024-09-22T08:42:15.418 INFO:teuthology.orchestra.run.smithi038.stdout: "email": "RGW11111111111111111+test@test.test", 2024-09-22T08:42:15.418 INFO:teuthology.orchestra.run.smithi038.stdout: "quota": { 2024-09-22T08:42:15.418 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-22T08:42:15.418 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-22T08:42:15.418 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-22T08:42:15.418 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-22T08:42:15.418 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-22T08:42:15.418 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-22T08:42:15.418 INFO:teuthology.orchestra.run.smithi038.stdout: "bucket_quota": { 2024-09-22T08:42:15.418 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-22T08:42:15.418 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-22T08:42:15.418 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-22T08:42:15.418 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-22T08:42:15.418 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-22T08:42:15.418 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-22T08:42:15.419 INFO:teuthology.orchestra.run.smithi038.stdout: "max_users": 1000, 2024-09-22T08:42:15.419 INFO:teuthology.orchestra.run.smithi038.stdout: "max_roles": 1000, 2024-09-22T08:42:15.419 INFO:teuthology.orchestra.run.smithi038.stdout: "max_groups": 1000, 2024-09-22T08:42:15.419 INFO:teuthology.orchestra.run.smithi038.stdout: "max_buckets": 1000, 2024-09-22T08:42:15.419 INFO:teuthology.orchestra.run.smithi038.stdout: "max_access_keys": 4 2024-09-22T08:42:15.419 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-22T08:42:15.420 DEBUG:tasks.s3tests:Creating user RGW11111111111111111 on client.0 2024-09-22T08:42:15.420 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.RGW11111111111111111 --email foo+test@test.test --access-key BSHASSVLJLEYFEDEYFDR --secret cH9Y0MsVOVplK3pmEnfddSg9ARo/zkNis33XcKvZNjKQ52dke4pK/A== --cluster ceph --account-id RGW11111111111111111 --account-root 2024-09-22T08:42:15.489 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:15.489 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:15.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.525+0000 7fe368f24800 20 rados->read ofs=0 len=0 2024-09-22T08:42:15.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.527+0000 7fe368f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:15.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.527+0000 7fe368f24800 20 realm 2024-09-22T08:42:15.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.527+0000 7fe368f24800 20 rados->read ofs=0 len=0 2024-09-22T08:42:15.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.527+0000 7fe368f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:15.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.527+0000 7fe368f24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:15.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.527+0000 7fe368f24800 20 rados->read ofs=0 len=0 2024-09-22T08:42:15.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.527+0000 7fe368f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:15.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.527+0000 7fe368f24800 20 rados->read ofs=0 len=0 2024-09-22T08:42:15.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.528+0000 7fe368f24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:15.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.528+0000 7fe368f24800 20 rados->read ofs=0 len=0 2024-09-22T08:42:15.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.528+0000 7fe368f24800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:15.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.529+0000 7fe368f24800 20 searching for the correct realm 2024-09-22T08:42:15.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.529+0000 7fe364b02640 0 -- 172.21.15.38:0/689343570 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x5586b3f9f060 msgr2=0x5586b3fa1520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:15.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.734+0000 7fe364b02640 0 -- 172.21.15.38:0/689343570 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x5586b3f925e0 msgr2=0x5586b3f94a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:15.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.743+0000 7fe368f24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:15.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.743+0000 7fe368f24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:15.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.743+0000 7fe368f24800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:42:15.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.743+0000 7fe368f24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:15.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.743+0000 7fe368f24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:15.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.743+0000 7fe368f24800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:42:15.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.743+0000 7fe368f24800 20 rados->read ofs=0 len=0 2024-09-22T08:42:15.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.743+0000 7fe368f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:15.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.743+0000 7fe368f24800 20 rados->read ofs=0 len=0 2024-09-22T08:42:15.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.743+0000 7fe368f24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:15.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.743+0000 7fe368f24800 20 rados->read ofs=0 len=0 2024-09-22T08:42:15.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.744+0000 7fe368f24800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:15.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.744+0000 7fe368f24800 20 zone default found 2024-09-22T08:42:15.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.744+0000 7fe368f24800 4 Realm: () 2024-09-22T08:42:15.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.744+0000 7fe368f24800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:42:15.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.744+0000 7fe368f24800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:42:15.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.744+0000 7fe368f24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:15.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.744+0000 7fe368f24800 20 zonegroup default 2024-09-22T08:42:15.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.744+0000 7fe368f24800 20 rados->read ofs=0 len=0 2024-09-22T08:42:15.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.744+0000 7fe368f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:15.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.744+0000 7fe368f24800 20 rados->read ofs=0 len=0 2024-09-22T08:42:15.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.744+0000 7fe368f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:15.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.744+0000 7fe368f24800 20 rados->read ofs=0 len=0 2024-09-22T08:42:15.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.745+0000 7fe368f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:15.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.745+0000 7fe368f24800 20 started sync module instance, tier type = 2024-09-22T08:42:15.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.745+0000 7fe368f24800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:42:15.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.756+0000 7fe368f24800 20 add_watcher() i=0 2024-09-22T08:42:15.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.756+0000 7fe368f24800 20 add_watcher() i=1 2024-09-22T08:42:15.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.756+0000 7fe368f24800 20 add_watcher() i=2 2024-09-22T08:42:15.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.756+0000 7fe368f24800 20 add_watcher() i=3 2024-09-22T08:42:15.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.756+0000 7fe368f24800 20 add_watcher() i=4 2024-09-22T08:42:15.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.756+0000 7fe368f24800 20 add_watcher() i=5 2024-09-22T08:42:15.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.756+0000 7fe368f24800 20 add_watcher() i=6 2024-09-22T08:42:15.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.757+0000 7fe368f24800 20 add_watcher() i=7 2024-09-22T08:42:15.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.757+0000 7fe368f24800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:15.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.759+0000 7fe21afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:15.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.759+0000 7fe368f24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:15.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.759+0000 7fe368f24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:15.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.759+0000 7fe368f24800 5 note: GC not initialized 2024-09-22T08:42:15.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.759+0000 7fe219fe3640 20 reqs_thread_entry: start 2024-09-22T08:42:15.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.760+0000 7fe368f24800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:15.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.760+0000 7fe368f24800 20 Filter name: none 2024-09-22T08:42:15.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.760+0000 7fe18b7fe640 20 reqs_thread_entry: start 2024-09-22T08:42:15.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.760+0000 7fe368f24800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-22T08:42:15.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.760+0000 7fe368f24800 20 rados->read ofs=0 len=0 2024-09-22T08:42:15.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.761+0000 7fe368f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:15.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.761+0000 7fe368f24800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-22T08:42:15.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.761+0000 7fe368f24800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-22T08:42:15.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.761+0000 7fe368f24800 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-22T08:42:15.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.761+0000 7fe368f24800 20 rados->read ofs=0 len=0 2024-09-22T08:42:15.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.761+0000 7fe368f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:15.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.761+0000 7fe368f24800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-22T08:42:15.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.761+0000 7fe368f24800 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-22T08:42:15.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.761+0000 7fe368f24800 10 cache get: name=default.rgw.meta+users.keys+BSHASSVLJLEYFEDEYFDR : miss 2024-09-22T08:42:15.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.761+0000 7fe368f24800 20 rados->read ofs=0 len=0 2024-09-22T08:42:15.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.761+0000 7fe368f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:15.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.761+0000 7fe368f24800 10 cache put: name=default.rgw.meta+users.keys+BSHASSVLJLEYFEDEYFDR info.flags=0x0 2024-09-22T08:42:15.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.761+0000 7fe368f24800 10 adding default.rgw.meta+users.keys+BSHASSVLJLEYFEDEYFDR to cache LRU end 2024-09-22T08:42:15.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.761+0000 7fe368f24800 10 cache get: name=default.rgw.meta+accounts+account.RGW11111111111111111 : miss 2024-09-22T08:42:15.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.761+0000 7fe368f24800 20 rados->read ofs=0 len=0 2024-09-22T08:42:15.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.762+0000 7fe368f24800 20 rados_obj.operate() r=0 bl.length=184 2024-09-22T08:42:15.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.762+0000 7fe368f24800 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-22T08:42:15.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.762+0000 7fe368f24800 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-22T08:42:15.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.762+0000 7fe368f24800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:42:15.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.762+0000 7fe368f24800 10 cache get: name=default.rgw.meta+users.keys+BSHASSVLJLEYFEDEYFDR : hit (negative entry) 2024-09-22T08:42:15.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.762+0000 7fe368f24800 10 cache get: name=default.rgw.meta+users.keys+BSHASSVLJLEYFEDEYFDR : hit (negative entry) 2024-09-22T08:42:15.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.763+0000 7fe368f24800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-22T08:42:15.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.763+0000 7fe368f24800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-22T08:42:15.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.763+0000 7fe368f24800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-22T08:42:15.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.764+0000 7fe23bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497053 cookie 94037033434304 notifier 8363 bl.length()=673 2024-09-22T08:42:15.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.764+0000 7fe23bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-22T08:42:15.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.764+0000 7fe23bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-22T08:42:15.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.766+0000 7fe368f24800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-22T08:42:15.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.766+0000 7fe368f24800 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-22T08:42:15.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.766+0000 7fe368f24800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-22T08:42:15.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.766+0000 7fe23b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497231 cookie 94037033501968 notifier 8363 bl.length()=185 2024-09-22T08:42:15.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.766+0000 7fe23b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-22T08:42:15.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.766+0000 7fe23b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-22T08:42:15.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.768+0000 7fe368f24800 10 cache put: name=default.rgw.meta+users.keys+BSHASSVLJLEYFEDEYFDR info.flags=0x7 2024-09-22T08:42:15.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.768+0000 7fe368f24800 10 moving default.rgw.meta+users.keys+BSHASSVLJLEYFEDEYFDR to cache LRU end 2024-09-22T08:42:15.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.768+0000 7fe368f24800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:BSHASSVLJLEYFEDEYFDR, ofs0, ns] 2024-09-22T08:42:15.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.768+0000 7fe23bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497232 cookie 94037033501968 notifier 8363 bl.length()=186 2024-09-22T08:42:15.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.768+0000 7fe23bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+BSHASSVLJLEYFEDEYFDR info.flags=0x7 2024-09-22T08:42:15.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.768+0000 7fe23bfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+BSHASSVLJLEYFEDEYFDR to cache LRU end 2024-09-22T08:42:15.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.770+0000 7fe368f24800 20 linked user foo.client.0 to account RGW11111111111111111 2024-09-22T08:42:15.772 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-22T08:42:15.772 INFO:teuthology.orchestra.run.smithi038.stdout: "user_id": "foo.client.0", 2024-09-22T08:42:15.772 INFO:teuthology.orchestra.run.smithi038.stdout: "display_name": "Mr.RGW11111111111111111", 2024-09-22T08:42:15.772 INFO:teuthology.orchestra.run.smithi038.stdout: "email": "foo+test@test.test", 2024-09-22T08:42:15.772 INFO:teuthology.orchestra.run.smithi038.stdout: "suspended": 0, 2024-09-22T08:42:15.772 INFO:teuthology.orchestra.run.smithi038.stdout: "max_buckets": 1000, 2024-09-22T08:42:15.772 INFO:teuthology.orchestra.run.smithi038.stdout: "subusers": [], 2024-09-22T08:42:15.772 INFO:teuthology.orchestra.run.smithi038.stdout: "keys": [ 2024-09-22T08:42:15.772 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-22T08:42:15.772 INFO:teuthology.orchestra.run.smithi038.stdout: "user": "foo.client.0", 2024-09-22T08:42:15.773 INFO:teuthology.orchestra.run.smithi038.stdout: "access_key": "BSHASSVLJLEYFEDEYFDR", 2024-09-22T08:42:15.773 INFO:teuthology.orchestra.run.smithi038.stdout: "secret_key": "cH9Y0MsVOVplK3pmEnfddSg9ARo/zkNis33XcKvZNjKQ52dke4pK/A==", 2024-09-22T08:42:15.773 INFO:teuthology.orchestra.run.smithi038.stdout: "active": true, 2024-09-22T08:42:15.773 INFO:teuthology.orchestra.run.smithi038.stdout: "create_date": "2024-09-22T08:42:15.763983Z" 2024-09-22T08:42:15.773 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-22T08:42:15.773 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-22T08:42:15.773 INFO:teuthology.orchestra.run.smithi038.stdout: "swift_keys": [], 2024-09-22T08:42:15.773 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": [], 2024-09-22T08:42:15.773 INFO:teuthology.orchestra.run.smithi038.stdout: "op_mask": "read, write, delete", 2024-09-22T08:42:15.773 INFO:teuthology.orchestra.run.smithi038.stdout: "default_placement": "", 2024-09-22T08:42:15.773 INFO:teuthology.orchestra.run.smithi038.stdout: "default_storage_class": "", 2024-09-22T08:42:15.773 INFO:teuthology.orchestra.run.smithi038.stdout: "placement_tags": [], 2024-09-22T08:42:15.773 INFO:teuthology.orchestra.run.smithi038.stdout: "bucket_quota": { 2024-09-22T08:42:15.773 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-22T08:42:15.773 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-22T08:42:15.774 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-22T08:42:15.774 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-22T08:42:15.774 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-22T08:42:15.774 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-22T08:42:15.774 INFO:teuthology.orchestra.run.smithi038.stdout: "user_quota": { 2024-09-22T08:42:15.774 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-22T08:42:15.774 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-22T08:42:15.774 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-22T08:42:15.774 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-22T08:42:15.774 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-22T08:42:15.774 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-22T08:42:15.774 INFO:teuthology.orchestra.run.smithi038.stdout: "temp_url_keys": [], 2024-09-22T08:42:15.774 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "root", 2024-09-22T08:42:15.774 INFO:teuthology.orchestra.run.smithi038.stdout: "mfa_ids": [], 2024-09-22T08:42:15.775 INFO:teuthology.orchestra.run.smithi038.stdout: "account_id": "RGW11111111111111111", 2024-09-22T08:42:15.775 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-22T08:42:15.775 INFO:teuthology.orchestra.run.smithi038.stdout: "create_date": "2024-09-22T08:42:15.763971Z", 2024-09-22T08:42:15.775 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-22T08:42:15.775 INFO:teuthology.orchestra.run.smithi038.stdout: "group_ids": [] 2024-09-22T08:42:15.775 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-22T08:42:15.775 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:15.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.771+0000 7fe21afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:15.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.773+0000 7fe368f24800 20 remove_watcher() i=0 2024-09-22T08:42:15.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.773+0000 7fe368f24800 2 removed watcher, disabling cache 2024-09-22T08:42:15.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.774+0000 7fe368f24800 20 remove_watcher() i=1 2024-09-22T08:42:15.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.775+0000 7fe368f24800 20 remove_watcher() i=2 2024-09-22T08:42:15.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.777+0000 7fe368f24800 20 remove_watcher() i=3 2024-09-22T08:42:15.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.778+0000 7fe368f24800 20 remove_watcher() i=4 2024-09-22T08:42:15.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.779+0000 7fe368f24800 20 remove_watcher() i=5 2024-09-22T08:42:15.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.780+0000 7fe368f24800 20 remove_watcher() i=6 2024-09-22T08:42:15.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.781+0000 7fe368f24800 20 remove_watcher() i=7 2024-09-22T08:42:15.795 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 6019303843 --totp-seed TNY6NUFTP7JVNXI6L3N7NH3DRSND6UPPXWKUZC7WD3RCX52ME4HOBFZ6NWBFDJDS --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-22T08:42:15.863 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:15.863 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:15.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.897+0000 7ffa2c096800 20 rados->read ofs=0 len=0 2024-09-22T08:42:15.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.899+0000 7ffa2c096800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:15.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.899+0000 7ffa2c096800 20 realm 2024-09-22T08:42:15.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.899+0000 7ffa2c096800 20 rados->read ofs=0 len=0 2024-09-22T08:42:15.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.899+0000 7ffa2c096800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:15.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.899+0000 7ffa2c096800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:15.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.899+0000 7ffa2c096800 20 rados->read ofs=0 len=0 2024-09-22T08:42:15.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.899+0000 7ffa2c096800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:15.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.899+0000 7ffa2c096800 20 rados->read ofs=0 len=0 2024-09-22T08:42:15.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.900+0000 7ffa2c096800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:15.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.900+0000 7ffa2c096800 20 rados->read ofs=0 len=0 2024-09-22T08:42:15.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.901+0000 7ffa2c096800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:15.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.901+0000 7ffa2c096800 20 searching for the correct realm 2024-09-22T08:42:15.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.903+0000 7ffa29b80640 0 -- 172.21.15.38:0/2308593992 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x564613b92410 msgr2=0x564613b948d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:15.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:15.907+0000 7ffa2937f640 0 -- 172.21.15.38:0/2308593992 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7ffa1c022910 msgr2=0x7ffa1c03e3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:16.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.113+0000 7ffa2c096800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:16.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.113+0000 7ffa2c096800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:16.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.113+0000 7ffa2c096800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:42:16.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.113+0000 7ffa2c096800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:16.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.113+0000 7ffa2c096800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:16.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.113+0000 7ffa2c096800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:42:16.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.113+0000 7ffa2c096800 20 rados->read ofs=0 len=0 2024-09-22T08:42:16.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.114+0000 7ffa2c096800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:16.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.114+0000 7ffa2c096800 20 rados->read ofs=0 len=0 2024-09-22T08:42:16.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.114+0000 7ffa2c096800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:16.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.114+0000 7ffa2c096800 20 rados->read ofs=0 len=0 2024-09-22T08:42:16.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.115+0000 7ffa2c096800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:16.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.115+0000 7ffa2c096800 20 zone default found 2024-09-22T08:42:16.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.115+0000 7ffa2c096800 4 Realm: () 2024-09-22T08:42:16.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.115+0000 7ffa2c096800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:42:16.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.115+0000 7ffa2c096800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:42:16.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.115+0000 7ffa2c096800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:16.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.115+0000 7ffa2c096800 20 zonegroup default 2024-09-22T08:42:16.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.115+0000 7ffa2c096800 20 rados->read ofs=0 len=0 2024-09-22T08:42:16.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.115+0000 7ffa2c096800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:16.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.115+0000 7ffa2c096800 20 rados->read ofs=0 len=0 2024-09-22T08:42:16.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.115+0000 7ffa2c096800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:16.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.115+0000 7ffa2c096800 20 rados->read ofs=0 len=0 2024-09-22T08:42:16.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.116+0000 7ffa2c096800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:16.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.116+0000 7ffa2c096800 20 started sync module instance, tier type = 2024-09-22T08:42:16.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.116+0000 7ffa2c096800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:42:16.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.126+0000 7ffa2c096800 20 add_watcher() i=0 2024-09-22T08:42:16.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.126+0000 7ffa2c096800 20 add_watcher() i=1 2024-09-22T08:42:16.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.126+0000 7ffa2c096800 20 add_watcher() i=2 2024-09-22T08:42:16.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.126+0000 7ffa2c096800 20 add_watcher() i=3 2024-09-22T08:42:16.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.126+0000 7ffa2c096800 20 add_watcher() i=4 2024-09-22T08:42:16.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.126+0000 7ffa2c096800 20 add_watcher() i=5 2024-09-22T08:42:16.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.126+0000 7ffa2c096800 20 add_watcher() i=6 2024-09-22T08:42:16.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.128+0000 7ffa2c096800 20 add_watcher() i=7 2024-09-22T08:42:16.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.128+0000 7ffa2c096800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:16.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.129+0000 7ff8db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:16.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.130+0000 7ffa2c096800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:16.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.130+0000 7ffa2c096800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:16.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.130+0000 7ffa2c096800 5 note: GC not initialized 2024-09-22T08:42:16.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.130+0000 7ff8da7fc640 20 reqs_thread_entry: start 2024-09-22T08:42:16.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.130+0000 7ffa2c096800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:16.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.130+0000 7ffa2c096800 20 Filter name: none 2024-09-22T08:42:16.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.130+0000 7ff84bfff640 20 reqs_thread_entry: start 2024-09-22T08:42:16.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.130+0000 7ffa2c096800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-22T08:42:16.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.130+0000 7ffa2c096800 20 rados->read ofs=0 len=0 2024-09-22T08:42:16.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.131+0000 7ffa2c096800 20 rados_obj.operate() r=0 bl.length=488 2024-09-22T08:42:16.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.131+0000 7ffa2c096800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-22T08:42:16.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.131+0000 7ffa2c096800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-22T08:42:16.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:16.131+0000 7ffa2c096800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:42:17.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.434+0000 7ffa2c096800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-22T08:42:17.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.434+0000 7ffa2c096800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-22T08:42:17.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.434+0000 7ffa2c096800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-22T08:42:17.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.435+0000 7ff90cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431646 cookie 94858978605840 notifier 8988 bl.length()=687 2024-09-22T08:42:17.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.435+0000 7ff90cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-22T08:42:17.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.435+0000 7ff90cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-22T08:42:17.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.437+0000 7ff8db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:17.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.440+0000 7ffa2c096800 20 remove_watcher() i=0 2024-09-22T08:42:17.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.440+0000 7ffa2c096800 2 removed watcher, disabling cache 2024-09-22T08:42:17.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.441+0000 7ffa2c096800 20 remove_watcher() i=1 2024-09-22T08:42:17.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.442+0000 7ffa2c096800 20 remove_watcher() i=2 2024-09-22T08:42:17.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.444+0000 7ffa2c096800 20 remove_watcher() i=3 2024-09-22T08:42:17.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.445+0000 7ffa2c096800 20 remove_watcher() i=4 2024-09-22T08:42:17.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.446+0000 7ffa2c096800 20 remove_watcher() i=5 2024-09-22T08:42:17.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.447+0000 7ffa2c096800 20 remove_watcher() i=6 2024-09-22T08:42:17.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.449+0000 7ffa2c096800 20 remove_watcher() i=7 2024-09-22T08:42:17.464 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-22T08:42:17.464 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key YQISCORZSHLRAWHEXQNT --secret Xn8dnBWhcoYxr/fNIhYDcwJuRbhbB0th9XSVfwfLnB0EagykH1lOrg== --cluster ceph 2024-09-22T08:42:17.534 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:17.534 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:17.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.569+0000 7f96c3c11800 20 rados->read ofs=0 len=0 2024-09-22T08:42:17.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.571+0000 7f96c3c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:17.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.571+0000 7f96c3c11800 20 realm 2024-09-22T08:42:17.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.571+0000 7f96c3c11800 20 rados->read ofs=0 len=0 2024-09-22T08:42:17.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.571+0000 7f96c3c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:17.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.571+0000 7f96c3c11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:17.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.571+0000 7f96c3c11800 20 rados->read ofs=0 len=0 2024-09-22T08:42:17.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.571+0000 7f96c3c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:17.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.571+0000 7f96c3c11800 20 rados->read ofs=0 len=0 2024-09-22T08:42:17.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.572+0000 7f96c3c11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:17.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.572+0000 7f96c3c11800 20 rados->read ofs=0 len=0 2024-09-22T08:42:17.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.573+0000 7f96c3c11800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:17.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.573+0000 7f96c3c11800 20 searching for the correct realm 2024-09-22T08:42:17.577 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.575+0000 7f96beb47640 0 -- 172.21.15.38:0/349671004 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f96b403a400 msgr2=0x7f96b403a880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:17.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.782+0000 7f96beb47640 0 -- 172.21.15.38:0/349671004 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f96b0061ba0 msgr2=0x7f96b006a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:17.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.990+0000 7f96c3c11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:17.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.990+0000 7f96c3c11800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:17.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.990+0000 7f96c3c11800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:42:17.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.990+0000 7f96c3c11800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:17.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.990+0000 7f96c3c11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:17.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.990+0000 7f96c3c11800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:42:17.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.990+0000 7f96c3c11800 20 rados->read ofs=0 len=0 2024-09-22T08:42:17.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.990+0000 7f96c3c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:17.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.990+0000 7f96c3c11800 20 rados->read ofs=0 len=0 2024-09-22T08:42:17.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.991+0000 7f96c3c11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:17.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.991+0000 7f96c3c11800 20 rados->read ofs=0 len=0 2024-09-22T08:42:17.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.991+0000 7f96c3c11800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:17.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.992+0000 7f96c3c11800 20 zone default found 2024-09-22T08:42:17.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.992+0000 7f96c3c11800 4 Realm: () 2024-09-22T08:42:17.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.992+0000 7f96c3c11800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:42:17.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.992+0000 7f96c3c11800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:42:17.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.992+0000 7f96c3c11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:17.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.992+0000 7f96c3c11800 20 zonegroup default 2024-09-22T08:42:17.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.992+0000 7f96c3c11800 20 rados->read ofs=0 len=0 2024-09-22T08:42:17.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.992+0000 7f96c3c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:17.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.992+0000 7f96c3c11800 20 rados->read ofs=0 len=0 2024-09-22T08:42:17.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.992+0000 7f96c3c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:17.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.992+0000 7f96c3c11800 20 rados->read ofs=0 len=0 2024-09-22T08:42:17.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.993+0000 7f96c3c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:17.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.993+0000 7f96c3c11800 20 started sync module instance, tier type = 2024-09-22T08:42:17.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:17.993+0000 7f96c3c11800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:42:18.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.004+0000 7f96c3c11800 20 add_watcher() i=0 2024-09-22T08:42:18.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.004+0000 7f96c3c11800 20 add_watcher() i=1 2024-09-22T08:42:18.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.004+0000 7f96c3c11800 20 add_watcher() i=2 2024-09-22T08:42:18.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.004+0000 7f96c3c11800 20 add_watcher() i=3 2024-09-22T08:42:18.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.004+0000 7f96c3c11800 20 add_watcher() i=4 2024-09-22T08:42:18.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.004+0000 7f96c3c11800 20 add_watcher() i=5 2024-09-22T08:42:18.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.004+0000 7f96c3c11800 20 add_watcher() i=6 2024-09-22T08:42:18.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.005+0000 7f96c3c11800 20 add_watcher() i=7 2024-09-22T08:42:18.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.005+0000 7f96c3c11800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:18.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.007+0000 7f9575fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:18.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.008+0000 7f96c3c11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:18.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.008+0000 7f96c3c11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:18.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.008+0000 7f96c3c11800 5 note: GC not initialized 2024-09-22T08:42:18.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.008+0000 7f9574fe1640 20 reqs_thread_entry: start 2024-09-22T08:42:18.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.008+0000 7f96c3c11800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:18.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.008+0000 7f96c3c11800 20 Filter name: none 2024-09-22T08:42:18.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.008+0000 7f94ee7fc640 20 reqs_thread_entry: start 2024-09-22T08:42:18.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.008+0000 7f96c3c11800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-22T08:42:18.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.008+0000 7f96c3c11800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.009+0000 7f96c3c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:18.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.009+0000 7f96c3c11800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-22T08:42:18.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.009+0000 7f96c3c11800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-22T08:42:18.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.009+0000 7f96c3c11800 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-22T08:42:18.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.009+0000 7f96c3c11800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.009+0000 7f96c3c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:18.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.010+0000 7f96c3c11800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-22T08:42:18.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.010+0000 7f96c3c11800 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-22T08:42:18.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.010+0000 7f96c3c11800 10 cache get: name=default.rgw.meta+users.keys+YQISCORZSHLRAWHEXQNT : miss 2024-09-22T08:42:18.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.010+0000 7f96c3c11800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.010+0000 7f96c3c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:18.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.010+0000 7f96c3c11800 10 cache put: name=default.rgw.meta+users.keys+YQISCORZSHLRAWHEXQNT info.flags=0x0 2024-09-22T08:42:18.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.010+0000 7f96c3c11800 10 adding default.rgw.meta+users.keys+YQISCORZSHLRAWHEXQNT to cache LRU end 2024-09-22T08:42:18.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.010+0000 7f96c3c11800 10 cache get: name=default.rgw.meta+users.keys+YQISCORZSHLRAWHEXQNT : hit (negative entry) 2024-09-22T08:42:18.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.010+0000 7f96c3c11800 10 cache get: name=default.rgw.meta+users.keys+YQISCORZSHLRAWHEXQNT : hit (negative entry) 2024-09-22T08:42:18.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.011+0000 7f96c3c11800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-22T08:42:18.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.011+0000 7f96c3c11800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-22T08:42:18.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.011+0000 7f96c3c11800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-22T08:42:18.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.011+0000 7f95a2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431825 cookie 94508302561296 notifier 8399 bl.length()=645 2024-09-22T08:42:18.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.012+0000 7f95a2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-22T08:42:18.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.012+0000 7f95a2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-22T08:42:18.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.014+0000 7f96c3c11800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-22T08:42:18.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.014+0000 7f96c3c11800 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-22T08:42:18.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.014+0000 7f96c3c11800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-22T08:42:18.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.014+0000 7f95a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431781 cookie 94508302572000 notifier 8399 bl.length()=185 2024-09-22T08:42:18.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.014+0000 7f95a27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-22T08:42:18.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.014+0000 7f95a27fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-22T08:42:18.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.016+0000 7f96c3c11800 10 cache put: name=default.rgw.meta+users.keys+YQISCORZSHLRAWHEXQNT info.flags=0x7 2024-09-22T08:42:18.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.016+0000 7f96c3c11800 10 moving default.rgw.meta+users.keys+YQISCORZSHLRAWHEXQNT to cache LRU end 2024-09-22T08:42:18.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.016+0000 7f96c3c11800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:YQISCORZSHLRAWHEXQNT, ofs0, ns] 2024-09-22T08:42:18.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.016+0000 7f95a2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431782 cookie 94508302573664 notifier 8399 bl.length()=186 2024-09-22T08:42:18.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.016+0000 7f95a2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+YQISCORZSHLRAWHEXQNT info.flags=0x7 2024-09-22T08:42:18.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.016+0000 7f95a2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+YQISCORZSHLRAWHEXQNT to cache LRU end 2024-09-22T08:42:18.019 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-22T08:42:18.019 INFO:teuthology.orchestra.run.smithi038.stdout: "user_id": "bar.client.0", 2024-09-22T08:42:18.019 INFO:teuthology.orchestra.run.smithi038.stdout: "display_name": "Mr.bar.client.0", 2024-09-22T08:42:18.019 INFO:teuthology.orchestra.run.smithi038.stdout: "email": "bar+test@test.test", 2024-09-22T08:42:18.019 INFO:teuthology.orchestra.run.smithi038.stdout: "suspended": 0, 2024-09-22T08:42:18.019 INFO:teuthology.orchestra.run.smithi038.stdout: "max_buckets": 1000, 2024-09-22T08:42:18.019 INFO:teuthology.orchestra.run.smithi038.stdout: "subusers": [], 2024-09-22T08:42:18.019 INFO:teuthology.orchestra.run.smithi038.stdout: "keys": [ 2024-09-22T08:42:18.020 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-22T08:42:18.020 INFO:teuthology.orchestra.run.smithi038.stdout: "user": "bar.client.0", 2024-09-22T08:42:18.020 INFO:teuthology.orchestra.run.smithi038.stdout: "access_key": "YQISCORZSHLRAWHEXQNT", 2024-09-22T08:42:18.020 INFO:teuthology.orchestra.run.smithi038.stdout: "secret_key": "Xn8dnBWhcoYxr/fNIhYDcwJuRbhbB0th9XSVfwfLnB0EagykH1lOrg==", 2024-09-22T08:42:18.020 INFO:teuthology.orchestra.run.smithi038.stdout: "active": true, 2024-09-22T08:42:18.020 INFO:teuthology.orchestra.run.smithi038.stdout: "create_date": "2024-09-22T08:42:18.012149Z" 2024-09-22T08:42:18.020 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-22T08:42:18.020 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-22T08:42:18.020 INFO:teuthology.orchestra.run.smithi038.stdout: "swift_keys": [], 2024-09-22T08:42:18.020 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": [], 2024-09-22T08:42:18.020 INFO:teuthology.orchestra.run.smithi038.stdout: "op_mask": "read, write, delete", 2024-09-22T08:42:18.020 INFO:teuthology.orchestra.run.smithi038.stdout: "default_placement": "", 2024-09-22T08:42:18.020 INFO:teuthology.orchestra.run.smithi038.stdout: "default_storage_class": "", 2024-09-22T08:42:18.020 INFO:teuthology.orchestra.run.smithi038.stdout: "placement_tags": [], 2024-09-22T08:42:18.020 INFO:teuthology.orchestra.run.smithi038.stdout: "bucket_quota": { 2024-09-22T08:42:18.021 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-22T08:42:18.021 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-22T08:42:18.021 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-22T08:42:18.021 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-22T08:42:18.021 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-22T08:42:18.021 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-22T08:42:18.021 INFO:teuthology.orchestra.run.smithi038.stdout: "user_quota": { 2024-09-22T08:42:18.021 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-22T08:42:18.021 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-22T08:42:18.021 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-22T08:42:18.021 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-22T08:42:18.021 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-22T08:42:18.021 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-22T08:42:18.021 INFO:teuthology.orchestra.run.smithi038.stdout: "temp_url_keys": [], 2024-09-22T08:42:18.021 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "rgw", 2024-09-22T08:42:18.022 INFO:teuthology.orchestra.run.smithi038.stdout: "mfa_ids": [], 2024-09-22T08:42:18.022 INFO:teuthology.orchestra.run.smithi038.stdout: "account_id": "", 2024-09-22T08:42:18.022 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-22T08:42:18.022 INFO:teuthology.orchestra.run.smithi038.stdout: "create_date": "2024-09-22T08:42:18.012130Z", 2024-09-22T08:42:18.022 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-22T08:42:18.022 INFO:teuthology.orchestra.run.smithi038.stdout: "group_ids": [] 2024-09-22T08:42:18.022 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-22T08:42:18.022 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:18.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.018+0000 7f9575fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:18.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.020+0000 7f96c3c11800 20 remove_watcher() i=0 2024-09-22T08:42:18.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.020+0000 7f96c3c11800 2 removed watcher, disabling cache 2024-09-22T08:42:18.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.021+0000 7f96c3c11800 20 remove_watcher() i=1 2024-09-22T08:42:18.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.023+0000 7f96c3c11800 20 remove_watcher() i=2 2024-09-22T08:42:18.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.024+0000 7f96c3c11800 20 remove_watcher() i=3 2024-09-22T08:42:18.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.025+0000 7f96c3c11800 20 remove_watcher() i=4 2024-09-22T08:42:18.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.026+0000 7f96c3c11800 20 remove_watcher() i=5 2024-09-22T08:42:18.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.028+0000 7f96c3c11800 20 remove_watcher() i=6 2024-09-22T08:42:18.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.029+0000 7f96c3c11800 20 remove_watcher() i=7 2024-09-22T08:42:18.044 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 8986219877 --totp-seed GLGLMKAUHKK25S32QZKREKZT2Y4ORPPQDMPG4VNJEFSTIMSYCKU7HNFRYFNTHO7G --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-22T08:42:18.115 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:18.115 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:18.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.152+0000 7f5608c15800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.153+0000 7f5608c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:18.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.153+0000 7f5608c15800 20 realm 2024-09-22T08:42:18.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.153+0000 7f5608c15800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.154+0000 7f5608c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:18.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.154+0000 7f5608c15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:18.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.154+0000 7f5608c15800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.154+0000 7f5608c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:18.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.154+0000 7f5608c15800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.155+0000 7f5608c15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:18.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.155+0000 7f5608c15800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.155+0000 7f5608c15800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:18.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.155+0000 7f5608c15800 20 searching for the correct realm 2024-09-22T08:42:18.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.156+0000 7f5604392640 0 -- 172.21.15.38:0/1265697388 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x55752738e7a0 msgr2=0x557527390c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:18.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.362+0000 7f5604392640 0 -- 172.21.15.38:0/1265697388 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x557527381d00 msgr2=0x557527384170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:18.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.370+0000 7f5608c15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:18.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.370+0000 7f5608c15800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:18.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.370+0000 7f5608c15800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:42:18.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.370+0000 7f5608c15800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:18.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.370+0000 7f5608c15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:18.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.370+0000 7f5608c15800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:42:18.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.370+0000 7f5608c15800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.370+0000 7f5608c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:18.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.370+0000 7f5608c15800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.371+0000 7f5608c15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:18.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.371+0000 7f5608c15800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.371+0000 7f5608c15800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:18.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.371+0000 7f5608c15800 20 zone default found 2024-09-22T08:42:18.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.371+0000 7f5608c15800 4 Realm: () 2024-09-22T08:42:18.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.371+0000 7f5608c15800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:42:18.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.371+0000 7f5608c15800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:42:18.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.371+0000 7f5608c15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:18.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.371+0000 7f5608c15800 20 zonegroup default 2024-09-22T08:42:18.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.371+0000 7f5608c15800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.372+0000 7f5608c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:18.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.372+0000 7f5608c15800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.372+0000 7f5608c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:18.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.372+0000 7f5608c15800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.372+0000 7f5608c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:18.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.372+0000 7f5608c15800 20 started sync module instance, tier type = 2024-09-22T08:42:18.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.372+0000 7f5608c15800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:42:18.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.382+0000 7f5608c15800 20 add_watcher() i=0 2024-09-22T08:42:18.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.382+0000 7f5608c15800 20 add_watcher() i=1 2024-09-22T08:42:18.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.382+0000 7f5608c15800 20 add_watcher() i=2 2024-09-22T08:42:18.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.382+0000 7f5608c15800 20 add_watcher() i=3 2024-09-22T08:42:18.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.382+0000 7f5608c15800 20 add_watcher() i=4 2024-09-22T08:42:18.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.382+0000 7f5608c15800 20 add_watcher() i=5 2024-09-22T08:42:18.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.382+0000 7f5608c15800 20 add_watcher() i=6 2024-09-22T08:42:18.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.383+0000 7f5608c15800 20 add_watcher() i=7 2024-09-22T08:42:18.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.383+0000 7f5608c15800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:18.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.385+0000 7f54bafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:18.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.385+0000 7f5608c15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:18.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.385+0000 7f5608c15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:18.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.385+0000 7f5608c15800 5 note: GC not initialized 2024-09-22T08:42:18.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.385+0000 7f54b9fdb640 20 reqs_thread_entry: start 2024-09-22T08:42:18.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.385+0000 7f5608c15800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:18.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.385+0000 7f5608c15800 20 Filter name: none 2024-09-22T08:42:18.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.386+0000 7f542b7fe640 20 reqs_thread_entry: start 2024-09-22T08:42:18.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.386+0000 7f5608c15800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-22T08:42:18.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.386+0000 7f5608c15800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.386+0000 7f5608c15800 20 rados_obj.operate() r=0 bl.length=460 2024-09-22T08:42:18.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.386+0000 7f5608c15800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-22T08:42:18.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.386+0000 7f5608c15800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-22T08:42:18.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.386+0000 7f5608c15800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:42:18.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.389+0000 7f5608c15800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-22T08:42:18.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.389+0000 7f5608c15800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-22T08:42:18.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.389+0000 7f5608c15800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-22T08:42:18.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.389+0000 7f54db7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431826 cookie 93961657531376 notifier 9024 bl.length()=659 2024-09-22T08:42:18.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.389+0000 7f54db7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-22T08:42:18.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.389+0000 7f54db7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-22T08:42:18.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.391+0000 7f54bafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:18.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.393+0000 7f5608c15800 20 remove_watcher() i=0 2024-09-22T08:42:18.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.393+0000 7f5608c15800 2 removed watcher, disabling cache 2024-09-22T08:42:18.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.394+0000 7f5608c15800 20 remove_watcher() i=1 2024-09-22T08:42:18.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.395+0000 7f5608c15800 20 remove_watcher() i=2 2024-09-22T08:42:18.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.397+0000 7f5608c15800 20 remove_watcher() i=3 2024-09-22T08:42:18.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.398+0000 7f5608c15800 20 remove_watcher() i=4 2024-09-22T08:42:18.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.399+0000 7f5608c15800 20 remove_watcher() i=5 2024-09-22T08:42:18.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.400+0000 7f5608c15800 20 remove_watcher() i=6 2024-09-22T08:42:18.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.401+0000 7f5608c15800 20 remove_watcher() i=7 2024-09-22T08:42:18.415 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW33333333333333333 --account-name Mr.RGW33333333333333333 --email RGW33333333333333333+test@test.test --tenant testx 2024-09-22T08:42:18.482 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:18.482 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:18.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.530+0000 7f5052573800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.532+0000 7f5052573800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:18.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.532+0000 7f5052573800 20 realm 2024-09-22T08:42:18.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.532+0000 7f5052573800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.532+0000 7f5052573800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:18.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.532+0000 7f5052573800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:18.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.532+0000 7f5052573800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.533+0000 7f5052573800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:18.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.533+0000 7f5052573800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.533+0000 7f5052573800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:18.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.533+0000 7f5052573800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.534+0000 7f5052573800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:18.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.534+0000 7f5052573800 20 searching for the correct realm 2024-09-22T08:42:18.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.536+0000 7f504f85c640 0 -- 172.21.15.38:0/651061878 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f5044074020 msgr2=0x7f5044059860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:18.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.746+0000 7f504f85c640 0 -- 172.21.15.38:0/651061878 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f5040041430 msgr2=0x7f5040041890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:18.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.953+0000 7f5052573800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:18.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.953+0000 7f5052573800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:18.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.953+0000 7f5052573800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:42:18.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.953+0000 7f5052573800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:18.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.953+0000 7f5052573800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:18.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.953+0000 7f5052573800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:42:18.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.953+0000 7f5052573800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.953+0000 7f5052573800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:18.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.953+0000 7f5052573800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.954+0000 7f5052573800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:18.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.954+0000 7f5052573800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.954+0000 7f5052573800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:18.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.954+0000 7f5052573800 20 zone default found 2024-09-22T08:42:18.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.954+0000 7f5052573800 4 Realm: () 2024-09-22T08:42:18.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.954+0000 7f5052573800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:42:18.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.954+0000 7f5052573800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:42:18.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.954+0000 7f5052573800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:18.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.954+0000 7f5052573800 20 zonegroup default 2024-09-22T08:42:18.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.954+0000 7f5052573800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.955+0000 7f5052573800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:18.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.955+0000 7f5052573800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.955+0000 7f5052573800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:18.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.955+0000 7f5052573800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.955+0000 7f5052573800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:18.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.955+0000 7f5052573800 20 started sync module instance, tier type = 2024-09-22T08:42:18.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.955+0000 7f5052573800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:42:18.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.967+0000 7f5052573800 20 add_watcher() i=0 2024-09-22T08:42:18.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.967+0000 7f5052573800 20 add_watcher() i=1 2024-09-22T08:42:18.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.967+0000 7f5052573800 20 add_watcher() i=2 2024-09-22T08:42:18.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.967+0000 7f5052573800 20 add_watcher() i=3 2024-09-22T08:42:18.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.967+0000 7f5052573800 20 add_watcher() i=4 2024-09-22T08:42:18.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.967+0000 7f5052573800 20 add_watcher() i=5 2024-09-22T08:42:18.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.967+0000 7f5052573800 20 add_watcher() i=6 2024-09-22T08:42:18.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.968+0000 7f5052573800 20 add_watcher() i=7 2024-09-22T08:42:18.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.968+0000 7f5052573800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:18.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.970+0000 7f4f06fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:18.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.970+0000 7f5052573800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:18.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.970+0000 7f5052573800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:18.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.970+0000 7f5052573800 5 note: GC not initialized 2024-09-22T08:42:18.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.970+0000 7f4f05fdb640 20 reqs_thread_entry: start 2024-09-22T08:42:18.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.970+0000 7f5052573800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:18.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.970+0000 7f5052573800 20 Filter name: none 2024-09-22T08:42:18.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.971+0000 7f4e777fe640 20 reqs_thread_entry: start 2024-09-22T08:42:18.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.971+0000 7f5052573800 10 cache get: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 : miss 2024-09-22T08:42:18.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.971+0000 7f5052573800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.971+0000 7f5052573800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:18.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.971+0000 7f5052573800 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x0 2024-09-22T08:42:18.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.971+0000 7f5052573800 10 adding default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-22T08:42:18.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.971+0000 7f5052573800 20 failed to read name.testx$Mr.RGW33333333333333333 with: (2) No such file or directory 2024-09-22T08:42:18.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.971+0000 7f5052573800 10 cache get: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test : miss 2024-09-22T08:42:18.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.971+0000 7f5052573800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.971+0000 7f5052573800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:18.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.971+0000 7f5052573800 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x0 2024-09-22T08:42:18.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.971+0000 7f5052573800 10 adding default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-22T08:42:18.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.971+0000 7f5052573800 20 failed to read rgw33333333333333333+test@test.test with: (2) No such file or directory 2024-09-22T08:42:18.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.973+0000 7f5052573800 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-22T08:42:18.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.973+0000 7f5052573800 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-22T08:42:18.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.973+0000 7f5052573800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW33333333333333333, ofs0, ns] 2024-09-22T08:42:18.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.974+0000 7f4f277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399123 cookie 94918275933728 notifier 9045 bl.length()=389 2024-09-22T08:42:18.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.974+0000 7f4f277fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-22T08:42:18.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.974+0000 7f4f277fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-22T08:42:18.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.976+0000 7f5052573800 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-22T08:42:18.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.976+0000 7f5052573800 10 moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-22T08:42:18.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.976+0000 7f5052573800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.testx$Mr.RGW33333333333333333, ofs0, ns] 2024-09-22T08:42:18.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.976+0000 7f4f277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399124 cookie 94918275942352 notifier 9045 bl.length()=230 2024-09-22T08:42:18.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.976+0000 7f4f277fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-22T08:42:18.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.976+0000 7f4f277fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-22T08:42:18.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.978+0000 7f5052573800 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-22T08:42:18.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.978+0000 7f5052573800 10 moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-22T08:42:18.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.978+0000 7f5052573800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw33333333333333333+test@test.test, ofs0, ns] 2024-09-22T08:42:18.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.978+0000 7f4f277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398961 cookie 94918275940256 notifier 9045 bl.length()=234 2024-09-22T08:42:18.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.978+0000 7f4f277fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-22T08:42:18.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.978+0000 7f4f277fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-22T08:42:18.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.980+0000 7f4f06fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:18.985 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.983+0000 7f5052573800 20 remove_watcher() i=0 2024-09-22T08:42:18.985 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.983+0000 7f5052573800 2 removed watcher, disabling cache 2024-09-22T08:42:18.986 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.984+0000 7f5052573800 20 remove_watcher() i=1 2024-09-22T08:42:18.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.985+0000 7f5052573800 20 remove_watcher() i=2 2024-09-22T08:42:18.989 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.987+0000 7f5052573800 20 remove_watcher() i=3 2024-09-22T08:42:18.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.988+0000 7f5052573800 20 remove_watcher() i=4 2024-09-22T08:42:18.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.989+0000 7f5052573800 20 remove_watcher() i=5 2024-09-22T08:42:18.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.990+0000 7f5052573800 20 remove_watcher() i=6 2024-09-22T08:42:18.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:18.992+0000 7f5052573800 20 remove_watcher() i=7 2024-09-22T08:42:19.004 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-22T08:42:19.004 INFO:teuthology.orchestra.run.smithi038.stdout: "id": "RGW33333333333333333", 2024-09-22T08:42:19.004 INFO:teuthology.orchestra.run.smithi038.stdout: "tenant": "testx", 2024-09-22T08:42:19.004 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "Mr.RGW33333333333333333", 2024-09-22T08:42:19.004 INFO:teuthology.orchestra.run.smithi038.stdout: "email": "RGW33333333333333333+test@test.test", 2024-09-22T08:42:19.004 INFO:teuthology.orchestra.run.smithi038.stdout: "quota": { 2024-09-22T08:42:19.004 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-22T08:42:19.005 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-22T08:42:19.005 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-22T08:42:19.005 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-22T08:42:19.005 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-22T08:42:19.005 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-22T08:42:19.005 INFO:teuthology.orchestra.run.smithi038.stdout: "bucket_quota": { 2024-09-22T08:42:19.005 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-22T08:42:19.005 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-22T08:42:19.005 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-22T08:42:19.005 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-22T08:42:19.005 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-22T08:42:19.005 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-22T08:42:19.005 INFO:teuthology.orchestra.run.smithi038.stdout: "max_users": 1000, 2024-09-22T08:42:19.005 INFO:teuthology.orchestra.run.smithi038.stdout: "max_roles": 1000, 2024-09-22T08:42:19.005 INFO:teuthology.orchestra.run.smithi038.stdout: "max_groups": 1000, 2024-09-22T08:42:19.006 INFO:teuthology.orchestra.run.smithi038.stdout: "max_buckets": 1000, 2024-09-22T08:42:19.006 INFO:teuthology.orchestra.run.smithi038.stdout: "max_access_keys": 4 2024-09-22T08:42:19.006 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-22T08:42:19.007 DEBUG:tasks.s3tests:Creating user RGW33333333333333333 on client.0 2024-09-22T08:42:19.007 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name Mr.RGW33333333333333333 --email 'testx$tenanteduser+test@test.test' --access-key NLKNNTIPMNVUHFFRRZTC --secret zfnM/4DwYnK6Vqbin844bFnshH5AObEWD9AgOJ2jL8Z+0xwtQ8917A== --cluster ceph --account-id RGW33333333333333333 --account-root 2024-09-22T08:42:19.081 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:19.081 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:19.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.115+0000 7f3323b46800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.117+0000 7f3323b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:19.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.117+0000 7f3323b46800 20 realm 2024-09-22T08:42:19.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.117+0000 7f3323b46800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.117+0000 7f3323b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:19.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.117+0000 7f3323b46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:19.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.117+0000 7f3323b46800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.117+0000 7f3323b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:19.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.117+0000 7f3323b46800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.118+0000 7f3323b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:19.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.118+0000 7f3323b46800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.119+0000 7f3323b46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:19.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.119+0000 7f3323b46800 20 searching for the correct realm 2024-09-22T08:42:19.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.121+0000 7f3320e2f640 0 -- 172.21.15.38:0/56117260 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f3318039ba0 msgr2=0x7f3318047430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:19.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.125+0000 7f3320e2f640 0 -- 172.21.15.38:0/56117260 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f331406bb40 msgr2=0x7f33140ac770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:42:19.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.332+0000 7f3323b46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:19.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.332+0000 7f3323b46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:19.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.332+0000 7f3323b46800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:42:19.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.332+0000 7f3323b46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:19.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.332+0000 7f3323b46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:19.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.332+0000 7f3323b46800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:42:19.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.332+0000 7f3323b46800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.332+0000 7f3323b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:19.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.332+0000 7f3323b46800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.332+0000 7f3323b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:19.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.332+0000 7f3323b46800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.333+0000 7f3323b46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:19.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.333+0000 7f3323b46800 20 zone default found 2024-09-22T08:42:19.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.333+0000 7f3323b46800 4 Realm: () 2024-09-22T08:42:19.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.333+0000 7f3323b46800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:42:19.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.333+0000 7f3323b46800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:42:19.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.333+0000 7f3323b46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:19.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.333+0000 7f3323b46800 20 zonegroup default 2024-09-22T08:42:19.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.333+0000 7f3323b46800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.333+0000 7f3323b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:19.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.333+0000 7f3323b46800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.334+0000 7f3323b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:19.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.334+0000 7f3323b46800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.334+0000 7f3323b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:19.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.334+0000 7f3323b46800 20 started sync module instance, tier type = 2024-09-22T08:42:19.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.334+0000 7f3323b46800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:42:19.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.345+0000 7f3323b46800 20 add_watcher() i=0 2024-09-22T08:42:19.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.345+0000 7f3323b46800 20 add_watcher() i=1 2024-09-22T08:42:19.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.345+0000 7f3323b46800 20 add_watcher() i=2 2024-09-22T08:42:19.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.345+0000 7f3323b46800 20 add_watcher() i=3 2024-09-22T08:42:19.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.345+0000 7f3323b46800 20 add_watcher() i=4 2024-09-22T08:42:19.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.345+0000 7f3323b46800 20 add_watcher() i=5 2024-09-22T08:42:19.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.345+0000 7f3323b46800 20 add_watcher() i=6 2024-09-22T08:42:19.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.346+0000 7f3323b46800 20 add_watcher() i=7 2024-09-22T08:42:19.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.346+0000 7f3323b46800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:19.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.348+0000 7f31d7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:19.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.348+0000 7f3323b46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:19.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.348+0000 7f3323b46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:19.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.348+0000 7f3323b46800 5 note: GC not initialized 2024-09-22T08:42:19.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.349+0000 7f31d6fe5640 20 reqs_thread_entry: start 2024-09-22T08:42:19.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.349+0000 7f3323b46800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:19.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.349+0000 7f3323b46800 20 Filter name: none 2024-09-22T08:42:19.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.349+0000 7f31d4fe1640 20 reqs_thread_entry: start 2024-09-22T08:42:19.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.349+0000 7f3323b46800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-22T08:42:19.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.349+0000 7f3323b46800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.350+0000 7f3323b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:19.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.350+0000 7f3323b46800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-22T08:42:19.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.350+0000 7f3323b46800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-22T08:42:19.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.350+0000 7f3323b46800 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-22T08:42:19.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.350+0000 7f3323b46800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.350+0000 7f3323b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:19.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.350+0000 7f3323b46800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-22T08:42:19.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.350+0000 7f3323b46800 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-22T08:42:19.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.350+0000 7f3323b46800 10 cache get: name=default.rgw.meta+users.keys+NLKNNTIPMNVUHFFRRZTC : miss 2024-09-22T08:42:19.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.350+0000 7f3323b46800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.350+0000 7f3323b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:19.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.350+0000 7f3323b46800 10 cache put: name=default.rgw.meta+users.keys+NLKNNTIPMNVUHFFRRZTC info.flags=0x0 2024-09-22T08:42:19.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.350+0000 7f3323b46800 10 adding default.rgw.meta+users.keys+NLKNNTIPMNVUHFFRRZTC to cache LRU end 2024-09-22T08:42:19.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.350+0000 7f3323b46800 10 cache get: name=default.rgw.meta+accounts+account.RGW33333333333333333 : miss 2024-09-22T08:42:19.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.350+0000 7f3323b46800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.351+0000 7f3323b46800 20 rados_obj.operate() r=0 bl.length=189 2024-09-22T08:42:19.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.351+0000 7f3323b46800 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-22T08:42:19.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.351+0000 7f3323b46800 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-22T08:42:19.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.351+0000 7f3323b46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:42:19.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.351+0000 7f3323b46800 10 cache get: name=default.rgw.meta+users.keys+NLKNNTIPMNVUHFFRRZTC : hit (negative entry) 2024-09-22T08:42:19.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.351+0000 7f3323b46800 10 cache get: name=default.rgw.meta+users.keys+NLKNNTIPMNVUHFFRRZTC : hit (negative entry) 2024-09-22T08:42:19.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.353+0000 7f3323b46800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-22T08:42:19.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.353+0000 7f3323b46800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-22T08:42:19.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.353+0000 7f3323b46800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-22T08:42:19.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.354+0000 7f3204ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399079 cookie 93897382063936 notifier 8441 bl.length()=732 2024-09-22T08:42:19.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.354+0000 7f3204ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-22T08:42:19.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.354+0000 7f3204ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-22T08:42:19.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.355+0000 7f3323b46800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-22T08:42:19.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.355+0000 7f3323b46800 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-22T08:42:19.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.355+0000 7f3323b46800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-22T08:42:19.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.356+0000 7f31f3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399080 cookie 93897382070640 notifier 8441 bl.length()=215 2024-09-22T08:42:19.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.356+0000 7f31f3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-22T08:42:19.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.356+0000 7f31f3fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-22T08:42:19.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.357+0000 7f3323b46800 10 cache put: name=default.rgw.meta+users.keys+NLKNNTIPMNVUHFFRRZTC info.flags=0x7 2024-09-22T08:42:19.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.357+0000 7f3323b46800 10 moving default.rgw.meta+users.keys+NLKNNTIPMNVUHFFRRZTC to cache LRU end 2024-09-22T08:42:19.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.357+0000 7f3323b46800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:NLKNNTIPMNVUHFFRRZTC, ofs0, ns] 2024-09-22T08:42:19.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.358+0000 7f3204ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399081 cookie 93897382070640 notifier 8441 bl.length()=201 2024-09-22T08:42:19.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.358+0000 7f3204ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NLKNNTIPMNVUHFFRRZTC info.flags=0x7 2024-09-22T08:42:19.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.358+0000 7f3204ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NLKNNTIPMNVUHFFRRZTC to cache LRU end 2024-09-22T08:42:19.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.360+0000 7f3323b46800 20 linked user testx$tenanteduser.client.0 to account RGW33333333333333333 2024-09-22T08:42:19.362 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-22T08:42:19.362 INFO:teuthology.orchestra.run.smithi038.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-22T08:42:19.362 INFO:teuthology.orchestra.run.smithi038.stdout: "display_name": "Mr.RGW33333333333333333", 2024-09-22T08:42:19.362 INFO:teuthology.orchestra.run.smithi038.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-22T08:42:19.362 INFO:teuthology.orchestra.run.smithi038.stdout: "suspended": 0, 2024-09-22T08:42:19.362 INFO:teuthology.orchestra.run.smithi038.stdout: "max_buckets": 1000, 2024-09-22T08:42:19.362 INFO:teuthology.orchestra.run.smithi038.stdout: "subusers": [], 2024-09-22T08:42:19.362 INFO:teuthology.orchestra.run.smithi038.stdout: "keys": [ 2024-09-22T08:42:19.362 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-22T08:42:19.363 INFO:teuthology.orchestra.run.smithi038.stdout: "user": "testx$tenanteduser.client.0", 2024-09-22T08:42:19.363 INFO:teuthology.orchestra.run.smithi038.stdout: "access_key": "NLKNNTIPMNVUHFFRRZTC", 2024-09-22T08:42:19.363 INFO:teuthology.orchestra.run.smithi038.stdout: "secret_key": "zfnM/4DwYnK6Vqbin844bFnshH5AObEWD9AgOJ2jL8Z+0xwtQ8917A==", 2024-09-22T08:42:19.363 INFO:teuthology.orchestra.run.smithi038.stdout: "active": true, 2024-09-22T08:42:19.363 INFO:teuthology.orchestra.run.smithi038.stdout: "create_date": "2024-09-22T08:42:19.353458Z" 2024-09-22T08:42:19.363 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-22T08:42:19.363 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-22T08:42:19.363 INFO:teuthology.orchestra.run.smithi038.stdout: "swift_keys": [], 2024-09-22T08:42:19.363 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": [], 2024-09-22T08:42:19.363 INFO:teuthology.orchestra.run.smithi038.stdout: "op_mask": "read, write, delete", 2024-09-22T08:42:19.363 INFO:teuthology.orchestra.run.smithi038.stdout: "default_placement": "", 2024-09-22T08:42:19.363 INFO:teuthology.orchestra.run.smithi038.stdout: "default_storage_class": "", 2024-09-22T08:42:19.363 INFO:teuthology.orchestra.run.smithi038.stdout: "placement_tags": [], 2024-09-22T08:42:19.363 INFO:teuthology.orchestra.run.smithi038.stdout: "bucket_quota": { 2024-09-22T08:42:19.364 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-22T08:42:19.364 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-22T08:42:19.364 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-22T08:42:19.364 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-22T08:42:19.364 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-22T08:42:19.364 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-22T08:42:19.364 INFO:teuthology.orchestra.run.smithi038.stdout: "user_quota": { 2024-09-22T08:42:19.364 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-22T08:42:19.364 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-22T08:42:19.364 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-22T08:42:19.364 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-22T08:42:19.364 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-22T08:42:19.364 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-22T08:42:19.364 INFO:teuthology.orchestra.run.smithi038.stdout: "temp_url_keys": [], 2024-09-22T08:42:19.364 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "root", 2024-09-22T08:42:19.365 INFO:teuthology.orchestra.run.smithi038.stdout: "mfa_ids": [], 2024-09-22T08:42:19.365 INFO:teuthology.orchestra.run.smithi038.stdout: "account_id": "RGW33333333333333333", 2024-09-22T08:42:19.365 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-22T08:42:19.365 INFO:teuthology.orchestra.run.smithi038.stdout: "create_date": "2024-09-22T08:42:19.353443Z", 2024-09-22T08:42:19.365 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-22T08:42:19.365 INFO:teuthology.orchestra.run.smithi038.stdout: "group_ids": [] 2024-09-22T08:42:19.365 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-22T08:42:19.365 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:19.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.361+0000 7f31d7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:19.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.363+0000 7f3323b46800 20 remove_watcher() i=0 2024-09-22T08:42:19.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.363+0000 7f3323b46800 2 removed watcher, disabling cache 2024-09-22T08:42:19.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.365+0000 7f3323b46800 20 remove_watcher() i=1 2024-09-22T08:42:19.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.366+0000 7f3323b46800 20 remove_watcher() i=2 2024-09-22T08:42:19.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.367+0000 7f3323b46800 20 remove_watcher() i=3 2024-09-22T08:42:19.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.368+0000 7f3323b46800 20 remove_watcher() i=4 2024-09-22T08:42:19.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.369+0000 7f3323b46800 20 remove_watcher() i=5 2024-09-22T08:42:19.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.371+0000 7f3323b46800 20 remove_watcher() i=6 2024-09-22T08:42:19.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.372+0000 7f3323b46800 20 remove_watcher() i=7 2024-09-22T08:42:19.385 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 8284264034 --totp-seed FTC24HENUROU2E7RFA5VPV6XVHM3YVIZ2CQS4SE6WLG4HUX5PU6CWMMAPP2A63TT --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-22T08:42:19.455 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:19.455 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:19.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.490+0000 7f4ce130c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.491+0000 7f4ce130c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:19.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.491+0000 7f4ce130c800 20 realm 2024-09-22T08:42:19.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.491+0000 7f4ce130c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.492+0000 7f4ce130c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:19.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.492+0000 7f4ce130c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:19.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.492+0000 7f4ce130c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.492+0000 7f4ce130c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:19.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.492+0000 7f4ce130c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.493+0000 7f4ce130c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:19.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.493+0000 7f4ce130c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.493+0000 7f4ce130c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:19.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.493+0000 7f4ce130c800 20 searching for the correct realm 2024-09-22T08:42:19.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.496+0000 7f4cdf5f7640 0 -- 172.21.15.38:0/3826797994 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7f4cd0071030 msgr2=0x7f4cd0048810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:19.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.701+0000 7f4cdedf6640 0 -- 172.21.15.38:0/3826797994 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x55e27befd200 msgr2=0x55e27beff650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:19.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.706+0000 7f4ce130c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:19.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.706+0000 7f4ce130c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:19.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.706+0000 7f4ce130c800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:42:19.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.706+0000 7f4ce130c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:19.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.706+0000 7f4ce130c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:19.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.706+0000 7f4ce130c800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:42:19.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.706+0000 7f4ce130c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.706+0000 7f4ce130c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:19.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.706+0000 7f4ce130c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.707+0000 7f4ce130c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:19.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.707+0000 7f4ce130c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.707+0000 7f4ce130c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:19.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.707+0000 7f4ce130c800 20 zone default found 2024-09-22T08:42:19.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.707+0000 7f4ce130c800 4 Realm: () 2024-09-22T08:42:19.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.707+0000 7f4ce130c800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:42:19.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.707+0000 7f4ce130c800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:42:19.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.707+0000 7f4ce130c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:19.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.707+0000 7f4ce130c800 20 zonegroup default 2024-09-22T08:42:19.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.707+0000 7f4ce130c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.708+0000 7f4ce130c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:19.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.708+0000 7f4ce130c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.708+0000 7f4ce130c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:19.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.708+0000 7f4ce130c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.708+0000 7f4ce130c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:19.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.708+0000 7f4ce130c800 20 started sync module instance, tier type = 2024-09-22T08:42:19.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.708+0000 7f4ce130c800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:42:19.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.719+0000 7f4ce130c800 20 add_watcher() i=0 2024-09-22T08:42:19.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.719+0000 7f4ce130c800 20 add_watcher() i=1 2024-09-22T08:42:19.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.719+0000 7f4ce130c800 20 add_watcher() i=2 2024-09-22T08:42:19.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.719+0000 7f4ce130c800 20 add_watcher() i=3 2024-09-22T08:42:19.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.719+0000 7f4ce130c800 20 add_watcher() i=4 2024-09-22T08:42:19.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.719+0000 7f4ce130c800 20 add_watcher() i=5 2024-09-22T08:42:19.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.719+0000 7f4ce130c800 20 add_watcher() i=6 2024-09-22T08:42:19.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.720+0000 7f4ce130c800 20 add_watcher() i=7 2024-09-22T08:42:19.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.720+0000 7f4ce130c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:19.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.722+0000 7f4b957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:19.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.722+0000 7f4ce130c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:19.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.722+0000 7f4ce130c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:19.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.723+0000 7f4ce130c800 5 note: GC not initialized 2024-09-22T08:42:19.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.723+0000 7f4b0ffff640 20 reqs_thread_entry: start 2024-09-22T08:42:19.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.723+0000 7f4ce130c800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:19.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.723+0000 7f4ce130c800 20 Filter name: none 2024-09-22T08:42:19.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.723+0000 7f4b0dffb640 20 reqs_thread_entry: start 2024-09-22T08:42:19.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.723+0000 7f4ce130c800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-22T08:42:19.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.723+0000 7f4ce130c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.724+0000 7f4ce130c800 20 rados_obj.operate() r=0 bl.length=532 2024-09-22T08:42:19.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.724+0000 7f4ce130c800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-22T08:42:19.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.724+0000 7f4ce130c800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-22T08:42:19.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.724+0000 7f4ce130c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:42:19.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.727+0000 7f4ce130c800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-22T08:42:19.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.727+0000 7f4ce130c800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-22T08:42:19.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.727+0000 7f4ce130c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-22T08:42:19.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.728+0000 7f4bc27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399082 cookie 94431230358208 notifier 8459 bl.length()=746 2024-09-22T08:42:19.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.728+0000 7f4bc27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-22T08:42:19.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.728+0000 7f4bc27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-22T08:42:19.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.729+0000 7f4b957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:19.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.731+0000 7f4ce130c800 20 remove_watcher() i=0 2024-09-22T08:42:19.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.731+0000 7f4ce130c800 2 removed watcher, disabling cache 2024-09-22T08:42:19.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.732+0000 7f4ce130c800 20 remove_watcher() i=1 2024-09-22T08:42:19.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.733+0000 7f4ce130c800 20 remove_watcher() i=2 2024-09-22T08:42:19.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.735+0000 7f4ce130c800 20 remove_watcher() i=3 2024-09-22T08:42:19.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.736+0000 7f4ce130c800 20 remove_watcher() i=4 2024-09-22T08:42:19.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.737+0000 7f4ce130c800 20 remove_watcher() i=5 2024-09-22T08:42:19.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.738+0000 7f4ce130c800 20 remove_watcher() i=6 2024-09-22T08:42:19.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.739+0000 7f4ce130c800 20 remove_watcher() i=7 2024-09-22T08:42:19.754 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-22T08:42:19.754 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key SEJNUTUZRJDVQNNEXJBI --secret u4DXZ3kzpZG1wNHo6m2olPwLIkoOFc8eZbHOB2My7miEjahPWvF08A== --cluster ceph 2024-09-22T08:42:19.820 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:19.820 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:19.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.855+0000 7fe847811800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.856+0000 7fe847811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:19.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.856+0000 7fe847811800 20 realm 2024-09-22T08:42:19.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.856+0000 7fe847811800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.856+0000 7fe847811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:19.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.856+0000 7fe847811800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:19.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.856+0000 7fe847811800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.857+0000 7fe847811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:19.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.857+0000 7fe847811800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.857+0000 7fe847811800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:19.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.857+0000 7fe847811800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.858+0000 7fe847811800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:19.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.858+0000 7fe847811800 20 searching for the correct realm 2024-09-22T08:42:19.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.861+0000 7fe842791640 0 -- 172.21.15.38:0/3441832855 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7fe83801b040 msgr2=0x7fe838066c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:19.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:19.864+0000 7fe842791640 0 -- 172.21.15.38:0/3441832855 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fe83409a910 msgr2=0x7fe83408c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:20.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.071+0000 7fe847811800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:20.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.071+0000 7fe847811800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:20.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.071+0000 7fe847811800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:42:20.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.071+0000 7fe847811800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:20.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.071+0000 7fe847811800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:20.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.071+0000 7fe847811800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:42:20.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.071+0000 7fe847811800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.071+0000 7fe847811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:20.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.071+0000 7fe847811800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.072+0000 7fe847811800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:20.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.072+0000 7fe847811800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.072+0000 7fe847811800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:20.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.072+0000 7fe847811800 20 zone default found 2024-09-22T08:42:20.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.072+0000 7fe847811800 4 Realm: () 2024-09-22T08:42:20.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.072+0000 7fe847811800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:42:20.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.072+0000 7fe847811800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:42:20.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.072+0000 7fe847811800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:20.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.072+0000 7fe847811800 20 zonegroup default 2024-09-22T08:42:20.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.072+0000 7fe847811800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.073+0000 7fe847811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:20.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.073+0000 7fe847811800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.073+0000 7fe847811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:20.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.073+0000 7fe847811800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.073+0000 7fe847811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:20.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.073+0000 7fe847811800 20 started sync module instance, tier type = 2024-09-22T08:42:20.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.073+0000 7fe847811800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:42:20.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.084+0000 7fe847811800 20 add_watcher() i=0 2024-09-22T08:42:20.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.084+0000 7fe847811800 20 add_watcher() i=1 2024-09-22T08:42:20.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.084+0000 7fe847811800 20 add_watcher() i=2 2024-09-22T08:42:20.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.084+0000 7fe847811800 20 add_watcher() i=3 2024-09-22T08:42:20.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.084+0000 7fe847811800 20 add_watcher() i=4 2024-09-22T08:42:20.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.084+0000 7fe847811800 20 add_watcher() i=5 2024-09-22T08:42:20.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.084+0000 7fe847811800 20 add_watcher() i=6 2024-09-22T08:42:20.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.085+0000 7fe847811800 20 add_watcher() i=7 2024-09-22T08:42:20.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.085+0000 7fe847811800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:20.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.087+0000 7fe6f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:20.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.087+0000 7fe847811800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:20.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.087+0000 7fe847811800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:20.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.087+0000 7fe847811800 5 note: GC not initialized 2024-09-22T08:42:20.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.088+0000 7fe673fff640 20 reqs_thread_entry: start 2024-09-22T08:42:20.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.088+0000 7fe847811800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:20.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.088+0000 7fe847811800 20 Filter name: none 2024-09-22T08:42:20.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.088+0000 7fe671ffb640 20 reqs_thread_entry: start 2024-09-22T08:42:20.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.088+0000 7fe847811800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-22T08:42:20.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.088+0000 7fe847811800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.088+0000 7fe847811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:20.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.088+0000 7fe847811800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-22T08:42:20.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.088+0000 7fe847811800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-22T08:42:20.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.088+0000 7fe847811800 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-22T08:42:20.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.088+0000 7fe847811800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.089+0000 7fe847811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:20.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.089+0000 7fe847811800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-22T08:42:20.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.089+0000 7fe847811800 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-22T08:42:20.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.089+0000 7fe847811800 10 cache get: name=default.rgw.meta+users.keys+SEJNUTUZRJDVQNNEXJBI : miss 2024-09-22T08:42:20.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.089+0000 7fe847811800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.089+0000 7fe847811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:20.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.089+0000 7fe847811800 10 cache put: name=default.rgw.meta+users.keys+SEJNUTUZRJDVQNNEXJBI info.flags=0x0 2024-09-22T08:42:20.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.089+0000 7fe847811800 10 adding default.rgw.meta+users.keys+SEJNUTUZRJDVQNNEXJBI to cache LRU end 2024-09-22T08:42:20.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.089+0000 7fe847811800 10 cache get: name=default.rgw.meta+users.keys+SEJNUTUZRJDVQNNEXJBI : hit (negative entry) 2024-09-22T08:42:20.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.089+0000 7fe847811800 10 cache get: name=default.rgw.meta+users.keys+SEJNUTUZRJDVQNNEXJBI : hit (negative entry) 2024-09-22T08:42:20.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.091+0000 7fe847811800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-22T08:42:20.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.091+0000 7fe847811800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-22T08:42:20.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.091+0000 7fe847811800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-22T08:42:20.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.091+0000 7fe7267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399083 cookie 93974049102960 notifier 9102 bl.length()=660 2024-09-22T08:42:20.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.091+0000 7fe7267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-22T08:42:20.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.091+0000 7fe7267fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-22T08:42:20.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.093+0000 7fe847811800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-22T08:42:20.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.093+0000 7fe847811800 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-22T08:42:20.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.093+0000 7fe847811800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-22T08:42:20.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.093+0000 7fe7267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399125 cookie 93974049086496 notifier 9102 bl.length()=191 2024-09-22T08:42:20.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.093+0000 7fe7267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-22T08:42:20.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.093+0000 7fe7267fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-22T08:42:20.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.095+0000 7fe847811800 10 cache put: name=default.rgw.meta+users.keys+SEJNUTUZRJDVQNNEXJBI info.flags=0x7 2024-09-22T08:42:20.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.095+0000 7fe847811800 10 moving default.rgw.meta+users.keys+SEJNUTUZRJDVQNNEXJBI to cache LRU end 2024-09-22T08:42:20.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.095+0000 7fe847811800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:SEJNUTUZRJDVQNNEXJBI, ofs0, ns] 2024-09-22T08:42:20.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.096+0000 7fe725ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399126 cookie 93974049095024 notifier 9102 bl.length()=189 2024-09-22T08:42:20.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.096+0000 7fe725ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+SEJNUTUZRJDVQNNEXJBI info.flags=0x7 2024-09-22T08:42:20.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.096+0000 7fe725ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+SEJNUTUZRJDVQNNEXJBI to cache LRU end 2024-09-22T08:42:20.098 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-22T08:42:20.099 INFO:teuthology.orchestra.run.smithi038.stdout: "user_id": "foobar.client.0", 2024-09-22T08:42:20.099 INFO:teuthology.orchestra.run.smithi038.stdout: "display_name": "Mr.foobar.client.0", 2024-09-22T08:42:20.099 INFO:teuthology.orchestra.run.smithi038.stdout: "email": "foobar+test@test.test", 2024-09-22T08:42:20.099 INFO:teuthology.orchestra.run.smithi038.stdout: "suspended": 0, 2024-09-22T08:42:20.099 INFO:teuthology.orchestra.run.smithi038.stdout: "max_buckets": 1000, 2024-09-22T08:42:20.099 INFO:teuthology.orchestra.run.smithi038.stdout: "subusers": [], 2024-09-22T08:42:20.099 INFO:teuthology.orchestra.run.smithi038.stdout: "keys": [ 2024-09-22T08:42:20.099 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-22T08:42:20.099 INFO:teuthology.orchestra.run.smithi038.stdout: "user": "foobar.client.0", 2024-09-22T08:42:20.099 INFO:teuthology.orchestra.run.smithi038.stdout: "access_key": "SEJNUTUZRJDVQNNEXJBI", 2024-09-22T08:42:20.099 INFO:teuthology.orchestra.run.smithi038.stdout: "secret_key": "u4DXZ3kzpZG1wNHo6m2olPwLIkoOFc8eZbHOB2My7miEjahPWvF08A==", 2024-09-22T08:42:20.099 INFO:teuthology.orchestra.run.smithi038.stdout: "active": true, 2024-09-22T08:42:20.099 INFO:teuthology.orchestra.run.smithi038.stdout: "create_date": "2024-09-22T08:42:20.091424Z" 2024-09-22T08:42:20.100 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-22T08:42:20.100 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-22T08:42:20.100 INFO:teuthology.orchestra.run.smithi038.stdout: "swift_keys": [], 2024-09-22T08:42:20.100 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": [], 2024-09-22T08:42:20.100 INFO:teuthology.orchestra.run.smithi038.stdout: "op_mask": "read, write, delete", 2024-09-22T08:42:20.100 INFO:teuthology.orchestra.run.smithi038.stdout: "default_placement": "", 2024-09-22T08:42:20.100 INFO:teuthology.orchestra.run.smithi038.stdout: "default_storage_class": "", 2024-09-22T08:42:20.100 INFO:teuthology.orchestra.run.smithi038.stdout: "placement_tags": [], 2024-09-22T08:42:20.100 INFO:teuthology.orchestra.run.smithi038.stdout: "bucket_quota": { 2024-09-22T08:42:20.100 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-22T08:42:20.100 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-22T08:42:20.100 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-22T08:42:20.100 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-22T08:42:20.100 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-22T08:42:20.100 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-22T08:42:20.101 INFO:teuthology.orchestra.run.smithi038.stdout: "user_quota": { 2024-09-22T08:42:20.101 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-22T08:42:20.101 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-22T08:42:20.101 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-22T08:42:20.101 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-22T08:42:20.101 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-22T08:42:20.101 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-22T08:42:20.101 INFO:teuthology.orchestra.run.smithi038.stdout: "temp_url_keys": [], 2024-09-22T08:42:20.101 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "rgw", 2024-09-22T08:42:20.101 INFO:teuthology.orchestra.run.smithi038.stdout: "mfa_ids": [], 2024-09-22T08:42:20.101 INFO:teuthology.orchestra.run.smithi038.stdout: "account_id": "", 2024-09-22T08:42:20.101 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-22T08:42:20.101 INFO:teuthology.orchestra.run.smithi038.stdout: "create_date": "2024-09-22T08:42:20.091412Z", 2024-09-22T08:42:20.101 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-22T08:42:20.101 INFO:teuthology.orchestra.run.smithi038.stdout: "group_ids": [] 2024-09-22T08:42:20.102 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-22T08:42:20.102 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:20.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.097+0000 7fe6f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:20.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.099+0000 7fe847811800 20 remove_watcher() i=0 2024-09-22T08:42:20.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.099+0000 7fe847811800 2 removed watcher, disabling cache 2024-09-22T08:42:20.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.101+0000 7fe847811800 20 remove_watcher() i=1 2024-09-22T08:42:20.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.102+0000 7fe847811800 20 remove_watcher() i=2 2024-09-22T08:42:20.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.103+0000 7fe847811800 20 remove_watcher() i=3 2024-09-22T08:42:20.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.104+0000 7fe847811800 20 remove_watcher() i=4 2024-09-22T08:42:20.107 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.105+0000 7fe847811800 20 remove_watcher() i=5 2024-09-22T08:42:20.108 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.106+0000 7fe847811800 20 remove_watcher() i=6 2024-09-22T08:42:20.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.108+0000 7fe847811800 20 remove_watcher() i=7 2024-09-22T08:42:20.121 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 3700743187 --totp-seed 6TRNRNEIVRWN3DEVFQAG3SIJNAIKIAUIKXR4SF3P3QVFN6MZCJ4TMK5YAJ4ZHXUG --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-22T08:42:20.190 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:20.190 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:20.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.224+0000 7fe3c3696800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.226+0000 7fe3c3696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:20.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.226+0000 7fe3c3696800 20 realm 2024-09-22T08:42:20.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.226+0000 7fe3c3696800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.226+0000 7fe3c3696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:20.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.226+0000 7fe3c3696800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:20.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.226+0000 7fe3c3696800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.226+0000 7fe3c3696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:20.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.226+0000 7fe3c3696800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.227+0000 7fe3c3696800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:20.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.227+0000 7fe3c3696800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.228+0000 7fe3c3696800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:20.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.228+0000 7fe3c3696800 20 searching for the correct realm 2024-09-22T08:42:20.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.230+0000 7fe3c1180640 0 -- 172.21.15.38:0/3075483056 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x5593352c7bc0 msgr2=0x5593352ca080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:20.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.233+0000 7fe3c097f640 0 -- 172.21.15.38:0/3075483056 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fe3b406b020 msgr2=0x7fe3b40aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:20.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.440+0000 7fe3c3696800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:20.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.440+0000 7fe3c3696800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:20.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.440+0000 7fe3c3696800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:42:20.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.440+0000 7fe3c3696800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:20.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.440+0000 7fe3c3696800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:20.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.440+0000 7fe3c3696800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:42:20.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.440+0000 7fe3c3696800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.440+0000 7fe3c3696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:20.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.440+0000 7fe3c3696800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.441+0000 7fe3c3696800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:20.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.441+0000 7fe3c3696800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.441+0000 7fe3c3696800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:20.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.441+0000 7fe3c3696800 20 zone default found 2024-09-22T08:42:20.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.441+0000 7fe3c3696800 4 Realm: () 2024-09-22T08:42:20.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.441+0000 7fe3c3696800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:42:20.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.441+0000 7fe3c3696800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:42:20.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.441+0000 7fe3c3696800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:20.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.441+0000 7fe3c3696800 20 zonegroup default 2024-09-22T08:42:20.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.441+0000 7fe3c3696800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.441+0000 7fe3c3696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:20.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.441+0000 7fe3c3696800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.442+0000 7fe3c3696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:20.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.442+0000 7fe3c3696800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.442+0000 7fe3c3696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:20.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.442+0000 7fe3c3696800 20 started sync module instance, tier type = 2024-09-22T08:42:20.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.442+0000 7fe3c3696800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:42:20.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.453+0000 7fe3c3696800 20 add_watcher() i=0 2024-09-22T08:42:20.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.453+0000 7fe3c3696800 20 add_watcher() i=1 2024-09-22T08:42:20.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.453+0000 7fe3c3696800 20 add_watcher() i=2 2024-09-22T08:42:20.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.453+0000 7fe3c3696800 20 add_watcher() i=3 2024-09-22T08:42:20.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.453+0000 7fe3c3696800 20 add_watcher() i=4 2024-09-22T08:42:20.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.453+0000 7fe3c3696800 20 add_watcher() i=5 2024-09-22T08:42:20.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.453+0000 7fe3c3696800 20 add_watcher() i=6 2024-09-22T08:42:20.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.454+0000 7fe3c3696800 20 add_watcher() i=7 2024-09-22T08:42:20.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.454+0000 7fe3c3696800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:20.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.456+0000 7fe2777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:20.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.456+0000 7fe3c3696800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:20.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.456+0000 7fe3c3696800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:20.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.456+0000 7fe3c3696800 5 note: GC not initialized 2024-09-22T08:42:20.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.457+0000 7fe2767e4640 20 reqs_thread_entry: start 2024-09-22T08:42:20.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.457+0000 7fe3c3696800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:20.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.457+0000 7fe3c3696800 20 Filter name: none 2024-09-22T08:42:20.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.457+0000 7fe1e7fff640 20 reqs_thread_entry: start 2024-09-22T08:42:20.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.457+0000 7fe3c3696800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-22T08:42:20.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.457+0000 7fe3c3696800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.458+0000 7fe3c3696800 20 rados_obj.operate() r=0 bl.length=472 2024-09-22T08:42:20.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.458+0000 7fe3c3696800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-22T08:42:20.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.458+0000 7fe3c3696800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-22T08:42:20.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.458+0000 7fe3c3696800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:42:20.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.460+0000 7fe3c3696800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-22T08:42:20.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.460+0000 7fe3c3696800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-22T08:42:20.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.460+0000 7fe3c3696800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-22T08:42:20.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.461+0000 7fe2a4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399084 cookie 94090740690336 notifier 8492 bl.length()=674 2024-09-22T08:42:20.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.461+0000 7fe2a4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-22T08:42:20.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.461+0000 7fe2a4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-22T08:42:20.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.462+0000 7fe2777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:20.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.465+0000 7fe3c3696800 20 remove_watcher() i=0 2024-09-22T08:42:20.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.465+0000 7fe3c3696800 2 removed watcher, disabling cache 2024-09-22T08:42:20.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.466+0000 7fe3c3696800 20 remove_watcher() i=1 2024-09-22T08:42:20.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.467+0000 7fe3c3696800 20 remove_watcher() i=2 2024-09-22T08:42:20.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.468+0000 7fe3c3696800 20 remove_watcher() i=3 2024-09-22T08:42:20.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.469+0000 7fe3c3696800 20 remove_watcher() i=4 2024-09-22T08:42:20.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.470+0000 7fe3c3696800 20 remove_watcher() i=5 2024-09-22T08:42:20.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.471+0000 7fe3c3696800 20 remove_watcher() i=6 2024-09-22T08:42:20.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.473+0000 7fe3c3696800 20 remove_watcher() i=7 2024-09-22T08:42:20.487 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-22T08:42:20.548 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:20.548 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:20.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.582+0000 7fe505142800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.584+0000 7fe505142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:20.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.584+0000 7fe505142800 20 realm 2024-09-22T08:42:20.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.584+0000 7fe505142800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.584+0000 7fe505142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:20.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.584+0000 7fe505142800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:20.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.584+0000 7fe505142800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.584+0000 7fe505142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:20.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.584+0000 7fe505142800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.585+0000 7fe505142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:20.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.585+0000 7fe505142800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.586+0000 7fe505142800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:20.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.586+0000 7fe505142800 20 searching for the correct realm 2024-09-22T08:42:20.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.588+0000 7fe500e86640 0 -- 172.21.15.38:0/1595809321 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x5617f2811c10 msgr2=0x5617f28140d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:20.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.592+0000 7fe500685640 0 -- 172.21.15.38:0/1595809321 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fe4f007e930 msgr2=0x7fe4f00973f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:20.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.798+0000 7fe505142800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:20.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.798+0000 7fe505142800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:20.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.798+0000 7fe505142800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:42:20.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.798+0000 7fe505142800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:20.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.798+0000 7fe505142800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:20.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.798+0000 7fe505142800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:42:20.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.798+0000 7fe505142800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.799+0000 7fe505142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:20.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.799+0000 7fe505142800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.799+0000 7fe505142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:20.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.799+0000 7fe505142800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.800+0000 7fe505142800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:20.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.800+0000 7fe505142800 20 zone default found 2024-09-22T08:42:20.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.800+0000 7fe505142800 4 Realm: () 2024-09-22T08:42:20.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.800+0000 7fe505142800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:42:20.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.800+0000 7fe505142800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:42:20.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.800+0000 7fe505142800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:20.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.800+0000 7fe505142800 20 zonegroup default 2024-09-22T08:42:20.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.800+0000 7fe505142800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.800+0000 7fe505142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:20.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.800+0000 7fe505142800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.800+0000 7fe505142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:20.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.800+0000 7fe505142800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.801+0000 7fe505142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:20.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.801+0000 7fe505142800 20 started sync module instance, tier type = 2024-09-22T08:42:20.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.801+0000 7fe505142800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:42:20.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.812+0000 7fe505142800 20 add_watcher() i=0 2024-09-22T08:42:20.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.812+0000 7fe505142800 20 add_watcher() i=1 2024-09-22T08:42:20.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.812+0000 7fe505142800 20 add_watcher() i=2 2024-09-22T08:42:20.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.812+0000 7fe505142800 20 add_watcher() i=3 2024-09-22T08:42:20.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.812+0000 7fe505142800 20 add_watcher() i=4 2024-09-22T08:42:20.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.812+0000 7fe505142800 20 add_watcher() i=5 2024-09-22T08:42:20.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.812+0000 7fe505142800 20 add_watcher() i=6 2024-09-22T08:42:20.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.813+0000 7fe505142800 20 add_watcher() i=7 2024-09-22T08:42:20.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.813+0000 7fe505142800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:20.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.814+0000 7fe3b6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:20.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.815+0000 7fe505142800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:20.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.815+0000 7fe505142800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:20.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.815+0000 7fe505142800 5 note: GC not initialized 2024-09-22T08:42:20.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.815+0000 7fe3b5fe3640 20 reqs_thread_entry: start 2024-09-22T08:42:20.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.815+0000 7fe505142800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:20.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.815+0000 7fe505142800 20 Filter name: none 2024-09-22T08:42:20.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.815+0000 7fe3277fe640 20 reqs_thread_entry: start 2024-09-22T08:42:20.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.815+0000 7fe505142800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-22T08:42:20.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.815+0000 7fe505142800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.816+0000 7fe505142800 20 rados_obj.operate() r=0 bl.length=486 2024-09-22T08:42:20.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.816+0000 7fe505142800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-22T08:42:20.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.816+0000 7fe505142800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-22T08:42:20.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.816+0000 7fe505142800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:42:20.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.818+0000 7fe505142800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-22T08:42:20.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.818+0000 7fe505142800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-22T08:42:20.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.818+0000 7fe505142800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-22T08:42:20.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.818+0000 7fe3d7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399085 cookie 94660852813120 notifier 8507 bl.length()=727 2024-09-22T08:42:20.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.818+0000 7fe3d7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-22T08:42:20.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.818+0000 7fe3d7fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-22T08:42:20.821 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-22T08:42:20.821 INFO:teuthology.orchestra.run.smithi038.stdout: "user_id": "foobar.client.0", 2024-09-22T08:42:20.821 INFO:teuthology.orchestra.run.smithi038.stdout: "display_name": "Mr.foobar.client.0", 2024-09-22T08:42:20.821 INFO:teuthology.orchestra.run.smithi038.stdout: "email": "foobar+test@test.test", 2024-09-22T08:42:20.821 INFO:teuthology.orchestra.run.smithi038.stdout: "suspended": 0, 2024-09-22T08:42:20.821 INFO:teuthology.orchestra.run.smithi038.stdout: "max_buckets": 1000, 2024-09-22T08:42:20.821 INFO:teuthology.orchestra.run.smithi038.stdout: "subusers": [], 2024-09-22T08:42:20.821 INFO:teuthology.orchestra.run.smithi038.stdout: "keys": [ 2024-09-22T08:42:20.821 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-22T08:42:20.821 INFO:teuthology.orchestra.run.smithi038.stdout: "user": "foobar.client.0", 2024-09-22T08:42:20.821 INFO:teuthology.orchestra.run.smithi038.stdout: "access_key": "SEJNUTUZRJDVQNNEXJBI", 2024-09-22T08:42:20.821 INFO:teuthology.orchestra.run.smithi038.stdout: "secret_key": "u4DXZ3kzpZG1wNHo6m2olPwLIkoOFc8eZbHOB2My7miEjahPWvF08A==", 2024-09-22T08:42:20.822 INFO:teuthology.orchestra.run.smithi038.stdout: "active": true, 2024-09-22T08:42:20.822 INFO:teuthology.orchestra.run.smithi038.stdout: "create_date": "2024-09-22T08:42:20.091424Z" 2024-09-22T08:42:20.822 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-22T08:42:20.822 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-22T08:42:20.822 INFO:teuthology.orchestra.run.smithi038.stdout: "swift_keys": [], 2024-09-22T08:42:20.822 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": [ 2024-09-22T08:42:20.822 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-22T08:42:20.822 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "oidc-provider", 2024-09-22T08:42:20.822 INFO:teuthology.orchestra.run.smithi038.stdout: "perm": "*" 2024-09-22T08:42:20.822 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-22T08:42:20.822 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-22T08:42:20.822 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "roles", 2024-09-22T08:42:20.822 INFO:teuthology.orchestra.run.smithi038.stdout: "perm": "*" 2024-09-22T08:42:20.822 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-22T08:42:20.823 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-22T08:42:20.823 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "user-policy", 2024-09-22T08:42:20.823 INFO:teuthology.orchestra.run.smithi038.stdout: "perm": "*" 2024-09-22T08:42:20.823 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-22T08:42:20.823 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-22T08:42:20.823 INFO:teuthology.orchestra.run.smithi038.stdout: "op_mask": "read, write, delete", 2024-09-22T08:42:20.823 INFO:teuthology.orchestra.run.smithi038.stdout: "default_placement": "", 2024-09-22T08:42:20.823 INFO:teuthology.orchestra.run.smithi038.stdout: "default_storage_class": "", 2024-09-22T08:42:20.823 INFO:teuthology.orchestra.run.smithi038.stdout: "placement_tags": [], 2024-09-22T08:42:20.823 INFO:teuthology.orchestra.run.smithi038.stdout: "bucket_quota": { 2024-09-22T08:42:20.823 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-22T08:42:20.823 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-22T08:42:20.823 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-22T08:42:20.823 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-22T08:42:20.823 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-22T08:42:20.824 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-22T08:42:20.824 INFO:teuthology.orchestra.run.smithi038.stdout: "user_quota": { 2024-09-22T08:42:20.824 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-22T08:42:20.824 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-22T08:42:20.824 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-22T08:42:20.824 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-22T08:42:20.824 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-22T08:42:20.824 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-22T08:42:20.824 INFO:teuthology.orchestra.run.smithi038.stdout: "temp_url_keys": [], 2024-09-22T08:42:20.824 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "rgw", 2024-09-22T08:42:20.824 INFO:teuthology.orchestra.run.smithi038.stdout: "mfa_ids": [ 2024-09-22T08:42:20.824 INFO:teuthology.orchestra.run.smithi038.stdout: "3700743187" 2024-09-22T08:42:20.824 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-22T08:42:20.824 INFO:teuthology.orchestra.run.smithi038.stdout: "account_id": "", 2024-09-22T08:42:20.824 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-22T08:42:20.824 INFO:teuthology.orchestra.run.smithi038.stdout: "create_date": "2024-09-22T08:42:20.091412Z", 2024-09-22T08:42:20.825 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-22T08:42:20.825 INFO:teuthology.orchestra.run.smithi038.stdout: "group_ids": [] 2024-09-22T08:42:20.825 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-22T08:42:20.825 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:20.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.820+0000 7fe3b6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:20.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.822+0000 7fe505142800 20 remove_watcher() i=0 2024-09-22T08:42:20.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.822+0000 7fe505142800 2 removed watcher, disabling cache 2024-09-22T08:42:20.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.823+0000 7fe505142800 20 remove_watcher() i=1 2024-09-22T08:42:20.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.824+0000 7fe505142800 20 remove_watcher() i=2 2024-09-22T08:42:20.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.825+0000 7fe505142800 20 remove_watcher() i=3 2024-09-22T08:42:20.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.827+0000 7fe505142800 20 remove_watcher() i=4 2024-09-22T08:42:20.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.828+0000 7fe505142800 20 remove_watcher() i=5 2024-09-22T08:42:20.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.829+0000 7fe505142800 20 remove_watcher() i=6 2024-09-22T08:42:20.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.830+0000 7fe505142800 20 remove_watcher() i=7 2024-09-22T08:42:20.844 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-22T08:42:20.905 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:20.906 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:20.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.940+0000 7fb87890c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.942+0000 7fb87890c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:20.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.942+0000 7fb87890c800 20 realm 2024-09-22T08:42:20.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.942+0000 7fb87890c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.942+0000 7fb87890c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:20.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.942+0000 7fb87890c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:20.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.942+0000 7fb87890c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.942+0000 7fb87890c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:20.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.942+0000 7fb87890c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.943+0000 7fb87890c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:20.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.943+0000 7fb87890c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.944+0000 7fb87890c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:20.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.944+0000 7fb87890c800 20 searching for the correct realm 2024-09-22T08:42:20.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.947+0000 7fb8763f6640 0 -- 172.21.15.38:0/2251221872 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x559b972d0780 msgr2=0x559b972d2c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:20.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:20.951+0000 7fb875bf5640 0 -- 172.21.15.38:0/2251221872 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fb868058450 msgr2=0x7fb8680588b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:21.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.158+0000 7fb87890c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:21.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.158+0000 7fb87890c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:21.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.158+0000 7fb87890c800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:42:21.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.158+0000 7fb87890c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:21.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.158+0000 7fb87890c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:21.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.158+0000 7fb87890c800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:42:21.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.158+0000 7fb87890c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.159+0000 7fb87890c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:21.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.159+0000 7fb87890c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.159+0000 7fb87890c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:21.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.159+0000 7fb87890c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.160+0000 7fb87890c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:21.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.160+0000 7fb87890c800 20 zone default found 2024-09-22T08:42:21.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.160+0000 7fb87890c800 4 Realm: () 2024-09-22T08:42:21.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.160+0000 7fb87890c800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:42:21.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.160+0000 7fb87890c800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:42:21.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.160+0000 7fb87890c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:21.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.160+0000 7fb87890c800 20 zonegroup default 2024-09-22T08:42:21.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.160+0000 7fb87890c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.160+0000 7fb87890c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:21.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.160+0000 7fb87890c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.160+0000 7fb87890c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:21.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.160+0000 7fb87890c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.161+0000 7fb87890c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:21.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.161+0000 7fb87890c800 20 started sync module instance, tier type = 2024-09-22T08:42:21.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.161+0000 7fb87890c800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:42:21.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.171+0000 7fb87890c800 20 add_watcher() i=0 2024-09-22T08:42:21.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.171+0000 7fb87890c800 20 add_watcher() i=1 2024-09-22T08:42:21.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.171+0000 7fb87890c800 20 add_watcher() i=2 2024-09-22T08:42:21.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.171+0000 7fb87890c800 20 add_watcher() i=3 2024-09-22T08:42:21.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.171+0000 7fb87890c800 20 add_watcher() i=4 2024-09-22T08:42:21.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.171+0000 7fb87890c800 20 add_watcher() i=5 2024-09-22T08:42:21.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.171+0000 7fb87890c800 20 add_watcher() i=6 2024-09-22T08:42:21.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.173+0000 7fb87890c800 20 add_watcher() i=7 2024-09-22T08:42:21.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.173+0000 7fb87890c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:21.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.175+0000 7fb72cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:21.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.175+0000 7fb87890c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:21.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.175+0000 7fb87890c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:21.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.175+0000 7fb87890c800 5 note: GC not initialized 2024-09-22T08:42:21.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.175+0000 7fb6a77fe640 20 reqs_thread_entry: start 2024-09-22T08:42:21.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.175+0000 7fb87890c800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:21.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.175+0000 7fb87890c800 20 Filter name: none 2024-09-22T08:42:21.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.175+0000 7fb6a57fa640 20 reqs_thread_entry: start 2024-09-22T08:42:21.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.175+0000 7fb87890c800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-22T08:42:21.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.175+0000 7fb87890c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.176+0000 7fb87890c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:21.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.176+0000 7fb87890c800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-22T08:42:21.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.176+0000 7fb87890c800 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-22T08:42:21.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.176+0000 7fb87890c800 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-22T08:42:21.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.176+0000 7fb87890c800 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-22T08:42:21.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.176+0000 7fb87890c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.176+0000 7fb87890c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:21.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.176+0000 7fb87890c800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-22T08:42:21.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.176+0000 7fb87890c800 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-22T08:42:21.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.176+0000 7fb87890c800 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-22T08:42:21.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.178+0000 7fb87890c800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-22T08:42:21.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.178+0000 7fb87890c800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-22T08:42:21.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.178+0000 7fb87890c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-22T08:42:21.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.178+0000 7fb759ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399127 cookie 94126744617984 notifier 9156 bl.length()=384 2024-09-22T08:42:21.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.178+0000 7fb759ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-22T08:42:21.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.178+0000 7fb759ffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-22T08:42:21.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.180+0000 7fb87890c800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-22T08:42:21.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.180+0000 7fb87890c800 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-22T08:42:21.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.180+0000 7fb87890c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-22T08:42:21.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.180+0000 7fb7597fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399128 cookie 94126744626224 notifier 9156 bl.length()=225 2024-09-22T08:42:21.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.180+0000 7fb7597fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-22T08:42:21.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.180+0000 7fb7597fa640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-22T08:42:21.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.182+0000 7fb87890c800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-22T08:42:21.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.182+0000 7fb87890c800 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-22T08:42:21.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.182+0000 7fb87890c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-22T08:42:21.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.182+0000 7fb7597fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398962 cookie 94126744611568 notifier 9156 bl.length()=234 2024-09-22T08:42:21.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.182+0000 7fb7597fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-22T08:42:21.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.182+0000 7fb7597fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-22T08:42:21.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.184+0000 7fb72cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:21.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.186+0000 7fb87890c800 20 remove_watcher() i=0 2024-09-22T08:42:21.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.186+0000 7fb87890c800 2 removed watcher, disabling cache 2024-09-22T08:42:21.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.188+0000 7fb87890c800 20 remove_watcher() i=1 2024-09-22T08:42:21.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.189+0000 7fb87890c800 20 remove_watcher() i=2 2024-09-22T08:42:21.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.190+0000 7fb87890c800 20 remove_watcher() i=3 2024-09-22T08:42:21.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.191+0000 7fb87890c800 20 remove_watcher() i=4 2024-09-22T08:42:21.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.192+0000 7fb87890c800 20 remove_watcher() i=5 2024-09-22T08:42:21.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.193+0000 7fb87890c800 20 remove_watcher() i=6 2024-09-22T08:42:21.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.195+0000 7fb87890c800 20 remove_watcher() i=7 2024-09-22T08:42:21.206 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-22T08:42:21.206 INFO:teuthology.orchestra.run.smithi038.stdout: "id": "RGW88888888888888888", 2024-09-22T08:42:21.206 INFO:teuthology.orchestra.run.smithi038.stdout: "tenant": "", 2024-09-22T08:42:21.206 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "Mr.RGW88888888888888888", 2024-09-22T08:42:21.206 INFO:teuthology.orchestra.run.smithi038.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-22T08:42:21.206 INFO:teuthology.orchestra.run.smithi038.stdout: "quota": { 2024-09-22T08:42:21.206 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-22T08:42:21.207 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-22T08:42:21.207 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-22T08:42:21.207 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-22T08:42:21.207 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-22T08:42:21.207 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-22T08:42:21.207 INFO:teuthology.orchestra.run.smithi038.stdout: "bucket_quota": { 2024-09-22T08:42:21.207 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-22T08:42:21.207 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-22T08:42:21.207 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-22T08:42:21.207 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-22T08:42:21.207 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-22T08:42:21.207 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-22T08:42:21.207 INFO:teuthology.orchestra.run.smithi038.stdout: "max_users": 1000, 2024-09-22T08:42:21.207 INFO:teuthology.orchestra.run.smithi038.stdout: "max_roles": 1000, 2024-09-22T08:42:21.207 INFO:teuthology.orchestra.run.smithi038.stdout: "max_groups": 1000, 2024-09-22T08:42:21.207 INFO:teuthology.orchestra.run.smithi038.stdout: "max_buckets": 1000, 2024-09-22T08:42:21.208 INFO:teuthology.orchestra.run.smithi038.stdout: "max_access_keys": 4 2024-09-22T08:42:21.208 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-22T08:42:21.209 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-22T08:42:21.209 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key AUGFSBETAATMZXSWWFCT --secret 7a/4/WfscrwXPCRkpU8K42bzpBHlA1v7fH8lTegClxtT2T/lF9kuUg== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-22T08:42:21.277 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:21.278 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:21.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.312+0000 7fc8a1887800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.314+0000 7fc8a1887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:21.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.314+0000 7fc8a1887800 20 realm 2024-09-22T08:42:21.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.314+0000 7fc8a1887800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.314+0000 7fc8a1887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:21.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.314+0000 7fc8a1887800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:21.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.314+0000 7fc8a1887800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.314+0000 7fc8a1887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:21.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.314+0000 7fc8a1887800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.315+0000 7fc8a1887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:21.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.315+0000 7fc8a1887800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.316+0000 7fc8a1887800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:21.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.316+0000 7fc8a1887800 20 searching for the correct realm 2024-09-22T08:42:21.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.317+0000 7fc89f378640 0 -- 172.21.15.38:0/4024048106 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x564917c94e20 msgr2=0x564917c972e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:21.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.321+0000 7fc89f378640 0 -- 172.21.15.38:0/4024048106 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x564917c88350 msgr2=0x564917c8a7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:21.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.327+0000 7fc8a1887800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:21.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.327+0000 7fc8a1887800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:21.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.327+0000 7fc8a1887800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:42:21.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.327+0000 7fc8a1887800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:21.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.327+0000 7fc8a1887800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:21.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.327+0000 7fc8a1887800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:42:21.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.328+0000 7fc8a1887800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.328+0000 7fc8a1887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:21.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.328+0000 7fc8a1887800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.328+0000 7fc8a1887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:21.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.328+0000 7fc8a1887800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.328+0000 7fc8a1887800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:21.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.328+0000 7fc8a1887800 20 zone default found 2024-09-22T08:42:21.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.328+0000 7fc8a1887800 4 Realm: () 2024-09-22T08:42:21.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.328+0000 7fc8a1887800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:42:21.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.328+0000 7fc8a1887800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:42:21.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.328+0000 7fc8a1887800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:21.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.328+0000 7fc8a1887800 20 zonegroup default 2024-09-22T08:42:21.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.328+0000 7fc8a1887800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.329+0000 7fc8a1887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:21.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.329+0000 7fc8a1887800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.329+0000 7fc8a1887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:21.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.329+0000 7fc8a1887800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.329+0000 7fc8a1887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:21.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.329+0000 7fc8a1887800 20 started sync module instance, tier type = 2024-09-22T08:42:21.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.329+0000 7fc8a1887800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:42:21.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.339+0000 7fc8a1887800 20 add_watcher() i=0 2024-09-22T08:42:21.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.339+0000 7fc8a1887800 20 add_watcher() i=1 2024-09-22T08:42:21.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.339+0000 7fc8a1887800 20 add_watcher() i=2 2024-09-22T08:42:21.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.339+0000 7fc8a1887800 20 add_watcher() i=3 2024-09-22T08:42:21.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.339+0000 7fc8a1887800 20 add_watcher() i=4 2024-09-22T08:42:21.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.339+0000 7fc8a1887800 20 add_watcher() i=5 2024-09-22T08:42:21.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.339+0000 7fc8a1887800 20 add_watcher() i=6 2024-09-22T08:42:21.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.340+0000 7fc8a1887800 20 add_watcher() i=7 2024-09-22T08:42:21.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.340+0000 7fc8a1887800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:21.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.342+0000 7fc755fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:21.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.342+0000 7fc8a1887800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:21.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.342+0000 7fc8a1887800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:21.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.342+0000 7fc8a1887800 5 note: GC not initialized 2024-09-22T08:42:21.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.342+0000 7fc754fe1640 20 reqs_thread_entry: start 2024-09-22T08:42:21.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.343+0000 7fc8a1887800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:21.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.343+0000 7fc8a1887800 20 Filter name: none 2024-09-22T08:42:21.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.343+0000 7fc6ce7fc640 20 reqs_thread_entry: start 2024-09-22T08:42:21.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.343+0000 7fc8a1887800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-22T08:42:21.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.343+0000 7fc8a1887800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.343+0000 7fc8a1887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:21.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.343+0000 7fc8a1887800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-22T08:42:21.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.343+0000 7fc8a1887800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-22T08:42:21.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.343+0000 7fc8a1887800 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-22T08:42:21.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.343+0000 7fc8a1887800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.344+0000 7fc8a1887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:21.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.344+0000 7fc8a1887800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-22T08:42:21.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.344+0000 7fc8a1887800 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-22T08:42:21.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.344+0000 7fc8a1887800 10 cache get: name=default.rgw.meta+users.keys+AUGFSBETAATMZXSWWFCT : miss 2024-09-22T08:42:21.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.344+0000 7fc8a1887800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.344+0000 7fc8a1887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:21.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.344+0000 7fc8a1887800 10 cache put: name=default.rgw.meta+users.keys+AUGFSBETAATMZXSWWFCT info.flags=0x0 2024-09-22T08:42:21.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.344+0000 7fc8a1887800 10 adding default.rgw.meta+users.keys+AUGFSBETAATMZXSWWFCT to cache LRU end 2024-09-22T08:42:21.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.344+0000 7fc8a1887800 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-22T08:42:21.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.344+0000 7fc8a1887800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.344+0000 7fc8a1887800 20 rados_obj.operate() r=0 bl.length=184 2024-09-22T08:42:21.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.344+0000 7fc8a1887800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-22T08:42:21.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.344+0000 7fc8a1887800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-22T08:42:21.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.344+0000 7fc8a1887800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:42:21.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.345+0000 7fc8a1887800 10 cache get: name=default.rgw.meta+users.keys+AUGFSBETAATMZXSWWFCT : hit (negative entry) 2024-09-22T08:42:21.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.345+0000 7fc8a1887800 10 cache get: name=default.rgw.meta+users.keys+AUGFSBETAATMZXSWWFCT : hit (negative entry) 2024-09-22T08:42:21.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.347+0000 7fc8a1887800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-22T08:42:21.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.347+0000 7fc8a1887800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-22T08:42:21.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.347+0000 7fc8a1887800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-22T08:42:21.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.347+0000 7fc782ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399129 cookie 94871931674384 notifier 9174 bl.length()=681 2024-09-22T08:42:21.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.347+0000 7fc782ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-22T08:42:21.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.347+0000 7fc782ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-22T08:42:21.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.349+0000 7fc8a1887800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-22T08:42:21.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.349+0000 7fc8a1887800 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-22T08:42:21.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.349+0000 7fc8a1887800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-22T08:42:21.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.349+0000 7fc782ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399086 cookie 94871931689024 notifier 9174 bl.length()=189 2024-09-22T08:42:21.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.349+0000 7fc782ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-22T08:42:21.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.349+0000 7fc782ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-22T08:42:21.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.351+0000 7fc8a1887800 10 cache put: name=default.rgw.meta+users.keys+AUGFSBETAATMZXSWWFCT info.flags=0x7 2024-09-22T08:42:21.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.351+0000 7fc8a1887800 10 moving default.rgw.meta+users.keys+AUGFSBETAATMZXSWWFCT to cache LRU end 2024-09-22T08:42:21.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.351+0000 7fc8a1887800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:AUGFSBETAATMZXSWWFCT, ofs0, ns] 2024-09-22T08:42:21.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.351+0000 7fc782ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399130 cookie 94871931674384 notifier 9174 bl.length()=188 2024-09-22T08:42:21.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.351+0000 7fc782ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+AUGFSBETAATMZXSWWFCT info.flags=0x7 2024-09-22T08:42:21.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.351+0000 7fc782ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+AUGFSBETAATMZXSWWFCT to cache LRU end 2024-09-22T08:42:21.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.352+0000 7fc8a1887800 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-22T08:42:21.355 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-22T08:42:21.355 INFO:teuthology.orchestra.run.smithi038.stdout: "user_id": "root1.client.0", 2024-09-22T08:42:21.355 INFO:teuthology.orchestra.run.smithi038.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-22T08:42:21.355 INFO:teuthology.orchestra.run.smithi038.stdout: "email": "root1+test@test.test", 2024-09-22T08:42:21.355 INFO:teuthology.orchestra.run.smithi038.stdout: "suspended": 0, 2024-09-22T08:42:21.355 INFO:teuthology.orchestra.run.smithi038.stdout: "max_buckets": 1000, 2024-09-22T08:42:21.355 INFO:teuthology.orchestra.run.smithi038.stdout: "subusers": [], 2024-09-22T08:42:21.355 INFO:teuthology.orchestra.run.smithi038.stdout: "keys": [ 2024-09-22T08:42:21.356 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-22T08:42:21.356 INFO:teuthology.orchestra.run.smithi038.stdout: "user": "root1.client.0", 2024-09-22T08:42:21.356 INFO:teuthology.orchestra.run.smithi038.stdout: "access_key": "AUGFSBETAATMZXSWWFCT", 2024-09-22T08:42:21.356 INFO:teuthology.orchestra.run.smithi038.stdout: "secret_key": "7a/4/WfscrwXPCRkpU8K42bzpBHlA1v7fH8lTegClxtT2T/lF9kuUg==", 2024-09-22T08:42:21.356 INFO:teuthology.orchestra.run.smithi038.stdout: "active": true, 2024-09-22T08:42:21.356 INFO:teuthology.orchestra.run.smithi038.stdout: "create_date": "2024-09-22T08:42:21.346850Z" 2024-09-22T08:42:21.356 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-22T08:42:21.356 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-22T08:42:21.356 INFO:teuthology.orchestra.run.smithi038.stdout: "swift_keys": [], 2024-09-22T08:42:21.356 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": [], 2024-09-22T08:42:21.356 INFO:teuthology.orchestra.run.smithi038.stdout: "op_mask": "read, write, delete", 2024-09-22T08:42:21.356 INFO:teuthology.orchestra.run.smithi038.stdout: "default_placement": "", 2024-09-22T08:42:21.356 INFO:teuthology.orchestra.run.smithi038.stdout: "default_storage_class": "", 2024-09-22T08:42:21.356 INFO:teuthology.orchestra.run.smithi038.stdout: "placement_tags": [], 2024-09-22T08:42:21.357 INFO:teuthology.orchestra.run.smithi038.stdout: "bucket_quota": { 2024-09-22T08:42:21.357 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-22T08:42:21.357 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-22T08:42:21.357 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-22T08:42:21.357 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-22T08:42:21.357 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-22T08:42:21.357 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-22T08:42:21.357 INFO:teuthology.orchestra.run.smithi038.stdout: "user_quota": { 2024-09-22T08:42:21.357 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-22T08:42:21.357 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-22T08:42:21.357 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-22T08:42:21.357 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-22T08:42:21.357 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-22T08:42:21.357 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-22T08:42:21.358 INFO:teuthology.orchestra.run.smithi038.stdout: "temp_url_keys": [], 2024-09-22T08:42:21.358 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "root", 2024-09-22T08:42:21.358 INFO:teuthology.orchestra.run.smithi038.stdout: "mfa_ids": [], 2024-09-22T08:42:21.358 INFO:teuthology.orchestra.run.smithi038.stdout: "account_id": "RGW88888888888888888", 2024-09-22T08:42:21.358 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-22T08:42:21.358 INFO:teuthology.orchestra.run.smithi038.stdout: "create_date": "2024-09-22T08:42:21.346837Z", 2024-09-22T08:42:21.358 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-22T08:42:21.358 INFO:teuthology.orchestra.run.smithi038.stdout: "group_ids": [] 2024-09-22T08:42:21.358 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-22T08:42:21.358 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:21.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.353+0000 7fc755fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:21.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.356+0000 7fc8a1887800 20 remove_watcher() i=0 2024-09-22T08:42:21.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.356+0000 7fc8a1887800 2 removed watcher, disabling cache 2024-09-22T08:42:21.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.357+0000 7fc8a1887800 20 remove_watcher() i=1 2024-09-22T08:42:21.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.358+0000 7fc8a1887800 20 remove_watcher() i=2 2024-09-22T08:42:21.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.359+0000 7fc8a1887800 20 remove_watcher() i=3 2024-09-22T08:42:21.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.360+0000 7fc8a1887800 20 remove_watcher() i=4 2024-09-22T08:42:21.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.361+0000 7fc8a1887800 20 remove_watcher() i=5 2024-09-22T08:42:21.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.363+0000 7fc8a1887800 20 remove_watcher() i=6 2024-09-22T08:42:21.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.364+0000 7fc8a1887800 20 remove_watcher() i=7 2024-09-22T08:42:21.377 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 4858638504 --totp-seed 6ZXP4KNNYQKJ5HTIDSD5JZHTAABWGBRIAXH6NXT6FF432CJHTSTTTQGDGSBPNF4G --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-22T08:42:21.445 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:21.445 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:21.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.479+0000 7f93dcb2e800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.481+0000 7f93dcb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:21.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.481+0000 7f93dcb2e800 20 realm 2024-09-22T08:42:21.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.481+0000 7f93dcb2e800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.481+0000 7f93dcb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:21.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.481+0000 7f93dcb2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:21.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.481+0000 7f93dcb2e800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.481+0000 7f93dcb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:21.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.481+0000 7f93dcb2e800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.482+0000 7f93dcb2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:21.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.482+0000 7f93dcb2e800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.483+0000 7f93dcb2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:21.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.483+0000 7f93dcb2e800 20 searching for the correct realm 2024-09-22T08:42:21.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.485+0000 7f93d88dd640 0 -- 172.21.15.38:0/1289126749 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x561904d1ed20 msgr2=0x561904d211e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:21.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.488+0000 7f93d3fff640 0 -- 172.21.15.38:0/1289126749 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f93cc063a40 msgr2=0x7f93cc079230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:21.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.695+0000 7f93dcb2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:21.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.695+0000 7f93dcb2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:21.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.695+0000 7f93dcb2e800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:42:21.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.695+0000 7f93dcb2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:21.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.695+0000 7f93dcb2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:21.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.695+0000 7f93dcb2e800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:42:21.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.695+0000 7f93dcb2e800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.695+0000 7f93dcb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:21.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.695+0000 7f93dcb2e800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.696+0000 7f93dcb2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:21.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.696+0000 7f93dcb2e800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.696+0000 7f93dcb2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:21.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.696+0000 7f93dcb2e800 20 zone default found 2024-09-22T08:42:21.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.696+0000 7f93dcb2e800 4 Realm: () 2024-09-22T08:42:21.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.696+0000 7f93dcb2e800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:42:21.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.696+0000 7f93dcb2e800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:42:21.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.696+0000 7f93dcb2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:21.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.696+0000 7f93dcb2e800 20 zonegroup default 2024-09-22T08:42:21.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.696+0000 7f93dcb2e800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.696+0000 7f93dcb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:21.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.697+0000 7f93dcb2e800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.697+0000 7f93dcb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:21.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.697+0000 7f93dcb2e800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.697+0000 7f93dcb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:21.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.697+0000 7f93dcb2e800 20 started sync module instance, tier type = 2024-09-22T08:42:21.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.697+0000 7f93dcb2e800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:42:21.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.709+0000 7f93dcb2e800 20 add_watcher() i=0 2024-09-22T08:42:21.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.709+0000 7f93dcb2e800 20 add_watcher() i=1 2024-09-22T08:42:21.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.709+0000 7f93dcb2e800 20 add_watcher() i=2 2024-09-22T08:42:21.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.709+0000 7f93dcb2e800 20 add_watcher() i=3 2024-09-22T08:42:21.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.709+0000 7f93dcb2e800 20 add_watcher() i=4 2024-09-22T08:42:21.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.709+0000 7f93dcb2e800 20 add_watcher() i=5 2024-09-22T08:42:21.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.709+0000 7f93dcb2e800 20 add_watcher() i=6 2024-09-22T08:42:21.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.710+0000 7f93dcb2e800 20 add_watcher() i=7 2024-09-22T08:42:21.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.710+0000 7f93dcb2e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:21.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.712+0000 7f928efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:21.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.712+0000 7f93dcb2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:21.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.712+0000 7f93dcb2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:21.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.712+0000 7f93dcb2e800 5 note: GC not initialized 2024-09-22T08:42:21.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.712+0000 7f928dfe3640 20 reqs_thread_entry: start 2024-09-22T08:42:21.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.712+0000 7f93dcb2e800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:21.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.712+0000 7f93dcb2e800 20 Filter name: none 2024-09-22T08:42:21.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.712+0000 7f91ff7fe640 20 reqs_thread_entry: start 2024-09-22T08:42:21.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.713+0000 7f93dcb2e800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-22T08:42:21.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.713+0000 7f93dcb2e800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.713+0000 7f93dcb2e800 20 rados_obj.operate() r=0 bl.length=494 2024-09-22T08:42:21.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.713+0000 7f93dcb2e800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-22T08:42:21.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.713+0000 7f93dcb2e800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-22T08:42:21.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.713+0000 7f93dcb2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:42:21.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.716+0000 7f93dcb2e800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-22T08:42:21.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.716+0000 7f93dcb2e800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-22T08:42:21.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.716+0000 7f93dcb2e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-22T08:42:21.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.717+0000 7f92affff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399131 cookie 94665455052944 notifier 8558 bl.length()=695 2024-09-22T08:42:21.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.717+0000 7f92affff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-22T08:42:21.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.717+0000 7f92affff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-22T08:42:21.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.718+0000 7f928efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:21.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.720+0000 7f93dcb2e800 20 remove_watcher() i=0 2024-09-22T08:42:21.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.720+0000 7f93dcb2e800 2 removed watcher, disabling cache 2024-09-22T08:42:21.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.721+0000 7f93dcb2e800 20 remove_watcher() i=1 2024-09-22T08:42:21.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.723+0000 7f93dcb2e800 20 remove_watcher() i=2 2024-09-22T08:42:21.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.724+0000 7f93dcb2e800 20 remove_watcher() i=3 2024-09-22T08:42:21.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.725+0000 7f93dcb2e800 20 remove_watcher() i=4 2024-09-22T08:42:21.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.726+0000 7f93dcb2e800 20 remove_watcher() i=5 2024-09-22T08:42:21.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.728+0000 7f93dcb2e800 20 remove_watcher() i=6 2024-09-22T08:42:21.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.729+0000 7f93dcb2e800 20 remove_watcher() i=7 2024-09-22T08:42:21.743 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-22T08:42:21.805 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:21.805 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:21.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.839+0000 7fb4faf2e800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.841+0000 7fb4faf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:21.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.841+0000 7fb4faf2e800 20 realm 2024-09-22T08:42:21.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.841+0000 7fb4faf2e800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.841+0000 7fb4faf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:21.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.841+0000 7fb4faf2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:21.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.841+0000 7fb4faf2e800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.842+0000 7fb4faf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:21.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.842+0000 7fb4faf2e800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.842+0000 7fb4faf2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:21.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.842+0000 7fb4faf2e800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.843+0000 7fb4faf2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:21.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.843+0000 7fb4faf2e800 20 searching for the correct realm 2024-09-22T08:42:21.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:21.845+0000 7fb4f64dc640 0 -- 172.21.15.38:0/88742034 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7fb4ec078070 msgr2=0x7fb4ec089a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:22.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.050+0000 7fb4f64dc640 0 -- 172.21.15.38:0/88742034 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fb4e803e430 msgr2=0x7fb4e803e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:22.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.258+0000 7fb4faf2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:22.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.258+0000 7fb4faf2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:22.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.258+0000 7fb4faf2e800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:42:22.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.258+0000 7fb4faf2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:22.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.258+0000 7fb4faf2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:22.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.258+0000 7fb4faf2e800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:42:22.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.258+0000 7fb4faf2e800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.258+0000 7fb4faf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:22.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.258+0000 7fb4faf2e800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.258+0000 7fb4faf2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:22.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.258+0000 7fb4faf2e800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.259+0000 7fb4faf2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:22.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.259+0000 7fb4faf2e800 20 zone default found 2024-09-22T08:42:22.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.259+0000 7fb4faf2e800 4 Realm: () 2024-09-22T08:42:22.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.259+0000 7fb4faf2e800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:42:22.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.259+0000 7fb4faf2e800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:42:22.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.259+0000 7fb4faf2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:22.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.259+0000 7fb4faf2e800 20 zonegroup default 2024-09-22T08:42:22.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.259+0000 7fb4faf2e800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.260+0000 7fb4faf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:22.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.260+0000 7fb4faf2e800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.260+0000 7fb4faf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:22.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.260+0000 7fb4faf2e800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.260+0000 7fb4faf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:22.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.260+0000 7fb4faf2e800 20 started sync module instance, tier type = 2024-09-22T08:42:22.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.260+0000 7fb4faf2e800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:42:22.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.271+0000 7fb4faf2e800 20 add_watcher() i=0 2024-09-22T08:42:22.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.271+0000 7fb4faf2e800 20 add_watcher() i=1 2024-09-22T08:42:22.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.271+0000 7fb4faf2e800 20 add_watcher() i=2 2024-09-22T08:42:22.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.271+0000 7fb4faf2e800 20 add_watcher() i=3 2024-09-22T08:42:22.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.271+0000 7fb4faf2e800 20 add_watcher() i=4 2024-09-22T08:42:22.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.271+0000 7fb4faf2e800 20 add_watcher() i=5 2024-09-22T08:42:22.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.271+0000 7fb4faf2e800 20 add_watcher() i=6 2024-09-22T08:42:22.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.272+0000 7fb4faf2e800 20 add_watcher() i=7 2024-09-22T08:42:22.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.272+0000 7fb4faf2e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:22.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.274+0000 7fb3ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:22.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.274+0000 7fb4faf2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:22.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.274+0000 7fb4faf2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:22.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.275+0000 7fb4faf2e800 5 note: GC not initialized 2024-09-22T08:42:22.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.275+0000 7fb327fff640 20 reqs_thread_entry: start 2024-09-22T08:42:22.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.275+0000 7fb4faf2e800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:22.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.275+0000 7fb4faf2e800 20 Filter name: none 2024-09-22T08:42:22.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.275+0000 7fb325ffb640 20 reqs_thread_entry: start 2024-09-22T08:42:22.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.275+0000 7fb4faf2e800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-22T08:42:22.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.275+0000 7fb4faf2e800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.276+0000 7fb4faf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:22.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.276+0000 7fb4faf2e800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-22T08:42:22.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.276+0000 7fb4faf2e800 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-22T08:42:22.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.276+0000 7fb4faf2e800 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-22T08:42:22.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.276+0000 7fb4faf2e800 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-22T08:42:22.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.276+0000 7fb4faf2e800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.276+0000 7fb4faf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:22.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.276+0000 7fb4faf2e800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-22T08:42:22.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.276+0000 7fb4faf2e800 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-22T08:42:22.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.276+0000 7fb4faf2e800 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-22T08:42:22.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.277+0000 7fb4faf2e800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-22T08:42:22.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.277+0000 7fb4faf2e800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-22T08:42:22.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.277+0000 7fb4faf2e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-22T08:42:22.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.278+0000 7fb3da7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399132 cookie 93830402595072 notifier 8576 bl.length()=384 2024-09-22T08:42:22.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.278+0000 7fb3da7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-22T08:42:22.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.278+0000 7fb3da7fc640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-22T08:42:22.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.280+0000 7fb4faf2e800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-22T08:42:22.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.280+0000 7fb4faf2e800 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-22T08:42:22.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.280+0000 7fb4faf2e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-22T08:42:22.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.280+0000 7fb3da7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399133 cookie 93830402606544 notifier 8576 bl.length()=225 2024-09-22T08:42:22.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.280+0000 7fb3da7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-22T08:42:22.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.280+0000 7fb3da7fc640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-22T08:42:22.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.282+0000 7fb4faf2e800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-22T08:42:22.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.282+0000 7fb4faf2e800 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-22T08:42:22.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.282+0000 7fb4faf2e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-22T08:42:22.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.282+0000 7fb3d9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398963 cookie 93830402604272 notifier 8576 bl.length()=234 2024-09-22T08:42:22.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.282+0000 7fb3d9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-22T08:42:22.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.282+0000 7fb3d9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-22T08:42:22.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.284+0000 7fb3ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:22.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.286+0000 7fb4faf2e800 20 remove_watcher() i=0 2024-09-22T08:42:22.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.286+0000 7fb4faf2e800 2 removed watcher, disabling cache 2024-09-22T08:42:22.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.288+0000 7fb4faf2e800 20 remove_watcher() i=1 2024-09-22T08:42:22.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.289+0000 7fb4faf2e800 20 remove_watcher() i=2 2024-09-22T08:42:22.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.291+0000 7fb4faf2e800 20 remove_watcher() i=3 2024-09-22T08:42:22.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.292+0000 7fb4faf2e800 20 remove_watcher() i=4 2024-09-22T08:42:22.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.293+0000 7fb4faf2e800 20 remove_watcher() i=5 2024-09-22T08:42:22.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.294+0000 7fb4faf2e800 20 remove_watcher() i=6 2024-09-22T08:42:22.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.295+0000 7fb4faf2e800 20 remove_watcher() i=7 2024-09-22T08:42:22.308 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-22T08:42:22.308 INFO:teuthology.orchestra.run.smithi038.stdout: "id": "RGW99999999999999999", 2024-09-22T08:42:22.308 INFO:teuthology.orchestra.run.smithi038.stdout: "tenant": "", 2024-09-22T08:42:22.308 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "Mr.RGW99999999999999999", 2024-09-22T08:42:22.308 INFO:teuthology.orchestra.run.smithi038.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-22T08:42:22.308 INFO:teuthology.orchestra.run.smithi038.stdout: "quota": { 2024-09-22T08:42:22.308 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-22T08:42:22.308 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-22T08:42:22.308 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-22T08:42:22.308 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-22T08:42:22.308 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-22T08:42:22.308 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-22T08:42:22.308 INFO:teuthology.orchestra.run.smithi038.stdout: "bucket_quota": { 2024-09-22T08:42:22.309 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-22T08:42:22.309 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-22T08:42:22.309 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-22T08:42:22.309 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-22T08:42:22.309 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-22T08:42:22.309 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-22T08:42:22.309 INFO:teuthology.orchestra.run.smithi038.stdout: "max_users": 1000, 2024-09-22T08:42:22.309 INFO:teuthology.orchestra.run.smithi038.stdout: "max_roles": 1000, 2024-09-22T08:42:22.309 INFO:teuthology.orchestra.run.smithi038.stdout: "max_groups": 1000, 2024-09-22T08:42:22.309 INFO:teuthology.orchestra.run.smithi038.stdout: "max_buckets": 1000, 2024-09-22T08:42:22.309 INFO:teuthology.orchestra.run.smithi038.stdout: "max_access_keys": 4 2024-09-22T08:42:22.309 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-22T08:42:22.310 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-22T08:42:22.311 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key WVSCCBKGKQXBDXSIPVLS --secret QjGfHSg8ZIOS4XBf4p1ZYQXhWIcbjHMIKrmJ1dc8jNQK0ERcEG1/kg== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-22T08:42:22.382 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:22.383 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:22.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.417+0000 7f201e412800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.418+0000 7f201e412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:22.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.418+0000 7f201e412800 20 realm 2024-09-22T08:42:22.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.418+0000 7f201e412800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.419+0000 7f201e412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:22.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.419+0000 7f201e412800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:22.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.419+0000 7f201e412800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.419+0000 7f201e412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:22.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.419+0000 7f201e412800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.420+0000 7f201e412800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:22.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.420+0000 7f201e412800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.420+0000 7f201e412800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:22.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.420+0000 7f201e412800 20 searching for the correct realm 2024-09-22T08:42:22.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.423+0000 7f2019acb640 0 -- 172.21.15.38:0/3328469712 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x55edc9457ef0 msgr2=0x55edc945a3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:22.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.427+0000 7f20192ca640 0 -- 172.21.15.38:0/3328469712 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f200c07e920 msgr2=0x7f200c0973f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:42:22.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.634+0000 7f201e412800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:22.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.634+0000 7f201e412800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:22.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.634+0000 7f201e412800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:42:22.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.634+0000 7f201e412800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:22.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.634+0000 7f201e412800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:22.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.634+0000 7f201e412800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:42:22.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.634+0000 7f201e412800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.635+0000 7f201e412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:22.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.635+0000 7f201e412800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.635+0000 7f201e412800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:22.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.635+0000 7f201e412800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.636+0000 7f201e412800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:22.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.636+0000 7f201e412800 20 zone default found 2024-09-22T08:42:22.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.636+0000 7f201e412800 4 Realm: () 2024-09-22T08:42:22.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.636+0000 7f201e412800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:42:22.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.636+0000 7f201e412800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:42:22.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.636+0000 7f201e412800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:22.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.636+0000 7f201e412800 20 zonegroup default 2024-09-22T08:42:22.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.636+0000 7f201e412800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.636+0000 7f201e412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:22.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.636+0000 7f201e412800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.636+0000 7f201e412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:22.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.636+0000 7f201e412800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.637+0000 7f201e412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:22.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.637+0000 7f201e412800 20 started sync module instance, tier type = 2024-09-22T08:42:22.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.637+0000 7f201e412800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:42:22.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.647+0000 7f201e412800 20 add_watcher() i=0 2024-09-22T08:42:22.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.647+0000 7f201e412800 20 add_watcher() i=1 2024-09-22T08:42:22.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.647+0000 7f201e412800 20 add_watcher() i=2 2024-09-22T08:42:22.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.647+0000 7f201e412800 20 add_watcher() i=3 2024-09-22T08:42:22.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.647+0000 7f201e412800 20 add_watcher() i=4 2024-09-22T08:42:22.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.647+0000 7f201e412800 20 add_watcher() i=5 2024-09-22T08:42:22.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.647+0000 7f201e412800 20 add_watcher() i=6 2024-09-22T08:42:22.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.648+0000 7f201e412800 20 add_watcher() i=7 2024-09-22T08:42:22.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.648+0000 7f201e412800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:22.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.650+0000 7f1ecb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:22.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.650+0000 7f201e412800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:22.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.650+0000 7f201e412800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:22.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.650+0000 7f201e412800 5 note: GC not initialized 2024-09-22T08:42:22.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.651+0000 7f1eca7fc640 20 reqs_thread_entry: start 2024-09-22T08:42:22.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.651+0000 7f201e412800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:22.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.651+0000 7f201e412800 20 Filter name: none 2024-09-22T08:42:22.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.651+0000 7f1e3bfff640 20 reqs_thread_entry: start 2024-09-22T08:42:22.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.651+0000 7f201e412800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-22T08:42:22.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.651+0000 7f201e412800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.651+0000 7f201e412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:22.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.651+0000 7f201e412800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-22T08:42:22.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.651+0000 7f201e412800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-22T08:42:22.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.651+0000 7f201e412800 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-22T08:42:22.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.651+0000 7f201e412800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.652+0000 7f201e412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:22.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.652+0000 7f201e412800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-22T08:42:22.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.652+0000 7f201e412800 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-22T08:42:22.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.652+0000 7f201e412800 10 cache get: name=default.rgw.meta+users.keys+WVSCCBKGKQXBDXSIPVLS : miss 2024-09-22T08:42:22.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.652+0000 7f201e412800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.652+0000 7f201e412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:22.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.652+0000 7f201e412800 10 cache put: name=default.rgw.meta+users.keys+WVSCCBKGKQXBDXSIPVLS info.flags=0x0 2024-09-22T08:42:22.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.652+0000 7f201e412800 10 adding default.rgw.meta+users.keys+WVSCCBKGKQXBDXSIPVLS to cache LRU end 2024-09-22T08:42:22.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.652+0000 7f201e412800 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-22T08:42:22.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.652+0000 7f201e412800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.653+0000 7f201e412800 20 rados_obj.operate() r=0 bl.length=184 2024-09-22T08:42:22.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.653+0000 7f201e412800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-22T08:42:22.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.653+0000 7f201e412800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-22T08:42:22.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.653+0000 7f201e412800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:42:22.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.653+0000 7f201e412800 10 cache get: name=default.rgw.meta+users.keys+WVSCCBKGKQXBDXSIPVLS : hit (negative entry) 2024-09-22T08:42:22.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.653+0000 7f201e412800 10 cache get: name=default.rgw.meta+users.keys+WVSCCBKGKQXBDXSIPVLS : hit (negative entry) 2024-09-22T08:42:22.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.655+0000 7f201e412800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-22T08:42:22.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.655+0000 7f201e412800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-22T08:42:22.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.655+0000 7f201e412800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-22T08:42:22.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.655+0000 7f1efd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399134 cookie 94479772397648 notifier 9234 bl.length()=681 2024-09-22T08:42:22.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.655+0000 7f1efd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-22T08:42:22.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.655+0000 7f1efd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-22T08:42:22.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.657+0000 7f201e412800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-22T08:42:22.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.657+0000 7f201e412800 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-22T08:42:22.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.657+0000 7f201e412800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-22T08:42:22.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.657+0000 7f1efd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399087 cookie 94479772408208 notifier 9234 bl.length()=189 2024-09-22T08:42:22.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.657+0000 7f1efd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-22T08:42:22.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.657+0000 7f1efd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-22T08:42:22.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.659+0000 7f201e412800 10 cache put: name=default.rgw.meta+users.keys+WVSCCBKGKQXBDXSIPVLS info.flags=0x7 2024-09-22T08:42:22.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.659+0000 7f201e412800 10 moving default.rgw.meta+users.keys+WVSCCBKGKQXBDXSIPVLS to cache LRU end 2024-09-22T08:42:22.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.659+0000 7f201e412800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:WVSCCBKGKQXBDXSIPVLS, ofs0, ns] 2024-09-22T08:42:22.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.659+0000 7f1efd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399135 cookie 94479772397648 notifier 9234 bl.length()=188 2024-09-22T08:42:22.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.659+0000 7f1efd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+WVSCCBKGKQXBDXSIPVLS info.flags=0x7 2024-09-22T08:42:22.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.659+0000 7f1efd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+WVSCCBKGKQXBDXSIPVLS to cache LRU end 2024-09-22T08:42:22.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.661+0000 7f201e412800 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-22T08:42:22.663 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-22T08:42:22.663 INFO:teuthology.orchestra.run.smithi038.stdout: "user_id": "root2.client.0", 2024-09-22T08:42:22.663 INFO:teuthology.orchestra.run.smithi038.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-22T08:42:22.663 INFO:teuthology.orchestra.run.smithi038.stdout: "email": "root2+test@test.test", 2024-09-22T08:42:22.663 INFO:teuthology.orchestra.run.smithi038.stdout: "suspended": 0, 2024-09-22T08:42:22.664 INFO:teuthology.orchestra.run.smithi038.stdout: "max_buckets": 1000, 2024-09-22T08:42:22.664 INFO:teuthology.orchestra.run.smithi038.stdout: "subusers": [], 2024-09-22T08:42:22.664 INFO:teuthology.orchestra.run.smithi038.stdout: "keys": [ 2024-09-22T08:42:22.664 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-22T08:42:22.664 INFO:teuthology.orchestra.run.smithi038.stdout: "user": "root2.client.0", 2024-09-22T08:42:22.664 INFO:teuthology.orchestra.run.smithi038.stdout: "access_key": "WVSCCBKGKQXBDXSIPVLS", 2024-09-22T08:42:22.664 INFO:teuthology.orchestra.run.smithi038.stdout: "secret_key": "QjGfHSg8ZIOS4XBf4p1ZYQXhWIcbjHMIKrmJ1dc8jNQK0ERcEG1/kg==", 2024-09-22T08:42:22.664 INFO:teuthology.orchestra.run.smithi038.stdout: "active": true, 2024-09-22T08:42:22.664 INFO:teuthology.orchestra.run.smithi038.stdout: "create_date": "2024-09-22T08:42:22.655292Z" 2024-09-22T08:42:22.664 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-22T08:42:22.664 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-22T08:42:22.664 INFO:teuthology.orchestra.run.smithi038.stdout: "swift_keys": [], 2024-09-22T08:42:22.664 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": [], 2024-09-22T08:42:22.664 INFO:teuthology.orchestra.run.smithi038.stdout: "op_mask": "read, write, delete", 2024-09-22T08:42:22.664 INFO:teuthology.orchestra.run.smithi038.stdout: "default_placement": "", 2024-09-22T08:42:22.665 INFO:teuthology.orchestra.run.smithi038.stdout: "default_storage_class": "", 2024-09-22T08:42:22.665 INFO:teuthology.orchestra.run.smithi038.stdout: "placement_tags": [], 2024-09-22T08:42:22.665 INFO:teuthology.orchestra.run.smithi038.stdout: "bucket_quota": { 2024-09-22T08:42:22.665 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-22T08:42:22.665 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-22T08:42:22.665 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-22T08:42:22.665 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-22T08:42:22.665 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-22T08:42:22.665 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-22T08:42:22.665 INFO:teuthology.orchestra.run.smithi038.stdout: "user_quota": { 2024-09-22T08:42:22.665 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-22T08:42:22.665 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-22T08:42:22.665 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-22T08:42:22.665 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-22T08:42:22.665 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-22T08:42:22.665 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-22T08:42:22.666 INFO:teuthology.orchestra.run.smithi038.stdout: "temp_url_keys": [], 2024-09-22T08:42:22.666 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "root", 2024-09-22T08:42:22.666 INFO:teuthology.orchestra.run.smithi038.stdout: "mfa_ids": [], 2024-09-22T08:42:22.666 INFO:teuthology.orchestra.run.smithi038.stdout: "account_id": "RGW99999999999999999", 2024-09-22T08:42:22.666 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-22T08:42:22.666 INFO:teuthology.orchestra.run.smithi038.stdout: "create_date": "2024-09-22T08:42:22.655278Z", 2024-09-22T08:42:22.666 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-22T08:42:22.666 INFO:teuthology.orchestra.run.smithi038.stdout: "group_ids": [] 2024-09-22T08:42:22.666 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-22T08:42:22.666 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:42:22.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.662+0000 7f1ecb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:22.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.664+0000 7f201e412800 20 remove_watcher() i=0 2024-09-22T08:42:22.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.664+0000 7f201e412800 2 removed watcher, disabling cache 2024-09-22T08:42:22.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.666+0000 7f201e412800 20 remove_watcher() i=1 2024-09-22T08:42:22.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.667+0000 7f201e412800 20 remove_watcher() i=2 2024-09-22T08:42:22.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.668+0000 7f201e412800 20 remove_watcher() i=3 2024-09-22T08:42:22.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.669+0000 7f201e412800 20 remove_watcher() i=4 2024-09-22T08:42:22.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.671+0000 7f201e412800 20 remove_watcher() i=5 2024-09-22T08:42:22.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.672+0000 7f201e412800 20 remove_watcher() i=6 2024-09-22T08:42:22.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.673+0000 7f201e412800 20 remove_watcher() i=7 2024-09-22T08:42:22.686 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 9838425540 --totp-seed 3X6EJTGFBBDXQ3N6PUF5NS26U4QQLSXW3765TGVWLQ6AA36FTOIPYTAR5A2DFSFS --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-22T08:42:22.754 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:22.754 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:22.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.789+0000 7fa321b73800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.791+0000 7fa321b73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:22.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.791+0000 7fa321b73800 20 realm 2024-09-22T08:42:22.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.791+0000 7fa321b73800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.791+0000 7fa321b73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:22.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.791+0000 7fa321b73800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:22.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.791+0000 7fa321b73800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.791+0000 7fa321b73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:22.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.791+0000 7fa321b73800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.792+0000 7fa321b73800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:22.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.792+0000 7fa321b73800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.793+0000 7fa321b73800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:22.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.793+0000 7fa321b73800 20 searching for the correct realm 2024-09-22T08:42:22.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:22.796+0000 7fa31fe5e640 0 -- 172.21.15.38:0/3119119340 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x7fa31009ec20 msgr2=0x7fa310066e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:23.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.002+0000 7fa31f65d640 0 -- 172.21.15.38:0/3119119340 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x55d46fceb090 msgr2=0x55d46fced4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:23.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.007+0000 7fa321b73800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:23.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.007+0000 7fa321b73800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:23.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.007+0000 7fa321b73800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:42:23.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.007+0000 7fa321b73800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:23.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.007+0000 7fa321b73800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:23.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.007+0000 7fa321b73800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:42:23.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.007+0000 7fa321b73800 20 rados->read ofs=0 len=0 2024-09-22T08:42:23.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.007+0000 7fa321b73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:23.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.007+0000 7fa321b73800 20 rados->read ofs=0 len=0 2024-09-22T08:42:23.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.008+0000 7fa321b73800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:23.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.008+0000 7fa321b73800 20 rados->read ofs=0 len=0 2024-09-22T08:42:23.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.008+0000 7fa321b73800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:23.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.008+0000 7fa321b73800 20 zone default found 2024-09-22T08:42:23.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.008+0000 7fa321b73800 4 Realm: () 2024-09-22T08:42:23.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.008+0000 7fa321b73800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:42:23.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.008+0000 7fa321b73800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:42:23.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.008+0000 7fa321b73800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:23.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.008+0000 7fa321b73800 20 zonegroup default 2024-09-22T08:42:23.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.008+0000 7fa321b73800 20 rados->read ofs=0 len=0 2024-09-22T08:42:23.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.008+0000 7fa321b73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:23.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.008+0000 7fa321b73800 20 rados->read ofs=0 len=0 2024-09-22T08:42:23.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.009+0000 7fa321b73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:23.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.009+0000 7fa321b73800 20 rados->read ofs=0 len=0 2024-09-22T08:42:23.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.009+0000 7fa321b73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:23.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.009+0000 7fa321b73800 20 started sync module instance, tier type = 2024-09-22T08:42:23.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.009+0000 7fa321b73800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:42:23.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.020+0000 7fa321b73800 20 add_watcher() i=0 2024-09-22T08:42:23.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.020+0000 7fa321b73800 20 add_watcher() i=1 2024-09-22T08:42:23.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.020+0000 7fa321b73800 20 add_watcher() i=2 2024-09-22T08:42:23.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.020+0000 7fa321b73800 20 add_watcher() i=3 2024-09-22T08:42:23.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.020+0000 7fa321b73800 20 add_watcher() i=4 2024-09-22T08:42:23.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.020+0000 7fa321b73800 20 add_watcher() i=5 2024-09-22T08:42:23.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.020+0000 7fa321b73800 20 add_watcher() i=6 2024-09-22T08:42:23.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.021+0000 7fa321b73800 20 add_watcher() i=7 2024-09-22T08:42:23.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.021+0000 7fa321b73800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:23.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.023+0000 7fa1d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:23.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.023+0000 7fa321b73800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:23.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.023+0000 7fa321b73800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:23.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.023+0000 7fa321b73800 5 note: GC not initialized 2024-09-22T08:42:23.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.024+0000 7fa1d4fe1640 20 reqs_thread_entry: start 2024-09-22T08:42:23.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.024+0000 7fa321b73800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:23.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.024+0000 7fa321b73800 20 Filter name: none 2024-09-22T08:42:23.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.024+0000 7fa14e7fc640 20 reqs_thread_entry: start 2024-09-22T08:42:23.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.024+0000 7fa321b73800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-22T08:42:23.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.024+0000 7fa321b73800 20 rados->read ofs=0 len=0 2024-09-22T08:42:23.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.024+0000 7fa321b73800 20 rados_obj.operate() r=0 bl.length=494 2024-09-22T08:42:23.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.025+0000 7fa321b73800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-22T08:42:23.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.025+0000 7fa321b73800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-22T08:42:23.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.025+0000 7fa321b73800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:42:23.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.027+0000 7fa321b73800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-22T08:42:23.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.027+0000 7fa321b73800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-22T08:42:23.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.027+0000 7fa321b73800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-22T08:42:23.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.027+0000 7fa202ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399136 cookie 94370897310144 notifier 9252 bl.length()=695 2024-09-22T08:42:23.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.027+0000 7fa202ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-22T08:42:23.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.027+0000 7fa202ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-22T08:42:23.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.029+0000 7fa1d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:23.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.032+0000 7fa321b73800 20 remove_watcher() i=0 2024-09-22T08:42:23.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.032+0000 7fa321b73800 2 removed watcher, disabling cache 2024-09-22T08:42:23.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.033+0000 7fa321b73800 20 remove_watcher() i=1 2024-09-22T08:42:23.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.034+0000 7fa321b73800 20 remove_watcher() i=2 2024-09-22T08:42:23.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.035+0000 7fa321b73800 20 remove_watcher() i=3 2024-09-22T08:42:23.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.036+0000 7fa321b73800 20 remove_watcher() i=4 2024-09-22T08:42:23.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.037+0000 7fa321b73800 20 remove_watcher() i=5 2024-09-22T08:42:23.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.038+0000 7fa321b73800 20 remove_watcher() i=6 2024-09-22T08:42:23.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:42:23.040+0000 7fa321b73800 20 remove_watcher() i=7 2024-09-22T08:42:23.053 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-22T08:42:23.054 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-22T08:42:23.054 DEBUG:teuthology.orchestra.run.smithi038:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-22T08:42:23.083 INFO:tasks.s3tests:Configuring boto... 2024-09-22T08:42:23.083 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-22T08:42:23.083 DEBUG:teuthology.orchestra.run.smithi038:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-22T08:42:23.152 DEBUG:teuthology.orchestra.run.smithi038:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-22T08:42:23.336 INFO:teuthology.orchestra.run.smithi038.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-22T08:42:23.522 INFO:teuthology.orchestra.run.smithi038.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-22T08:42:23.800 INFO:teuthology.orchestra.run.smithi038.stdout:py installdeps: -rrequirements.txt 2024-09-22T08:44:08.150 INFO:teuthology.orchestra.run.smithi038.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-22T08:44:09.627 INFO:teuthology.orchestra.run.smithi038.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.1,gevent==24.2.1,greenlet==3.1.1,httplib2==0.22.0,idna==3.10,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.6,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.8.0,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=8688dd8b3ebd2a6efe2134cbf7a8f89733baccfa0554d9858dbb586cd7fe0d47,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.20.0,urllib3==1.26.20,virtualenv==20.26.5,zope.event==5.0,zope.interface==7.0.3 2024-09-22T08:44:09.628 INFO:teuthology.orchestra.run.smithi038.stdout:py run-test-pre: PYTHONHASHSEED='450439756' 2024-09-22T08:44:09.628 INFO:teuthology.orchestra.run.smithi038.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-22T08:44:09.768 INFO:teuthology.orchestra.run.smithi038.stdout:============================= test session starts ============================== 2024-09-22T08:44:09.768 INFO:teuthology.orchestra.run.smithi038.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-22T08:44:09.768 INFO:teuthology.orchestra.run.smithi038.stdout:cachedir: .tox/py/.pytest_cache 2024-09-22T08:44:09.768 INFO:teuthology.orchestra.run.smithi038.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-22T08:44:09.768 INFO:teuthology.orchestra.run.smithi038.stdout:configfile: pytest.ini 2024-09-22T08:44:11.612 INFO:teuthology.orchestra.run.smithi038.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-22T08:44:11.613 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:44:11.945 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-22T08:44:12.121 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-22T08:44:12.294 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-22T08:44:12.467 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-22T08:44:12.641 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-22T08:44:12.768 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-22T08:44:12.941 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-22T08:44:13.068 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-22T08:44:13.154 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-22T08:44:13.241 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-22T08:44:13.422 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-22T08:44:13.600 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-22T08:44:13.780 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-22T08:44:13.956 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-22T08:44:14.043 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-22T08:44:14.130 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-22T08:44:14.176 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-22T08:44:14.221 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-22T08:44:14.266 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-22T08:44:14.312 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-22T08:44:14.357 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-22T08:44:14.403 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-22T08:44:14.450 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-22T08:44:14.496 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-22T08:44:14.542 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-22T08:44:14.588 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-22T08:44:14.634 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-22T08:44:14.680 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-22T08:44:14.727 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-22T08:44:14.773 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-22T08:44:14.820 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-22T08:44:14.868 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-22T08:44:14.915 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-22T08:44:14.962 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-22T08:44:15.008 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-22T08:44:15.056 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-22T08:44:15.103 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-22T08:44:15.150 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-22T08:44:15.197 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-22T08:44:15.244 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-22T08:44:15.291 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-22T08:44:15.338 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-22T08:44:15.385 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-22T08:44:15.432 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-22T08:44:15.480 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-22T08:44:15.527 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-22T08:44:15.573 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-22T08:44:15.621 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-22T08:44:15.668 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-22T08:44:15.714 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-22T08:44:15.761 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-22T08:44:15.809 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-22T08:44:15.856 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-22T08:44:16.298 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-22T08:44:16.895 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-22T08:44:17.945 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-22T08:44:19.028 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-22T08:44:20.815 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-22T08:44:21.441 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-22T08:44:22.234 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-22T08:44:22.471 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-22T08:44:22.607 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-22T08:44:22.825 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-22T08:44:23.048 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-22T08:44:23.397 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-22T08:44:23.596 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-22T08:44:23.835 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-22T08:44:23.835 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-22T08:44:23.836 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-22T08:44:23.837 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-22T08:44:23.855 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-22T08:44:23.855 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-22T08:44:23.856 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-22T08:44:23.857 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-22T08:44:23.858 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-22T08:44:23.858 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-22T08:44:23.859 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-22T08:44:23.860 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-22T08:44:23.861 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-22T08:44:23.862 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-22T08:44:23.863 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-22T08:44:23.863 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-22T08:44:23.864 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-22T08:44:23.865 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-22T08:44:23.866 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-22T08:44:23.867 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-22T08:44:23.867 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-22T08:44:23.868 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-22T08:44:23.869 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-22T08:44:23.870 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-22T08:44:23.871 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-22T08:44:23.871 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-22T08:44:23.872 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-22T08:44:23.873 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-22T08:44:23.962 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-22T08:44:23.975 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-22T08:44:24.573 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-22T08:44:30.133 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-22T08:44:30.474 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-22T08:44:30.833 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-22T08:44:31.257 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-22T08:44:31.653 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-22T08:44:32.023 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-22T08:44:32.368 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-22T08:44:32.832 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-22T08:44:33.173 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-22T08:44:33.512 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-22T08:44:33.877 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-22T08:44:34.176 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-22T08:44:34.465 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-22T08:44:34.679 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-22T08:44:35.029 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-22T08:44:35.443 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-22T08:44:35.791 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-22T08:44:36.167 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-22T08:44:36.548 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-22T08:44:36.924 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-22T08:44:37.300 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-22T08:44:37.645 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-22T08:44:37.935 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-22T08:44:38.262 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-22T08:44:38.504 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-22T08:44:38.782 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-22T08:44:39.037 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-22T08:44:39.292 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-22T08:44:39.545 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-22T08:44:39.999 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-22T08:44:40.255 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-22T08:44:40.508 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-22T08:44:40.851 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-22T08:44:41.195 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-22T08:44:41.487 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-22T08:44:41.842 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-22T08:44:42.181 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-22T08:44:42.618 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-22T08:44:42.937 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-22T08:44:43.297 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-22T08:44:43.662 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-22T08:44:44.205 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-22T08:44:44.629 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-22T08:44:45.028 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-22T08:44:45.430 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-22T08:44:45.964 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-22T08:44:46.383 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-22T08:44:46.876 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-22T08:44:47.375 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-22T08:44:47.863 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-22T08:44:48.285 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-22T08:44:48.814 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-22T08:44:49.214 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-22T08:44:50.149 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-22T08:44:50.823 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-22T08:44:51.642 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-22T08:44:53.298 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-22T08:44:55.516 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-22T08:44:56.759 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-22T08:44:57.875 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-22T08:44:58.696 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-22T08:44:59.235 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-22T08:45:00.232 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-22T08:45:00.956 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-22T08:45:01.910 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-22T08:45:02.588 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-22T08:45:03.862 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-22T08:45:04.730 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-22T08:45:06.071 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-22T08:45:07.371 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-22T08:45:08.263 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-22T08:45:09.081 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-22T08:45:09.756 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-22T08:45:11.391 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-22T08:45:12.588 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-22T08:45:13.968 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-22T08:45:15.254 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-22T08:45:16.424 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-22T08:45:17.595 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-22T08:45:18.503 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-22T08:45:19.187 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-22T08:45:19.950 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-22T08:45:21.396 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-22T08:45:23.339 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-22T08:45:24.158 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-22T08:45:25.400 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-22T08:45:26.646 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-22T08:45:27.758 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-22T08:45:28.973 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-22T08:45:30.295 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-22T08:45:31.491 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-22T08:45:32.650 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-22T08:45:33.437 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-22T08:45:34.106 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-22T08:45:34.751 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-22T08:45:35.446 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-22T08:45:36.478 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-22T08:45:37.558 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-22T08:45:38.625 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-22T08:45:39.672 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-22T08:45:40.773 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-22T08:45:41.841 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-22T08:45:42.870 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-22T08:45:43.960 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-22T08:45:44.993 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-22T08:45:46.104 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-22T08:45:47.177 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-22T08:45:48.292 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-22T08:45:48.995 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-22T08:45:49.733 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-22T08:45:50.422 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-22T08:45:51.124 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-22T08:45:51.617 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-22T08:45:52.127 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-22T08:45:52.569 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-22T08:45:53.024 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-22T08:45:53.440 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-22T08:45:53.851 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-22T08:45:54.335 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-22T08:45:54.770 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-22T08:45:55.205 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-22T08:45:55.960 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-22T08:45:56.710 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-22T08:45:57.097 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-22T08:45:57.532 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-22T08:45:57.983 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-22T08:45:58.422 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-22T08:45:59.218 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-22T08:46:00.012 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-22T08:46:00.452 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-22T08:46:00.857 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-22T08:46:01.276 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-22T08:46:01.697 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-22T08:46:02.137 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-22T08:46:02.585 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-22T08:46:03.027 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-22T08:46:03.483 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-22T08:46:03.907 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-22T08:46:04.313 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-22T08:46:04.747 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-22T08:46:05.184 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-22T08:46:05.582 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-22T08:46:05.999 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-22T08:46:06.472 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-22T08:46:06.878 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-22T08:46:07.282 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-22T08:46:14.849 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-22T08:46:15.258 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-22T08:46:15.692 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-22T08:46:16.120 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-22T08:46:16.521 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-22T08:46:16.956 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-22T08:46:17.356 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-22T08:46:17.767 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-22T08:46:18.177 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-22T08:46:18.606 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-22T08:46:19.004 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-22T08:46:19.448 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-22T08:46:19.883 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-22T08:46:20.302 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-22T08:46:20.741 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-22T08:46:21.150 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-22T08:46:21.569 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-22T08:46:22.009 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-22T08:46:22.460 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-22T08:46:22.909 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-22T08:46:23.346 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-22T08:46:23.748 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-22T08:46:24.152 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-22T08:46:24.605 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-22T08:46:25.091 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-22T08:46:25.578 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-22T08:46:26.015 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-22T08:46:26.457 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-22T08:46:26.878 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-22T08:46:27.122 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-22T08:46:27.552 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-22T08:46:28.318 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-22T08:46:29.073 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-22T08:46:29.490 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-22T08:46:30.103 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-22T08:46:30.511 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-22T08:46:30.952 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-22T08:46:31.466 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-22T08:46:31.929 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-22T08:46:32.353 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-22T08:46:32.763 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-22T08:46:33.210 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-22T08:46:33.619 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-22T08:46:34.056 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-22T08:46:34.505 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-22T08:46:35.111 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-22T08:46:35.864 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-22T08:46:36.248 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-22T08:46:36.826 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-22T08:46:37.208 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-22T08:46:37.579 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-22T08:46:37.871 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-22T08:46:38.114 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-22T08:46:38.368 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-22T08:46:38.758 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-22T08:46:39.176 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-22T08:46:39.420 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-22T08:46:39.843 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-22T08:46:40.173 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-22T08:46:40.543 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-22T08:46:40.948 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-22T08:46:41.588 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-22T08:46:42.117 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-22T08:46:42.646 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-22T08:46:50.110 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-22T08:46:57.657 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-22T08:46:58.045 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-22T08:46:58.427 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-22T08:46:58.826 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-22T08:46:59.182 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-22T08:46:59.621 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-22T08:46:59.994 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-22T08:47:00.370 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-22T08:47:00.762 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-22T08:47:01.169 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-22T08:47:01.598 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-22T08:47:02.034 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-22T08:47:02.443 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-22T08:47:02.826 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-22T08:47:03.207 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-22T08:47:03.591 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-22T08:47:03.936 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-22T08:47:04.352 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-22T08:47:04.836 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-22T08:47:05.189 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-22T08:47:05.580 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-22T08:47:06.047 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-22T08:47:06.443 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-22T08:47:06.831 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-22T08:47:07.174 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-22T08:47:07.527 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-22T08:47:07.911 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-22T08:47:08.323 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-22T08:47:08.679 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-22T08:47:09.104 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-22T08:47:09.457 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-22T08:47:09.841 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-22T08:47:10.215 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-22T08:47:10.587 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-22T08:47:11.014 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-22T08:47:11.401 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-22T08:47:11.745 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-22T08:47:12.117 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-22T08:47:12.478 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-22T08:47:12.861 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-22T08:47:13.206 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-22T08:47:13.580 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-22T08:47:14.021 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-22T08:47:14.408 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-22T08:47:14.797 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-22T08:47:15.264 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-22T08:47:15.629 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-22T08:47:16.017 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-22T08:47:16.472 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-22T08:47:17.914 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-22T08:47:18.354 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-22T08:47:18.791 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-22T08:47:19.313 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-22T08:47:19.838 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-22T08:47:20.273 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-22T08:47:20.697 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-22T08:47:21.167 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-22T08:47:21.646 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-22T08:47:22.047 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-22T08:47:22.561 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-22T08:47:22.976 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-22T08:47:23.359 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-22T08:47:23.709 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-22T08:47:24.099 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-22T08:47:24.461 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-22T08:47:24.663 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-22T08:47:25.096 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-22T08:47:25.479 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-22T08:47:25.942 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-22T08:47:28.553 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-22T08:47:28.955 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-22T08:47:29.358 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-22T08:47:29.704 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-22T08:47:30.048 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-22T08:47:30.394 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-22T08:47:30.778 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-22T08:47:31.235 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-22T08:47:31.692 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-22T08:47:32.126 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-22T08:47:32.520 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-22T08:47:32.956 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-22T08:47:33.426 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-22T08:47:33.780 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-22T08:47:34.126 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-22T08:47:34.570 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-22T08:47:35.013 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-22T08:47:35.489 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-22T08:47:35.783 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-22T08:47:36.026 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-22T08:47:36.281 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-22T08:47:36.596 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-22T08:47:36.929 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-22T08:47:37.258 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-22T08:47:37.579 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-22T08:47:37.948 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-22T08:47:38.190 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-22T08:47:38.435 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-22T08:47:38.774 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-22T08:47:39.016 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-22T08:47:39.259 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-22T08:47:39.502 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-22T08:47:39.744 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-22T08:47:40.045 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-22T08:47:40.404 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-22T08:47:40.768 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-22T08:47:41.097 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-22T08:47:41.459 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-22T08:47:41.794 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-22T08:47:42.164 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-22T08:47:42.571 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-22T08:47:42.903 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-22T08:47:43.260 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-22T08:47:43.698 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-22T08:47:44.190 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-22T08:47:44.678 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-22T08:47:45.095 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-22T08:47:45.495 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-22T08:47:45.933 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-22T08:47:46.365 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-22T08:47:46.797 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-22T08:47:47.237 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-22T08:47:47.606 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-22T08:47:48.113 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-22T08:47:48.604 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-22T08:47:49.072 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-22T08:47:49.595 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-22T08:47:50.074 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-22T08:47:50.815 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-22T08:47:51.521 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-22T08:47:52.064 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-22T08:47:52.734 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-22T08:47:53.404 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-22T08:47:53.802 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-22T08:47:54.270 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-22T08:47:54.737 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-22T08:47:55.161 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-22T08:47:55.589 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-22T08:47:56.095 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-22T08:47:56.766 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-22T08:47:57.452 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-22T08:47:58.184 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-22T08:47:58.856 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-22T08:47:59.541 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-22T08:48:00.229 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-22T08:48:00.866 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-22T08:48:01.596 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-22T08:48:02.263 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-22T08:48:02.857 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-22T08:48:03.424 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-22T08:48:03.979 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-22T08:48:04.723 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-22T08:48:05.417 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-22T08:48:05.711 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-22T08:48:05.966 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-22T08:48:06.222 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-22T08:48:06.640 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-22T08:48:07.047 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-22T08:48:07.377 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-22T08:48:07.697 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-22T08:48:08.218 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-22T08:48:09.272 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-22T08:48:09.815 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-22T08:48:10.286 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-22T08:48:10.860 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-22T08:48:11.373 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-22T08:48:11.814 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-22T08:48:12.243 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-22T08:48:12.694 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-22T08:48:13.357 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-22T08:48:13.835 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-22T08:48:14.434 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-22T08:48:14.996 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-22T08:48:15.686 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-22T08:48:16.316 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-22T08:48:16.658 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-22T08:48:17.225 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-22T08:48:18.471 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-22T08:48:18.958 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-22T08:48:20.953 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-22T08:48:21.359 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-22T08:48:21.903 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-22T08:48:22.726 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-22T08:48:23.206 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-22T08:48:24.056 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-22T08:48:25.896 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-22T08:48:28.305 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-22T08:48:30.779 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-22T08:48:41.302 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-22T08:48:42.551 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-22T08:48:45.437 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-22T08:48:45.937 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-22T08:48:46.658 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-22T08:48:47.390 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-22T08:48:47.961 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-22T08:48:48.393 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-22T08:48:49.110 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-22T08:48:49.596 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-22T08:48:50.001 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-22T08:48:50.436 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-22T08:49:04.825 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-22T08:49:06.838 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-22T08:49:07.270 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-22T08:49:07.566 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-22T08:49:08.039 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-22T08:49:13.160 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-22T08:49:16.661 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-22T08:49:20.117 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-22T08:49:20.588 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-22T08:49:21.105 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-22T08:49:21.584 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-22T08:49:22.077 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-22T08:49:22.535 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-22T08:49:22.938 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-22T08:49:23.370 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-22T08:49:23.962 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-22T08:49:24.540 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-22T08:49:25.195 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-22T08:49:25.793 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-22T08:49:26.570 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-22T08:49:27.234 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-22T08:49:27.689 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-22T08:49:28.347 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-22T08:49:28.940 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-22T08:49:29.443 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-22T08:49:29.972 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-22T08:49:30.637 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-22T08:49:31.024 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-22T08:49:35.583 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-22T08:49:36.026 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-22T08:49:36.452 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-22T08:49:36.859 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-22T08:49:37.314 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-22T08:49:38.008 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-22T08:49:44.422 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-22T08:49:44.968 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-22T08:49:45.591 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-22T08:49:46.276 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-22T08:49:47.083 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-22T08:49:49.862 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-22T08:49:50.507 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-22T08:49:53.986 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-22T08:50:06.657 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-22T08:50:09.005 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-22T08:50:10.141 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-22T08:50:11.432 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-22T08:50:12.005 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-22T08:50:12.639 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-22T08:50:13.197 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-22T08:50:13.843 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-22T08:50:14.436 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-22T08:50:15.144 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-22T08:50:15.477 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-22T08:50:15.823 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-22T08:50:16.169 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-22T08:50:16.539 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-22T08:50:16.884 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-22T08:50:17.306 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-22T08:50:17.644 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-22T08:50:18.009 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-22T08:50:18.441 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-22T08:50:18.775 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-22T08:50:19.095 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-22T08:50:19.449 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-22T08:50:19.785 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-22T08:50:20.123 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-22T08:50:20.547 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-22T08:50:21.014 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-22T08:50:21.412 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-22T08:50:21.857 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-22T08:50:22.254 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-22T08:50:22.682 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-22T08:50:23.067 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-22T08:50:23.406 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-22T08:50:23.742 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-22T08:50:24.120 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-22T08:50:24.456 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-22T08:50:27.791 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-22T08:50:31.083 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-22T08:50:32.059 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-22T08:50:32.529 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-22T08:51:33.085 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-22T08:52:34.402 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-22T08:52:34.831 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-22T08:52:35.273 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-22T08:52:35.687 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-22T08:52:36.022 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-22T08:52:38.512 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-22T08:52:39.295 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-22T08:52:40.095 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-22T08:52:40.556 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-22T08:52:41.009 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-22T08:52:41.424 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-22T08:52:41.855 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-22T08:52:42.297 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-22T08:52:42.720 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-22T08:52:43.171 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-22T08:52:43.596 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-22T08:52:44.043 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-22T08:52:44.461 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-22T08:52:44.940 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-22T08:52:45.364 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-22T08:52:46.034 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-22T08:52:46.711 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-22T08:52:47.298 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-22T08:52:47.785 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-22T08:52:48.265 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-22T08:52:48.862 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-22T08:52:49.387 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-22T08:52:49.891 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-22T08:52:50.445 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-22T08:52:50.977 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-22T08:52:51.544 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-22T08:52:51.973 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-22T08:52:52.409 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-22T08:52:52.946 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-22T08:52:53.443 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-22T08:52:53.979 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-22T08:52:54.556 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-22T08:52:55.477 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-22T08:52:57.704 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-22T08:52:58.271 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-22T08:52:58.872 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-22T08:52:59.417 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-22T08:53:00.424 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-22T08:53:01.134 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-22T08:53:01.562 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-22T08:53:02.235 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-22T08:53:02.571 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-22T08:53:02.936 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-22T08:53:03.301 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-22T08:53:03.638 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-22T08:53:04.111 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-22T08:53:04.521 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-22T08:53:05.126 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-22T08:53:05.478 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-22T08:53:05.807 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-22T08:53:06.168 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-22T08:53:06.531 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-22T08:53:06.880 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-22T08:53:07.285 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-22T08:53:07.647 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-22T08:53:07.976 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-22T08:53:08.310 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-22T08:53:08.683 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-22T08:53:09.045 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-22T08:53:09.460 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-22T08:53:09.935 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-22T08:53:10.297 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-22T08:53:10.627 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-22T08:53:11.005 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-22T08:53:11.449 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-22T08:53:11.820 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-22T08:53:12.263 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-22T08:53:12.629 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-22T08:53:12.998 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-22T08:53:13.362 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-22T08:53:13.838 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-22T08:53:14.290 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-22T08:53:14.693 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-22T08:53:15.046 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-22T08:53:15.440 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-22T08:53:15.826 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-22T08:53:16.316 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-22T08:53:16.741 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-22T08:53:17.173 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-22T08:53:17.668 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-22T08:53:17.983 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-22T08:53:18.328 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-22T08:53:18.692 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-22T08:53:28.957 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-22T08:53:29.403 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-22T08:53:39.228 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-22T08:53:39.697 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-22T08:53:40.133 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-22T08:53:40.467 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-22T08:53:40.876 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-22T08:53:41.243 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-22T08:53:41.639 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-22T08:53:42.060 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-22T08:53:42.398 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-22T08:53:42.765 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-22T08:53:43.164 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-22T08:53:43.604 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-22T08:53:44.013 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-22T08:53:44.549 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-22T08:53:45.044 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-22T08:53:45.424 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-22T08:53:45.779 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-22T08:53:46.352 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-22T08:53:47.479 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-22T08:53:47.787 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-22T08:53:48.180 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-22T08:53:48.560 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-22T08:53:49.019 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-22T08:53:49.481 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-22T08:53:49.908 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-22T08:53:50.622 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-22T08:53:51.382 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-22T08:53:51.816 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-22T08:53:57.425 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-22T08:54:02.803 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-22T08:54:03.260 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-22T08:54:03.953 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-22T08:54:05.158 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-22T08:54:06.484 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-22T08:54:07.613 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-22T08:54:08.420 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-22T08:54:09.327 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-22T08:54:09.991 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-22T08:54:10.521 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-22T08:54:11.556 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-22T08:54:12.678 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-22T08:54:14.586 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-22T08:54:15.659 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-22T08:54:16.380 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-22T08:54:16.967 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-22T08:54:17.522 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-22T08:54:18.307 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-22T08:54:19.036 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-22T08:54:19.758 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-22T08:54:20.420 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-22T08:54:21.176 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-22T08:54:21.975 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-22T08:54:22.838 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-22T08:54:23.537 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-22T08:54:23.732 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-22T08:54:24.775 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-22T08:54:26.101 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-22T08:54:26.863 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-22T08:54:27.503 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-22T08:54:28.103 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-22T08:54:39.069 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-22T08:54:39.262 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-22T08:54:40.000 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-22T08:54:40.615 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-22T08:54:41.142 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-22T08:54:41.729 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-22T08:54:41.754 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-22T08:54:41.754 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:54:41.754 INFO:teuthology.orchestra.run.smithi038.stdout:=============================== warnings summary =============================== 2024-09-22T08:54:41.754 INFO:teuthology.orchestra.run.smithi038.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-22T08:54:41.754 INFO:teuthology.orchestra.run.smithi038.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-22T08:54:41.754 INFO:teuthology.orchestra.run.smithi038.stdout: import imp 2024-09-22T08:54:41.755 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:54:41.755 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py:120 2024-09-22T08:54:41.755 INFO:teuthology.orchestra.run.smithi038.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-22T08:54:41.755 INFO:teuthology.orchestra.run.smithi038.stdout: if boto_type is 'S3Connection': 2024-09-22T08:54:41.755 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:54:41.755 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py:124 2024-09-22T08:54:41.755 INFO:teuthology.orchestra.run.smithi038.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-22T08:54:41.756 INFO:teuthology.orchestra.run.smithi038.stdout: elif boto_type is 'HTTPRequest': 2024-09-22T08:54:41.756 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:54:41.756 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3.py:359 2024-09-22T08:54:41.756 INFO:teuthology.orchestra.run.smithi038.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence \W 2024-09-22T08:54:41.756 INFO:teuthology.orchestra.run.smithi038.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-22T08:54:41.756 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:54:41.756 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py:176 2024-09-22T08:54:41.757 INFO:teuthology.orchestra.run.smithi038.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-22T08:54:41.757 INFO:teuthology.orchestra.run.smithi038.stdout: if k is 'BucketName': 2024-09-22T08:54:41.757 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:54:41.757 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py:253 2024-09-22T08:54:41.757 INFO:teuthology.orchestra.run.smithi038.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-22T08:54:41.757 INFO:teuthology.orchestra.run.smithi038.stdout: @pytest.mark.timeout(10) 2024-09-22T08:54:41.757 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:54:41.758 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-22T08:54:41.758 INFO:teuthology.orchestra.run.smithi038.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-22T08:54:41.758 INFO:teuthology.orchestra.run.smithi038.stdout: @pytest.mark.s3website_routing_rules 2024-09-22T08:54:41.758 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:54:41.758 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-22T08:54:41.758 INFO:teuthology.orchestra.run.smithi038.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence \$ 2024-09-22T08:54:41.758 INFO:teuthology.orchestra.run.smithi038.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-22T08:54:41.758 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:54:41.759 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-22T08:54:41.759 INFO:teuthology.orchestra.run.smithi038.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence \$ 2024-09-22T08:54:41.759 INFO:teuthology.orchestra.run.smithi038.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-22T08:54:41.759 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:54:41.759 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-22T08:54:41.759 INFO:teuthology.orchestra.run.smithi038.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence \$ 2024-09-22T08:54:41.759 INFO:teuthology.orchestra.run.smithi038.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-22T08:54:41.759 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:54:41.760 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-22T08:54:41.760 INFO:teuthology.orchestra.run.smithi038.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence \$ 2024-09-22T08:54:41.760 INFO:teuthology.orchestra.run.smithi038.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-22T08:54:41.760 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:54:41.760 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-22T08:54:41.760 INFO:teuthology.orchestra.run.smithi038.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence \$ 2024-09-22T08:54:41.760 INFO:teuthology.orchestra.run.smithi038.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-22T08:54:41.760 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:54:41.761 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-22T08:54:41.761 INFO:teuthology.orchestra.run.smithi038.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence \$ 2024-09-22T08:54:41.761 INFO:teuthology.orchestra.run.smithi038.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-22T08:54:41.761 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:54:41.761 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-22T08:54:41.761 INFO:teuthology.orchestra.run.smithi038.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence \$ 2024-09-22T08:54:41.761 INFO:teuthology.orchestra.run.smithi038.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-22T08:54:41.761 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:54:41.762 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-22T08:54:41.762 INFO:teuthology.orchestra.run.smithi038.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence \$ 2024-09-22T08:54:41.762 INFO:teuthology.orchestra.run.smithi038.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-22T08:54:41.762 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:54:41.762 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-22T08:54:41.762 INFO:teuthology.orchestra.run.smithi038.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence \$ 2024-09-22T08:54:41.762 INFO:teuthology.orchestra.run.smithi038.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-22T08:54:41.763 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:54:41.763 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-22T08:54:41.763 INFO:teuthology.orchestra.run.smithi038.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence \$ 2024-09-22T08:54:41.763 INFO:teuthology.orchestra.run.smithi038.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-22T08:54:41.763 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:54:41.763 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-22T08:54:41.763 INFO:teuthology.orchestra.run.smithi038.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence \$ 2024-09-22T08:54:41.763 INFO:teuthology.orchestra.run.smithi038.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-22T08:54:41.764 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:54:41.764 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py: 29 warnings 2024-09-22T08:54:41.764 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py: 82 warnings 2024-09-22T08:54:41.764 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py: 497 warnings 2024-09-22T08:54:41.764 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py: 33 warnings 2024-09-22T08:54:41.764 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_sns.py: 3 warnings 2024-09-22T08:54:41.764 INFO:teuthology.orchestra.run.smithi038.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi038.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:54:41.765 INFO:teuthology.orchestra.run.smithi038.stdout: warnings.warn( 2024-09-22T08:54:41.765 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:54:41.765 INFO:teuthology.orchestra.run.smithi038.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-22T08:54:41.765 INFO:teuthology.orchestra.run.smithi038.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 662 warnings in 631.99s (0:10:31) = 2024-09-22T08:54:41.889 INFO:teuthology.orchestra.run.smithi038.stdout:___________________________________ summary ____________________________________ 2024-09-22T08:54:41.889 INFO:teuthology.orchestra.run.smithi038.stdout: py: commands succeeded 2024-09-22T08:54:41.889 INFO:teuthology.orchestra.run.smithi038.stdout: congratulations :) 2024-09-22T08:54:41.907 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-22T08:54:41.907 DEBUG:teuthology.orchestra.run.smithi038:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-22T08:54:42.013 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:54:42.013 INFO:tasks.s3tests:Cleaning up boto... 2024-09-22T08:54:42.013 DEBUG:teuthology.orchestra.run.smithi038:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-22T08:54:42.044 INFO:tasks.s3tests:Removing s3-tests... 2024-09-22T08:54:42.044 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-22T08:54:42.253 INFO:teuthology.run_tasks:Running task workunit... 2024-09-22T08:54:42.264 INFO:tasks.workunit:Pulling workunits from ref 8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:54:42.264 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-22T08:54:42.264 DEBUG:teuthology.orchestra.run.smithi038:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-22T08:54:42.294 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:54:42.294 INFO:teuthology.orchestra.run.smithi038.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-22T08:54:42.294 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-22T08:54:42.363 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-22T08:54:42.364 DEBUG:teuthology.orchestra.run.smithi038:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-22T08:54:42.434 INFO:tasks.workunit:timeout=3h 2024-09-22T08:54:42.434 INFO:tasks.workunit:cleanup=True 2024-09-22T08:54:42.434 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:54:42.504 INFO:tasks.workunit.client.0.smithi038.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-22T08:55:43.630 INFO:tasks.workunit.client.0.smithi038.stderr:Updating files: 92% (11706/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-22T08:55:44.443 INFO:tasks.workunit.client.0.smithi038.stderr:Note: switching to '8852379c050c686f4605f33f0129009b2029ca9d'. 2024-09-22T08:55:44.443 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:55:44.443 INFO:tasks.workunit.client.0.smithi038.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-22T08:55:44.444 INFO:tasks.workunit.client.0.smithi038.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-22T08:55:44.444 INFO:tasks.workunit.client.0.smithi038.stderr:state without impacting any branches by switching back to a branch. 2024-09-22T08:55:44.444 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:55:44.444 INFO:tasks.workunit.client.0.smithi038.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-22T08:55:44.444 INFO:tasks.workunit.client.0.smithi038.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-22T08:55:44.444 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:55:44.444 INFO:tasks.workunit.client.0.smithi038.stderr: git switch -c 2024-09-22T08:55:44.444 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:55:44.444 INFO:tasks.workunit.client.0.smithi038.stderr:Or undo this operation with: 2024-09-22T08:55:44.444 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:55:44.444 INFO:tasks.workunit.client.0.smithi038.stderr: git switch - 2024-09-22T08:55:44.444 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:55:44.444 INFO:tasks.workunit.client.0.smithi038.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-22T08:55:44.445 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:55:44.445 INFO:tasks.workunit.client.0.smithi038.stderr:HEAD is now at 8852379c050 rgw/cloud-restore: Fixed storage class update while listing objects. 2024-09-22T08:55:44.448 DEBUG:teuthology.orchestra.run.smithi038:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-22T08:55:44.517 INFO:tasks.workunit.client.0.smithi038.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-22T08:55:44.519 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-22T08:55:44.520 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-22T08:55:44.569 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-22T08:55:44.620 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-22T08:55:44.660 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-22T08:55:44.662 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-22T08:55:44.662 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-22T08:55:44.701 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-22T08:55:44.705 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-22T08:55:44.705 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-22T08:55:44.775 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-22T08:55:44.776 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-22T08:55:44.777 DEBUG:teuthology.orchestra.run.smithi038:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-22T08:55:44.850 INFO:tasks.workunit.client.0.smithi038.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-22T08:55:44.850 INFO:tasks.workunit.client.0.smithi038.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-22T08:55:44.850 INFO:tasks.workunit.client.0.smithi038.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-22T08:55:47.213 INFO:tasks.workunit.client.0.smithi038.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-22T08:55:47.213 INFO:tasks.workunit.client.0.smithi038.stderr:++ deactivate nondestructive 2024-09-22T08:55:47.213 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -n '' ']' 2024-09-22T08:55:47.213 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -n '' ']' 2024-09-22T08:55:47.213 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-22T08:55:47.213 INFO:tasks.workunit.client.0.smithi038.stderr:++ hash -r 2024-09-22T08:55:47.213 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -n '' ']' 2024-09-22T08:55:47.214 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset VIRTUAL_ENV 2024-09-22T08:55:47.214 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-22T08:55:47.214 INFO:tasks.workunit.client.0.smithi038.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-22T08:55:47.214 INFO:tasks.workunit.client.0.smithi038.stderr:++ export VIRTUAL_ENV 2024-09-22T08:55:47.214 INFO:tasks.workunit.client.0.smithi038.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-22T08:55:47.214 INFO:tasks.workunit.client.0.smithi038.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-22T08:55:47.214 INFO:tasks.workunit.client.0.smithi038.stderr:++ export PATH 2024-09-22T08:55:47.214 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -n '' ']' 2024-09-22T08:55:47.214 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-09-22T08:55:47.214 INFO:tasks.workunit.client.0.smithi038.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-22T08:55:47.214 INFO:tasks.workunit.client.0.smithi038.stderr:++ PS1='(rgw) ' 2024-09-22T08:55:47.214 INFO:tasks.workunit.client.0.smithi038.stderr:++ export PS1 2024-09-22T08:55:47.215 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-22T08:55:47.215 INFO:tasks.workunit.client.0.smithi038.stderr:++ hash -r 2024-09-22T08:55:47.215 INFO:tasks.workunit.client.0.smithi038.stderr:+ pip install pip --upgrade 2024-09-22T08:55:47.450 INFO:tasks.workunit.client.0.smithi038.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-22T08:55:47.634 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting pip 2024-09-22T08:55:47.640 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-22T08:55:47.687 INFO:tasks.workunit.client.0.smithi038.stdout:Installing collected packages: pip 2024-09-22T08:55:47.687 INFO:tasks.workunit.client.0.smithi038.stdout: Attempting uninstall: pip 2024-09-22T08:55:47.688 INFO:tasks.workunit.client.0.smithi038.stdout: Found existing installation: pip 21.3.1 2024-09-22T08:55:47.851 INFO:tasks.workunit.client.0.smithi038.stdout: Uninstalling pip-21.3.1: 2024-09-22T08:55:47.857 INFO:tasks.workunit.client.0.smithi038.stdout: Successfully uninstalled pip-21.3.1 2024-09-22T08:55:48.632 INFO:tasks.workunit.client.0.smithi038.stdout:Successfully installed pip-24.2 2024-09-22T08:55:48.681 INFO:tasks.workunit.client.0.smithi038.stderr:+ pip install boto3 2024-09-22T08:55:49.489 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting boto3 2024-09-22T08:55:49.490 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached boto3-1.35.24-py3-none-any.whl.metadata (6.6 kB) 2024-09-22T08:55:50.048 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting botocore<1.36.0,>=1.35.24 (from boto3) 2024-09-22T08:55:50.050 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached botocore-1.35.24-py3-none-any.whl.metadata (5.7 kB) 2024-09-22T08:55:50.108 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-22T08:55:50.109 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-22T08:55:50.163 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-22T08:55:50.165 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-22T08:55:50.214 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.24->boto3) 2024-09-22T08:55:50.215 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-22T08:55:50.292 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.24->boto3) 2024-09-22T08:55:50.294 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-22T08:55:50.520 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.24->boto3) 2024-09-22T08:55:50.521 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-22T08:55:50.525 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached boto3-1.35.24-py3-none-any.whl (139 kB) 2024-09-22T08:55:50.527 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached botocore-1.35.24-py3-none-any.whl (12.6 MB) 2024-09-22T08:55:50.536 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-22T08:55:50.537 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-22T08:55:50.539 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-22T08:55:50.540 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-22T08:55:50.542 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-22T08:55:50.618 INFO:tasks.workunit.client.0.smithi038.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-22T08:55:51.811 INFO:tasks.workunit.client.0.smithi038.stdout:Successfully installed boto3-1.35.24 botocore-1.35.24 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-22T08:55:51.929 INFO:tasks.workunit.client.0.smithi038.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-22T08:55:52.056 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-22T08:55:52.091 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:55:52.091 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:55:52.132 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.131+0000 7fb72392f800 20 rados->read ofs=0 len=0 2024-09-22T08:55:52.134 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.133+0000 7fb72392f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:55:52.135 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.133+0000 7fb72392f800 20 realm 2024-09-22T08:55:52.135 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.133+0000 7fb72392f800 20 rados->read ofs=0 len=0 2024-09-22T08:55:52.135 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.133+0000 7fb72392f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:55:52.135 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.133+0000 7fb72392f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:55:52.135 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.133+0000 7fb72392f800 20 rados->read ofs=0 len=0 2024-09-22T08:55:52.135 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.133+0000 7fb72392f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:55:52.135 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.133+0000 7fb72392f800 20 rados->read ofs=0 len=0 2024-09-22T08:55:52.135 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.134+0000 7fb72392f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:55:52.135 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.134+0000 7fb72392f800 20 rados->read ofs=0 len=0 2024-09-22T08:55:52.136 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.135+0000 7fb72392f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:55:52.136 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.135+0000 7fb72392f800 20 searching for the correct realm 2024-09-22T08:55:52.138 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.137+0000 7fb71ee75640 0 -- 172.21.15.38:0/376014875 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7fb71401a040 msgr2=0x7fb714068790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:55:52.142 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.141+0000 7fb71ee75640 0 -- 172.21.15.38:0/376014875 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7fb7100466e0 msgr2=0x7fb71006a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:55:52.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.349+0000 7fb72392f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:55:52.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.349+0000 7fb72392f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:55:52.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.349+0000 7fb72392f800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:55:52.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.349+0000 7fb72392f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:55:52.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.349+0000 7fb72392f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:55:52.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.349+0000 7fb72392f800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:55:52.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.349+0000 7fb72392f800 20 rados->read ofs=0 len=0 2024-09-22T08:55:52.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.349+0000 7fb72392f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:55:52.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.349+0000 7fb72392f800 20 rados->read ofs=0 len=0 2024-09-22T08:55:52.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.349+0000 7fb72392f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:55:52.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.349+0000 7fb72392f800 20 rados->read ofs=0 len=0 2024-09-22T08:55:52.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.350+0000 7fb72392f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:55:52.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.350+0000 7fb72392f800 20 zone default found 2024-09-22T08:55:52.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.350+0000 7fb72392f800 4 Realm: () 2024-09-22T08:55:52.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.350+0000 7fb72392f800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:55:52.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.350+0000 7fb72392f800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:55:52.353 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.350+0000 7fb72392f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:55:52.353 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.350+0000 7fb72392f800 20 zonegroup default 2024-09-22T08:55:52.353 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.350+0000 7fb72392f800 20 rados->read ofs=0 len=0 2024-09-22T08:55:52.353 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.350+0000 7fb72392f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:55:52.353 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.350+0000 7fb72392f800 20 rados->read ofs=0 len=0 2024-09-22T08:55:52.353 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.350+0000 7fb72392f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:55:52.353 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.350+0000 7fb72392f800 20 rados->read ofs=0 len=0 2024-09-22T08:55:52.353 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.351+0000 7fb72392f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:55:52.353 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.351+0000 7fb72392f800 20 started sync module instance, tier type = 2024-09-22T08:55:52.353 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.351+0000 7fb72392f800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:55:52.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.361+0000 7fb72392f800 20 add_watcher() i=0 2024-09-22T08:55:52.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.361+0000 7fb72392f800 20 add_watcher() i=1 2024-09-22T08:55:52.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.361+0000 7fb72392f800 20 add_watcher() i=2 2024-09-22T08:55:52.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.361+0000 7fb72392f800 20 add_watcher() i=3 2024-09-22T08:55:52.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.361+0000 7fb72392f800 20 add_watcher() i=4 2024-09-22T08:55:52.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.361+0000 7fb72392f800 20 add_watcher() i=5 2024-09-22T08:55:52.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.361+0000 7fb72392f800 20 add_watcher() i=6 2024-09-22T08:55:52.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.362+0000 7fb72392f800 20 add_watcher() i=7 2024-09-22T08:55:52.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.362+0000 7fb72392f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:55:52.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.364+0000 7fb5d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:55:52.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.365+0000 7fb72392f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:55:52.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.365+0000 7fb72392f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:55:52.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.365+0000 7fb72392f800 5 note: GC not initialized 2024-09-22T08:55:52.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.365+0000 7fb5d4fe1640 20 reqs_thread_entry: start 2024-09-22T08:55:52.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.365+0000 7fb72392f800 20 init_complete bucket index max shards: 11 2024-09-22T08:55:52.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.365+0000 7fb72392f800 20 Filter name: none 2024-09-22T08:55:52.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.365+0000 7fb54e7fc640 20 reqs_thread_entry: start 2024-09-22T08:55:52.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.365+0000 7fb72392f800 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-22T08:55:52.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.365+0000 7fb72392f800 20 rados->read ofs=0 len=0 2024-09-22T08:55:52.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.366+0000 7fb72392f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:55:52.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.366+0000 7fb72392f800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-22T08:55:52.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.366+0000 7fb72392f800 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-22T08:55:52.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.366+0000 7fb72392f800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-22T08:55:52.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.366+0000 7fb72392f800 20 rados->read ofs=0 len=0 2024-09-22T08:55:52.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.366+0000 7fb72392f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:55:52.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.366+0000 7fb72392f800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-22T08:55:52.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.366+0000 7fb72392f800 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-22T08:55:52.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.366+0000 7fb72392f800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-22T08:55:52.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.366+0000 7fb72392f800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-22T08:55:52.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.367+0000 7fb72392f800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-22T08:55:52.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.367+0000 7fb72392f800 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-22T08:55:52.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.367+0000 7fb72392f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-22T08:55:52.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.368+0000 7fb602ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399529 cookie 94783860269504 notifier 8624 bl.length()=613 2024-09-22T08:55:52.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.368+0000 7fb602ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-22T08:55:52.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.368+0000 7fb602ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-22T08:55:52.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.370+0000 7fb72392f800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-22T08:55:52.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.370+0000 7fb72392f800 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-22T08:55:52.372 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.370+0000 7fb72392f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-22T08:55:52.372 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.371+0000 7fb6027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399530 cookie 94783860267936 notifier 8624 bl.length()=191 2024-09-22T08:55:52.372 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.371+0000 7fb6027fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-22T08:55:52.372 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.371+0000 7fb6027fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-22T08:55:52.373 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.372+0000 7fb5d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:55:52.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.374+0000 7fb72392f800 20 remove_watcher() i=0 2024-09-22T08:55:52.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.374+0000 7fb72392f800 2 removed watcher, disabling cache 2024-09-22T08:55:52.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.375+0000 7fb72392f800 20 remove_watcher() i=1 2024-09-22T08:55:52.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.376+0000 7fb72392f800 20 remove_watcher() i=2 2024-09-22T08:55:52.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.378+0000 7fb72392f800 20 remove_watcher() i=3 2024-09-22T08:55:52.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.379+0000 7fb72392f800 20 remove_watcher() i=4 2024-09-22T08:55:52.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.380+0000 7fb72392f800 20 remove_watcher() i=5 2024-09-22T08:55:52.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.381+0000 7fb72392f800 20 remove_watcher() i=6 2024-09-22T08:55:52.384 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.383+0000 7fb72392f800 20 remove_watcher() i=7 2024-09-22T08:55:52.534 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:55:52.534 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:55:52.580 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:55:52.580 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:55:52.626 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:55:52.626 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:55:52.639 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:55:52.639 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:55:52.642 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-22T08:55:52.642 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:55:52.645 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:55:52.645 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:55:52.655 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:55:52.655 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:55:52.662 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:55:52.662 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:55:52.673 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-22T08:55:52.702 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:55:52.703 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:55:52.741 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.740+0000 7f5c5e525800 20 rados->read ofs=0 len=0 2024-09-22T08:55:52.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.742+0000 7f5c5e525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:55:52.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.742+0000 7f5c5e525800 20 realm 2024-09-22T08:55:52.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.742+0000 7f5c5e525800 20 rados->read ofs=0 len=0 2024-09-22T08:55:52.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.743+0000 7f5c5e525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:55:52.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.743+0000 7f5c5e525800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:55:52.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.743+0000 7f5c5e525800 20 rados->read ofs=0 len=0 2024-09-22T08:55:52.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.743+0000 7f5c5e525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:55:52.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.743+0000 7f5c5e525800 20 rados->read ofs=0 len=0 2024-09-22T08:55:52.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.743+0000 7f5c5e525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:55:52.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.743+0000 7f5c5e525800 20 rados->read ofs=0 len=0 2024-09-22T08:55:52.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.744+0000 7f5c5e525800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:55:52.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.744+0000 7f5c5e525800 20 searching for the correct realm 2024-09-22T08:55:52.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.746+0000 7f5c53fff640 0 -- 172.21.15.38:0/3070986365 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f5c440ba030 msgr2=0x7f5c440d24a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:55:52.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:52.953+0000 7f5c53fff640 0 -- 172.21.15.38:0/3070986365 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f5c4c03d920 msgr2=0x7f5c4c03c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:55:53.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.161+0000 7f5c5e525800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:55:53.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.161+0000 7f5c5e525800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:55:53.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.161+0000 7f5c5e525800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:55:53.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.161+0000 7f5c5e525800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:55:53.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.161+0000 7f5c5e525800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:55:53.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.161+0000 7f5c5e525800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:55:53.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.161+0000 7f5c5e525800 20 rados->read ofs=0 len=0 2024-09-22T08:55:53.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.161+0000 7f5c5e525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:55:53.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.161+0000 7f5c5e525800 20 rados->read ofs=0 len=0 2024-09-22T08:55:53.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.162+0000 7f5c5e525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:55:53.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.162+0000 7f5c5e525800 20 rados->read ofs=0 len=0 2024-09-22T08:55:53.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.162+0000 7f5c5e525800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:55:53.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.162+0000 7f5c5e525800 20 zone default found 2024-09-22T08:55:53.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.162+0000 7f5c5e525800 4 Realm: () 2024-09-22T08:55:53.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.162+0000 7f5c5e525800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:55:53.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.162+0000 7f5c5e525800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:55:53.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.162+0000 7f5c5e525800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:55:53.165 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.162+0000 7f5c5e525800 20 zonegroup default 2024-09-22T08:55:53.165 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.162+0000 7f5c5e525800 20 rados->read ofs=0 len=0 2024-09-22T08:55:53.165 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.163+0000 7f5c5e525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:55:53.165 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.163+0000 7f5c5e525800 20 rados->read ofs=0 len=0 2024-09-22T08:55:53.165 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.163+0000 7f5c5e525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:55:53.165 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.163+0000 7f5c5e525800 20 rados->read ofs=0 len=0 2024-09-22T08:55:53.165 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.163+0000 7f5c5e525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:55:53.165 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.163+0000 7f5c5e525800 20 started sync module instance, tier type = 2024-09-22T08:55:53.165 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.163+0000 7f5c5e525800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:55:53.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.174+0000 7f5c5e525800 20 add_watcher() i=0 2024-09-22T08:55:53.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.174+0000 7f5c5e525800 20 add_watcher() i=1 2024-09-22T08:55:53.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.174+0000 7f5c5e525800 20 add_watcher() i=2 2024-09-22T08:55:53.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.174+0000 7f5c5e525800 20 add_watcher() i=3 2024-09-22T08:55:53.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.174+0000 7f5c5e525800 20 add_watcher() i=4 2024-09-22T08:55:53.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.174+0000 7f5c5e525800 20 add_watcher() i=5 2024-09-22T08:55:53.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.174+0000 7f5c5e525800 20 add_watcher() i=6 2024-09-22T08:55:53.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.175+0000 7f5c5e525800 20 add_watcher() i=7 2024-09-22T08:55:53.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.175+0000 7f5c5e525800 2 all 8 watchers are set, enabling cache 2024-09-22T08:55:53.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.177+0000 7f5b10fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:55:53.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.177+0000 7f5c5e525800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:55:53.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.177+0000 7f5c5e525800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:55:53.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.177+0000 7f5c5e525800 5 note: GC not initialized 2024-09-22T08:55:53.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.178+0000 7f5a8b7fe640 20 reqs_thread_entry: start 2024-09-22T08:55:53.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.178+0000 7f5c5e525800 20 init_complete bucket index max shards: 11 2024-09-22T08:55:53.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.178+0000 7f5c5e525800 20 Filter name: none 2024-09-22T08:55:53.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.178+0000 7f5a897fa640 20 reqs_thread_entry: start 2024-09-22T08:55:53.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.178+0000 7f5c5e525800 20 rados->read ofs=0 len=0 2024-09-22T08:55:53.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.179+0000 7f5c5e525800 20 rados_obj.operate() r=0 bl.length=209 2024-09-22T08:55:53.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.179+0000 7f5c5e525800 20 rados->read ofs=0 len=0 2024-09-22T08:55:53.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.180+0000 7f5c5e525800 20 rados_obj.operate() r=0 bl.length=431 2024-09-22T08:55:53.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.180+0000 7f5c5e525800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:55:53.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.180+0000 7f5c5e525800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-22T08:55:53.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.180+0000 7f5c5e525800 20 INFO: main: starting shard=0 2024-09-22T08:55:53.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.180+0000 7f5c5e525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.782.0 2024-09-22T08:55:53.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.181+0000 7f5c5e525800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:55:53.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.181+0000 7f5c5e525800 20 INFO: main: starting shard=1 2024-09-22T08:55:53.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.181+0000 7f5c5e525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.782.1 2024-09-22T08:55:53.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.181+0000 7f5c5e525800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:55:53.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.181+0000 7f5c5e525800 20 INFO: main: starting shard=2 2024-09-22T08:55:53.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.181+0000 7f5c5e525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.782.2 2024-09-22T08:55:53.183 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.182+0000 7f5c5e525800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:55:53.183 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.182+0000 7f5c5e525800 20 INFO: main: starting shard=3 2024-09-22T08:55:53.183 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.182+0000 7f5c5e525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.782.3 2024-09-22T08:55:53.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.182+0000 7f5c5e525800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:55:53.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.183+0000 7f5c5e525800 20 INFO: main: starting shard=4 2024-09-22T08:55:53.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.183+0000 7f5c5e525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.782.4 2024-09-22T08:55:53.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.183+0000 7f5c5e525800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:55:53.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.183+0000 7f5c5e525800 20 INFO: main: starting shard=5 2024-09-22T08:55:53.185 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.183+0000 7f5c5e525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.782.5 2024-09-22T08:55:53.185 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.184+0000 7f5c5e525800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:55:53.185 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.184+0000 7f5c5e525800 20 INFO: main: starting shard=6 2024-09-22T08:55:53.185 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.184+0000 7f5c5e525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.782.6 2024-09-22T08:55:53.185 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.184+0000 7f5c5e525800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:55:53.186 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.184+0000 7f5c5e525800 20 INFO: main: starting shard=7 2024-09-22T08:55:53.186 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.184+0000 7f5c5e525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.782.7 2024-09-22T08:55:53.186 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.185+0000 7f5c5e525800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:55:53.186 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.185+0000 7f5c5e525800 20 INFO: main: starting shard=8 2024-09-22T08:55:53.186 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.185+0000 7f5c5e525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.782.8 2024-09-22T08:55:53.187 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.186+0000 7f5c5e525800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:55:53.187 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.186+0000 7f5c5e525800 20 INFO: main: starting shard=9 2024-09-22T08:55:53.187 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.186+0000 7f5c5e525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.782.9 2024-09-22T08:55:53.187 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.186+0000 7f5c5e525800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:55:53.187 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.186+0000 7f5c5e525800 20 INFO: main: starting shard=10 2024-09-22T08:55:53.187 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.186+0000 7f5c5e525800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.782.10 2024-09-22T08:55:53.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.187+0000 7f5c5e525800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:55:53.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.187+0000 7f5c5e525800 20 INFO: main: done 2024-09-22T08:55:53.189 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.188+0000 7f5b10fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:55:53.191 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.190+0000 7f5c5e525800 20 remove_watcher() i=0 2024-09-22T08:55:53.191 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.190+0000 7f5c5e525800 2 removed watcher, disabling cache 2024-09-22T08:55:53.192 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.191+0000 7f5c5e525800 20 remove_watcher() i=1 2024-09-22T08:55:53.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.192+0000 7f5c5e525800 20 remove_watcher() i=2 2024-09-22T08:55:53.195 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.194+0000 7f5c5e525800 20 remove_watcher() i=3 2024-09-22T08:55:53.196 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.195+0000 7f5c5e525800 20 remove_watcher() i=4 2024-09-22T08:55:53.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.196+0000 7f5c5e525800 20 remove_watcher() i=5 2024-09-22T08:55:53.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.197+0000 7f5c5e525800 20 remove_watcher() i=6 2024-09-22T08:55:53.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.199+0000 7f5c5e525800 20 remove_watcher() i=7 2024-09-22T08:55:53.213 INFO:tasks.workunit.client.0.smithi038.stderr:rados -p default.rgw.buckets.data ls | grep a11a935c-be55-4f7e-8000-992fd2893636 2024-09-22T08:55:53.237 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:55:53.237 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:55:53.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.446+0000 7fadd376d640 0 --2- 172.21.15.38:0/3974497837 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561876801420 0x56187689f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-22T08:55:53.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.474+0000 7fadd376d640 0 -- 172.21.15.38:0/3974497837 >> [v2:172.21.15.38:6800/703968303,v1:172.21.15.38:6801/703968303] conn(0x561876736e00 msgr2=0x7fadcc00b3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:55:53.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:53.483+0000 7fadd3f6e640 0 -- 172.21.15.38:0/3974497837 >> [v2:172.21.15.42:6810/1033356835,v1:172.21.15.42:6811/1033356835] conn(0x5618767fede0 msgr2=0x561876805c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:55:53.492 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-22T08:55:53.492 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:55:53.493 INFO:tasks.workunit.client.0.smithi038.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-22T08:55:54.922 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:55:54.922 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:55:54.932 INFO:tasks.workunit.client.0.smithi038.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-22T08:55:55.357 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-22T08:55:55.386 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:55:55.386 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:55:55.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.424+0000 7ff64652e800 20 rados->read ofs=0 len=0 2024-09-22T08:55:55.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.426+0000 7ff64652e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:55:55.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.426+0000 7ff64652e800 20 realm 2024-09-22T08:55:55.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.426+0000 7ff64652e800 20 rados->read ofs=0 len=0 2024-09-22T08:55:55.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.427+0000 7ff64652e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:55:55.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.427+0000 7ff64652e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:55:55.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.427+0000 7ff64652e800 20 rados->read ofs=0 len=0 2024-09-22T08:55:55.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.427+0000 7ff64652e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:55:55.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.427+0000 7ff64652e800 20 rados->read ofs=0 len=0 2024-09-22T08:55:55.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.428+0000 7ff64652e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:55:55.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.428+0000 7ff64652e800 20 rados->read ofs=0 len=0 2024-09-22T08:55:55.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.428+0000 7ff64652e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:55:55.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.428+0000 7ff64652e800 20 searching for the correct realm 2024-09-22T08:55:55.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.431+0000 7ff641adc640 0 -- 172.21.15.38:0/1981557625 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7ff638025040 msgr2=0x7ff63804f430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:55:55.435 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.434+0000 7ff641adc640 0 -- 172.21.15.38:0/1981557625 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7ff634095550 msgr2=0x7ff63405b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:55:55.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.641+0000 7ff64652e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:55:55.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.641+0000 7ff64652e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:55:55.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.641+0000 7ff64652e800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:55:55.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.641+0000 7ff64652e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:55:55.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.641+0000 7ff64652e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:55:55.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.641+0000 7ff64652e800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:55:55.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.641+0000 7ff64652e800 20 rados->read ofs=0 len=0 2024-09-22T08:55:55.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.642+0000 7ff64652e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:55:55.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.642+0000 7ff64652e800 20 rados->read ofs=0 len=0 2024-09-22T08:55:55.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.642+0000 7ff64652e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:55:55.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.642+0000 7ff64652e800 20 rados->read ofs=0 len=0 2024-09-22T08:55:55.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.642+0000 7ff64652e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:55:55.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.642+0000 7ff64652e800 20 zone default found 2024-09-22T08:55:55.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.642+0000 7ff64652e800 4 Realm: () 2024-09-22T08:55:55.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.642+0000 7ff64652e800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:55:55.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.642+0000 7ff64652e800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:55:55.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.642+0000 7ff64652e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:55:55.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.642+0000 7ff64652e800 20 zonegroup default 2024-09-22T08:55:55.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.642+0000 7ff64652e800 20 rados->read ofs=0 len=0 2024-09-22T08:55:55.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.643+0000 7ff64652e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:55:55.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.643+0000 7ff64652e800 20 rados->read ofs=0 len=0 2024-09-22T08:55:55.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.643+0000 7ff64652e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:55:55.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.643+0000 7ff64652e800 20 rados->read ofs=0 len=0 2024-09-22T08:55:55.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.643+0000 7ff64652e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:55:55.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.643+0000 7ff64652e800 20 started sync module instance, tier type = 2024-09-22T08:55:55.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.643+0000 7ff64652e800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:55:55.655 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.654+0000 7ff64652e800 20 add_watcher() i=0 2024-09-22T08:55:55.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.654+0000 7ff64652e800 20 add_watcher() i=1 2024-09-22T08:55:55.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.654+0000 7ff64652e800 20 add_watcher() i=2 2024-09-22T08:55:55.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.654+0000 7ff64652e800 20 add_watcher() i=3 2024-09-22T08:55:55.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.654+0000 7ff64652e800 20 add_watcher() i=4 2024-09-22T08:55:55.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.654+0000 7ff64652e800 20 add_watcher() i=5 2024-09-22T08:55:55.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.654+0000 7ff64652e800 20 add_watcher() i=6 2024-09-22T08:55:55.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.656+0000 7ff64652e800 20 add_watcher() i=7 2024-09-22T08:55:55.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.656+0000 7ff64652e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:55:55.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.657+0000 7ff4f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:55:55.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.658+0000 7ff64652e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:55:55.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.658+0000 7ff64652e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:55:55.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.658+0000 7ff64652e800 5 note: GC not initialized 2024-09-22T08:55:55.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.658+0000 7ff4737fe640 20 reqs_thread_entry: start 2024-09-22T08:55:55.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.658+0000 7ff64652e800 20 init_complete bucket index max shards: 11 2024-09-22T08:55:55.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.658+0000 7ff64652e800 20 Filter name: none 2024-09-22T08:55:55.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.658+0000 7ff4717fa640 20 reqs_thread_entry: start 2024-09-22T08:55:55.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.658+0000 7ff64652e800 20 rados->read ofs=0 len=0 2024-09-22T08:55:55.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.659+0000 7ff64652e800 20 rados_obj.operate() r=0 bl.length=209 2024-09-22T08:55:55.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.659+0000 7ff64652e800 20 rados->read ofs=0 len=0 2024-09-22T08:55:55.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.659+0000 7ff64652e800 20 rados_obj.operate() r=0 bl.length=431 2024-09-22T08:55:55.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.659+0000 7ff64652e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:55:55.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.659+0000 7ff64652e800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-22T08:55:55.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.659+0000 7ff64652e800 20 INFO: main: starting shard=0 2024-09-22T08:55:55.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.659+0000 7ff64652e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.782.0 2024-09-22T08:55:55.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.660+0000 7ff64652e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:55:55.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.660+0000 7ff64652e800 20 INFO: main: starting shard=1 2024-09-22T08:55:55.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.660+0000 7ff64652e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.782.1 2024-09-22T08:55:55.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.660+0000 7ff64652e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:55:55.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.660+0000 7ff64652e800 20 INFO: main: starting shard=2 2024-09-22T08:55:55.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.660+0000 7ff64652e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.782.2 2024-09-22T08:55:55.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.661+0000 7ff64652e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:55:55.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.661+0000 7ff64652e800 20 INFO: main: starting shard=3 2024-09-22T08:55:55.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.661+0000 7ff64652e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.782.3 2024-09-22T08:55:55.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.662+0000 7ff64652e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:55:55.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.662+0000 7ff64652e800 20 INFO: main: starting shard=4 2024-09-22T08:55:55.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.662+0000 7ff64652e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.782.4 2024-09-22T08:55:55.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.662+0000 7ff64652e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:55:55.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.662+0000 7ff64652e800 20 INFO: main: starting shard=5 2024-09-22T08:55:55.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.662+0000 7ff64652e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.782.5 2024-09-22T08:55:55.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.663+0000 7ff64652e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:55:55.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.663+0000 7ff64652e800 20 INFO: main: starting shard=6 2024-09-22T08:55:55.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.663+0000 7ff64652e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.782.6 2024-09-22T08:55:55.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.664+0000 7ff64652e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:55:55.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.664+0000 7ff64652e800 20 INFO: main: starting shard=7 2024-09-22T08:55:55.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.664+0000 7ff64652e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.782.7 2024-09-22T08:55:55.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.664+0000 7ff64652e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:55:55.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.664+0000 7ff64652e800 20 INFO: main: starting shard=8 2024-09-22T08:55:55.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.664+0000 7ff64652e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.782.8 2024-09-22T08:55:55.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.665+0000 7ff64652e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:55:55.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.665+0000 7ff64652e800 20 INFO: main: starting shard=9 2024-09-22T08:55:55.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.665+0000 7ff64652e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.782.9 2024-09-22T08:55:55.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.666+0000 7ff64652e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:55:55.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.666+0000 7ff64652e800 20 INFO: main: starting shard=10 2024-09-22T08:55:55.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.666+0000 7ff64652e800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.782.10 2024-09-22T08:55:55.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.666+0000 7ff64652e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:55:55.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.666+0000 7ff64652e800 20 INFO: main: done 2024-09-22T08:55:55.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.667+0000 7ff4f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:55:55.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.669+0000 7ff64652e800 20 remove_watcher() i=0 2024-09-22T08:55:55.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.669+0000 7ff64652e800 2 removed watcher, disabling cache 2024-09-22T08:55:55.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.671+0000 7ff64652e800 20 remove_watcher() i=1 2024-09-22T08:55:55.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.672+0000 7ff64652e800 20 remove_watcher() i=2 2024-09-22T08:55:55.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.673+0000 7ff64652e800 20 remove_watcher() i=3 2024-09-22T08:55:55.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.674+0000 7ff64652e800 20 remove_watcher() i=4 2024-09-22T08:55:55.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.675+0000 7ff64652e800 20 remove_watcher() i=5 2024-09-22T08:55:55.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.677+0000 7ff64652e800 20 remove_watcher() i=6 2024-09-22T08:55:55.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.678+0000 7ff64652e800 20 remove_watcher() i=7 2024-09-22T08:55:55.692 INFO:tasks.workunit.client.0.smithi038.stderr:rados -p default.rgw.buckets.data ls | grep 92f84a68-9f51-48b8-86c5-0b4c68aa7919 2024-09-22T08:55:55.716 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:55:55.716 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:55:55.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:55:55.755+0000 7f9c23454640 0 -- 172.21.15.38:0/2917335962 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f9c1c0628e0 msgr2=0x7f9c1c087380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:55:55.763 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-22T08:55:55.763 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:55:55.765 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:55:55.766 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:55:55.771 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:55:55.771 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:55:55.780 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:55:55.781 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:55:55.785 INFO:tasks.workunit.client.0.smithi038.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-22T08:55:57.202 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:55:57.203 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:55:57.254 INFO:tasks.workunit.client.0.smithi038.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-22T08:55:57.256 INFO:tasks.workunit.client.0.smithi038.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-22T08:55:57.684 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:55:57.685 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:55:57.692 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:55:57.692 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:55:57.694 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-22T08:55:57.694 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-22T08:55:57.696 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:55:57.696 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:55:57.741 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:55:57.741 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:55:57.786 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:55:57.786 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:55:57.795 INFO:tasks.workunit.client.0.smithi038.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-22T08:55:59.226 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:55:59.226 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:55:59.230 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:55:59.230 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:56:01.244 INFO:tasks.workunit.client.0.smithi038.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-22T08:56:01.672 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-22T08:56:01.702 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:56:01.703 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:56:01.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.743+0000 7f6237b35800 20 rados->read ofs=0 len=0 2024-09-22T08:56:01.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.744+0000 7f6237b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:56:01.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.744+0000 7f6237b35800 20 realm 2024-09-22T08:56:01.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.744+0000 7f6237b35800 20 rados->read ofs=0 len=0 2024-09-22T08:56:01.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.744+0000 7f6237b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:56:01.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.744+0000 7f6237b35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:56:01.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.744+0000 7f6237b35800 20 rados->read ofs=0 len=0 2024-09-22T08:56:01.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.745+0000 7f6237b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:56:01.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.745+0000 7f6237b35800 20 rados->read ofs=0 len=0 2024-09-22T08:56:01.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.746+0000 7f6237b35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:56:01.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.746+0000 7f6237b35800 20 rados->read ofs=0 len=0 2024-09-22T08:56:01.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.746+0000 7f6237b35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:56:01.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.746+0000 7f6237b35800 20 searching for the correct realm 2024-09-22T08:56:01.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.747+0000 7f62338e4640 0 -- 172.21.15.38:0/1722254055 >> [v2:172.21.15.42:6818/951985313,v1:172.21.15.42:6819/951985313] conn(0x55ad6779ffa0 msgr2=0x55ad677a2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:56:01.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.953+0000 7f62340e5640 0 -- 172.21.15.38:0/1722254055 >> [v2:172.21.15.42:6802/2532764980,v1:172.21.15.42:6803/2532764980] conn(0x55ad67793810 msgr2=0x55ad67795c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:56:01.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.961+0000 7f6237b35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:56:01.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.961+0000 7f6237b35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:56:01.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.961+0000 7f6237b35800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:56:01.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.961+0000 7f6237b35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:56:01.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.961+0000 7f6237b35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:56:01.963 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.961+0000 7f6237b35800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:56:01.963 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.961+0000 7f6237b35800 20 rados->read ofs=0 len=0 2024-09-22T08:56:01.963 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.961+0000 7f6237b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:56:01.963 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.961+0000 7f6237b35800 20 rados->read ofs=0 len=0 2024-09-22T08:56:01.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.961+0000 7f6237b35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:56:01.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.961+0000 7f6237b35800 20 rados->read ofs=0 len=0 2024-09-22T08:56:01.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.962+0000 7f6237b35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:56:01.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.962+0000 7f6237b35800 20 zone default found 2024-09-22T08:56:01.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.962+0000 7f6237b35800 4 Realm: () 2024-09-22T08:56:01.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.962+0000 7f6237b35800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:56:01.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.962+0000 7f6237b35800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:56:01.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.962+0000 7f6237b35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:56:01.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.962+0000 7f6237b35800 20 zonegroup default 2024-09-22T08:56:01.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.962+0000 7f6237b35800 20 rados->read ofs=0 len=0 2024-09-22T08:56:01.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.962+0000 7f6237b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:56:01.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.962+0000 7f6237b35800 20 rados->read ofs=0 len=0 2024-09-22T08:56:01.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.962+0000 7f6237b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:56:01.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.962+0000 7f6237b35800 20 rados->read ofs=0 len=0 2024-09-22T08:56:01.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.963+0000 7f6237b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:56:01.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.963+0000 7f6237b35800 20 started sync module instance, tier type = 2024-09-22T08:56:01.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.963+0000 7f6237b35800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:56:01.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.973+0000 7f6237b35800 20 add_watcher() i=0 2024-09-22T08:56:01.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.973+0000 7f6237b35800 20 add_watcher() i=1 2024-09-22T08:56:01.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.973+0000 7f6237b35800 20 add_watcher() i=2 2024-09-22T08:56:01.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.973+0000 7f6237b35800 20 add_watcher() i=3 2024-09-22T08:56:01.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.973+0000 7f6237b35800 20 add_watcher() i=4 2024-09-22T08:56:01.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.973+0000 7f6237b35800 20 add_watcher() i=5 2024-09-22T08:56:01.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.973+0000 7f6237b35800 20 add_watcher() i=6 2024-09-22T08:56:01.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.974+0000 7f6237b35800 20 add_watcher() i=7 2024-09-22T08:56:01.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.974+0000 7f6237b35800 2 all 8 watchers are set, enabling cache 2024-09-22T08:56:01.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.975+0000 7f60ea7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:56:01.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.976+0000 7f6237b35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:56:01.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.976+0000 7f6237b35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:56:01.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.976+0000 7f6237b35800 5 note: GC not initialized 2024-09-22T08:56:01.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.976+0000 7f60e97e2640 20 reqs_thread_entry: start 2024-09-22T08:56:01.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.976+0000 7f6237b35800 20 init_complete bucket index max shards: 11 2024-09-22T08:56:01.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.976+0000 7f6237b35800 20 Filter name: none 2024-09-22T08:56:01.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.976+0000 7f60e27fc640 20 reqs_thread_entry: start 2024-09-22T08:56:01.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.976+0000 7f6237b35800 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-22T08:56:01.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.976+0000 7f6237b35800 20 rados->read ofs=0 len=0 2024-09-22T08:56:01.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.977+0000 7f6237b35800 20 rados_obj.operate() r=0 bl.length=209 2024-09-22T08:56:01.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.977+0000 7f6237b35800 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-22T08:56:01.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.977+0000 7f6237b35800 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-22T08:56:01.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.977+0000 7f6237b35800 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.782 : miss 2024-09-22T08:56:01.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.977+0000 7f6237b35800 20 rados->read ofs=0 len=0 2024-09-22T08:56:01.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.978+0000 7f6237b35800 20 rados_obj.operate() r=0 bl.length=431 2024-09-22T08:56:01.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.978+0000 7f6237b35800 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.782 info.flags=0x17 2024-09-22T08:56:01.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.978+0000 7f6237b35800 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.782 to cache LRU end 2024-09-22T08:56:01.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.978+0000 7f6237b35800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:56:01.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.978+0000 7f6237b35800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-22T08:56:01.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.978+0000 7f6237b35800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:c62f9d7b-f6b6-404a-90de-de5607499115.4584.782 2024-09-22T08:56:01.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.978+0000 7f6237b35800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.782.0 2024-09-22T08:56:01.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.978+0000 7f6237b35800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-22T08:56:01.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.978+0000 7f6237b35800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.782.1 2024-09-22T08:56:01.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.979+0000 7f6237b35800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-22T08:56:01.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.979+0000 7f6237b35800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.782.2 2024-09-22T08:56:01.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.979+0000 7f6237b35800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-22T08:56:01.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.979+0000 7f6237b35800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.782.3 2024-09-22T08:56:01.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.980+0000 7f6237b35800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-22T08:56:01.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.980+0000 7f6237b35800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.782.4 2024-09-22T08:56:01.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.980+0000 7f6237b35800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-22T08:56:01.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.980+0000 7f6237b35800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.782.5 2024-09-22T08:56:01.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.981+0000 7f6237b35800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-22T08:56:01.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.981+0000 7f6237b35800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.782.6 2024-09-22T08:56:01.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.981+0000 7f6237b35800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-22T08:56:01.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.981+0000 7f6237b35800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.782.7 2024-09-22T08:56:01.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.982+0000 7f6237b35800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-22T08:56:01.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.982+0000 7f6237b35800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.782.8 2024-09-22T08:56:01.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.982+0000 7f6237b35800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-22T08:56:01.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.982+0000 7f6237b35800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.782.9 2024-09-22T08:56:01.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.983+0000 7f6237b35800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-22T08:56:01.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.983+0000 7f6237b35800 20 bucket index object: :.dir.c62f9d7b-f6b6-404a-90de-de5607499115.4584.782.10 2024-09-22T08:56:01.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.983+0000 7f6237b35800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-22T08:56:01.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.983+0000 7f6237b35800 1 NOTICE: finished all shards (0 entries found) 2024-09-22T08:56:01.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.985+0000 7f60ea7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:56:01.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.987+0000 7f6237b35800 20 remove_watcher() i=0 2024-09-22T08:56:01.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.987+0000 7f6237b35800 2 removed watcher, disabling cache 2024-09-22T08:56:01.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.989+0000 7f6237b35800 20 remove_watcher() i=1 2024-09-22T08:56:01.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.990+0000 7f6237b35800 20 remove_watcher() i=2 2024-09-22T08:56:01.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.991+0000 7f6237b35800 20 remove_watcher() i=3 2024-09-22T08:56:01.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.992+0000 7f6237b35800 20 remove_watcher() i=4 2024-09-22T08:56:01.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.993+0000 7f6237b35800 20 remove_watcher() i=5 2024-09-22T08:56:01.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.995+0000 7f6237b35800 20 remove_watcher() i=6 2024-09-22T08:56:01.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-22T08:56:01.996+0000 7f6237b35800 20 remove_watcher() i=7 2024-09-22T08:56:02.010 INFO:tasks.workunit.client.0.smithi038.stderr:Deleting bucket versioning-bucket 2024-09-22T08:56:02.011 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:56:02.011 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:56:02.016 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:56:02.016 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-22T08:56:02.044 INFO:tasks.workunit.client.0.smithi038.stderr:Completed bucket versioning tests 2024-09-22T08:56:02.044 INFO:tasks.workunit.client.0.smithi038.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-22T08:56:02.044 INFO:tasks.workunit.client.0.smithi038.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-22T08:56:02.045 INFO:tasks.workunit.client.0.smithi038.stdout:connected to https://localhost:443 2024-09-22T08:56:02.107 INFO:tasks.workunit.client.0.smithi038.stderr:+ deactivate 2024-09-22T08:56:02.107 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-22T08:56:02.107 INFO:tasks.workunit.client.0.smithi038.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-22T08:56:02.107 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-09-22T08:56:02.107 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-22T08:56:02.108 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -n '' ']' 2024-09-22T08:56:02.108 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-22T08:56:02.108 INFO:tasks.workunit.client.0.smithi038.stderr:+ hash -r 2024-09-22T08:56:02.108 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -n '' ']' 2024-09-22T08:56:02.108 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset VIRTUAL_ENV 2024-09-22T08:56:02.108 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-22T08:56:02.108 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset -f deactivate 2024-09-22T08:56:02.108 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo OK. 2024-09-22T08:56:02.109 INFO:tasks.workunit.client.0.smithi038.stdout:OK. 2024-09-22T08:56:02.109 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:56:02.109 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:56:02.190 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-22T08:56:02.191 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-22T08:56:02.577 DEBUG:teuthology.parallel:result is None 2024-09-22T08:56:02.578 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T08:56:02.618 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T08:56:02.618 DEBUG:teuthology.orchestra.run.smithi038:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-22T08:56:02.688 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T08:56:02.689 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-22T08:56:02.698 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-22T08:56:02.708 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-22T08:56:02.708 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-22T08:56:02.708 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-22T08:56:02.793 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-22T08:56:02.794 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-22T08:56:02.852 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:56:02.852 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:56:02.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:02.887+0000 7f6dabb3a800 20 rados->read ofs=0 len=0 2024-09-22T08:56:02.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:02.889+0000 7f6dabb3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:56:02.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:02.889+0000 7f6dabb3a800 20 realm 2024-09-22T08:56:02.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:02.889+0000 7f6dabb3a800 20 rados->read ofs=0 len=0 2024-09-22T08:56:02.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:02.890+0000 7f6dabb3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:56:02.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:02.890+0000 7f6dabb3a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:56:02.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:02.890+0000 7f6dabb3a800 20 rados->read ofs=0 len=0 2024-09-22T08:56:02.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:02.890+0000 7f6dabb3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:56:02.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:02.890+0000 7f6dabb3a800 20 rados->read ofs=0 len=0 2024-09-22T08:56:02.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:02.891+0000 7f6dabb3a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:56:02.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:02.891+0000 7f6dabb3a800 20 rados->read ofs=0 len=0 2024-09-22T08:56:02.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:02.891+0000 7f6dabb3a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:56:02.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:02.891+0000 7f6dabb3a800 20 searching for the correct realm 2024-09-22T08:56:02.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:02.893+0000 7f6da70ba640 0 -- 172.21.15.38:0/1926291947 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f6d9c04b020 msgr2=0x7f6d9c077fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:56:03.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.099+0000 7f6da70ba640 0 -- 172.21.15.38:0/1926291947 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f6d980e50b0 msgr2=0x7f6d980dea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:56:03.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.306+0000 7f6dabb3a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:56:03.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.306+0000 7f6dabb3a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:56:03.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.306+0000 7f6dabb3a800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:56:03.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.306+0000 7f6dabb3a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:56:03.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.306+0000 7f6dabb3a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:56:03.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.306+0000 7f6dabb3a800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:56:03.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.306+0000 7f6dabb3a800 20 rados->read ofs=0 len=0 2024-09-22T08:56:03.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.306+0000 7f6dabb3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:56:03.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.306+0000 7f6dabb3a800 20 rados->read ofs=0 len=0 2024-09-22T08:56:03.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.306+0000 7f6dabb3a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:56:03.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.306+0000 7f6dabb3a800 20 rados->read ofs=0 len=0 2024-09-22T08:56:03.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.307+0000 7f6dabb3a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:56:03.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.307+0000 7f6dabb3a800 20 zone default found 2024-09-22T08:56:03.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.307+0000 7f6dabb3a800 4 Realm: () 2024-09-22T08:56:03.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.307+0000 7f6dabb3a800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:56:03.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.307+0000 7f6dabb3a800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:56:03.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.307+0000 7f6dabb3a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:56:03.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.307+0000 7f6dabb3a800 20 zonegroup default 2024-09-22T08:56:03.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.307+0000 7f6dabb3a800 20 rados->read ofs=0 len=0 2024-09-22T08:56:03.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.307+0000 7f6dabb3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:56:03.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.307+0000 7f6dabb3a800 20 rados->read ofs=0 len=0 2024-09-22T08:56:03.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.308+0000 7f6dabb3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:56:03.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.308+0000 7f6dabb3a800 20 rados->read ofs=0 len=0 2024-09-22T08:56:03.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.308+0000 7f6dabb3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:56:03.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.308+0000 7f6dabb3a800 20 started sync module instance, tier type = 2024-09-22T08:56:03.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.308+0000 7f6dabb3a800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:56:03.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.318+0000 7f6dabb3a800 20 add_watcher() i=0 2024-09-22T08:56:03.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.318+0000 7f6dabb3a800 20 add_watcher() i=1 2024-09-22T08:56:03.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.318+0000 7f6dabb3a800 20 add_watcher() i=2 2024-09-22T08:56:03.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.318+0000 7f6dabb3a800 20 add_watcher() i=3 2024-09-22T08:56:03.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.318+0000 7f6dabb3a800 20 add_watcher() i=4 2024-09-22T08:56:03.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.318+0000 7f6dabb3a800 20 add_watcher() i=5 2024-09-22T08:56:03.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.318+0000 7f6dabb3a800 20 add_watcher() i=6 2024-09-22T08:56:03.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.320+0000 7f6dabb3a800 20 add_watcher() i=7 2024-09-22T08:56:03.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.320+0000 7f6dabb3a800 2 all 8 watchers are set, enabling cache 2024-09-22T08:56:03.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.321+0000 7f6c5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:56:03.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.322+0000 7f6dabb3a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:56:03.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.322+0000 7f6dabb3a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:56:03.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.362+0000 7f6c5cfe1640 20 reqs_thread_entry: start 2024-09-22T08:56:03.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.362+0000 7f6dabb3a800 20 init_complete bucket index max shards: 11 2024-09-22T08:56:03.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.363+0000 7f6dabb3a800 20 Filter name: none 2024-09-22T08:56:03.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.363+0000 7f6bd67fc640 20 reqs_thread_entry: start 2024-09-22T08:56:03.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.363+0000 7f6dabb3a800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-22T08:56:03.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.363+0000 7f6dabb3a800 20 rados->read ofs=0 len=0 2024-09-22T08:56:03.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.363+0000 7f6dabb3a800 20 rados_obj.operate() r=0 bl.length=482 2024-09-22T08:56:03.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.363+0000 7f6dabb3a800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-22T08:56:03.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.363+0000 7f6dabb3a800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-22T08:56:03.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.363+0000 7f6dabb3a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:56:03.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.364+0000 7f6dabb3a800 10 removing key index: DEKCZBFWWWQNIMOULNLB 2024-09-22T08:56:03.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.365+0000 7f6dabb3a800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:DEKCZBFWWWQNIMOULNLB, ofs0, ns] 2024-09-22T08:56:03.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.366+0000 7f6c86ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576400623 cookie 93970283218352 notifier 9414 bl.length()=170 2024-09-22T08:56:03.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.366+0000 7f6dabb3a800 10 removing email index: tester.client.0_test@test.test 2024-09-22T08:56:03.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.367+0000 7f6dabb3a800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-22T08:56:03.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.367+0000 7f6c867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576400079 cookie 93970283213104 notifier 9414 bl.length()=181 2024-09-22T08:56:03.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.368+0000 7f6dabb3a800 10 removing user buckets index 2024-09-22T08:56:03.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.369+0000 7f6dabb3a800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-22T08:56:03.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.369+0000 7f6c86ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399533 cookie 93970283236224 notifier 9414 bl.length()=172 2024-09-22T08:56:03.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.370+0000 7f6dabb3a800 10 removing user index: tester.client.0 2024-09-22T08:56:03.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.371+0000 7f6dabb3a800 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-22T08:56:03.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.371+0000 7f6dabb3a800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-22T08:56:03.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.371+0000 7f6c867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399534 cookie 93970283224720 notifier 9414 bl.length()=164 2024-09-22T08:56:03.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.373+0000 7f6c5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:56:03.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.375+0000 7f6dabb3a800 20 remove_watcher() i=0 2024-09-22T08:56:03.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.375+0000 7f6dabb3a800 2 removed watcher, disabling cache 2024-09-22T08:56:03.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.376+0000 7f6dabb3a800 20 remove_watcher() i=1 2024-09-22T08:56:03.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.377+0000 7f6dabb3a800 20 remove_watcher() i=2 2024-09-22T08:56:03.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.378+0000 7f6dabb3a800 20 remove_watcher() i=3 2024-09-22T08:56:03.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.379+0000 7f6dabb3a800 20 remove_watcher() i=4 2024-09-22T08:56:03.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.381+0000 7f6dabb3a800 20 remove_watcher() i=5 2024-09-22T08:56:03.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.382+0000 7f6dabb3a800 20 remove_watcher() i=6 2024-09-22T08:56:03.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:03.383+0000 7f6dabb3a800 20 remove_watcher() i=7 2024-09-22T08:56:03.395 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-22T08:56:03.412 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-22T08:56:03.423 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-22T08:56:03.483 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-22T08:56:03.497 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-22T08:56:03.498 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T08:56:03.498 INFO:tasks.rgw.client.0.smithi038.stdout:2024-09-22T08:56:03.497+0000 7f03f067d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 44461) UID: 0 2024-09-22T08:56:03.499 INFO:tasks.rgw.client.0.smithi038.stdout:2024-09-22T08:56:03.497+0000 7f03f3ed8880 -1 shutting down 2024-09-22T08:56:15.700 INFO:tasks.rgw.client.0:Stopped 2024-09-22T08:56:15.701 DEBUG:teuthology.orchestra.run.smithi038:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-22T08:56:15.737 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f /etc/ceph/vault-root-token 2024-09-22T08:56:15.822 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-22T08:56:15.865 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-22T08:56:15.865 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-22T08:56:15.865 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-22T08:56:15.966 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:56:15.966 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:56:16.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.002+0000 7f06bad28800 20 rados->read ofs=0 len=0 2024-09-22T08:56:16.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.003+0000 7f06bad28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:56:16.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.003+0000 7f06bad28800 20 realm 2024-09-22T08:56:16.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.003+0000 7f06bad28800 20 rados->read ofs=0 len=0 2024-09-22T08:56:16.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.004+0000 7f06bad28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:56:16.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.004+0000 7f06bad28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:56:16.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.004+0000 7f06bad28800 20 rados->read ofs=0 len=0 2024-09-22T08:56:16.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.004+0000 7f06bad28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:56:16.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.004+0000 7f06bad28800 20 rados->read ofs=0 len=0 2024-09-22T08:56:16.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.005+0000 7f06bad28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:56:16.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.005+0000 7f06bad28800 20 rados->read ofs=0 len=0 2024-09-22T08:56:16.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.006+0000 7f06bad28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:56:16.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.006+0000 7f06bad28800 20 searching for the correct realm 2024-09-22T08:56:16.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.008+0000 7f06b626e640 0 -- 172.21.15.38:0/4228843338 >> [v2:172.21.15.38:6824/2964048893,v1:172.21.15.38:6825/2964048893] conn(0x7f06ac0c3030 msgr2=0x7f06ac0ab010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:56:16.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.012+0000 7f06b626e640 0 -- 172.21.15.38:0/4228843338 >> [v2:172.21.15.38:6816/852564455,v1:172.21.15.38:6817/852564455] conn(0x7f06a8052040 msgr2=0x7f06a8052930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:56:16.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.220+0000 7f06bad28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:56:16.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.220+0000 7f06bad28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:56:16.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.220+0000 7f06bad28800 20 RGWRados::pool_iterate: got zonegroup_info.a580c690-16b0-43a7-b11d-4ed607d96ad3 2024-09-22T08:56:16.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.220+0000 7f06bad28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:56:16.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.220+0000 7f06bad28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:56:16.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.220+0000 7f06bad28800 20 RGWRados::pool_iterate: got zone_info.c62f9d7b-f6b6-404a-90de-de5607499115 2024-09-22T08:56:16.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.220+0000 7f06bad28800 20 rados->read ofs=0 len=0 2024-09-22T08:56:16.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.220+0000 7f06bad28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:56:16.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.220+0000 7f06bad28800 20 rados->read ofs=0 len=0 2024-09-22T08:56:16.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.221+0000 7f06bad28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:56:16.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.221+0000 7f06bad28800 20 rados->read ofs=0 len=0 2024-09-22T08:56:16.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.221+0000 7f06bad28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:56:16.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.221+0000 7f06bad28800 20 zone default found 2024-09-22T08:56:16.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.221+0000 7f06bad28800 4 Realm: () 2024-09-22T08:56:16.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.221+0000 7f06bad28800 4 ZoneGroup: default (a580c690-16b0-43a7-b11d-4ed607d96ad3) 2024-09-22T08:56:16.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.221+0000 7f06bad28800 4 Zone: default (c62f9d7b-f6b6-404a-90de-de5607499115) 2024-09-22T08:56:16.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.221+0000 7f06bad28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:56:16.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.221+0000 7f06bad28800 20 zonegroup default 2024-09-22T08:56:16.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.221+0000 7f06bad28800 20 rados->read ofs=0 len=0 2024-09-22T08:56:16.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.222+0000 7f06bad28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:56:16.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.222+0000 7f06bad28800 20 rados->read ofs=0 len=0 2024-09-22T08:56:16.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.222+0000 7f06bad28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:56:16.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.222+0000 7f06bad28800 20 rados->read ofs=0 len=0 2024-09-22T08:56:16.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.222+0000 7f06bad28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:56:16.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.222+0000 7f06bad28800 20 started sync module instance, tier type = 2024-09-22T08:56:16.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.222+0000 7f06bad28800 20 started zone id=c62f9d7b-f6b6-404a-90de-de5607499115 (name=default) with tier type = 2024-09-22T08:56:16.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.233+0000 7f06bad28800 20 add_watcher() i=0 2024-09-22T08:56:16.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.233+0000 7f06bad28800 20 add_watcher() i=1 2024-09-22T08:56:16.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.233+0000 7f06bad28800 20 add_watcher() i=2 2024-09-22T08:56:16.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.233+0000 7f06bad28800 20 add_watcher() i=3 2024-09-22T08:56:16.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.233+0000 7f06bad28800 20 add_watcher() i=4 2024-09-22T08:56:16.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.233+0000 7f06bad28800 20 add_watcher() i=5 2024-09-22T08:56:16.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.233+0000 7f06bad28800 20 add_watcher() i=6 2024-09-22T08:56:16.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.234+0000 7f06bad28800 20 add_watcher() i=7 2024-09-22T08:56:16.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.234+0000 7f06bad28800 2 all 8 watchers are set, enabling cache 2024-09-22T08:56:16.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.236+0000 7f056d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:56:16.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.236+0000 7f06bad28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:56:16.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.236+0000 7f06bad28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:56:16.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.278+0000 7f04e7fff640 20 reqs_thread_entry: start 2024-09-22T08:56:16.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.278+0000 7f06bad28800 20 init_complete bucket index max shards: 11 2024-09-22T08:56:16.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.278+0000 7f06bad28800 20 Filter name: none 2024-09-22T08:56:16.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.278+0000 7f04e5ffb640 20 reqs_thread_entry: start 2024-09-22T08:56:16.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.278+0000 7f06bad28800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-22T08:56:16.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.280+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:56:16.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.281+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:56:16.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.281+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T08:56:16.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.281+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.15880235845648396818', time=2024-09-22T10:48:23.834811+0000, chain.objs.size()=1 2024-09-22T08:56:16.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.281+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.516__multipart_mymultipartcopy.2~3EMzsg2e1mzIRkWiCuRGaKsRzTvGMTZ.1 2024-09-22T08:56:16.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.281+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.4246277065204640719', time=2024-09-22T10:48:24.937549+0000, chain.objs.size()=1 2024-09-22T08:56:16.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.281+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.518__multipart_mymultipart.2~zz22brYIBH_JOv2jDUbHthmrfnRUVrt.1 2024-09-22T08:56:16.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.283+0000 7f06bad28800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:56:16.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.286+0000 7f06bad28800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-22T08:56:16.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.287+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:56:16.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.287+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:56:16.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.288+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-22T08:56:16.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.288+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='2~JvSvh1Y1St1ZHcE2IHo6RQoRhDAOz09', time=2024-09-22T10:48:50.274223+0000, chain.objs.size()=1 2024-09-22T08:56:16.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.288+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.534__multipart_mymultipart.2~JvSvh1Y1St1ZHcE2IHo6RQoRhDAOz09.1 2024-09-22T08:56:16.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.288+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.9604587991435574315', time=2024-09-22T10:49:28.722191+0000, chain.objs.size()=1 2024-09-22T08:56:16.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.288+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.558__shadow_.OJJoQM9k2kx6UhGeTHEq3L_aANSqTyh_1 2024-09-22T08:56:16.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.288+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='2~7z0h9KgkKB3l6hz0i8Wa6i1Rs8Vuc1o', time=2024-09-22T10:52:39.135004+0000, chain.objs.size()=12 2024-09-22T08:56:16.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.288+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.624__multipart_multipart_enc.2~7z0h9KgkKB3l6hz0i8Wa6i1Rs8Vuc1o.1 2024-09-22T08:56:16.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.288+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.624__shadow_multipart_enc.2~7z0h9KgkKB3l6hz0i8Wa6i1Rs8Vuc1o.1_1 2024-09-22T08:56:16.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.288+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.624__multipart_multipart_enc.2~7z0h9KgkKB3l6hz0i8Wa6i1Rs8Vuc1o.2 2024-09-22T08:56:16.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.288+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.624__shadow_multipart_enc.2~7z0h9KgkKB3l6hz0i8Wa6i1Rs8Vuc1o.2_1 2024-09-22T08:56:16.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.288+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.624__multipart_multipart_enc.2~7z0h9KgkKB3l6hz0i8Wa6i1Rs8Vuc1o.3 2024-09-22T08:56:16.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.288+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.624__shadow_multipart_enc.2~7z0h9KgkKB3l6hz0i8Wa6i1Rs8Vuc1o.3_1 2024-09-22T08:56:16.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.288+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.624__multipart_multipart_enc.2~7z0h9KgkKB3l6hz0i8Wa6i1Rs8Vuc1o.4 2024-09-22T08:56:16.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.288+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.624__shadow_multipart_enc.2~7z0h9KgkKB3l6hz0i8Wa6i1Rs8Vuc1o.4_1 2024-09-22T08:56:16.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.288+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.624__multipart_multipart_enc.2~7z0h9KgkKB3l6hz0i8Wa6i1Rs8Vuc1o.5 2024-09-22T08:56:16.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.288+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.624__shadow_multipart_enc.2~7z0h9KgkKB3l6hz0i8Wa6i1Rs8Vuc1o.5_1 2024-09-22T08:56:16.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.291+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.624__multipart_multipart_enc.2~7z0h9KgkKB3l6hz0i8Wa6i1Rs8Vuc1o.6 2024-09-22T08:56:16.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.292+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.624__shadow_multipart_enc.2~7z0h9KgkKB3l6hz0i8Wa6i1Rs8Vuc1o.6_1 2024-09-22T08:56:16.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.294+0000 7f06bad28800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:56:16.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.296+0000 7f06bad28800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-22T08:56:16.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.298+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:56:16.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.298+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:56:16.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.299+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-22T08:56:16.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.299+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='_0QLj0KCntL8G-VOgrR48m3X6j1f_pE6', time=2024-09-22T10:44:22.202293+0000, chain.objs.size()=1 2024-09-22T08:56:16.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.299+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.165__shadow_.FJw11N6SLO3Z163SdTFBs-vIWqakQbn_0 2024-09-22T08:56:16.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.299+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.13657812883455395950', time=2024-09-22T10:48:20.301767+0000, chain.objs.size()=12 2024-09-22T08:56:16.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.299+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__multipart_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.1 2024-09-22T08:56:16.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.299+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__shadow_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.1_1 2024-09-22T08:56:16.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.299+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__multipart_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.2 2024-09-22T08:56:16.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.299+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__shadow_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.2_1 2024-09-22T08:56:16.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.299+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__multipart_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.3 2024-09-22T08:56:16.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.299+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__shadow_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.3_1 2024-09-22T08:56:16.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.299+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__multipart_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.4 2024-09-22T08:56:16.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.299+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__shadow_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.4_1 2024-09-22T08:56:16.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.299+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__multipart_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.5 2024-09-22T08:56:16.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.299+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__shadow_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.5_1 2024-09-22T08:56:16.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.299+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__multipart_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.6 2024-09-22T08:56:16.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.300+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__shadow_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.6_1 2024-09-22T08:56:16.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.300+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.2145669608062719129', time=2024-09-22T10:48:41.902016+0000, chain.objs.size()=3 2024-09-22T08:56:16.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.300+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.523__multipart_mymultipart.2~zJ_IuK4f5AiN0Ya0ycX6tlSw323Vp4Q.1 2024-09-22T08:56:16.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.302+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.523__shadow_mymultipart.2~zJ_IuK4f5AiN0Ya0ycX6tlSw323Vp4Q.1_1 2024-09-22T08:56:16.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.302+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.523__multipart_mymultipart.2~zJ_IuK4f5AiN0Ya0ycX6tlSw323Vp4Q.2 2024-09-22T08:56:16.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.302+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.9243431877242635054', time=2024-09-22T10:48:42.345337+0000, chain.objs.size()=2 2024-09-22T08:56:16.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.302+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.523__multipart_mymultipart.2~Uoo2BXUPl1_nQsro-vT-wsSPz868lqd.1 2024-09-22T08:56:16.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.302+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.523__multipart_mymultipart.2~Uoo2BXUPl1_nQsro-vT-wsSPz868lqd.2 2024-09-22T08:56:16.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.302+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.4728530375612103488', time=2024-09-22T10:48:44.527431+0000, chain.objs.size()=3 2024-09-22T08:56:16.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.302+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.525__multipart_mymultipart.2~TM9moQ-13xDJkTM-n6hqiPm5o8NFJoZ.1 2024-09-22T08:56:16.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.302+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.525__multipart_mymultipart.2~TM9moQ-13xDJkTM-n6hqiPm5o8NFJoZ.2 2024-09-22T08:56:16.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.302+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.525__multipart_mymultipart.2~TM9moQ-13xDJkTM-n6hqiPm5o8NFJoZ.3 2024-09-22T08:56:16.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.302+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='2~UzI9kDyCD65OP5cF0Tt4qXpI9gshwrh', time=2024-09-22T10:48:49.839264+0000, chain.objs.size()=1 2024-09-22T08:56:16.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.302+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.533__multipart_mymultipart.2~UzI9kDyCD65OP5cF0Tt4qXpI9gshwrh.1 2024-09-22T08:56:16.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.302+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.7463976384747590428', time=2024-09-22T10:50:08.257645+0000, chain.objs.size()=4 2024-09-22T08:56:16.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.302+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.578__multipart_testobj.2~hhukgTGBRIMELhZh8mINjYzqUUrc6-H.1 2024-09-22T08:56:16.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.302+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.578__multipart_testobj.2~hhukgTGBRIMELhZh8mINjYzqUUrc6-H.2 2024-09-22T08:56:16.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.302+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.578__multipart_testobj.2~hhukgTGBRIMELhZh8mINjYzqUUrc6-H.3 2024-09-22T08:56:16.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.304+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.578__multipart_testobj.2~hhukgTGBRIMELhZh8mINjYzqUUrc6-H.4 2024-09-22T08:56:16.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.304+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.15557901950439599142', time=2024-09-22T10:52:57.369734+0000, chain.objs.size()=6 2024-09-22T08:56:16.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.304+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.661__multipart_baz.2~MlZ8cVSKsH7rQI5YCF2W2dqNifZgS9h.1 2024-09-22T08:56:16.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.304+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.661__multipart_baz.2~MlZ8cVSKsH7rQI5YCF2W2dqNifZgS9h.2 2024-09-22T08:56:16.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.304+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.661__multipart_baz.2~MlZ8cVSKsH7rQI5YCF2W2dqNifZgS9h.3 2024-09-22T08:56:16.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.304+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.661__multipart_baz.2~MlZ8cVSKsH7rQI5YCF2W2dqNifZgS9h.4 2024-09-22T08:56:16.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.304+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.661__multipart_baz.2~MlZ8cVSKsH7rQI5YCF2W2dqNifZgS9h.5 2024-09-22T08:56:16.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.304+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.661__multipart_baz.2~MlZ8cVSKsH7rQI5YCF2W2dqNifZgS9h.6 2024-09-22T08:56:16.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.306+0000 7f06bad28800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:56:16.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.309+0000 7f06bad28800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-22T08:56:16.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.310+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:56:16.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.310+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:56:16.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.311+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T08:56:16.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.311+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='_FqCkDMpaUbzrUHz0VCsoA3DGmrvx2OH', time=2024-09-22T10:44:20.782318+0000, chain.objs.size()=1 2024-09-22T08:56:16.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.311+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.161__shadow_.iDMHUgKnTswktP13e7JW6qf0apm2Lmz_0 2024-09-22T08:56:16.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.311+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.11591562744893007954', time=2024-09-22T10:53:51.129512+0000, chain.objs.size()=3 2024-09-22T08:56:16.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.311+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.743__multipart_mymultipart3.2~0EjF8DpV_UJdN6WY7GFV8lO3GkLWnee.1 2024-09-22T08:56:16.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.311+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.743__multipart_mymultipart3.2~0EjF8DpV_UJdN6WY7GFV8lO3GkLWnee.2 2024-09-22T08:56:16.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.311+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.743__multipart_mymultipart3.2~0EjF8DpV_UJdN6WY7GFV8lO3GkLWnee.3 2024-09-22T08:56:16.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.312+0000 7f06bad28800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:56:16.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.314+0000 7f06bad28800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-22T08:56:16.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.316+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:56:16.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.316+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:56:16.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.317+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-22T08:56:16.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.317+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.12960900394921458679', time=2024-09-22T10:44:17.899528+0000, chain.objs.size()=5 2024-09-22T08:56:16.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.317+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.159__multipart_mymultipart-FROZEN.2~AW2M97g1qTTmCUGsxPBYUjm0ErWF41I.1 2024-09-22T08:56:16.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.317+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.159__shadow_mymultipart-FROZEN.2~AW2M97g1qTTmCUGsxPBYUjm0ErWF41I.1_1 2024-09-22T08:56:16.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.317+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.159__multipart_mymultipart-FROZEN.2~AW2M97g1qTTmCUGsxPBYUjm0ErWF41I.2 2024-09-22T08:56:16.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.317+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.159__shadow_mymultipart-FROZEN.2~AW2M97g1qTTmCUGsxPBYUjm0ErWF41I.2_1 2024-09-22T08:56:16.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.317+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.159__multipart_mymultipart-FROZEN.2~AW2M97g1qTTmCUGsxPBYUjm0ErWF41I.3 2024-09-22T08:56:16.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.317+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='_5BSC2TvzRRX5qWcoc5LRKM6A5oD2diO', time=2024-09-22T10:44:18.991786+0000, chain.objs.size()=3 2024-09-22T08:56:16.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.317+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.160__shadow_.1qxKqlZOaFORIY7QVy4lmPav8AJckGl_0 2024-09-22T08:56:16.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.317+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.160__shadow_.1qxKqlZOaFORIY7QVy4lmPav8AJckGl_1 2024-09-22T08:56:16.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.317+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.160__shadow_.1qxKqlZOaFORIY7QVy4lmPav8AJckGl_2 2024-09-22T08:56:16.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.317+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='2~z4HUGUM2CWJIE0OwU_tRMs6MKq15p0j', time=2024-09-22T10:48:50.793141+0000, chain.objs.size()=1 2024-09-22T08:56:16.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.317+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.535__multipart_mymultipart.2~z4HUGUM2CWJIE0OwU_tRMs6MKq15p0j.3 2024-09-22T08:56:16.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.317+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.15665412345082242855', time=2024-09-22T10:52:57.285558+0000, chain.objs.size()=6 2024-09-22T08:56:16.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.317+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.660__multipart_bar.2~cMCnAL9Zd4W4J3e6xW-vwXDs7ub3beC.1 2024-09-22T08:56:16.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.317+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.660__multipart_bar.2~cMCnAL9Zd4W4J3e6xW-vwXDs7ub3beC.2 2024-09-22T08:56:16.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.317+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.660__multipart_bar.2~cMCnAL9Zd4W4J3e6xW-vwXDs7ub3beC.3 2024-09-22T08:56:16.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.320+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.660__multipart_bar.2~cMCnAL9Zd4W4J3e6xW-vwXDs7ub3beC.4 2024-09-22T08:56:16.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.320+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.660__multipart_bar.2~cMCnAL9Zd4W4J3e6xW-vwXDs7ub3beC.5 2024-09-22T08:56:16.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.321+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.660__multipart_bar.2~cMCnAL9Zd4W4J3e6xW-vwXDs7ub3beC.6 2024-09-22T08:56:16.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.321+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.14193820359310212909', time=2024-09-22T10:53:17.463869+0000, chain.objs.size()=1 2024-09-22T08:56:16.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.321+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.711__multipart_file1.2~OlQG_mP02cgCDBbHt4PZ8rzkXKJONaI.1 2024-09-22T08:56:16.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.322+0000 7f06bad28800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:56:16.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.324+0000 7f06bad28800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-22T08:56:16.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.326+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:56:16.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.326+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:56:16.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.327+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-22T08:56:16.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.327+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='_ds9Y00w9HsOcvsxGPGStaby34NGApv8', time=2024-09-22T10:44:18.842248+0000, chain.objs.size()=2 2024-09-22T08:56:16.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.327+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.160__shadow_.SyA6rf3QuR7LWzbosWK62Rc-992k896_1 2024-09-22T08:56:16.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.327+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.160__shadow_.SyA6rf3QuR7LWzbosWK62Rc-992k896_2 2024-09-22T08:56:16.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.327+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.9418307703229656521', time=2024-09-22T10:48:43.668160+0000, chain.objs.size()=3 2024-09-22T08:56:16.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.327+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.525__multipart_mymultipart.2~q9KJmETM36NYzkLGvEcutQ7_9HFB6Jg.1 2024-09-22T08:56:16.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.327+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.525__shadow_mymultipart.2~q9KJmETM36NYzkLGvEcutQ7_9HFB6Jg.1_1 2024-09-22T08:56:16.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.327+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.525__multipart_mymultipart.2~q9KJmETM36NYzkLGvEcutQ7_9HFB6Jg.2 2024-09-22T08:56:16.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.327+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.5358293679654778746', time=2024-09-22T10:48:47.167983+0000, chain.objs.size()=2 2024-09-22T08:56:16.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.327+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.528__multipart_mymultipart.2~zHcxyuR_IKOw7X9eQYTT-G3avy_GprI.1 2024-09-22T08:56:16.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.327+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.528__multipart_mymultipart.2~zHcxyuR_IKOw7X9eQYTT-G3avy_GprI.2 2024-09-22T08:56:16.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.327+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.17422359245372847782', time=2024-09-22T10:50:31.853984+0000, chain.objs.size()=12 2024-09-22T08:56:16.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.327+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.615__multipart_multipart_enc.2~ID85pei2oPIsLT-vEfUSG_EH3PI2EOh.1 2024-09-22T08:56:16.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.327+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.615__shadow_multipart_enc.2~ID85pei2oPIsLT-vEfUSG_EH3PI2EOh.1_1 2024-09-22T08:56:16.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.327+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.615__multipart_multipart_enc.2~ID85pei2oPIsLT-vEfUSG_EH3PI2EOh.2 2024-09-22T08:56:16.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.327+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.615__shadow_multipart_enc.2~ID85pei2oPIsLT-vEfUSG_EH3PI2EOh.2_1 2024-09-22T08:56:16.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.327+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.615__multipart_multipart_enc.2~ID85pei2oPIsLT-vEfUSG_EH3PI2EOh.3 2024-09-22T08:56:16.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.330+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.615__shadow_multipart_enc.2~ID85pei2oPIsLT-vEfUSG_EH3PI2EOh.3_1 2024-09-22T08:56:16.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.331+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.615__multipart_multipart_enc.2~ID85pei2oPIsLT-vEfUSG_EH3PI2EOh.4 2024-09-22T08:56:16.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.331+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.615__shadow_multipart_enc.2~ID85pei2oPIsLT-vEfUSG_EH3PI2EOh.4_1 2024-09-22T08:56:16.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.331+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.615__multipart_multipart_enc.2~ID85pei2oPIsLT-vEfUSG_EH3PI2EOh.5 2024-09-22T08:56:16.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.331+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.615__shadow_multipart_enc.2~ID85pei2oPIsLT-vEfUSG_EH3PI2EOh.5_1 2024-09-22T08:56:16.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.331+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.615__multipart_multipart_enc.2~ID85pei2oPIsLT-vEfUSG_EH3PI2EOh.6 2024-09-22T08:56:16.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.331+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.615__shadow_multipart_enc.2~ID85pei2oPIsLT-vEfUSG_EH3PI2EOh.6_1 2024-09-22T08:56:16.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.331+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='2~bu_byG8f2LA4RokoClyq89m-zueT5bR', time=2024-09-22T10:52:39.932902+0000, chain.objs.size()=12 2024-09-22T08:56:16.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.331+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.625__multipart_multipart_enc.2~bu_byG8f2LA4RokoClyq89m-zueT5bR.1 2024-09-22T08:56:16.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.331+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.625__shadow_multipart_enc.2~bu_byG8f2LA4RokoClyq89m-zueT5bR.1_1 2024-09-22T08:56:16.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.331+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.625__multipart_multipart_enc.2~bu_byG8f2LA4RokoClyq89m-zueT5bR.2 2024-09-22T08:56:16.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.331+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.625__shadow_multipart_enc.2~bu_byG8f2LA4RokoClyq89m-zueT5bR.2_1 2024-09-22T08:56:16.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.334+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.625__multipart_multipart_enc.2~bu_byG8f2LA4RokoClyq89m-zueT5bR.3 2024-09-22T08:56:16.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.334+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.625__shadow_multipart_enc.2~bu_byG8f2LA4RokoClyq89m-zueT5bR.3_1 2024-09-22T08:56:16.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.334+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.625__multipart_multipart_enc.2~bu_byG8f2LA4RokoClyq89m-zueT5bR.4 2024-09-22T08:56:16.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.334+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.625__shadow_multipart_enc.2~bu_byG8f2LA4RokoClyq89m-zueT5bR.4_1 2024-09-22T08:56:16.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.334+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.625__multipart_multipart_enc.2~bu_byG8f2LA4RokoClyq89m-zueT5bR.5 2024-09-22T08:56:16.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.334+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.625__shadow_multipart_enc.2~bu_byG8f2LA4RokoClyq89m-zueT5bR.5_1 2024-09-22T08:56:16.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.335+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.625__multipart_multipart_enc.2~bu_byG8f2LA4RokoClyq89m-zueT5bR.6 2024-09-22T08:56:16.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.335+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.625__shadow_multipart_enc.2~bu_byG8f2LA4RokoClyq89m-zueT5bR.6_1 2024-09-22T08:56:16.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.335+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='2~ggi6-bDfszuhg6oIuM77iXYLpJKd57W', time=2024-09-22T10:53:50.449555+0000, chain.objs.size()=1 2024-09-22T08:56:16.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.335+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.742__multipart_mymultipart2.2~ggi6-bDfszuhg6oIuM77iXYLpJKd57W.1 2024-09-22T08:56:16.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.337+0000 7f06bad28800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:56:16.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.339+0000 7f06bad28800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-22T08:56:16.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.341+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:56:16.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.341+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:56:16.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.342+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-22T08:56:16.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.342+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.15753349636757385997', time=2024-09-22T10:44:19.450961+0000, chain.objs.size()=3 2024-09-22T08:56:16.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.342+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.161__multipart_foo-STANDARD.2~HihmwVfKJIzzQZREb1SsBQncsnyLL1y.1 2024-09-22T08:56:16.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.342+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.161__multipart_foo-STANDARD.2~HihmwVfKJIzzQZREb1SsBQncsnyLL1y.2 2024-09-22T08:56:16.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.342+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.161__multipart_foo-STANDARD.2~HihmwVfKJIzzQZREb1SsBQncsnyLL1y.3 2024-09-22T08:56:16.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.342+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.8175266294325233485', time=2024-09-22T10:48:42.235153+0000, chain.objs.size()=3 2024-09-22T08:56:16.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.342+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.523__multipart_mymultipart.2~PjByjYuc6mCZV4iPo1N5OnhuGGQ14m0.1 2024-09-22T08:56:16.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.342+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.523__multipart_mymultipart.2~PjByjYuc6mCZV4iPo1N5OnhuGGQ14m0.2 2024-09-22T08:56:16.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.342+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.523__multipart_mymultipart.2~PjByjYuc6mCZV4iPo1N5OnhuGGQ14m0.3 2024-09-22T08:56:16.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.342+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.5021219457300722814', time=2024-09-22T10:48:46.445453+0000, chain.objs.size()=4 2024-09-22T08:56:16.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.342+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.527__multipart_mymultipart.2~4neCZjoDevR-EPONEzq2KgGDxQww0rq.1 2024-09-22T08:56:16.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.342+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.527__multipart_mymultipart.2~4neCZjoDevR-EPONEzq2KgGDxQww0rq.2 2024-09-22T08:56:16.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.342+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.527__multipart_mymultipart.2~4neCZjoDevR-EPONEzq2KgGDxQww0rq.3 2024-09-22T08:56:16.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.342+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.527__multipart_mymultipart.2~4neCZjoDevR-EPONEzq2KgGDxQww0rq.4 2024-09-22T08:56:16.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.344+0000 7f06bad28800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:56:16.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.346+0000 7f06bad28800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-22T08:56:16.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.347+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:56:16.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.348+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:56:16.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.348+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:56:16.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.348+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='2~dwhXSMLUQMZrYyTYBsn0QQRIwHRjOdH', time=2024-09-22T10:48:47.640944+0000, chain.objs.size()=2 2024-09-22T08:56:16.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.348+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.529__multipart_mymultipart.2~dwhXSMLUQMZrYyTYBsn0QQRIwHRjOdH.1 2024-09-22T08:56:16.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.348+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.529__multipart_mymultipart.2~dwhXSMLUQMZrYyTYBsn0QQRIwHRjOdH.2 2024-09-22T08:56:16.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.349+0000 7f06bad28800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:56:16.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.352+0000 7f06bad28800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-22T08:56:16.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.353+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:56:16.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.354+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:56:16.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.354+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T08:56:16.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.354+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.7118045447467235463', time=2024-09-22T10:48:44.889520+0000, chain.objs.size()=3 2024-09-22T08:56:16.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.354+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.525__multipart_mymultipart.2~AwfkrmNBgNTEfCpcehvXbIdWnJIaxwr.1 2024-09-22T08:56:16.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.354+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.525__multipart_mymultipart.2~AwfkrmNBgNTEfCpcehvXbIdWnJIaxwr.2 2024-09-22T08:56:16.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.354+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.525__multipart_mymultipart.2~AwfkrmNBgNTEfCpcehvXbIdWnJIaxwr.3 2024-09-22T08:56:16.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.354+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.16755128996997000551', time=2024-09-22T10:49:35.330530+0000, chain.objs.size()=1 2024-09-22T08:56:16.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.354+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.563__shadow_.TlVNbyAGkLuJDKytoYxWFsYM0XOSzNG_1 2024-09-22T08:56:16.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.356+0000 7f06bad28800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:56:16.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.358+0000 7f06bad28800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-22T08:56:16.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.359+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:56:16.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.360+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:56:16.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.360+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-22T08:56:16.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.360+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.17714493851034470708', time=2024-09-22T10:44:17.912552+0000, chain.objs.size()=3 2024-09-22T08:56:16.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.360+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.159__multipart_mymultipart-STANDARD.2~fd6UMFtkVetWSITwg7wc-pFj5ZkeodX.1 2024-09-22T08:56:16.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.360+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.159__multipart_mymultipart-STANDARD.2~fd6UMFtkVetWSITwg7wc-pFj5ZkeodX.2 2024-09-22T08:56:16.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.360+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.159__multipart_mymultipart-STANDARD.2~fd6UMFtkVetWSITwg7wc-pFj5ZkeodX.3 2024-09-22T08:56:16.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.360+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.10325232011404455259', time=2024-09-22T10:44:18.427822+0000, chain.objs.size()=3 2024-09-22T08:56:16.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.360+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.160__shadow_.o2fzkqkbrudl90-e2-qvH2pINpeRbRi_0 2024-09-22T08:56:16.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.360+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.160__shadow_.o2fzkqkbrudl90-e2-qvH2pINpeRbRi_1 2024-09-22T08:56:16.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.360+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.160__shadow_.o2fzkqkbrudl90-e2-qvH2pINpeRbRi_2 2024-09-22T08:56:16.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.360+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='_Q2SdoxYwGP7SgwAQ12ZDRS4I4SgZcdZ', time=2024-09-22T10:44:18.986985+0000, chain.objs.size()=3 2024-09-22T08:56:16.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.360+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.160__shadow_.IJKNnbQbnNaylckE524UbhdPturUaBC_0 2024-09-22T08:56:16.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.360+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.160__shadow_.IJKNnbQbnNaylckE524UbhdPturUaBC_1 2024-09-22T08:56:16.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.360+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.160__shadow_.IJKNnbQbnNaylckE524UbhdPturUaBC_2 2024-09-22T08:56:16.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.360+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='2~ANX3Am4cabOiFHfpJffwPs9i0e48qDa', time=2024-09-22T10:53:50.443566+0000, chain.objs.size()=1 2024-09-22T08:56:16.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.360+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.742__multipart_mymultipart.2~ANX3Am4cabOiFHfpJffwPs9i0e48qDa.1 2024-09-22T08:56:16.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.363+0000 7f06bad28800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:56:16.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.365+0000 7f06bad28800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-22T08:56:16.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.368+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:56:16.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.368+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:56:16.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.368+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T08:56:16.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.368+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='2~etgFaWXjiB9wkBzmagMenhAQQnNfnZb', time=2024-09-22T10:48:45.776008+0000, chain.objs.size()=10 2024-09-22T08:56:16.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.368+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.526__multipart_mymultipart.2~etgFaWXjiB9wkBzmagMenhAQQnNfnZb.1 2024-09-22T08:56:16.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.368+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.526__multipart_mymultipart.2~etgFaWXjiB9wkBzmagMenhAQQnNfnZb.2 2024-09-22T08:56:16.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.368+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.526__multipart_mymultipart.2~etgFaWXjiB9wkBzmagMenhAQQnNfnZb.3 2024-09-22T08:56:16.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.368+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.526__multipart_mymultipart.2~etgFaWXjiB9wkBzmagMenhAQQnNfnZb.4 2024-09-22T08:56:16.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.368+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.526__multipart_mymultipart.2~etgFaWXjiB9wkBzmagMenhAQQnNfnZb.5 2024-09-22T08:56:16.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.368+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.526__multipart_mymultipart.2~etgFaWXjiB9wkBzmagMenhAQQnNfnZb.6 2024-09-22T08:56:16.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.368+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.526__multipart_mymultipart.2~etgFaWXjiB9wkBzmagMenhAQQnNfnZb.7 2024-09-22T08:56:16.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.368+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.526__multipart_mymultipart.2~etgFaWXjiB9wkBzmagMenhAQQnNfnZb.8 2024-09-22T08:56:16.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.368+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.526__multipart_mymultipart.2~etgFaWXjiB9wkBzmagMenhAQQnNfnZb.9 2024-09-22T08:56:16.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.368+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.526__multipart_mymultipart.2~etgFaWXjiB9wkBzmagMenhAQQnNfnZb.10 2024-09-22T08:56:16.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.368+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.15952888161113341426', time=2024-09-22T10:49:30.110196+0000, chain.objs.size()=1 2024-09-22T08:56:16.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.368+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.561__multipart_mymultipart.2~EfemOSZd2cn50E_WYHYszxw4J8r8jms.1 2024-09-22T08:56:16.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.371+0000 7f06bad28800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:56:16.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.373+0000 7f06bad28800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-22T08:56:16.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.375+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:56:16.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.375+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:56:16.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.375+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-22T08:56:16.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.375+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.10220926123380481177', time=2024-09-22T10:44:18.755815+0000, chain.objs.size()=3 2024-09-22T08:56:16.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.375+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.160__shadow_.N6udf0J-KNJDkpMEMOA8YcRUHDPFLPj_0 2024-09-22T08:56:16.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.375+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.160__shadow_.N6udf0J-KNJDkpMEMOA8YcRUHDPFLPj_1 2024-09-22T08:56:16.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.375+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.160__shadow_.N6udf0J-KNJDkpMEMOA8YcRUHDPFLPj_2 2024-09-22T08:56:16.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.375+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='_G5exI_UxUTC21gaHz5t_Jhmmyi8mtw6', time=2024-09-22T10:44:20.776239+0000, chain.objs.size()=3 2024-09-22T08:56:16.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.375+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.161__shadow_.lUfCCLt01CUZ6Z4kIa90Tr8wcbDoL9E_0 2024-09-22T08:56:16.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.375+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.161__shadow_.lUfCCLt01CUZ6Z4kIa90Tr8wcbDoL9E_1 2024-09-22T08:56:16.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.375+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.161__shadow_.lUfCCLt01CUZ6Z4kIa90Tr8wcbDoL9E_2 2024-09-22T08:56:16.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.375+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='_kpDU5_25jv3afWCnhHC01hPdWb8nVnF', time=2024-09-22T10:44:21.408855+0000, chain.objs.size()=1 2024-09-22T08:56:16.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.375+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.163__shadow_.WhBE1xIDx6ijR59c2sQGG8n65lG8vax_0 2024-09-22T08:56:16.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.375+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.4018119367102408799', time=2024-09-22T10:48:33.209339+0000, chain.objs.size()=6 2024-09-22T08:56:16.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.375+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.522__multipart_mymultipart.yTLq6Y8gtEWPgcCVj7zAD2TzZ1_5-iVX.1 2024-09-22T08:56:16.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.376+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.522__multipart_mymultipart.2~j_7iO5Y8K-InaInpSTX1MvjG2bVJZe4.2 2024-09-22T08:56:16.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.376+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.522__multipart_mymultipart.2~j_7iO5Y8K-InaInpSTX1MvjG2bVJZe4.3 2024-09-22T08:56:16.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.376+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.522__multipart_mymultipart.2~j_7iO5Y8K-InaInpSTX1MvjG2bVJZe4.4 2024-09-22T08:56:16.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.376+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.522__multipart_mymultipart.2~j_7iO5Y8K-InaInpSTX1MvjG2bVJZe4.5 2024-09-22T08:56:16.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.378+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.522__multipart_mymultipart.2~j_7iO5Y8K-InaInpSTX1MvjG2bVJZe4.6 2024-09-22T08:56:16.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.380+0000 7f06bad28800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:56:16.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.382+0000 7f06bad28800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-22T08:56:16.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.384+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:56:16.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.384+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:56:16.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.385+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-22T08:56:16.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.385+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='_K83Aj1zK2-zRFioAqC8vRBdPge_TQnB', time=2024-09-22T10:44:18.511556+0000, chain.objs.size()=2 2024-09-22T08:56:16.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.385+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.160__shadow_.Kw9Dy5j60S67v4nOmON9nvJ5rFnKAnf_1 2024-09-22T08:56:16.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.385+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.160__shadow_.Kw9Dy5j60S67v4nOmON9nvJ5rFnKAnf_2 2024-09-22T08:56:16.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.385+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='_TwPk4p65YtEpUs8p4Se0uW8nG1s7hMo', time=2024-09-22T10:44:21.402757+0000, chain.objs.size()=1 2024-09-22T08:56:16.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.385+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.163__shadow_.aWgCbug7qePxBwIpUBSBsfMr9gD2HGs_0 2024-09-22T08:56:16.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.385+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.14869433233969836728', time=2024-09-22T10:48:20.299373+0000, chain.objs.size()=12 2024-09-22T08:56:16.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.385+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__multipart_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.1 2024-09-22T08:56:16.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.385+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__shadow_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.1_1 2024-09-22T08:56:16.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.385+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__multipart_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.2 2024-09-22T08:56:16.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.385+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__shadow_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.2_1 2024-09-22T08:56:16.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.385+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__multipart_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.3 2024-09-22T08:56:16.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.385+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__shadow_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.3_1 2024-09-22T08:56:16.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.385+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__multipart_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.4 2024-09-22T08:56:16.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.385+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__shadow_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.4_1 2024-09-22T08:56:16.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.385+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__multipart_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.5 2024-09-22T08:56:16.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.388+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__shadow_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.5_1 2024-09-22T08:56:16.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.388+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__multipart_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.6 2024-09-22T08:56:16.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.388+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__shadow_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.6_1 2024-09-22T08:56:16.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.388+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='2~yNGM1kYuEgi90w00ZxELbDJ6yVAIEWx', time=2024-09-22T10:48:35.060267+0000, chain.objs.size()=1 2024-09-22T08:56:16.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.388+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.522__multipart_mymultipart.2~yNGM1kYuEgi90w00ZxELbDJ6yVAIEWx.3 2024-09-22T08:56:16.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.388+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.11929670597870168164', time=2024-09-22T10:48:44.069119+0000, chain.objs.size()=2 2024-09-22T08:56:16.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.388+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.525__multipart_mymultipart.2~9OH916VrSOFxfePuN3sR771i1nr6pt8.1 2024-09-22T08:56:16.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.388+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.525__multipart_mymultipart.2~9OH916VrSOFxfePuN3sR771i1nr6pt8.2 2024-09-22T08:56:16.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.388+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.17012699651585468611', time=2024-09-22T10:50:08.566651+0000, chain.objs.size()=4 2024-09-22T08:56:16.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.388+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.578__multipart_testobj.2~YEkId0XsX2O_gYXViJ1xTujqtdsD6wP.1 2024-09-22T08:56:16.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.388+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.578__multipart_testobj.2~YEkId0XsX2O_gYXViJ1xTujqtdsD6wP.2 2024-09-22T08:56:16.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.388+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.578__multipart_testobj.2~YEkId0XsX2O_gYXViJ1xTujqtdsD6wP.3 2024-09-22T08:56:16.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.388+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.578__multipart_testobj.2~YEkId0XsX2O_gYXViJ1xTujqtdsD6wP.4 2024-09-22T08:56:16.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.391+0000 7f06bad28800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:56:16.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.393+0000 7f06bad28800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-22T08:56:16.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.395+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:56:16.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.395+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:56:16.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.395+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-22T08:56:16.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.396+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.493834791088699885', time=2024-09-22T10:44:16.855951+0000, chain.objs.size()=3 2024-09-22T08:56:16.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.396+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.158__shadow_.fToFV_CwNNDqnRvkhavXAR5sugVEvjs_0 2024-09-22T08:56:16.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.396+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.158__shadow_.fToFV_CwNNDqnRvkhavXAR5sugVEvjs_1 2024-09-22T08:56:16.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.396+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.158__shadow_.fToFV_CwNNDqnRvkhavXAR5sugVEvjs_2 2024-09-22T08:56:16.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.396+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.15665384799093932224', time=2024-09-22T10:48:20.300305+0000, chain.objs.size()=12 2024-09-22T08:56:16.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.396+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__multipart_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.1 2024-09-22T08:56:16.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.396+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__shadow_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.1_1 2024-09-22T08:56:16.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.396+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__multipart_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.2 2024-09-22T08:56:16.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.396+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__shadow_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.2_1 2024-09-22T08:56:16.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.396+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__multipart_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.3 2024-09-22T08:56:16.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.396+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__shadow_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.3_1 2024-09-22T08:56:16.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.396+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__multipart_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.4 2024-09-22T08:56:16.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.396+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__shadow_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.4_1 2024-09-22T08:56:16.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.396+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__multipart_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.5 2024-09-22T08:56:16.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.399+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__shadow_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.5_1 2024-09-22T08:56:16.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.399+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__multipart_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.6 2024-09-22T08:56:16.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.399+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__shadow_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.6_1 2024-09-22T08:56:16.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.399+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.15795699906925963452', time=2024-09-22T10:48:21.644637+0000, chain.objs.size()=1 2024-09-22T08:56:16.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.399+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.511__multipart_mymultipart.2~X43D-rzKvIRqAh9-NWecjuwX1Qdn9d9.1 2024-09-22T08:56:16.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.400+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='2~z-DZvvTdYj_znJ9nmIk9CLRXKdsOilp', time=2024-09-22T10:48:39.050963+0000, chain.objs.size()=1 2024-09-22T08:56:16.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.400+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.522__multipart_mymultipart.2~z-DZvvTdYj_znJ9nmIk9CLRXKdsOilp.1 2024-09-22T08:56:16.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.400+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='2~z-DZvvTdYj_znJ9nmIk9CLRXKdsOilp', time=2024-09-22T10:48:39.052437+0000, chain.objs.size()=1 2024-09-22T08:56:16.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.400+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.522__multipart_mymultipart.2~z-DZvvTdYj_znJ9nmIk9CLRXKdsOilp.2 2024-09-22T08:56:16.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.400+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='2~z-DZvvTdYj_znJ9nmIk9CLRXKdsOilp', time=2024-09-22T10:48:39.053732+0000, chain.objs.size()=1 2024-09-22T08:56:16.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.400+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.522__multipart_mymultipart.2~z-DZvvTdYj_znJ9nmIk9CLRXKdsOilp.3 2024-09-22T08:56:16.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.400+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='2~z-DZvvTdYj_znJ9nmIk9CLRXKdsOilp', time=2024-09-22T10:48:39.055239+0000, chain.objs.size()=1 2024-09-22T08:56:16.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.400+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.522__multipart_mymultipart.2~z-DZvvTdYj_znJ9nmIk9CLRXKdsOilp.4 2024-09-22T08:56:16.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.400+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='2~z-DZvvTdYj_znJ9nmIk9CLRXKdsOilp', time=2024-09-22T10:48:39.056691+0000, chain.objs.size()=1 2024-09-22T08:56:16.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.400+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.522__multipart_mymultipart.2~z-DZvvTdYj_znJ9nmIk9CLRXKdsOilp.5 2024-09-22T08:56:16.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.400+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='2~z-DZvvTdYj_znJ9nmIk9CLRXKdsOilp', time=2024-09-22T10:48:39.058360+0000, chain.objs.size()=1 2024-09-22T08:56:16.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.400+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.522__multipart_mymultipart.2~z-DZvvTdYj_znJ9nmIk9CLRXKdsOilp.6 2024-09-22T08:56:16.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.400+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.7764405884856966727', time=2024-09-22T10:48:39.067056+0000, chain.objs.size()=6 2024-09-22T08:56:16.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.400+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.522__multipart_mymultipart.2~GBPC3M70Fure5MuWxj2WGeGI7aEdgC3.1 2024-09-22T08:56:16.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.401+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.522__multipart_mymultipart.SKhE7p_wA0vEOQMjIwCUHQ3WFgBbJzCo.2 2024-09-22T08:56:16.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.401+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.522__multipart_mymultipart.zyvJYjpGOqh6w-LOTAyVVETC9y_jdjCM.3 2024-09-22T08:56:16.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.401+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.522__multipart_mymultipart.2~GBPC3M70Fure5MuWxj2WGeGI7aEdgC3.4 2024-09-22T08:56:16.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.401+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.522__multipart_mymultipart.2~GBPC3M70Fure5MuWxj2WGeGI7aEdgC3.5 2024-09-22T08:56:16.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.401+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.522__multipart_mymultipart.2~GBPC3M70Fure5MuWxj2WGeGI7aEdgC3.6 2024-09-22T08:56:16.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.402+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.5653175885443656505', time=2024-09-22T10:48:42.074646+0000, chain.objs.size()=3 2024-09-22T08:56:16.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.402+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.523__multipart_mymultipart.2~E6nid_BSF6XCp-UEIH5fSWZqHXyWzi6.1 2024-09-22T08:56:16.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.402+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.523__multipart_mymultipart.2~E6nid_BSF6XCp-UEIH5fSWZqHXyWzi6.2 2024-09-22T08:56:16.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.403+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.523__multipart_mymultipart.2~E6nid_BSF6XCp-UEIH5fSWZqHXyWzi6.3 2024-09-22T08:56:16.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.404+0000 7f06bad28800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:56:16.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.407+0000 7f06bad28800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-22T08:56:16.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.408+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:56:16.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.409+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:56:16.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.409+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:56:16.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.409+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.3184028561153274732', time=2024-09-22T10:48:20.525853+0000, chain.objs.size()=12 2024-09-22T08:56:16.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.409+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__multipart_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.1 2024-09-22T08:56:16.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.409+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__shadow_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.1_1 2024-09-22T08:56:16.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.409+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__multipart_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.2 2024-09-22T08:56:16.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.409+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__shadow_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.2_1 2024-09-22T08:56:16.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.409+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__multipart_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.3 2024-09-22T08:56:16.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.409+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__shadow_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.3_1 2024-09-22T08:56:16.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.409+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__multipart_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.4 2024-09-22T08:56:16.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.409+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__shadow_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.4_1 2024-09-22T08:56:16.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.409+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__multipart_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.5 2024-09-22T08:56:16.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.409+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__shadow_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.5_1 2024-09-22T08:56:16.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.409+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__multipart_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.6 2024-09-22T08:56:16.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.409+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__shadow_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.6_1 2024-09-22T08:56:16.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.412+0000 7f06bad28800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:56:16.416 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.414+0000 7f06bad28800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-22T08:56:16.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.416+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:56:16.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.416+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:56:16.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.417+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T08:56:16.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.417+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.8306796445028636619', time=2024-09-22T10:48:30.559348+0000, chain.objs.size()=3 2024-09-22T08:56:16.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.417+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.521__multipart_mymultipart.2~jjtudk9raUCEmtajA-5Y0Cd4ff7lq6V.1 2024-09-22T08:56:16.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.417+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.521__multipart_mymultipart.2~jjtudk9raUCEmtajA-5Y0Cd4ff7lq6V.2 2024-09-22T08:56:16.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.417+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.521__multipart_mymultipart.2~jjtudk9raUCEmtajA-5Y0Cd4ff7lq6V.3 2024-09-22T08:56:16.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.417+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.18376870065481108183', time=2024-09-22T10:48:43.312942+0000, chain.objs.size()=1 2024-09-22T08:56:16.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.417+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.525__multipart_mymultipart.2~roR7pCN6eW7oKrM-KBRRGsf--KubMD0.1 2024-09-22T08:56:16.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.418+0000 7f06bad28800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:56:16.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.420+0000 7f06bad28800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-22T08:56:16.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.422+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:56:16.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.422+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:56:16.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.422+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-22T08:56:16.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.422+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.16753680774231407387', time=2024-09-22T10:44:19.972083+0000, chain.objs.size()=5 2024-09-22T08:56:16.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.423+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.161__multipart_foo-LUKEWARM.2~qMEAaVW_kMPuQ3eieOH_LAXHkgxDkan.1 2024-09-22T08:56:16.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.423+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.161__shadow_foo-LUKEWARM.2~qMEAaVW_kMPuQ3eieOH_LAXHkgxDkan.1_1 2024-09-22T08:56:16.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.423+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.161__multipart_foo-LUKEWARM.2~qMEAaVW_kMPuQ3eieOH_LAXHkgxDkan.2 2024-09-22T08:56:16.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.423+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.161__shadow_foo-LUKEWARM.2~qMEAaVW_kMPuQ3eieOH_LAXHkgxDkan.2_1 2024-09-22T08:56:16.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.423+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.161__multipart_foo-LUKEWARM.2~qMEAaVW_kMPuQ3eieOH_LAXHkgxDkan.3 2024-09-22T08:56:16.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.423+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='2~j_7iO5Y8K-InaInpSTX1MvjG2bVJZe4', time=2024-09-22T10:48:31.220747+0000, chain.objs.size()=1 2024-09-22T08:56:16.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.423+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.522__multipart_mymultipart.2~j_7iO5Y8K-InaInpSTX1MvjG2bVJZe4.1 2024-09-22T08:56:16.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.423+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='2~LXPoKO0suQJQfxF9NvwDoGjYI25UQ0b', time=2024-09-22T10:48:48.806769+0000, chain.objs.size()=1 2024-09-22T08:56:16.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.423+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.531__multipart_mymultipart.2~LXPoKO0suQJQfxF9NvwDoGjYI25UQ0b.1 2024-09-22T08:56:16.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.425+0000 7f06bad28800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:56:16.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.427+0000 7f06bad28800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-22T08:56:16.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.428+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:56:16.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.429+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:56:16.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.429+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-22T08:56:16.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.429+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='_gdViqpkh4A-pYQudgffOCGken0EVK9K', time=2024-09-22T10:44:20.770565+0000, chain.objs.size()=3 2024-09-22T08:56:16.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.429+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.161__shadow_.pB0XmXJqOMqJN9KhDbodQc-v934m00c_0 2024-09-22T08:56:16.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.429+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.161__shadow_.pB0XmXJqOMqJN9KhDbodQc-v934m00c_1 2024-09-22T08:56:16.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.429+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.161__shadow_.pB0XmXJqOMqJN9KhDbodQc-v934m00c_2 2024-09-22T08:56:16.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.429+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='2~htc_gJGx58JS5XrRoP-jCTl_298CEro', time=2024-09-22T10:48:48.814236+0000, chain.objs.size()=2 2024-09-22T08:56:16.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.429+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.531__multipart_mymultipart.2~htc_gJGx58JS5XrRoP-jCTl_298CEro.1 2024-09-22T08:56:16.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.429+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.531__multipart_mymultipart.2~htc_gJGx58JS5XrRoP-jCTl_298CEro.2 2024-09-22T08:56:16.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.429+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.16772648709423718493', time=2024-09-22T10:50:08.729638+0000, chain.objs.size()=4 2024-09-22T08:56:16.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.429+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.578__multipart_testobj.2~S9p9YJeIGziGNkuJcLbTJr39xDmOYye.1 2024-09-22T08:56:16.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.429+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.578__multipart_testobj.2~S9p9YJeIGziGNkuJcLbTJr39xDmOYye.2 2024-09-22T08:56:16.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.429+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.578__multipart_testobj.2~S9p9YJeIGziGNkuJcLbTJr39xDmOYye.3 2024-09-22T08:56:16.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.429+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.578__multipart_testobj.2~S9p9YJeIGziGNkuJcLbTJr39xDmOYye.4 2024-09-22T08:56:16.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.429+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.18225888343155840654', time=2024-09-22T10:50:27.585743+0000, chain.objs.size()=12 2024-09-22T08:56:16.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.429+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.613__multipart_multipart_enc.2~ikiIkXh8CRHGBCTwDALZ48r1HlzBZiY.1 2024-09-22T08:56:16.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.429+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.613__shadow_multipart_enc.2~ikiIkXh8CRHGBCTwDALZ48r1HlzBZiY.1_1 2024-09-22T08:56:16.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.429+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.613__multipart_multipart_enc.2~ikiIkXh8CRHGBCTwDALZ48r1HlzBZiY.2 2024-09-22T08:56:16.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.432+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.613__shadow_multipart_enc.2~ikiIkXh8CRHGBCTwDALZ48r1HlzBZiY.2_1 2024-09-22T08:56:16.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.432+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.613__multipart_multipart_enc.2~ikiIkXh8CRHGBCTwDALZ48r1HlzBZiY.3 2024-09-22T08:56:16.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.432+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.613__shadow_multipart_enc.2~ikiIkXh8CRHGBCTwDALZ48r1HlzBZiY.3_1 2024-09-22T08:56:16.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.432+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.613__multipart_multipart_enc.2~ikiIkXh8CRHGBCTwDALZ48r1HlzBZiY.4 2024-09-22T08:56:16.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.432+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.613__shadow_multipart_enc.2~ikiIkXh8CRHGBCTwDALZ48r1HlzBZiY.4_1 2024-09-22T08:56:16.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.432+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.613__multipart_multipart_enc.2~ikiIkXh8CRHGBCTwDALZ48r1HlzBZiY.5 2024-09-22T08:56:16.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.432+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.613__shadow_multipart_enc.2~ikiIkXh8CRHGBCTwDALZ48r1HlzBZiY.5_1 2024-09-22T08:56:16.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.432+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.613__multipart_multipart_enc.2~ikiIkXh8CRHGBCTwDALZ48r1HlzBZiY.6 2024-09-22T08:56:16.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.432+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.613__shadow_multipart_enc.2~ikiIkXh8CRHGBCTwDALZ48r1HlzBZiY.6_1 2024-09-22T08:56:16.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.437+0000 7f06bad28800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:56:16.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.439+0000 7f06bad28800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-22T08:56:16.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.440+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:56:16.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.441+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:56:16.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.441+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-22T08:56:16.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.441+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='_TbpTUBxCmq-M3qtXbNh8-aGXGoR_H9z', time=2024-09-22T10:44:20.604151+0000, chain.objs.size()=2 2024-09-22T08:56:16.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.441+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.161__shadow_.iSq-y1AWjx1CF1h_9HRbFhc-R2dYdkV_1 2024-09-22T08:56:16.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.441+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.161__shadow_.iSq-y1AWjx1CF1h_9HRbFhc-R2dYdkV_2 2024-09-22T08:56:16.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.441+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.9501942383256925335', time=2024-09-22T10:44:22.118791+0000, chain.objs.size()=2 2024-09-22T08:56:16.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.441+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.164__multipart_foo.2~4RyPE2gXprBDptIbgN0Gr-ZnOTj3YG2.1 2024-09-22T08:56:16.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.441+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.164__multipart_foo.2~4RyPE2gXprBDptIbgN0Gr-ZnOTj3YG2.2 2024-09-22T08:56:16.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.441+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.12477368782721763178', time=2024-09-22T10:48:41.585386+0000, chain.objs.size()=1 2024-09-22T08:56:16.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.441+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.523__multipart_mymultipart.2~_G05ItlEsb7Nj0NjPGJQqFPavFO7nKA.1 2024-09-22T08:56:16.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.443+0000 7f06bad28800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:56:16.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.445+0000 7f06bad28800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-22T08:56:16.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.447+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:56:16.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.447+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:56:16.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.448+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-22T08:56:16.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.448+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.5401210653717948789', time=2024-09-22T10:48:35.066715+0000, chain.objs.size()=6 2024-09-22T08:56:16.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.448+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.522__multipart_mymultipart.2~BGQgvFkLwxOK3tUqQESCU0942k7_Z09.1 2024-09-22T08:56:16.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.448+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.522__multipart_mymultipart.8fCBRm0VLDq6ya51mEXYwyIpwNWcwY8a.2 2024-09-22T08:56:16.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.448+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.522__multipart_mymultipart.2~BGQgvFkLwxOK3tUqQESCU0942k7_Z09.3 2024-09-22T08:56:16.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.448+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.522__multipart_mymultipart.2~BGQgvFkLwxOK3tUqQESCU0942k7_Z09.4 2024-09-22T08:56:16.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.448+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.522__multipart_mymultipart.2~BGQgvFkLwxOK3tUqQESCU0942k7_Z09.5 2024-09-22T08:56:16.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.448+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.522__multipart_mymultipart.2~BGQgvFkLwxOK3tUqQESCU0942k7_Z09.6 2024-09-22T08:56:16.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.448+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.11741039810288294738', time=2024-09-22T10:52:54.336471+0000, chain.objs.size()=1 2024-09-22T08:56:16.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.448+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.656__shadow_.QOOMq4kaIS9vK4K6GIzGY3wRmtKYU7m_1 2024-09-22T08:56:16.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.448+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.1930140664335223319', time=2024-09-22T10:53:13.551719+0000, chain.objs.size()=1 2024-09-22T08:56:16.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.448+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.702__multipart_file1.2~JTy0i2618aREbpo-fBJnpj70Aloj_iH.1 2024-09-22T08:56:16.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.450+0000 7f06bad28800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:56:16.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.452+0000 7f06bad28800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-22T08:56:16.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.453+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:56:16.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.454+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:56:16.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.454+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:56:16.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.454+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.498803437117103057', time=2024-09-22T10:48:22.521611+0000, chain.objs.size()=1 2024-09-22T08:56:16.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.454+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.513__multipart_mymultipart.2~99a18XnHYvsD4wjPQNXYVfueQSGmkRj.1 2024-09-22T08:56:16.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.456+0000 7f06bad28800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:56:16.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.458+0000 7f06bad28800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-22T08:56:16.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.459+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:56:16.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.459+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:56:16.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.460+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-22T08:56:16.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.460+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.5317231353555467994', time=2024-09-22T10:44:17.905693+0000, chain.objs.size()=5 2024-09-22T08:56:16.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.460+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.159__multipart_mymultipart-LUKEWARM.2~ifylhgHQZDaigm3C4jGJpP3LWEAvQuN.1 2024-09-22T08:56:16.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.460+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.159__shadow_mymultipart-LUKEWARM.2~ifylhgHQZDaigm3C4jGJpP3LWEAvQuN.1_1 2024-09-22T08:56:16.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.460+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.159__multipart_mymultipart-LUKEWARM.2~ifylhgHQZDaigm3C4jGJpP3LWEAvQuN.2 2024-09-22T08:56:16.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.460+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.159__shadow_mymultipart-LUKEWARM.2~ifylhgHQZDaigm3C4jGJpP3LWEAvQuN.2_1 2024-09-22T08:56:16.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.460+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.159__multipart_mymultipart-LUKEWARM.2~ifylhgHQZDaigm3C4jGJpP3LWEAvQuN.3 2024-09-22T08:56:16.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.460+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.1676538118134034883', time=2024-09-22T10:48:24.619354+0000, chain.objs.size()=1 2024-09-22T08:56:16.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.460+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.518__multipart_mymultipart.2~R9HkSlRcHkAKev0SHPLV4DeaD6LTNBb.1 2024-09-22T08:56:16.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.460+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.14637877829370681032', time=2024-09-22T10:48:25.323565+0000, chain.objs.size()=1 2024-09-22T08:56:16.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.460+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.518__multipart_mymultipart.2~siQBK4StBW9FlWn7xdAjFwUtrspoIhP.1 2024-09-22T08:56:16.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.460+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.7510563114960087999', time=2024-09-22T10:48:28.085204+0000, chain.objs.size()=6 2024-09-22T08:56:16.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.460+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.519__multipart_mymultipart.2~sw14TNMLn6rTXuO7ns-42eWczmFmuKh.1 2024-09-22T08:56:16.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.460+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.519__multipart_mymultipart.2~sw14TNMLn6rTXuO7ns-42eWczmFmuKh.2 2024-09-22T08:56:16.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.460+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.519__multipart_mymultipart.2~sw14TNMLn6rTXuO7ns-42eWczmFmuKh.3 2024-09-22T08:56:16.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.460+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.519__multipart_mymultipart.2~sw14TNMLn6rTXuO7ns-42eWczmFmuKh.4 2024-09-22T08:56:16.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.460+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.519__multipart_mymultipart.2~sw14TNMLn6rTXuO7ns-42eWczmFmuKh.5 2024-09-22T08:56:16.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.463+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.519__multipart_mymultipart.2~sw14TNMLn6rTXuO7ns-42eWczmFmuKh.6 2024-09-22T08:56:16.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.464+0000 7f06bad28800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:56:16.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.466+0000 7f06bad28800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-22T08:56:16.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.468+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:56:16.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.468+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:56:16.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.469+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-22T08:56:16.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.469+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='_IKUD7d220sBOVNbXgrAVbvOdqJVr4Dt', time=2024-09-22T10:44:18.997119+0000, chain.objs.size()=3 2024-09-22T08:56:16.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.469+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.160__shadow_.HgbQ51OSp0-ovHxoNOktV2cOc-2d45f_0 2024-09-22T08:56:16.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.469+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.160__shadow_.HgbQ51OSp0-ovHxoNOktV2cOc-2d45f_1 2024-09-22T08:56:16.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.469+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.160__shadow_.HgbQ51OSp0-ovHxoNOktV2cOc-2d45f_2 2024-09-22T08:56:16.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.469+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.13357440234125511920', time=2024-09-22T10:48:37.032325+0000, chain.objs.size()=6 2024-09-22T08:56:16.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.469+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.522__multipart_mymultipart.2~yNGM1kYuEgi90w00ZxELbDJ6yVAIEWx.1 2024-09-22T08:56:16.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.469+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.522__multipart_mymultipart.2~yNGM1kYuEgi90w00ZxELbDJ6yVAIEWx.2 2024-09-22T08:56:16.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.469+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.522__multipart_mymultipart.xgj5nJdZ2eTjdsn5NYEbB9o6n8hIrv-s.3 2024-09-22T08:56:16.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.469+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.522__multipart_mymultipart.2~yNGM1kYuEgi90w00ZxELbDJ6yVAIEWx.4 2024-09-22T08:56:16.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.469+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.522__multipart_mymultipart.2~yNGM1kYuEgi90w00ZxELbDJ6yVAIEWx.5 2024-09-22T08:56:16.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.469+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.522__multipart_mymultipart.2~yNGM1kYuEgi90w00ZxELbDJ6yVAIEWx.6 2024-09-22T08:56:16.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.469+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.718354024270688134', time=2024-09-22T10:48:40.836187+0000, chain.objs.size()=6 2024-09-22T08:56:16.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.469+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.522__multipart_mymultipart.OOHIj-iGtih_gnOiqzWaJ2U3_wtJAl_1.1 2024-09-22T08:56:16.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.469+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.522__multipart_mymultipart.RRiYQvjMDn8_P1YHBl_GpQ-_-dbRhXwL.2 2024-09-22T08:56:16.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.469+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.522__multipart_mymultipart.lXAza8A9nZMRCkpkuq2RjN6bvjd7Rluo.3 2024-09-22T08:56:16.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.472+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.522__multipart_mymultipart.LBE7eSNa9O898Budo4d8MIPKoo6Img9R.4 2024-09-22T08:56:16.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.472+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.522__multipart_mymultipart.Z3Nq8aIu4LT2OyePFKf4KWRh89tQb1UG.5 2024-09-22T08:56:16.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.472+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.522__multipart_mymultipart.aNQv3e9ma-ArPGsflUG-G-6ba1Vn30DE.6 2024-09-22T08:56:16.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.472+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.17362511581749743608', time=2024-09-22T10:48:45.220731+0000, chain.objs.size()=2 2024-09-22T08:56:16.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.472+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.525__multipart_mymultipart.2~BycboBVWJJvRzPJ0zeA1OrG8VM8lUBu.1 2024-09-22T08:56:16.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.472+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.525__multipart_mymultipart.2~BycboBVWJJvRzPJ0zeA1OrG8VM8lUBu.2 2024-09-22T08:56:16.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.472+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.2866061638180944600', time=2024-09-22T10:52:57.490668+0000, chain.objs.size()=6 2024-09-22T08:56:16.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.472+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.662__multipart_foo.2~EXR2pyobNOLU6U6_i09EIzJzyGTs1ju.1 2024-09-22T08:56:16.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.472+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.662__multipart_foo.2~EXR2pyobNOLU6U6_i09EIzJzyGTs1ju.2 2024-09-22T08:56:16.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.472+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.662__multipart_foo.2~EXR2pyobNOLU6U6_i09EIzJzyGTs1ju.3 2024-09-22T08:56:16.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.472+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.662__multipart_foo.2~EXR2pyobNOLU6U6_i09EIzJzyGTs1ju.4 2024-09-22T08:56:16.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.472+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.662__multipart_foo.2~EXR2pyobNOLU6U6_i09EIzJzyGTs1ju.5 2024-09-22T08:56:16.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.472+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.662__multipart_foo.2~EXR2pyobNOLU6U6_i09EIzJzyGTs1ju.6 2024-09-22T08:56:16.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.475+0000 7f06bad28800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:56:16.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.477+0000 7f06bad28800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-22T08:56:16.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.478+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:56:16.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.479+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:56:16.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.479+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T08:56:16.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.479+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.3785438990095880923', time=2024-09-22T10:48:30.162778+0000, chain.objs.size()=6 2024-09-22T08:56:16.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.479+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.521__multipart_mymultipart.2~kdy-_U-jApkr8MGwiMSTOrkSgEZOugn.1 2024-09-22T08:56:16.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.479+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.521__shadow_mymultipart.2~kdy-_U-jApkr8MGwiMSTOrkSgEZOugn.1_1 2024-09-22T08:56:16.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.479+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.521__multipart_mymultipart.2~kdy-_U-jApkr8MGwiMSTOrkSgEZOugn.2 2024-09-22T08:56:16.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.479+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.521__shadow_mymultipart.2~kdy-_U-jApkr8MGwiMSTOrkSgEZOugn.2_1 2024-09-22T08:56:16.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.479+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.521__multipart_mymultipart.2~kdy-_U-jApkr8MGwiMSTOrkSgEZOugn.3 2024-09-22T08:56:16.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.479+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.521__shadow_mymultipart.2~kdy-_U-jApkr8MGwiMSTOrkSgEZOugn.3_1 2024-09-22T08:56:16.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.479+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.9747833906023557462', time=2024-09-22T10:48:41.732581+0000, chain.objs.size()=2 2024-09-22T08:56:16.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.479+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.523__multipart_mymultipart.2~XnrU1wjHhNcpY-hf4grZuCqXfYr4P5J.1 2024-09-22T08:56:16.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.479+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.523__multipart_mymultipart.2~XnrU1wjHhNcpY-hf4grZuCqXfYr4P5J.2 2024-09-22T08:56:16.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.482+0000 7f06bad28800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:56:16.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.484+0000 7f06bad28800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-22T08:56:16.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.485+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:56:16.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.486+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:56:16.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.487+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-22T08:56:16.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.487+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='2~B2r0mjqBm78wKo6QP24ON5t2AjJ3CJ8', time=2024-09-22T10:48:48.821589+0000, chain.objs.size()=1 2024-09-22T08:56:16.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.487+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.531__multipart_mymultipart2.2~B2r0mjqBm78wKo6QP24ON5t2AjJ3CJ8.1 2024-09-22T08:56:16.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.487+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.12616799460889730765', time=2024-09-22T10:49:04.569721+0000, chain.objs.size()=4 2024-09-22T08:56:16.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.487+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.535__multipart_mymultipart.2~z4HUGUM2CWJIE0OwU_tRMs6MKq15p0j.1 2024-09-22T08:56:16.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.487+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.535__multipart_mymultipart.2~z4HUGUM2CWJIE0OwU_tRMs6MKq15p0j.2 2024-09-22T08:56:16.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.487+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.535__multipart_mymultipart.3aQAo0FOSjhgMHKmumjXDDrcucdqu71A.3 2024-09-22T08:56:16.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.487+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.535__multipart_mymultipart.2~z4HUGUM2CWJIE0OwU_tRMs6MKq15p0j.4 2024-09-22T08:56:16.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.487+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='2~LPAo7K3_5N5w_Y7Um24ZHBLLk8y0Om4', time=2024-09-22T10:49:30.184339+0000, chain.objs.size()=1 2024-09-22T08:56:16.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.487+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.561__multipart_mymultipart.2~LPAo7K3_5N5w_Y7Um24ZHBLLk8y0Om4.1 2024-09-22T08:56:16.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.488+0000 7f06bad28800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:56:16.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.491+0000 7f06bad28800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-22T08:56:16.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.492+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:56:16.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.492+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:56:16.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.493+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:56:16.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.493+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='2~BGQgvFkLwxOK3tUqQESCU0942k7_Z09', time=2024-09-22T10:48:33.202975+0000, chain.objs.size()=1 2024-09-22T08:56:16.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.493+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.522__multipart_mymultipart.2~BGQgvFkLwxOK3tUqQESCU0942k7_Z09.2 2024-09-22T08:56:16.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.494+0000 7f06bad28800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:56:16.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.496+0000 7f06bad28800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-22T08:56:16.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.498+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:56:16.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.499+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:56:16.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.499+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:56:16.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.499+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='_R0frcox5KT94j7UdEqCnCW_7A8np3PB', time=2024-09-22T10:44:22.196524+0000, chain.objs.size()=1 2024-09-22T08:56:16.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.499+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.165__shadow_.WsZqeh5TuwuGXaH7MdWbBgdxeJoL8Sa_0 2024-09-22T08:56:16.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.500+0000 7f06bad28800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:56:16.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.502+0000 7f06bad28800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-22T08:56:16.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.504+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:56:16.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.504+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:56:16.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.504+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-22T08:56:16.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.504+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.4186447535075361677', time=2024-09-22T10:44:16.850381+0000, chain.objs.size()=3 2024-09-22T08:56:16.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.504+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.158__shadow_.QemfejnFqiNnEViiKePPJpbRXqPV8A9_0 2024-09-22T08:56:16.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.504+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.158__shadow_.QemfejnFqiNnEViiKePPJpbRXqPV8A9_1 2024-09-22T08:56:16.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.504+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.158__shadow_.QemfejnFqiNnEViiKePPJpbRXqPV8A9_2 2024-09-22T08:56:16.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.505+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='2~8N9bTUyZd3C2FMICnz35zq-5POJYJAX', time=2024-09-22T10:44:46.640490+0000, chain.objs.size()=1 2024-09-22T08:56:16.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.505+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.202__multipart_mymultipart.2~8N9bTUyZd3C2FMICnz35zq-5POJYJAX.1 2024-09-22T08:56:16.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.505+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.14449543126266281334', time=2024-09-22T10:49:06.628395+0000, chain.objs.size()=1 2024-09-22T08:56:16.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.505+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.536__multipart_mymultipart.2~8YbCjniNOHA-Z4-5-KlCBFbu3gT3GNy.1 2024-09-22T08:56:16.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.505+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.13826169359779303468', time=2024-09-22T10:53:47.273565+0000, chain.objs.size()=20 2024-09-22T08:56:16.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.505+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.735__multipart_foo.2~hBlSe8t7hgmTAC7rPv5Owh9Oa1ICM_H.1 2024-09-22T08:56:16.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.505+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.735__shadow_foo.2~hBlSe8t7hgmTAC7rPv5Owh9Oa1ICM_H.1_1 2024-09-22T08:56:16.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.505+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.735__multipart_foo.2~hBlSe8t7hgmTAC7rPv5Owh9Oa1ICM_H.2 2024-09-22T08:56:16.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.505+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.735__shadow_foo.2~hBlSe8t7hgmTAC7rPv5Owh9Oa1ICM_H.2_1 2024-09-22T08:56:16.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.505+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.735__multipart_foo.2~hBlSe8t7hgmTAC7rPv5Owh9Oa1ICM_H.3 2024-09-22T08:56:16.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.505+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.735__shadow_foo.2~hBlSe8t7hgmTAC7rPv5Owh9Oa1ICM_H.3_1 2024-09-22T08:56:16.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.505+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.735__multipart_foo.2~hBlSe8t7hgmTAC7rPv5Owh9Oa1ICM_H.4 2024-09-22T08:56:16.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.508+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.735__shadow_foo.2~hBlSe8t7hgmTAC7rPv5Owh9Oa1ICM_H.4_1 2024-09-22T08:56:16.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.509+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.735__multipart_foo.2~hBlSe8t7hgmTAC7rPv5Owh9Oa1ICM_H.5 2024-09-22T08:56:16.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.509+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.735__shadow_foo.2~hBlSe8t7hgmTAC7rPv5Owh9Oa1ICM_H.5_1 2024-09-22T08:56:16.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.509+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.735__multipart_foo.2~hBlSe8t7hgmTAC7rPv5Owh9Oa1ICM_H.6 2024-09-22T08:56:16.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.509+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.735__shadow_foo.2~hBlSe8t7hgmTAC7rPv5Owh9Oa1ICM_H.6_1 2024-09-22T08:56:16.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.509+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.735__multipart_foo.2~hBlSe8t7hgmTAC7rPv5Owh9Oa1ICM_H.7 2024-09-22T08:56:16.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.509+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.735__shadow_foo.2~hBlSe8t7hgmTAC7rPv5Owh9Oa1ICM_H.7_1 2024-09-22T08:56:16.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.509+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.735__multipart_foo.2~hBlSe8t7hgmTAC7rPv5Owh9Oa1ICM_H.8 2024-09-22T08:56:16.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.509+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.735__shadow_foo.2~hBlSe8t7hgmTAC7rPv5Owh9Oa1ICM_H.8_1 2024-09-22T08:56:16.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.509+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.735__multipart_foo.2~hBlSe8t7hgmTAC7rPv5Owh9Oa1ICM_H.9 2024-09-22T08:56:16.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.509+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.735__shadow_foo.2~hBlSe8t7hgmTAC7rPv5Owh9Oa1ICM_H.9_1 2024-09-22T08:56:16.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.511+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.735__multipart_foo.2~hBlSe8t7hgmTAC7rPv5Owh9Oa1ICM_H.10 2024-09-22T08:56:16.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.511+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.735__shadow_foo.2~hBlSe8t7hgmTAC7rPv5Owh9Oa1ICM_H.10_1 2024-09-22T08:56:16.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.514+0000 7f06bad28800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:56:16.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.517+0000 7f06bad28800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-22T08:56:16.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.518+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:56:16.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.518+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:56:16.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.519+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-22T08:56:16.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.519+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.1868368245448488022', time=2024-09-22T10:44:18.122660+0000, chain.objs.size()=2 2024-09-22T08:56:16.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.519+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.160__shadow_.Q-FH59Fr3AdvylsVtHl83vhhc0nYZlF_1 2024-09-22T08:56:16.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.519+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.160__shadow_.Q-FH59Fr3AdvylsVtHl83vhhc0nYZlF_2 2024-09-22T08:56:16.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.519+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='_x2SeBPGeE6VDurfyzZG_eQAw3ZzpLKm', time=2024-09-22T10:44:20.060248+0000, chain.objs.size()=2 2024-09-22T08:56:16.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.519+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.161__shadow_.JeZLbczmeFOm6NmRUWYZeDcRUvYR6Qn_1 2024-09-22T08:56:16.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.519+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.161__shadow_.JeZLbczmeFOm6NmRUWYZeDcRUvYR6Qn_2 2024-09-22T08:56:16.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.519+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.2345785539455524898', time=2024-09-22T10:53:50.390565+0000, chain.objs.size()=1 2024-09-22T08:56:16.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.519+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.742__multipart_mymultipart3.2~MJhRiJl9-NeBIK5_dPVJ5XNtKdUppXl.1 2024-09-22T08:56:16.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.522+0000 7f06bad28800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:56:16.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.525+0000 7f06bad28800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-22T08:56:16.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.527+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:56:16.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.527+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:56:16.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.527+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-22T08:56:16.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.527+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.7693380174282760534', time=2024-09-22T10:44:16.861966+0000, chain.objs.size()=2 2024-09-22T08:56:16.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.527+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.158__shadow_.JKUtpGKrn0yN3tnFzQ-NFEJ0jSihbP9_1 2024-09-22T08:56:16.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.527+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.158__shadow_.JKUtpGKrn0yN3tnFzQ-NFEJ0jSihbP9_2 2024-09-22T08:56:16.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.527+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.7381135880452914580', time=2024-09-22T10:48:29.731822+0000, chain.objs.size()=3 2024-09-22T08:56:16.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.527+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.521__multipart_mymultipart.2~qjGuXLQ-oztMyfRDQryCRJEmxdNDE1c.1 2024-09-22T08:56:16.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.527+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.521__multipart_mymultipart.2~qjGuXLQ-oztMyfRDQryCRJEmxdNDE1c.2 2024-09-22T08:56:16.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.527+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.521__multipart_mymultipart.2~qjGuXLQ-oztMyfRDQryCRJEmxdNDE1c.3 2024-09-22T08:56:16.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.527+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='2~GBPC3M70Fure5MuWxj2WGeGI7aEdgC3', time=2024-09-22T10:48:37.023364+0000, chain.objs.size()=1 2024-09-22T08:56:16.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.527+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.522__multipart_mymultipart.2~GBPC3M70Fure5MuWxj2WGeGI7aEdgC3.2 2024-09-22T08:56:16.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.527+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='2~GBPC3M70Fure5MuWxj2WGeGI7aEdgC3', time=2024-09-22T10:48:37.024930+0000, chain.objs.size()=1 2024-09-22T08:56:16.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.527+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.522__multipart_mymultipart.2~GBPC3M70Fure5MuWxj2WGeGI7aEdgC3.3 2024-09-22T08:56:16.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.527+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.8706280561041449051', time=2024-09-22T10:52:38.303741+0000, chain.objs.size()=12 2024-09-22T08:56:16.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.527+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.623__multipart_multipart_enc.2~_r-GuA1KI6Q9QNG1QWCMYi0z8V_cEtn.1 2024-09-22T08:56:16.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.527+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.623__shadow_multipart_enc.2~_r-GuA1KI6Q9QNG1QWCMYi0z8V_cEtn.1_1 2024-09-22T08:56:16.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.527+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.623__multipart_multipart_enc.2~_r-GuA1KI6Q9QNG1QWCMYi0z8V_cEtn.2 2024-09-22T08:56:16.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.527+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.623__shadow_multipart_enc.2~_r-GuA1KI6Q9QNG1QWCMYi0z8V_cEtn.2_1 2024-09-22T08:56:16.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.528+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.623__multipart_multipart_enc.2~_r-GuA1KI6Q9QNG1QWCMYi0z8V_cEtn.3 2024-09-22T08:56:16.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.530+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.623__shadow_multipart_enc.2~_r-GuA1KI6Q9QNG1QWCMYi0z8V_cEtn.3_1 2024-09-22T08:56:16.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.530+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.623__multipart_multipart_enc.2~_r-GuA1KI6Q9QNG1QWCMYi0z8V_cEtn.4 2024-09-22T08:56:16.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.530+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.623__shadow_multipart_enc.2~_r-GuA1KI6Q9QNG1QWCMYi0z8V_cEtn.4_1 2024-09-22T08:56:16.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.530+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.623__multipart_multipart_enc.2~_r-GuA1KI6Q9QNG1QWCMYi0z8V_cEtn.5 2024-09-22T08:56:16.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.531+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.623__shadow_multipart_enc.2~_r-GuA1KI6Q9QNG1QWCMYi0z8V_cEtn.5_1 2024-09-22T08:56:16.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.531+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.623__multipart_multipart_enc.2~_r-GuA1KI6Q9QNG1QWCMYi0z8V_cEtn.6 2024-09-22T08:56:16.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.531+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.623__shadow_multipart_enc.2~_r-GuA1KI6Q9QNG1QWCMYi0z8V_cEtn.6_1 2024-09-22T08:56:16.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.534+0000 7f06bad28800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:56:16.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.536+0000 7f06bad28800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-22T08:56:16.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.538+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:56:16.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.538+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:56:16.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.538+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-22T08:56:16.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.538+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='_iiZwZjuQ4PjdRuQSkaQdP8russf_Svr', time=2024-09-22T10:44:18.210906+0000, chain.objs.size()=3 2024-09-22T08:56:16.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.538+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.160__shadow_.sLrL2J1dz_ZA24xkbiUMRrPodH6iobF_0 2024-09-22T08:56:16.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.538+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.160__shadow_.sLrL2J1dz_ZA24xkbiUMRrPodH6iobF_1 2024-09-22T08:56:16.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.538+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.160__shadow_.sLrL2J1dz_ZA24xkbiUMRrPodH6iobF_2 2024-09-22T08:56:16.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.538+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='_QyUMUuqtXXcy3tV1vUY23k5YKeVBPc4', time=2024-09-22T10:44:19.516226+0000, chain.objs.size()=1 2024-09-22T08:56:16.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.538+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c62f9d7b-f6b6-404a-90de-de5607499115.4584.161__shadow_.W3oGHA6vomP3gjOE9GvT5cFvv4KR7Y6_0 2024-09-22T08:56:16.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.538+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.6374149076429507354', time=2024-09-22T10:48:20.414365+0000, chain.objs.size()=12 2024-09-22T08:56:16.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.538+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__multipart_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.1 2024-09-22T08:56:16.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.538+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__shadow_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.1_1 2024-09-22T08:56:16.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.538+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__multipart_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.2 2024-09-22T08:56:16.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.538+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__shadow_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.2_1 2024-09-22T08:56:16.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.538+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__multipart_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.3 2024-09-22T08:56:16.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.538+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__shadow_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.3_1 2024-09-22T08:56:16.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.538+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__multipart_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.4 2024-09-22T08:56:16.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.538+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__shadow_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.4_1 2024-09-22T08:56:16.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.541+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__multipart_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.5 2024-09-22T08:56:16.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.541+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__shadow_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.5_1 2024-09-22T08:56:16.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.541+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__multipart_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.6 2024-09-22T08:56:16.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.541+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__shadow_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.6_1 2024-09-22T08:56:16.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.541+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.6235447116032808034', time=2024-09-22T10:49:30.430354+0000, chain.objs.size()=1 2024-09-22T08:56:16.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.541+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.561__multipart_mymultipart.8Kb7bhduRu1-jlk-XKOm-u5NZBkWqiJ6.1 2024-09-22T08:56:16.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.541+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.2258113614411375772', time=2024-09-22T10:50:30.877002+0000, chain.objs.size()=12 2024-09-22T08:56:16.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.541+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.614__multipart_multipart_enc.2~GG34_TEtFZXaHpKb2h8YDLDFjnotcsD.1 2024-09-22T08:56:16.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.541+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.614__shadow_multipart_enc.2~GG34_TEtFZXaHpKb2h8YDLDFjnotcsD.1_1 2024-09-22T08:56:16.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.541+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.614__multipart_multipart_enc.2~GG34_TEtFZXaHpKb2h8YDLDFjnotcsD.2 2024-09-22T08:56:16.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.541+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.614__shadow_multipart_enc.2~GG34_TEtFZXaHpKb2h8YDLDFjnotcsD.2_1 2024-09-22T08:56:16.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.541+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.614__multipart_multipart_enc.2~GG34_TEtFZXaHpKb2h8YDLDFjnotcsD.3 2024-09-22T08:56:16.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.541+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.614__shadow_multipart_enc.2~GG34_TEtFZXaHpKb2h8YDLDFjnotcsD.3_1 2024-09-22T08:56:16.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.544+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.614__multipart_multipart_enc.2~GG34_TEtFZXaHpKb2h8YDLDFjnotcsD.4 2024-09-22T08:56:16.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.544+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.614__shadow_multipart_enc.2~GG34_TEtFZXaHpKb2h8YDLDFjnotcsD.4_1 2024-09-22T08:56:16.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.544+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.614__multipart_multipart_enc.2~GG34_TEtFZXaHpKb2h8YDLDFjnotcsD.5 2024-09-22T08:56:16.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.544+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.614__shadow_multipart_enc.2~GG34_TEtFZXaHpKb2h8YDLDFjnotcsD.5_1 2024-09-22T08:56:16.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.544+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.614__multipart_multipart_enc.2~GG34_TEtFZXaHpKb2h8YDLDFjnotcsD.6 2024-09-22T08:56:16.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.544+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.614__shadow_multipart_enc.2~GG34_TEtFZXaHpKb2h8YDLDFjnotcsD.6_1 2024-09-22T08:56:16.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.545+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.1257315221641256577', time=2024-09-22T10:54:38.861370+0000, chain.objs.size()=6 2024-09-22T08:56:16.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.545+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.779__shadow_.h4f8FopuJk6x0IrzYy5OlU6n6Jvwtkv_1 2024-09-22T08:56:16.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.547+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.779__shadow_.h4f8FopuJk6x0IrzYy5OlU6n6Jvwtkv_2 2024-09-22T08:56:16.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.547+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.779__shadow_.h4f8FopuJk6x0IrzYy5OlU6n6Jvwtkv_3 2024-09-22T08:56:16.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.547+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.779__shadow_.h4f8FopuJk6x0IrzYy5OlU6n6Jvwtkv_4 2024-09-22T08:56:16.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.547+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.779__shadow_.h4f8FopuJk6x0IrzYy5OlU6n6Jvwtkv_5 2024-09-22T08:56:16.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.547+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.779__shadow_.h4f8FopuJk6x0IrzYy5OlU6n6Jvwtkv_6 2024-09-22T08:56:16.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.550+0000 7f06bad28800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:56:16.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.552+0000 7f06bad28800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-22T08:56:16.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.553+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:56:16.557 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.554+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:56:16.557 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.554+0000 7f06bad28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-22T08:56:16.557 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.554+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.731663497634050702', time=2024-09-22T10:44:20.510072+0000, chain.objs.size()=5 2024-09-22T08:56:16.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.554+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.161__multipart_foo-FROZEN.2~aATBkevW45II1cHResWXCjPhPp2JjAT.1 2024-09-22T08:56:16.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.554+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.161__shadow_foo-FROZEN.2~aATBkevW45II1cHResWXCjPhPp2JjAT.1_1 2024-09-22T08:56:16.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.554+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.161__multipart_foo-FROZEN.2~aATBkevW45II1cHResWXCjPhPp2JjAT.2 2024-09-22T08:56:16.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.554+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.161__shadow_foo-FROZEN.2~aATBkevW45II1cHResWXCjPhPp2JjAT.2_1 2024-09-22T08:56:16.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.554+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c62f9d7b-f6b6-404a-90de-de5607499115.4584.161__multipart_foo-FROZEN.2~aATBkevW45II1cHResWXCjPhPp2JjAT.3 2024-09-22T08:56:16.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.554+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='2~b8azIvyufwxGlYFeOStzZyyQjil2lJq', time=2024-09-22T10:44:46.133502+0000, chain.objs.size()=1 2024-09-22T08:56:16.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.554+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.201__multipart_mymultipart.2~b8azIvyufwxGlYFeOStzZyyQjil2lJq.1 2024-09-22T08:56:16.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.554+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.6728805746141031523', time=2024-09-22T10:48:20.527037+0000, chain.objs.size()=12 2024-09-22T08:56:16.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.554+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__multipart_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.1 2024-09-22T08:56:16.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.554+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__shadow_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.1_1 2024-09-22T08:56:16.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.554+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__multipart_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.2 2024-09-22T08:56:16.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.554+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__shadow_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.2_1 2024-09-22T08:56:16.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.554+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__multipart_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.3 2024-09-22T08:56:16.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.554+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__shadow_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.3_1 2024-09-22T08:56:16.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.556+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__multipart_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.4 2024-09-22T08:56:16.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.556+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__shadow_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.4_1 2024-09-22T08:56:16.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.557+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__multipart_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.5 2024-09-22T08:56:16.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.557+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__shadow_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.5_1 2024-09-22T08:56:16.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.557+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__multipart_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.6 2024-09-22T08:56:16.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.557+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.507__shadow_srcmultipart.2~fBSdRoSqgnbb2lAeD2iivixvZKx3Qy5.6_1 2024-09-22T08:56:16.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.557+0000 7f06bad28800 20 garbage collection: RGWGC::process iterating over entry tag='c62f9d7b-f6b6-404a-90de-de5607499115.4584.14359937370621586707', time=2024-09-22T10:48:25.690370+0000, chain.objs.size()=1 2024-09-22T08:56:16.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.557+0000 7f06bad28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c62f9d7b-f6b6-404a-90de-de5607499115.4584.518__multipart_mymultipart.2~GL5cJ-lZhyJxT1cUB1U4z_DZZ-oQiJD.1 2024-09-22T08:56:16.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.560+0000 7f06bad28800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:56:16.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.563+0000 7f056d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:56:16.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.565+0000 7f06bad28800 20 remove_watcher() i=0 2024-09-22T08:56:16.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.565+0000 7f06bad28800 2 removed watcher, disabling cache 2024-09-22T08:56:16.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.566+0000 7f06bad28800 20 remove_watcher() i=1 2024-09-22T08:56:16.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.567+0000 7f06bad28800 20 remove_watcher() i=2 2024-09-22T08:56:16.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.568+0000 7f06bad28800 20 remove_watcher() i=3 2024-09-22T08:56:16.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.569+0000 7f06bad28800 20 remove_watcher() i=4 2024-09-22T08:56:16.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.570+0000 7f06bad28800 20 remove_watcher() i=5 2024-09-22T08:56:16.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.571+0000 7f06bad28800 20 remove_watcher() i=6 2024-09-22T08:56:16.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-22T08:56:16.572+0000 7f06bad28800 20 remove_watcher() i=7 2024-09-22T08:56:16.587 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-22T08:56:16.597 DEBUG:teuthology.orchestra.run.smithi038:> rm -f /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/root.key 2024-09-22T08:56:16.627 DEBUG:teuthology.orchestra.run.smithi038:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-22T08:56:16.696 DEBUG:teuthology.orchestra.run.smithi038:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.crt /home/ubuntu/cephtest/ca/rgw.client.0.key 2024-09-22T08:56:16.766 DEBUG:teuthology.orchestra.run.smithi038:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-22T08:56:16.835 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm /usr/share/pki/ca-trust-source/anchors/root.crt 2024-09-22T08:56:16.915 DEBUG:teuthology.orchestra.run.smithi038:> sudo update-ca-trust 2024-09-22T08:56:17.977 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-22T08:56:17.995 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-22T08:56:17.995 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T08:56:18.336 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:56:18.347 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-09-22T08:56:18.350 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":1502,"stamp":"2024-09-22T08:56:17.629295+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":314098563,"num_objects":817,"num_object_clones":0,"num_object_copies":1634,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":817,"num_whiteouts":0,"num_read":296536,"num_read_kb":2781413,"num_write":145878,"num_write_kb":2427250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":189,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13249,"ondisk_log_size":13249,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2084892,"kb_used_data":813668,"kb_used_omap":12,"kb_used_meta":1270963,"kb_avail":752889828,"statfs":{"total":773094113280,"available":770959183872,"internally_reserved":0,"allocated":833196032,"data_stored":819261610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1301466673},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-239420878,"num_objects":-165,"num_object_clones":0,"num_object_copies":-330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-165,"num_whiteouts":0,"num_read":391,"num_read_kb":430,"num_write":255,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004659"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:18.466360+0000","last_change":"2024-09-22T08:42:17.435884+0000","last_active":"2024-09-22T08:52:18.466360+0000","last_peered":"2024-09-22T08:52:18.466360+0000","last_clean":"2024-09-22T08:52:18.466360+0000","last_became_active":"2024-09-22T08:42:17.435576+0000","last_became_peered":"2024-09-22T08:42:17.435576+0000","last_unstale":"2024-09-22T08:52:18.466360+0000","last_undegraded":"2024-09-22T08:52:18.466360+0000","last_fullsized":"2024-09-22T08:52:18.466360+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:18:12.399293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"263'4","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:18.375143+0000","last_change":"2024-09-22T08:31:14.254986+0000","last_active":"2024-09-22T08:51:18.375143+0000","last_peered":"2024-09-22T08:51:18.375143+0000","last_clean":"2024-09-22T08:51:18.375143+0000","last_became_active":"2024-09-22T08:31:14.254610+0000","last_became_peered":"2024-09-22T08:31:14.254610+0000","last_unstale":"2024-09-22T08:51:18.375143+0000","last_undegraded":"2024-09-22T08:51:18.375143+0000","last_fullsized":"2024-09-22T08:51:18.375143+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:29:54.524062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":9,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"263'4","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.314152+0000","last_change":"2024-09-22T08:31:11.216063+0000","last_active":"2024-09-22T08:56:16.314152+0000","last_peered":"2024-09-22T08:56:16.314152+0000","last_clean":"2024-09-22T08:56:16.314152+0000","last_became_active":"2024-09-22T08:31:11.215757+0000","last_became_peered":"2024-09-22T08:31:11.215757+0000","last_unstale":"2024-09-22T08:56:16.314152+0000","last_undegraded":"2024-09-22T08:56:16.314152+0000","last_fullsized":"2024-09-22T08:56:16.314152+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:30:49.027544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6203,"num_write":4,"num_write_kb":3131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"263'27","reported_seq":113,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:39.138788+0000","last_change":"2024-09-22T08:29:26.069972+0000","last_active":"2024-09-22T08:52:39.138788+0000","last_peered":"2024-09-22T08:52:39.138788+0000","last_clean":"2024-09-22T08:52:39.138788+0000","last_became_active":"2024-09-22T08:29:26.069635+0000","last_became_peered":"2024-09-22T08:29:26.069635+0000","last_unstale":"2024-09-22T08:52:39.138788+0000","last_undegraded":"2024-09-22T08:52:39.138788+0000","last_fullsized":"2024-09-22T08:52:39.138788+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:19:23.283184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":139,"num_write":76,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:17.271882+0000","last_change":"2024-09-22T08:42:17.433226+0000","last_active":"2024-09-22T08:52:17.271882+0000","last_peered":"2024-09-22T08:52:17.271882+0000","last_clean":"2024-09-22T08:52:17.271882+0000","last_became_active":"2024-09-22T08:42:17.432946+0000","last_became_peered":"2024-09-22T08:42:17.432946+0000","last_unstale":"2024-09-22T08:52:17.271882+0000","last_undegraded":"2024-09-22T08:52:17.271882+0000","last_fullsized":"2024-09-22T08:52:17.271882+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:57:47.463137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"263'3","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:46.271105+0000","last_change":"2024-09-22T08:31:14.256838+0000","last_active":"2024-09-22T08:53:46.271105+0000","last_peered":"2024-09-22T08:53:46.271105+0000","last_clean":"2024-09-22T08:53:46.271105+0000","last_became_active":"2024-09-22T08:31:14.256486+0000","last_became_peered":"2024-09-22T08:31:14.256486+0000","last_unstale":"2024-09-22T08:53:46.271105+0000","last_undegraded":"2024-09-22T08:53:46.271105+0000","last_fullsized":"2024-09-22T08:53:46.271105+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:05:48.401720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4242723,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":8240,"num_write":8,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"260'2","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:42.284418+0000","last_change":"2024-09-22T08:31:11.216967+0000","last_active":"2024-09-22T08:53:42.284418+0000","last_peered":"2024-09-22T08:53:42.284418+0000","last_clean":"2024-09-22T08:53:42.284418+0000","last_became_active":"2024-09-22T08:31:11.216515+0000","last_became_peered":"2024-09-22T08:31:11.216515+0000","last_unstale":"2024-09-22T08:53:42.284418+0000","last_undegraded":"2024-09-22T08:53:42.284418+0000","last_fullsized":"2024-09-22T08:53:42.284418+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:40:06.800121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"263'31","reported_seq":130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:32.404964+0000","last_change":"2024-09-22T08:29:26.074014+0000","last_active":"2024-09-22T08:53:32.404964+0000","last_peered":"2024-09-22T08:53:32.404964+0000","last_clean":"2024-09-22T08:53:32.404964+0000","last_became_active":"2024-09-22T08:29:26.073415+0000","last_became_peered":"2024-09-22T08:29:26.073415+0000","last_unstale":"2024-09-22T08:53:32.404964+0000","last_undegraded":"2024-09-22T08:53:32.404964+0000","last_fullsized":"2024-09-22T08:53:32.404964+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:07:10.743328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":176,"num_write":77,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:58.380840+0000","last_change":"2024-09-22T08:42:17.436629+0000","last_active":"2024-09-22T08:51:58.380840+0000","last_peered":"2024-09-22T08:51:58.380840+0000","last_clean":"2024-09-22T08:51:58.380840+0000","last_became_active":"2024-09-22T08:42:17.436334+0000","last_became_peered":"2024-09-22T08:42:17.436334+0000","last_unstale":"2024-09-22T08:51:58.380840+0000","last_undegraded":"2024-09-22T08:51:58.380840+0000","last_fullsized":"2024-09-22T08:51:58.380840+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:04:08.905608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"260'4","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:12.288779+0000","last_change":"2024-09-22T08:31:14.257057+0000","last_active":"2024-09-22T08:54:12.288779+0000","last_peered":"2024-09-22T08:54:12.288779+0000","last_clean":"2024-09-22T08:54:12.288779+0000","last_became_active":"2024-09-22T08:31:14.256769+0000","last_became_peered":"2024-09-22T08:31:14.256769+0000","last_unstale":"2024-09-22T08:54:12.288779+0000","last_undegraded":"2024-09-22T08:54:12.288779+0000","last_fullsized":"2024-09-22T08:54:12.288779+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:06:32.378399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:17.289881+0000","last_change":"2024-09-22T08:31:11.211351+0000","last_active":"2024-09-22T08:53:17.289881+0000","last_peered":"2024-09-22T08:53:17.289881+0000","last_clean":"2024-09-22T08:53:17.289881+0000","last_became_active":"2024-09-22T08:31:11.210892+0000","last_became_peered":"2024-09-22T08:31:11.210892+0000","last_unstale":"2024-09-22T08:53:17.289881+0000","last_undegraded":"2024-09-22T08:53:17.289881+0000","last_fullsized":"2024-09-22T08:53:17.289881+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:20:58.942888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"263'43","reported_seq":162,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:57.268885+0000","last_change":"2024-09-22T08:29:26.068513+0000","last_active":"2024-09-22T08:51:57.268885+0000","last_peered":"2024-09-22T08:51:57.268885+0000","last_clean":"2024-09-22T08:51:57.268885+0000","last_became_active":"2024-09-22T08:29:26.067963+0000","last_became_peered":"2024-09-22T08:29:26.067963+0000","last_unstale":"2024-09-22T08:51:57.268885+0000","last_undegraded":"2024-09-22T08:51:57.268885+0000","last_fullsized":"2024-09-22T08:51:57.268885+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:19:50.645315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":380,"num_read_kb":284,"num_write":99,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:02.269565+0000","last_change":"2024-09-22T08:42:17.431238+0000","last_active":"2024-09-22T08:52:02.269565+0000","last_peered":"2024-09-22T08:52:02.269565+0000","last_clean":"2024-09-22T08:52:02.269565+0000","last_became_active":"2024-09-22T08:42:17.430938+0000","last_became_peered":"2024-09-22T08:42:17.430938+0000","last_unstale":"2024-09-22T08:52:02.269565+0000","last_undegraded":"2024-09-22T08:52:02.269565+0000","last_fullsized":"2024-09-22T08:52:02.269565+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:34:21.108839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"263'5","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:22.299767+0000","last_change":"2024-09-22T08:31:14.257263+0000","last_active":"2024-09-22T08:55:22.299767+0000","last_peered":"2024-09-22T08:55:22.299767+0000","last_clean":"2024-09-22T08:55:22.299767+0000","last_became_active":"2024-09-22T08:31:14.255086+0000","last_became_peered":"2024-09-22T08:31:14.255086+0000","last_unstale":"2024-09-22T08:55:22.299767+0000","last_undegraded":"2024-09-22T08:55:22.299767+0000","last_fullsized":"2024-09-22T08:55:22.299767+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:28:49.743007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:08.397293+0000","last_change":"2024-09-22T08:31:11.207653+0000","last_active":"2024-09-22T08:54:08.397293+0000","last_peered":"2024-09-22T08:54:08.397293+0000","last_clean":"2024-09-22T08:54:08.397293+0000","last_became_active":"2024-09-22T08:31:11.207375+0000","last_became_peered":"2024-09-22T08:31:11.207375+0000","last_unstale":"2024-09-22T08:54:08.397293+0000","last_undegraded":"2024-09-22T08:54:08.397293+0000","last_fullsized":"2024-09-22T08:54:08.397293+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:55:26.229921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"263'31","reported_seq":122,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:57.268855+0000","last_change":"2024-09-22T08:29:26.072556+0000","last_active":"2024-09-22T08:51:57.268855+0000","last_peered":"2024-09-22T08:51:57.268855+0000","last_clean":"2024-09-22T08:51:57.268855+0000","last_became_active":"2024-09-22T08:29:26.072183+0000","last_became_peered":"2024-09-22T08:29:26.072183+0000","last_unstale":"2024-09-22T08:51:57.268855+0000","last_undegraded":"2024-09-22T08:51:57.268855+0000","last_fullsized":"2024-09-22T08:51:57.268855+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:30:12.756499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":233,"num_read_kb":155,"num_write":81,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:22.282338+0000","last_change":"2024-09-22T08:42:17.418516+0000","last_active":"2024-09-22T08:52:22.282338+0000","last_peered":"2024-09-22T08:52:22.282338+0000","last_clean":"2024-09-22T08:52:22.282338+0000","last_became_active":"2024-09-22T08:42:17.418224+0000","last_became_peered":"2024-09-22T08:42:17.418224+0000","last_unstale":"2024-09-22T08:52:22.282338+0000","last_undegraded":"2024-09-22T08:52:22.282338+0000","last_fullsized":"2024-09-22T08:52:22.282338+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:06:49.930134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"263'3","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:03.472601+0000","last_change":"2024-09-22T08:31:14.262084+0000","last_active":"2024-09-22T08:53:03.472601+0000","last_peered":"2024-09-22T08:53:03.472601+0000","last_clean":"2024-09-22T08:53:03.472601+0000","last_became_active":"2024-09-22T08:31:14.261753+0000","last_became_peered":"2024-09-22T08:31:14.261753+0000","last_unstale":"2024-09-22T08:53:03.472601+0000","last_undegraded":"2024-09-22T08:53:03.472601+0000","last_fullsized":"2024-09-22T08:53:03.472601+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:21:33.510246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"260'9","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:57.277829+0000","last_change":"2024-09-22T08:31:11.215327+0000","last_active":"2024-09-22T08:52:57.277829+0000","last_peered":"2024-09-22T08:52:57.277829+0000","last_clean":"2024-09-22T08:52:57.277829+0000","last_became_active":"2024-09-22T08:31:11.215024+0000","last_became_peered":"2024-09-22T08:31:11.215024+0000","last_unstale":"2024-09-22T08:52:57.277829+0000","last_undegraded":"2024-09-22T08:52:57.277829+0000","last_fullsized":"2024-09-22T08:52:57.277829+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:27:55.278924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":17455,"num_write":14,"num_write_kb":5165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"263'52","reported_seq":185,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:50.448372+0000","last_change":"2024-09-22T08:29:26.071185+0000","last_active":"2024-09-22T08:53:50.448372+0000","last_peered":"2024-09-22T08:53:50.448372+0000","last_clean":"2024-09-22T08:53:50.448372+0000","last_became_active":"2024-09-22T08:29:26.070913+0000","last_became_peered":"2024-09-22T08:29:26.070913+0000","last_unstale":"2024-09-22T08:53:50.448372+0000","last_undegraded":"2024-09-22T08:53:50.448372+0000","last_fullsized":"2024-09-22T08:53:50.448372+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:50:29.931826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":289,"num_write":128,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:42.398384+0000","last_change":"2024-09-22T08:42:17.428992+0000","last_active":"2024-09-22T08:52:42.398384+0000","last_peered":"2024-09-22T08:52:42.398384+0000","last_clean":"2024-09-22T08:52:42.398384+0000","last_became_active":"2024-09-22T08:42:17.428589+0000","last_became_peered":"2024-09-22T08:42:17.428589+0000","last_unstale":"2024-09-22T08:52:42.398384+0000","last_undegraded":"2024-09-22T08:52:42.398384+0000","last_fullsized":"2024-09-22T08:52:42.398384+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:34:40.543481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"263'5","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:03.389575+0000","last_change":"2024-09-22T08:31:14.256450+0000","last_active":"2024-09-22T08:53:03.389575+0000","last_peered":"2024-09-22T08:53:03.389575+0000","last_clean":"2024-09-22T08:53:03.389575+0000","last_became_active":"2024-09-22T08:31:14.256133+0000","last_became_peered":"2024-09-22T08:31:14.256133+0000","last_unstale":"2024-09-22T08:53:03.389575+0000","last_undegraded":"2024-09-22T08:53:03.389575+0000","last_fullsized":"2024-09-22T08:53:03.389575+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:35:53.157445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":15,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"263'1","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:58.389014+0000","last_change":"2024-09-22T08:31:11.214428+0000","last_active":"2024-09-22T08:52:58.389014+0000","last_peered":"2024-09-22T08:52:58.389014+0000","last_clean":"2024-09-22T08:52:58.389014+0000","last_became_active":"2024-09-22T08:31:11.214152+0000","last_became_peered":"2024-09-22T08:31:11.214152+0000","last_unstale":"2024-09-22T08:52:58.389014+0000","last_undegraded":"2024-09-22T08:52:58.389014+0000","last_fullsized":"2024-09-22T08:52:58.389014+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:24:25.711738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"263'41","reported_seq":155,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:56.954636+0000","last_change":"2024-09-22T08:29:26.073207+0000","last_active":"2024-09-22T08:52:56.954636+0000","last_peered":"2024-09-22T08:52:56.954636+0000","last_clean":"2024-09-22T08:52:56.954636+0000","last_became_active":"2024-09-22T08:29:26.072935+0000","last_became_peered":"2024-09-22T08:29:26.072935+0000","last_unstale":"2024-09-22T08:52:56.954636+0000","last_undegraded":"2024-09-22T08:52:56.954636+0000","last_fullsized":"2024-09-22T08:52:56.954636+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:08.214582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":341,"num_read_kb":226,"num_write":101,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:16.259851+0000","last_change":"2024-09-22T08:42:17.429598+0000","last_active":"2024-09-22T08:52:16.259851+0000","last_peered":"2024-09-22T08:52:16.259851+0000","last_clean":"2024-09-22T08:52:16.259851+0000","last_became_active":"2024-09-22T08:42:17.429298+0000","last_became_peered":"2024-09-22T08:42:17.429298+0000","last_unstale":"2024-09-22T08:52:16.259851+0000","last_undegraded":"2024-09-22T08:52:16.259851+0000","last_fullsized":"2024-09-22T08:52:16.259851+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:26:36.238407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"260'7","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:46.271089+0000","last_change":"2024-09-22T08:31:14.258062+0000","last_active":"2024-09-22T08:53:46.271089+0000","last_peered":"2024-09-22T08:53:46.271089+0000","last_clean":"2024-09-22T08:53:46.271089+0000","last_became_active":"2024-09-22T08:31:14.257659+0000","last_became_peered":"2024-09-22T08:31:14.257659+0000","last_unstale":"2024-09-22T08:53:46.271089+0000","last_undegraded":"2024-09-22T08:53:46.271089+0000","last_fullsized":"2024-09-22T08:53:46.271089+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:32:38.962644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4143,"num_write":12,"num_write_kb":1069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"263'1","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:43.477749+0000","last_change":"2024-09-22T08:31:11.216523+0000","last_active":"2024-09-22T08:53:43.477749+0000","last_peered":"2024-09-22T08:53:43.477749+0000","last_clean":"2024-09-22T08:53:43.477749+0000","last_became_active":"2024-09-22T08:31:11.216248+0000","last_became_peered":"2024-09-22T08:31:11.216248+0000","last_unstale":"2024-09-22T08:53:43.477749+0000","last_undegraded":"2024-09-22T08:53:43.477749+0000","last_fullsized":"2024-09-22T08:53:43.477749+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:46:16.857947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"263'16","reported_seq":84,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:47.294012+0000","last_change":"2024-09-22T08:29:26.076631+0000","last_active":"2024-09-22T08:53:47.294012+0000","last_peered":"2024-09-22T08:53:47.294012+0000","last_clean":"2024-09-22T08:53:47.294012+0000","last_became_active":"2024-09-22T08:29:26.076243+0000","last_became_peered":"2024-09-22T08:29:26.076243+0000","last_unstale":"2024-09-22T08:53:47.294012+0000","last_undegraded":"2024-09-22T08:53:47.294012+0000","last_fullsized":"2024-09-22T08:53:47.294012+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:02:16.942826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":86,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:18.466402+0000","last_change":"2024-09-22T08:42:17.433193+0000","last_active":"2024-09-22T08:52:18.466402+0000","last_peered":"2024-09-22T08:52:18.466402+0000","last_clean":"2024-09-22T08:52:18.466402+0000","last_became_active":"2024-09-22T08:42:17.432923+0000","last_became_peered":"2024-09-22T08:42:17.432923+0000","last_unstale":"2024-09-22T08:52:18.466402+0000","last_undegraded":"2024-09-22T08:52:18.466402+0000","last_fullsized":"2024-09-22T08:52:18.466402+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:17:35.794496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"263'8","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.426367+0000","last_change":"2024-09-22T08:31:14.256601+0000","last_active":"2024-09-22T08:56:16.426367+0000","last_peered":"2024-09-22T08:56:16.426367+0000","last_clean":"2024-09-22T08:56:16.426367+0000","last_became_active":"2024-09-22T08:31:14.256055+0000","last_became_peered":"2024-09-22T08:31:14.256055+0000","last_unstale":"2024-09-22T08:56:16.426367+0000","last_undegraded":"2024-09-22T08:56:16.426367+0000","last_fullsized":"2024-09-22T08:56:16.426367+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:48:31.013743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":18434,"num_write":18,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"263'8","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.321761+0000","last_change":"2024-09-22T08:31:11.215990+0000","last_active":"2024-09-22T08:56:16.321761+0000","last_peered":"2024-09-22T08:56:16.321761+0000","last_clean":"2024-09-22T08:56:16.321761+0000","last_became_active":"2024-09-22T08:31:11.215609+0000","last_became_peered":"2024-09-22T08:31:11.215609+0000","last_unstale":"2024-09-22T08:56:16.321761+0000","last_undegraded":"2024-09-22T08:56:16.321761+0000","last_fullsized":"2024-09-22T08:56:16.321761+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:52:29.022225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":18,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"263'42","reported_seq":155,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:37.283579+0000","last_change":"2024-09-22T08:29:26.067779+0000","last_active":"2024-09-22T08:53:37.283579+0000","last_peered":"2024-09-22T08:53:37.283579+0000","last_clean":"2024-09-22T08:53:37.283579+0000","last_became_active":"2024-09-22T08:29:26.066447+0000","last_became_peered":"2024-09-22T08:29:26.066447+0000","last_unstale":"2024-09-22T08:53:37.283579+0000","last_undegraded":"2024-09-22T08:53:37.283579+0000","last_fullsized":"2024-09-22T08:53:37.283579+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:16:11.771113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":325,"num_read_kb":214,"num_write":107,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:57.286263+0000","last_change":"2024-09-22T08:42:17.436182+0000","last_active":"2024-09-22T08:53:57.286263+0000","last_peered":"2024-09-22T08:53:57.286263+0000","last_clean":"2024-09-22T08:53:57.286263+0000","last_became_active":"2024-09-22T08:42:17.435842+0000","last_became_peered":"2024-09-22T08:42:17.435842+0000","last_unstale":"2024-09-22T08:53:57.286263+0000","last_undegraded":"2024-09-22T08:53:57.286263+0000","last_fullsized":"2024-09-22T08:53:57.286263+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:44:56.306198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"263'2","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:27.307511+0000","last_change":"2024-09-22T08:31:14.255793+0000","last_active":"2024-09-22T08:55:27.307511+0000","last_peered":"2024-09-22T08:55:27.307511+0000","last_clean":"2024-09-22T08:55:27.307511+0000","last_became_active":"2024-09-22T08:31:14.255497+0000","last_became_peered":"2024-09-22T08:31:14.255497+0000","last_unstale":"2024-09-22T08:55:27.307511+0000","last_undegraded":"2024-09-22T08:55:27.307511+0000","last_fullsized":"2024-09-22T08:55:27.307511+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:31.376498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"263'3","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:13.383058+0000","last_change":"2024-09-22T08:31:11.217315+0000","last_active":"2024-09-22T08:52:13.383058+0000","last_peered":"2024-09-22T08:52:13.383058+0000","last_clean":"2024-09-22T08:52:13.383058+0000","last_became_active":"2024-09-22T08:31:11.216997+0000","last_became_peered":"2024-09-22T08:31:11.216997+0000","last_unstale":"2024-09-22T08:52:13.383058+0000","last_undegraded":"2024-09-22T08:52:13.383058+0000","last_fullsized":"2024-09-22T08:52:13.383058+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:29.441399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"263'25","reported_seq":111,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:37.405734+0000","last_change":"2024-09-22T08:29:26.071169+0000","last_active":"2024-09-22T08:53:37.405734+0000","last_peered":"2024-09-22T08:53:37.405734+0000","last_clean":"2024-09-22T08:53:37.405734+0000","last_became_active":"2024-09-22T08:29:26.070906+0000","last_became_peered":"2024-09-22T08:29:26.070906+0000","last_unstale":"2024-09-22T08:53:37.405734+0000","last_undegraded":"2024-09-22T08:53:37.405734+0000","last_fullsized":"2024-09-22T08:53:37.405734+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:55:47.696276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":135,"num_write":63,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:57.286143+0000","last_change":"2024-09-22T08:42:17.430752+0000","last_active":"2024-09-22T08:53:57.286143+0000","last_peered":"2024-09-22T08:53:57.286143+0000","last_clean":"2024-09-22T08:53:57.286143+0000","last_became_active":"2024-09-22T08:42:17.430457+0000","last_became_peered":"2024-09-22T08:42:17.430457+0000","last_unstale":"2024-09-22T08:53:57.286143+0000","last_undegraded":"2024-09-22T08:53:57.286143+0000","last_fullsized":"2024-09-22T08:53:57.286143+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:57:22.012215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"263'9","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.464617+0000","last_change":"2024-09-22T08:31:14.256126+0000","last_active":"2024-09-22T08:56:16.464617+0000","last_peered":"2024-09-22T08:56:16.464617+0000","last_clean":"2024-09-22T08:56:16.464617+0000","last_became_active":"2024-09-22T08:31:14.255245+0000","last_became_peered":"2024-09-22T08:31:14.255245+0000","last_unstale":"2024-09-22T08:56:16.464617+0000","last_undegraded":"2024-09-22T08:56:16.464617+0000","last_fullsized":"2024-09-22T08:56:16.464617+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:45:50.399892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":20480,"num_write":14,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"260'6","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:58.472145+0000","last_change":"2024-09-22T08:31:11.211294+0000","last_active":"2024-09-22T08:52:58.472145+0000","last_peered":"2024-09-22T08:52:58.472145+0000","last_clean":"2024-09-22T08:52:58.472145+0000","last_became_active":"2024-09-22T08:31:11.211000+0000","last_became_peered":"2024-09-22T08:31:11.211000+0000","last_unstale":"2024-09-22T08:52:58.472145+0000","last_undegraded":"2024-09-22T08:52:58.472145+0000","last_fullsized":"2024-09-22T08:52:58.472145+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:34:47.341250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8192,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"263'32","reported_seq":130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:37.405687+0000","last_change":"2024-09-22T08:29:26.075955+0000","last_active":"2024-09-22T08:53:37.405687+0000","last_peered":"2024-09-22T08:53:37.405687+0000","last_clean":"2024-09-22T08:53:37.405687+0000","last_became_active":"2024-09-22T08:29:26.074151+0000","last_became_peered":"2024-09-22T08:29:26.074151+0000","last_unstale":"2024-09-22T08:53:37.405687+0000","last_undegraded":"2024-09-22T08:53:37.405687+0000","last_fullsized":"2024-09-22T08:53:37.405687+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:36:04.989650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":180,"num_write":78,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:56.272330+0000","last_change":"2024-09-22T08:42:17.432351+0000","last_active":"2024-09-22T08:53:56.272330+0000","last_peered":"2024-09-22T08:53:56.272330+0000","last_clean":"2024-09-22T08:53:56.272330+0000","last_became_active":"2024-09-22T08:42:17.432056+0000","last_became_peered":"2024-09-22T08:42:17.432056+0000","last_unstale":"2024-09-22T08:53:56.272330+0000","last_undegraded":"2024-09-22T08:53:56.272330+0000","last_fullsized":"2024-09-22T08:53:56.272330+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:19:22.863621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"263'6","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.434342+0000","last_change":"2024-09-22T08:31:14.259324+0000","last_active":"2024-09-22T08:56:16.434342+0000","last_peered":"2024-09-22T08:56:16.434342+0000","last_clean":"2024-09-22T08:56:16.434342+0000","last_became_active":"2024-09-22T08:31:14.259009+0000","last_became_peered":"2024-09-22T08:31:14.259009+0000","last_unstale":"2024-09-22T08:56:16.434342+0000","last_undegraded":"2024-09-22T08:56:16.434342+0000","last_fullsized":"2024-09-22T08:56:16.434342+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:19:27.710241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8192,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"263'5","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:22.306782+0000","last_change":"2024-09-22T08:31:11.216003+0000","last_active":"2024-09-22T08:55:22.306782+0000","last_peered":"2024-09-22T08:55:22.306782+0000","last_clean":"2024-09-22T08:55:22.306782+0000","last_became_active":"2024-09-22T08:31:11.215708+0000","last_became_peered":"2024-09-22T08:31:11.215708+0000","last_unstale":"2024-09-22T08:55:22.306782+0000","last_undegraded":"2024-09-22T08:55:22.306782+0000","last_fullsized":"2024-09-22T08:55:22.306782+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:19:30.880256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"263'26","reported_seq":110,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:37.292875+0000","last_change":"2024-09-22T08:29:26.069760+0000","last_active":"2024-09-22T08:53:37.292875+0000","last_peered":"2024-09-22T08:53:37.292875+0000","last_clean":"2024-09-22T08:53:37.292875+0000","last_became_active":"2024-09-22T08:29:26.069440+0000","last_became_peered":"2024-09-22T08:29:26.069440+0000","last_unstale":"2024-09-22T08:53:37.292875+0000","last_undegraded":"2024-09-22T08:53:37.292875+0000","last_fullsized":"2024-09-22T08:53:37.292875+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:48:41.597112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":134,"num_write":69,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:38.461091+0000","last_change":"2024-09-22T08:42:17.436175+0000","last_active":"2024-09-22T08:51:38.461091+0000","last_peered":"2024-09-22T08:51:38.461091+0000","last_clean":"2024-09-22T08:51:38.461091+0000","last_became_active":"2024-09-22T08:42:17.435825+0000","last_became_peered":"2024-09-22T08:42:17.435825+0000","last_unstale":"2024-09-22T08:51:38.461091+0000","last_undegraded":"2024-09-22T08:51:38.461091+0000","last_fullsized":"2024-09-22T08:51:38.461091+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:50:07.804836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"260'2","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:58.472161+0000","last_change":"2024-09-22T08:31:14.256513+0000","last_active":"2024-09-22T08:52:58.472161+0000","last_peered":"2024-09-22T08:52:58.472161+0000","last_clean":"2024-09-22T08:52:58.472161+0000","last_became_active":"2024-09-22T08:31:14.256218+0000","last_became_peered":"2024-09-22T08:31:14.256218+0000","last_unstale":"2024-09-22T08:52:58.472161+0000","last_undegraded":"2024-09-22T08:52:58.472161+0000","last_fullsized":"2024-09-22T08:52:58.472161+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:27:57.407928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:57.277949+0000","last_change":"2024-09-22T08:31:11.214383+0000","last_active":"2024-09-22T08:52:57.277949+0000","last_peered":"2024-09-22T08:52:57.277949+0000","last_clean":"2024-09-22T08:52:57.277949+0000","last_became_active":"2024-09-22T08:31:11.214111+0000","last_became_peered":"2024-09-22T08:31:11.214111+0000","last_unstale":"2024-09-22T08:52:57.277949+0000","last_undegraded":"2024-09-22T08:52:57.277949+0000","last_fullsized":"2024-09-22T08:52:57.277949+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:55:25.197395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"263'20","reported_seq":95,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:53.388471+0000","last_change":"2024-09-22T08:29:26.069573+0000","last_active":"2024-09-22T08:52:53.388471+0000","last_peered":"2024-09-22T08:52:53.388471+0000","last_clean":"2024-09-22T08:52:53.388471+0000","last_became_active":"2024-09-22T08:29:26.069293+0000","last_became_peered":"2024-09-22T08:29:26.069293+0000","last_unstale":"2024-09-22T08:52:53.388471+0000","last_undegraded":"2024-09-22T08:52:53.388471+0000","last_fullsized":"2024-09-22T08:52:53.388471+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:06:27.426634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":89,"num_write":52,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:57.268896+0000","last_change":"2024-09-22T08:42:17.429646+0000","last_active":"2024-09-22T08:51:57.268896+0000","last_peered":"2024-09-22T08:51:57.268896+0000","last_clean":"2024-09-22T08:51:57.268896+0000","last_became_active":"2024-09-22T08:42:17.429163+0000","last_became_peered":"2024-09-22T08:42:17.429163+0000","last_unstale":"2024-09-22T08:51:57.268896+0000","last_undegraded":"2024-09-22T08:51:57.268896+0000","last_fullsized":"2024-09-22T08:51:57.268896+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:52:58.326332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"263'2","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:37.292485+0000","last_change":"2024-09-22T08:31:14.259778+0000","last_active":"2024-09-22T08:54:37.292485+0000","last_peered":"2024-09-22T08:54:37.292485+0000","last_clean":"2024-09-22T08:54:37.292485+0000","last_became_active":"2024-09-22T08:31:14.259484+0000","last_became_peered":"2024-09-22T08:31:14.259484+0000","last_unstale":"2024-09-22T08:54:37.292485+0000","last_undegraded":"2024-09-22T08:54:37.292485+0000","last_fullsized":"2024-09-22T08:54:37.292485+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:10:58.591122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"263'5","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:13.382709+0000","last_change":"2024-09-22T08:31:11.203333+0000","last_active":"2024-09-22T08:52:13.382709+0000","last_peered":"2024-09-22T08:52:13.382709+0000","last_clean":"2024-09-22T08:52:13.382709+0000","last_became_active":"2024-09-22T08:31:11.203053+0000","last_became_peered":"2024-09-22T08:31:11.203053+0000","last_unstale":"2024-09-22T08:52:13.382709+0000","last_undegraded":"2024-09-22T08:52:13.382709+0000","last_fullsized":"2024-09-22T08:52:13.382709+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:29:11.633546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48419,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":4146,"num_write":5,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"263'318","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:48.387936+0000","last_change":"2024-09-22T08:29:26.070758+0000","last_active":"2024-09-22T08:52:48.387936+0000","last_peered":"2024-09-22T08:52:48.387936+0000","last_clean":"2024-09-22T08:52:48.387936+0000","last_became_active":"2024-09-22T08:29:26.070475+0000","last_became_peered":"2024-09-22T08:29:26.070475+0000","last_unstale":"2024-09-22T08:52:48.387936+0000","last_undegraded":"2024-09-22T08:52:48.387936+0000","last_fullsized":"2024-09-22T08:52:48.387936+0000","mapping_epoch":252,"log_start":"263'300","ondisk_log_start":"263'300","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:21:22.076883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2975,"num_read_kb":3480,"num_write":654,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:57.268912+0000","last_change":"2024-09-22T08:42:17.431838+0000","last_active":"2024-09-22T08:51:57.268912+0000","last_peered":"2024-09-22T08:51:57.268912+0000","last_clean":"2024-09-22T08:51:57.268912+0000","last_became_active":"2024-09-22T08:42:17.431528+0000","last_became_peered":"2024-09-22T08:42:17.431528+0000","last_unstale":"2024-09-22T08:51:57.268912+0000","last_undegraded":"2024-09-22T08:51:57.268912+0000","last_fullsized":"2024-09-22T08:51:57.268912+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:29:19.259078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:17.271924+0000","last_change":"2024-09-22T08:31:14.256347+0000","last_active":"2024-09-22T08:52:17.271924+0000","last_peered":"2024-09-22T08:52:17.271924+0000","last_clean":"2024-09-22T08:52:17.271924+0000","last_became_active":"2024-09-22T08:31:14.256054+0000","last_became_peered":"2024-09-22T08:31:14.256054+0000","last_unstale":"2024-09-22T08:52:17.271924+0000","last_undegraded":"2024-09-22T08:52:17.271924+0000","last_fullsized":"2024-09-22T08:52:17.271924+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:02:08.137287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"263'8","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.323100+0000","last_change":"2024-09-22T08:31:11.213551+0000","last_active":"2024-09-22T08:56:16.323100+0000","last_peered":"2024-09-22T08:56:16.323100+0000","last_clean":"2024-09-22T08:56:16.323100+0000","last_became_active":"2024-09-22T08:31:11.212539+0000","last_became_peered":"2024-09-22T08:31:11.212539+0000","last_unstale":"2024-09-22T08:56:16.323100+0000","last_undegraded":"2024-09-22T08:56:16.323100+0000","last_fullsized":"2024-09-22T08:56:16.323100+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:38:43.370688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":18,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"263'51","reported_seq":176,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:47.088466+0000","last_change":"2024-09-22T08:29:26.070905+0000","last_active":"2024-09-22T08:53:47.088466+0000","last_peered":"2024-09-22T08:53:47.088466+0000","last_clean":"2024-09-22T08:53:47.088466+0000","last_became_active":"2024-09-22T08:29:26.070576+0000","last_became_peered":"2024-09-22T08:29:26.070576+0000","last_unstale":"2024-09-22T08:53:47.088466+0000","last_undegraded":"2024-09-22T08:53:47.088466+0000","last_fullsized":"2024-09-22T08:53:47.088466+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:55:10.934768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":389,"num_read_kb":252,"num_write":129,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:42.389903+0000","last_change":"2024-09-22T08:42:17.426058+0000","last_active":"2024-09-22T08:51:42.389903+0000","last_peered":"2024-09-22T08:51:42.389903+0000","last_clean":"2024-09-22T08:51:42.389903+0000","last_became_active":"2024-09-22T08:42:17.425759+0000","last_became_peered":"2024-09-22T08:42:17.425759+0000","last_unstale":"2024-09-22T08:51:42.389903+0000","last_undegraded":"2024-09-22T08:51:42.389903+0000","last_fullsized":"2024-09-22T08:51:42.389903+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:58:13.952750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"263'2","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:37.300796+0000","last_change":"2024-09-22T08:31:14.258185+0000","last_active":"2024-09-22T08:54:37.300796+0000","last_peered":"2024-09-22T08:54:37.300796+0000","last_clean":"2024-09-22T08:54:37.300796+0000","last_became_active":"2024-09-22T08:31:14.257900+0000","last_became_peered":"2024-09-22T08:31:14.257900+0000","last_unstale":"2024-09-22T08:54:37.300796+0000","last_undegraded":"2024-09-22T08:54:37.300796+0000","last_fullsized":"2024-09-22T08:54:37.300796+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:24:42.015943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":118,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"263'5","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:13.382766+0000","last_change":"2024-09-22T08:31:11.205171+0000","last_active":"2024-09-22T08:52:13.382766+0000","last_peered":"2024-09-22T08:52:13.382766+0000","last_clean":"2024-09-22T08:52:13.382766+0000","last_became_active":"2024-09-22T08:31:11.204846+0000","last_became_peered":"2024-09-22T08:31:11.204846+0000","last_unstale":"2024-09-22T08:52:13.382766+0000","last_undegraded":"2024-09-22T08:52:13.382766+0000","last_fullsized":"2024-09-22T08:52:13.382766+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:09:45.501944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":6146,"num_write":5,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"263'48","reported_seq":173,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:50.979504+0000","last_change":"2024-09-22T08:29:26.064230+0000","last_active":"2024-09-22T08:53:50.979504+0000","last_peered":"2024-09-22T08:53:50.979504+0000","last_clean":"2024-09-22T08:53:50.979504+0000","last_became_active":"2024-09-22T08:29:26.063914+0000","last_became_peered":"2024-09-22T08:29:26.063914+0000","last_unstale":"2024-09-22T08:53:50.979504+0000","last_undegraded":"2024-09-22T08:53:50.979504+0000","last_fullsized":"2024-09-22T08:53:50.979504+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:49.440925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":381,"num_read_kb":265,"num_write":119,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:57.268871+0000","last_change":"2024-09-22T08:42:17.431413+0000","last_active":"2024-09-22T08:51:57.268871+0000","last_peered":"2024-09-22T08:51:57.268871+0000","last_clean":"2024-09-22T08:51:57.268871+0000","last_became_active":"2024-09-22T08:42:17.429964+0000","last_became_peered":"2024-09-22T08:42:17.429964+0000","last_unstale":"2024-09-22T08:51:57.268871+0000","last_undegraded":"2024-09-22T08:51:57.268871+0000","last_fullsized":"2024-09-22T08:51:57.268871+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:20:04.762853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"260'4","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:18.383736+0000","last_change":"2024-09-22T08:31:14.260215+0000","last_active":"2024-09-22T08:52:18.383736+0000","last_peered":"2024-09-22T08:52:18.383736+0000","last_clean":"2024-09-22T08:52:18.383736+0000","last_became_active":"2024-09-22T08:31:14.259875+0000","last_became_peered":"2024-09-22T08:31:14.259875+0000","last_unstale":"2024-09-22T08:52:18.383736+0000","last_undegraded":"2024-09-22T08:52:18.383736+0000","last_fullsized":"2024-09-22T08:52:18.383736+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:27:56.369023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:13.382799+0000","last_change":"2024-09-22T08:31:11.210358+0000","last_active":"2024-09-22T08:52:13.382799+0000","last_peered":"2024-09-22T08:52:13.382799+0000","last_clean":"2024-09-22T08:52:13.382799+0000","last_became_active":"2024-09-22T08:31:11.210054+0000","last_became_peered":"2024-09-22T08:31:11.210054+0000","last_unstale":"2024-09-22T08:52:13.382799+0000","last_undegraded":"2024-09-22T08:52:13.382799+0000","last_fullsized":"2024-09-22T08:52:13.382799+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:51:41.210904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"263'31","reported_seq":129,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:47.285810+0000","last_change":"2024-09-22T08:29:26.070816+0000","last_active":"2024-09-22T08:52:47.285810+0000","last_peered":"2024-09-22T08:52:47.285810+0000","last_clean":"2024-09-22T08:52:47.285810+0000","last_became_active":"2024-09-22T08:29:26.070492+0000","last_became_peered":"2024-09-22T08:29:26.070492+0000","last_unstale":"2024-09-22T08:52:47.285810+0000","last_undegraded":"2024-09-22T08:52:47.285810+0000","last_fullsized":"2024-09-22T08:52:47.285810+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:33:45.551687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":169,"num_write":83,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:12.279928+0000","last_change":"2024-09-22T08:42:17.433621+0000","last_active":"2024-09-22T08:53:12.279928+0000","last_peered":"2024-09-22T08:53:12.279928+0000","last_clean":"2024-09-22T08:53:12.279928+0000","last_became_active":"2024-09-22T08:42:17.433193+0000","last_became_peered":"2024-09-22T08:42:17.433193+0000","last_unstale":"2024-09-22T08:53:12.279928+0000","last_undegraded":"2024-09-22T08:53:12.279928+0000","last_fullsized":"2024-09-22T08:53:12.279928+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:13.472859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:47.294076+0000","last_change":"2024-09-22T08:31:14.255077+0000","last_active":"2024-09-22T08:53:47.294076+0000","last_peered":"2024-09-22T08:53:47.294076+0000","last_clean":"2024-09-22T08:53:47.294076+0000","last_became_active":"2024-09-22T08:31:14.254710+0000","last_became_peered":"2024-09-22T08:31:14.254710+0000","last_unstale":"2024-09-22T08:53:47.294076+0000","last_undegraded":"2024-09-22T08:53:47.294076+0000","last_fullsized":"2024-09-22T08:53:47.294076+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:21:50.613490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:41.270510+0000","last_change":"2024-09-22T08:31:11.203734+0000","last_active":"2024-09-22T08:53:41.270510+0000","last_peered":"2024-09-22T08:53:41.270510+0000","last_clean":"2024-09-22T08:53:41.270510+0000","last_became_active":"2024-09-22T08:31:11.203413+0000","last_became_peered":"2024-09-22T08:31:11.203413+0000","last_unstale":"2024-09-22T08:53:41.270510+0000","last_undegraded":"2024-09-22T08:53:41.270510+0000","last_fullsized":"2024-09-22T08:53:41.270510+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:44:09.630276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:07.280107+0000","last_change":"2024-09-22T08:29:26.072040+0000","last_active":"2024-09-22T08:52:07.280107+0000","last_peered":"2024-09-22T08:52:07.280107+0000","last_clean":"2024-09-22T08:52:07.280107+0000","last_became_active":"2024-09-22T08:29:26.071742+0000","last_became_peered":"2024-09-22T08:29:26.071742+0000","last_unstale":"2024-09-22T08:52:07.280107+0000","last_undegraded":"2024-09-22T08:52:07.280107+0000","last_fullsized":"2024-09-22T08:52:07.280107+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:02:35.173782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:33.393176+0000","last_change":"2024-09-22T08:42:17.433663+0000","last_active":"2024-09-22T08:53:33.393176+0000","last_peered":"2024-09-22T08:53:33.393176+0000","last_clean":"2024-09-22T08:53:33.393176+0000","last_became_active":"2024-09-22T08:42:17.433346+0000","last_became_peered":"2024-09-22T08:42:17.433346+0000","last_unstale":"2024-09-22T08:53:33.393176+0000","last_undegraded":"2024-09-22T08:53:33.393176+0000","last_fullsized":"2024-09-22T08:53:33.393176+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:42:29.816828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"260'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:47.294055+0000","last_change":"2024-09-22T08:31:14.256186+0000","last_active":"2024-09-22T08:53:47.294055+0000","last_peered":"2024-09-22T08:53:47.294055+0000","last_clean":"2024-09-22T08:53:47.294055+0000","last_became_active":"2024-09-22T08:31:14.255243+0000","last_became_peered":"2024-09-22T08:31:14.255243+0000","last_unstale":"2024-09-22T08:53:47.294055+0000","last_undegraded":"2024-09-22T08:53:47.294055+0000","last_fullsized":"2024-09-22T08:53:47.294055+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:14:49.285058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"263'6","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.322059+0000","last_change":"2024-09-22T08:31:11.210583+0000","last_active":"2024-09-22T08:56:16.322059+0000","last_peered":"2024-09-22T08:56:16.322059+0000","last_clean":"2024-09-22T08:56:16.322059+0000","last_became_active":"2024-09-22T08:31:11.210266+0000","last_became_peered":"2024-09-22T08:31:11.210266+0000","last_unstale":"2024-09-22T08:56:16.322059+0000","last_undegraded":"2024-09-22T08:56:16.322059+0000","last_fullsized":"2024-09-22T08:56:16.322059+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:55:04.094565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":13312,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"263'39","reported_seq":148,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:56.069487+0000","last_change":"2024-09-22T08:29:26.076488+0000","last_active":"2024-09-22T08:52:56.069487+0000","last_peered":"2024-09-22T08:52:56.069487+0000","last_clean":"2024-09-22T08:52:56.069487+0000","last_became_active":"2024-09-22T08:29:26.076175+0000","last_became_peered":"2024-09-22T08:29:26.076175+0000","last_unstale":"2024-09-22T08:52:56.069487+0000","last_undegraded":"2024-09-22T08:52:56.069487+0000","last_fullsized":"2024-09-22T08:52:56.069487+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:10:01.915865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":317,"num_read_kb":219,"num_write":102,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:08.390223+0000","last_change":"2024-09-22T08:42:17.435167+0000","last_active":"2024-09-22T08:53:08.390223+0000","last_peered":"2024-09-22T08:53:08.390223+0000","last_clean":"2024-09-22T08:53:08.390223+0000","last_became_active":"2024-09-22T08:42:17.434909+0000","last_became_peered":"2024-09-22T08:42:17.434909+0000","last_unstale":"2024-09-22T08:53:08.390223+0000","last_undegraded":"2024-09-22T08:53:08.390223+0000","last_fullsized":"2024-09-22T08:53:08.390223+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:22.417079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"263'4","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:07.313078+0000","last_change":"2024-09-22T08:31:14.252478+0000","last_active":"2024-09-22T08:56:07.313078+0000","last_peered":"2024-09-22T08:56:07.313078+0000","last_clean":"2024-09-22T08:56:07.313078+0000","last_became_active":"2024-09-22T08:31:14.252184+0000","last_became_peered":"2024-09-22T08:31:14.252184+0000","last_unstale":"2024-09-22T08:56:07.313078+0000","last_undegraded":"2024-09-22T08:56:07.313078+0000","last_fullsized":"2024-09-22T08:56:07.313078+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:09.321417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":4,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"263'2","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:57.311651+0000","last_change":"2024-09-22T08:31:11.218103+0000","last_active":"2024-09-22T08:55:57.311651+0000","last_peered":"2024-09-22T08:55:57.311651+0000","last_clean":"2024-09-22T08:55:57.311651+0000","last_became_active":"2024-09-22T08:31:11.217115+0000","last_became_peered":"2024-09-22T08:31:11.217115+0000","last_unstale":"2024-09-22T08:55:57.311651+0000","last_undegraded":"2024-09-22T08:55:57.311651+0000","last_fullsized":"2024-09-22T08:55:57.311651+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:15:42.708378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"263'57","reported_seq":192,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:58.380936+0000","last_change":"2024-09-22T08:29:26.076353+0000","last_active":"2024-09-22T08:51:58.380936+0000","last_peered":"2024-09-22T08:51:58.380936+0000","last_clean":"2024-09-22T08:51:58.380936+0000","last_became_active":"2024-09-22T08:29:26.076048+0000","last_became_peered":"2024-09-22T08:29:26.076048+0000","last_unstale":"2024-09-22T08:51:58.380936+0000","last_undegraded":"2024-09-22T08:51:58.380936+0000","last_fullsized":"2024-09-22T08:51:58.380936+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:12:53.422787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":427,"num_read_kb":265,"num_write":151,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:08.389849+0000","last_change":"2024-09-22T08:42:17.431316+0000","last_active":"2024-09-22T08:53:08.389849+0000","last_peered":"2024-09-22T08:53:08.389849+0000","last_clean":"2024-09-22T08:53:08.389849+0000","last_became_active":"2024-09-22T08:42:17.430974+0000","last_became_peered":"2024-09-22T08:42:17.430974+0000","last_unstale":"2024-09-22T08:53:08.389849+0000","last_undegraded":"2024-09-22T08:53:08.389849+0000","last_fullsized":"2024-09-22T08:53:08.389849+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:40:42.175541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"260'3","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:47.284984+0000","last_change":"2024-09-22T08:31:14.258289+0000","last_active":"2024-09-22T08:53:47.284984+0000","last_peered":"2024-09-22T08:53:47.284984+0000","last_clean":"2024-09-22T08:53:47.284984+0000","last_became_active":"2024-09-22T08:31:14.257952+0000","last_became_peered":"2024-09-22T08:31:14.257952+0000","last_unstale":"2024-09-22T08:53:47.284984+0000","last_undegraded":"2024-09-22T08:53:47.284984+0000","last_fullsized":"2024-09-22T08:53:47.284984+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:26:33.079615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:47.294104+0000","last_change":"2024-09-22T08:31:11.214070+0000","last_active":"2024-09-22T08:53:47.294104+0000","last_peered":"2024-09-22T08:53:47.294104+0000","last_clean":"2024-09-22T08:53:47.294104+0000","last_became_active":"2024-09-22T08:31:11.213273+0000","last_became_peered":"2024-09-22T08:31:11.213273+0000","last_unstale":"2024-09-22T08:53:47.294104+0000","last_undegraded":"2024-09-22T08:53:47.294104+0000","last_fullsized":"2024-09-22T08:53:47.294104+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:48:59.089464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"263'16","reported_seq":83,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:50.237668+0000","last_change":"2024-09-22T08:29:26.074703+0000","last_active":"2024-09-22T08:53:50.237668+0000","last_peered":"2024-09-22T08:53:50.237668+0000","last_clean":"2024-09-22T08:53:50.237668+0000","last_became_active":"2024-09-22T08:29:26.074205+0000","last_became_peered":"2024-09-22T08:29:26.074205+0000","last_unstale":"2024-09-22T08:53:50.237668+0000","last_undegraded":"2024-09-22T08:53:50.237668+0000","last_fullsized":"2024-09-22T08:53:50.237668+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:39:29.451981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":71,"num_write":43,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:32.283041+0000","last_change":"2024-09-22T08:42:17.430839+0000","last_active":"2024-09-22T08:53:32.283041+0000","last_peered":"2024-09-22T08:53:32.283041+0000","last_clean":"2024-09-22T08:53:32.283041+0000","last_became_active":"2024-09-22T08:42:17.429927+0000","last_became_peered":"2024-09-22T08:42:17.429927+0000","last_unstale":"2024-09-22T08:53:32.283041+0000","last_undegraded":"2024-09-22T08:53:32.283041+0000","last_fullsized":"2024-09-22T08:53:32.283041+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:28:06.806210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"263'5","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:58.388987+0000","last_change":"2024-09-22T08:31:14.253906+0000","last_active":"2024-09-22T08:52:58.388987+0000","last_peered":"2024-09-22T08:52:58.388987+0000","last_clean":"2024-09-22T08:52:58.388987+0000","last_became_active":"2024-09-22T08:31:14.253610+0000","last_became_peered":"2024-09-22T08:31:14.253610+0000","last_unstale":"2024-09-22T08:52:58.388987+0000","last_undegraded":"2024-09-22T08:52:58.388987+0000","last_fullsized":"2024-09-22T08:52:58.388987+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:13:39.366489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":13314,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"263'4","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.380507+0000","last_change":"2024-09-22T08:31:11.217832+0000","last_active":"2024-09-22T08:56:16.380507+0000","last_peered":"2024-09-22T08:56:16.380507+0000","last_clean":"2024-09-22T08:56:16.380507+0000","last_became_active":"2024-09-22T08:31:11.217553+0000","last_became_peered":"2024-09-22T08:31:11.217553+0000","last_unstale":"2024-09-22T08:56:16.380507+0000","last_undegraded":"2024-09-22T08:56:16.380507+0000","last_fullsized":"2024-09-22T08:56:16.380507+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:22:26.456715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"263'36","reported_seq":134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:57.268762+0000","last_change":"2024-09-22T08:29:26.070957+0000","last_active":"2024-09-22T08:51:57.268762+0000","last_peered":"2024-09-22T08:51:57.268762+0000","last_clean":"2024-09-22T08:51:57.268762+0000","last_became_active":"2024-09-22T08:29:26.070671+0000","last_became_peered":"2024-09-22T08:29:26.070671+0000","last_unstale":"2024-09-22T08:51:57.268762+0000","last_undegraded":"2024-09-22T08:51:57.268762+0000","last_fullsized":"2024-09-22T08:51:57.268762+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:28:38.453942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":255,"num_read_kb":155,"num_write":90,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:36.270019+0000","last_change":"2024-09-22T08:42:17.433684+0000","last_active":"2024-09-22T08:53:36.270019+0000","last_peered":"2024-09-22T08:53:36.270019+0000","last_clean":"2024-09-22T08:53:36.270019+0000","last_became_active":"2024-09-22T08:42:17.433331+0000","last_became_peered":"2024-09-22T08:42:17.433331+0000","last_unstale":"2024-09-22T08:53:36.270019+0000","last_undegraded":"2024-09-22T08:53:36.270019+0000","last_fullsized":"2024-09-22T08:53:36.270019+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:19:35.698543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"263'3","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:56.264954+0000","last_change":"2024-09-22T08:31:14.253520+0000","last_active":"2024-09-22T08:52:56.264954+0000","last_peered":"2024-09-22T08:52:56.264954+0000","last_clean":"2024-09-22T08:52:56.264954+0000","last_became_active":"2024-09-22T08:31:14.253118+0000","last_became_peered":"2024-09-22T08:31:14.253118+0000","last_unstale":"2024-09-22T08:52:56.264954+0000","last_undegraded":"2024-09-22T08:52:56.264954+0000","last_fullsized":"2024-09-22T08:52:56.264954+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:35:19.513521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"263'9","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:02.296482+0000","last_change":"2024-09-22T08:31:11.212852+0000","last_active":"2024-09-22T08:55:02.296482+0000","last_peered":"2024-09-22T08:55:02.296482+0000","last_clean":"2024-09-22T08:55:02.296482+0000","last_became_active":"2024-09-22T08:31:11.211939+0000","last_became_peered":"2024-09-22T08:31:11.211939+0000","last_unstale":"2024-09-22T08:55:02.296482+0000","last_undegraded":"2024-09-22T08:55:02.296482+0000","last_fullsized":"2024-09-22T08:55:02.296482+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:24:50.321996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":24578,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"263'43","reported_seq":155,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:21.268004+0000","last_change":"2024-09-22T08:29:26.069502+0000","last_active":"2024-09-22T08:53:21.268004+0000","last_peered":"2024-09-22T08:53:21.268004+0000","last_clean":"2024-09-22T08:53:21.268004+0000","last_became_active":"2024-09-22T08:29:26.069202+0000","last_became_peered":"2024-09-22T08:29:26.069202+0000","last_unstale":"2024-09-22T08:53:21.268004+0000","last_undegraded":"2024-09-22T08:53:21.268004+0000","last_fullsized":"2024-09-22T08:53:21.268004+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:00:21.857731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":316,"num_read_kb":207,"num_write":121,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:33.476466+0000","last_change":"2024-09-22T08:42:17.436971+0000","last_active":"2024-09-22T08:53:33.476466+0000","last_peered":"2024-09-22T08:53:33.476466+0000","last_clean":"2024-09-22T08:53:33.476466+0000","last_became_active":"2024-09-22T08:42:17.436036+0000","last_became_peered":"2024-09-22T08:42:17.436036+0000","last_unstale":"2024-09-22T08:53:33.476466+0000","last_undegraded":"2024-09-22T08:53:33.476466+0000","last_fullsized":"2024-09-22T08:53:33.476466+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:15:23.383676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"260'6","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:47.284803+0000","last_change":"2024-09-22T08:31:14.260840+0000","last_active":"2024-09-22T08:53:47.284803+0000","last_peered":"2024-09-22T08:53:47.284803+0000","last_clean":"2024-09-22T08:53:47.284803+0000","last_became_active":"2024-09-22T08:31:14.260111+0000","last_became_peered":"2024-09-22T08:31:14.260111+0000","last_unstale":"2024-09-22T08:53:47.284803+0000","last_undegraded":"2024-09-22T08:53:47.284803+0000","last_fullsized":"2024-09-22T08:53:47.284803+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:54:00.288860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"263'5","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.322290+0000","last_change":"2024-09-22T08:31:11.213758+0000","last_active":"2024-09-22T08:56:16.322290+0000","last_peered":"2024-09-22T08:56:16.322290+0000","last_clean":"2024-09-22T08:56:16.322290+0000","last_became_active":"2024-09-22T08:31:11.213121+0000","last_became_peered":"2024-09-22T08:31:11.213121+0000","last_unstale":"2024-09-22T08:56:16.322290+0000","last_undegraded":"2024-09-22T08:56:16.322290+0000","last_fullsized":"2024-09-22T08:56:16.322290+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:13:15.074520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"263'24","reported_seq":106,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:17.280800+0000","last_change":"2024-09-22T08:29:26.068711+0000","last_active":"2024-09-22T08:53:17.280800+0000","last_peered":"2024-09-22T08:53:17.280800+0000","last_clean":"2024-09-22T08:53:17.280800+0000","last_became_active":"2024-09-22T08:29:26.068397+0000","last_became_peered":"2024-09-22T08:29:26.068397+0000","last_unstale":"2024-09-22T08:53:17.280800+0000","last_undegraded":"2024-09-22T08:53:17.280800+0000","last_fullsized":"2024-09-22T08:53:17.280800+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:31:42.395480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":108,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:32.292011+0000","last_change":"2024-09-22T08:42:17.431775+0000","last_active":"2024-09-22T08:53:32.292011+0000","last_peered":"2024-09-22T08:53:32.292011+0000","last_clean":"2024-09-22T08:53:32.292011+0000","last_became_active":"2024-09-22T08:42:17.431476+0000","last_became_peered":"2024-09-22T08:42:17.431476+0000","last_unstale":"2024-09-22T08:53:32.292011+0000","last_undegraded":"2024-09-22T08:53:32.292011+0000","last_fullsized":"2024-09-22T08:53:32.292011+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:20.126935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"263'1","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:58.472094+0000","last_change":"2024-09-22T08:31:14.257816+0000","last_active":"2024-09-22T08:52:58.472094+0000","last_peered":"2024-09-22T08:52:58.472094+0000","last_clean":"2024-09-22T08:52:58.472094+0000","last_became_active":"2024-09-22T08:31:14.257508+0000","last_became_peered":"2024-09-22T08:31:14.257508+0000","last_unstale":"2024-09-22T08:52:58.472094+0000","last_undegraded":"2024-09-22T08:52:58.472094+0000","last_fullsized":"2024-09-22T08:52:58.472094+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:30.899995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:43.394740+0000","last_change":"2024-09-22T08:31:11.215332+0000","last_active":"2024-09-22T08:53:43.394740+0000","last_peered":"2024-09-22T08:53:43.394740+0000","last_clean":"2024-09-22T08:53:43.394740+0000","last_became_active":"2024-09-22T08:31:11.214953+0000","last_became_peered":"2024-09-22T08:31:11.214953+0000","last_unstale":"2024-09-22T08:53:43.394740+0000","last_undegraded":"2024-09-22T08:53:43.394740+0000","last_fullsized":"2024-09-22T08:53:43.394740+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:54:54.175587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"263'16","reported_seq":88,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:18.474308+0000","last_change":"2024-09-22T08:29:26.072747+0000","last_active":"2024-09-22T08:53:18.474308+0000","last_peered":"2024-09-22T08:53:18.474308+0000","last_clean":"2024-09-22T08:53:18.474308+0000","last_became_active":"2024-09-22T08:29:26.072473+0000","last_became_peered":"2024-09-22T08:29:26.072473+0000","last_unstale":"2024-09-22T08:53:18.474308+0000","last_undegraded":"2024-09-22T08:53:18.474308+0000","last_fullsized":"2024-09-22T08:53:18.474308+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:22.926382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":83,"num_write":41,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:43.469960+0000","last_change":"2024-09-22T08:42:17.431917+0000","last_active":"2024-09-22T08:52:43.469960+0000","last_peered":"2024-09-22T08:52:43.469960+0000","last_clean":"2024-09-22T08:52:43.469960+0000","last_became_active":"2024-09-22T08:42:17.431637+0000","last_became_peered":"2024-09-22T08:42:17.431637+0000","last_unstale":"2024-09-22T08:52:43.469960+0000","last_undegraded":"2024-09-22T08:52:43.469960+0000","last_fullsized":"2024-09-22T08:52:43.469960+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:33:12.811194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"263'4","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.434444+0000","last_change":"2024-09-22T08:31:14.261671+0000","last_active":"2024-09-22T08:56:16.434444+0000","last_peered":"2024-09-22T08:56:16.434444+0000","last_clean":"2024-09-22T08:56:16.434444+0000","last_became_active":"2024-09-22T08:31:14.261352+0000","last_became_peered":"2024-09-22T08:31:14.261352+0000","last_unstale":"2024-09-22T08:56:16.434444+0000","last_undegraded":"2024-09-22T08:56:16.434444+0000","last_fullsized":"2024-09-22T08:56:16.434444+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:19:15.325599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"263'5","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:08.397654+0000","last_change":"2024-09-22T08:31:11.216385+0000","last_active":"2024-09-22T08:54:08.397654+0000","last_peered":"2024-09-22T08:54:08.397654+0000","last_clean":"2024-09-22T08:54:08.397654+0000","last_became_active":"2024-09-22T08:31:11.216081+0000","last_became_peered":"2024-09-22T08:31:11.216081+0000","last_unstale":"2024-09-22T08:54:08.397654+0000","last_undegraded":"2024-09-22T08:54:08.397654+0000","last_fullsized":"2024-09-22T08:54:08.397654+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:17:40.729275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":5,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"253'4","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:17.402881+0000","last_change":"2024-09-22T08:29:26.073082+0000","last_active":"2024-09-22T08:53:17.402881+0000","last_peered":"2024-09-22T08:53:17.402881+0000","last_clean":"2024-09-22T08:53:17.402881+0000","last_became_active":"2024-09-22T08:29:26.072681+0000","last_became_peered":"2024-09-22T08:29:26.072681+0000","last_unstale":"2024-09-22T08:53:17.402881+0000","last_undegraded":"2024-09-22T08:53:17.402881+0000","last_fullsized":"2024-09-22T08:53:17.402881+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:10:40.106076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:43.469980+0000","last_change":"2024-09-22T08:42:17.432516+0000","last_active":"2024-09-22T08:52:43.469980+0000","last_peered":"2024-09-22T08:52:43.469980+0000","last_clean":"2024-09-22T08:52:43.469980+0000","last_became_active":"2024-09-22T08:42:17.430084+0000","last_became_peered":"2024-09-22T08:42:17.430084+0000","last_unstale":"2024-09-22T08:52:43.469980+0000","last_undegraded":"2024-09-22T08:52:43.469980+0000","last_fullsized":"2024-09-22T08:52:43.469980+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:34:54.878963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"260'2","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:12.288667+0000","last_change":"2024-09-22T08:31:14.259915+0000","last_active":"2024-09-22T08:54:12.288667+0000","last_peered":"2024-09-22T08:54:12.288667+0000","last_clean":"2024-09-22T08:54:12.288667+0000","last_became_active":"2024-09-22T08:31:14.259624+0000","last_became_peered":"2024-09-22T08:31:14.259624+0000","last_unstale":"2024-09-22T08:54:12.288667+0000","last_undegraded":"2024-09-22T08:54:12.288667+0000","last_fullsized":"2024-09-22T08:54:12.288667+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:44:39.512910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"263'5","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.510695+0000","last_change":"2024-09-22T08:31:11.214838+0000","last_active":"2024-09-22T08:56:16.510695+0000","last_peered":"2024-09-22T08:56:16.510695+0000","last_clean":"2024-09-22T08:56:16.510695+0000","last_became_active":"2024-09-22T08:31:11.214279+0000","last_became_peered":"2024-09-22T08:31:11.214279+0000","last_unstale":"2024-09-22T08:56:16.510695+0000","last_undegraded":"2024-09-22T08:56:16.510695+0000","last_fullsized":"2024-09-22T08:56:16.510695+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:50:49.253194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"263'2","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:18.391441+0000","last_change":"2024-09-22T08:29:26.075341+0000","last_active":"2024-09-22T08:53:18.391441+0000","last_peered":"2024-09-22T08:53:18.391441+0000","last_clean":"2024-09-22T08:53:18.391441+0000","last_became_active":"2024-09-22T08:29:26.074971+0000","last_became_peered":"2024-09-22T08:29:26.074971+0000","last_unstale":"2024-09-22T08:53:18.391441+0000","last_undegraded":"2024-09-22T08:53:18.391441+0000","last_fullsized":"2024-09-22T08:53:18.391441+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:38:15.699643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:22.272596+0000","last_change":"2024-09-22T08:42:17.433389+0000","last_active":"2024-09-22T08:52:22.272596+0000","last_peered":"2024-09-22T08:52:22.272596+0000","last_clean":"2024-09-22T08:52:22.272596+0000","last_became_active":"2024-09-22T08:42:17.433090+0000","last_became_peered":"2024-09-22T08:42:17.433090+0000","last_unstale":"2024-09-22T08:52:22.272596+0000","last_undegraded":"2024-09-22T08:52:22.272596+0000","last_fullsized":"2024-09-22T08:52:22.272596+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:05:15.147705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"260'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:53.471440+0000","last_change":"2024-09-22T08:31:14.257105+0000","last_active":"2024-09-22T08:52:53.471440+0000","last_peered":"2024-09-22T08:52:53.471440+0000","last_clean":"2024-09-22T08:52:53.471440+0000","last_became_active":"2024-09-22T08:31:14.256835+0000","last_became_peered":"2024-09-22T08:31:14.256835+0000","last_unstale":"2024-09-22T08:52:53.471440+0000","last_undegraded":"2024-09-22T08:52:53.471440+0000","last_fullsized":"2024-09-22T08:52:53.471440+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:01:16.187889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"263'3","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:51.264489+0000","last_change":"2024-09-22T08:31:11.212839+0000","last_active":"2024-09-22T08:52:51.264489+0000","last_peered":"2024-09-22T08:52:51.264489+0000","last_clean":"2024-09-22T08:52:51.264489+0000","last_became_active":"2024-09-22T08:31:11.212487+0000","last_became_peered":"2024-09-22T08:31:11.212487+0000","last_unstale":"2024-09-22T08:52:51.264489+0000","last_undegraded":"2024-09-22T08:52:51.264489+0000","last_fullsized":"2024-09-22T08:52:51.264489+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:30:25.357785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"263'131","reported_seq":431,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:50.453613+0000","last_change":"2024-09-22T08:29:26.067437+0000","last_active":"2024-09-22T08:53:50.453613+0000","last_peered":"2024-09-22T08:53:50.453613+0000","last_clean":"2024-09-22T08:53:50.453613+0000","last_became_active":"2024-09-22T08:29:26.067149+0000","last_became_peered":"2024-09-22T08:29:26.067149+0000","last_unstale":"2024-09-22T08:53:50.453613+0000","last_undegraded":"2024-09-22T08:53:50.453613+0000","last_fullsized":"2024-09-22T08:53:50.453613+0000","mapping_epoch":252,"log_start":"260'100","ondisk_log_start":"260'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:08:58.265926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1238,"num_read_kb":970,"num_write":283,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:43.387307+0000","last_change":"2024-09-22T08:42:17.435234+0000","last_active":"2024-09-22T08:52:43.387307+0000","last_peered":"2024-09-22T08:52:43.387307+0000","last_clean":"2024-09-22T08:52:43.387307+0000","last_became_active":"2024-09-22T08:42:17.434424+0000","last_became_peered":"2024-09-22T08:42:17.434424+0000","last_unstale":"2024-09-22T08:52:43.387307+0000","last_undegraded":"2024-09-22T08:52:43.387307+0000","last_fullsized":"2024-09-22T08:52:43.387307+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:58:01.260992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"260'9","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:58.389082+0000","last_change":"2024-09-22T08:31:14.255605+0000","last_active":"2024-09-22T08:52:58.389082+0000","last_peered":"2024-09-22T08:52:58.389082+0000","last_clean":"2024-09-22T08:52:58.389082+0000","last_became_active":"2024-09-22T08:31:14.255160+0000","last_became_peered":"2024-09-22T08:31:14.255160+0000","last_unstale":"2024-09-22T08:52:58.389082+0000","last_undegraded":"2024-09-22T08:52:58.389082+0000","last_fullsized":"2024-09-22T08:52:58.389082+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:32:19.999119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":23554,"num_write":14,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:53.388519+0000","last_change":"2024-09-22T08:31:11.216563+0000","last_active":"2024-09-22T08:52:53.388519+0000","last_peered":"2024-09-22T08:52:53.388519+0000","last_clean":"2024-09-22T08:52:53.388519+0000","last_became_active":"2024-09-22T08:31:11.216271+0000","last_became_peered":"2024-09-22T08:31:11.216271+0000","last_unstale":"2024-09-22T08:52:53.388519+0000","last_undegraded":"2024-09-22T08:52:53.388519+0000","last_fullsized":"2024-09-22T08:52:53.388519+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:55:11.448805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"263'19","reported_seq":97,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:22.282291+0000","last_change":"2024-09-22T08:29:26.070044+0000","last_active":"2024-09-22T08:52:22.282291+0000","last_peered":"2024-09-22T08:52:22.282291+0000","last_clean":"2024-09-22T08:52:22.282291+0000","last_became_active":"2024-09-22T08:29:26.069730+0000","last_became_peered":"2024-09-22T08:29:26.069730+0000","last_unstale":"2024-09-22T08:52:22.282291+0000","last_undegraded":"2024-09-22T08:52:22.282291+0000","last_fullsized":"2024-09-22T08:52:22.282291+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:21:35.672741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":95,"num_write":48,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:07.288626+0000","last_change":"2024-09-22T08:42:17.419131+0000","last_active":"2024-09-22T08:53:07.288626+0000","last_peered":"2024-09-22T08:53:07.288626+0000","last_clean":"2024-09-22T08:53:07.288626+0000","last_became_active":"2024-09-22T08:42:17.418864+0000","last_became_peered":"2024-09-22T08:42:17.418864+0000","last_unstale":"2024-09-22T08:53:07.288626+0000","last_undegraded":"2024-09-22T08:53:07.288626+0000","last_fullsized":"2024-09-22T08:53:07.288626+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:05:15.592372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"263'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.434270+0000","last_change":"2024-09-22T08:31:14.259787+0000","last_active":"2024-09-22T08:56:16.434270+0000","last_peered":"2024-09-22T08:56:16.434270+0000","last_clean":"2024-09-22T08:56:16.434270+0000","last_became_active":"2024-09-22T08:31:14.259485+0000","last_became_peered":"2024-09-22T08:31:14.259485+0000","last_unstale":"2024-09-22T08:56:16.434270+0000","last_undegraded":"2024-09-22T08:56:16.434270+0000","last_fullsized":"2024-09-22T08:56:16.434270+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:38:49.843585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"260'5","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:16.267265+0000","last_change":"2024-09-22T08:31:11.211139+0000","last_active":"2024-09-22T08:53:16.267265+0000","last_peered":"2024-09-22T08:53:16.267265+0000","last_clean":"2024-09-22T08:53:16.267265+0000","last_became_active":"2024-09-22T08:31:11.210835+0000","last_became_peered":"2024-09-22T08:31:11.210835+0000","last_unstale":"2024-09-22T08:53:16.267265+0000","last_undegraded":"2024-09-22T08:53:16.267265+0000","last_fullsized":"2024-09-22T08:53:16.267265+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:48:20.118083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"263'36","reported_seq":145,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:21.260531+0000","last_change":"2024-09-22T08:29:26.068377+0000","last_active":"2024-09-22T08:52:21.260531+0000","last_peered":"2024-09-22T08:52:21.260531+0000","last_clean":"2024-09-22T08:52:21.260531+0000","last_became_active":"2024-09-22T08:29:26.068105+0000","last_became_peered":"2024-09-22T08:29:26.068105+0000","last_unstale":"2024-09-22T08:52:21.260531+0000","last_undegraded":"2024-09-22T08:52:21.260531+0000","last_fullsized":"2024-09-22T08:52:21.260531+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:08:26.567273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":308,"num_read_kb":184,"num_write":90,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:07.401463+0000","last_change":"2024-09-22T08:42:17.435288+0000","last_active":"2024-09-22T08:53:07.401463+0000","last_peered":"2024-09-22T08:53:07.401463+0000","last_clean":"2024-09-22T08:53:07.401463+0000","last_became_active":"2024-09-22T08:42:17.434953+0000","last_became_peered":"2024-09-22T08:42:17.434953+0000","last_unstale":"2024-09-22T08:53:07.401463+0000","last_undegraded":"2024-09-22T08:53:07.401463+0000","last_fullsized":"2024-09-22T08:53:07.401463+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:45:12.549260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"260'2","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:18.391339+0000","last_change":"2024-09-22T08:31:14.255977+0000","last_active":"2024-09-22T08:53:18.391339+0000","last_peered":"2024-09-22T08:53:18.391339+0000","last_clean":"2024-09-22T08:53:18.391339+0000","last_became_active":"2024-09-22T08:31:14.255534+0000","last_became_peered":"2024-09-22T08:31:14.255534+0000","last_unstale":"2024-09-22T08:53:18.391339+0000","last_undegraded":"2024-09-22T08:53:18.391339+0000","last_fullsized":"2024-09-22T08:53:18.391339+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:09:54.469702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"263'5","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:08.397594+0000","last_change":"2024-09-22T08:31:11.214320+0000","last_active":"2024-09-22T08:54:08.397594+0000","last_peered":"2024-09-22T08:54:08.397594+0000","last_clean":"2024-09-22T08:54:08.397594+0000","last_became_active":"2024-09-22T08:31:11.213851+0000","last_became_peered":"2024-09-22T08:31:11.213851+0000","last_unstale":"2024-09-22T08:54:08.397594+0000","last_undegraded":"2024-09-22T08:54:08.397594+0000","last_fullsized":"2024-09-22T08:54:08.397594+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:24:21.493458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":6146,"num_write":5,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"263'4","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:23.384458+0000","last_change":"2024-09-22T08:29:26.075210+0000","last_active":"2024-09-22T08:52:23.384458+0000","last_peered":"2024-09-22T08:52:23.384458+0000","last_clean":"2024-09-22T08:52:23.384458+0000","last_became_active":"2024-09-22T08:29:26.074907+0000","last_became_peered":"2024-09-22T08:29:26.074907+0000","last_unstale":"2024-09-22T08:52:23.384458+0000","last_undegraded":"2024-09-22T08:52:23.384458+0000","last_fullsized":"2024-09-22T08:52:23.384458+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:03:30.755739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:42.275910+0000","last_change":"2024-09-22T08:42:17.430325+0000","last_active":"2024-09-22T08:52:42.275910+0000","last_peered":"2024-09-22T08:52:42.275910+0000","last_clean":"2024-09-22T08:52:42.275910+0000","last_became_active":"2024-09-22T08:42:17.429341+0000","last_became_peered":"2024-09-22T08:42:17.429341+0000","last_unstale":"2024-09-22T08:52:42.275910+0000","last_undegraded":"2024-09-22T08:52:42.275910+0000","last_fullsized":"2024-09-22T08:52:42.275910+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:58:45.447447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"263'2","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:11.274127+0000","last_change":"2024-09-22T08:31:14.246719+0000","last_active":"2024-09-22T08:54:11.274127+0000","last_peered":"2024-09-22T08:54:11.274127+0000","last_clean":"2024-09-22T08:54:11.274127+0000","last_became_active":"2024-09-22T08:31:14.246417+0000","last_became_peered":"2024-09-22T08:31:14.246417+0000","last_unstale":"2024-09-22T08:54:11.274127+0000","last_undegraded":"2024-09-22T08:54:11.274127+0000","last_fullsized":"2024-09-22T08:54:11.274127+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:41:02.060530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"263'9","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.381511+0000","last_change":"2024-09-22T08:31:11.211394+0000","last_active":"2024-09-22T08:56:16.381511+0000","last_peered":"2024-09-22T08:56:16.381511+0000","last_clean":"2024-09-22T08:56:16.381511+0000","last_became_active":"2024-09-22T08:31:11.211079+0000","last_became_peered":"2024-09-22T08:31:11.211079+0000","last_unstale":"2024-09-22T08:56:16.381511+0000","last_undegraded":"2024-09-22T08:56:16.381511+0000","last_fullsized":"2024-09-22T08:56:16.381511+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:24:21.252446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10242,"num_write":14,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"263'18","reported_seq":88,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:23.384401+0000","last_change":"2024-09-22T08:29:26.068293+0000","last_active":"2024-09-22T08:52:23.384401+0000","last_peered":"2024-09-22T08:52:23.384401+0000","last_clean":"2024-09-22T08:52:23.384401+0000","last_became_active":"2024-09-22T08:29:26.067964+0000","last_became_peered":"2024-09-22T08:29:26.067964+0000","last_unstale":"2024-09-22T08:52:23.384401+0000","last_undegraded":"2024-09-22T08:52:23.384401+0000","last_fullsized":"2024-09-22T08:52:23.384401+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:41:20.023712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":85,"num_write":46,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:43.387400+0000","last_change":"2024-09-22T08:42:17.438619+0000","last_active":"2024-09-22T08:52:43.387400+0000","last_peered":"2024-09-22T08:52:43.387400+0000","last_clean":"2024-09-22T08:52:43.387400+0000","last_became_active":"2024-09-22T08:42:17.438318+0000","last_became_peered":"2024-09-22T08:42:17.438318+0000","last_unstale":"2024-09-22T08:52:43.387400+0000","last_undegraded":"2024-09-22T08:52:43.387400+0000","last_fullsized":"2024-09-22T08:52:43.387400+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:18:22.838300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:11.274093+0000","last_change":"2024-09-22T08:31:14.258446+0000","last_active":"2024-09-22T08:54:11.274093+0000","last_peered":"2024-09-22T08:54:11.274093+0000","last_clean":"2024-09-22T08:54:11.274093+0000","last_became_active":"2024-09-22T08:31:14.258136+0000","last_became_peered":"2024-09-22T08:31:14.258136+0000","last_unstale":"2024-09-22T08:54:11.274093+0000","last_undegraded":"2024-09-22T08:54:11.274093+0000","last_fullsized":"2024-09-22T08:54:11.274093+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:09:06.068754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"263'1","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:08.397264+0000","last_change":"2024-09-22T08:31:11.214416+0000","last_active":"2024-09-22T08:54:08.397264+0000","last_peered":"2024-09-22T08:54:08.397264+0000","last_clean":"2024-09-22T08:54:08.397264+0000","last_became_active":"2024-09-22T08:31:11.214112+0000","last_became_peered":"2024-09-22T08:31:11.214112+0000","last_unstale":"2024-09-22T08:54:08.397264+0000","last_undegraded":"2024-09-22T08:54:08.397264+0000","last_fullsized":"2024-09-22T08:54:08.397264+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:13:58.692971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"263'20","reported_seq":98,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:31.269276+0000","last_change":"2024-09-22T08:29:26.069691+0000","last_active":"2024-09-22T08:53:31.269276+0000","last_peered":"2024-09-22T08:53:31.269276+0000","last_clean":"2024-09-22T08:53:31.269276+0000","last_became_active":"2024-09-22T08:29:26.069407+0000","last_became_peered":"2024-09-22T08:29:26.069407+0000","last_unstale":"2024-09-22T08:53:31.269276+0000","last_undegraded":"2024-09-22T08:53:31.269276+0000","last_fullsized":"2024-09-22T08:53:31.269276+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:46:12.719810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":95,"num_write":53,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"263'218","reported_seq":855,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:19.551923+0000","last_change":"2024-09-22T08:15:04.957845+0000","last_active":"2024-09-22T08:54:19.551923+0000","last_peered":"2024-09-22T08:54:19.551923+0000","last_clean":"2024-09-22T08:54:19.551923+0000","last_became_active":"2024-09-22T08:15:04.957090+0000","last_became_peered":"2024-09-22T08:15:04.957090+0000","last_unstale":"2024-09-22T08:54:19.551923+0000","last_undegraded":"2024-09-22T08:54:19.551923+0000","last_fullsized":"2024-09-22T08:54:19.551923+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:32:54.449746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6325712,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":578,"num_read_kb":1123,"num_write":1108,"num_write_kb":27318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"263'475","reported_seq":2198,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.479858+0000","last_change":"2024-09-22T08:15:06.981247+0000","last_active":"2024-09-22T08:54:41.479858+0000","last_peered":"2024-09-22T08:54:41.479858+0000","last_clean":"2024-09-22T08:54:41.479858+0000","last_became_active":"2024-09-22T08:15:06.980616+0000","last_became_peered":"2024-09-22T08:15:06.980616+0000","last_unstale":"2024-09-22T08:54:41.479858+0000","last_undegraded":"2024-09-22T08:54:41.479858+0000","last_fullsized":"2024-09-22T08:54:41.479858+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:58:53.792749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2847,"num_read_kb":2707,"num_write":560,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"263'239","reported_seq":875,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.532805+0000","last_change":"2024-09-22T08:15:04.957479+0000","last_active":"2024-09-22T08:56:16.532805+0000","last_peered":"2024-09-22T08:56:16.532805+0000","last_clean":"2024-09-22T08:56:16.532805+0000","last_became_active":"2024-09-22T08:15:04.956643+0000","last_became_peered":"2024-09-22T08:15:04.956643+0000","last_unstale":"2024-09-22T08:56:16.532805+0000","last_undegraded":"2024-09-22T08:56:16.532805+0000","last_fullsized":"2024-09-22T08:56:16.532805+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:23:49.336948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":599,"num_read_kb":19417,"num_write":1105,"num_write_kb":24732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"263'386","reported_seq":1918,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:17.378056+0000","last_change":"2024-09-22T08:15:06.974580+0000","last_active":"2024-09-22T08:54:17.378056+0000","last_peered":"2024-09-22T08:54:17.378056+0000","last_clean":"2024-09-22T08:54:17.378056+0000","last_became_active":"2024-09-22T08:15:06.974127+0000","last_became_peered":"2024-09-22T08:15:06.974127+0000","last_unstale":"2024-09-22T08:54:17.378056+0000","last_undegraded":"2024-09-22T08:54:17.378056+0000","last_fullsized":"2024-09-22T08:54:17.378056+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:33:05.581133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2097,"num_read_kb":2016,"num_write":427,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"263'254","reported_seq":921,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.464973+0000","last_change":"2024-09-22T08:15:04.956999+0000","last_active":"2024-09-22T08:56:16.464973+0000","last_peered":"2024-09-22T08:56:16.464973+0000","last_clean":"2024-09-22T08:56:16.464973+0000","last_became_active":"2024-09-22T08:15:04.956659+0000","last_became_peered":"2024-09-22T08:15:04.956659+0000","last_unstale":"2024-09-22T08:56:16.464973+0000","last_undegraded":"2024-09-22T08:56:16.464973+0000","last_fullsized":"2024-09-22T08:56:16.464973+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:42:55.552056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":699,"num_read_kb":25466,"num_write":1131,"num_write_kb":27131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"263'898","reported_seq":2493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.960994+0000","last_change":"2024-09-22T08:15:06.969243+0000","last_active":"2024-09-22T08:54:27.960994+0000","last_peered":"2024-09-22T08:54:27.960994+0000","last_clean":"2024-09-22T08:54:27.960994+0000","last_became_active":"2024-09-22T08:15:06.968959+0000","last_became_peered":"2024-09-22T08:15:06.968959+0000","last_unstale":"2024-09-22T08:54:27.960994+0000","last_undegraded":"2024-09-22T08:54:27.960994+0000","last_fullsized":"2024-09-22T08:54:27.960994+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":800,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:30:18.722556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4516,"num_read_kb":4043,"num_write":1241,"num_write_kb":490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"263'227","reported_seq":864,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:54.926677+0000","last_change":"2024-09-22T08:15:04.961682+0000","last_active":"2024-09-22T08:55:54.926677+0000","last_peered":"2024-09-22T08:55:54.926677+0000","last_clean":"2024-09-22T08:55:54.926677+0000","last_became_active":"2024-09-22T08:15:04.961309+0000","last_became_peered":"2024-09-22T08:15:04.961309+0000","last_unstale":"2024-09-22T08:55:54.926677+0000","last_undegraded":"2024-09-22T08:55:54.926677+0000","last_fullsized":"2024-09-22T08:55:54.926677+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:32:00.847272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14713433,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":548,"num_read_kb":61449,"num_write":1033,"num_write_kb":33072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"263'535","reported_seq":2232,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:26.719838+0000","last_change":"2024-09-22T08:15:06.969850+0000","last_active":"2024-09-22T08:54:26.719838+0000","last_peered":"2024-09-22T08:54:26.719838+0000","last_clean":"2024-09-22T08:54:26.719838+0000","last_became_active":"2024-09-22T08:15:06.969540+0000","last_became_peered":"2024-09-22T08:15:06.969540+0000","last_unstale":"2024-09-22T08:54:26.719838+0000","last_undegraded":"2024-09-22T08:54:26.719838+0000","last_fullsized":"2024-09-22T08:54:26.719838+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:39:46.162178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2823,"num_read_kb":2637,"num_write":641,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"263'205","reported_seq":905,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:04.696447+0000","last_change":"2024-09-22T08:15:04.958005+0000","last_active":"2024-09-22T08:54:04.696447+0000","last_peered":"2024-09-22T08:54:04.696447+0000","last_clean":"2024-09-22T08:54:04.696447+0000","last_became_active":"2024-09-22T08:15:04.957717+0000","last_became_peered":"2024-09-22T08:15:04.957717+0000","last_unstale":"2024-09-22T08:54:04.696447+0000","last_undegraded":"2024-09-22T08:54:04.696447+0000","last_fullsized":"2024-09-22T08:54:04.696447+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:54:04.680306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12435334,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":712,"num_read_kb":166418,"num_write":947,"num_write_kb":57547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"263'603","reported_seq":2125,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:18.165751+0000","last_change":"2024-09-22T08:15:06.962885+0000","last_active":"2024-09-22T08:54:18.165751+0000","last_peered":"2024-09-22T08:54:18.165751+0000","last_clean":"2024-09-22T08:54:18.165751+0000","last_became_active":"2024-09-22T08:15:06.962605+0000","last_became_peered":"2024-09-22T08:15:06.962605+0000","last_unstale":"2024-09-22T08:54:18.165751+0000","last_undegraded":"2024-09-22T08:54:18.165751+0000","last_fullsized":"2024-09-22T08:54:18.165751+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":500,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:20:20.581344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3087,"num_read_kb":2910,"num_write":853,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"263'248","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.428976+0000","last_change":"2024-09-22T08:15:04.962423+0000","last_active":"2024-09-22T08:54:38.428976+0000","last_peered":"2024-09-22T08:54:38.428976+0000","last_clean":"2024-09-22T08:54:38.428976+0000","last_became_active":"2024-09-22T08:15:04.962128+0000","last_became_peered":"2024-09-22T08:15:04.962128+0000","last_unstale":"2024-09-22T08:54:38.428976+0000","last_undegraded":"2024-09-22T08:54:38.428976+0000","last_fullsized":"2024-09-22T08:54:38.428976+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:42:18.164351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13663310,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":745,"num_read_kb":52063,"num_write":1231,"num_write_kb":44926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"263'868","reported_seq":2689,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.926078+0000","last_change":"2024-09-22T08:15:06.973142+0000","last_active":"2024-09-22T08:54:38.926078+0000","last_peered":"2024-09-22T08:54:38.926078+0000","last_clean":"2024-09-22T08:54:38.926078+0000","last_became_active":"2024-09-22T08:15:06.972756+0000","last_became_peered":"2024-09-22T08:15:06.972756+0000","last_unstale":"2024-09-22T08:54:38.926078+0000","last_undegraded":"2024-09-22T08:54:38.926078+0000","last_fullsized":"2024-09-22T08:54:38.926078+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":800,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:03:48.112288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4443,"num_read_kb":4056,"num_write":1153,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"263'243","reported_seq":909,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:48.816030+0000","last_change":"2024-09-22T08:15:04.945272+0000","last_active":"2024-09-22T08:53:48.816030+0000","last_peered":"2024-09-22T08:53:48.816030+0000","last_clean":"2024-09-22T08:53:48.816030+0000","last_became_active":"2024-09-22T08:15:04.944916+0000","last_became_peered":"2024-09-22T08:15:04.944916+0000","last_unstale":"2024-09-22T08:53:48.816030+0000","last_undegraded":"2024-09-22T08:53:48.816030+0000","last_fullsized":"2024-09-22T08:53:48.816030+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:27:56.610167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6353845,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":799,"num_read_kb":10946,"num_write":1069,"num_write_kb":28039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"263'555","reported_seq":2079,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:22.694280+0000","last_change":"2024-09-22T08:15:06.969137+0000","last_active":"2024-09-22T08:54:22.694280+0000","last_peered":"2024-09-22T08:54:22.694280+0000","last_clean":"2024-09-22T08:54:22.694280+0000","last_became_active":"2024-09-22T08:15:06.968853+0000","last_became_peered":"2024-09-22T08:15:06.968853+0000","last_unstale":"2024-09-22T08:54:22.694280+0000","last_undegraded":"2024-09-22T08:54:22.694280+0000","last_fullsized":"2024-09-22T08:54:22.694280+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:30:47.410362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2932,"num_read_kb":2656,"num_write":742,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"263'185","reported_seq":754,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.542818+0000","last_change":"2024-09-22T08:15:04.959783+0000","last_active":"2024-09-22T08:56:16.542818+0000","last_peered":"2024-09-22T08:56:16.542818+0000","last_clean":"2024-09-22T08:56:16.542818+0000","last_became_active":"2024-09-22T08:15:04.959395+0000","last_became_peered":"2024-09-22T08:15:04.959395+0000","last_unstale":"2024-09-22T08:56:16.542818+0000","last_undegraded":"2024-09-22T08:56:16.542818+0000","last_fullsized":"2024-09-22T08:56:16.542818+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:39:51.640256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":318,"num_read_kb":28967,"num_write":772,"num_write_kb":45290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"263'1560","reported_seq":3265,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:40.939260+0000","last_change":"2024-09-22T08:15:06.972382+0000","last_active":"2024-09-22T08:54:40.939260+0000","last_peered":"2024-09-22T08:54:40.939260+0000","last_clean":"2024-09-22T08:54:40.939260+0000","last_became_active":"2024-09-22T08:15:06.972074+0000","last_became_peered":"2024-09-22T08:15:06.972074+0000","last_unstale":"2024-09-22T08:54:40.939260+0000","last_undegraded":"2024-09-22T08:54:40.939260+0000","last_fullsized":"2024-09-22T08:54:40.939260+0000","mapping_epoch":25,"log_start":"263'1500","ondisk_log_start":"263'1500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":1500,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:28:04.310796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6961,"num_read_kb":6120,"num_write":2165,"num_write_kb":918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"263'483","reported_seq":2143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:40.939680+0000","last_change":"2024-09-22T08:15:06.966028+0000","last_active":"2024-09-22T08:54:40.939680+0000","last_peered":"2024-09-22T08:54:40.939680+0000","last_clean":"2024-09-22T08:54:40.939680+0000","last_became_active":"2024-09-22T08:15:06.965751+0000","last_became_peered":"2024-09-22T08:15:06.965751+0000","last_unstale":"2024-09-22T08:54:40.939680+0000","last_undegraded":"2024-09-22T08:54:40.939680+0000","last_fullsized":"2024-09-22T08:54:40.939680+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:49:12.402190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2631,"num_read_kb":2475,"num_write":578,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"263'206","reported_seq":849,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:18.411364+0000","last_change":"2024-09-22T08:15:04.953971+0000","last_active":"2024-09-22T08:53:18.411364+0000","last_peered":"2024-09-22T08:53:18.411364+0000","last_clean":"2024-09-22T08:53:18.411364+0000","last_became_active":"2024-09-22T08:15:04.953628+0000","last_became_peered":"2024-09-22T08:15:04.953628+0000","last_unstale":"2024-09-22T08:53:18.411364+0000","last_undegraded":"2024-09-22T08:53:18.411364+0000","last_fullsized":"2024-09-22T08:53:18.411364+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:19:43.155317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1699996,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":528,"num_read_kb":68585,"num_write":868,"num_write_kb":34888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"263'357","reported_seq":1735,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:25.944981+0000","last_change":"2024-09-22T08:15:06.969299+0000","last_active":"2024-09-22T08:54:25.944981+0000","last_peered":"2024-09-22T08:54:25.944981+0000","last_clean":"2024-09-22T08:54:25.944981+0000","last_became_active":"2024-09-22T08:15:06.968970+0000","last_became_peered":"2024-09-22T08:15:06.968970+0000","last_unstale":"2024-09-22T08:54:25.944981+0000","last_undegraded":"2024-09-22T08:54:25.944981+0000","last_fullsized":"2024-09-22T08:54:25.944981+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:38:44.711239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2053,"num_read_kb":1926,"num_write":427,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"263'223","reported_seq":854,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:17.312246+0000","last_change":"2024-09-22T08:15:04.967060+0000","last_active":"2024-09-22T08:54:17.312246+0000","last_peered":"2024-09-22T08:54:17.312246+0000","last_clean":"2024-09-22T08:54:17.312246+0000","last_became_active":"2024-09-22T08:15:04.966769+0000","last_became_peered":"2024-09-22T08:15:04.966769+0000","last_unstale":"2024-09-22T08:54:17.312246+0000","last_undegraded":"2024-09-22T08:54:17.312246+0000","last_fullsized":"2024-09-22T08:54:17.312246+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:56:04.347599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9763965,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":514,"num_read_kb":51014,"num_write":1099,"num_write_kb":43963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"263'468","reported_seq":1924,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:20.263692+0000","last_change":"2024-09-22T08:15:06.973138+0000","last_active":"2024-09-22T08:54:20.263692+0000","last_peered":"2024-09-22T08:54:20.263692+0000","last_clean":"2024-09-22T08:54:20.263692+0000","last_became_active":"2024-09-22T08:15:06.972821+0000","last_became_peered":"2024-09-22T08:15:06.972821+0000","last_unstale":"2024-09-22T08:54:20.263692+0000","last_undegraded":"2024-09-22T08:54:20.263692+0000","last_fullsized":"2024-09-22T08:54:20.263692+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:14.633460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2415,"num_read_kb":2238,"num_write":577,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"263'218","reported_seq":940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:57.751847+0000","last_change":"2024-09-22T08:15:04.956245+0000","last_active":"2024-09-22T08:55:57.751847+0000","last_peered":"2024-09-22T08:55:57.751847+0000","last_clean":"2024-09-22T08:55:57.751847+0000","last_became_active":"2024-09-22T08:15:04.955972+0000","last_became_peered":"2024-09-22T08:15:04.955972+0000","last_unstale":"2024-09-22T08:55:57.751847+0000","last_undegraded":"2024-09-22T08:55:57.751847+0000","last_fullsized":"2024-09-22T08:55:57.751847+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:47:06.545629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":381104,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":990,"num_read_kb":8164,"num_write":931,"num_write_kb":17459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"263'463","reported_seq":2079,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:40.939187+0000","last_change":"2024-09-22T08:15:06.972576+0000","last_active":"2024-09-22T08:54:40.939187+0000","last_peered":"2024-09-22T08:54:40.939187+0000","last_clean":"2024-09-22T08:54:40.939187+0000","last_became_active":"2024-09-22T08:15:06.972250+0000","last_became_peered":"2024-09-22T08:15:06.972250+0000","last_unstale":"2024-09-22T08:54:40.939187+0000","last_undegraded":"2024-09-22T08:54:40.939187+0000","last_fullsized":"2024-09-22T08:54:40.939187+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:26:28.387708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2654,"num_read_kb":2505,"num_write":533,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"263'239","reported_seq":881,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:48.478320+0000","last_change":"2024-09-22T08:15:04.955521+0000","last_active":"2024-09-22T08:53:48.478320+0000","last_peered":"2024-09-22T08:53:48.478320+0000","last_clean":"2024-09-22T08:53:48.478320+0000","last_became_active":"2024-09-22T08:15:04.954948+0000","last_became_peered":"2024-09-22T08:15:04.954948+0000","last_unstale":"2024-09-22T08:53:48.478320+0000","last_undegraded":"2024-09-22T08:53:48.478320+0000","last_fullsized":"2024-09-22T08:53:48.478320+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:55:10.800461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2190676,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":543,"num_read_kb":6536,"num_write":1080,"num_write_kb":24915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"263'385","reported_seq":1845,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:40.939101+0000","last_change":"2024-09-22T08:15:06.970282+0000","last_active":"2024-09-22T08:54:40.939101+0000","last_peered":"2024-09-22T08:54:40.939101+0000","last_clean":"2024-09-22T08:54:40.939101+0000","last_became_active":"2024-09-22T08:15:06.968651+0000","last_became_peered":"2024-09-22T08:15:06.968651+0000","last_unstale":"2024-09-22T08:54:40.939101+0000","last_undegraded":"2024-09-22T08:54:40.939101+0000","last_fullsized":"2024-09-22T08:54:40.939101+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:24:42.424031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2079,"num_read_kb":1977,"num_write":435,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"263'237","reported_seq":852,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:12.308091+0000","last_change":"2024-09-22T08:15:04.958944+0000","last_active":"2024-09-22T08:56:12.308091+0000","last_peered":"2024-09-22T08:56:12.308091+0000","last_clean":"2024-09-22T08:56:12.308091+0000","last_became_active":"2024-09-22T08:15:04.958578+0000","last_became_peered":"2024-09-22T08:15:04.958578+0000","last_unstale":"2024-09-22T08:56:12.308091+0000","last_undegraded":"2024-09-22T08:56:12.308091+0000","last_fullsized":"2024-09-22T08:56:12.308091+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:42:49.203289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":554,"num_read_kb":7725,"num_write":1073,"num_write_kb":35221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"263'573","reported_seq":2255,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:21.832642+0000","last_change":"2024-09-22T08:15:06.980925+0000","last_active":"2024-09-22T08:54:21.832642+0000","last_peered":"2024-09-22T08:54:21.832642+0000","last_clean":"2024-09-22T08:54:21.832642+0000","last_became_active":"2024-09-22T08:15:06.980621+0000","last_became_peered":"2024-09-22T08:15:06.980621+0000","last_unstale":"2024-09-22T08:54:21.832642+0000","last_undegraded":"2024-09-22T08:54:21.832642+0000","last_fullsized":"2024-09-22T08:54:21.832642+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":500,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:01.217800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3075,"num_read_kb":2832,"num_write":740,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"263'193","reported_seq":993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.473026+0000","last_change":"2024-09-22T08:15:04.952516+0000","last_active":"2024-09-22T08:56:16.473026+0000","last_peered":"2024-09-22T08:56:16.473026+0000","last_clean":"2024-09-22T08:56:16.473026+0000","last_became_active":"2024-09-22T08:15:04.952203+0000","last_became_peered":"2024-09-22T08:15:04.952203+0000","last_unstale":"2024-09-22T08:56:16.473026+0000","last_undegraded":"2024-09-22T08:56:16.473026+0000","last_fullsized":"2024-09-22T08:56:16.473026+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:30:00.993327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1058,"num_read_kb":8867,"num_write":911,"num_write_kb":21916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"263'139","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.532349+0000","last_change":"2024-09-22T08:15:15.011843+0000","last_active":"2024-09-22T08:54:41.532349+0000","last_peered":"2024-09-22T08:54:41.532349+0000","last_clean":"2024-09-22T08:54:41.532349+0000","last_became_active":"2024-09-22T08:15:15.011529+0000","last_became_peered":"2024-09-22T08:15:15.011529+0000","last_unstale":"2024-09-22T08:54:41.532349+0000","last_undegraded":"2024-09-22T08:54:41.532349+0000","last_fullsized":"2024-09-22T08:54:41.532349+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:25.703936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":192,"num_read_kb":186,"num_write":338,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"263'502","reported_seq":2104,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:26.719888+0000","last_change":"2024-09-22T08:15:06.968110+0000","last_active":"2024-09-22T08:54:26.719888+0000","last_peered":"2024-09-22T08:54:26.719888+0000","last_clean":"2024-09-22T08:54:26.719888+0000","last_became_active":"2024-09-22T08:15:06.967794+0000","last_became_peered":"2024-09-22T08:15:06.967794+0000","last_unstale":"2024-09-22T08:54:26.719888+0000","last_undegraded":"2024-09-22T08:54:26.719888+0000","last_fullsized":"2024-09-22T08:54:26.719888+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:18:56.559988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2789,"num_read_kb":2608,"num_write":647,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"263'214","reported_seq":859,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.861009+0000","last_change":"2024-09-22T08:15:04.964175+0000","last_active":"2024-09-22T08:54:38.861009+0000","last_peered":"2024-09-22T08:54:38.861009+0000","last_clean":"2024-09-22T08:54:38.861009+0000","last_became_active":"2024-09-22T08:15:04.963890+0000","last_became_peered":"2024-09-22T08:15:04.963890+0000","last_unstale":"2024-09-22T08:54:38.861009+0000","last_undegraded":"2024-09-22T08:54:38.861009+0000","last_fullsized":"2024-09-22T08:54:38.861009+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:19:35.111320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5671389,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":530,"num_read_kb":15199,"num_write":1083,"num_write_kb":18954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:48.395352+0000","last_change":"2024-09-22T08:15:08.968916+0000","last_active":"2024-09-22T08:53:48.395352+0000","last_peered":"2024-09-22T08:53:48.395352+0000","last_clean":"2024-09-22T08:53:48.395352+0000","last_became_active":"2024-09-22T08:15:08.968482+0000","last_became_peered":"2024-09-22T08:15:08.968482+0000","last_unstale":"2024-09-22T08:53:48.395352+0000","last_undegraded":"2024-09-22T08:53:48.395352+0000","last_fullsized":"2024-09-22T08:53:48.395352+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:17:40.343334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"263'192","reported_seq":791,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.348297+0000","last_change":"2024-09-22T08:15:10.987896+0000","last_active":"2024-09-22T08:56:16.348297+0000","last_peered":"2024-09-22T08:56:16.348297+0000","last_clean":"2024-09-22T08:56:16.348297+0000","last_became_active":"2024-09-22T08:15:10.987539+0000","last_became_peered":"2024-09-22T08:15:10.987539+0000","last_unstale":"2024-09-22T08:56:16.348297+0000","last_undegraded":"2024-09-22T08:56:16.348297+0000","last_fullsized":"2024-09-22T08:56:16.348297+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:00:01.634988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7203,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":254,"num_read_kb":315,"num_write":148,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:28.376501+0000","last_change":"2024-09-22T08:15:13.019038+0000","last_active":"2024-09-22T08:51:28.376501+0000","last_peered":"2024-09-22T08:51:28.376501+0000","last_clean":"2024-09-22T08:51:28.376501+0000","last_became_active":"2024-09-22T08:15:13.018750+0000","last_became_peered":"2024-09-22T08:15:13.018750+0000","last_unstale":"2024-09-22T08:51:28.376501+0000","last_undegraded":"2024-09-22T08:51:28.376501+0000","last_fullsized":"2024-09-22T08:51:28.376501+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:37:28.422394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"263'150","reported_seq":640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.301330+0000","last_change":"2024-09-22T08:15:15.020868+0000","last_active":"2024-09-22T08:54:41.301330+0000","last_peered":"2024-09-22T08:54:41.301330+0000","last_clean":"2024-09-22T08:54:41.301330+0000","last_became_active":"2024-09-22T08:15:15.020542+0000","last_became_peered":"2024-09-22T08:15:15.020542+0000","last_unstale":"2024-09-22T08:54:41.301330+0000","last_undegraded":"2024-09-22T08:54:41.301330+0000","last_fullsized":"2024-09-22T08:54:41.301330+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:46:43.042803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":183,"num_read_kb":175,"num_write":358,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"263'751","reported_seq":2354,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:40.939200+0000","last_change":"2024-09-22T08:15:06.981089+0000","last_active":"2024-09-22T08:54:40.939200+0000","last_peered":"2024-09-22T08:54:40.939200+0000","last_clean":"2024-09-22T08:54:40.939200+0000","last_became_active":"2024-09-22T08:15:06.980479+0000","last_became_peered":"2024-09-22T08:15:06.980479+0000","last_unstale":"2024-09-22T08:54:40.939200+0000","last_undegraded":"2024-09-22T08:54:40.939200+0000","last_fullsized":"2024-09-22T08:54:40.939200+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:49:26.940326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3625,"num_read_kb":3307,"num_write":963,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"263'254","reported_seq":922,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:47.293755+0000","last_change":"2024-09-22T08:15:04.951572+0000","last_active":"2024-09-22T08:54:47.293755+0000","last_peered":"2024-09-22T08:54:47.293755+0000","last_clean":"2024-09-22T08:54:47.293755+0000","last_became_active":"2024-09-22T08:15:04.951265+0000","last_became_peered":"2024-09-22T08:15:04.951265+0000","last_unstale":"2024-09-22T08:54:47.293755+0000","last_undegraded":"2024-09-22T08:54:47.293755+0000","last_fullsized":"2024-09-22T08:54:47.293755+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:22:06.557070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":764,"num_read_kb":7954,"num_write":1369,"num_write_kb":16798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:37.397545+0000","last_change":"2024-09-22T08:15:08.979213+0000","last_active":"2024-09-22T08:52:37.397545+0000","last_peered":"2024-09-22T08:52:37.397545+0000","last_clean":"2024-09-22T08:52:37.397545+0000","last_became_active":"2024-09-22T08:15:08.978832+0000","last_became_peered":"2024-09-22T08:15:08.978832+0000","last_unstale":"2024-09-22T08:52:37.397545+0000","last_undegraded":"2024-09-22T08:52:37.397545+0000","last_fullsized":"2024-09-22T08:52:37.397545+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:42:16.081624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"263'77","reported_seq":597,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.725866+0000","last_change":"2024-09-22T08:15:10.984633+0000","last_active":"2024-09-22T08:55:19.725866+0000","last_peered":"2024-09-22T08:55:19.725866+0000","last_clean":"2024-09-22T08:55:19.725866+0000","last_became_active":"2024-09-22T08:15:10.984027+0000","last_became_peered":"2024-09-22T08:15:10.984027+0000","last_unstale":"2024-09-22T08:55:19.725866+0000","last_undegraded":"2024-09-22T08:55:19.725866+0000","last_fullsized":"2024-09-22T08:55:19.725866+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:59:59.106865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":87,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:28.376429+0000","last_change":"2024-09-22T08:15:13.013974+0000","last_active":"2024-09-22T08:51:28.376429+0000","last_peered":"2024-09-22T08:51:28.376429+0000","last_clean":"2024-09-22T08:51:28.376429+0000","last_became_active":"2024-09-22T08:15:13.013609+0000","last_became_peered":"2024-09-22T08:15:13.013609+0000","last_unstale":"2024-09-22T08:51:28.376429+0000","last_undegraded":"2024-09-22T08:51:28.376429+0000","last_fullsized":"2024-09-22T08:51:28.376429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:39:31.786695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"263'154","reported_seq":663,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:14.427460+0000","last_change":"2024-09-22T08:15:15.019318+0000","last_active":"2024-09-22T08:54:14.427460+0000","last_peered":"2024-09-22T08:54:14.427460+0000","last_clean":"2024-09-22T08:54:14.427460+0000","last_became_active":"2024-09-22T08:15:15.018984+0000","last_became_peered":"2024-09-22T08:15:15.018984+0000","last_unstale":"2024-09-22T08:54:14.427460+0000","last_undegraded":"2024-09-22T08:54:14.427460+0000","last_fullsized":"2024-09-22T08:54:14.427460+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:29:44.945052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":263,"num_read_kb":245,"num_write":379,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"263'1935","reported_seq":3646,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.040078+0000","last_change":"2024-09-22T08:15:06.969580+0000","last_active":"2024-09-22T08:56:02.040078+0000","last_peered":"2024-09-22T08:56:02.040078+0000","last_clean":"2024-09-22T08:56:02.040078+0000","last_became_active":"2024-09-22T08:15:06.967645+0000","last_became_peered":"2024-09-22T08:15:06.967645+0000","last_unstale":"2024-09-22T08:56:02.040078+0000","last_undegraded":"2024-09-22T08:56:02.040078+0000","last_fullsized":"2024-09-22T08:56:02.040078+0000","mapping_epoch":25,"log_start":"263'1900","ondisk_log_start":"263'1900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":1900,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:51:46.954458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8532,"num_read_kb":7421,"num_write":2741,"num_write_kb":1214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"263'186","reported_seq":831,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:15.625027+0000","last_change":"2024-09-22T08:15:04.965135+0000","last_active":"2024-09-22T08:53:15.625027+0000","last_peered":"2024-09-22T08:53:15.625027+0000","last_clean":"2024-09-22T08:53:15.625027+0000","last_became_active":"2024-09-22T08:15:04.964798+0000","last_became_peered":"2024-09-22T08:15:04.964798+0000","last_unstale":"2024-09-22T08:53:15.625027+0000","last_undegraded":"2024-09-22T08:53:15.625027+0000","last_fullsized":"2024-09-22T08:53:15.625027+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:57:26.490605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21034321,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":429,"num_read_kb":111211,"num_write":822,"num_write_kb":54102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:52.407838+0000","last_change":"2024-09-22T08:15:08.977351+0000","last_active":"2024-09-22T08:53:52.407838+0000","last_peered":"2024-09-22T08:53:52.407838+0000","last_clean":"2024-09-22T08:53:52.407838+0000","last_became_active":"2024-09-22T08:15:08.976950+0000","last_became_peered":"2024-09-22T08:15:08.976950+0000","last_unstale":"2024-09-22T08:53:52.407838+0000","last_undegraded":"2024-09-22T08:53:52.407838+0000","last_fullsized":"2024-09-22T08:53:52.407838+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:02:30.621484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"263'107","reported_seq":638,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.745947+0000","last_change":"2024-09-22T08:15:10.981219+0000","last_active":"2024-09-22T08:55:19.745947+0000","last_peered":"2024-09-22T08:55:19.745947+0000","last_clean":"2024-09-22T08:55:19.745947+0000","last_became_active":"2024-09-22T08:15:10.980879+0000","last_became_peered":"2024-09-22T08:15:10.980879+0000","last_unstale":"2024-09-22T08:55:19.745947+0000","last_undegraded":"2024-09-22T08:55:19.745947+0000","last_fullsized":"2024-09-22T08:55:19.745947+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:15:11.627561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":117,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"263'778","reported_seq":2374,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:03.378420+0000","last_change":"2024-09-22T08:15:13.012087+0000","last_active":"2024-09-22T08:56:03.378420+0000","last_peered":"2024-09-22T08:56:03.378420+0000","last_clean":"2024-09-22T08:56:03.378420+0000","last_became_active":"2024-09-22T08:15:13.011812+0000","last_became_peered":"2024-09-22T08:15:13.011812+0000","last_unstale":"2024-09-22T08:56:03.378420+0000","last_undegraded":"2024-09-22T08:56:03.378420+0000","last_fullsized":"2024-09-22T08:56:03.378420+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":700,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:23:51.018829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"263'178","reported_seq":999,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.583483+0000","last_change":"2024-09-22T08:15:15.016044+0000","last_active":"2024-09-22T08:54:41.583483+0000","last_peered":"2024-09-22T08:54:41.583483+0000","last_clean":"2024-09-22T08:54:41.583483+0000","last_became_active":"2024-09-22T08:15:15.015684+0000","last_became_peered":"2024-09-22T08:15:15.015684+0000","last_unstale":"2024-09-22T08:54:41.583483+0000","last_undegraded":"2024-09-22T08:54:41.583483+0000","last_fullsized":"2024-09-22T08:54:41.583483+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:38.991298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":616,"num_read_kb":611,"num_write":377,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"263'1260","reported_seq":2732,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.361262+0000","last_change":"2024-09-22T08:15:06.967665+0000","last_active":"2024-09-22T08:54:27.361262+0000","last_peered":"2024-09-22T08:54:27.361262+0000","last_clean":"2024-09-22T08:54:27.361262+0000","last_became_active":"2024-09-22T08:15:06.967323+0000","last_became_peered":"2024-09-22T08:15:06.967323+0000","last_unstale":"2024-09-22T08:54:27.361262+0000","last_undegraded":"2024-09-22T08:54:27.361262+0000","last_fullsized":"2024-09-22T08:54:27.361262+0000","mapping_epoch":25,"log_start":"263'1200","ondisk_log_start":"263'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":1200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:20:28.597649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7857,"num_read_kb":7154,"num_write":1964,"num_write_kb":850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"263'239","reported_seq":907,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:07.393499+0000","last_change":"2024-09-22T08:15:04.960077+0000","last_active":"2024-09-22T08:54:07.393499+0000","last_peered":"2024-09-22T08:54:07.393499+0000","last_clean":"2024-09-22T08:54:07.393499+0000","last_became_active":"2024-09-22T08:15:04.959776+0000","last_became_peered":"2024-09-22T08:15:04.959776+0000","last_unstale":"2024-09-22T08:54:07.393499+0000","last_undegraded":"2024-09-22T08:54:07.393499+0000","last_fullsized":"2024-09-22T08:54:07.393499+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:51:36.656890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7371376,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":714,"num_read_kb":18775,"num_write":1147,"num_write_kb":38377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:48.395364+0000","last_change":"2024-09-22T08:15:08.973303+0000","last_active":"2024-09-22T08:53:48.395364+0000","last_peered":"2024-09-22T08:53:48.395364+0000","last_clean":"2024-09-22T08:53:48.395364+0000","last_became_active":"2024-09-22T08:15:08.973025+0000","last_became_peered":"2024-09-22T08:15:08.973025+0000","last_unstale":"2024-09-22T08:53:48.395364+0000","last_undegraded":"2024-09-22T08:53:48.395364+0000","last_fullsized":"2024-09-22T08:53:48.395364+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:04:18.829657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"263'131","reported_seq":694,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.289651+0000","last_change":"2024-09-22T08:15:10.985906+0000","last_active":"2024-09-22T08:56:16.289651+0000","last_peered":"2024-09-22T08:56:16.289651+0000","last_clean":"2024-09-22T08:56:16.289651+0000","last_became_active":"2024-09-22T08:15:10.985540+0000","last_became_peered":"2024-09-22T08:15:10.985540+0000","last_unstale":"2024-09-22T08:56:16.289651+0000","last_undegraded":"2024-09-22T08:56:16.289651+0000","last_fullsized":"2024-09-22T08:56:16.289651+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:26:23.397471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14875,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":153,"num_read_kb":214,"num_write":77,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"263'792","reported_seq":2267,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.235006+0000","last_change":"2024-09-22T08:15:13.005672+0000","last_active":"2024-09-22T08:56:16.235006+0000","last_peered":"2024-09-22T08:56:16.235006+0000","last_clean":"2024-09-22T08:56:16.235006+0000","last_became_active":"2024-09-22T08:15:13.004752+0000","last_became_peered":"2024-09-22T08:15:13.004752+0000","last_unstale":"2024-09-22T08:56:16.235006+0000","last_undegraded":"2024-09-22T08:56:16.235006+0000","last_fullsized":"2024-09-22T08:56:16.235006+0000","mapping_epoch":31,"log_start":"263'701","ondisk_log_start":"263'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":701,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:24:31.084429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"263'440","reported_seq":2067,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.474057+0000","last_change":"2024-09-22T08:15:06.965797+0000","last_active":"2024-09-22T08:54:41.474057+0000","last_peered":"2024-09-22T08:54:41.474057+0000","last_clean":"2024-09-22T08:54:41.474057+0000","last_became_active":"2024-09-22T08:15:06.965387+0000","last_became_peered":"2024-09-22T08:15:06.965387+0000","last_unstale":"2024-09-22T08:54:41.474057+0000","last_undegraded":"2024-09-22T08:54:41.474057+0000","last_fullsized":"2024-09-22T08:54:41.474057+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:11:37.474066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2432,"num_read_kb":2308,"num_write":489,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"263'263","reported_seq":905,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:50.779466+0000","last_change":"2024-09-22T08:15:04.954321+0000","last_active":"2024-09-22T08:53:50.779466+0000","last_peered":"2024-09-22T08:53:50.779466+0000","last_clean":"2024-09-22T08:53:50.779466+0000","last_became_active":"2024-09-22T08:15:04.954015+0000","last_became_peered":"2024-09-22T08:15:04.954015+0000","last_unstale":"2024-09-22T08:53:50.779466+0000","last_undegraded":"2024-09-22T08:53:50.779466+0000","last_fullsized":"2024-09-22T08:53:50.779466+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:41:32.803566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15799511,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":648,"num_read_kb":30283,"num_write":1072,"num_write_kb":39703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:58.380897+0000","last_change":"2024-09-22T08:15:08.982558+0000","last_active":"2024-09-22T08:51:58.380897+0000","last_peered":"2024-09-22T08:51:58.380897+0000","last_clean":"2024-09-22T08:51:58.380897+0000","last_became_active":"2024-09-22T08:15:08.982222+0000","last_became_peered":"2024-09-22T08:15:08.982222+0000","last_unstale":"2024-09-22T08:51:58.380897+0000","last_undegraded":"2024-09-22T08:51:58.380897+0000","last_fullsized":"2024-09-22T08:51:58.380897+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:01.178334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"263'209","reported_seq":810,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.787460+0000","last_change":"2024-09-22T08:15:10.985101+0000","last_active":"2024-09-22T08:55:19.787460+0000","last_peered":"2024-09-22T08:55:19.787460+0000","last_clean":"2024-09-22T08:55:19.787460+0000","last_became_active":"2024-09-22T08:15:10.984769+0000","last_became_peered":"2024-09-22T08:15:10.984769+0000","last_unstale":"2024-09-22T08:55:19.787460+0000","last_undegraded":"2024-09-22T08:55:19.787460+0000","last_fullsized":"2024-09-22T08:55:19.787460+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:45:44.909883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14988,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":277,"num_read_kb":341,"num_write":162,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:27.282125+0000","last_change":"2024-09-22T08:15:13.012935+0000","last_active":"2024-09-22T08:53:27.282125+0000","last_peered":"2024-09-22T08:53:27.282125+0000","last_clean":"2024-09-22T08:53:27.282125+0000","last_became_active":"2024-09-22T08:15:13.012498+0000","last_became_peered":"2024-09-22T08:15:13.012498+0000","last_unstale":"2024-09-22T08:53:27.282125+0000","last_undegraded":"2024-09-22T08:53:27.282125+0000","last_fullsized":"2024-09-22T08:53:27.282125+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:45:11.434166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"263'554","reported_seq":1379,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:03.364987+0000","last_change":"2024-09-22T08:15:15.015237+0000","last_active":"2024-09-22T08:56:03.364987+0000","last_peered":"2024-09-22T08:56:03.364987+0000","last_clean":"2024-09-22T08:56:03.364987+0000","last_became_active":"2024-09-22T08:15:15.014801+0000","last_became_peered":"2024-09-22T08:15:15.014801+0000","last_unstale":"2024-09-22T08:56:03.364987+0000","last_undegraded":"2024-09-22T08:56:03.364987+0000","last_fullsized":"2024-09-22T08:56:03.364987+0000","mapping_epoch":33,"log_start":"263'500","ondisk_log_start":"263'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":500,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:46:54.702216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":467,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1367,"num_read_kb":1346,"num_write":1156,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"263'860","reported_seq":2445,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.032017+0000","last_change":"2024-09-22T08:15:06.973268+0000","last_active":"2024-09-22T08:56:02.032017+0000","last_peered":"2024-09-22T08:56:02.032017+0000","last_clean":"2024-09-22T08:56:02.032017+0000","last_became_active":"2024-09-22T08:15:06.972958+0000","last_became_peered":"2024-09-22T08:15:06.972958+0000","last_unstale":"2024-09-22T08:56:02.032017+0000","last_undegraded":"2024-09-22T08:56:02.032017+0000","last_fullsized":"2024-09-22T08:56:02.032017+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":800,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:07.108632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4079,"num_read_kb":3669,"num_write":1154,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"263'222","reported_seq":880,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:23.330118+0000","last_change":"2024-09-22T08:15:40.188660+0000","last_active":"2024-09-22T08:54:23.330118+0000","last_peered":"2024-09-22T08:54:23.330118+0000","last_clean":"2024-09-22T08:54:23.330118+0000","last_became_active":"2024-09-22T08:15:40.188251+0000","last_became_peered":"2024-09-22T08:15:40.188251+0000","last_unstale":"2024-09-22T08:54:23.330118+0000","last_undegraded":"2024-09-22T08:54:23.330118+0000","last_fullsized":"2024-09-22T08:54:23.330118+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:26:41.611736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16380026,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":534,"num_read_kb":133818,"num_write":961,"num_write_kb":45053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:02.269516+0000","last_change":"2024-09-22T08:15:08.975801+0000","last_active":"2024-09-22T08:52:02.269516+0000","last_peered":"2024-09-22T08:52:02.269516+0000","last_clean":"2024-09-22T08:52:02.269516+0000","last_became_active":"2024-09-22T08:15:08.975435+0000","last_became_peered":"2024-09-22T08:15:08.975435+0000","last_unstale":"2024-09-22T08:52:02.269516+0000","last_undegraded":"2024-09-22T08:52:02.269516+0000","last_fullsized":"2024-09-22T08:52:02.269516+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:08:19.699188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"263'126","reported_seq":692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.485217+0000","last_change":"2024-09-22T08:15:10.988940+0000","last_active":"2024-09-22T08:56:16.485217+0000","last_peered":"2024-09-22T08:56:16.485217+0000","last_clean":"2024-09-22T08:56:16.485217+0000","last_became_active":"2024-09-22T08:15:10.988458+0000","last_became_peered":"2024-09-22T08:15:10.988458+0000","last_unstale":"2024-09-22T08:56:16.485217+0000","last_undegraded":"2024-09-22T08:56:16.485217+0000","last_fullsized":"2024-09-22T08:56:16.485217+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:25.942851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8309,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":166,"num_read_kb":226,"num_write":90,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:07.393316+0000","last_change":"2024-09-22T08:15:13.003344+0000","last_active":"2024-09-22T08:52:07.393316+0000","last_peered":"2024-09-22T08:52:07.393316+0000","last_clean":"2024-09-22T08:52:07.393316+0000","last_became_active":"2024-09-22T08:15:13.002538+0000","last_became_peered":"2024-09-22T08:15:13.002538+0000","last_unstale":"2024-09-22T08:52:07.393316+0000","last_undegraded":"2024-09-22T08:52:07.393316+0000","last_fullsized":"2024-09-22T08:52:07.393316+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:50:12.973900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"263'2482","reported_seq":4310,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:58.403142+0000","last_change":"2024-09-22T08:15:15.020723+0000","last_active":"2024-09-22T08:54:58.403142+0000","last_peered":"2024-09-22T08:54:58.403142+0000","last_clean":"2024-09-22T08:54:58.403142+0000","last_became_active":"2024-09-22T08:15:15.020438+0000","last_became_peered":"2024-09-22T08:15:15.020438+0000","last_unstale":"2024-09-22T08:54:58.403142+0000","last_undegraded":"2024-09-22T08:54:58.403142+0000","last_fullsized":"2024-09-22T08:54:58.403142+0000","mapping_epoch":33,"log_start":"263'2400","ondisk_log_start":"263'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":2400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:19:48.770997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6235,"num_read_kb":6232,"num_write":5030,"num_write_kb":1847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"263'474","reported_seq":1995,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.469591+0000","last_change":"2024-09-22T08:15:06.971112+0000","last_active":"2024-09-22T08:54:41.469591+0000","last_peered":"2024-09-22T08:54:41.469591+0000","last_clean":"2024-09-22T08:54:41.469591+0000","last_became_active":"2024-09-22T08:15:06.970532+0000","last_became_peered":"2024-09-22T08:15:06.970532+0000","last_unstale":"2024-09-22T08:54:41.469591+0000","last_undegraded":"2024-09-22T08:54:41.469591+0000","last_fullsized":"2024-09-22T08:54:41.469591+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:04:08.887293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2482,"num_read_kb":2307,"num_write":574,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"263'212","reported_seq":836,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:23.392143+0000","last_change":"2024-09-22T08:15:04.963933+0000","last_active":"2024-09-22T08:53:23.392143+0000","last_peered":"2024-09-22T08:53:23.392143+0000","last_clean":"2024-09-22T08:53:23.392143+0000","last_became_active":"2024-09-22T08:15:04.963648+0000","last_became_peered":"2024-09-22T08:15:04.963648+0000","last_unstale":"2024-09-22T08:53:23.392143+0000","last_undegraded":"2024-09-22T08:53:23.392143+0000","last_fullsized":"2024-09-22T08:53:23.392143+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:06:54.477482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3520137,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":479,"num_read_kb":19400,"num_write":961,"num_write_kb":35249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"35'3","reported_seq":976,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:15.995729+0000","last_change":"2024-09-22T08:15:08.975603+0000","last_active":"2024-09-22T08:56:15.995729+0000","last_peered":"2024-09-22T08:56:15.995729+0000","last_clean":"2024-09-22T08:56:15.995729+0000","last_became_active":"2024-09-22T08:15:08.975260+0000","last_became_peered":"2024-09-22T08:15:08.975260+0000","last_unstale":"2024-09-22T08:56:15.995729+0000","last_undegraded":"2024-09-22T08:56:15.995729+0000","last_fullsized":"2024-09-22T08:56:15.995729+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:44:40.766275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":720,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"263'154","reported_seq":733,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.710226+0000","last_change":"2024-09-22T08:15:10.989559+0000","last_active":"2024-09-22T08:55:19.710226+0000","last_peered":"2024-09-22T08:55:19.710226+0000","last_clean":"2024-09-22T08:55:19.710226+0000","last_became_active":"2024-09-22T08:15:10.989211+0000","last_became_peered":"2024-09-22T08:15:10.989211+0000","last_unstale":"2024-09-22T08:55:19.710226+0000","last_undegraded":"2024-09-22T08:55:19.710226+0000","last_fullsized":"2024-09-22T08:55:19.710226+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:21:23.417691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15314,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":202,"num_read_kb":270,"num_write":114,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"263'792","reported_seq":2273,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.236259+0000","last_change":"2024-09-22T08:15:13.003152+0000","last_active":"2024-09-22T08:56:16.236259+0000","last_peered":"2024-09-22T08:56:16.236259+0000","last_clean":"2024-09-22T08:56:16.236259+0000","last_became_active":"2024-09-22T08:15:13.002828+0000","last_became_peered":"2024-09-22T08:15:13.002828+0000","last_unstale":"2024-09-22T08:56:16.236259+0000","last_undegraded":"2024-09-22T08:56:16.236259+0000","last_fullsized":"2024-09-22T08:56:16.236259+0000","mapping_epoch":31,"log_start":"263'701","ondisk_log_start":"263'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":701,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:50:06.133670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"263'130","reported_seq":617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:01.978028+0000","last_change":"2024-09-22T08:15:15.019494+0000","last_active":"2024-09-22T08:56:01.978028+0000","last_peered":"2024-09-22T08:56:01.978028+0000","last_clean":"2024-09-22T08:56:01.978028+0000","last_became_active":"2024-09-22T08:15:15.019162+0000","last_became_peered":"2024-09-22T08:15:15.019162+0000","last_unstale":"2024-09-22T08:56:01.978028+0000","last_undegraded":"2024-09-22T08:56:01.978028+0000","last_fullsized":"2024-09-22T08:56:01.978028+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:35:08.999759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":846,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":147,"num_read_kb":143,"num_write":317,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"263'517","reported_seq":2263,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.480093+0000","last_change":"2024-09-22T08:15:06.962857+0000","last_active":"2024-09-22T08:54:41.480093+0000","last_peered":"2024-09-22T08:54:41.480093+0000","last_clean":"2024-09-22T08:54:41.480093+0000","last_became_active":"2024-09-22T08:15:06.962528+0000","last_became_peered":"2024-09-22T08:15:06.962528+0000","last_unstale":"2024-09-22T08:54:41.480093+0000","last_undegraded":"2024-09-22T08:54:41.480093+0000","last_fullsized":"2024-09-22T08:54:41.480093+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":500,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:34:50.127904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2917,"num_read_kb":2741,"num_write":627,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"263'189","reported_seq":806,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:23.475071+0000","last_change":"2024-09-22T08:15:04.948041+0000","last_active":"2024-09-22T08:53:23.475071+0000","last_peered":"2024-09-22T08:53:23.475071+0000","last_clean":"2024-09-22T08:53:23.475071+0000","last_became_active":"2024-09-22T08:15:04.947739+0000","last_became_peered":"2024-09-22T08:15:04.947739+0000","last_unstale":"2024-09-22T08:53:23.475071+0000","last_undegraded":"2024-09-22T08:53:23.475071+0000","last_fullsized":"2024-09-22T08:53:23.475071+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:22:45.887704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1400013,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":448,"num_read_kb":50575,"num_write":899,"num_write_kb":23711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:12.271102+0000","last_change":"2024-09-22T08:15:08.974959+0000","last_active":"2024-09-22T08:52:12.271102+0000","last_peered":"2024-09-22T08:52:12.271102+0000","last_clean":"2024-09-22T08:52:12.271102+0000","last_became_active":"2024-09-22T08:15:08.974693+0000","last_became_peered":"2024-09-22T08:15:08.974693+0000","last_unstale":"2024-09-22T08:52:12.271102+0000","last_undegraded":"2024-09-22T08:52:12.271102+0000","last_fullsized":"2024-09-22T08:52:12.271102+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:41:04.052651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"263'193","reported_seq":819,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.503445+0000","last_change":"2024-09-22T08:15:10.984896+0000","last_active":"2024-09-22T08:56:16.503445+0000","last_peered":"2024-09-22T08:56:16.503445+0000","last_clean":"2024-09-22T08:56:16.503445+0000","last_became_active":"2024-09-22T08:15:10.984402+0000","last_became_peered":"2024-09-22T08:15:10.984402+0000","last_unstale":"2024-09-22T08:56:16.503445+0000","last_undegraded":"2024-09-22T08:56:16.503445+0000","last_fullsized":"2024-09-22T08:56:16.503445+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:10:18.043549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13027,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":258,"num_read_kb":332,"num_write":120,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:02.269532+0000","last_change":"2024-09-22T08:15:13.014853+0000","last_active":"2024-09-22T08:52:02.269532+0000","last_peered":"2024-09-22T08:52:02.269532+0000","last_clean":"2024-09-22T08:52:02.269532+0000","last_became_active":"2024-09-22T08:15:13.014612+0000","last_became_peered":"2024-09-22T08:15:13.014612+0000","last_unstale":"2024-09-22T08:52:02.269532+0000","last_undegraded":"2024-09-22T08:52:02.269532+0000","last_fullsized":"2024-09-22T08:52:02.269532+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:42:53.637961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"263'140","reported_seq":652,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:40.818796+0000","last_change":"2024-09-22T08:15:15.011646+0000","last_active":"2024-09-22T08:54:40.818796+0000","last_peered":"2024-09-22T08:54:40.818796+0000","last_clean":"2024-09-22T08:54:40.818796+0000","last_became_active":"2024-09-22T08:15:15.011332+0000","last_became_peered":"2024-09-22T08:15:15.011332+0000","last_unstale":"2024-09-22T08:54:40.818796+0000","last_undegraded":"2024-09-22T08:54:40.818796+0000","last_fullsized":"2024-09-22T08:54:40.818796+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:19:09.424500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":195,"num_read_kb":186,"num_write":318,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"263'475","reported_seq":2049,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.961820+0000","last_change":"2024-09-22T08:15:06.966989+0000","last_active":"2024-09-22T08:54:27.961820+0000","last_peered":"2024-09-22T08:54:27.961820+0000","last_clean":"2024-09-22T08:54:27.961820+0000","last_became_active":"2024-09-22T08:15:06.966708+0000","last_became_peered":"2024-09-22T08:15:06.966708+0000","last_unstale":"2024-09-22T08:54:27.961820+0000","last_undegraded":"2024-09-22T08:54:27.961820+0000","last_fullsized":"2024-09-22T08:54:27.961820+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:55:12.487019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2455,"num_read_kb":2308,"num_write":546,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"263'247","reported_seq":879,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.306459+0000","last_change":"2024-09-22T08:15:04.949510+0000","last_active":"2024-09-22T08:56:16.306459+0000","last_peered":"2024-09-22T08:56:16.306459+0000","last_clean":"2024-09-22T08:56:16.306459+0000","last_became_active":"2024-09-22T08:15:04.949202+0000","last_became_peered":"2024-09-22T08:15:04.949202+0000","last_unstale":"2024-09-22T08:56:16.306459+0000","last_undegraded":"2024-09-22T08:56:16.306459+0000","last_fullsized":"2024-09-22T08:56:16.306459+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:52:02.522606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1386384,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":583,"num_read_kb":11398,"num_write":1166,"num_write_kb":28598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:27.291253+0000","last_change":"2024-09-22T08:15:08.978620+0000","last_active":"2024-09-22T08:53:27.291253+0000","last_peered":"2024-09-22T08:53:27.291253+0000","last_clean":"2024-09-22T08:53:27.291253+0000","last_became_active":"2024-09-22T08:15:08.978280+0000","last_became_peered":"2024-09-22T08:15:08.978280+0000","last_unstale":"2024-09-22T08:53:27.291253+0000","last_undegraded":"2024-09-22T08:53:27.291253+0000","last_fullsized":"2024-09-22T08:53:27.291253+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:04:18.494310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"263'165","reported_seq":732,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:43.408357+0000","last_change":"2024-09-22T08:15:10.986865+0000","last_active":"2024-09-22T08:55:43.408357+0000","last_peered":"2024-09-22T08:55:43.408357+0000","last_clean":"2024-09-22T08:55:43.408357+0000","last_became_active":"2024-09-22T08:15:10.986433+0000","last_became_peered":"2024-09-22T08:15:10.986433+0000","last_unstale":"2024-09-22T08:55:43.408357+0000","last_undegraded":"2024-09-22T08:55:43.408357+0000","last_fullsized":"2024-09-22T08:55:43.408357+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:30:33.526965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15502,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":219,"num_read_kb":274,"num_write":182,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:37.292935+0000","last_change":"2024-09-22T08:15:12.999342+0000","last_active":"2024-09-22T08:53:37.292935+0000","last_peered":"2024-09-22T08:53:37.292935+0000","last_clean":"2024-09-22T08:53:37.292935+0000","last_became_active":"2024-09-22T08:15:12.999036+0000","last_became_peered":"2024-09-22T08:15:12.999036+0000","last_unstale":"2024-09-22T08:53:37.292935+0000","last_undegraded":"2024-09-22T08:53:37.292935+0000","last_fullsized":"2024-09-22T08:53:37.292935+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:32:19.162385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"263'97","reported_seq":586,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:22.299581+0000","last_change":"2024-09-22T08:15:15.012235+0000","last_active":"2024-09-22T08:55:22.299581+0000","last_peered":"2024-09-22T08:55:22.299581+0000","last_clean":"2024-09-22T08:55:22.299581+0000","last_became_active":"2024-09-22T08:15:15.011949+0000","last_became_peered":"2024-09-22T08:15:15.011949+0000","last_unstale":"2024-09-22T08:55:22.299581+0000","last_undegraded":"2024-09-22T08:55:22.299581+0000","last_fullsized":"2024-09-22T08:55:22.299581+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:28.798518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":93,"num_read_kb":93,"num_write":223,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"263'824","reported_seq":2604,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.479954+0000","last_change":"2024-09-22T08:15:06.967305+0000","last_active":"2024-09-22T08:54:41.479954+0000","last_peered":"2024-09-22T08:54:41.479954+0000","last_clean":"2024-09-22T08:54:41.479954+0000","last_became_active":"2024-09-22T08:15:06.966795+0000","last_became_peered":"2024-09-22T08:15:06.966795+0000","last_unstale":"2024-09-22T08:54:41.479954+0000","last_undegraded":"2024-09-22T08:54:41.479954+0000","last_fullsized":"2024-09-22T08:54:41.479954+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:21:48.140336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4273,"num_read_kb":3896,"num_write":1079,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"263'208","reported_seq":830,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:03.381777+0000","last_change":"2024-09-22T08:15:04.954764+0000","last_active":"2024-09-22T08:52:03.381777+0000","last_peered":"2024-09-22T08:52:03.381777+0000","last_clean":"2024-09-22T08:52:03.381777+0000","last_became_active":"2024-09-22T08:15:04.954492+0000","last_became_peered":"2024-09-22T08:15:04.954492+0000","last_unstale":"2024-09-22T08:52:03.381777+0000","last_undegraded":"2024-09-22T08:52:03.381777+0000","last_fullsized":"2024-09-22T08:52:03.381777+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:20:34.096792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8020669,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":467,"num_read_kb":44807,"num_write":937,"num_write_kb":39223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:27.282275+0000","last_change":"2024-09-22T08:15:08.977376+0000","last_active":"2024-09-22T08:53:27.282275+0000","last_peered":"2024-09-22T08:53:27.282275+0000","last_clean":"2024-09-22T08:53:27.282275+0000","last_became_active":"2024-09-22T08:15:08.976990+0000","last_became_peered":"2024-09-22T08:15:08.976990+0000","last_unstale":"2024-09-22T08:53:27.282275+0000","last_undegraded":"2024-09-22T08:53:27.282275+0000","last_fullsized":"2024-09-22T08:53:27.282275+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:28.364951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"263'149","reported_seq":732,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.458993+0000","last_change":"2024-09-22T08:15:10.979752+0000","last_active":"2024-09-22T08:56:16.458993+0000","last_peered":"2024-09-22T08:56:16.458993+0000","last_clean":"2024-09-22T08:56:16.458993+0000","last_became_active":"2024-09-22T08:15:10.979449+0000","last_became_peered":"2024-09-22T08:15:10.979449+0000","last_unstale":"2024-09-22T08:56:16.458993+0000","last_undegraded":"2024-09-22T08:56:16.458993+0000","last_fullsized":"2024-09-22T08:56:16.458993+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:04.362070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6421,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":192,"num_read_kb":205,"num_write":100,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"263'771","reported_seq":4251,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.231331+0000","last_change":"2024-09-22T08:15:13.015830+0000","last_active":"2024-09-22T08:56:16.231331+0000","last_peered":"2024-09-22T08:56:16.231331+0000","last_clean":"2024-09-22T08:56:16.231331+0000","last_became_active":"2024-09-22T08:15:13.015504+0000","last_became_peered":"2024-09-22T08:15:13.015504+0000","last_unstale":"2024-09-22T08:56:16.231331+0000","last_undegraded":"2024-09-22T08:56:16.231331+0000","last_fullsized":"2024-09-22T08:56:16.231331+0000","mapping_epoch":31,"log_start":"263'701","ondisk_log_start":"263'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":701,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:41:04.669012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"263'132","reported_seq":628,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:18.162485+0000","last_change":"2024-09-22T08:15:15.018247+0000","last_active":"2024-09-22T08:54:18.162485+0000","last_peered":"2024-09-22T08:54:18.162485+0000","last_clean":"2024-09-22T08:54:18.162485+0000","last_became_active":"2024-09-22T08:15:15.017584+0000","last_became_peered":"2024-09-22T08:15:15.017584+0000","last_unstale":"2024-09-22T08:54:18.162485+0000","last_undegraded":"2024-09-22T08:54:18.162485+0000","last_fullsized":"2024-09-22T08:54:18.162485+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:04:30.454178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":193,"num_read_kb":181,"num_write":318,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"263'745","reported_seq":2321,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:26.719305+0000","last_change":"2024-09-22T08:15:06.974286+0000","last_active":"2024-09-22T08:54:26.719305+0000","last_peered":"2024-09-22T08:54:26.719305+0000","last_clean":"2024-09-22T08:54:26.719305+0000","last_became_active":"2024-09-22T08:15:06.973918+0000","last_became_peered":"2024-09-22T08:15:06.973918+0000","last_unstale":"2024-09-22T08:54:26.719305+0000","last_undegraded":"2024-09-22T08:54:26.719305+0000","last_fullsized":"2024-09-22T08:54:26.719305+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":700,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:53:08.286370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3813,"num_read_kb":3478,"num_write":973,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"263'223","reported_seq":879,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:25.874116+0000","last_change":"2024-09-22T08:15:04.958607+0000","last_active":"2024-09-22T08:54:25.874116+0000","last_peered":"2024-09-22T08:54:25.874116+0000","last_clean":"2024-09-22T08:54:25.874116+0000","last_became_active":"2024-09-22T08:15:04.958336+0000","last_became_peered":"2024-09-22T08:15:04.958336+0000","last_unstale":"2024-09-22T08:54:25.874116+0000","last_undegraded":"2024-09-22T08:54:25.874116+0000","last_fullsized":"2024-09-22T08:54:25.874116+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:31:07.605629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1058332,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":650,"num_read_kb":3596,"num_write":1073,"num_write_kb":27039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1443,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.891754+0000","last_change":"2024-09-22T08:15:08.982924+0000","last_active":"2024-09-22T08:56:02.891754+0000","last_peered":"2024-09-22T08:56:02.891754+0000","last_clean":"2024-09-22T08:56:02.891754+0000","last_became_active":"2024-09-22T08:15:08.982221+0000","last_became_peered":"2024-09-22T08:15:08.982221+0000","last_unstale":"2024-09-22T08:56:02.891754+0000","last_undegraded":"2024-09-22T08:56:02.891754+0000","last_fullsized":"2024-09-22T08:56:02.891754+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:06:24.534601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":946,"num_read_kb":946,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"263'73","reported_seq":585,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:42.302697+0000","last_change":"2024-09-22T08:15:10.987583+0000","last_active":"2024-09-22T08:55:42.302697+0000","last_peered":"2024-09-22T08:55:42.302697+0000","last_clean":"2024-09-22T08:55:42.302697+0000","last_became_active":"2024-09-22T08:15:10.987273+0000","last_became_peered":"2024-09-22T08:15:10.987273+0000","last_unstale":"2024-09-22T08:55:42.302697+0000","last_undegraded":"2024-09-22T08:55:42.302697+0000","last_fullsized":"2024-09-22T08:55:42.302697+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:52:00.308800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"263'788","reported_seq":2309,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:03.380604+0000","last_change":"2024-09-22T08:15:13.010979+0000","last_active":"2024-09-22T08:56:03.380604+0000","last_peered":"2024-09-22T08:56:03.380604+0000","last_clean":"2024-09-22T08:56:03.380604+0000","last_became_active":"2024-09-22T08:15:13.010641+0000","last_became_peered":"2024-09-22T08:15:13.010641+0000","last_unstale":"2024-09-22T08:56:03.380604+0000","last_undegraded":"2024-09-22T08:56:03.380604+0000","last_fullsized":"2024-09-22T08:56:03.380604+0000","mapping_epoch":31,"log_start":"263'701","ondisk_log_start":"263'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":701,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:31:51.024056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"263'125","reported_seq":620,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:14.425045+0000","last_change":"2024-09-22T08:15:15.015212+0000","last_active":"2024-09-22T08:54:14.425045+0000","last_peered":"2024-09-22T08:54:14.425045+0000","last_clean":"2024-09-22T08:54:14.425045+0000","last_became_active":"2024-09-22T08:15:15.014775+0000","last_became_peered":"2024-09-22T08:15:15.014775+0000","last_unstale":"2024-09-22T08:54:14.425045+0000","last_undegraded":"2024-09-22T08:54:14.425045+0000","last_fullsized":"2024-09-22T08:54:14.425045+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:24:57.427955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":160,"num_write":304,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"263'414","reported_seq":1970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:22.693834+0000","last_change":"2024-09-22T08:15:06.957525+0000","last_active":"2024-09-22T08:54:22.693834+0000","last_peered":"2024-09-22T08:54:22.693834+0000","last_clean":"2024-09-22T08:54:22.693834+0000","last_became_active":"2024-09-22T08:15:06.957239+0000","last_became_peered":"2024-09-22T08:15:06.957239+0000","last_unstale":"2024-09-22T08:54:22.693834+0000","last_undegraded":"2024-09-22T08:54:22.693834+0000","last_fullsized":"2024-09-22T08:54:22.693834+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:14:48.411753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2251,"num_read_kb":2145,"num_write":475,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"263'270","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.464029+0000","last_change":"2024-09-22T08:15:04.944257+0000","last_active":"2024-09-22T08:56:16.464029+0000","last_peered":"2024-09-22T08:56:16.464029+0000","last_clean":"2024-09-22T08:56:16.464029+0000","last_became_active":"2024-09-22T08:15:04.943906+0000","last_became_peered":"2024-09-22T08:15:04.943906+0000","last_unstale":"2024-09-22T08:56:16.464029+0000","last_undegraded":"2024-09-22T08:56:16.464029+0000","last_fullsized":"2024-09-22T08:56:16.464029+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:58:25.000568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079942,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":793,"num_read_kb":68557,"num_write":1190,"num_write_kb":29712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:23.392212+0000","last_change":"2024-09-22T08:15:08.969465+0000","last_active":"2024-09-22T08:53:23.392212+0000","last_peered":"2024-09-22T08:53:23.392212+0000","last_clean":"2024-09-22T08:53:23.392212+0000","last_became_active":"2024-09-22T08:15:08.969175+0000","last_became_peered":"2024-09-22T08:15:08.969175+0000","last_unstale":"2024-09-22T08:53:23.392212+0000","last_undegraded":"2024-09-22T08:53:23.392212+0000","last_fullsized":"2024-09-22T08:53:23.392212+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:02:12.589731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"263'190","reported_seq":788,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:43.408305+0000","last_change":"2024-09-22T08:15:10.987387+0000","last_active":"2024-09-22T08:55:43.408305+0000","last_peered":"2024-09-22T08:55:43.408305+0000","last_clean":"2024-09-22T08:55:43.408305+0000","last_became_active":"2024-09-22T08:15:10.987081+0000","last_became_peered":"2024-09-22T08:15:10.987081+0000","last_unstale":"2024-09-22T08:55:43.408305+0000","last_undegraded":"2024-09-22T08:55:43.408305+0000","last_fullsized":"2024-09-22T08:55:43.408305+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:27:15.431867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6008,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":242,"num_read_kb":270,"num_write":134,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:31.269342+0000","last_change":"2024-09-22T08:15:13.008391+0000","last_active":"2024-09-22T08:53:31.269342+0000","last_peered":"2024-09-22T08:53:31.269342+0000","last_clean":"2024-09-22T08:53:31.269342+0000","last_became_active":"2024-09-22T08:15:13.007735+0000","last_became_peered":"2024-09-22T08:15:13.007735+0000","last_unstale":"2024-09-22T08:53:31.269342+0000","last_undegraded":"2024-09-22T08:53:31.269342+0000","last_fullsized":"2024-09-22T08:53:31.269342+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:36:22.012503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"263'149","reported_seq":642,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:52.302863+0000","last_change":"2024-09-22T08:15:15.013532+0000","last_active":"2024-09-22T08:54:52.302863+0000","last_peered":"2024-09-22T08:54:52.302863+0000","last_clean":"2024-09-22T08:54:52.302863+0000","last_became_active":"2024-09-22T08:15:15.013216+0000","last_became_peered":"2024-09-22T08:15:15.013216+0000","last_unstale":"2024-09-22T08:54:52.302863+0000","last_undegraded":"2024-09-22T08:54:52.302863+0000","last_fullsized":"2024-09-22T08:54:52.302863+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:46:24.084971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1066,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":167,"num_read_kb":166,"num_write":339,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"263'392","reported_seq":1961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.030717+0000","last_change":"2024-09-22T08:15:06.966999+0000","last_active":"2024-09-22T08:56:02.030717+0000","last_peered":"2024-09-22T08:56:02.030717+0000","last_clean":"2024-09-22T08:56:02.030717+0000","last_became_active":"2024-09-22T08:15:06.966710+0000","last_became_peered":"2024-09-22T08:15:06.966710+0000","last_unstale":"2024-09-22T08:56:02.030717+0000","last_undegraded":"2024-09-22T08:56:02.030717+0000","last_fullsized":"2024-09-22T08:56:02.030717+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:19.004364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2363,"num_read_kb":2266,"num_write":458,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":611,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:53.387983+0000","last_change":"2024-09-22T08:14:48.585279+0000","last_active":"2024-09-22T08:52:53.387983+0000","last_peered":"2024-09-22T08:52:53.387983+0000","last_clean":"2024-09-22T08:52:53.387983+0000","last_became_active":"2024-09-22T08:14:48.584210+0000","last_became_peered":"2024-09-22T08:14:48.584210+0000","last_unstale":"2024-09-22T08:52:53.387983+0000","last_undegraded":"2024-09-22T08:52:53.387983+0000","last_fullsized":"2024-09-22T08:52:53.387983+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:47.452169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:47.452169+0000","last_clean_scrub_stamp":"2024-09-22T08:14:47.452169+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:40:54.190577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:28.385374+0000","last_change":"2024-09-22T08:14:56.729851+0000","last_active":"2024-09-22T08:52:28.385374+0000","last_peered":"2024-09-22T08:52:28.385374+0000","last_clean":"2024-09-22T08:52:28.385374+0000","last_became_active":"2024-09-22T08:14:54.727501+0000","last_became_peered":"2024-09-22T08:14:54.727501+0000","last_unstale":"2024-09-22T08:52:28.385374+0000","last_undegraded":"2024-09-22T08:52:28.385374+0000","last_fullsized":"2024-09-22T08:52:28.385374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:23:47.178939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001065632,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"263'179","reported_seq":841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:42.415042+0000","last_change":"2024-09-22T08:15:04.963864+0000","last_active":"2024-09-22T08:54:42.415042+0000","last_peered":"2024-09-22T08:54:42.415042+0000","last_clean":"2024-09-22T08:54:42.415042+0000","last_became_active":"2024-09-22T08:15:04.963447+0000","last_became_peered":"2024-09-22T08:15:04.963447+0000","last_unstale":"2024-09-22T08:54:42.415042+0000","last_undegraded":"2024-09-22T08:54:42.415042+0000","last_fullsized":"2024-09-22T08:54:42.415042+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:24:35.067492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":624,"num_read_kb":9185,"num_write":876,"num_write_kb":23340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:38.469151+0000","last_change":"2024-09-22T08:15:08.979105+0000","last_active":"2024-09-22T08:52:38.469151+0000","last_peered":"2024-09-22T08:52:38.469151+0000","last_clean":"2024-09-22T08:52:38.469151+0000","last_became_active":"2024-09-22T08:15:08.978755+0000","last_became_peered":"2024-09-22T08:15:08.978755+0000","last_unstale":"2024-09-22T08:52:38.469151+0000","last_undegraded":"2024-09-22T08:52:38.469151+0000","last_fullsized":"2024-09-22T08:52:38.469151+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:35:55.269048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"263'267","reported_seq":954,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:03.350649+0000","last_change":"2024-09-22T08:15:10.991397+0000","last_active":"2024-09-22T08:56:03.350649+0000","last_peered":"2024-09-22T08:56:03.350649+0000","last_clean":"2024-09-22T08:56:03.350649+0000","last_became_active":"2024-09-22T08:15:10.991050+0000","last_became_peered":"2024-09-22T08:15:10.991050+0000","last_unstale":"2024-09-22T08:56:03.350649+0000","last_undegraded":"2024-09-22T08:56:03.350649+0000","last_fullsized":"2024-09-22T08:56:03.350649+0000","mapping_epoch":29,"log_start":"260'200","ondisk_log_start":"260'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:20:04.247945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36893,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":504,"num_read_kb":686,"num_write":418,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:02.269685+0000","last_change":"2024-09-22T08:15:13.018888+0000","last_active":"2024-09-22T08:52:02.269685+0000","last_peered":"2024-09-22T08:52:02.269685+0000","last_clean":"2024-09-22T08:52:02.269685+0000","last_became_active":"2024-09-22T08:15:13.018627+0000","last_became_peered":"2024-09-22T08:15:13.018627+0000","last_unstale":"2024-09-22T08:52:02.269685+0000","last_undegraded":"2024-09-22T08:52:02.269685+0000","last_fullsized":"2024-09-22T08:52:02.269685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:34:15.340844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"263'226","reported_seq":951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:40.424193+0000","last_change":"2024-09-22T08:15:15.017846+0000","last_active":"2024-09-22T08:54:40.424193+0000","last_peered":"2024-09-22T08:54:40.424193+0000","last_clean":"2024-09-22T08:54:40.424193+0000","last_became_active":"2024-09-22T08:15:15.017533+0000","last_became_peered":"2024-09-22T08:15:15.017533+0000","last_unstale":"2024-09-22T08:54:40.424193+0000","last_undegraded":"2024-09-22T08:54:40.424193+0000","last_fullsized":"2024-09-22T08:54:40.424193+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:27:07.313303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":616,"num_read_kb":580,"num_write":434,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"263'394","reported_seq":1957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:40.939121+0000","last_change":"2024-09-22T08:15:06.967150+0000","last_active":"2024-09-22T08:54:40.939121+0000","last_peered":"2024-09-22T08:54:40.939121+0000","last_clean":"2024-09-22T08:54:40.939121+0000","last_became_active":"2024-09-22T08:15:06.966792+0000","last_became_peered":"2024-09-22T08:15:06.966792+0000","last_unstale":"2024-09-22T08:54:40.939121+0000","last_undegraded":"2024-09-22T08:54:40.939121+0000","last_fullsized":"2024-09-22T08:54:40.939121+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:48:17.209756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2208,"num_read_kb":2116,"num_write":452,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:03.389601+0000","last_change":"2024-09-22T08:14:56.729334+0000","last_active":"2024-09-22T08:53:03.389601+0000","last_peered":"2024-09-22T08:53:03.389601+0000","last_clean":"2024-09-22T08:53:03.389601+0000","last_became_active":"2024-09-22T08:14:54.726875+0000","last_became_peered":"2024-09-22T08:14:54.726875+0000","last_unstale":"2024-09-22T08:53:03.389601+0000","last_undegraded":"2024-09-22T08:53:03.389601+0000","last_fullsized":"2024-09-22T08:53:03.389601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:39:49.545065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000558433,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"263'180","reported_seq":785,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.389663+0000","last_change":"2024-09-22T08:15:04.964320+0000","last_active":"2024-09-22T08:56:16.389663+0000","last_peered":"2024-09-22T08:56:16.389663+0000","last_clean":"2024-09-22T08:56:16.389663+0000","last_became_active":"2024-09-22T08:15:04.963967+0000","last_became_peered":"2024-09-22T08:15:04.963967+0000","last_unstale":"2024-09-22T08:56:16.389663+0000","last_undegraded":"2024-09-22T08:56:16.389663+0000","last_fullsized":"2024-09-22T08:56:16.389663+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:27:24.495059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":424,"num_read_kb":76135,"num_write":811,"num_write_kb":37187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:58.381193+0000","last_change":"2024-09-22T08:15:08.969618+0000","last_active":"2024-09-22T08:51:58.381193+0000","last_peered":"2024-09-22T08:51:58.381193+0000","last_clean":"2024-09-22T08:51:58.381193+0000","last_became_active":"2024-09-22T08:15:08.969276+0000","last_became_peered":"2024-09-22T08:15:08.969276+0000","last_unstale":"2024-09-22T08:51:58.381193+0000","last_undegraded":"2024-09-22T08:51:58.381193+0000","last_fullsized":"2024-09-22T08:51:58.381193+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:45:38.728128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"263'861","reported_seq":2292,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.492952+0000","last_change":"2024-09-22T08:15:10.984491+0000","last_active":"2024-09-22T08:56:16.492952+0000","last_peered":"2024-09-22T08:56:16.492952+0000","last_clean":"2024-09-22T08:56:16.492952+0000","last_became_active":"2024-09-22T08:15:10.984157+0000","last_became_peered":"2024-09-22T08:15:10.984157+0000","last_unstale":"2024-09-22T08:56:16.492952+0000","last_undegraded":"2024-09-22T08:56:16.492952+0000","last_fullsized":"2024-09-22T08:56:16.492952+0000","mapping_epoch":29,"log_start":"263'800","ondisk_log_start":"263'800","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":800,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:22:53.295285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49716,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1169,"num_read_kb":1404,"num_write":276,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:48.387989+0000","last_change":"2024-09-22T08:15:13.012134+0000","last_active":"2024-09-22T08:52:48.387989+0000","last_peered":"2024-09-22T08:52:48.387989+0000","last_clean":"2024-09-22T08:52:48.387989+0000","last_became_active":"2024-09-22T08:15:13.011864+0000","last_became_peered":"2024-09-22T08:15:13.011864+0000","last_unstale":"2024-09-22T08:52:48.387989+0000","last_undegraded":"2024-09-22T08:52:48.387989+0000","last_fullsized":"2024-09-22T08:52:48.387989+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:25:33.123487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"263'214","reported_seq":740,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:21.016218+0000","last_change":"2024-09-22T08:15:15.014316+0000","last_active":"2024-09-22T08:54:21.016218+0000","last_peered":"2024-09-22T08:54:21.016218+0000","last_clean":"2024-09-22T08:54:21.016218+0000","last_became_active":"2024-09-22T08:15:15.014003+0000","last_became_peered":"2024-09-22T08:15:15.014003+0000","last_unstale":"2024-09-22T08:54:21.016218+0000","last_undegraded":"2024-09-22T08:54:21.016218+0000","last_fullsized":"2024-09-22T08:54:21.016218+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:43:13.045667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":401,"num_read_kb":391,"num_write":491,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"263'696","reported_seq":2529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.362007+0000","last_change":"2024-09-22T08:15:06.973031+0000","last_active":"2024-09-22T08:54:27.362007+0000","last_peered":"2024-09-22T08:54:27.362007+0000","last_clean":"2024-09-22T08:54:27.362007+0000","last_became_active":"2024-09-22T08:15:06.972591+0000","last_became_peered":"2024-09-22T08:15:06.972591+0000","last_unstale":"2024-09-22T08:54:27.362007+0000","last_undegraded":"2024-09-22T08:54:27.362007+0000","last_fullsized":"2024-09-22T08:54:27.362007+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":600,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:47.241992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3779,"num_read_kb":3472,"num_write":954,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:27.282937+0000","last_change":"2024-09-22T08:14:56.717627+0000","last_active":"2024-09-22T08:52:27.282937+0000","last_peered":"2024-09-22T08:52:27.282937+0000","last_clean":"2024-09-22T08:52:27.282937+0000","last_became_active":"2024-09-22T08:14:54.718660+0000","last_became_peered":"2024-09-22T08:14:54.718660+0000","last_unstale":"2024-09-22T08:52:27.282937+0000","last_undegraded":"2024-09-22T08:52:27.282937+0000","last_fullsized":"2024-09-22T08:52:27.282937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:04:54.693455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042448600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"263'260","reported_seq":945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.513802+0000","last_change":"2024-09-22T08:15:04.956486+0000","last_active":"2024-09-22T08:56:16.513802+0000","last_peered":"2024-09-22T08:56:16.513802+0000","last_clean":"2024-09-22T08:56:16.513802+0000","last_became_active":"2024-09-22T08:15:04.954726+0000","last_became_peered":"2024-09-22T08:15:04.954726+0000","last_unstale":"2024-09-22T08:56:16.513802+0000","last_undegraded":"2024-09-22T08:56:16.513802+0000","last_fullsized":"2024-09-22T08:56:16.513802+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:50:58.850263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":813,"num_read_kb":7176,"num_write":1020,"num_write_kb":41627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:02.279468+0000","last_change":"2024-09-22T08:15:08.974770+0000","last_active":"2024-09-22T08:52:02.279468+0000","last_peered":"2024-09-22T08:52:02.279468+0000","last_clean":"2024-09-22T08:52:02.279468+0000","last_became_active":"2024-09-22T08:15:08.974419+0000","last_became_peered":"2024-09-22T08:15:08.974419+0000","last_unstale":"2024-09-22T08:52:02.279468+0000","last_undegraded":"2024-09-22T08:52:02.279468+0000","last_fullsized":"2024-09-22T08:52:02.279468+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:25:16.095099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"263'233","reported_seq":1269,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:03.082254+0000","last_change":"2024-09-22T08:15:10.987757+0000","last_active":"2024-09-22T08:56:03.082254+0000","last_peered":"2024-09-22T08:56:03.082254+0000","last_clean":"2024-09-22T08:56:03.082254+0000","last_became_active":"2024-09-22T08:15:10.987358+0000","last_became_peered":"2024-09-22T08:15:10.987358+0000","last_unstale":"2024-09-22T08:56:03.082254+0000","last_undegraded":"2024-09-22T08:56:03.082254+0000","last_fullsized":"2024-09-22T08:56:03.082254+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:37:21.645192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":174,"num_read_kb":166,"num_write":139,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:42.398346+0000","last_change":"2024-09-22T08:15:13.010215+0000","last_active":"2024-09-22T08:52:42.398346+0000","last_peered":"2024-09-22T08:52:42.398346+0000","last_clean":"2024-09-22T08:52:42.398346+0000","last_became_active":"2024-09-22T08:15:13.009891+0000","last_became_peered":"2024-09-22T08:15:13.009891+0000","last_unstale":"2024-09-22T08:52:42.398346+0000","last_undegraded":"2024-09-22T08:52:42.398346+0000","last_fullsized":"2024-09-22T08:52:42.398346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:10:10.890953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"263'244","reported_seq":839,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.629431+0000","last_change":"2024-09-22T08:15:15.018070+0000","last_active":"2024-09-22T08:54:41.629431+0000","last_peered":"2024-09-22T08:54:41.629431+0000","last_clean":"2024-09-22T08:54:41.629431+0000","last_became_active":"2024-09-22T08:15:15.017686+0000","last_became_peered":"2024-09-22T08:15:15.017686+0000","last_unstale":"2024-09-22T08:54:41.629431+0000","last_undegraded":"2024-09-22T08:54:41.629431+0000","last_fullsized":"2024-09-22T08:54:41.629431+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:59:24.235010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":504,"num_read_kb":528,"num_write":541,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"263'456","reported_seq":1982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.479919+0000","last_change":"2024-09-22T08:15:06.963038+0000","last_active":"2024-09-22T08:54:41.479919+0000","last_peered":"2024-09-22T08:54:41.479919+0000","last_clean":"2024-09-22T08:54:41.479919+0000","last_became_active":"2024-09-22T08:15:06.962486+0000","last_became_peered":"2024-09-22T08:15:06.962486+0000","last_unstale":"2024-09-22T08:54:41.479919+0000","last_undegraded":"2024-09-22T08:54:41.479919+0000","last_fullsized":"2024-09-22T08:54:41.479919+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:46:27.014096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2436,"num_read_kb":2281,"num_write":554,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:28.385348+0000","last_change":"2024-09-22T08:14:56.729819+0000","last_active":"2024-09-22T08:52:28.385348+0000","last_peered":"2024-09-22T08:52:28.385348+0000","last_clean":"2024-09-22T08:52:28.385348+0000","last_became_active":"2024-09-22T08:14:55.586088+0000","last_became_peered":"2024-09-22T08:14:55.586088+0000","last_unstale":"2024-09-22T08:52:28.385348+0000","last_undegraded":"2024-09-22T08:52:28.385348+0000","last_fullsized":"2024-09-22T08:52:28.385348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:11:26.177736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010233219999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"263'159","reported_seq":747,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:20.955181+0000","last_change":"2024-09-22T08:15:04.964256+0000","last_active":"2024-09-22T08:54:20.955181+0000","last_peered":"2024-09-22T08:54:20.955181+0000","last_clean":"2024-09-22T08:54:20.955181+0000","last_became_active":"2024-09-22T08:15:04.963894+0000","last_became_peered":"2024-09-22T08:15:04.963894+0000","last_unstale":"2024-09-22T08:54:20.955181+0000","last_undegraded":"2024-09-22T08:54:20.955181+0000","last_fullsized":"2024-09-22T08:54:20.955181+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:03:26.990192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1397368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":408,"num_read_kb":11085,"num_write":744,"num_write_kb":14868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:52.286614+0000","last_change":"2024-09-22T08:15:08.968415+0000","last_active":"2024-09-22T08:52:52.286614+0000","last_peered":"2024-09-22T08:52:52.286614+0000","last_clean":"2024-09-22T08:52:52.286614+0000","last_became_active":"2024-09-22T08:15:08.968076+0000","last_became_peered":"2024-09-22T08:15:08.968076+0000","last_unstale":"2024-09-22T08:52:52.286614+0000","last_undegraded":"2024-09-22T08:52:52.286614+0000","last_fullsized":"2024-09-22T08:52:52.286614+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:46:34.843923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"263'111","reported_seq":650,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.699221+0000","last_change":"2024-09-22T08:15:10.992735+0000","last_active":"2024-09-22T08:55:19.699221+0000","last_peered":"2024-09-22T08:55:19.699221+0000","last_clean":"2024-09-22T08:55:19.699221+0000","last_became_active":"2024-09-22T08:15:10.992450+0000","last_became_peered":"2024-09-22T08:15:10.992450+0000","last_unstale":"2024-09-22T08:55:19.699221+0000","last_undegraded":"2024-09-22T08:55:19.699221+0000","last_fullsized":"2024-09-22T08:55:19.699221+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:04:43.027150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":139,"num_read_kb":133,"num_write":98,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:03.381868+0000","last_change":"2024-09-22T08:15:13.012190+0000","last_active":"2024-09-22T08:52:03.381868+0000","last_peered":"2024-09-22T08:52:03.381868+0000","last_clean":"2024-09-22T08:52:03.381868+0000","last_became_active":"2024-09-22T08:15:13.011756+0000","last_became_peered":"2024-09-22T08:15:13.011756+0000","last_unstale":"2024-09-22T08:52:03.381868+0000","last_undegraded":"2024-09-22T08:52:03.381868+0000","last_fullsized":"2024-09-22T08:52:03.381868+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:22:28.670776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"263'109","reported_seq":659,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:23.867017+0000","last_change":"2024-09-22T08:15:15.017200+0000","last_active":"2024-09-22T08:54:23.867017+0000","last_peered":"2024-09-22T08:54:23.867017+0000","last_clean":"2024-09-22T08:54:23.867017+0000","last_became_active":"2024-09-22T08:15:15.016910+0000","last_became_peered":"2024-09-22T08:15:15.016910+0000","last_unstale":"2024-09-22T08:54:23.867017+0000","last_undegraded":"2024-09-22T08:54:23.867017+0000","last_fullsized":"2024-09-22T08:54:23.867017+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:32:32.592078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":271,"num_read_kb":261,"num_write":275,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"263'846","reported_seq":2453,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:24.609357+0000","last_change":"2024-09-22T08:15:06.965563+0000","last_active":"2024-09-22T08:54:24.609357+0000","last_peered":"2024-09-22T08:54:24.609357+0000","last_clean":"2024-09-22T08:54:24.609357+0000","last_became_active":"2024-09-22T08:15:06.965021+0000","last_became_peered":"2024-09-22T08:15:06.965021+0000","last_unstale":"2024-09-22T08:54:24.609357+0000","last_undegraded":"2024-09-22T08:54:24.609357+0000","last_fullsized":"2024-09-22T08:54:24.609357+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":800,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:23:54.792970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4016,"num_read_kb":3619,"num_write":1120,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"263'170","reported_seq":776,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:08.199270+0000","last_change":"2024-09-22T08:15:04.960052+0000","last_active":"2024-09-22T08:54:08.199270+0000","last_peered":"2024-09-22T08:54:08.199270+0000","last_clean":"2024-09-22T08:54:08.199270+0000","last_became_active":"2024-09-22T08:15:04.958834+0000","last_became_peered":"2024-09-22T08:15:04.958834+0000","last_unstale":"2024-09-22T08:54:08.199270+0000","last_undegraded":"2024-09-22T08:54:08.199270+0000","last_fullsized":"2024-09-22T08:54:08.199270+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:26:47.552408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1229077,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":463,"num_read_kb":15054,"num_write":834,"num_write_kb":27215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:27.273473+0000","last_change":"2024-09-22T08:14:56.801946+0000","last_active":"2024-09-22T08:52:27.273473+0000","last_peered":"2024-09-22T08:52:27.273473+0000","last_clean":"2024-09-22T08:52:27.273473+0000","last_became_active":"2024-09-22T08:14:55.585738+0000","last_became_peered":"2024-09-22T08:14:55.585738+0000","last_unstale":"2024-09-22T08:52:27.273473+0000","last_undegraded":"2024-09-22T08:52:27.273473+0000","last_fullsized":"2024-09-22T08:52:27.273473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:33:45.401549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053802500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:42.398327+0000","last_change":"2024-09-22T08:15:08.975546+0000","last_active":"2024-09-22T08:52:42.398327+0000","last_peered":"2024-09-22T08:52:42.398327+0000","last_clean":"2024-09-22T08:52:42.398327+0000","last_became_active":"2024-09-22T08:15:08.975175+0000","last_became_peered":"2024-09-22T08:15:08.975175+0000","last_unstale":"2024-09-22T08:52:42.398327+0000","last_undegraded":"2024-09-22T08:52:42.398327+0000","last_fullsized":"2024-09-22T08:52:42.398327+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:08:07.721638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"263'293","reported_seq":956,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.453257+0000","last_change":"2024-09-22T08:15:10.982518+0000","last_active":"2024-09-22T08:56:16.453257+0000","last_peered":"2024-09-22T08:56:16.453257+0000","last_clean":"2024-09-22T08:56:16.453257+0000","last_became_active":"2024-09-22T08:15:10.982147+0000","last_became_peered":"2024-09-22T08:15:10.982147+0000","last_unstale":"2024-09-22T08:56:16.453257+0000","last_undegraded":"2024-09-22T08:56:16.453257+0000","last_fullsized":"2024-09-22T08:56:16.453257+0000","mapping_epoch":29,"log_start":"260'200","ondisk_log_start":"260'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:56:53.506784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30730,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1060,"num_read_kb":1272,"num_write":1552,"num_write_kb":1410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:46.263665+0000","last_change":"2024-09-22T08:15:13.014254+0000","last_active":"2024-09-22T08:52:46.263665+0000","last_peered":"2024-09-22T08:52:46.263665+0000","last_clean":"2024-09-22T08:52:46.263665+0000","last_became_active":"2024-09-22T08:15:13.013980+0000","last_became_peered":"2024-09-22T08:15:13.013980+0000","last_unstale":"2024-09-22T08:52:46.263665+0000","last_undegraded":"2024-09-22T08:52:46.263665+0000","last_fullsized":"2024-09-22T08:52:46.263665+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:43:47.566603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"263'169","reported_seq":721,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.923448+0000","last_change":"2024-09-22T08:15:15.012481+0000","last_active":"2024-09-22T08:54:38.923448+0000","last_peered":"2024-09-22T08:54:38.923448+0000","last_clean":"2024-09-22T08:54:38.923448+0000","last_became_active":"2024-09-22T08:15:15.012146+0000","last_became_peered":"2024-09-22T08:15:15.012146+0000","last_unstale":"2024-09-22T08:54:38.923448+0000","last_undegraded":"2024-09-22T08:54:38.923448+0000","last_fullsized":"2024-09-22T08:54:38.923448+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:12:50.086341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":420,"num_read_kb":363,"num_write":419,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"263'442","reported_seq":2036,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.480349+0000","last_change":"2024-09-22T08:15:06.973875+0000","last_active":"2024-09-22T08:54:41.480349+0000","last_peered":"2024-09-22T08:54:41.480349+0000","last_clean":"2024-09-22T08:54:41.480349+0000","last_became_active":"2024-09-22T08:15:06.973563+0000","last_became_peered":"2024-09-22T08:15:06.973563+0000","last_unstale":"2024-09-22T08:54:41.480349+0000","last_undegraded":"2024-09-22T08:54:41.480349+0000","last_fullsized":"2024-09-22T08:54:41.480349+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:06:45.622252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2370,"num_read_kb":2248,"num_write":498,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"263'189","reported_seq":810,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.434906+0000","last_change":"2024-09-22T08:15:04.956915+0000","last_active":"2024-09-22T08:56:16.434906+0000","last_peered":"2024-09-22T08:56:16.434906+0000","last_clean":"2024-09-22T08:56:16.434906+0000","last_became_active":"2024-09-22T08:15:04.956585+0000","last_became_peered":"2024-09-22T08:15:04.956585+0000","last_unstale":"2024-09-22T08:56:16.434906+0000","last_undegraded":"2024-09-22T08:56:16.434906+0000","last_fullsized":"2024-09-22T08:56:16.434906+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:18.062351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":533,"num_read_kb":28072,"num_write":815,"num_write_kb":27925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:33.386112+0000","last_change":"2024-09-22T08:14:56.729377+0000","last_active":"2024-09-22T08:52:33.386112+0000","last_peered":"2024-09-22T08:52:33.386112+0000","last_clean":"2024-09-22T08:52:33.386112+0000","last_became_active":"2024-09-22T08:14:54.727321+0000","last_became_peered":"2024-09-22T08:14:54.727321+0000","last_unstale":"2024-09-22T08:52:33.386112+0000","last_undegraded":"2024-09-22T08:52:33.386112+0000","last_fullsized":"2024-09-22T08:52:33.386112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:21:23.198586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058148900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:38.469084+0000","last_change":"2024-09-22T08:15:08.975127+0000","last_active":"2024-09-22T08:52:38.469084+0000","last_peered":"2024-09-22T08:52:38.469084+0000","last_clean":"2024-09-22T08:52:38.469084+0000","last_became_active":"2024-09-22T08:15:08.974823+0000","last_became_peered":"2024-09-22T08:15:08.974823+0000","last_unstale":"2024-09-22T08:52:38.469084+0000","last_undegraded":"2024-09-22T08:52:38.469084+0000","last_fullsized":"2024-09-22T08:52:38.469084+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:35:56.356491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"263'158","reported_seq":713,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.767668+0000","last_change":"2024-09-22T08:15:10.991721+0000","last_active":"2024-09-22T08:55:19.767668+0000","last_peered":"2024-09-22T08:55:19.767668+0000","last_clean":"2024-09-22T08:55:19.767668+0000","last_became_active":"2024-09-22T08:15:10.991426+0000","last_became_peered":"2024-09-22T08:15:10.991426+0000","last_unstale":"2024-09-22T08:55:19.767668+0000","last_undegraded":"2024-09-22T08:55:19.767668+0000","last_fullsized":"2024-09-22T08:55:19.767668+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:13:29.594926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":204,"num_read_kb":193,"num_write":140,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"263'787","reported_seq":4933,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:03.377377+0000","last_change":"2024-09-22T08:15:13.014146+0000","last_active":"2024-09-22T08:56:03.377377+0000","last_peered":"2024-09-22T08:56:03.377377+0000","last_clean":"2024-09-22T08:56:03.377377+0000","last_became_active":"2024-09-22T08:15:13.013828+0000","last_became_peered":"2024-09-22T08:15:13.013828+0000","last_unstale":"2024-09-22T08:56:03.377377+0000","last_undegraded":"2024-09-22T08:56:03.377377+0000","last_fullsized":"2024-09-22T08:56:03.377377+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:14:34.454135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"263'140","reported_seq":640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:57.311692+0000","last_change":"2024-09-22T08:15:15.014270+0000","last_active":"2024-09-22T08:55:57.311692+0000","last_peered":"2024-09-22T08:55:57.311692+0000","last_clean":"2024-09-22T08:55:57.311692+0000","last_became_active":"2024-09-22T08:15:15.013976+0000","last_became_peered":"2024-09-22T08:15:15.013976+0000","last_unstale":"2024-09-22T08:55:57.311692+0000","last_undegraded":"2024-09-22T08:55:57.311692+0000","last_fullsized":"2024-09-22T08:55:57.311692+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:36:15.356232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":177,"num_read_kb":172,"num_write":337,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"263'452","reported_seq":1950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.926375+0000","last_change":"2024-09-22T08:15:06.966706+0000","last_active":"2024-09-22T08:54:38.926375+0000","last_peered":"2024-09-22T08:54:38.926375+0000","last_clean":"2024-09-22T08:54:38.926375+0000","last_became_active":"2024-09-22T08:15:06.966387+0000","last_became_peered":"2024-09-22T08:15:06.966387+0000","last_unstale":"2024-09-22T08:54:38.926375+0000","last_undegraded":"2024-09-22T08:54:38.926375+0000","last_fullsized":"2024-09-22T08:54:38.926375+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:16:14.149148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2402,"num_read_kb":2235,"num_write":539,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"263'205","reported_seq":835,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.558391+0000","last_change":"2024-09-22T08:15:04.952329+0000","last_active":"2024-09-22T08:56:16.558391+0000","last_peered":"2024-09-22T08:56:16.558391+0000","last_clean":"2024-09-22T08:56:16.558391+0000","last_became_active":"2024-09-22T08:15:04.951731+0000","last_became_peered":"2024-09-22T08:15:04.951731+0000","last_unstale":"2024-09-22T08:56:16.558391+0000","last_undegraded":"2024-09-22T08:56:16.558391+0000","last_fullsized":"2024-09-22T08:56:16.558391+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:44:40.856747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079922,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":440,"num_read_kb":57796,"num_write":879,"num_write_kb":62478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:57.408520+0000","last_change":"2024-09-22T08:14:56.713315+0000","last_active":"2024-09-22T08:53:57.408520+0000","last_peered":"2024-09-22T08:53:57.408520+0000","last_clean":"2024-09-22T08:53:57.408520+0000","last_became_active":"2024-09-22T08:14:55.585607+0000","last_became_peered":"2024-09-22T08:14:55.585607+0000","last_unstale":"2024-09-22T08:53:57.408520+0000","last_undegraded":"2024-09-22T08:53:57.408520+0000","last_fullsized":"2024-09-22T08:53:57.408520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:00:51.872643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049298099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:38.386674+0000","last_change":"2024-09-22T08:15:08.969703+0000","last_active":"2024-09-22T08:52:38.386674+0000","last_peered":"2024-09-22T08:52:38.386674+0000","last_clean":"2024-09-22T08:52:38.386674+0000","last_became_active":"2024-09-22T08:15:08.969373+0000","last_became_peered":"2024-09-22T08:15:08.969373+0000","last_unstale":"2024-09-22T08:52:38.386674+0000","last_undegraded":"2024-09-22T08:52:38.386674+0000","last_fullsized":"2024-09-22T08:52:38.386674+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:47:22.188961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"263'106","reported_seq":641,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.751986+0000","last_change":"2024-09-22T08:15:10.986552+0000","last_active":"2024-09-22T08:55:19.751986+0000","last_peered":"2024-09-22T08:55:19.751986+0000","last_clean":"2024-09-22T08:55:19.751986+0000","last_became_active":"2024-09-22T08:15:10.984232+0000","last_became_peered":"2024-09-22T08:15:10.984232+0000","last_unstale":"2024-09-22T08:55:19.751986+0000","last_undegraded":"2024-09-22T08:55:19.751986+0000","last_fullsized":"2024-09-22T08:55:19.751986+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:21.636103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":116,"num_write":82,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"263'792","reported_seq":2214,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.233603+0000","last_change":"2024-09-22T08:15:13.008717+0000","last_active":"2024-09-22T08:56:16.233603+0000","last_peered":"2024-09-22T08:56:16.233603+0000","last_clean":"2024-09-22T08:56:16.233603+0000","last_became_active":"2024-09-22T08:15:13.008027+0000","last_became_peered":"2024-09-22T08:15:13.008027+0000","last_unstale":"2024-09-22T08:56:16.233603+0000","last_undegraded":"2024-09-22T08:56:16.233603+0000","last_fullsized":"2024-09-22T08:56:16.233603+0000","mapping_epoch":31,"log_start":"263'701","ondisk_log_start":"263'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":701,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:47:23.567624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"263'198","reported_seq":712,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:51.192463+0000","last_change":"2024-09-22T08:15:15.014730+0000","last_active":"2024-09-22T08:53:51.192463+0000","last_peered":"2024-09-22T08:53:51.192463+0000","last_clean":"2024-09-22T08:53:51.192463+0000","last_became_active":"2024-09-22T08:15:15.014423+0000","last_became_peered":"2024-09-22T08:15:15.014423+0000","last_unstale":"2024-09-22T08:53:51.192463+0000","last_undegraded":"2024-09-22T08:53:51.192463+0000","last_fullsized":"2024-09-22T08:53:51.192463+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:25:32.708147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":250,"num_read_kb":232,"num_write":460,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"263'497","reported_seq":2058,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.360747+0000","last_change":"2024-09-22T08:15:06.968425+0000","last_active":"2024-09-22T08:54:27.360747+0000","last_peered":"2024-09-22T08:54:27.360747+0000","last_clean":"2024-09-22T08:54:27.360747+0000","last_became_active":"2024-09-22T08:15:06.968153+0000","last_became_peered":"2024-09-22T08:15:06.968153+0000","last_unstale":"2024-09-22T08:54:27.360747+0000","last_undegraded":"2024-09-22T08:54:27.360747+0000","last_fullsized":"2024-09-22T08:54:27.360747+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:29:50.157707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2565,"num_read_kb":2386,"num_write":597,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"263'198","reported_seq":816,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.531962+0000","last_change":"2024-09-22T08:15:04.944258+0000","last_active":"2024-09-22T08:56:16.531962+0000","last_peered":"2024-09-22T08:56:16.531962+0000","last_clean":"2024-09-22T08:56:16.531962+0000","last_became_active":"2024-09-22T08:15:04.943901+0000","last_became_peered":"2024-09-22T08:15:04.943901+0000","last_unstale":"2024-09-22T08:56:16.531962+0000","last_undegraded":"2024-09-22T08:56:16.531962+0000","last_fullsized":"2024-09-22T08:56:16.531962+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:56:16.418792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":512,"num_read_kb":4964,"num_write":959,"num_write_kb":21539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:58.396569+0000","last_change":"2024-09-22T08:14:56.730085+0000","last_active":"2024-09-22T08:53:58.396569+0000","last_peered":"2024-09-22T08:53:58.396569+0000","last_clean":"2024-09-22T08:53:58.396569+0000","last_became_active":"2024-09-22T08:14:55.585485+0000","last_became_peered":"2024-09-22T08:14:55.585485+0000","last_unstale":"2024-09-22T08:53:58.396569+0000","last_undegraded":"2024-09-22T08:53:58.396569+0000","last_fullsized":"2024-09-22T08:53:58.396569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:42:52.718426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012642249999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:17.402768+0000","last_change":"2024-09-22T08:15:08.979746+0000","last_active":"2024-09-22T08:53:17.402768+0000","last_peered":"2024-09-22T08:53:17.402768+0000","last_clean":"2024-09-22T08:53:17.402768+0000","last_became_active":"2024-09-22T08:15:08.979291+0000","last_became_peered":"2024-09-22T08:15:08.979291+0000","last_unstale":"2024-09-22T08:53:17.402768+0000","last_undegraded":"2024-09-22T08:53:17.402768+0000","last_fullsized":"2024-09-22T08:53:17.402768+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:35:42.491182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"263'309","reported_seq":1008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:03.336761+0000","last_change":"2024-09-22T08:15:10.979541+0000","last_active":"2024-09-22T08:56:03.336761+0000","last_peered":"2024-09-22T08:56:03.336761+0000","last_clean":"2024-09-22T08:56:03.336761+0000","last_became_active":"2024-09-22T08:15:10.979261+0000","last_became_peered":"2024-09-22T08:15:10.979261+0000","last_unstale":"2024-09-22T08:56:03.336761+0000","last_undegraded":"2024-09-22T08:56:03.336761+0000","last_fullsized":"2024-09-22T08:56:03.336761+0000","mapping_epoch":29,"log_start":"260'200","ondisk_log_start":"260'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:29:00.655646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40554,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":435,"num_read_kb":615,"num_write":222,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:42.398292+0000","last_change":"2024-09-22T08:15:13.003662+0000","last_active":"2024-09-22T08:52:42.398292+0000","last_peered":"2024-09-22T08:52:42.398292+0000","last_clean":"2024-09-22T08:52:42.398292+0000","last_became_active":"2024-09-22T08:15:13.003041+0000","last_became_peered":"2024-09-22T08:15:13.003041+0000","last_unstale":"2024-09-22T08:52:42.398292+0000","last_undegraded":"2024-09-22T08:52:42.398292+0000","last_fullsized":"2024-09-22T08:52:42.398292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:43:46.552092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"263'126","reported_seq":624,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:09.125091+0000","last_change":"2024-09-22T08:15:15.015370+0000","last_active":"2024-09-22T08:54:09.125091+0000","last_peered":"2024-09-22T08:54:09.125091+0000","last_clean":"2024-09-22T08:54:09.125091+0000","last_became_active":"2024-09-22T08:15:15.014775+0000","last_became_peered":"2024-09-22T08:15:15.014775+0000","last_unstale":"2024-09-22T08:54:09.125091+0000","last_undegraded":"2024-09-22T08:54:09.125091+0000","last_fullsized":"2024-09-22T08:54:09.125091+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:42:57.977942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":162,"num_read_kb":158,"num_write":286,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"263'108","reported_seq":658,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.586531+0000","last_change":"2024-09-22T08:15:15.020963+0000","last_active":"2024-09-22T08:54:41.586531+0000","last_peered":"2024-09-22T08:54:41.586531+0000","last_clean":"2024-09-22T08:54:41.586531+0000","last_became_active":"2024-09-22T08:15:15.020653+0000","last_became_peered":"2024-09-22T08:15:15.020653+0000","last_unstale":"2024-09-22T08:54:41.586531+0000","last_undegraded":"2024-09-22T08:54:41.586531+0000","last_fullsized":"2024-09-22T08:54:41.586531+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:30:42.055327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":202,"num_read_kb":202,"num_write":258,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"263'487","reported_seq":2210,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.031042+0000","last_change":"2024-09-22T08:15:06.970797+0000","last_active":"2024-09-22T08:56:02.031042+0000","last_peered":"2024-09-22T08:56:02.031042+0000","last_clean":"2024-09-22T08:56:02.031042+0000","last_became_active":"2024-09-22T08:15:06.970382+0000","last_became_peered":"2024-09-22T08:15:06.970382+0000","last_unstale":"2024-09-22T08:56:02.031042+0000","last_undegraded":"2024-09-22T08:56:02.031042+0000","last_fullsized":"2024-09-22T08:56:02.031042+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:20:33.767995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2792,"num_read_kb":2647,"num_write":560,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"263'220","reported_seq":867,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:50.871750+0000","last_change":"2024-09-22T08:15:04.966483+0000","last_active":"2024-09-22T08:53:50.871750+0000","last_peered":"2024-09-22T08:53:50.871750+0000","last_clean":"2024-09-22T08:53:50.871750+0000","last_became_active":"2024-09-22T08:15:04.965572+0000","last_became_peered":"2024-09-22T08:15:04.965572+0000","last_unstale":"2024-09-22T08:53:50.871750+0000","last_undegraded":"2024-09-22T08:53:50.871750+0000","last_fullsized":"2024-09-22T08:53:50.871750+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:27:30.805751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8745608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":593,"num_read_kb":42984,"num_write":1008,"num_write_kb":35756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:32.274252+0000","last_change":"2024-09-22T08:15:08.976752+0000","last_active":"2024-09-22T08:52:32.274252+0000","last_peered":"2024-09-22T08:52:32.274252+0000","last_clean":"2024-09-22T08:52:32.274252+0000","last_became_active":"2024-09-22T08:15:08.976444+0000","last_became_peered":"2024-09-22T08:15:08.976444+0000","last_unstale":"2024-09-22T08:52:32.274252+0000","last_undegraded":"2024-09-22T08:52:32.274252+0000","last_fullsized":"2024-09-22T08:52:32.274252+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:57:35.914622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"263'133","reported_seq":699,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.383600+0000","last_change":"2024-09-22T08:15:10.987944+0000","last_active":"2024-09-22T08:56:16.383600+0000","last_peered":"2024-09-22T08:56:16.383600+0000","last_clean":"2024-09-22T08:56:16.383600+0000","last_became_active":"2024-09-22T08:15:10.987623+0000","last_became_peered":"2024-09-22T08:15:10.987623+0000","last_unstale":"2024-09-22T08:56:16.383600+0000","last_undegraded":"2024-09-22T08:56:16.383600+0000","last_fullsized":"2024-09-22T08:56:16.383600+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:57:31.114053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8761,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":170,"num_read_kb":207,"num_write":88,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:32.283704+0000","last_change":"2024-09-22T08:15:12.997719+0000","last_active":"2024-09-22T08:52:32.283704+0000","last_peered":"2024-09-22T08:52:32.283704+0000","last_clean":"2024-09-22T08:52:32.283704+0000","last_became_active":"2024-09-22T08:15:12.997350+0000","last_became_peered":"2024-09-22T08:15:12.997350+0000","last_unstale":"2024-09-22T08:52:32.283704+0000","last_undegraded":"2024-09-22T08:52:32.283704+0000","last_fullsized":"2024-09-22T08:52:32.283704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:08:30.511917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"263'110","reported_seq":606,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.956370+0000","last_change":"2024-09-22T08:15:15.017170+0000","last_active":"2024-09-22T08:54:27.956370+0000","last_peered":"2024-09-22T08:54:27.956370+0000","last_clean":"2024-09-22T08:54:27.956370+0000","last_became_active":"2024-09-22T08:15:15.016918+0000","last_became_peered":"2024-09-22T08:15:15.016918+0000","last_unstale":"2024-09-22T08:54:27.956370+0000","last_undegraded":"2024-09-22T08:54:27.956370+0000","last_fullsized":"2024-09-22T08:54:27.956370+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:37:28.672486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":125,"num_write":254,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"263'1037","reported_seq":2820,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:23.395142+0000","last_change":"2024-09-22T08:15:06.965797+0000","last_active":"2024-09-22T08:54:23.395142+0000","last_peered":"2024-09-22T08:54:23.395142+0000","last_clean":"2024-09-22T08:54:23.395142+0000","last_became_active":"2024-09-22T08:15:06.965465+0000","last_became_peered":"2024-09-22T08:15:06.965465+0000","last_unstale":"2024-09-22T08:54:23.395142+0000","last_undegraded":"2024-09-22T08:54:23.395142+0000","last_fullsized":"2024-09-22T08:54:23.395142+0000","mapping_epoch":25,"log_start":"263'1000","ondisk_log_start":"263'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":1000,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:50:52.178644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5105,"num_read_kb":4580,"num_write":1460,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"263'203","reported_seq":821,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:48.478344+0000","last_change":"2024-09-22T08:15:04.949496+0000","last_active":"2024-09-22T08:53:48.478344+0000","last_peered":"2024-09-22T08:53:48.478344+0000","last_clean":"2024-09-22T08:53:48.478344+0000","last_became_active":"2024-09-22T08:15:04.949181+0000","last_became_peered":"2024-09-22T08:15:04.949181+0000","last_unstale":"2024-09-22T08:53:48.478344+0000","last_undegraded":"2024-09-22T08:53:48.478344+0000","last_fullsized":"2024-09-22T08:53:48.478344+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:45:42.806686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10517089,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":534,"num_read_kb":11766,"num_write":953,"num_write_kb":45959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:32.396743+0000","last_change":"2024-09-22T08:15:08.976023+0000","last_active":"2024-09-22T08:52:32.396743+0000","last_peered":"2024-09-22T08:52:32.396743+0000","last_clean":"2024-09-22T08:52:32.396743+0000","last_became_active":"2024-09-22T08:15:08.975704+0000","last_became_peered":"2024-09-22T08:15:08.975704+0000","last_unstale":"2024-09-22T08:52:32.396743+0000","last_undegraded":"2024-09-22T08:52:32.396743+0000","last_fullsized":"2024-09-22T08:52:32.396743+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:17:14.568660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"263'38","reported_seq":538,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.550720+0000","last_change":"2024-09-22T08:15:10.983890+0000","last_active":"2024-09-22T08:55:19.550720+0000","last_peered":"2024-09-22T08:55:19.550720+0000","last_clean":"2024-09-22T08:55:19.550720+0000","last_became_active":"2024-09-22T08:15:10.983593+0000","last_became_peered":"2024-09-22T08:15:10.983593+0000","last_unstale":"2024-09-22T08:55:19.550720+0000","last_undegraded":"2024-09-22T08:55:19.550720+0000","last_fullsized":"2024-09-22T08:55:19.550720+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:52:12.816398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:36.262497+0000","last_change":"2024-09-22T08:15:13.019365+0000","last_active":"2024-09-22T08:52:36.262497+0000","last_peered":"2024-09-22T08:52:36.262497+0000","last_clean":"2024-09-22T08:52:36.262497+0000","last_became_active":"2024-09-22T08:15:13.019020+0000","last_became_peered":"2024-09-22T08:15:13.019020+0000","last_unstale":"2024-09-22T08:52:36.262497+0000","last_undegraded":"2024-09-22T08:52:36.262497+0000","last_fullsized":"2024-09-22T08:52:36.262497+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:35:35.235215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"263'182","reported_seq":702,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:40.942611+0000","last_change":"2024-09-22T08:15:15.013674+0000","last_active":"2024-09-22T08:54:40.942611+0000","last_peered":"2024-09-22T08:54:40.942611+0000","last_clean":"2024-09-22T08:54:40.942611+0000","last_became_active":"2024-09-22T08:15:15.013300+0000","last_became_peered":"2024-09-22T08:15:15.013300+0000","last_unstale":"2024-09-22T08:54:40.942611+0000","last_undegraded":"2024-09-22T08:54:40.942611+0000","last_fullsized":"2024-09-22T08:54:40.942611+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:24:00.672977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":337,"num_read_kb":325,"num_write":401,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"263'1197","reported_seq":2836,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.361022+0000","last_change":"2024-09-22T08:15:06.957428+0000","last_active":"2024-09-22T08:54:27.361022+0000","last_peered":"2024-09-22T08:54:27.361022+0000","last_clean":"2024-09-22T08:54:27.361022+0000","last_became_active":"2024-09-22T08:15:06.957116+0000","last_became_peered":"2024-09-22T08:15:06.957116+0000","last_unstale":"2024-09-22T08:54:27.361022+0000","last_undegraded":"2024-09-22T08:54:27.361022+0000","last_fullsized":"2024-09-22T08:54:27.361022+0000","mapping_epoch":25,"log_start":"263'1100","ondisk_log_start":"263'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":1100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:50:47.227003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5635,"num_read_kb":5002,"num_write":1685,"num_write_kb":733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"263'188","reported_seq":802,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:26.655338+0000","last_change":"2024-09-22T08:15:04.969475+0000","last_active":"2024-09-22T08:54:26.655338+0000","last_peered":"2024-09-22T08:54:26.655338+0000","last_clean":"2024-09-22T08:54:26.655338+0000","last_became_active":"2024-09-22T08:15:04.968557+0000","last_became_peered":"2024-09-22T08:15:04.968557+0000","last_unstale":"2024-09-22T08:54:26.655338+0000","last_undegraded":"2024-09-22T08:54:26.655338+0000","last_fullsized":"2024-09-22T08:54:26.655338+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:09:13.268818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3177072,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":518,"num_read_kb":8164,"num_write":862,"num_write_kb":39531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:31.261934+0000","last_change":"2024-09-22T08:15:08.975282+0000","last_active":"2024-09-22T08:52:31.261934+0000","last_peered":"2024-09-22T08:52:31.261934+0000","last_clean":"2024-09-22T08:52:31.261934+0000","last_became_active":"2024-09-22T08:15:08.975001+0000","last_became_peered":"2024-09-22T08:15:08.975001+0000","last_unstale":"2024-09-22T08:52:31.261934+0000","last_undegraded":"2024-09-22T08:52:31.261934+0000","last_fullsized":"2024-09-22T08:52:31.261934+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:33.382158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"263'169","reported_seq":759,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.286569+0000","last_change":"2024-09-22T08:15:10.980804+0000","last_active":"2024-09-22T08:56:16.286569+0000","last_peered":"2024-09-22T08:56:16.286569+0000","last_clean":"2024-09-22T08:56:16.286569+0000","last_became_active":"2024-09-22T08:15:10.980443+0000","last_became_peered":"2024-09-22T08:15:10.980443+0000","last_unstale":"2024-09-22T08:56:16.286569+0000","last_undegraded":"2024-09-22T08:56:16.286569+0000","last_fullsized":"2024-09-22T08:56:16.286569+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:05:27.025223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":222,"num_read_kb":300,"num_write":124,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:33.385632+0000","last_change":"2024-09-22T08:15:13.010967+0000","last_active":"2024-09-22T08:52:33.385632+0000","last_peered":"2024-09-22T08:52:33.385632+0000","last_clean":"2024-09-22T08:52:33.385632+0000","last_became_active":"2024-09-22T08:15:13.010660+0000","last_became_peered":"2024-09-22T08:15:13.010660+0000","last_unstale":"2024-09-22T08:52:33.385632+0000","last_undegraded":"2024-09-22T08:52:33.385632+0000","last_fullsized":"2024-09-22T08:52:33.385632+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:04:33.172378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"263'141","reported_seq":674,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:23.390425+0000","last_change":"2024-09-22T08:15:15.015966+0000","last_active":"2024-09-22T08:54:23.390425+0000","last_peered":"2024-09-22T08:54:23.390425+0000","last_clean":"2024-09-22T08:54:23.390425+0000","last_became_active":"2024-09-22T08:15:15.015497+0000","last_became_peered":"2024-09-22T08:15:15.015497+0000","last_unstale":"2024-09-22T08:54:23.390425+0000","last_undegraded":"2024-09-22T08:54:23.390425+0000","last_fullsized":"2024-09-22T08:54:23.390425+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:19:47.834057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":885,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":300,"num_read_kb":272,"num_write":341,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"263'915","reported_seq":2761,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.032493+0000","last_change":"2024-09-22T08:15:06.964381+0000","last_active":"2024-09-22T08:56:02.032493+0000","last_peered":"2024-09-22T08:56:02.032493+0000","last_clean":"2024-09-22T08:56:02.032493+0000","last_became_active":"2024-09-22T08:15:06.964082+0000","last_became_peered":"2024-09-22T08:15:06.964082+0000","last_unstale":"2024-09-22T08:56:02.032493+0000","last_undegraded":"2024-09-22T08:56:02.032493+0000","last_fullsized":"2024-09-22T08:56:02.032493+0000","mapping_epoch":25,"log_start":"263'900","ondisk_log_start":"263'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":900,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:59:59.631124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4594,"num_read_kb":4173,"num_write":1193,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"263'259","reported_seq":885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.532208+0000","last_change":"2024-09-22T08:15:04.956185+0000","last_active":"2024-09-22T08:56:16.532208+0000","last_peered":"2024-09-22T08:56:16.532208+0000","last_clean":"2024-09-22T08:56:16.532208+0000","last_became_active":"2024-09-22T08:15:04.954431+0000","last_became_peered":"2024-09-22T08:15:04.954431+0000","last_unstale":"2024-09-22T08:56:16.532208+0000","last_undegraded":"2024-09-22T08:56:16.532208+0000","last_fullsized":"2024-09-22T08:56:16.532208+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:58:31.332537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":625,"num_read_kb":10749,"num_write":1043,"num_write_kb":36368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:28.385312+0000","last_change":"2024-09-22T08:15:08.978366+0000","last_active":"2024-09-22T08:52:28.385312+0000","last_peered":"2024-09-22T08:52:28.385312+0000","last_clean":"2024-09-22T08:52:28.385312+0000","last_became_active":"2024-09-22T08:15:08.978080+0000","last_became_peered":"2024-09-22T08:15:08.978080+0000","last_unstale":"2024-09-22T08:52:28.385312+0000","last_undegraded":"2024-09-22T08:52:28.385312+0000","last_fullsized":"2024-09-22T08:52:28.385312+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:58:42.395174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"263'132","reported_seq":691,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.643815+0000","last_change":"2024-09-22T08:15:10.975370+0000","last_active":"2024-09-22T08:55:19.643815+0000","last_peered":"2024-09-22T08:55:19.643815+0000","last_clean":"2024-09-22T08:55:19.643815+0000","last_became_active":"2024-09-22T08:15:10.975066+0000","last_became_peered":"2024-09-22T08:15:10.975066+0000","last_unstale":"2024-09-22T08:55:19.643815+0000","last_undegraded":"2024-09-22T08:55:19.643815+0000","last_fullsized":"2024-09-22T08:55:19.643815+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:20:29.364085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10151,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":148,"num_read_kb":198,"num_write":76,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:32.283752+0000","last_change":"2024-09-22T08:15:13.008345+0000","last_active":"2024-09-22T08:52:32.283752+0000","last_peered":"2024-09-22T08:52:32.283752+0000","last_clean":"2024-09-22T08:52:32.283752+0000","last_became_active":"2024-09-22T08:15:13.008005+0000","last_became_peered":"2024-09-22T08:15:13.008005+0000","last_unstale":"2024-09-22T08:52:32.283752+0000","last_undegraded":"2024-09-22T08:52:32.283752+0000","last_fullsized":"2024-09-22T08:52:32.283752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:44:00.256968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"263'386","reported_seq":1910,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:19.614767+0000","last_change":"2024-09-22T08:15:06.974360+0000","last_active":"2024-09-22T08:54:19.614767+0000","last_peered":"2024-09-22T08:54:19.614767+0000","last_clean":"2024-09-22T08:54:19.614767+0000","last_became_active":"2024-09-22T08:15:06.974083+0000","last_became_peered":"2024-09-22T08:15:06.974083+0000","last_unstale":"2024-09-22T08:54:19.614767+0000","last_undegraded":"2024-09-22T08:54:19.614767+0000","last_fullsized":"2024-09-22T08:54:19.614767+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:42:23.068549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2095,"num_read_kb":2009,"num_write":415,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"263'216","reported_seq":850,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.483594+0000","last_change":"2024-09-22T08:15:04.953656+0000","last_active":"2024-09-22T08:56:16.483594+0000","last_peered":"2024-09-22T08:56:16.483594+0000","last_clean":"2024-09-22T08:56:16.483594+0000","last_became_active":"2024-09-22T08:15:04.953371+0000","last_became_peered":"2024-09-22T08:15:04.953371+0000","last_unstale":"2024-09-22T08:56:16.483594+0000","last_undegraded":"2024-09-22T08:56:16.483594+0000","last_fullsized":"2024-09-22T08:56:16.483594+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:18:43.995683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079956,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":551,"num_read_kb":20845,"num_write":984,"num_write_kb":34041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:22.281487+0000","last_change":"2024-09-22T08:15:08.978352+0000","last_active":"2024-09-22T08:53:22.281487+0000","last_peered":"2024-09-22T08:53:22.281487+0000","last_clean":"2024-09-22T08:53:22.281487+0000","last_became_active":"2024-09-22T08:15:08.977975+0000","last_became_peered":"2024-09-22T08:15:08.977975+0000","last_unstale":"2024-09-22T08:53:22.281487+0000","last_undegraded":"2024-09-22T08:53:22.281487+0000","last_fullsized":"2024-09-22T08:53:22.281487+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:36:49.695370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"263'212","reported_seq":832,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.526285+0000","last_change":"2024-09-22T08:15:10.985792+0000","last_active":"2024-09-22T08:56:16.526285+0000","last_peered":"2024-09-22T08:56:16.526285+0000","last_clean":"2024-09-22T08:56:16.526285+0000","last_became_active":"2024-09-22T08:15:10.985454+0000","last_became_peered":"2024-09-22T08:15:10.985454+0000","last_unstale":"2024-09-22T08:56:16.526285+0000","last_undegraded":"2024-09-22T08:56:16.526285+0000","last_fullsized":"2024-09-22T08:56:16.526285+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:42:16.011379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24540,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":311,"num_read_kb":482,"num_write":196,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:46.263744+0000","last_change":"2024-09-22T08:15:13.008746+0000","last_active":"2024-09-22T08:52:46.263744+0000","last_peered":"2024-09-22T08:52:46.263744+0000","last_clean":"2024-09-22T08:52:46.263744+0000","last_became_active":"2024-09-22T08:15:13.008080+0000","last_became_peered":"2024-09-22T08:15:13.008080+0000","last_unstale":"2024-09-22T08:52:46.263744+0000","last_undegraded":"2024-09-22T08:52:46.263744+0000","last_fullsized":"2024-09-22T08:52:46.263744+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:40:33.932227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"263'174","reported_seq":680,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.958769+0000","last_change":"2024-09-22T08:15:15.014411+0000","last_active":"2024-09-22T08:54:27.958769+0000","last_peered":"2024-09-22T08:54:27.958769+0000","last_clean":"2024-09-22T08:54:27.958769+0000","last_became_active":"2024-09-22T08:15:15.014112+0000","last_became_peered":"2024-09-22T08:15:15.014112+0000","last_unstale":"2024-09-22T08:54:27.958769+0000","last_undegraded":"2024-09-22T08:54:27.958769+0000","last_fullsized":"2024-09-22T08:54:27.958769+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:23:12.522068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":264,"num_read_kb":269,"num_write":416,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"263'430","reported_seq":2036,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.040119+0000","last_change":"2024-09-22T08:15:06.967093+0000","last_active":"2024-09-22T08:56:02.040119+0000","last_peered":"2024-09-22T08:56:02.040119+0000","last_clean":"2024-09-22T08:56:02.040119+0000","last_became_active":"2024-09-22T08:15:06.966715+0000","last_became_peered":"2024-09-22T08:15:06.966715+0000","last_unstale":"2024-09-22T08:56:02.040119+0000","last_undegraded":"2024-09-22T08:56:02.040119+0000","last_fullsized":"2024-09-22T08:56:02.040119+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:36:05.010276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2445,"num_read_kb":2324,"num_write":493,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"263'212","reported_seq":876,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.551729+0000","last_change":"2024-09-22T08:15:04.951193+0000","last_active":"2024-09-22T08:56:16.551729+0000","last_peered":"2024-09-22T08:56:16.551729+0000","last_clean":"2024-09-22T08:56:16.551729+0000","last_became_active":"2024-09-22T08:15:04.950890+0000","last_became_peered":"2024-09-22T08:15:04.950890+0000","last_unstale":"2024-09-22T08:56:16.551729+0000","last_undegraded":"2024-09-22T08:56:16.551729+0000","last_fullsized":"2024-09-22T08:56:16.551729+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:58:21.202885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":625,"num_read_kb":94909,"num_write":959,"num_write_kb":40287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"35'4","reported_seq":973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:15.994400+0000","last_change":"2024-09-22T08:15:08.977689+0000","last_active":"2024-09-22T08:56:15.994400+0000","last_peered":"2024-09-22T08:56:15.994400+0000","last_clean":"2024-09-22T08:56:15.994400+0000","last_became_active":"2024-09-22T08:15:08.977250+0000","last_became_peered":"2024-09-22T08:15:08.977250+0000","last_unstale":"2024-09-22T08:56:15.994400+0000","last_undegraded":"2024-09-22T08:56:15.994400+0000","last_fullsized":"2024-09-22T08:56:15.994400+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:54:28.653095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":1187,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"263'165","reported_seq":742,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.701735+0000","last_change":"2024-09-22T08:15:10.988286+0000","last_active":"2024-09-22T08:55:19.701735+0000","last_peered":"2024-09-22T08:55:19.701735+0000","last_clean":"2024-09-22T08:55:19.701735+0000","last_became_active":"2024-09-22T08:15:10.987541+0000","last_became_peered":"2024-09-22T08:15:10.987541+0000","last_unstale":"2024-09-22T08:55:19.701735+0000","last_undegraded":"2024-09-22T08:55:19.701735+0000","last_fullsized":"2024-09-22T08:55:19.701735+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:03:59.129935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13640,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":208,"num_read_kb":211,"num_write":136,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:42.275936+0000","last_change":"2024-09-22T08:15:13.012164+0000","last_active":"2024-09-22T08:52:42.275936+0000","last_peered":"2024-09-22T08:52:42.275936+0000","last_clean":"2024-09-22T08:52:42.275936+0000","last_became_active":"2024-09-22T08:15:13.011781+0000","last_became_peered":"2024-09-22T08:15:13.011781+0000","last_unstale":"2024-09-22T08:52:42.275936+0000","last_undegraded":"2024-09-22T08:52:42.275936+0000","last_fullsized":"2024-09-22T08:52:42.275936+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:36:44.769092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"263'184","reported_seq":694,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:01.978766+0000","last_change":"2024-09-22T08:15:15.011928+0000","last_active":"2024-09-22T08:56:01.978766+0000","last_peered":"2024-09-22T08:56:01.978766+0000","last_clean":"2024-09-22T08:56:01.978766+0000","last_became_active":"2024-09-22T08:15:15.011648+0000","last_became_peered":"2024-09-22T08:15:15.011648+0000","last_unstale":"2024-09-22T08:56:01.978766+0000","last_undegraded":"2024-09-22T08:56:01.978766+0000","last_fullsized":"2024-09-22T08:56:01.978766+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:40:53.969713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":287,"num_read_kb":275,"num_write":539,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"263'437","reported_seq":1950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.032917+0000","last_change":"2024-09-22T08:15:06.972503+0000","last_active":"2024-09-22T08:56:02.032917+0000","last_peered":"2024-09-22T08:56:02.032917+0000","last_clean":"2024-09-22T08:56:02.032917+0000","last_became_active":"2024-09-22T08:15:06.972213+0000","last_became_peered":"2024-09-22T08:15:06.972213+0000","last_unstale":"2024-09-22T08:56:02.032917+0000","last_undegraded":"2024-09-22T08:56:02.032917+0000","last_fullsized":"2024-09-22T08:56:02.032917+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:02:45.936755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2524,"num_read_kb":2354,"num_write":541,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"263'238","reported_seq":871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:46.585051+0000","last_change":"2024-09-22T08:15:04.960034+0000","last_active":"2024-09-22T08:53:46.585051+0000","last_peered":"2024-09-22T08:53:46.585051+0000","last_clean":"2024-09-22T08:53:46.585051+0000","last_became_active":"2024-09-22T08:15:04.959607+0000","last_became_peered":"2024-09-22T08:15:04.959607+0000","last_unstale":"2024-09-22T08:53:46.585051+0000","last_undegraded":"2024-09-22T08:53:46.585051+0000","last_fullsized":"2024-09-22T08:53:46.585051+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:36:26.063552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12214957,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":559,"num_read_kb":22702,"num_write":1139,"num_write_kb":43754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:41.263102+0000","last_change":"2024-09-22T08:15:08.975205+0000","last_active":"2024-09-22T08:52:41.263102+0000","last_peered":"2024-09-22T08:52:41.263102+0000","last_clean":"2024-09-22T08:52:41.263102+0000","last_became_active":"2024-09-22T08:15:08.974925+0000","last_became_peered":"2024-09-22T08:15:08.974925+0000","last_unstale":"2024-09-22T08:52:41.263102+0000","last_undegraded":"2024-09-22T08:52:41.263102+0000","last_fullsized":"2024-09-22T08:52:41.263102+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:08:36.707707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"263'148","reported_seq":716,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.421615+0000","last_change":"2024-09-22T08:15:10.985655+0000","last_active":"2024-09-22T08:56:16.421615+0000","last_peered":"2024-09-22T08:56:16.421615+0000","last_clean":"2024-09-22T08:56:16.421615+0000","last_became_active":"2024-09-22T08:15:10.985312+0000","last_became_peered":"2024-09-22T08:15:10.985312+0000","last_unstale":"2024-09-22T08:56:16.421615+0000","last_undegraded":"2024-09-22T08:56:16.421615+0000","last_fullsized":"2024-09-22T08:56:16.421615+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:32:30.326830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9037,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":176,"num_read_kb":231,"num_write":94,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:22.290600+0000","last_change":"2024-09-22T08:15:12.998592+0000","last_active":"2024-09-22T08:53:22.290600+0000","last_peered":"2024-09-22T08:53:22.290600+0000","last_clean":"2024-09-22T08:53:22.290600+0000","last_became_active":"2024-09-22T08:15:12.998276+0000","last_became_peered":"2024-09-22T08:15:12.998276+0000","last_unstale":"2024-09-22T08:53:22.290600+0000","last_undegraded":"2024-09-22T08:53:22.290600+0000","last_fullsized":"2024-09-22T08:53:22.290600+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:45:18.409944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"263'129","reported_seq":634,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:03.364497+0000","last_change":"2024-09-22T08:15:15.022528+0000","last_active":"2024-09-22T08:56:03.364497+0000","last_peered":"2024-09-22T08:56:03.364497+0000","last_clean":"2024-09-22T08:56:03.364497+0000","last_became_active":"2024-09-22T08:15:15.022140+0000","last_became_peered":"2024-09-22T08:15:15.022140+0000","last_unstale":"2024-09-22T08:56:03.364497+0000","last_undegraded":"2024-09-22T08:56:03.364497+0000","last_fullsized":"2024-09-22T08:56:03.364497+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:19:15.143722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":810,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":211,"num_read_kb":192,"num_write":312,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"263'532","reported_seq":2401,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.961208+0000","last_change":"2024-09-22T08:15:06.963522+0000","last_active":"2024-09-22T08:54:27.961208+0000","last_peered":"2024-09-22T08:54:27.961208+0000","last_clean":"2024-09-22T08:54:27.961208+0000","last_became_active":"2024-09-22T08:15:06.963136+0000","last_became_peered":"2024-09-22T08:15:06.963136+0000","last_unstale":"2024-09-22T08:54:27.961208+0000","last_undegraded":"2024-09-22T08:54:27.961208+0000","last_fullsized":"2024-09-22T08:54:27.961208+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":500,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:27:39.654856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3196,"num_read_kb":3015,"num_write":651,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"263'227","reported_seq":849,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.484031+0000","last_change":"2024-09-22T08:15:04.962067+0000","last_active":"2024-09-22T08:56:16.484031+0000","last_peered":"2024-09-22T08:56:16.484031+0000","last_clean":"2024-09-22T08:56:16.484031+0000","last_became_active":"2024-09-22T08:15:04.961731+0000","last_became_peered":"2024-09-22T08:15:04.961731+0000","last_unstale":"2024-09-22T08:56:16.484031+0000","last_undegraded":"2024-09-22T08:56:16.484031+0000","last_fullsized":"2024-09-22T08:56:16.484031+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:15:56.579006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079902,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":556,"num_read_kb":16778,"num_write":1039,"num_write_kb":35959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:42.398363+0000","last_change":"2024-09-22T08:15:08.974366+0000","last_active":"2024-09-22T08:52:42.398363+0000","last_peered":"2024-09-22T08:52:42.398363+0000","last_clean":"2024-09-22T08:52:42.398363+0000","last_became_active":"2024-09-22T08:15:08.973985+0000","last_became_peered":"2024-09-22T08:15:08.973985+0000","last_unstale":"2024-09-22T08:52:42.398363+0000","last_undegraded":"2024-09-22T08:52:42.398363+0000","last_fullsized":"2024-09-22T08:52:42.398363+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:43:10.742833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"263'91","reported_seq":611,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.764889+0000","last_change":"2024-09-22T08:15:10.991408+0000","last_active":"2024-09-22T08:55:19.764889+0000","last_peered":"2024-09-22T08:55:19.764889+0000","last_clean":"2024-09-22T08:55:19.764889+0000","last_became_active":"2024-09-22T08:15:10.991099+0000","last_became_peered":"2024-09-22T08:15:10.991099+0000","last_unstale":"2024-09-22T08:55:19.764889+0000","last_undegraded":"2024-09-22T08:55:19.764889+0000","last_fullsized":"2024-09-22T08:55:19.764889+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:03.952941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":117,"num_read_kb":110,"num_write":130,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"263'769","reported_seq":2287,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:03.376310+0000","last_change":"2024-09-22T08:15:13.020129+0000","last_active":"2024-09-22T08:56:03.376310+0000","last_peered":"2024-09-22T08:56:03.376310+0000","last_clean":"2024-09-22T08:56:03.376310+0000","last_became_active":"2024-09-22T08:15:13.018826+0000","last_became_peered":"2024-09-22T08:15:13.018826+0000","last_unstale":"2024-09-22T08:56:03.376310+0000","last_undegraded":"2024-09-22T08:56:03.376310+0000","last_fullsized":"2024-09-22T08:56:03.376310+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:17:45.964569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"263'136","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:22.688867+0000","last_change":"2024-09-22T08:15:15.017866+0000","last_active":"2024-09-22T08:54:22.688867+0000","last_peered":"2024-09-22T08:54:22.688867+0000","last_clean":"2024-09-22T08:54:22.688867+0000","last_became_active":"2024-09-22T08:15:15.017568+0000","last_became_peered":"2024-09-22T08:15:15.017568+0000","last_unstale":"2024-09-22T08:54:22.688867+0000","last_undegraded":"2024-09-22T08:54:22.688867+0000","last_fullsized":"2024-09-22T08:54:22.688867+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:37:11.451571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":178,"num_write":322,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"263'422","reported_seq":1876,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.030317+0000","last_change":"2024-09-22T08:15:06.973437+0000","last_active":"2024-09-22T08:56:02.030317+0000","last_peered":"2024-09-22T08:56:02.030317+0000","last_clean":"2024-09-22T08:56:02.030317+0000","last_became_active":"2024-09-22T08:15:06.973142+0000","last_became_peered":"2024-09-22T08:15:06.973142+0000","last_unstale":"2024-09-22T08:56:02.030317+0000","last_undegraded":"2024-09-22T08:56:02.030317+0000","last_fullsized":"2024-09-22T08:56:02.030317+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:42:57.640096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2325,"num_read_kb":2186,"num_write":496,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"263'204","reported_seq":802,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:14.348112+0000","last_change":"2024-09-22T08:15:04.955055+0000","last_active":"2024-09-22T08:53:14.348112+0000","last_peered":"2024-09-22T08:53:14.348112+0000","last_clean":"2024-09-22T08:53:14.348112+0000","last_became_active":"2024-09-22T08:15:04.954608+0000","last_became_peered":"2024-09-22T08:15:04.954608+0000","last_unstale":"2024-09-22T08:53:14.348112+0000","last_undegraded":"2024-09-22T08:53:14.348112+0000","last_fullsized":"2024-09-22T08:53:14.348112+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:48:59.571776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":469,"num_read_kb":8602,"num_write":952,"num_write_kb":32105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:38.386310+0000","last_change":"2024-09-22T08:15:08.980771+0000","last_active":"2024-09-22T08:52:38.386310+0000","last_peered":"2024-09-22T08:52:38.386310+0000","last_clean":"2024-09-22T08:52:38.386310+0000","last_became_active":"2024-09-22T08:15:08.980570+0000","last_became_peered":"2024-09-22T08:15:08.980570+0000","last_unstale":"2024-09-22T08:52:38.386310+0000","last_undegraded":"2024-09-22T08:52:38.386310+0000","last_fullsized":"2024-09-22T08:52:38.386310+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:52:24.440386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"263'159","reported_seq":732,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.779560+0000","last_change":"2024-09-22T08:15:10.979788+0000","last_active":"2024-09-22T08:55:19.779560+0000","last_peered":"2024-09-22T08:55:19.779560+0000","last_clean":"2024-09-22T08:55:19.779560+0000","last_became_active":"2024-09-22T08:15:10.979384+0000","last_became_peered":"2024-09-22T08:15:10.979384+0000","last_unstale":"2024-09-22T08:55:19.779560+0000","last_undegraded":"2024-09-22T08:55:19.779560+0000","last_fullsized":"2024-09-22T08:55:19.779560+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:28:09.165373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14159,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":207,"num_read_kb":270,"num_write":122,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:52.407725+0000","last_change":"2024-09-22T08:15:13.013531+0000","last_active":"2024-09-22T08:53:52.407725+0000","last_peered":"2024-09-22T08:53:52.407725+0000","last_clean":"2024-09-22T08:53:52.407725+0000","last_became_active":"2024-09-22T08:15:13.013160+0000","last_became_peered":"2024-09-22T08:15:13.013160+0000","last_unstale":"2024-09-22T08:53:52.407725+0000","last_undegraded":"2024-09-22T08:53:52.407725+0000","last_fullsized":"2024-09-22T08:53:52.407725+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:55:35.021615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"263'138","reported_seq":639,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:26.975514+0000","last_change":"2024-09-22T08:15:15.021053+0000","last_active":"2024-09-22T08:54:26.975514+0000","last_peered":"2024-09-22T08:54:26.975514+0000","last_clean":"2024-09-22T08:54:26.975514+0000","last_became_active":"2024-09-22T08:15:15.020718+0000","last_became_peered":"2024-09-22T08:15:15.020718+0000","last_unstale":"2024-09-22T08:54:26.975514+0000","last_undegraded":"2024-09-22T08:54:26.975514+0000","last_fullsized":"2024-09-22T08:54:26.975514+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:03:37.066806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":211,"num_read_kb":197,"num_write":330,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"263'800","reported_seq":2276,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.926503+0000","last_change":"2024-09-22T08:15:06.970563+0000","last_active":"2024-09-22T08:54:38.926503+0000","last_peered":"2024-09-22T08:54:38.926503+0000","last_clean":"2024-09-22T08:54:38.926503+0000","last_became_active":"2024-09-22T08:15:06.970077+0000","last_became_peered":"2024-09-22T08:15:06.970077+0000","last_unstale":"2024-09-22T08:54:38.926503+0000","last_undegraded":"2024-09-22T08:54:38.926503+0000","last_fullsized":"2024-09-22T08:54:38.926503+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:50:00.177977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3751,"num_read_kb":3364,"num_write":1047,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"263'194","reported_seq":906,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:46.952442+0000","last_change":"2024-09-22T08:15:04.962527+0000","last_active":"2024-09-22T08:53:46.952442+0000","last_peered":"2024-09-22T08:53:46.952442+0000","last_clean":"2024-09-22T08:53:46.952442+0000","last_became_active":"2024-09-22T08:15:04.962268+0000","last_became_peered":"2024-09-22T08:15:04.962268+0000","last_unstale":"2024-09-22T08:53:46.952442+0000","last_undegraded":"2024-09-22T08:53:46.952442+0000","last_fullsized":"2024-09-22T08:53:46.952442+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:54:23.748527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10535612,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":777,"num_read_kb":150382,"num_write":900,"num_write_kb":51576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:41.263079+0000","last_change":"2024-09-22T08:15:08.977670+0000","last_active":"2024-09-22T08:52:41.263079+0000","last_peered":"2024-09-22T08:52:41.263079+0000","last_clean":"2024-09-22T08:52:41.263079+0000","last_became_active":"2024-09-22T08:15:08.977341+0000","last_became_peered":"2024-09-22T08:15:08.977341+0000","last_unstale":"2024-09-22T08:52:41.263079+0000","last_undegraded":"2024-09-22T08:52:41.263079+0000","last_fullsized":"2024-09-22T08:52:41.263079+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:18:39.684334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"263'127","reported_seq":692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.479118+0000","last_change":"2024-09-22T08:15:10.981034+0000","last_active":"2024-09-22T08:56:16.479118+0000","last_peered":"2024-09-22T08:56:16.479118+0000","last_clean":"2024-09-22T08:56:16.479118+0000","last_became_active":"2024-09-22T08:15:10.980015+0000","last_became_peered":"2024-09-22T08:15:10.980015+0000","last_unstale":"2024-09-22T08:56:16.479118+0000","last_undegraded":"2024-09-22T08:56:16.479118+0000","last_fullsized":"2024-09-22T08:56:16.479118+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:10:49.816903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20804,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":281,"num_write":88,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:33.376948+0000","last_change":"2024-09-22T08:15:13.012480+0000","last_active":"2024-09-22T08:51:33.376948+0000","last_peered":"2024-09-22T08:51:33.376948+0000","last_clean":"2024-09-22T08:51:33.376948+0000","last_became_active":"2024-09-22T08:15:13.011134+0000","last_became_peered":"2024-09-22T08:15:13.011134+0000","last_unstale":"2024-09-22T08:51:33.376948+0000","last_undegraded":"2024-09-22T08:51:33.376948+0000","last_fullsized":"2024-09-22T08:51:33.376948+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:29:04.991665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"263'150","reported_seq":670,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.360615+0000","last_change":"2024-09-22T08:15:15.013212+0000","last_active":"2024-09-22T08:54:41.360615+0000","last_peered":"2024-09-22T08:54:41.360615+0000","last_clean":"2024-09-22T08:54:41.360615+0000","last_became_active":"2024-09-22T08:15:15.012939+0000","last_became_peered":"2024-09-22T08:15:15.012939+0000","last_unstale":"2024-09-22T08:54:41.360615+0000","last_undegraded":"2024-09-22T08:54:41.360615+0000","last_fullsized":"2024-09-22T08:54:41.360615+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:08:40.354379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":256,"num_read_kb":247,"num_write":364,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"263'562","reported_seq":2355,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.472866+0000","last_change":"2024-09-22T08:15:06.960886+0000","last_active":"2024-09-22T08:54:41.472866+0000","last_peered":"2024-09-22T08:54:41.472866+0000","last_clean":"2024-09-22T08:54:41.472866+0000","last_became_active":"2024-09-22T08:15:06.960599+0000","last_became_peered":"2024-09-22T08:15:06.960599+0000","last_unstale":"2024-09-22T08:54:41.472866+0000","last_undegraded":"2024-09-22T08:54:41.472866+0000","last_fullsized":"2024-09-22T08:54:41.472866+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":500,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:27:19.885943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3136,"num_read_kb":2948,"num_write":673,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"263'210","reported_seq":837,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.548080+0000","last_change":"2024-09-22T08:15:04.963136+0000","last_active":"2024-09-22T08:56:16.548080+0000","last_peered":"2024-09-22T08:56:16.548080+0000","last_clean":"2024-09-22T08:56:16.548080+0000","last_became_active":"2024-09-22T08:15:04.962785+0000","last_became_peered":"2024-09-22T08:15:04.962785+0000","last_unstale":"2024-09-22T08:56:16.548080+0000","last_undegraded":"2024-09-22T08:56:16.548080+0000","last_fullsized":"2024-09-22T08:56:16.548080+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:29:11.602912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":497,"num_read_kb":22160,"num_write":848,"num_write_kb":45151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:48.394911+0000","last_change":"2024-09-22T08:15:08.979401+0000","last_active":"2024-09-22T08:53:48.394911+0000","last_peered":"2024-09-22T08:53:48.394911+0000","last_clean":"2024-09-22T08:53:48.394911+0000","last_became_active":"2024-09-22T08:15:08.978844+0000","last_became_peered":"2024-09-22T08:15:08.978844+0000","last_unstale":"2024-09-22T08:53:48.394911+0000","last_undegraded":"2024-09-22T08:53:48.394911+0000","last_fullsized":"2024-09-22T08:53:48.394911+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:07:22.042882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"263'128","reported_seq":678,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.407905+0000","last_change":"2024-09-22T08:15:10.983840+0000","last_active":"2024-09-22T08:56:16.407905+0000","last_peered":"2024-09-22T08:56:16.407905+0000","last_clean":"2024-09-22T08:56:16.407905+0000","last_became_active":"2024-09-22T08:15:10.983522+0000","last_became_peered":"2024-09-22T08:15:10.983522+0000","last_unstale":"2024-09-22T08:56:16.407905+0000","last_undegraded":"2024-09-22T08:56:16.407905+0000","last_fullsized":"2024-09-22T08:56:16.407905+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:05:15.621827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62130,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":173,"num_read_kb":427,"num_write":104,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:43.387370+0000","last_change":"2024-09-22T08:15:13.015794+0000","last_active":"2024-09-22T08:52:43.387370+0000","last_peered":"2024-09-22T08:52:43.387370+0000","last_clean":"2024-09-22T08:52:43.387370+0000","last_became_active":"2024-09-22T08:15:13.015473+0000","last_became_peered":"2024-09-22T08:15:13.015473+0000","last_unstale":"2024-09-22T08:52:43.387370+0000","last_undegraded":"2024-09-22T08:52:43.387370+0000","last_fullsized":"2024-09-22T08:52:43.387370+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:45:01.160499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"263'213","reported_seq":1671,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:39.321243+0000","last_change":"2024-09-22T08:15:15.018252+0000","last_active":"2024-09-22T08:54:39.321243+0000","last_peered":"2024-09-22T08:54:39.321243+0000","last_clean":"2024-09-22T08:54:39.321243+0000","last_became_active":"2024-09-22T08:15:15.017394+0000","last_became_peered":"2024-09-22T08:15:15.017394+0000","last_unstale":"2024-09-22T08:54:39.321243+0000","last_undegraded":"2024-09-22T08:54:39.321243+0000","last_fullsized":"2024-09-22T08:54:39.321243+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:26:17.481953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1186,"num_read_kb":1185,"num_write":465,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"263'821","reported_seq":2516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.926722+0000","last_change":"2024-09-22T08:15:06.967900+0000","last_active":"2024-09-22T08:54:38.926722+0000","last_peered":"2024-09-22T08:54:38.926722+0000","last_clean":"2024-09-22T08:54:38.926722+0000","last_became_active":"2024-09-22T08:15:06.967603+0000","last_became_peered":"2024-09-22T08:15:06.967603+0000","last_unstale":"2024-09-22T08:54:38.926722+0000","last_undegraded":"2024-09-22T08:54:38.926722+0000","last_fullsized":"2024-09-22T08:54:38.926722+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":800,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:44:20.031138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4151,"num_read_kb":3787,"num_write":1085,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"263'209","reported_seq":872,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.482922+0000","last_change":"2024-09-22T08:15:04.957997+0000","last_active":"2024-09-22T08:56:16.482922+0000","last_peered":"2024-09-22T08:56:16.482922+0000","last_clean":"2024-09-22T08:56:16.482922+0000","last_became_active":"2024-09-22T08:15:04.957654+0000","last_became_peered":"2024-09-22T08:15:04.957654+0000","last_unstale":"2024-09-22T08:56:16.482922+0000","last_undegraded":"2024-09-22T08:56:16.482922+0000","last_fullsized":"2024-09-22T08:56:16.482922+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:15:19.864352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":592,"num_read_kb":25705,"num_write":948,"num_write_kb":45275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:32.388383+0000","last_change":"2024-09-22T08:15:08.973107+0000","last_active":"2024-09-22T08:51:32.388383+0000","last_peered":"2024-09-22T08:51:32.388383+0000","last_clean":"2024-09-22T08:51:32.388383+0000","last_became_active":"2024-09-22T08:15:08.972733+0000","last_became_peered":"2024-09-22T08:15:08.972733+0000","last_unstale":"2024-09-22T08:51:32.388383+0000","last_undegraded":"2024-09-22T08:51:32.388383+0000","last_fullsized":"2024-09-22T08:51:32.388383+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:09:10.684801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"263'152","reported_seq":730,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.652107+0000","last_change":"2024-09-22T08:15:10.987881+0000","last_active":"2024-09-22T08:55:19.652107+0000","last_peered":"2024-09-22T08:55:19.652107+0000","last_clean":"2024-09-22T08:55:19.652107+0000","last_became_active":"2024-09-22T08:15:10.987610+0000","last_became_peered":"2024-09-22T08:15:10.987610+0000","last_unstale":"2024-09-22T08:55:19.652107+0000","last_undegraded":"2024-09-22T08:55:19.652107+0000","last_fullsized":"2024-09-22T08:55:19.652107+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:25:04.343680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8998,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":200,"num_read_kb":256,"num_write":114,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:42.398317+0000","last_change":"2024-09-22T08:15:13.003540+0000","last_active":"2024-09-22T08:52:42.398317+0000","last_peered":"2024-09-22T08:52:42.398317+0000","last_clean":"2024-09-22T08:52:42.398317+0000","last_became_active":"2024-09-22T08:15:13.003219+0000","last_became_peered":"2024-09-22T08:15:13.003219+0000","last_unstale":"2024-09-22T08:52:42.398317+0000","last_undegraded":"2024-09-22T08:52:42.398317+0000","last_fullsized":"2024-09-22T08:52:42.398317+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:50:35.499014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"263'159","reported_seq":639,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.030006+0000","last_change":"2024-09-22T08:15:15.018630+0000","last_active":"2024-09-22T08:56:02.030006+0000","last_peered":"2024-09-22T08:56:02.030006+0000","last_clean":"2024-09-22T08:56:02.030006+0000","last_became_active":"2024-09-22T08:15:15.018311+0000","last_became_peered":"2024-09-22T08:15:15.018311+0000","last_unstale":"2024-09-22T08:56:02.030006+0000","last_undegraded":"2024-09-22T08:56:02.030006+0000","last_fullsized":"2024-09-22T08:56:02.030006+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:45:03.170254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":160,"num_write":367,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"263'889","reported_seq":2468,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.961170+0000","last_change":"2024-09-22T08:15:06.965116+0000","last_active":"2024-09-22T08:54:27.961170+0000","last_peered":"2024-09-22T08:54:27.961170+0000","last_clean":"2024-09-22T08:54:27.961170+0000","last_became_active":"2024-09-22T08:15:06.964786+0000","last_became_peered":"2024-09-22T08:15:06.964786+0000","last_unstale":"2024-09-22T08:54:27.961170+0000","last_undegraded":"2024-09-22T08:54:27.961170+0000","last_fullsized":"2024-09-22T08:54:27.961170+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":800,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:33:01.235899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4058,"num_read_kb":3642,"num_write":1164,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"263'224","reported_seq":892,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:18.408563+0000","last_change":"2024-09-22T08:15:04.963081+0000","last_active":"2024-09-22T08:53:18.408563+0000","last_peered":"2024-09-22T08:53:18.408563+0000","last_clean":"2024-09-22T08:53:18.408563+0000","last_became_active":"2024-09-22T08:15:04.962774+0000","last_became_peered":"2024-09-22T08:15:04.962774+0000","last_unstale":"2024-09-22T08:53:18.408563+0000","last_undegraded":"2024-09-22T08:53:18.408563+0000","last_fullsized":"2024-09-22T08:53:18.408563+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:28:22.448316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":683,"num_read_kb":4749,"num_write":1115,"num_write_kb":28646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"263'862","reported_seq":2345,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:25.945638+0000","last_change":"2024-09-22T08:15:06.958712+0000","last_active":"2024-09-22T08:54:25.945638+0000","last_peered":"2024-09-22T08:54:25.945638+0000","last_clean":"2024-09-22T08:54:25.945638+0000","last_became_active":"2024-09-22T08:15:06.958389+0000","last_became_peered":"2024-09-22T08:15:06.958389+0000","last_unstale":"2024-09-22T08:54:25.945638+0000","last_undegraded":"2024-09-22T08:54:25.945638+0000","last_fullsized":"2024-09-22T08:54:25.945638+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":800,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:17:52.710339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3808,"num_read_kb":3398,"num_write":1097,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"263'363","reported_seq":1051,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.392172+0000","last_change":"2024-09-22T08:15:04.951222+0000","last_active":"2024-09-22T08:56:16.392172+0000","last_peered":"2024-09-22T08:56:16.392172+0000","last_clean":"2024-09-22T08:56:16.392172+0000","last_became_active":"2024-09-22T08:15:04.950922+0000","last_became_peered":"2024-09-22T08:15:04.950922+0000","last_unstale":"2024-09-22T08:56:16.392172+0000","last_undegraded":"2024-09-22T08:56:16.392172+0000","last_fullsized":"2024-09-22T08:56:16.392172+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:41:56.256814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1005,"num_read_kb":11417,"num_write":1356,"num_write_kb":38557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"263'414","reported_seq":1863,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:07.456606+0000","last_change":"2024-09-22T08:15:06.974074+0000","last_active":"2024-09-22T08:54:07.456606+0000","last_peered":"2024-09-22T08:54:07.456606+0000","last_clean":"2024-09-22T08:54:07.456606+0000","last_became_active":"2024-09-22T08:15:06.973749+0000","last_became_peered":"2024-09-22T08:15:06.973749+0000","last_unstale":"2024-09-22T08:54:07.456606+0000","last_undegraded":"2024-09-22T08:54:07.456606+0000","last_fullsized":"2024-09-22T08:54:07.456606+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:09:45.710062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2229,"num_read_kb":2093,"num_write":519,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"263'224","reported_seq":855,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:43.401544+0000","last_change":"2024-09-22T08:15:04.960573+0000","last_active":"2024-09-22T08:54:43.401544+0000","last_peered":"2024-09-22T08:54:43.401544+0000","last_clean":"2024-09-22T08:54:43.401544+0000","last_became_active":"2024-09-22T08:15:04.959501+0000","last_became_peered":"2024-09-22T08:15:04.959501+0000","last_unstale":"2024-09-22T08:54:43.401544+0000","last_undegraded":"2024-09-22T08:54:43.401544+0000","last_fullsized":"2024-09-22T08:54:43.401544+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:58:53.308481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194372,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":550,"num_read_kb":25081,"num_write":1073,"num_write_kb":19730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"263'880","reported_seq":2574,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.040269+0000","last_change":"2024-09-22T08:15:06.971393+0000","last_active":"2024-09-22T08:56:02.040269+0000","last_peered":"2024-09-22T08:56:02.040269+0000","last_clean":"2024-09-22T08:56:02.040269+0000","last_became_active":"2024-09-22T08:15:06.970991+0000","last_became_peered":"2024-09-22T08:15:06.970991+0000","last_unstale":"2024-09-22T08:56:02.040269+0000","last_undegraded":"2024-09-22T08:56:02.040269+0000","last_fullsized":"2024-09-22T08:56:02.040269+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":800,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:27:06.535070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4175,"num_read_kb":3774,"num_write":1132,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"263'195","reported_seq":826,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.292438+0000","last_change":"2024-09-22T08:15:04.954644+0000","last_active":"2024-09-22T08:56:16.292438+0000","last_peered":"2024-09-22T08:56:16.292438+0000","last_clean":"2024-09-22T08:56:16.292438+0000","last_became_active":"2024-09-22T08:15:04.954281+0000","last_became_peered":"2024-09-22T08:15:04.954281+0000","last_unstale":"2024-09-22T08:56:16.292438+0000","last_undegraded":"2024-09-22T08:56:16.292438+0000","last_fullsized":"2024-09-22T08:56:16.292438+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:43:06.650935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":578,"num_read_kb":4135,"num_write":927,"num_write_kb":8648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"263'1127","reported_seq":2681,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.961055+0000","last_change":"2024-09-22T08:15:06.968491+0000","last_active":"2024-09-22T08:54:27.961055+0000","last_peered":"2024-09-22T08:54:27.961055+0000","last_clean":"2024-09-22T08:54:27.961055+0000","last_became_active":"2024-09-22T08:15:06.967938+0000","last_became_peered":"2024-09-22T08:15:06.967938+0000","last_unstale":"2024-09-22T08:54:27.961055+0000","last_undegraded":"2024-09-22T08:54:27.961055+0000","last_fullsized":"2024-09-22T08:54:27.961055+0000","mapping_epoch":25,"log_start":"263'1100","ondisk_log_start":"263'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":1100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:05:32.099143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5297,"num_read_kb":4688,"num_write":1564,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"263'196","reported_seq":874,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:07.287692+0000","last_change":"2024-09-22T08:15:04.964365+0000","last_active":"2024-09-22T08:54:07.287692+0000","last_peered":"2024-09-22T08:54:07.287692+0000","last_clean":"2024-09-22T08:54:07.287692+0000","last_became_active":"2024-09-22T08:15:04.963992+0000","last_became_peered":"2024-09-22T08:15:04.963992+0000","last_unstale":"2024-09-22T08:54:07.287692+0000","last_undegraded":"2024-09-22T08:54:07.287692+0000","last_fullsized":"2024-09-22T08:54:07.287692+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:47:44.152954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":707,"num_read_kb":8108,"num_write":879,"num_write_kb":38701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"263'391","reported_seq":2065,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:25.944051+0000","last_change":"2024-09-22T08:15:06.964443+0000","last_active":"2024-09-22T08:54:25.944051+0000","last_peered":"2024-09-22T08:54:25.944051+0000","last_clean":"2024-09-22T08:54:25.944051+0000","last_became_active":"2024-09-22T08:15:06.964116+0000","last_became_peered":"2024-09-22T08:15:06.964116+0000","last_unstale":"2024-09-22T08:54:25.944051+0000","last_undegraded":"2024-09-22T08:54:25.944051+0000","last_fullsized":"2024-09-22T08:54:25.944051+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:11:34.518000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2347,"num_read_kb":2272,"num_write":440,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"263'229","reported_seq":911,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.490048+0000","last_change":"2024-09-22T08:15:04.951989+0000","last_active":"2024-09-22T08:56:16.490048+0000","last_peered":"2024-09-22T08:56:16.490048+0000","last_clean":"2024-09-22T08:56:16.490048+0000","last_became_active":"2024-09-22T08:15:04.951628+0000","last_became_peered":"2024-09-22T08:15:04.951628+0000","last_unstale":"2024-09-22T08:56:16.490048+0000","last_undegraded":"2024-09-22T08:56:16.490048+0000","last_fullsized":"2024-09-22T08:56:16.490048+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:10:52.618601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":736,"num_read_kb":9856,"num_write":1118,"num_write_kb":28547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"263'359","reported_seq":1832,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.361190+0000","last_change":"2024-09-22T08:15:06.973913+0000","last_active":"2024-09-22T08:54:27.361190+0000","last_peered":"2024-09-22T08:54:27.361190+0000","last_clean":"2024-09-22T08:54:27.361190+0000","last_became_active":"2024-09-22T08:15:06.973584+0000","last_became_peered":"2024-09-22T08:15:06.973584+0000","last_unstale":"2024-09-22T08:54:27.361190+0000","last_undegraded":"2024-09-22T08:54:27.361190+0000","last_fullsized":"2024-09-22T08:54:27.361190+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:45:47.505506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2011,"num_read_kb":1931,"num_write":399,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"263'212","reported_seq":879,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:06.273562+0000","last_change":"2024-09-22T08:15:04.969769+0000","last_active":"2024-09-22T08:54:06.273562+0000","last_peered":"2024-09-22T08:54:06.273562+0000","last_clean":"2024-09-22T08:54:06.273562+0000","last_became_active":"2024-09-22T08:15:04.968983+0000","last_became_peered":"2024-09-22T08:15:04.968983+0000","last_unstale":"2024-09-22T08:54:06.273562+0000","last_undegraded":"2024-09-22T08:54:06.273562+0000","last_fullsized":"2024-09-22T08:54:06.273562+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:18.808569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10519112,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":611,"num_read_kb":66139,"num_write":1053,"num_write_kb":31816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"263'1262","reported_seq":3112,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.961464+0000","last_change":"2024-09-22T08:15:06.971511+0000","last_active":"2024-09-22T08:54:27.961464+0000","last_peered":"2024-09-22T08:54:27.961464+0000","last_clean":"2024-09-22T08:54:27.961464+0000","last_became_active":"2024-09-22T08:15:06.970055+0000","last_became_peered":"2024-09-22T08:15:06.970055+0000","last_unstale":"2024-09-22T08:54:27.961464+0000","last_undegraded":"2024-09-22T08:54:27.961464+0000","last_fullsized":"2024-09-22T08:54:27.961464+0000","mapping_epoch":25,"log_start":"263'1200","ondisk_log_start":"263'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":1200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:22:55.292514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6370,"num_read_kb":5597,"num_write":1961,"num_write_kb":987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"263'217","reported_seq":880,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.331777+0000","last_change":"2024-09-22T08:15:04.961957+0000","last_active":"2024-09-22T08:56:16.331777+0000","last_peered":"2024-09-22T08:56:16.331777+0000","last_clean":"2024-09-22T08:56:16.331777+0000","last_became_active":"2024-09-22T08:15:04.961545+0000","last_became_peered":"2024-09-22T08:15:04.961545+0000","last_unstale":"2024-09-22T08:56:16.331777+0000","last_undegraded":"2024-09-22T08:56:16.331777+0000","last_fullsized":"2024-09-22T08:56:16.331777+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:16:41.974072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":669,"num_read_kb":2609,"num_write":1038,"num_write_kb":23374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"263'491","reported_seq":1940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.926788+0000","last_change":"2024-09-22T08:15:06.959643+0000","last_active":"2024-09-22T08:54:38.926788+0000","last_peered":"2024-09-22T08:54:38.926788+0000","last_clean":"2024-09-22T08:54:38.926788+0000","last_became_active":"2024-09-22T08:15:06.959331+0000","last_became_peered":"2024-09-22T08:15:06.959331+0000","last_unstale":"2024-09-22T08:54:38.926788+0000","last_undegraded":"2024-09-22T08:54:38.926788+0000","last_fullsized":"2024-09-22T08:54:38.926788+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:46:47.067650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2542,"num_read_kb":2330,"num_write":651,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"263'189","reported_seq":779,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:46.773614+0000","last_change":"2024-09-22T08:15:04.959005+0000","last_active":"2024-09-22T08:53:46.773614+0000","last_peered":"2024-09-22T08:53:46.773614+0000","last_clean":"2024-09-22T08:53:46.773614+0000","last_became_active":"2024-09-22T08:15:04.958725+0000","last_became_peered":"2024-09-22T08:15:04.958725+0000","last_unstale":"2024-09-22T08:53:46.773614+0000","last_undegraded":"2024-09-22T08:53:46.773614+0000","last_fullsized":"2024-09-22T08:53:46.773614+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:57:53.879433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5247038,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":388,"num_read_kb":18786,"num_write":896,"num_write_kb":46944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"263'798","reported_seq":2381,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:19.614771+0000","last_change":"2024-09-22T08:15:06.956815+0000","last_active":"2024-09-22T08:54:19.614771+0000","last_peered":"2024-09-22T08:54:19.614771+0000","last_clean":"2024-09-22T08:54:19.614771+0000","last_became_active":"2024-09-22T08:15:06.956485+0000","last_became_peered":"2024-09-22T08:15:06.956485+0000","last_unstale":"2024-09-22T08:54:19.614771+0000","last_undegraded":"2024-09-22T08:54:19.614771+0000","last_fullsized":"2024-09-22T08:54:19.614771+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:11:36.316290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3799,"num_read_kb":3445,"num_write":1066,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"263'218","reported_seq":891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.438588+0000","last_change":"2024-09-22T08:15:04.962465+0000","last_active":"2024-09-22T08:56:16.438588+0000","last_peered":"2024-09-22T08:56:16.438588+0000","last_clean":"2024-09-22T08:56:16.438588+0000","last_became_active":"2024-09-22T08:15:04.962165+0000","last_became_peered":"2024-09-22T08:15:04.962165+0000","last_unstale":"2024-09-22T08:56:16.438588+0000","last_undegraded":"2024-09-22T08:56:16.438588+0000","last_fullsized":"2024-09-22T08:56:16.438588+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:54.072073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":601,"num_read_kb":98488,"num_write":1035,"num_write_kb":53405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"263'774","reported_seq":2242,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.926395+0000","last_change":"2024-09-22T08:15:06.970487+0000","last_active":"2024-09-22T08:54:38.926395+0000","last_peered":"2024-09-22T08:54:38.926395+0000","last_clean":"2024-09-22T08:54:38.926395+0000","last_became_active":"2024-09-22T08:15:06.970111+0000","last_became_peered":"2024-09-22T08:15:06.970111+0000","last_unstale":"2024-09-22T08:54:38.926395+0000","last_undegraded":"2024-09-22T08:54:38.926395+0000","last_fullsized":"2024-09-22T08:54:38.926395+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:58.671223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3767,"num_read_kb":3405,"num_write":1035,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"263'179","reported_seq":881,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:52.668674+0000","last_change":"2024-09-22T08:15:04.963818+0000","last_active":"2024-09-22T08:55:52.668674+0000","last_peered":"2024-09-22T08:55:52.668674+0000","last_clean":"2024-09-22T08:55:52.668674+0000","last_became_active":"2024-09-22T08:15:04.963383+0000","last_became_peered":"2024-09-22T08:15:04.963383+0000","last_unstale":"2024-09-22T08:55:52.668674+0000","last_undegraded":"2024-09-22T08:55:52.668674+0000","last_fullsized":"2024-09-22T08:55:52.668674+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:27:08.401857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5489195,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":838,"num_read_kb":15208,"num_write":838,"num_write_kb":25255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"263'748","reported_seq":2174,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.033948+0000","last_change":"2024-09-22T08:15:06.968144+0000","last_active":"2024-09-22T08:56:02.033948+0000","last_peered":"2024-09-22T08:56:02.033948+0000","last_clean":"2024-09-22T08:56:02.033948+0000","last_became_active":"2024-09-22T08:15:06.967819+0000","last_became_peered":"2024-09-22T08:15:06.967819+0000","last_unstale":"2024-09-22T08:56:02.033948+0000","last_undegraded":"2024-09-22T08:56:02.033948+0000","last_fullsized":"2024-09-22T08:56:02.033948+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:33:21.226600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3557,"num_read_kb":3203,"num_write":994,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"263'220","reported_seq":850,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.532155+0000","last_change":"2024-09-22T08:15:04.963531+0000","last_active":"2024-09-22T08:56:16.532155+0000","last_peered":"2024-09-22T08:56:16.532155+0000","last_clean":"2024-09-22T08:56:16.532155+0000","last_became_active":"2024-09-22T08:15:04.963035+0000","last_became_peered":"2024-09-22T08:15:04.963035+0000","last_unstale":"2024-09-22T08:56:16.532155+0000","last_undegraded":"2024-09-22T08:56:16.532155+0000","last_fullsized":"2024-09-22T08:56:16.532155+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:06:11.269656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":484,"num_read_kb":60036,"num_write":970,"num_write_kb":46477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"263'433","reported_seq":2054,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:24.609260+0000","last_change":"2024-09-22T08:15:06.973192+0000","last_active":"2024-09-22T08:54:24.609260+0000","last_peered":"2024-09-22T08:54:24.609260+0000","last_clean":"2024-09-22T08:54:24.609260+0000","last_became_active":"2024-09-22T08:15:06.972901+0000","last_became_peered":"2024-09-22T08:15:06.972901+0000","last_unstale":"2024-09-22T08:54:24.609260+0000","last_undegraded":"2024-09-22T08:54:24.609260+0000","last_fullsized":"2024-09-22T08:54:24.609260+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:05:44.213357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2630,"num_read_kb":2493,"num_write":497,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"263'190","reported_seq":793,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:23.475033+0000","last_change":"2024-09-22T08:15:04.955216+0000","last_active":"2024-09-22T08:53:23.475033+0000","last_peered":"2024-09-22T08:53:23.475033+0000","last_clean":"2024-09-22T08:53:23.475033+0000","last_became_active":"2024-09-22T08:15:04.954601+0000","last_became_peered":"2024-09-22T08:15:04.954601+0000","last_unstale":"2024-09-22T08:53:23.475033+0000","last_undegraded":"2024-09-22T08:53:23.475033+0000","last_fullsized":"2024-09-22T08:53:23.475033+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:09:17.404903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145754,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":487,"num_read_kb":10659,"num_write":870,"num_write_kb":26887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"263'435","reported_seq":1895,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:26.720211+0000","last_change":"2024-09-22T08:15:06.956049+0000","last_active":"2024-09-22T08:54:26.720211+0000","last_peered":"2024-09-22T08:54:26.720211+0000","last_clean":"2024-09-22T08:54:26.720211+0000","last_became_active":"2024-09-22T08:15:06.955721+0000","last_became_peered":"2024-09-22T08:15:06.955721+0000","last_unstale":"2024-09-22T08:54:26.720211+0000","last_undegraded":"2024-09-22T08:54:26.720211+0000","last_fullsized":"2024-09-22T08:54:26.720211+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:49:20.581915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2301,"num_read_kb":2146,"num_write":527,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"263'213","reported_seq":874,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:28.392913+0000","last_change":"2024-09-22T08:15:04.961490+0000","last_active":"2024-09-22T08:53:28.392913+0000","last_peered":"2024-09-22T08:53:28.392913+0000","last_clean":"2024-09-22T08:53:28.392913+0000","last_became_active":"2024-09-22T08:15:04.961217+0000","last_became_peered":"2024-09-22T08:15:04.961217+0000","last_unstale":"2024-09-22T08:53:28.392913+0000","last_undegraded":"2024-09-22T08:53:28.392913+0000","last_fullsized":"2024-09-22T08:53:28.392913+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:36:23.921216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1319535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":594,"num_read_kb":11776,"num_write":1058,"num_write_kb":6843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"263'549","reported_seq":2080,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.927363+0000","last_change":"2024-09-22T08:15:06.971069+0000","last_active":"2024-09-22T08:54:38.927363+0000","last_peered":"2024-09-22T08:54:38.927363+0000","last_clean":"2024-09-22T08:54:38.927363+0000","last_became_active":"2024-09-22T08:15:06.970735+0000","last_became_peered":"2024-09-22T08:15:06.970735+0000","last_unstale":"2024-09-22T08:54:38.927363+0000","last_undegraded":"2024-09-22T08:54:38.927363+0000","last_fullsized":"2024-09-22T08:54:38.927363+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":500,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:22:49.656390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2725,"num_read_kb":2496,"num_write":675,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"263'217","reported_seq":874,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.490267+0000","last_change":"2024-09-22T08:15:04.968447+0000","last_active":"2024-09-22T08:56:16.490267+0000","last_peered":"2024-09-22T08:56:16.490267+0000","last_clean":"2024-09-22T08:56:16.490267+0000","last_became_active":"2024-09-22T08:15:04.968172+0000","last_became_peered":"2024-09-22T08:15:04.968172+0000","last_unstale":"2024-09-22T08:56:16.490267+0000","last_undegraded":"2024-09-22T08:56:16.490267+0000","last_fullsized":"2024-09-22T08:56:16.490267+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:13:04.823684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":641,"num_read_kb":8608,"num_write":1007,"num_write_kb":17473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"263'756","reported_seq":2289,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:20.255569+0000","last_change":"2024-09-22T08:15:06.976244+0000","last_active":"2024-09-22T08:54:20.255569+0000","last_peered":"2024-09-22T08:54:20.255569+0000","last_clean":"2024-09-22T08:54:20.255569+0000","last_became_active":"2024-09-22T08:15:06.976019+0000","last_became_peered":"2024-09-22T08:15:06.976019+0000","last_unstale":"2024-09-22T08:54:20.255569+0000","last_undegraded":"2024-09-22T08:54:20.255569+0000","last_fullsized":"2024-09-22T08:54:20.255569+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:12:42.777379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3691,"num_read_kb":3360,"num_write":995,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"263'220","reported_seq":910,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:18.048628+0000","last_change":"2024-09-22T08:15:04.963673+0000","last_active":"2024-09-22T08:53:18.048628+0000","last_peered":"2024-09-22T08:53:18.048628+0000","last_clean":"2024-09-22T08:53:18.048628+0000","last_became_active":"2024-09-22T08:15:04.963391+0000","last_became_peered":"2024-09-22T08:15:04.963391+0000","last_unstale":"2024-09-22T08:53:18.048628+0000","last_undegraded":"2024-09-22T08:53:18.048628+0000","last_fullsized":"2024-09-22T08:53:18.048628+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:19:28.768330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5835011,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":632,"num_read_kb":95067,"num_write":1055,"num_write_kb":43906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"263'259","reported_seq":914,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:56.799472+0000","last_change":"2024-09-22T08:15:04.966802+0000","last_active":"2024-09-22T08:52:56.799472+0000","last_peered":"2024-09-22T08:52:56.799472+0000","last_clean":"2024-09-22T08:52:56.799472+0000","last_became_active":"2024-09-22T08:15:04.965396+0000","last_became_peered":"2024-09-22T08:15:04.965396+0000","last_unstale":"2024-09-22T08:52:56.799472+0000","last_undegraded":"2024-09-22T08:52:56.799472+0000","last_fullsized":"2024-09-22T08:52:56.799472+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:33:44.025013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10815762,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":737,"num_read_kb":7770,"num_write":1111,"num_write_kb":20319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"263'1208","reported_seq":2920,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.480223+0000","last_change":"2024-09-22T08:15:06.971024+0000","last_active":"2024-09-22T08:54:41.480223+0000","last_peered":"2024-09-22T08:54:41.480223+0000","last_clean":"2024-09-22T08:54:41.480223+0000","last_became_active":"2024-09-22T08:15:06.970717+0000","last_became_peered":"2024-09-22T08:15:06.970717+0000","last_unstale":"2024-09-22T08:54:41.480223+0000","last_undegraded":"2024-09-22T08:54:41.480223+0000","last_fullsized":"2024-09-22T08:54:41.480223+0000","mapping_epoch":25,"log_start":"263'1100","ondisk_log_start":"263'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":1100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:28:38.936914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5779,"num_read_kb":5147,"num_write":1662,"num_write_kb":686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"263'200","reported_seq":785,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.545519+0000","last_change":"2024-09-22T08:15:04.959358+0000","last_active":"2024-09-22T08:56:16.545519+0000","last_peered":"2024-09-22T08:56:16.545519+0000","last_clean":"2024-09-22T08:56:16.545519+0000","last_became_active":"2024-09-22T08:15:04.959102+0000","last_became_peered":"2024-09-22T08:15:04.959102+0000","last_unstale":"2024-09-22T08:56:16.545519+0000","last_undegraded":"2024-09-22T08:56:16.545519+0000","last_fullsized":"2024-09-22T08:56:16.545519+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:04:57.231333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":396,"num_read_kb":24955,"num_write":899,"num_write_kb":36551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"263'497","reported_seq":2107,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:23.395197+0000","last_change":"2024-09-22T08:15:06.969693+0000","last_active":"2024-09-22T08:54:23.395197+0000","last_peered":"2024-09-22T08:54:23.395197+0000","last_clean":"2024-09-22T08:54:23.395197+0000","last_became_active":"2024-09-22T08:15:06.968345+0000","last_became_peered":"2024-09-22T08:15:06.968345+0000","last_unstale":"2024-09-22T08:54:23.395197+0000","last_undegraded":"2024-09-22T08:54:23.395197+0000","last_fullsized":"2024-09-22T08:54:23.395197+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:19.848260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2601,"num_read_kb":2436,"num_write":597,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10844,"num_read_kb":8840,"num_write":3116,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":899,"ondisk_log_size":899,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15081,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":16349,"num_read_kb":16036,"num_write":17069,"num_write_kb":4981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":30162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1780,"ondisk_log_size":1780,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":664,"ondisk_log_size":664,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":447566,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":8192,"num_read_kb":10309,"num_write":5544,"num_write_kb":2758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":516096,"data_stored":125593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1958,"ondisk_log_size":1958,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2389,"num_read_kb":2853,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":219693,"num_read_kb":201308,"num_write":55750,"num_write_kb":18998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3980,"ondisk_log_size":3980,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":250032338,"num_objects":339,"num_object_clones":0,"num_object_copies":678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":339,"num_whiteouts":0,"num_read":38674,"num_read_kb":2160973,"num_write":63909,"num_write_kb":2146956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":497967104,"data_stored":496530405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3647,"ondisk_log_size":3647,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":37797155,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":159,"num_read_kb":194127,"num_write":173,"num_write_kb":125446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":46297088,"data_stored":46294552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":25214243,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":158,"num_read_kb":186900,"num_write":176,"num_write_kb":125446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":44138496,"data_stored":44137030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":116,"ondisk_log_size":116,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509941,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":319748,"kb_used_data":130292,"kb_used_omap":1,"kb_used_meta":189438,"kb_avail":94052092,"statfs":{"total":96636764160,"available":96309342208,"internally_reserved":0,"allocated":133419008,"data_stored":131577570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":193984968},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509942,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":356048,"kb_used_data":108288,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":94015792,"statfs":{"total":96636764160,"available":96272171008,"internally_reserved":0,"allocated":110886912,"data_stored":109128914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":253688261},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509942,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":224460,"kb_used_data":153020,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94147380,"statfs":{"total":96636764160,"available":96406917120,"internally_reserved":0,"allocated":156692480,"data_stored":154843870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542646,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":209020,"kb_used_data":7100,"kb_used_omap":1,"kb_used_meta":201854,"kb_avail":94162820,"statfs":{"total":96636764160,"available":96422727680,"internally_reserved":0,"allocated":7270400,"data_stored":5649861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":206698954},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542645,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":152972,"kb_used_data":81524,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94218868,"statfs":{"total":96636764160,"available":96480120832,"internally_reserved":0,"allocated":83480576,"data_stored":81759643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542646,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":322808,"kb_used_data":84752,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94049032,"statfs":{"total":96636764160,"available":96306208768,"internally_reserved":0,"allocated":86786048,"data_stored":85108849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243726789},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542648,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":211624,"kb_used_data":72176,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94160216,"statfs":{"total":96636764160,"available":96420061184,"internally_reserved":0,"allocated":73908224,"data_stored":72287988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575348,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":288212,"kb_used_data":176516,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94083628,"statfs":{"total":96636764160,"available":96341635072,"internally_reserved":0,"allocated":180752384,"data_stored":178904915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":133992448,"data_stored":133717149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":84480000,"data_stored":84293177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":147660800,"data_stored":147368995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":109801472,"data_stored":109525406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5492736,"data_stored":5399824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":6012928,"data_stored":5893124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6889472,"data_stored":6786226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3637248,"data_stored":3546504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":135168,"data_stored":43190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":28335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":22866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":27544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":5633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":3876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":5455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9486336,"data_stored":9485603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9486336,"data_stored":9485603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14680064,"data_stored":14680064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9498624,"data_stored":9497554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12632064,"data_stored":12631331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18923520,"data_stored":18922787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T08:56:18.365 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T08:56:18.723 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:56:18.734 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-09-22T08:56:18.736 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":1502,"stamp":"2024-09-22T08:56:17.629295+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":314098563,"num_objects":817,"num_object_clones":0,"num_object_copies":1634,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":817,"num_whiteouts":0,"num_read":296536,"num_read_kb":2781413,"num_write":145878,"num_write_kb":2427250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":189,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13249,"ondisk_log_size":13249,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2084892,"kb_used_data":813668,"kb_used_omap":12,"kb_used_meta":1270963,"kb_avail":752889828,"statfs":{"total":773094113280,"available":770959183872,"internally_reserved":0,"allocated":833196032,"data_stored":819261610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1301466673},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-239420878,"num_objects":-165,"num_object_clones":0,"num_object_copies":-330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-165,"num_whiteouts":0,"num_read":391,"num_read_kb":430,"num_write":255,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004659"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:18.466360+0000","last_change":"2024-09-22T08:42:17.435884+0000","last_active":"2024-09-22T08:52:18.466360+0000","last_peered":"2024-09-22T08:52:18.466360+0000","last_clean":"2024-09-22T08:52:18.466360+0000","last_became_active":"2024-09-22T08:42:17.435576+0000","last_became_peered":"2024-09-22T08:42:17.435576+0000","last_unstale":"2024-09-22T08:52:18.466360+0000","last_undegraded":"2024-09-22T08:52:18.466360+0000","last_fullsized":"2024-09-22T08:52:18.466360+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:18:12.399293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"263'4","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:18.375143+0000","last_change":"2024-09-22T08:31:14.254986+0000","last_active":"2024-09-22T08:51:18.375143+0000","last_peered":"2024-09-22T08:51:18.375143+0000","last_clean":"2024-09-22T08:51:18.375143+0000","last_became_active":"2024-09-22T08:31:14.254610+0000","last_became_peered":"2024-09-22T08:31:14.254610+0000","last_unstale":"2024-09-22T08:51:18.375143+0000","last_undegraded":"2024-09-22T08:51:18.375143+0000","last_fullsized":"2024-09-22T08:51:18.375143+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:29:54.524062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":9,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"263'4","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.314152+0000","last_change":"2024-09-22T08:31:11.216063+0000","last_active":"2024-09-22T08:56:16.314152+0000","last_peered":"2024-09-22T08:56:16.314152+0000","last_clean":"2024-09-22T08:56:16.314152+0000","last_became_active":"2024-09-22T08:31:11.215757+0000","last_became_peered":"2024-09-22T08:31:11.215757+0000","last_unstale":"2024-09-22T08:56:16.314152+0000","last_undegraded":"2024-09-22T08:56:16.314152+0000","last_fullsized":"2024-09-22T08:56:16.314152+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:30:49.027544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6203,"num_write":4,"num_write_kb":3131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"263'27","reported_seq":113,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:39.138788+0000","last_change":"2024-09-22T08:29:26.069972+0000","last_active":"2024-09-22T08:52:39.138788+0000","last_peered":"2024-09-22T08:52:39.138788+0000","last_clean":"2024-09-22T08:52:39.138788+0000","last_became_active":"2024-09-22T08:29:26.069635+0000","last_became_peered":"2024-09-22T08:29:26.069635+0000","last_unstale":"2024-09-22T08:52:39.138788+0000","last_undegraded":"2024-09-22T08:52:39.138788+0000","last_fullsized":"2024-09-22T08:52:39.138788+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:19:23.283184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":139,"num_write":76,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:17.271882+0000","last_change":"2024-09-22T08:42:17.433226+0000","last_active":"2024-09-22T08:52:17.271882+0000","last_peered":"2024-09-22T08:52:17.271882+0000","last_clean":"2024-09-22T08:52:17.271882+0000","last_became_active":"2024-09-22T08:42:17.432946+0000","last_became_peered":"2024-09-22T08:42:17.432946+0000","last_unstale":"2024-09-22T08:52:17.271882+0000","last_undegraded":"2024-09-22T08:52:17.271882+0000","last_fullsized":"2024-09-22T08:52:17.271882+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:57:47.463137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"263'3","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:46.271105+0000","last_change":"2024-09-22T08:31:14.256838+0000","last_active":"2024-09-22T08:53:46.271105+0000","last_peered":"2024-09-22T08:53:46.271105+0000","last_clean":"2024-09-22T08:53:46.271105+0000","last_became_active":"2024-09-22T08:31:14.256486+0000","last_became_peered":"2024-09-22T08:31:14.256486+0000","last_unstale":"2024-09-22T08:53:46.271105+0000","last_undegraded":"2024-09-22T08:53:46.271105+0000","last_fullsized":"2024-09-22T08:53:46.271105+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:05:48.401720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4242723,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":8240,"num_write":8,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"260'2","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:42.284418+0000","last_change":"2024-09-22T08:31:11.216967+0000","last_active":"2024-09-22T08:53:42.284418+0000","last_peered":"2024-09-22T08:53:42.284418+0000","last_clean":"2024-09-22T08:53:42.284418+0000","last_became_active":"2024-09-22T08:31:11.216515+0000","last_became_peered":"2024-09-22T08:31:11.216515+0000","last_unstale":"2024-09-22T08:53:42.284418+0000","last_undegraded":"2024-09-22T08:53:42.284418+0000","last_fullsized":"2024-09-22T08:53:42.284418+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:40:06.800121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"263'31","reported_seq":130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:32.404964+0000","last_change":"2024-09-22T08:29:26.074014+0000","last_active":"2024-09-22T08:53:32.404964+0000","last_peered":"2024-09-22T08:53:32.404964+0000","last_clean":"2024-09-22T08:53:32.404964+0000","last_became_active":"2024-09-22T08:29:26.073415+0000","last_became_peered":"2024-09-22T08:29:26.073415+0000","last_unstale":"2024-09-22T08:53:32.404964+0000","last_undegraded":"2024-09-22T08:53:32.404964+0000","last_fullsized":"2024-09-22T08:53:32.404964+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:07:10.743328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":176,"num_write":77,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:58.380840+0000","last_change":"2024-09-22T08:42:17.436629+0000","last_active":"2024-09-22T08:51:58.380840+0000","last_peered":"2024-09-22T08:51:58.380840+0000","last_clean":"2024-09-22T08:51:58.380840+0000","last_became_active":"2024-09-22T08:42:17.436334+0000","last_became_peered":"2024-09-22T08:42:17.436334+0000","last_unstale":"2024-09-22T08:51:58.380840+0000","last_undegraded":"2024-09-22T08:51:58.380840+0000","last_fullsized":"2024-09-22T08:51:58.380840+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:04:08.905608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"260'4","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:12.288779+0000","last_change":"2024-09-22T08:31:14.257057+0000","last_active":"2024-09-22T08:54:12.288779+0000","last_peered":"2024-09-22T08:54:12.288779+0000","last_clean":"2024-09-22T08:54:12.288779+0000","last_became_active":"2024-09-22T08:31:14.256769+0000","last_became_peered":"2024-09-22T08:31:14.256769+0000","last_unstale":"2024-09-22T08:54:12.288779+0000","last_undegraded":"2024-09-22T08:54:12.288779+0000","last_fullsized":"2024-09-22T08:54:12.288779+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:06:32.378399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:17.289881+0000","last_change":"2024-09-22T08:31:11.211351+0000","last_active":"2024-09-22T08:53:17.289881+0000","last_peered":"2024-09-22T08:53:17.289881+0000","last_clean":"2024-09-22T08:53:17.289881+0000","last_became_active":"2024-09-22T08:31:11.210892+0000","last_became_peered":"2024-09-22T08:31:11.210892+0000","last_unstale":"2024-09-22T08:53:17.289881+0000","last_undegraded":"2024-09-22T08:53:17.289881+0000","last_fullsized":"2024-09-22T08:53:17.289881+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:20:58.942888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"263'43","reported_seq":162,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:57.268885+0000","last_change":"2024-09-22T08:29:26.068513+0000","last_active":"2024-09-22T08:51:57.268885+0000","last_peered":"2024-09-22T08:51:57.268885+0000","last_clean":"2024-09-22T08:51:57.268885+0000","last_became_active":"2024-09-22T08:29:26.067963+0000","last_became_peered":"2024-09-22T08:29:26.067963+0000","last_unstale":"2024-09-22T08:51:57.268885+0000","last_undegraded":"2024-09-22T08:51:57.268885+0000","last_fullsized":"2024-09-22T08:51:57.268885+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:19:50.645315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":380,"num_read_kb":284,"num_write":99,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:02.269565+0000","last_change":"2024-09-22T08:42:17.431238+0000","last_active":"2024-09-22T08:52:02.269565+0000","last_peered":"2024-09-22T08:52:02.269565+0000","last_clean":"2024-09-22T08:52:02.269565+0000","last_became_active":"2024-09-22T08:42:17.430938+0000","last_became_peered":"2024-09-22T08:42:17.430938+0000","last_unstale":"2024-09-22T08:52:02.269565+0000","last_undegraded":"2024-09-22T08:52:02.269565+0000","last_fullsized":"2024-09-22T08:52:02.269565+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:34:21.108839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"263'5","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:22.299767+0000","last_change":"2024-09-22T08:31:14.257263+0000","last_active":"2024-09-22T08:55:22.299767+0000","last_peered":"2024-09-22T08:55:22.299767+0000","last_clean":"2024-09-22T08:55:22.299767+0000","last_became_active":"2024-09-22T08:31:14.255086+0000","last_became_peered":"2024-09-22T08:31:14.255086+0000","last_unstale":"2024-09-22T08:55:22.299767+0000","last_undegraded":"2024-09-22T08:55:22.299767+0000","last_fullsized":"2024-09-22T08:55:22.299767+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:28:49.743007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:08.397293+0000","last_change":"2024-09-22T08:31:11.207653+0000","last_active":"2024-09-22T08:54:08.397293+0000","last_peered":"2024-09-22T08:54:08.397293+0000","last_clean":"2024-09-22T08:54:08.397293+0000","last_became_active":"2024-09-22T08:31:11.207375+0000","last_became_peered":"2024-09-22T08:31:11.207375+0000","last_unstale":"2024-09-22T08:54:08.397293+0000","last_undegraded":"2024-09-22T08:54:08.397293+0000","last_fullsized":"2024-09-22T08:54:08.397293+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:55:26.229921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"263'31","reported_seq":122,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:57.268855+0000","last_change":"2024-09-22T08:29:26.072556+0000","last_active":"2024-09-22T08:51:57.268855+0000","last_peered":"2024-09-22T08:51:57.268855+0000","last_clean":"2024-09-22T08:51:57.268855+0000","last_became_active":"2024-09-22T08:29:26.072183+0000","last_became_peered":"2024-09-22T08:29:26.072183+0000","last_unstale":"2024-09-22T08:51:57.268855+0000","last_undegraded":"2024-09-22T08:51:57.268855+0000","last_fullsized":"2024-09-22T08:51:57.268855+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:30:12.756499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":233,"num_read_kb":155,"num_write":81,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:22.282338+0000","last_change":"2024-09-22T08:42:17.418516+0000","last_active":"2024-09-22T08:52:22.282338+0000","last_peered":"2024-09-22T08:52:22.282338+0000","last_clean":"2024-09-22T08:52:22.282338+0000","last_became_active":"2024-09-22T08:42:17.418224+0000","last_became_peered":"2024-09-22T08:42:17.418224+0000","last_unstale":"2024-09-22T08:52:22.282338+0000","last_undegraded":"2024-09-22T08:52:22.282338+0000","last_fullsized":"2024-09-22T08:52:22.282338+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:06:49.930134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"263'3","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:03.472601+0000","last_change":"2024-09-22T08:31:14.262084+0000","last_active":"2024-09-22T08:53:03.472601+0000","last_peered":"2024-09-22T08:53:03.472601+0000","last_clean":"2024-09-22T08:53:03.472601+0000","last_became_active":"2024-09-22T08:31:14.261753+0000","last_became_peered":"2024-09-22T08:31:14.261753+0000","last_unstale":"2024-09-22T08:53:03.472601+0000","last_undegraded":"2024-09-22T08:53:03.472601+0000","last_fullsized":"2024-09-22T08:53:03.472601+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:21:33.510246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"260'9","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:57.277829+0000","last_change":"2024-09-22T08:31:11.215327+0000","last_active":"2024-09-22T08:52:57.277829+0000","last_peered":"2024-09-22T08:52:57.277829+0000","last_clean":"2024-09-22T08:52:57.277829+0000","last_became_active":"2024-09-22T08:31:11.215024+0000","last_became_peered":"2024-09-22T08:31:11.215024+0000","last_unstale":"2024-09-22T08:52:57.277829+0000","last_undegraded":"2024-09-22T08:52:57.277829+0000","last_fullsized":"2024-09-22T08:52:57.277829+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:27:55.278924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":17455,"num_write":14,"num_write_kb":5165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"263'52","reported_seq":185,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:50.448372+0000","last_change":"2024-09-22T08:29:26.071185+0000","last_active":"2024-09-22T08:53:50.448372+0000","last_peered":"2024-09-22T08:53:50.448372+0000","last_clean":"2024-09-22T08:53:50.448372+0000","last_became_active":"2024-09-22T08:29:26.070913+0000","last_became_peered":"2024-09-22T08:29:26.070913+0000","last_unstale":"2024-09-22T08:53:50.448372+0000","last_undegraded":"2024-09-22T08:53:50.448372+0000","last_fullsized":"2024-09-22T08:53:50.448372+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:50:29.931826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":289,"num_write":128,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:42.398384+0000","last_change":"2024-09-22T08:42:17.428992+0000","last_active":"2024-09-22T08:52:42.398384+0000","last_peered":"2024-09-22T08:52:42.398384+0000","last_clean":"2024-09-22T08:52:42.398384+0000","last_became_active":"2024-09-22T08:42:17.428589+0000","last_became_peered":"2024-09-22T08:42:17.428589+0000","last_unstale":"2024-09-22T08:52:42.398384+0000","last_undegraded":"2024-09-22T08:52:42.398384+0000","last_fullsized":"2024-09-22T08:52:42.398384+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:34:40.543481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"263'5","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:03.389575+0000","last_change":"2024-09-22T08:31:14.256450+0000","last_active":"2024-09-22T08:53:03.389575+0000","last_peered":"2024-09-22T08:53:03.389575+0000","last_clean":"2024-09-22T08:53:03.389575+0000","last_became_active":"2024-09-22T08:31:14.256133+0000","last_became_peered":"2024-09-22T08:31:14.256133+0000","last_unstale":"2024-09-22T08:53:03.389575+0000","last_undegraded":"2024-09-22T08:53:03.389575+0000","last_fullsized":"2024-09-22T08:53:03.389575+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:35:53.157445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":15,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"263'1","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:58.389014+0000","last_change":"2024-09-22T08:31:11.214428+0000","last_active":"2024-09-22T08:52:58.389014+0000","last_peered":"2024-09-22T08:52:58.389014+0000","last_clean":"2024-09-22T08:52:58.389014+0000","last_became_active":"2024-09-22T08:31:11.214152+0000","last_became_peered":"2024-09-22T08:31:11.214152+0000","last_unstale":"2024-09-22T08:52:58.389014+0000","last_undegraded":"2024-09-22T08:52:58.389014+0000","last_fullsized":"2024-09-22T08:52:58.389014+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:24:25.711738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"263'41","reported_seq":155,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:56.954636+0000","last_change":"2024-09-22T08:29:26.073207+0000","last_active":"2024-09-22T08:52:56.954636+0000","last_peered":"2024-09-22T08:52:56.954636+0000","last_clean":"2024-09-22T08:52:56.954636+0000","last_became_active":"2024-09-22T08:29:26.072935+0000","last_became_peered":"2024-09-22T08:29:26.072935+0000","last_unstale":"2024-09-22T08:52:56.954636+0000","last_undegraded":"2024-09-22T08:52:56.954636+0000","last_fullsized":"2024-09-22T08:52:56.954636+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:08.214582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":341,"num_read_kb":226,"num_write":101,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:16.259851+0000","last_change":"2024-09-22T08:42:17.429598+0000","last_active":"2024-09-22T08:52:16.259851+0000","last_peered":"2024-09-22T08:52:16.259851+0000","last_clean":"2024-09-22T08:52:16.259851+0000","last_became_active":"2024-09-22T08:42:17.429298+0000","last_became_peered":"2024-09-22T08:42:17.429298+0000","last_unstale":"2024-09-22T08:52:16.259851+0000","last_undegraded":"2024-09-22T08:52:16.259851+0000","last_fullsized":"2024-09-22T08:52:16.259851+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:26:36.238407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"260'7","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:46.271089+0000","last_change":"2024-09-22T08:31:14.258062+0000","last_active":"2024-09-22T08:53:46.271089+0000","last_peered":"2024-09-22T08:53:46.271089+0000","last_clean":"2024-09-22T08:53:46.271089+0000","last_became_active":"2024-09-22T08:31:14.257659+0000","last_became_peered":"2024-09-22T08:31:14.257659+0000","last_unstale":"2024-09-22T08:53:46.271089+0000","last_undegraded":"2024-09-22T08:53:46.271089+0000","last_fullsized":"2024-09-22T08:53:46.271089+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:32:38.962644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4143,"num_write":12,"num_write_kb":1069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"263'1","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:43.477749+0000","last_change":"2024-09-22T08:31:11.216523+0000","last_active":"2024-09-22T08:53:43.477749+0000","last_peered":"2024-09-22T08:53:43.477749+0000","last_clean":"2024-09-22T08:53:43.477749+0000","last_became_active":"2024-09-22T08:31:11.216248+0000","last_became_peered":"2024-09-22T08:31:11.216248+0000","last_unstale":"2024-09-22T08:53:43.477749+0000","last_undegraded":"2024-09-22T08:53:43.477749+0000","last_fullsized":"2024-09-22T08:53:43.477749+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:46:16.857947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"263'16","reported_seq":84,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:47.294012+0000","last_change":"2024-09-22T08:29:26.076631+0000","last_active":"2024-09-22T08:53:47.294012+0000","last_peered":"2024-09-22T08:53:47.294012+0000","last_clean":"2024-09-22T08:53:47.294012+0000","last_became_active":"2024-09-22T08:29:26.076243+0000","last_became_peered":"2024-09-22T08:29:26.076243+0000","last_unstale":"2024-09-22T08:53:47.294012+0000","last_undegraded":"2024-09-22T08:53:47.294012+0000","last_fullsized":"2024-09-22T08:53:47.294012+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:02:16.942826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":86,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:18.466402+0000","last_change":"2024-09-22T08:42:17.433193+0000","last_active":"2024-09-22T08:52:18.466402+0000","last_peered":"2024-09-22T08:52:18.466402+0000","last_clean":"2024-09-22T08:52:18.466402+0000","last_became_active":"2024-09-22T08:42:17.432923+0000","last_became_peered":"2024-09-22T08:42:17.432923+0000","last_unstale":"2024-09-22T08:52:18.466402+0000","last_undegraded":"2024-09-22T08:52:18.466402+0000","last_fullsized":"2024-09-22T08:52:18.466402+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:17:35.794496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"263'8","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.426367+0000","last_change":"2024-09-22T08:31:14.256601+0000","last_active":"2024-09-22T08:56:16.426367+0000","last_peered":"2024-09-22T08:56:16.426367+0000","last_clean":"2024-09-22T08:56:16.426367+0000","last_became_active":"2024-09-22T08:31:14.256055+0000","last_became_peered":"2024-09-22T08:31:14.256055+0000","last_unstale":"2024-09-22T08:56:16.426367+0000","last_undegraded":"2024-09-22T08:56:16.426367+0000","last_fullsized":"2024-09-22T08:56:16.426367+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:48:31.013743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":18434,"num_write":18,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"263'8","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.321761+0000","last_change":"2024-09-22T08:31:11.215990+0000","last_active":"2024-09-22T08:56:16.321761+0000","last_peered":"2024-09-22T08:56:16.321761+0000","last_clean":"2024-09-22T08:56:16.321761+0000","last_became_active":"2024-09-22T08:31:11.215609+0000","last_became_peered":"2024-09-22T08:31:11.215609+0000","last_unstale":"2024-09-22T08:56:16.321761+0000","last_undegraded":"2024-09-22T08:56:16.321761+0000","last_fullsized":"2024-09-22T08:56:16.321761+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:52:29.022225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":18,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"263'42","reported_seq":155,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:37.283579+0000","last_change":"2024-09-22T08:29:26.067779+0000","last_active":"2024-09-22T08:53:37.283579+0000","last_peered":"2024-09-22T08:53:37.283579+0000","last_clean":"2024-09-22T08:53:37.283579+0000","last_became_active":"2024-09-22T08:29:26.066447+0000","last_became_peered":"2024-09-22T08:29:26.066447+0000","last_unstale":"2024-09-22T08:53:37.283579+0000","last_undegraded":"2024-09-22T08:53:37.283579+0000","last_fullsized":"2024-09-22T08:53:37.283579+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:16:11.771113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":325,"num_read_kb":214,"num_write":107,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:57.286263+0000","last_change":"2024-09-22T08:42:17.436182+0000","last_active":"2024-09-22T08:53:57.286263+0000","last_peered":"2024-09-22T08:53:57.286263+0000","last_clean":"2024-09-22T08:53:57.286263+0000","last_became_active":"2024-09-22T08:42:17.435842+0000","last_became_peered":"2024-09-22T08:42:17.435842+0000","last_unstale":"2024-09-22T08:53:57.286263+0000","last_undegraded":"2024-09-22T08:53:57.286263+0000","last_fullsized":"2024-09-22T08:53:57.286263+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:44:56.306198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"263'2","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:27.307511+0000","last_change":"2024-09-22T08:31:14.255793+0000","last_active":"2024-09-22T08:55:27.307511+0000","last_peered":"2024-09-22T08:55:27.307511+0000","last_clean":"2024-09-22T08:55:27.307511+0000","last_became_active":"2024-09-22T08:31:14.255497+0000","last_became_peered":"2024-09-22T08:31:14.255497+0000","last_unstale":"2024-09-22T08:55:27.307511+0000","last_undegraded":"2024-09-22T08:55:27.307511+0000","last_fullsized":"2024-09-22T08:55:27.307511+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:31.376498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"263'3","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:13.383058+0000","last_change":"2024-09-22T08:31:11.217315+0000","last_active":"2024-09-22T08:52:13.383058+0000","last_peered":"2024-09-22T08:52:13.383058+0000","last_clean":"2024-09-22T08:52:13.383058+0000","last_became_active":"2024-09-22T08:31:11.216997+0000","last_became_peered":"2024-09-22T08:31:11.216997+0000","last_unstale":"2024-09-22T08:52:13.383058+0000","last_undegraded":"2024-09-22T08:52:13.383058+0000","last_fullsized":"2024-09-22T08:52:13.383058+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:29.441399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"263'25","reported_seq":111,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:37.405734+0000","last_change":"2024-09-22T08:29:26.071169+0000","last_active":"2024-09-22T08:53:37.405734+0000","last_peered":"2024-09-22T08:53:37.405734+0000","last_clean":"2024-09-22T08:53:37.405734+0000","last_became_active":"2024-09-22T08:29:26.070906+0000","last_became_peered":"2024-09-22T08:29:26.070906+0000","last_unstale":"2024-09-22T08:53:37.405734+0000","last_undegraded":"2024-09-22T08:53:37.405734+0000","last_fullsized":"2024-09-22T08:53:37.405734+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:55:47.696276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":135,"num_write":63,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:57.286143+0000","last_change":"2024-09-22T08:42:17.430752+0000","last_active":"2024-09-22T08:53:57.286143+0000","last_peered":"2024-09-22T08:53:57.286143+0000","last_clean":"2024-09-22T08:53:57.286143+0000","last_became_active":"2024-09-22T08:42:17.430457+0000","last_became_peered":"2024-09-22T08:42:17.430457+0000","last_unstale":"2024-09-22T08:53:57.286143+0000","last_undegraded":"2024-09-22T08:53:57.286143+0000","last_fullsized":"2024-09-22T08:53:57.286143+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:57:22.012215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"263'9","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.464617+0000","last_change":"2024-09-22T08:31:14.256126+0000","last_active":"2024-09-22T08:56:16.464617+0000","last_peered":"2024-09-22T08:56:16.464617+0000","last_clean":"2024-09-22T08:56:16.464617+0000","last_became_active":"2024-09-22T08:31:14.255245+0000","last_became_peered":"2024-09-22T08:31:14.255245+0000","last_unstale":"2024-09-22T08:56:16.464617+0000","last_undegraded":"2024-09-22T08:56:16.464617+0000","last_fullsized":"2024-09-22T08:56:16.464617+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:45:50.399892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":20480,"num_write":14,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"260'6","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:58.472145+0000","last_change":"2024-09-22T08:31:11.211294+0000","last_active":"2024-09-22T08:52:58.472145+0000","last_peered":"2024-09-22T08:52:58.472145+0000","last_clean":"2024-09-22T08:52:58.472145+0000","last_became_active":"2024-09-22T08:31:11.211000+0000","last_became_peered":"2024-09-22T08:31:11.211000+0000","last_unstale":"2024-09-22T08:52:58.472145+0000","last_undegraded":"2024-09-22T08:52:58.472145+0000","last_fullsized":"2024-09-22T08:52:58.472145+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:34:47.341250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8192,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"263'32","reported_seq":130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:37.405687+0000","last_change":"2024-09-22T08:29:26.075955+0000","last_active":"2024-09-22T08:53:37.405687+0000","last_peered":"2024-09-22T08:53:37.405687+0000","last_clean":"2024-09-22T08:53:37.405687+0000","last_became_active":"2024-09-22T08:29:26.074151+0000","last_became_peered":"2024-09-22T08:29:26.074151+0000","last_unstale":"2024-09-22T08:53:37.405687+0000","last_undegraded":"2024-09-22T08:53:37.405687+0000","last_fullsized":"2024-09-22T08:53:37.405687+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:36:04.989650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":180,"num_write":78,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:56.272330+0000","last_change":"2024-09-22T08:42:17.432351+0000","last_active":"2024-09-22T08:53:56.272330+0000","last_peered":"2024-09-22T08:53:56.272330+0000","last_clean":"2024-09-22T08:53:56.272330+0000","last_became_active":"2024-09-22T08:42:17.432056+0000","last_became_peered":"2024-09-22T08:42:17.432056+0000","last_unstale":"2024-09-22T08:53:56.272330+0000","last_undegraded":"2024-09-22T08:53:56.272330+0000","last_fullsized":"2024-09-22T08:53:56.272330+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:19:22.863621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"263'6","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.434342+0000","last_change":"2024-09-22T08:31:14.259324+0000","last_active":"2024-09-22T08:56:16.434342+0000","last_peered":"2024-09-22T08:56:16.434342+0000","last_clean":"2024-09-22T08:56:16.434342+0000","last_became_active":"2024-09-22T08:31:14.259009+0000","last_became_peered":"2024-09-22T08:31:14.259009+0000","last_unstale":"2024-09-22T08:56:16.434342+0000","last_undegraded":"2024-09-22T08:56:16.434342+0000","last_fullsized":"2024-09-22T08:56:16.434342+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:19:27.710241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8192,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"263'5","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:22.306782+0000","last_change":"2024-09-22T08:31:11.216003+0000","last_active":"2024-09-22T08:55:22.306782+0000","last_peered":"2024-09-22T08:55:22.306782+0000","last_clean":"2024-09-22T08:55:22.306782+0000","last_became_active":"2024-09-22T08:31:11.215708+0000","last_became_peered":"2024-09-22T08:31:11.215708+0000","last_unstale":"2024-09-22T08:55:22.306782+0000","last_undegraded":"2024-09-22T08:55:22.306782+0000","last_fullsized":"2024-09-22T08:55:22.306782+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:19:30.880256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"263'26","reported_seq":110,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:37.292875+0000","last_change":"2024-09-22T08:29:26.069760+0000","last_active":"2024-09-22T08:53:37.292875+0000","last_peered":"2024-09-22T08:53:37.292875+0000","last_clean":"2024-09-22T08:53:37.292875+0000","last_became_active":"2024-09-22T08:29:26.069440+0000","last_became_peered":"2024-09-22T08:29:26.069440+0000","last_unstale":"2024-09-22T08:53:37.292875+0000","last_undegraded":"2024-09-22T08:53:37.292875+0000","last_fullsized":"2024-09-22T08:53:37.292875+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:48:41.597112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":134,"num_write":69,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:38.461091+0000","last_change":"2024-09-22T08:42:17.436175+0000","last_active":"2024-09-22T08:51:38.461091+0000","last_peered":"2024-09-22T08:51:38.461091+0000","last_clean":"2024-09-22T08:51:38.461091+0000","last_became_active":"2024-09-22T08:42:17.435825+0000","last_became_peered":"2024-09-22T08:42:17.435825+0000","last_unstale":"2024-09-22T08:51:38.461091+0000","last_undegraded":"2024-09-22T08:51:38.461091+0000","last_fullsized":"2024-09-22T08:51:38.461091+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:50:07.804836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"260'2","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:58.472161+0000","last_change":"2024-09-22T08:31:14.256513+0000","last_active":"2024-09-22T08:52:58.472161+0000","last_peered":"2024-09-22T08:52:58.472161+0000","last_clean":"2024-09-22T08:52:58.472161+0000","last_became_active":"2024-09-22T08:31:14.256218+0000","last_became_peered":"2024-09-22T08:31:14.256218+0000","last_unstale":"2024-09-22T08:52:58.472161+0000","last_undegraded":"2024-09-22T08:52:58.472161+0000","last_fullsized":"2024-09-22T08:52:58.472161+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:27:57.407928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:57.277949+0000","last_change":"2024-09-22T08:31:11.214383+0000","last_active":"2024-09-22T08:52:57.277949+0000","last_peered":"2024-09-22T08:52:57.277949+0000","last_clean":"2024-09-22T08:52:57.277949+0000","last_became_active":"2024-09-22T08:31:11.214111+0000","last_became_peered":"2024-09-22T08:31:11.214111+0000","last_unstale":"2024-09-22T08:52:57.277949+0000","last_undegraded":"2024-09-22T08:52:57.277949+0000","last_fullsized":"2024-09-22T08:52:57.277949+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:55:25.197395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"263'20","reported_seq":95,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:53.388471+0000","last_change":"2024-09-22T08:29:26.069573+0000","last_active":"2024-09-22T08:52:53.388471+0000","last_peered":"2024-09-22T08:52:53.388471+0000","last_clean":"2024-09-22T08:52:53.388471+0000","last_became_active":"2024-09-22T08:29:26.069293+0000","last_became_peered":"2024-09-22T08:29:26.069293+0000","last_unstale":"2024-09-22T08:52:53.388471+0000","last_undegraded":"2024-09-22T08:52:53.388471+0000","last_fullsized":"2024-09-22T08:52:53.388471+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:06:27.426634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":89,"num_write":52,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:57.268896+0000","last_change":"2024-09-22T08:42:17.429646+0000","last_active":"2024-09-22T08:51:57.268896+0000","last_peered":"2024-09-22T08:51:57.268896+0000","last_clean":"2024-09-22T08:51:57.268896+0000","last_became_active":"2024-09-22T08:42:17.429163+0000","last_became_peered":"2024-09-22T08:42:17.429163+0000","last_unstale":"2024-09-22T08:51:57.268896+0000","last_undegraded":"2024-09-22T08:51:57.268896+0000","last_fullsized":"2024-09-22T08:51:57.268896+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:52:58.326332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"263'2","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:37.292485+0000","last_change":"2024-09-22T08:31:14.259778+0000","last_active":"2024-09-22T08:54:37.292485+0000","last_peered":"2024-09-22T08:54:37.292485+0000","last_clean":"2024-09-22T08:54:37.292485+0000","last_became_active":"2024-09-22T08:31:14.259484+0000","last_became_peered":"2024-09-22T08:31:14.259484+0000","last_unstale":"2024-09-22T08:54:37.292485+0000","last_undegraded":"2024-09-22T08:54:37.292485+0000","last_fullsized":"2024-09-22T08:54:37.292485+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:10:58.591122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"263'5","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:13.382709+0000","last_change":"2024-09-22T08:31:11.203333+0000","last_active":"2024-09-22T08:52:13.382709+0000","last_peered":"2024-09-22T08:52:13.382709+0000","last_clean":"2024-09-22T08:52:13.382709+0000","last_became_active":"2024-09-22T08:31:11.203053+0000","last_became_peered":"2024-09-22T08:31:11.203053+0000","last_unstale":"2024-09-22T08:52:13.382709+0000","last_undegraded":"2024-09-22T08:52:13.382709+0000","last_fullsized":"2024-09-22T08:52:13.382709+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:29:11.633546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48419,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":4146,"num_write":5,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"263'318","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:48.387936+0000","last_change":"2024-09-22T08:29:26.070758+0000","last_active":"2024-09-22T08:52:48.387936+0000","last_peered":"2024-09-22T08:52:48.387936+0000","last_clean":"2024-09-22T08:52:48.387936+0000","last_became_active":"2024-09-22T08:29:26.070475+0000","last_became_peered":"2024-09-22T08:29:26.070475+0000","last_unstale":"2024-09-22T08:52:48.387936+0000","last_undegraded":"2024-09-22T08:52:48.387936+0000","last_fullsized":"2024-09-22T08:52:48.387936+0000","mapping_epoch":252,"log_start":"263'300","ondisk_log_start":"263'300","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:21:22.076883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2975,"num_read_kb":3480,"num_write":654,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:57.268912+0000","last_change":"2024-09-22T08:42:17.431838+0000","last_active":"2024-09-22T08:51:57.268912+0000","last_peered":"2024-09-22T08:51:57.268912+0000","last_clean":"2024-09-22T08:51:57.268912+0000","last_became_active":"2024-09-22T08:42:17.431528+0000","last_became_peered":"2024-09-22T08:42:17.431528+0000","last_unstale":"2024-09-22T08:51:57.268912+0000","last_undegraded":"2024-09-22T08:51:57.268912+0000","last_fullsized":"2024-09-22T08:51:57.268912+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:29:19.259078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:17.271924+0000","last_change":"2024-09-22T08:31:14.256347+0000","last_active":"2024-09-22T08:52:17.271924+0000","last_peered":"2024-09-22T08:52:17.271924+0000","last_clean":"2024-09-22T08:52:17.271924+0000","last_became_active":"2024-09-22T08:31:14.256054+0000","last_became_peered":"2024-09-22T08:31:14.256054+0000","last_unstale":"2024-09-22T08:52:17.271924+0000","last_undegraded":"2024-09-22T08:52:17.271924+0000","last_fullsized":"2024-09-22T08:52:17.271924+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:02:08.137287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"263'8","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.323100+0000","last_change":"2024-09-22T08:31:11.213551+0000","last_active":"2024-09-22T08:56:16.323100+0000","last_peered":"2024-09-22T08:56:16.323100+0000","last_clean":"2024-09-22T08:56:16.323100+0000","last_became_active":"2024-09-22T08:31:11.212539+0000","last_became_peered":"2024-09-22T08:31:11.212539+0000","last_unstale":"2024-09-22T08:56:16.323100+0000","last_undegraded":"2024-09-22T08:56:16.323100+0000","last_fullsized":"2024-09-22T08:56:16.323100+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:38:43.370688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":18,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"263'51","reported_seq":176,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:47.088466+0000","last_change":"2024-09-22T08:29:26.070905+0000","last_active":"2024-09-22T08:53:47.088466+0000","last_peered":"2024-09-22T08:53:47.088466+0000","last_clean":"2024-09-22T08:53:47.088466+0000","last_became_active":"2024-09-22T08:29:26.070576+0000","last_became_peered":"2024-09-22T08:29:26.070576+0000","last_unstale":"2024-09-22T08:53:47.088466+0000","last_undegraded":"2024-09-22T08:53:47.088466+0000","last_fullsized":"2024-09-22T08:53:47.088466+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:55:10.934768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":389,"num_read_kb":252,"num_write":129,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:42.389903+0000","last_change":"2024-09-22T08:42:17.426058+0000","last_active":"2024-09-22T08:51:42.389903+0000","last_peered":"2024-09-22T08:51:42.389903+0000","last_clean":"2024-09-22T08:51:42.389903+0000","last_became_active":"2024-09-22T08:42:17.425759+0000","last_became_peered":"2024-09-22T08:42:17.425759+0000","last_unstale":"2024-09-22T08:51:42.389903+0000","last_undegraded":"2024-09-22T08:51:42.389903+0000","last_fullsized":"2024-09-22T08:51:42.389903+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:58:13.952750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"263'2","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:37.300796+0000","last_change":"2024-09-22T08:31:14.258185+0000","last_active":"2024-09-22T08:54:37.300796+0000","last_peered":"2024-09-22T08:54:37.300796+0000","last_clean":"2024-09-22T08:54:37.300796+0000","last_became_active":"2024-09-22T08:31:14.257900+0000","last_became_peered":"2024-09-22T08:31:14.257900+0000","last_unstale":"2024-09-22T08:54:37.300796+0000","last_undegraded":"2024-09-22T08:54:37.300796+0000","last_fullsized":"2024-09-22T08:54:37.300796+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:24:42.015943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":118,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"263'5","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:13.382766+0000","last_change":"2024-09-22T08:31:11.205171+0000","last_active":"2024-09-22T08:52:13.382766+0000","last_peered":"2024-09-22T08:52:13.382766+0000","last_clean":"2024-09-22T08:52:13.382766+0000","last_became_active":"2024-09-22T08:31:11.204846+0000","last_became_peered":"2024-09-22T08:31:11.204846+0000","last_unstale":"2024-09-22T08:52:13.382766+0000","last_undegraded":"2024-09-22T08:52:13.382766+0000","last_fullsized":"2024-09-22T08:52:13.382766+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:09:45.501944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":6146,"num_write":5,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"263'48","reported_seq":173,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:50.979504+0000","last_change":"2024-09-22T08:29:26.064230+0000","last_active":"2024-09-22T08:53:50.979504+0000","last_peered":"2024-09-22T08:53:50.979504+0000","last_clean":"2024-09-22T08:53:50.979504+0000","last_became_active":"2024-09-22T08:29:26.063914+0000","last_became_peered":"2024-09-22T08:29:26.063914+0000","last_unstale":"2024-09-22T08:53:50.979504+0000","last_undegraded":"2024-09-22T08:53:50.979504+0000","last_fullsized":"2024-09-22T08:53:50.979504+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:49.440925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":381,"num_read_kb":265,"num_write":119,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:57.268871+0000","last_change":"2024-09-22T08:42:17.431413+0000","last_active":"2024-09-22T08:51:57.268871+0000","last_peered":"2024-09-22T08:51:57.268871+0000","last_clean":"2024-09-22T08:51:57.268871+0000","last_became_active":"2024-09-22T08:42:17.429964+0000","last_became_peered":"2024-09-22T08:42:17.429964+0000","last_unstale":"2024-09-22T08:51:57.268871+0000","last_undegraded":"2024-09-22T08:51:57.268871+0000","last_fullsized":"2024-09-22T08:51:57.268871+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:20:04.762853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"260'4","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:18.383736+0000","last_change":"2024-09-22T08:31:14.260215+0000","last_active":"2024-09-22T08:52:18.383736+0000","last_peered":"2024-09-22T08:52:18.383736+0000","last_clean":"2024-09-22T08:52:18.383736+0000","last_became_active":"2024-09-22T08:31:14.259875+0000","last_became_peered":"2024-09-22T08:31:14.259875+0000","last_unstale":"2024-09-22T08:52:18.383736+0000","last_undegraded":"2024-09-22T08:52:18.383736+0000","last_fullsized":"2024-09-22T08:52:18.383736+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:27:56.369023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:13.382799+0000","last_change":"2024-09-22T08:31:11.210358+0000","last_active":"2024-09-22T08:52:13.382799+0000","last_peered":"2024-09-22T08:52:13.382799+0000","last_clean":"2024-09-22T08:52:13.382799+0000","last_became_active":"2024-09-22T08:31:11.210054+0000","last_became_peered":"2024-09-22T08:31:11.210054+0000","last_unstale":"2024-09-22T08:52:13.382799+0000","last_undegraded":"2024-09-22T08:52:13.382799+0000","last_fullsized":"2024-09-22T08:52:13.382799+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:51:41.210904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"263'31","reported_seq":129,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:47.285810+0000","last_change":"2024-09-22T08:29:26.070816+0000","last_active":"2024-09-22T08:52:47.285810+0000","last_peered":"2024-09-22T08:52:47.285810+0000","last_clean":"2024-09-22T08:52:47.285810+0000","last_became_active":"2024-09-22T08:29:26.070492+0000","last_became_peered":"2024-09-22T08:29:26.070492+0000","last_unstale":"2024-09-22T08:52:47.285810+0000","last_undegraded":"2024-09-22T08:52:47.285810+0000","last_fullsized":"2024-09-22T08:52:47.285810+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:33:45.551687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":169,"num_write":83,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:12.279928+0000","last_change":"2024-09-22T08:42:17.433621+0000","last_active":"2024-09-22T08:53:12.279928+0000","last_peered":"2024-09-22T08:53:12.279928+0000","last_clean":"2024-09-22T08:53:12.279928+0000","last_became_active":"2024-09-22T08:42:17.433193+0000","last_became_peered":"2024-09-22T08:42:17.433193+0000","last_unstale":"2024-09-22T08:53:12.279928+0000","last_undegraded":"2024-09-22T08:53:12.279928+0000","last_fullsized":"2024-09-22T08:53:12.279928+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:13.472859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:47.294076+0000","last_change":"2024-09-22T08:31:14.255077+0000","last_active":"2024-09-22T08:53:47.294076+0000","last_peered":"2024-09-22T08:53:47.294076+0000","last_clean":"2024-09-22T08:53:47.294076+0000","last_became_active":"2024-09-22T08:31:14.254710+0000","last_became_peered":"2024-09-22T08:31:14.254710+0000","last_unstale":"2024-09-22T08:53:47.294076+0000","last_undegraded":"2024-09-22T08:53:47.294076+0000","last_fullsized":"2024-09-22T08:53:47.294076+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:21:50.613490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:41.270510+0000","last_change":"2024-09-22T08:31:11.203734+0000","last_active":"2024-09-22T08:53:41.270510+0000","last_peered":"2024-09-22T08:53:41.270510+0000","last_clean":"2024-09-22T08:53:41.270510+0000","last_became_active":"2024-09-22T08:31:11.203413+0000","last_became_peered":"2024-09-22T08:31:11.203413+0000","last_unstale":"2024-09-22T08:53:41.270510+0000","last_undegraded":"2024-09-22T08:53:41.270510+0000","last_fullsized":"2024-09-22T08:53:41.270510+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:44:09.630276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:07.280107+0000","last_change":"2024-09-22T08:29:26.072040+0000","last_active":"2024-09-22T08:52:07.280107+0000","last_peered":"2024-09-22T08:52:07.280107+0000","last_clean":"2024-09-22T08:52:07.280107+0000","last_became_active":"2024-09-22T08:29:26.071742+0000","last_became_peered":"2024-09-22T08:29:26.071742+0000","last_unstale":"2024-09-22T08:52:07.280107+0000","last_undegraded":"2024-09-22T08:52:07.280107+0000","last_fullsized":"2024-09-22T08:52:07.280107+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:02:35.173782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:33.393176+0000","last_change":"2024-09-22T08:42:17.433663+0000","last_active":"2024-09-22T08:53:33.393176+0000","last_peered":"2024-09-22T08:53:33.393176+0000","last_clean":"2024-09-22T08:53:33.393176+0000","last_became_active":"2024-09-22T08:42:17.433346+0000","last_became_peered":"2024-09-22T08:42:17.433346+0000","last_unstale":"2024-09-22T08:53:33.393176+0000","last_undegraded":"2024-09-22T08:53:33.393176+0000","last_fullsized":"2024-09-22T08:53:33.393176+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:42:29.816828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"260'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:47.294055+0000","last_change":"2024-09-22T08:31:14.256186+0000","last_active":"2024-09-22T08:53:47.294055+0000","last_peered":"2024-09-22T08:53:47.294055+0000","last_clean":"2024-09-22T08:53:47.294055+0000","last_became_active":"2024-09-22T08:31:14.255243+0000","last_became_peered":"2024-09-22T08:31:14.255243+0000","last_unstale":"2024-09-22T08:53:47.294055+0000","last_undegraded":"2024-09-22T08:53:47.294055+0000","last_fullsized":"2024-09-22T08:53:47.294055+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:14:49.285058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"263'6","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.322059+0000","last_change":"2024-09-22T08:31:11.210583+0000","last_active":"2024-09-22T08:56:16.322059+0000","last_peered":"2024-09-22T08:56:16.322059+0000","last_clean":"2024-09-22T08:56:16.322059+0000","last_became_active":"2024-09-22T08:31:11.210266+0000","last_became_peered":"2024-09-22T08:31:11.210266+0000","last_unstale":"2024-09-22T08:56:16.322059+0000","last_undegraded":"2024-09-22T08:56:16.322059+0000","last_fullsized":"2024-09-22T08:56:16.322059+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:55:04.094565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":13312,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"263'39","reported_seq":148,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:56.069487+0000","last_change":"2024-09-22T08:29:26.076488+0000","last_active":"2024-09-22T08:52:56.069487+0000","last_peered":"2024-09-22T08:52:56.069487+0000","last_clean":"2024-09-22T08:52:56.069487+0000","last_became_active":"2024-09-22T08:29:26.076175+0000","last_became_peered":"2024-09-22T08:29:26.076175+0000","last_unstale":"2024-09-22T08:52:56.069487+0000","last_undegraded":"2024-09-22T08:52:56.069487+0000","last_fullsized":"2024-09-22T08:52:56.069487+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:10:01.915865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":317,"num_read_kb":219,"num_write":102,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:08.390223+0000","last_change":"2024-09-22T08:42:17.435167+0000","last_active":"2024-09-22T08:53:08.390223+0000","last_peered":"2024-09-22T08:53:08.390223+0000","last_clean":"2024-09-22T08:53:08.390223+0000","last_became_active":"2024-09-22T08:42:17.434909+0000","last_became_peered":"2024-09-22T08:42:17.434909+0000","last_unstale":"2024-09-22T08:53:08.390223+0000","last_undegraded":"2024-09-22T08:53:08.390223+0000","last_fullsized":"2024-09-22T08:53:08.390223+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:22.417079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"263'4","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:07.313078+0000","last_change":"2024-09-22T08:31:14.252478+0000","last_active":"2024-09-22T08:56:07.313078+0000","last_peered":"2024-09-22T08:56:07.313078+0000","last_clean":"2024-09-22T08:56:07.313078+0000","last_became_active":"2024-09-22T08:31:14.252184+0000","last_became_peered":"2024-09-22T08:31:14.252184+0000","last_unstale":"2024-09-22T08:56:07.313078+0000","last_undegraded":"2024-09-22T08:56:07.313078+0000","last_fullsized":"2024-09-22T08:56:07.313078+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:09.321417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":4,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"263'2","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:57.311651+0000","last_change":"2024-09-22T08:31:11.218103+0000","last_active":"2024-09-22T08:55:57.311651+0000","last_peered":"2024-09-22T08:55:57.311651+0000","last_clean":"2024-09-22T08:55:57.311651+0000","last_became_active":"2024-09-22T08:31:11.217115+0000","last_became_peered":"2024-09-22T08:31:11.217115+0000","last_unstale":"2024-09-22T08:55:57.311651+0000","last_undegraded":"2024-09-22T08:55:57.311651+0000","last_fullsized":"2024-09-22T08:55:57.311651+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:15:42.708378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"263'57","reported_seq":192,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:58.380936+0000","last_change":"2024-09-22T08:29:26.076353+0000","last_active":"2024-09-22T08:51:58.380936+0000","last_peered":"2024-09-22T08:51:58.380936+0000","last_clean":"2024-09-22T08:51:58.380936+0000","last_became_active":"2024-09-22T08:29:26.076048+0000","last_became_peered":"2024-09-22T08:29:26.076048+0000","last_unstale":"2024-09-22T08:51:58.380936+0000","last_undegraded":"2024-09-22T08:51:58.380936+0000","last_fullsized":"2024-09-22T08:51:58.380936+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:12:53.422787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":427,"num_read_kb":265,"num_write":151,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:08.389849+0000","last_change":"2024-09-22T08:42:17.431316+0000","last_active":"2024-09-22T08:53:08.389849+0000","last_peered":"2024-09-22T08:53:08.389849+0000","last_clean":"2024-09-22T08:53:08.389849+0000","last_became_active":"2024-09-22T08:42:17.430974+0000","last_became_peered":"2024-09-22T08:42:17.430974+0000","last_unstale":"2024-09-22T08:53:08.389849+0000","last_undegraded":"2024-09-22T08:53:08.389849+0000","last_fullsized":"2024-09-22T08:53:08.389849+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:40:42.175541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"260'3","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:47.284984+0000","last_change":"2024-09-22T08:31:14.258289+0000","last_active":"2024-09-22T08:53:47.284984+0000","last_peered":"2024-09-22T08:53:47.284984+0000","last_clean":"2024-09-22T08:53:47.284984+0000","last_became_active":"2024-09-22T08:31:14.257952+0000","last_became_peered":"2024-09-22T08:31:14.257952+0000","last_unstale":"2024-09-22T08:53:47.284984+0000","last_undegraded":"2024-09-22T08:53:47.284984+0000","last_fullsized":"2024-09-22T08:53:47.284984+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:26:33.079615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:47.294104+0000","last_change":"2024-09-22T08:31:11.214070+0000","last_active":"2024-09-22T08:53:47.294104+0000","last_peered":"2024-09-22T08:53:47.294104+0000","last_clean":"2024-09-22T08:53:47.294104+0000","last_became_active":"2024-09-22T08:31:11.213273+0000","last_became_peered":"2024-09-22T08:31:11.213273+0000","last_unstale":"2024-09-22T08:53:47.294104+0000","last_undegraded":"2024-09-22T08:53:47.294104+0000","last_fullsized":"2024-09-22T08:53:47.294104+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:48:59.089464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"263'16","reported_seq":83,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:50.237668+0000","last_change":"2024-09-22T08:29:26.074703+0000","last_active":"2024-09-22T08:53:50.237668+0000","last_peered":"2024-09-22T08:53:50.237668+0000","last_clean":"2024-09-22T08:53:50.237668+0000","last_became_active":"2024-09-22T08:29:26.074205+0000","last_became_peered":"2024-09-22T08:29:26.074205+0000","last_unstale":"2024-09-22T08:53:50.237668+0000","last_undegraded":"2024-09-22T08:53:50.237668+0000","last_fullsized":"2024-09-22T08:53:50.237668+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:39:29.451981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":71,"num_write":43,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:32.283041+0000","last_change":"2024-09-22T08:42:17.430839+0000","last_active":"2024-09-22T08:53:32.283041+0000","last_peered":"2024-09-22T08:53:32.283041+0000","last_clean":"2024-09-22T08:53:32.283041+0000","last_became_active":"2024-09-22T08:42:17.429927+0000","last_became_peered":"2024-09-22T08:42:17.429927+0000","last_unstale":"2024-09-22T08:53:32.283041+0000","last_undegraded":"2024-09-22T08:53:32.283041+0000","last_fullsized":"2024-09-22T08:53:32.283041+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:28:06.806210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"263'5","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:58.388987+0000","last_change":"2024-09-22T08:31:14.253906+0000","last_active":"2024-09-22T08:52:58.388987+0000","last_peered":"2024-09-22T08:52:58.388987+0000","last_clean":"2024-09-22T08:52:58.388987+0000","last_became_active":"2024-09-22T08:31:14.253610+0000","last_became_peered":"2024-09-22T08:31:14.253610+0000","last_unstale":"2024-09-22T08:52:58.388987+0000","last_undegraded":"2024-09-22T08:52:58.388987+0000","last_fullsized":"2024-09-22T08:52:58.388987+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:13:39.366489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":13314,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"263'4","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.380507+0000","last_change":"2024-09-22T08:31:11.217832+0000","last_active":"2024-09-22T08:56:16.380507+0000","last_peered":"2024-09-22T08:56:16.380507+0000","last_clean":"2024-09-22T08:56:16.380507+0000","last_became_active":"2024-09-22T08:31:11.217553+0000","last_became_peered":"2024-09-22T08:31:11.217553+0000","last_unstale":"2024-09-22T08:56:16.380507+0000","last_undegraded":"2024-09-22T08:56:16.380507+0000","last_fullsized":"2024-09-22T08:56:16.380507+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:22:26.456715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"263'36","reported_seq":134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:57.268762+0000","last_change":"2024-09-22T08:29:26.070957+0000","last_active":"2024-09-22T08:51:57.268762+0000","last_peered":"2024-09-22T08:51:57.268762+0000","last_clean":"2024-09-22T08:51:57.268762+0000","last_became_active":"2024-09-22T08:29:26.070671+0000","last_became_peered":"2024-09-22T08:29:26.070671+0000","last_unstale":"2024-09-22T08:51:57.268762+0000","last_undegraded":"2024-09-22T08:51:57.268762+0000","last_fullsized":"2024-09-22T08:51:57.268762+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:28:38.453942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":255,"num_read_kb":155,"num_write":90,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:36.270019+0000","last_change":"2024-09-22T08:42:17.433684+0000","last_active":"2024-09-22T08:53:36.270019+0000","last_peered":"2024-09-22T08:53:36.270019+0000","last_clean":"2024-09-22T08:53:36.270019+0000","last_became_active":"2024-09-22T08:42:17.433331+0000","last_became_peered":"2024-09-22T08:42:17.433331+0000","last_unstale":"2024-09-22T08:53:36.270019+0000","last_undegraded":"2024-09-22T08:53:36.270019+0000","last_fullsized":"2024-09-22T08:53:36.270019+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:19:35.698543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"263'3","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:56.264954+0000","last_change":"2024-09-22T08:31:14.253520+0000","last_active":"2024-09-22T08:52:56.264954+0000","last_peered":"2024-09-22T08:52:56.264954+0000","last_clean":"2024-09-22T08:52:56.264954+0000","last_became_active":"2024-09-22T08:31:14.253118+0000","last_became_peered":"2024-09-22T08:31:14.253118+0000","last_unstale":"2024-09-22T08:52:56.264954+0000","last_undegraded":"2024-09-22T08:52:56.264954+0000","last_fullsized":"2024-09-22T08:52:56.264954+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:35:19.513521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"263'9","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:02.296482+0000","last_change":"2024-09-22T08:31:11.212852+0000","last_active":"2024-09-22T08:55:02.296482+0000","last_peered":"2024-09-22T08:55:02.296482+0000","last_clean":"2024-09-22T08:55:02.296482+0000","last_became_active":"2024-09-22T08:31:11.211939+0000","last_became_peered":"2024-09-22T08:31:11.211939+0000","last_unstale":"2024-09-22T08:55:02.296482+0000","last_undegraded":"2024-09-22T08:55:02.296482+0000","last_fullsized":"2024-09-22T08:55:02.296482+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:24:50.321996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":24578,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"263'43","reported_seq":155,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:21.268004+0000","last_change":"2024-09-22T08:29:26.069502+0000","last_active":"2024-09-22T08:53:21.268004+0000","last_peered":"2024-09-22T08:53:21.268004+0000","last_clean":"2024-09-22T08:53:21.268004+0000","last_became_active":"2024-09-22T08:29:26.069202+0000","last_became_peered":"2024-09-22T08:29:26.069202+0000","last_unstale":"2024-09-22T08:53:21.268004+0000","last_undegraded":"2024-09-22T08:53:21.268004+0000","last_fullsized":"2024-09-22T08:53:21.268004+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:00:21.857731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":316,"num_read_kb":207,"num_write":121,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:33.476466+0000","last_change":"2024-09-22T08:42:17.436971+0000","last_active":"2024-09-22T08:53:33.476466+0000","last_peered":"2024-09-22T08:53:33.476466+0000","last_clean":"2024-09-22T08:53:33.476466+0000","last_became_active":"2024-09-22T08:42:17.436036+0000","last_became_peered":"2024-09-22T08:42:17.436036+0000","last_unstale":"2024-09-22T08:53:33.476466+0000","last_undegraded":"2024-09-22T08:53:33.476466+0000","last_fullsized":"2024-09-22T08:53:33.476466+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:15:23.383676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"260'6","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:47.284803+0000","last_change":"2024-09-22T08:31:14.260840+0000","last_active":"2024-09-22T08:53:47.284803+0000","last_peered":"2024-09-22T08:53:47.284803+0000","last_clean":"2024-09-22T08:53:47.284803+0000","last_became_active":"2024-09-22T08:31:14.260111+0000","last_became_peered":"2024-09-22T08:31:14.260111+0000","last_unstale":"2024-09-22T08:53:47.284803+0000","last_undegraded":"2024-09-22T08:53:47.284803+0000","last_fullsized":"2024-09-22T08:53:47.284803+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:54:00.288860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"263'5","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.322290+0000","last_change":"2024-09-22T08:31:11.213758+0000","last_active":"2024-09-22T08:56:16.322290+0000","last_peered":"2024-09-22T08:56:16.322290+0000","last_clean":"2024-09-22T08:56:16.322290+0000","last_became_active":"2024-09-22T08:31:11.213121+0000","last_became_peered":"2024-09-22T08:31:11.213121+0000","last_unstale":"2024-09-22T08:56:16.322290+0000","last_undegraded":"2024-09-22T08:56:16.322290+0000","last_fullsized":"2024-09-22T08:56:16.322290+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:13:15.074520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"263'24","reported_seq":106,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:17.280800+0000","last_change":"2024-09-22T08:29:26.068711+0000","last_active":"2024-09-22T08:53:17.280800+0000","last_peered":"2024-09-22T08:53:17.280800+0000","last_clean":"2024-09-22T08:53:17.280800+0000","last_became_active":"2024-09-22T08:29:26.068397+0000","last_became_peered":"2024-09-22T08:29:26.068397+0000","last_unstale":"2024-09-22T08:53:17.280800+0000","last_undegraded":"2024-09-22T08:53:17.280800+0000","last_fullsized":"2024-09-22T08:53:17.280800+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:31:42.395480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":108,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:32.292011+0000","last_change":"2024-09-22T08:42:17.431775+0000","last_active":"2024-09-22T08:53:32.292011+0000","last_peered":"2024-09-22T08:53:32.292011+0000","last_clean":"2024-09-22T08:53:32.292011+0000","last_became_active":"2024-09-22T08:42:17.431476+0000","last_became_peered":"2024-09-22T08:42:17.431476+0000","last_unstale":"2024-09-22T08:53:32.292011+0000","last_undegraded":"2024-09-22T08:53:32.292011+0000","last_fullsized":"2024-09-22T08:53:32.292011+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:20.126935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"263'1","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:58.472094+0000","last_change":"2024-09-22T08:31:14.257816+0000","last_active":"2024-09-22T08:52:58.472094+0000","last_peered":"2024-09-22T08:52:58.472094+0000","last_clean":"2024-09-22T08:52:58.472094+0000","last_became_active":"2024-09-22T08:31:14.257508+0000","last_became_peered":"2024-09-22T08:31:14.257508+0000","last_unstale":"2024-09-22T08:52:58.472094+0000","last_undegraded":"2024-09-22T08:52:58.472094+0000","last_fullsized":"2024-09-22T08:52:58.472094+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:30.899995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:43.394740+0000","last_change":"2024-09-22T08:31:11.215332+0000","last_active":"2024-09-22T08:53:43.394740+0000","last_peered":"2024-09-22T08:53:43.394740+0000","last_clean":"2024-09-22T08:53:43.394740+0000","last_became_active":"2024-09-22T08:31:11.214953+0000","last_became_peered":"2024-09-22T08:31:11.214953+0000","last_unstale":"2024-09-22T08:53:43.394740+0000","last_undegraded":"2024-09-22T08:53:43.394740+0000","last_fullsized":"2024-09-22T08:53:43.394740+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:54:54.175587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"263'16","reported_seq":88,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:18.474308+0000","last_change":"2024-09-22T08:29:26.072747+0000","last_active":"2024-09-22T08:53:18.474308+0000","last_peered":"2024-09-22T08:53:18.474308+0000","last_clean":"2024-09-22T08:53:18.474308+0000","last_became_active":"2024-09-22T08:29:26.072473+0000","last_became_peered":"2024-09-22T08:29:26.072473+0000","last_unstale":"2024-09-22T08:53:18.474308+0000","last_undegraded":"2024-09-22T08:53:18.474308+0000","last_fullsized":"2024-09-22T08:53:18.474308+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:22.926382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":83,"num_write":41,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:43.469960+0000","last_change":"2024-09-22T08:42:17.431917+0000","last_active":"2024-09-22T08:52:43.469960+0000","last_peered":"2024-09-22T08:52:43.469960+0000","last_clean":"2024-09-22T08:52:43.469960+0000","last_became_active":"2024-09-22T08:42:17.431637+0000","last_became_peered":"2024-09-22T08:42:17.431637+0000","last_unstale":"2024-09-22T08:52:43.469960+0000","last_undegraded":"2024-09-22T08:52:43.469960+0000","last_fullsized":"2024-09-22T08:52:43.469960+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:33:12.811194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"263'4","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.434444+0000","last_change":"2024-09-22T08:31:14.261671+0000","last_active":"2024-09-22T08:56:16.434444+0000","last_peered":"2024-09-22T08:56:16.434444+0000","last_clean":"2024-09-22T08:56:16.434444+0000","last_became_active":"2024-09-22T08:31:14.261352+0000","last_became_peered":"2024-09-22T08:31:14.261352+0000","last_unstale":"2024-09-22T08:56:16.434444+0000","last_undegraded":"2024-09-22T08:56:16.434444+0000","last_fullsized":"2024-09-22T08:56:16.434444+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:19:15.325599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"263'5","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:08.397654+0000","last_change":"2024-09-22T08:31:11.216385+0000","last_active":"2024-09-22T08:54:08.397654+0000","last_peered":"2024-09-22T08:54:08.397654+0000","last_clean":"2024-09-22T08:54:08.397654+0000","last_became_active":"2024-09-22T08:31:11.216081+0000","last_became_peered":"2024-09-22T08:31:11.216081+0000","last_unstale":"2024-09-22T08:54:08.397654+0000","last_undegraded":"2024-09-22T08:54:08.397654+0000","last_fullsized":"2024-09-22T08:54:08.397654+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:17:40.729275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":5,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"253'4","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:17.402881+0000","last_change":"2024-09-22T08:29:26.073082+0000","last_active":"2024-09-22T08:53:17.402881+0000","last_peered":"2024-09-22T08:53:17.402881+0000","last_clean":"2024-09-22T08:53:17.402881+0000","last_became_active":"2024-09-22T08:29:26.072681+0000","last_became_peered":"2024-09-22T08:29:26.072681+0000","last_unstale":"2024-09-22T08:53:17.402881+0000","last_undegraded":"2024-09-22T08:53:17.402881+0000","last_fullsized":"2024-09-22T08:53:17.402881+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:10:40.106076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:43.469980+0000","last_change":"2024-09-22T08:42:17.432516+0000","last_active":"2024-09-22T08:52:43.469980+0000","last_peered":"2024-09-22T08:52:43.469980+0000","last_clean":"2024-09-22T08:52:43.469980+0000","last_became_active":"2024-09-22T08:42:17.430084+0000","last_became_peered":"2024-09-22T08:42:17.430084+0000","last_unstale":"2024-09-22T08:52:43.469980+0000","last_undegraded":"2024-09-22T08:52:43.469980+0000","last_fullsized":"2024-09-22T08:52:43.469980+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:34:54.878963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"260'2","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:12.288667+0000","last_change":"2024-09-22T08:31:14.259915+0000","last_active":"2024-09-22T08:54:12.288667+0000","last_peered":"2024-09-22T08:54:12.288667+0000","last_clean":"2024-09-22T08:54:12.288667+0000","last_became_active":"2024-09-22T08:31:14.259624+0000","last_became_peered":"2024-09-22T08:31:14.259624+0000","last_unstale":"2024-09-22T08:54:12.288667+0000","last_undegraded":"2024-09-22T08:54:12.288667+0000","last_fullsized":"2024-09-22T08:54:12.288667+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:44:39.512910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"263'5","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.510695+0000","last_change":"2024-09-22T08:31:11.214838+0000","last_active":"2024-09-22T08:56:16.510695+0000","last_peered":"2024-09-22T08:56:16.510695+0000","last_clean":"2024-09-22T08:56:16.510695+0000","last_became_active":"2024-09-22T08:31:11.214279+0000","last_became_peered":"2024-09-22T08:31:11.214279+0000","last_unstale":"2024-09-22T08:56:16.510695+0000","last_undegraded":"2024-09-22T08:56:16.510695+0000","last_fullsized":"2024-09-22T08:56:16.510695+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:50:49.253194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"263'2","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:18.391441+0000","last_change":"2024-09-22T08:29:26.075341+0000","last_active":"2024-09-22T08:53:18.391441+0000","last_peered":"2024-09-22T08:53:18.391441+0000","last_clean":"2024-09-22T08:53:18.391441+0000","last_became_active":"2024-09-22T08:29:26.074971+0000","last_became_peered":"2024-09-22T08:29:26.074971+0000","last_unstale":"2024-09-22T08:53:18.391441+0000","last_undegraded":"2024-09-22T08:53:18.391441+0000","last_fullsized":"2024-09-22T08:53:18.391441+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:38:15.699643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:22.272596+0000","last_change":"2024-09-22T08:42:17.433389+0000","last_active":"2024-09-22T08:52:22.272596+0000","last_peered":"2024-09-22T08:52:22.272596+0000","last_clean":"2024-09-22T08:52:22.272596+0000","last_became_active":"2024-09-22T08:42:17.433090+0000","last_became_peered":"2024-09-22T08:42:17.433090+0000","last_unstale":"2024-09-22T08:52:22.272596+0000","last_undegraded":"2024-09-22T08:52:22.272596+0000","last_fullsized":"2024-09-22T08:52:22.272596+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:05:15.147705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"260'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:53.471440+0000","last_change":"2024-09-22T08:31:14.257105+0000","last_active":"2024-09-22T08:52:53.471440+0000","last_peered":"2024-09-22T08:52:53.471440+0000","last_clean":"2024-09-22T08:52:53.471440+0000","last_became_active":"2024-09-22T08:31:14.256835+0000","last_became_peered":"2024-09-22T08:31:14.256835+0000","last_unstale":"2024-09-22T08:52:53.471440+0000","last_undegraded":"2024-09-22T08:52:53.471440+0000","last_fullsized":"2024-09-22T08:52:53.471440+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:01:16.187889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"263'3","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:51.264489+0000","last_change":"2024-09-22T08:31:11.212839+0000","last_active":"2024-09-22T08:52:51.264489+0000","last_peered":"2024-09-22T08:52:51.264489+0000","last_clean":"2024-09-22T08:52:51.264489+0000","last_became_active":"2024-09-22T08:31:11.212487+0000","last_became_peered":"2024-09-22T08:31:11.212487+0000","last_unstale":"2024-09-22T08:52:51.264489+0000","last_undegraded":"2024-09-22T08:52:51.264489+0000","last_fullsized":"2024-09-22T08:52:51.264489+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:30:25.357785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"263'131","reported_seq":431,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:50.453613+0000","last_change":"2024-09-22T08:29:26.067437+0000","last_active":"2024-09-22T08:53:50.453613+0000","last_peered":"2024-09-22T08:53:50.453613+0000","last_clean":"2024-09-22T08:53:50.453613+0000","last_became_active":"2024-09-22T08:29:26.067149+0000","last_became_peered":"2024-09-22T08:29:26.067149+0000","last_unstale":"2024-09-22T08:53:50.453613+0000","last_undegraded":"2024-09-22T08:53:50.453613+0000","last_fullsized":"2024-09-22T08:53:50.453613+0000","mapping_epoch":252,"log_start":"260'100","ondisk_log_start":"260'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:08:58.265926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1238,"num_read_kb":970,"num_write":283,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:43.387307+0000","last_change":"2024-09-22T08:42:17.435234+0000","last_active":"2024-09-22T08:52:43.387307+0000","last_peered":"2024-09-22T08:52:43.387307+0000","last_clean":"2024-09-22T08:52:43.387307+0000","last_became_active":"2024-09-22T08:42:17.434424+0000","last_became_peered":"2024-09-22T08:42:17.434424+0000","last_unstale":"2024-09-22T08:52:43.387307+0000","last_undegraded":"2024-09-22T08:52:43.387307+0000","last_fullsized":"2024-09-22T08:52:43.387307+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:58:01.260992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"260'9","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:58.389082+0000","last_change":"2024-09-22T08:31:14.255605+0000","last_active":"2024-09-22T08:52:58.389082+0000","last_peered":"2024-09-22T08:52:58.389082+0000","last_clean":"2024-09-22T08:52:58.389082+0000","last_became_active":"2024-09-22T08:31:14.255160+0000","last_became_peered":"2024-09-22T08:31:14.255160+0000","last_unstale":"2024-09-22T08:52:58.389082+0000","last_undegraded":"2024-09-22T08:52:58.389082+0000","last_fullsized":"2024-09-22T08:52:58.389082+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:32:19.999119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":23554,"num_write":14,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:53.388519+0000","last_change":"2024-09-22T08:31:11.216563+0000","last_active":"2024-09-22T08:52:53.388519+0000","last_peered":"2024-09-22T08:52:53.388519+0000","last_clean":"2024-09-22T08:52:53.388519+0000","last_became_active":"2024-09-22T08:31:11.216271+0000","last_became_peered":"2024-09-22T08:31:11.216271+0000","last_unstale":"2024-09-22T08:52:53.388519+0000","last_undegraded":"2024-09-22T08:52:53.388519+0000","last_fullsized":"2024-09-22T08:52:53.388519+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:55:11.448805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"263'19","reported_seq":97,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:22.282291+0000","last_change":"2024-09-22T08:29:26.070044+0000","last_active":"2024-09-22T08:52:22.282291+0000","last_peered":"2024-09-22T08:52:22.282291+0000","last_clean":"2024-09-22T08:52:22.282291+0000","last_became_active":"2024-09-22T08:29:26.069730+0000","last_became_peered":"2024-09-22T08:29:26.069730+0000","last_unstale":"2024-09-22T08:52:22.282291+0000","last_undegraded":"2024-09-22T08:52:22.282291+0000","last_fullsized":"2024-09-22T08:52:22.282291+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:21:35.672741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":95,"num_write":48,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:07.288626+0000","last_change":"2024-09-22T08:42:17.419131+0000","last_active":"2024-09-22T08:53:07.288626+0000","last_peered":"2024-09-22T08:53:07.288626+0000","last_clean":"2024-09-22T08:53:07.288626+0000","last_became_active":"2024-09-22T08:42:17.418864+0000","last_became_peered":"2024-09-22T08:42:17.418864+0000","last_unstale":"2024-09-22T08:53:07.288626+0000","last_undegraded":"2024-09-22T08:53:07.288626+0000","last_fullsized":"2024-09-22T08:53:07.288626+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:05:15.592372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"263'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.434270+0000","last_change":"2024-09-22T08:31:14.259787+0000","last_active":"2024-09-22T08:56:16.434270+0000","last_peered":"2024-09-22T08:56:16.434270+0000","last_clean":"2024-09-22T08:56:16.434270+0000","last_became_active":"2024-09-22T08:31:14.259485+0000","last_became_peered":"2024-09-22T08:31:14.259485+0000","last_unstale":"2024-09-22T08:56:16.434270+0000","last_undegraded":"2024-09-22T08:56:16.434270+0000","last_fullsized":"2024-09-22T08:56:16.434270+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:38:49.843585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"260'5","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:16.267265+0000","last_change":"2024-09-22T08:31:11.211139+0000","last_active":"2024-09-22T08:53:16.267265+0000","last_peered":"2024-09-22T08:53:16.267265+0000","last_clean":"2024-09-22T08:53:16.267265+0000","last_became_active":"2024-09-22T08:31:11.210835+0000","last_became_peered":"2024-09-22T08:31:11.210835+0000","last_unstale":"2024-09-22T08:53:16.267265+0000","last_undegraded":"2024-09-22T08:53:16.267265+0000","last_fullsized":"2024-09-22T08:53:16.267265+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:48:20.118083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"263'36","reported_seq":145,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:21.260531+0000","last_change":"2024-09-22T08:29:26.068377+0000","last_active":"2024-09-22T08:52:21.260531+0000","last_peered":"2024-09-22T08:52:21.260531+0000","last_clean":"2024-09-22T08:52:21.260531+0000","last_became_active":"2024-09-22T08:29:26.068105+0000","last_became_peered":"2024-09-22T08:29:26.068105+0000","last_unstale":"2024-09-22T08:52:21.260531+0000","last_undegraded":"2024-09-22T08:52:21.260531+0000","last_fullsized":"2024-09-22T08:52:21.260531+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:08:26.567273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":308,"num_read_kb":184,"num_write":90,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:07.401463+0000","last_change":"2024-09-22T08:42:17.435288+0000","last_active":"2024-09-22T08:53:07.401463+0000","last_peered":"2024-09-22T08:53:07.401463+0000","last_clean":"2024-09-22T08:53:07.401463+0000","last_became_active":"2024-09-22T08:42:17.434953+0000","last_became_peered":"2024-09-22T08:42:17.434953+0000","last_unstale":"2024-09-22T08:53:07.401463+0000","last_undegraded":"2024-09-22T08:53:07.401463+0000","last_fullsized":"2024-09-22T08:53:07.401463+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:45:12.549260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"260'2","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:18.391339+0000","last_change":"2024-09-22T08:31:14.255977+0000","last_active":"2024-09-22T08:53:18.391339+0000","last_peered":"2024-09-22T08:53:18.391339+0000","last_clean":"2024-09-22T08:53:18.391339+0000","last_became_active":"2024-09-22T08:31:14.255534+0000","last_became_peered":"2024-09-22T08:31:14.255534+0000","last_unstale":"2024-09-22T08:53:18.391339+0000","last_undegraded":"2024-09-22T08:53:18.391339+0000","last_fullsized":"2024-09-22T08:53:18.391339+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:09:54.469702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"263'5","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:08.397594+0000","last_change":"2024-09-22T08:31:11.214320+0000","last_active":"2024-09-22T08:54:08.397594+0000","last_peered":"2024-09-22T08:54:08.397594+0000","last_clean":"2024-09-22T08:54:08.397594+0000","last_became_active":"2024-09-22T08:31:11.213851+0000","last_became_peered":"2024-09-22T08:31:11.213851+0000","last_unstale":"2024-09-22T08:54:08.397594+0000","last_undegraded":"2024-09-22T08:54:08.397594+0000","last_fullsized":"2024-09-22T08:54:08.397594+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:24:21.493458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":6146,"num_write":5,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"263'4","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:23.384458+0000","last_change":"2024-09-22T08:29:26.075210+0000","last_active":"2024-09-22T08:52:23.384458+0000","last_peered":"2024-09-22T08:52:23.384458+0000","last_clean":"2024-09-22T08:52:23.384458+0000","last_became_active":"2024-09-22T08:29:26.074907+0000","last_became_peered":"2024-09-22T08:29:26.074907+0000","last_unstale":"2024-09-22T08:52:23.384458+0000","last_undegraded":"2024-09-22T08:52:23.384458+0000","last_fullsized":"2024-09-22T08:52:23.384458+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:03:30.755739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:42.275910+0000","last_change":"2024-09-22T08:42:17.430325+0000","last_active":"2024-09-22T08:52:42.275910+0000","last_peered":"2024-09-22T08:52:42.275910+0000","last_clean":"2024-09-22T08:52:42.275910+0000","last_became_active":"2024-09-22T08:42:17.429341+0000","last_became_peered":"2024-09-22T08:42:17.429341+0000","last_unstale":"2024-09-22T08:52:42.275910+0000","last_undegraded":"2024-09-22T08:52:42.275910+0000","last_fullsized":"2024-09-22T08:52:42.275910+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:58:45.447447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"263'2","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:11.274127+0000","last_change":"2024-09-22T08:31:14.246719+0000","last_active":"2024-09-22T08:54:11.274127+0000","last_peered":"2024-09-22T08:54:11.274127+0000","last_clean":"2024-09-22T08:54:11.274127+0000","last_became_active":"2024-09-22T08:31:14.246417+0000","last_became_peered":"2024-09-22T08:31:14.246417+0000","last_unstale":"2024-09-22T08:54:11.274127+0000","last_undegraded":"2024-09-22T08:54:11.274127+0000","last_fullsized":"2024-09-22T08:54:11.274127+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:41:02.060530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"263'9","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.381511+0000","last_change":"2024-09-22T08:31:11.211394+0000","last_active":"2024-09-22T08:56:16.381511+0000","last_peered":"2024-09-22T08:56:16.381511+0000","last_clean":"2024-09-22T08:56:16.381511+0000","last_became_active":"2024-09-22T08:31:11.211079+0000","last_became_peered":"2024-09-22T08:31:11.211079+0000","last_unstale":"2024-09-22T08:56:16.381511+0000","last_undegraded":"2024-09-22T08:56:16.381511+0000","last_fullsized":"2024-09-22T08:56:16.381511+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:24:21.252446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10242,"num_write":14,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"263'18","reported_seq":88,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:23.384401+0000","last_change":"2024-09-22T08:29:26.068293+0000","last_active":"2024-09-22T08:52:23.384401+0000","last_peered":"2024-09-22T08:52:23.384401+0000","last_clean":"2024-09-22T08:52:23.384401+0000","last_became_active":"2024-09-22T08:29:26.067964+0000","last_became_peered":"2024-09-22T08:29:26.067964+0000","last_unstale":"2024-09-22T08:52:23.384401+0000","last_undegraded":"2024-09-22T08:52:23.384401+0000","last_fullsized":"2024-09-22T08:52:23.384401+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:41:20.023712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":85,"num_write":46,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:43.387400+0000","last_change":"2024-09-22T08:42:17.438619+0000","last_active":"2024-09-22T08:52:43.387400+0000","last_peered":"2024-09-22T08:52:43.387400+0000","last_clean":"2024-09-22T08:52:43.387400+0000","last_became_active":"2024-09-22T08:42:17.438318+0000","last_became_peered":"2024-09-22T08:42:17.438318+0000","last_unstale":"2024-09-22T08:52:43.387400+0000","last_undegraded":"2024-09-22T08:52:43.387400+0000","last_fullsized":"2024-09-22T08:52:43.387400+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:18:22.838300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:11.274093+0000","last_change":"2024-09-22T08:31:14.258446+0000","last_active":"2024-09-22T08:54:11.274093+0000","last_peered":"2024-09-22T08:54:11.274093+0000","last_clean":"2024-09-22T08:54:11.274093+0000","last_became_active":"2024-09-22T08:31:14.258136+0000","last_became_peered":"2024-09-22T08:31:14.258136+0000","last_unstale":"2024-09-22T08:54:11.274093+0000","last_undegraded":"2024-09-22T08:54:11.274093+0000","last_fullsized":"2024-09-22T08:54:11.274093+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:09:06.068754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"263'1","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:08.397264+0000","last_change":"2024-09-22T08:31:11.214416+0000","last_active":"2024-09-22T08:54:08.397264+0000","last_peered":"2024-09-22T08:54:08.397264+0000","last_clean":"2024-09-22T08:54:08.397264+0000","last_became_active":"2024-09-22T08:31:11.214112+0000","last_became_peered":"2024-09-22T08:31:11.214112+0000","last_unstale":"2024-09-22T08:54:08.397264+0000","last_undegraded":"2024-09-22T08:54:08.397264+0000","last_fullsized":"2024-09-22T08:54:08.397264+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:13:58.692971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"263'20","reported_seq":98,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:31.269276+0000","last_change":"2024-09-22T08:29:26.069691+0000","last_active":"2024-09-22T08:53:31.269276+0000","last_peered":"2024-09-22T08:53:31.269276+0000","last_clean":"2024-09-22T08:53:31.269276+0000","last_became_active":"2024-09-22T08:29:26.069407+0000","last_became_peered":"2024-09-22T08:29:26.069407+0000","last_unstale":"2024-09-22T08:53:31.269276+0000","last_undegraded":"2024-09-22T08:53:31.269276+0000","last_fullsized":"2024-09-22T08:53:31.269276+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:46:12.719810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":95,"num_write":53,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"263'218","reported_seq":855,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:19.551923+0000","last_change":"2024-09-22T08:15:04.957845+0000","last_active":"2024-09-22T08:54:19.551923+0000","last_peered":"2024-09-22T08:54:19.551923+0000","last_clean":"2024-09-22T08:54:19.551923+0000","last_became_active":"2024-09-22T08:15:04.957090+0000","last_became_peered":"2024-09-22T08:15:04.957090+0000","last_unstale":"2024-09-22T08:54:19.551923+0000","last_undegraded":"2024-09-22T08:54:19.551923+0000","last_fullsized":"2024-09-22T08:54:19.551923+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:32:54.449746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6325712,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":578,"num_read_kb":1123,"num_write":1108,"num_write_kb":27318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"263'475","reported_seq":2198,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.479858+0000","last_change":"2024-09-22T08:15:06.981247+0000","last_active":"2024-09-22T08:54:41.479858+0000","last_peered":"2024-09-22T08:54:41.479858+0000","last_clean":"2024-09-22T08:54:41.479858+0000","last_became_active":"2024-09-22T08:15:06.980616+0000","last_became_peered":"2024-09-22T08:15:06.980616+0000","last_unstale":"2024-09-22T08:54:41.479858+0000","last_undegraded":"2024-09-22T08:54:41.479858+0000","last_fullsized":"2024-09-22T08:54:41.479858+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:58:53.792749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2847,"num_read_kb":2707,"num_write":560,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"263'239","reported_seq":875,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.532805+0000","last_change":"2024-09-22T08:15:04.957479+0000","last_active":"2024-09-22T08:56:16.532805+0000","last_peered":"2024-09-22T08:56:16.532805+0000","last_clean":"2024-09-22T08:56:16.532805+0000","last_became_active":"2024-09-22T08:15:04.956643+0000","last_became_peered":"2024-09-22T08:15:04.956643+0000","last_unstale":"2024-09-22T08:56:16.532805+0000","last_undegraded":"2024-09-22T08:56:16.532805+0000","last_fullsized":"2024-09-22T08:56:16.532805+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:23:49.336948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":599,"num_read_kb":19417,"num_write":1105,"num_write_kb":24732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"263'386","reported_seq":1918,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:17.378056+0000","last_change":"2024-09-22T08:15:06.974580+0000","last_active":"2024-09-22T08:54:17.378056+0000","last_peered":"2024-09-22T08:54:17.378056+0000","last_clean":"2024-09-22T08:54:17.378056+0000","last_became_active":"2024-09-22T08:15:06.974127+0000","last_became_peered":"2024-09-22T08:15:06.974127+0000","last_unstale":"2024-09-22T08:54:17.378056+0000","last_undegraded":"2024-09-22T08:54:17.378056+0000","last_fullsized":"2024-09-22T08:54:17.378056+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:33:05.581133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2097,"num_read_kb":2016,"num_write":427,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"263'254","reported_seq":921,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.464973+0000","last_change":"2024-09-22T08:15:04.956999+0000","last_active":"2024-09-22T08:56:16.464973+0000","last_peered":"2024-09-22T08:56:16.464973+0000","last_clean":"2024-09-22T08:56:16.464973+0000","last_became_active":"2024-09-22T08:15:04.956659+0000","last_became_peered":"2024-09-22T08:15:04.956659+0000","last_unstale":"2024-09-22T08:56:16.464973+0000","last_undegraded":"2024-09-22T08:56:16.464973+0000","last_fullsized":"2024-09-22T08:56:16.464973+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:42:55.552056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":699,"num_read_kb":25466,"num_write":1131,"num_write_kb":27131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"263'898","reported_seq":2493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.960994+0000","last_change":"2024-09-22T08:15:06.969243+0000","last_active":"2024-09-22T08:54:27.960994+0000","last_peered":"2024-09-22T08:54:27.960994+0000","last_clean":"2024-09-22T08:54:27.960994+0000","last_became_active":"2024-09-22T08:15:06.968959+0000","last_became_peered":"2024-09-22T08:15:06.968959+0000","last_unstale":"2024-09-22T08:54:27.960994+0000","last_undegraded":"2024-09-22T08:54:27.960994+0000","last_fullsized":"2024-09-22T08:54:27.960994+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":800,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:30:18.722556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4516,"num_read_kb":4043,"num_write":1241,"num_write_kb":490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"263'227","reported_seq":864,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:54.926677+0000","last_change":"2024-09-22T08:15:04.961682+0000","last_active":"2024-09-22T08:55:54.926677+0000","last_peered":"2024-09-22T08:55:54.926677+0000","last_clean":"2024-09-22T08:55:54.926677+0000","last_became_active":"2024-09-22T08:15:04.961309+0000","last_became_peered":"2024-09-22T08:15:04.961309+0000","last_unstale":"2024-09-22T08:55:54.926677+0000","last_undegraded":"2024-09-22T08:55:54.926677+0000","last_fullsized":"2024-09-22T08:55:54.926677+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:32:00.847272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14713433,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":548,"num_read_kb":61449,"num_write":1033,"num_write_kb":33072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"263'535","reported_seq":2232,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:26.719838+0000","last_change":"2024-09-22T08:15:06.969850+0000","last_active":"2024-09-22T08:54:26.719838+0000","last_peered":"2024-09-22T08:54:26.719838+0000","last_clean":"2024-09-22T08:54:26.719838+0000","last_became_active":"2024-09-22T08:15:06.969540+0000","last_became_peered":"2024-09-22T08:15:06.969540+0000","last_unstale":"2024-09-22T08:54:26.719838+0000","last_undegraded":"2024-09-22T08:54:26.719838+0000","last_fullsized":"2024-09-22T08:54:26.719838+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:39:46.162178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2823,"num_read_kb":2637,"num_write":641,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"263'205","reported_seq":905,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:04.696447+0000","last_change":"2024-09-22T08:15:04.958005+0000","last_active":"2024-09-22T08:54:04.696447+0000","last_peered":"2024-09-22T08:54:04.696447+0000","last_clean":"2024-09-22T08:54:04.696447+0000","last_became_active":"2024-09-22T08:15:04.957717+0000","last_became_peered":"2024-09-22T08:15:04.957717+0000","last_unstale":"2024-09-22T08:54:04.696447+0000","last_undegraded":"2024-09-22T08:54:04.696447+0000","last_fullsized":"2024-09-22T08:54:04.696447+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:54:04.680306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12435334,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":712,"num_read_kb":166418,"num_write":947,"num_write_kb":57547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"263'603","reported_seq":2125,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:18.165751+0000","last_change":"2024-09-22T08:15:06.962885+0000","last_active":"2024-09-22T08:54:18.165751+0000","last_peered":"2024-09-22T08:54:18.165751+0000","last_clean":"2024-09-22T08:54:18.165751+0000","last_became_active":"2024-09-22T08:15:06.962605+0000","last_became_peered":"2024-09-22T08:15:06.962605+0000","last_unstale":"2024-09-22T08:54:18.165751+0000","last_undegraded":"2024-09-22T08:54:18.165751+0000","last_fullsized":"2024-09-22T08:54:18.165751+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":500,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:20:20.581344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3087,"num_read_kb":2910,"num_write":853,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"263'248","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.428976+0000","last_change":"2024-09-22T08:15:04.962423+0000","last_active":"2024-09-22T08:54:38.428976+0000","last_peered":"2024-09-22T08:54:38.428976+0000","last_clean":"2024-09-22T08:54:38.428976+0000","last_became_active":"2024-09-22T08:15:04.962128+0000","last_became_peered":"2024-09-22T08:15:04.962128+0000","last_unstale":"2024-09-22T08:54:38.428976+0000","last_undegraded":"2024-09-22T08:54:38.428976+0000","last_fullsized":"2024-09-22T08:54:38.428976+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:42:18.164351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13663310,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":745,"num_read_kb":52063,"num_write":1231,"num_write_kb":44926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"263'868","reported_seq":2689,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.926078+0000","last_change":"2024-09-22T08:15:06.973142+0000","last_active":"2024-09-22T08:54:38.926078+0000","last_peered":"2024-09-22T08:54:38.926078+0000","last_clean":"2024-09-22T08:54:38.926078+0000","last_became_active":"2024-09-22T08:15:06.972756+0000","last_became_peered":"2024-09-22T08:15:06.972756+0000","last_unstale":"2024-09-22T08:54:38.926078+0000","last_undegraded":"2024-09-22T08:54:38.926078+0000","last_fullsized":"2024-09-22T08:54:38.926078+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":800,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:03:48.112288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4443,"num_read_kb":4056,"num_write":1153,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"263'243","reported_seq":909,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:48.816030+0000","last_change":"2024-09-22T08:15:04.945272+0000","last_active":"2024-09-22T08:53:48.816030+0000","last_peered":"2024-09-22T08:53:48.816030+0000","last_clean":"2024-09-22T08:53:48.816030+0000","last_became_active":"2024-09-22T08:15:04.944916+0000","last_became_peered":"2024-09-22T08:15:04.944916+0000","last_unstale":"2024-09-22T08:53:48.816030+0000","last_undegraded":"2024-09-22T08:53:48.816030+0000","last_fullsized":"2024-09-22T08:53:48.816030+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:27:56.610167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6353845,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":799,"num_read_kb":10946,"num_write":1069,"num_write_kb":28039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"263'555","reported_seq":2079,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:22.694280+0000","last_change":"2024-09-22T08:15:06.969137+0000","last_active":"2024-09-22T08:54:22.694280+0000","last_peered":"2024-09-22T08:54:22.694280+0000","last_clean":"2024-09-22T08:54:22.694280+0000","last_became_active":"2024-09-22T08:15:06.968853+0000","last_became_peered":"2024-09-22T08:15:06.968853+0000","last_unstale":"2024-09-22T08:54:22.694280+0000","last_undegraded":"2024-09-22T08:54:22.694280+0000","last_fullsized":"2024-09-22T08:54:22.694280+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:30:47.410362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2932,"num_read_kb":2656,"num_write":742,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"263'185","reported_seq":754,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.542818+0000","last_change":"2024-09-22T08:15:04.959783+0000","last_active":"2024-09-22T08:56:16.542818+0000","last_peered":"2024-09-22T08:56:16.542818+0000","last_clean":"2024-09-22T08:56:16.542818+0000","last_became_active":"2024-09-22T08:15:04.959395+0000","last_became_peered":"2024-09-22T08:15:04.959395+0000","last_unstale":"2024-09-22T08:56:16.542818+0000","last_undegraded":"2024-09-22T08:56:16.542818+0000","last_fullsized":"2024-09-22T08:56:16.542818+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:39:51.640256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":318,"num_read_kb":28967,"num_write":772,"num_write_kb":45290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"263'1560","reported_seq":3265,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:40.939260+0000","last_change":"2024-09-22T08:15:06.972382+0000","last_active":"2024-09-22T08:54:40.939260+0000","last_peered":"2024-09-22T08:54:40.939260+0000","last_clean":"2024-09-22T08:54:40.939260+0000","last_became_active":"2024-09-22T08:15:06.972074+0000","last_became_peered":"2024-09-22T08:15:06.972074+0000","last_unstale":"2024-09-22T08:54:40.939260+0000","last_undegraded":"2024-09-22T08:54:40.939260+0000","last_fullsized":"2024-09-22T08:54:40.939260+0000","mapping_epoch":25,"log_start":"263'1500","ondisk_log_start":"263'1500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":1500,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:28:04.310796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6961,"num_read_kb":6120,"num_write":2165,"num_write_kb":918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"263'483","reported_seq":2143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:40.939680+0000","last_change":"2024-09-22T08:15:06.966028+0000","last_active":"2024-09-22T08:54:40.939680+0000","last_peered":"2024-09-22T08:54:40.939680+0000","last_clean":"2024-09-22T08:54:40.939680+0000","last_became_active":"2024-09-22T08:15:06.965751+0000","last_became_peered":"2024-09-22T08:15:06.965751+0000","last_unstale":"2024-09-22T08:54:40.939680+0000","last_undegraded":"2024-09-22T08:54:40.939680+0000","last_fullsized":"2024-09-22T08:54:40.939680+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:49:12.402190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2631,"num_read_kb":2475,"num_write":578,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"263'206","reported_seq":849,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:18.411364+0000","last_change":"2024-09-22T08:15:04.953971+0000","last_active":"2024-09-22T08:53:18.411364+0000","last_peered":"2024-09-22T08:53:18.411364+0000","last_clean":"2024-09-22T08:53:18.411364+0000","last_became_active":"2024-09-22T08:15:04.953628+0000","last_became_peered":"2024-09-22T08:15:04.953628+0000","last_unstale":"2024-09-22T08:53:18.411364+0000","last_undegraded":"2024-09-22T08:53:18.411364+0000","last_fullsized":"2024-09-22T08:53:18.411364+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:19:43.155317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1699996,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":528,"num_read_kb":68585,"num_write":868,"num_write_kb":34888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"263'357","reported_seq":1735,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:25.944981+0000","last_change":"2024-09-22T08:15:06.969299+0000","last_active":"2024-09-22T08:54:25.944981+0000","last_peered":"2024-09-22T08:54:25.944981+0000","last_clean":"2024-09-22T08:54:25.944981+0000","last_became_active":"2024-09-22T08:15:06.968970+0000","last_became_peered":"2024-09-22T08:15:06.968970+0000","last_unstale":"2024-09-22T08:54:25.944981+0000","last_undegraded":"2024-09-22T08:54:25.944981+0000","last_fullsized":"2024-09-22T08:54:25.944981+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:38:44.711239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2053,"num_read_kb":1926,"num_write":427,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"263'223","reported_seq":854,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:17.312246+0000","last_change":"2024-09-22T08:15:04.967060+0000","last_active":"2024-09-22T08:54:17.312246+0000","last_peered":"2024-09-22T08:54:17.312246+0000","last_clean":"2024-09-22T08:54:17.312246+0000","last_became_active":"2024-09-22T08:15:04.966769+0000","last_became_peered":"2024-09-22T08:15:04.966769+0000","last_unstale":"2024-09-22T08:54:17.312246+0000","last_undegraded":"2024-09-22T08:54:17.312246+0000","last_fullsized":"2024-09-22T08:54:17.312246+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:56:04.347599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9763965,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":514,"num_read_kb":51014,"num_write":1099,"num_write_kb":43963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"263'468","reported_seq":1924,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:20.263692+0000","last_change":"2024-09-22T08:15:06.973138+0000","last_active":"2024-09-22T08:54:20.263692+0000","last_peered":"2024-09-22T08:54:20.263692+0000","last_clean":"2024-09-22T08:54:20.263692+0000","last_became_active":"2024-09-22T08:15:06.972821+0000","last_became_peered":"2024-09-22T08:15:06.972821+0000","last_unstale":"2024-09-22T08:54:20.263692+0000","last_undegraded":"2024-09-22T08:54:20.263692+0000","last_fullsized":"2024-09-22T08:54:20.263692+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:14.633460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2415,"num_read_kb":2238,"num_write":577,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"263'218","reported_seq":940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:57.751847+0000","last_change":"2024-09-22T08:15:04.956245+0000","last_active":"2024-09-22T08:55:57.751847+0000","last_peered":"2024-09-22T08:55:57.751847+0000","last_clean":"2024-09-22T08:55:57.751847+0000","last_became_active":"2024-09-22T08:15:04.955972+0000","last_became_peered":"2024-09-22T08:15:04.955972+0000","last_unstale":"2024-09-22T08:55:57.751847+0000","last_undegraded":"2024-09-22T08:55:57.751847+0000","last_fullsized":"2024-09-22T08:55:57.751847+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:47:06.545629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":381104,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":990,"num_read_kb":8164,"num_write":931,"num_write_kb":17459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"263'463","reported_seq":2079,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:40.939187+0000","last_change":"2024-09-22T08:15:06.972576+0000","last_active":"2024-09-22T08:54:40.939187+0000","last_peered":"2024-09-22T08:54:40.939187+0000","last_clean":"2024-09-22T08:54:40.939187+0000","last_became_active":"2024-09-22T08:15:06.972250+0000","last_became_peered":"2024-09-22T08:15:06.972250+0000","last_unstale":"2024-09-22T08:54:40.939187+0000","last_undegraded":"2024-09-22T08:54:40.939187+0000","last_fullsized":"2024-09-22T08:54:40.939187+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:26:28.387708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2654,"num_read_kb":2505,"num_write":533,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"263'239","reported_seq":881,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:48.478320+0000","last_change":"2024-09-22T08:15:04.955521+0000","last_active":"2024-09-22T08:53:48.478320+0000","last_peered":"2024-09-22T08:53:48.478320+0000","last_clean":"2024-09-22T08:53:48.478320+0000","last_became_active":"2024-09-22T08:15:04.954948+0000","last_became_peered":"2024-09-22T08:15:04.954948+0000","last_unstale":"2024-09-22T08:53:48.478320+0000","last_undegraded":"2024-09-22T08:53:48.478320+0000","last_fullsized":"2024-09-22T08:53:48.478320+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:55:10.800461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2190676,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":543,"num_read_kb":6536,"num_write":1080,"num_write_kb":24915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"263'385","reported_seq":1845,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:40.939101+0000","last_change":"2024-09-22T08:15:06.970282+0000","last_active":"2024-09-22T08:54:40.939101+0000","last_peered":"2024-09-22T08:54:40.939101+0000","last_clean":"2024-09-22T08:54:40.939101+0000","last_became_active":"2024-09-22T08:15:06.968651+0000","last_became_peered":"2024-09-22T08:15:06.968651+0000","last_unstale":"2024-09-22T08:54:40.939101+0000","last_undegraded":"2024-09-22T08:54:40.939101+0000","last_fullsized":"2024-09-22T08:54:40.939101+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:24:42.424031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2079,"num_read_kb":1977,"num_write":435,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"263'237","reported_seq":852,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:12.308091+0000","last_change":"2024-09-22T08:15:04.958944+0000","last_active":"2024-09-22T08:56:12.308091+0000","last_peered":"2024-09-22T08:56:12.308091+0000","last_clean":"2024-09-22T08:56:12.308091+0000","last_became_active":"2024-09-22T08:15:04.958578+0000","last_became_peered":"2024-09-22T08:15:04.958578+0000","last_unstale":"2024-09-22T08:56:12.308091+0000","last_undegraded":"2024-09-22T08:56:12.308091+0000","last_fullsized":"2024-09-22T08:56:12.308091+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:42:49.203289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":554,"num_read_kb":7725,"num_write":1073,"num_write_kb":35221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"263'573","reported_seq":2255,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:21.832642+0000","last_change":"2024-09-22T08:15:06.980925+0000","last_active":"2024-09-22T08:54:21.832642+0000","last_peered":"2024-09-22T08:54:21.832642+0000","last_clean":"2024-09-22T08:54:21.832642+0000","last_became_active":"2024-09-22T08:15:06.980621+0000","last_became_peered":"2024-09-22T08:15:06.980621+0000","last_unstale":"2024-09-22T08:54:21.832642+0000","last_undegraded":"2024-09-22T08:54:21.832642+0000","last_fullsized":"2024-09-22T08:54:21.832642+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":500,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:01.217800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3075,"num_read_kb":2832,"num_write":740,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"263'193","reported_seq":993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.473026+0000","last_change":"2024-09-22T08:15:04.952516+0000","last_active":"2024-09-22T08:56:16.473026+0000","last_peered":"2024-09-22T08:56:16.473026+0000","last_clean":"2024-09-22T08:56:16.473026+0000","last_became_active":"2024-09-22T08:15:04.952203+0000","last_became_peered":"2024-09-22T08:15:04.952203+0000","last_unstale":"2024-09-22T08:56:16.473026+0000","last_undegraded":"2024-09-22T08:56:16.473026+0000","last_fullsized":"2024-09-22T08:56:16.473026+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:30:00.993327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1058,"num_read_kb":8867,"num_write":911,"num_write_kb":21916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"263'139","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.532349+0000","last_change":"2024-09-22T08:15:15.011843+0000","last_active":"2024-09-22T08:54:41.532349+0000","last_peered":"2024-09-22T08:54:41.532349+0000","last_clean":"2024-09-22T08:54:41.532349+0000","last_became_active":"2024-09-22T08:15:15.011529+0000","last_became_peered":"2024-09-22T08:15:15.011529+0000","last_unstale":"2024-09-22T08:54:41.532349+0000","last_undegraded":"2024-09-22T08:54:41.532349+0000","last_fullsized":"2024-09-22T08:54:41.532349+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:25.703936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":192,"num_read_kb":186,"num_write":338,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"263'502","reported_seq":2104,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:26.719888+0000","last_change":"2024-09-22T08:15:06.968110+0000","last_active":"2024-09-22T08:54:26.719888+0000","last_peered":"2024-09-22T08:54:26.719888+0000","last_clean":"2024-09-22T08:54:26.719888+0000","last_became_active":"2024-09-22T08:15:06.967794+0000","last_became_peered":"2024-09-22T08:15:06.967794+0000","last_unstale":"2024-09-22T08:54:26.719888+0000","last_undegraded":"2024-09-22T08:54:26.719888+0000","last_fullsized":"2024-09-22T08:54:26.719888+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:18:56.559988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2789,"num_read_kb":2608,"num_write":647,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"263'214","reported_seq":859,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.861009+0000","last_change":"2024-09-22T08:15:04.964175+0000","last_active":"2024-09-22T08:54:38.861009+0000","last_peered":"2024-09-22T08:54:38.861009+0000","last_clean":"2024-09-22T08:54:38.861009+0000","last_became_active":"2024-09-22T08:15:04.963890+0000","last_became_peered":"2024-09-22T08:15:04.963890+0000","last_unstale":"2024-09-22T08:54:38.861009+0000","last_undegraded":"2024-09-22T08:54:38.861009+0000","last_fullsized":"2024-09-22T08:54:38.861009+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:19:35.111320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5671389,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":530,"num_read_kb":15199,"num_write":1083,"num_write_kb":18954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:48.395352+0000","last_change":"2024-09-22T08:15:08.968916+0000","last_active":"2024-09-22T08:53:48.395352+0000","last_peered":"2024-09-22T08:53:48.395352+0000","last_clean":"2024-09-22T08:53:48.395352+0000","last_became_active":"2024-09-22T08:15:08.968482+0000","last_became_peered":"2024-09-22T08:15:08.968482+0000","last_unstale":"2024-09-22T08:53:48.395352+0000","last_undegraded":"2024-09-22T08:53:48.395352+0000","last_fullsized":"2024-09-22T08:53:48.395352+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:17:40.343334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"263'192","reported_seq":791,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.348297+0000","last_change":"2024-09-22T08:15:10.987896+0000","last_active":"2024-09-22T08:56:16.348297+0000","last_peered":"2024-09-22T08:56:16.348297+0000","last_clean":"2024-09-22T08:56:16.348297+0000","last_became_active":"2024-09-22T08:15:10.987539+0000","last_became_peered":"2024-09-22T08:15:10.987539+0000","last_unstale":"2024-09-22T08:56:16.348297+0000","last_undegraded":"2024-09-22T08:56:16.348297+0000","last_fullsized":"2024-09-22T08:56:16.348297+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:00:01.634988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7203,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":254,"num_read_kb":315,"num_write":148,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:28.376501+0000","last_change":"2024-09-22T08:15:13.019038+0000","last_active":"2024-09-22T08:51:28.376501+0000","last_peered":"2024-09-22T08:51:28.376501+0000","last_clean":"2024-09-22T08:51:28.376501+0000","last_became_active":"2024-09-22T08:15:13.018750+0000","last_became_peered":"2024-09-22T08:15:13.018750+0000","last_unstale":"2024-09-22T08:51:28.376501+0000","last_undegraded":"2024-09-22T08:51:28.376501+0000","last_fullsized":"2024-09-22T08:51:28.376501+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:37:28.422394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"263'150","reported_seq":640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.301330+0000","last_change":"2024-09-22T08:15:15.020868+0000","last_active":"2024-09-22T08:54:41.301330+0000","last_peered":"2024-09-22T08:54:41.301330+0000","last_clean":"2024-09-22T08:54:41.301330+0000","last_became_active":"2024-09-22T08:15:15.020542+0000","last_became_peered":"2024-09-22T08:15:15.020542+0000","last_unstale":"2024-09-22T08:54:41.301330+0000","last_undegraded":"2024-09-22T08:54:41.301330+0000","last_fullsized":"2024-09-22T08:54:41.301330+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:46:43.042803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":183,"num_read_kb":175,"num_write":358,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"263'751","reported_seq":2354,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:40.939200+0000","last_change":"2024-09-22T08:15:06.981089+0000","last_active":"2024-09-22T08:54:40.939200+0000","last_peered":"2024-09-22T08:54:40.939200+0000","last_clean":"2024-09-22T08:54:40.939200+0000","last_became_active":"2024-09-22T08:15:06.980479+0000","last_became_peered":"2024-09-22T08:15:06.980479+0000","last_unstale":"2024-09-22T08:54:40.939200+0000","last_undegraded":"2024-09-22T08:54:40.939200+0000","last_fullsized":"2024-09-22T08:54:40.939200+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:49:26.940326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3625,"num_read_kb":3307,"num_write":963,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"263'254","reported_seq":922,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:47.293755+0000","last_change":"2024-09-22T08:15:04.951572+0000","last_active":"2024-09-22T08:54:47.293755+0000","last_peered":"2024-09-22T08:54:47.293755+0000","last_clean":"2024-09-22T08:54:47.293755+0000","last_became_active":"2024-09-22T08:15:04.951265+0000","last_became_peered":"2024-09-22T08:15:04.951265+0000","last_unstale":"2024-09-22T08:54:47.293755+0000","last_undegraded":"2024-09-22T08:54:47.293755+0000","last_fullsized":"2024-09-22T08:54:47.293755+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:22:06.557070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":764,"num_read_kb":7954,"num_write":1369,"num_write_kb":16798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:37.397545+0000","last_change":"2024-09-22T08:15:08.979213+0000","last_active":"2024-09-22T08:52:37.397545+0000","last_peered":"2024-09-22T08:52:37.397545+0000","last_clean":"2024-09-22T08:52:37.397545+0000","last_became_active":"2024-09-22T08:15:08.978832+0000","last_became_peered":"2024-09-22T08:15:08.978832+0000","last_unstale":"2024-09-22T08:52:37.397545+0000","last_undegraded":"2024-09-22T08:52:37.397545+0000","last_fullsized":"2024-09-22T08:52:37.397545+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:42:16.081624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"263'77","reported_seq":597,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.725866+0000","last_change":"2024-09-22T08:15:10.984633+0000","last_active":"2024-09-22T08:55:19.725866+0000","last_peered":"2024-09-22T08:55:19.725866+0000","last_clean":"2024-09-22T08:55:19.725866+0000","last_became_active":"2024-09-22T08:15:10.984027+0000","last_became_peered":"2024-09-22T08:15:10.984027+0000","last_unstale":"2024-09-22T08:55:19.725866+0000","last_undegraded":"2024-09-22T08:55:19.725866+0000","last_fullsized":"2024-09-22T08:55:19.725866+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:59:59.106865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":87,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:28.376429+0000","last_change":"2024-09-22T08:15:13.013974+0000","last_active":"2024-09-22T08:51:28.376429+0000","last_peered":"2024-09-22T08:51:28.376429+0000","last_clean":"2024-09-22T08:51:28.376429+0000","last_became_active":"2024-09-22T08:15:13.013609+0000","last_became_peered":"2024-09-22T08:15:13.013609+0000","last_unstale":"2024-09-22T08:51:28.376429+0000","last_undegraded":"2024-09-22T08:51:28.376429+0000","last_fullsized":"2024-09-22T08:51:28.376429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:39:31.786695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"263'154","reported_seq":663,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:14.427460+0000","last_change":"2024-09-22T08:15:15.019318+0000","last_active":"2024-09-22T08:54:14.427460+0000","last_peered":"2024-09-22T08:54:14.427460+0000","last_clean":"2024-09-22T08:54:14.427460+0000","last_became_active":"2024-09-22T08:15:15.018984+0000","last_became_peered":"2024-09-22T08:15:15.018984+0000","last_unstale":"2024-09-22T08:54:14.427460+0000","last_undegraded":"2024-09-22T08:54:14.427460+0000","last_fullsized":"2024-09-22T08:54:14.427460+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:29:44.945052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":263,"num_read_kb":245,"num_write":379,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"263'1935","reported_seq":3646,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.040078+0000","last_change":"2024-09-22T08:15:06.969580+0000","last_active":"2024-09-22T08:56:02.040078+0000","last_peered":"2024-09-22T08:56:02.040078+0000","last_clean":"2024-09-22T08:56:02.040078+0000","last_became_active":"2024-09-22T08:15:06.967645+0000","last_became_peered":"2024-09-22T08:15:06.967645+0000","last_unstale":"2024-09-22T08:56:02.040078+0000","last_undegraded":"2024-09-22T08:56:02.040078+0000","last_fullsized":"2024-09-22T08:56:02.040078+0000","mapping_epoch":25,"log_start":"263'1900","ondisk_log_start":"263'1900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":1900,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:51:46.954458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8532,"num_read_kb":7421,"num_write":2741,"num_write_kb":1214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"263'186","reported_seq":831,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:15.625027+0000","last_change":"2024-09-22T08:15:04.965135+0000","last_active":"2024-09-22T08:53:15.625027+0000","last_peered":"2024-09-22T08:53:15.625027+0000","last_clean":"2024-09-22T08:53:15.625027+0000","last_became_active":"2024-09-22T08:15:04.964798+0000","last_became_peered":"2024-09-22T08:15:04.964798+0000","last_unstale":"2024-09-22T08:53:15.625027+0000","last_undegraded":"2024-09-22T08:53:15.625027+0000","last_fullsized":"2024-09-22T08:53:15.625027+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:57:26.490605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21034321,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":429,"num_read_kb":111211,"num_write":822,"num_write_kb":54102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:52.407838+0000","last_change":"2024-09-22T08:15:08.977351+0000","last_active":"2024-09-22T08:53:52.407838+0000","last_peered":"2024-09-22T08:53:52.407838+0000","last_clean":"2024-09-22T08:53:52.407838+0000","last_became_active":"2024-09-22T08:15:08.976950+0000","last_became_peered":"2024-09-22T08:15:08.976950+0000","last_unstale":"2024-09-22T08:53:52.407838+0000","last_undegraded":"2024-09-22T08:53:52.407838+0000","last_fullsized":"2024-09-22T08:53:52.407838+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:02:30.621484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"263'107","reported_seq":638,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.745947+0000","last_change":"2024-09-22T08:15:10.981219+0000","last_active":"2024-09-22T08:55:19.745947+0000","last_peered":"2024-09-22T08:55:19.745947+0000","last_clean":"2024-09-22T08:55:19.745947+0000","last_became_active":"2024-09-22T08:15:10.980879+0000","last_became_peered":"2024-09-22T08:15:10.980879+0000","last_unstale":"2024-09-22T08:55:19.745947+0000","last_undegraded":"2024-09-22T08:55:19.745947+0000","last_fullsized":"2024-09-22T08:55:19.745947+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:15:11.627561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":117,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"263'778","reported_seq":2374,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:03.378420+0000","last_change":"2024-09-22T08:15:13.012087+0000","last_active":"2024-09-22T08:56:03.378420+0000","last_peered":"2024-09-22T08:56:03.378420+0000","last_clean":"2024-09-22T08:56:03.378420+0000","last_became_active":"2024-09-22T08:15:13.011812+0000","last_became_peered":"2024-09-22T08:15:13.011812+0000","last_unstale":"2024-09-22T08:56:03.378420+0000","last_undegraded":"2024-09-22T08:56:03.378420+0000","last_fullsized":"2024-09-22T08:56:03.378420+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":700,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:23:51.018829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"263'178","reported_seq":999,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.583483+0000","last_change":"2024-09-22T08:15:15.016044+0000","last_active":"2024-09-22T08:54:41.583483+0000","last_peered":"2024-09-22T08:54:41.583483+0000","last_clean":"2024-09-22T08:54:41.583483+0000","last_became_active":"2024-09-22T08:15:15.015684+0000","last_became_peered":"2024-09-22T08:15:15.015684+0000","last_unstale":"2024-09-22T08:54:41.583483+0000","last_undegraded":"2024-09-22T08:54:41.583483+0000","last_fullsized":"2024-09-22T08:54:41.583483+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:38.991298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":616,"num_read_kb":611,"num_write":377,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"263'1260","reported_seq":2732,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.361262+0000","last_change":"2024-09-22T08:15:06.967665+0000","last_active":"2024-09-22T08:54:27.361262+0000","last_peered":"2024-09-22T08:54:27.361262+0000","last_clean":"2024-09-22T08:54:27.361262+0000","last_became_active":"2024-09-22T08:15:06.967323+0000","last_became_peered":"2024-09-22T08:15:06.967323+0000","last_unstale":"2024-09-22T08:54:27.361262+0000","last_undegraded":"2024-09-22T08:54:27.361262+0000","last_fullsized":"2024-09-22T08:54:27.361262+0000","mapping_epoch":25,"log_start":"263'1200","ondisk_log_start":"263'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":1200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:20:28.597649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7857,"num_read_kb":7154,"num_write":1964,"num_write_kb":850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"263'239","reported_seq":907,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:07.393499+0000","last_change":"2024-09-22T08:15:04.960077+0000","last_active":"2024-09-22T08:54:07.393499+0000","last_peered":"2024-09-22T08:54:07.393499+0000","last_clean":"2024-09-22T08:54:07.393499+0000","last_became_active":"2024-09-22T08:15:04.959776+0000","last_became_peered":"2024-09-22T08:15:04.959776+0000","last_unstale":"2024-09-22T08:54:07.393499+0000","last_undegraded":"2024-09-22T08:54:07.393499+0000","last_fullsized":"2024-09-22T08:54:07.393499+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:51:36.656890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7371376,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":714,"num_read_kb":18775,"num_write":1147,"num_write_kb":38377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:48.395364+0000","last_change":"2024-09-22T08:15:08.973303+0000","last_active":"2024-09-22T08:53:48.395364+0000","last_peered":"2024-09-22T08:53:48.395364+0000","last_clean":"2024-09-22T08:53:48.395364+0000","last_became_active":"2024-09-22T08:15:08.973025+0000","last_became_peered":"2024-09-22T08:15:08.973025+0000","last_unstale":"2024-09-22T08:53:48.395364+0000","last_undegraded":"2024-09-22T08:53:48.395364+0000","last_fullsized":"2024-09-22T08:53:48.395364+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:04:18.829657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"263'131","reported_seq":694,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.289651+0000","last_change":"2024-09-22T08:15:10.985906+0000","last_active":"2024-09-22T08:56:16.289651+0000","last_peered":"2024-09-22T08:56:16.289651+0000","last_clean":"2024-09-22T08:56:16.289651+0000","last_became_active":"2024-09-22T08:15:10.985540+0000","last_became_peered":"2024-09-22T08:15:10.985540+0000","last_unstale":"2024-09-22T08:56:16.289651+0000","last_undegraded":"2024-09-22T08:56:16.289651+0000","last_fullsized":"2024-09-22T08:56:16.289651+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:26:23.397471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14875,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":153,"num_read_kb":214,"num_write":77,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"263'792","reported_seq":2267,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.235006+0000","last_change":"2024-09-22T08:15:13.005672+0000","last_active":"2024-09-22T08:56:16.235006+0000","last_peered":"2024-09-22T08:56:16.235006+0000","last_clean":"2024-09-22T08:56:16.235006+0000","last_became_active":"2024-09-22T08:15:13.004752+0000","last_became_peered":"2024-09-22T08:15:13.004752+0000","last_unstale":"2024-09-22T08:56:16.235006+0000","last_undegraded":"2024-09-22T08:56:16.235006+0000","last_fullsized":"2024-09-22T08:56:16.235006+0000","mapping_epoch":31,"log_start":"263'701","ondisk_log_start":"263'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":701,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:24:31.084429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"263'440","reported_seq":2067,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.474057+0000","last_change":"2024-09-22T08:15:06.965797+0000","last_active":"2024-09-22T08:54:41.474057+0000","last_peered":"2024-09-22T08:54:41.474057+0000","last_clean":"2024-09-22T08:54:41.474057+0000","last_became_active":"2024-09-22T08:15:06.965387+0000","last_became_peered":"2024-09-22T08:15:06.965387+0000","last_unstale":"2024-09-22T08:54:41.474057+0000","last_undegraded":"2024-09-22T08:54:41.474057+0000","last_fullsized":"2024-09-22T08:54:41.474057+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:11:37.474066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2432,"num_read_kb":2308,"num_write":489,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"263'263","reported_seq":905,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:50.779466+0000","last_change":"2024-09-22T08:15:04.954321+0000","last_active":"2024-09-22T08:53:50.779466+0000","last_peered":"2024-09-22T08:53:50.779466+0000","last_clean":"2024-09-22T08:53:50.779466+0000","last_became_active":"2024-09-22T08:15:04.954015+0000","last_became_peered":"2024-09-22T08:15:04.954015+0000","last_unstale":"2024-09-22T08:53:50.779466+0000","last_undegraded":"2024-09-22T08:53:50.779466+0000","last_fullsized":"2024-09-22T08:53:50.779466+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:41:32.803566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15799511,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":648,"num_read_kb":30283,"num_write":1072,"num_write_kb":39703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:58.380897+0000","last_change":"2024-09-22T08:15:08.982558+0000","last_active":"2024-09-22T08:51:58.380897+0000","last_peered":"2024-09-22T08:51:58.380897+0000","last_clean":"2024-09-22T08:51:58.380897+0000","last_became_active":"2024-09-22T08:15:08.982222+0000","last_became_peered":"2024-09-22T08:15:08.982222+0000","last_unstale":"2024-09-22T08:51:58.380897+0000","last_undegraded":"2024-09-22T08:51:58.380897+0000","last_fullsized":"2024-09-22T08:51:58.380897+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:01.178334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"263'209","reported_seq":810,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.787460+0000","last_change":"2024-09-22T08:15:10.985101+0000","last_active":"2024-09-22T08:55:19.787460+0000","last_peered":"2024-09-22T08:55:19.787460+0000","last_clean":"2024-09-22T08:55:19.787460+0000","last_became_active":"2024-09-22T08:15:10.984769+0000","last_became_peered":"2024-09-22T08:15:10.984769+0000","last_unstale":"2024-09-22T08:55:19.787460+0000","last_undegraded":"2024-09-22T08:55:19.787460+0000","last_fullsized":"2024-09-22T08:55:19.787460+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:45:44.909883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14988,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":277,"num_read_kb":341,"num_write":162,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:27.282125+0000","last_change":"2024-09-22T08:15:13.012935+0000","last_active":"2024-09-22T08:53:27.282125+0000","last_peered":"2024-09-22T08:53:27.282125+0000","last_clean":"2024-09-22T08:53:27.282125+0000","last_became_active":"2024-09-22T08:15:13.012498+0000","last_became_peered":"2024-09-22T08:15:13.012498+0000","last_unstale":"2024-09-22T08:53:27.282125+0000","last_undegraded":"2024-09-22T08:53:27.282125+0000","last_fullsized":"2024-09-22T08:53:27.282125+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:45:11.434166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"263'554","reported_seq":1379,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:03.364987+0000","last_change":"2024-09-22T08:15:15.015237+0000","last_active":"2024-09-22T08:56:03.364987+0000","last_peered":"2024-09-22T08:56:03.364987+0000","last_clean":"2024-09-22T08:56:03.364987+0000","last_became_active":"2024-09-22T08:15:15.014801+0000","last_became_peered":"2024-09-22T08:15:15.014801+0000","last_unstale":"2024-09-22T08:56:03.364987+0000","last_undegraded":"2024-09-22T08:56:03.364987+0000","last_fullsized":"2024-09-22T08:56:03.364987+0000","mapping_epoch":33,"log_start":"263'500","ondisk_log_start":"263'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":500,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:46:54.702216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":467,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1367,"num_read_kb":1346,"num_write":1156,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"263'860","reported_seq":2445,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.032017+0000","last_change":"2024-09-22T08:15:06.973268+0000","last_active":"2024-09-22T08:56:02.032017+0000","last_peered":"2024-09-22T08:56:02.032017+0000","last_clean":"2024-09-22T08:56:02.032017+0000","last_became_active":"2024-09-22T08:15:06.972958+0000","last_became_peered":"2024-09-22T08:15:06.972958+0000","last_unstale":"2024-09-22T08:56:02.032017+0000","last_undegraded":"2024-09-22T08:56:02.032017+0000","last_fullsized":"2024-09-22T08:56:02.032017+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":800,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:07.108632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4079,"num_read_kb":3669,"num_write":1154,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"263'222","reported_seq":880,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:23.330118+0000","last_change":"2024-09-22T08:15:40.188660+0000","last_active":"2024-09-22T08:54:23.330118+0000","last_peered":"2024-09-22T08:54:23.330118+0000","last_clean":"2024-09-22T08:54:23.330118+0000","last_became_active":"2024-09-22T08:15:40.188251+0000","last_became_peered":"2024-09-22T08:15:40.188251+0000","last_unstale":"2024-09-22T08:54:23.330118+0000","last_undegraded":"2024-09-22T08:54:23.330118+0000","last_fullsized":"2024-09-22T08:54:23.330118+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:26:41.611736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16380026,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":534,"num_read_kb":133818,"num_write":961,"num_write_kb":45053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:02.269516+0000","last_change":"2024-09-22T08:15:08.975801+0000","last_active":"2024-09-22T08:52:02.269516+0000","last_peered":"2024-09-22T08:52:02.269516+0000","last_clean":"2024-09-22T08:52:02.269516+0000","last_became_active":"2024-09-22T08:15:08.975435+0000","last_became_peered":"2024-09-22T08:15:08.975435+0000","last_unstale":"2024-09-22T08:52:02.269516+0000","last_undegraded":"2024-09-22T08:52:02.269516+0000","last_fullsized":"2024-09-22T08:52:02.269516+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:08:19.699188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"263'126","reported_seq":692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.485217+0000","last_change":"2024-09-22T08:15:10.988940+0000","last_active":"2024-09-22T08:56:16.485217+0000","last_peered":"2024-09-22T08:56:16.485217+0000","last_clean":"2024-09-22T08:56:16.485217+0000","last_became_active":"2024-09-22T08:15:10.988458+0000","last_became_peered":"2024-09-22T08:15:10.988458+0000","last_unstale":"2024-09-22T08:56:16.485217+0000","last_undegraded":"2024-09-22T08:56:16.485217+0000","last_fullsized":"2024-09-22T08:56:16.485217+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:25.942851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8309,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":166,"num_read_kb":226,"num_write":90,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:07.393316+0000","last_change":"2024-09-22T08:15:13.003344+0000","last_active":"2024-09-22T08:52:07.393316+0000","last_peered":"2024-09-22T08:52:07.393316+0000","last_clean":"2024-09-22T08:52:07.393316+0000","last_became_active":"2024-09-22T08:15:13.002538+0000","last_became_peered":"2024-09-22T08:15:13.002538+0000","last_unstale":"2024-09-22T08:52:07.393316+0000","last_undegraded":"2024-09-22T08:52:07.393316+0000","last_fullsized":"2024-09-22T08:52:07.393316+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:50:12.973900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"263'2482","reported_seq":4310,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:58.403142+0000","last_change":"2024-09-22T08:15:15.020723+0000","last_active":"2024-09-22T08:54:58.403142+0000","last_peered":"2024-09-22T08:54:58.403142+0000","last_clean":"2024-09-22T08:54:58.403142+0000","last_became_active":"2024-09-22T08:15:15.020438+0000","last_became_peered":"2024-09-22T08:15:15.020438+0000","last_unstale":"2024-09-22T08:54:58.403142+0000","last_undegraded":"2024-09-22T08:54:58.403142+0000","last_fullsized":"2024-09-22T08:54:58.403142+0000","mapping_epoch":33,"log_start":"263'2400","ondisk_log_start":"263'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":2400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:19:48.770997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6235,"num_read_kb":6232,"num_write":5030,"num_write_kb":1847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"263'474","reported_seq":1995,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.469591+0000","last_change":"2024-09-22T08:15:06.971112+0000","last_active":"2024-09-22T08:54:41.469591+0000","last_peered":"2024-09-22T08:54:41.469591+0000","last_clean":"2024-09-22T08:54:41.469591+0000","last_became_active":"2024-09-22T08:15:06.970532+0000","last_became_peered":"2024-09-22T08:15:06.970532+0000","last_unstale":"2024-09-22T08:54:41.469591+0000","last_undegraded":"2024-09-22T08:54:41.469591+0000","last_fullsized":"2024-09-22T08:54:41.469591+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:04:08.887293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2482,"num_read_kb":2307,"num_write":574,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"263'212","reported_seq":836,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:23.392143+0000","last_change":"2024-09-22T08:15:04.963933+0000","last_active":"2024-09-22T08:53:23.392143+0000","last_peered":"2024-09-22T08:53:23.392143+0000","last_clean":"2024-09-22T08:53:23.392143+0000","last_became_active":"2024-09-22T08:15:04.963648+0000","last_became_peered":"2024-09-22T08:15:04.963648+0000","last_unstale":"2024-09-22T08:53:23.392143+0000","last_undegraded":"2024-09-22T08:53:23.392143+0000","last_fullsized":"2024-09-22T08:53:23.392143+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:06:54.477482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3520137,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":479,"num_read_kb":19400,"num_write":961,"num_write_kb":35249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"35'3","reported_seq":976,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:15.995729+0000","last_change":"2024-09-22T08:15:08.975603+0000","last_active":"2024-09-22T08:56:15.995729+0000","last_peered":"2024-09-22T08:56:15.995729+0000","last_clean":"2024-09-22T08:56:15.995729+0000","last_became_active":"2024-09-22T08:15:08.975260+0000","last_became_peered":"2024-09-22T08:15:08.975260+0000","last_unstale":"2024-09-22T08:56:15.995729+0000","last_undegraded":"2024-09-22T08:56:15.995729+0000","last_fullsized":"2024-09-22T08:56:15.995729+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:44:40.766275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":720,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"263'154","reported_seq":733,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.710226+0000","last_change":"2024-09-22T08:15:10.989559+0000","last_active":"2024-09-22T08:55:19.710226+0000","last_peered":"2024-09-22T08:55:19.710226+0000","last_clean":"2024-09-22T08:55:19.710226+0000","last_became_active":"2024-09-22T08:15:10.989211+0000","last_became_peered":"2024-09-22T08:15:10.989211+0000","last_unstale":"2024-09-22T08:55:19.710226+0000","last_undegraded":"2024-09-22T08:55:19.710226+0000","last_fullsized":"2024-09-22T08:55:19.710226+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:21:23.417691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15314,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":202,"num_read_kb":270,"num_write":114,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"263'792","reported_seq":2273,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.236259+0000","last_change":"2024-09-22T08:15:13.003152+0000","last_active":"2024-09-22T08:56:16.236259+0000","last_peered":"2024-09-22T08:56:16.236259+0000","last_clean":"2024-09-22T08:56:16.236259+0000","last_became_active":"2024-09-22T08:15:13.002828+0000","last_became_peered":"2024-09-22T08:15:13.002828+0000","last_unstale":"2024-09-22T08:56:16.236259+0000","last_undegraded":"2024-09-22T08:56:16.236259+0000","last_fullsized":"2024-09-22T08:56:16.236259+0000","mapping_epoch":31,"log_start":"263'701","ondisk_log_start":"263'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":701,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:50:06.133670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"263'130","reported_seq":617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:01.978028+0000","last_change":"2024-09-22T08:15:15.019494+0000","last_active":"2024-09-22T08:56:01.978028+0000","last_peered":"2024-09-22T08:56:01.978028+0000","last_clean":"2024-09-22T08:56:01.978028+0000","last_became_active":"2024-09-22T08:15:15.019162+0000","last_became_peered":"2024-09-22T08:15:15.019162+0000","last_unstale":"2024-09-22T08:56:01.978028+0000","last_undegraded":"2024-09-22T08:56:01.978028+0000","last_fullsized":"2024-09-22T08:56:01.978028+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:35:08.999759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":846,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":147,"num_read_kb":143,"num_write":317,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"263'517","reported_seq":2263,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.480093+0000","last_change":"2024-09-22T08:15:06.962857+0000","last_active":"2024-09-22T08:54:41.480093+0000","last_peered":"2024-09-22T08:54:41.480093+0000","last_clean":"2024-09-22T08:54:41.480093+0000","last_became_active":"2024-09-22T08:15:06.962528+0000","last_became_peered":"2024-09-22T08:15:06.962528+0000","last_unstale":"2024-09-22T08:54:41.480093+0000","last_undegraded":"2024-09-22T08:54:41.480093+0000","last_fullsized":"2024-09-22T08:54:41.480093+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":500,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:34:50.127904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2917,"num_read_kb":2741,"num_write":627,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"263'189","reported_seq":806,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:23.475071+0000","last_change":"2024-09-22T08:15:04.948041+0000","last_active":"2024-09-22T08:53:23.475071+0000","last_peered":"2024-09-22T08:53:23.475071+0000","last_clean":"2024-09-22T08:53:23.475071+0000","last_became_active":"2024-09-22T08:15:04.947739+0000","last_became_peered":"2024-09-22T08:15:04.947739+0000","last_unstale":"2024-09-22T08:53:23.475071+0000","last_undegraded":"2024-09-22T08:53:23.475071+0000","last_fullsized":"2024-09-22T08:53:23.475071+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:22:45.887704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1400013,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":448,"num_read_kb":50575,"num_write":899,"num_write_kb":23711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:12.271102+0000","last_change":"2024-09-22T08:15:08.974959+0000","last_active":"2024-09-22T08:52:12.271102+0000","last_peered":"2024-09-22T08:52:12.271102+0000","last_clean":"2024-09-22T08:52:12.271102+0000","last_became_active":"2024-09-22T08:15:08.974693+0000","last_became_peered":"2024-09-22T08:15:08.974693+0000","last_unstale":"2024-09-22T08:52:12.271102+0000","last_undegraded":"2024-09-22T08:52:12.271102+0000","last_fullsized":"2024-09-22T08:52:12.271102+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:41:04.052651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"263'193","reported_seq":819,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.503445+0000","last_change":"2024-09-22T08:15:10.984896+0000","last_active":"2024-09-22T08:56:16.503445+0000","last_peered":"2024-09-22T08:56:16.503445+0000","last_clean":"2024-09-22T08:56:16.503445+0000","last_became_active":"2024-09-22T08:15:10.984402+0000","last_became_peered":"2024-09-22T08:15:10.984402+0000","last_unstale":"2024-09-22T08:56:16.503445+0000","last_undegraded":"2024-09-22T08:56:16.503445+0000","last_fullsized":"2024-09-22T08:56:16.503445+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:10:18.043549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13027,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":258,"num_read_kb":332,"num_write":120,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:02.269532+0000","last_change":"2024-09-22T08:15:13.014853+0000","last_active":"2024-09-22T08:52:02.269532+0000","last_peered":"2024-09-22T08:52:02.269532+0000","last_clean":"2024-09-22T08:52:02.269532+0000","last_became_active":"2024-09-22T08:15:13.014612+0000","last_became_peered":"2024-09-22T08:15:13.014612+0000","last_unstale":"2024-09-22T08:52:02.269532+0000","last_undegraded":"2024-09-22T08:52:02.269532+0000","last_fullsized":"2024-09-22T08:52:02.269532+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:42:53.637961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"263'140","reported_seq":652,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:40.818796+0000","last_change":"2024-09-22T08:15:15.011646+0000","last_active":"2024-09-22T08:54:40.818796+0000","last_peered":"2024-09-22T08:54:40.818796+0000","last_clean":"2024-09-22T08:54:40.818796+0000","last_became_active":"2024-09-22T08:15:15.011332+0000","last_became_peered":"2024-09-22T08:15:15.011332+0000","last_unstale":"2024-09-22T08:54:40.818796+0000","last_undegraded":"2024-09-22T08:54:40.818796+0000","last_fullsized":"2024-09-22T08:54:40.818796+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:19:09.424500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":195,"num_read_kb":186,"num_write":318,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"263'475","reported_seq":2049,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.961820+0000","last_change":"2024-09-22T08:15:06.966989+0000","last_active":"2024-09-22T08:54:27.961820+0000","last_peered":"2024-09-22T08:54:27.961820+0000","last_clean":"2024-09-22T08:54:27.961820+0000","last_became_active":"2024-09-22T08:15:06.966708+0000","last_became_peered":"2024-09-22T08:15:06.966708+0000","last_unstale":"2024-09-22T08:54:27.961820+0000","last_undegraded":"2024-09-22T08:54:27.961820+0000","last_fullsized":"2024-09-22T08:54:27.961820+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:55:12.487019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2455,"num_read_kb":2308,"num_write":546,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"263'247","reported_seq":879,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.306459+0000","last_change":"2024-09-22T08:15:04.949510+0000","last_active":"2024-09-22T08:56:16.306459+0000","last_peered":"2024-09-22T08:56:16.306459+0000","last_clean":"2024-09-22T08:56:16.306459+0000","last_became_active":"2024-09-22T08:15:04.949202+0000","last_became_peered":"2024-09-22T08:15:04.949202+0000","last_unstale":"2024-09-22T08:56:16.306459+0000","last_undegraded":"2024-09-22T08:56:16.306459+0000","last_fullsized":"2024-09-22T08:56:16.306459+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:52:02.522606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1386384,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":583,"num_read_kb":11398,"num_write":1166,"num_write_kb":28598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:27.291253+0000","last_change":"2024-09-22T08:15:08.978620+0000","last_active":"2024-09-22T08:53:27.291253+0000","last_peered":"2024-09-22T08:53:27.291253+0000","last_clean":"2024-09-22T08:53:27.291253+0000","last_became_active":"2024-09-22T08:15:08.978280+0000","last_became_peered":"2024-09-22T08:15:08.978280+0000","last_unstale":"2024-09-22T08:53:27.291253+0000","last_undegraded":"2024-09-22T08:53:27.291253+0000","last_fullsized":"2024-09-22T08:53:27.291253+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:04:18.494310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"263'165","reported_seq":732,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:43.408357+0000","last_change":"2024-09-22T08:15:10.986865+0000","last_active":"2024-09-22T08:55:43.408357+0000","last_peered":"2024-09-22T08:55:43.408357+0000","last_clean":"2024-09-22T08:55:43.408357+0000","last_became_active":"2024-09-22T08:15:10.986433+0000","last_became_peered":"2024-09-22T08:15:10.986433+0000","last_unstale":"2024-09-22T08:55:43.408357+0000","last_undegraded":"2024-09-22T08:55:43.408357+0000","last_fullsized":"2024-09-22T08:55:43.408357+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:30:33.526965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15502,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":219,"num_read_kb":274,"num_write":182,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:37.292935+0000","last_change":"2024-09-22T08:15:12.999342+0000","last_active":"2024-09-22T08:53:37.292935+0000","last_peered":"2024-09-22T08:53:37.292935+0000","last_clean":"2024-09-22T08:53:37.292935+0000","last_became_active":"2024-09-22T08:15:12.999036+0000","last_became_peered":"2024-09-22T08:15:12.999036+0000","last_unstale":"2024-09-22T08:53:37.292935+0000","last_undegraded":"2024-09-22T08:53:37.292935+0000","last_fullsized":"2024-09-22T08:53:37.292935+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:32:19.162385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"263'97","reported_seq":586,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:22.299581+0000","last_change":"2024-09-22T08:15:15.012235+0000","last_active":"2024-09-22T08:55:22.299581+0000","last_peered":"2024-09-22T08:55:22.299581+0000","last_clean":"2024-09-22T08:55:22.299581+0000","last_became_active":"2024-09-22T08:15:15.011949+0000","last_became_peered":"2024-09-22T08:15:15.011949+0000","last_unstale":"2024-09-22T08:55:22.299581+0000","last_undegraded":"2024-09-22T08:55:22.299581+0000","last_fullsized":"2024-09-22T08:55:22.299581+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:28.798518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":93,"num_read_kb":93,"num_write":223,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"263'824","reported_seq":2604,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.479954+0000","last_change":"2024-09-22T08:15:06.967305+0000","last_active":"2024-09-22T08:54:41.479954+0000","last_peered":"2024-09-22T08:54:41.479954+0000","last_clean":"2024-09-22T08:54:41.479954+0000","last_became_active":"2024-09-22T08:15:06.966795+0000","last_became_peered":"2024-09-22T08:15:06.966795+0000","last_unstale":"2024-09-22T08:54:41.479954+0000","last_undegraded":"2024-09-22T08:54:41.479954+0000","last_fullsized":"2024-09-22T08:54:41.479954+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:21:48.140336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4273,"num_read_kb":3896,"num_write":1079,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"263'208","reported_seq":830,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:03.381777+0000","last_change":"2024-09-22T08:15:04.954764+0000","last_active":"2024-09-22T08:52:03.381777+0000","last_peered":"2024-09-22T08:52:03.381777+0000","last_clean":"2024-09-22T08:52:03.381777+0000","last_became_active":"2024-09-22T08:15:04.954492+0000","last_became_peered":"2024-09-22T08:15:04.954492+0000","last_unstale":"2024-09-22T08:52:03.381777+0000","last_undegraded":"2024-09-22T08:52:03.381777+0000","last_fullsized":"2024-09-22T08:52:03.381777+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:20:34.096792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8020669,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":467,"num_read_kb":44807,"num_write":937,"num_write_kb":39223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:27.282275+0000","last_change":"2024-09-22T08:15:08.977376+0000","last_active":"2024-09-22T08:53:27.282275+0000","last_peered":"2024-09-22T08:53:27.282275+0000","last_clean":"2024-09-22T08:53:27.282275+0000","last_became_active":"2024-09-22T08:15:08.976990+0000","last_became_peered":"2024-09-22T08:15:08.976990+0000","last_unstale":"2024-09-22T08:53:27.282275+0000","last_undegraded":"2024-09-22T08:53:27.282275+0000","last_fullsized":"2024-09-22T08:53:27.282275+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:28.364951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"263'149","reported_seq":732,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.458993+0000","last_change":"2024-09-22T08:15:10.979752+0000","last_active":"2024-09-22T08:56:16.458993+0000","last_peered":"2024-09-22T08:56:16.458993+0000","last_clean":"2024-09-22T08:56:16.458993+0000","last_became_active":"2024-09-22T08:15:10.979449+0000","last_became_peered":"2024-09-22T08:15:10.979449+0000","last_unstale":"2024-09-22T08:56:16.458993+0000","last_undegraded":"2024-09-22T08:56:16.458993+0000","last_fullsized":"2024-09-22T08:56:16.458993+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:04.362070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6421,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":192,"num_read_kb":205,"num_write":100,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"263'771","reported_seq":4251,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.231331+0000","last_change":"2024-09-22T08:15:13.015830+0000","last_active":"2024-09-22T08:56:16.231331+0000","last_peered":"2024-09-22T08:56:16.231331+0000","last_clean":"2024-09-22T08:56:16.231331+0000","last_became_active":"2024-09-22T08:15:13.015504+0000","last_became_peered":"2024-09-22T08:15:13.015504+0000","last_unstale":"2024-09-22T08:56:16.231331+0000","last_undegraded":"2024-09-22T08:56:16.231331+0000","last_fullsized":"2024-09-22T08:56:16.231331+0000","mapping_epoch":31,"log_start":"263'701","ondisk_log_start":"263'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":701,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:41:04.669012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"263'132","reported_seq":628,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:18.162485+0000","last_change":"2024-09-22T08:15:15.018247+0000","last_active":"2024-09-22T08:54:18.162485+0000","last_peered":"2024-09-22T08:54:18.162485+0000","last_clean":"2024-09-22T08:54:18.162485+0000","last_became_active":"2024-09-22T08:15:15.017584+0000","last_became_peered":"2024-09-22T08:15:15.017584+0000","last_unstale":"2024-09-22T08:54:18.162485+0000","last_undegraded":"2024-09-22T08:54:18.162485+0000","last_fullsized":"2024-09-22T08:54:18.162485+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:04:30.454178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":193,"num_read_kb":181,"num_write":318,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"263'745","reported_seq":2321,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:26.719305+0000","last_change":"2024-09-22T08:15:06.974286+0000","last_active":"2024-09-22T08:54:26.719305+0000","last_peered":"2024-09-22T08:54:26.719305+0000","last_clean":"2024-09-22T08:54:26.719305+0000","last_became_active":"2024-09-22T08:15:06.973918+0000","last_became_peered":"2024-09-22T08:15:06.973918+0000","last_unstale":"2024-09-22T08:54:26.719305+0000","last_undegraded":"2024-09-22T08:54:26.719305+0000","last_fullsized":"2024-09-22T08:54:26.719305+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":700,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:53:08.286370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3813,"num_read_kb":3478,"num_write":973,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"263'223","reported_seq":879,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:25.874116+0000","last_change":"2024-09-22T08:15:04.958607+0000","last_active":"2024-09-22T08:54:25.874116+0000","last_peered":"2024-09-22T08:54:25.874116+0000","last_clean":"2024-09-22T08:54:25.874116+0000","last_became_active":"2024-09-22T08:15:04.958336+0000","last_became_peered":"2024-09-22T08:15:04.958336+0000","last_unstale":"2024-09-22T08:54:25.874116+0000","last_undegraded":"2024-09-22T08:54:25.874116+0000","last_fullsized":"2024-09-22T08:54:25.874116+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:31:07.605629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1058332,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":650,"num_read_kb":3596,"num_write":1073,"num_write_kb":27039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1443,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.891754+0000","last_change":"2024-09-22T08:15:08.982924+0000","last_active":"2024-09-22T08:56:02.891754+0000","last_peered":"2024-09-22T08:56:02.891754+0000","last_clean":"2024-09-22T08:56:02.891754+0000","last_became_active":"2024-09-22T08:15:08.982221+0000","last_became_peered":"2024-09-22T08:15:08.982221+0000","last_unstale":"2024-09-22T08:56:02.891754+0000","last_undegraded":"2024-09-22T08:56:02.891754+0000","last_fullsized":"2024-09-22T08:56:02.891754+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:06:24.534601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":946,"num_read_kb":946,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"263'73","reported_seq":585,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:42.302697+0000","last_change":"2024-09-22T08:15:10.987583+0000","last_active":"2024-09-22T08:55:42.302697+0000","last_peered":"2024-09-22T08:55:42.302697+0000","last_clean":"2024-09-22T08:55:42.302697+0000","last_became_active":"2024-09-22T08:15:10.987273+0000","last_became_peered":"2024-09-22T08:15:10.987273+0000","last_unstale":"2024-09-22T08:55:42.302697+0000","last_undegraded":"2024-09-22T08:55:42.302697+0000","last_fullsized":"2024-09-22T08:55:42.302697+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:52:00.308800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"263'788","reported_seq":2309,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:03.380604+0000","last_change":"2024-09-22T08:15:13.010979+0000","last_active":"2024-09-22T08:56:03.380604+0000","last_peered":"2024-09-22T08:56:03.380604+0000","last_clean":"2024-09-22T08:56:03.380604+0000","last_became_active":"2024-09-22T08:15:13.010641+0000","last_became_peered":"2024-09-22T08:15:13.010641+0000","last_unstale":"2024-09-22T08:56:03.380604+0000","last_undegraded":"2024-09-22T08:56:03.380604+0000","last_fullsized":"2024-09-22T08:56:03.380604+0000","mapping_epoch":31,"log_start":"263'701","ondisk_log_start":"263'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":701,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:31:51.024056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"263'125","reported_seq":620,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:14.425045+0000","last_change":"2024-09-22T08:15:15.015212+0000","last_active":"2024-09-22T08:54:14.425045+0000","last_peered":"2024-09-22T08:54:14.425045+0000","last_clean":"2024-09-22T08:54:14.425045+0000","last_became_active":"2024-09-22T08:15:15.014775+0000","last_became_peered":"2024-09-22T08:15:15.014775+0000","last_unstale":"2024-09-22T08:54:14.425045+0000","last_undegraded":"2024-09-22T08:54:14.425045+0000","last_fullsized":"2024-09-22T08:54:14.425045+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:24:57.427955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":160,"num_write":304,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"263'414","reported_seq":1970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:22.693834+0000","last_change":"2024-09-22T08:15:06.957525+0000","last_active":"2024-09-22T08:54:22.693834+0000","last_peered":"2024-09-22T08:54:22.693834+0000","last_clean":"2024-09-22T08:54:22.693834+0000","last_became_active":"2024-09-22T08:15:06.957239+0000","last_became_peered":"2024-09-22T08:15:06.957239+0000","last_unstale":"2024-09-22T08:54:22.693834+0000","last_undegraded":"2024-09-22T08:54:22.693834+0000","last_fullsized":"2024-09-22T08:54:22.693834+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:14:48.411753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2251,"num_read_kb":2145,"num_write":475,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"263'270","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.464029+0000","last_change":"2024-09-22T08:15:04.944257+0000","last_active":"2024-09-22T08:56:16.464029+0000","last_peered":"2024-09-22T08:56:16.464029+0000","last_clean":"2024-09-22T08:56:16.464029+0000","last_became_active":"2024-09-22T08:15:04.943906+0000","last_became_peered":"2024-09-22T08:15:04.943906+0000","last_unstale":"2024-09-22T08:56:16.464029+0000","last_undegraded":"2024-09-22T08:56:16.464029+0000","last_fullsized":"2024-09-22T08:56:16.464029+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:58:25.000568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079942,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":793,"num_read_kb":68557,"num_write":1190,"num_write_kb":29712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:23.392212+0000","last_change":"2024-09-22T08:15:08.969465+0000","last_active":"2024-09-22T08:53:23.392212+0000","last_peered":"2024-09-22T08:53:23.392212+0000","last_clean":"2024-09-22T08:53:23.392212+0000","last_became_active":"2024-09-22T08:15:08.969175+0000","last_became_peered":"2024-09-22T08:15:08.969175+0000","last_unstale":"2024-09-22T08:53:23.392212+0000","last_undegraded":"2024-09-22T08:53:23.392212+0000","last_fullsized":"2024-09-22T08:53:23.392212+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:02:12.589731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"263'190","reported_seq":788,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:43.408305+0000","last_change":"2024-09-22T08:15:10.987387+0000","last_active":"2024-09-22T08:55:43.408305+0000","last_peered":"2024-09-22T08:55:43.408305+0000","last_clean":"2024-09-22T08:55:43.408305+0000","last_became_active":"2024-09-22T08:15:10.987081+0000","last_became_peered":"2024-09-22T08:15:10.987081+0000","last_unstale":"2024-09-22T08:55:43.408305+0000","last_undegraded":"2024-09-22T08:55:43.408305+0000","last_fullsized":"2024-09-22T08:55:43.408305+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:27:15.431867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6008,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":242,"num_read_kb":270,"num_write":134,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:31.269342+0000","last_change":"2024-09-22T08:15:13.008391+0000","last_active":"2024-09-22T08:53:31.269342+0000","last_peered":"2024-09-22T08:53:31.269342+0000","last_clean":"2024-09-22T08:53:31.269342+0000","last_became_active":"2024-09-22T08:15:13.007735+0000","last_became_peered":"2024-09-22T08:15:13.007735+0000","last_unstale":"2024-09-22T08:53:31.269342+0000","last_undegraded":"2024-09-22T08:53:31.269342+0000","last_fullsized":"2024-09-22T08:53:31.269342+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:36:22.012503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"263'149","reported_seq":642,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:52.302863+0000","last_change":"2024-09-22T08:15:15.013532+0000","last_active":"2024-09-22T08:54:52.302863+0000","last_peered":"2024-09-22T08:54:52.302863+0000","last_clean":"2024-09-22T08:54:52.302863+0000","last_became_active":"2024-09-22T08:15:15.013216+0000","last_became_peered":"2024-09-22T08:15:15.013216+0000","last_unstale":"2024-09-22T08:54:52.302863+0000","last_undegraded":"2024-09-22T08:54:52.302863+0000","last_fullsized":"2024-09-22T08:54:52.302863+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:46:24.084971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1066,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":167,"num_read_kb":166,"num_write":339,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"263'392","reported_seq":1961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.030717+0000","last_change":"2024-09-22T08:15:06.966999+0000","last_active":"2024-09-22T08:56:02.030717+0000","last_peered":"2024-09-22T08:56:02.030717+0000","last_clean":"2024-09-22T08:56:02.030717+0000","last_became_active":"2024-09-22T08:15:06.966710+0000","last_became_peered":"2024-09-22T08:15:06.966710+0000","last_unstale":"2024-09-22T08:56:02.030717+0000","last_undegraded":"2024-09-22T08:56:02.030717+0000","last_fullsized":"2024-09-22T08:56:02.030717+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:19.004364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2363,"num_read_kb":2266,"num_write":458,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":611,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:53.387983+0000","last_change":"2024-09-22T08:14:48.585279+0000","last_active":"2024-09-22T08:52:53.387983+0000","last_peered":"2024-09-22T08:52:53.387983+0000","last_clean":"2024-09-22T08:52:53.387983+0000","last_became_active":"2024-09-22T08:14:48.584210+0000","last_became_peered":"2024-09-22T08:14:48.584210+0000","last_unstale":"2024-09-22T08:52:53.387983+0000","last_undegraded":"2024-09-22T08:52:53.387983+0000","last_fullsized":"2024-09-22T08:52:53.387983+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:47.452169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:47.452169+0000","last_clean_scrub_stamp":"2024-09-22T08:14:47.452169+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:40:54.190577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:28.385374+0000","last_change":"2024-09-22T08:14:56.729851+0000","last_active":"2024-09-22T08:52:28.385374+0000","last_peered":"2024-09-22T08:52:28.385374+0000","last_clean":"2024-09-22T08:52:28.385374+0000","last_became_active":"2024-09-22T08:14:54.727501+0000","last_became_peered":"2024-09-22T08:14:54.727501+0000","last_unstale":"2024-09-22T08:52:28.385374+0000","last_undegraded":"2024-09-22T08:52:28.385374+0000","last_fullsized":"2024-09-22T08:52:28.385374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:23:47.178939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001065632,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"263'179","reported_seq":841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:42.415042+0000","last_change":"2024-09-22T08:15:04.963864+0000","last_active":"2024-09-22T08:54:42.415042+0000","last_peered":"2024-09-22T08:54:42.415042+0000","last_clean":"2024-09-22T08:54:42.415042+0000","last_became_active":"2024-09-22T08:15:04.963447+0000","last_became_peered":"2024-09-22T08:15:04.963447+0000","last_unstale":"2024-09-22T08:54:42.415042+0000","last_undegraded":"2024-09-22T08:54:42.415042+0000","last_fullsized":"2024-09-22T08:54:42.415042+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:24:35.067492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":624,"num_read_kb":9185,"num_write":876,"num_write_kb":23340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:38.469151+0000","last_change":"2024-09-22T08:15:08.979105+0000","last_active":"2024-09-22T08:52:38.469151+0000","last_peered":"2024-09-22T08:52:38.469151+0000","last_clean":"2024-09-22T08:52:38.469151+0000","last_became_active":"2024-09-22T08:15:08.978755+0000","last_became_peered":"2024-09-22T08:15:08.978755+0000","last_unstale":"2024-09-22T08:52:38.469151+0000","last_undegraded":"2024-09-22T08:52:38.469151+0000","last_fullsized":"2024-09-22T08:52:38.469151+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:35:55.269048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"263'267","reported_seq":954,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:03.350649+0000","last_change":"2024-09-22T08:15:10.991397+0000","last_active":"2024-09-22T08:56:03.350649+0000","last_peered":"2024-09-22T08:56:03.350649+0000","last_clean":"2024-09-22T08:56:03.350649+0000","last_became_active":"2024-09-22T08:15:10.991050+0000","last_became_peered":"2024-09-22T08:15:10.991050+0000","last_unstale":"2024-09-22T08:56:03.350649+0000","last_undegraded":"2024-09-22T08:56:03.350649+0000","last_fullsized":"2024-09-22T08:56:03.350649+0000","mapping_epoch":29,"log_start":"260'200","ondisk_log_start":"260'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:20:04.247945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36893,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":504,"num_read_kb":686,"num_write":418,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:02.269685+0000","last_change":"2024-09-22T08:15:13.018888+0000","last_active":"2024-09-22T08:52:02.269685+0000","last_peered":"2024-09-22T08:52:02.269685+0000","last_clean":"2024-09-22T08:52:02.269685+0000","last_became_active":"2024-09-22T08:15:13.018627+0000","last_became_peered":"2024-09-22T08:15:13.018627+0000","last_unstale":"2024-09-22T08:52:02.269685+0000","last_undegraded":"2024-09-22T08:52:02.269685+0000","last_fullsized":"2024-09-22T08:52:02.269685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:34:15.340844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"263'226","reported_seq":951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:40.424193+0000","last_change":"2024-09-22T08:15:15.017846+0000","last_active":"2024-09-22T08:54:40.424193+0000","last_peered":"2024-09-22T08:54:40.424193+0000","last_clean":"2024-09-22T08:54:40.424193+0000","last_became_active":"2024-09-22T08:15:15.017533+0000","last_became_peered":"2024-09-22T08:15:15.017533+0000","last_unstale":"2024-09-22T08:54:40.424193+0000","last_undegraded":"2024-09-22T08:54:40.424193+0000","last_fullsized":"2024-09-22T08:54:40.424193+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:27:07.313303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":616,"num_read_kb":580,"num_write":434,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"263'394","reported_seq":1957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:40.939121+0000","last_change":"2024-09-22T08:15:06.967150+0000","last_active":"2024-09-22T08:54:40.939121+0000","last_peered":"2024-09-22T08:54:40.939121+0000","last_clean":"2024-09-22T08:54:40.939121+0000","last_became_active":"2024-09-22T08:15:06.966792+0000","last_became_peered":"2024-09-22T08:15:06.966792+0000","last_unstale":"2024-09-22T08:54:40.939121+0000","last_undegraded":"2024-09-22T08:54:40.939121+0000","last_fullsized":"2024-09-22T08:54:40.939121+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:48:17.209756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2208,"num_read_kb":2116,"num_write":452,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:03.389601+0000","last_change":"2024-09-22T08:14:56.729334+0000","last_active":"2024-09-22T08:53:03.389601+0000","last_peered":"2024-09-22T08:53:03.389601+0000","last_clean":"2024-09-22T08:53:03.389601+0000","last_became_active":"2024-09-22T08:14:54.726875+0000","last_became_peered":"2024-09-22T08:14:54.726875+0000","last_unstale":"2024-09-22T08:53:03.389601+0000","last_undegraded":"2024-09-22T08:53:03.389601+0000","last_fullsized":"2024-09-22T08:53:03.389601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:39:49.545065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000558433,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"263'180","reported_seq":785,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.389663+0000","last_change":"2024-09-22T08:15:04.964320+0000","last_active":"2024-09-22T08:56:16.389663+0000","last_peered":"2024-09-22T08:56:16.389663+0000","last_clean":"2024-09-22T08:56:16.389663+0000","last_became_active":"2024-09-22T08:15:04.963967+0000","last_became_peered":"2024-09-22T08:15:04.963967+0000","last_unstale":"2024-09-22T08:56:16.389663+0000","last_undegraded":"2024-09-22T08:56:16.389663+0000","last_fullsized":"2024-09-22T08:56:16.389663+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:27:24.495059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":424,"num_read_kb":76135,"num_write":811,"num_write_kb":37187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:58.381193+0000","last_change":"2024-09-22T08:15:08.969618+0000","last_active":"2024-09-22T08:51:58.381193+0000","last_peered":"2024-09-22T08:51:58.381193+0000","last_clean":"2024-09-22T08:51:58.381193+0000","last_became_active":"2024-09-22T08:15:08.969276+0000","last_became_peered":"2024-09-22T08:15:08.969276+0000","last_unstale":"2024-09-22T08:51:58.381193+0000","last_undegraded":"2024-09-22T08:51:58.381193+0000","last_fullsized":"2024-09-22T08:51:58.381193+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:45:38.728128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"263'861","reported_seq":2292,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.492952+0000","last_change":"2024-09-22T08:15:10.984491+0000","last_active":"2024-09-22T08:56:16.492952+0000","last_peered":"2024-09-22T08:56:16.492952+0000","last_clean":"2024-09-22T08:56:16.492952+0000","last_became_active":"2024-09-22T08:15:10.984157+0000","last_became_peered":"2024-09-22T08:15:10.984157+0000","last_unstale":"2024-09-22T08:56:16.492952+0000","last_undegraded":"2024-09-22T08:56:16.492952+0000","last_fullsized":"2024-09-22T08:56:16.492952+0000","mapping_epoch":29,"log_start":"263'800","ondisk_log_start":"263'800","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":800,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:22:53.295285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49716,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1169,"num_read_kb":1404,"num_write":276,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:48.387989+0000","last_change":"2024-09-22T08:15:13.012134+0000","last_active":"2024-09-22T08:52:48.387989+0000","last_peered":"2024-09-22T08:52:48.387989+0000","last_clean":"2024-09-22T08:52:48.387989+0000","last_became_active":"2024-09-22T08:15:13.011864+0000","last_became_peered":"2024-09-22T08:15:13.011864+0000","last_unstale":"2024-09-22T08:52:48.387989+0000","last_undegraded":"2024-09-22T08:52:48.387989+0000","last_fullsized":"2024-09-22T08:52:48.387989+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:25:33.123487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"263'214","reported_seq":740,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:21.016218+0000","last_change":"2024-09-22T08:15:15.014316+0000","last_active":"2024-09-22T08:54:21.016218+0000","last_peered":"2024-09-22T08:54:21.016218+0000","last_clean":"2024-09-22T08:54:21.016218+0000","last_became_active":"2024-09-22T08:15:15.014003+0000","last_became_peered":"2024-09-22T08:15:15.014003+0000","last_unstale":"2024-09-22T08:54:21.016218+0000","last_undegraded":"2024-09-22T08:54:21.016218+0000","last_fullsized":"2024-09-22T08:54:21.016218+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:43:13.045667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":401,"num_read_kb":391,"num_write":491,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"263'696","reported_seq":2529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.362007+0000","last_change":"2024-09-22T08:15:06.973031+0000","last_active":"2024-09-22T08:54:27.362007+0000","last_peered":"2024-09-22T08:54:27.362007+0000","last_clean":"2024-09-22T08:54:27.362007+0000","last_became_active":"2024-09-22T08:15:06.972591+0000","last_became_peered":"2024-09-22T08:15:06.972591+0000","last_unstale":"2024-09-22T08:54:27.362007+0000","last_undegraded":"2024-09-22T08:54:27.362007+0000","last_fullsized":"2024-09-22T08:54:27.362007+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":600,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:47.241992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3779,"num_read_kb":3472,"num_write":954,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:27.282937+0000","last_change":"2024-09-22T08:14:56.717627+0000","last_active":"2024-09-22T08:52:27.282937+0000","last_peered":"2024-09-22T08:52:27.282937+0000","last_clean":"2024-09-22T08:52:27.282937+0000","last_became_active":"2024-09-22T08:14:54.718660+0000","last_became_peered":"2024-09-22T08:14:54.718660+0000","last_unstale":"2024-09-22T08:52:27.282937+0000","last_undegraded":"2024-09-22T08:52:27.282937+0000","last_fullsized":"2024-09-22T08:52:27.282937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:04:54.693455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042448600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"263'260","reported_seq":945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.513802+0000","last_change":"2024-09-22T08:15:04.956486+0000","last_active":"2024-09-22T08:56:16.513802+0000","last_peered":"2024-09-22T08:56:16.513802+0000","last_clean":"2024-09-22T08:56:16.513802+0000","last_became_active":"2024-09-22T08:15:04.954726+0000","last_became_peered":"2024-09-22T08:15:04.954726+0000","last_unstale":"2024-09-22T08:56:16.513802+0000","last_undegraded":"2024-09-22T08:56:16.513802+0000","last_fullsized":"2024-09-22T08:56:16.513802+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:50:58.850263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":813,"num_read_kb":7176,"num_write":1020,"num_write_kb":41627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:02.279468+0000","last_change":"2024-09-22T08:15:08.974770+0000","last_active":"2024-09-22T08:52:02.279468+0000","last_peered":"2024-09-22T08:52:02.279468+0000","last_clean":"2024-09-22T08:52:02.279468+0000","last_became_active":"2024-09-22T08:15:08.974419+0000","last_became_peered":"2024-09-22T08:15:08.974419+0000","last_unstale":"2024-09-22T08:52:02.279468+0000","last_undegraded":"2024-09-22T08:52:02.279468+0000","last_fullsized":"2024-09-22T08:52:02.279468+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:25:16.095099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"263'233","reported_seq":1269,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:03.082254+0000","last_change":"2024-09-22T08:15:10.987757+0000","last_active":"2024-09-22T08:56:03.082254+0000","last_peered":"2024-09-22T08:56:03.082254+0000","last_clean":"2024-09-22T08:56:03.082254+0000","last_became_active":"2024-09-22T08:15:10.987358+0000","last_became_peered":"2024-09-22T08:15:10.987358+0000","last_unstale":"2024-09-22T08:56:03.082254+0000","last_undegraded":"2024-09-22T08:56:03.082254+0000","last_fullsized":"2024-09-22T08:56:03.082254+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:37:21.645192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":174,"num_read_kb":166,"num_write":139,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:42.398346+0000","last_change":"2024-09-22T08:15:13.010215+0000","last_active":"2024-09-22T08:52:42.398346+0000","last_peered":"2024-09-22T08:52:42.398346+0000","last_clean":"2024-09-22T08:52:42.398346+0000","last_became_active":"2024-09-22T08:15:13.009891+0000","last_became_peered":"2024-09-22T08:15:13.009891+0000","last_unstale":"2024-09-22T08:52:42.398346+0000","last_undegraded":"2024-09-22T08:52:42.398346+0000","last_fullsized":"2024-09-22T08:52:42.398346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:10:10.890953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"263'244","reported_seq":839,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.629431+0000","last_change":"2024-09-22T08:15:15.018070+0000","last_active":"2024-09-22T08:54:41.629431+0000","last_peered":"2024-09-22T08:54:41.629431+0000","last_clean":"2024-09-22T08:54:41.629431+0000","last_became_active":"2024-09-22T08:15:15.017686+0000","last_became_peered":"2024-09-22T08:15:15.017686+0000","last_unstale":"2024-09-22T08:54:41.629431+0000","last_undegraded":"2024-09-22T08:54:41.629431+0000","last_fullsized":"2024-09-22T08:54:41.629431+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:59:24.235010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":504,"num_read_kb":528,"num_write":541,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"263'456","reported_seq":1982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.479919+0000","last_change":"2024-09-22T08:15:06.963038+0000","last_active":"2024-09-22T08:54:41.479919+0000","last_peered":"2024-09-22T08:54:41.479919+0000","last_clean":"2024-09-22T08:54:41.479919+0000","last_became_active":"2024-09-22T08:15:06.962486+0000","last_became_peered":"2024-09-22T08:15:06.962486+0000","last_unstale":"2024-09-22T08:54:41.479919+0000","last_undegraded":"2024-09-22T08:54:41.479919+0000","last_fullsized":"2024-09-22T08:54:41.479919+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:46:27.014096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2436,"num_read_kb":2281,"num_write":554,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:28.385348+0000","last_change":"2024-09-22T08:14:56.729819+0000","last_active":"2024-09-22T08:52:28.385348+0000","last_peered":"2024-09-22T08:52:28.385348+0000","last_clean":"2024-09-22T08:52:28.385348+0000","last_became_active":"2024-09-22T08:14:55.586088+0000","last_became_peered":"2024-09-22T08:14:55.586088+0000","last_unstale":"2024-09-22T08:52:28.385348+0000","last_undegraded":"2024-09-22T08:52:28.385348+0000","last_fullsized":"2024-09-22T08:52:28.385348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:11:26.177736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010233219999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"263'159","reported_seq":747,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:20.955181+0000","last_change":"2024-09-22T08:15:04.964256+0000","last_active":"2024-09-22T08:54:20.955181+0000","last_peered":"2024-09-22T08:54:20.955181+0000","last_clean":"2024-09-22T08:54:20.955181+0000","last_became_active":"2024-09-22T08:15:04.963894+0000","last_became_peered":"2024-09-22T08:15:04.963894+0000","last_unstale":"2024-09-22T08:54:20.955181+0000","last_undegraded":"2024-09-22T08:54:20.955181+0000","last_fullsized":"2024-09-22T08:54:20.955181+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:03:26.990192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1397368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":408,"num_read_kb":11085,"num_write":744,"num_write_kb":14868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:52.286614+0000","last_change":"2024-09-22T08:15:08.968415+0000","last_active":"2024-09-22T08:52:52.286614+0000","last_peered":"2024-09-22T08:52:52.286614+0000","last_clean":"2024-09-22T08:52:52.286614+0000","last_became_active":"2024-09-22T08:15:08.968076+0000","last_became_peered":"2024-09-22T08:15:08.968076+0000","last_unstale":"2024-09-22T08:52:52.286614+0000","last_undegraded":"2024-09-22T08:52:52.286614+0000","last_fullsized":"2024-09-22T08:52:52.286614+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:46:34.843923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"263'111","reported_seq":650,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.699221+0000","last_change":"2024-09-22T08:15:10.992735+0000","last_active":"2024-09-22T08:55:19.699221+0000","last_peered":"2024-09-22T08:55:19.699221+0000","last_clean":"2024-09-22T08:55:19.699221+0000","last_became_active":"2024-09-22T08:15:10.992450+0000","last_became_peered":"2024-09-22T08:15:10.992450+0000","last_unstale":"2024-09-22T08:55:19.699221+0000","last_undegraded":"2024-09-22T08:55:19.699221+0000","last_fullsized":"2024-09-22T08:55:19.699221+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:04:43.027150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":139,"num_read_kb":133,"num_write":98,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:03.381868+0000","last_change":"2024-09-22T08:15:13.012190+0000","last_active":"2024-09-22T08:52:03.381868+0000","last_peered":"2024-09-22T08:52:03.381868+0000","last_clean":"2024-09-22T08:52:03.381868+0000","last_became_active":"2024-09-22T08:15:13.011756+0000","last_became_peered":"2024-09-22T08:15:13.011756+0000","last_unstale":"2024-09-22T08:52:03.381868+0000","last_undegraded":"2024-09-22T08:52:03.381868+0000","last_fullsized":"2024-09-22T08:52:03.381868+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:22:28.670776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"263'109","reported_seq":659,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:23.867017+0000","last_change":"2024-09-22T08:15:15.017200+0000","last_active":"2024-09-22T08:54:23.867017+0000","last_peered":"2024-09-22T08:54:23.867017+0000","last_clean":"2024-09-22T08:54:23.867017+0000","last_became_active":"2024-09-22T08:15:15.016910+0000","last_became_peered":"2024-09-22T08:15:15.016910+0000","last_unstale":"2024-09-22T08:54:23.867017+0000","last_undegraded":"2024-09-22T08:54:23.867017+0000","last_fullsized":"2024-09-22T08:54:23.867017+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:32:32.592078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":271,"num_read_kb":261,"num_write":275,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"263'846","reported_seq":2453,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:24.609357+0000","last_change":"2024-09-22T08:15:06.965563+0000","last_active":"2024-09-22T08:54:24.609357+0000","last_peered":"2024-09-22T08:54:24.609357+0000","last_clean":"2024-09-22T08:54:24.609357+0000","last_became_active":"2024-09-22T08:15:06.965021+0000","last_became_peered":"2024-09-22T08:15:06.965021+0000","last_unstale":"2024-09-22T08:54:24.609357+0000","last_undegraded":"2024-09-22T08:54:24.609357+0000","last_fullsized":"2024-09-22T08:54:24.609357+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":800,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:23:54.792970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4016,"num_read_kb":3619,"num_write":1120,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"263'170","reported_seq":776,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:08.199270+0000","last_change":"2024-09-22T08:15:04.960052+0000","last_active":"2024-09-22T08:54:08.199270+0000","last_peered":"2024-09-22T08:54:08.199270+0000","last_clean":"2024-09-22T08:54:08.199270+0000","last_became_active":"2024-09-22T08:15:04.958834+0000","last_became_peered":"2024-09-22T08:15:04.958834+0000","last_unstale":"2024-09-22T08:54:08.199270+0000","last_undegraded":"2024-09-22T08:54:08.199270+0000","last_fullsized":"2024-09-22T08:54:08.199270+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:26:47.552408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1229077,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":463,"num_read_kb":15054,"num_write":834,"num_write_kb":27215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:27.273473+0000","last_change":"2024-09-22T08:14:56.801946+0000","last_active":"2024-09-22T08:52:27.273473+0000","last_peered":"2024-09-22T08:52:27.273473+0000","last_clean":"2024-09-22T08:52:27.273473+0000","last_became_active":"2024-09-22T08:14:55.585738+0000","last_became_peered":"2024-09-22T08:14:55.585738+0000","last_unstale":"2024-09-22T08:52:27.273473+0000","last_undegraded":"2024-09-22T08:52:27.273473+0000","last_fullsized":"2024-09-22T08:52:27.273473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:33:45.401549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053802500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:42.398327+0000","last_change":"2024-09-22T08:15:08.975546+0000","last_active":"2024-09-22T08:52:42.398327+0000","last_peered":"2024-09-22T08:52:42.398327+0000","last_clean":"2024-09-22T08:52:42.398327+0000","last_became_active":"2024-09-22T08:15:08.975175+0000","last_became_peered":"2024-09-22T08:15:08.975175+0000","last_unstale":"2024-09-22T08:52:42.398327+0000","last_undegraded":"2024-09-22T08:52:42.398327+0000","last_fullsized":"2024-09-22T08:52:42.398327+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:08:07.721638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"263'293","reported_seq":956,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.453257+0000","last_change":"2024-09-22T08:15:10.982518+0000","last_active":"2024-09-22T08:56:16.453257+0000","last_peered":"2024-09-22T08:56:16.453257+0000","last_clean":"2024-09-22T08:56:16.453257+0000","last_became_active":"2024-09-22T08:15:10.982147+0000","last_became_peered":"2024-09-22T08:15:10.982147+0000","last_unstale":"2024-09-22T08:56:16.453257+0000","last_undegraded":"2024-09-22T08:56:16.453257+0000","last_fullsized":"2024-09-22T08:56:16.453257+0000","mapping_epoch":29,"log_start":"260'200","ondisk_log_start":"260'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:56:53.506784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30730,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1060,"num_read_kb":1272,"num_write":1552,"num_write_kb":1410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:46.263665+0000","last_change":"2024-09-22T08:15:13.014254+0000","last_active":"2024-09-22T08:52:46.263665+0000","last_peered":"2024-09-22T08:52:46.263665+0000","last_clean":"2024-09-22T08:52:46.263665+0000","last_became_active":"2024-09-22T08:15:13.013980+0000","last_became_peered":"2024-09-22T08:15:13.013980+0000","last_unstale":"2024-09-22T08:52:46.263665+0000","last_undegraded":"2024-09-22T08:52:46.263665+0000","last_fullsized":"2024-09-22T08:52:46.263665+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:43:47.566603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"263'169","reported_seq":721,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.923448+0000","last_change":"2024-09-22T08:15:15.012481+0000","last_active":"2024-09-22T08:54:38.923448+0000","last_peered":"2024-09-22T08:54:38.923448+0000","last_clean":"2024-09-22T08:54:38.923448+0000","last_became_active":"2024-09-22T08:15:15.012146+0000","last_became_peered":"2024-09-22T08:15:15.012146+0000","last_unstale":"2024-09-22T08:54:38.923448+0000","last_undegraded":"2024-09-22T08:54:38.923448+0000","last_fullsized":"2024-09-22T08:54:38.923448+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:12:50.086341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":420,"num_read_kb":363,"num_write":419,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"263'442","reported_seq":2036,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.480349+0000","last_change":"2024-09-22T08:15:06.973875+0000","last_active":"2024-09-22T08:54:41.480349+0000","last_peered":"2024-09-22T08:54:41.480349+0000","last_clean":"2024-09-22T08:54:41.480349+0000","last_became_active":"2024-09-22T08:15:06.973563+0000","last_became_peered":"2024-09-22T08:15:06.973563+0000","last_unstale":"2024-09-22T08:54:41.480349+0000","last_undegraded":"2024-09-22T08:54:41.480349+0000","last_fullsized":"2024-09-22T08:54:41.480349+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:06:45.622252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2370,"num_read_kb":2248,"num_write":498,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"263'189","reported_seq":810,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.434906+0000","last_change":"2024-09-22T08:15:04.956915+0000","last_active":"2024-09-22T08:56:16.434906+0000","last_peered":"2024-09-22T08:56:16.434906+0000","last_clean":"2024-09-22T08:56:16.434906+0000","last_became_active":"2024-09-22T08:15:04.956585+0000","last_became_peered":"2024-09-22T08:15:04.956585+0000","last_unstale":"2024-09-22T08:56:16.434906+0000","last_undegraded":"2024-09-22T08:56:16.434906+0000","last_fullsized":"2024-09-22T08:56:16.434906+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:18.062351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":533,"num_read_kb":28072,"num_write":815,"num_write_kb":27925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:33.386112+0000","last_change":"2024-09-22T08:14:56.729377+0000","last_active":"2024-09-22T08:52:33.386112+0000","last_peered":"2024-09-22T08:52:33.386112+0000","last_clean":"2024-09-22T08:52:33.386112+0000","last_became_active":"2024-09-22T08:14:54.727321+0000","last_became_peered":"2024-09-22T08:14:54.727321+0000","last_unstale":"2024-09-22T08:52:33.386112+0000","last_undegraded":"2024-09-22T08:52:33.386112+0000","last_fullsized":"2024-09-22T08:52:33.386112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:21:23.198586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058148900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:38.469084+0000","last_change":"2024-09-22T08:15:08.975127+0000","last_active":"2024-09-22T08:52:38.469084+0000","last_peered":"2024-09-22T08:52:38.469084+0000","last_clean":"2024-09-22T08:52:38.469084+0000","last_became_active":"2024-09-22T08:15:08.974823+0000","last_became_peered":"2024-09-22T08:15:08.974823+0000","last_unstale":"2024-09-22T08:52:38.469084+0000","last_undegraded":"2024-09-22T08:52:38.469084+0000","last_fullsized":"2024-09-22T08:52:38.469084+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:35:56.356491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"263'158","reported_seq":713,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.767668+0000","last_change":"2024-09-22T08:15:10.991721+0000","last_active":"2024-09-22T08:55:19.767668+0000","last_peered":"2024-09-22T08:55:19.767668+0000","last_clean":"2024-09-22T08:55:19.767668+0000","last_became_active":"2024-09-22T08:15:10.991426+0000","last_became_peered":"2024-09-22T08:15:10.991426+0000","last_unstale":"2024-09-22T08:55:19.767668+0000","last_undegraded":"2024-09-22T08:55:19.767668+0000","last_fullsized":"2024-09-22T08:55:19.767668+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:13:29.594926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":204,"num_read_kb":193,"num_write":140,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"263'787","reported_seq":4933,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:03.377377+0000","last_change":"2024-09-22T08:15:13.014146+0000","last_active":"2024-09-22T08:56:03.377377+0000","last_peered":"2024-09-22T08:56:03.377377+0000","last_clean":"2024-09-22T08:56:03.377377+0000","last_became_active":"2024-09-22T08:15:13.013828+0000","last_became_peered":"2024-09-22T08:15:13.013828+0000","last_unstale":"2024-09-22T08:56:03.377377+0000","last_undegraded":"2024-09-22T08:56:03.377377+0000","last_fullsized":"2024-09-22T08:56:03.377377+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:14:34.454135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"263'140","reported_seq":640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:57.311692+0000","last_change":"2024-09-22T08:15:15.014270+0000","last_active":"2024-09-22T08:55:57.311692+0000","last_peered":"2024-09-22T08:55:57.311692+0000","last_clean":"2024-09-22T08:55:57.311692+0000","last_became_active":"2024-09-22T08:15:15.013976+0000","last_became_peered":"2024-09-22T08:15:15.013976+0000","last_unstale":"2024-09-22T08:55:57.311692+0000","last_undegraded":"2024-09-22T08:55:57.311692+0000","last_fullsized":"2024-09-22T08:55:57.311692+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:36:15.356232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":177,"num_read_kb":172,"num_write":337,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"263'452","reported_seq":1950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.926375+0000","last_change":"2024-09-22T08:15:06.966706+0000","last_active":"2024-09-22T08:54:38.926375+0000","last_peered":"2024-09-22T08:54:38.926375+0000","last_clean":"2024-09-22T08:54:38.926375+0000","last_became_active":"2024-09-22T08:15:06.966387+0000","last_became_peered":"2024-09-22T08:15:06.966387+0000","last_unstale":"2024-09-22T08:54:38.926375+0000","last_undegraded":"2024-09-22T08:54:38.926375+0000","last_fullsized":"2024-09-22T08:54:38.926375+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:16:14.149148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2402,"num_read_kb":2235,"num_write":539,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"263'205","reported_seq":835,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.558391+0000","last_change":"2024-09-22T08:15:04.952329+0000","last_active":"2024-09-22T08:56:16.558391+0000","last_peered":"2024-09-22T08:56:16.558391+0000","last_clean":"2024-09-22T08:56:16.558391+0000","last_became_active":"2024-09-22T08:15:04.951731+0000","last_became_peered":"2024-09-22T08:15:04.951731+0000","last_unstale":"2024-09-22T08:56:16.558391+0000","last_undegraded":"2024-09-22T08:56:16.558391+0000","last_fullsized":"2024-09-22T08:56:16.558391+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:44:40.856747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079922,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":440,"num_read_kb":57796,"num_write":879,"num_write_kb":62478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:57.408520+0000","last_change":"2024-09-22T08:14:56.713315+0000","last_active":"2024-09-22T08:53:57.408520+0000","last_peered":"2024-09-22T08:53:57.408520+0000","last_clean":"2024-09-22T08:53:57.408520+0000","last_became_active":"2024-09-22T08:14:55.585607+0000","last_became_peered":"2024-09-22T08:14:55.585607+0000","last_unstale":"2024-09-22T08:53:57.408520+0000","last_undegraded":"2024-09-22T08:53:57.408520+0000","last_fullsized":"2024-09-22T08:53:57.408520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:00:51.872643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049298099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:38.386674+0000","last_change":"2024-09-22T08:15:08.969703+0000","last_active":"2024-09-22T08:52:38.386674+0000","last_peered":"2024-09-22T08:52:38.386674+0000","last_clean":"2024-09-22T08:52:38.386674+0000","last_became_active":"2024-09-22T08:15:08.969373+0000","last_became_peered":"2024-09-22T08:15:08.969373+0000","last_unstale":"2024-09-22T08:52:38.386674+0000","last_undegraded":"2024-09-22T08:52:38.386674+0000","last_fullsized":"2024-09-22T08:52:38.386674+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:47:22.188961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"263'106","reported_seq":641,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.751986+0000","last_change":"2024-09-22T08:15:10.986552+0000","last_active":"2024-09-22T08:55:19.751986+0000","last_peered":"2024-09-22T08:55:19.751986+0000","last_clean":"2024-09-22T08:55:19.751986+0000","last_became_active":"2024-09-22T08:15:10.984232+0000","last_became_peered":"2024-09-22T08:15:10.984232+0000","last_unstale":"2024-09-22T08:55:19.751986+0000","last_undegraded":"2024-09-22T08:55:19.751986+0000","last_fullsized":"2024-09-22T08:55:19.751986+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:21.636103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":116,"num_write":82,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"263'792","reported_seq":2214,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.233603+0000","last_change":"2024-09-22T08:15:13.008717+0000","last_active":"2024-09-22T08:56:16.233603+0000","last_peered":"2024-09-22T08:56:16.233603+0000","last_clean":"2024-09-22T08:56:16.233603+0000","last_became_active":"2024-09-22T08:15:13.008027+0000","last_became_peered":"2024-09-22T08:15:13.008027+0000","last_unstale":"2024-09-22T08:56:16.233603+0000","last_undegraded":"2024-09-22T08:56:16.233603+0000","last_fullsized":"2024-09-22T08:56:16.233603+0000","mapping_epoch":31,"log_start":"263'701","ondisk_log_start":"263'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":701,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:47:23.567624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"263'198","reported_seq":712,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:51.192463+0000","last_change":"2024-09-22T08:15:15.014730+0000","last_active":"2024-09-22T08:53:51.192463+0000","last_peered":"2024-09-22T08:53:51.192463+0000","last_clean":"2024-09-22T08:53:51.192463+0000","last_became_active":"2024-09-22T08:15:15.014423+0000","last_became_peered":"2024-09-22T08:15:15.014423+0000","last_unstale":"2024-09-22T08:53:51.192463+0000","last_undegraded":"2024-09-22T08:53:51.192463+0000","last_fullsized":"2024-09-22T08:53:51.192463+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:25:32.708147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":250,"num_read_kb":232,"num_write":460,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"263'497","reported_seq":2058,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.360747+0000","last_change":"2024-09-22T08:15:06.968425+0000","last_active":"2024-09-22T08:54:27.360747+0000","last_peered":"2024-09-22T08:54:27.360747+0000","last_clean":"2024-09-22T08:54:27.360747+0000","last_became_active":"2024-09-22T08:15:06.968153+0000","last_became_peered":"2024-09-22T08:15:06.968153+0000","last_unstale":"2024-09-22T08:54:27.360747+0000","last_undegraded":"2024-09-22T08:54:27.360747+0000","last_fullsized":"2024-09-22T08:54:27.360747+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:29:50.157707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2565,"num_read_kb":2386,"num_write":597,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"263'198","reported_seq":816,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.531962+0000","last_change":"2024-09-22T08:15:04.944258+0000","last_active":"2024-09-22T08:56:16.531962+0000","last_peered":"2024-09-22T08:56:16.531962+0000","last_clean":"2024-09-22T08:56:16.531962+0000","last_became_active":"2024-09-22T08:15:04.943901+0000","last_became_peered":"2024-09-22T08:15:04.943901+0000","last_unstale":"2024-09-22T08:56:16.531962+0000","last_undegraded":"2024-09-22T08:56:16.531962+0000","last_fullsized":"2024-09-22T08:56:16.531962+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:56:16.418792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":512,"num_read_kb":4964,"num_write":959,"num_write_kb":21539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:58.396569+0000","last_change":"2024-09-22T08:14:56.730085+0000","last_active":"2024-09-22T08:53:58.396569+0000","last_peered":"2024-09-22T08:53:58.396569+0000","last_clean":"2024-09-22T08:53:58.396569+0000","last_became_active":"2024-09-22T08:14:55.585485+0000","last_became_peered":"2024-09-22T08:14:55.585485+0000","last_unstale":"2024-09-22T08:53:58.396569+0000","last_undegraded":"2024-09-22T08:53:58.396569+0000","last_fullsized":"2024-09-22T08:53:58.396569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:42:52.718426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012642249999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:17.402768+0000","last_change":"2024-09-22T08:15:08.979746+0000","last_active":"2024-09-22T08:53:17.402768+0000","last_peered":"2024-09-22T08:53:17.402768+0000","last_clean":"2024-09-22T08:53:17.402768+0000","last_became_active":"2024-09-22T08:15:08.979291+0000","last_became_peered":"2024-09-22T08:15:08.979291+0000","last_unstale":"2024-09-22T08:53:17.402768+0000","last_undegraded":"2024-09-22T08:53:17.402768+0000","last_fullsized":"2024-09-22T08:53:17.402768+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:35:42.491182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"263'309","reported_seq":1008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:03.336761+0000","last_change":"2024-09-22T08:15:10.979541+0000","last_active":"2024-09-22T08:56:03.336761+0000","last_peered":"2024-09-22T08:56:03.336761+0000","last_clean":"2024-09-22T08:56:03.336761+0000","last_became_active":"2024-09-22T08:15:10.979261+0000","last_became_peered":"2024-09-22T08:15:10.979261+0000","last_unstale":"2024-09-22T08:56:03.336761+0000","last_undegraded":"2024-09-22T08:56:03.336761+0000","last_fullsized":"2024-09-22T08:56:03.336761+0000","mapping_epoch":29,"log_start":"260'200","ondisk_log_start":"260'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:29:00.655646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40554,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":435,"num_read_kb":615,"num_write":222,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:42.398292+0000","last_change":"2024-09-22T08:15:13.003662+0000","last_active":"2024-09-22T08:52:42.398292+0000","last_peered":"2024-09-22T08:52:42.398292+0000","last_clean":"2024-09-22T08:52:42.398292+0000","last_became_active":"2024-09-22T08:15:13.003041+0000","last_became_peered":"2024-09-22T08:15:13.003041+0000","last_unstale":"2024-09-22T08:52:42.398292+0000","last_undegraded":"2024-09-22T08:52:42.398292+0000","last_fullsized":"2024-09-22T08:52:42.398292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:43:46.552092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"263'126","reported_seq":624,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:09.125091+0000","last_change":"2024-09-22T08:15:15.015370+0000","last_active":"2024-09-22T08:54:09.125091+0000","last_peered":"2024-09-22T08:54:09.125091+0000","last_clean":"2024-09-22T08:54:09.125091+0000","last_became_active":"2024-09-22T08:15:15.014775+0000","last_became_peered":"2024-09-22T08:15:15.014775+0000","last_unstale":"2024-09-22T08:54:09.125091+0000","last_undegraded":"2024-09-22T08:54:09.125091+0000","last_fullsized":"2024-09-22T08:54:09.125091+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:42:57.977942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":162,"num_read_kb":158,"num_write":286,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"263'108","reported_seq":658,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.586531+0000","last_change":"2024-09-22T08:15:15.020963+0000","last_active":"2024-09-22T08:54:41.586531+0000","last_peered":"2024-09-22T08:54:41.586531+0000","last_clean":"2024-09-22T08:54:41.586531+0000","last_became_active":"2024-09-22T08:15:15.020653+0000","last_became_peered":"2024-09-22T08:15:15.020653+0000","last_unstale":"2024-09-22T08:54:41.586531+0000","last_undegraded":"2024-09-22T08:54:41.586531+0000","last_fullsized":"2024-09-22T08:54:41.586531+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:30:42.055327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":202,"num_read_kb":202,"num_write":258,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"263'487","reported_seq":2210,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.031042+0000","last_change":"2024-09-22T08:15:06.970797+0000","last_active":"2024-09-22T08:56:02.031042+0000","last_peered":"2024-09-22T08:56:02.031042+0000","last_clean":"2024-09-22T08:56:02.031042+0000","last_became_active":"2024-09-22T08:15:06.970382+0000","last_became_peered":"2024-09-22T08:15:06.970382+0000","last_unstale":"2024-09-22T08:56:02.031042+0000","last_undegraded":"2024-09-22T08:56:02.031042+0000","last_fullsized":"2024-09-22T08:56:02.031042+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:20:33.767995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2792,"num_read_kb":2647,"num_write":560,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"263'220","reported_seq":867,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:50.871750+0000","last_change":"2024-09-22T08:15:04.966483+0000","last_active":"2024-09-22T08:53:50.871750+0000","last_peered":"2024-09-22T08:53:50.871750+0000","last_clean":"2024-09-22T08:53:50.871750+0000","last_became_active":"2024-09-22T08:15:04.965572+0000","last_became_peered":"2024-09-22T08:15:04.965572+0000","last_unstale":"2024-09-22T08:53:50.871750+0000","last_undegraded":"2024-09-22T08:53:50.871750+0000","last_fullsized":"2024-09-22T08:53:50.871750+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:27:30.805751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8745608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":593,"num_read_kb":42984,"num_write":1008,"num_write_kb":35756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:32.274252+0000","last_change":"2024-09-22T08:15:08.976752+0000","last_active":"2024-09-22T08:52:32.274252+0000","last_peered":"2024-09-22T08:52:32.274252+0000","last_clean":"2024-09-22T08:52:32.274252+0000","last_became_active":"2024-09-22T08:15:08.976444+0000","last_became_peered":"2024-09-22T08:15:08.976444+0000","last_unstale":"2024-09-22T08:52:32.274252+0000","last_undegraded":"2024-09-22T08:52:32.274252+0000","last_fullsized":"2024-09-22T08:52:32.274252+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:57:35.914622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"263'133","reported_seq":699,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.383600+0000","last_change":"2024-09-22T08:15:10.987944+0000","last_active":"2024-09-22T08:56:16.383600+0000","last_peered":"2024-09-22T08:56:16.383600+0000","last_clean":"2024-09-22T08:56:16.383600+0000","last_became_active":"2024-09-22T08:15:10.987623+0000","last_became_peered":"2024-09-22T08:15:10.987623+0000","last_unstale":"2024-09-22T08:56:16.383600+0000","last_undegraded":"2024-09-22T08:56:16.383600+0000","last_fullsized":"2024-09-22T08:56:16.383600+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:57:31.114053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8761,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":170,"num_read_kb":207,"num_write":88,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:32.283704+0000","last_change":"2024-09-22T08:15:12.997719+0000","last_active":"2024-09-22T08:52:32.283704+0000","last_peered":"2024-09-22T08:52:32.283704+0000","last_clean":"2024-09-22T08:52:32.283704+0000","last_became_active":"2024-09-22T08:15:12.997350+0000","last_became_peered":"2024-09-22T08:15:12.997350+0000","last_unstale":"2024-09-22T08:52:32.283704+0000","last_undegraded":"2024-09-22T08:52:32.283704+0000","last_fullsized":"2024-09-22T08:52:32.283704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:08:30.511917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"263'110","reported_seq":606,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.956370+0000","last_change":"2024-09-22T08:15:15.017170+0000","last_active":"2024-09-22T08:54:27.956370+0000","last_peered":"2024-09-22T08:54:27.956370+0000","last_clean":"2024-09-22T08:54:27.956370+0000","last_became_active":"2024-09-22T08:15:15.016918+0000","last_became_peered":"2024-09-22T08:15:15.016918+0000","last_unstale":"2024-09-22T08:54:27.956370+0000","last_undegraded":"2024-09-22T08:54:27.956370+0000","last_fullsized":"2024-09-22T08:54:27.956370+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:37:28.672486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":125,"num_write":254,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"263'1037","reported_seq":2820,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:23.395142+0000","last_change":"2024-09-22T08:15:06.965797+0000","last_active":"2024-09-22T08:54:23.395142+0000","last_peered":"2024-09-22T08:54:23.395142+0000","last_clean":"2024-09-22T08:54:23.395142+0000","last_became_active":"2024-09-22T08:15:06.965465+0000","last_became_peered":"2024-09-22T08:15:06.965465+0000","last_unstale":"2024-09-22T08:54:23.395142+0000","last_undegraded":"2024-09-22T08:54:23.395142+0000","last_fullsized":"2024-09-22T08:54:23.395142+0000","mapping_epoch":25,"log_start":"263'1000","ondisk_log_start":"263'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":1000,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:50:52.178644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5105,"num_read_kb":4580,"num_write":1460,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"263'203","reported_seq":821,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:48.478344+0000","last_change":"2024-09-22T08:15:04.949496+0000","last_active":"2024-09-22T08:53:48.478344+0000","last_peered":"2024-09-22T08:53:48.478344+0000","last_clean":"2024-09-22T08:53:48.478344+0000","last_became_active":"2024-09-22T08:15:04.949181+0000","last_became_peered":"2024-09-22T08:15:04.949181+0000","last_unstale":"2024-09-22T08:53:48.478344+0000","last_undegraded":"2024-09-22T08:53:48.478344+0000","last_fullsized":"2024-09-22T08:53:48.478344+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:45:42.806686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10517089,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":534,"num_read_kb":11766,"num_write":953,"num_write_kb":45959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:32.396743+0000","last_change":"2024-09-22T08:15:08.976023+0000","last_active":"2024-09-22T08:52:32.396743+0000","last_peered":"2024-09-22T08:52:32.396743+0000","last_clean":"2024-09-22T08:52:32.396743+0000","last_became_active":"2024-09-22T08:15:08.975704+0000","last_became_peered":"2024-09-22T08:15:08.975704+0000","last_unstale":"2024-09-22T08:52:32.396743+0000","last_undegraded":"2024-09-22T08:52:32.396743+0000","last_fullsized":"2024-09-22T08:52:32.396743+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:17:14.568660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"263'38","reported_seq":538,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.550720+0000","last_change":"2024-09-22T08:15:10.983890+0000","last_active":"2024-09-22T08:55:19.550720+0000","last_peered":"2024-09-22T08:55:19.550720+0000","last_clean":"2024-09-22T08:55:19.550720+0000","last_became_active":"2024-09-22T08:15:10.983593+0000","last_became_peered":"2024-09-22T08:15:10.983593+0000","last_unstale":"2024-09-22T08:55:19.550720+0000","last_undegraded":"2024-09-22T08:55:19.550720+0000","last_fullsized":"2024-09-22T08:55:19.550720+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:52:12.816398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:36.262497+0000","last_change":"2024-09-22T08:15:13.019365+0000","last_active":"2024-09-22T08:52:36.262497+0000","last_peered":"2024-09-22T08:52:36.262497+0000","last_clean":"2024-09-22T08:52:36.262497+0000","last_became_active":"2024-09-22T08:15:13.019020+0000","last_became_peered":"2024-09-22T08:15:13.019020+0000","last_unstale":"2024-09-22T08:52:36.262497+0000","last_undegraded":"2024-09-22T08:52:36.262497+0000","last_fullsized":"2024-09-22T08:52:36.262497+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:35:35.235215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"263'182","reported_seq":702,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:40.942611+0000","last_change":"2024-09-22T08:15:15.013674+0000","last_active":"2024-09-22T08:54:40.942611+0000","last_peered":"2024-09-22T08:54:40.942611+0000","last_clean":"2024-09-22T08:54:40.942611+0000","last_became_active":"2024-09-22T08:15:15.013300+0000","last_became_peered":"2024-09-22T08:15:15.013300+0000","last_unstale":"2024-09-22T08:54:40.942611+0000","last_undegraded":"2024-09-22T08:54:40.942611+0000","last_fullsized":"2024-09-22T08:54:40.942611+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:24:00.672977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":337,"num_read_kb":325,"num_write":401,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"263'1197","reported_seq":2836,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.361022+0000","last_change":"2024-09-22T08:15:06.957428+0000","last_active":"2024-09-22T08:54:27.361022+0000","last_peered":"2024-09-22T08:54:27.361022+0000","last_clean":"2024-09-22T08:54:27.361022+0000","last_became_active":"2024-09-22T08:15:06.957116+0000","last_became_peered":"2024-09-22T08:15:06.957116+0000","last_unstale":"2024-09-22T08:54:27.361022+0000","last_undegraded":"2024-09-22T08:54:27.361022+0000","last_fullsized":"2024-09-22T08:54:27.361022+0000","mapping_epoch":25,"log_start":"263'1100","ondisk_log_start":"263'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":1100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:50:47.227003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5635,"num_read_kb":5002,"num_write":1685,"num_write_kb":733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"263'188","reported_seq":802,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:26.655338+0000","last_change":"2024-09-22T08:15:04.969475+0000","last_active":"2024-09-22T08:54:26.655338+0000","last_peered":"2024-09-22T08:54:26.655338+0000","last_clean":"2024-09-22T08:54:26.655338+0000","last_became_active":"2024-09-22T08:15:04.968557+0000","last_became_peered":"2024-09-22T08:15:04.968557+0000","last_unstale":"2024-09-22T08:54:26.655338+0000","last_undegraded":"2024-09-22T08:54:26.655338+0000","last_fullsized":"2024-09-22T08:54:26.655338+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:09:13.268818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3177072,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":518,"num_read_kb":8164,"num_write":862,"num_write_kb":39531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:31.261934+0000","last_change":"2024-09-22T08:15:08.975282+0000","last_active":"2024-09-22T08:52:31.261934+0000","last_peered":"2024-09-22T08:52:31.261934+0000","last_clean":"2024-09-22T08:52:31.261934+0000","last_became_active":"2024-09-22T08:15:08.975001+0000","last_became_peered":"2024-09-22T08:15:08.975001+0000","last_unstale":"2024-09-22T08:52:31.261934+0000","last_undegraded":"2024-09-22T08:52:31.261934+0000","last_fullsized":"2024-09-22T08:52:31.261934+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:33.382158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"263'169","reported_seq":759,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.286569+0000","last_change":"2024-09-22T08:15:10.980804+0000","last_active":"2024-09-22T08:56:16.286569+0000","last_peered":"2024-09-22T08:56:16.286569+0000","last_clean":"2024-09-22T08:56:16.286569+0000","last_became_active":"2024-09-22T08:15:10.980443+0000","last_became_peered":"2024-09-22T08:15:10.980443+0000","last_unstale":"2024-09-22T08:56:16.286569+0000","last_undegraded":"2024-09-22T08:56:16.286569+0000","last_fullsized":"2024-09-22T08:56:16.286569+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:05:27.025223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":222,"num_read_kb":300,"num_write":124,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:33.385632+0000","last_change":"2024-09-22T08:15:13.010967+0000","last_active":"2024-09-22T08:52:33.385632+0000","last_peered":"2024-09-22T08:52:33.385632+0000","last_clean":"2024-09-22T08:52:33.385632+0000","last_became_active":"2024-09-22T08:15:13.010660+0000","last_became_peered":"2024-09-22T08:15:13.010660+0000","last_unstale":"2024-09-22T08:52:33.385632+0000","last_undegraded":"2024-09-22T08:52:33.385632+0000","last_fullsized":"2024-09-22T08:52:33.385632+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:04:33.172378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"263'141","reported_seq":674,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:23.390425+0000","last_change":"2024-09-22T08:15:15.015966+0000","last_active":"2024-09-22T08:54:23.390425+0000","last_peered":"2024-09-22T08:54:23.390425+0000","last_clean":"2024-09-22T08:54:23.390425+0000","last_became_active":"2024-09-22T08:15:15.015497+0000","last_became_peered":"2024-09-22T08:15:15.015497+0000","last_unstale":"2024-09-22T08:54:23.390425+0000","last_undegraded":"2024-09-22T08:54:23.390425+0000","last_fullsized":"2024-09-22T08:54:23.390425+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:19:47.834057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":885,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":300,"num_read_kb":272,"num_write":341,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"263'915","reported_seq":2761,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.032493+0000","last_change":"2024-09-22T08:15:06.964381+0000","last_active":"2024-09-22T08:56:02.032493+0000","last_peered":"2024-09-22T08:56:02.032493+0000","last_clean":"2024-09-22T08:56:02.032493+0000","last_became_active":"2024-09-22T08:15:06.964082+0000","last_became_peered":"2024-09-22T08:15:06.964082+0000","last_unstale":"2024-09-22T08:56:02.032493+0000","last_undegraded":"2024-09-22T08:56:02.032493+0000","last_fullsized":"2024-09-22T08:56:02.032493+0000","mapping_epoch":25,"log_start":"263'900","ondisk_log_start":"263'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":900,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:59:59.631124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4594,"num_read_kb":4173,"num_write":1193,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"263'259","reported_seq":885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.532208+0000","last_change":"2024-09-22T08:15:04.956185+0000","last_active":"2024-09-22T08:56:16.532208+0000","last_peered":"2024-09-22T08:56:16.532208+0000","last_clean":"2024-09-22T08:56:16.532208+0000","last_became_active":"2024-09-22T08:15:04.954431+0000","last_became_peered":"2024-09-22T08:15:04.954431+0000","last_unstale":"2024-09-22T08:56:16.532208+0000","last_undegraded":"2024-09-22T08:56:16.532208+0000","last_fullsized":"2024-09-22T08:56:16.532208+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:58:31.332537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":625,"num_read_kb":10749,"num_write":1043,"num_write_kb":36368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:28.385312+0000","last_change":"2024-09-22T08:15:08.978366+0000","last_active":"2024-09-22T08:52:28.385312+0000","last_peered":"2024-09-22T08:52:28.385312+0000","last_clean":"2024-09-22T08:52:28.385312+0000","last_became_active":"2024-09-22T08:15:08.978080+0000","last_became_peered":"2024-09-22T08:15:08.978080+0000","last_unstale":"2024-09-22T08:52:28.385312+0000","last_undegraded":"2024-09-22T08:52:28.385312+0000","last_fullsized":"2024-09-22T08:52:28.385312+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:58:42.395174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"263'132","reported_seq":691,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.643815+0000","last_change":"2024-09-22T08:15:10.975370+0000","last_active":"2024-09-22T08:55:19.643815+0000","last_peered":"2024-09-22T08:55:19.643815+0000","last_clean":"2024-09-22T08:55:19.643815+0000","last_became_active":"2024-09-22T08:15:10.975066+0000","last_became_peered":"2024-09-22T08:15:10.975066+0000","last_unstale":"2024-09-22T08:55:19.643815+0000","last_undegraded":"2024-09-22T08:55:19.643815+0000","last_fullsized":"2024-09-22T08:55:19.643815+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:20:29.364085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10151,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":148,"num_read_kb":198,"num_write":76,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:32.283752+0000","last_change":"2024-09-22T08:15:13.008345+0000","last_active":"2024-09-22T08:52:32.283752+0000","last_peered":"2024-09-22T08:52:32.283752+0000","last_clean":"2024-09-22T08:52:32.283752+0000","last_became_active":"2024-09-22T08:15:13.008005+0000","last_became_peered":"2024-09-22T08:15:13.008005+0000","last_unstale":"2024-09-22T08:52:32.283752+0000","last_undegraded":"2024-09-22T08:52:32.283752+0000","last_fullsized":"2024-09-22T08:52:32.283752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:44:00.256968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"263'386","reported_seq":1910,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:19.614767+0000","last_change":"2024-09-22T08:15:06.974360+0000","last_active":"2024-09-22T08:54:19.614767+0000","last_peered":"2024-09-22T08:54:19.614767+0000","last_clean":"2024-09-22T08:54:19.614767+0000","last_became_active":"2024-09-22T08:15:06.974083+0000","last_became_peered":"2024-09-22T08:15:06.974083+0000","last_unstale":"2024-09-22T08:54:19.614767+0000","last_undegraded":"2024-09-22T08:54:19.614767+0000","last_fullsized":"2024-09-22T08:54:19.614767+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:42:23.068549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2095,"num_read_kb":2009,"num_write":415,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"263'216","reported_seq":850,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.483594+0000","last_change":"2024-09-22T08:15:04.953656+0000","last_active":"2024-09-22T08:56:16.483594+0000","last_peered":"2024-09-22T08:56:16.483594+0000","last_clean":"2024-09-22T08:56:16.483594+0000","last_became_active":"2024-09-22T08:15:04.953371+0000","last_became_peered":"2024-09-22T08:15:04.953371+0000","last_unstale":"2024-09-22T08:56:16.483594+0000","last_undegraded":"2024-09-22T08:56:16.483594+0000","last_fullsized":"2024-09-22T08:56:16.483594+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:18:43.995683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079956,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":551,"num_read_kb":20845,"num_write":984,"num_write_kb":34041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:22.281487+0000","last_change":"2024-09-22T08:15:08.978352+0000","last_active":"2024-09-22T08:53:22.281487+0000","last_peered":"2024-09-22T08:53:22.281487+0000","last_clean":"2024-09-22T08:53:22.281487+0000","last_became_active":"2024-09-22T08:15:08.977975+0000","last_became_peered":"2024-09-22T08:15:08.977975+0000","last_unstale":"2024-09-22T08:53:22.281487+0000","last_undegraded":"2024-09-22T08:53:22.281487+0000","last_fullsized":"2024-09-22T08:53:22.281487+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:36:49.695370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"263'212","reported_seq":832,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.526285+0000","last_change":"2024-09-22T08:15:10.985792+0000","last_active":"2024-09-22T08:56:16.526285+0000","last_peered":"2024-09-22T08:56:16.526285+0000","last_clean":"2024-09-22T08:56:16.526285+0000","last_became_active":"2024-09-22T08:15:10.985454+0000","last_became_peered":"2024-09-22T08:15:10.985454+0000","last_unstale":"2024-09-22T08:56:16.526285+0000","last_undegraded":"2024-09-22T08:56:16.526285+0000","last_fullsized":"2024-09-22T08:56:16.526285+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:42:16.011379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24540,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":311,"num_read_kb":482,"num_write":196,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:46.263744+0000","last_change":"2024-09-22T08:15:13.008746+0000","last_active":"2024-09-22T08:52:46.263744+0000","last_peered":"2024-09-22T08:52:46.263744+0000","last_clean":"2024-09-22T08:52:46.263744+0000","last_became_active":"2024-09-22T08:15:13.008080+0000","last_became_peered":"2024-09-22T08:15:13.008080+0000","last_unstale":"2024-09-22T08:52:46.263744+0000","last_undegraded":"2024-09-22T08:52:46.263744+0000","last_fullsized":"2024-09-22T08:52:46.263744+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:40:33.932227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"263'174","reported_seq":680,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.958769+0000","last_change":"2024-09-22T08:15:15.014411+0000","last_active":"2024-09-22T08:54:27.958769+0000","last_peered":"2024-09-22T08:54:27.958769+0000","last_clean":"2024-09-22T08:54:27.958769+0000","last_became_active":"2024-09-22T08:15:15.014112+0000","last_became_peered":"2024-09-22T08:15:15.014112+0000","last_unstale":"2024-09-22T08:54:27.958769+0000","last_undegraded":"2024-09-22T08:54:27.958769+0000","last_fullsized":"2024-09-22T08:54:27.958769+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:23:12.522068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":264,"num_read_kb":269,"num_write":416,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"263'430","reported_seq":2036,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.040119+0000","last_change":"2024-09-22T08:15:06.967093+0000","last_active":"2024-09-22T08:56:02.040119+0000","last_peered":"2024-09-22T08:56:02.040119+0000","last_clean":"2024-09-22T08:56:02.040119+0000","last_became_active":"2024-09-22T08:15:06.966715+0000","last_became_peered":"2024-09-22T08:15:06.966715+0000","last_unstale":"2024-09-22T08:56:02.040119+0000","last_undegraded":"2024-09-22T08:56:02.040119+0000","last_fullsized":"2024-09-22T08:56:02.040119+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:36:05.010276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2445,"num_read_kb":2324,"num_write":493,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"263'212","reported_seq":876,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.551729+0000","last_change":"2024-09-22T08:15:04.951193+0000","last_active":"2024-09-22T08:56:16.551729+0000","last_peered":"2024-09-22T08:56:16.551729+0000","last_clean":"2024-09-22T08:56:16.551729+0000","last_became_active":"2024-09-22T08:15:04.950890+0000","last_became_peered":"2024-09-22T08:15:04.950890+0000","last_unstale":"2024-09-22T08:56:16.551729+0000","last_undegraded":"2024-09-22T08:56:16.551729+0000","last_fullsized":"2024-09-22T08:56:16.551729+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:58:21.202885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":625,"num_read_kb":94909,"num_write":959,"num_write_kb":40287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"35'4","reported_seq":973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:15.994400+0000","last_change":"2024-09-22T08:15:08.977689+0000","last_active":"2024-09-22T08:56:15.994400+0000","last_peered":"2024-09-22T08:56:15.994400+0000","last_clean":"2024-09-22T08:56:15.994400+0000","last_became_active":"2024-09-22T08:15:08.977250+0000","last_became_peered":"2024-09-22T08:15:08.977250+0000","last_unstale":"2024-09-22T08:56:15.994400+0000","last_undegraded":"2024-09-22T08:56:15.994400+0000","last_fullsized":"2024-09-22T08:56:15.994400+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:54:28.653095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":1187,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"263'165","reported_seq":742,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.701735+0000","last_change":"2024-09-22T08:15:10.988286+0000","last_active":"2024-09-22T08:55:19.701735+0000","last_peered":"2024-09-22T08:55:19.701735+0000","last_clean":"2024-09-22T08:55:19.701735+0000","last_became_active":"2024-09-22T08:15:10.987541+0000","last_became_peered":"2024-09-22T08:15:10.987541+0000","last_unstale":"2024-09-22T08:55:19.701735+0000","last_undegraded":"2024-09-22T08:55:19.701735+0000","last_fullsized":"2024-09-22T08:55:19.701735+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:03:59.129935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13640,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":208,"num_read_kb":211,"num_write":136,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:42.275936+0000","last_change":"2024-09-22T08:15:13.012164+0000","last_active":"2024-09-22T08:52:42.275936+0000","last_peered":"2024-09-22T08:52:42.275936+0000","last_clean":"2024-09-22T08:52:42.275936+0000","last_became_active":"2024-09-22T08:15:13.011781+0000","last_became_peered":"2024-09-22T08:15:13.011781+0000","last_unstale":"2024-09-22T08:52:42.275936+0000","last_undegraded":"2024-09-22T08:52:42.275936+0000","last_fullsized":"2024-09-22T08:52:42.275936+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:36:44.769092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"263'184","reported_seq":694,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:01.978766+0000","last_change":"2024-09-22T08:15:15.011928+0000","last_active":"2024-09-22T08:56:01.978766+0000","last_peered":"2024-09-22T08:56:01.978766+0000","last_clean":"2024-09-22T08:56:01.978766+0000","last_became_active":"2024-09-22T08:15:15.011648+0000","last_became_peered":"2024-09-22T08:15:15.011648+0000","last_unstale":"2024-09-22T08:56:01.978766+0000","last_undegraded":"2024-09-22T08:56:01.978766+0000","last_fullsized":"2024-09-22T08:56:01.978766+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:40:53.969713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":287,"num_read_kb":275,"num_write":539,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"263'437","reported_seq":1950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.032917+0000","last_change":"2024-09-22T08:15:06.972503+0000","last_active":"2024-09-22T08:56:02.032917+0000","last_peered":"2024-09-22T08:56:02.032917+0000","last_clean":"2024-09-22T08:56:02.032917+0000","last_became_active":"2024-09-22T08:15:06.972213+0000","last_became_peered":"2024-09-22T08:15:06.972213+0000","last_unstale":"2024-09-22T08:56:02.032917+0000","last_undegraded":"2024-09-22T08:56:02.032917+0000","last_fullsized":"2024-09-22T08:56:02.032917+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:02:45.936755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2524,"num_read_kb":2354,"num_write":541,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"263'238","reported_seq":871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:46.585051+0000","last_change":"2024-09-22T08:15:04.960034+0000","last_active":"2024-09-22T08:53:46.585051+0000","last_peered":"2024-09-22T08:53:46.585051+0000","last_clean":"2024-09-22T08:53:46.585051+0000","last_became_active":"2024-09-22T08:15:04.959607+0000","last_became_peered":"2024-09-22T08:15:04.959607+0000","last_unstale":"2024-09-22T08:53:46.585051+0000","last_undegraded":"2024-09-22T08:53:46.585051+0000","last_fullsized":"2024-09-22T08:53:46.585051+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:36:26.063552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12214957,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":559,"num_read_kb":22702,"num_write":1139,"num_write_kb":43754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:41.263102+0000","last_change":"2024-09-22T08:15:08.975205+0000","last_active":"2024-09-22T08:52:41.263102+0000","last_peered":"2024-09-22T08:52:41.263102+0000","last_clean":"2024-09-22T08:52:41.263102+0000","last_became_active":"2024-09-22T08:15:08.974925+0000","last_became_peered":"2024-09-22T08:15:08.974925+0000","last_unstale":"2024-09-22T08:52:41.263102+0000","last_undegraded":"2024-09-22T08:52:41.263102+0000","last_fullsized":"2024-09-22T08:52:41.263102+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:08:36.707707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"263'148","reported_seq":716,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.421615+0000","last_change":"2024-09-22T08:15:10.985655+0000","last_active":"2024-09-22T08:56:16.421615+0000","last_peered":"2024-09-22T08:56:16.421615+0000","last_clean":"2024-09-22T08:56:16.421615+0000","last_became_active":"2024-09-22T08:15:10.985312+0000","last_became_peered":"2024-09-22T08:15:10.985312+0000","last_unstale":"2024-09-22T08:56:16.421615+0000","last_undegraded":"2024-09-22T08:56:16.421615+0000","last_fullsized":"2024-09-22T08:56:16.421615+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:32:30.326830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9037,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":176,"num_read_kb":231,"num_write":94,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:22.290600+0000","last_change":"2024-09-22T08:15:12.998592+0000","last_active":"2024-09-22T08:53:22.290600+0000","last_peered":"2024-09-22T08:53:22.290600+0000","last_clean":"2024-09-22T08:53:22.290600+0000","last_became_active":"2024-09-22T08:15:12.998276+0000","last_became_peered":"2024-09-22T08:15:12.998276+0000","last_unstale":"2024-09-22T08:53:22.290600+0000","last_undegraded":"2024-09-22T08:53:22.290600+0000","last_fullsized":"2024-09-22T08:53:22.290600+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:45:18.409944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"263'129","reported_seq":634,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:03.364497+0000","last_change":"2024-09-22T08:15:15.022528+0000","last_active":"2024-09-22T08:56:03.364497+0000","last_peered":"2024-09-22T08:56:03.364497+0000","last_clean":"2024-09-22T08:56:03.364497+0000","last_became_active":"2024-09-22T08:15:15.022140+0000","last_became_peered":"2024-09-22T08:15:15.022140+0000","last_unstale":"2024-09-22T08:56:03.364497+0000","last_undegraded":"2024-09-22T08:56:03.364497+0000","last_fullsized":"2024-09-22T08:56:03.364497+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:19:15.143722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":810,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":211,"num_read_kb":192,"num_write":312,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"263'532","reported_seq":2401,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.961208+0000","last_change":"2024-09-22T08:15:06.963522+0000","last_active":"2024-09-22T08:54:27.961208+0000","last_peered":"2024-09-22T08:54:27.961208+0000","last_clean":"2024-09-22T08:54:27.961208+0000","last_became_active":"2024-09-22T08:15:06.963136+0000","last_became_peered":"2024-09-22T08:15:06.963136+0000","last_unstale":"2024-09-22T08:54:27.961208+0000","last_undegraded":"2024-09-22T08:54:27.961208+0000","last_fullsized":"2024-09-22T08:54:27.961208+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":500,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:27:39.654856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3196,"num_read_kb":3015,"num_write":651,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"263'227","reported_seq":849,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.484031+0000","last_change":"2024-09-22T08:15:04.962067+0000","last_active":"2024-09-22T08:56:16.484031+0000","last_peered":"2024-09-22T08:56:16.484031+0000","last_clean":"2024-09-22T08:56:16.484031+0000","last_became_active":"2024-09-22T08:15:04.961731+0000","last_became_peered":"2024-09-22T08:15:04.961731+0000","last_unstale":"2024-09-22T08:56:16.484031+0000","last_undegraded":"2024-09-22T08:56:16.484031+0000","last_fullsized":"2024-09-22T08:56:16.484031+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:15:56.579006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079902,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":556,"num_read_kb":16778,"num_write":1039,"num_write_kb":35959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:42.398363+0000","last_change":"2024-09-22T08:15:08.974366+0000","last_active":"2024-09-22T08:52:42.398363+0000","last_peered":"2024-09-22T08:52:42.398363+0000","last_clean":"2024-09-22T08:52:42.398363+0000","last_became_active":"2024-09-22T08:15:08.973985+0000","last_became_peered":"2024-09-22T08:15:08.973985+0000","last_unstale":"2024-09-22T08:52:42.398363+0000","last_undegraded":"2024-09-22T08:52:42.398363+0000","last_fullsized":"2024-09-22T08:52:42.398363+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:43:10.742833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"263'91","reported_seq":611,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.764889+0000","last_change":"2024-09-22T08:15:10.991408+0000","last_active":"2024-09-22T08:55:19.764889+0000","last_peered":"2024-09-22T08:55:19.764889+0000","last_clean":"2024-09-22T08:55:19.764889+0000","last_became_active":"2024-09-22T08:15:10.991099+0000","last_became_peered":"2024-09-22T08:15:10.991099+0000","last_unstale":"2024-09-22T08:55:19.764889+0000","last_undegraded":"2024-09-22T08:55:19.764889+0000","last_fullsized":"2024-09-22T08:55:19.764889+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:03.952941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":117,"num_read_kb":110,"num_write":130,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"263'769","reported_seq":2287,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:03.376310+0000","last_change":"2024-09-22T08:15:13.020129+0000","last_active":"2024-09-22T08:56:03.376310+0000","last_peered":"2024-09-22T08:56:03.376310+0000","last_clean":"2024-09-22T08:56:03.376310+0000","last_became_active":"2024-09-22T08:15:13.018826+0000","last_became_peered":"2024-09-22T08:15:13.018826+0000","last_unstale":"2024-09-22T08:56:03.376310+0000","last_undegraded":"2024-09-22T08:56:03.376310+0000","last_fullsized":"2024-09-22T08:56:03.376310+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:17:45.964569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"263'136","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:22.688867+0000","last_change":"2024-09-22T08:15:15.017866+0000","last_active":"2024-09-22T08:54:22.688867+0000","last_peered":"2024-09-22T08:54:22.688867+0000","last_clean":"2024-09-22T08:54:22.688867+0000","last_became_active":"2024-09-22T08:15:15.017568+0000","last_became_peered":"2024-09-22T08:15:15.017568+0000","last_unstale":"2024-09-22T08:54:22.688867+0000","last_undegraded":"2024-09-22T08:54:22.688867+0000","last_fullsized":"2024-09-22T08:54:22.688867+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:37:11.451571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":178,"num_write":322,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"263'422","reported_seq":1876,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.030317+0000","last_change":"2024-09-22T08:15:06.973437+0000","last_active":"2024-09-22T08:56:02.030317+0000","last_peered":"2024-09-22T08:56:02.030317+0000","last_clean":"2024-09-22T08:56:02.030317+0000","last_became_active":"2024-09-22T08:15:06.973142+0000","last_became_peered":"2024-09-22T08:15:06.973142+0000","last_unstale":"2024-09-22T08:56:02.030317+0000","last_undegraded":"2024-09-22T08:56:02.030317+0000","last_fullsized":"2024-09-22T08:56:02.030317+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:42:57.640096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2325,"num_read_kb":2186,"num_write":496,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"263'204","reported_seq":802,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:14.348112+0000","last_change":"2024-09-22T08:15:04.955055+0000","last_active":"2024-09-22T08:53:14.348112+0000","last_peered":"2024-09-22T08:53:14.348112+0000","last_clean":"2024-09-22T08:53:14.348112+0000","last_became_active":"2024-09-22T08:15:04.954608+0000","last_became_peered":"2024-09-22T08:15:04.954608+0000","last_unstale":"2024-09-22T08:53:14.348112+0000","last_undegraded":"2024-09-22T08:53:14.348112+0000","last_fullsized":"2024-09-22T08:53:14.348112+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:48:59.571776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":469,"num_read_kb":8602,"num_write":952,"num_write_kb":32105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:38.386310+0000","last_change":"2024-09-22T08:15:08.980771+0000","last_active":"2024-09-22T08:52:38.386310+0000","last_peered":"2024-09-22T08:52:38.386310+0000","last_clean":"2024-09-22T08:52:38.386310+0000","last_became_active":"2024-09-22T08:15:08.980570+0000","last_became_peered":"2024-09-22T08:15:08.980570+0000","last_unstale":"2024-09-22T08:52:38.386310+0000","last_undegraded":"2024-09-22T08:52:38.386310+0000","last_fullsized":"2024-09-22T08:52:38.386310+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:52:24.440386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"263'159","reported_seq":732,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.779560+0000","last_change":"2024-09-22T08:15:10.979788+0000","last_active":"2024-09-22T08:55:19.779560+0000","last_peered":"2024-09-22T08:55:19.779560+0000","last_clean":"2024-09-22T08:55:19.779560+0000","last_became_active":"2024-09-22T08:15:10.979384+0000","last_became_peered":"2024-09-22T08:15:10.979384+0000","last_unstale":"2024-09-22T08:55:19.779560+0000","last_undegraded":"2024-09-22T08:55:19.779560+0000","last_fullsized":"2024-09-22T08:55:19.779560+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:28:09.165373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14159,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":207,"num_read_kb":270,"num_write":122,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:52.407725+0000","last_change":"2024-09-22T08:15:13.013531+0000","last_active":"2024-09-22T08:53:52.407725+0000","last_peered":"2024-09-22T08:53:52.407725+0000","last_clean":"2024-09-22T08:53:52.407725+0000","last_became_active":"2024-09-22T08:15:13.013160+0000","last_became_peered":"2024-09-22T08:15:13.013160+0000","last_unstale":"2024-09-22T08:53:52.407725+0000","last_undegraded":"2024-09-22T08:53:52.407725+0000","last_fullsized":"2024-09-22T08:53:52.407725+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:55:35.021615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"263'138","reported_seq":639,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:26.975514+0000","last_change":"2024-09-22T08:15:15.021053+0000","last_active":"2024-09-22T08:54:26.975514+0000","last_peered":"2024-09-22T08:54:26.975514+0000","last_clean":"2024-09-22T08:54:26.975514+0000","last_became_active":"2024-09-22T08:15:15.020718+0000","last_became_peered":"2024-09-22T08:15:15.020718+0000","last_unstale":"2024-09-22T08:54:26.975514+0000","last_undegraded":"2024-09-22T08:54:26.975514+0000","last_fullsized":"2024-09-22T08:54:26.975514+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:03:37.066806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":211,"num_read_kb":197,"num_write":330,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"263'800","reported_seq":2276,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.926503+0000","last_change":"2024-09-22T08:15:06.970563+0000","last_active":"2024-09-22T08:54:38.926503+0000","last_peered":"2024-09-22T08:54:38.926503+0000","last_clean":"2024-09-22T08:54:38.926503+0000","last_became_active":"2024-09-22T08:15:06.970077+0000","last_became_peered":"2024-09-22T08:15:06.970077+0000","last_unstale":"2024-09-22T08:54:38.926503+0000","last_undegraded":"2024-09-22T08:54:38.926503+0000","last_fullsized":"2024-09-22T08:54:38.926503+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:50:00.177977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3751,"num_read_kb":3364,"num_write":1047,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"263'194","reported_seq":906,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:46.952442+0000","last_change":"2024-09-22T08:15:04.962527+0000","last_active":"2024-09-22T08:53:46.952442+0000","last_peered":"2024-09-22T08:53:46.952442+0000","last_clean":"2024-09-22T08:53:46.952442+0000","last_became_active":"2024-09-22T08:15:04.962268+0000","last_became_peered":"2024-09-22T08:15:04.962268+0000","last_unstale":"2024-09-22T08:53:46.952442+0000","last_undegraded":"2024-09-22T08:53:46.952442+0000","last_fullsized":"2024-09-22T08:53:46.952442+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:54:23.748527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10535612,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":777,"num_read_kb":150382,"num_write":900,"num_write_kb":51576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:41.263079+0000","last_change":"2024-09-22T08:15:08.977670+0000","last_active":"2024-09-22T08:52:41.263079+0000","last_peered":"2024-09-22T08:52:41.263079+0000","last_clean":"2024-09-22T08:52:41.263079+0000","last_became_active":"2024-09-22T08:15:08.977341+0000","last_became_peered":"2024-09-22T08:15:08.977341+0000","last_unstale":"2024-09-22T08:52:41.263079+0000","last_undegraded":"2024-09-22T08:52:41.263079+0000","last_fullsized":"2024-09-22T08:52:41.263079+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:18:39.684334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"263'127","reported_seq":692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.479118+0000","last_change":"2024-09-22T08:15:10.981034+0000","last_active":"2024-09-22T08:56:16.479118+0000","last_peered":"2024-09-22T08:56:16.479118+0000","last_clean":"2024-09-22T08:56:16.479118+0000","last_became_active":"2024-09-22T08:15:10.980015+0000","last_became_peered":"2024-09-22T08:15:10.980015+0000","last_unstale":"2024-09-22T08:56:16.479118+0000","last_undegraded":"2024-09-22T08:56:16.479118+0000","last_fullsized":"2024-09-22T08:56:16.479118+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:10:49.816903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20804,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":281,"num_write":88,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:33.376948+0000","last_change":"2024-09-22T08:15:13.012480+0000","last_active":"2024-09-22T08:51:33.376948+0000","last_peered":"2024-09-22T08:51:33.376948+0000","last_clean":"2024-09-22T08:51:33.376948+0000","last_became_active":"2024-09-22T08:15:13.011134+0000","last_became_peered":"2024-09-22T08:15:13.011134+0000","last_unstale":"2024-09-22T08:51:33.376948+0000","last_undegraded":"2024-09-22T08:51:33.376948+0000","last_fullsized":"2024-09-22T08:51:33.376948+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:29:04.991665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"263'150","reported_seq":670,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.360615+0000","last_change":"2024-09-22T08:15:15.013212+0000","last_active":"2024-09-22T08:54:41.360615+0000","last_peered":"2024-09-22T08:54:41.360615+0000","last_clean":"2024-09-22T08:54:41.360615+0000","last_became_active":"2024-09-22T08:15:15.012939+0000","last_became_peered":"2024-09-22T08:15:15.012939+0000","last_unstale":"2024-09-22T08:54:41.360615+0000","last_undegraded":"2024-09-22T08:54:41.360615+0000","last_fullsized":"2024-09-22T08:54:41.360615+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:08:40.354379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":256,"num_read_kb":247,"num_write":364,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"263'562","reported_seq":2355,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.472866+0000","last_change":"2024-09-22T08:15:06.960886+0000","last_active":"2024-09-22T08:54:41.472866+0000","last_peered":"2024-09-22T08:54:41.472866+0000","last_clean":"2024-09-22T08:54:41.472866+0000","last_became_active":"2024-09-22T08:15:06.960599+0000","last_became_peered":"2024-09-22T08:15:06.960599+0000","last_unstale":"2024-09-22T08:54:41.472866+0000","last_undegraded":"2024-09-22T08:54:41.472866+0000","last_fullsized":"2024-09-22T08:54:41.472866+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":500,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:27:19.885943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3136,"num_read_kb":2948,"num_write":673,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"263'210","reported_seq":837,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.548080+0000","last_change":"2024-09-22T08:15:04.963136+0000","last_active":"2024-09-22T08:56:16.548080+0000","last_peered":"2024-09-22T08:56:16.548080+0000","last_clean":"2024-09-22T08:56:16.548080+0000","last_became_active":"2024-09-22T08:15:04.962785+0000","last_became_peered":"2024-09-22T08:15:04.962785+0000","last_unstale":"2024-09-22T08:56:16.548080+0000","last_undegraded":"2024-09-22T08:56:16.548080+0000","last_fullsized":"2024-09-22T08:56:16.548080+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:29:11.602912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":497,"num_read_kb":22160,"num_write":848,"num_write_kb":45151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:48.394911+0000","last_change":"2024-09-22T08:15:08.979401+0000","last_active":"2024-09-22T08:53:48.394911+0000","last_peered":"2024-09-22T08:53:48.394911+0000","last_clean":"2024-09-22T08:53:48.394911+0000","last_became_active":"2024-09-22T08:15:08.978844+0000","last_became_peered":"2024-09-22T08:15:08.978844+0000","last_unstale":"2024-09-22T08:53:48.394911+0000","last_undegraded":"2024-09-22T08:53:48.394911+0000","last_fullsized":"2024-09-22T08:53:48.394911+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:07:22.042882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"263'128","reported_seq":678,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.407905+0000","last_change":"2024-09-22T08:15:10.983840+0000","last_active":"2024-09-22T08:56:16.407905+0000","last_peered":"2024-09-22T08:56:16.407905+0000","last_clean":"2024-09-22T08:56:16.407905+0000","last_became_active":"2024-09-22T08:15:10.983522+0000","last_became_peered":"2024-09-22T08:15:10.983522+0000","last_unstale":"2024-09-22T08:56:16.407905+0000","last_undegraded":"2024-09-22T08:56:16.407905+0000","last_fullsized":"2024-09-22T08:56:16.407905+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:05:15.621827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62130,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":173,"num_read_kb":427,"num_write":104,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:43.387370+0000","last_change":"2024-09-22T08:15:13.015794+0000","last_active":"2024-09-22T08:52:43.387370+0000","last_peered":"2024-09-22T08:52:43.387370+0000","last_clean":"2024-09-22T08:52:43.387370+0000","last_became_active":"2024-09-22T08:15:13.015473+0000","last_became_peered":"2024-09-22T08:15:13.015473+0000","last_unstale":"2024-09-22T08:52:43.387370+0000","last_undegraded":"2024-09-22T08:52:43.387370+0000","last_fullsized":"2024-09-22T08:52:43.387370+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:45:01.160499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"263'213","reported_seq":1671,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:39.321243+0000","last_change":"2024-09-22T08:15:15.018252+0000","last_active":"2024-09-22T08:54:39.321243+0000","last_peered":"2024-09-22T08:54:39.321243+0000","last_clean":"2024-09-22T08:54:39.321243+0000","last_became_active":"2024-09-22T08:15:15.017394+0000","last_became_peered":"2024-09-22T08:15:15.017394+0000","last_unstale":"2024-09-22T08:54:39.321243+0000","last_undegraded":"2024-09-22T08:54:39.321243+0000","last_fullsized":"2024-09-22T08:54:39.321243+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:26:17.481953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1186,"num_read_kb":1185,"num_write":465,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"263'821","reported_seq":2516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.926722+0000","last_change":"2024-09-22T08:15:06.967900+0000","last_active":"2024-09-22T08:54:38.926722+0000","last_peered":"2024-09-22T08:54:38.926722+0000","last_clean":"2024-09-22T08:54:38.926722+0000","last_became_active":"2024-09-22T08:15:06.967603+0000","last_became_peered":"2024-09-22T08:15:06.967603+0000","last_unstale":"2024-09-22T08:54:38.926722+0000","last_undegraded":"2024-09-22T08:54:38.926722+0000","last_fullsized":"2024-09-22T08:54:38.926722+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":800,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:44:20.031138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4151,"num_read_kb":3787,"num_write":1085,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"263'209","reported_seq":872,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.482922+0000","last_change":"2024-09-22T08:15:04.957997+0000","last_active":"2024-09-22T08:56:16.482922+0000","last_peered":"2024-09-22T08:56:16.482922+0000","last_clean":"2024-09-22T08:56:16.482922+0000","last_became_active":"2024-09-22T08:15:04.957654+0000","last_became_peered":"2024-09-22T08:15:04.957654+0000","last_unstale":"2024-09-22T08:56:16.482922+0000","last_undegraded":"2024-09-22T08:56:16.482922+0000","last_fullsized":"2024-09-22T08:56:16.482922+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:15:19.864352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":592,"num_read_kb":25705,"num_write":948,"num_write_kb":45275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:32.388383+0000","last_change":"2024-09-22T08:15:08.973107+0000","last_active":"2024-09-22T08:51:32.388383+0000","last_peered":"2024-09-22T08:51:32.388383+0000","last_clean":"2024-09-22T08:51:32.388383+0000","last_became_active":"2024-09-22T08:15:08.972733+0000","last_became_peered":"2024-09-22T08:15:08.972733+0000","last_unstale":"2024-09-22T08:51:32.388383+0000","last_undegraded":"2024-09-22T08:51:32.388383+0000","last_fullsized":"2024-09-22T08:51:32.388383+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:09:10.684801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"263'152","reported_seq":730,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.652107+0000","last_change":"2024-09-22T08:15:10.987881+0000","last_active":"2024-09-22T08:55:19.652107+0000","last_peered":"2024-09-22T08:55:19.652107+0000","last_clean":"2024-09-22T08:55:19.652107+0000","last_became_active":"2024-09-22T08:15:10.987610+0000","last_became_peered":"2024-09-22T08:15:10.987610+0000","last_unstale":"2024-09-22T08:55:19.652107+0000","last_undegraded":"2024-09-22T08:55:19.652107+0000","last_fullsized":"2024-09-22T08:55:19.652107+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:25:04.343680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8998,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":200,"num_read_kb":256,"num_write":114,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:42.398317+0000","last_change":"2024-09-22T08:15:13.003540+0000","last_active":"2024-09-22T08:52:42.398317+0000","last_peered":"2024-09-22T08:52:42.398317+0000","last_clean":"2024-09-22T08:52:42.398317+0000","last_became_active":"2024-09-22T08:15:13.003219+0000","last_became_peered":"2024-09-22T08:15:13.003219+0000","last_unstale":"2024-09-22T08:52:42.398317+0000","last_undegraded":"2024-09-22T08:52:42.398317+0000","last_fullsized":"2024-09-22T08:52:42.398317+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:50:35.499014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"263'159","reported_seq":639,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.030006+0000","last_change":"2024-09-22T08:15:15.018630+0000","last_active":"2024-09-22T08:56:02.030006+0000","last_peered":"2024-09-22T08:56:02.030006+0000","last_clean":"2024-09-22T08:56:02.030006+0000","last_became_active":"2024-09-22T08:15:15.018311+0000","last_became_peered":"2024-09-22T08:15:15.018311+0000","last_unstale":"2024-09-22T08:56:02.030006+0000","last_undegraded":"2024-09-22T08:56:02.030006+0000","last_fullsized":"2024-09-22T08:56:02.030006+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:45:03.170254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":160,"num_write":367,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"263'889","reported_seq":2468,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.961170+0000","last_change":"2024-09-22T08:15:06.965116+0000","last_active":"2024-09-22T08:54:27.961170+0000","last_peered":"2024-09-22T08:54:27.961170+0000","last_clean":"2024-09-22T08:54:27.961170+0000","last_became_active":"2024-09-22T08:15:06.964786+0000","last_became_peered":"2024-09-22T08:15:06.964786+0000","last_unstale":"2024-09-22T08:54:27.961170+0000","last_undegraded":"2024-09-22T08:54:27.961170+0000","last_fullsized":"2024-09-22T08:54:27.961170+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":800,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:33:01.235899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4058,"num_read_kb":3642,"num_write":1164,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"263'224","reported_seq":892,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:18.408563+0000","last_change":"2024-09-22T08:15:04.963081+0000","last_active":"2024-09-22T08:53:18.408563+0000","last_peered":"2024-09-22T08:53:18.408563+0000","last_clean":"2024-09-22T08:53:18.408563+0000","last_became_active":"2024-09-22T08:15:04.962774+0000","last_became_peered":"2024-09-22T08:15:04.962774+0000","last_unstale":"2024-09-22T08:53:18.408563+0000","last_undegraded":"2024-09-22T08:53:18.408563+0000","last_fullsized":"2024-09-22T08:53:18.408563+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:28:22.448316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":683,"num_read_kb":4749,"num_write":1115,"num_write_kb":28646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"263'862","reported_seq":2345,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:25.945638+0000","last_change":"2024-09-22T08:15:06.958712+0000","last_active":"2024-09-22T08:54:25.945638+0000","last_peered":"2024-09-22T08:54:25.945638+0000","last_clean":"2024-09-22T08:54:25.945638+0000","last_became_active":"2024-09-22T08:15:06.958389+0000","last_became_peered":"2024-09-22T08:15:06.958389+0000","last_unstale":"2024-09-22T08:54:25.945638+0000","last_undegraded":"2024-09-22T08:54:25.945638+0000","last_fullsized":"2024-09-22T08:54:25.945638+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":800,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:17:52.710339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3808,"num_read_kb":3398,"num_write":1097,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"263'363","reported_seq":1051,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.392172+0000","last_change":"2024-09-22T08:15:04.951222+0000","last_active":"2024-09-22T08:56:16.392172+0000","last_peered":"2024-09-22T08:56:16.392172+0000","last_clean":"2024-09-22T08:56:16.392172+0000","last_became_active":"2024-09-22T08:15:04.950922+0000","last_became_peered":"2024-09-22T08:15:04.950922+0000","last_unstale":"2024-09-22T08:56:16.392172+0000","last_undegraded":"2024-09-22T08:56:16.392172+0000","last_fullsized":"2024-09-22T08:56:16.392172+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:41:56.256814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1005,"num_read_kb":11417,"num_write":1356,"num_write_kb":38557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"263'414","reported_seq":1863,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:07.456606+0000","last_change":"2024-09-22T08:15:06.974074+0000","last_active":"2024-09-22T08:54:07.456606+0000","last_peered":"2024-09-22T08:54:07.456606+0000","last_clean":"2024-09-22T08:54:07.456606+0000","last_became_active":"2024-09-22T08:15:06.973749+0000","last_became_peered":"2024-09-22T08:15:06.973749+0000","last_unstale":"2024-09-22T08:54:07.456606+0000","last_undegraded":"2024-09-22T08:54:07.456606+0000","last_fullsized":"2024-09-22T08:54:07.456606+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:09:45.710062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2229,"num_read_kb":2093,"num_write":519,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"263'224","reported_seq":855,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:43.401544+0000","last_change":"2024-09-22T08:15:04.960573+0000","last_active":"2024-09-22T08:54:43.401544+0000","last_peered":"2024-09-22T08:54:43.401544+0000","last_clean":"2024-09-22T08:54:43.401544+0000","last_became_active":"2024-09-22T08:15:04.959501+0000","last_became_peered":"2024-09-22T08:15:04.959501+0000","last_unstale":"2024-09-22T08:54:43.401544+0000","last_undegraded":"2024-09-22T08:54:43.401544+0000","last_fullsized":"2024-09-22T08:54:43.401544+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:58:53.308481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194372,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":550,"num_read_kb":25081,"num_write":1073,"num_write_kb":19730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"263'880","reported_seq":2574,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.040269+0000","last_change":"2024-09-22T08:15:06.971393+0000","last_active":"2024-09-22T08:56:02.040269+0000","last_peered":"2024-09-22T08:56:02.040269+0000","last_clean":"2024-09-22T08:56:02.040269+0000","last_became_active":"2024-09-22T08:15:06.970991+0000","last_became_peered":"2024-09-22T08:15:06.970991+0000","last_unstale":"2024-09-22T08:56:02.040269+0000","last_undegraded":"2024-09-22T08:56:02.040269+0000","last_fullsized":"2024-09-22T08:56:02.040269+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":800,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:27:06.535070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4175,"num_read_kb":3774,"num_write":1132,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"263'195","reported_seq":826,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.292438+0000","last_change":"2024-09-22T08:15:04.954644+0000","last_active":"2024-09-22T08:56:16.292438+0000","last_peered":"2024-09-22T08:56:16.292438+0000","last_clean":"2024-09-22T08:56:16.292438+0000","last_became_active":"2024-09-22T08:15:04.954281+0000","last_became_peered":"2024-09-22T08:15:04.954281+0000","last_unstale":"2024-09-22T08:56:16.292438+0000","last_undegraded":"2024-09-22T08:56:16.292438+0000","last_fullsized":"2024-09-22T08:56:16.292438+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:43:06.650935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":578,"num_read_kb":4135,"num_write":927,"num_write_kb":8648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"263'1127","reported_seq":2681,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.961055+0000","last_change":"2024-09-22T08:15:06.968491+0000","last_active":"2024-09-22T08:54:27.961055+0000","last_peered":"2024-09-22T08:54:27.961055+0000","last_clean":"2024-09-22T08:54:27.961055+0000","last_became_active":"2024-09-22T08:15:06.967938+0000","last_became_peered":"2024-09-22T08:15:06.967938+0000","last_unstale":"2024-09-22T08:54:27.961055+0000","last_undegraded":"2024-09-22T08:54:27.961055+0000","last_fullsized":"2024-09-22T08:54:27.961055+0000","mapping_epoch":25,"log_start":"263'1100","ondisk_log_start":"263'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":1100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:05:32.099143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5297,"num_read_kb":4688,"num_write":1564,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"263'196","reported_seq":874,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:07.287692+0000","last_change":"2024-09-22T08:15:04.964365+0000","last_active":"2024-09-22T08:54:07.287692+0000","last_peered":"2024-09-22T08:54:07.287692+0000","last_clean":"2024-09-22T08:54:07.287692+0000","last_became_active":"2024-09-22T08:15:04.963992+0000","last_became_peered":"2024-09-22T08:15:04.963992+0000","last_unstale":"2024-09-22T08:54:07.287692+0000","last_undegraded":"2024-09-22T08:54:07.287692+0000","last_fullsized":"2024-09-22T08:54:07.287692+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:47:44.152954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":707,"num_read_kb":8108,"num_write":879,"num_write_kb":38701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"263'391","reported_seq":2065,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:25.944051+0000","last_change":"2024-09-22T08:15:06.964443+0000","last_active":"2024-09-22T08:54:25.944051+0000","last_peered":"2024-09-22T08:54:25.944051+0000","last_clean":"2024-09-22T08:54:25.944051+0000","last_became_active":"2024-09-22T08:15:06.964116+0000","last_became_peered":"2024-09-22T08:15:06.964116+0000","last_unstale":"2024-09-22T08:54:25.944051+0000","last_undegraded":"2024-09-22T08:54:25.944051+0000","last_fullsized":"2024-09-22T08:54:25.944051+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:11:34.518000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2347,"num_read_kb":2272,"num_write":440,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"263'229","reported_seq":911,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.490048+0000","last_change":"2024-09-22T08:15:04.951989+0000","last_active":"2024-09-22T08:56:16.490048+0000","last_peered":"2024-09-22T08:56:16.490048+0000","last_clean":"2024-09-22T08:56:16.490048+0000","last_became_active":"2024-09-22T08:15:04.951628+0000","last_became_peered":"2024-09-22T08:15:04.951628+0000","last_unstale":"2024-09-22T08:56:16.490048+0000","last_undegraded":"2024-09-22T08:56:16.490048+0000","last_fullsized":"2024-09-22T08:56:16.490048+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:10:52.618601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":736,"num_read_kb":9856,"num_write":1118,"num_write_kb":28547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"263'359","reported_seq":1832,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.361190+0000","last_change":"2024-09-22T08:15:06.973913+0000","last_active":"2024-09-22T08:54:27.361190+0000","last_peered":"2024-09-22T08:54:27.361190+0000","last_clean":"2024-09-22T08:54:27.361190+0000","last_became_active":"2024-09-22T08:15:06.973584+0000","last_became_peered":"2024-09-22T08:15:06.973584+0000","last_unstale":"2024-09-22T08:54:27.361190+0000","last_undegraded":"2024-09-22T08:54:27.361190+0000","last_fullsized":"2024-09-22T08:54:27.361190+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:45:47.505506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2011,"num_read_kb":1931,"num_write":399,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"263'212","reported_seq":879,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:06.273562+0000","last_change":"2024-09-22T08:15:04.969769+0000","last_active":"2024-09-22T08:54:06.273562+0000","last_peered":"2024-09-22T08:54:06.273562+0000","last_clean":"2024-09-22T08:54:06.273562+0000","last_became_active":"2024-09-22T08:15:04.968983+0000","last_became_peered":"2024-09-22T08:15:04.968983+0000","last_unstale":"2024-09-22T08:54:06.273562+0000","last_undegraded":"2024-09-22T08:54:06.273562+0000","last_fullsized":"2024-09-22T08:54:06.273562+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:18.808569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10519112,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":611,"num_read_kb":66139,"num_write":1053,"num_write_kb":31816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"263'1262","reported_seq":3112,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.961464+0000","last_change":"2024-09-22T08:15:06.971511+0000","last_active":"2024-09-22T08:54:27.961464+0000","last_peered":"2024-09-22T08:54:27.961464+0000","last_clean":"2024-09-22T08:54:27.961464+0000","last_became_active":"2024-09-22T08:15:06.970055+0000","last_became_peered":"2024-09-22T08:15:06.970055+0000","last_unstale":"2024-09-22T08:54:27.961464+0000","last_undegraded":"2024-09-22T08:54:27.961464+0000","last_fullsized":"2024-09-22T08:54:27.961464+0000","mapping_epoch":25,"log_start":"263'1200","ondisk_log_start":"263'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":1200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:22:55.292514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6370,"num_read_kb":5597,"num_write":1961,"num_write_kb":987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"263'217","reported_seq":880,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.331777+0000","last_change":"2024-09-22T08:15:04.961957+0000","last_active":"2024-09-22T08:56:16.331777+0000","last_peered":"2024-09-22T08:56:16.331777+0000","last_clean":"2024-09-22T08:56:16.331777+0000","last_became_active":"2024-09-22T08:15:04.961545+0000","last_became_peered":"2024-09-22T08:15:04.961545+0000","last_unstale":"2024-09-22T08:56:16.331777+0000","last_undegraded":"2024-09-22T08:56:16.331777+0000","last_fullsized":"2024-09-22T08:56:16.331777+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:16:41.974072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":669,"num_read_kb":2609,"num_write":1038,"num_write_kb":23374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"263'491","reported_seq":1940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.926788+0000","last_change":"2024-09-22T08:15:06.959643+0000","last_active":"2024-09-22T08:54:38.926788+0000","last_peered":"2024-09-22T08:54:38.926788+0000","last_clean":"2024-09-22T08:54:38.926788+0000","last_became_active":"2024-09-22T08:15:06.959331+0000","last_became_peered":"2024-09-22T08:15:06.959331+0000","last_unstale":"2024-09-22T08:54:38.926788+0000","last_undegraded":"2024-09-22T08:54:38.926788+0000","last_fullsized":"2024-09-22T08:54:38.926788+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:46:47.067650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2542,"num_read_kb":2330,"num_write":651,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"263'189","reported_seq":779,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:46.773614+0000","last_change":"2024-09-22T08:15:04.959005+0000","last_active":"2024-09-22T08:53:46.773614+0000","last_peered":"2024-09-22T08:53:46.773614+0000","last_clean":"2024-09-22T08:53:46.773614+0000","last_became_active":"2024-09-22T08:15:04.958725+0000","last_became_peered":"2024-09-22T08:15:04.958725+0000","last_unstale":"2024-09-22T08:53:46.773614+0000","last_undegraded":"2024-09-22T08:53:46.773614+0000","last_fullsized":"2024-09-22T08:53:46.773614+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:57:53.879433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5247038,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":388,"num_read_kb":18786,"num_write":896,"num_write_kb":46944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"263'798","reported_seq":2381,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:19.614771+0000","last_change":"2024-09-22T08:15:06.956815+0000","last_active":"2024-09-22T08:54:19.614771+0000","last_peered":"2024-09-22T08:54:19.614771+0000","last_clean":"2024-09-22T08:54:19.614771+0000","last_became_active":"2024-09-22T08:15:06.956485+0000","last_became_peered":"2024-09-22T08:15:06.956485+0000","last_unstale":"2024-09-22T08:54:19.614771+0000","last_undegraded":"2024-09-22T08:54:19.614771+0000","last_fullsized":"2024-09-22T08:54:19.614771+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:11:36.316290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3799,"num_read_kb":3445,"num_write":1066,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"263'218","reported_seq":891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.438588+0000","last_change":"2024-09-22T08:15:04.962465+0000","last_active":"2024-09-22T08:56:16.438588+0000","last_peered":"2024-09-22T08:56:16.438588+0000","last_clean":"2024-09-22T08:56:16.438588+0000","last_became_active":"2024-09-22T08:15:04.962165+0000","last_became_peered":"2024-09-22T08:15:04.962165+0000","last_unstale":"2024-09-22T08:56:16.438588+0000","last_undegraded":"2024-09-22T08:56:16.438588+0000","last_fullsized":"2024-09-22T08:56:16.438588+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:54.072073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":601,"num_read_kb":98488,"num_write":1035,"num_write_kb":53405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"263'774","reported_seq":2242,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.926395+0000","last_change":"2024-09-22T08:15:06.970487+0000","last_active":"2024-09-22T08:54:38.926395+0000","last_peered":"2024-09-22T08:54:38.926395+0000","last_clean":"2024-09-22T08:54:38.926395+0000","last_became_active":"2024-09-22T08:15:06.970111+0000","last_became_peered":"2024-09-22T08:15:06.970111+0000","last_unstale":"2024-09-22T08:54:38.926395+0000","last_undegraded":"2024-09-22T08:54:38.926395+0000","last_fullsized":"2024-09-22T08:54:38.926395+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:58.671223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3767,"num_read_kb":3405,"num_write":1035,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"263'179","reported_seq":881,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:52.668674+0000","last_change":"2024-09-22T08:15:04.963818+0000","last_active":"2024-09-22T08:55:52.668674+0000","last_peered":"2024-09-22T08:55:52.668674+0000","last_clean":"2024-09-22T08:55:52.668674+0000","last_became_active":"2024-09-22T08:15:04.963383+0000","last_became_peered":"2024-09-22T08:15:04.963383+0000","last_unstale":"2024-09-22T08:55:52.668674+0000","last_undegraded":"2024-09-22T08:55:52.668674+0000","last_fullsized":"2024-09-22T08:55:52.668674+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:27:08.401857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5489195,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":838,"num_read_kb":15208,"num_write":838,"num_write_kb":25255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"263'748","reported_seq":2174,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.033948+0000","last_change":"2024-09-22T08:15:06.968144+0000","last_active":"2024-09-22T08:56:02.033948+0000","last_peered":"2024-09-22T08:56:02.033948+0000","last_clean":"2024-09-22T08:56:02.033948+0000","last_became_active":"2024-09-22T08:15:06.967819+0000","last_became_peered":"2024-09-22T08:15:06.967819+0000","last_unstale":"2024-09-22T08:56:02.033948+0000","last_undegraded":"2024-09-22T08:56:02.033948+0000","last_fullsized":"2024-09-22T08:56:02.033948+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:33:21.226600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3557,"num_read_kb":3203,"num_write":994,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"263'220","reported_seq":850,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.532155+0000","last_change":"2024-09-22T08:15:04.963531+0000","last_active":"2024-09-22T08:56:16.532155+0000","last_peered":"2024-09-22T08:56:16.532155+0000","last_clean":"2024-09-22T08:56:16.532155+0000","last_became_active":"2024-09-22T08:15:04.963035+0000","last_became_peered":"2024-09-22T08:15:04.963035+0000","last_unstale":"2024-09-22T08:56:16.532155+0000","last_undegraded":"2024-09-22T08:56:16.532155+0000","last_fullsized":"2024-09-22T08:56:16.532155+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:06:11.269656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":484,"num_read_kb":60036,"num_write":970,"num_write_kb":46477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"263'433","reported_seq":2054,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:24.609260+0000","last_change":"2024-09-22T08:15:06.973192+0000","last_active":"2024-09-22T08:54:24.609260+0000","last_peered":"2024-09-22T08:54:24.609260+0000","last_clean":"2024-09-22T08:54:24.609260+0000","last_became_active":"2024-09-22T08:15:06.972901+0000","last_became_peered":"2024-09-22T08:15:06.972901+0000","last_unstale":"2024-09-22T08:54:24.609260+0000","last_undegraded":"2024-09-22T08:54:24.609260+0000","last_fullsized":"2024-09-22T08:54:24.609260+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:05:44.213357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2630,"num_read_kb":2493,"num_write":497,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"263'190","reported_seq":793,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:23.475033+0000","last_change":"2024-09-22T08:15:04.955216+0000","last_active":"2024-09-22T08:53:23.475033+0000","last_peered":"2024-09-22T08:53:23.475033+0000","last_clean":"2024-09-22T08:53:23.475033+0000","last_became_active":"2024-09-22T08:15:04.954601+0000","last_became_peered":"2024-09-22T08:15:04.954601+0000","last_unstale":"2024-09-22T08:53:23.475033+0000","last_undegraded":"2024-09-22T08:53:23.475033+0000","last_fullsized":"2024-09-22T08:53:23.475033+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:09:17.404903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145754,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":487,"num_read_kb":10659,"num_write":870,"num_write_kb":26887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"263'435","reported_seq":1895,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:26.720211+0000","last_change":"2024-09-22T08:15:06.956049+0000","last_active":"2024-09-22T08:54:26.720211+0000","last_peered":"2024-09-22T08:54:26.720211+0000","last_clean":"2024-09-22T08:54:26.720211+0000","last_became_active":"2024-09-22T08:15:06.955721+0000","last_became_peered":"2024-09-22T08:15:06.955721+0000","last_unstale":"2024-09-22T08:54:26.720211+0000","last_undegraded":"2024-09-22T08:54:26.720211+0000","last_fullsized":"2024-09-22T08:54:26.720211+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:49:20.581915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2301,"num_read_kb":2146,"num_write":527,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"263'213","reported_seq":874,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:28.392913+0000","last_change":"2024-09-22T08:15:04.961490+0000","last_active":"2024-09-22T08:53:28.392913+0000","last_peered":"2024-09-22T08:53:28.392913+0000","last_clean":"2024-09-22T08:53:28.392913+0000","last_became_active":"2024-09-22T08:15:04.961217+0000","last_became_peered":"2024-09-22T08:15:04.961217+0000","last_unstale":"2024-09-22T08:53:28.392913+0000","last_undegraded":"2024-09-22T08:53:28.392913+0000","last_fullsized":"2024-09-22T08:53:28.392913+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:36:23.921216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1319535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":594,"num_read_kb":11776,"num_write":1058,"num_write_kb":6843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"263'549","reported_seq":2080,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.927363+0000","last_change":"2024-09-22T08:15:06.971069+0000","last_active":"2024-09-22T08:54:38.927363+0000","last_peered":"2024-09-22T08:54:38.927363+0000","last_clean":"2024-09-22T08:54:38.927363+0000","last_became_active":"2024-09-22T08:15:06.970735+0000","last_became_peered":"2024-09-22T08:15:06.970735+0000","last_unstale":"2024-09-22T08:54:38.927363+0000","last_undegraded":"2024-09-22T08:54:38.927363+0000","last_fullsized":"2024-09-22T08:54:38.927363+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":500,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:22:49.656390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2725,"num_read_kb":2496,"num_write":675,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"263'217","reported_seq":874,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.490267+0000","last_change":"2024-09-22T08:15:04.968447+0000","last_active":"2024-09-22T08:56:16.490267+0000","last_peered":"2024-09-22T08:56:16.490267+0000","last_clean":"2024-09-22T08:56:16.490267+0000","last_became_active":"2024-09-22T08:15:04.968172+0000","last_became_peered":"2024-09-22T08:15:04.968172+0000","last_unstale":"2024-09-22T08:56:16.490267+0000","last_undegraded":"2024-09-22T08:56:16.490267+0000","last_fullsized":"2024-09-22T08:56:16.490267+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:13:04.823684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":641,"num_read_kb":8608,"num_write":1007,"num_write_kb":17473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"263'756","reported_seq":2289,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:20.255569+0000","last_change":"2024-09-22T08:15:06.976244+0000","last_active":"2024-09-22T08:54:20.255569+0000","last_peered":"2024-09-22T08:54:20.255569+0000","last_clean":"2024-09-22T08:54:20.255569+0000","last_became_active":"2024-09-22T08:15:06.976019+0000","last_became_peered":"2024-09-22T08:15:06.976019+0000","last_unstale":"2024-09-22T08:54:20.255569+0000","last_undegraded":"2024-09-22T08:54:20.255569+0000","last_fullsized":"2024-09-22T08:54:20.255569+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:12:42.777379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3691,"num_read_kb":3360,"num_write":995,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"263'220","reported_seq":910,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:18.048628+0000","last_change":"2024-09-22T08:15:04.963673+0000","last_active":"2024-09-22T08:53:18.048628+0000","last_peered":"2024-09-22T08:53:18.048628+0000","last_clean":"2024-09-22T08:53:18.048628+0000","last_became_active":"2024-09-22T08:15:04.963391+0000","last_became_peered":"2024-09-22T08:15:04.963391+0000","last_unstale":"2024-09-22T08:53:18.048628+0000","last_undegraded":"2024-09-22T08:53:18.048628+0000","last_fullsized":"2024-09-22T08:53:18.048628+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:19:28.768330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5835011,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":632,"num_read_kb":95067,"num_write":1055,"num_write_kb":43906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"263'259","reported_seq":914,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:56.799472+0000","last_change":"2024-09-22T08:15:04.966802+0000","last_active":"2024-09-22T08:52:56.799472+0000","last_peered":"2024-09-22T08:52:56.799472+0000","last_clean":"2024-09-22T08:52:56.799472+0000","last_became_active":"2024-09-22T08:15:04.965396+0000","last_became_peered":"2024-09-22T08:15:04.965396+0000","last_unstale":"2024-09-22T08:52:56.799472+0000","last_undegraded":"2024-09-22T08:52:56.799472+0000","last_fullsized":"2024-09-22T08:52:56.799472+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:33:44.025013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10815762,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":737,"num_read_kb":7770,"num_write":1111,"num_write_kb":20319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"263'1208","reported_seq":2920,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.480223+0000","last_change":"2024-09-22T08:15:06.971024+0000","last_active":"2024-09-22T08:54:41.480223+0000","last_peered":"2024-09-22T08:54:41.480223+0000","last_clean":"2024-09-22T08:54:41.480223+0000","last_became_active":"2024-09-22T08:15:06.970717+0000","last_became_peered":"2024-09-22T08:15:06.970717+0000","last_unstale":"2024-09-22T08:54:41.480223+0000","last_undegraded":"2024-09-22T08:54:41.480223+0000","last_fullsized":"2024-09-22T08:54:41.480223+0000","mapping_epoch":25,"log_start":"263'1100","ondisk_log_start":"263'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":1100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:28:38.936914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5779,"num_read_kb":5147,"num_write":1662,"num_write_kb":686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"263'200","reported_seq":785,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.545519+0000","last_change":"2024-09-22T08:15:04.959358+0000","last_active":"2024-09-22T08:56:16.545519+0000","last_peered":"2024-09-22T08:56:16.545519+0000","last_clean":"2024-09-22T08:56:16.545519+0000","last_became_active":"2024-09-22T08:15:04.959102+0000","last_became_peered":"2024-09-22T08:15:04.959102+0000","last_unstale":"2024-09-22T08:56:16.545519+0000","last_undegraded":"2024-09-22T08:56:16.545519+0000","last_fullsized":"2024-09-22T08:56:16.545519+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:04:57.231333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":396,"num_read_kb":24955,"num_write":899,"num_write_kb":36551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"263'497","reported_seq":2107,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:23.395197+0000","last_change":"2024-09-22T08:15:06.969693+0000","last_active":"2024-09-22T08:54:23.395197+0000","last_peered":"2024-09-22T08:54:23.395197+0000","last_clean":"2024-09-22T08:54:23.395197+0000","last_became_active":"2024-09-22T08:15:06.968345+0000","last_became_peered":"2024-09-22T08:15:06.968345+0000","last_unstale":"2024-09-22T08:54:23.395197+0000","last_undegraded":"2024-09-22T08:54:23.395197+0000","last_fullsized":"2024-09-22T08:54:23.395197+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:19.848260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2601,"num_read_kb":2436,"num_write":597,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10844,"num_read_kb":8840,"num_write":3116,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":899,"ondisk_log_size":899,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15081,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":16349,"num_read_kb":16036,"num_write":17069,"num_write_kb":4981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":30162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1780,"ondisk_log_size":1780,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":664,"ondisk_log_size":664,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":447566,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":8192,"num_read_kb":10309,"num_write":5544,"num_write_kb":2758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":516096,"data_stored":125593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1958,"ondisk_log_size":1958,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2389,"num_read_kb":2853,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":219693,"num_read_kb":201308,"num_write":55750,"num_write_kb":18998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3980,"ondisk_log_size":3980,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":250032338,"num_objects":339,"num_object_clones":0,"num_object_copies":678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":339,"num_whiteouts":0,"num_read":38674,"num_read_kb":2160973,"num_write":63909,"num_write_kb":2146956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":497967104,"data_stored":496530405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3647,"ondisk_log_size":3647,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":37797155,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":159,"num_read_kb":194127,"num_write":173,"num_write_kb":125446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":46297088,"data_stored":46294552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":25214243,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":158,"num_read_kb":186900,"num_write":176,"num_write_kb":125446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":44138496,"data_stored":44137030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":116,"ondisk_log_size":116,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509941,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":319748,"kb_used_data":130292,"kb_used_omap":1,"kb_used_meta":189438,"kb_avail":94052092,"statfs":{"total":96636764160,"available":96309342208,"internally_reserved":0,"allocated":133419008,"data_stored":131577570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":193984968},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509942,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":356048,"kb_used_data":108288,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":94015792,"statfs":{"total":96636764160,"available":96272171008,"internally_reserved":0,"allocated":110886912,"data_stored":109128914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":253688261},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509942,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":224460,"kb_used_data":153020,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94147380,"statfs":{"total":96636764160,"available":96406917120,"internally_reserved":0,"allocated":156692480,"data_stored":154843870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542646,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":209020,"kb_used_data":7100,"kb_used_omap":1,"kb_used_meta":201854,"kb_avail":94162820,"statfs":{"total":96636764160,"available":96422727680,"internally_reserved":0,"allocated":7270400,"data_stored":5649861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":206698954},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542645,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":152972,"kb_used_data":81524,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94218868,"statfs":{"total":96636764160,"available":96480120832,"internally_reserved":0,"allocated":83480576,"data_stored":81759643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542646,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":322808,"kb_used_data":84752,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94049032,"statfs":{"total":96636764160,"available":96306208768,"internally_reserved":0,"allocated":86786048,"data_stored":85108849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243726789},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542648,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":211624,"kb_used_data":72176,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94160216,"statfs":{"total":96636764160,"available":96420061184,"internally_reserved":0,"allocated":73908224,"data_stored":72287988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575348,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":288212,"kb_used_data":176516,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94083628,"statfs":{"total":96636764160,"available":96341635072,"internally_reserved":0,"allocated":180752384,"data_stored":178904915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":133992448,"data_stored":133717149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":84480000,"data_stored":84293177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":147660800,"data_stored":147368995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":109801472,"data_stored":109525406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5492736,"data_stored":5399824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":6012928,"data_stored":5893124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6889472,"data_stored":6786226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3637248,"data_stored":3546504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":135168,"data_stored":43190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":28335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":22866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":27544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":5633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":3876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":5455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9486336,"data_stored":9485603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9486336,"data_stored":9485603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14680064,"data_stored":14680064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9498624,"data_stored":9497554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12632064,"data_stored":12631331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18923520,"data_stored":18922787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T08:56:18.750 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-22T08:56:18.751 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T08:56:19.115 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:56:19.126 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-09-22T08:56:19.128 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":1502,"stamp":"2024-09-22T08:56:17.629295+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":314098563,"num_objects":817,"num_object_clones":0,"num_object_copies":1634,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":817,"num_whiteouts":0,"num_read":296536,"num_read_kb":2781413,"num_write":145878,"num_write_kb":2427250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":189,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13249,"ondisk_log_size":13249,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2084892,"kb_used_data":813668,"kb_used_omap":12,"kb_used_meta":1270963,"kb_avail":752889828,"statfs":{"total":773094113280,"available":770959183872,"internally_reserved":0,"allocated":833196032,"data_stored":819261610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1301466673},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-239420878,"num_objects":-165,"num_object_clones":0,"num_object_copies":-330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-165,"num_whiteouts":0,"num_read":391,"num_read_kb":430,"num_write":255,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004659"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:18.466360+0000","last_change":"2024-09-22T08:42:17.435884+0000","last_active":"2024-09-22T08:52:18.466360+0000","last_peered":"2024-09-22T08:52:18.466360+0000","last_clean":"2024-09-22T08:52:18.466360+0000","last_became_active":"2024-09-22T08:42:17.435576+0000","last_became_peered":"2024-09-22T08:42:17.435576+0000","last_unstale":"2024-09-22T08:52:18.466360+0000","last_undegraded":"2024-09-22T08:52:18.466360+0000","last_fullsized":"2024-09-22T08:52:18.466360+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:18:12.399293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"263'4","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:18.375143+0000","last_change":"2024-09-22T08:31:14.254986+0000","last_active":"2024-09-22T08:51:18.375143+0000","last_peered":"2024-09-22T08:51:18.375143+0000","last_clean":"2024-09-22T08:51:18.375143+0000","last_became_active":"2024-09-22T08:31:14.254610+0000","last_became_peered":"2024-09-22T08:31:14.254610+0000","last_unstale":"2024-09-22T08:51:18.375143+0000","last_undegraded":"2024-09-22T08:51:18.375143+0000","last_fullsized":"2024-09-22T08:51:18.375143+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:29:54.524062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":9,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"263'4","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.314152+0000","last_change":"2024-09-22T08:31:11.216063+0000","last_active":"2024-09-22T08:56:16.314152+0000","last_peered":"2024-09-22T08:56:16.314152+0000","last_clean":"2024-09-22T08:56:16.314152+0000","last_became_active":"2024-09-22T08:31:11.215757+0000","last_became_peered":"2024-09-22T08:31:11.215757+0000","last_unstale":"2024-09-22T08:56:16.314152+0000","last_undegraded":"2024-09-22T08:56:16.314152+0000","last_fullsized":"2024-09-22T08:56:16.314152+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:30:49.027544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6203,"num_write":4,"num_write_kb":3131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"263'27","reported_seq":113,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:39.138788+0000","last_change":"2024-09-22T08:29:26.069972+0000","last_active":"2024-09-22T08:52:39.138788+0000","last_peered":"2024-09-22T08:52:39.138788+0000","last_clean":"2024-09-22T08:52:39.138788+0000","last_became_active":"2024-09-22T08:29:26.069635+0000","last_became_peered":"2024-09-22T08:29:26.069635+0000","last_unstale":"2024-09-22T08:52:39.138788+0000","last_undegraded":"2024-09-22T08:52:39.138788+0000","last_fullsized":"2024-09-22T08:52:39.138788+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:19:23.283184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":139,"num_write":76,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:17.271882+0000","last_change":"2024-09-22T08:42:17.433226+0000","last_active":"2024-09-22T08:52:17.271882+0000","last_peered":"2024-09-22T08:52:17.271882+0000","last_clean":"2024-09-22T08:52:17.271882+0000","last_became_active":"2024-09-22T08:42:17.432946+0000","last_became_peered":"2024-09-22T08:42:17.432946+0000","last_unstale":"2024-09-22T08:52:17.271882+0000","last_undegraded":"2024-09-22T08:52:17.271882+0000","last_fullsized":"2024-09-22T08:52:17.271882+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:57:47.463137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"263'3","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:46.271105+0000","last_change":"2024-09-22T08:31:14.256838+0000","last_active":"2024-09-22T08:53:46.271105+0000","last_peered":"2024-09-22T08:53:46.271105+0000","last_clean":"2024-09-22T08:53:46.271105+0000","last_became_active":"2024-09-22T08:31:14.256486+0000","last_became_peered":"2024-09-22T08:31:14.256486+0000","last_unstale":"2024-09-22T08:53:46.271105+0000","last_undegraded":"2024-09-22T08:53:46.271105+0000","last_fullsized":"2024-09-22T08:53:46.271105+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:05:48.401720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4242723,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":8240,"num_write":8,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"260'2","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:42.284418+0000","last_change":"2024-09-22T08:31:11.216967+0000","last_active":"2024-09-22T08:53:42.284418+0000","last_peered":"2024-09-22T08:53:42.284418+0000","last_clean":"2024-09-22T08:53:42.284418+0000","last_became_active":"2024-09-22T08:31:11.216515+0000","last_became_peered":"2024-09-22T08:31:11.216515+0000","last_unstale":"2024-09-22T08:53:42.284418+0000","last_undegraded":"2024-09-22T08:53:42.284418+0000","last_fullsized":"2024-09-22T08:53:42.284418+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:40:06.800121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"263'31","reported_seq":130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:32.404964+0000","last_change":"2024-09-22T08:29:26.074014+0000","last_active":"2024-09-22T08:53:32.404964+0000","last_peered":"2024-09-22T08:53:32.404964+0000","last_clean":"2024-09-22T08:53:32.404964+0000","last_became_active":"2024-09-22T08:29:26.073415+0000","last_became_peered":"2024-09-22T08:29:26.073415+0000","last_unstale":"2024-09-22T08:53:32.404964+0000","last_undegraded":"2024-09-22T08:53:32.404964+0000","last_fullsized":"2024-09-22T08:53:32.404964+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:07:10.743328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":176,"num_write":77,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:58.380840+0000","last_change":"2024-09-22T08:42:17.436629+0000","last_active":"2024-09-22T08:51:58.380840+0000","last_peered":"2024-09-22T08:51:58.380840+0000","last_clean":"2024-09-22T08:51:58.380840+0000","last_became_active":"2024-09-22T08:42:17.436334+0000","last_became_peered":"2024-09-22T08:42:17.436334+0000","last_unstale":"2024-09-22T08:51:58.380840+0000","last_undegraded":"2024-09-22T08:51:58.380840+0000","last_fullsized":"2024-09-22T08:51:58.380840+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:04:08.905608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"260'4","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:12.288779+0000","last_change":"2024-09-22T08:31:14.257057+0000","last_active":"2024-09-22T08:54:12.288779+0000","last_peered":"2024-09-22T08:54:12.288779+0000","last_clean":"2024-09-22T08:54:12.288779+0000","last_became_active":"2024-09-22T08:31:14.256769+0000","last_became_peered":"2024-09-22T08:31:14.256769+0000","last_unstale":"2024-09-22T08:54:12.288779+0000","last_undegraded":"2024-09-22T08:54:12.288779+0000","last_fullsized":"2024-09-22T08:54:12.288779+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:06:32.378399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:17.289881+0000","last_change":"2024-09-22T08:31:11.211351+0000","last_active":"2024-09-22T08:53:17.289881+0000","last_peered":"2024-09-22T08:53:17.289881+0000","last_clean":"2024-09-22T08:53:17.289881+0000","last_became_active":"2024-09-22T08:31:11.210892+0000","last_became_peered":"2024-09-22T08:31:11.210892+0000","last_unstale":"2024-09-22T08:53:17.289881+0000","last_undegraded":"2024-09-22T08:53:17.289881+0000","last_fullsized":"2024-09-22T08:53:17.289881+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:20:58.942888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"263'43","reported_seq":162,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:57.268885+0000","last_change":"2024-09-22T08:29:26.068513+0000","last_active":"2024-09-22T08:51:57.268885+0000","last_peered":"2024-09-22T08:51:57.268885+0000","last_clean":"2024-09-22T08:51:57.268885+0000","last_became_active":"2024-09-22T08:29:26.067963+0000","last_became_peered":"2024-09-22T08:29:26.067963+0000","last_unstale":"2024-09-22T08:51:57.268885+0000","last_undegraded":"2024-09-22T08:51:57.268885+0000","last_fullsized":"2024-09-22T08:51:57.268885+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:19:50.645315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":380,"num_read_kb":284,"num_write":99,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:02.269565+0000","last_change":"2024-09-22T08:42:17.431238+0000","last_active":"2024-09-22T08:52:02.269565+0000","last_peered":"2024-09-22T08:52:02.269565+0000","last_clean":"2024-09-22T08:52:02.269565+0000","last_became_active":"2024-09-22T08:42:17.430938+0000","last_became_peered":"2024-09-22T08:42:17.430938+0000","last_unstale":"2024-09-22T08:52:02.269565+0000","last_undegraded":"2024-09-22T08:52:02.269565+0000","last_fullsized":"2024-09-22T08:52:02.269565+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:34:21.108839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"263'5","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:22.299767+0000","last_change":"2024-09-22T08:31:14.257263+0000","last_active":"2024-09-22T08:55:22.299767+0000","last_peered":"2024-09-22T08:55:22.299767+0000","last_clean":"2024-09-22T08:55:22.299767+0000","last_became_active":"2024-09-22T08:31:14.255086+0000","last_became_peered":"2024-09-22T08:31:14.255086+0000","last_unstale":"2024-09-22T08:55:22.299767+0000","last_undegraded":"2024-09-22T08:55:22.299767+0000","last_fullsized":"2024-09-22T08:55:22.299767+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:28:49.743007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:08.397293+0000","last_change":"2024-09-22T08:31:11.207653+0000","last_active":"2024-09-22T08:54:08.397293+0000","last_peered":"2024-09-22T08:54:08.397293+0000","last_clean":"2024-09-22T08:54:08.397293+0000","last_became_active":"2024-09-22T08:31:11.207375+0000","last_became_peered":"2024-09-22T08:31:11.207375+0000","last_unstale":"2024-09-22T08:54:08.397293+0000","last_undegraded":"2024-09-22T08:54:08.397293+0000","last_fullsized":"2024-09-22T08:54:08.397293+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:55:26.229921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"263'31","reported_seq":122,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:57.268855+0000","last_change":"2024-09-22T08:29:26.072556+0000","last_active":"2024-09-22T08:51:57.268855+0000","last_peered":"2024-09-22T08:51:57.268855+0000","last_clean":"2024-09-22T08:51:57.268855+0000","last_became_active":"2024-09-22T08:29:26.072183+0000","last_became_peered":"2024-09-22T08:29:26.072183+0000","last_unstale":"2024-09-22T08:51:57.268855+0000","last_undegraded":"2024-09-22T08:51:57.268855+0000","last_fullsized":"2024-09-22T08:51:57.268855+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:30:12.756499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":233,"num_read_kb":155,"num_write":81,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:22.282338+0000","last_change":"2024-09-22T08:42:17.418516+0000","last_active":"2024-09-22T08:52:22.282338+0000","last_peered":"2024-09-22T08:52:22.282338+0000","last_clean":"2024-09-22T08:52:22.282338+0000","last_became_active":"2024-09-22T08:42:17.418224+0000","last_became_peered":"2024-09-22T08:42:17.418224+0000","last_unstale":"2024-09-22T08:52:22.282338+0000","last_undegraded":"2024-09-22T08:52:22.282338+0000","last_fullsized":"2024-09-22T08:52:22.282338+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:06:49.930134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"263'3","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:03.472601+0000","last_change":"2024-09-22T08:31:14.262084+0000","last_active":"2024-09-22T08:53:03.472601+0000","last_peered":"2024-09-22T08:53:03.472601+0000","last_clean":"2024-09-22T08:53:03.472601+0000","last_became_active":"2024-09-22T08:31:14.261753+0000","last_became_peered":"2024-09-22T08:31:14.261753+0000","last_unstale":"2024-09-22T08:53:03.472601+0000","last_undegraded":"2024-09-22T08:53:03.472601+0000","last_fullsized":"2024-09-22T08:53:03.472601+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:21:33.510246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"260'9","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:57.277829+0000","last_change":"2024-09-22T08:31:11.215327+0000","last_active":"2024-09-22T08:52:57.277829+0000","last_peered":"2024-09-22T08:52:57.277829+0000","last_clean":"2024-09-22T08:52:57.277829+0000","last_became_active":"2024-09-22T08:31:11.215024+0000","last_became_peered":"2024-09-22T08:31:11.215024+0000","last_unstale":"2024-09-22T08:52:57.277829+0000","last_undegraded":"2024-09-22T08:52:57.277829+0000","last_fullsized":"2024-09-22T08:52:57.277829+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:27:55.278924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":17455,"num_write":14,"num_write_kb":5165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"263'52","reported_seq":185,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:50.448372+0000","last_change":"2024-09-22T08:29:26.071185+0000","last_active":"2024-09-22T08:53:50.448372+0000","last_peered":"2024-09-22T08:53:50.448372+0000","last_clean":"2024-09-22T08:53:50.448372+0000","last_became_active":"2024-09-22T08:29:26.070913+0000","last_became_peered":"2024-09-22T08:29:26.070913+0000","last_unstale":"2024-09-22T08:53:50.448372+0000","last_undegraded":"2024-09-22T08:53:50.448372+0000","last_fullsized":"2024-09-22T08:53:50.448372+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:50:29.931826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":289,"num_write":128,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:42.398384+0000","last_change":"2024-09-22T08:42:17.428992+0000","last_active":"2024-09-22T08:52:42.398384+0000","last_peered":"2024-09-22T08:52:42.398384+0000","last_clean":"2024-09-22T08:52:42.398384+0000","last_became_active":"2024-09-22T08:42:17.428589+0000","last_became_peered":"2024-09-22T08:42:17.428589+0000","last_unstale":"2024-09-22T08:52:42.398384+0000","last_undegraded":"2024-09-22T08:52:42.398384+0000","last_fullsized":"2024-09-22T08:52:42.398384+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:34:40.543481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"263'5","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:03.389575+0000","last_change":"2024-09-22T08:31:14.256450+0000","last_active":"2024-09-22T08:53:03.389575+0000","last_peered":"2024-09-22T08:53:03.389575+0000","last_clean":"2024-09-22T08:53:03.389575+0000","last_became_active":"2024-09-22T08:31:14.256133+0000","last_became_peered":"2024-09-22T08:31:14.256133+0000","last_unstale":"2024-09-22T08:53:03.389575+0000","last_undegraded":"2024-09-22T08:53:03.389575+0000","last_fullsized":"2024-09-22T08:53:03.389575+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:35:53.157445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":15,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"263'1","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:58.389014+0000","last_change":"2024-09-22T08:31:11.214428+0000","last_active":"2024-09-22T08:52:58.389014+0000","last_peered":"2024-09-22T08:52:58.389014+0000","last_clean":"2024-09-22T08:52:58.389014+0000","last_became_active":"2024-09-22T08:31:11.214152+0000","last_became_peered":"2024-09-22T08:31:11.214152+0000","last_unstale":"2024-09-22T08:52:58.389014+0000","last_undegraded":"2024-09-22T08:52:58.389014+0000","last_fullsized":"2024-09-22T08:52:58.389014+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:24:25.711738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"263'41","reported_seq":155,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:56.954636+0000","last_change":"2024-09-22T08:29:26.073207+0000","last_active":"2024-09-22T08:52:56.954636+0000","last_peered":"2024-09-22T08:52:56.954636+0000","last_clean":"2024-09-22T08:52:56.954636+0000","last_became_active":"2024-09-22T08:29:26.072935+0000","last_became_peered":"2024-09-22T08:29:26.072935+0000","last_unstale":"2024-09-22T08:52:56.954636+0000","last_undegraded":"2024-09-22T08:52:56.954636+0000","last_fullsized":"2024-09-22T08:52:56.954636+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:08.214582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":341,"num_read_kb":226,"num_write":101,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:16.259851+0000","last_change":"2024-09-22T08:42:17.429598+0000","last_active":"2024-09-22T08:52:16.259851+0000","last_peered":"2024-09-22T08:52:16.259851+0000","last_clean":"2024-09-22T08:52:16.259851+0000","last_became_active":"2024-09-22T08:42:17.429298+0000","last_became_peered":"2024-09-22T08:42:17.429298+0000","last_unstale":"2024-09-22T08:52:16.259851+0000","last_undegraded":"2024-09-22T08:52:16.259851+0000","last_fullsized":"2024-09-22T08:52:16.259851+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:26:36.238407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"260'7","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:46.271089+0000","last_change":"2024-09-22T08:31:14.258062+0000","last_active":"2024-09-22T08:53:46.271089+0000","last_peered":"2024-09-22T08:53:46.271089+0000","last_clean":"2024-09-22T08:53:46.271089+0000","last_became_active":"2024-09-22T08:31:14.257659+0000","last_became_peered":"2024-09-22T08:31:14.257659+0000","last_unstale":"2024-09-22T08:53:46.271089+0000","last_undegraded":"2024-09-22T08:53:46.271089+0000","last_fullsized":"2024-09-22T08:53:46.271089+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:32:38.962644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4143,"num_write":12,"num_write_kb":1069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"263'1","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:43.477749+0000","last_change":"2024-09-22T08:31:11.216523+0000","last_active":"2024-09-22T08:53:43.477749+0000","last_peered":"2024-09-22T08:53:43.477749+0000","last_clean":"2024-09-22T08:53:43.477749+0000","last_became_active":"2024-09-22T08:31:11.216248+0000","last_became_peered":"2024-09-22T08:31:11.216248+0000","last_unstale":"2024-09-22T08:53:43.477749+0000","last_undegraded":"2024-09-22T08:53:43.477749+0000","last_fullsized":"2024-09-22T08:53:43.477749+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:46:16.857947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"263'16","reported_seq":84,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:47.294012+0000","last_change":"2024-09-22T08:29:26.076631+0000","last_active":"2024-09-22T08:53:47.294012+0000","last_peered":"2024-09-22T08:53:47.294012+0000","last_clean":"2024-09-22T08:53:47.294012+0000","last_became_active":"2024-09-22T08:29:26.076243+0000","last_became_peered":"2024-09-22T08:29:26.076243+0000","last_unstale":"2024-09-22T08:53:47.294012+0000","last_undegraded":"2024-09-22T08:53:47.294012+0000","last_fullsized":"2024-09-22T08:53:47.294012+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:02:16.942826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":86,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:18.466402+0000","last_change":"2024-09-22T08:42:17.433193+0000","last_active":"2024-09-22T08:52:18.466402+0000","last_peered":"2024-09-22T08:52:18.466402+0000","last_clean":"2024-09-22T08:52:18.466402+0000","last_became_active":"2024-09-22T08:42:17.432923+0000","last_became_peered":"2024-09-22T08:42:17.432923+0000","last_unstale":"2024-09-22T08:52:18.466402+0000","last_undegraded":"2024-09-22T08:52:18.466402+0000","last_fullsized":"2024-09-22T08:52:18.466402+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:17:35.794496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"263'8","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.426367+0000","last_change":"2024-09-22T08:31:14.256601+0000","last_active":"2024-09-22T08:56:16.426367+0000","last_peered":"2024-09-22T08:56:16.426367+0000","last_clean":"2024-09-22T08:56:16.426367+0000","last_became_active":"2024-09-22T08:31:14.256055+0000","last_became_peered":"2024-09-22T08:31:14.256055+0000","last_unstale":"2024-09-22T08:56:16.426367+0000","last_undegraded":"2024-09-22T08:56:16.426367+0000","last_fullsized":"2024-09-22T08:56:16.426367+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:48:31.013743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":18434,"num_write":18,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"263'8","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.321761+0000","last_change":"2024-09-22T08:31:11.215990+0000","last_active":"2024-09-22T08:56:16.321761+0000","last_peered":"2024-09-22T08:56:16.321761+0000","last_clean":"2024-09-22T08:56:16.321761+0000","last_became_active":"2024-09-22T08:31:11.215609+0000","last_became_peered":"2024-09-22T08:31:11.215609+0000","last_unstale":"2024-09-22T08:56:16.321761+0000","last_undegraded":"2024-09-22T08:56:16.321761+0000","last_fullsized":"2024-09-22T08:56:16.321761+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:52:29.022225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":18,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"263'42","reported_seq":155,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:37.283579+0000","last_change":"2024-09-22T08:29:26.067779+0000","last_active":"2024-09-22T08:53:37.283579+0000","last_peered":"2024-09-22T08:53:37.283579+0000","last_clean":"2024-09-22T08:53:37.283579+0000","last_became_active":"2024-09-22T08:29:26.066447+0000","last_became_peered":"2024-09-22T08:29:26.066447+0000","last_unstale":"2024-09-22T08:53:37.283579+0000","last_undegraded":"2024-09-22T08:53:37.283579+0000","last_fullsized":"2024-09-22T08:53:37.283579+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:16:11.771113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":325,"num_read_kb":214,"num_write":107,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:57.286263+0000","last_change":"2024-09-22T08:42:17.436182+0000","last_active":"2024-09-22T08:53:57.286263+0000","last_peered":"2024-09-22T08:53:57.286263+0000","last_clean":"2024-09-22T08:53:57.286263+0000","last_became_active":"2024-09-22T08:42:17.435842+0000","last_became_peered":"2024-09-22T08:42:17.435842+0000","last_unstale":"2024-09-22T08:53:57.286263+0000","last_undegraded":"2024-09-22T08:53:57.286263+0000","last_fullsized":"2024-09-22T08:53:57.286263+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:44:56.306198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"263'2","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:27.307511+0000","last_change":"2024-09-22T08:31:14.255793+0000","last_active":"2024-09-22T08:55:27.307511+0000","last_peered":"2024-09-22T08:55:27.307511+0000","last_clean":"2024-09-22T08:55:27.307511+0000","last_became_active":"2024-09-22T08:31:14.255497+0000","last_became_peered":"2024-09-22T08:31:14.255497+0000","last_unstale":"2024-09-22T08:55:27.307511+0000","last_undegraded":"2024-09-22T08:55:27.307511+0000","last_fullsized":"2024-09-22T08:55:27.307511+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:31.376498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"263'3","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:13.383058+0000","last_change":"2024-09-22T08:31:11.217315+0000","last_active":"2024-09-22T08:52:13.383058+0000","last_peered":"2024-09-22T08:52:13.383058+0000","last_clean":"2024-09-22T08:52:13.383058+0000","last_became_active":"2024-09-22T08:31:11.216997+0000","last_became_peered":"2024-09-22T08:31:11.216997+0000","last_unstale":"2024-09-22T08:52:13.383058+0000","last_undegraded":"2024-09-22T08:52:13.383058+0000","last_fullsized":"2024-09-22T08:52:13.383058+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:29.441399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"263'25","reported_seq":111,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:37.405734+0000","last_change":"2024-09-22T08:29:26.071169+0000","last_active":"2024-09-22T08:53:37.405734+0000","last_peered":"2024-09-22T08:53:37.405734+0000","last_clean":"2024-09-22T08:53:37.405734+0000","last_became_active":"2024-09-22T08:29:26.070906+0000","last_became_peered":"2024-09-22T08:29:26.070906+0000","last_unstale":"2024-09-22T08:53:37.405734+0000","last_undegraded":"2024-09-22T08:53:37.405734+0000","last_fullsized":"2024-09-22T08:53:37.405734+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:55:47.696276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":135,"num_write":63,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:57.286143+0000","last_change":"2024-09-22T08:42:17.430752+0000","last_active":"2024-09-22T08:53:57.286143+0000","last_peered":"2024-09-22T08:53:57.286143+0000","last_clean":"2024-09-22T08:53:57.286143+0000","last_became_active":"2024-09-22T08:42:17.430457+0000","last_became_peered":"2024-09-22T08:42:17.430457+0000","last_unstale":"2024-09-22T08:53:57.286143+0000","last_undegraded":"2024-09-22T08:53:57.286143+0000","last_fullsized":"2024-09-22T08:53:57.286143+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:57:22.012215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"263'9","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.464617+0000","last_change":"2024-09-22T08:31:14.256126+0000","last_active":"2024-09-22T08:56:16.464617+0000","last_peered":"2024-09-22T08:56:16.464617+0000","last_clean":"2024-09-22T08:56:16.464617+0000","last_became_active":"2024-09-22T08:31:14.255245+0000","last_became_peered":"2024-09-22T08:31:14.255245+0000","last_unstale":"2024-09-22T08:56:16.464617+0000","last_undegraded":"2024-09-22T08:56:16.464617+0000","last_fullsized":"2024-09-22T08:56:16.464617+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:45:50.399892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":20480,"num_write":14,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"260'6","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:58.472145+0000","last_change":"2024-09-22T08:31:11.211294+0000","last_active":"2024-09-22T08:52:58.472145+0000","last_peered":"2024-09-22T08:52:58.472145+0000","last_clean":"2024-09-22T08:52:58.472145+0000","last_became_active":"2024-09-22T08:31:11.211000+0000","last_became_peered":"2024-09-22T08:31:11.211000+0000","last_unstale":"2024-09-22T08:52:58.472145+0000","last_undegraded":"2024-09-22T08:52:58.472145+0000","last_fullsized":"2024-09-22T08:52:58.472145+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:34:47.341250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8192,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"263'32","reported_seq":130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:37.405687+0000","last_change":"2024-09-22T08:29:26.075955+0000","last_active":"2024-09-22T08:53:37.405687+0000","last_peered":"2024-09-22T08:53:37.405687+0000","last_clean":"2024-09-22T08:53:37.405687+0000","last_became_active":"2024-09-22T08:29:26.074151+0000","last_became_peered":"2024-09-22T08:29:26.074151+0000","last_unstale":"2024-09-22T08:53:37.405687+0000","last_undegraded":"2024-09-22T08:53:37.405687+0000","last_fullsized":"2024-09-22T08:53:37.405687+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:36:04.989650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":180,"num_write":78,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:56.272330+0000","last_change":"2024-09-22T08:42:17.432351+0000","last_active":"2024-09-22T08:53:56.272330+0000","last_peered":"2024-09-22T08:53:56.272330+0000","last_clean":"2024-09-22T08:53:56.272330+0000","last_became_active":"2024-09-22T08:42:17.432056+0000","last_became_peered":"2024-09-22T08:42:17.432056+0000","last_unstale":"2024-09-22T08:53:56.272330+0000","last_undegraded":"2024-09-22T08:53:56.272330+0000","last_fullsized":"2024-09-22T08:53:56.272330+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:19:22.863621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"263'6","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.434342+0000","last_change":"2024-09-22T08:31:14.259324+0000","last_active":"2024-09-22T08:56:16.434342+0000","last_peered":"2024-09-22T08:56:16.434342+0000","last_clean":"2024-09-22T08:56:16.434342+0000","last_became_active":"2024-09-22T08:31:14.259009+0000","last_became_peered":"2024-09-22T08:31:14.259009+0000","last_unstale":"2024-09-22T08:56:16.434342+0000","last_undegraded":"2024-09-22T08:56:16.434342+0000","last_fullsized":"2024-09-22T08:56:16.434342+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:19:27.710241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8192,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"263'5","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:22.306782+0000","last_change":"2024-09-22T08:31:11.216003+0000","last_active":"2024-09-22T08:55:22.306782+0000","last_peered":"2024-09-22T08:55:22.306782+0000","last_clean":"2024-09-22T08:55:22.306782+0000","last_became_active":"2024-09-22T08:31:11.215708+0000","last_became_peered":"2024-09-22T08:31:11.215708+0000","last_unstale":"2024-09-22T08:55:22.306782+0000","last_undegraded":"2024-09-22T08:55:22.306782+0000","last_fullsized":"2024-09-22T08:55:22.306782+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:19:30.880256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"263'26","reported_seq":110,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:37.292875+0000","last_change":"2024-09-22T08:29:26.069760+0000","last_active":"2024-09-22T08:53:37.292875+0000","last_peered":"2024-09-22T08:53:37.292875+0000","last_clean":"2024-09-22T08:53:37.292875+0000","last_became_active":"2024-09-22T08:29:26.069440+0000","last_became_peered":"2024-09-22T08:29:26.069440+0000","last_unstale":"2024-09-22T08:53:37.292875+0000","last_undegraded":"2024-09-22T08:53:37.292875+0000","last_fullsized":"2024-09-22T08:53:37.292875+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:48:41.597112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":134,"num_write":69,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:38.461091+0000","last_change":"2024-09-22T08:42:17.436175+0000","last_active":"2024-09-22T08:51:38.461091+0000","last_peered":"2024-09-22T08:51:38.461091+0000","last_clean":"2024-09-22T08:51:38.461091+0000","last_became_active":"2024-09-22T08:42:17.435825+0000","last_became_peered":"2024-09-22T08:42:17.435825+0000","last_unstale":"2024-09-22T08:51:38.461091+0000","last_undegraded":"2024-09-22T08:51:38.461091+0000","last_fullsized":"2024-09-22T08:51:38.461091+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:50:07.804836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"260'2","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:58.472161+0000","last_change":"2024-09-22T08:31:14.256513+0000","last_active":"2024-09-22T08:52:58.472161+0000","last_peered":"2024-09-22T08:52:58.472161+0000","last_clean":"2024-09-22T08:52:58.472161+0000","last_became_active":"2024-09-22T08:31:14.256218+0000","last_became_peered":"2024-09-22T08:31:14.256218+0000","last_unstale":"2024-09-22T08:52:58.472161+0000","last_undegraded":"2024-09-22T08:52:58.472161+0000","last_fullsized":"2024-09-22T08:52:58.472161+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:27:57.407928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:57.277949+0000","last_change":"2024-09-22T08:31:11.214383+0000","last_active":"2024-09-22T08:52:57.277949+0000","last_peered":"2024-09-22T08:52:57.277949+0000","last_clean":"2024-09-22T08:52:57.277949+0000","last_became_active":"2024-09-22T08:31:11.214111+0000","last_became_peered":"2024-09-22T08:31:11.214111+0000","last_unstale":"2024-09-22T08:52:57.277949+0000","last_undegraded":"2024-09-22T08:52:57.277949+0000","last_fullsized":"2024-09-22T08:52:57.277949+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:55:25.197395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"263'20","reported_seq":95,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:53.388471+0000","last_change":"2024-09-22T08:29:26.069573+0000","last_active":"2024-09-22T08:52:53.388471+0000","last_peered":"2024-09-22T08:52:53.388471+0000","last_clean":"2024-09-22T08:52:53.388471+0000","last_became_active":"2024-09-22T08:29:26.069293+0000","last_became_peered":"2024-09-22T08:29:26.069293+0000","last_unstale":"2024-09-22T08:52:53.388471+0000","last_undegraded":"2024-09-22T08:52:53.388471+0000","last_fullsized":"2024-09-22T08:52:53.388471+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:06:27.426634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":89,"num_write":52,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:57.268896+0000","last_change":"2024-09-22T08:42:17.429646+0000","last_active":"2024-09-22T08:51:57.268896+0000","last_peered":"2024-09-22T08:51:57.268896+0000","last_clean":"2024-09-22T08:51:57.268896+0000","last_became_active":"2024-09-22T08:42:17.429163+0000","last_became_peered":"2024-09-22T08:42:17.429163+0000","last_unstale":"2024-09-22T08:51:57.268896+0000","last_undegraded":"2024-09-22T08:51:57.268896+0000","last_fullsized":"2024-09-22T08:51:57.268896+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:52:58.326332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"263'2","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:37.292485+0000","last_change":"2024-09-22T08:31:14.259778+0000","last_active":"2024-09-22T08:54:37.292485+0000","last_peered":"2024-09-22T08:54:37.292485+0000","last_clean":"2024-09-22T08:54:37.292485+0000","last_became_active":"2024-09-22T08:31:14.259484+0000","last_became_peered":"2024-09-22T08:31:14.259484+0000","last_unstale":"2024-09-22T08:54:37.292485+0000","last_undegraded":"2024-09-22T08:54:37.292485+0000","last_fullsized":"2024-09-22T08:54:37.292485+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:10:58.591122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"263'5","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:13.382709+0000","last_change":"2024-09-22T08:31:11.203333+0000","last_active":"2024-09-22T08:52:13.382709+0000","last_peered":"2024-09-22T08:52:13.382709+0000","last_clean":"2024-09-22T08:52:13.382709+0000","last_became_active":"2024-09-22T08:31:11.203053+0000","last_became_peered":"2024-09-22T08:31:11.203053+0000","last_unstale":"2024-09-22T08:52:13.382709+0000","last_undegraded":"2024-09-22T08:52:13.382709+0000","last_fullsized":"2024-09-22T08:52:13.382709+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:29:11.633546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48419,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":4146,"num_write":5,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"263'318","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:48.387936+0000","last_change":"2024-09-22T08:29:26.070758+0000","last_active":"2024-09-22T08:52:48.387936+0000","last_peered":"2024-09-22T08:52:48.387936+0000","last_clean":"2024-09-22T08:52:48.387936+0000","last_became_active":"2024-09-22T08:29:26.070475+0000","last_became_peered":"2024-09-22T08:29:26.070475+0000","last_unstale":"2024-09-22T08:52:48.387936+0000","last_undegraded":"2024-09-22T08:52:48.387936+0000","last_fullsized":"2024-09-22T08:52:48.387936+0000","mapping_epoch":252,"log_start":"263'300","ondisk_log_start":"263'300","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:21:22.076883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2975,"num_read_kb":3480,"num_write":654,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:57.268912+0000","last_change":"2024-09-22T08:42:17.431838+0000","last_active":"2024-09-22T08:51:57.268912+0000","last_peered":"2024-09-22T08:51:57.268912+0000","last_clean":"2024-09-22T08:51:57.268912+0000","last_became_active":"2024-09-22T08:42:17.431528+0000","last_became_peered":"2024-09-22T08:42:17.431528+0000","last_unstale":"2024-09-22T08:51:57.268912+0000","last_undegraded":"2024-09-22T08:51:57.268912+0000","last_fullsized":"2024-09-22T08:51:57.268912+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:29:19.259078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:17.271924+0000","last_change":"2024-09-22T08:31:14.256347+0000","last_active":"2024-09-22T08:52:17.271924+0000","last_peered":"2024-09-22T08:52:17.271924+0000","last_clean":"2024-09-22T08:52:17.271924+0000","last_became_active":"2024-09-22T08:31:14.256054+0000","last_became_peered":"2024-09-22T08:31:14.256054+0000","last_unstale":"2024-09-22T08:52:17.271924+0000","last_undegraded":"2024-09-22T08:52:17.271924+0000","last_fullsized":"2024-09-22T08:52:17.271924+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:02:08.137287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"263'8","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.323100+0000","last_change":"2024-09-22T08:31:11.213551+0000","last_active":"2024-09-22T08:56:16.323100+0000","last_peered":"2024-09-22T08:56:16.323100+0000","last_clean":"2024-09-22T08:56:16.323100+0000","last_became_active":"2024-09-22T08:31:11.212539+0000","last_became_peered":"2024-09-22T08:31:11.212539+0000","last_unstale":"2024-09-22T08:56:16.323100+0000","last_undegraded":"2024-09-22T08:56:16.323100+0000","last_fullsized":"2024-09-22T08:56:16.323100+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:38:43.370688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":18,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"263'51","reported_seq":176,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:47.088466+0000","last_change":"2024-09-22T08:29:26.070905+0000","last_active":"2024-09-22T08:53:47.088466+0000","last_peered":"2024-09-22T08:53:47.088466+0000","last_clean":"2024-09-22T08:53:47.088466+0000","last_became_active":"2024-09-22T08:29:26.070576+0000","last_became_peered":"2024-09-22T08:29:26.070576+0000","last_unstale":"2024-09-22T08:53:47.088466+0000","last_undegraded":"2024-09-22T08:53:47.088466+0000","last_fullsized":"2024-09-22T08:53:47.088466+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:55:10.934768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":389,"num_read_kb":252,"num_write":129,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:42.389903+0000","last_change":"2024-09-22T08:42:17.426058+0000","last_active":"2024-09-22T08:51:42.389903+0000","last_peered":"2024-09-22T08:51:42.389903+0000","last_clean":"2024-09-22T08:51:42.389903+0000","last_became_active":"2024-09-22T08:42:17.425759+0000","last_became_peered":"2024-09-22T08:42:17.425759+0000","last_unstale":"2024-09-22T08:51:42.389903+0000","last_undegraded":"2024-09-22T08:51:42.389903+0000","last_fullsized":"2024-09-22T08:51:42.389903+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:58:13.952750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"263'2","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:37.300796+0000","last_change":"2024-09-22T08:31:14.258185+0000","last_active":"2024-09-22T08:54:37.300796+0000","last_peered":"2024-09-22T08:54:37.300796+0000","last_clean":"2024-09-22T08:54:37.300796+0000","last_became_active":"2024-09-22T08:31:14.257900+0000","last_became_peered":"2024-09-22T08:31:14.257900+0000","last_unstale":"2024-09-22T08:54:37.300796+0000","last_undegraded":"2024-09-22T08:54:37.300796+0000","last_fullsized":"2024-09-22T08:54:37.300796+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:24:42.015943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":118,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"263'5","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:13.382766+0000","last_change":"2024-09-22T08:31:11.205171+0000","last_active":"2024-09-22T08:52:13.382766+0000","last_peered":"2024-09-22T08:52:13.382766+0000","last_clean":"2024-09-22T08:52:13.382766+0000","last_became_active":"2024-09-22T08:31:11.204846+0000","last_became_peered":"2024-09-22T08:31:11.204846+0000","last_unstale":"2024-09-22T08:52:13.382766+0000","last_undegraded":"2024-09-22T08:52:13.382766+0000","last_fullsized":"2024-09-22T08:52:13.382766+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:09:45.501944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":6146,"num_write":5,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"263'48","reported_seq":173,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:50.979504+0000","last_change":"2024-09-22T08:29:26.064230+0000","last_active":"2024-09-22T08:53:50.979504+0000","last_peered":"2024-09-22T08:53:50.979504+0000","last_clean":"2024-09-22T08:53:50.979504+0000","last_became_active":"2024-09-22T08:29:26.063914+0000","last_became_peered":"2024-09-22T08:29:26.063914+0000","last_unstale":"2024-09-22T08:53:50.979504+0000","last_undegraded":"2024-09-22T08:53:50.979504+0000","last_fullsized":"2024-09-22T08:53:50.979504+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:49.440925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":381,"num_read_kb":265,"num_write":119,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:57.268871+0000","last_change":"2024-09-22T08:42:17.431413+0000","last_active":"2024-09-22T08:51:57.268871+0000","last_peered":"2024-09-22T08:51:57.268871+0000","last_clean":"2024-09-22T08:51:57.268871+0000","last_became_active":"2024-09-22T08:42:17.429964+0000","last_became_peered":"2024-09-22T08:42:17.429964+0000","last_unstale":"2024-09-22T08:51:57.268871+0000","last_undegraded":"2024-09-22T08:51:57.268871+0000","last_fullsized":"2024-09-22T08:51:57.268871+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:20:04.762853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"260'4","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:18.383736+0000","last_change":"2024-09-22T08:31:14.260215+0000","last_active":"2024-09-22T08:52:18.383736+0000","last_peered":"2024-09-22T08:52:18.383736+0000","last_clean":"2024-09-22T08:52:18.383736+0000","last_became_active":"2024-09-22T08:31:14.259875+0000","last_became_peered":"2024-09-22T08:31:14.259875+0000","last_unstale":"2024-09-22T08:52:18.383736+0000","last_undegraded":"2024-09-22T08:52:18.383736+0000","last_fullsized":"2024-09-22T08:52:18.383736+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:27:56.369023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:13.382799+0000","last_change":"2024-09-22T08:31:11.210358+0000","last_active":"2024-09-22T08:52:13.382799+0000","last_peered":"2024-09-22T08:52:13.382799+0000","last_clean":"2024-09-22T08:52:13.382799+0000","last_became_active":"2024-09-22T08:31:11.210054+0000","last_became_peered":"2024-09-22T08:31:11.210054+0000","last_unstale":"2024-09-22T08:52:13.382799+0000","last_undegraded":"2024-09-22T08:52:13.382799+0000","last_fullsized":"2024-09-22T08:52:13.382799+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:51:41.210904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"263'31","reported_seq":129,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:47.285810+0000","last_change":"2024-09-22T08:29:26.070816+0000","last_active":"2024-09-22T08:52:47.285810+0000","last_peered":"2024-09-22T08:52:47.285810+0000","last_clean":"2024-09-22T08:52:47.285810+0000","last_became_active":"2024-09-22T08:29:26.070492+0000","last_became_peered":"2024-09-22T08:29:26.070492+0000","last_unstale":"2024-09-22T08:52:47.285810+0000","last_undegraded":"2024-09-22T08:52:47.285810+0000","last_fullsized":"2024-09-22T08:52:47.285810+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:33:45.551687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":169,"num_write":83,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:12.279928+0000","last_change":"2024-09-22T08:42:17.433621+0000","last_active":"2024-09-22T08:53:12.279928+0000","last_peered":"2024-09-22T08:53:12.279928+0000","last_clean":"2024-09-22T08:53:12.279928+0000","last_became_active":"2024-09-22T08:42:17.433193+0000","last_became_peered":"2024-09-22T08:42:17.433193+0000","last_unstale":"2024-09-22T08:53:12.279928+0000","last_undegraded":"2024-09-22T08:53:12.279928+0000","last_fullsized":"2024-09-22T08:53:12.279928+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:13.472859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:47.294076+0000","last_change":"2024-09-22T08:31:14.255077+0000","last_active":"2024-09-22T08:53:47.294076+0000","last_peered":"2024-09-22T08:53:47.294076+0000","last_clean":"2024-09-22T08:53:47.294076+0000","last_became_active":"2024-09-22T08:31:14.254710+0000","last_became_peered":"2024-09-22T08:31:14.254710+0000","last_unstale":"2024-09-22T08:53:47.294076+0000","last_undegraded":"2024-09-22T08:53:47.294076+0000","last_fullsized":"2024-09-22T08:53:47.294076+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:21:50.613490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:41.270510+0000","last_change":"2024-09-22T08:31:11.203734+0000","last_active":"2024-09-22T08:53:41.270510+0000","last_peered":"2024-09-22T08:53:41.270510+0000","last_clean":"2024-09-22T08:53:41.270510+0000","last_became_active":"2024-09-22T08:31:11.203413+0000","last_became_peered":"2024-09-22T08:31:11.203413+0000","last_unstale":"2024-09-22T08:53:41.270510+0000","last_undegraded":"2024-09-22T08:53:41.270510+0000","last_fullsized":"2024-09-22T08:53:41.270510+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:44:09.630276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:07.280107+0000","last_change":"2024-09-22T08:29:26.072040+0000","last_active":"2024-09-22T08:52:07.280107+0000","last_peered":"2024-09-22T08:52:07.280107+0000","last_clean":"2024-09-22T08:52:07.280107+0000","last_became_active":"2024-09-22T08:29:26.071742+0000","last_became_peered":"2024-09-22T08:29:26.071742+0000","last_unstale":"2024-09-22T08:52:07.280107+0000","last_undegraded":"2024-09-22T08:52:07.280107+0000","last_fullsized":"2024-09-22T08:52:07.280107+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:02:35.173782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:33.393176+0000","last_change":"2024-09-22T08:42:17.433663+0000","last_active":"2024-09-22T08:53:33.393176+0000","last_peered":"2024-09-22T08:53:33.393176+0000","last_clean":"2024-09-22T08:53:33.393176+0000","last_became_active":"2024-09-22T08:42:17.433346+0000","last_became_peered":"2024-09-22T08:42:17.433346+0000","last_unstale":"2024-09-22T08:53:33.393176+0000","last_undegraded":"2024-09-22T08:53:33.393176+0000","last_fullsized":"2024-09-22T08:53:33.393176+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:42:29.816828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"260'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:47.294055+0000","last_change":"2024-09-22T08:31:14.256186+0000","last_active":"2024-09-22T08:53:47.294055+0000","last_peered":"2024-09-22T08:53:47.294055+0000","last_clean":"2024-09-22T08:53:47.294055+0000","last_became_active":"2024-09-22T08:31:14.255243+0000","last_became_peered":"2024-09-22T08:31:14.255243+0000","last_unstale":"2024-09-22T08:53:47.294055+0000","last_undegraded":"2024-09-22T08:53:47.294055+0000","last_fullsized":"2024-09-22T08:53:47.294055+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:14:49.285058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"263'6","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.322059+0000","last_change":"2024-09-22T08:31:11.210583+0000","last_active":"2024-09-22T08:56:16.322059+0000","last_peered":"2024-09-22T08:56:16.322059+0000","last_clean":"2024-09-22T08:56:16.322059+0000","last_became_active":"2024-09-22T08:31:11.210266+0000","last_became_peered":"2024-09-22T08:31:11.210266+0000","last_unstale":"2024-09-22T08:56:16.322059+0000","last_undegraded":"2024-09-22T08:56:16.322059+0000","last_fullsized":"2024-09-22T08:56:16.322059+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:55:04.094565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":13312,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"263'39","reported_seq":148,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:56.069487+0000","last_change":"2024-09-22T08:29:26.076488+0000","last_active":"2024-09-22T08:52:56.069487+0000","last_peered":"2024-09-22T08:52:56.069487+0000","last_clean":"2024-09-22T08:52:56.069487+0000","last_became_active":"2024-09-22T08:29:26.076175+0000","last_became_peered":"2024-09-22T08:29:26.076175+0000","last_unstale":"2024-09-22T08:52:56.069487+0000","last_undegraded":"2024-09-22T08:52:56.069487+0000","last_fullsized":"2024-09-22T08:52:56.069487+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:10:01.915865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":317,"num_read_kb":219,"num_write":102,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:08.390223+0000","last_change":"2024-09-22T08:42:17.435167+0000","last_active":"2024-09-22T08:53:08.390223+0000","last_peered":"2024-09-22T08:53:08.390223+0000","last_clean":"2024-09-22T08:53:08.390223+0000","last_became_active":"2024-09-22T08:42:17.434909+0000","last_became_peered":"2024-09-22T08:42:17.434909+0000","last_unstale":"2024-09-22T08:53:08.390223+0000","last_undegraded":"2024-09-22T08:53:08.390223+0000","last_fullsized":"2024-09-22T08:53:08.390223+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:22.417079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"263'4","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:07.313078+0000","last_change":"2024-09-22T08:31:14.252478+0000","last_active":"2024-09-22T08:56:07.313078+0000","last_peered":"2024-09-22T08:56:07.313078+0000","last_clean":"2024-09-22T08:56:07.313078+0000","last_became_active":"2024-09-22T08:31:14.252184+0000","last_became_peered":"2024-09-22T08:31:14.252184+0000","last_unstale":"2024-09-22T08:56:07.313078+0000","last_undegraded":"2024-09-22T08:56:07.313078+0000","last_fullsized":"2024-09-22T08:56:07.313078+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:09.321417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":4,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"263'2","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:57.311651+0000","last_change":"2024-09-22T08:31:11.218103+0000","last_active":"2024-09-22T08:55:57.311651+0000","last_peered":"2024-09-22T08:55:57.311651+0000","last_clean":"2024-09-22T08:55:57.311651+0000","last_became_active":"2024-09-22T08:31:11.217115+0000","last_became_peered":"2024-09-22T08:31:11.217115+0000","last_unstale":"2024-09-22T08:55:57.311651+0000","last_undegraded":"2024-09-22T08:55:57.311651+0000","last_fullsized":"2024-09-22T08:55:57.311651+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:15:42.708378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"263'57","reported_seq":192,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:58.380936+0000","last_change":"2024-09-22T08:29:26.076353+0000","last_active":"2024-09-22T08:51:58.380936+0000","last_peered":"2024-09-22T08:51:58.380936+0000","last_clean":"2024-09-22T08:51:58.380936+0000","last_became_active":"2024-09-22T08:29:26.076048+0000","last_became_peered":"2024-09-22T08:29:26.076048+0000","last_unstale":"2024-09-22T08:51:58.380936+0000","last_undegraded":"2024-09-22T08:51:58.380936+0000","last_fullsized":"2024-09-22T08:51:58.380936+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:12:53.422787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":427,"num_read_kb":265,"num_write":151,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:08.389849+0000","last_change":"2024-09-22T08:42:17.431316+0000","last_active":"2024-09-22T08:53:08.389849+0000","last_peered":"2024-09-22T08:53:08.389849+0000","last_clean":"2024-09-22T08:53:08.389849+0000","last_became_active":"2024-09-22T08:42:17.430974+0000","last_became_peered":"2024-09-22T08:42:17.430974+0000","last_unstale":"2024-09-22T08:53:08.389849+0000","last_undegraded":"2024-09-22T08:53:08.389849+0000","last_fullsized":"2024-09-22T08:53:08.389849+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:40:42.175541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"260'3","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:47.284984+0000","last_change":"2024-09-22T08:31:14.258289+0000","last_active":"2024-09-22T08:53:47.284984+0000","last_peered":"2024-09-22T08:53:47.284984+0000","last_clean":"2024-09-22T08:53:47.284984+0000","last_became_active":"2024-09-22T08:31:14.257952+0000","last_became_peered":"2024-09-22T08:31:14.257952+0000","last_unstale":"2024-09-22T08:53:47.284984+0000","last_undegraded":"2024-09-22T08:53:47.284984+0000","last_fullsized":"2024-09-22T08:53:47.284984+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:26:33.079615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:47.294104+0000","last_change":"2024-09-22T08:31:11.214070+0000","last_active":"2024-09-22T08:53:47.294104+0000","last_peered":"2024-09-22T08:53:47.294104+0000","last_clean":"2024-09-22T08:53:47.294104+0000","last_became_active":"2024-09-22T08:31:11.213273+0000","last_became_peered":"2024-09-22T08:31:11.213273+0000","last_unstale":"2024-09-22T08:53:47.294104+0000","last_undegraded":"2024-09-22T08:53:47.294104+0000","last_fullsized":"2024-09-22T08:53:47.294104+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:48:59.089464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"263'16","reported_seq":83,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:50.237668+0000","last_change":"2024-09-22T08:29:26.074703+0000","last_active":"2024-09-22T08:53:50.237668+0000","last_peered":"2024-09-22T08:53:50.237668+0000","last_clean":"2024-09-22T08:53:50.237668+0000","last_became_active":"2024-09-22T08:29:26.074205+0000","last_became_peered":"2024-09-22T08:29:26.074205+0000","last_unstale":"2024-09-22T08:53:50.237668+0000","last_undegraded":"2024-09-22T08:53:50.237668+0000","last_fullsized":"2024-09-22T08:53:50.237668+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:39:29.451981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":71,"num_write":43,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:32.283041+0000","last_change":"2024-09-22T08:42:17.430839+0000","last_active":"2024-09-22T08:53:32.283041+0000","last_peered":"2024-09-22T08:53:32.283041+0000","last_clean":"2024-09-22T08:53:32.283041+0000","last_became_active":"2024-09-22T08:42:17.429927+0000","last_became_peered":"2024-09-22T08:42:17.429927+0000","last_unstale":"2024-09-22T08:53:32.283041+0000","last_undegraded":"2024-09-22T08:53:32.283041+0000","last_fullsized":"2024-09-22T08:53:32.283041+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:28:06.806210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"263'5","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:58.388987+0000","last_change":"2024-09-22T08:31:14.253906+0000","last_active":"2024-09-22T08:52:58.388987+0000","last_peered":"2024-09-22T08:52:58.388987+0000","last_clean":"2024-09-22T08:52:58.388987+0000","last_became_active":"2024-09-22T08:31:14.253610+0000","last_became_peered":"2024-09-22T08:31:14.253610+0000","last_unstale":"2024-09-22T08:52:58.388987+0000","last_undegraded":"2024-09-22T08:52:58.388987+0000","last_fullsized":"2024-09-22T08:52:58.388987+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:13:39.366489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":13314,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"263'4","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.380507+0000","last_change":"2024-09-22T08:31:11.217832+0000","last_active":"2024-09-22T08:56:16.380507+0000","last_peered":"2024-09-22T08:56:16.380507+0000","last_clean":"2024-09-22T08:56:16.380507+0000","last_became_active":"2024-09-22T08:31:11.217553+0000","last_became_peered":"2024-09-22T08:31:11.217553+0000","last_unstale":"2024-09-22T08:56:16.380507+0000","last_undegraded":"2024-09-22T08:56:16.380507+0000","last_fullsized":"2024-09-22T08:56:16.380507+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:22:26.456715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"263'36","reported_seq":134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:57.268762+0000","last_change":"2024-09-22T08:29:26.070957+0000","last_active":"2024-09-22T08:51:57.268762+0000","last_peered":"2024-09-22T08:51:57.268762+0000","last_clean":"2024-09-22T08:51:57.268762+0000","last_became_active":"2024-09-22T08:29:26.070671+0000","last_became_peered":"2024-09-22T08:29:26.070671+0000","last_unstale":"2024-09-22T08:51:57.268762+0000","last_undegraded":"2024-09-22T08:51:57.268762+0000","last_fullsized":"2024-09-22T08:51:57.268762+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:28:38.453942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":255,"num_read_kb":155,"num_write":90,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:36.270019+0000","last_change":"2024-09-22T08:42:17.433684+0000","last_active":"2024-09-22T08:53:36.270019+0000","last_peered":"2024-09-22T08:53:36.270019+0000","last_clean":"2024-09-22T08:53:36.270019+0000","last_became_active":"2024-09-22T08:42:17.433331+0000","last_became_peered":"2024-09-22T08:42:17.433331+0000","last_unstale":"2024-09-22T08:53:36.270019+0000","last_undegraded":"2024-09-22T08:53:36.270019+0000","last_fullsized":"2024-09-22T08:53:36.270019+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:19:35.698543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"263'3","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:56.264954+0000","last_change":"2024-09-22T08:31:14.253520+0000","last_active":"2024-09-22T08:52:56.264954+0000","last_peered":"2024-09-22T08:52:56.264954+0000","last_clean":"2024-09-22T08:52:56.264954+0000","last_became_active":"2024-09-22T08:31:14.253118+0000","last_became_peered":"2024-09-22T08:31:14.253118+0000","last_unstale":"2024-09-22T08:52:56.264954+0000","last_undegraded":"2024-09-22T08:52:56.264954+0000","last_fullsized":"2024-09-22T08:52:56.264954+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:35:19.513521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"263'9","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:02.296482+0000","last_change":"2024-09-22T08:31:11.212852+0000","last_active":"2024-09-22T08:55:02.296482+0000","last_peered":"2024-09-22T08:55:02.296482+0000","last_clean":"2024-09-22T08:55:02.296482+0000","last_became_active":"2024-09-22T08:31:11.211939+0000","last_became_peered":"2024-09-22T08:31:11.211939+0000","last_unstale":"2024-09-22T08:55:02.296482+0000","last_undegraded":"2024-09-22T08:55:02.296482+0000","last_fullsized":"2024-09-22T08:55:02.296482+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:24:50.321996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":24578,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"263'43","reported_seq":155,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:21.268004+0000","last_change":"2024-09-22T08:29:26.069502+0000","last_active":"2024-09-22T08:53:21.268004+0000","last_peered":"2024-09-22T08:53:21.268004+0000","last_clean":"2024-09-22T08:53:21.268004+0000","last_became_active":"2024-09-22T08:29:26.069202+0000","last_became_peered":"2024-09-22T08:29:26.069202+0000","last_unstale":"2024-09-22T08:53:21.268004+0000","last_undegraded":"2024-09-22T08:53:21.268004+0000","last_fullsized":"2024-09-22T08:53:21.268004+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:00:21.857731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":316,"num_read_kb":207,"num_write":121,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:33.476466+0000","last_change":"2024-09-22T08:42:17.436971+0000","last_active":"2024-09-22T08:53:33.476466+0000","last_peered":"2024-09-22T08:53:33.476466+0000","last_clean":"2024-09-22T08:53:33.476466+0000","last_became_active":"2024-09-22T08:42:17.436036+0000","last_became_peered":"2024-09-22T08:42:17.436036+0000","last_unstale":"2024-09-22T08:53:33.476466+0000","last_undegraded":"2024-09-22T08:53:33.476466+0000","last_fullsized":"2024-09-22T08:53:33.476466+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:15:23.383676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"260'6","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:47.284803+0000","last_change":"2024-09-22T08:31:14.260840+0000","last_active":"2024-09-22T08:53:47.284803+0000","last_peered":"2024-09-22T08:53:47.284803+0000","last_clean":"2024-09-22T08:53:47.284803+0000","last_became_active":"2024-09-22T08:31:14.260111+0000","last_became_peered":"2024-09-22T08:31:14.260111+0000","last_unstale":"2024-09-22T08:53:47.284803+0000","last_undegraded":"2024-09-22T08:53:47.284803+0000","last_fullsized":"2024-09-22T08:53:47.284803+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:54:00.288860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"263'5","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.322290+0000","last_change":"2024-09-22T08:31:11.213758+0000","last_active":"2024-09-22T08:56:16.322290+0000","last_peered":"2024-09-22T08:56:16.322290+0000","last_clean":"2024-09-22T08:56:16.322290+0000","last_became_active":"2024-09-22T08:31:11.213121+0000","last_became_peered":"2024-09-22T08:31:11.213121+0000","last_unstale":"2024-09-22T08:56:16.322290+0000","last_undegraded":"2024-09-22T08:56:16.322290+0000","last_fullsized":"2024-09-22T08:56:16.322290+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:13:15.074520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"263'24","reported_seq":106,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:17.280800+0000","last_change":"2024-09-22T08:29:26.068711+0000","last_active":"2024-09-22T08:53:17.280800+0000","last_peered":"2024-09-22T08:53:17.280800+0000","last_clean":"2024-09-22T08:53:17.280800+0000","last_became_active":"2024-09-22T08:29:26.068397+0000","last_became_peered":"2024-09-22T08:29:26.068397+0000","last_unstale":"2024-09-22T08:53:17.280800+0000","last_undegraded":"2024-09-22T08:53:17.280800+0000","last_fullsized":"2024-09-22T08:53:17.280800+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:31:42.395480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":108,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:32.292011+0000","last_change":"2024-09-22T08:42:17.431775+0000","last_active":"2024-09-22T08:53:32.292011+0000","last_peered":"2024-09-22T08:53:32.292011+0000","last_clean":"2024-09-22T08:53:32.292011+0000","last_became_active":"2024-09-22T08:42:17.431476+0000","last_became_peered":"2024-09-22T08:42:17.431476+0000","last_unstale":"2024-09-22T08:53:32.292011+0000","last_undegraded":"2024-09-22T08:53:32.292011+0000","last_fullsized":"2024-09-22T08:53:32.292011+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:20.126935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"263'1","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:58.472094+0000","last_change":"2024-09-22T08:31:14.257816+0000","last_active":"2024-09-22T08:52:58.472094+0000","last_peered":"2024-09-22T08:52:58.472094+0000","last_clean":"2024-09-22T08:52:58.472094+0000","last_became_active":"2024-09-22T08:31:14.257508+0000","last_became_peered":"2024-09-22T08:31:14.257508+0000","last_unstale":"2024-09-22T08:52:58.472094+0000","last_undegraded":"2024-09-22T08:52:58.472094+0000","last_fullsized":"2024-09-22T08:52:58.472094+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:30.899995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:43.394740+0000","last_change":"2024-09-22T08:31:11.215332+0000","last_active":"2024-09-22T08:53:43.394740+0000","last_peered":"2024-09-22T08:53:43.394740+0000","last_clean":"2024-09-22T08:53:43.394740+0000","last_became_active":"2024-09-22T08:31:11.214953+0000","last_became_peered":"2024-09-22T08:31:11.214953+0000","last_unstale":"2024-09-22T08:53:43.394740+0000","last_undegraded":"2024-09-22T08:53:43.394740+0000","last_fullsized":"2024-09-22T08:53:43.394740+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:54:54.175587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"263'16","reported_seq":88,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:18.474308+0000","last_change":"2024-09-22T08:29:26.072747+0000","last_active":"2024-09-22T08:53:18.474308+0000","last_peered":"2024-09-22T08:53:18.474308+0000","last_clean":"2024-09-22T08:53:18.474308+0000","last_became_active":"2024-09-22T08:29:26.072473+0000","last_became_peered":"2024-09-22T08:29:26.072473+0000","last_unstale":"2024-09-22T08:53:18.474308+0000","last_undegraded":"2024-09-22T08:53:18.474308+0000","last_fullsized":"2024-09-22T08:53:18.474308+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:22.926382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":83,"num_write":41,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:43.469960+0000","last_change":"2024-09-22T08:42:17.431917+0000","last_active":"2024-09-22T08:52:43.469960+0000","last_peered":"2024-09-22T08:52:43.469960+0000","last_clean":"2024-09-22T08:52:43.469960+0000","last_became_active":"2024-09-22T08:42:17.431637+0000","last_became_peered":"2024-09-22T08:42:17.431637+0000","last_unstale":"2024-09-22T08:52:43.469960+0000","last_undegraded":"2024-09-22T08:52:43.469960+0000","last_fullsized":"2024-09-22T08:52:43.469960+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:33:12.811194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"263'4","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.434444+0000","last_change":"2024-09-22T08:31:14.261671+0000","last_active":"2024-09-22T08:56:16.434444+0000","last_peered":"2024-09-22T08:56:16.434444+0000","last_clean":"2024-09-22T08:56:16.434444+0000","last_became_active":"2024-09-22T08:31:14.261352+0000","last_became_peered":"2024-09-22T08:31:14.261352+0000","last_unstale":"2024-09-22T08:56:16.434444+0000","last_undegraded":"2024-09-22T08:56:16.434444+0000","last_fullsized":"2024-09-22T08:56:16.434444+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:19:15.325599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"263'5","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:08.397654+0000","last_change":"2024-09-22T08:31:11.216385+0000","last_active":"2024-09-22T08:54:08.397654+0000","last_peered":"2024-09-22T08:54:08.397654+0000","last_clean":"2024-09-22T08:54:08.397654+0000","last_became_active":"2024-09-22T08:31:11.216081+0000","last_became_peered":"2024-09-22T08:31:11.216081+0000","last_unstale":"2024-09-22T08:54:08.397654+0000","last_undegraded":"2024-09-22T08:54:08.397654+0000","last_fullsized":"2024-09-22T08:54:08.397654+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:17:40.729275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":5,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"253'4","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:17.402881+0000","last_change":"2024-09-22T08:29:26.073082+0000","last_active":"2024-09-22T08:53:17.402881+0000","last_peered":"2024-09-22T08:53:17.402881+0000","last_clean":"2024-09-22T08:53:17.402881+0000","last_became_active":"2024-09-22T08:29:26.072681+0000","last_became_peered":"2024-09-22T08:29:26.072681+0000","last_unstale":"2024-09-22T08:53:17.402881+0000","last_undegraded":"2024-09-22T08:53:17.402881+0000","last_fullsized":"2024-09-22T08:53:17.402881+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:10:40.106076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:43.469980+0000","last_change":"2024-09-22T08:42:17.432516+0000","last_active":"2024-09-22T08:52:43.469980+0000","last_peered":"2024-09-22T08:52:43.469980+0000","last_clean":"2024-09-22T08:52:43.469980+0000","last_became_active":"2024-09-22T08:42:17.430084+0000","last_became_peered":"2024-09-22T08:42:17.430084+0000","last_unstale":"2024-09-22T08:52:43.469980+0000","last_undegraded":"2024-09-22T08:52:43.469980+0000","last_fullsized":"2024-09-22T08:52:43.469980+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:34:54.878963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"260'2","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:12.288667+0000","last_change":"2024-09-22T08:31:14.259915+0000","last_active":"2024-09-22T08:54:12.288667+0000","last_peered":"2024-09-22T08:54:12.288667+0000","last_clean":"2024-09-22T08:54:12.288667+0000","last_became_active":"2024-09-22T08:31:14.259624+0000","last_became_peered":"2024-09-22T08:31:14.259624+0000","last_unstale":"2024-09-22T08:54:12.288667+0000","last_undegraded":"2024-09-22T08:54:12.288667+0000","last_fullsized":"2024-09-22T08:54:12.288667+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:44:39.512910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"263'5","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.510695+0000","last_change":"2024-09-22T08:31:11.214838+0000","last_active":"2024-09-22T08:56:16.510695+0000","last_peered":"2024-09-22T08:56:16.510695+0000","last_clean":"2024-09-22T08:56:16.510695+0000","last_became_active":"2024-09-22T08:31:11.214279+0000","last_became_peered":"2024-09-22T08:31:11.214279+0000","last_unstale":"2024-09-22T08:56:16.510695+0000","last_undegraded":"2024-09-22T08:56:16.510695+0000","last_fullsized":"2024-09-22T08:56:16.510695+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:50:49.253194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"263'2","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:18.391441+0000","last_change":"2024-09-22T08:29:26.075341+0000","last_active":"2024-09-22T08:53:18.391441+0000","last_peered":"2024-09-22T08:53:18.391441+0000","last_clean":"2024-09-22T08:53:18.391441+0000","last_became_active":"2024-09-22T08:29:26.074971+0000","last_became_peered":"2024-09-22T08:29:26.074971+0000","last_unstale":"2024-09-22T08:53:18.391441+0000","last_undegraded":"2024-09-22T08:53:18.391441+0000","last_fullsized":"2024-09-22T08:53:18.391441+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:38:15.699643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:22.272596+0000","last_change":"2024-09-22T08:42:17.433389+0000","last_active":"2024-09-22T08:52:22.272596+0000","last_peered":"2024-09-22T08:52:22.272596+0000","last_clean":"2024-09-22T08:52:22.272596+0000","last_became_active":"2024-09-22T08:42:17.433090+0000","last_became_peered":"2024-09-22T08:42:17.433090+0000","last_unstale":"2024-09-22T08:52:22.272596+0000","last_undegraded":"2024-09-22T08:52:22.272596+0000","last_fullsized":"2024-09-22T08:52:22.272596+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:05:15.147705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"260'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:53.471440+0000","last_change":"2024-09-22T08:31:14.257105+0000","last_active":"2024-09-22T08:52:53.471440+0000","last_peered":"2024-09-22T08:52:53.471440+0000","last_clean":"2024-09-22T08:52:53.471440+0000","last_became_active":"2024-09-22T08:31:14.256835+0000","last_became_peered":"2024-09-22T08:31:14.256835+0000","last_unstale":"2024-09-22T08:52:53.471440+0000","last_undegraded":"2024-09-22T08:52:53.471440+0000","last_fullsized":"2024-09-22T08:52:53.471440+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:01:16.187889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"263'3","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:51.264489+0000","last_change":"2024-09-22T08:31:11.212839+0000","last_active":"2024-09-22T08:52:51.264489+0000","last_peered":"2024-09-22T08:52:51.264489+0000","last_clean":"2024-09-22T08:52:51.264489+0000","last_became_active":"2024-09-22T08:31:11.212487+0000","last_became_peered":"2024-09-22T08:31:11.212487+0000","last_unstale":"2024-09-22T08:52:51.264489+0000","last_undegraded":"2024-09-22T08:52:51.264489+0000","last_fullsized":"2024-09-22T08:52:51.264489+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:30:25.357785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"263'131","reported_seq":431,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:50.453613+0000","last_change":"2024-09-22T08:29:26.067437+0000","last_active":"2024-09-22T08:53:50.453613+0000","last_peered":"2024-09-22T08:53:50.453613+0000","last_clean":"2024-09-22T08:53:50.453613+0000","last_became_active":"2024-09-22T08:29:26.067149+0000","last_became_peered":"2024-09-22T08:29:26.067149+0000","last_unstale":"2024-09-22T08:53:50.453613+0000","last_undegraded":"2024-09-22T08:53:50.453613+0000","last_fullsized":"2024-09-22T08:53:50.453613+0000","mapping_epoch":252,"log_start":"260'100","ondisk_log_start":"260'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:08:58.265926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1238,"num_read_kb":970,"num_write":283,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:43.387307+0000","last_change":"2024-09-22T08:42:17.435234+0000","last_active":"2024-09-22T08:52:43.387307+0000","last_peered":"2024-09-22T08:52:43.387307+0000","last_clean":"2024-09-22T08:52:43.387307+0000","last_became_active":"2024-09-22T08:42:17.434424+0000","last_became_peered":"2024-09-22T08:42:17.434424+0000","last_unstale":"2024-09-22T08:52:43.387307+0000","last_undegraded":"2024-09-22T08:52:43.387307+0000","last_fullsized":"2024-09-22T08:52:43.387307+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:58:01.260992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"260'9","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:58.389082+0000","last_change":"2024-09-22T08:31:14.255605+0000","last_active":"2024-09-22T08:52:58.389082+0000","last_peered":"2024-09-22T08:52:58.389082+0000","last_clean":"2024-09-22T08:52:58.389082+0000","last_became_active":"2024-09-22T08:31:14.255160+0000","last_became_peered":"2024-09-22T08:31:14.255160+0000","last_unstale":"2024-09-22T08:52:58.389082+0000","last_undegraded":"2024-09-22T08:52:58.389082+0000","last_fullsized":"2024-09-22T08:52:58.389082+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:32:19.999119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":23554,"num_write":14,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:53.388519+0000","last_change":"2024-09-22T08:31:11.216563+0000","last_active":"2024-09-22T08:52:53.388519+0000","last_peered":"2024-09-22T08:52:53.388519+0000","last_clean":"2024-09-22T08:52:53.388519+0000","last_became_active":"2024-09-22T08:31:11.216271+0000","last_became_peered":"2024-09-22T08:31:11.216271+0000","last_unstale":"2024-09-22T08:52:53.388519+0000","last_undegraded":"2024-09-22T08:52:53.388519+0000","last_fullsized":"2024-09-22T08:52:53.388519+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:55:11.448805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"263'19","reported_seq":97,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:22.282291+0000","last_change":"2024-09-22T08:29:26.070044+0000","last_active":"2024-09-22T08:52:22.282291+0000","last_peered":"2024-09-22T08:52:22.282291+0000","last_clean":"2024-09-22T08:52:22.282291+0000","last_became_active":"2024-09-22T08:29:26.069730+0000","last_became_peered":"2024-09-22T08:29:26.069730+0000","last_unstale":"2024-09-22T08:52:22.282291+0000","last_undegraded":"2024-09-22T08:52:22.282291+0000","last_fullsized":"2024-09-22T08:52:22.282291+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:21:35.672741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":95,"num_write":48,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:07.288626+0000","last_change":"2024-09-22T08:42:17.419131+0000","last_active":"2024-09-22T08:53:07.288626+0000","last_peered":"2024-09-22T08:53:07.288626+0000","last_clean":"2024-09-22T08:53:07.288626+0000","last_became_active":"2024-09-22T08:42:17.418864+0000","last_became_peered":"2024-09-22T08:42:17.418864+0000","last_unstale":"2024-09-22T08:53:07.288626+0000","last_undegraded":"2024-09-22T08:53:07.288626+0000","last_fullsized":"2024-09-22T08:53:07.288626+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:05:15.592372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"263'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.434270+0000","last_change":"2024-09-22T08:31:14.259787+0000","last_active":"2024-09-22T08:56:16.434270+0000","last_peered":"2024-09-22T08:56:16.434270+0000","last_clean":"2024-09-22T08:56:16.434270+0000","last_became_active":"2024-09-22T08:31:14.259485+0000","last_became_peered":"2024-09-22T08:31:14.259485+0000","last_unstale":"2024-09-22T08:56:16.434270+0000","last_undegraded":"2024-09-22T08:56:16.434270+0000","last_fullsized":"2024-09-22T08:56:16.434270+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:38:49.843585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"260'5","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:16.267265+0000","last_change":"2024-09-22T08:31:11.211139+0000","last_active":"2024-09-22T08:53:16.267265+0000","last_peered":"2024-09-22T08:53:16.267265+0000","last_clean":"2024-09-22T08:53:16.267265+0000","last_became_active":"2024-09-22T08:31:11.210835+0000","last_became_peered":"2024-09-22T08:31:11.210835+0000","last_unstale":"2024-09-22T08:53:16.267265+0000","last_undegraded":"2024-09-22T08:53:16.267265+0000","last_fullsized":"2024-09-22T08:53:16.267265+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:48:20.118083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"263'36","reported_seq":145,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:21.260531+0000","last_change":"2024-09-22T08:29:26.068377+0000","last_active":"2024-09-22T08:52:21.260531+0000","last_peered":"2024-09-22T08:52:21.260531+0000","last_clean":"2024-09-22T08:52:21.260531+0000","last_became_active":"2024-09-22T08:29:26.068105+0000","last_became_peered":"2024-09-22T08:29:26.068105+0000","last_unstale":"2024-09-22T08:52:21.260531+0000","last_undegraded":"2024-09-22T08:52:21.260531+0000","last_fullsized":"2024-09-22T08:52:21.260531+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:08:26.567273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":308,"num_read_kb":184,"num_write":90,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:07.401463+0000","last_change":"2024-09-22T08:42:17.435288+0000","last_active":"2024-09-22T08:53:07.401463+0000","last_peered":"2024-09-22T08:53:07.401463+0000","last_clean":"2024-09-22T08:53:07.401463+0000","last_became_active":"2024-09-22T08:42:17.434953+0000","last_became_peered":"2024-09-22T08:42:17.434953+0000","last_unstale":"2024-09-22T08:53:07.401463+0000","last_undegraded":"2024-09-22T08:53:07.401463+0000","last_fullsized":"2024-09-22T08:53:07.401463+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:45:12.549260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"260'2","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:18.391339+0000","last_change":"2024-09-22T08:31:14.255977+0000","last_active":"2024-09-22T08:53:18.391339+0000","last_peered":"2024-09-22T08:53:18.391339+0000","last_clean":"2024-09-22T08:53:18.391339+0000","last_became_active":"2024-09-22T08:31:14.255534+0000","last_became_peered":"2024-09-22T08:31:14.255534+0000","last_unstale":"2024-09-22T08:53:18.391339+0000","last_undegraded":"2024-09-22T08:53:18.391339+0000","last_fullsized":"2024-09-22T08:53:18.391339+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:09:54.469702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"263'5","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:08.397594+0000","last_change":"2024-09-22T08:31:11.214320+0000","last_active":"2024-09-22T08:54:08.397594+0000","last_peered":"2024-09-22T08:54:08.397594+0000","last_clean":"2024-09-22T08:54:08.397594+0000","last_became_active":"2024-09-22T08:31:11.213851+0000","last_became_peered":"2024-09-22T08:31:11.213851+0000","last_unstale":"2024-09-22T08:54:08.397594+0000","last_undegraded":"2024-09-22T08:54:08.397594+0000","last_fullsized":"2024-09-22T08:54:08.397594+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:24:21.493458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":6146,"num_write":5,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"263'4","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:23.384458+0000","last_change":"2024-09-22T08:29:26.075210+0000","last_active":"2024-09-22T08:52:23.384458+0000","last_peered":"2024-09-22T08:52:23.384458+0000","last_clean":"2024-09-22T08:52:23.384458+0000","last_became_active":"2024-09-22T08:29:26.074907+0000","last_became_peered":"2024-09-22T08:29:26.074907+0000","last_unstale":"2024-09-22T08:52:23.384458+0000","last_undegraded":"2024-09-22T08:52:23.384458+0000","last_fullsized":"2024-09-22T08:52:23.384458+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:03:30.755739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:42.275910+0000","last_change":"2024-09-22T08:42:17.430325+0000","last_active":"2024-09-22T08:52:42.275910+0000","last_peered":"2024-09-22T08:52:42.275910+0000","last_clean":"2024-09-22T08:52:42.275910+0000","last_became_active":"2024-09-22T08:42:17.429341+0000","last_became_peered":"2024-09-22T08:42:17.429341+0000","last_unstale":"2024-09-22T08:52:42.275910+0000","last_undegraded":"2024-09-22T08:52:42.275910+0000","last_fullsized":"2024-09-22T08:52:42.275910+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:58:45.447447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"263'2","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:11.274127+0000","last_change":"2024-09-22T08:31:14.246719+0000","last_active":"2024-09-22T08:54:11.274127+0000","last_peered":"2024-09-22T08:54:11.274127+0000","last_clean":"2024-09-22T08:54:11.274127+0000","last_became_active":"2024-09-22T08:31:14.246417+0000","last_became_peered":"2024-09-22T08:31:14.246417+0000","last_unstale":"2024-09-22T08:54:11.274127+0000","last_undegraded":"2024-09-22T08:54:11.274127+0000","last_fullsized":"2024-09-22T08:54:11.274127+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:41:02.060530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"263'9","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.381511+0000","last_change":"2024-09-22T08:31:11.211394+0000","last_active":"2024-09-22T08:56:16.381511+0000","last_peered":"2024-09-22T08:56:16.381511+0000","last_clean":"2024-09-22T08:56:16.381511+0000","last_became_active":"2024-09-22T08:31:11.211079+0000","last_became_peered":"2024-09-22T08:31:11.211079+0000","last_unstale":"2024-09-22T08:56:16.381511+0000","last_undegraded":"2024-09-22T08:56:16.381511+0000","last_fullsized":"2024-09-22T08:56:16.381511+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:24:21.252446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10242,"num_write":14,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"263'18","reported_seq":88,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:23.384401+0000","last_change":"2024-09-22T08:29:26.068293+0000","last_active":"2024-09-22T08:52:23.384401+0000","last_peered":"2024-09-22T08:52:23.384401+0000","last_clean":"2024-09-22T08:52:23.384401+0000","last_became_active":"2024-09-22T08:29:26.067964+0000","last_became_peered":"2024-09-22T08:29:26.067964+0000","last_unstale":"2024-09-22T08:52:23.384401+0000","last_undegraded":"2024-09-22T08:52:23.384401+0000","last_fullsized":"2024-09-22T08:52:23.384401+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:41:20.023712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":85,"num_write":46,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:43.387400+0000","last_change":"2024-09-22T08:42:17.438619+0000","last_active":"2024-09-22T08:52:43.387400+0000","last_peered":"2024-09-22T08:52:43.387400+0000","last_clean":"2024-09-22T08:52:43.387400+0000","last_became_active":"2024-09-22T08:42:17.438318+0000","last_became_peered":"2024-09-22T08:42:17.438318+0000","last_unstale":"2024-09-22T08:52:43.387400+0000","last_undegraded":"2024-09-22T08:52:43.387400+0000","last_fullsized":"2024-09-22T08:52:43.387400+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:18:22.838300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:11.274093+0000","last_change":"2024-09-22T08:31:14.258446+0000","last_active":"2024-09-22T08:54:11.274093+0000","last_peered":"2024-09-22T08:54:11.274093+0000","last_clean":"2024-09-22T08:54:11.274093+0000","last_became_active":"2024-09-22T08:31:14.258136+0000","last_became_peered":"2024-09-22T08:31:14.258136+0000","last_unstale":"2024-09-22T08:54:11.274093+0000","last_undegraded":"2024-09-22T08:54:11.274093+0000","last_fullsized":"2024-09-22T08:54:11.274093+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:09:06.068754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"263'1","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:08.397264+0000","last_change":"2024-09-22T08:31:11.214416+0000","last_active":"2024-09-22T08:54:08.397264+0000","last_peered":"2024-09-22T08:54:08.397264+0000","last_clean":"2024-09-22T08:54:08.397264+0000","last_became_active":"2024-09-22T08:31:11.214112+0000","last_became_peered":"2024-09-22T08:31:11.214112+0000","last_unstale":"2024-09-22T08:54:08.397264+0000","last_undegraded":"2024-09-22T08:54:08.397264+0000","last_fullsized":"2024-09-22T08:54:08.397264+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:13:58.692971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"263'20","reported_seq":98,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:31.269276+0000","last_change":"2024-09-22T08:29:26.069691+0000","last_active":"2024-09-22T08:53:31.269276+0000","last_peered":"2024-09-22T08:53:31.269276+0000","last_clean":"2024-09-22T08:53:31.269276+0000","last_became_active":"2024-09-22T08:29:26.069407+0000","last_became_peered":"2024-09-22T08:29:26.069407+0000","last_unstale":"2024-09-22T08:53:31.269276+0000","last_undegraded":"2024-09-22T08:53:31.269276+0000","last_fullsized":"2024-09-22T08:53:31.269276+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:46:12.719810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":95,"num_write":53,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"263'218","reported_seq":855,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:19.551923+0000","last_change":"2024-09-22T08:15:04.957845+0000","last_active":"2024-09-22T08:54:19.551923+0000","last_peered":"2024-09-22T08:54:19.551923+0000","last_clean":"2024-09-22T08:54:19.551923+0000","last_became_active":"2024-09-22T08:15:04.957090+0000","last_became_peered":"2024-09-22T08:15:04.957090+0000","last_unstale":"2024-09-22T08:54:19.551923+0000","last_undegraded":"2024-09-22T08:54:19.551923+0000","last_fullsized":"2024-09-22T08:54:19.551923+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:32:54.449746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6325712,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":578,"num_read_kb":1123,"num_write":1108,"num_write_kb":27318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"263'475","reported_seq":2198,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.479858+0000","last_change":"2024-09-22T08:15:06.981247+0000","last_active":"2024-09-22T08:54:41.479858+0000","last_peered":"2024-09-22T08:54:41.479858+0000","last_clean":"2024-09-22T08:54:41.479858+0000","last_became_active":"2024-09-22T08:15:06.980616+0000","last_became_peered":"2024-09-22T08:15:06.980616+0000","last_unstale":"2024-09-22T08:54:41.479858+0000","last_undegraded":"2024-09-22T08:54:41.479858+0000","last_fullsized":"2024-09-22T08:54:41.479858+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:58:53.792749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2847,"num_read_kb":2707,"num_write":560,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"263'239","reported_seq":875,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.532805+0000","last_change":"2024-09-22T08:15:04.957479+0000","last_active":"2024-09-22T08:56:16.532805+0000","last_peered":"2024-09-22T08:56:16.532805+0000","last_clean":"2024-09-22T08:56:16.532805+0000","last_became_active":"2024-09-22T08:15:04.956643+0000","last_became_peered":"2024-09-22T08:15:04.956643+0000","last_unstale":"2024-09-22T08:56:16.532805+0000","last_undegraded":"2024-09-22T08:56:16.532805+0000","last_fullsized":"2024-09-22T08:56:16.532805+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:23:49.336948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":599,"num_read_kb":19417,"num_write":1105,"num_write_kb":24732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"263'386","reported_seq":1918,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:17.378056+0000","last_change":"2024-09-22T08:15:06.974580+0000","last_active":"2024-09-22T08:54:17.378056+0000","last_peered":"2024-09-22T08:54:17.378056+0000","last_clean":"2024-09-22T08:54:17.378056+0000","last_became_active":"2024-09-22T08:15:06.974127+0000","last_became_peered":"2024-09-22T08:15:06.974127+0000","last_unstale":"2024-09-22T08:54:17.378056+0000","last_undegraded":"2024-09-22T08:54:17.378056+0000","last_fullsized":"2024-09-22T08:54:17.378056+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:33:05.581133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2097,"num_read_kb":2016,"num_write":427,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"263'254","reported_seq":921,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.464973+0000","last_change":"2024-09-22T08:15:04.956999+0000","last_active":"2024-09-22T08:56:16.464973+0000","last_peered":"2024-09-22T08:56:16.464973+0000","last_clean":"2024-09-22T08:56:16.464973+0000","last_became_active":"2024-09-22T08:15:04.956659+0000","last_became_peered":"2024-09-22T08:15:04.956659+0000","last_unstale":"2024-09-22T08:56:16.464973+0000","last_undegraded":"2024-09-22T08:56:16.464973+0000","last_fullsized":"2024-09-22T08:56:16.464973+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:42:55.552056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":699,"num_read_kb":25466,"num_write":1131,"num_write_kb":27131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"263'898","reported_seq":2493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.960994+0000","last_change":"2024-09-22T08:15:06.969243+0000","last_active":"2024-09-22T08:54:27.960994+0000","last_peered":"2024-09-22T08:54:27.960994+0000","last_clean":"2024-09-22T08:54:27.960994+0000","last_became_active":"2024-09-22T08:15:06.968959+0000","last_became_peered":"2024-09-22T08:15:06.968959+0000","last_unstale":"2024-09-22T08:54:27.960994+0000","last_undegraded":"2024-09-22T08:54:27.960994+0000","last_fullsized":"2024-09-22T08:54:27.960994+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":800,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:30:18.722556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4516,"num_read_kb":4043,"num_write":1241,"num_write_kb":490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"263'227","reported_seq":864,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:54.926677+0000","last_change":"2024-09-22T08:15:04.961682+0000","last_active":"2024-09-22T08:55:54.926677+0000","last_peered":"2024-09-22T08:55:54.926677+0000","last_clean":"2024-09-22T08:55:54.926677+0000","last_became_active":"2024-09-22T08:15:04.961309+0000","last_became_peered":"2024-09-22T08:15:04.961309+0000","last_unstale":"2024-09-22T08:55:54.926677+0000","last_undegraded":"2024-09-22T08:55:54.926677+0000","last_fullsized":"2024-09-22T08:55:54.926677+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:32:00.847272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14713433,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":548,"num_read_kb":61449,"num_write":1033,"num_write_kb":33072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"263'535","reported_seq":2232,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:26.719838+0000","last_change":"2024-09-22T08:15:06.969850+0000","last_active":"2024-09-22T08:54:26.719838+0000","last_peered":"2024-09-22T08:54:26.719838+0000","last_clean":"2024-09-22T08:54:26.719838+0000","last_became_active":"2024-09-22T08:15:06.969540+0000","last_became_peered":"2024-09-22T08:15:06.969540+0000","last_unstale":"2024-09-22T08:54:26.719838+0000","last_undegraded":"2024-09-22T08:54:26.719838+0000","last_fullsized":"2024-09-22T08:54:26.719838+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:39:46.162178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2823,"num_read_kb":2637,"num_write":641,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"263'205","reported_seq":905,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:04.696447+0000","last_change":"2024-09-22T08:15:04.958005+0000","last_active":"2024-09-22T08:54:04.696447+0000","last_peered":"2024-09-22T08:54:04.696447+0000","last_clean":"2024-09-22T08:54:04.696447+0000","last_became_active":"2024-09-22T08:15:04.957717+0000","last_became_peered":"2024-09-22T08:15:04.957717+0000","last_unstale":"2024-09-22T08:54:04.696447+0000","last_undegraded":"2024-09-22T08:54:04.696447+0000","last_fullsized":"2024-09-22T08:54:04.696447+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:54:04.680306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12435334,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":712,"num_read_kb":166418,"num_write":947,"num_write_kb":57547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"263'603","reported_seq":2125,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:18.165751+0000","last_change":"2024-09-22T08:15:06.962885+0000","last_active":"2024-09-22T08:54:18.165751+0000","last_peered":"2024-09-22T08:54:18.165751+0000","last_clean":"2024-09-22T08:54:18.165751+0000","last_became_active":"2024-09-22T08:15:06.962605+0000","last_became_peered":"2024-09-22T08:15:06.962605+0000","last_unstale":"2024-09-22T08:54:18.165751+0000","last_undegraded":"2024-09-22T08:54:18.165751+0000","last_fullsized":"2024-09-22T08:54:18.165751+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":500,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:20:20.581344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3087,"num_read_kb":2910,"num_write":853,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"263'248","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.428976+0000","last_change":"2024-09-22T08:15:04.962423+0000","last_active":"2024-09-22T08:54:38.428976+0000","last_peered":"2024-09-22T08:54:38.428976+0000","last_clean":"2024-09-22T08:54:38.428976+0000","last_became_active":"2024-09-22T08:15:04.962128+0000","last_became_peered":"2024-09-22T08:15:04.962128+0000","last_unstale":"2024-09-22T08:54:38.428976+0000","last_undegraded":"2024-09-22T08:54:38.428976+0000","last_fullsized":"2024-09-22T08:54:38.428976+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:42:18.164351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13663310,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":745,"num_read_kb":52063,"num_write":1231,"num_write_kb":44926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"263'868","reported_seq":2689,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.926078+0000","last_change":"2024-09-22T08:15:06.973142+0000","last_active":"2024-09-22T08:54:38.926078+0000","last_peered":"2024-09-22T08:54:38.926078+0000","last_clean":"2024-09-22T08:54:38.926078+0000","last_became_active":"2024-09-22T08:15:06.972756+0000","last_became_peered":"2024-09-22T08:15:06.972756+0000","last_unstale":"2024-09-22T08:54:38.926078+0000","last_undegraded":"2024-09-22T08:54:38.926078+0000","last_fullsized":"2024-09-22T08:54:38.926078+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":800,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:03:48.112288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4443,"num_read_kb":4056,"num_write":1153,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"263'243","reported_seq":909,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:48.816030+0000","last_change":"2024-09-22T08:15:04.945272+0000","last_active":"2024-09-22T08:53:48.816030+0000","last_peered":"2024-09-22T08:53:48.816030+0000","last_clean":"2024-09-22T08:53:48.816030+0000","last_became_active":"2024-09-22T08:15:04.944916+0000","last_became_peered":"2024-09-22T08:15:04.944916+0000","last_unstale":"2024-09-22T08:53:48.816030+0000","last_undegraded":"2024-09-22T08:53:48.816030+0000","last_fullsized":"2024-09-22T08:53:48.816030+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:27:56.610167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6353845,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":799,"num_read_kb":10946,"num_write":1069,"num_write_kb":28039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"263'555","reported_seq":2079,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:22.694280+0000","last_change":"2024-09-22T08:15:06.969137+0000","last_active":"2024-09-22T08:54:22.694280+0000","last_peered":"2024-09-22T08:54:22.694280+0000","last_clean":"2024-09-22T08:54:22.694280+0000","last_became_active":"2024-09-22T08:15:06.968853+0000","last_became_peered":"2024-09-22T08:15:06.968853+0000","last_unstale":"2024-09-22T08:54:22.694280+0000","last_undegraded":"2024-09-22T08:54:22.694280+0000","last_fullsized":"2024-09-22T08:54:22.694280+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:30:47.410362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2932,"num_read_kb":2656,"num_write":742,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"263'185","reported_seq":754,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.542818+0000","last_change":"2024-09-22T08:15:04.959783+0000","last_active":"2024-09-22T08:56:16.542818+0000","last_peered":"2024-09-22T08:56:16.542818+0000","last_clean":"2024-09-22T08:56:16.542818+0000","last_became_active":"2024-09-22T08:15:04.959395+0000","last_became_peered":"2024-09-22T08:15:04.959395+0000","last_unstale":"2024-09-22T08:56:16.542818+0000","last_undegraded":"2024-09-22T08:56:16.542818+0000","last_fullsized":"2024-09-22T08:56:16.542818+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:39:51.640256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":318,"num_read_kb":28967,"num_write":772,"num_write_kb":45290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"263'1560","reported_seq":3265,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:40.939260+0000","last_change":"2024-09-22T08:15:06.972382+0000","last_active":"2024-09-22T08:54:40.939260+0000","last_peered":"2024-09-22T08:54:40.939260+0000","last_clean":"2024-09-22T08:54:40.939260+0000","last_became_active":"2024-09-22T08:15:06.972074+0000","last_became_peered":"2024-09-22T08:15:06.972074+0000","last_unstale":"2024-09-22T08:54:40.939260+0000","last_undegraded":"2024-09-22T08:54:40.939260+0000","last_fullsized":"2024-09-22T08:54:40.939260+0000","mapping_epoch":25,"log_start":"263'1500","ondisk_log_start":"263'1500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":1500,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:28:04.310796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6961,"num_read_kb":6120,"num_write":2165,"num_write_kb":918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"263'483","reported_seq":2143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:40.939680+0000","last_change":"2024-09-22T08:15:06.966028+0000","last_active":"2024-09-22T08:54:40.939680+0000","last_peered":"2024-09-22T08:54:40.939680+0000","last_clean":"2024-09-22T08:54:40.939680+0000","last_became_active":"2024-09-22T08:15:06.965751+0000","last_became_peered":"2024-09-22T08:15:06.965751+0000","last_unstale":"2024-09-22T08:54:40.939680+0000","last_undegraded":"2024-09-22T08:54:40.939680+0000","last_fullsized":"2024-09-22T08:54:40.939680+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:49:12.402190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2631,"num_read_kb":2475,"num_write":578,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"263'206","reported_seq":849,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:18.411364+0000","last_change":"2024-09-22T08:15:04.953971+0000","last_active":"2024-09-22T08:53:18.411364+0000","last_peered":"2024-09-22T08:53:18.411364+0000","last_clean":"2024-09-22T08:53:18.411364+0000","last_became_active":"2024-09-22T08:15:04.953628+0000","last_became_peered":"2024-09-22T08:15:04.953628+0000","last_unstale":"2024-09-22T08:53:18.411364+0000","last_undegraded":"2024-09-22T08:53:18.411364+0000","last_fullsized":"2024-09-22T08:53:18.411364+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:19:43.155317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1699996,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":528,"num_read_kb":68585,"num_write":868,"num_write_kb":34888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"263'357","reported_seq":1735,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:25.944981+0000","last_change":"2024-09-22T08:15:06.969299+0000","last_active":"2024-09-22T08:54:25.944981+0000","last_peered":"2024-09-22T08:54:25.944981+0000","last_clean":"2024-09-22T08:54:25.944981+0000","last_became_active":"2024-09-22T08:15:06.968970+0000","last_became_peered":"2024-09-22T08:15:06.968970+0000","last_unstale":"2024-09-22T08:54:25.944981+0000","last_undegraded":"2024-09-22T08:54:25.944981+0000","last_fullsized":"2024-09-22T08:54:25.944981+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:38:44.711239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2053,"num_read_kb":1926,"num_write":427,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"263'223","reported_seq":854,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:17.312246+0000","last_change":"2024-09-22T08:15:04.967060+0000","last_active":"2024-09-22T08:54:17.312246+0000","last_peered":"2024-09-22T08:54:17.312246+0000","last_clean":"2024-09-22T08:54:17.312246+0000","last_became_active":"2024-09-22T08:15:04.966769+0000","last_became_peered":"2024-09-22T08:15:04.966769+0000","last_unstale":"2024-09-22T08:54:17.312246+0000","last_undegraded":"2024-09-22T08:54:17.312246+0000","last_fullsized":"2024-09-22T08:54:17.312246+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:56:04.347599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9763965,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":514,"num_read_kb":51014,"num_write":1099,"num_write_kb":43963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"263'468","reported_seq":1924,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:20.263692+0000","last_change":"2024-09-22T08:15:06.973138+0000","last_active":"2024-09-22T08:54:20.263692+0000","last_peered":"2024-09-22T08:54:20.263692+0000","last_clean":"2024-09-22T08:54:20.263692+0000","last_became_active":"2024-09-22T08:15:06.972821+0000","last_became_peered":"2024-09-22T08:15:06.972821+0000","last_unstale":"2024-09-22T08:54:20.263692+0000","last_undegraded":"2024-09-22T08:54:20.263692+0000","last_fullsized":"2024-09-22T08:54:20.263692+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:14.633460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2415,"num_read_kb":2238,"num_write":577,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"263'218","reported_seq":940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:57.751847+0000","last_change":"2024-09-22T08:15:04.956245+0000","last_active":"2024-09-22T08:55:57.751847+0000","last_peered":"2024-09-22T08:55:57.751847+0000","last_clean":"2024-09-22T08:55:57.751847+0000","last_became_active":"2024-09-22T08:15:04.955972+0000","last_became_peered":"2024-09-22T08:15:04.955972+0000","last_unstale":"2024-09-22T08:55:57.751847+0000","last_undegraded":"2024-09-22T08:55:57.751847+0000","last_fullsized":"2024-09-22T08:55:57.751847+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:47:06.545629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":381104,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":990,"num_read_kb":8164,"num_write":931,"num_write_kb":17459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"263'463","reported_seq":2079,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:40.939187+0000","last_change":"2024-09-22T08:15:06.972576+0000","last_active":"2024-09-22T08:54:40.939187+0000","last_peered":"2024-09-22T08:54:40.939187+0000","last_clean":"2024-09-22T08:54:40.939187+0000","last_became_active":"2024-09-22T08:15:06.972250+0000","last_became_peered":"2024-09-22T08:15:06.972250+0000","last_unstale":"2024-09-22T08:54:40.939187+0000","last_undegraded":"2024-09-22T08:54:40.939187+0000","last_fullsized":"2024-09-22T08:54:40.939187+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:26:28.387708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2654,"num_read_kb":2505,"num_write":533,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"263'239","reported_seq":881,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:48.478320+0000","last_change":"2024-09-22T08:15:04.955521+0000","last_active":"2024-09-22T08:53:48.478320+0000","last_peered":"2024-09-22T08:53:48.478320+0000","last_clean":"2024-09-22T08:53:48.478320+0000","last_became_active":"2024-09-22T08:15:04.954948+0000","last_became_peered":"2024-09-22T08:15:04.954948+0000","last_unstale":"2024-09-22T08:53:48.478320+0000","last_undegraded":"2024-09-22T08:53:48.478320+0000","last_fullsized":"2024-09-22T08:53:48.478320+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:55:10.800461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2190676,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":543,"num_read_kb":6536,"num_write":1080,"num_write_kb":24915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"263'385","reported_seq":1845,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:40.939101+0000","last_change":"2024-09-22T08:15:06.970282+0000","last_active":"2024-09-22T08:54:40.939101+0000","last_peered":"2024-09-22T08:54:40.939101+0000","last_clean":"2024-09-22T08:54:40.939101+0000","last_became_active":"2024-09-22T08:15:06.968651+0000","last_became_peered":"2024-09-22T08:15:06.968651+0000","last_unstale":"2024-09-22T08:54:40.939101+0000","last_undegraded":"2024-09-22T08:54:40.939101+0000","last_fullsized":"2024-09-22T08:54:40.939101+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:24:42.424031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2079,"num_read_kb":1977,"num_write":435,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"263'237","reported_seq":852,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:12.308091+0000","last_change":"2024-09-22T08:15:04.958944+0000","last_active":"2024-09-22T08:56:12.308091+0000","last_peered":"2024-09-22T08:56:12.308091+0000","last_clean":"2024-09-22T08:56:12.308091+0000","last_became_active":"2024-09-22T08:15:04.958578+0000","last_became_peered":"2024-09-22T08:15:04.958578+0000","last_unstale":"2024-09-22T08:56:12.308091+0000","last_undegraded":"2024-09-22T08:56:12.308091+0000","last_fullsized":"2024-09-22T08:56:12.308091+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:42:49.203289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":554,"num_read_kb":7725,"num_write":1073,"num_write_kb":35221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"263'573","reported_seq":2255,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:21.832642+0000","last_change":"2024-09-22T08:15:06.980925+0000","last_active":"2024-09-22T08:54:21.832642+0000","last_peered":"2024-09-22T08:54:21.832642+0000","last_clean":"2024-09-22T08:54:21.832642+0000","last_became_active":"2024-09-22T08:15:06.980621+0000","last_became_peered":"2024-09-22T08:15:06.980621+0000","last_unstale":"2024-09-22T08:54:21.832642+0000","last_undegraded":"2024-09-22T08:54:21.832642+0000","last_fullsized":"2024-09-22T08:54:21.832642+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":500,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:01.217800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3075,"num_read_kb":2832,"num_write":740,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"263'193","reported_seq":993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.473026+0000","last_change":"2024-09-22T08:15:04.952516+0000","last_active":"2024-09-22T08:56:16.473026+0000","last_peered":"2024-09-22T08:56:16.473026+0000","last_clean":"2024-09-22T08:56:16.473026+0000","last_became_active":"2024-09-22T08:15:04.952203+0000","last_became_peered":"2024-09-22T08:15:04.952203+0000","last_unstale":"2024-09-22T08:56:16.473026+0000","last_undegraded":"2024-09-22T08:56:16.473026+0000","last_fullsized":"2024-09-22T08:56:16.473026+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:30:00.993327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1058,"num_read_kb":8867,"num_write":911,"num_write_kb":21916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"263'139","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.532349+0000","last_change":"2024-09-22T08:15:15.011843+0000","last_active":"2024-09-22T08:54:41.532349+0000","last_peered":"2024-09-22T08:54:41.532349+0000","last_clean":"2024-09-22T08:54:41.532349+0000","last_became_active":"2024-09-22T08:15:15.011529+0000","last_became_peered":"2024-09-22T08:15:15.011529+0000","last_unstale":"2024-09-22T08:54:41.532349+0000","last_undegraded":"2024-09-22T08:54:41.532349+0000","last_fullsized":"2024-09-22T08:54:41.532349+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:25.703936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":192,"num_read_kb":186,"num_write":338,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"263'502","reported_seq":2104,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:26.719888+0000","last_change":"2024-09-22T08:15:06.968110+0000","last_active":"2024-09-22T08:54:26.719888+0000","last_peered":"2024-09-22T08:54:26.719888+0000","last_clean":"2024-09-22T08:54:26.719888+0000","last_became_active":"2024-09-22T08:15:06.967794+0000","last_became_peered":"2024-09-22T08:15:06.967794+0000","last_unstale":"2024-09-22T08:54:26.719888+0000","last_undegraded":"2024-09-22T08:54:26.719888+0000","last_fullsized":"2024-09-22T08:54:26.719888+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:18:56.559988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2789,"num_read_kb":2608,"num_write":647,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"263'214","reported_seq":859,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.861009+0000","last_change":"2024-09-22T08:15:04.964175+0000","last_active":"2024-09-22T08:54:38.861009+0000","last_peered":"2024-09-22T08:54:38.861009+0000","last_clean":"2024-09-22T08:54:38.861009+0000","last_became_active":"2024-09-22T08:15:04.963890+0000","last_became_peered":"2024-09-22T08:15:04.963890+0000","last_unstale":"2024-09-22T08:54:38.861009+0000","last_undegraded":"2024-09-22T08:54:38.861009+0000","last_fullsized":"2024-09-22T08:54:38.861009+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:19:35.111320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5671389,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":530,"num_read_kb":15199,"num_write":1083,"num_write_kb":18954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:48.395352+0000","last_change":"2024-09-22T08:15:08.968916+0000","last_active":"2024-09-22T08:53:48.395352+0000","last_peered":"2024-09-22T08:53:48.395352+0000","last_clean":"2024-09-22T08:53:48.395352+0000","last_became_active":"2024-09-22T08:15:08.968482+0000","last_became_peered":"2024-09-22T08:15:08.968482+0000","last_unstale":"2024-09-22T08:53:48.395352+0000","last_undegraded":"2024-09-22T08:53:48.395352+0000","last_fullsized":"2024-09-22T08:53:48.395352+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:17:40.343334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"263'192","reported_seq":791,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.348297+0000","last_change":"2024-09-22T08:15:10.987896+0000","last_active":"2024-09-22T08:56:16.348297+0000","last_peered":"2024-09-22T08:56:16.348297+0000","last_clean":"2024-09-22T08:56:16.348297+0000","last_became_active":"2024-09-22T08:15:10.987539+0000","last_became_peered":"2024-09-22T08:15:10.987539+0000","last_unstale":"2024-09-22T08:56:16.348297+0000","last_undegraded":"2024-09-22T08:56:16.348297+0000","last_fullsized":"2024-09-22T08:56:16.348297+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:00:01.634988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7203,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":254,"num_read_kb":315,"num_write":148,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:28.376501+0000","last_change":"2024-09-22T08:15:13.019038+0000","last_active":"2024-09-22T08:51:28.376501+0000","last_peered":"2024-09-22T08:51:28.376501+0000","last_clean":"2024-09-22T08:51:28.376501+0000","last_became_active":"2024-09-22T08:15:13.018750+0000","last_became_peered":"2024-09-22T08:15:13.018750+0000","last_unstale":"2024-09-22T08:51:28.376501+0000","last_undegraded":"2024-09-22T08:51:28.376501+0000","last_fullsized":"2024-09-22T08:51:28.376501+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:37:28.422394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"263'150","reported_seq":640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.301330+0000","last_change":"2024-09-22T08:15:15.020868+0000","last_active":"2024-09-22T08:54:41.301330+0000","last_peered":"2024-09-22T08:54:41.301330+0000","last_clean":"2024-09-22T08:54:41.301330+0000","last_became_active":"2024-09-22T08:15:15.020542+0000","last_became_peered":"2024-09-22T08:15:15.020542+0000","last_unstale":"2024-09-22T08:54:41.301330+0000","last_undegraded":"2024-09-22T08:54:41.301330+0000","last_fullsized":"2024-09-22T08:54:41.301330+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:46:43.042803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":183,"num_read_kb":175,"num_write":358,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"263'751","reported_seq":2354,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:40.939200+0000","last_change":"2024-09-22T08:15:06.981089+0000","last_active":"2024-09-22T08:54:40.939200+0000","last_peered":"2024-09-22T08:54:40.939200+0000","last_clean":"2024-09-22T08:54:40.939200+0000","last_became_active":"2024-09-22T08:15:06.980479+0000","last_became_peered":"2024-09-22T08:15:06.980479+0000","last_unstale":"2024-09-22T08:54:40.939200+0000","last_undegraded":"2024-09-22T08:54:40.939200+0000","last_fullsized":"2024-09-22T08:54:40.939200+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:49:26.940326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3625,"num_read_kb":3307,"num_write":963,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"263'254","reported_seq":922,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:47.293755+0000","last_change":"2024-09-22T08:15:04.951572+0000","last_active":"2024-09-22T08:54:47.293755+0000","last_peered":"2024-09-22T08:54:47.293755+0000","last_clean":"2024-09-22T08:54:47.293755+0000","last_became_active":"2024-09-22T08:15:04.951265+0000","last_became_peered":"2024-09-22T08:15:04.951265+0000","last_unstale":"2024-09-22T08:54:47.293755+0000","last_undegraded":"2024-09-22T08:54:47.293755+0000","last_fullsized":"2024-09-22T08:54:47.293755+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:22:06.557070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":764,"num_read_kb":7954,"num_write":1369,"num_write_kb":16798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:37.397545+0000","last_change":"2024-09-22T08:15:08.979213+0000","last_active":"2024-09-22T08:52:37.397545+0000","last_peered":"2024-09-22T08:52:37.397545+0000","last_clean":"2024-09-22T08:52:37.397545+0000","last_became_active":"2024-09-22T08:15:08.978832+0000","last_became_peered":"2024-09-22T08:15:08.978832+0000","last_unstale":"2024-09-22T08:52:37.397545+0000","last_undegraded":"2024-09-22T08:52:37.397545+0000","last_fullsized":"2024-09-22T08:52:37.397545+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:42:16.081624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"263'77","reported_seq":597,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.725866+0000","last_change":"2024-09-22T08:15:10.984633+0000","last_active":"2024-09-22T08:55:19.725866+0000","last_peered":"2024-09-22T08:55:19.725866+0000","last_clean":"2024-09-22T08:55:19.725866+0000","last_became_active":"2024-09-22T08:15:10.984027+0000","last_became_peered":"2024-09-22T08:15:10.984027+0000","last_unstale":"2024-09-22T08:55:19.725866+0000","last_undegraded":"2024-09-22T08:55:19.725866+0000","last_fullsized":"2024-09-22T08:55:19.725866+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:59:59.106865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":87,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:28.376429+0000","last_change":"2024-09-22T08:15:13.013974+0000","last_active":"2024-09-22T08:51:28.376429+0000","last_peered":"2024-09-22T08:51:28.376429+0000","last_clean":"2024-09-22T08:51:28.376429+0000","last_became_active":"2024-09-22T08:15:13.013609+0000","last_became_peered":"2024-09-22T08:15:13.013609+0000","last_unstale":"2024-09-22T08:51:28.376429+0000","last_undegraded":"2024-09-22T08:51:28.376429+0000","last_fullsized":"2024-09-22T08:51:28.376429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:39:31.786695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"263'154","reported_seq":663,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:14.427460+0000","last_change":"2024-09-22T08:15:15.019318+0000","last_active":"2024-09-22T08:54:14.427460+0000","last_peered":"2024-09-22T08:54:14.427460+0000","last_clean":"2024-09-22T08:54:14.427460+0000","last_became_active":"2024-09-22T08:15:15.018984+0000","last_became_peered":"2024-09-22T08:15:15.018984+0000","last_unstale":"2024-09-22T08:54:14.427460+0000","last_undegraded":"2024-09-22T08:54:14.427460+0000","last_fullsized":"2024-09-22T08:54:14.427460+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:29:44.945052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":263,"num_read_kb":245,"num_write":379,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"263'1935","reported_seq":3646,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.040078+0000","last_change":"2024-09-22T08:15:06.969580+0000","last_active":"2024-09-22T08:56:02.040078+0000","last_peered":"2024-09-22T08:56:02.040078+0000","last_clean":"2024-09-22T08:56:02.040078+0000","last_became_active":"2024-09-22T08:15:06.967645+0000","last_became_peered":"2024-09-22T08:15:06.967645+0000","last_unstale":"2024-09-22T08:56:02.040078+0000","last_undegraded":"2024-09-22T08:56:02.040078+0000","last_fullsized":"2024-09-22T08:56:02.040078+0000","mapping_epoch":25,"log_start":"263'1900","ondisk_log_start":"263'1900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":1900,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:51:46.954458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8532,"num_read_kb":7421,"num_write":2741,"num_write_kb":1214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"263'186","reported_seq":831,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:15.625027+0000","last_change":"2024-09-22T08:15:04.965135+0000","last_active":"2024-09-22T08:53:15.625027+0000","last_peered":"2024-09-22T08:53:15.625027+0000","last_clean":"2024-09-22T08:53:15.625027+0000","last_became_active":"2024-09-22T08:15:04.964798+0000","last_became_peered":"2024-09-22T08:15:04.964798+0000","last_unstale":"2024-09-22T08:53:15.625027+0000","last_undegraded":"2024-09-22T08:53:15.625027+0000","last_fullsized":"2024-09-22T08:53:15.625027+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:57:26.490605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21034321,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":429,"num_read_kb":111211,"num_write":822,"num_write_kb":54102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:52.407838+0000","last_change":"2024-09-22T08:15:08.977351+0000","last_active":"2024-09-22T08:53:52.407838+0000","last_peered":"2024-09-22T08:53:52.407838+0000","last_clean":"2024-09-22T08:53:52.407838+0000","last_became_active":"2024-09-22T08:15:08.976950+0000","last_became_peered":"2024-09-22T08:15:08.976950+0000","last_unstale":"2024-09-22T08:53:52.407838+0000","last_undegraded":"2024-09-22T08:53:52.407838+0000","last_fullsized":"2024-09-22T08:53:52.407838+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:02:30.621484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"263'107","reported_seq":638,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.745947+0000","last_change":"2024-09-22T08:15:10.981219+0000","last_active":"2024-09-22T08:55:19.745947+0000","last_peered":"2024-09-22T08:55:19.745947+0000","last_clean":"2024-09-22T08:55:19.745947+0000","last_became_active":"2024-09-22T08:15:10.980879+0000","last_became_peered":"2024-09-22T08:15:10.980879+0000","last_unstale":"2024-09-22T08:55:19.745947+0000","last_undegraded":"2024-09-22T08:55:19.745947+0000","last_fullsized":"2024-09-22T08:55:19.745947+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:15:11.627561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":117,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"263'778","reported_seq":2374,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:03.378420+0000","last_change":"2024-09-22T08:15:13.012087+0000","last_active":"2024-09-22T08:56:03.378420+0000","last_peered":"2024-09-22T08:56:03.378420+0000","last_clean":"2024-09-22T08:56:03.378420+0000","last_became_active":"2024-09-22T08:15:13.011812+0000","last_became_peered":"2024-09-22T08:15:13.011812+0000","last_unstale":"2024-09-22T08:56:03.378420+0000","last_undegraded":"2024-09-22T08:56:03.378420+0000","last_fullsized":"2024-09-22T08:56:03.378420+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":700,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:23:51.018829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"263'178","reported_seq":999,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.583483+0000","last_change":"2024-09-22T08:15:15.016044+0000","last_active":"2024-09-22T08:54:41.583483+0000","last_peered":"2024-09-22T08:54:41.583483+0000","last_clean":"2024-09-22T08:54:41.583483+0000","last_became_active":"2024-09-22T08:15:15.015684+0000","last_became_peered":"2024-09-22T08:15:15.015684+0000","last_unstale":"2024-09-22T08:54:41.583483+0000","last_undegraded":"2024-09-22T08:54:41.583483+0000","last_fullsized":"2024-09-22T08:54:41.583483+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:38.991298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":616,"num_read_kb":611,"num_write":377,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"263'1260","reported_seq":2732,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.361262+0000","last_change":"2024-09-22T08:15:06.967665+0000","last_active":"2024-09-22T08:54:27.361262+0000","last_peered":"2024-09-22T08:54:27.361262+0000","last_clean":"2024-09-22T08:54:27.361262+0000","last_became_active":"2024-09-22T08:15:06.967323+0000","last_became_peered":"2024-09-22T08:15:06.967323+0000","last_unstale":"2024-09-22T08:54:27.361262+0000","last_undegraded":"2024-09-22T08:54:27.361262+0000","last_fullsized":"2024-09-22T08:54:27.361262+0000","mapping_epoch":25,"log_start":"263'1200","ondisk_log_start":"263'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":1200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:20:28.597649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7857,"num_read_kb":7154,"num_write":1964,"num_write_kb":850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"263'239","reported_seq":907,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:07.393499+0000","last_change":"2024-09-22T08:15:04.960077+0000","last_active":"2024-09-22T08:54:07.393499+0000","last_peered":"2024-09-22T08:54:07.393499+0000","last_clean":"2024-09-22T08:54:07.393499+0000","last_became_active":"2024-09-22T08:15:04.959776+0000","last_became_peered":"2024-09-22T08:15:04.959776+0000","last_unstale":"2024-09-22T08:54:07.393499+0000","last_undegraded":"2024-09-22T08:54:07.393499+0000","last_fullsized":"2024-09-22T08:54:07.393499+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:51:36.656890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7371376,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":714,"num_read_kb":18775,"num_write":1147,"num_write_kb":38377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:48.395364+0000","last_change":"2024-09-22T08:15:08.973303+0000","last_active":"2024-09-22T08:53:48.395364+0000","last_peered":"2024-09-22T08:53:48.395364+0000","last_clean":"2024-09-22T08:53:48.395364+0000","last_became_active":"2024-09-22T08:15:08.973025+0000","last_became_peered":"2024-09-22T08:15:08.973025+0000","last_unstale":"2024-09-22T08:53:48.395364+0000","last_undegraded":"2024-09-22T08:53:48.395364+0000","last_fullsized":"2024-09-22T08:53:48.395364+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:04:18.829657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"263'131","reported_seq":694,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.289651+0000","last_change":"2024-09-22T08:15:10.985906+0000","last_active":"2024-09-22T08:56:16.289651+0000","last_peered":"2024-09-22T08:56:16.289651+0000","last_clean":"2024-09-22T08:56:16.289651+0000","last_became_active":"2024-09-22T08:15:10.985540+0000","last_became_peered":"2024-09-22T08:15:10.985540+0000","last_unstale":"2024-09-22T08:56:16.289651+0000","last_undegraded":"2024-09-22T08:56:16.289651+0000","last_fullsized":"2024-09-22T08:56:16.289651+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:26:23.397471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14875,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":153,"num_read_kb":214,"num_write":77,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"263'792","reported_seq":2267,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.235006+0000","last_change":"2024-09-22T08:15:13.005672+0000","last_active":"2024-09-22T08:56:16.235006+0000","last_peered":"2024-09-22T08:56:16.235006+0000","last_clean":"2024-09-22T08:56:16.235006+0000","last_became_active":"2024-09-22T08:15:13.004752+0000","last_became_peered":"2024-09-22T08:15:13.004752+0000","last_unstale":"2024-09-22T08:56:16.235006+0000","last_undegraded":"2024-09-22T08:56:16.235006+0000","last_fullsized":"2024-09-22T08:56:16.235006+0000","mapping_epoch":31,"log_start":"263'701","ondisk_log_start":"263'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":701,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:24:31.084429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"263'440","reported_seq":2067,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.474057+0000","last_change":"2024-09-22T08:15:06.965797+0000","last_active":"2024-09-22T08:54:41.474057+0000","last_peered":"2024-09-22T08:54:41.474057+0000","last_clean":"2024-09-22T08:54:41.474057+0000","last_became_active":"2024-09-22T08:15:06.965387+0000","last_became_peered":"2024-09-22T08:15:06.965387+0000","last_unstale":"2024-09-22T08:54:41.474057+0000","last_undegraded":"2024-09-22T08:54:41.474057+0000","last_fullsized":"2024-09-22T08:54:41.474057+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:11:37.474066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2432,"num_read_kb":2308,"num_write":489,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"263'263","reported_seq":905,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:50.779466+0000","last_change":"2024-09-22T08:15:04.954321+0000","last_active":"2024-09-22T08:53:50.779466+0000","last_peered":"2024-09-22T08:53:50.779466+0000","last_clean":"2024-09-22T08:53:50.779466+0000","last_became_active":"2024-09-22T08:15:04.954015+0000","last_became_peered":"2024-09-22T08:15:04.954015+0000","last_unstale":"2024-09-22T08:53:50.779466+0000","last_undegraded":"2024-09-22T08:53:50.779466+0000","last_fullsized":"2024-09-22T08:53:50.779466+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:41:32.803566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15799511,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":648,"num_read_kb":30283,"num_write":1072,"num_write_kb":39703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:58.380897+0000","last_change":"2024-09-22T08:15:08.982558+0000","last_active":"2024-09-22T08:51:58.380897+0000","last_peered":"2024-09-22T08:51:58.380897+0000","last_clean":"2024-09-22T08:51:58.380897+0000","last_became_active":"2024-09-22T08:15:08.982222+0000","last_became_peered":"2024-09-22T08:15:08.982222+0000","last_unstale":"2024-09-22T08:51:58.380897+0000","last_undegraded":"2024-09-22T08:51:58.380897+0000","last_fullsized":"2024-09-22T08:51:58.380897+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:01.178334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"263'209","reported_seq":810,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.787460+0000","last_change":"2024-09-22T08:15:10.985101+0000","last_active":"2024-09-22T08:55:19.787460+0000","last_peered":"2024-09-22T08:55:19.787460+0000","last_clean":"2024-09-22T08:55:19.787460+0000","last_became_active":"2024-09-22T08:15:10.984769+0000","last_became_peered":"2024-09-22T08:15:10.984769+0000","last_unstale":"2024-09-22T08:55:19.787460+0000","last_undegraded":"2024-09-22T08:55:19.787460+0000","last_fullsized":"2024-09-22T08:55:19.787460+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:45:44.909883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14988,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":277,"num_read_kb":341,"num_write":162,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:27.282125+0000","last_change":"2024-09-22T08:15:13.012935+0000","last_active":"2024-09-22T08:53:27.282125+0000","last_peered":"2024-09-22T08:53:27.282125+0000","last_clean":"2024-09-22T08:53:27.282125+0000","last_became_active":"2024-09-22T08:15:13.012498+0000","last_became_peered":"2024-09-22T08:15:13.012498+0000","last_unstale":"2024-09-22T08:53:27.282125+0000","last_undegraded":"2024-09-22T08:53:27.282125+0000","last_fullsized":"2024-09-22T08:53:27.282125+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:45:11.434166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"263'554","reported_seq":1379,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:03.364987+0000","last_change":"2024-09-22T08:15:15.015237+0000","last_active":"2024-09-22T08:56:03.364987+0000","last_peered":"2024-09-22T08:56:03.364987+0000","last_clean":"2024-09-22T08:56:03.364987+0000","last_became_active":"2024-09-22T08:15:15.014801+0000","last_became_peered":"2024-09-22T08:15:15.014801+0000","last_unstale":"2024-09-22T08:56:03.364987+0000","last_undegraded":"2024-09-22T08:56:03.364987+0000","last_fullsized":"2024-09-22T08:56:03.364987+0000","mapping_epoch":33,"log_start":"263'500","ondisk_log_start":"263'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":500,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:46:54.702216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":467,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1367,"num_read_kb":1346,"num_write":1156,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"263'860","reported_seq":2445,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.032017+0000","last_change":"2024-09-22T08:15:06.973268+0000","last_active":"2024-09-22T08:56:02.032017+0000","last_peered":"2024-09-22T08:56:02.032017+0000","last_clean":"2024-09-22T08:56:02.032017+0000","last_became_active":"2024-09-22T08:15:06.972958+0000","last_became_peered":"2024-09-22T08:15:06.972958+0000","last_unstale":"2024-09-22T08:56:02.032017+0000","last_undegraded":"2024-09-22T08:56:02.032017+0000","last_fullsized":"2024-09-22T08:56:02.032017+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":800,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:07.108632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4079,"num_read_kb":3669,"num_write":1154,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"263'222","reported_seq":880,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:23.330118+0000","last_change":"2024-09-22T08:15:40.188660+0000","last_active":"2024-09-22T08:54:23.330118+0000","last_peered":"2024-09-22T08:54:23.330118+0000","last_clean":"2024-09-22T08:54:23.330118+0000","last_became_active":"2024-09-22T08:15:40.188251+0000","last_became_peered":"2024-09-22T08:15:40.188251+0000","last_unstale":"2024-09-22T08:54:23.330118+0000","last_undegraded":"2024-09-22T08:54:23.330118+0000","last_fullsized":"2024-09-22T08:54:23.330118+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:26:41.611736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16380026,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":534,"num_read_kb":133818,"num_write":961,"num_write_kb":45053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:02.269516+0000","last_change":"2024-09-22T08:15:08.975801+0000","last_active":"2024-09-22T08:52:02.269516+0000","last_peered":"2024-09-22T08:52:02.269516+0000","last_clean":"2024-09-22T08:52:02.269516+0000","last_became_active":"2024-09-22T08:15:08.975435+0000","last_became_peered":"2024-09-22T08:15:08.975435+0000","last_unstale":"2024-09-22T08:52:02.269516+0000","last_undegraded":"2024-09-22T08:52:02.269516+0000","last_fullsized":"2024-09-22T08:52:02.269516+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:08:19.699188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"263'126","reported_seq":692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.485217+0000","last_change":"2024-09-22T08:15:10.988940+0000","last_active":"2024-09-22T08:56:16.485217+0000","last_peered":"2024-09-22T08:56:16.485217+0000","last_clean":"2024-09-22T08:56:16.485217+0000","last_became_active":"2024-09-22T08:15:10.988458+0000","last_became_peered":"2024-09-22T08:15:10.988458+0000","last_unstale":"2024-09-22T08:56:16.485217+0000","last_undegraded":"2024-09-22T08:56:16.485217+0000","last_fullsized":"2024-09-22T08:56:16.485217+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:25.942851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8309,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":166,"num_read_kb":226,"num_write":90,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:07.393316+0000","last_change":"2024-09-22T08:15:13.003344+0000","last_active":"2024-09-22T08:52:07.393316+0000","last_peered":"2024-09-22T08:52:07.393316+0000","last_clean":"2024-09-22T08:52:07.393316+0000","last_became_active":"2024-09-22T08:15:13.002538+0000","last_became_peered":"2024-09-22T08:15:13.002538+0000","last_unstale":"2024-09-22T08:52:07.393316+0000","last_undegraded":"2024-09-22T08:52:07.393316+0000","last_fullsized":"2024-09-22T08:52:07.393316+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:50:12.973900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"263'2482","reported_seq":4310,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:58.403142+0000","last_change":"2024-09-22T08:15:15.020723+0000","last_active":"2024-09-22T08:54:58.403142+0000","last_peered":"2024-09-22T08:54:58.403142+0000","last_clean":"2024-09-22T08:54:58.403142+0000","last_became_active":"2024-09-22T08:15:15.020438+0000","last_became_peered":"2024-09-22T08:15:15.020438+0000","last_unstale":"2024-09-22T08:54:58.403142+0000","last_undegraded":"2024-09-22T08:54:58.403142+0000","last_fullsized":"2024-09-22T08:54:58.403142+0000","mapping_epoch":33,"log_start":"263'2400","ondisk_log_start":"263'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":2400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:19:48.770997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6235,"num_read_kb":6232,"num_write":5030,"num_write_kb":1847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"263'474","reported_seq":1995,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.469591+0000","last_change":"2024-09-22T08:15:06.971112+0000","last_active":"2024-09-22T08:54:41.469591+0000","last_peered":"2024-09-22T08:54:41.469591+0000","last_clean":"2024-09-22T08:54:41.469591+0000","last_became_active":"2024-09-22T08:15:06.970532+0000","last_became_peered":"2024-09-22T08:15:06.970532+0000","last_unstale":"2024-09-22T08:54:41.469591+0000","last_undegraded":"2024-09-22T08:54:41.469591+0000","last_fullsized":"2024-09-22T08:54:41.469591+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:04:08.887293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2482,"num_read_kb":2307,"num_write":574,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"263'212","reported_seq":836,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:23.392143+0000","last_change":"2024-09-22T08:15:04.963933+0000","last_active":"2024-09-22T08:53:23.392143+0000","last_peered":"2024-09-22T08:53:23.392143+0000","last_clean":"2024-09-22T08:53:23.392143+0000","last_became_active":"2024-09-22T08:15:04.963648+0000","last_became_peered":"2024-09-22T08:15:04.963648+0000","last_unstale":"2024-09-22T08:53:23.392143+0000","last_undegraded":"2024-09-22T08:53:23.392143+0000","last_fullsized":"2024-09-22T08:53:23.392143+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:06:54.477482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3520137,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":479,"num_read_kb":19400,"num_write":961,"num_write_kb":35249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"35'3","reported_seq":976,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:15.995729+0000","last_change":"2024-09-22T08:15:08.975603+0000","last_active":"2024-09-22T08:56:15.995729+0000","last_peered":"2024-09-22T08:56:15.995729+0000","last_clean":"2024-09-22T08:56:15.995729+0000","last_became_active":"2024-09-22T08:15:08.975260+0000","last_became_peered":"2024-09-22T08:15:08.975260+0000","last_unstale":"2024-09-22T08:56:15.995729+0000","last_undegraded":"2024-09-22T08:56:15.995729+0000","last_fullsized":"2024-09-22T08:56:15.995729+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:44:40.766275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":720,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"263'154","reported_seq":733,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.710226+0000","last_change":"2024-09-22T08:15:10.989559+0000","last_active":"2024-09-22T08:55:19.710226+0000","last_peered":"2024-09-22T08:55:19.710226+0000","last_clean":"2024-09-22T08:55:19.710226+0000","last_became_active":"2024-09-22T08:15:10.989211+0000","last_became_peered":"2024-09-22T08:15:10.989211+0000","last_unstale":"2024-09-22T08:55:19.710226+0000","last_undegraded":"2024-09-22T08:55:19.710226+0000","last_fullsized":"2024-09-22T08:55:19.710226+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:21:23.417691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15314,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":202,"num_read_kb":270,"num_write":114,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"263'792","reported_seq":2273,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.236259+0000","last_change":"2024-09-22T08:15:13.003152+0000","last_active":"2024-09-22T08:56:16.236259+0000","last_peered":"2024-09-22T08:56:16.236259+0000","last_clean":"2024-09-22T08:56:16.236259+0000","last_became_active":"2024-09-22T08:15:13.002828+0000","last_became_peered":"2024-09-22T08:15:13.002828+0000","last_unstale":"2024-09-22T08:56:16.236259+0000","last_undegraded":"2024-09-22T08:56:16.236259+0000","last_fullsized":"2024-09-22T08:56:16.236259+0000","mapping_epoch":31,"log_start":"263'701","ondisk_log_start":"263'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":701,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:50:06.133670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"263'130","reported_seq":617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:01.978028+0000","last_change":"2024-09-22T08:15:15.019494+0000","last_active":"2024-09-22T08:56:01.978028+0000","last_peered":"2024-09-22T08:56:01.978028+0000","last_clean":"2024-09-22T08:56:01.978028+0000","last_became_active":"2024-09-22T08:15:15.019162+0000","last_became_peered":"2024-09-22T08:15:15.019162+0000","last_unstale":"2024-09-22T08:56:01.978028+0000","last_undegraded":"2024-09-22T08:56:01.978028+0000","last_fullsized":"2024-09-22T08:56:01.978028+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:35:08.999759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":846,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":147,"num_read_kb":143,"num_write":317,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"263'517","reported_seq":2263,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.480093+0000","last_change":"2024-09-22T08:15:06.962857+0000","last_active":"2024-09-22T08:54:41.480093+0000","last_peered":"2024-09-22T08:54:41.480093+0000","last_clean":"2024-09-22T08:54:41.480093+0000","last_became_active":"2024-09-22T08:15:06.962528+0000","last_became_peered":"2024-09-22T08:15:06.962528+0000","last_unstale":"2024-09-22T08:54:41.480093+0000","last_undegraded":"2024-09-22T08:54:41.480093+0000","last_fullsized":"2024-09-22T08:54:41.480093+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":500,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:34:50.127904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2917,"num_read_kb":2741,"num_write":627,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"263'189","reported_seq":806,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:23.475071+0000","last_change":"2024-09-22T08:15:04.948041+0000","last_active":"2024-09-22T08:53:23.475071+0000","last_peered":"2024-09-22T08:53:23.475071+0000","last_clean":"2024-09-22T08:53:23.475071+0000","last_became_active":"2024-09-22T08:15:04.947739+0000","last_became_peered":"2024-09-22T08:15:04.947739+0000","last_unstale":"2024-09-22T08:53:23.475071+0000","last_undegraded":"2024-09-22T08:53:23.475071+0000","last_fullsized":"2024-09-22T08:53:23.475071+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:22:45.887704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1400013,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":448,"num_read_kb":50575,"num_write":899,"num_write_kb":23711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:12.271102+0000","last_change":"2024-09-22T08:15:08.974959+0000","last_active":"2024-09-22T08:52:12.271102+0000","last_peered":"2024-09-22T08:52:12.271102+0000","last_clean":"2024-09-22T08:52:12.271102+0000","last_became_active":"2024-09-22T08:15:08.974693+0000","last_became_peered":"2024-09-22T08:15:08.974693+0000","last_unstale":"2024-09-22T08:52:12.271102+0000","last_undegraded":"2024-09-22T08:52:12.271102+0000","last_fullsized":"2024-09-22T08:52:12.271102+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:41:04.052651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"263'193","reported_seq":819,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.503445+0000","last_change":"2024-09-22T08:15:10.984896+0000","last_active":"2024-09-22T08:56:16.503445+0000","last_peered":"2024-09-22T08:56:16.503445+0000","last_clean":"2024-09-22T08:56:16.503445+0000","last_became_active":"2024-09-22T08:15:10.984402+0000","last_became_peered":"2024-09-22T08:15:10.984402+0000","last_unstale":"2024-09-22T08:56:16.503445+0000","last_undegraded":"2024-09-22T08:56:16.503445+0000","last_fullsized":"2024-09-22T08:56:16.503445+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:10:18.043549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13027,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":258,"num_read_kb":332,"num_write":120,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:02.269532+0000","last_change":"2024-09-22T08:15:13.014853+0000","last_active":"2024-09-22T08:52:02.269532+0000","last_peered":"2024-09-22T08:52:02.269532+0000","last_clean":"2024-09-22T08:52:02.269532+0000","last_became_active":"2024-09-22T08:15:13.014612+0000","last_became_peered":"2024-09-22T08:15:13.014612+0000","last_unstale":"2024-09-22T08:52:02.269532+0000","last_undegraded":"2024-09-22T08:52:02.269532+0000","last_fullsized":"2024-09-22T08:52:02.269532+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:42:53.637961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"263'140","reported_seq":652,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:40.818796+0000","last_change":"2024-09-22T08:15:15.011646+0000","last_active":"2024-09-22T08:54:40.818796+0000","last_peered":"2024-09-22T08:54:40.818796+0000","last_clean":"2024-09-22T08:54:40.818796+0000","last_became_active":"2024-09-22T08:15:15.011332+0000","last_became_peered":"2024-09-22T08:15:15.011332+0000","last_unstale":"2024-09-22T08:54:40.818796+0000","last_undegraded":"2024-09-22T08:54:40.818796+0000","last_fullsized":"2024-09-22T08:54:40.818796+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:19:09.424500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":195,"num_read_kb":186,"num_write":318,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"263'475","reported_seq":2049,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.961820+0000","last_change":"2024-09-22T08:15:06.966989+0000","last_active":"2024-09-22T08:54:27.961820+0000","last_peered":"2024-09-22T08:54:27.961820+0000","last_clean":"2024-09-22T08:54:27.961820+0000","last_became_active":"2024-09-22T08:15:06.966708+0000","last_became_peered":"2024-09-22T08:15:06.966708+0000","last_unstale":"2024-09-22T08:54:27.961820+0000","last_undegraded":"2024-09-22T08:54:27.961820+0000","last_fullsized":"2024-09-22T08:54:27.961820+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:55:12.487019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2455,"num_read_kb":2308,"num_write":546,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"263'247","reported_seq":879,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.306459+0000","last_change":"2024-09-22T08:15:04.949510+0000","last_active":"2024-09-22T08:56:16.306459+0000","last_peered":"2024-09-22T08:56:16.306459+0000","last_clean":"2024-09-22T08:56:16.306459+0000","last_became_active":"2024-09-22T08:15:04.949202+0000","last_became_peered":"2024-09-22T08:15:04.949202+0000","last_unstale":"2024-09-22T08:56:16.306459+0000","last_undegraded":"2024-09-22T08:56:16.306459+0000","last_fullsized":"2024-09-22T08:56:16.306459+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:52:02.522606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1386384,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":583,"num_read_kb":11398,"num_write":1166,"num_write_kb":28598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:27.291253+0000","last_change":"2024-09-22T08:15:08.978620+0000","last_active":"2024-09-22T08:53:27.291253+0000","last_peered":"2024-09-22T08:53:27.291253+0000","last_clean":"2024-09-22T08:53:27.291253+0000","last_became_active":"2024-09-22T08:15:08.978280+0000","last_became_peered":"2024-09-22T08:15:08.978280+0000","last_unstale":"2024-09-22T08:53:27.291253+0000","last_undegraded":"2024-09-22T08:53:27.291253+0000","last_fullsized":"2024-09-22T08:53:27.291253+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:04:18.494310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"263'165","reported_seq":732,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:43.408357+0000","last_change":"2024-09-22T08:15:10.986865+0000","last_active":"2024-09-22T08:55:43.408357+0000","last_peered":"2024-09-22T08:55:43.408357+0000","last_clean":"2024-09-22T08:55:43.408357+0000","last_became_active":"2024-09-22T08:15:10.986433+0000","last_became_peered":"2024-09-22T08:15:10.986433+0000","last_unstale":"2024-09-22T08:55:43.408357+0000","last_undegraded":"2024-09-22T08:55:43.408357+0000","last_fullsized":"2024-09-22T08:55:43.408357+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:30:33.526965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15502,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":219,"num_read_kb":274,"num_write":182,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:37.292935+0000","last_change":"2024-09-22T08:15:12.999342+0000","last_active":"2024-09-22T08:53:37.292935+0000","last_peered":"2024-09-22T08:53:37.292935+0000","last_clean":"2024-09-22T08:53:37.292935+0000","last_became_active":"2024-09-22T08:15:12.999036+0000","last_became_peered":"2024-09-22T08:15:12.999036+0000","last_unstale":"2024-09-22T08:53:37.292935+0000","last_undegraded":"2024-09-22T08:53:37.292935+0000","last_fullsized":"2024-09-22T08:53:37.292935+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:32:19.162385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"263'97","reported_seq":586,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:22.299581+0000","last_change":"2024-09-22T08:15:15.012235+0000","last_active":"2024-09-22T08:55:22.299581+0000","last_peered":"2024-09-22T08:55:22.299581+0000","last_clean":"2024-09-22T08:55:22.299581+0000","last_became_active":"2024-09-22T08:15:15.011949+0000","last_became_peered":"2024-09-22T08:15:15.011949+0000","last_unstale":"2024-09-22T08:55:22.299581+0000","last_undegraded":"2024-09-22T08:55:22.299581+0000","last_fullsized":"2024-09-22T08:55:22.299581+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:28.798518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":93,"num_read_kb":93,"num_write":223,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"263'824","reported_seq":2604,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.479954+0000","last_change":"2024-09-22T08:15:06.967305+0000","last_active":"2024-09-22T08:54:41.479954+0000","last_peered":"2024-09-22T08:54:41.479954+0000","last_clean":"2024-09-22T08:54:41.479954+0000","last_became_active":"2024-09-22T08:15:06.966795+0000","last_became_peered":"2024-09-22T08:15:06.966795+0000","last_unstale":"2024-09-22T08:54:41.479954+0000","last_undegraded":"2024-09-22T08:54:41.479954+0000","last_fullsized":"2024-09-22T08:54:41.479954+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:21:48.140336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4273,"num_read_kb":3896,"num_write":1079,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"263'208","reported_seq":830,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:03.381777+0000","last_change":"2024-09-22T08:15:04.954764+0000","last_active":"2024-09-22T08:52:03.381777+0000","last_peered":"2024-09-22T08:52:03.381777+0000","last_clean":"2024-09-22T08:52:03.381777+0000","last_became_active":"2024-09-22T08:15:04.954492+0000","last_became_peered":"2024-09-22T08:15:04.954492+0000","last_unstale":"2024-09-22T08:52:03.381777+0000","last_undegraded":"2024-09-22T08:52:03.381777+0000","last_fullsized":"2024-09-22T08:52:03.381777+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:20:34.096792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8020669,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":467,"num_read_kb":44807,"num_write":937,"num_write_kb":39223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:27.282275+0000","last_change":"2024-09-22T08:15:08.977376+0000","last_active":"2024-09-22T08:53:27.282275+0000","last_peered":"2024-09-22T08:53:27.282275+0000","last_clean":"2024-09-22T08:53:27.282275+0000","last_became_active":"2024-09-22T08:15:08.976990+0000","last_became_peered":"2024-09-22T08:15:08.976990+0000","last_unstale":"2024-09-22T08:53:27.282275+0000","last_undegraded":"2024-09-22T08:53:27.282275+0000","last_fullsized":"2024-09-22T08:53:27.282275+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:28.364951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"263'149","reported_seq":732,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.458993+0000","last_change":"2024-09-22T08:15:10.979752+0000","last_active":"2024-09-22T08:56:16.458993+0000","last_peered":"2024-09-22T08:56:16.458993+0000","last_clean":"2024-09-22T08:56:16.458993+0000","last_became_active":"2024-09-22T08:15:10.979449+0000","last_became_peered":"2024-09-22T08:15:10.979449+0000","last_unstale":"2024-09-22T08:56:16.458993+0000","last_undegraded":"2024-09-22T08:56:16.458993+0000","last_fullsized":"2024-09-22T08:56:16.458993+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:04.362070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6421,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":192,"num_read_kb":205,"num_write":100,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"263'771","reported_seq":4251,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.231331+0000","last_change":"2024-09-22T08:15:13.015830+0000","last_active":"2024-09-22T08:56:16.231331+0000","last_peered":"2024-09-22T08:56:16.231331+0000","last_clean":"2024-09-22T08:56:16.231331+0000","last_became_active":"2024-09-22T08:15:13.015504+0000","last_became_peered":"2024-09-22T08:15:13.015504+0000","last_unstale":"2024-09-22T08:56:16.231331+0000","last_undegraded":"2024-09-22T08:56:16.231331+0000","last_fullsized":"2024-09-22T08:56:16.231331+0000","mapping_epoch":31,"log_start":"263'701","ondisk_log_start":"263'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":701,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:41:04.669012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"263'132","reported_seq":628,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:18.162485+0000","last_change":"2024-09-22T08:15:15.018247+0000","last_active":"2024-09-22T08:54:18.162485+0000","last_peered":"2024-09-22T08:54:18.162485+0000","last_clean":"2024-09-22T08:54:18.162485+0000","last_became_active":"2024-09-22T08:15:15.017584+0000","last_became_peered":"2024-09-22T08:15:15.017584+0000","last_unstale":"2024-09-22T08:54:18.162485+0000","last_undegraded":"2024-09-22T08:54:18.162485+0000","last_fullsized":"2024-09-22T08:54:18.162485+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:04:30.454178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":193,"num_read_kb":181,"num_write":318,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"263'745","reported_seq":2321,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:26.719305+0000","last_change":"2024-09-22T08:15:06.974286+0000","last_active":"2024-09-22T08:54:26.719305+0000","last_peered":"2024-09-22T08:54:26.719305+0000","last_clean":"2024-09-22T08:54:26.719305+0000","last_became_active":"2024-09-22T08:15:06.973918+0000","last_became_peered":"2024-09-22T08:15:06.973918+0000","last_unstale":"2024-09-22T08:54:26.719305+0000","last_undegraded":"2024-09-22T08:54:26.719305+0000","last_fullsized":"2024-09-22T08:54:26.719305+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":700,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:53:08.286370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3813,"num_read_kb":3478,"num_write":973,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"263'223","reported_seq":879,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:25.874116+0000","last_change":"2024-09-22T08:15:04.958607+0000","last_active":"2024-09-22T08:54:25.874116+0000","last_peered":"2024-09-22T08:54:25.874116+0000","last_clean":"2024-09-22T08:54:25.874116+0000","last_became_active":"2024-09-22T08:15:04.958336+0000","last_became_peered":"2024-09-22T08:15:04.958336+0000","last_unstale":"2024-09-22T08:54:25.874116+0000","last_undegraded":"2024-09-22T08:54:25.874116+0000","last_fullsized":"2024-09-22T08:54:25.874116+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:31:07.605629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1058332,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":650,"num_read_kb":3596,"num_write":1073,"num_write_kb":27039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1443,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.891754+0000","last_change":"2024-09-22T08:15:08.982924+0000","last_active":"2024-09-22T08:56:02.891754+0000","last_peered":"2024-09-22T08:56:02.891754+0000","last_clean":"2024-09-22T08:56:02.891754+0000","last_became_active":"2024-09-22T08:15:08.982221+0000","last_became_peered":"2024-09-22T08:15:08.982221+0000","last_unstale":"2024-09-22T08:56:02.891754+0000","last_undegraded":"2024-09-22T08:56:02.891754+0000","last_fullsized":"2024-09-22T08:56:02.891754+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:06:24.534601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":946,"num_read_kb":946,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"263'73","reported_seq":585,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:42.302697+0000","last_change":"2024-09-22T08:15:10.987583+0000","last_active":"2024-09-22T08:55:42.302697+0000","last_peered":"2024-09-22T08:55:42.302697+0000","last_clean":"2024-09-22T08:55:42.302697+0000","last_became_active":"2024-09-22T08:15:10.987273+0000","last_became_peered":"2024-09-22T08:15:10.987273+0000","last_unstale":"2024-09-22T08:55:42.302697+0000","last_undegraded":"2024-09-22T08:55:42.302697+0000","last_fullsized":"2024-09-22T08:55:42.302697+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:52:00.308800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"263'788","reported_seq":2309,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:03.380604+0000","last_change":"2024-09-22T08:15:13.010979+0000","last_active":"2024-09-22T08:56:03.380604+0000","last_peered":"2024-09-22T08:56:03.380604+0000","last_clean":"2024-09-22T08:56:03.380604+0000","last_became_active":"2024-09-22T08:15:13.010641+0000","last_became_peered":"2024-09-22T08:15:13.010641+0000","last_unstale":"2024-09-22T08:56:03.380604+0000","last_undegraded":"2024-09-22T08:56:03.380604+0000","last_fullsized":"2024-09-22T08:56:03.380604+0000","mapping_epoch":31,"log_start":"263'701","ondisk_log_start":"263'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":701,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:31:51.024056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"263'125","reported_seq":620,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:14.425045+0000","last_change":"2024-09-22T08:15:15.015212+0000","last_active":"2024-09-22T08:54:14.425045+0000","last_peered":"2024-09-22T08:54:14.425045+0000","last_clean":"2024-09-22T08:54:14.425045+0000","last_became_active":"2024-09-22T08:15:15.014775+0000","last_became_peered":"2024-09-22T08:15:15.014775+0000","last_unstale":"2024-09-22T08:54:14.425045+0000","last_undegraded":"2024-09-22T08:54:14.425045+0000","last_fullsized":"2024-09-22T08:54:14.425045+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:24:57.427955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":160,"num_write":304,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"263'414","reported_seq":1970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:22.693834+0000","last_change":"2024-09-22T08:15:06.957525+0000","last_active":"2024-09-22T08:54:22.693834+0000","last_peered":"2024-09-22T08:54:22.693834+0000","last_clean":"2024-09-22T08:54:22.693834+0000","last_became_active":"2024-09-22T08:15:06.957239+0000","last_became_peered":"2024-09-22T08:15:06.957239+0000","last_unstale":"2024-09-22T08:54:22.693834+0000","last_undegraded":"2024-09-22T08:54:22.693834+0000","last_fullsized":"2024-09-22T08:54:22.693834+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:14:48.411753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2251,"num_read_kb":2145,"num_write":475,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"263'270","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.464029+0000","last_change":"2024-09-22T08:15:04.944257+0000","last_active":"2024-09-22T08:56:16.464029+0000","last_peered":"2024-09-22T08:56:16.464029+0000","last_clean":"2024-09-22T08:56:16.464029+0000","last_became_active":"2024-09-22T08:15:04.943906+0000","last_became_peered":"2024-09-22T08:15:04.943906+0000","last_unstale":"2024-09-22T08:56:16.464029+0000","last_undegraded":"2024-09-22T08:56:16.464029+0000","last_fullsized":"2024-09-22T08:56:16.464029+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:58:25.000568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079942,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":793,"num_read_kb":68557,"num_write":1190,"num_write_kb":29712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:23.392212+0000","last_change":"2024-09-22T08:15:08.969465+0000","last_active":"2024-09-22T08:53:23.392212+0000","last_peered":"2024-09-22T08:53:23.392212+0000","last_clean":"2024-09-22T08:53:23.392212+0000","last_became_active":"2024-09-22T08:15:08.969175+0000","last_became_peered":"2024-09-22T08:15:08.969175+0000","last_unstale":"2024-09-22T08:53:23.392212+0000","last_undegraded":"2024-09-22T08:53:23.392212+0000","last_fullsized":"2024-09-22T08:53:23.392212+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:02:12.589731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"263'190","reported_seq":788,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:43.408305+0000","last_change":"2024-09-22T08:15:10.987387+0000","last_active":"2024-09-22T08:55:43.408305+0000","last_peered":"2024-09-22T08:55:43.408305+0000","last_clean":"2024-09-22T08:55:43.408305+0000","last_became_active":"2024-09-22T08:15:10.987081+0000","last_became_peered":"2024-09-22T08:15:10.987081+0000","last_unstale":"2024-09-22T08:55:43.408305+0000","last_undegraded":"2024-09-22T08:55:43.408305+0000","last_fullsized":"2024-09-22T08:55:43.408305+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:27:15.431867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6008,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":242,"num_read_kb":270,"num_write":134,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:31.269342+0000","last_change":"2024-09-22T08:15:13.008391+0000","last_active":"2024-09-22T08:53:31.269342+0000","last_peered":"2024-09-22T08:53:31.269342+0000","last_clean":"2024-09-22T08:53:31.269342+0000","last_became_active":"2024-09-22T08:15:13.007735+0000","last_became_peered":"2024-09-22T08:15:13.007735+0000","last_unstale":"2024-09-22T08:53:31.269342+0000","last_undegraded":"2024-09-22T08:53:31.269342+0000","last_fullsized":"2024-09-22T08:53:31.269342+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:36:22.012503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"263'149","reported_seq":642,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:52.302863+0000","last_change":"2024-09-22T08:15:15.013532+0000","last_active":"2024-09-22T08:54:52.302863+0000","last_peered":"2024-09-22T08:54:52.302863+0000","last_clean":"2024-09-22T08:54:52.302863+0000","last_became_active":"2024-09-22T08:15:15.013216+0000","last_became_peered":"2024-09-22T08:15:15.013216+0000","last_unstale":"2024-09-22T08:54:52.302863+0000","last_undegraded":"2024-09-22T08:54:52.302863+0000","last_fullsized":"2024-09-22T08:54:52.302863+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:46:24.084971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1066,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":167,"num_read_kb":166,"num_write":339,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"263'392","reported_seq":1961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.030717+0000","last_change":"2024-09-22T08:15:06.966999+0000","last_active":"2024-09-22T08:56:02.030717+0000","last_peered":"2024-09-22T08:56:02.030717+0000","last_clean":"2024-09-22T08:56:02.030717+0000","last_became_active":"2024-09-22T08:15:06.966710+0000","last_became_peered":"2024-09-22T08:15:06.966710+0000","last_unstale":"2024-09-22T08:56:02.030717+0000","last_undegraded":"2024-09-22T08:56:02.030717+0000","last_fullsized":"2024-09-22T08:56:02.030717+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:19.004364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2363,"num_read_kb":2266,"num_write":458,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":611,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:53.387983+0000","last_change":"2024-09-22T08:14:48.585279+0000","last_active":"2024-09-22T08:52:53.387983+0000","last_peered":"2024-09-22T08:52:53.387983+0000","last_clean":"2024-09-22T08:52:53.387983+0000","last_became_active":"2024-09-22T08:14:48.584210+0000","last_became_peered":"2024-09-22T08:14:48.584210+0000","last_unstale":"2024-09-22T08:52:53.387983+0000","last_undegraded":"2024-09-22T08:52:53.387983+0000","last_fullsized":"2024-09-22T08:52:53.387983+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:47.452169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:47.452169+0000","last_clean_scrub_stamp":"2024-09-22T08:14:47.452169+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:40:54.190577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:28.385374+0000","last_change":"2024-09-22T08:14:56.729851+0000","last_active":"2024-09-22T08:52:28.385374+0000","last_peered":"2024-09-22T08:52:28.385374+0000","last_clean":"2024-09-22T08:52:28.385374+0000","last_became_active":"2024-09-22T08:14:54.727501+0000","last_became_peered":"2024-09-22T08:14:54.727501+0000","last_unstale":"2024-09-22T08:52:28.385374+0000","last_undegraded":"2024-09-22T08:52:28.385374+0000","last_fullsized":"2024-09-22T08:52:28.385374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:23:47.178939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001065632,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"263'179","reported_seq":841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:42.415042+0000","last_change":"2024-09-22T08:15:04.963864+0000","last_active":"2024-09-22T08:54:42.415042+0000","last_peered":"2024-09-22T08:54:42.415042+0000","last_clean":"2024-09-22T08:54:42.415042+0000","last_became_active":"2024-09-22T08:15:04.963447+0000","last_became_peered":"2024-09-22T08:15:04.963447+0000","last_unstale":"2024-09-22T08:54:42.415042+0000","last_undegraded":"2024-09-22T08:54:42.415042+0000","last_fullsized":"2024-09-22T08:54:42.415042+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:24:35.067492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":624,"num_read_kb":9185,"num_write":876,"num_write_kb":23340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:38.469151+0000","last_change":"2024-09-22T08:15:08.979105+0000","last_active":"2024-09-22T08:52:38.469151+0000","last_peered":"2024-09-22T08:52:38.469151+0000","last_clean":"2024-09-22T08:52:38.469151+0000","last_became_active":"2024-09-22T08:15:08.978755+0000","last_became_peered":"2024-09-22T08:15:08.978755+0000","last_unstale":"2024-09-22T08:52:38.469151+0000","last_undegraded":"2024-09-22T08:52:38.469151+0000","last_fullsized":"2024-09-22T08:52:38.469151+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:35:55.269048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"263'267","reported_seq":954,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:03.350649+0000","last_change":"2024-09-22T08:15:10.991397+0000","last_active":"2024-09-22T08:56:03.350649+0000","last_peered":"2024-09-22T08:56:03.350649+0000","last_clean":"2024-09-22T08:56:03.350649+0000","last_became_active":"2024-09-22T08:15:10.991050+0000","last_became_peered":"2024-09-22T08:15:10.991050+0000","last_unstale":"2024-09-22T08:56:03.350649+0000","last_undegraded":"2024-09-22T08:56:03.350649+0000","last_fullsized":"2024-09-22T08:56:03.350649+0000","mapping_epoch":29,"log_start":"260'200","ondisk_log_start":"260'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:20:04.247945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36893,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":504,"num_read_kb":686,"num_write":418,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:02.269685+0000","last_change":"2024-09-22T08:15:13.018888+0000","last_active":"2024-09-22T08:52:02.269685+0000","last_peered":"2024-09-22T08:52:02.269685+0000","last_clean":"2024-09-22T08:52:02.269685+0000","last_became_active":"2024-09-22T08:15:13.018627+0000","last_became_peered":"2024-09-22T08:15:13.018627+0000","last_unstale":"2024-09-22T08:52:02.269685+0000","last_undegraded":"2024-09-22T08:52:02.269685+0000","last_fullsized":"2024-09-22T08:52:02.269685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:34:15.340844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"263'226","reported_seq":951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:40.424193+0000","last_change":"2024-09-22T08:15:15.017846+0000","last_active":"2024-09-22T08:54:40.424193+0000","last_peered":"2024-09-22T08:54:40.424193+0000","last_clean":"2024-09-22T08:54:40.424193+0000","last_became_active":"2024-09-22T08:15:15.017533+0000","last_became_peered":"2024-09-22T08:15:15.017533+0000","last_unstale":"2024-09-22T08:54:40.424193+0000","last_undegraded":"2024-09-22T08:54:40.424193+0000","last_fullsized":"2024-09-22T08:54:40.424193+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:27:07.313303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":616,"num_read_kb":580,"num_write":434,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"263'394","reported_seq":1957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:40.939121+0000","last_change":"2024-09-22T08:15:06.967150+0000","last_active":"2024-09-22T08:54:40.939121+0000","last_peered":"2024-09-22T08:54:40.939121+0000","last_clean":"2024-09-22T08:54:40.939121+0000","last_became_active":"2024-09-22T08:15:06.966792+0000","last_became_peered":"2024-09-22T08:15:06.966792+0000","last_unstale":"2024-09-22T08:54:40.939121+0000","last_undegraded":"2024-09-22T08:54:40.939121+0000","last_fullsized":"2024-09-22T08:54:40.939121+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:48:17.209756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2208,"num_read_kb":2116,"num_write":452,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:03.389601+0000","last_change":"2024-09-22T08:14:56.729334+0000","last_active":"2024-09-22T08:53:03.389601+0000","last_peered":"2024-09-22T08:53:03.389601+0000","last_clean":"2024-09-22T08:53:03.389601+0000","last_became_active":"2024-09-22T08:14:54.726875+0000","last_became_peered":"2024-09-22T08:14:54.726875+0000","last_unstale":"2024-09-22T08:53:03.389601+0000","last_undegraded":"2024-09-22T08:53:03.389601+0000","last_fullsized":"2024-09-22T08:53:03.389601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:39:49.545065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000558433,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"263'180","reported_seq":785,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.389663+0000","last_change":"2024-09-22T08:15:04.964320+0000","last_active":"2024-09-22T08:56:16.389663+0000","last_peered":"2024-09-22T08:56:16.389663+0000","last_clean":"2024-09-22T08:56:16.389663+0000","last_became_active":"2024-09-22T08:15:04.963967+0000","last_became_peered":"2024-09-22T08:15:04.963967+0000","last_unstale":"2024-09-22T08:56:16.389663+0000","last_undegraded":"2024-09-22T08:56:16.389663+0000","last_fullsized":"2024-09-22T08:56:16.389663+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:27:24.495059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":424,"num_read_kb":76135,"num_write":811,"num_write_kb":37187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:58.381193+0000","last_change":"2024-09-22T08:15:08.969618+0000","last_active":"2024-09-22T08:51:58.381193+0000","last_peered":"2024-09-22T08:51:58.381193+0000","last_clean":"2024-09-22T08:51:58.381193+0000","last_became_active":"2024-09-22T08:15:08.969276+0000","last_became_peered":"2024-09-22T08:15:08.969276+0000","last_unstale":"2024-09-22T08:51:58.381193+0000","last_undegraded":"2024-09-22T08:51:58.381193+0000","last_fullsized":"2024-09-22T08:51:58.381193+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:45:38.728128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"263'861","reported_seq":2292,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.492952+0000","last_change":"2024-09-22T08:15:10.984491+0000","last_active":"2024-09-22T08:56:16.492952+0000","last_peered":"2024-09-22T08:56:16.492952+0000","last_clean":"2024-09-22T08:56:16.492952+0000","last_became_active":"2024-09-22T08:15:10.984157+0000","last_became_peered":"2024-09-22T08:15:10.984157+0000","last_unstale":"2024-09-22T08:56:16.492952+0000","last_undegraded":"2024-09-22T08:56:16.492952+0000","last_fullsized":"2024-09-22T08:56:16.492952+0000","mapping_epoch":29,"log_start":"263'800","ondisk_log_start":"263'800","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":800,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:22:53.295285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49716,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1169,"num_read_kb":1404,"num_write":276,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:48.387989+0000","last_change":"2024-09-22T08:15:13.012134+0000","last_active":"2024-09-22T08:52:48.387989+0000","last_peered":"2024-09-22T08:52:48.387989+0000","last_clean":"2024-09-22T08:52:48.387989+0000","last_became_active":"2024-09-22T08:15:13.011864+0000","last_became_peered":"2024-09-22T08:15:13.011864+0000","last_unstale":"2024-09-22T08:52:48.387989+0000","last_undegraded":"2024-09-22T08:52:48.387989+0000","last_fullsized":"2024-09-22T08:52:48.387989+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:25:33.123487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"263'214","reported_seq":740,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:21.016218+0000","last_change":"2024-09-22T08:15:15.014316+0000","last_active":"2024-09-22T08:54:21.016218+0000","last_peered":"2024-09-22T08:54:21.016218+0000","last_clean":"2024-09-22T08:54:21.016218+0000","last_became_active":"2024-09-22T08:15:15.014003+0000","last_became_peered":"2024-09-22T08:15:15.014003+0000","last_unstale":"2024-09-22T08:54:21.016218+0000","last_undegraded":"2024-09-22T08:54:21.016218+0000","last_fullsized":"2024-09-22T08:54:21.016218+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:43:13.045667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":401,"num_read_kb":391,"num_write":491,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"263'696","reported_seq":2529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.362007+0000","last_change":"2024-09-22T08:15:06.973031+0000","last_active":"2024-09-22T08:54:27.362007+0000","last_peered":"2024-09-22T08:54:27.362007+0000","last_clean":"2024-09-22T08:54:27.362007+0000","last_became_active":"2024-09-22T08:15:06.972591+0000","last_became_peered":"2024-09-22T08:15:06.972591+0000","last_unstale":"2024-09-22T08:54:27.362007+0000","last_undegraded":"2024-09-22T08:54:27.362007+0000","last_fullsized":"2024-09-22T08:54:27.362007+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":600,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:47.241992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3779,"num_read_kb":3472,"num_write":954,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:27.282937+0000","last_change":"2024-09-22T08:14:56.717627+0000","last_active":"2024-09-22T08:52:27.282937+0000","last_peered":"2024-09-22T08:52:27.282937+0000","last_clean":"2024-09-22T08:52:27.282937+0000","last_became_active":"2024-09-22T08:14:54.718660+0000","last_became_peered":"2024-09-22T08:14:54.718660+0000","last_unstale":"2024-09-22T08:52:27.282937+0000","last_undegraded":"2024-09-22T08:52:27.282937+0000","last_fullsized":"2024-09-22T08:52:27.282937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:04:54.693455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042448600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"263'260","reported_seq":945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.513802+0000","last_change":"2024-09-22T08:15:04.956486+0000","last_active":"2024-09-22T08:56:16.513802+0000","last_peered":"2024-09-22T08:56:16.513802+0000","last_clean":"2024-09-22T08:56:16.513802+0000","last_became_active":"2024-09-22T08:15:04.954726+0000","last_became_peered":"2024-09-22T08:15:04.954726+0000","last_unstale":"2024-09-22T08:56:16.513802+0000","last_undegraded":"2024-09-22T08:56:16.513802+0000","last_fullsized":"2024-09-22T08:56:16.513802+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:50:58.850263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":813,"num_read_kb":7176,"num_write":1020,"num_write_kb":41627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:02.279468+0000","last_change":"2024-09-22T08:15:08.974770+0000","last_active":"2024-09-22T08:52:02.279468+0000","last_peered":"2024-09-22T08:52:02.279468+0000","last_clean":"2024-09-22T08:52:02.279468+0000","last_became_active":"2024-09-22T08:15:08.974419+0000","last_became_peered":"2024-09-22T08:15:08.974419+0000","last_unstale":"2024-09-22T08:52:02.279468+0000","last_undegraded":"2024-09-22T08:52:02.279468+0000","last_fullsized":"2024-09-22T08:52:02.279468+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:25:16.095099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"263'233","reported_seq":1269,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:03.082254+0000","last_change":"2024-09-22T08:15:10.987757+0000","last_active":"2024-09-22T08:56:03.082254+0000","last_peered":"2024-09-22T08:56:03.082254+0000","last_clean":"2024-09-22T08:56:03.082254+0000","last_became_active":"2024-09-22T08:15:10.987358+0000","last_became_peered":"2024-09-22T08:15:10.987358+0000","last_unstale":"2024-09-22T08:56:03.082254+0000","last_undegraded":"2024-09-22T08:56:03.082254+0000","last_fullsized":"2024-09-22T08:56:03.082254+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:37:21.645192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":174,"num_read_kb":166,"num_write":139,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:42.398346+0000","last_change":"2024-09-22T08:15:13.010215+0000","last_active":"2024-09-22T08:52:42.398346+0000","last_peered":"2024-09-22T08:52:42.398346+0000","last_clean":"2024-09-22T08:52:42.398346+0000","last_became_active":"2024-09-22T08:15:13.009891+0000","last_became_peered":"2024-09-22T08:15:13.009891+0000","last_unstale":"2024-09-22T08:52:42.398346+0000","last_undegraded":"2024-09-22T08:52:42.398346+0000","last_fullsized":"2024-09-22T08:52:42.398346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:10:10.890953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"263'244","reported_seq":839,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.629431+0000","last_change":"2024-09-22T08:15:15.018070+0000","last_active":"2024-09-22T08:54:41.629431+0000","last_peered":"2024-09-22T08:54:41.629431+0000","last_clean":"2024-09-22T08:54:41.629431+0000","last_became_active":"2024-09-22T08:15:15.017686+0000","last_became_peered":"2024-09-22T08:15:15.017686+0000","last_unstale":"2024-09-22T08:54:41.629431+0000","last_undegraded":"2024-09-22T08:54:41.629431+0000","last_fullsized":"2024-09-22T08:54:41.629431+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:59:24.235010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":504,"num_read_kb":528,"num_write":541,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"263'456","reported_seq":1982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.479919+0000","last_change":"2024-09-22T08:15:06.963038+0000","last_active":"2024-09-22T08:54:41.479919+0000","last_peered":"2024-09-22T08:54:41.479919+0000","last_clean":"2024-09-22T08:54:41.479919+0000","last_became_active":"2024-09-22T08:15:06.962486+0000","last_became_peered":"2024-09-22T08:15:06.962486+0000","last_unstale":"2024-09-22T08:54:41.479919+0000","last_undegraded":"2024-09-22T08:54:41.479919+0000","last_fullsized":"2024-09-22T08:54:41.479919+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:46:27.014096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2436,"num_read_kb":2281,"num_write":554,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:28.385348+0000","last_change":"2024-09-22T08:14:56.729819+0000","last_active":"2024-09-22T08:52:28.385348+0000","last_peered":"2024-09-22T08:52:28.385348+0000","last_clean":"2024-09-22T08:52:28.385348+0000","last_became_active":"2024-09-22T08:14:55.586088+0000","last_became_peered":"2024-09-22T08:14:55.586088+0000","last_unstale":"2024-09-22T08:52:28.385348+0000","last_undegraded":"2024-09-22T08:52:28.385348+0000","last_fullsized":"2024-09-22T08:52:28.385348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:11:26.177736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010233219999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"263'159","reported_seq":747,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:20.955181+0000","last_change":"2024-09-22T08:15:04.964256+0000","last_active":"2024-09-22T08:54:20.955181+0000","last_peered":"2024-09-22T08:54:20.955181+0000","last_clean":"2024-09-22T08:54:20.955181+0000","last_became_active":"2024-09-22T08:15:04.963894+0000","last_became_peered":"2024-09-22T08:15:04.963894+0000","last_unstale":"2024-09-22T08:54:20.955181+0000","last_undegraded":"2024-09-22T08:54:20.955181+0000","last_fullsized":"2024-09-22T08:54:20.955181+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:03:26.990192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1397368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":408,"num_read_kb":11085,"num_write":744,"num_write_kb":14868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:52.286614+0000","last_change":"2024-09-22T08:15:08.968415+0000","last_active":"2024-09-22T08:52:52.286614+0000","last_peered":"2024-09-22T08:52:52.286614+0000","last_clean":"2024-09-22T08:52:52.286614+0000","last_became_active":"2024-09-22T08:15:08.968076+0000","last_became_peered":"2024-09-22T08:15:08.968076+0000","last_unstale":"2024-09-22T08:52:52.286614+0000","last_undegraded":"2024-09-22T08:52:52.286614+0000","last_fullsized":"2024-09-22T08:52:52.286614+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:46:34.843923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"263'111","reported_seq":650,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.699221+0000","last_change":"2024-09-22T08:15:10.992735+0000","last_active":"2024-09-22T08:55:19.699221+0000","last_peered":"2024-09-22T08:55:19.699221+0000","last_clean":"2024-09-22T08:55:19.699221+0000","last_became_active":"2024-09-22T08:15:10.992450+0000","last_became_peered":"2024-09-22T08:15:10.992450+0000","last_unstale":"2024-09-22T08:55:19.699221+0000","last_undegraded":"2024-09-22T08:55:19.699221+0000","last_fullsized":"2024-09-22T08:55:19.699221+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:04:43.027150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":139,"num_read_kb":133,"num_write":98,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:03.381868+0000","last_change":"2024-09-22T08:15:13.012190+0000","last_active":"2024-09-22T08:52:03.381868+0000","last_peered":"2024-09-22T08:52:03.381868+0000","last_clean":"2024-09-22T08:52:03.381868+0000","last_became_active":"2024-09-22T08:15:13.011756+0000","last_became_peered":"2024-09-22T08:15:13.011756+0000","last_unstale":"2024-09-22T08:52:03.381868+0000","last_undegraded":"2024-09-22T08:52:03.381868+0000","last_fullsized":"2024-09-22T08:52:03.381868+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:22:28.670776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"263'109","reported_seq":659,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:23.867017+0000","last_change":"2024-09-22T08:15:15.017200+0000","last_active":"2024-09-22T08:54:23.867017+0000","last_peered":"2024-09-22T08:54:23.867017+0000","last_clean":"2024-09-22T08:54:23.867017+0000","last_became_active":"2024-09-22T08:15:15.016910+0000","last_became_peered":"2024-09-22T08:15:15.016910+0000","last_unstale":"2024-09-22T08:54:23.867017+0000","last_undegraded":"2024-09-22T08:54:23.867017+0000","last_fullsized":"2024-09-22T08:54:23.867017+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:32:32.592078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":271,"num_read_kb":261,"num_write":275,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"263'846","reported_seq":2453,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:24.609357+0000","last_change":"2024-09-22T08:15:06.965563+0000","last_active":"2024-09-22T08:54:24.609357+0000","last_peered":"2024-09-22T08:54:24.609357+0000","last_clean":"2024-09-22T08:54:24.609357+0000","last_became_active":"2024-09-22T08:15:06.965021+0000","last_became_peered":"2024-09-22T08:15:06.965021+0000","last_unstale":"2024-09-22T08:54:24.609357+0000","last_undegraded":"2024-09-22T08:54:24.609357+0000","last_fullsized":"2024-09-22T08:54:24.609357+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":800,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:23:54.792970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4016,"num_read_kb":3619,"num_write":1120,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"263'170","reported_seq":776,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:08.199270+0000","last_change":"2024-09-22T08:15:04.960052+0000","last_active":"2024-09-22T08:54:08.199270+0000","last_peered":"2024-09-22T08:54:08.199270+0000","last_clean":"2024-09-22T08:54:08.199270+0000","last_became_active":"2024-09-22T08:15:04.958834+0000","last_became_peered":"2024-09-22T08:15:04.958834+0000","last_unstale":"2024-09-22T08:54:08.199270+0000","last_undegraded":"2024-09-22T08:54:08.199270+0000","last_fullsized":"2024-09-22T08:54:08.199270+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:26:47.552408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1229077,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":463,"num_read_kb":15054,"num_write":834,"num_write_kb":27215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:27.273473+0000","last_change":"2024-09-22T08:14:56.801946+0000","last_active":"2024-09-22T08:52:27.273473+0000","last_peered":"2024-09-22T08:52:27.273473+0000","last_clean":"2024-09-22T08:52:27.273473+0000","last_became_active":"2024-09-22T08:14:55.585738+0000","last_became_peered":"2024-09-22T08:14:55.585738+0000","last_unstale":"2024-09-22T08:52:27.273473+0000","last_undegraded":"2024-09-22T08:52:27.273473+0000","last_fullsized":"2024-09-22T08:52:27.273473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:33:45.401549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053802500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:42.398327+0000","last_change":"2024-09-22T08:15:08.975546+0000","last_active":"2024-09-22T08:52:42.398327+0000","last_peered":"2024-09-22T08:52:42.398327+0000","last_clean":"2024-09-22T08:52:42.398327+0000","last_became_active":"2024-09-22T08:15:08.975175+0000","last_became_peered":"2024-09-22T08:15:08.975175+0000","last_unstale":"2024-09-22T08:52:42.398327+0000","last_undegraded":"2024-09-22T08:52:42.398327+0000","last_fullsized":"2024-09-22T08:52:42.398327+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:08:07.721638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"263'293","reported_seq":956,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.453257+0000","last_change":"2024-09-22T08:15:10.982518+0000","last_active":"2024-09-22T08:56:16.453257+0000","last_peered":"2024-09-22T08:56:16.453257+0000","last_clean":"2024-09-22T08:56:16.453257+0000","last_became_active":"2024-09-22T08:15:10.982147+0000","last_became_peered":"2024-09-22T08:15:10.982147+0000","last_unstale":"2024-09-22T08:56:16.453257+0000","last_undegraded":"2024-09-22T08:56:16.453257+0000","last_fullsized":"2024-09-22T08:56:16.453257+0000","mapping_epoch":29,"log_start":"260'200","ondisk_log_start":"260'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:56:53.506784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30730,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1060,"num_read_kb":1272,"num_write":1552,"num_write_kb":1410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:46.263665+0000","last_change":"2024-09-22T08:15:13.014254+0000","last_active":"2024-09-22T08:52:46.263665+0000","last_peered":"2024-09-22T08:52:46.263665+0000","last_clean":"2024-09-22T08:52:46.263665+0000","last_became_active":"2024-09-22T08:15:13.013980+0000","last_became_peered":"2024-09-22T08:15:13.013980+0000","last_unstale":"2024-09-22T08:52:46.263665+0000","last_undegraded":"2024-09-22T08:52:46.263665+0000","last_fullsized":"2024-09-22T08:52:46.263665+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:43:47.566603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"263'169","reported_seq":721,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.923448+0000","last_change":"2024-09-22T08:15:15.012481+0000","last_active":"2024-09-22T08:54:38.923448+0000","last_peered":"2024-09-22T08:54:38.923448+0000","last_clean":"2024-09-22T08:54:38.923448+0000","last_became_active":"2024-09-22T08:15:15.012146+0000","last_became_peered":"2024-09-22T08:15:15.012146+0000","last_unstale":"2024-09-22T08:54:38.923448+0000","last_undegraded":"2024-09-22T08:54:38.923448+0000","last_fullsized":"2024-09-22T08:54:38.923448+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:12:50.086341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":420,"num_read_kb":363,"num_write":419,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"263'442","reported_seq":2036,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.480349+0000","last_change":"2024-09-22T08:15:06.973875+0000","last_active":"2024-09-22T08:54:41.480349+0000","last_peered":"2024-09-22T08:54:41.480349+0000","last_clean":"2024-09-22T08:54:41.480349+0000","last_became_active":"2024-09-22T08:15:06.973563+0000","last_became_peered":"2024-09-22T08:15:06.973563+0000","last_unstale":"2024-09-22T08:54:41.480349+0000","last_undegraded":"2024-09-22T08:54:41.480349+0000","last_fullsized":"2024-09-22T08:54:41.480349+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:06:45.622252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2370,"num_read_kb":2248,"num_write":498,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"263'189","reported_seq":810,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.434906+0000","last_change":"2024-09-22T08:15:04.956915+0000","last_active":"2024-09-22T08:56:16.434906+0000","last_peered":"2024-09-22T08:56:16.434906+0000","last_clean":"2024-09-22T08:56:16.434906+0000","last_became_active":"2024-09-22T08:15:04.956585+0000","last_became_peered":"2024-09-22T08:15:04.956585+0000","last_unstale":"2024-09-22T08:56:16.434906+0000","last_undegraded":"2024-09-22T08:56:16.434906+0000","last_fullsized":"2024-09-22T08:56:16.434906+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:18.062351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":533,"num_read_kb":28072,"num_write":815,"num_write_kb":27925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:33.386112+0000","last_change":"2024-09-22T08:14:56.729377+0000","last_active":"2024-09-22T08:52:33.386112+0000","last_peered":"2024-09-22T08:52:33.386112+0000","last_clean":"2024-09-22T08:52:33.386112+0000","last_became_active":"2024-09-22T08:14:54.727321+0000","last_became_peered":"2024-09-22T08:14:54.727321+0000","last_unstale":"2024-09-22T08:52:33.386112+0000","last_undegraded":"2024-09-22T08:52:33.386112+0000","last_fullsized":"2024-09-22T08:52:33.386112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:21:23.198586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058148900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:38.469084+0000","last_change":"2024-09-22T08:15:08.975127+0000","last_active":"2024-09-22T08:52:38.469084+0000","last_peered":"2024-09-22T08:52:38.469084+0000","last_clean":"2024-09-22T08:52:38.469084+0000","last_became_active":"2024-09-22T08:15:08.974823+0000","last_became_peered":"2024-09-22T08:15:08.974823+0000","last_unstale":"2024-09-22T08:52:38.469084+0000","last_undegraded":"2024-09-22T08:52:38.469084+0000","last_fullsized":"2024-09-22T08:52:38.469084+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:35:56.356491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"263'158","reported_seq":713,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.767668+0000","last_change":"2024-09-22T08:15:10.991721+0000","last_active":"2024-09-22T08:55:19.767668+0000","last_peered":"2024-09-22T08:55:19.767668+0000","last_clean":"2024-09-22T08:55:19.767668+0000","last_became_active":"2024-09-22T08:15:10.991426+0000","last_became_peered":"2024-09-22T08:15:10.991426+0000","last_unstale":"2024-09-22T08:55:19.767668+0000","last_undegraded":"2024-09-22T08:55:19.767668+0000","last_fullsized":"2024-09-22T08:55:19.767668+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:13:29.594926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":204,"num_read_kb":193,"num_write":140,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"263'787","reported_seq":4933,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:03.377377+0000","last_change":"2024-09-22T08:15:13.014146+0000","last_active":"2024-09-22T08:56:03.377377+0000","last_peered":"2024-09-22T08:56:03.377377+0000","last_clean":"2024-09-22T08:56:03.377377+0000","last_became_active":"2024-09-22T08:15:13.013828+0000","last_became_peered":"2024-09-22T08:15:13.013828+0000","last_unstale":"2024-09-22T08:56:03.377377+0000","last_undegraded":"2024-09-22T08:56:03.377377+0000","last_fullsized":"2024-09-22T08:56:03.377377+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:14:34.454135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"263'140","reported_seq":640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:57.311692+0000","last_change":"2024-09-22T08:15:15.014270+0000","last_active":"2024-09-22T08:55:57.311692+0000","last_peered":"2024-09-22T08:55:57.311692+0000","last_clean":"2024-09-22T08:55:57.311692+0000","last_became_active":"2024-09-22T08:15:15.013976+0000","last_became_peered":"2024-09-22T08:15:15.013976+0000","last_unstale":"2024-09-22T08:55:57.311692+0000","last_undegraded":"2024-09-22T08:55:57.311692+0000","last_fullsized":"2024-09-22T08:55:57.311692+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:36:15.356232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":177,"num_read_kb":172,"num_write":337,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"263'452","reported_seq":1950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.926375+0000","last_change":"2024-09-22T08:15:06.966706+0000","last_active":"2024-09-22T08:54:38.926375+0000","last_peered":"2024-09-22T08:54:38.926375+0000","last_clean":"2024-09-22T08:54:38.926375+0000","last_became_active":"2024-09-22T08:15:06.966387+0000","last_became_peered":"2024-09-22T08:15:06.966387+0000","last_unstale":"2024-09-22T08:54:38.926375+0000","last_undegraded":"2024-09-22T08:54:38.926375+0000","last_fullsized":"2024-09-22T08:54:38.926375+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:16:14.149148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2402,"num_read_kb":2235,"num_write":539,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"263'205","reported_seq":835,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.558391+0000","last_change":"2024-09-22T08:15:04.952329+0000","last_active":"2024-09-22T08:56:16.558391+0000","last_peered":"2024-09-22T08:56:16.558391+0000","last_clean":"2024-09-22T08:56:16.558391+0000","last_became_active":"2024-09-22T08:15:04.951731+0000","last_became_peered":"2024-09-22T08:15:04.951731+0000","last_unstale":"2024-09-22T08:56:16.558391+0000","last_undegraded":"2024-09-22T08:56:16.558391+0000","last_fullsized":"2024-09-22T08:56:16.558391+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:44:40.856747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079922,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":440,"num_read_kb":57796,"num_write":879,"num_write_kb":62478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:57.408520+0000","last_change":"2024-09-22T08:14:56.713315+0000","last_active":"2024-09-22T08:53:57.408520+0000","last_peered":"2024-09-22T08:53:57.408520+0000","last_clean":"2024-09-22T08:53:57.408520+0000","last_became_active":"2024-09-22T08:14:55.585607+0000","last_became_peered":"2024-09-22T08:14:55.585607+0000","last_unstale":"2024-09-22T08:53:57.408520+0000","last_undegraded":"2024-09-22T08:53:57.408520+0000","last_fullsized":"2024-09-22T08:53:57.408520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:00:51.872643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049298099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:38.386674+0000","last_change":"2024-09-22T08:15:08.969703+0000","last_active":"2024-09-22T08:52:38.386674+0000","last_peered":"2024-09-22T08:52:38.386674+0000","last_clean":"2024-09-22T08:52:38.386674+0000","last_became_active":"2024-09-22T08:15:08.969373+0000","last_became_peered":"2024-09-22T08:15:08.969373+0000","last_unstale":"2024-09-22T08:52:38.386674+0000","last_undegraded":"2024-09-22T08:52:38.386674+0000","last_fullsized":"2024-09-22T08:52:38.386674+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:47:22.188961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"263'106","reported_seq":641,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.751986+0000","last_change":"2024-09-22T08:15:10.986552+0000","last_active":"2024-09-22T08:55:19.751986+0000","last_peered":"2024-09-22T08:55:19.751986+0000","last_clean":"2024-09-22T08:55:19.751986+0000","last_became_active":"2024-09-22T08:15:10.984232+0000","last_became_peered":"2024-09-22T08:15:10.984232+0000","last_unstale":"2024-09-22T08:55:19.751986+0000","last_undegraded":"2024-09-22T08:55:19.751986+0000","last_fullsized":"2024-09-22T08:55:19.751986+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:21.636103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":116,"num_write":82,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"263'792","reported_seq":2214,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.233603+0000","last_change":"2024-09-22T08:15:13.008717+0000","last_active":"2024-09-22T08:56:16.233603+0000","last_peered":"2024-09-22T08:56:16.233603+0000","last_clean":"2024-09-22T08:56:16.233603+0000","last_became_active":"2024-09-22T08:15:13.008027+0000","last_became_peered":"2024-09-22T08:15:13.008027+0000","last_unstale":"2024-09-22T08:56:16.233603+0000","last_undegraded":"2024-09-22T08:56:16.233603+0000","last_fullsized":"2024-09-22T08:56:16.233603+0000","mapping_epoch":31,"log_start":"263'701","ondisk_log_start":"263'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":701,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:47:23.567624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"263'198","reported_seq":712,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:51.192463+0000","last_change":"2024-09-22T08:15:15.014730+0000","last_active":"2024-09-22T08:53:51.192463+0000","last_peered":"2024-09-22T08:53:51.192463+0000","last_clean":"2024-09-22T08:53:51.192463+0000","last_became_active":"2024-09-22T08:15:15.014423+0000","last_became_peered":"2024-09-22T08:15:15.014423+0000","last_unstale":"2024-09-22T08:53:51.192463+0000","last_undegraded":"2024-09-22T08:53:51.192463+0000","last_fullsized":"2024-09-22T08:53:51.192463+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:25:32.708147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":250,"num_read_kb":232,"num_write":460,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"263'497","reported_seq":2058,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.360747+0000","last_change":"2024-09-22T08:15:06.968425+0000","last_active":"2024-09-22T08:54:27.360747+0000","last_peered":"2024-09-22T08:54:27.360747+0000","last_clean":"2024-09-22T08:54:27.360747+0000","last_became_active":"2024-09-22T08:15:06.968153+0000","last_became_peered":"2024-09-22T08:15:06.968153+0000","last_unstale":"2024-09-22T08:54:27.360747+0000","last_undegraded":"2024-09-22T08:54:27.360747+0000","last_fullsized":"2024-09-22T08:54:27.360747+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:29:50.157707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2565,"num_read_kb":2386,"num_write":597,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"263'198","reported_seq":816,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.531962+0000","last_change":"2024-09-22T08:15:04.944258+0000","last_active":"2024-09-22T08:56:16.531962+0000","last_peered":"2024-09-22T08:56:16.531962+0000","last_clean":"2024-09-22T08:56:16.531962+0000","last_became_active":"2024-09-22T08:15:04.943901+0000","last_became_peered":"2024-09-22T08:15:04.943901+0000","last_unstale":"2024-09-22T08:56:16.531962+0000","last_undegraded":"2024-09-22T08:56:16.531962+0000","last_fullsized":"2024-09-22T08:56:16.531962+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:56:16.418792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":512,"num_read_kb":4964,"num_write":959,"num_write_kb":21539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:58.396569+0000","last_change":"2024-09-22T08:14:56.730085+0000","last_active":"2024-09-22T08:53:58.396569+0000","last_peered":"2024-09-22T08:53:58.396569+0000","last_clean":"2024-09-22T08:53:58.396569+0000","last_became_active":"2024-09-22T08:14:55.585485+0000","last_became_peered":"2024-09-22T08:14:55.585485+0000","last_unstale":"2024-09-22T08:53:58.396569+0000","last_undegraded":"2024-09-22T08:53:58.396569+0000","last_fullsized":"2024-09-22T08:53:58.396569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:42:52.718426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012642249999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:17.402768+0000","last_change":"2024-09-22T08:15:08.979746+0000","last_active":"2024-09-22T08:53:17.402768+0000","last_peered":"2024-09-22T08:53:17.402768+0000","last_clean":"2024-09-22T08:53:17.402768+0000","last_became_active":"2024-09-22T08:15:08.979291+0000","last_became_peered":"2024-09-22T08:15:08.979291+0000","last_unstale":"2024-09-22T08:53:17.402768+0000","last_undegraded":"2024-09-22T08:53:17.402768+0000","last_fullsized":"2024-09-22T08:53:17.402768+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:35:42.491182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"263'309","reported_seq":1008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:03.336761+0000","last_change":"2024-09-22T08:15:10.979541+0000","last_active":"2024-09-22T08:56:03.336761+0000","last_peered":"2024-09-22T08:56:03.336761+0000","last_clean":"2024-09-22T08:56:03.336761+0000","last_became_active":"2024-09-22T08:15:10.979261+0000","last_became_peered":"2024-09-22T08:15:10.979261+0000","last_unstale":"2024-09-22T08:56:03.336761+0000","last_undegraded":"2024-09-22T08:56:03.336761+0000","last_fullsized":"2024-09-22T08:56:03.336761+0000","mapping_epoch":29,"log_start":"260'200","ondisk_log_start":"260'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:29:00.655646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40554,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":435,"num_read_kb":615,"num_write":222,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:42.398292+0000","last_change":"2024-09-22T08:15:13.003662+0000","last_active":"2024-09-22T08:52:42.398292+0000","last_peered":"2024-09-22T08:52:42.398292+0000","last_clean":"2024-09-22T08:52:42.398292+0000","last_became_active":"2024-09-22T08:15:13.003041+0000","last_became_peered":"2024-09-22T08:15:13.003041+0000","last_unstale":"2024-09-22T08:52:42.398292+0000","last_undegraded":"2024-09-22T08:52:42.398292+0000","last_fullsized":"2024-09-22T08:52:42.398292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:43:46.552092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"263'126","reported_seq":624,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:09.125091+0000","last_change":"2024-09-22T08:15:15.015370+0000","last_active":"2024-09-22T08:54:09.125091+0000","last_peered":"2024-09-22T08:54:09.125091+0000","last_clean":"2024-09-22T08:54:09.125091+0000","last_became_active":"2024-09-22T08:15:15.014775+0000","last_became_peered":"2024-09-22T08:15:15.014775+0000","last_unstale":"2024-09-22T08:54:09.125091+0000","last_undegraded":"2024-09-22T08:54:09.125091+0000","last_fullsized":"2024-09-22T08:54:09.125091+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:42:57.977942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":162,"num_read_kb":158,"num_write":286,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"263'108","reported_seq":658,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.586531+0000","last_change":"2024-09-22T08:15:15.020963+0000","last_active":"2024-09-22T08:54:41.586531+0000","last_peered":"2024-09-22T08:54:41.586531+0000","last_clean":"2024-09-22T08:54:41.586531+0000","last_became_active":"2024-09-22T08:15:15.020653+0000","last_became_peered":"2024-09-22T08:15:15.020653+0000","last_unstale":"2024-09-22T08:54:41.586531+0000","last_undegraded":"2024-09-22T08:54:41.586531+0000","last_fullsized":"2024-09-22T08:54:41.586531+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:30:42.055327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":202,"num_read_kb":202,"num_write":258,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"263'487","reported_seq":2210,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.031042+0000","last_change":"2024-09-22T08:15:06.970797+0000","last_active":"2024-09-22T08:56:02.031042+0000","last_peered":"2024-09-22T08:56:02.031042+0000","last_clean":"2024-09-22T08:56:02.031042+0000","last_became_active":"2024-09-22T08:15:06.970382+0000","last_became_peered":"2024-09-22T08:15:06.970382+0000","last_unstale":"2024-09-22T08:56:02.031042+0000","last_undegraded":"2024-09-22T08:56:02.031042+0000","last_fullsized":"2024-09-22T08:56:02.031042+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:20:33.767995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2792,"num_read_kb":2647,"num_write":560,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"263'220","reported_seq":867,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:50.871750+0000","last_change":"2024-09-22T08:15:04.966483+0000","last_active":"2024-09-22T08:53:50.871750+0000","last_peered":"2024-09-22T08:53:50.871750+0000","last_clean":"2024-09-22T08:53:50.871750+0000","last_became_active":"2024-09-22T08:15:04.965572+0000","last_became_peered":"2024-09-22T08:15:04.965572+0000","last_unstale":"2024-09-22T08:53:50.871750+0000","last_undegraded":"2024-09-22T08:53:50.871750+0000","last_fullsized":"2024-09-22T08:53:50.871750+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:27:30.805751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8745608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":593,"num_read_kb":42984,"num_write":1008,"num_write_kb":35756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:32.274252+0000","last_change":"2024-09-22T08:15:08.976752+0000","last_active":"2024-09-22T08:52:32.274252+0000","last_peered":"2024-09-22T08:52:32.274252+0000","last_clean":"2024-09-22T08:52:32.274252+0000","last_became_active":"2024-09-22T08:15:08.976444+0000","last_became_peered":"2024-09-22T08:15:08.976444+0000","last_unstale":"2024-09-22T08:52:32.274252+0000","last_undegraded":"2024-09-22T08:52:32.274252+0000","last_fullsized":"2024-09-22T08:52:32.274252+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:57:35.914622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"263'133","reported_seq":699,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.383600+0000","last_change":"2024-09-22T08:15:10.987944+0000","last_active":"2024-09-22T08:56:16.383600+0000","last_peered":"2024-09-22T08:56:16.383600+0000","last_clean":"2024-09-22T08:56:16.383600+0000","last_became_active":"2024-09-22T08:15:10.987623+0000","last_became_peered":"2024-09-22T08:15:10.987623+0000","last_unstale":"2024-09-22T08:56:16.383600+0000","last_undegraded":"2024-09-22T08:56:16.383600+0000","last_fullsized":"2024-09-22T08:56:16.383600+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:57:31.114053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8761,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":170,"num_read_kb":207,"num_write":88,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:32.283704+0000","last_change":"2024-09-22T08:15:12.997719+0000","last_active":"2024-09-22T08:52:32.283704+0000","last_peered":"2024-09-22T08:52:32.283704+0000","last_clean":"2024-09-22T08:52:32.283704+0000","last_became_active":"2024-09-22T08:15:12.997350+0000","last_became_peered":"2024-09-22T08:15:12.997350+0000","last_unstale":"2024-09-22T08:52:32.283704+0000","last_undegraded":"2024-09-22T08:52:32.283704+0000","last_fullsized":"2024-09-22T08:52:32.283704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:08:30.511917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"263'110","reported_seq":606,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.956370+0000","last_change":"2024-09-22T08:15:15.017170+0000","last_active":"2024-09-22T08:54:27.956370+0000","last_peered":"2024-09-22T08:54:27.956370+0000","last_clean":"2024-09-22T08:54:27.956370+0000","last_became_active":"2024-09-22T08:15:15.016918+0000","last_became_peered":"2024-09-22T08:15:15.016918+0000","last_unstale":"2024-09-22T08:54:27.956370+0000","last_undegraded":"2024-09-22T08:54:27.956370+0000","last_fullsized":"2024-09-22T08:54:27.956370+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:37:28.672486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":125,"num_write":254,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"263'1037","reported_seq":2820,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:23.395142+0000","last_change":"2024-09-22T08:15:06.965797+0000","last_active":"2024-09-22T08:54:23.395142+0000","last_peered":"2024-09-22T08:54:23.395142+0000","last_clean":"2024-09-22T08:54:23.395142+0000","last_became_active":"2024-09-22T08:15:06.965465+0000","last_became_peered":"2024-09-22T08:15:06.965465+0000","last_unstale":"2024-09-22T08:54:23.395142+0000","last_undegraded":"2024-09-22T08:54:23.395142+0000","last_fullsized":"2024-09-22T08:54:23.395142+0000","mapping_epoch":25,"log_start":"263'1000","ondisk_log_start":"263'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":1000,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:50:52.178644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5105,"num_read_kb":4580,"num_write":1460,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"263'203","reported_seq":821,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:48.478344+0000","last_change":"2024-09-22T08:15:04.949496+0000","last_active":"2024-09-22T08:53:48.478344+0000","last_peered":"2024-09-22T08:53:48.478344+0000","last_clean":"2024-09-22T08:53:48.478344+0000","last_became_active":"2024-09-22T08:15:04.949181+0000","last_became_peered":"2024-09-22T08:15:04.949181+0000","last_unstale":"2024-09-22T08:53:48.478344+0000","last_undegraded":"2024-09-22T08:53:48.478344+0000","last_fullsized":"2024-09-22T08:53:48.478344+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:45:42.806686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10517089,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":534,"num_read_kb":11766,"num_write":953,"num_write_kb":45959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:32.396743+0000","last_change":"2024-09-22T08:15:08.976023+0000","last_active":"2024-09-22T08:52:32.396743+0000","last_peered":"2024-09-22T08:52:32.396743+0000","last_clean":"2024-09-22T08:52:32.396743+0000","last_became_active":"2024-09-22T08:15:08.975704+0000","last_became_peered":"2024-09-22T08:15:08.975704+0000","last_unstale":"2024-09-22T08:52:32.396743+0000","last_undegraded":"2024-09-22T08:52:32.396743+0000","last_fullsized":"2024-09-22T08:52:32.396743+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:17:14.568660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"263'38","reported_seq":538,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.550720+0000","last_change":"2024-09-22T08:15:10.983890+0000","last_active":"2024-09-22T08:55:19.550720+0000","last_peered":"2024-09-22T08:55:19.550720+0000","last_clean":"2024-09-22T08:55:19.550720+0000","last_became_active":"2024-09-22T08:15:10.983593+0000","last_became_peered":"2024-09-22T08:15:10.983593+0000","last_unstale":"2024-09-22T08:55:19.550720+0000","last_undegraded":"2024-09-22T08:55:19.550720+0000","last_fullsized":"2024-09-22T08:55:19.550720+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:52:12.816398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:36.262497+0000","last_change":"2024-09-22T08:15:13.019365+0000","last_active":"2024-09-22T08:52:36.262497+0000","last_peered":"2024-09-22T08:52:36.262497+0000","last_clean":"2024-09-22T08:52:36.262497+0000","last_became_active":"2024-09-22T08:15:13.019020+0000","last_became_peered":"2024-09-22T08:15:13.019020+0000","last_unstale":"2024-09-22T08:52:36.262497+0000","last_undegraded":"2024-09-22T08:52:36.262497+0000","last_fullsized":"2024-09-22T08:52:36.262497+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:35:35.235215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"263'182","reported_seq":702,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:40.942611+0000","last_change":"2024-09-22T08:15:15.013674+0000","last_active":"2024-09-22T08:54:40.942611+0000","last_peered":"2024-09-22T08:54:40.942611+0000","last_clean":"2024-09-22T08:54:40.942611+0000","last_became_active":"2024-09-22T08:15:15.013300+0000","last_became_peered":"2024-09-22T08:15:15.013300+0000","last_unstale":"2024-09-22T08:54:40.942611+0000","last_undegraded":"2024-09-22T08:54:40.942611+0000","last_fullsized":"2024-09-22T08:54:40.942611+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:24:00.672977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":337,"num_read_kb":325,"num_write":401,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"263'1197","reported_seq":2836,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.361022+0000","last_change":"2024-09-22T08:15:06.957428+0000","last_active":"2024-09-22T08:54:27.361022+0000","last_peered":"2024-09-22T08:54:27.361022+0000","last_clean":"2024-09-22T08:54:27.361022+0000","last_became_active":"2024-09-22T08:15:06.957116+0000","last_became_peered":"2024-09-22T08:15:06.957116+0000","last_unstale":"2024-09-22T08:54:27.361022+0000","last_undegraded":"2024-09-22T08:54:27.361022+0000","last_fullsized":"2024-09-22T08:54:27.361022+0000","mapping_epoch":25,"log_start":"263'1100","ondisk_log_start":"263'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":1100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:50:47.227003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5635,"num_read_kb":5002,"num_write":1685,"num_write_kb":733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"263'188","reported_seq":802,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:26.655338+0000","last_change":"2024-09-22T08:15:04.969475+0000","last_active":"2024-09-22T08:54:26.655338+0000","last_peered":"2024-09-22T08:54:26.655338+0000","last_clean":"2024-09-22T08:54:26.655338+0000","last_became_active":"2024-09-22T08:15:04.968557+0000","last_became_peered":"2024-09-22T08:15:04.968557+0000","last_unstale":"2024-09-22T08:54:26.655338+0000","last_undegraded":"2024-09-22T08:54:26.655338+0000","last_fullsized":"2024-09-22T08:54:26.655338+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:09:13.268818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3177072,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":518,"num_read_kb":8164,"num_write":862,"num_write_kb":39531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:31.261934+0000","last_change":"2024-09-22T08:15:08.975282+0000","last_active":"2024-09-22T08:52:31.261934+0000","last_peered":"2024-09-22T08:52:31.261934+0000","last_clean":"2024-09-22T08:52:31.261934+0000","last_became_active":"2024-09-22T08:15:08.975001+0000","last_became_peered":"2024-09-22T08:15:08.975001+0000","last_unstale":"2024-09-22T08:52:31.261934+0000","last_undegraded":"2024-09-22T08:52:31.261934+0000","last_fullsized":"2024-09-22T08:52:31.261934+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:33.382158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"263'169","reported_seq":759,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.286569+0000","last_change":"2024-09-22T08:15:10.980804+0000","last_active":"2024-09-22T08:56:16.286569+0000","last_peered":"2024-09-22T08:56:16.286569+0000","last_clean":"2024-09-22T08:56:16.286569+0000","last_became_active":"2024-09-22T08:15:10.980443+0000","last_became_peered":"2024-09-22T08:15:10.980443+0000","last_unstale":"2024-09-22T08:56:16.286569+0000","last_undegraded":"2024-09-22T08:56:16.286569+0000","last_fullsized":"2024-09-22T08:56:16.286569+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:05:27.025223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":222,"num_read_kb":300,"num_write":124,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:33.385632+0000","last_change":"2024-09-22T08:15:13.010967+0000","last_active":"2024-09-22T08:52:33.385632+0000","last_peered":"2024-09-22T08:52:33.385632+0000","last_clean":"2024-09-22T08:52:33.385632+0000","last_became_active":"2024-09-22T08:15:13.010660+0000","last_became_peered":"2024-09-22T08:15:13.010660+0000","last_unstale":"2024-09-22T08:52:33.385632+0000","last_undegraded":"2024-09-22T08:52:33.385632+0000","last_fullsized":"2024-09-22T08:52:33.385632+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:04:33.172378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"263'141","reported_seq":674,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:23.390425+0000","last_change":"2024-09-22T08:15:15.015966+0000","last_active":"2024-09-22T08:54:23.390425+0000","last_peered":"2024-09-22T08:54:23.390425+0000","last_clean":"2024-09-22T08:54:23.390425+0000","last_became_active":"2024-09-22T08:15:15.015497+0000","last_became_peered":"2024-09-22T08:15:15.015497+0000","last_unstale":"2024-09-22T08:54:23.390425+0000","last_undegraded":"2024-09-22T08:54:23.390425+0000","last_fullsized":"2024-09-22T08:54:23.390425+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:19:47.834057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":885,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":300,"num_read_kb":272,"num_write":341,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"263'915","reported_seq":2761,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.032493+0000","last_change":"2024-09-22T08:15:06.964381+0000","last_active":"2024-09-22T08:56:02.032493+0000","last_peered":"2024-09-22T08:56:02.032493+0000","last_clean":"2024-09-22T08:56:02.032493+0000","last_became_active":"2024-09-22T08:15:06.964082+0000","last_became_peered":"2024-09-22T08:15:06.964082+0000","last_unstale":"2024-09-22T08:56:02.032493+0000","last_undegraded":"2024-09-22T08:56:02.032493+0000","last_fullsized":"2024-09-22T08:56:02.032493+0000","mapping_epoch":25,"log_start":"263'900","ondisk_log_start":"263'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":900,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:59:59.631124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4594,"num_read_kb":4173,"num_write":1193,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"263'259","reported_seq":885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.532208+0000","last_change":"2024-09-22T08:15:04.956185+0000","last_active":"2024-09-22T08:56:16.532208+0000","last_peered":"2024-09-22T08:56:16.532208+0000","last_clean":"2024-09-22T08:56:16.532208+0000","last_became_active":"2024-09-22T08:15:04.954431+0000","last_became_peered":"2024-09-22T08:15:04.954431+0000","last_unstale":"2024-09-22T08:56:16.532208+0000","last_undegraded":"2024-09-22T08:56:16.532208+0000","last_fullsized":"2024-09-22T08:56:16.532208+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:58:31.332537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":625,"num_read_kb":10749,"num_write":1043,"num_write_kb":36368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:28.385312+0000","last_change":"2024-09-22T08:15:08.978366+0000","last_active":"2024-09-22T08:52:28.385312+0000","last_peered":"2024-09-22T08:52:28.385312+0000","last_clean":"2024-09-22T08:52:28.385312+0000","last_became_active":"2024-09-22T08:15:08.978080+0000","last_became_peered":"2024-09-22T08:15:08.978080+0000","last_unstale":"2024-09-22T08:52:28.385312+0000","last_undegraded":"2024-09-22T08:52:28.385312+0000","last_fullsized":"2024-09-22T08:52:28.385312+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:58:42.395174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"263'132","reported_seq":691,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.643815+0000","last_change":"2024-09-22T08:15:10.975370+0000","last_active":"2024-09-22T08:55:19.643815+0000","last_peered":"2024-09-22T08:55:19.643815+0000","last_clean":"2024-09-22T08:55:19.643815+0000","last_became_active":"2024-09-22T08:15:10.975066+0000","last_became_peered":"2024-09-22T08:15:10.975066+0000","last_unstale":"2024-09-22T08:55:19.643815+0000","last_undegraded":"2024-09-22T08:55:19.643815+0000","last_fullsized":"2024-09-22T08:55:19.643815+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:20:29.364085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10151,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":148,"num_read_kb":198,"num_write":76,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:32.283752+0000","last_change":"2024-09-22T08:15:13.008345+0000","last_active":"2024-09-22T08:52:32.283752+0000","last_peered":"2024-09-22T08:52:32.283752+0000","last_clean":"2024-09-22T08:52:32.283752+0000","last_became_active":"2024-09-22T08:15:13.008005+0000","last_became_peered":"2024-09-22T08:15:13.008005+0000","last_unstale":"2024-09-22T08:52:32.283752+0000","last_undegraded":"2024-09-22T08:52:32.283752+0000","last_fullsized":"2024-09-22T08:52:32.283752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:44:00.256968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"263'386","reported_seq":1910,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:19.614767+0000","last_change":"2024-09-22T08:15:06.974360+0000","last_active":"2024-09-22T08:54:19.614767+0000","last_peered":"2024-09-22T08:54:19.614767+0000","last_clean":"2024-09-22T08:54:19.614767+0000","last_became_active":"2024-09-22T08:15:06.974083+0000","last_became_peered":"2024-09-22T08:15:06.974083+0000","last_unstale":"2024-09-22T08:54:19.614767+0000","last_undegraded":"2024-09-22T08:54:19.614767+0000","last_fullsized":"2024-09-22T08:54:19.614767+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:42:23.068549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2095,"num_read_kb":2009,"num_write":415,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"263'216","reported_seq":850,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.483594+0000","last_change":"2024-09-22T08:15:04.953656+0000","last_active":"2024-09-22T08:56:16.483594+0000","last_peered":"2024-09-22T08:56:16.483594+0000","last_clean":"2024-09-22T08:56:16.483594+0000","last_became_active":"2024-09-22T08:15:04.953371+0000","last_became_peered":"2024-09-22T08:15:04.953371+0000","last_unstale":"2024-09-22T08:56:16.483594+0000","last_undegraded":"2024-09-22T08:56:16.483594+0000","last_fullsized":"2024-09-22T08:56:16.483594+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:18:43.995683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079956,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":551,"num_read_kb":20845,"num_write":984,"num_write_kb":34041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:22.281487+0000","last_change":"2024-09-22T08:15:08.978352+0000","last_active":"2024-09-22T08:53:22.281487+0000","last_peered":"2024-09-22T08:53:22.281487+0000","last_clean":"2024-09-22T08:53:22.281487+0000","last_became_active":"2024-09-22T08:15:08.977975+0000","last_became_peered":"2024-09-22T08:15:08.977975+0000","last_unstale":"2024-09-22T08:53:22.281487+0000","last_undegraded":"2024-09-22T08:53:22.281487+0000","last_fullsized":"2024-09-22T08:53:22.281487+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:36:49.695370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"263'212","reported_seq":832,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.526285+0000","last_change":"2024-09-22T08:15:10.985792+0000","last_active":"2024-09-22T08:56:16.526285+0000","last_peered":"2024-09-22T08:56:16.526285+0000","last_clean":"2024-09-22T08:56:16.526285+0000","last_became_active":"2024-09-22T08:15:10.985454+0000","last_became_peered":"2024-09-22T08:15:10.985454+0000","last_unstale":"2024-09-22T08:56:16.526285+0000","last_undegraded":"2024-09-22T08:56:16.526285+0000","last_fullsized":"2024-09-22T08:56:16.526285+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:42:16.011379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24540,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":311,"num_read_kb":482,"num_write":196,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:46.263744+0000","last_change":"2024-09-22T08:15:13.008746+0000","last_active":"2024-09-22T08:52:46.263744+0000","last_peered":"2024-09-22T08:52:46.263744+0000","last_clean":"2024-09-22T08:52:46.263744+0000","last_became_active":"2024-09-22T08:15:13.008080+0000","last_became_peered":"2024-09-22T08:15:13.008080+0000","last_unstale":"2024-09-22T08:52:46.263744+0000","last_undegraded":"2024-09-22T08:52:46.263744+0000","last_fullsized":"2024-09-22T08:52:46.263744+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:40:33.932227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"263'174","reported_seq":680,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.958769+0000","last_change":"2024-09-22T08:15:15.014411+0000","last_active":"2024-09-22T08:54:27.958769+0000","last_peered":"2024-09-22T08:54:27.958769+0000","last_clean":"2024-09-22T08:54:27.958769+0000","last_became_active":"2024-09-22T08:15:15.014112+0000","last_became_peered":"2024-09-22T08:15:15.014112+0000","last_unstale":"2024-09-22T08:54:27.958769+0000","last_undegraded":"2024-09-22T08:54:27.958769+0000","last_fullsized":"2024-09-22T08:54:27.958769+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:23:12.522068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":264,"num_read_kb":269,"num_write":416,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"263'430","reported_seq":2036,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.040119+0000","last_change":"2024-09-22T08:15:06.967093+0000","last_active":"2024-09-22T08:56:02.040119+0000","last_peered":"2024-09-22T08:56:02.040119+0000","last_clean":"2024-09-22T08:56:02.040119+0000","last_became_active":"2024-09-22T08:15:06.966715+0000","last_became_peered":"2024-09-22T08:15:06.966715+0000","last_unstale":"2024-09-22T08:56:02.040119+0000","last_undegraded":"2024-09-22T08:56:02.040119+0000","last_fullsized":"2024-09-22T08:56:02.040119+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:36:05.010276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2445,"num_read_kb":2324,"num_write":493,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"263'212","reported_seq":876,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.551729+0000","last_change":"2024-09-22T08:15:04.951193+0000","last_active":"2024-09-22T08:56:16.551729+0000","last_peered":"2024-09-22T08:56:16.551729+0000","last_clean":"2024-09-22T08:56:16.551729+0000","last_became_active":"2024-09-22T08:15:04.950890+0000","last_became_peered":"2024-09-22T08:15:04.950890+0000","last_unstale":"2024-09-22T08:56:16.551729+0000","last_undegraded":"2024-09-22T08:56:16.551729+0000","last_fullsized":"2024-09-22T08:56:16.551729+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:58:21.202885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":625,"num_read_kb":94909,"num_write":959,"num_write_kb":40287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"35'4","reported_seq":973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:15.994400+0000","last_change":"2024-09-22T08:15:08.977689+0000","last_active":"2024-09-22T08:56:15.994400+0000","last_peered":"2024-09-22T08:56:15.994400+0000","last_clean":"2024-09-22T08:56:15.994400+0000","last_became_active":"2024-09-22T08:15:08.977250+0000","last_became_peered":"2024-09-22T08:15:08.977250+0000","last_unstale":"2024-09-22T08:56:15.994400+0000","last_undegraded":"2024-09-22T08:56:15.994400+0000","last_fullsized":"2024-09-22T08:56:15.994400+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:54:28.653095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":1187,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"263'165","reported_seq":742,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.701735+0000","last_change":"2024-09-22T08:15:10.988286+0000","last_active":"2024-09-22T08:55:19.701735+0000","last_peered":"2024-09-22T08:55:19.701735+0000","last_clean":"2024-09-22T08:55:19.701735+0000","last_became_active":"2024-09-22T08:15:10.987541+0000","last_became_peered":"2024-09-22T08:15:10.987541+0000","last_unstale":"2024-09-22T08:55:19.701735+0000","last_undegraded":"2024-09-22T08:55:19.701735+0000","last_fullsized":"2024-09-22T08:55:19.701735+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:03:59.129935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13640,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":208,"num_read_kb":211,"num_write":136,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:42.275936+0000","last_change":"2024-09-22T08:15:13.012164+0000","last_active":"2024-09-22T08:52:42.275936+0000","last_peered":"2024-09-22T08:52:42.275936+0000","last_clean":"2024-09-22T08:52:42.275936+0000","last_became_active":"2024-09-22T08:15:13.011781+0000","last_became_peered":"2024-09-22T08:15:13.011781+0000","last_unstale":"2024-09-22T08:52:42.275936+0000","last_undegraded":"2024-09-22T08:52:42.275936+0000","last_fullsized":"2024-09-22T08:52:42.275936+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:36:44.769092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"263'184","reported_seq":694,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:01.978766+0000","last_change":"2024-09-22T08:15:15.011928+0000","last_active":"2024-09-22T08:56:01.978766+0000","last_peered":"2024-09-22T08:56:01.978766+0000","last_clean":"2024-09-22T08:56:01.978766+0000","last_became_active":"2024-09-22T08:15:15.011648+0000","last_became_peered":"2024-09-22T08:15:15.011648+0000","last_unstale":"2024-09-22T08:56:01.978766+0000","last_undegraded":"2024-09-22T08:56:01.978766+0000","last_fullsized":"2024-09-22T08:56:01.978766+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:40:53.969713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":287,"num_read_kb":275,"num_write":539,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"263'437","reported_seq":1950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.032917+0000","last_change":"2024-09-22T08:15:06.972503+0000","last_active":"2024-09-22T08:56:02.032917+0000","last_peered":"2024-09-22T08:56:02.032917+0000","last_clean":"2024-09-22T08:56:02.032917+0000","last_became_active":"2024-09-22T08:15:06.972213+0000","last_became_peered":"2024-09-22T08:15:06.972213+0000","last_unstale":"2024-09-22T08:56:02.032917+0000","last_undegraded":"2024-09-22T08:56:02.032917+0000","last_fullsized":"2024-09-22T08:56:02.032917+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:02:45.936755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2524,"num_read_kb":2354,"num_write":541,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"263'238","reported_seq":871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:46.585051+0000","last_change":"2024-09-22T08:15:04.960034+0000","last_active":"2024-09-22T08:53:46.585051+0000","last_peered":"2024-09-22T08:53:46.585051+0000","last_clean":"2024-09-22T08:53:46.585051+0000","last_became_active":"2024-09-22T08:15:04.959607+0000","last_became_peered":"2024-09-22T08:15:04.959607+0000","last_unstale":"2024-09-22T08:53:46.585051+0000","last_undegraded":"2024-09-22T08:53:46.585051+0000","last_fullsized":"2024-09-22T08:53:46.585051+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:36:26.063552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12214957,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":559,"num_read_kb":22702,"num_write":1139,"num_write_kb":43754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:41.263102+0000","last_change":"2024-09-22T08:15:08.975205+0000","last_active":"2024-09-22T08:52:41.263102+0000","last_peered":"2024-09-22T08:52:41.263102+0000","last_clean":"2024-09-22T08:52:41.263102+0000","last_became_active":"2024-09-22T08:15:08.974925+0000","last_became_peered":"2024-09-22T08:15:08.974925+0000","last_unstale":"2024-09-22T08:52:41.263102+0000","last_undegraded":"2024-09-22T08:52:41.263102+0000","last_fullsized":"2024-09-22T08:52:41.263102+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:08:36.707707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"263'148","reported_seq":716,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.421615+0000","last_change":"2024-09-22T08:15:10.985655+0000","last_active":"2024-09-22T08:56:16.421615+0000","last_peered":"2024-09-22T08:56:16.421615+0000","last_clean":"2024-09-22T08:56:16.421615+0000","last_became_active":"2024-09-22T08:15:10.985312+0000","last_became_peered":"2024-09-22T08:15:10.985312+0000","last_unstale":"2024-09-22T08:56:16.421615+0000","last_undegraded":"2024-09-22T08:56:16.421615+0000","last_fullsized":"2024-09-22T08:56:16.421615+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:32:30.326830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9037,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":176,"num_read_kb":231,"num_write":94,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:22.290600+0000","last_change":"2024-09-22T08:15:12.998592+0000","last_active":"2024-09-22T08:53:22.290600+0000","last_peered":"2024-09-22T08:53:22.290600+0000","last_clean":"2024-09-22T08:53:22.290600+0000","last_became_active":"2024-09-22T08:15:12.998276+0000","last_became_peered":"2024-09-22T08:15:12.998276+0000","last_unstale":"2024-09-22T08:53:22.290600+0000","last_undegraded":"2024-09-22T08:53:22.290600+0000","last_fullsized":"2024-09-22T08:53:22.290600+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:45:18.409944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"263'129","reported_seq":634,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:03.364497+0000","last_change":"2024-09-22T08:15:15.022528+0000","last_active":"2024-09-22T08:56:03.364497+0000","last_peered":"2024-09-22T08:56:03.364497+0000","last_clean":"2024-09-22T08:56:03.364497+0000","last_became_active":"2024-09-22T08:15:15.022140+0000","last_became_peered":"2024-09-22T08:15:15.022140+0000","last_unstale":"2024-09-22T08:56:03.364497+0000","last_undegraded":"2024-09-22T08:56:03.364497+0000","last_fullsized":"2024-09-22T08:56:03.364497+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:19:15.143722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":810,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":211,"num_read_kb":192,"num_write":312,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"263'532","reported_seq":2401,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.961208+0000","last_change":"2024-09-22T08:15:06.963522+0000","last_active":"2024-09-22T08:54:27.961208+0000","last_peered":"2024-09-22T08:54:27.961208+0000","last_clean":"2024-09-22T08:54:27.961208+0000","last_became_active":"2024-09-22T08:15:06.963136+0000","last_became_peered":"2024-09-22T08:15:06.963136+0000","last_unstale":"2024-09-22T08:54:27.961208+0000","last_undegraded":"2024-09-22T08:54:27.961208+0000","last_fullsized":"2024-09-22T08:54:27.961208+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":500,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:27:39.654856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3196,"num_read_kb":3015,"num_write":651,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"263'227","reported_seq":849,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.484031+0000","last_change":"2024-09-22T08:15:04.962067+0000","last_active":"2024-09-22T08:56:16.484031+0000","last_peered":"2024-09-22T08:56:16.484031+0000","last_clean":"2024-09-22T08:56:16.484031+0000","last_became_active":"2024-09-22T08:15:04.961731+0000","last_became_peered":"2024-09-22T08:15:04.961731+0000","last_unstale":"2024-09-22T08:56:16.484031+0000","last_undegraded":"2024-09-22T08:56:16.484031+0000","last_fullsized":"2024-09-22T08:56:16.484031+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:15:56.579006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079902,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":556,"num_read_kb":16778,"num_write":1039,"num_write_kb":35959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:42.398363+0000","last_change":"2024-09-22T08:15:08.974366+0000","last_active":"2024-09-22T08:52:42.398363+0000","last_peered":"2024-09-22T08:52:42.398363+0000","last_clean":"2024-09-22T08:52:42.398363+0000","last_became_active":"2024-09-22T08:15:08.973985+0000","last_became_peered":"2024-09-22T08:15:08.973985+0000","last_unstale":"2024-09-22T08:52:42.398363+0000","last_undegraded":"2024-09-22T08:52:42.398363+0000","last_fullsized":"2024-09-22T08:52:42.398363+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:43:10.742833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"263'91","reported_seq":611,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.764889+0000","last_change":"2024-09-22T08:15:10.991408+0000","last_active":"2024-09-22T08:55:19.764889+0000","last_peered":"2024-09-22T08:55:19.764889+0000","last_clean":"2024-09-22T08:55:19.764889+0000","last_became_active":"2024-09-22T08:15:10.991099+0000","last_became_peered":"2024-09-22T08:15:10.991099+0000","last_unstale":"2024-09-22T08:55:19.764889+0000","last_undegraded":"2024-09-22T08:55:19.764889+0000","last_fullsized":"2024-09-22T08:55:19.764889+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:03.952941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":117,"num_read_kb":110,"num_write":130,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"263'769","reported_seq":2287,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:03.376310+0000","last_change":"2024-09-22T08:15:13.020129+0000","last_active":"2024-09-22T08:56:03.376310+0000","last_peered":"2024-09-22T08:56:03.376310+0000","last_clean":"2024-09-22T08:56:03.376310+0000","last_became_active":"2024-09-22T08:15:13.018826+0000","last_became_peered":"2024-09-22T08:15:13.018826+0000","last_unstale":"2024-09-22T08:56:03.376310+0000","last_undegraded":"2024-09-22T08:56:03.376310+0000","last_fullsized":"2024-09-22T08:56:03.376310+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:17:45.964569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"263'136","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:22.688867+0000","last_change":"2024-09-22T08:15:15.017866+0000","last_active":"2024-09-22T08:54:22.688867+0000","last_peered":"2024-09-22T08:54:22.688867+0000","last_clean":"2024-09-22T08:54:22.688867+0000","last_became_active":"2024-09-22T08:15:15.017568+0000","last_became_peered":"2024-09-22T08:15:15.017568+0000","last_unstale":"2024-09-22T08:54:22.688867+0000","last_undegraded":"2024-09-22T08:54:22.688867+0000","last_fullsized":"2024-09-22T08:54:22.688867+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:37:11.451571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":178,"num_write":322,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"263'422","reported_seq":1876,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.030317+0000","last_change":"2024-09-22T08:15:06.973437+0000","last_active":"2024-09-22T08:56:02.030317+0000","last_peered":"2024-09-22T08:56:02.030317+0000","last_clean":"2024-09-22T08:56:02.030317+0000","last_became_active":"2024-09-22T08:15:06.973142+0000","last_became_peered":"2024-09-22T08:15:06.973142+0000","last_unstale":"2024-09-22T08:56:02.030317+0000","last_undegraded":"2024-09-22T08:56:02.030317+0000","last_fullsized":"2024-09-22T08:56:02.030317+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:42:57.640096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2325,"num_read_kb":2186,"num_write":496,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"263'204","reported_seq":802,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:14.348112+0000","last_change":"2024-09-22T08:15:04.955055+0000","last_active":"2024-09-22T08:53:14.348112+0000","last_peered":"2024-09-22T08:53:14.348112+0000","last_clean":"2024-09-22T08:53:14.348112+0000","last_became_active":"2024-09-22T08:15:04.954608+0000","last_became_peered":"2024-09-22T08:15:04.954608+0000","last_unstale":"2024-09-22T08:53:14.348112+0000","last_undegraded":"2024-09-22T08:53:14.348112+0000","last_fullsized":"2024-09-22T08:53:14.348112+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:48:59.571776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":469,"num_read_kb":8602,"num_write":952,"num_write_kb":32105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:38.386310+0000","last_change":"2024-09-22T08:15:08.980771+0000","last_active":"2024-09-22T08:52:38.386310+0000","last_peered":"2024-09-22T08:52:38.386310+0000","last_clean":"2024-09-22T08:52:38.386310+0000","last_became_active":"2024-09-22T08:15:08.980570+0000","last_became_peered":"2024-09-22T08:15:08.980570+0000","last_unstale":"2024-09-22T08:52:38.386310+0000","last_undegraded":"2024-09-22T08:52:38.386310+0000","last_fullsized":"2024-09-22T08:52:38.386310+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:52:24.440386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"263'159","reported_seq":732,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.779560+0000","last_change":"2024-09-22T08:15:10.979788+0000","last_active":"2024-09-22T08:55:19.779560+0000","last_peered":"2024-09-22T08:55:19.779560+0000","last_clean":"2024-09-22T08:55:19.779560+0000","last_became_active":"2024-09-22T08:15:10.979384+0000","last_became_peered":"2024-09-22T08:15:10.979384+0000","last_unstale":"2024-09-22T08:55:19.779560+0000","last_undegraded":"2024-09-22T08:55:19.779560+0000","last_fullsized":"2024-09-22T08:55:19.779560+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:28:09.165373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14159,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":207,"num_read_kb":270,"num_write":122,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:52.407725+0000","last_change":"2024-09-22T08:15:13.013531+0000","last_active":"2024-09-22T08:53:52.407725+0000","last_peered":"2024-09-22T08:53:52.407725+0000","last_clean":"2024-09-22T08:53:52.407725+0000","last_became_active":"2024-09-22T08:15:13.013160+0000","last_became_peered":"2024-09-22T08:15:13.013160+0000","last_unstale":"2024-09-22T08:53:52.407725+0000","last_undegraded":"2024-09-22T08:53:52.407725+0000","last_fullsized":"2024-09-22T08:53:52.407725+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:55:35.021615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"263'138","reported_seq":639,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:26.975514+0000","last_change":"2024-09-22T08:15:15.021053+0000","last_active":"2024-09-22T08:54:26.975514+0000","last_peered":"2024-09-22T08:54:26.975514+0000","last_clean":"2024-09-22T08:54:26.975514+0000","last_became_active":"2024-09-22T08:15:15.020718+0000","last_became_peered":"2024-09-22T08:15:15.020718+0000","last_unstale":"2024-09-22T08:54:26.975514+0000","last_undegraded":"2024-09-22T08:54:26.975514+0000","last_fullsized":"2024-09-22T08:54:26.975514+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:03:37.066806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":211,"num_read_kb":197,"num_write":330,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"263'800","reported_seq":2276,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.926503+0000","last_change":"2024-09-22T08:15:06.970563+0000","last_active":"2024-09-22T08:54:38.926503+0000","last_peered":"2024-09-22T08:54:38.926503+0000","last_clean":"2024-09-22T08:54:38.926503+0000","last_became_active":"2024-09-22T08:15:06.970077+0000","last_became_peered":"2024-09-22T08:15:06.970077+0000","last_unstale":"2024-09-22T08:54:38.926503+0000","last_undegraded":"2024-09-22T08:54:38.926503+0000","last_fullsized":"2024-09-22T08:54:38.926503+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:50:00.177977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3751,"num_read_kb":3364,"num_write":1047,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"263'194","reported_seq":906,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:46.952442+0000","last_change":"2024-09-22T08:15:04.962527+0000","last_active":"2024-09-22T08:53:46.952442+0000","last_peered":"2024-09-22T08:53:46.952442+0000","last_clean":"2024-09-22T08:53:46.952442+0000","last_became_active":"2024-09-22T08:15:04.962268+0000","last_became_peered":"2024-09-22T08:15:04.962268+0000","last_unstale":"2024-09-22T08:53:46.952442+0000","last_undegraded":"2024-09-22T08:53:46.952442+0000","last_fullsized":"2024-09-22T08:53:46.952442+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:54:23.748527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10535612,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":777,"num_read_kb":150382,"num_write":900,"num_write_kb":51576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:41.263079+0000","last_change":"2024-09-22T08:15:08.977670+0000","last_active":"2024-09-22T08:52:41.263079+0000","last_peered":"2024-09-22T08:52:41.263079+0000","last_clean":"2024-09-22T08:52:41.263079+0000","last_became_active":"2024-09-22T08:15:08.977341+0000","last_became_peered":"2024-09-22T08:15:08.977341+0000","last_unstale":"2024-09-22T08:52:41.263079+0000","last_undegraded":"2024-09-22T08:52:41.263079+0000","last_fullsized":"2024-09-22T08:52:41.263079+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:18:39.684334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"263'127","reported_seq":692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.479118+0000","last_change":"2024-09-22T08:15:10.981034+0000","last_active":"2024-09-22T08:56:16.479118+0000","last_peered":"2024-09-22T08:56:16.479118+0000","last_clean":"2024-09-22T08:56:16.479118+0000","last_became_active":"2024-09-22T08:15:10.980015+0000","last_became_peered":"2024-09-22T08:15:10.980015+0000","last_unstale":"2024-09-22T08:56:16.479118+0000","last_undegraded":"2024-09-22T08:56:16.479118+0000","last_fullsized":"2024-09-22T08:56:16.479118+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:10:49.816903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20804,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":281,"num_write":88,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:33.376948+0000","last_change":"2024-09-22T08:15:13.012480+0000","last_active":"2024-09-22T08:51:33.376948+0000","last_peered":"2024-09-22T08:51:33.376948+0000","last_clean":"2024-09-22T08:51:33.376948+0000","last_became_active":"2024-09-22T08:15:13.011134+0000","last_became_peered":"2024-09-22T08:15:13.011134+0000","last_unstale":"2024-09-22T08:51:33.376948+0000","last_undegraded":"2024-09-22T08:51:33.376948+0000","last_fullsized":"2024-09-22T08:51:33.376948+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:29:04.991665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"263'150","reported_seq":670,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.360615+0000","last_change":"2024-09-22T08:15:15.013212+0000","last_active":"2024-09-22T08:54:41.360615+0000","last_peered":"2024-09-22T08:54:41.360615+0000","last_clean":"2024-09-22T08:54:41.360615+0000","last_became_active":"2024-09-22T08:15:15.012939+0000","last_became_peered":"2024-09-22T08:15:15.012939+0000","last_unstale":"2024-09-22T08:54:41.360615+0000","last_undegraded":"2024-09-22T08:54:41.360615+0000","last_fullsized":"2024-09-22T08:54:41.360615+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:08:40.354379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":256,"num_read_kb":247,"num_write":364,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"263'562","reported_seq":2355,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.472866+0000","last_change":"2024-09-22T08:15:06.960886+0000","last_active":"2024-09-22T08:54:41.472866+0000","last_peered":"2024-09-22T08:54:41.472866+0000","last_clean":"2024-09-22T08:54:41.472866+0000","last_became_active":"2024-09-22T08:15:06.960599+0000","last_became_peered":"2024-09-22T08:15:06.960599+0000","last_unstale":"2024-09-22T08:54:41.472866+0000","last_undegraded":"2024-09-22T08:54:41.472866+0000","last_fullsized":"2024-09-22T08:54:41.472866+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":500,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:27:19.885943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3136,"num_read_kb":2948,"num_write":673,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"263'210","reported_seq":837,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.548080+0000","last_change":"2024-09-22T08:15:04.963136+0000","last_active":"2024-09-22T08:56:16.548080+0000","last_peered":"2024-09-22T08:56:16.548080+0000","last_clean":"2024-09-22T08:56:16.548080+0000","last_became_active":"2024-09-22T08:15:04.962785+0000","last_became_peered":"2024-09-22T08:15:04.962785+0000","last_unstale":"2024-09-22T08:56:16.548080+0000","last_undegraded":"2024-09-22T08:56:16.548080+0000","last_fullsized":"2024-09-22T08:56:16.548080+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:29:11.602912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":497,"num_read_kb":22160,"num_write":848,"num_write_kb":45151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:48.394911+0000","last_change":"2024-09-22T08:15:08.979401+0000","last_active":"2024-09-22T08:53:48.394911+0000","last_peered":"2024-09-22T08:53:48.394911+0000","last_clean":"2024-09-22T08:53:48.394911+0000","last_became_active":"2024-09-22T08:15:08.978844+0000","last_became_peered":"2024-09-22T08:15:08.978844+0000","last_unstale":"2024-09-22T08:53:48.394911+0000","last_undegraded":"2024-09-22T08:53:48.394911+0000","last_fullsized":"2024-09-22T08:53:48.394911+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:07:22.042882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"263'128","reported_seq":678,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.407905+0000","last_change":"2024-09-22T08:15:10.983840+0000","last_active":"2024-09-22T08:56:16.407905+0000","last_peered":"2024-09-22T08:56:16.407905+0000","last_clean":"2024-09-22T08:56:16.407905+0000","last_became_active":"2024-09-22T08:15:10.983522+0000","last_became_peered":"2024-09-22T08:15:10.983522+0000","last_unstale":"2024-09-22T08:56:16.407905+0000","last_undegraded":"2024-09-22T08:56:16.407905+0000","last_fullsized":"2024-09-22T08:56:16.407905+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:05:15.621827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62130,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":173,"num_read_kb":427,"num_write":104,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:43.387370+0000","last_change":"2024-09-22T08:15:13.015794+0000","last_active":"2024-09-22T08:52:43.387370+0000","last_peered":"2024-09-22T08:52:43.387370+0000","last_clean":"2024-09-22T08:52:43.387370+0000","last_became_active":"2024-09-22T08:15:13.015473+0000","last_became_peered":"2024-09-22T08:15:13.015473+0000","last_unstale":"2024-09-22T08:52:43.387370+0000","last_undegraded":"2024-09-22T08:52:43.387370+0000","last_fullsized":"2024-09-22T08:52:43.387370+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:45:01.160499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"263'213","reported_seq":1671,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:39.321243+0000","last_change":"2024-09-22T08:15:15.018252+0000","last_active":"2024-09-22T08:54:39.321243+0000","last_peered":"2024-09-22T08:54:39.321243+0000","last_clean":"2024-09-22T08:54:39.321243+0000","last_became_active":"2024-09-22T08:15:15.017394+0000","last_became_peered":"2024-09-22T08:15:15.017394+0000","last_unstale":"2024-09-22T08:54:39.321243+0000","last_undegraded":"2024-09-22T08:54:39.321243+0000","last_fullsized":"2024-09-22T08:54:39.321243+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:26:17.481953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1186,"num_read_kb":1185,"num_write":465,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"263'821","reported_seq":2516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.926722+0000","last_change":"2024-09-22T08:15:06.967900+0000","last_active":"2024-09-22T08:54:38.926722+0000","last_peered":"2024-09-22T08:54:38.926722+0000","last_clean":"2024-09-22T08:54:38.926722+0000","last_became_active":"2024-09-22T08:15:06.967603+0000","last_became_peered":"2024-09-22T08:15:06.967603+0000","last_unstale":"2024-09-22T08:54:38.926722+0000","last_undegraded":"2024-09-22T08:54:38.926722+0000","last_fullsized":"2024-09-22T08:54:38.926722+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":800,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:44:20.031138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4151,"num_read_kb":3787,"num_write":1085,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"263'209","reported_seq":872,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.482922+0000","last_change":"2024-09-22T08:15:04.957997+0000","last_active":"2024-09-22T08:56:16.482922+0000","last_peered":"2024-09-22T08:56:16.482922+0000","last_clean":"2024-09-22T08:56:16.482922+0000","last_became_active":"2024-09-22T08:15:04.957654+0000","last_became_peered":"2024-09-22T08:15:04.957654+0000","last_unstale":"2024-09-22T08:56:16.482922+0000","last_undegraded":"2024-09-22T08:56:16.482922+0000","last_fullsized":"2024-09-22T08:56:16.482922+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:15:19.864352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":592,"num_read_kb":25705,"num_write":948,"num_write_kb":45275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:32.388383+0000","last_change":"2024-09-22T08:15:08.973107+0000","last_active":"2024-09-22T08:51:32.388383+0000","last_peered":"2024-09-22T08:51:32.388383+0000","last_clean":"2024-09-22T08:51:32.388383+0000","last_became_active":"2024-09-22T08:15:08.972733+0000","last_became_peered":"2024-09-22T08:15:08.972733+0000","last_unstale":"2024-09-22T08:51:32.388383+0000","last_undegraded":"2024-09-22T08:51:32.388383+0000","last_fullsized":"2024-09-22T08:51:32.388383+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:09:10.684801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"263'152","reported_seq":730,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.652107+0000","last_change":"2024-09-22T08:15:10.987881+0000","last_active":"2024-09-22T08:55:19.652107+0000","last_peered":"2024-09-22T08:55:19.652107+0000","last_clean":"2024-09-22T08:55:19.652107+0000","last_became_active":"2024-09-22T08:15:10.987610+0000","last_became_peered":"2024-09-22T08:15:10.987610+0000","last_unstale":"2024-09-22T08:55:19.652107+0000","last_undegraded":"2024-09-22T08:55:19.652107+0000","last_fullsized":"2024-09-22T08:55:19.652107+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:25:04.343680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8998,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":200,"num_read_kb":256,"num_write":114,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:42.398317+0000","last_change":"2024-09-22T08:15:13.003540+0000","last_active":"2024-09-22T08:52:42.398317+0000","last_peered":"2024-09-22T08:52:42.398317+0000","last_clean":"2024-09-22T08:52:42.398317+0000","last_became_active":"2024-09-22T08:15:13.003219+0000","last_became_peered":"2024-09-22T08:15:13.003219+0000","last_unstale":"2024-09-22T08:52:42.398317+0000","last_undegraded":"2024-09-22T08:52:42.398317+0000","last_fullsized":"2024-09-22T08:52:42.398317+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:50:35.499014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"263'159","reported_seq":639,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.030006+0000","last_change":"2024-09-22T08:15:15.018630+0000","last_active":"2024-09-22T08:56:02.030006+0000","last_peered":"2024-09-22T08:56:02.030006+0000","last_clean":"2024-09-22T08:56:02.030006+0000","last_became_active":"2024-09-22T08:15:15.018311+0000","last_became_peered":"2024-09-22T08:15:15.018311+0000","last_unstale":"2024-09-22T08:56:02.030006+0000","last_undegraded":"2024-09-22T08:56:02.030006+0000","last_fullsized":"2024-09-22T08:56:02.030006+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:45:03.170254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":160,"num_write":367,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"263'889","reported_seq":2468,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.961170+0000","last_change":"2024-09-22T08:15:06.965116+0000","last_active":"2024-09-22T08:54:27.961170+0000","last_peered":"2024-09-22T08:54:27.961170+0000","last_clean":"2024-09-22T08:54:27.961170+0000","last_became_active":"2024-09-22T08:15:06.964786+0000","last_became_peered":"2024-09-22T08:15:06.964786+0000","last_unstale":"2024-09-22T08:54:27.961170+0000","last_undegraded":"2024-09-22T08:54:27.961170+0000","last_fullsized":"2024-09-22T08:54:27.961170+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":800,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:33:01.235899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4058,"num_read_kb":3642,"num_write":1164,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"263'224","reported_seq":892,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:18.408563+0000","last_change":"2024-09-22T08:15:04.963081+0000","last_active":"2024-09-22T08:53:18.408563+0000","last_peered":"2024-09-22T08:53:18.408563+0000","last_clean":"2024-09-22T08:53:18.408563+0000","last_became_active":"2024-09-22T08:15:04.962774+0000","last_became_peered":"2024-09-22T08:15:04.962774+0000","last_unstale":"2024-09-22T08:53:18.408563+0000","last_undegraded":"2024-09-22T08:53:18.408563+0000","last_fullsized":"2024-09-22T08:53:18.408563+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:28:22.448316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":683,"num_read_kb":4749,"num_write":1115,"num_write_kb":28646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"263'862","reported_seq":2345,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:25.945638+0000","last_change":"2024-09-22T08:15:06.958712+0000","last_active":"2024-09-22T08:54:25.945638+0000","last_peered":"2024-09-22T08:54:25.945638+0000","last_clean":"2024-09-22T08:54:25.945638+0000","last_became_active":"2024-09-22T08:15:06.958389+0000","last_became_peered":"2024-09-22T08:15:06.958389+0000","last_unstale":"2024-09-22T08:54:25.945638+0000","last_undegraded":"2024-09-22T08:54:25.945638+0000","last_fullsized":"2024-09-22T08:54:25.945638+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":800,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:17:52.710339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3808,"num_read_kb":3398,"num_write":1097,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"263'363","reported_seq":1051,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.392172+0000","last_change":"2024-09-22T08:15:04.951222+0000","last_active":"2024-09-22T08:56:16.392172+0000","last_peered":"2024-09-22T08:56:16.392172+0000","last_clean":"2024-09-22T08:56:16.392172+0000","last_became_active":"2024-09-22T08:15:04.950922+0000","last_became_peered":"2024-09-22T08:15:04.950922+0000","last_unstale":"2024-09-22T08:56:16.392172+0000","last_undegraded":"2024-09-22T08:56:16.392172+0000","last_fullsized":"2024-09-22T08:56:16.392172+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:41:56.256814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1005,"num_read_kb":11417,"num_write":1356,"num_write_kb":38557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"263'414","reported_seq":1863,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:07.456606+0000","last_change":"2024-09-22T08:15:06.974074+0000","last_active":"2024-09-22T08:54:07.456606+0000","last_peered":"2024-09-22T08:54:07.456606+0000","last_clean":"2024-09-22T08:54:07.456606+0000","last_became_active":"2024-09-22T08:15:06.973749+0000","last_became_peered":"2024-09-22T08:15:06.973749+0000","last_unstale":"2024-09-22T08:54:07.456606+0000","last_undegraded":"2024-09-22T08:54:07.456606+0000","last_fullsized":"2024-09-22T08:54:07.456606+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:09:45.710062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2229,"num_read_kb":2093,"num_write":519,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"263'224","reported_seq":855,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:43.401544+0000","last_change":"2024-09-22T08:15:04.960573+0000","last_active":"2024-09-22T08:54:43.401544+0000","last_peered":"2024-09-22T08:54:43.401544+0000","last_clean":"2024-09-22T08:54:43.401544+0000","last_became_active":"2024-09-22T08:15:04.959501+0000","last_became_peered":"2024-09-22T08:15:04.959501+0000","last_unstale":"2024-09-22T08:54:43.401544+0000","last_undegraded":"2024-09-22T08:54:43.401544+0000","last_fullsized":"2024-09-22T08:54:43.401544+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:58:53.308481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194372,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":550,"num_read_kb":25081,"num_write":1073,"num_write_kb":19730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"263'880","reported_seq":2574,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.040269+0000","last_change":"2024-09-22T08:15:06.971393+0000","last_active":"2024-09-22T08:56:02.040269+0000","last_peered":"2024-09-22T08:56:02.040269+0000","last_clean":"2024-09-22T08:56:02.040269+0000","last_became_active":"2024-09-22T08:15:06.970991+0000","last_became_peered":"2024-09-22T08:15:06.970991+0000","last_unstale":"2024-09-22T08:56:02.040269+0000","last_undegraded":"2024-09-22T08:56:02.040269+0000","last_fullsized":"2024-09-22T08:56:02.040269+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":800,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:27:06.535070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4175,"num_read_kb":3774,"num_write":1132,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"263'195","reported_seq":826,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.292438+0000","last_change":"2024-09-22T08:15:04.954644+0000","last_active":"2024-09-22T08:56:16.292438+0000","last_peered":"2024-09-22T08:56:16.292438+0000","last_clean":"2024-09-22T08:56:16.292438+0000","last_became_active":"2024-09-22T08:15:04.954281+0000","last_became_peered":"2024-09-22T08:15:04.954281+0000","last_unstale":"2024-09-22T08:56:16.292438+0000","last_undegraded":"2024-09-22T08:56:16.292438+0000","last_fullsized":"2024-09-22T08:56:16.292438+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:43:06.650935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":578,"num_read_kb":4135,"num_write":927,"num_write_kb":8648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"263'1127","reported_seq":2681,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.961055+0000","last_change":"2024-09-22T08:15:06.968491+0000","last_active":"2024-09-22T08:54:27.961055+0000","last_peered":"2024-09-22T08:54:27.961055+0000","last_clean":"2024-09-22T08:54:27.961055+0000","last_became_active":"2024-09-22T08:15:06.967938+0000","last_became_peered":"2024-09-22T08:15:06.967938+0000","last_unstale":"2024-09-22T08:54:27.961055+0000","last_undegraded":"2024-09-22T08:54:27.961055+0000","last_fullsized":"2024-09-22T08:54:27.961055+0000","mapping_epoch":25,"log_start":"263'1100","ondisk_log_start":"263'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":1100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:05:32.099143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5297,"num_read_kb":4688,"num_write":1564,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"263'196","reported_seq":874,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:07.287692+0000","last_change":"2024-09-22T08:15:04.964365+0000","last_active":"2024-09-22T08:54:07.287692+0000","last_peered":"2024-09-22T08:54:07.287692+0000","last_clean":"2024-09-22T08:54:07.287692+0000","last_became_active":"2024-09-22T08:15:04.963992+0000","last_became_peered":"2024-09-22T08:15:04.963992+0000","last_unstale":"2024-09-22T08:54:07.287692+0000","last_undegraded":"2024-09-22T08:54:07.287692+0000","last_fullsized":"2024-09-22T08:54:07.287692+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:47:44.152954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":707,"num_read_kb":8108,"num_write":879,"num_write_kb":38701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"263'391","reported_seq":2065,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:25.944051+0000","last_change":"2024-09-22T08:15:06.964443+0000","last_active":"2024-09-22T08:54:25.944051+0000","last_peered":"2024-09-22T08:54:25.944051+0000","last_clean":"2024-09-22T08:54:25.944051+0000","last_became_active":"2024-09-22T08:15:06.964116+0000","last_became_peered":"2024-09-22T08:15:06.964116+0000","last_unstale":"2024-09-22T08:54:25.944051+0000","last_undegraded":"2024-09-22T08:54:25.944051+0000","last_fullsized":"2024-09-22T08:54:25.944051+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:11:34.518000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2347,"num_read_kb":2272,"num_write":440,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"263'229","reported_seq":911,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.490048+0000","last_change":"2024-09-22T08:15:04.951989+0000","last_active":"2024-09-22T08:56:16.490048+0000","last_peered":"2024-09-22T08:56:16.490048+0000","last_clean":"2024-09-22T08:56:16.490048+0000","last_became_active":"2024-09-22T08:15:04.951628+0000","last_became_peered":"2024-09-22T08:15:04.951628+0000","last_unstale":"2024-09-22T08:56:16.490048+0000","last_undegraded":"2024-09-22T08:56:16.490048+0000","last_fullsized":"2024-09-22T08:56:16.490048+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:10:52.618601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":736,"num_read_kb":9856,"num_write":1118,"num_write_kb":28547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"263'359","reported_seq":1832,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.361190+0000","last_change":"2024-09-22T08:15:06.973913+0000","last_active":"2024-09-22T08:54:27.361190+0000","last_peered":"2024-09-22T08:54:27.361190+0000","last_clean":"2024-09-22T08:54:27.361190+0000","last_became_active":"2024-09-22T08:15:06.973584+0000","last_became_peered":"2024-09-22T08:15:06.973584+0000","last_unstale":"2024-09-22T08:54:27.361190+0000","last_undegraded":"2024-09-22T08:54:27.361190+0000","last_fullsized":"2024-09-22T08:54:27.361190+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:45:47.505506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2011,"num_read_kb":1931,"num_write":399,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"263'212","reported_seq":879,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:06.273562+0000","last_change":"2024-09-22T08:15:04.969769+0000","last_active":"2024-09-22T08:54:06.273562+0000","last_peered":"2024-09-22T08:54:06.273562+0000","last_clean":"2024-09-22T08:54:06.273562+0000","last_became_active":"2024-09-22T08:15:04.968983+0000","last_became_peered":"2024-09-22T08:15:04.968983+0000","last_unstale":"2024-09-22T08:54:06.273562+0000","last_undegraded":"2024-09-22T08:54:06.273562+0000","last_fullsized":"2024-09-22T08:54:06.273562+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:18.808569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10519112,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":611,"num_read_kb":66139,"num_write":1053,"num_write_kb":31816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"263'1262","reported_seq":3112,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.961464+0000","last_change":"2024-09-22T08:15:06.971511+0000","last_active":"2024-09-22T08:54:27.961464+0000","last_peered":"2024-09-22T08:54:27.961464+0000","last_clean":"2024-09-22T08:54:27.961464+0000","last_became_active":"2024-09-22T08:15:06.970055+0000","last_became_peered":"2024-09-22T08:15:06.970055+0000","last_unstale":"2024-09-22T08:54:27.961464+0000","last_undegraded":"2024-09-22T08:54:27.961464+0000","last_fullsized":"2024-09-22T08:54:27.961464+0000","mapping_epoch":25,"log_start":"263'1200","ondisk_log_start":"263'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":1200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:22:55.292514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6370,"num_read_kb":5597,"num_write":1961,"num_write_kb":987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"263'217","reported_seq":880,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.331777+0000","last_change":"2024-09-22T08:15:04.961957+0000","last_active":"2024-09-22T08:56:16.331777+0000","last_peered":"2024-09-22T08:56:16.331777+0000","last_clean":"2024-09-22T08:56:16.331777+0000","last_became_active":"2024-09-22T08:15:04.961545+0000","last_became_peered":"2024-09-22T08:15:04.961545+0000","last_unstale":"2024-09-22T08:56:16.331777+0000","last_undegraded":"2024-09-22T08:56:16.331777+0000","last_fullsized":"2024-09-22T08:56:16.331777+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:16:41.974072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":669,"num_read_kb":2609,"num_write":1038,"num_write_kb":23374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"263'491","reported_seq":1940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.926788+0000","last_change":"2024-09-22T08:15:06.959643+0000","last_active":"2024-09-22T08:54:38.926788+0000","last_peered":"2024-09-22T08:54:38.926788+0000","last_clean":"2024-09-22T08:54:38.926788+0000","last_became_active":"2024-09-22T08:15:06.959331+0000","last_became_peered":"2024-09-22T08:15:06.959331+0000","last_unstale":"2024-09-22T08:54:38.926788+0000","last_undegraded":"2024-09-22T08:54:38.926788+0000","last_fullsized":"2024-09-22T08:54:38.926788+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:46:47.067650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2542,"num_read_kb":2330,"num_write":651,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"263'189","reported_seq":779,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:46.773614+0000","last_change":"2024-09-22T08:15:04.959005+0000","last_active":"2024-09-22T08:53:46.773614+0000","last_peered":"2024-09-22T08:53:46.773614+0000","last_clean":"2024-09-22T08:53:46.773614+0000","last_became_active":"2024-09-22T08:15:04.958725+0000","last_became_peered":"2024-09-22T08:15:04.958725+0000","last_unstale":"2024-09-22T08:53:46.773614+0000","last_undegraded":"2024-09-22T08:53:46.773614+0000","last_fullsized":"2024-09-22T08:53:46.773614+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:57:53.879433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5247038,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":388,"num_read_kb":18786,"num_write":896,"num_write_kb":46944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"263'798","reported_seq":2381,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:19.614771+0000","last_change":"2024-09-22T08:15:06.956815+0000","last_active":"2024-09-22T08:54:19.614771+0000","last_peered":"2024-09-22T08:54:19.614771+0000","last_clean":"2024-09-22T08:54:19.614771+0000","last_became_active":"2024-09-22T08:15:06.956485+0000","last_became_peered":"2024-09-22T08:15:06.956485+0000","last_unstale":"2024-09-22T08:54:19.614771+0000","last_undegraded":"2024-09-22T08:54:19.614771+0000","last_fullsized":"2024-09-22T08:54:19.614771+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:11:36.316290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3799,"num_read_kb":3445,"num_write":1066,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"263'218","reported_seq":891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.438588+0000","last_change":"2024-09-22T08:15:04.962465+0000","last_active":"2024-09-22T08:56:16.438588+0000","last_peered":"2024-09-22T08:56:16.438588+0000","last_clean":"2024-09-22T08:56:16.438588+0000","last_became_active":"2024-09-22T08:15:04.962165+0000","last_became_peered":"2024-09-22T08:15:04.962165+0000","last_unstale":"2024-09-22T08:56:16.438588+0000","last_undegraded":"2024-09-22T08:56:16.438588+0000","last_fullsized":"2024-09-22T08:56:16.438588+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:54.072073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":601,"num_read_kb":98488,"num_write":1035,"num_write_kb":53405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"263'774","reported_seq":2242,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.926395+0000","last_change":"2024-09-22T08:15:06.970487+0000","last_active":"2024-09-22T08:54:38.926395+0000","last_peered":"2024-09-22T08:54:38.926395+0000","last_clean":"2024-09-22T08:54:38.926395+0000","last_became_active":"2024-09-22T08:15:06.970111+0000","last_became_peered":"2024-09-22T08:15:06.970111+0000","last_unstale":"2024-09-22T08:54:38.926395+0000","last_undegraded":"2024-09-22T08:54:38.926395+0000","last_fullsized":"2024-09-22T08:54:38.926395+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:58.671223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3767,"num_read_kb":3405,"num_write":1035,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"263'179","reported_seq":881,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:52.668674+0000","last_change":"2024-09-22T08:15:04.963818+0000","last_active":"2024-09-22T08:55:52.668674+0000","last_peered":"2024-09-22T08:55:52.668674+0000","last_clean":"2024-09-22T08:55:52.668674+0000","last_became_active":"2024-09-22T08:15:04.963383+0000","last_became_peered":"2024-09-22T08:15:04.963383+0000","last_unstale":"2024-09-22T08:55:52.668674+0000","last_undegraded":"2024-09-22T08:55:52.668674+0000","last_fullsized":"2024-09-22T08:55:52.668674+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:27:08.401857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5489195,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":838,"num_read_kb":15208,"num_write":838,"num_write_kb":25255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"263'748","reported_seq":2174,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.033948+0000","last_change":"2024-09-22T08:15:06.968144+0000","last_active":"2024-09-22T08:56:02.033948+0000","last_peered":"2024-09-22T08:56:02.033948+0000","last_clean":"2024-09-22T08:56:02.033948+0000","last_became_active":"2024-09-22T08:15:06.967819+0000","last_became_peered":"2024-09-22T08:15:06.967819+0000","last_unstale":"2024-09-22T08:56:02.033948+0000","last_undegraded":"2024-09-22T08:56:02.033948+0000","last_fullsized":"2024-09-22T08:56:02.033948+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:33:21.226600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3557,"num_read_kb":3203,"num_write":994,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"263'220","reported_seq":850,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.532155+0000","last_change":"2024-09-22T08:15:04.963531+0000","last_active":"2024-09-22T08:56:16.532155+0000","last_peered":"2024-09-22T08:56:16.532155+0000","last_clean":"2024-09-22T08:56:16.532155+0000","last_became_active":"2024-09-22T08:15:04.963035+0000","last_became_peered":"2024-09-22T08:15:04.963035+0000","last_unstale":"2024-09-22T08:56:16.532155+0000","last_undegraded":"2024-09-22T08:56:16.532155+0000","last_fullsized":"2024-09-22T08:56:16.532155+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:06:11.269656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":484,"num_read_kb":60036,"num_write":970,"num_write_kb":46477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"263'433","reported_seq":2054,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:24.609260+0000","last_change":"2024-09-22T08:15:06.973192+0000","last_active":"2024-09-22T08:54:24.609260+0000","last_peered":"2024-09-22T08:54:24.609260+0000","last_clean":"2024-09-22T08:54:24.609260+0000","last_became_active":"2024-09-22T08:15:06.972901+0000","last_became_peered":"2024-09-22T08:15:06.972901+0000","last_unstale":"2024-09-22T08:54:24.609260+0000","last_undegraded":"2024-09-22T08:54:24.609260+0000","last_fullsized":"2024-09-22T08:54:24.609260+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:05:44.213357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2630,"num_read_kb":2493,"num_write":497,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"263'190","reported_seq":793,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:23.475033+0000","last_change":"2024-09-22T08:15:04.955216+0000","last_active":"2024-09-22T08:53:23.475033+0000","last_peered":"2024-09-22T08:53:23.475033+0000","last_clean":"2024-09-22T08:53:23.475033+0000","last_became_active":"2024-09-22T08:15:04.954601+0000","last_became_peered":"2024-09-22T08:15:04.954601+0000","last_unstale":"2024-09-22T08:53:23.475033+0000","last_undegraded":"2024-09-22T08:53:23.475033+0000","last_fullsized":"2024-09-22T08:53:23.475033+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:09:17.404903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145754,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":487,"num_read_kb":10659,"num_write":870,"num_write_kb":26887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"263'435","reported_seq":1895,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:26.720211+0000","last_change":"2024-09-22T08:15:06.956049+0000","last_active":"2024-09-22T08:54:26.720211+0000","last_peered":"2024-09-22T08:54:26.720211+0000","last_clean":"2024-09-22T08:54:26.720211+0000","last_became_active":"2024-09-22T08:15:06.955721+0000","last_became_peered":"2024-09-22T08:15:06.955721+0000","last_unstale":"2024-09-22T08:54:26.720211+0000","last_undegraded":"2024-09-22T08:54:26.720211+0000","last_fullsized":"2024-09-22T08:54:26.720211+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:49:20.581915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2301,"num_read_kb":2146,"num_write":527,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"263'213","reported_seq":874,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:28.392913+0000","last_change":"2024-09-22T08:15:04.961490+0000","last_active":"2024-09-22T08:53:28.392913+0000","last_peered":"2024-09-22T08:53:28.392913+0000","last_clean":"2024-09-22T08:53:28.392913+0000","last_became_active":"2024-09-22T08:15:04.961217+0000","last_became_peered":"2024-09-22T08:15:04.961217+0000","last_unstale":"2024-09-22T08:53:28.392913+0000","last_undegraded":"2024-09-22T08:53:28.392913+0000","last_fullsized":"2024-09-22T08:53:28.392913+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:36:23.921216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1319535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":594,"num_read_kb":11776,"num_write":1058,"num_write_kb":6843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"263'549","reported_seq":2080,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.927363+0000","last_change":"2024-09-22T08:15:06.971069+0000","last_active":"2024-09-22T08:54:38.927363+0000","last_peered":"2024-09-22T08:54:38.927363+0000","last_clean":"2024-09-22T08:54:38.927363+0000","last_became_active":"2024-09-22T08:15:06.970735+0000","last_became_peered":"2024-09-22T08:15:06.970735+0000","last_unstale":"2024-09-22T08:54:38.927363+0000","last_undegraded":"2024-09-22T08:54:38.927363+0000","last_fullsized":"2024-09-22T08:54:38.927363+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":500,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:22:49.656390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2725,"num_read_kb":2496,"num_write":675,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"263'217","reported_seq":874,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.490267+0000","last_change":"2024-09-22T08:15:04.968447+0000","last_active":"2024-09-22T08:56:16.490267+0000","last_peered":"2024-09-22T08:56:16.490267+0000","last_clean":"2024-09-22T08:56:16.490267+0000","last_became_active":"2024-09-22T08:15:04.968172+0000","last_became_peered":"2024-09-22T08:15:04.968172+0000","last_unstale":"2024-09-22T08:56:16.490267+0000","last_undegraded":"2024-09-22T08:56:16.490267+0000","last_fullsized":"2024-09-22T08:56:16.490267+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:13:04.823684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":641,"num_read_kb":8608,"num_write":1007,"num_write_kb":17473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"263'756","reported_seq":2289,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:20.255569+0000","last_change":"2024-09-22T08:15:06.976244+0000","last_active":"2024-09-22T08:54:20.255569+0000","last_peered":"2024-09-22T08:54:20.255569+0000","last_clean":"2024-09-22T08:54:20.255569+0000","last_became_active":"2024-09-22T08:15:06.976019+0000","last_became_peered":"2024-09-22T08:15:06.976019+0000","last_unstale":"2024-09-22T08:54:20.255569+0000","last_undegraded":"2024-09-22T08:54:20.255569+0000","last_fullsized":"2024-09-22T08:54:20.255569+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:12:42.777379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3691,"num_read_kb":3360,"num_write":995,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"263'220","reported_seq":910,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:18.048628+0000","last_change":"2024-09-22T08:15:04.963673+0000","last_active":"2024-09-22T08:53:18.048628+0000","last_peered":"2024-09-22T08:53:18.048628+0000","last_clean":"2024-09-22T08:53:18.048628+0000","last_became_active":"2024-09-22T08:15:04.963391+0000","last_became_peered":"2024-09-22T08:15:04.963391+0000","last_unstale":"2024-09-22T08:53:18.048628+0000","last_undegraded":"2024-09-22T08:53:18.048628+0000","last_fullsized":"2024-09-22T08:53:18.048628+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:19:28.768330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5835011,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":632,"num_read_kb":95067,"num_write":1055,"num_write_kb":43906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"263'259","reported_seq":914,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:56.799472+0000","last_change":"2024-09-22T08:15:04.966802+0000","last_active":"2024-09-22T08:52:56.799472+0000","last_peered":"2024-09-22T08:52:56.799472+0000","last_clean":"2024-09-22T08:52:56.799472+0000","last_became_active":"2024-09-22T08:15:04.965396+0000","last_became_peered":"2024-09-22T08:15:04.965396+0000","last_unstale":"2024-09-22T08:52:56.799472+0000","last_undegraded":"2024-09-22T08:52:56.799472+0000","last_fullsized":"2024-09-22T08:52:56.799472+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:33:44.025013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10815762,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":737,"num_read_kb":7770,"num_write":1111,"num_write_kb":20319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"263'1208","reported_seq":2920,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.480223+0000","last_change":"2024-09-22T08:15:06.971024+0000","last_active":"2024-09-22T08:54:41.480223+0000","last_peered":"2024-09-22T08:54:41.480223+0000","last_clean":"2024-09-22T08:54:41.480223+0000","last_became_active":"2024-09-22T08:15:06.970717+0000","last_became_peered":"2024-09-22T08:15:06.970717+0000","last_unstale":"2024-09-22T08:54:41.480223+0000","last_undegraded":"2024-09-22T08:54:41.480223+0000","last_fullsized":"2024-09-22T08:54:41.480223+0000","mapping_epoch":25,"log_start":"263'1100","ondisk_log_start":"263'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":1100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:28:38.936914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5779,"num_read_kb":5147,"num_write":1662,"num_write_kb":686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"263'200","reported_seq":785,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.545519+0000","last_change":"2024-09-22T08:15:04.959358+0000","last_active":"2024-09-22T08:56:16.545519+0000","last_peered":"2024-09-22T08:56:16.545519+0000","last_clean":"2024-09-22T08:56:16.545519+0000","last_became_active":"2024-09-22T08:15:04.959102+0000","last_became_peered":"2024-09-22T08:15:04.959102+0000","last_unstale":"2024-09-22T08:56:16.545519+0000","last_undegraded":"2024-09-22T08:56:16.545519+0000","last_fullsized":"2024-09-22T08:56:16.545519+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:04:57.231333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":396,"num_read_kb":24955,"num_write":899,"num_write_kb":36551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"263'497","reported_seq":2107,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:23.395197+0000","last_change":"2024-09-22T08:15:06.969693+0000","last_active":"2024-09-22T08:54:23.395197+0000","last_peered":"2024-09-22T08:54:23.395197+0000","last_clean":"2024-09-22T08:54:23.395197+0000","last_became_active":"2024-09-22T08:15:06.968345+0000","last_became_peered":"2024-09-22T08:15:06.968345+0000","last_unstale":"2024-09-22T08:54:23.395197+0000","last_undegraded":"2024-09-22T08:54:23.395197+0000","last_fullsized":"2024-09-22T08:54:23.395197+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:19.848260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2601,"num_read_kb":2436,"num_write":597,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10844,"num_read_kb":8840,"num_write":3116,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":899,"ondisk_log_size":899,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15081,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":16349,"num_read_kb":16036,"num_write":17069,"num_write_kb":4981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":30162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1780,"ondisk_log_size":1780,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":664,"ondisk_log_size":664,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":447566,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":8192,"num_read_kb":10309,"num_write":5544,"num_write_kb":2758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":516096,"data_stored":125593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1958,"ondisk_log_size":1958,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2389,"num_read_kb":2853,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":219693,"num_read_kb":201308,"num_write":55750,"num_write_kb":18998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3980,"ondisk_log_size":3980,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":250032338,"num_objects":339,"num_object_clones":0,"num_object_copies":678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":339,"num_whiteouts":0,"num_read":38674,"num_read_kb":2160973,"num_write":63909,"num_write_kb":2146956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":497967104,"data_stored":496530405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3647,"ondisk_log_size":3647,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":37797155,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":159,"num_read_kb":194127,"num_write":173,"num_write_kb":125446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":46297088,"data_stored":46294552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":25214243,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":158,"num_read_kb":186900,"num_write":176,"num_write_kb":125446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":44138496,"data_stored":44137030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":116,"ondisk_log_size":116,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509941,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":319748,"kb_used_data":130292,"kb_used_omap":1,"kb_used_meta":189438,"kb_avail":94052092,"statfs":{"total":96636764160,"available":96309342208,"internally_reserved":0,"allocated":133419008,"data_stored":131577570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":193984968},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509942,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":356048,"kb_used_data":108288,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":94015792,"statfs":{"total":96636764160,"available":96272171008,"internally_reserved":0,"allocated":110886912,"data_stored":109128914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":253688261},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509942,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":224460,"kb_used_data":153020,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94147380,"statfs":{"total":96636764160,"available":96406917120,"internally_reserved":0,"allocated":156692480,"data_stored":154843870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542646,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":209020,"kb_used_data":7100,"kb_used_omap":1,"kb_used_meta":201854,"kb_avail":94162820,"statfs":{"total":96636764160,"available":96422727680,"internally_reserved":0,"allocated":7270400,"data_stored":5649861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":206698954},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542645,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":152972,"kb_used_data":81524,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94218868,"statfs":{"total":96636764160,"available":96480120832,"internally_reserved":0,"allocated":83480576,"data_stored":81759643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542646,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":322808,"kb_used_data":84752,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94049032,"statfs":{"total":96636764160,"available":96306208768,"internally_reserved":0,"allocated":86786048,"data_stored":85108849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243726789},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542648,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":211624,"kb_used_data":72176,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94160216,"statfs":{"total":96636764160,"available":96420061184,"internally_reserved":0,"allocated":73908224,"data_stored":72287988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575348,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":288212,"kb_used_data":176516,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94083628,"statfs":{"total":96636764160,"available":96341635072,"internally_reserved":0,"allocated":180752384,"data_stored":178904915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":133992448,"data_stored":133717149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":84480000,"data_stored":84293177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":147660800,"data_stored":147368995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":109801472,"data_stored":109525406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5492736,"data_stored":5399824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":6012928,"data_stored":5893124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6889472,"data_stored":6786226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3637248,"data_stored":3546504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":135168,"data_stored":43190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":28335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":22866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":27544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":5633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":3876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":5455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9486336,"data_stored":9485603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9486336,"data_stored":9485603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14680064,"data_stored":14680064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9498624,"data_stored":9497554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12632064,"data_stored":12631331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18923520,"data_stored":18922787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T08:56:19.141 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T08:56:19.483 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:56:19.483 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":263,"fsid":"a14e7f8f-bdf2-40f5-bed7-476dd1b34b7f","created":"2024-09-22T08:14:34.158414+0000","modified":"2024-09-22T08:42:18.408951+0000","last_up_change":"2024-09-22T08:14:47.452169+0000","last_in_change":"2024-09-22T08:14:37.441829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":15,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-22T08:14:46.663444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-22T08:14:53.369744+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-22T08:15:03.472940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-22T08:15:05.306418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-22T08:15:07.116361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-22T08:15:09.035767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-22T08:15:10.997244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-22T08:15:13.090266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-22T08:29:24.450220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"254","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-22T08:31:09.843503+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"257","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-22T08:31:12.284526+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"260","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-22T08:42:16.137897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"263","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e925403-23d1-4b76-8c8e-5782ecc00c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":2964048893},{"type":"v1","addr":"172.21.15.38:6825","nonce":2964048893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":2964048893},{"type":"v1","addr":"172.21.15.38:6827","nonce":2964048893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":2964048893},{"type":"v1","addr":"172.21.15.38:6831","nonce":2964048893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":2964048893},{"type":"v1","addr":"172.21.15.38:6829","nonce":2964048893}]},"public_addr":"172.21.15.38:6825/2964048893","cluster_addr":"172.21.15.38:6827/2964048893","heartbeat_back_addr":"172.21.15.38:6831/2964048893","heartbeat_front_addr":"172.21.15.38:6829/2964048893","state":["exists","up"]},{"osd":1,"uuid":"e385e001-2edb-4915-9721-5f41f7f59cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1856522357},{"type":"v1","addr":"172.21.15.38:6809","nonce":1856522357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1856522357},{"type":"v1","addr":"172.21.15.38:6811","nonce":1856522357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1856522357},{"type":"v1","addr":"172.21.15.38:6815","nonce":1856522357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1856522357},{"type":"v1","addr":"172.21.15.38:6813","nonce":1856522357}]},"public_addr":"172.21.15.38:6809/1856522357","cluster_addr":"172.21.15.38:6811/1856522357","heartbeat_back_addr":"172.21.15.38:6815/1856522357","heartbeat_front_addr":"172.21.15.38:6813/1856522357","state":["exists","up"]},{"osd":2,"uuid":"d679834b-edf5-4271-894e-75cc07af0a5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":703968303},{"type":"v1","addr":"172.21.15.38:6801","nonce":703968303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":703968303},{"type":"v1","addr":"172.21.15.38:6803","nonce":703968303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":703968303},{"type":"v1","addr":"172.21.15.38:6807","nonce":703968303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":703968303},{"type":"v1","addr":"172.21.15.38:6805","nonce":703968303}]},"public_addr":"172.21.15.38:6801/703968303","cluster_addr":"172.21.15.38:6803/703968303","heartbeat_back_addr":"172.21.15.38:6807/703968303","heartbeat_front_addr":"172.21.15.38:6805/703968303","state":["exists","up"]},{"osd":3,"uuid":"20730742-284b-4749-b55c-42b108fa4601","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":852564455},{"type":"v1","addr":"172.21.15.38:6817","nonce":852564455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":852564455},{"type":"v1","addr":"172.21.15.38:6819","nonce":852564455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":852564455},{"type":"v1","addr":"172.21.15.38:6823","nonce":852564455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":852564455},{"type":"v1","addr":"172.21.15.38:6821","nonce":852564455}]},"public_addr":"172.21.15.38:6817/852564455","cluster_addr":"172.21.15.38:6819/852564455","heartbeat_back_addr":"172.21.15.38:6823/852564455","heartbeat_front_addr":"172.21.15.38:6821/852564455","state":["exists","up"]},{"osd":4,"uuid":"f69a0cda-2c26-4bd3-a2b0-42343e8bbf4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":951985313},{"type":"v1","addr":"172.21.15.42:6819","nonce":951985313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":951985313},{"type":"v1","addr":"172.21.15.42:6821","nonce":951985313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":951985313},{"type":"v1","addr":"172.21.15.42:6825","nonce":951985313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":951985313},{"type":"v1","addr":"172.21.15.42:6823","nonce":951985313}]},"public_addr":"172.21.15.42:6819/951985313","cluster_addr":"172.21.15.42:6821/951985313","heartbeat_back_addr":"172.21.15.42:6825/951985313","heartbeat_front_addr":"172.21.15.42:6823/951985313","state":["exists","up"]},{"osd":5,"uuid":"81a144c6-eae2-48fe-8113-7f5920197be9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":1033356835},{"type":"v1","addr":"172.21.15.42:6811","nonce":1033356835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":1033356835},{"type":"v1","addr":"172.21.15.42:6813","nonce":1033356835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":1033356835},{"type":"v1","addr":"172.21.15.42:6817","nonce":1033356835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":1033356835},{"type":"v1","addr":"172.21.15.42:6815","nonce":1033356835}]},"public_addr":"172.21.15.42:6811/1033356835","cluster_addr":"172.21.15.42:6813/1033356835","heartbeat_back_addr":"172.21.15.42:6817/1033356835","heartbeat_front_addr":"172.21.15.42:6815/1033356835","state":["exists","up"]},{"osd":6,"uuid":"041e0082-acb7-46ce-adc1-4ffba52bf5db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2532764980},{"type":"v1","addr":"172.21.15.42:6803","nonce":2532764980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2532764980},{"type":"v1","addr":"172.21.15.42:6805","nonce":2532764980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2532764980},{"type":"v1","addr":"172.21.15.42:6809","nonce":2532764980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2532764980},{"type":"v1","addr":"172.21.15.42:6807","nonce":2532764980}]},"public_addr":"172.21.15.42:6803/2532764980","cluster_addr":"172.21.15.42:6805/2532764980","heartbeat_back_addr":"172.21.15.42:6809/2532764980","heartbeat_front_addr":"172.21.15.42:6807/2532764980","state":["exists","up"]},{"osd":7,"uuid":"30e812ad-f0df-4b22-808d-dd0caea9983b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1437467409},{"type":"v1","addr":"172.21.15.42:6827","nonce":1437467409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":1437467409},{"type":"v1","addr":"172.21.15.42:6829","nonce":1437467409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1437467409},{"type":"v1","addr":"172.21.15.42:6833","nonce":1437467409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":1437467409},{"type":"v1","addr":"172.21.15.42:6831","nonce":1437467409}]},"public_addr":"172.21.15.42:6827/1437467409","cluster_addr":"172.21.15.42:6829/1437467409","heartbeat_back_addr":"172.21.15.42:6833/1437467409","heartbeat_front_addr":"172.21.15.42:6831/1437467409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:14:44.809004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:14:44.323165+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:14:43.821347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:14:44.760911+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:14:44.042922+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:14:43.773491+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:14:43.707930+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:14:44.567066+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.e","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T08:56:20.497 INFO:tasks.ceph:Scrubbing osd.0 2024-09-22T08:56:20.497 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-22T08:56:20.652 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-22T08:56:20.652 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-22T08:56:20.652 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-22T08:56:20.663 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-22T08:56:20.979 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 0 to deep-scrub 2024-09-22T08:56:20.992 INFO:tasks.ceph:Scrubbing osd.1 2024-09-22T08:56:20.992 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-22T08:56:21.134 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-22T08:56:21.134 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-22T08:56:21.134 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-22T08:56:21.145 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-22T08:56:21.461 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 1 to deep-scrub 2024-09-22T08:56:21.475 INFO:tasks.ceph:Scrubbing osd.2 2024-09-22T08:56:21.476 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-22T08:56:21.616 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-22T08:56:21.616 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-22T08:56:21.616 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-22T08:56:21.627 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-22T08:56:21.945 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 2 to deep-scrub 2024-09-22T08:56:21.959 INFO:tasks.ceph:Scrubbing osd.3 2024-09-22T08:56:21.959 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-22T08:56:22.100 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-22T08:56:22.100 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-22T08:56:22.100 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-22T08:56:22.111 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-22T08:56:22.430 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 3 to deep-scrub 2024-09-22T08:56:22.444 INFO:tasks.ceph:Scrubbing osd.4 2024-09-22T08:56:22.444 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-22T08:56:22.586 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-22T08:56:22.586 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-22T08:56:22.586 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-22T08:56:22.597 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-22T08:56:22.915 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 4 to deep-scrub 2024-09-22T08:56:22.929 INFO:tasks.ceph:Scrubbing osd.5 2024-09-22T08:56:22.929 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-22T08:56:23.072 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-22T08:56:23.072 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-22T08:56:23.072 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-22T08:56:23.083 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-22T08:56:23.401 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 5 to deep-scrub 2024-09-22T08:56:23.414 INFO:tasks.ceph:Scrubbing osd.6 2024-09-22T08:56:23.415 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-22T08:56:23.557 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-22T08:56:23.557 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-22T08:56:23.557 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-22T08:56:23.567 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-22T08:56:23.888 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 6 to deep-scrub 2024-09-22T08:56:23.901 INFO:tasks.ceph:Scrubbing osd.7 2024-09-22T08:56:23.901 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-22T08:56:24.043 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-22T08:56:24.044 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-22T08:56:24.044 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-22T08:56:24.054 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-22T08:56:24.374 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 7 to deep-scrub 2024-09-22T08:56:24.387 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T08:56:24.725 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:56:24.736 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-09-22T08:56:24.739 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":1505,"stamp":"2024-09-22T08:56:23.632104+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23389059,"num_objects":621,"num_object_clones":0,"num_object_copies":1242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":621,"num_whiteouts":0,"num_read":296912,"num_read_kb":2781806,"num_write":146178,"num_write_kb":2427265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":189,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13076,"ondisk_log_size":13076,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1349780,"kb_used_data":74232,"kb_used_omap":12,"kb_used_meta":1275123,"kb_avail":753624940,"statfs":{"total":773094113280,"available":771711938560,"internally_reserved":0,"allocated":76013568,"data_stored":62802638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1305726513},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-530130344,"num_objects":-356,"num_object_clones":0,"num_object_copies":-712,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-356,"num_whiteouts":0,"num_read":717,"num_read_kb":769,"num_write":544,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004961"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:18.466360+0000","last_change":"2024-09-22T08:42:17.435884+0000","last_active":"2024-09-22T08:52:18.466360+0000","last_peered":"2024-09-22T08:52:18.466360+0000","last_clean":"2024-09-22T08:52:18.466360+0000","last_became_active":"2024-09-22T08:42:17.435576+0000","last_became_peered":"2024-09-22T08:42:17.435576+0000","last_unstale":"2024-09-22T08:52:18.466360+0000","last_undegraded":"2024-09-22T08:52:18.466360+0000","last_fullsized":"2024-09-22T08:52:18.466360+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:18:12.399293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"263'7","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.464541+0000","last_change":"2024-09-22T08:31:14.254986+0000","last_active":"2024-09-22T08:56:16.464541+0000","last_peered":"2024-09-22T08:56:16.464541+0000","last_clean":"2024-09-22T08:56:16.464541+0000","last_became_active":"2024-09-22T08:31:14.254610+0000","last_became_peered":"2024-09-22T08:31:14.254610+0000","last_unstale":"2024-09-22T08:56:16.464541+0000","last_undegraded":"2024-09-22T08:56:16.464541+0000","last_fullsized":"2024-09-22T08:56:16.464541+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:29:54.524062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"263'4","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.314152+0000","last_change":"2024-09-22T08:31:11.216063+0000","last_active":"2024-09-22T08:56:16.314152+0000","last_peered":"2024-09-22T08:56:16.314152+0000","last_clean":"2024-09-22T08:56:16.314152+0000","last_became_active":"2024-09-22T08:31:11.215757+0000","last_became_peered":"2024-09-22T08:31:11.215757+0000","last_unstale":"2024-09-22T08:56:16.314152+0000","last_undegraded":"2024-09-22T08:56:16.314152+0000","last_fullsized":"2024-09-22T08:56:16.314152+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:30:49.027544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6203,"num_write":4,"num_write_kb":3131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"263'27","reported_seq":113,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:39.138788+0000","last_change":"2024-09-22T08:29:26.069972+0000","last_active":"2024-09-22T08:52:39.138788+0000","last_peered":"2024-09-22T08:52:39.138788+0000","last_clean":"2024-09-22T08:52:39.138788+0000","last_became_active":"2024-09-22T08:29:26.069635+0000","last_became_peered":"2024-09-22T08:29:26.069635+0000","last_unstale":"2024-09-22T08:52:39.138788+0000","last_undegraded":"2024-09-22T08:52:39.138788+0000","last_fullsized":"2024-09-22T08:52:39.138788+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:19:23.283184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":139,"num_write":76,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:17.271882+0000","last_change":"2024-09-22T08:42:17.433226+0000","last_active":"2024-09-22T08:52:17.271882+0000","last_peered":"2024-09-22T08:52:17.271882+0000","last_clean":"2024-09-22T08:52:17.271882+0000","last_became_active":"2024-09-22T08:42:17.432946+0000","last_became_peered":"2024-09-22T08:42:17.432946+0000","last_unstale":"2024-09-22T08:52:17.271882+0000","last_undegraded":"2024-09-22T08:52:17.271882+0000","last_fullsized":"2024-09-22T08:52:17.271882+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:57:47.463137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"263'5","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.380075+0000","last_change":"2024-09-22T08:31:14.256838+0000","last_active":"2024-09-22T08:56:16.380075+0000","last_peered":"2024-09-22T08:56:16.380075+0000","last_clean":"2024-09-22T08:56:16.380075+0000","last_became_active":"2024-09-22T08:31:14.256486+0000","last_became_peered":"2024-09-22T08:31:14.256486+0000","last_unstale":"2024-09-22T08:56:16.380075+0000","last_undegraded":"2024-09-22T08:56:16.380075+0000","last_fullsized":"2024-09-22T08:56:16.380075+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:05:48.401720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8240,"num_write":10,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"260'2","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:42.284418+0000","last_change":"2024-09-22T08:31:11.216967+0000","last_active":"2024-09-22T08:53:42.284418+0000","last_peered":"2024-09-22T08:53:42.284418+0000","last_clean":"2024-09-22T08:53:42.284418+0000","last_became_active":"2024-09-22T08:31:11.216515+0000","last_became_peered":"2024-09-22T08:31:11.216515+0000","last_unstale":"2024-09-22T08:53:42.284418+0000","last_undegraded":"2024-09-22T08:53:42.284418+0000","last_fullsized":"2024-09-22T08:53:42.284418+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:40:06.800121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"263'31","reported_seq":130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:32.404964+0000","last_change":"2024-09-22T08:29:26.074014+0000","last_active":"2024-09-22T08:53:32.404964+0000","last_peered":"2024-09-22T08:53:32.404964+0000","last_clean":"2024-09-22T08:53:32.404964+0000","last_became_active":"2024-09-22T08:29:26.073415+0000","last_became_peered":"2024-09-22T08:29:26.073415+0000","last_unstale":"2024-09-22T08:53:32.404964+0000","last_undegraded":"2024-09-22T08:53:32.404964+0000","last_fullsized":"2024-09-22T08:53:32.404964+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:07:10.743328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":176,"num_write":77,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:58.380840+0000","last_change":"2024-09-22T08:42:17.436629+0000","last_active":"2024-09-22T08:51:58.380840+0000","last_peered":"2024-09-22T08:51:58.380840+0000","last_clean":"2024-09-22T08:51:58.380840+0000","last_became_active":"2024-09-22T08:42:17.436334+0000","last_became_peered":"2024-09-22T08:42:17.436334+0000","last_unstale":"2024-09-22T08:51:58.380840+0000","last_undegraded":"2024-09-22T08:51:58.380840+0000","last_fullsized":"2024-09-22T08:51:58.380840+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:04:08.905608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"260'4","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:12.288779+0000","last_change":"2024-09-22T08:31:14.257057+0000","last_active":"2024-09-22T08:54:12.288779+0000","last_peered":"2024-09-22T08:54:12.288779+0000","last_clean":"2024-09-22T08:54:12.288779+0000","last_became_active":"2024-09-22T08:31:14.256769+0000","last_became_peered":"2024-09-22T08:31:14.256769+0000","last_unstale":"2024-09-22T08:54:12.288779+0000","last_undegraded":"2024-09-22T08:54:12.288779+0000","last_fullsized":"2024-09-22T08:54:12.288779+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:06:32.378399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:17.289881+0000","last_change":"2024-09-22T08:31:11.211351+0000","last_active":"2024-09-22T08:53:17.289881+0000","last_peered":"2024-09-22T08:53:17.289881+0000","last_clean":"2024-09-22T08:53:17.289881+0000","last_became_active":"2024-09-22T08:31:11.210892+0000","last_became_peered":"2024-09-22T08:31:11.210892+0000","last_unstale":"2024-09-22T08:53:17.289881+0000","last_undegraded":"2024-09-22T08:53:17.289881+0000","last_fullsized":"2024-09-22T08:53:17.289881+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:20:58.942888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"263'43","reported_seq":162,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:57.268885+0000","last_change":"2024-09-22T08:29:26.068513+0000","last_active":"2024-09-22T08:51:57.268885+0000","last_peered":"2024-09-22T08:51:57.268885+0000","last_clean":"2024-09-22T08:51:57.268885+0000","last_became_active":"2024-09-22T08:29:26.067963+0000","last_became_peered":"2024-09-22T08:29:26.067963+0000","last_unstale":"2024-09-22T08:51:57.268885+0000","last_undegraded":"2024-09-22T08:51:57.268885+0000","last_fullsized":"2024-09-22T08:51:57.268885+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:19:50.645315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":380,"num_read_kb":284,"num_write":99,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:02.269565+0000","last_change":"2024-09-22T08:42:17.431238+0000","last_active":"2024-09-22T08:52:02.269565+0000","last_peered":"2024-09-22T08:52:02.269565+0000","last_clean":"2024-09-22T08:52:02.269565+0000","last_became_active":"2024-09-22T08:42:17.430938+0000","last_became_peered":"2024-09-22T08:42:17.430938+0000","last_unstale":"2024-09-22T08:52:02.269565+0000","last_undegraded":"2024-09-22T08:52:02.269565+0000","last_fullsized":"2024-09-22T08:52:02.269565+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:34:21.108839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"263'5","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:22.299767+0000","last_change":"2024-09-22T08:31:14.257263+0000","last_active":"2024-09-22T08:55:22.299767+0000","last_peered":"2024-09-22T08:55:22.299767+0000","last_clean":"2024-09-22T08:55:22.299767+0000","last_became_active":"2024-09-22T08:31:14.255086+0000","last_became_peered":"2024-09-22T08:31:14.255086+0000","last_unstale":"2024-09-22T08:55:22.299767+0000","last_undegraded":"2024-09-22T08:55:22.299767+0000","last_fullsized":"2024-09-22T08:55:22.299767+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:28:49.743007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:08.397293+0000","last_change":"2024-09-22T08:31:11.207653+0000","last_active":"2024-09-22T08:54:08.397293+0000","last_peered":"2024-09-22T08:54:08.397293+0000","last_clean":"2024-09-22T08:54:08.397293+0000","last_became_active":"2024-09-22T08:31:11.207375+0000","last_became_peered":"2024-09-22T08:31:11.207375+0000","last_unstale":"2024-09-22T08:54:08.397293+0000","last_undegraded":"2024-09-22T08:54:08.397293+0000","last_fullsized":"2024-09-22T08:54:08.397293+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:55:26.229921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"263'31","reported_seq":122,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:57.268855+0000","last_change":"2024-09-22T08:29:26.072556+0000","last_active":"2024-09-22T08:51:57.268855+0000","last_peered":"2024-09-22T08:51:57.268855+0000","last_clean":"2024-09-22T08:51:57.268855+0000","last_became_active":"2024-09-22T08:29:26.072183+0000","last_became_peered":"2024-09-22T08:29:26.072183+0000","last_unstale":"2024-09-22T08:51:57.268855+0000","last_undegraded":"2024-09-22T08:51:57.268855+0000","last_fullsized":"2024-09-22T08:51:57.268855+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:30:12.756499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":233,"num_read_kb":155,"num_write":81,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:22.298701+0000","last_change":"2024-09-22T08:42:17.418516+0000","last_active":"2024-09-22T08:54:22.298701+0000","last_peered":"2024-09-22T08:54:22.298701+0000","last_clean":"2024-09-22T08:54:22.298701+0000","last_became_active":"2024-09-22T08:42:17.418224+0000","last_became_peered":"2024-09-22T08:42:17.418224+0000","last_unstale":"2024-09-22T08:54:22.298701+0000","last_undegraded":"2024-09-22T08:54:22.298701+0000","last_fullsized":"2024-09-22T08:54:22.298701+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:06:49.930134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"263'5","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.365270+0000","last_change":"2024-09-22T08:31:14.262084+0000","last_active":"2024-09-22T08:56:16.365270+0000","last_peered":"2024-09-22T08:56:16.365270+0000","last_clean":"2024-09-22T08:56:16.365270+0000","last_became_active":"2024-09-22T08:31:14.261753+0000","last_became_peered":"2024-09-22T08:31:14.261753+0000","last_unstale":"2024-09-22T08:56:16.365270+0000","last_undegraded":"2024-09-22T08:56:16.365270+0000","last_fullsized":"2024-09-22T08:56:16.365270+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:21:33.510246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"260'9","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:57.277829+0000","last_change":"2024-09-22T08:31:11.215327+0000","last_active":"2024-09-22T08:52:57.277829+0000","last_peered":"2024-09-22T08:52:57.277829+0000","last_clean":"2024-09-22T08:52:57.277829+0000","last_became_active":"2024-09-22T08:31:11.215024+0000","last_became_peered":"2024-09-22T08:31:11.215024+0000","last_unstale":"2024-09-22T08:52:57.277829+0000","last_undegraded":"2024-09-22T08:52:57.277829+0000","last_fullsized":"2024-09-22T08:52:57.277829+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:27:55.278924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":17455,"num_write":14,"num_write_kb":5165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"263'52","reported_seq":185,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:50.448372+0000","last_change":"2024-09-22T08:29:26.071185+0000","last_active":"2024-09-22T08:53:50.448372+0000","last_peered":"2024-09-22T08:53:50.448372+0000","last_clean":"2024-09-22T08:53:50.448372+0000","last_became_active":"2024-09-22T08:29:26.070913+0000","last_became_peered":"2024-09-22T08:29:26.070913+0000","last_unstale":"2024-09-22T08:53:50.448372+0000","last_undegraded":"2024-09-22T08:53:50.448372+0000","last_fullsized":"2024-09-22T08:53:50.448372+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:50:29.931826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":289,"num_write":128,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:42.398384+0000","last_change":"2024-09-22T08:42:17.428992+0000","last_active":"2024-09-22T08:52:42.398384+0000","last_peered":"2024-09-22T08:52:42.398384+0000","last_clean":"2024-09-22T08:52:42.398384+0000","last_became_active":"2024-09-22T08:42:17.428589+0000","last_became_peered":"2024-09-22T08:42:17.428589+0000","last_unstale":"2024-09-22T08:52:42.398384+0000","last_undegraded":"2024-09-22T08:52:42.398384+0000","last_fullsized":"2024-09-22T08:52:42.398384+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:34:40.543481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"263'6","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:28.407335+0000","last_change":"2024-09-22T08:31:14.256450+0000","last_active":"2024-09-22T08:55:28.407335+0000","last_peered":"2024-09-22T08:55:28.407335+0000","last_clean":"2024-09-22T08:55:28.407335+0000","last_became_active":"2024-09-22T08:31:14.256133+0000","last_became_peered":"2024-09-22T08:31:14.256133+0000","last_unstale":"2024-09-22T08:55:28.407335+0000","last_undegraded":"2024-09-22T08:55:28.407335+0000","last_fullsized":"2024-09-22T08:55:28.407335+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:35:53.157445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":16,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"263'2","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:23.406685+0000","last_change":"2024-09-22T08:31:11.214428+0000","last_active":"2024-09-22T08:55:23.406685+0000","last_peered":"2024-09-22T08:55:23.406685+0000","last_clean":"2024-09-22T08:55:23.406685+0000","last_became_active":"2024-09-22T08:31:11.214152+0000","last_became_peered":"2024-09-22T08:31:11.214152+0000","last_unstale":"2024-09-22T08:55:23.406685+0000","last_undegraded":"2024-09-22T08:55:23.406685+0000","last_fullsized":"2024-09-22T08:55:23.406685+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:24:25.711738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"263'41","reported_seq":155,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:56.954636+0000","last_change":"2024-09-22T08:29:26.073207+0000","last_active":"2024-09-22T08:52:56.954636+0000","last_peered":"2024-09-22T08:52:56.954636+0000","last_clean":"2024-09-22T08:52:56.954636+0000","last_became_active":"2024-09-22T08:29:26.072935+0000","last_became_peered":"2024-09-22T08:29:26.072935+0000","last_unstale":"2024-09-22T08:52:56.954636+0000","last_undegraded":"2024-09-22T08:52:56.954636+0000","last_fullsized":"2024-09-22T08:52:56.954636+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:08.214582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":341,"num_read_kb":226,"num_write":101,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:16.259851+0000","last_change":"2024-09-22T08:42:17.429598+0000","last_active":"2024-09-22T08:52:16.259851+0000","last_peered":"2024-09-22T08:52:16.259851+0000","last_clean":"2024-09-22T08:52:16.259851+0000","last_became_active":"2024-09-22T08:42:17.429298+0000","last_became_peered":"2024-09-22T08:42:17.429298+0000","last_unstale":"2024-09-22T08:52:16.259851+0000","last_undegraded":"2024-09-22T08:52:16.259851+0000","last_fullsized":"2024-09-22T08:52:16.259851+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:26:36.238407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"260'7","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:46.271089+0000","last_change":"2024-09-22T08:31:14.258062+0000","last_active":"2024-09-22T08:53:46.271089+0000","last_peered":"2024-09-22T08:53:46.271089+0000","last_clean":"2024-09-22T08:53:46.271089+0000","last_became_active":"2024-09-22T08:31:14.257659+0000","last_became_peered":"2024-09-22T08:31:14.257659+0000","last_unstale":"2024-09-22T08:53:46.271089+0000","last_undegraded":"2024-09-22T08:53:46.271089+0000","last_fullsized":"2024-09-22T08:53:46.271089+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:32:38.962644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4143,"num_write":12,"num_write_kb":1069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"263'2","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:13.496086+0000","last_change":"2024-09-22T08:31:11.216523+0000","last_active":"2024-09-22T08:56:13.496086+0000","last_peered":"2024-09-22T08:56:13.496086+0000","last_clean":"2024-09-22T08:56:13.496086+0000","last_became_active":"2024-09-22T08:31:11.216248+0000","last_became_peered":"2024-09-22T08:31:11.216248+0000","last_unstale":"2024-09-22T08:56:13.496086+0000","last_undegraded":"2024-09-22T08:56:13.496086+0000","last_fullsized":"2024-09-22T08:56:13.496086+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:46:16.857947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"263'16","reported_seq":84,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:47.294012+0000","last_change":"2024-09-22T08:29:26.076631+0000","last_active":"2024-09-22T08:53:47.294012+0000","last_peered":"2024-09-22T08:53:47.294012+0000","last_clean":"2024-09-22T08:53:47.294012+0000","last_became_active":"2024-09-22T08:29:26.076243+0000","last_became_peered":"2024-09-22T08:29:26.076243+0000","last_unstale":"2024-09-22T08:53:47.294012+0000","last_undegraded":"2024-09-22T08:53:47.294012+0000","last_fullsized":"2024-09-22T08:53:47.294012+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:02:16.942826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":86,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:18.466402+0000","last_change":"2024-09-22T08:42:17.433193+0000","last_active":"2024-09-22T08:52:18.466402+0000","last_peered":"2024-09-22T08:52:18.466402+0000","last_clean":"2024-09-22T08:52:18.466402+0000","last_became_active":"2024-09-22T08:42:17.432923+0000","last_became_peered":"2024-09-22T08:42:17.432923+0000","last_unstale":"2024-09-22T08:52:18.466402+0000","last_undegraded":"2024-09-22T08:52:18.466402+0000","last_fullsized":"2024-09-22T08:52:18.466402+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:17:35.794496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"263'8","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.426367+0000","last_change":"2024-09-22T08:31:14.256601+0000","last_active":"2024-09-22T08:56:16.426367+0000","last_peered":"2024-09-22T08:56:16.426367+0000","last_clean":"2024-09-22T08:56:16.426367+0000","last_became_active":"2024-09-22T08:31:14.256055+0000","last_became_peered":"2024-09-22T08:31:14.256055+0000","last_unstale":"2024-09-22T08:56:16.426367+0000","last_undegraded":"2024-09-22T08:56:16.426367+0000","last_fullsized":"2024-09-22T08:56:16.426367+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:48:31.013743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":18434,"num_write":18,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"263'8","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.321761+0000","last_change":"2024-09-22T08:31:11.215990+0000","last_active":"2024-09-22T08:56:16.321761+0000","last_peered":"2024-09-22T08:56:16.321761+0000","last_clean":"2024-09-22T08:56:16.321761+0000","last_became_active":"2024-09-22T08:31:11.215609+0000","last_became_peered":"2024-09-22T08:31:11.215609+0000","last_unstale":"2024-09-22T08:56:16.321761+0000","last_undegraded":"2024-09-22T08:56:16.321761+0000","last_fullsized":"2024-09-22T08:56:16.321761+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:52:29.022225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":18,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"263'42","reported_seq":155,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:37.283579+0000","last_change":"2024-09-22T08:29:26.067779+0000","last_active":"2024-09-22T08:53:37.283579+0000","last_peered":"2024-09-22T08:53:37.283579+0000","last_clean":"2024-09-22T08:53:37.283579+0000","last_became_active":"2024-09-22T08:29:26.066447+0000","last_became_peered":"2024-09-22T08:29:26.066447+0000","last_unstale":"2024-09-22T08:53:37.283579+0000","last_undegraded":"2024-09-22T08:53:37.283579+0000","last_fullsized":"2024-09-22T08:53:37.283579+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:16:11.771113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":325,"num_read_kb":214,"num_write":107,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:57.286263+0000","last_change":"2024-09-22T08:42:17.436182+0000","last_active":"2024-09-22T08:53:57.286263+0000","last_peered":"2024-09-22T08:53:57.286263+0000","last_clean":"2024-09-22T08:53:57.286263+0000","last_became_active":"2024-09-22T08:42:17.435842+0000","last_became_peered":"2024-09-22T08:42:17.435842+0000","last_unstale":"2024-09-22T08:53:57.286263+0000","last_undegraded":"2024-09-22T08:53:57.286263+0000","last_fullsized":"2024-09-22T08:53:57.286263+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:44:56.306198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"263'2","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:27.307511+0000","last_change":"2024-09-22T08:31:14.255793+0000","last_active":"2024-09-22T08:55:27.307511+0000","last_peered":"2024-09-22T08:55:27.307511+0000","last_clean":"2024-09-22T08:55:27.307511+0000","last_became_active":"2024-09-22T08:31:14.255497+0000","last_became_peered":"2024-09-22T08:31:14.255497+0000","last_unstale":"2024-09-22T08:55:27.307511+0000","last_undegraded":"2024-09-22T08:55:27.307511+0000","last_fullsized":"2024-09-22T08:55:27.307511+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:31.376498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"263'4","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:33.400382+0000","last_change":"2024-09-22T08:31:11.217315+0000","last_active":"2024-09-22T08:54:33.400382+0000","last_peered":"2024-09-22T08:54:33.400382+0000","last_clean":"2024-09-22T08:54:33.400382+0000","last_became_active":"2024-09-22T08:31:11.216997+0000","last_became_peered":"2024-09-22T08:31:11.216997+0000","last_unstale":"2024-09-22T08:54:33.400382+0000","last_undegraded":"2024-09-22T08:54:33.400382+0000","last_fullsized":"2024-09-22T08:54:33.400382+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:29.441399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"263'25","reported_seq":111,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:37.405734+0000","last_change":"2024-09-22T08:29:26.071169+0000","last_active":"2024-09-22T08:53:37.405734+0000","last_peered":"2024-09-22T08:53:37.405734+0000","last_clean":"2024-09-22T08:53:37.405734+0000","last_became_active":"2024-09-22T08:29:26.070906+0000","last_became_peered":"2024-09-22T08:29:26.070906+0000","last_unstale":"2024-09-22T08:53:37.405734+0000","last_undegraded":"2024-09-22T08:53:37.405734+0000","last_fullsized":"2024-09-22T08:53:37.405734+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:55:47.696276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":135,"num_write":63,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:57.286143+0000","last_change":"2024-09-22T08:42:17.430752+0000","last_active":"2024-09-22T08:53:57.286143+0000","last_peered":"2024-09-22T08:53:57.286143+0000","last_clean":"2024-09-22T08:53:57.286143+0000","last_became_active":"2024-09-22T08:42:17.430457+0000","last_became_peered":"2024-09-22T08:42:17.430457+0000","last_unstale":"2024-09-22T08:53:57.286143+0000","last_undegraded":"2024-09-22T08:53:57.286143+0000","last_fullsized":"2024-09-22T08:53:57.286143+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:57:22.012215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"263'9","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.464617+0000","last_change":"2024-09-22T08:31:14.256126+0000","last_active":"2024-09-22T08:56:16.464617+0000","last_peered":"2024-09-22T08:56:16.464617+0000","last_clean":"2024-09-22T08:56:16.464617+0000","last_became_active":"2024-09-22T08:31:14.255245+0000","last_became_peered":"2024-09-22T08:31:14.255245+0000","last_unstale":"2024-09-22T08:56:16.464617+0000","last_undegraded":"2024-09-22T08:56:16.464617+0000","last_fullsized":"2024-09-22T08:56:16.464617+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:45:50.399892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":20480,"num_write":14,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"260'6","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:58.472145+0000","last_change":"2024-09-22T08:31:11.211294+0000","last_active":"2024-09-22T08:52:58.472145+0000","last_peered":"2024-09-22T08:52:58.472145+0000","last_clean":"2024-09-22T08:52:58.472145+0000","last_became_active":"2024-09-22T08:31:11.211000+0000","last_became_peered":"2024-09-22T08:31:11.211000+0000","last_unstale":"2024-09-22T08:52:58.472145+0000","last_undegraded":"2024-09-22T08:52:58.472145+0000","last_fullsized":"2024-09-22T08:52:58.472145+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:34:47.341250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8192,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"263'32","reported_seq":130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:37.405687+0000","last_change":"2024-09-22T08:29:26.075955+0000","last_active":"2024-09-22T08:53:37.405687+0000","last_peered":"2024-09-22T08:53:37.405687+0000","last_clean":"2024-09-22T08:53:37.405687+0000","last_became_active":"2024-09-22T08:29:26.074151+0000","last_became_peered":"2024-09-22T08:29:26.074151+0000","last_unstale":"2024-09-22T08:53:37.405687+0000","last_undegraded":"2024-09-22T08:53:37.405687+0000","last_fullsized":"2024-09-22T08:53:37.405687+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:36:04.989650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":180,"num_write":78,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:56.272330+0000","last_change":"2024-09-22T08:42:17.432351+0000","last_active":"2024-09-22T08:53:56.272330+0000","last_peered":"2024-09-22T08:53:56.272330+0000","last_clean":"2024-09-22T08:53:56.272330+0000","last_became_active":"2024-09-22T08:42:17.432056+0000","last_became_peered":"2024-09-22T08:42:17.432056+0000","last_unstale":"2024-09-22T08:53:56.272330+0000","last_undegraded":"2024-09-22T08:53:56.272330+0000","last_fullsized":"2024-09-22T08:53:56.272330+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:19:22.863621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"263'6","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.434342+0000","last_change":"2024-09-22T08:31:14.259324+0000","last_active":"2024-09-22T08:56:16.434342+0000","last_peered":"2024-09-22T08:56:16.434342+0000","last_clean":"2024-09-22T08:56:16.434342+0000","last_became_active":"2024-09-22T08:31:14.259009+0000","last_became_peered":"2024-09-22T08:31:14.259009+0000","last_unstale":"2024-09-22T08:56:16.434342+0000","last_undegraded":"2024-09-22T08:56:16.434342+0000","last_fullsized":"2024-09-22T08:56:16.434342+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:19:27.710241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8192,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"263'5","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:22.306782+0000","last_change":"2024-09-22T08:31:11.216003+0000","last_active":"2024-09-22T08:55:22.306782+0000","last_peered":"2024-09-22T08:55:22.306782+0000","last_clean":"2024-09-22T08:55:22.306782+0000","last_became_active":"2024-09-22T08:31:11.215708+0000","last_became_peered":"2024-09-22T08:31:11.215708+0000","last_unstale":"2024-09-22T08:55:22.306782+0000","last_undegraded":"2024-09-22T08:55:22.306782+0000","last_fullsized":"2024-09-22T08:55:22.306782+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:19:30.880256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"263'26","reported_seq":110,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:37.292875+0000","last_change":"2024-09-22T08:29:26.069760+0000","last_active":"2024-09-22T08:53:37.292875+0000","last_peered":"2024-09-22T08:53:37.292875+0000","last_clean":"2024-09-22T08:53:37.292875+0000","last_became_active":"2024-09-22T08:29:26.069440+0000","last_became_peered":"2024-09-22T08:29:26.069440+0000","last_unstale":"2024-09-22T08:53:37.292875+0000","last_undegraded":"2024-09-22T08:53:37.292875+0000","last_fullsized":"2024-09-22T08:53:37.292875+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:48:41.597112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":134,"num_write":69,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:58.479676+0000","last_change":"2024-09-22T08:42:17.436175+0000","last_active":"2024-09-22T08:53:58.479676+0000","last_peered":"2024-09-22T08:53:58.479676+0000","last_clean":"2024-09-22T08:53:58.479676+0000","last_became_active":"2024-09-22T08:42:17.435825+0000","last_became_peered":"2024-09-22T08:42:17.435825+0000","last_unstale":"2024-09-22T08:53:58.479676+0000","last_undegraded":"2024-09-22T08:53:58.479676+0000","last_fullsized":"2024-09-22T08:53:58.479676+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:50:07.804836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"260'2","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:58.472161+0000","last_change":"2024-09-22T08:31:14.256513+0000","last_active":"2024-09-22T08:52:58.472161+0000","last_peered":"2024-09-22T08:52:58.472161+0000","last_clean":"2024-09-22T08:52:58.472161+0000","last_became_active":"2024-09-22T08:31:14.256218+0000","last_became_peered":"2024-09-22T08:31:14.256218+0000","last_unstale":"2024-09-22T08:52:58.472161+0000","last_undegraded":"2024-09-22T08:52:58.472161+0000","last_fullsized":"2024-09-22T08:52:58.472161+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:27:57.407928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:57.277949+0000","last_change":"2024-09-22T08:31:11.214383+0000","last_active":"2024-09-22T08:52:57.277949+0000","last_peered":"2024-09-22T08:52:57.277949+0000","last_clean":"2024-09-22T08:52:57.277949+0000","last_became_active":"2024-09-22T08:31:11.214111+0000","last_became_peered":"2024-09-22T08:31:11.214111+0000","last_unstale":"2024-09-22T08:52:57.277949+0000","last_undegraded":"2024-09-22T08:52:57.277949+0000","last_fullsized":"2024-09-22T08:52:57.277949+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:55:25.197395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"263'20","reported_seq":95,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:53.388471+0000","last_change":"2024-09-22T08:29:26.069573+0000","last_active":"2024-09-22T08:52:53.388471+0000","last_peered":"2024-09-22T08:52:53.388471+0000","last_clean":"2024-09-22T08:52:53.388471+0000","last_became_active":"2024-09-22T08:29:26.069293+0000","last_became_peered":"2024-09-22T08:29:26.069293+0000","last_unstale":"2024-09-22T08:52:53.388471+0000","last_undegraded":"2024-09-22T08:52:53.388471+0000","last_fullsized":"2024-09-22T08:52:53.388471+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:06:27.426634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":89,"num_write":52,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:57.268896+0000","last_change":"2024-09-22T08:42:17.429646+0000","last_active":"2024-09-22T08:51:57.268896+0000","last_peered":"2024-09-22T08:51:57.268896+0000","last_clean":"2024-09-22T08:51:57.268896+0000","last_became_active":"2024-09-22T08:42:17.429163+0000","last_became_peered":"2024-09-22T08:42:17.429163+0000","last_unstale":"2024-09-22T08:51:57.268896+0000","last_undegraded":"2024-09-22T08:51:57.268896+0000","last_fullsized":"2024-09-22T08:51:57.268896+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:52:58.326332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"263'2","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:37.292485+0000","last_change":"2024-09-22T08:31:14.259778+0000","last_active":"2024-09-22T08:54:37.292485+0000","last_peered":"2024-09-22T08:54:37.292485+0000","last_clean":"2024-09-22T08:54:37.292485+0000","last_became_active":"2024-09-22T08:31:14.259484+0000","last_became_peered":"2024-09-22T08:31:14.259484+0000","last_unstale":"2024-09-22T08:54:37.292485+0000","last_undegraded":"2024-09-22T08:54:37.292485+0000","last_fullsized":"2024-09-22T08:54:37.292485+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:10:58.591122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"263'6","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:33.399760+0000","last_change":"2024-09-22T08:31:11.203333+0000","last_active":"2024-09-22T08:54:33.399760+0000","last_peered":"2024-09-22T08:54:33.399760+0000","last_clean":"2024-09-22T08:54:33.399760+0000","last_became_active":"2024-09-22T08:31:11.203053+0000","last_became_peered":"2024-09-22T08:31:11.203053+0000","last_unstale":"2024-09-22T08:54:33.399760+0000","last_undegraded":"2024-09-22T08:54:33.399760+0000","last_fullsized":"2024-09-22T08:54:33.399760+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:29:11.633546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4146,"num_write":6,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"263'318","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:48.387936+0000","last_change":"2024-09-22T08:29:26.070758+0000","last_active":"2024-09-22T08:52:48.387936+0000","last_peered":"2024-09-22T08:52:48.387936+0000","last_clean":"2024-09-22T08:52:48.387936+0000","last_became_active":"2024-09-22T08:29:26.070475+0000","last_became_peered":"2024-09-22T08:29:26.070475+0000","last_unstale":"2024-09-22T08:52:48.387936+0000","last_undegraded":"2024-09-22T08:52:48.387936+0000","last_fullsized":"2024-09-22T08:52:48.387936+0000","mapping_epoch":252,"log_start":"263'300","ondisk_log_start":"263'300","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:21:22.076883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2975,"num_read_kb":3480,"num_write":654,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:57.268912+0000","last_change":"2024-09-22T08:42:17.431838+0000","last_active":"2024-09-22T08:51:57.268912+0000","last_peered":"2024-09-22T08:51:57.268912+0000","last_clean":"2024-09-22T08:51:57.268912+0000","last_became_active":"2024-09-22T08:42:17.431528+0000","last_became_peered":"2024-09-22T08:42:17.431528+0000","last_unstale":"2024-09-22T08:51:57.268912+0000","last_undegraded":"2024-09-22T08:51:57.268912+0000","last_fullsized":"2024-09-22T08:51:57.268912+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:29:19.259078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:17.271924+0000","last_change":"2024-09-22T08:31:14.256347+0000","last_active":"2024-09-22T08:52:17.271924+0000","last_peered":"2024-09-22T08:52:17.271924+0000","last_clean":"2024-09-22T08:52:17.271924+0000","last_became_active":"2024-09-22T08:31:14.256054+0000","last_became_peered":"2024-09-22T08:31:14.256054+0000","last_unstale":"2024-09-22T08:52:17.271924+0000","last_undegraded":"2024-09-22T08:52:17.271924+0000","last_fullsized":"2024-09-22T08:52:17.271924+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:02:08.137287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"263'8","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.323100+0000","last_change":"2024-09-22T08:31:11.213551+0000","last_active":"2024-09-22T08:56:16.323100+0000","last_peered":"2024-09-22T08:56:16.323100+0000","last_clean":"2024-09-22T08:56:16.323100+0000","last_became_active":"2024-09-22T08:31:11.212539+0000","last_became_peered":"2024-09-22T08:31:11.212539+0000","last_unstale":"2024-09-22T08:56:16.323100+0000","last_undegraded":"2024-09-22T08:56:16.323100+0000","last_fullsized":"2024-09-22T08:56:16.323100+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:38:43.370688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":18,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"263'51","reported_seq":176,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:47.088466+0000","last_change":"2024-09-22T08:29:26.070905+0000","last_active":"2024-09-22T08:53:47.088466+0000","last_peered":"2024-09-22T08:53:47.088466+0000","last_clean":"2024-09-22T08:53:47.088466+0000","last_became_active":"2024-09-22T08:29:26.070576+0000","last_became_peered":"2024-09-22T08:29:26.070576+0000","last_unstale":"2024-09-22T08:53:47.088466+0000","last_undegraded":"2024-09-22T08:53:47.088466+0000","last_fullsized":"2024-09-22T08:53:47.088466+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:55:10.934768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":389,"num_read_kb":252,"num_write":129,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:02.409119+0000","last_change":"2024-09-22T08:42:17.426058+0000","last_active":"2024-09-22T08:54:02.409119+0000","last_peered":"2024-09-22T08:54:02.409119+0000","last_clean":"2024-09-22T08:54:02.409119+0000","last_became_active":"2024-09-22T08:42:17.425759+0000","last_became_peered":"2024-09-22T08:42:17.425759+0000","last_unstale":"2024-09-22T08:54:02.409119+0000","last_undegraded":"2024-09-22T08:54:02.409119+0000","last_fullsized":"2024-09-22T08:54:02.409119+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:58:13.952750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"263'2","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:37.300796+0000","last_change":"2024-09-22T08:31:14.258185+0000","last_active":"2024-09-22T08:54:37.300796+0000","last_peered":"2024-09-22T08:54:37.300796+0000","last_clean":"2024-09-22T08:54:37.300796+0000","last_became_active":"2024-09-22T08:31:14.257900+0000","last_became_peered":"2024-09-22T08:31:14.257900+0000","last_unstale":"2024-09-22T08:54:37.300796+0000","last_undegraded":"2024-09-22T08:54:37.300796+0000","last_fullsized":"2024-09-22T08:54:37.300796+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:24:42.015943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":118,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"263'6","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:33.399798+0000","last_change":"2024-09-22T08:31:11.205171+0000","last_active":"2024-09-22T08:54:33.399798+0000","last_peered":"2024-09-22T08:54:33.399798+0000","last_clean":"2024-09-22T08:54:33.399798+0000","last_became_active":"2024-09-22T08:31:11.204846+0000","last_became_peered":"2024-09-22T08:31:11.204846+0000","last_unstale":"2024-09-22T08:54:33.399798+0000","last_undegraded":"2024-09-22T08:54:33.399798+0000","last_fullsized":"2024-09-22T08:54:33.399798+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:09:45.501944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":6146,"num_write":6,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"263'48","reported_seq":173,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:50.979504+0000","last_change":"2024-09-22T08:29:26.064230+0000","last_active":"2024-09-22T08:53:50.979504+0000","last_peered":"2024-09-22T08:53:50.979504+0000","last_clean":"2024-09-22T08:53:50.979504+0000","last_became_active":"2024-09-22T08:29:26.063914+0000","last_became_peered":"2024-09-22T08:29:26.063914+0000","last_unstale":"2024-09-22T08:53:50.979504+0000","last_undegraded":"2024-09-22T08:53:50.979504+0000","last_fullsized":"2024-09-22T08:53:50.979504+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:49.440925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":381,"num_read_kb":265,"num_write":119,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:57.268871+0000","last_change":"2024-09-22T08:42:17.431413+0000","last_active":"2024-09-22T08:51:57.268871+0000","last_peered":"2024-09-22T08:51:57.268871+0000","last_clean":"2024-09-22T08:51:57.268871+0000","last_became_active":"2024-09-22T08:42:17.429964+0000","last_became_peered":"2024-09-22T08:42:17.429964+0000","last_unstale":"2024-09-22T08:51:57.268871+0000","last_undegraded":"2024-09-22T08:51:57.268871+0000","last_fullsized":"2024-09-22T08:51:57.268871+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:20:04.762853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"260'4","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:18.383736+0000","last_change":"2024-09-22T08:31:14.260215+0000","last_active":"2024-09-22T08:52:18.383736+0000","last_peered":"2024-09-22T08:52:18.383736+0000","last_clean":"2024-09-22T08:52:18.383736+0000","last_became_active":"2024-09-22T08:31:14.259875+0000","last_became_peered":"2024-09-22T08:31:14.259875+0000","last_unstale":"2024-09-22T08:52:18.383736+0000","last_undegraded":"2024-09-22T08:52:18.383736+0000","last_fullsized":"2024-09-22T08:52:18.383736+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:27:56.369023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:13.382799+0000","last_change":"2024-09-22T08:31:11.210358+0000","last_active":"2024-09-22T08:52:13.382799+0000","last_peered":"2024-09-22T08:52:13.382799+0000","last_clean":"2024-09-22T08:52:13.382799+0000","last_became_active":"2024-09-22T08:31:11.210054+0000","last_became_peered":"2024-09-22T08:31:11.210054+0000","last_unstale":"2024-09-22T08:52:13.382799+0000","last_undegraded":"2024-09-22T08:52:13.382799+0000","last_fullsized":"2024-09-22T08:52:13.382799+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:51:41.210904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"263'31","reported_seq":129,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:47.285810+0000","last_change":"2024-09-22T08:29:26.070816+0000","last_active":"2024-09-22T08:52:47.285810+0000","last_peered":"2024-09-22T08:52:47.285810+0000","last_clean":"2024-09-22T08:52:47.285810+0000","last_became_active":"2024-09-22T08:29:26.070492+0000","last_became_peered":"2024-09-22T08:29:26.070492+0000","last_unstale":"2024-09-22T08:52:47.285810+0000","last_undegraded":"2024-09-22T08:52:47.285810+0000","last_fullsized":"2024-09-22T08:52:47.285810+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:33:45.551687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":169,"num_write":83,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:12.279928+0000","last_change":"2024-09-22T08:42:17.433621+0000","last_active":"2024-09-22T08:53:12.279928+0000","last_peered":"2024-09-22T08:53:12.279928+0000","last_clean":"2024-09-22T08:53:12.279928+0000","last_became_active":"2024-09-22T08:42:17.433193+0000","last_became_peered":"2024-09-22T08:42:17.433193+0000","last_unstale":"2024-09-22T08:53:12.279928+0000","last_undegraded":"2024-09-22T08:53:12.279928+0000","last_fullsized":"2024-09-22T08:53:12.279928+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:13.472859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:47.294076+0000","last_change":"2024-09-22T08:31:14.255077+0000","last_active":"2024-09-22T08:53:47.294076+0000","last_peered":"2024-09-22T08:53:47.294076+0000","last_clean":"2024-09-22T08:53:47.294076+0000","last_became_active":"2024-09-22T08:31:14.254710+0000","last_became_peered":"2024-09-22T08:31:14.254710+0000","last_unstale":"2024-09-22T08:53:47.294076+0000","last_undegraded":"2024-09-22T08:53:47.294076+0000","last_fullsized":"2024-09-22T08:53:47.294076+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:21:50.613490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:41.270510+0000","last_change":"2024-09-22T08:31:11.203734+0000","last_active":"2024-09-22T08:53:41.270510+0000","last_peered":"2024-09-22T08:53:41.270510+0000","last_clean":"2024-09-22T08:53:41.270510+0000","last_became_active":"2024-09-22T08:31:11.203413+0000","last_became_peered":"2024-09-22T08:31:11.203413+0000","last_unstale":"2024-09-22T08:53:41.270510+0000","last_undegraded":"2024-09-22T08:53:41.270510+0000","last_fullsized":"2024-09-22T08:53:41.270510+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:44:09.630276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:07.280107+0000","last_change":"2024-09-22T08:29:26.072040+0000","last_active":"2024-09-22T08:52:07.280107+0000","last_peered":"2024-09-22T08:52:07.280107+0000","last_clean":"2024-09-22T08:52:07.280107+0000","last_became_active":"2024-09-22T08:29:26.071742+0000","last_became_peered":"2024-09-22T08:29:26.071742+0000","last_unstale":"2024-09-22T08:52:07.280107+0000","last_undegraded":"2024-09-22T08:52:07.280107+0000","last_fullsized":"2024-09-22T08:52:07.280107+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:02:35.173782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:33.393176+0000","last_change":"2024-09-22T08:42:17.433663+0000","last_active":"2024-09-22T08:53:33.393176+0000","last_peered":"2024-09-22T08:53:33.393176+0000","last_clean":"2024-09-22T08:53:33.393176+0000","last_became_active":"2024-09-22T08:42:17.433346+0000","last_became_peered":"2024-09-22T08:42:17.433346+0000","last_unstale":"2024-09-22T08:53:33.393176+0000","last_undegraded":"2024-09-22T08:53:33.393176+0000","last_fullsized":"2024-09-22T08:53:33.393176+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:42:29.816828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"260'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:47.294055+0000","last_change":"2024-09-22T08:31:14.256186+0000","last_active":"2024-09-22T08:53:47.294055+0000","last_peered":"2024-09-22T08:53:47.294055+0000","last_clean":"2024-09-22T08:53:47.294055+0000","last_became_active":"2024-09-22T08:31:14.255243+0000","last_became_peered":"2024-09-22T08:31:14.255243+0000","last_unstale":"2024-09-22T08:53:47.294055+0000","last_undegraded":"2024-09-22T08:53:47.294055+0000","last_fullsized":"2024-09-22T08:53:47.294055+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:14:49.285058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"263'6","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.322059+0000","last_change":"2024-09-22T08:31:11.210583+0000","last_active":"2024-09-22T08:56:16.322059+0000","last_peered":"2024-09-22T08:56:16.322059+0000","last_clean":"2024-09-22T08:56:16.322059+0000","last_became_active":"2024-09-22T08:31:11.210266+0000","last_became_peered":"2024-09-22T08:31:11.210266+0000","last_unstale":"2024-09-22T08:56:16.322059+0000","last_undegraded":"2024-09-22T08:56:16.322059+0000","last_fullsized":"2024-09-22T08:56:16.322059+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:55:04.094565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":13312,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"263'39","reported_seq":148,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:56.069487+0000","last_change":"2024-09-22T08:29:26.076488+0000","last_active":"2024-09-22T08:52:56.069487+0000","last_peered":"2024-09-22T08:52:56.069487+0000","last_clean":"2024-09-22T08:52:56.069487+0000","last_became_active":"2024-09-22T08:29:26.076175+0000","last_became_peered":"2024-09-22T08:29:26.076175+0000","last_unstale":"2024-09-22T08:52:56.069487+0000","last_undegraded":"2024-09-22T08:52:56.069487+0000","last_fullsized":"2024-09-22T08:52:56.069487+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:10:01.915865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":317,"num_read_kb":219,"num_write":102,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:08.390223+0000","last_change":"2024-09-22T08:42:17.435167+0000","last_active":"2024-09-22T08:53:08.390223+0000","last_peered":"2024-09-22T08:53:08.390223+0000","last_clean":"2024-09-22T08:53:08.390223+0000","last_became_active":"2024-09-22T08:42:17.434909+0000","last_became_peered":"2024-09-22T08:42:17.434909+0000","last_unstale":"2024-09-22T08:53:08.390223+0000","last_undegraded":"2024-09-22T08:53:08.390223+0000","last_fullsized":"2024-09-22T08:53:08.390223+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:22.417079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"263'4","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:07.313078+0000","last_change":"2024-09-22T08:31:14.252478+0000","last_active":"2024-09-22T08:56:07.313078+0000","last_peered":"2024-09-22T08:56:07.313078+0000","last_clean":"2024-09-22T08:56:07.313078+0000","last_became_active":"2024-09-22T08:31:14.252184+0000","last_became_peered":"2024-09-22T08:31:14.252184+0000","last_unstale":"2024-09-22T08:56:07.313078+0000","last_undegraded":"2024-09-22T08:56:07.313078+0000","last_fullsized":"2024-09-22T08:56:07.313078+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:09.321417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":4,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"263'2","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:57.311651+0000","last_change":"2024-09-22T08:31:11.218103+0000","last_active":"2024-09-22T08:55:57.311651+0000","last_peered":"2024-09-22T08:55:57.311651+0000","last_clean":"2024-09-22T08:55:57.311651+0000","last_became_active":"2024-09-22T08:31:11.217115+0000","last_became_peered":"2024-09-22T08:31:11.217115+0000","last_unstale":"2024-09-22T08:55:57.311651+0000","last_undegraded":"2024-09-22T08:55:57.311651+0000","last_fullsized":"2024-09-22T08:55:57.311651+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:15:42.708378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"263'57","reported_seq":192,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:58.380936+0000","last_change":"2024-09-22T08:29:26.076353+0000","last_active":"2024-09-22T08:51:58.380936+0000","last_peered":"2024-09-22T08:51:58.380936+0000","last_clean":"2024-09-22T08:51:58.380936+0000","last_became_active":"2024-09-22T08:29:26.076048+0000","last_became_peered":"2024-09-22T08:29:26.076048+0000","last_unstale":"2024-09-22T08:51:58.380936+0000","last_undegraded":"2024-09-22T08:51:58.380936+0000","last_fullsized":"2024-09-22T08:51:58.380936+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:12:53.422787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":427,"num_read_kb":265,"num_write":151,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:08.389849+0000","last_change":"2024-09-22T08:42:17.431316+0000","last_active":"2024-09-22T08:53:08.389849+0000","last_peered":"2024-09-22T08:53:08.389849+0000","last_clean":"2024-09-22T08:53:08.389849+0000","last_became_active":"2024-09-22T08:42:17.430974+0000","last_became_peered":"2024-09-22T08:42:17.430974+0000","last_unstale":"2024-09-22T08:53:08.389849+0000","last_undegraded":"2024-09-22T08:53:08.389849+0000","last_fullsized":"2024-09-22T08:53:08.389849+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:40:42.175541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"260'3","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:47.284984+0000","last_change":"2024-09-22T08:31:14.258289+0000","last_active":"2024-09-22T08:53:47.284984+0000","last_peered":"2024-09-22T08:53:47.284984+0000","last_clean":"2024-09-22T08:53:47.284984+0000","last_became_active":"2024-09-22T08:31:14.257952+0000","last_became_peered":"2024-09-22T08:31:14.257952+0000","last_unstale":"2024-09-22T08:53:47.284984+0000","last_undegraded":"2024-09-22T08:53:47.284984+0000","last_fullsized":"2024-09-22T08:53:47.284984+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:26:33.079615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:47.294104+0000","last_change":"2024-09-22T08:31:11.214070+0000","last_active":"2024-09-22T08:53:47.294104+0000","last_peered":"2024-09-22T08:53:47.294104+0000","last_clean":"2024-09-22T08:53:47.294104+0000","last_became_active":"2024-09-22T08:31:11.213273+0000","last_became_peered":"2024-09-22T08:31:11.213273+0000","last_unstale":"2024-09-22T08:53:47.294104+0000","last_undegraded":"2024-09-22T08:53:47.294104+0000","last_fullsized":"2024-09-22T08:53:47.294104+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:48:59.089464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"263'16","reported_seq":83,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:50.237668+0000","last_change":"2024-09-22T08:29:26.074703+0000","last_active":"2024-09-22T08:53:50.237668+0000","last_peered":"2024-09-22T08:53:50.237668+0000","last_clean":"2024-09-22T08:53:50.237668+0000","last_became_active":"2024-09-22T08:29:26.074205+0000","last_became_peered":"2024-09-22T08:29:26.074205+0000","last_unstale":"2024-09-22T08:53:50.237668+0000","last_undegraded":"2024-09-22T08:53:50.237668+0000","last_fullsized":"2024-09-22T08:53:50.237668+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:39:29.451981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":71,"num_write":43,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:32.283041+0000","last_change":"2024-09-22T08:42:17.430839+0000","last_active":"2024-09-22T08:53:32.283041+0000","last_peered":"2024-09-22T08:53:32.283041+0000","last_clean":"2024-09-22T08:53:32.283041+0000","last_became_active":"2024-09-22T08:42:17.429927+0000","last_became_peered":"2024-09-22T08:42:17.429927+0000","last_unstale":"2024-09-22T08:53:32.283041+0000","last_undegraded":"2024-09-22T08:53:32.283041+0000","last_fullsized":"2024-09-22T08:53:32.283041+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:28:06.806210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"263'6","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:08.404715+0000","last_change":"2024-09-22T08:31:14.253906+0000","last_active":"2024-09-22T08:55:08.404715+0000","last_peered":"2024-09-22T08:55:08.404715+0000","last_clean":"2024-09-22T08:55:08.404715+0000","last_became_active":"2024-09-22T08:31:14.253610+0000","last_became_peered":"2024-09-22T08:31:14.253610+0000","last_unstale":"2024-09-22T08:55:08.404715+0000","last_undegraded":"2024-09-22T08:55:08.404715+0000","last_fullsized":"2024-09-22T08:55:08.404715+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:13:39.366489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13314,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"263'4","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.380507+0000","last_change":"2024-09-22T08:31:11.217832+0000","last_active":"2024-09-22T08:56:16.380507+0000","last_peered":"2024-09-22T08:56:16.380507+0000","last_clean":"2024-09-22T08:56:16.380507+0000","last_became_active":"2024-09-22T08:31:11.217553+0000","last_became_peered":"2024-09-22T08:31:11.217553+0000","last_unstale":"2024-09-22T08:56:16.380507+0000","last_undegraded":"2024-09-22T08:56:16.380507+0000","last_fullsized":"2024-09-22T08:56:16.380507+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:22:26.456715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"263'36","reported_seq":134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:57.268762+0000","last_change":"2024-09-22T08:29:26.070957+0000","last_active":"2024-09-22T08:51:57.268762+0000","last_peered":"2024-09-22T08:51:57.268762+0000","last_clean":"2024-09-22T08:51:57.268762+0000","last_became_active":"2024-09-22T08:29:26.070671+0000","last_became_peered":"2024-09-22T08:29:26.070671+0000","last_unstale":"2024-09-22T08:51:57.268762+0000","last_undegraded":"2024-09-22T08:51:57.268762+0000","last_fullsized":"2024-09-22T08:51:57.268762+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:28:38.453942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":255,"num_read_kb":155,"num_write":90,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:36.270019+0000","last_change":"2024-09-22T08:42:17.433684+0000","last_active":"2024-09-22T08:53:36.270019+0000","last_peered":"2024-09-22T08:53:36.270019+0000","last_clean":"2024-09-22T08:53:36.270019+0000","last_became_active":"2024-09-22T08:42:17.433331+0000","last_became_peered":"2024-09-22T08:42:17.433331+0000","last_unstale":"2024-09-22T08:53:36.270019+0000","last_undegraded":"2024-09-22T08:53:36.270019+0000","last_fullsized":"2024-09-22T08:53:36.270019+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:19:35.698543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"263'4","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:06.280498+0000","last_change":"2024-09-22T08:31:14.253520+0000","last_active":"2024-09-22T08:55:06.280498+0000","last_peered":"2024-09-22T08:55:06.280498+0000","last_clean":"2024-09-22T08:55:06.280498+0000","last_became_active":"2024-09-22T08:31:14.253118+0000","last_became_peered":"2024-09-22T08:31:14.253118+0000","last_unstale":"2024-09-22T08:55:06.280498+0000","last_undegraded":"2024-09-22T08:55:06.280498+0000","last_fullsized":"2024-09-22T08:55:06.280498+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:35:19.513521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"263'9","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:02.296482+0000","last_change":"2024-09-22T08:31:11.212852+0000","last_active":"2024-09-22T08:55:02.296482+0000","last_peered":"2024-09-22T08:55:02.296482+0000","last_clean":"2024-09-22T08:55:02.296482+0000","last_became_active":"2024-09-22T08:31:11.211939+0000","last_became_peered":"2024-09-22T08:31:11.211939+0000","last_unstale":"2024-09-22T08:55:02.296482+0000","last_undegraded":"2024-09-22T08:55:02.296482+0000","last_fullsized":"2024-09-22T08:55:02.296482+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:24:50.321996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":24578,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"263'43","reported_seq":155,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:21.268004+0000","last_change":"2024-09-22T08:29:26.069502+0000","last_active":"2024-09-22T08:53:21.268004+0000","last_peered":"2024-09-22T08:53:21.268004+0000","last_clean":"2024-09-22T08:53:21.268004+0000","last_became_active":"2024-09-22T08:29:26.069202+0000","last_became_peered":"2024-09-22T08:29:26.069202+0000","last_unstale":"2024-09-22T08:53:21.268004+0000","last_undegraded":"2024-09-22T08:53:21.268004+0000","last_fullsized":"2024-09-22T08:53:21.268004+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:00:21.857731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":316,"num_read_kb":207,"num_write":121,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:33.476466+0000","last_change":"2024-09-22T08:42:17.436971+0000","last_active":"2024-09-22T08:53:33.476466+0000","last_peered":"2024-09-22T08:53:33.476466+0000","last_clean":"2024-09-22T08:53:33.476466+0000","last_became_active":"2024-09-22T08:42:17.436036+0000","last_became_peered":"2024-09-22T08:42:17.436036+0000","last_unstale":"2024-09-22T08:53:33.476466+0000","last_undegraded":"2024-09-22T08:53:33.476466+0000","last_fullsized":"2024-09-22T08:53:33.476466+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:15:23.383676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"260'6","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:47.284803+0000","last_change":"2024-09-22T08:31:14.260840+0000","last_active":"2024-09-22T08:53:47.284803+0000","last_peered":"2024-09-22T08:53:47.284803+0000","last_clean":"2024-09-22T08:53:47.284803+0000","last_became_active":"2024-09-22T08:31:14.260111+0000","last_became_peered":"2024-09-22T08:31:14.260111+0000","last_unstale":"2024-09-22T08:53:47.284803+0000","last_undegraded":"2024-09-22T08:53:47.284803+0000","last_fullsized":"2024-09-22T08:53:47.284803+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:54:00.288860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"263'5","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.322290+0000","last_change":"2024-09-22T08:31:11.213758+0000","last_active":"2024-09-22T08:56:16.322290+0000","last_peered":"2024-09-22T08:56:16.322290+0000","last_clean":"2024-09-22T08:56:16.322290+0000","last_became_active":"2024-09-22T08:31:11.213121+0000","last_became_peered":"2024-09-22T08:31:11.213121+0000","last_unstale":"2024-09-22T08:56:16.322290+0000","last_undegraded":"2024-09-22T08:56:16.322290+0000","last_fullsized":"2024-09-22T08:56:16.322290+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:13:15.074520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"263'24","reported_seq":106,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:17.280800+0000","last_change":"2024-09-22T08:29:26.068711+0000","last_active":"2024-09-22T08:53:17.280800+0000","last_peered":"2024-09-22T08:53:17.280800+0000","last_clean":"2024-09-22T08:53:17.280800+0000","last_became_active":"2024-09-22T08:29:26.068397+0000","last_became_peered":"2024-09-22T08:29:26.068397+0000","last_unstale":"2024-09-22T08:53:17.280800+0000","last_undegraded":"2024-09-22T08:53:17.280800+0000","last_fullsized":"2024-09-22T08:53:17.280800+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:31:42.395480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":108,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:32.292011+0000","last_change":"2024-09-22T08:42:17.431775+0000","last_active":"2024-09-22T08:53:32.292011+0000","last_peered":"2024-09-22T08:53:32.292011+0000","last_clean":"2024-09-22T08:53:32.292011+0000","last_became_active":"2024-09-22T08:42:17.431476+0000","last_became_peered":"2024-09-22T08:42:17.431476+0000","last_unstale":"2024-09-22T08:53:32.292011+0000","last_undegraded":"2024-09-22T08:53:32.292011+0000","last_fullsized":"2024-09-22T08:53:32.292011+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:20.126935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"263'2","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:08.488263+0000","last_change":"2024-09-22T08:31:14.257816+0000","last_active":"2024-09-22T08:55:08.488263+0000","last_peered":"2024-09-22T08:55:08.488263+0000","last_clean":"2024-09-22T08:55:08.488263+0000","last_became_active":"2024-09-22T08:31:14.257508+0000","last_became_peered":"2024-09-22T08:31:14.257508+0000","last_unstale":"2024-09-22T08:55:08.488263+0000","last_undegraded":"2024-09-22T08:55:08.488263+0000","last_fullsized":"2024-09-22T08:55:08.488263+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:30.899995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:43.394740+0000","last_change":"2024-09-22T08:31:11.215332+0000","last_active":"2024-09-22T08:53:43.394740+0000","last_peered":"2024-09-22T08:53:43.394740+0000","last_clean":"2024-09-22T08:53:43.394740+0000","last_became_active":"2024-09-22T08:31:11.214953+0000","last_became_peered":"2024-09-22T08:31:11.214953+0000","last_unstale":"2024-09-22T08:53:43.394740+0000","last_undegraded":"2024-09-22T08:53:43.394740+0000","last_fullsized":"2024-09-22T08:53:43.394740+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:54:54.175587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"263'16","reported_seq":88,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:18.474308+0000","last_change":"2024-09-22T08:29:26.072747+0000","last_active":"2024-09-22T08:53:18.474308+0000","last_peered":"2024-09-22T08:53:18.474308+0000","last_clean":"2024-09-22T08:53:18.474308+0000","last_became_active":"2024-09-22T08:29:26.072473+0000","last_became_peered":"2024-09-22T08:29:26.072473+0000","last_unstale":"2024-09-22T08:53:18.474308+0000","last_undegraded":"2024-09-22T08:53:18.474308+0000","last_fullsized":"2024-09-22T08:53:18.474308+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:22.926382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":83,"num_write":41,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:43.469960+0000","last_change":"2024-09-22T08:42:17.431917+0000","last_active":"2024-09-22T08:52:43.469960+0000","last_peered":"2024-09-22T08:52:43.469960+0000","last_clean":"2024-09-22T08:52:43.469960+0000","last_became_active":"2024-09-22T08:42:17.431637+0000","last_became_peered":"2024-09-22T08:42:17.431637+0000","last_unstale":"2024-09-22T08:52:43.469960+0000","last_undegraded":"2024-09-22T08:52:43.469960+0000","last_fullsized":"2024-09-22T08:52:43.469960+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:33:12.811194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"263'4","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.543285+0000","last_change":"2024-09-22T08:31:14.261671+0000","last_active":"2024-09-22T08:56:16.543285+0000","last_peered":"2024-09-22T08:56:16.543285+0000","last_clean":"2024-09-22T08:56:16.543285+0000","last_became_active":"2024-09-22T08:31:14.261352+0000","last_became_peered":"2024-09-22T08:31:14.261352+0000","last_unstale":"2024-09-22T08:56:16.543285+0000","last_undegraded":"2024-09-22T08:56:16.543285+0000","last_fullsized":"2024-09-22T08:56:16.543285+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:19:15.325599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"263'6","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:13.412983+0000","last_change":"2024-09-22T08:31:11.216385+0000","last_active":"2024-09-22T08:56:13.412983+0000","last_peered":"2024-09-22T08:56:13.412983+0000","last_clean":"2024-09-22T08:56:13.412983+0000","last_became_active":"2024-09-22T08:31:11.216081+0000","last_became_peered":"2024-09-22T08:31:11.216081+0000","last_unstale":"2024-09-22T08:56:13.412983+0000","last_undegraded":"2024-09-22T08:56:13.412983+0000","last_fullsized":"2024-09-22T08:56:13.412983+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:17:40.729275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":6,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"253'4","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:17.402881+0000","last_change":"2024-09-22T08:29:26.073082+0000","last_active":"2024-09-22T08:53:17.402881+0000","last_peered":"2024-09-22T08:53:17.402881+0000","last_clean":"2024-09-22T08:53:17.402881+0000","last_became_active":"2024-09-22T08:29:26.072681+0000","last_became_peered":"2024-09-22T08:29:26.072681+0000","last_unstale":"2024-09-22T08:53:17.402881+0000","last_undegraded":"2024-09-22T08:53:17.402881+0000","last_fullsized":"2024-09-22T08:53:17.402881+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:10:40.106076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:43.469980+0000","last_change":"2024-09-22T08:42:17.432516+0000","last_active":"2024-09-22T08:52:43.469980+0000","last_peered":"2024-09-22T08:52:43.469980+0000","last_clean":"2024-09-22T08:52:43.469980+0000","last_became_active":"2024-09-22T08:42:17.430084+0000","last_became_peered":"2024-09-22T08:42:17.430084+0000","last_unstale":"2024-09-22T08:52:43.469980+0000","last_undegraded":"2024-09-22T08:52:43.469980+0000","last_fullsized":"2024-09-22T08:52:43.469980+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:34:54.878963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"260'2","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:12.288667+0000","last_change":"2024-09-22T08:31:14.259915+0000","last_active":"2024-09-22T08:54:12.288667+0000","last_peered":"2024-09-22T08:54:12.288667+0000","last_clean":"2024-09-22T08:54:12.288667+0000","last_became_active":"2024-09-22T08:31:14.259624+0000","last_became_peered":"2024-09-22T08:31:14.259624+0000","last_unstale":"2024-09-22T08:54:12.288667+0000","last_undegraded":"2024-09-22T08:54:12.288667+0000","last_fullsized":"2024-09-22T08:54:12.288667+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:44:39.512910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"263'5","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.510695+0000","last_change":"2024-09-22T08:31:11.214838+0000","last_active":"2024-09-22T08:56:16.510695+0000","last_peered":"2024-09-22T08:56:16.510695+0000","last_clean":"2024-09-22T08:56:16.510695+0000","last_became_active":"2024-09-22T08:31:11.214279+0000","last_became_peered":"2024-09-22T08:31:11.214279+0000","last_unstale":"2024-09-22T08:56:16.510695+0000","last_undegraded":"2024-09-22T08:56:16.510695+0000","last_fullsized":"2024-09-22T08:56:16.510695+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:50:49.253194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"263'2","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:18.391441+0000","last_change":"2024-09-22T08:29:26.075341+0000","last_active":"2024-09-22T08:53:18.391441+0000","last_peered":"2024-09-22T08:53:18.391441+0000","last_clean":"2024-09-22T08:53:18.391441+0000","last_became_active":"2024-09-22T08:29:26.074971+0000","last_became_peered":"2024-09-22T08:29:26.074971+0000","last_unstale":"2024-09-22T08:53:18.391441+0000","last_undegraded":"2024-09-22T08:53:18.391441+0000","last_fullsized":"2024-09-22T08:53:18.391441+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:38:15.699643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:22.290069+0000","last_change":"2024-09-22T08:42:17.433389+0000","last_active":"2024-09-22T08:54:22.290069+0000","last_peered":"2024-09-22T08:54:22.290069+0000","last_clean":"2024-09-22T08:54:22.290069+0000","last_became_active":"2024-09-22T08:42:17.433090+0000","last_became_peered":"2024-09-22T08:42:17.433090+0000","last_unstale":"2024-09-22T08:54:22.290069+0000","last_undegraded":"2024-09-22T08:54:22.290069+0000","last_fullsized":"2024-09-22T08:54:22.290069+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:05:15.147705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"260'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:53.471440+0000","last_change":"2024-09-22T08:31:14.257105+0000","last_active":"2024-09-22T08:52:53.471440+0000","last_peered":"2024-09-22T08:52:53.471440+0000","last_clean":"2024-09-22T08:52:53.471440+0000","last_became_active":"2024-09-22T08:31:14.256835+0000","last_became_peered":"2024-09-22T08:31:14.256835+0000","last_unstale":"2024-09-22T08:52:53.471440+0000","last_undegraded":"2024-09-22T08:52:53.471440+0000","last_fullsized":"2024-09-22T08:52:53.471440+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:01:16.187889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"263'5","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.321901+0000","last_change":"2024-09-22T08:31:11.212839+0000","last_active":"2024-09-22T08:56:16.321901+0000","last_peered":"2024-09-22T08:56:16.321901+0000","last_clean":"2024-09-22T08:56:16.321901+0000","last_became_active":"2024-09-22T08:31:11.212487+0000","last_became_peered":"2024-09-22T08:31:11.212487+0000","last_unstale":"2024-09-22T08:56:16.321901+0000","last_undegraded":"2024-09-22T08:56:16.321901+0000","last_fullsized":"2024-09-22T08:56:16.321901+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:30:25.357785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"263'131","reported_seq":431,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:50.453613+0000","last_change":"2024-09-22T08:29:26.067437+0000","last_active":"2024-09-22T08:53:50.453613+0000","last_peered":"2024-09-22T08:53:50.453613+0000","last_clean":"2024-09-22T08:53:50.453613+0000","last_became_active":"2024-09-22T08:29:26.067149+0000","last_became_peered":"2024-09-22T08:29:26.067149+0000","last_unstale":"2024-09-22T08:53:50.453613+0000","last_undegraded":"2024-09-22T08:53:50.453613+0000","last_fullsized":"2024-09-22T08:53:50.453613+0000","mapping_epoch":252,"log_start":"260'100","ondisk_log_start":"260'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:08:58.265926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1238,"num_read_kb":970,"num_write":283,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:43.387307+0000","last_change":"2024-09-22T08:42:17.435234+0000","last_active":"2024-09-22T08:52:43.387307+0000","last_peered":"2024-09-22T08:52:43.387307+0000","last_clean":"2024-09-22T08:52:43.387307+0000","last_became_active":"2024-09-22T08:42:17.434424+0000","last_became_peered":"2024-09-22T08:42:17.434424+0000","last_unstale":"2024-09-22T08:52:43.387307+0000","last_undegraded":"2024-09-22T08:52:43.387307+0000","last_fullsized":"2024-09-22T08:52:43.387307+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:58:01.260992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"260'9","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:58.389082+0000","last_change":"2024-09-22T08:31:14.255605+0000","last_active":"2024-09-22T08:52:58.389082+0000","last_peered":"2024-09-22T08:52:58.389082+0000","last_clean":"2024-09-22T08:52:58.389082+0000","last_became_active":"2024-09-22T08:31:14.255160+0000","last_became_peered":"2024-09-22T08:31:14.255160+0000","last_unstale":"2024-09-22T08:52:58.389082+0000","last_undegraded":"2024-09-22T08:52:58.389082+0000","last_fullsized":"2024-09-22T08:52:58.389082+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:32:19.999119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":23554,"num_write":14,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:53.388519+0000","last_change":"2024-09-22T08:31:11.216563+0000","last_active":"2024-09-22T08:52:53.388519+0000","last_peered":"2024-09-22T08:52:53.388519+0000","last_clean":"2024-09-22T08:52:53.388519+0000","last_became_active":"2024-09-22T08:31:11.216271+0000","last_became_peered":"2024-09-22T08:31:11.216271+0000","last_unstale":"2024-09-22T08:52:53.388519+0000","last_undegraded":"2024-09-22T08:52:53.388519+0000","last_fullsized":"2024-09-22T08:52:53.388519+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:55:11.448805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"263'19","reported_seq":97,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:22.282291+0000","last_change":"2024-09-22T08:29:26.070044+0000","last_active":"2024-09-22T08:52:22.282291+0000","last_peered":"2024-09-22T08:52:22.282291+0000","last_clean":"2024-09-22T08:52:22.282291+0000","last_became_active":"2024-09-22T08:29:26.069730+0000","last_became_peered":"2024-09-22T08:29:26.069730+0000","last_unstale":"2024-09-22T08:52:22.282291+0000","last_undegraded":"2024-09-22T08:52:22.282291+0000","last_fullsized":"2024-09-22T08:52:22.282291+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:21:35.672741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":95,"num_write":48,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:07.288626+0000","last_change":"2024-09-22T08:42:17.419131+0000","last_active":"2024-09-22T08:53:07.288626+0000","last_peered":"2024-09-22T08:53:07.288626+0000","last_clean":"2024-09-22T08:53:07.288626+0000","last_became_active":"2024-09-22T08:42:17.418864+0000","last_became_peered":"2024-09-22T08:42:17.418864+0000","last_unstale":"2024-09-22T08:53:07.288626+0000","last_undegraded":"2024-09-22T08:53:07.288626+0000","last_fullsized":"2024-09-22T08:53:07.288626+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:05:15.592372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"263'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.434270+0000","last_change":"2024-09-22T08:31:14.259787+0000","last_active":"2024-09-22T08:56:16.434270+0000","last_peered":"2024-09-22T08:56:16.434270+0000","last_clean":"2024-09-22T08:56:16.434270+0000","last_became_active":"2024-09-22T08:31:14.259485+0000","last_became_peered":"2024-09-22T08:31:14.259485+0000","last_unstale":"2024-09-22T08:56:16.434270+0000","last_undegraded":"2024-09-22T08:56:16.434270+0000","last_fullsized":"2024-09-22T08:56:16.434270+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:38:49.843585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"260'5","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:16.267265+0000","last_change":"2024-09-22T08:31:11.211139+0000","last_active":"2024-09-22T08:53:16.267265+0000","last_peered":"2024-09-22T08:53:16.267265+0000","last_clean":"2024-09-22T08:53:16.267265+0000","last_became_active":"2024-09-22T08:31:11.210835+0000","last_became_peered":"2024-09-22T08:31:11.210835+0000","last_unstale":"2024-09-22T08:53:16.267265+0000","last_undegraded":"2024-09-22T08:53:16.267265+0000","last_fullsized":"2024-09-22T08:53:16.267265+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:48:20.118083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"263'36","reported_seq":145,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:21.260531+0000","last_change":"2024-09-22T08:29:26.068377+0000","last_active":"2024-09-22T08:52:21.260531+0000","last_peered":"2024-09-22T08:52:21.260531+0000","last_clean":"2024-09-22T08:52:21.260531+0000","last_became_active":"2024-09-22T08:29:26.068105+0000","last_became_peered":"2024-09-22T08:29:26.068105+0000","last_unstale":"2024-09-22T08:52:21.260531+0000","last_undegraded":"2024-09-22T08:52:21.260531+0000","last_fullsized":"2024-09-22T08:52:21.260531+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:08:26.567273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":308,"num_read_kb":184,"num_write":90,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:07.401463+0000","last_change":"2024-09-22T08:42:17.435288+0000","last_active":"2024-09-22T08:53:07.401463+0000","last_peered":"2024-09-22T08:53:07.401463+0000","last_clean":"2024-09-22T08:53:07.401463+0000","last_became_active":"2024-09-22T08:42:17.434953+0000","last_became_peered":"2024-09-22T08:42:17.434953+0000","last_unstale":"2024-09-22T08:53:07.401463+0000","last_undegraded":"2024-09-22T08:53:07.401463+0000","last_fullsized":"2024-09-22T08:53:07.401463+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:45:12.549260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"260'2","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:18.391339+0000","last_change":"2024-09-22T08:31:14.255977+0000","last_active":"2024-09-22T08:53:18.391339+0000","last_peered":"2024-09-22T08:53:18.391339+0000","last_clean":"2024-09-22T08:53:18.391339+0000","last_became_active":"2024-09-22T08:31:14.255534+0000","last_became_peered":"2024-09-22T08:31:14.255534+0000","last_unstale":"2024-09-22T08:53:18.391339+0000","last_undegraded":"2024-09-22T08:53:18.391339+0000","last_fullsized":"2024-09-22T08:53:18.391339+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:09:54.469702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"263'6","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:13.412902+0000","last_change":"2024-09-22T08:31:11.214320+0000","last_active":"2024-09-22T08:56:13.412902+0000","last_peered":"2024-09-22T08:56:13.412902+0000","last_clean":"2024-09-22T08:56:13.412902+0000","last_became_active":"2024-09-22T08:31:11.213851+0000","last_became_peered":"2024-09-22T08:31:11.213851+0000","last_unstale":"2024-09-22T08:56:13.412902+0000","last_undegraded":"2024-09-22T08:56:13.412902+0000","last_fullsized":"2024-09-22T08:56:13.412902+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:24:21.493458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":6146,"num_write":6,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"263'4","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:23.384458+0000","last_change":"2024-09-22T08:29:26.075210+0000","last_active":"2024-09-22T08:52:23.384458+0000","last_peered":"2024-09-22T08:52:23.384458+0000","last_clean":"2024-09-22T08:52:23.384458+0000","last_became_active":"2024-09-22T08:29:26.074907+0000","last_became_peered":"2024-09-22T08:29:26.074907+0000","last_unstale":"2024-09-22T08:52:23.384458+0000","last_undegraded":"2024-09-22T08:52:23.384458+0000","last_fullsized":"2024-09-22T08:52:23.384458+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:03:30.755739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:42.275910+0000","last_change":"2024-09-22T08:42:17.430325+0000","last_active":"2024-09-22T08:52:42.275910+0000","last_peered":"2024-09-22T08:52:42.275910+0000","last_clean":"2024-09-22T08:52:42.275910+0000","last_became_active":"2024-09-22T08:42:17.429341+0000","last_became_peered":"2024-09-22T08:42:17.429341+0000","last_unstale":"2024-09-22T08:52:42.275910+0000","last_undegraded":"2024-09-22T08:52:42.275910+0000","last_fullsized":"2024-09-22T08:52:42.275910+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:58:45.447447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"263'4","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.364149+0000","last_change":"2024-09-22T08:31:14.246719+0000","last_active":"2024-09-22T08:56:16.364149+0000","last_peered":"2024-09-22T08:56:16.364149+0000","last_clean":"2024-09-22T08:56:16.364149+0000","last_became_active":"2024-09-22T08:31:14.246417+0000","last_became_peered":"2024-09-22T08:31:14.246417+0000","last_unstale":"2024-09-22T08:56:16.364149+0000","last_undegraded":"2024-09-22T08:56:16.364149+0000","last_fullsized":"2024-09-22T08:56:16.364149+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:41:02.060530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"263'9","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.381511+0000","last_change":"2024-09-22T08:31:11.211394+0000","last_active":"2024-09-22T08:56:16.381511+0000","last_peered":"2024-09-22T08:56:16.381511+0000","last_clean":"2024-09-22T08:56:16.381511+0000","last_became_active":"2024-09-22T08:31:11.211079+0000","last_became_peered":"2024-09-22T08:31:11.211079+0000","last_unstale":"2024-09-22T08:56:16.381511+0000","last_undegraded":"2024-09-22T08:56:16.381511+0000","last_fullsized":"2024-09-22T08:56:16.381511+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:24:21.252446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10242,"num_write":14,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"263'18","reported_seq":88,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:23.384401+0000","last_change":"2024-09-22T08:29:26.068293+0000","last_active":"2024-09-22T08:52:23.384401+0000","last_peered":"2024-09-22T08:52:23.384401+0000","last_clean":"2024-09-22T08:52:23.384401+0000","last_became_active":"2024-09-22T08:29:26.067964+0000","last_became_peered":"2024-09-22T08:29:26.067964+0000","last_unstale":"2024-09-22T08:52:23.384401+0000","last_undegraded":"2024-09-22T08:52:23.384401+0000","last_fullsized":"2024-09-22T08:52:23.384401+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:41:20.023712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":85,"num_write":46,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:43.387400+0000","last_change":"2024-09-22T08:42:17.438619+0000","last_active":"2024-09-22T08:52:43.387400+0000","last_peered":"2024-09-22T08:52:43.387400+0000","last_clean":"2024-09-22T08:52:43.387400+0000","last_became_active":"2024-09-22T08:42:17.438318+0000","last_became_peered":"2024-09-22T08:42:17.438318+0000","last_unstale":"2024-09-22T08:52:43.387400+0000","last_undegraded":"2024-09-22T08:52:43.387400+0000","last_fullsized":"2024-09-22T08:52:43.387400+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:18:22.838300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:11.274093+0000","last_change":"2024-09-22T08:31:14.258446+0000","last_active":"2024-09-22T08:54:11.274093+0000","last_peered":"2024-09-22T08:54:11.274093+0000","last_clean":"2024-09-22T08:54:11.274093+0000","last_became_active":"2024-09-22T08:31:14.258136+0000","last_became_peered":"2024-09-22T08:31:14.258136+0000","last_unstale":"2024-09-22T08:54:11.274093+0000","last_undegraded":"2024-09-22T08:54:11.274093+0000","last_fullsized":"2024-09-22T08:54:11.274093+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:09:06.068754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"263'2","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:13.412427+0000","last_change":"2024-09-22T08:31:11.214416+0000","last_active":"2024-09-22T08:56:13.412427+0000","last_peered":"2024-09-22T08:56:13.412427+0000","last_clean":"2024-09-22T08:56:13.412427+0000","last_became_active":"2024-09-22T08:31:11.214112+0000","last_became_peered":"2024-09-22T08:31:11.214112+0000","last_unstale":"2024-09-22T08:56:13.412427+0000","last_undegraded":"2024-09-22T08:56:13.412427+0000","last_fullsized":"2024-09-22T08:56:13.412427+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:13:58.692971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"263'20","reported_seq":98,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:31.269276+0000","last_change":"2024-09-22T08:29:26.069691+0000","last_active":"2024-09-22T08:53:31.269276+0000","last_peered":"2024-09-22T08:53:31.269276+0000","last_clean":"2024-09-22T08:53:31.269276+0000","last_became_active":"2024-09-22T08:29:26.069407+0000","last_became_peered":"2024-09-22T08:29:26.069407+0000","last_unstale":"2024-09-22T08:53:31.269276+0000","last_undegraded":"2024-09-22T08:53:31.269276+0000","last_fullsized":"2024-09-22T08:53:31.269276+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:46:12.719810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":95,"num_write":53,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"263'227","reported_seq":864,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.515975+0000","last_change":"2024-09-22T08:15:04.957845+0000","last_active":"2024-09-22T08:56:16.515975+0000","last_peered":"2024-09-22T08:56:16.515975+0000","last_clean":"2024-09-22T08:56:16.515975+0000","last_became_active":"2024-09-22T08:15:04.957090+0000","last_became_peered":"2024-09-22T08:15:04.957090+0000","last_unstale":"2024-09-22T08:56:16.515975+0000","last_undegraded":"2024-09-22T08:56:16.515975+0000","last_fullsized":"2024-09-22T08:56:16.515975+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:32:54.449746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":587,"num_read_kb":1123,"num_write":1117,"num_write_kb":27318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"263'475","reported_seq":2198,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.479858+0000","last_change":"2024-09-22T08:15:06.981247+0000","last_active":"2024-09-22T08:54:41.479858+0000","last_peered":"2024-09-22T08:54:41.479858+0000","last_clean":"2024-09-22T08:54:41.479858+0000","last_became_active":"2024-09-22T08:15:06.980616+0000","last_became_peered":"2024-09-22T08:15:06.980616+0000","last_unstale":"2024-09-22T08:54:41.479858+0000","last_undegraded":"2024-09-22T08:54:41.479858+0000","last_fullsized":"2024-09-22T08:54:41.479858+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:58:53.792749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2847,"num_read_kb":2707,"num_write":560,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"263'239","reported_seq":875,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.532805+0000","last_change":"2024-09-22T08:15:04.957479+0000","last_active":"2024-09-22T08:56:16.532805+0000","last_peered":"2024-09-22T08:56:16.532805+0000","last_clean":"2024-09-22T08:56:16.532805+0000","last_became_active":"2024-09-22T08:15:04.956643+0000","last_became_peered":"2024-09-22T08:15:04.956643+0000","last_unstale":"2024-09-22T08:56:16.532805+0000","last_undegraded":"2024-09-22T08:56:16.532805+0000","last_fullsized":"2024-09-22T08:56:16.532805+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:23:49.336948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":599,"num_read_kb":19417,"num_write":1105,"num_write_kb":24732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"263'386","reported_seq":1918,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:17.378056+0000","last_change":"2024-09-22T08:15:06.974580+0000","last_active":"2024-09-22T08:54:17.378056+0000","last_peered":"2024-09-22T08:54:17.378056+0000","last_clean":"2024-09-22T08:54:17.378056+0000","last_became_active":"2024-09-22T08:15:06.974127+0000","last_became_peered":"2024-09-22T08:15:06.974127+0000","last_unstale":"2024-09-22T08:54:17.378056+0000","last_undegraded":"2024-09-22T08:54:17.378056+0000","last_fullsized":"2024-09-22T08:54:17.378056+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:33:05.581133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2097,"num_read_kb":2016,"num_write":427,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"263'254","reported_seq":921,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.464973+0000","last_change":"2024-09-22T08:15:04.956999+0000","last_active":"2024-09-22T08:56:16.464973+0000","last_peered":"2024-09-22T08:56:16.464973+0000","last_clean":"2024-09-22T08:56:16.464973+0000","last_became_active":"2024-09-22T08:15:04.956659+0000","last_became_peered":"2024-09-22T08:15:04.956659+0000","last_unstale":"2024-09-22T08:56:16.464973+0000","last_undegraded":"2024-09-22T08:56:16.464973+0000","last_fullsized":"2024-09-22T08:56:16.464973+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:42:55.552056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":699,"num_read_kb":25466,"num_write":1131,"num_write_kb":27131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"263'898","reported_seq":2493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.960994+0000","last_change":"2024-09-22T08:15:06.969243+0000","last_active":"2024-09-22T08:54:27.960994+0000","last_peered":"2024-09-22T08:54:27.960994+0000","last_clean":"2024-09-22T08:54:27.960994+0000","last_became_active":"2024-09-22T08:15:06.968959+0000","last_became_peered":"2024-09-22T08:15:06.968959+0000","last_unstale":"2024-09-22T08:54:27.960994+0000","last_undegraded":"2024-09-22T08:54:27.960994+0000","last_fullsized":"2024-09-22T08:54:27.960994+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":800,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:30:18.722556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4516,"num_read_kb":4043,"num_write":1241,"num_write_kb":490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"263'237","reported_seq":874,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.551507+0000","last_change":"2024-09-22T08:15:04.961682+0000","last_active":"2024-09-22T08:56:16.551507+0000","last_peered":"2024-09-22T08:56:16.551507+0000","last_clean":"2024-09-22T08:56:16.551507+0000","last_became_active":"2024-09-22T08:15:04.961309+0000","last_became_peered":"2024-09-22T08:15:04.961309+0000","last_unstale":"2024-09-22T08:56:16.551507+0000","last_undegraded":"2024-09-22T08:56:16.551507+0000","last_fullsized":"2024-09-22T08:56:16.551507+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:32:00.847272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079903,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":558,"num_read_kb":61455,"num_write":1043,"num_write_kb":33072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"263'535","reported_seq":2232,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:26.719838+0000","last_change":"2024-09-22T08:15:06.969850+0000","last_active":"2024-09-22T08:54:26.719838+0000","last_peered":"2024-09-22T08:54:26.719838+0000","last_clean":"2024-09-22T08:54:26.719838+0000","last_became_active":"2024-09-22T08:15:06.969540+0000","last_became_peered":"2024-09-22T08:15:06.969540+0000","last_unstale":"2024-09-22T08:54:26.719838+0000","last_undegraded":"2024-09-22T08:54:26.719838+0000","last_fullsized":"2024-09-22T08:54:26.719838+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:39:46.162178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2823,"num_read_kb":2637,"num_write":641,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"263'213","reported_seq":913,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.472704+0000","last_change":"2024-09-22T08:15:04.958005+0000","last_active":"2024-09-22T08:56:16.472704+0000","last_peered":"2024-09-22T08:56:16.472704+0000","last_clean":"2024-09-22T08:56:16.472704+0000","last_became_active":"2024-09-22T08:15:04.957717+0000","last_became_peered":"2024-09-22T08:15:04.957717+0000","last_unstale":"2024-09-22T08:56:16.472704+0000","last_undegraded":"2024-09-22T08:56:16.472704+0000","last_fullsized":"2024-09-22T08:56:16.472704+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:54:04.680306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1573037,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":720,"num_read_kb":166418,"num_write":955,"num_write_kb":57547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"263'603","reported_seq":2125,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:18.165751+0000","last_change":"2024-09-22T08:15:06.962885+0000","last_active":"2024-09-22T08:54:18.165751+0000","last_peered":"2024-09-22T08:54:18.165751+0000","last_clean":"2024-09-22T08:54:18.165751+0000","last_became_active":"2024-09-22T08:15:06.962605+0000","last_became_peered":"2024-09-22T08:15:06.962605+0000","last_unstale":"2024-09-22T08:54:18.165751+0000","last_undegraded":"2024-09-22T08:54:18.165751+0000","last_fullsized":"2024-09-22T08:54:18.165751+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":500,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:20:20.581344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3087,"num_read_kb":2910,"num_write":853,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"263'256","reported_seq":935,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.547310+0000","last_change":"2024-09-22T08:15:04.962423+0000","last_active":"2024-09-22T08:56:16.547310+0000","last_peered":"2024-09-22T08:56:16.547310+0000","last_clean":"2024-09-22T08:56:16.547310+0000","last_became_active":"2024-09-22T08:15:04.962128+0000","last_became_peered":"2024-09-22T08:15:04.962128+0000","last_unstale":"2024-09-22T08:56:16.547310+0000","last_undegraded":"2024-09-22T08:56:16.547310+0000","last_fullsized":"2024-09-22T08:56:16.547310+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:42:18.164351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":753,"num_read_kb":52063,"num_write":1239,"num_write_kb":44926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"263'868","reported_seq":2689,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.926078+0000","last_change":"2024-09-22T08:15:06.973142+0000","last_active":"2024-09-22T08:54:38.926078+0000","last_peered":"2024-09-22T08:54:38.926078+0000","last_clean":"2024-09-22T08:54:38.926078+0000","last_became_active":"2024-09-22T08:15:06.972756+0000","last_became_peered":"2024-09-22T08:15:06.972756+0000","last_unstale":"2024-09-22T08:54:38.926078+0000","last_undegraded":"2024-09-22T08:54:38.926078+0000","last_fullsized":"2024-09-22T08:54:38.926078+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":800,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:03:48.112288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4443,"num_read_kb":4056,"num_write":1153,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"263'249","reported_seq":915,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.393176+0000","last_change":"2024-09-22T08:15:04.945272+0000","last_active":"2024-09-22T08:56:16.393176+0000","last_peered":"2024-09-22T08:56:16.393176+0000","last_clean":"2024-09-22T08:56:16.393176+0000","last_became_active":"2024-09-22T08:15:04.944916+0000","last_became_peered":"2024-09-22T08:15:04.944916+0000","last_unstale":"2024-09-22T08:56:16.393176+0000","last_undegraded":"2024-09-22T08:56:16.393176+0000","last_fullsized":"2024-09-22T08:56:16.393176+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:27:56.610167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":805,"num_read_kb":10946,"num_write":1075,"num_write_kb":28039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"263'555","reported_seq":2079,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:22.694280+0000","last_change":"2024-09-22T08:15:06.969137+0000","last_active":"2024-09-22T08:54:22.694280+0000","last_peered":"2024-09-22T08:54:22.694280+0000","last_clean":"2024-09-22T08:54:22.694280+0000","last_became_active":"2024-09-22T08:15:06.968853+0000","last_became_peered":"2024-09-22T08:15:06.968853+0000","last_unstale":"2024-09-22T08:54:22.694280+0000","last_undegraded":"2024-09-22T08:54:22.694280+0000","last_fullsized":"2024-09-22T08:54:22.694280+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:30:47.410362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2932,"num_read_kb":2656,"num_write":742,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"263'185","reported_seq":754,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.542818+0000","last_change":"2024-09-22T08:15:04.959783+0000","last_active":"2024-09-22T08:56:16.542818+0000","last_peered":"2024-09-22T08:56:16.542818+0000","last_clean":"2024-09-22T08:56:16.542818+0000","last_became_active":"2024-09-22T08:15:04.959395+0000","last_became_peered":"2024-09-22T08:15:04.959395+0000","last_unstale":"2024-09-22T08:56:16.542818+0000","last_undegraded":"2024-09-22T08:56:16.542818+0000","last_fullsized":"2024-09-22T08:56:16.542818+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:39:51.640256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":318,"num_read_kb":28967,"num_write":772,"num_write_kb":45290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"263'1560","reported_seq":3265,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:40.939260+0000","last_change":"2024-09-22T08:15:06.972382+0000","last_active":"2024-09-22T08:54:40.939260+0000","last_peered":"2024-09-22T08:54:40.939260+0000","last_clean":"2024-09-22T08:54:40.939260+0000","last_became_active":"2024-09-22T08:15:06.972074+0000","last_became_peered":"2024-09-22T08:15:06.972074+0000","last_unstale":"2024-09-22T08:54:40.939260+0000","last_undegraded":"2024-09-22T08:54:40.939260+0000","last_fullsized":"2024-09-22T08:54:40.939260+0000","mapping_epoch":25,"log_start":"263'1500","ondisk_log_start":"263'1500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":1500,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:28:04.310796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6961,"num_read_kb":6120,"num_write":2165,"num_write_kb":918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"263'483","reported_seq":2143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:40.939680+0000","last_change":"2024-09-22T08:15:06.966028+0000","last_active":"2024-09-22T08:54:40.939680+0000","last_peered":"2024-09-22T08:54:40.939680+0000","last_clean":"2024-09-22T08:54:40.939680+0000","last_became_active":"2024-09-22T08:15:06.965751+0000","last_became_peered":"2024-09-22T08:15:06.965751+0000","last_unstale":"2024-09-22T08:54:40.939680+0000","last_undegraded":"2024-09-22T08:54:40.939680+0000","last_fullsized":"2024-09-22T08:54:40.939680+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:49:12.402190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2631,"num_read_kb":2475,"num_write":578,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"263'216","reported_seq":860,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.561251+0000","last_change":"2024-09-22T08:15:04.953971+0000","last_active":"2024-09-22T08:56:16.561251+0000","last_peered":"2024-09-22T08:56:16.561251+0000","last_clean":"2024-09-22T08:56:16.561251+0000","last_became_active":"2024-09-22T08:15:04.953628+0000","last_became_peered":"2024-09-22T08:15:04.953628+0000","last_unstale":"2024-09-22T08:56:16.561251+0000","last_undegraded":"2024-09-22T08:56:16.561251+0000","last_fullsized":"2024-09-22T08:56:16.561251+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:19:43.155317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":538,"num_read_kb":68591,"num_write":878,"num_write_kb":34888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"263'357","reported_seq":1735,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:25.944981+0000","last_change":"2024-09-22T08:15:06.969299+0000","last_active":"2024-09-22T08:54:25.944981+0000","last_peered":"2024-09-22T08:54:25.944981+0000","last_clean":"2024-09-22T08:54:25.944981+0000","last_became_active":"2024-09-22T08:15:06.968970+0000","last_became_peered":"2024-09-22T08:15:06.968970+0000","last_unstale":"2024-09-22T08:54:25.944981+0000","last_undegraded":"2024-09-22T08:54:25.944981+0000","last_fullsized":"2024-09-22T08:54:25.944981+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:38:44.711239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2053,"num_read_kb":1926,"num_write":427,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"263'228","reported_seq":859,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.452103+0000","last_change":"2024-09-22T08:15:04.967060+0000","last_active":"2024-09-22T08:56:16.452103+0000","last_peered":"2024-09-22T08:56:16.452103+0000","last_clean":"2024-09-22T08:56:16.452103+0000","last_became_active":"2024-09-22T08:15:04.966769+0000","last_became_peered":"2024-09-22T08:15:04.966769+0000","last_unstale":"2024-09-22T08:56:16.452103+0000","last_undegraded":"2024-09-22T08:56:16.452103+0000","last_fullsized":"2024-09-22T08:56:16.452103+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:56:04.347599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":51014,"num_write":1104,"num_write_kb":43963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"263'468","reported_seq":1924,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:20.263692+0000","last_change":"2024-09-22T08:15:06.973138+0000","last_active":"2024-09-22T08:54:20.263692+0000","last_peered":"2024-09-22T08:54:20.263692+0000","last_clean":"2024-09-22T08:54:20.263692+0000","last_became_active":"2024-09-22T08:15:06.972821+0000","last_became_peered":"2024-09-22T08:15:06.972821+0000","last_unstale":"2024-09-22T08:54:20.263692+0000","last_undegraded":"2024-09-22T08:54:20.263692+0000","last_fullsized":"2024-09-22T08:54:20.263692+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:14.633460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2415,"num_read_kb":2238,"num_write":577,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"263'222","reported_seq":944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.473267+0000","last_change":"2024-09-22T08:15:04.956245+0000","last_active":"2024-09-22T08:56:16.473267+0000","last_peered":"2024-09-22T08:56:16.473267+0000","last_clean":"2024-09-22T08:56:16.473267+0000","last_became_active":"2024-09-22T08:15:04.955972+0000","last_became_peered":"2024-09-22T08:15:04.955972+0000","last_unstale":"2024-09-22T08:56:16.473267+0000","last_undegraded":"2024-09-22T08:56:16.473267+0000","last_fullsized":"2024-09-22T08:56:16.473267+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:47:06.545629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":994,"num_read_kb":8164,"num_write":935,"num_write_kb":17459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"263'463","reported_seq":2079,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:40.939187+0000","last_change":"2024-09-22T08:15:06.972576+0000","last_active":"2024-09-22T08:54:40.939187+0000","last_peered":"2024-09-22T08:54:40.939187+0000","last_clean":"2024-09-22T08:54:40.939187+0000","last_became_active":"2024-09-22T08:15:06.972250+0000","last_became_peered":"2024-09-22T08:15:06.972250+0000","last_unstale":"2024-09-22T08:54:40.939187+0000","last_undegraded":"2024-09-22T08:54:40.939187+0000","last_fullsized":"2024-09-22T08:54:40.939187+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:26:28.387708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2654,"num_read_kb":2505,"num_write":533,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"263'247","reported_seq":889,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.496001+0000","last_change":"2024-09-22T08:15:04.955521+0000","last_active":"2024-09-22T08:56:16.496001+0000","last_peered":"2024-09-22T08:56:16.496001+0000","last_clean":"2024-09-22T08:56:16.496001+0000","last_became_active":"2024-09-22T08:15:04.954948+0000","last_became_peered":"2024-09-22T08:15:04.954948+0000","last_unstale":"2024-09-22T08:56:16.496001+0000","last_undegraded":"2024-09-22T08:56:16.496001+0000","last_fullsized":"2024-09-22T08:56:16.496001+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:55:10.800461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":551,"num_read_kb":6536,"num_write":1088,"num_write_kb":24915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"263'385","reported_seq":1845,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:40.939101+0000","last_change":"2024-09-22T08:15:06.970282+0000","last_active":"2024-09-22T08:54:40.939101+0000","last_peered":"2024-09-22T08:54:40.939101+0000","last_clean":"2024-09-22T08:54:40.939101+0000","last_became_active":"2024-09-22T08:15:06.968651+0000","last_became_peered":"2024-09-22T08:15:06.968651+0000","last_unstale":"2024-09-22T08:54:40.939101+0000","last_undegraded":"2024-09-22T08:54:40.939101+0000","last_fullsized":"2024-09-22T08:54:40.939101+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:24:42.424031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2079,"num_read_kb":1977,"num_write":435,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"263'237","reported_seq":852,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:12.308091+0000","last_change":"2024-09-22T08:15:04.958944+0000","last_active":"2024-09-22T08:56:12.308091+0000","last_peered":"2024-09-22T08:56:12.308091+0000","last_clean":"2024-09-22T08:56:12.308091+0000","last_became_active":"2024-09-22T08:15:04.958578+0000","last_became_peered":"2024-09-22T08:15:04.958578+0000","last_unstale":"2024-09-22T08:56:12.308091+0000","last_undegraded":"2024-09-22T08:56:12.308091+0000","last_fullsized":"2024-09-22T08:56:12.308091+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:42:49.203289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":554,"num_read_kb":7725,"num_write":1073,"num_write_kb":35221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"263'573","reported_seq":2255,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:21.832642+0000","last_change":"2024-09-22T08:15:06.980925+0000","last_active":"2024-09-22T08:54:21.832642+0000","last_peered":"2024-09-22T08:54:21.832642+0000","last_clean":"2024-09-22T08:54:21.832642+0000","last_became_active":"2024-09-22T08:15:06.980621+0000","last_became_peered":"2024-09-22T08:15:06.980621+0000","last_unstale":"2024-09-22T08:54:21.832642+0000","last_undegraded":"2024-09-22T08:54:21.832642+0000","last_fullsized":"2024-09-22T08:54:21.832642+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":500,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:01.217800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3075,"num_read_kb":2832,"num_write":740,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"263'193","reported_seq":993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.473026+0000","last_change":"2024-09-22T08:15:04.952516+0000","last_active":"2024-09-22T08:56:16.473026+0000","last_peered":"2024-09-22T08:56:16.473026+0000","last_clean":"2024-09-22T08:56:16.473026+0000","last_became_active":"2024-09-22T08:15:04.952203+0000","last_became_peered":"2024-09-22T08:15:04.952203+0000","last_unstale":"2024-09-22T08:56:16.473026+0000","last_undegraded":"2024-09-22T08:56:16.473026+0000","last_fullsized":"2024-09-22T08:56:16.473026+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:30:00.993327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1058,"num_read_kb":8867,"num_write":911,"num_write_kb":21916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"263'139","reported_seq":638,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.540408+0000","last_change":"2024-09-22T08:15:15.011843+0000","last_active":"2024-09-22T08:54:41.540408+0000","last_peered":"2024-09-22T08:54:41.540408+0000","last_clean":"2024-09-22T08:54:41.540408+0000","last_became_active":"2024-09-22T08:15:15.011529+0000","last_became_peered":"2024-09-22T08:15:15.011529+0000","last_unstale":"2024-09-22T08:54:41.540408+0000","last_undegraded":"2024-09-22T08:54:41.540408+0000","last_fullsized":"2024-09-22T08:54:41.540408+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":192,"num_read_kb":186,"num_write":338,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"263'502","reported_seq":2104,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:26.719888+0000","last_change":"2024-09-22T08:15:06.968110+0000","last_active":"2024-09-22T08:54:26.719888+0000","last_peered":"2024-09-22T08:54:26.719888+0000","last_clean":"2024-09-22T08:54:26.719888+0000","last_became_active":"2024-09-22T08:15:06.967794+0000","last_became_peered":"2024-09-22T08:15:06.967794+0000","last_unstale":"2024-09-22T08:54:26.719888+0000","last_undegraded":"2024-09-22T08:54:26.719888+0000","last_fullsized":"2024-09-22T08:54:26.719888+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:18:56.559988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2789,"num_read_kb":2608,"num_write":647,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"263'219","reported_seq":864,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.466299+0000","last_change":"2024-09-22T08:15:04.964175+0000","last_active":"2024-09-22T08:56:16.466299+0000","last_peered":"2024-09-22T08:56:16.466299+0000","last_clean":"2024-09-22T08:56:16.466299+0000","last_became_active":"2024-09-22T08:15:04.963890+0000","last_became_peered":"2024-09-22T08:15:04.963890+0000","last_unstale":"2024-09-22T08:56:16.466299+0000","last_undegraded":"2024-09-22T08:56:16.466299+0000","last_fullsized":"2024-09-22T08:56:16.466299+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:19:35.111320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079944,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":535,"num_read_kb":15199,"num_write":1088,"num_write_kb":18954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:48.395352+0000","last_change":"2024-09-22T08:15:08.968916+0000","last_active":"2024-09-22T08:53:48.395352+0000","last_peered":"2024-09-22T08:53:48.395352+0000","last_clean":"2024-09-22T08:53:48.395352+0000","last_became_active":"2024-09-22T08:15:08.968482+0000","last_became_peered":"2024-09-22T08:15:08.968482+0000","last_unstale":"2024-09-22T08:53:48.395352+0000","last_undegraded":"2024-09-22T08:53:48.395352+0000","last_fullsized":"2024-09-22T08:53:48.395352+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:17:40.343334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"263'192","reported_seq":791,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.348297+0000","last_change":"2024-09-22T08:15:10.987896+0000","last_active":"2024-09-22T08:56:16.348297+0000","last_peered":"2024-09-22T08:56:16.348297+0000","last_clean":"2024-09-22T08:56:16.348297+0000","last_became_active":"2024-09-22T08:15:10.987539+0000","last_became_peered":"2024-09-22T08:15:10.987539+0000","last_unstale":"2024-09-22T08:56:16.348297+0000","last_undegraded":"2024-09-22T08:56:16.348297+0000","last_fullsized":"2024-09-22T08:56:16.348297+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:00:01.634988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7203,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":254,"num_read_kb":315,"num_write":148,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:53.395578+0000","last_change":"2024-09-22T08:15:13.019038+0000","last_active":"2024-09-22T08:53:53.395578+0000","last_peered":"2024-09-22T08:53:53.395578+0000","last_clean":"2024-09-22T08:53:53.395578+0000","last_became_active":"2024-09-22T08:15:13.018750+0000","last_became_peered":"2024-09-22T08:15:13.018750+0000","last_unstale":"2024-09-22T08:53:53.395578+0000","last_undegraded":"2024-09-22T08:53:53.395578+0000","last_fullsized":"2024-09-22T08:53:53.395578+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:37:28.422394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"263'150","reported_seq":640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.301330+0000","last_change":"2024-09-22T08:15:15.020868+0000","last_active":"2024-09-22T08:54:41.301330+0000","last_peered":"2024-09-22T08:54:41.301330+0000","last_clean":"2024-09-22T08:54:41.301330+0000","last_became_active":"2024-09-22T08:15:15.020542+0000","last_became_peered":"2024-09-22T08:15:15.020542+0000","last_unstale":"2024-09-22T08:54:41.301330+0000","last_undegraded":"2024-09-22T08:54:41.301330+0000","last_fullsized":"2024-09-22T08:54:41.301330+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:46:43.042803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":183,"num_read_kb":175,"num_write":358,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"263'751","reported_seq":2354,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:40.939200+0000","last_change":"2024-09-22T08:15:06.981089+0000","last_active":"2024-09-22T08:54:40.939200+0000","last_peered":"2024-09-22T08:54:40.939200+0000","last_clean":"2024-09-22T08:54:40.939200+0000","last_became_active":"2024-09-22T08:15:06.980479+0000","last_became_peered":"2024-09-22T08:15:06.980479+0000","last_unstale":"2024-09-22T08:54:40.939200+0000","last_undegraded":"2024-09-22T08:54:40.939200+0000","last_fullsized":"2024-09-22T08:54:40.939200+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:49:26.940326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3625,"num_read_kb":3307,"num_write":963,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"263'254","reported_seq":922,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:47.293755+0000","last_change":"2024-09-22T08:15:04.951572+0000","last_active":"2024-09-22T08:54:47.293755+0000","last_peered":"2024-09-22T08:54:47.293755+0000","last_clean":"2024-09-22T08:54:47.293755+0000","last_became_active":"2024-09-22T08:15:04.951265+0000","last_became_peered":"2024-09-22T08:15:04.951265+0000","last_unstale":"2024-09-22T08:54:47.293755+0000","last_undegraded":"2024-09-22T08:54:47.293755+0000","last_fullsized":"2024-09-22T08:54:47.293755+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:22:06.557070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":764,"num_read_kb":7954,"num_write":1369,"num_write_kb":16798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:37.397545+0000","last_change":"2024-09-22T08:15:08.979213+0000","last_active":"2024-09-22T08:52:37.397545+0000","last_peered":"2024-09-22T08:52:37.397545+0000","last_clean":"2024-09-22T08:52:37.397545+0000","last_became_active":"2024-09-22T08:15:08.978832+0000","last_became_peered":"2024-09-22T08:15:08.978832+0000","last_unstale":"2024-09-22T08:52:37.397545+0000","last_undegraded":"2024-09-22T08:52:37.397545+0000","last_fullsized":"2024-09-22T08:52:37.397545+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:42:16.081624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"263'77","reported_seq":598,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.726753+0000","last_change":"2024-09-22T08:15:10.984633+0000","last_active":"2024-09-22T08:55:19.726753+0000","last_peered":"2024-09-22T08:55:19.726753+0000","last_clean":"2024-09-22T08:55:19.726753+0000","last_became_active":"2024-09-22T08:15:10.984027+0000","last_became_peered":"2024-09-22T08:15:10.984027+0000","last_unstale":"2024-09-22T08:55:19.726753+0000","last_undegraded":"2024-09-22T08:55:19.726753+0000","last_fullsized":"2024-09-22T08:55:19.726753+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:59:59.106865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":87,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:53.395512+0000","last_change":"2024-09-22T08:15:13.013974+0000","last_active":"2024-09-22T08:53:53.395512+0000","last_peered":"2024-09-22T08:53:53.395512+0000","last_clean":"2024-09-22T08:53:53.395512+0000","last_became_active":"2024-09-22T08:15:13.013609+0000","last_became_peered":"2024-09-22T08:15:13.013609+0000","last_unstale":"2024-09-22T08:53:53.395512+0000","last_undegraded":"2024-09-22T08:53:53.395512+0000","last_fullsized":"2024-09-22T08:53:53.395512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:39:31.786695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"263'154","reported_seq":663,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:14.427460+0000","last_change":"2024-09-22T08:15:15.019318+0000","last_active":"2024-09-22T08:54:14.427460+0000","last_peered":"2024-09-22T08:54:14.427460+0000","last_clean":"2024-09-22T08:54:14.427460+0000","last_became_active":"2024-09-22T08:15:15.018984+0000","last_became_peered":"2024-09-22T08:15:15.018984+0000","last_unstale":"2024-09-22T08:54:14.427460+0000","last_undegraded":"2024-09-22T08:54:14.427460+0000","last_fullsized":"2024-09-22T08:54:14.427460+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:29:44.945052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":263,"num_read_kb":245,"num_write":379,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"263'1935","reported_seq":3646,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.040078+0000","last_change":"2024-09-22T08:15:06.969580+0000","last_active":"2024-09-22T08:56:02.040078+0000","last_peered":"2024-09-22T08:56:02.040078+0000","last_clean":"2024-09-22T08:56:02.040078+0000","last_became_active":"2024-09-22T08:15:06.967645+0000","last_became_peered":"2024-09-22T08:15:06.967645+0000","last_unstale":"2024-09-22T08:56:02.040078+0000","last_undegraded":"2024-09-22T08:56:02.040078+0000","last_fullsized":"2024-09-22T08:56:02.040078+0000","mapping_epoch":25,"log_start":"263'1900","ondisk_log_start":"263'1900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":1900,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:51:46.954458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8532,"num_read_kb":7421,"num_write":2741,"num_write_kb":1214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"263'206","reported_seq":851,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.561577+0000","last_change":"2024-09-22T08:15:04.965135+0000","last_active":"2024-09-22T08:56:16.561577+0000","last_peered":"2024-09-22T08:56:16.561577+0000","last_clean":"2024-09-22T08:56:16.561577+0000","last_became_active":"2024-09-22T08:15:04.964798+0000","last_became_peered":"2024-09-22T08:15:04.964798+0000","last_unstale":"2024-09-22T08:56:16.561577+0000","last_undegraded":"2024-09-22T08:56:16.561577+0000","last_fullsized":"2024-09-22T08:56:16.561577+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:57:26.490605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":449,"num_read_kb":111223,"num_write":842,"num_write_kb":54102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:52.407838+0000","last_change":"2024-09-22T08:15:08.977351+0000","last_active":"2024-09-22T08:53:52.407838+0000","last_peered":"2024-09-22T08:53:52.407838+0000","last_clean":"2024-09-22T08:53:52.407838+0000","last_became_active":"2024-09-22T08:15:08.976950+0000","last_became_peered":"2024-09-22T08:15:08.976950+0000","last_unstale":"2024-09-22T08:53:52.407838+0000","last_undegraded":"2024-09-22T08:53:52.407838+0000","last_fullsized":"2024-09-22T08:53:52.407838+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:02:30.621484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"263'107","reported_seq":638,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.745947+0000","last_change":"2024-09-22T08:15:10.981219+0000","last_active":"2024-09-22T08:55:19.745947+0000","last_peered":"2024-09-22T08:55:19.745947+0000","last_clean":"2024-09-22T08:55:19.745947+0000","last_became_active":"2024-09-22T08:15:10.980879+0000","last_became_peered":"2024-09-22T08:15:10.980879+0000","last_unstale":"2024-09-22T08:55:19.745947+0000","last_undegraded":"2024-09-22T08:55:19.745947+0000","last_fullsized":"2024-09-22T08:55:19.745947+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:15:11.627561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":117,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"263'782","reported_seq":2379,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.569288+0000","last_change":"2024-09-22T08:15:13.012087+0000","last_active":"2024-09-22T08:56:16.569288+0000","last_peered":"2024-09-22T08:56:16.569288+0000","last_clean":"2024-09-22T08:56:16.569288+0000","last_became_active":"2024-09-22T08:15:13.011812+0000","last_became_peered":"2024-09-22T08:15:13.011812+0000","last_unstale":"2024-09-22T08:56:16.569288+0000","last_undegraded":"2024-09-22T08:56:16.569288+0000","last_fullsized":"2024-09-22T08:56:16.569288+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:23:51.018829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"263'178","reported_seq":999,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.583483+0000","last_change":"2024-09-22T08:15:15.016044+0000","last_active":"2024-09-22T08:54:41.583483+0000","last_peered":"2024-09-22T08:54:41.583483+0000","last_clean":"2024-09-22T08:54:41.583483+0000","last_became_active":"2024-09-22T08:15:15.015684+0000","last_became_peered":"2024-09-22T08:15:15.015684+0000","last_unstale":"2024-09-22T08:54:41.583483+0000","last_undegraded":"2024-09-22T08:54:41.583483+0000","last_fullsized":"2024-09-22T08:54:41.583483+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:38.991298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":616,"num_read_kb":611,"num_write":377,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"263'1260","reported_seq":2732,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.361262+0000","last_change":"2024-09-22T08:15:06.967665+0000","last_active":"2024-09-22T08:54:27.361262+0000","last_peered":"2024-09-22T08:54:27.361262+0000","last_clean":"2024-09-22T08:54:27.361262+0000","last_became_active":"2024-09-22T08:15:06.967323+0000","last_became_peered":"2024-09-22T08:15:06.967323+0000","last_unstale":"2024-09-22T08:54:27.361262+0000","last_undegraded":"2024-09-22T08:54:27.361262+0000","last_fullsized":"2024-09-22T08:54:27.361262+0000","mapping_epoch":25,"log_start":"263'1200","ondisk_log_start":"263'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":1200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:20:28.597649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7857,"num_read_kb":7154,"num_write":1964,"num_write_kb":850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"263'250","reported_seq":926,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:22.920450+0000","last_change":"2024-09-22T08:56:22.920450+0000","last_active":"2024-09-22T08:56:22.920450+0000","last_peered":"2024-09-22T08:56:22.920450+0000","last_clean":"2024-09-22T08:56:22.920450+0000","last_became_active":"2024-09-22T08:15:04.959776+0000","last_became_peered":"2024-09-22T08:15:04.959776+0000","last_unstale":"2024-09-22T08:56:22.920450+0000","last_undegraded":"2024-09-22T08:56:22.920450+0000","last_fullsized":"2024-09-22T08:56:22.920450+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'250","last_scrub_stamp":"2024-09-22T08:56:22.920344+0000","last_deep_scrub":"263'250","last_deep_scrub_stamp":"2024-09-22T08:56:22.920344+0000","last_clean_scrub_stamp":"2024-09-22T08:56:22.920344+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:50:17.909839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079920,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":722,"num_read_kb":18781,"num_write":1155,"num_write_kb":38377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:48.395364+0000","last_change":"2024-09-22T08:15:08.973303+0000","last_active":"2024-09-22T08:53:48.395364+0000","last_peered":"2024-09-22T08:53:48.395364+0000","last_clean":"2024-09-22T08:53:48.395364+0000","last_became_active":"2024-09-22T08:15:08.973025+0000","last_became_peered":"2024-09-22T08:15:08.973025+0000","last_unstale":"2024-09-22T08:53:48.395364+0000","last_undegraded":"2024-09-22T08:53:48.395364+0000","last_fullsized":"2024-09-22T08:53:48.395364+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:04:18.829657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"263'133","reported_seq":697,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.297403+0000","last_change":"2024-09-22T08:15:10.985906+0000","last_active":"2024-09-22T08:56:16.297403+0000","last_peered":"2024-09-22T08:56:16.297403+0000","last_clean":"2024-09-22T08:56:16.297403+0000","last_became_active":"2024-09-22T08:15:10.985540+0000","last_became_peered":"2024-09-22T08:15:10.985540+0000","last_unstale":"2024-09-22T08:56:16.297403+0000","last_undegraded":"2024-09-22T08:56:16.297403+0000","last_fullsized":"2024-09-22T08:56:16.297403+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:26:23.397471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10933,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":231,"num_write":80,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"263'792","reported_seq":2267,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.235006+0000","last_change":"2024-09-22T08:15:13.005672+0000","last_active":"2024-09-22T08:56:16.235006+0000","last_peered":"2024-09-22T08:56:16.235006+0000","last_clean":"2024-09-22T08:56:16.235006+0000","last_became_active":"2024-09-22T08:15:13.004752+0000","last_became_peered":"2024-09-22T08:15:13.004752+0000","last_unstale":"2024-09-22T08:56:16.235006+0000","last_undegraded":"2024-09-22T08:56:16.235006+0000","last_fullsized":"2024-09-22T08:56:16.235006+0000","mapping_epoch":31,"log_start":"263'701","ondisk_log_start":"263'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":701,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:24:31.084429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"263'440","reported_seq":2068,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.479991+0000","last_change":"2024-09-22T08:15:06.965797+0000","last_active":"2024-09-22T08:54:41.479991+0000","last_peered":"2024-09-22T08:54:41.479991+0000","last_clean":"2024-09-22T08:54:41.479991+0000","last_became_active":"2024-09-22T08:15:06.965387+0000","last_became_peered":"2024-09-22T08:15:06.965387+0000","last_unstale":"2024-09-22T08:54:41.479991+0000","last_undegraded":"2024-09-22T08:54:41.479991+0000","last_fullsized":"2024-09-22T08:54:41.479991+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:11:37.474066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2432,"num_read_kb":2308,"num_write":489,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"263'281","reported_seq":931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:22.419125+0000","last_change":"2024-09-22T08:56:22.419125+0000","last_active":"2024-09-22T08:56:22.419125+0000","last_peered":"2024-09-22T08:56:22.419125+0000","last_clean":"2024-09-22T08:56:22.419125+0000","last_became_active":"2024-09-22T08:15:04.954015+0000","last_became_peered":"2024-09-22T08:15:04.954015+0000","last_unstale":"2024-09-22T08:56:22.419125+0000","last_undegraded":"2024-09-22T08:56:22.419125+0000","last_fullsized":"2024-09-22T08:56:22.419125+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'281","last_scrub_stamp":"2024-09-22T08:56:22.418992+0000","last_deep_scrub":"263'281","last_deep_scrub_stamp":"2024-09-22T08:56:22.418992+0000","last_clean_scrub_stamp":"2024-09-22T08:56:22.418992+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:44:11.997685+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079929,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":663,"num_read_kb":30289,"num_write":1087,"num_write_kb":39703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:08.397243+0000","last_change":"2024-09-22T08:15:08.982558+0000","last_active":"2024-09-22T08:54:08.397243+0000","last_peered":"2024-09-22T08:54:08.397243+0000","last_clean":"2024-09-22T08:54:08.397243+0000","last_became_active":"2024-09-22T08:15:08.982222+0000","last_became_peered":"2024-09-22T08:15:08.982222+0000","last_unstale":"2024-09-22T08:54:08.397243+0000","last_undegraded":"2024-09-22T08:54:08.397243+0000","last_fullsized":"2024-09-22T08:54:08.397243+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:01.178334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"263'213","reported_seq":818,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.374444+0000","last_change":"2024-09-22T08:15:10.985101+0000","last_active":"2024-09-22T08:56:16.374444+0000","last_peered":"2024-09-22T08:56:16.374444+0000","last_clean":"2024-09-22T08:56:16.374444+0000","last_became_active":"2024-09-22T08:15:10.984769+0000","last_became_peered":"2024-09-22T08:15:10.984769+0000","last_unstale":"2024-09-22T08:56:16.374444+0000","last_undegraded":"2024-09-22T08:56:16.374444+0000","last_fullsized":"2024-09-22T08:56:16.374444+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:45:44.909883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11910,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":286,"num_read_kb":362,"num_write":166,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:27.282125+0000","last_change":"2024-09-22T08:15:13.012935+0000","last_active":"2024-09-22T08:53:27.282125+0000","last_peered":"2024-09-22T08:53:27.282125+0000","last_clean":"2024-09-22T08:53:27.282125+0000","last_became_active":"2024-09-22T08:15:13.012498+0000","last_became_peered":"2024-09-22T08:15:13.012498+0000","last_unstale":"2024-09-22T08:53:27.282125+0000","last_undegraded":"2024-09-22T08:53:27.282125+0000","last_fullsized":"2024-09-22T08:53:27.282125+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:45:11.434166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"263'554","reported_seq":1379,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:03.364987+0000","last_change":"2024-09-22T08:15:15.015237+0000","last_active":"2024-09-22T08:56:03.364987+0000","last_peered":"2024-09-22T08:56:03.364987+0000","last_clean":"2024-09-22T08:56:03.364987+0000","last_became_active":"2024-09-22T08:15:15.014801+0000","last_became_peered":"2024-09-22T08:15:15.014801+0000","last_unstale":"2024-09-22T08:56:03.364987+0000","last_undegraded":"2024-09-22T08:56:03.364987+0000","last_fullsized":"2024-09-22T08:56:03.364987+0000","mapping_epoch":33,"log_start":"263'500","ondisk_log_start":"263'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":500,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:46:54.702216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":467,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1367,"num_read_kb":1346,"num_write":1156,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"263'860","reported_seq":2446,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.040081+0000","last_change":"2024-09-22T08:15:06.973268+0000","last_active":"2024-09-22T08:56:02.040081+0000","last_peered":"2024-09-22T08:56:02.040081+0000","last_clean":"2024-09-22T08:56:02.040081+0000","last_became_active":"2024-09-22T08:15:06.972958+0000","last_became_peered":"2024-09-22T08:15:06.972958+0000","last_unstale":"2024-09-22T08:56:02.040081+0000","last_undegraded":"2024-09-22T08:56:02.040081+0000","last_fullsized":"2024-09-22T08:56:02.040081+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":800,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:07.108632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4079,"num_read_kb":3669,"num_write":1154,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"263'234","reported_seq":892,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.547697+0000","last_change":"2024-09-22T08:15:40.188660+0000","last_active":"2024-09-22T08:56:16.547697+0000","last_peered":"2024-09-22T08:56:16.547697+0000","last_clean":"2024-09-22T08:56:16.547697+0000","last_became_active":"2024-09-22T08:15:40.188251+0000","last_became_peered":"2024-09-22T08:15:40.188251+0000","last_unstale":"2024-09-22T08:56:16.547697+0000","last_undegraded":"2024-09-22T08:56:16.547697+0000","last_fullsized":"2024-09-22T08:56:16.547697+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:26:41.611736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":546,"num_read_kb":133824,"num_write":973,"num_write_kb":45053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:12.288413+0000","last_change":"2024-09-22T08:15:08.975801+0000","last_active":"2024-09-22T08:54:12.288413+0000","last_peered":"2024-09-22T08:54:12.288413+0000","last_clean":"2024-09-22T08:54:12.288413+0000","last_became_active":"2024-09-22T08:15:08.975435+0000","last_became_peered":"2024-09-22T08:15:08.975435+0000","last_unstale":"2024-09-22T08:54:12.288413+0000","last_undegraded":"2024-09-22T08:54:12.288413+0000","last_fullsized":"2024-09-22T08:54:12.288413+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:08:19.699188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"263'126","reported_seq":692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.485217+0000","last_change":"2024-09-22T08:15:10.988940+0000","last_active":"2024-09-22T08:56:16.485217+0000","last_peered":"2024-09-22T08:56:16.485217+0000","last_clean":"2024-09-22T08:56:16.485217+0000","last_became_active":"2024-09-22T08:15:10.988458+0000","last_became_peered":"2024-09-22T08:15:10.988458+0000","last_unstale":"2024-09-22T08:56:16.485217+0000","last_undegraded":"2024-09-22T08:56:16.485217+0000","last_fullsized":"2024-09-22T08:56:16.485217+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:25.942851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8309,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":166,"num_read_kb":226,"num_write":90,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:07.393316+0000","last_change":"2024-09-22T08:15:13.003344+0000","last_active":"2024-09-22T08:52:07.393316+0000","last_peered":"2024-09-22T08:52:07.393316+0000","last_clean":"2024-09-22T08:52:07.393316+0000","last_became_active":"2024-09-22T08:15:13.002538+0000","last_became_peered":"2024-09-22T08:15:13.002538+0000","last_unstale":"2024-09-22T08:52:07.393316+0000","last_undegraded":"2024-09-22T08:52:07.393316+0000","last_fullsized":"2024-09-22T08:52:07.393316+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:50:12.973900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"263'2482","reported_seq":4310,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:58.403142+0000","last_change":"2024-09-22T08:15:15.020723+0000","last_active":"2024-09-22T08:54:58.403142+0000","last_peered":"2024-09-22T08:54:58.403142+0000","last_clean":"2024-09-22T08:54:58.403142+0000","last_became_active":"2024-09-22T08:15:15.020438+0000","last_became_peered":"2024-09-22T08:15:15.020438+0000","last_unstale":"2024-09-22T08:54:58.403142+0000","last_undegraded":"2024-09-22T08:54:58.403142+0000","last_fullsized":"2024-09-22T08:54:58.403142+0000","mapping_epoch":33,"log_start":"263'2400","ondisk_log_start":"263'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":2400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:19:48.770997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6235,"num_read_kb":6232,"num_write":5030,"num_write_kb":1847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"263'474","reported_seq":1996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.479833+0000","last_change":"2024-09-22T08:15:06.971112+0000","last_active":"2024-09-22T08:54:41.479833+0000","last_peered":"2024-09-22T08:54:41.479833+0000","last_clean":"2024-09-22T08:54:41.479833+0000","last_became_active":"2024-09-22T08:15:06.970532+0000","last_became_peered":"2024-09-22T08:15:06.970532+0000","last_unstale":"2024-09-22T08:54:41.479833+0000","last_undegraded":"2024-09-22T08:54:41.479833+0000","last_fullsized":"2024-09-22T08:54:41.479833+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:04:08.887293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2482,"num_read_kb":2307,"num_write":574,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"263'219","reported_seq":843,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.534906+0000","last_change":"2024-09-22T08:15:04.963933+0000","last_active":"2024-09-22T08:56:16.534906+0000","last_peered":"2024-09-22T08:56:16.534906+0000","last_clean":"2024-09-22T08:56:16.534906+0000","last_became_active":"2024-09-22T08:15:04.963648+0000","last_became_peered":"2024-09-22T08:15:04.963648+0000","last_unstale":"2024-09-22T08:56:16.534906+0000","last_undegraded":"2024-09-22T08:56:16.534906+0000","last_fullsized":"2024-09-22T08:56:16.534906+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:06:54.477482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":486,"num_read_kb":19400,"num_write":968,"num_write_kb":35249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"35'3","reported_seq":976,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:15.995729+0000","last_change":"2024-09-22T08:15:08.975603+0000","last_active":"2024-09-22T08:56:15.995729+0000","last_peered":"2024-09-22T08:56:15.995729+0000","last_clean":"2024-09-22T08:56:15.995729+0000","last_became_active":"2024-09-22T08:15:08.975260+0000","last_became_peered":"2024-09-22T08:15:08.975260+0000","last_unstale":"2024-09-22T08:56:15.995729+0000","last_undegraded":"2024-09-22T08:56:15.995729+0000","last_fullsized":"2024-09-22T08:56:15.995729+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:44:40.766275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":720,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"263'158","reported_seq":742,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.395540+0000","last_change":"2024-09-22T08:15:10.989559+0000","last_active":"2024-09-22T08:56:16.395540+0000","last_peered":"2024-09-22T08:56:16.395540+0000","last_clean":"2024-09-22T08:56:16.395540+0000","last_became_active":"2024-09-22T08:15:10.989211+0000","last_became_peered":"2024-09-22T08:15:10.989211+0000","last_unstale":"2024-09-22T08:56:16.395540+0000","last_undegraded":"2024-09-22T08:56:16.395540+0000","last_fullsized":"2024-09-22T08:56:16.395540+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9099,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":211,"num_read_kb":297,"num_write":118,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"263'792","reported_seq":2274,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.574500+0000","last_change":"2024-09-22T08:15:13.003152+0000","last_active":"2024-09-22T08:56:16.574500+0000","last_peered":"2024-09-22T08:56:16.574500+0000","last_clean":"2024-09-22T08:56:16.574500+0000","last_became_active":"2024-09-22T08:15:13.002828+0000","last_became_peered":"2024-09-22T08:15:13.002828+0000","last_unstale":"2024-09-22T08:56:16.574500+0000","last_undegraded":"2024-09-22T08:56:16.574500+0000","last_fullsized":"2024-09-22T08:56:16.574500+0000","mapping_epoch":31,"log_start":"263'701","ondisk_log_start":"263'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":701,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:50:06.133670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"263'130","reported_seq":617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:01.978028+0000","last_change":"2024-09-22T08:15:15.019494+0000","last_active":"2024-09-22T08:56:01.978028+0000","last_peered":"2024-09-22T08:56:01.978028+0000","last_clean":"2024-09-22T08:56:01.978028+0000","last_became_active":"2024-09-22T08:15:15.019162+0000","last_became_peered":"2024-09-22T08:15:15.019162+0000","last_unstale":"2024-09-22T08:56:01.978028+0000","last_undegraded":"2024-09-22T08:56:01.978028+0000","last_fullsized":"2024-09-22T08:56:01.978028+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:35:08.999759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":846,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":147,"num_read_kb":143,"num_write":317,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"263'517","reported_seq":2263,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.480093+0000","last_change":"2024-09-22T08:15:06.962857+0000","last_active":"2024-09-22T08:54:41.480093+0000","last_peered":"2024-09-22T08:54:41.480093+0000","last_clean":"2024-09-22T08:54:41.480093+0000","last_became_active":"2024-09-22T08:15:06.962528+0000","last_became_peered":"2024-09-22T08:15:06.962528+0000","last_unstale":"2024-09-22T08:54:41.480093+0000","last_undegraded":"2024-09-22T08:54:41.480093+0000","last_fullsized":"2024-09-22T08:54:41.480093+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":500,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:34:50.127904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2917,"num_read_kb":2741,"num_write":627,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"263'197","reported_seq":822,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:23.466120+0000","last_change":"2024-09-22T08:56:23.466120+0000","last_active":"2024-09-22T08:56:23.466120+0000","last_peered":"2024-09-22T08:56:23.466120+0000","last_clean":"2024-09-22T08:56:23.466120+0000","last_became_active":"2024-09-22T08:15:04.947739+0000","last_became_peered":"2024-09-22T08:15:04.947739+0000","last_unstale":"2024-09-22T08:56:23.466120+0000","last_undegraded":"2024-09-22T08:56:23.466120+0000","last_fullsized":"2024-09-22T08:56:23.466120+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'197","last_scrub_stamp":"2024-09-22T08:56:23.466035+0000","last_deep_scrub":"263'197","last_deep_scrub_stamp":"2024-09-22T08:56:23.466035+0000","last_clean_scrub_stamp":"2024-09-22T08:56:23.466035+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:03:56.435199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":453,"num_read_kb":50575,"num_write":904,"num_write_kb":23711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:12.271102+0000","last_change":"2024-09-22T08:15:08.974959+0000","last_active":"2024-09-22T08:52:12.271102+0000","last_peered":"2024-09-22T08:52:12.271102+0000","last_clean":"2024-09-22T08:52:12.271102+0000","last_became_active":"2024-09-22T08:15:08.974693+0000","last_became_peered":"2024-09-22T08:15:08.974693+0000","last_unstale":"2024-09-22T08:52:12.271102+0000","last_undegraded":"2024-09-22T08:52:12.271102+0000","last_fullsized":"2024-09-22T08:52:12.271102+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:41:04.052651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"263'193","reported_seq":820,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.504548+0000","last_change":"2024-09-22T08:15:10.984896+0000","last_active":"2024-09-22T08:56:16.504548+0000","last_peered":"2024-09-22T08:56:16.504548+0000","last_clean":"2024-09-22T08:56:16.504548+0000","last_became_active":"2024-09-22T08:15:10.984402+0000","last_became_peered":"2024-09-22T08:15:10.984402+0000","last_unstale":"2024-09-22T08:56:16.504548+0000","last_undegraded":"2024-09-22T08:56:16.504548+0000","last_fullsized":"2024-09-22T08:56:16.504548+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:10:18.043549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13027,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":258,"num_read_kb":332,"num_write":120,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:12.288559+0000","last_change":"2024-09-22T08:15:13.014853+0000","last_active":"2024-09-22T08:54:12.288559+0000","last_peered":"2024-09-22T08:54:12.288559+0000","last_clean":"2024-09-22T08:54:12.288559+0000","last_became_active":"2024-09-22T08:15:13.014612+0000","last_became_peered":"2024-09-22T08:15:13.014612+0000","last_unstale":"2024-09-22T08:54:12.288559+0000","last_undegraded":"2024-09-22T08:54:12.288559+0000","last_fullsized":"2024-09-22T08:54:12.288559+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:42:53.637961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"263'140","reported_seq":652,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:40.818796+0000","last_change":"2024-09-22T08:15:15.011646+0000","last_active":"2024-09-22T08:54:40.818796+0000","last_peered":"2024-09-22T08:54:40.818796+0000","last_clean":"2024-09-22T08:54:40.818796+0000","last_became_active":"2024-09-22T08:15:15.011332+0000","last_became_peered":"2024-09-22T08:15:15.011332+0000","last_unstale":"2024-09-22T08:54:40.818796+0000","last_undegraded":"2024-09-22T08:54:40.818796+0000","last_fullsized":"2024-09-22T08:54:40.818796+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:19:09.424500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":195,"num_read_kb":186,"num_write":318,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"263'475","reported_seq":2049,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.961820+0000","last_change":"2024-09-22T08:15:06.966989+0000","last_active":"2024-09-22T08:54:27.961820+0000","last_peered":"2024-09-22T08:54:27.961820+0000","last_clean":"2024-09-22T08:54:27.961820+0000","last_became_active":"2024-09-22T08:15:06.966708+0000","last_became_peered":"2024-09-22T08:15:06.966708+0000","last_unstale":"2024-09-22T08:54:27.961820+0000","last_undegraded":"2024-09-22T08:54:27.961820+0000","last_fullsized":"2024-09-22T08:54:27.961820+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:55:12.487019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2455,"num_read_kb":2308,"num_write":546,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"263'247","reported_seq":879,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.306459+0000","last_change":"2024-09-22T08:15:04.949510+0000","last_active":"2024-09-22T08:56:16.306459+0000","last_peered":"2024-09-22T08:56:16.306459+0000","last_clean":"2024-09-22T08:56:16.306459+0000","last_became_active":"2024-09-22T08:15:04.949202+0000","last_became_peered":"2024-09-22T08:15:04.949202+0000","last_unstale":"2024-09-22T08:56:16.306459+0000","last_undegraded":"2024-09-22T08:56:16.306459+0000","last_fullsized":"2024-09-22T08:56:16.306459+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:52:02.522606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1386384,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":583,"num_read_kb":11398,"num_write":1166,"num_write_kb":28598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:27.291253+0000","last_change":"2024-09-22T08:15:08.978620+0000","last_active":"2024-09-22T08:53:27.291253+0000","last_peered":"2024-09-22T08:53:27.291253+0000","last_clean":"2024-09-22T08:53:27.291253+0000","last_became_active":"2024-09-22T08:15:08.978280+0000","last_became_peered":"2024-09-22T08:15:08.978280+0000","last_unstale":"2024-09-22T08:53:27.291253+0000","last_undegraded":"2024-09-22T08:53:27.291253+0000","last_fullsized":"2024-09-22T08:53:27.291253+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:04:18.494310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"263'169","reported_seq":740,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.517797+0000","last_change":"2024-09-22T08:15:10.986865+0000","last_active":"2024-09-22T08:56:16.517797+0000","last_peered":"2024-09-22T08:56:16.517797+0000","last_clean":"2024-09-22T08:56:16.517797+0000","last_became_active":"2024-09-22T08:15:10.986433+0000","last_became_peered":"2024-09-22T08:15:10.986433+0000","last_unstale":"2024-09-22T08:56:16.517797+0000","last_undegraded":"2024-09-22T08:56:16.517797+0000","last_fullsized":"2024-09-22T08:56:16.517797+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:30:33.526965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8940,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":228,"num_read_kb":301,"num_write":186,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:37.292935+0000","last_change":"2024-09-22T08:15:12.999342+0000","last_active":"2024-09-22T08:53:37.292935+0000","last_peered":"2024-09-22T08:53:37.292935+0000","last_clean":"2024-09-22T08:53:37.292935+0000","last_became_active":"2024-09-22T08:15:12.999036+0000","last_became_peered":"2024-09-22T08:15:12.999036+0000","last_unstale":"2024-09-22T08:53:37.292935+0000","last_undegraded":"2024-09-22T08:53:37.292935+0000","last_fullsized":"2024-09-22T08:53:37.292935+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:32:19.162385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"263'97","reported_seq":586,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:22.299581+0000","last_change":"2024-09-22T08:15:15.012235+0000","last_active":"2024-09-22T08:55:22.299581+0000","last_peered":"2024-09-22T08:55:22.299581+0000","last_clean":"2024-09-22T08:55:22.299581+0000","last_became_active":"2024-09-22T08:15:15.011949+0000","last_became_peered":"2024-09-22T08:15:15.011949+0000","last_unstale":"2024-09-22T08:55:22.299581+0000","last_undegraded":"2024-09-22T08:55:22.299581+0000","last_fullsized":"2024-09-22T08:55:22.299581+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:28.798518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":93,"num_read_kb":93,"num_write":223,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"263'824","reported_seq":2604,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.479954+0000","last_change":"2024-09-22T08:15:06.967305+0000","last_active":"2024-09-22T08:54:41.479954+0000","last_peered":"2024-09-22T08:54:41.479954+0000","last_clean":"2024-09-22T08:54:41.479954+0000","last_became_active":"2024-09-22T08:15:06.966795+0000","last_became_peered":"2024-09-22T08:15:06.966795+0000","last_unstale":"2024-09-22T08:54:41.479954+0000","last_undegraded":"2024-09-22T08:54:41.479954+0000","last_fullsized":"2024-09-22T08:54:41.479954+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:21:48.140336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4273,"num_read_kb":3896,"num_write":1079,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"263'218","reported_seq":841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.558453+0000","last_change":"2024-09-22T08:15:04.954764+0000","last_active":"2024-09-22T08:56:16.558453+0000","last_peered":"2024-09-22T08:56:16.558453+0000","last_clean":"2024-09-22T08:56:16.558453+0000","last_became_active":"2024-09-22T08:15:04.954492+0000","last_became_peered":"2024-09-22T08:15:04.954492+0000","last_unstale":"2024-09-22T08:56:16.558453+0000","last_undegraded":"2024-09-22T08:56:16.558453+0000","last_fullsized":"2024-09-22T08:56:16.558453+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079919,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":477,"num_read_kb":44813,"num_write":947,"num_write_kb":39223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:27.282275+0000","last_change":"2024-09-22T08:15:08.977376+0000","last_active":"2024-09-22T08:53:27.282275+0000","last_peered":"2024-09-22T08:53:27.282275+0000","last_clean":"2024-09-22T08:53:27.282275+0000","last_became_active":"2024-09-22T08:15:08.976990+0000","last_became_peered":"2024-09-22T08:15:08.976990+0000","last_unstale":"2024-09-22T08:53:27.282275+0000","last_undegraded":"2024-09-22T08:53:27.282275+0000","last_fullsized":"2024-09-22T08:53:27.282275+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:28.364951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"263'149","reported_seq":732,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.458993+0000","last_change":"2024-09-22T08:15:10.979752+0000","last_active":"2024-09-22T08:56:16.458993+0000","last_peered":"2024-09-22T08:56:16.458993+0000","last_clean":"2024-09-22T08:56:16.458993+0000","last_became_active":"2024-09-22T08:15:10.979449+0000","last_became_peered":"2024-09-22T08:15:10.979449+0000","last_unstale":"2024-09-22T08:56:16.458993+0000","last_undegraded":"2024-09-22T08:56:16.458993+0000","last_fullsized":"2024-09-22T08:56:16.458993+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:04.362070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6421,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":192,"num_read_kb":205,"num_write":100,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"263'771","reported_seq":4251,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.231331+0000","last_change":"2024-09-22T08:15:13.015830+0000","last_active":"2024-09-22T08:56:16.231331+0000","last_peered":"2024-09-22T08:56:16.231331+0000","last_clean":"2024-09-22T08:56:16.231331+0000","last_became_active":"2024-09-22T08:15:13.015504+0000","last_became_peered":"2024-09-22T08:15:13.015504+0000","last_unstale":"2024-09-22T08:56:16.231331+0000","last_undegraded":"2024-09-22T08:56:16.231331+0000","last_fullsized":"2024-09-22T08:56:16.231331+0000","mapping_epoch":31,"log_start":"263'701","ondisk_log_start":"263'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":701,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:41:04.669012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"263'132","reported_seq":628,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:18.162485+0000","last_change":"2024-09-22T08:15:15.018247+0000","last_active":"2024-09-22T08:54:18.162485+0000","last_peered":"2024-09-22T08:54:18.162485+0000","last_clean":"2024-09-22T08:54:18.162485+0000","last_became_active":"2024-09-22T08:15:15.017584+0000","last_became_peered":"2024-09-22T08:15:15.017584+0000","last_unstale":"2024-09-22T08:54:18.162485+0000","last_undegraded":"2024-09-22T08:54:18.162485+0000","last_fullsized":"2024-09-22T08:54:18.162485+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:04:30.454178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":193,"num_read_kb":181,"num_write":318,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"263'745","reported_seq":2321,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:26.719305+0000","last_change":"2024-09-22T08:15:06.974286+0000","last_active":"2024-09-22T08:54:26.719305+0000","last_peered":"2024-09-22T08:54:26.719305+0000","last_clean":"2024-09-22T08:54:26.719305+0000","last_became_active":"2024-09-22T08:15:06.973918+0000","last_became_peered":"2024-09-22T08:15:06.973918+0000","last_unstale":"2024-09-22T08:54:26.719305+0000","last_undegraded":"2024-09-22T08:54:26.719305+0000","last_fullsized":"2024-09-22T08:54:26.719305+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":700,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:53:08.286370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3813,"num_read_kb":3478,"num_write":973,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"263'227","reported_seq":884,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.451732+0000","last_change":"2024-09-22T08:15:04.958607+0000","last_active":"2024-09-22T08:56:16.451732+0000","last_peered":"2024-09-22T08:56:16.451732+0000","last_clean":"2024-09-22T08:56:16.451732+0000","last_became_active":"2024-09-22T08:15:04.958336+0000","last_became_peered":"2024-09-22T08:15:04.958336+0000","last_unstale":"2024-09-22T08:56:16.451732+0000","last_undegraded":"2024-09-22T08:56:16.451732+0000","last_fullsized":"2024-09-22T08:56:16.451732+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:31:07.605629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":654,"num_read_kb":3596,"num_write":1077,"num_write_kb":27039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1447,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.007031+0000","last_change":"2024-09-22T08:15:08.982924+0000","last_active":"2024-09-22T08:56:16.007031+0000","last_peered":"2024-09-22T08:56:16.007031+0000","last_clean":"2024-09-22T08:56:16.007031+0000","last_became_active":"2024-09-22T08:15:08.982221+0000","last_became_peered":"2024-09-22T08:15:08.982221+0000","last_unstale":"2024-09-22T08:56:16.007031+0000","last_undegraded":"2024-09-22T08:56:16.007031+0000","last_fullsized":"2024-09-22T08:56:16.007031+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:06:24.534601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":950,"num_read_kb":950,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"263'73","reported_seq":585,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:42.302697+0000","last_change":"2024-09-22T08:15:10.987583+0000","last_active":"2024-09-22T08:55:42.302697+0000","last_peered":"2024-09-22T08:55:42.302697+0000","last_clean":"2024-09-22T08:55:42.302697+0000","last_became_active":"2024-09-22T08:15:10.987273+0000","last_became_peered":"2024-09-22T08:15:10.987273+0000","last_unstale":"2024-09-22T08:55:42.302697+0000","last_undegraded":"2024-09-22T08:55:42.302697+0000","last_fullsized":"2024-09-22T08:55:42.302697+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:52:00.308800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"263'791","reported_seq":2312,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.232518+0000","last_change":"2024-09-22T08:15:13.010979+0000","last_active":"2024-09-22T08:56:16.232518+0000","last_peered":"2024-09-22T08:56:16.232518+0000","last_clean":"2024-09-22T08:56:16.232518+0000","last_became_active":"2024-09-22T08:15:13.010641+0000","last_became_peered":"2024-09-22T08:15:13.010641+0000","last_unstale":"2024-09-22T08:56:16.232518+0000","last_undegraded":"2024-09-22T08:56:16.232518+0000","last_fullsized":"2024-09-22T08:56:16.232518+0000","mapping_epoch":31,"log_start":"263'701","ondisk_log_start":"263'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":701,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:31:51.024056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"263'125","reported_seq":620,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:14.425045+0000","last_change":"2024-09-22T08:15:15.015212+0000","last_active":"2024-09-22T08:54:14.425045+0000","last_peered":"2024-09-22T08:54:14.425045+0000","last_clean":"2024-09-22T08:54:14.425045+0000","last_became_active":"2024-09-22T08:15:15.014775+0000","last_became_peered":"2024-09-22T08:15:15.014775+0000","last_unstale":"2024-09-22T08:54:14.425045+0000","last_undegraded":"2024-09-22T08:54:14.425045+0000","last_fullsized":"2024-09-22T08:54:14.425045+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:24:57.427955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":160,"num_write":304,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"263'414","reported_seq":1970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:22.693834+0000","last_change":"2024-09-22T08:15:06.957525+0000","last_active":"2024-09-22T08:54:22.693834+0000","last_peered":"2024-09-22T08:54:22.693834+0000","last_clean":"2024-09-22T08:54:22.693834+0000","last_became_active":"2024-09-22T08:15:06.957239+0000","last_became_peered":"2024-09-22T08:15:06.957239+0000","last_unstale":"2024-09-22T08:54:22.693834+0000","last_undegraded":"2024-09-22T08:54:22.693834+0000","last_fullsized":"2024-09-22T08:54:22.693834+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:14:48.411753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2251,"num_read_kb":2145,"num_write":475,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"263'270","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.464029+0000","last_change":"2024-09-22T08:15:04.944257+0000","last_active":"2024-09-22T08:56:16.464029+0000","last_peered":"2024-09-22T08:56:16.464029+0000","last_clean":"2024-09-22T08:56:16.464029+0000","last_became_active":"2024-09-22T08:15:04.943906+0000","last_became_peered":"2024-09-22T08:15:04.943906+0000","last_unstale":"2024-09-22T08:56:16.464029+0000","last_undegraded":"2024-09-22T08:56:16.464029+0000","last_fullsized":"2024-09-22T08:56:16.464029+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:58:25.000568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079942,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":793,"num_read_kb":68557,"num_write":1190,"num_write_kb":29712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:23.392212+0000","last_change":"2024-09-22T08:15:08.969465+0000","last_active":"2024-09-22T08:53:23.392212+0000","last_peered":"2024-09-22T08:53:23.392212+0000","last_clean":"2024-09-22T08:53:23.392212+0000","last_became_active":"2024-09-22T08:15:08.969175+0000","last_became_peered":"2024-09-22T08:15:08.969175+0000","last_unstale":"2024-09-22T08:53:23.392212+0000","last_undegraded":"2024-09-22T08:53:23.392212+0000","last_fullsized":"2024-09-22T08:53:23.392212+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:02:12.589731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"263'194","reported_seq":796,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.352899+0000","last_change":"2024-09-22T08:15:10.987387+0000","last_active":"2024-09-22T08:56:16.352899+0000","last_peered":"2024-09-22T08:56:16.352899+0000","last_clean":"2024-09-22T08:56:16.352899+0000","last_became_active":"2024-09-22T08:15:10.987081+0000","last_became_peered":"2024-09-22T08:15:10.987081+0000","last_unstale":"2024-09-22T08:56:16.352899+0000","last_undegraded":"2024-09-22T08:56:16.352899+0000","last_fullsized":"2024-09-22T08:56:16.352899+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:27:15.431867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5409,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":251,"num_read_kb":285,"num_write":138,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:31.269342+0000","last_change":"2024-09-22T08:15:13.008391+0000","last_active":"2024-09-22T08:53:31.269342+0000","last_peered":"2024-09-22T08:53:31.269342+0000","last_clean":"2024-09-22T08:53:31.269342+0000","last_became_active":"2024-09-22T08:15:13.007735+0000","last_became_peered":"2024-09-22T08:15:13.007735+0000","last_unstale":"2024-09-22T08:53:31.269342+0000","last_undegraded":"2024-09-22T08:53:31.269342+0000","last_fullsized":"2024-09-22T08:53:31.269342+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:36:22.012503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"263'149","reported_seq":642,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:52.302863+0000","last_change":"2024-09-22T08:15:15.013532+0000","last_active":"2024-09-22T08:54:52.302863+0000","last_peered":"2024-09-22T08:54:52.302863+0000","last_clean":"2024-09-22T08:54:52.302863+0000","last_became_active":"2024-09-22T08:15:15.013216+0000","last_became_peered":"2024-09-22T08:15:15.013216+0000","last_unstale":"2024-09-22T08:54:52.302863+0000","last_undegraded":"2024-09-22T08:54:52.302863+0000","last_fullsized":"2024-09-22T08:54:52.302863+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:46:24.084971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1066,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":167,"num_read_kb":166,"num_write":339,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"263'392","reported_seq":1961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.030717+0000","last_change":"2024-09-22T08:15:06.966999+0000","last_active":"2024-09-22T08:56:02.030717+0000","last_peered":"2024-09-22T08:56:02.030717+0000","last_clean":"2024-09-22T08:56:02.030717+0000","last_became_active":"2024-09-22T08:15:06.966710+0000","last_became_peered":"2024-09-22T08:15:06.966710+0000","last_unstale":"2024-09-22T08:56:02.030717+0000","last_undegraded":"2024-09-22T08:56:02.030717+0000","last_fullsized":"2024-09-22T08:56:02.030717+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:19.004364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2363,"num_read_kb":2266,"num_write":458,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":611,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:53.387983+0000","last_change":"2024-09-22T08:14:48.585279+0000","last_active":"2024-09-22T08:52:53.387983+0000","last_peered":"2024-09-22T08:52:53.387983+0000","last_clean":"2024-09-22T08:52:53.387983+0000","last_became_active":"2024-09-22T08:14:48.584210+0000","last_became_peered":"2024-09-22T08:14:48.584210+0000","last_unstale":"2024-09-22T08:52:53.387983+0000","last_undegraded":"2024-09-22T08:52:53.387983+0000","last_fullsized":"2024-09-22T08:52:53.387983+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:47.452169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:47.452169+0000","last_clean_scrub_stamp":"2024-09-22T08:14:47.452169+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:40:54.190577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:28.385374+0000","last_change":"2024-09-22T08:14:56.729851+0000","last_active":"2024-09-22T08:52:28.385374+0000","last_peered":"2024-09-22T08:52:28.385374+0000","last_clean":"2024-09-22T08:52:28.385374+0000","last_became_active":"2024-09-22T08:14:54.727501+0000","last_became_peered":"2024-09-22T08:14:54.727501+0000","last_unstale":"2024-09-22T08:52:28.385374+0000","last_undegraded":"2024-09-22T08:52:28.385374+0000","last_fullsized":"2024-09-22T08:52:28.385374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:23:47.178939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001065632,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"263'179","reported_seq":841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:42.415042+0000","last_change":"2024-09-22T08:15:04.963864+0000","last_active":"2024-09-22T08:54:42.415042+0000","last_peered":"2024-09-22T08:54:42.415042+0000","last_clean":"2024-09-22T08:54:42.415042+0000","last_became_active":"2024-09-22T08:15:04.963447+0000","last_became_peered":"2024-09-22T08:15:04.963447+0000","last_unstale":"2024-09-22T08:54:42.415042+0000","last_undegraded":"2024-09-22T08:54:42.415042+0000","last_fullsized":"2024-09-22T08:54:42.415042+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:24:35.067492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":624,"num_read_kb":9185,"num_write":876,"num_write_kb":23340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:38.469151+0000","last_change":"2024-09-22T08:15:08.979105+0000","last_active":"2024-09-22T08:52:38.469151+0000","last_peered":"2024-09-22T08:52:38.469151+0000","last_clean":"2024-09-22T08:52:38.469151+0000","last_became_active":"2024-09-22T08:15:08.978755+0000","last_became_peered":"2024-09-22T08:15:08.978755+0000","last_unstale":"2024-09-22T08:52:38.469151+0000","last_undegraded":"2024-09-22T08:52:38.469151+0000","last_fullsized":"2024-09-22T08:52:38.469151+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:35:55.269048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"263'279","reported_seq":979,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.447679+0000","last_change":"2024-09-22T08:15:10.991397+0000","last_active":"2024-09-22T08:56:16.447679+0000","last_peered":"2024-09-22T08:56:16.447679+0000","last_clean":"2024-09-22T08:56:16.447679+0000","last_became_active":"2024-09-22T08:15:10.991050+0000","last_became_peered":"2024-09-22T08:15:10.991050+0000","last_unstale":"2024-09-22T08:56:16.447679+0000","last_undegraded":"2024-09-22T08:56:16.447679+0000","last_fullsized":"2024-09-22T08:56:16.447679+0000","mapping_epoch":29,"log_start":"260'200","ondisk_log_start":"260'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27910,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":531,"num_read_kb":745,"num_write":430,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:12.288724+0000","last_change":"2024-09-22T08:15:13.018888+0000","last_active":"2024-09-22T08:54:12.288724+0000","last_peered":"2024-09-22T08:54:12.288724+0000","last_clean":"2024-09-22T08:54:12.288724+0000","last_became_active":"2024-09-22T08:15:13.018627+0000","last_became_peered":"2024-09-22T08:15:13.018627+0000","last_unstale":"2024-09-22T08:54:12.288724+0000","last_undegraded":"2024-09-22T08:54:12.288724+0000","last_fullsized":"2024-09-22T08:54:12.288724+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:34:15.340844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"263'226","reported_seq":951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:40.424193+0000","last_change":"2024-09-22T08:15:15.017846+0000","last_active":"2024-09-22T08:54:40.424193+0000","last_peered":"2024-09-22T08:54:40.424193+0000","last_clean":"2024-09-22T08:54:40.424193+0000","last_became_active":"2024-09-22T08:15:15.017533+0000","last_became_peered":"2024-09-22T08:15:15.017533+0000","last_unstale":"2024-09-22T08:54:40.424193+0000","last_undegraded":"2024-09-22T08:54:40.424193+0000","last_fullsized":"2024-09-22T08:54:40.424193+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:27:07.313303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":616,"num_read_kb":580,"num_write":434,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"263'394","reported_seq":1957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:40.939121+0000","last_change":"2024-09-22T08:15:06.967150+0000","last_active":"2024-09-22T08:54:40.939121+0000","last_peered":"2024-09-22T08:54:40.939121+0000","last_clean":"2024-09-22T08:54:40.939121+0000","last_became_active":"2024-09-22T08:15:06.966792+0000","last_became_peered":"2024-09-22T08:15:06.966792+0000","last_unstale":"2024-09-22T08:54:40.939121+0000","last_undegraded":"2024-09-22T08:54:40.939121+0000","last_fullsized":"2024-09-22T08:54:40.939121+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:48:17.209756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2208,"num_read_kb":2116,"num_write":452,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":530,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:22.986343+0000","last_change":"2024-09-22T08:56:22.986343+0000","last_active":"2024-09-22T08:56:22.986343+0000","last_peered":"2024-09-22T08:56:22.986343+0000","last_clean":"2024-09-22T08:56:22.986343+0000","last_became_active":"2024-09-22T08:14:54.726875+0000","last_became_peered":"2024-09-22T08:14:54.726875+0000","last_unstale":"2024-09-22T08:56:22.986343+0000","last_undegraded":"2024-09-22T08:56:22.986343+0000","last_fullsized":"2024-09-22T08:56:22.986343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:22.986260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:22.986260+0000","last_clean_scrub_stamp":"2024-09-22T08:56:22.986260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:13:47.646650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000558433,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"263'180","reported_seq":785,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.389663+0000","last_change":"2024-09-22T08:15:04.964320+0000","last_active":"2024-09-22T08:56:16.389663+0000","last_peered":"2024-09-22T08:56:16.389663+0000","last_clean":"2024-09-22T08:56:16.389663+0000","last_became_active":"2024-09-22T08:15:04.963967+0000","last_became_peered":"2024-09-22T08:15:04.963967+0000","last_unstale":"2024-09-22T08:56:16.389663+0000","last_undegraded":"2024-09-22T08:56:16.389663+0000","last_fullsized":"2024-09-22T08:56:16.389663+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:27:24.495059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":424,"num_read_kb":76135,"num_write":811,"num_write_kb":37187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:08.397709+0000","last_change":"2024-09-22T08:15:08.969618+0000","last_active":"2024-09-22T08:54:08.397709+0000","last_peered":"2024-09-22T08:54:08.397709+0000","last_clean":"2024-09-22T08:54:08.397709+0000","last_became_active":"2024-09-22T08:15:08.969276+0000","last_became_peered":"2024-09-22T08:15:08.969276+0000","last_unstale":"2024-09-22T08:54:08.397709+0000","last_undegraded":"2024-09-22T08:54:08.397709+0000","last_fullsized":"2024-09-22T08:54:08.397709+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:45:38.728128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"263'861","reported_seq":2292,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.492952+0000","last_change":"2024-09-22T08:15:10.984491+0000","last_active":"2024-09-22T08:56:16.492952+0000","last_peered":"2024-09-22T08:56:16.492952+0000","last_clean":"2024-09-22T08:56:16.492952+0000","last_became_active":"2024-09-22T08:15:10.984157+0000","last_became_peered":"2024-09-22T08:15:10.984157+0000","last_unstale":"2024-09-22T08:56:16.492952+0000","last_undegraded":"2024-09-22T08:56:16.492952+0000","last_fullsized":"2024-09-22T08:56:16.492952+0000","mapping_epoch":29,"log_start":"263'800","ondisk_log_start":"263'800","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":800,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:22:53.295285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49716,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1169,"num_read_kb":1404,"num_write":276,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:48.387989+0000","last_change":"2024-09-22T08:15:13.012134+0000","last_active":"2024-09-22T08:52:48.387989+0000","last_peered":"2024-09-22T08:52:48.387989+0000","last_clean":"2024-09-22T08:52:48.387989+0000","last_became_active":"2024-09-22T08:15:13.011864+0000","last_became_peered":"2024-09-22T08:15:13.011864+0000","last_unstale":"2024-09-22T08:52:48.387989+0000","last_undegraded":"2024-09-22T08:52:48.387989+0000","last_fullsized":"2024-09-22T08:52:48.387989+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:25:33.123487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"263'214","reported_seq":740,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:21.016218+0000","last_change":"2024-09-22T08:15:15.014316+0000","last_active":"2024-09-22T08:54:21.016218+0000","last_peered":"2024-09-22T08:54:21.016218+0000","last_clean":"2024-09-22T08:54:21.016218+0000","last_became_active":"2024-09-22T08:15:15.014003+0000","last_became_peered":"2024-09-22T08:15:15.014003+0000","last_unstale":"2024-09-22T08:54:21.016218+0000","last_undegraded":"2024-09-22T08:54:21.016218+0000","last_fullsized":"2024-09-22T08:54:21.016218+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:43:13.045667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":401,"num_read_kb":391,"num_write":491,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"263'696","reported_seq":2529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.362007+0000","last_change":"2024-09-22T08:15:06.973031+0000","last_active":"2024-09-22T08:54:27.362007+0000","last_peered":"2024-09-22T08:54:27.362007+0000","last_clean":"2024-09-22T08:54:27.362007+0000","last_became_active":"2024-09-22T08:15:06.972591+0000","last_became_peered":"2024-09-22T08:15:06.972591+0000","last_unstale":"2024-09-22T08:54:27.362007+0000","last_undegraded":"2024-09-22T08:54:27.362007+0000","last_fullsized":"2024-09-22T08:54:27.362007+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":600,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:47.241992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3779,"num_read_kb":3472,"num_write":954,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:27.282937+0000","last_change":"2024-09-22T08:14:56.717627+0000","last_active":"2024-09-22T08:52:27.282937+0000","last_peered":"2024-09-22T08:52:27.282937+0000","last_clean":"2024-09-22T08:52:27.282937+0000","last_became_active":"2024-09-22T08:14:54.718660+0000","last_became_peered":"2024-09-22T08:14:54.718660+0000","last_unstale":"2024-09-22T08:52:27.282937+0000","last_undegraded":"2024-09-22T08:52:27.282937+0000","last_fullsized":"2024-09-22T08:52:27.282937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:04:54.693455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042448600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"263'260","reported_seq":945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.513802+0000","last_change":"2024-09-22T08:15:04.956486+0000","last_active":"2024-09-22T08:56:16.513802+0000","last_peered":"2024-09-22T08:56:16.513802+0000","last_clean":"2024-09-22T08:56:16.513802+0000","last_became_active":"2024-09-22T08:15:04.954726+0000","last_became_peered":"2024-09-22T08:15:04.954726+0000","last_unstale":"2024-09-22T08:56:16.513802+0000","last_undegraded":"2024-09-22T08:56:16.513802+0000","last_fullsized":"2024-09-22T08:56:16.513802+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:50:58.850263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":813,"num_read_kb":7176,"num_write":1020,"num_write_kb":41627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:12.297346+0000","last_change":"2024-09-22T08:15:08.974770+0000","last_active":"2024-09-22T08:54:12.297346+0000","last_peered":"2024-09-22T08:54:12.297346+0000","last_clean":"2024-09-22T08:54:12.297346+0000","last_became_active":"2024-09-22T08:15:08.974419+0000","last_became_peered":"2024-09-22T08:15:08.974419+0000","last_unstale":"2024-09-22T08:54:12.297346+0000","last_undegraded":"2024-09-22T08:54:12.297346+0000","last_fullsized":"2024-09-22T08:54:12.297346+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:25:16.095099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"263'233","reported_seq":1269,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:03.082254+0000","last_change":"2024-09-22T08:15:10.987757+0000","last_active":"2024-09-22T08:56:03.082254+0000","last_peered":"2024-09-22T08:56:03.082254+0000","last_clean":"2024-09-22T08:56:03.082254+0000","last_became_active":"2024-09-22T08:15:10.987358+0000","last_became_peered":"2024-09-22T08:15:10.987358+0000","last_unstale":"2024-09-22T08:56:03.082254+0000","last_undegraded":"2024-09-22T08:56:03.082254+0000","last_fullsized":"2024-09-22T08:56:03.082254+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:37:21.645192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":174,"num_read_kb":166,"num_write":139,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:42.398346+0000","last_change":"2024-09-22T08:15:13.010215+0000","last_active":"2024-09-22T08:52:42.398346+0000","last_peered":"2024-09-22T08:52:42.398346+0000","last_clean":"2024-09-22T08:52:42.398346+0000","last_became_active":"2024-09-22T08:15:13.009891+0000","last_became_peered":"2024-09-22T08:15:13.009891+0000","last_unstale":"2024-09-22T08:52:42.398346+0000","last_undegraded":"2024-09-22T08:52:42.398346+0000","last_fullsized":"2024-09-22T08:52:42.398346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:10:10.890953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"263'244","reported_seq":839,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.629431+0000","last_change":"2024-09-22T08:15:15.018070+0000","last_active":"2024-09-22T08:54:41.629431+0000","last_peered":"2024-09-22T08:54:41.629431+0000","last_clean":"2024-09-22T08:54:41.629431+0000","last_became_active":"2024-09-22T08:15:15.017686+0000","last_became_peered":"2024-09-22T08:15:15.017686+0000","last_unstale":"2024-09-22T08:54:41.629431+0000","last_undegraded":"2024-09-22T08:54:41.629431+0000","last_fullsized":"2024-09-22T08:54:41.629431+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:59:24.235010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":504,"num_read_kb":528,"num_write":541,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"263'456","reported_seq":1982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.479919+0000","last_change":"2024-09-22T08:15:06.963038+0000","last_active":"2024-09-22T08:54:41.479919+0000","last_peered":"2024-09-22T08:54:41.479919+0000","last_clean":"2024-09-22T08:54:41.479919+0000","last_became_active":"2024-09-22T08:15:06.962486+0000","last_became_peered":"2024-09-22T08:15:06.962486+0000","last_unstale":"2024-09-22T08:54:41.479919+0000","last_undegraded":"2024-09-22T08:54:41.479919+0000","last_fullsized":"2024-09-22T08:54:41.479919+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:46:27.014096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2436,"num_read_kb":2281,"num_write":554,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:28.385348+0000","last_change":"2024-09-22T08:14:56.729819+0000","last_active":"2024-09-22T08:52:28.385348+0000","last_peered":"2024-09-22T08:52:28.385348+0000","last_clean":"2024-09-22T08:52:28.385348+0000","last_became_active":"2024-09-22T08:14:55.586088+0000","last_became_peered":"2024-09-22T08:14:55.586088+0000","last_unstale":"2024-09-22T08:52:28.385348+0000","last_undegraded":"2024-09-22T08:52:28.385348+0000","last_fullsized":"2024-09-22T08:52:28.385348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:11:26.177736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010233219999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"263'164","reported_seq":760,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:21.464541+0000","last_change":"2024-09-22T08:56:21.464541+0000","last_active":"2024-09-22T08:56:21.464541+0000","last_peered":"2024-09-22T08:56:21.464541+0000","last_clean":"2024-09-22T08:56:21.464541+0000","last_became_active":"2024-09-22T08:15:04.963894+0000","last_became_peered":"2024-09-22T08:15:04.963894+0000","last_unstale":"2024-09-22T08:56:21.464541+0000","last_undegraded":"2024-09-22T08:56:21.464541+0000","last_fullsized":"2024-09-22T08:56:21.464541+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'164","last_scrub_stamp":"2024-09-22T08:56:21.464437+0000","last_deep_scrub":"263'164","last_deep_scrub_stamp":"2024-09-22T08:56:21.464437+0000","last_clean_scrub_stamp":"2024-09-22T08:56:21.464437+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:37:48.941982+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":412,"num_read_kb":11085,"num_write":748,"num_write_kb":14868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:52.286614+0000","last_change":"2024-09-22T08:15:08.968415+0000","last_active":"2024-09-22T08:52:52.286614+0000","last_peered":"2024-09-22T08:52:52.286614+0000","last_clean":"2024-09-22T08:52:52.286614+0000","last_became_active":"2024-09-22T08:15:08.968076+0000","last_became_peered":"2024-09-22T08:15:08.968076+0000","last_unstale":"2024-09-22T08:52:52.286614+0000","last_undegraded":"2024-09-22T08:52:52.286614+0000","last_fullsized":"2024-09-22T08:52:52.286614+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:46:34.843923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"263'111","reported_seq":651,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:03.502269+0000","last_change":"2024-09-22T08:15:10.992735+0000","last_active":"2024-09-22T08:56:03.502269+0000","last_peered":"2024-09-22T08:56:03.502269+0000","last_clean":"2024-09-22T08:56:03.502269+0000","last_became_active":"2024-09-22T08:15:10.992450+0000","last_became_peered":"2024-09-22T08:15:10.992450+0000","last_unstale":"2024-09-22T08:56:03.502269+0000","last_undegraded":"2024-09-22T08:56:03.502269+0000","last_fullsized":"2024-09-22T08:56:03.502269+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:04:43.027150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":139,"num_read_kb":133,"num_write":98,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:13.398284+0000","last_change":"2024-09-22T08:15:13.012190+0000","last_active":"2024-09-22T08:54:13.398284+0000","last_peered":"2024-09-22T08:54:13.398284+0000","last_clean":"2024-09-22T08:54:13.398284+0000","last_became_active":"2024-09-22T08:15:13.011756+0000","last_became_peered":"2024-09-22T08:15:13.011756+0000","last_unstale":"2024-09-22T08:54:13.398284+0000","last_undegraded":"2024-09-22T08:54:13.398284+0000","last_fullsized":"2024-09-22T08:54:13.398284+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"263'109","reported_seq":659,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:23.867017+0000","last_change":"2024-09-22T08:15:15.017200+0000","last_active":"2024-09-22T08:54:23.867017+0000","last_peered":"2024-09-22T08:54:23.867017+0000","last_clean":"2024-09-22T08:54:23.867017+0000","last_became_active":"2024-09-22T08:15:15.016910+0000","last_became_peered":"2024-09-22T08:15:15.016910+0000","last_unstale":"2024-09-22T08:54:23.867017+0000","last_undegraded":"2024-09-22T08:54:23.867017+0000","last_fullsized":"2024-09-22T08:54:23.867017+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:32:32.592078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":271,"num_read_kb":261,"num_write":275,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"263'846","reported_seq":2453,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:24.609357+0000","last_change":"2024-09-22T08:15:06.965563+0000","last_active":"2024-09-22T08:54:24.609357+0000","last_peered":"2024-09-22T08:54:24.609357+0000","last_clean":"2024-09-22T08:54:24.609357+0000","last_became_active":"2024-09-22T08:15:06.965021+0000","last_became_peered":"2024-09-22T08:15:06.965021+0000","last_unstale":"2024-09-22T08:54:24.609357+0000","last_undegraded":"2024-09-22T08:54:24.609357+0000","last_fullsized":"2024-09-22T08:54:24.609357+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":800,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:23:54.792970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4016,"num_read_kb":3619,"num_write":1120,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"263'173","reported_seq":779,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.371991+0000","last_change":"2024-09-22T08:15:04.960052+0000","last_active":"2024-09-22T08:56:16.371991+0000","last_peered":"2024-09-22T08:56:16.371991+0000","last_clean":"2024-09-22T08:56:16.371991+0000","last_became_active":"2024-09-22T08:15:04.958834+0000","last_became_peered":"2024-09-22T08:15:04.958834+0000","last_unstale":"2024-09-22T08:56:16.371991+0000","last_undegraded":"2024-09-22T08:56:16.371991+0000","last_fullsized":"2024-09-22T08:56:16.371991+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:26:47.552408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":466,"num_read_kb":15054,"num_write":837,"num_write_kb":27215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:27.273473+0000","last_change":"2024-09-22T08:14:56.801946+0000","last_active":"2024-09-22T08:52:27.273473+0000","last_peered":"2024-09-22T08:52:27.273473+0000","last_clean":"2024-09-22T08:52:27.273473+0000","last_became_active":"2024-09-22T08:14:55.585738+0000","last_became_peered":"2024-09-22T08:14:55.585738+0000","last_unstale":"2024-09-22T08:52:27.273473+0000","last_undegraded":"2024-09-22T08:52:27.273473+0000","last_fullsized":"2024-09-22T08:52:27.273473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:33:45.401549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053802500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:42.398327+0000","last_change":"2024-09-22T08:15:08.975546+0000","last_active":"2024-09-22T08:52:42.398327+0000","last_peered":"2024-09-22T08:52:42.398327+0000","last_clean":"2024-09-22T08:52:42.398327+0000","last_became_active":"2024-09-22T08:15:08.975175+0000","last_became_peered":"2024-09-22T08:15:08.975175+0000","last_unstale":"2024-09-22T08:52:42.398327+0000","last_undegraded":"2024-09-22T08:52:42.398327+0000","last_fullsized":"2024-09-22T08:52:42.398327+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:08:07.721638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"263'293","reported_seq":956,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.453257+0000","last_change":"2024-09-22T08:15:10.982518+0000","last_active":"2024-09-22T08:56:16.453257+0000","last_peered":"2024-09-22T08:56:16.453257+0000","last_clean":"2024-09-22T08:56:16.453257+0000","last_became_active":"2024-09-22T08:15:10.982147+0000","last_became_peered":"2024-09-22T08:15:10.982147+0000","last_unstale":"2024-09-22T08:56:16.453257+0000","last_undegraded":"2024-09-22T08:56:16.453257+0000","last_fullsized":"2024-09-22T08:56:16.453257+0000","mapping_epoch":29,"log_start":"260'200","ondisk_log_start":"260'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:56:53.506784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30730,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1060,"num_read_kb":1272,"num_write":1552,"num_write_kb":1410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:46.263665+0000","last_change":"2024-09-22T08:15:13.014254+0000","last_active":"2024-09-22T08:52:46.263665+0000","last_peered":"2024-09-22T08:52:46.263665+0000","last_clean":"2024-09-22T08:52:46.263665+0000","last_became_active":"2024-09-22T08:15:13.013980+0000","last_became_peered":"2024-09-22T08:15:13.013980+0000","last_unstale":"2024-09-22T08:52:46.263665+0000","last_undegraded":"2024-09-22T08:52:46.263665+0000","last_fullsized":"2024-09-22T08:52:46.263665+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:43:47.566603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"263'169","reported_seq":721,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.923448+0000","last_change":"2024-09-22T08:15:15.012481+0000","last_active":"2024-09-22T08:54:38.923448+0000","last_peered":"2024-09-22T08:54:38.923448+0000","last_clean":"2024-09-22T08:54:38.923448+0000","last_became_active":"2024-09-22T08:15:15.012146+0000","last_became_peered":"2024-09-22T08:15:15.012146+0000","last_unstale":"2024-09-22T08:54:38.923448+0000","last_undegraded":"2024-09-22T08:54:38.923448+0000","last_fullsized":"2024-09-22T08:54:38.923448+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:12:50.086341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":420,"num_read_kb":363,"num_write":419,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"263'442","reported_seq":2036,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.480349+0000","last_change":"2024-09-22T08:15:06.973875+0000","last_active":"2024-09-22T08:54:41.480349+0000","last_peered":"2024-09-22T08:54:41.480349+0000","last_clean":"2024-09-22T08:54:41.480349+0000","last_became_active":"2024-09-22T08:15:06.973563+0000","last_became_peered":"2024-09-22T08:15:06.973563+0000","last_unstale":"2024-09-22T08:54:41.480349+0000","last_undegraded":"2024-09-22T08:54:41.480349+0000","last_fullsized":"2024-09-22T08:54:41.480349+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:06:45.622252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2370,"num_read_kb":2248,"num_write":498,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"263'189","reported_seq":810,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.434906+0000","last_change":"2024-09-22T08:15:04.956915+0000","last_active":"2024-09-22T08:56:16.434906+0000","last_peered":"2024-09-22T08:56:16.434906+0000","last_clean":"2024-09-22T08:56:16.434906+0000","last_became_active":"2024-09-22T08:15:04.956585+0000","last_became_peered":"2024-09-22T08:15:04.956585+0000","last_unstale":"2024-09-22T08:56:16.434906+0000","last_undegraded":"2024-09-22T08:56:16.434906+0000","last_fullsized":"2024-09-22T08:56:16.434906+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:18.062351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":533,"num_read_kb":28072,"num_write":815,"num_write_kb":27925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:33.386112+0000","last_change":"2024-09-22T08:14:56.729377+0000","last_active":"2024-09-22T08:52:33.386112+0000","last_peered":"2024-09-22T08:52:33.386112+0000","last_clean":"2024-09-22T08:52:33.386112+0000","last_became_active":"2024-09-22T08:14:54.727321+0000","last_became_peered":"2024-09-22T08:14:54.727321+0000","last_unstale":"2024-09-22T08:52:33.386112+0000","last_undegraded":"2024-09-22T08:52:33.386112+0000","last_fullsized":"2024-09-22T08:52:33.386112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:21:23.198586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058148900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:38.469084+0000","last_change":"2024-09-22T08:15:08.975127+0000","last_active":"2024-09-22T08:52:38.469084+0000","last_peered":"2024-09-22T08:52:38.469084+0000","last_clean":"2024-09-22T08:52:38.469084+0000","last_became_active":"2024-09-22T08:15:08.974823+0000","last_became_peered":"2024-09-22T08:15:08.974823+0000","last_unstale":"2024-09-22T08:52:38.469084+0000","last_undegraded":"2024-09-22T08:52:38.469084+0000","last_fullsized":"2024-09-22T08:52:38.469084+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:35:56.356491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"263'158","reported_seq":713,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.767668+0000","last_change":"2024-09-22T08:15:10.991721+0000","last_active":"2024-09-22T08:55:19.767668+0000","last_peered":"2024-09-22T08:55:19.767668+0000","last_clean":"2024-09-22T08:55:19.767668+0000","last_became_active":"2024-09-22T08:15:10.991426+0000","last_became_peered":"2024-09-22T08:15:10.991426+0000","last_unstale":"2024-09-22T08:55:19.767668+0000","last_undegraded":"2024-09-22T08:55:19.767668+0000","last_fullsized":"2024-09-22T08:55:19.767668+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:13:29.594926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":204,"num_read_kb":193,"num_write":140,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"263'790","reported_seq":4936,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.228586+0000","last_change":"2024-09-22T08:15:13.014146+0000","last_active":"2024-09-22T08:56:16.228586+0000","last_peered":"2024-09-22T08:56:16.228586+0000","last_clean":"2024-09-22T08:56:16.228586+0000","last_became_active":"2024-09-22T08:15:13.013828+0000","last_became_peered":"2024-09-22T08:15:13.013828+0000","last_unstale":"2024-09-22T08:56:16.228586+0000","last_undegraded":"2024-09-22T08:56:16.228586+0000","last_fullsized":"2024-09-22T08:56:16.228586+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:14:34.454135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"263'140","reported_seq":640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:57.311692+0000","last_change":"2024-09-22T08:15:15.014270+0000","last_active":"2024-09-22T08:55:57.311692+0000","last_peered":"2024-09-22T08:55:57.311692+0000","last_clean":"2024-09-22T08:55:57.311692+0000","last_became_active":"2024-09-22T08:15:15.013976+0000","last_became_peered":"2024-09-22T08:15:15.013976+0000","last_unstale":"2024-09-22T08:55:57.311692+0000","last_undegraded":"2024-09-22T08:55:57.311692+0000","last_fullsized":"2024-09-22T08:55:57.311692+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:36:15.356232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":177,"num_read_kb":172,"num_write":337,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"263'452","reported_seq":1950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.926375+0000","last_change":"2024-09-22T08:15:06.966706+0000","last_active":"2024-09-22T08:54:38.926375+0000","last_peered":"2024-09-22T08:54:38.926375+0000","last_clean":"2024-09-22T08:54:38.926375+0000","last_became_active":"2024-09-22T08:15:06.966387+0000","last_became_peered":"2024-09-22T08:15:06.966387+0000","last_unstale":"2024-09-22T08:54:38.926375+0000","last_undegraded":"2024-09-22T08:54:38.926375+0000","last_fullsized":"2024-09-22T08:54:38.926375+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:16:14.149148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2402,"num_read_kb":2235,"num_write":539,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"263'205","reported_seq":835,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.558391+0000","last_change":"2024-09-22T08:15:04.952329+0000","last_active":"2024-09-22T08:56:16.558391+0000","last_peered":"2024-09-22T08:56:16.558391+0000","last_clean":"2024-09-22T08:56:16.558391+0000","last_became_active":"2024-09-22T08:15:04.951731+0000","last_became_peered":"2024-09-22T08:15:04.951731+0000","last_unstale":"2024-09-22T08:56:16.558391+0000","last_undegraded":"2024-09-22T08:56:16.558391+0000","last_fullsized":"2024-09-22T08:56:16.558391+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:44:40.856747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079922,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":440,"num_read_kb":57796,"num_write":879,"num_write_kb":62478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:57.408520+0000","last_change":"2024-09-22T08:14:56.713315+0000","last_active":"2024-09-22T08:53:57.408520+0000","last_peered":"2024-09-22T08:53:57.408520+0000","last_clean":"2024-09-22T08:53:57.408520+0000","last_became_active":"2024-09-22T08:14:55.585607+0000","last_became_peered":"2024-09-22T08:14:55.585607+0000","last_unstale":"2024-09-22T08:53:57.408520+0000","last_undegraded":"2024-09-22T08:53:57.408520+0000","last_fullsized":"2024-09-22T08:53:57.408520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:00:51.872643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049298099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:38.386674+0000","last_change":"2024-09-22T08:15:08.969703+0000","last_active":"2024-09-22T08:52:38.386674+0000","last_peered":"2024-09-22T08:52:38.386674+0000","last_clean":"2024-09-22T08:52:38.386674+0000","last_became_active":"2024-09-22T08:15:08.969373+0000","last_became_peered":"2024-09-22T08:15:08.969373+0000","last_unstale":"2024-09-22T08:52:38.386674+0000","last_undegraded":"2024-09-22T08:52:38.386674+0000","last_fullsized":"2024-09-22T08:52:38.386674+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:47:22.188961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"263'106","reported_seq":641,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.751986+0000","last_change":"2024-09-22T08:15:10.986552+0000","last_active":"2024-09-22T08:55:19.751986+0000","last_peered":"2024-09-22T08:55:19.751986+0000","last_clean":"2024-09-22T08:55:19.751986+0000","last_became_active":"2024-09-22T08:15:10.984232+0000","last_became_peered":"2024-09-22T08:15:10.984232+0000","last_unstale":"2024-09-22T08:55:19.751986+0000","last_undegraded":"2024-09-22T08:55:19.751986+0000","last_fullsized":"2024-09-22T08:55:19.751986+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:21.636103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":116,"num_write":82,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"263'792","reported_seq":2214,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.233603+0000","last_change":"2024-09-22T08:15:13.008717+0000","last_active":"2024-09-22T08:56:16.233603+0000","last_peered":"2024-09-22T08:56:16.233603+0000","last_clean":"2024-09-22T08:56:16.233603+0000","last_became_active":"2024-09-22T08:15:13.008027+0000","last_became_peered":"2024-09-22T08:15:13.008027+0000","last_unstale":"2024-09-22T08:56:16.233603+0000","last_undegraded":"2024-09-22T08:56:16.233603+0000","last_fullsized":"2024-09-22T08:56:16.233603+0000","mapping_epoch":31,"log_start":"263'701","ondisk_log_start":"263'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":701,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:47:23.567624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"263'198","reported_seq":712,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:51.192463+0000","last_change":"2024-09-22T08:15:15.014730+0000","last_active":"2024-09-22T08:53:51.192463+0000","last_peered":"2024-09-22T08:53:51.192463+0000","last_clean":"2024-09-22T08:53:51.192463+0000","last_became_active":"2024-09-22T08:15:15.014423+0000","last_became_peered":"2024-09-22T08:15:15.014423+0000","last_unstale":"2024-09-22T08:53:51.192463+0000","last_undegraded":"2024-09-22T08:53:51.192463+0000","last_fullsized":"2024-09-22T08:53:51.192463+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:25:32.708147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":250,"num_read_kb":232,"num_write":460,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"263'497","reported_seq":2058,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.360747+0000","last_change":"2024-09-22T08:15:06.968425+0000","last_active":"2024-09-22T08:54:27.360747+0000","last_peered":"2024-09-22T08:54:27.360747+0000","last_clean":"2024-09-22T08:54:27.360747+0000","last_became_active":"2024-09-22T08:15:06.968153+0000","last_became_peered":"2024-09-22T08:15:06.968153+0000","last_unstale":"2024-09-22T08:54:27.360747+0000","last_undegraded":"2024-09-22T08:54:27.360747+0000","last_fullsized":"2024-09-22T08:54:27.360747+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:29:50.157707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2565,"num_read_kb":2386,"num_write":597,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"263'198","reported_seq":816,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.531962+0000","last_change":"2024-09-22T08:15:04.944258+0000","last_active":"2024-09-22T08:56:16.531962+0000","last_peered":"2024-09-22T08:56:16.531962+0000","last_clean":"2024-09-22T08:56:16.531962+0000","last_became_active":"2024-09-22T08:15:04.943901+0000","last_became_peered":"2024-09-22T08:15:04.943901+0000","last_unstale":"2024-09-22T08:56:16.531962+0000","last_undegraded":"2024-09-22T08:56:16.531962+0000","last_fullsized":"2024-09-22T08:56:16.531962+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:56:16.418792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":512,"num_read_kb":4964,"num_write":959,"num_write_kb":21539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:58.396569+0000","last_change":"2024-09-22T08:14:56.730085+0000","last_active":"2024-09-22T08:53:58.396569+0000","last_peered":"2024-09-22T08:53:58.396569+0000","last_clean":"2024-09-22T08:53:58.396569+0000","last_became_active":"2024-09-22T08:14:55.585485+0000","last_became_peered":"2024-09-22T08:14:55.585485+0000","last_unstale":"2024-09-22T08:53:58.396569+0000","last_undegraded":"2024-09-22T08:53:58.396569+0000","last_fullsized":"2024-09-22T08:53:58.396569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.700271+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.700271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:42:52.718426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012642249999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:17.402768+0000","last_change":"2024-09-22T08:15:08.979746+0000","last_active":"2024-09-22T08:53:17.402768+0000","last_peered":"2024-09-22T08:53:17.402768+0000","last_clean":"2024-09-22T08:53:17.402768+0000","last_became_active":"2024-09-22T08:15:08.979291+0000","last_became_peered":"2024-09-22T08:15:08.979291+0000","last_unstale":"2024-09-22T08:53:17.402768+0000","last_undegraded":"2024-09-22T08:53:17.402768+0000","last_fullsized":"2024-09-22T08:53:17.402768+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:35:42.491182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"263'321","reported_seq":1032,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.563281+0000","last_change":"2024-09-22T08:15:10.979541+0000","last_active":"2024-09-22T08:56:16.563281+0000","last_peered":"2024-09-22T08:56:16.563281+0000","last_clean":"2024-09-22T08:56:16.563281+0000","last_became_active":"2024-09-22T08:15:10.979261+0000","last_became_peered":"2024-09-22T08:15:10.979261+0000","last_unstale":"2024-09-22T08:56:16.563281+0000","last_undegraded":"2024-09-22T08:56:16.563281+0000","last_fullsized":"2024-09-22T08:56:16.563281+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:29:00.655646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25829,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":462,"num_read_kb":686,"num_write":234,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:42.398292+0000","last_change":"2024-09-22T08:15:13.003662+0000","last_active":"2024-09-22T08:52:42.398292+0000","last_peered":"2024-09-22T08:52:42.398292+0000","last_clean":"2024-09-22T08:52:42.398292+0000","last_became_active":"2024-09-22T08:15:13.003041+0000","last_became_peered":"2024-09-22T08:15:13.003041+0000","last_unstale":"2024-09-22T08:52:42.398292+0000","last_undegraded":"2024-09-22T08:52:42.398292+0000","last_fullsized":"2024-09-22T08:52:42.398292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:43:46.552092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"263'126","reported_seq":624,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:09.125091+0000","last_change":"2024-09-22T08:15:15.015370+0000","last_active":"2024-09-22T08:54:09.125091+0000","last_peered":"2024-09-22T08:54:09.125091+0000","last_clean":"2024-09-22T08:54:09.125091+0000","last_became_active":"2024-09-22T08:15:15.014775+0000","last_became_peered":"2024-09-22T08:15:15.014775+0000","last_unstale":"2024-09-22T08:54:09.125091+0000","last_undegraded":"2024-09-22T08:54:09.125091+0000","last_fullsized":"2024-09-22T08:54:09.125091+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:42:57.977942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":162,"num_read_kb":158,"num_write":286,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"263'108","reported_seq":658,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.586531+0000","last_change":"2024-09-22T08:15:15.020963+0000","last_active":"2024-09-22T08:54:41.586531+0000","last_peered":"2024-09-22T08:54:41.586531+0000","last_clean":"2024-09-22T08:54:41.586531+0000","last_became_active":"2024-09-22T08:15:15.020653+0000","last_became_peered":"2024-09-22T08:15:15.020653+0000","last_unstale":"2024-09-22T08:54:41.586531+0000","last_undegraded":"2024-09-22T08:54:41.586531+0000","last_fullsized":"2024-09-22T08:54:41.586531+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:30:42.055327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":202,"num_read_kb":202,"num_write":258,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"263'487","reported_seq":2210,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.031042+0000","last_change":"2024-09-22T08:15:06.970797+0000","last_active":"2024-09-22T08:56:02.031042+0000","last_peered":"2024-09-22T08:56:02.031042+0000","last_clean":"2024-09-22T08:56:02.031042+0000","last_became_active":"2024-09-22T08:15:06.970382+0000","last_became_peered":"2024-09-22T08:15:06.970382+0000","last_unstale":"2024-09-22T08:56:02.031042+0000","last_undegraded":"2024-09-22T08:56:02.031042+0000","last_fullsized":"2024-09-22T08:56:02.031042+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:20:33.767995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2792,"num_read_kb":2647,"num_write":560,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"263'225","reported_seq":872,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.438881+0000","last_change":"2024-09-22T08:15:04.966483+0000","last_active":"2024-09-22T08:56:16.438881+0000","last_peered":"2024-09-22T08:56:16.438881+0000","last_clean":"2024-09-22T08:56:16.438881+0000","last_became_active":"2024-09-22T08:15:04.965572+0000","last_became_peered":"2024-09-22T08:15:04.965572+0000","last_unstale":"2024-09-22T08:56:16.438881+0000","last_undegraded":"2024-09-22T08:56:16.438881+0000","last_fullsized":"2024-09-22T08:56:16.438881+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:27:30.805751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":598,"num_read_kb":42984,"num_write":1013,"num_write_kb":35756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:32.274252+0000","last_change":"2024-09-22T08:15:08.976752+0000","last_active":"2024-09-22T08:52:32.274252+0000","last_peered":"2024-09-22T08:52:32.274252+0000","last_clean":"2024-09-22T08:52:32.274252+0000","last_became_active":"2024-09-22T08:15:08.976444+0000","last_became_peered":"2024-09-22T08:15:08.976444+0000","last_unstale":"2024-09-22T08:52:32.274252+0000","last_undegraded":"2024-09-22T08:52:32.274252+0000","last_fullsized":"2024-09-22T08:52:32.274252+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:57:35.914622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"263'133","reported_seq":699,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.383600+0000","last_change":"2024-09-22T08:15:10.987944+0000","last_active":"2024-09-22T08:56:16.383600+0000","last_peered":"2024-09-22T08:56:16.383600+0000","last_clean":"2024-09-22T08:56:16.383600+0000","last_became_active":"2024-09-22T08:15:10.987623+0000","last_became_peered":"2024-09-22T08:15:10.987623+0000","last_unstale":"2024-09-22T08:56:16.383600+0000","last_undegraded":"2024-09-22T08:56:16.383600+0000","last_fullsized":"2024-09-22T08:56:16.383600+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:57:31.114053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8761,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":170,"num_read_kb":207,"num_write":88,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:32.283704+0000","last_change":"2024-09-22T08:15:12.997719+0000","last_active":"2024-09-22T08:52:32.283704+0000","last_peered":"2024-09-22T08:52:32.283704+0000","last_clean":"2024-09-22T08:52:32.283704+0000","last_became_active":"2024-09-22T08:15:12.997350+0000","last_became_peered":"2024-09-22T08:15:12.997350+0000","last_unstale":"2024-09-22T08:52:32.283704+0000","last_undegraded":"2024-09-22T08:52:32.283704+0000","last_fullsized":"2024-09-22T08:52:32.283704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:08:30.511917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"263'110","reported_seq":606,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.956370+0000","last_change":"2024-09-22T08:15:15.017170+0000","last_active":"2024-09-22T08:54:27.956370+0000","last_peered":"2024-09-22T08:54:27.956370+0000","last_clean":"2024-09-22T08:54:27.956370+0000","last_became_active":"2024-09-22T08:15:15.016918+0000","last_became_peered":"2024-09-22T08:15:15.016918+0000","last_unstale":"2024-09-22T08:54:27.956370+0000","last_undegraded":"2024-09-22T08:54:27.956370+0000","last_fullsized":"2024-09-22T08:54:27.956370+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:37:28.672486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":125,"num_write":254,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"263'1037","reported_seq":2820,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:23.395142+0000","last_change":"2024-09-22T08:15:06.965797+0000","last_active":"2024-09-22T08:54:23.395142+0000","last_peered":"2024-09-22T08:54:23.395142+0000","last_clean":"2024-09-22T08:54:23.395142+0000","last_became_active":"2024-09-22T08:15:06.965465+0000","last_became_peered":"2024-09-22T08:15:06.965465+0000","last_unstale":"2024-09-22T08:54:23.395142+0000","last_undegraded":"2024-09-22T08:54:23.395142+0000","last_fullsized":"2024-09-22T08:54:23.395142+0000","mapping_epoch":25,"log_start":"263'1000","ondisk_log_start":"263'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":1000,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:50:52.178644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5105,"num_read_kb":4580,"num_write":1460,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"263'207","reported_seq":825,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.513571+0000","last_change":"2024-09-22T08:15:04.949496+0000","last_active":"2024-09-22T08:56:16.513571+0000","last_peered":"2024-09-22T08:56:16.513571+0000","last_clean":"2024-09-22T08:56:16.513571+0000","last_became_active":"2024-09-22T08:15:04.949181+0000","last_became_peered":"2024-09-22T08:15:04.949181+0000","last_unstale":"2024-09-22T08:56:16.513571+0000","last_undegraded":"2024-09-22T08:56:16.513571+0000","last_fullsized":"2024-09-22T08:56:16.513571+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:45:42.806686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":538,"num_read_kb":11766,"num_write":957,"num_write_kb":45959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:32.396743+0000","last_change":"2024-09-22T08:15:08.976023+0000","last_active":"2024-09-22T08:52:32.396743+0000","last_peered":"2024-09-22T08:52:32.396743+0000","last_clean":"2024-09-22T08:52:32.396743+0000","last_became_active":"2024-09-22T08:15:08.975704+0000","last_became_peered":"2024-09-22T08:15:08.975704+0000","last_unstale":"2024-09-22T08:52:32.396743+0000","last_undegraded":"2024-09-22T08:52:32.396743+0000","last_fullsized":"2024-09-22T08:52:32.396743+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:17:14.568660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"263'38","reported_seq":538,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.550720+0000","last_change":"2024-09-22T08:15:10.983890+0000","last_active":"2024-09-22T08:55:19.550720+0000","last_peered":"2024-09-22T08:55:19.550720+0000","last_clean":"2024-09-22T08:55:19.550720+0000","last_became_active":"2024-09-22T08:15:10.983593+0000","last_became_peered":"2024-09-22T08:15:10.983593+0000","last_unstale":"2024-09-22T08:55:19.550720+0000","last_undegraded":"2024-09-22T08:55:19.550720+0000","last_fullsized":"2024-09-22T08:55:19.550720+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:52:12.816398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:36.262497+0000","last_change":"2024-09-22T08:15:13.019365+0000","last_active":"2024-09-22T08:52:36.262497+0000","last_peered":"2024-09-22T08:52:36.262497+0000","last_clean":"2024-09-22T08:52:36.262497+0000","last_became_active":"2024-09-22T08:15:13.019020+0000","last_became_peered":"2024-09-22T08:15:13.019020+0000","last_unstale":"2024-09-22T08:52:36.262497+0000","last_undegraded":"2024-09-22T08:52:36.262497+0000","last_fullsized":"2024-09-22T08:52:36.262497+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:35:35.235215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"263'182","reported_seq":702,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:40.942611+0000","last_change":"2024-09-22T08:15:15.013674+0000","last_active":"2024-09-22T08:54:40.942611+0000","last_peered":"2024-09-22T08:54:40.942611+0000","last_clean":"2024-09-22T08:54:40.942611+0000","last_became_active":"2024-09-22T08:15:15.013300+0000","last_became_peered":"2024-09-22T08:15:15.013300+0000","last_unstale":"2024-09-22T08:54:40.942611+0000","last_undegraded":"2024-09-22T08:54:40.942611+0000","last_fullsized":"2024-09-22T08:54:40.942611+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:24:00.672977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":337,"num_read_kb":325,"num_write":401,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"263'1197","reported_seq":2836,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.361022+0000","last_change":"2024-09-22T08:15:06.957428+0000","last_active":"2024-09-22T08:54:27.361022+0000","last_peered":"2024-09-22T08:54:27.361022+0000","last_clean":"2024-09-22T08:54:27.361022+0000","last_became_active":"2024-09-22T08:15:06.957116+0000","last_became_peered":"2024-09-22T08:15:06.957116+0000","last_unstale":"2024-09-22T08:54:27.361022+0000","last_undegraded":"2024-09-22T08:54:27.361022+0000","last_fullsized":"2024-09-22T08:54:27.361022+0000","mapping_epoch":25,"log_start":"263'1100","ondisk_log_start":"263'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":1100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:50:47.227003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5635,"num_read_kb":5002,"num_write":1685,"num_write_kb":733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"263'190","reported_seq":804,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.331202+0000","last_change":"2024-09-22T08:15:04.969475+0000","last_active":"2024-09-22T08:56:16.331202+0000","last_peered":"2024-09-22T08:56:16.331202+0000","last_clean":"2024-09-22T08:56:16.331202+0000","last_became_active":"2024-09-22T08:15:04.968557+0000","last_became_peered":"2024-09-22T08:15:04.968557+0000","last_unstale":"2024-09-22T08:56:16.331202+0000","last_undegraded":"2024-09-22T08:56:16.331202+0000","last_fullsized":"2024-09-22T08:56:16.331202+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:09:13.268818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079920,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":520,"num_read_kb":8164,"num_write":864,"num_write_kb":39531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:31.261934+0000","last_change":"2024-09-22T08:15:08.975282+0000","last_active":"2024-09-22T08:52:31.261934+0000","last_peered":"2024-09-22T08:52:31.261934+0000","last_clean":"2024-09-22T08:52:31.261934+0000","last_became_active":"2024-09-22T08:15:08.975001+0000","last_became_peered":"2024-09-22T08:15:08.975001+0000","last_unstale":"2024-09-22T08:52:31.261934+0000","last_undegraded":"2024-09-22T08:52:31.261934+0000","last_fullsized":"2024-09-22T08:52:31.261934+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:33.382158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"263'169","reported_seq":759,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.286569+0000","last_change":"2024-09-22T08:15:10.980804+0000","last_active":"2024-09-22T08:56:16.286569+0000","last_peered":"2024-09-22T08:56:16.286569+0000","last_clean":"2024-09-22T08:56:16.286569+0000","last_became_active":"2024-09-22T08:15:10.980443+0000","last_became_peered":"2024-09-22T08:15:10.980443+0000","last_unstale":"2024-09-22T08:56:16.286569+0000","last_undegraded":"2024-09-22T08:56:16.286569+0000","last_fullsized":"2024-09-22T08:56:16.286569+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:05:27.025223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":222,"num_read_kb":300,"num_write":124,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:33.385632+0000","last_change":"2024-09-22T08:15:13.010967+0000","last_active":"2024-09-22T08:52:33.385632+0000","last_peered":"2024-09-22T08:52:33.385632+0000","last_clean":"2024-09-22T08:52:33.385632+0000","last_became_active":"2024-09-22T08:15:13.010660+0000","last_became_peered":"2024-09-22T08:15:13.010660+0000","last_unstale":"2024-09-22T08:52:33.385632+0000","last_undegraded":"2024-09-22T08:52:33.385632+0000","last_fullsized":"2024-09-22T08:52:33.385632+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:04:33.172378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"263'141","reported_seq":674,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:23.390425+0000","last_change":"2024-09-22T08:15:15.015966+0000","last_active":"2024-09-22T08:54:23.390425+0000","last_peered":"2024-09-22T08:54:23.390425+0000","last_clean":"2024-09-22T08:54:23.390425+0000","last_became_active":"2024-09-22T08:15:15.015497+0000","last_became_peered":"2024-09-22T08:15:15.015497+0000","last_unstale":"2024-09-22T08:54:23.390425+0000","last_undegraded":"2024-09-22T08:54:23.390425+0000","last_fullsized":"2024-09-22T08:54:23.390425+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:19:47.834057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":885,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":300,"num_read_kb":272,"num_write":341,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"263'915","reported_seq":2761,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.032493+0000","last_change":"2024-09-22T08:15:06.964381+0000","last_active":"2024-09-22T08:56:02.032493+0000","last_peered":"2024-09-22T08:56:02.032493+0000","last_clean":"2024-09-22T08:56:02.032493+0000","last_became_active":"2024-09-22T08:15:06.964082+0000","last_became_peered":"2024-09-22T08:15:06.964082+0000","last_unstale":"2024-09-22T08:56:02.032493+0000","last_undegraded":"2024-09-22T08:56:02.032493+0000","last_fullsized":"2024-09-22T08:56:02.032493+0000","mapping_epoch":25,"log_start":"263'900","ondisk_log_start":"263'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":900,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:59:59.631124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4594,"num_read_kb":4173,"num_write":1193,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"263'259","reported_seq":885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.532208+0000","last_change":"2024-09-22T08:15:04.956185+0000","last_active":"2024-09-22T08:56:16.532208+0000","last_peered":"2024-09-22T08:56:16.532208+0000","last_clean":"2024-09-22T08:56:16.532208+0000","last_became_active":"2024-09-22T08:15:04.954431+0000","last_became_peered":"2024-09-22T08:15:04.954431+0000","last_unstale":"2024-09-22T08:56:16.532208+0000","last_undegraded":"2024-09-22T08:56:16.532208+0000","last_fullsized":"2024-09-22T08:56:16.532208+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:58:31.332537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":625,"num_read_kb":10749,"num_write":1043,"num_write_kb":36368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:28.385312+0000","last_change":"2024-09-22T08:15:08.978366+0000","last_active":"2024-09-22T08:52:28.385312+0000","last_peered":"2024-09-22T08:52:28.385312+0000","last_clean":"2024-09-22T08:52:28.385312+0000","last_became_active":"2024-09-22T08:15:08.978080+0000","last_became_peered":"2024-09-22T08:15:08.978080+0000","last_unstale":"2024-09-22T08:52:28.385312+0000","last_undegraded":"2024-09-22T08:52:28.385312+0000","last_fullsized":"2024-09-22T08:52:28.385312+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:58:42.395174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"263'136","reported_seq":699,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.537765+0000","last_change":"2024-09-22T08:15:10.975370+0000","last_active":"2024-09-22T08:56:16.537765+0000","last_peered":"2024-09-22T08:56:16.537765+0000","last_clean":"2024-09-22T08:56:16.537765+0000","last_became_active":"2024-09-22T08:15:10.975066+0000","last_became_peered":"2024-09-22T08:15:10.975066+0000","last_unstale":"2024-09-22T08:56:16.537765+0000","last_undegraded":"2024-09-22T08:56:16.537765+0000","last_fullsized":"2024-09-22T08:56:16.537765+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:20:29.364085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4721,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":157,"num_read_kb":223,"num_write":80,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:32.283752+0000","last_change":"2024-09-22T08:15:13.008345+0000","last_active":"2024-09-22T08:52:32.283752+0000","last_peered":"2024-09-22T08:52:32.283752+0000","last_clean":"2024-09-22T08:52:32.283752+0000","last_became_active":"2024-09-22T08:15:13.008005+0000","last_became_peered":"2024-09-22T08:15:13.008005+0000","last_unstale":"2024-09-22T08:52:32.283752+0000","last_undegraded":"2024-09-22T08:52:32.283752+0000","last_fullsized":"2024-09-22T08:52:32.283752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:44:00.256968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"263'386","reported_seq":1910,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:19.614767+0000","last_change":"2024-09-22T08:15:06.974360+0000","last_active":"2024-09-22T08:54:19.614767+0000","last_peered":"2024-09-22T08:54:19.614767+0000","last_clean":"2024-09-22T08:54:19.614767+0000","last_became_active":"2024-09-22T08:15:06.974083+0000","last_became_peered":"2024-09-22T08:15:06.974083+0000","last_unstale":"2024-09-22T08:54:19.614767+0000","last_undegraded":"2024-09-22T08:54:19.614767+0000","last_fullsized":"2024-09-22T08:54:19.614767+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:42:23.068549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2095,"num_read_kb":2009,"num_write":415,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"263'216","reported_seq":850,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.483594+0000","last_change":"2024-09-22T08:15:04.953656+0000","last_active":"2024-09-22T08:56:16.483594+0000","last_peered":"2024-09-22T08:56:16.483594+0000","last_clean":"2024-09-22T08:56:16.483594+0000","last_became_active":"2024-09-22T08:15:04.953371+0000","last_became_peered":"2024-09-22T08:15:04.953371+0000","last_unstale":"2024-09-22T08:56:16.483594+0000","last_undegraded":"2024-09-22T08:56:16.483594+0000","last_fullsized":"2024-09-22T08:56:16.483594+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:18:43.995683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079956,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":551,"num_read_kb":20845,"num_write":984,"num_write_kb":34041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:22.281487+0000","last_change":"2024-09-22T08:15:08.978352+0000","last_active":"2024-09-22T08:53:22.281487+0000","last_peered":"2024-09-22T08:53:22.281487+0000","last_clean":"2024-09-22T08:53:22.281487+0000","last_became_active":"2024-09-22T08:15:08.977975+0000","last_became_peered":"2024-09-22T08:15:08.977975+0000","last_unstale":"2024-09-22T08:53:22.281487+0000","last_undegraded":"2024-09-22T08:53:22.281487+0000","last_fullsized":"2024-09-22T08:53:22.281487+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:36:49.695370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"263'212","reported_seq":832,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.526285+0000","last_change":"2024-09-22T08:15:10.985792+0000","last_active":"2024-09-22T08:56:16.526285+0000","last_peered":"2024-09-22T08:56:16.526285+0000","last_clean":"2024-09-22T08:56:16.526285+0000","last_became_active":"2024-09-22T08:15:10.985454+0000","last_became_peered":"2024-09-22T08:15:10.985454+0000","last_unstale":"2024-09-22T08:56:16.526285+0000","last_undegraded":"2024-09-22T08:56:16.526285+0000","last_fullsized":"2024-09-22T08:56:16.526285+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:42:16.011379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24540,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":311,"num_read_kb":482,"num_write":196,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:46.263744+0000","last_change":"2024-09-22T08:15:13.008746+0000","last_active":"2024-09-22T08:52:46.263744+0000","last_peered":"2024-09-22T08:52:46.263744+0000","last_clean":"2024-09-22T08:52:46.263744+0000","last_became_active":"2024-09-22T08:15:13.008080+0000","last_became_peered":"2024-09-22T08:15:13.008080+0000","last_unstale":"2024-09-22T08:52:46.263744+0000","last_undegraded":"2024-09-22T08:52:46.263744+0000","last_fullsized":"2024-09-22T08:52:46.263744+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:40:33.932227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"263'174","reported_seq":680,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.958769+0000","last_change":"2024-09-22T08:15:15.014411+0000","last_active":"2024-09-22T08:54:27.958769+0000","last_peered":"2024-09-22T08:54:27.958769+0000","last_clean":"2024-09-22T08:54:27.958769+0000","last_became_active":"2024-09-22T08:15:15.014112+0000","last_became_peered":"2024-09-22T08:15:15.014112+0000","last_unstale":"2024-09-22T08:54:27.958769+0000","last_undegraded":"2024-09-22T08:54:27.958769+0000","last_fullsized":"2024-09-22T08:54:27.958769+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:23:12.522068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":264,"num_read_kb":269,"num_write":416,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"263'430","reported_seq":2036,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.040119+0000","last_change":"2024-09-22T08:15:06.967093+0000","last_active":"2024-09-22T08:56:02.040119+0000","last_peered":"2024-09-22T08:56:02.040119+0000","last_clean":"2024-09-22T08:56:02.040119+0000","last_became_active":"2024-09-22T08:15:06.966715+0000","last_became_peered":"2024-09-22T08:15:06.966715+0000","last_unstale":"2024-09-22T08:56:02.040119+0000","last_undegraded":"2024-09-22T08:56:02.040119+0000","last_fullsized":"2024-09-22T08:56:02.040119+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:36:05.010276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2445,"num_read_kb":2324,"num_write":493,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"263'212","reported_seq":876,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.551729+0000","last_change":"2024-09-22T08:15:04.951193+0000","last_active":"2024-09-22T08:56:16.551729+0000","last_peered":"2024-09-22T08:56:16.551729+0000","last_clean":"2024-09-22T08:56:16.551729+0000","last_became_active":"2024-09-22T08:15:04.950890+0000","last_became_peered":"2024-09-22T08:15:04.950890+0000","last_unstale":"2024-09-22T08:56:16.551729+0000","last_undegraded":"2024-09-22T08:56:16.551729+0000","last_fullsized":"2024-09-22T08:56:16.551729+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:58:21.202885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":625,"num_read_kb":94909,"num_write":959,"num_write_kb":40287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"35'4","reported_seq":973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:15.994400+0000","last_change":"2024-09-22T08:15:08.977689+0000","last_active":"2024-09-22T08:56:15.994400+0000","last_peered":"2024-09-22T08:56:15.994400+0000","last_clean":"2024-09-22T08:56:15.994400+0000","last_became_active":"2024-09-22T08:15:08.977250+0000","last_became_peered":"2024-09-22T08:15:08.977250+0000","last_unstale":"2024-09-22T08:56:15.994400+0000","last_undegraded":"2024-09-22T08:56:15.994400+0000","last_fullsized":"2024-09-22T08:56:15.994400+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:54:28.653095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":1187,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"263'169","reported_seq":750,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.552982+0000","last_change":"2024-09-22T08:15:10.988286+0000","last_active":"2024-09-22T08:56:16.552982+0000","last_peered":"2024-09-22T08:56:16.552982+0000","last_clean":"2024-09-22T08:56:16.552982+0000","last_became_active":"2024-09-22T08:15:10.987541+0000","last_became_peered":"2024-09-22T08:15:10.987541+0000","last_unstale":"2024-09-22T08:56:16.552982+0000","last_undegraded":"2024-09-22T08:56:16.552982+0000","last_fullsized":"2024-09-22T08:56:16.552982+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:03:59.129935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":217,"num_read_kb":244,"num_write":140,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:42.275936+0000","last_change":"2024-09-22T08:15:13.012164+0000","last_active":"2024-09-22T08:52:42.275936+0000","last_peered":"2024-09-22T08:52:42.275936+0000","last_clean":"2024-09-22T08:52:42.275936+0000","last_became_active":"2024-09-22T08:15:13.011781+0000","last_became_peered":"2024-09-22T08:15:13.011781+0000","last_unstale":"2024-09-22T08:52:42.275936+0000","last_undegraded":"2024-09-22T08:52:42.275936+0000","last_fullsized":"2024-09-22T08:52:42.275936+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:36:44.769092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"263'184","reported_seq":694,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:01.978766+0000","last_change":"2024-09-22T08:15:15.011928+0000","last_active":"2024-09-22T08:56:01.978766+0000","last_peered":"2024-09-22T08:56:01.978766+0000","last_clean":"2024-09-22T08:56:01.978766+0000","last_became_active":"2024-09-22T08:15:15.011648+0000","last_became_peered":"2024-09-22T08:15:15.011648+0000","last_unstale":"2024-09-22T08:56:01.978766+0000","last_undegraded":"2024-09-22T08:56:01.978766+0000","last_fullsized":"2024-09-22T08:56:01.978766+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:40:53.969713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":287,"num_read_kb":275,"num_write":539,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"263'437","reported_seq":1950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.032917+0000","last_change":"2024-09-22T08:15:06.972503+0000","last_active":"2024-09-22T08:56:02.032917+0000","last_peered":"2024-09-22T08:56:02.032917+0000","last_clean":"2024-09-22T08:56:02.032917+0000","last_became_active":"2024-09-22T08:15:06.972213+0000","last_became_peered":"2024-09-22T08:15:06.972213+0000","last_unstale":"2024-09-22T08:56:02.032917+0000","last_undegraded":"2024-09-22T08:56:02.032917+0000","last_fullsized":"2024-09-22T08:56:02.032917+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:02:45.936755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2524,"num_read_kb":2354,"num_write":541,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"263'244","reported_seq":877,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.510415+0000","last_change":"2024-09-22T08:15:04.960034+0000","last_active":"2024-09-22T08:56:16.510415+0000","last_peered":"2024-09-22T08:56:16.510415+0000","last_clean":"2024-09-22T08:56:16.510415+0000","last_became_active":"2024-09-22T08:15:04.959607+0000","last_became_peered":"2024-09-22T08:15:04.959607+0000","last_unstale":"2024-09-22T08:56:16.510415+0000","last_undegraded":"2024-09-22T08:56:16.510415+0000","last_fullsized":"2024-09-22T08:56:16.510415+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:36:26.063552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079903,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":565,"num_read_kb":22702,"num_write":1145,"num_write_kb":43754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:41.263102+0000","last_change":"2024-09-22T08:15:08.975205+0000","last_active":"2024-09-22T08:52:41.263102+0000","last_peered":"2024-09-22T08:52:41.263102+0000","last_clean":"2024-09-22T08:52:41.263102+0000","last_became_active":"2024-09-22T08:15:08.974925+0000","last_became_peered":"2024-09-22T08:15:08.974925+0000","last_unstale":"2024-09-22T08:52:41.263102+0000","last_undegraded":"2024-09-22T08:52:41.263102+0000","last_fullsized":"2024-09-22T08:52:41.263102+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:08:36.707707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"263'148","reported_seq":716,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.421615+0000","last_change":"2024-09-22T08:15:10.985655+0000","last_active":"2024-09-22T08:56:16.421615+0000","last_peered":"2024-09-22T08:56:16.421615+0000","last_clean":"2024-09-22T08:56:16.421615+0000","last_became_active":"2024-09-22T08:15:10.985312+0000","last_became_peered":"2024-09-22T08:15:10.985312+0000","last_unstale":"2024-09-22T08:56:16.421615+0000","last_undegraded":"2024-09-22T08:56:16.421615+0000","last_fullsized":"2024-09-22T08:56:16.421615+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:32:30.326830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9037,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":176,"num_read_kb":231,"num_write":94,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:22.290600+0000","last_change":"2024-09-22T08:15:12.998592+0000","last_active":"2024-09-22T08:53:22.290600+0000","last_peered":"2024-09-22T08:53:22.290600+0000","last_clean":"2024-09-22T08:53:22.290600+0000","last_became_active":"2024-09-22T08:15:12.998276+0000","last_became_peered":"2024-09-22T08:15:12.998276+0000","last_unstale":"2024-09-22T08:53:22.290600+0000","last_undegraded":"2024-09-22T08:53:22.290600+0000","last_fullsized":"2024-09-22T08:53:22.290600+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:45:18.409944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"263'129","reported_seq":634,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:03.364497+0000","last_change":"2024-09-22T08:15:15.022528+0000","last_active":"2024-09-22T08:56:03.364497+0000","last_peered":"2024-09-22T08:56:03.364497+0000","last_clean":"2024-09-22T08:56:03.364497+0000","last_became_active":"2024-09-22T08:15:15.022140+0000","last_became_peered":"2024-09-22T08:15:15.022140+0000","last_unstale":"2024-09-22T08:56:03.364497+0000","last_undegraded":"2024-09-22T08:56:03.364497+0000","last_fullsized":"2024-09-22T08:56:03.364497+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:19:15.143722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":810,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":211,"num_read_kb":192,"num_write":312,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"263'532","reported_seq":2401,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.961208+0000","last_change":"2024-09-22T08:15:06.963522+0000","last_active":"2024-09-22T08:54:27.961208+0000","last_peered":"2024-09-22T08:54:27.961208+0000","last_clean":"2024-09-22T08:54:27.961208+0000","last_became_active":"2024-09-22T08:15:06.963136+0000","last_became_peered":"2024-09-22T08:15:06.963136+0000","last_unstale":"2024-09-22T08:54:27.961208+0000","last_undegraded":"2024-09-22T08:54:27.961208+0000","last_fullsized":"2024-09-22T08:54:27.961208+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":500,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:27:39.654856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3196,"num_read_kb":3015,"num_write":651,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"263'227","reported_seq":849,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.484031+0000","last_change":"2024-09-22T08:15:04.962067+0000","last_active":"2024-09-22T08:56:16.484031+0000","last_peered":"2024-09-22T08:56:16.484031+0000","last_clean":"2024-09-22T08:56:16.484031+0000","last_became_active":"2024-09-22T08:15:04.961731+0000","last_became_peered":"2024-09-22T08:15:04.961731+0000","last_unstale":"2024-09-22T08:56:16.484031+0000","last_undegraded":"2024-09-22T08:56:16.484031+0000","last_fullsized":"2024-09-22T08:56:16.484031+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:15:56.579006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079902,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":556,"num_read_kb":16778,"num_write":1039,"num_write_kb":35959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:42.398363+0000","last_change":"2024-09-22T08:15:08.974366+0000","last_active":"2024-09-22T08:52:42.398363+0000","last_peered":"2024-09-22T08:52:42.398363+0000","last_clean":"2024-09-22T08:52:42.398363+0000","last_became_active":"2024-09-22T08:15:08.973985+0000","last_became_peered":"2024-09-22T08:15:08.973985+0000","last_unstale":"2024-09-22T08:52:42.398363+0000","last_undegraded":"2024-09-22T08:52:42.398363+0000","last_fullsized":"2024-09-22T08:52:42.398363+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:43:10.742833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"263'91","reported_seq":611,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.764889+0000","last_change":"2024-09-22T08:15:10.991408+0000","last_active":"2024-09-22T08:55:19.764889+0000","last_peered":"2024-09-22T08:55:19.764889+0000","last_clean":"2024-09-22T08:55:19.764889+0000","last_became_active":"2024-09-22T08:15:10.991099+0000","last_became_peered":"2024-09-22T08:15:10.991099+0000","last_unstale":"2024-09-22T08:55:19.764889+0000","last_undegraded":"2024-09-22T08:55:19.764889+0000","last_fullsized":"2024-09-22T08:55:19.764889+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:03.952941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":117,"num_read_kb":110,"num_write":130,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"263'772","reported_seq":2290,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.227168+0000","last_change":"2024-09-22T08:15:13.020129+0000","last_active":"2024-09-22T08:56:16.227168+0000","last_peered":"2024-09-22T08:56:16.227168+0000","last_clean":"2024-09-22T08:56:16.227168+0000","last_became_active":"2024-09-22T08:15:13.018826+0000","last_became_peered":"2024-09-22T08:15:13.018826+0000","last_unstale":"2024-09-22T08:56:16.227168+0000","last_undegraded":"2024-09-22T08:56:16.227168+0000","last_fullsized":"2024-09-22T08:56:16.227168+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:17:45.964569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"263'136","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:22.688867+0000","last_change":"2024-09-22T08:15:15.017866+0000","last_active":"2024-09-22T08:54:22.688867+0000","last_peered":"2024-09-22T08:54:22.688867+0000","last_clean":"2024-09-22T08:54:22.688867+0000","last_became_active":"2024-09-22T08:15:15.017568+0000","last_became_peered":"2024-09-22T08:15:15.017568+0000","last_unstale":"2024-09-22T08:54:22.688867+0000","last_undegraded":"2024-09-22T08:54:22.688867+0000","last_fullsized":"2024-09-22T08:54:22.688867+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:37:11.451571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":178,"num_write":322,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"263'422","reported_seq":1876,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.030317+0000","last_change":"2024-09-22T08:15:06.973437+0000","last_active":"2024-09-22T08:56:02.030317+0000","last_peered":"2024-09-22T08:56:02.030317+0000","last_clean":"2024-09-22T08:56:02.030317+0000","last_became_active":"2024-09-22T08:15:06.973142+0000","last_became_peered":"2024-09-22T08:15:06.973142+0000","last_unstale":"2024-09-22T08:56:02.030317+0000","last_undegraded":"2024-09-22T08:56:02.030317+0000","last_fullsized":"2024-09-22T08:56:02.030317+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:42:57.640096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2325,"num_read_kb":2186,"num_write":496,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"263'204","reported_seq":802,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:14.348112+0000","last_change":"2024-09-22T08:15:04.955055+0000","last_active":"2024-09-22T08:53:14.348112+0000","last_peered":"2024-09-22T08:53:14.348112+0000","last_clean":"2024-09-22T08:53:14.348112+0000","last_became_active":"2024-09-22T08:15:04.954608+0000","last_became_peered":"2024-09-22T08:15:04.954608+0000","last_unstale":"2024-09-22T08:53:14.348112+0000","last_undegraded":"2024-09-22T08:53:14.348112+0000","last_fullsized":"2024-09-22T08:53:14.348112+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:48:59.571776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":469,"num_read_kb":8602,"num_write":952,"num_write_kb":32105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:38.386310+0000","last_change":"2024-09-22T08:15:08.980771+0000","last_active":"2024-09-22T08:52:38.386310+0000","last_peered":"2024-09-22T08:52:38.386310+0000","last_clean":"2024-09-22T08:52:38.386310+0000","last_became_active":"2024-09-22T08:15:08.980570+0000","last_became_peered":"2024-09-22T08:15:08.980570+0000","last_unstale":"2024-09-22T08:52:38.386310+0000","last_undegraded":"2024-09-22T08:52:38.386310+0000","last_fullsized":"2024-09-22T08:52:38.386310+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:52:24.440386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"263'163","reported_seq":741,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.468746+0000","last_change":"2024-09-22T08:15:10.979788+0000","last_active":"2024-09-22T08:56:16.468746+0000","last_peered":"2024-09-22T08:56:16.468746+0000","last_clean":"2024-09-22T08:56:16.468746+0000","last_became_active":"2024-09-22T08:15:10.979384+0000","last_became_peered":"2024-09-22T08:15:10.979384+0000","last_unstale":"2024-09-22T08:56:16.468746+0000","last_undegraded":"2024-09-22T08:56:16.468746+0000","last_fullsized":"2024-09-22T08:56:16.468746+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10195,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":216,"num_read_kb":291,"num_write":126,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:52.407725+0000","last_change":"2024-09-22T08:15:13.013531+0000","last_active":"2024-09-22T08:53:52.407725+0000","last_peered":"2024-09-22T08:53:52.407725+0000","last_clean":"2024-09-22T08:53:52.407725+0000","last_became_active":"2024-09-22T08:15:13.013160+0000","last_became_peered":"2024-09-22T08:15:13.013160+0000","last_unstale":"2024-09-22T08:53:52.407725+0000","last_undegraded":"2024-09-22T08:53:52.407725+0000","last_fullsized":"2024-09-22T08:53:52.407725+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:55:35.021615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"263'138","reported_seq":640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.356176+0000","last_change":"2024-09-22T08:15:15.021053+0000","last_active":"2024-09-22T08:54:27.356176+0000","last_peered":"2024-09-22T08:54:27.356176+0000","last_clean":"2024-09-22T08:54:27.356176+0000","last_became_active":"2024-09-22T08:15:15.020718+0000","last_became_peered":"2024-09-22T08:15:15.020718+0000","last_unstale":"2024-09-22T08:54:27.356176+0000","last_undegraded":"2024-09-22T08:54:27.356176+0000","last_fullsized":"2024-09-22T08:54:27.356176+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":211,"num_read_kb":197,"num_write":330,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"263'800","reported_seq":2276,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.926503+0000","last_change":"2024-09-22T08:15:06.970563+0000","last_active":"2024-09-22T08:54:38.926503+0000","last_peered":"2024-09-22T08:54:38.926503+0000","last_clean":"2024-09-22T08:54:38.926503+0000","last_became_active":"2024-09-22T08:15:06.970077+0000","last_became_peered":"2024-09-22T08:15:06.970077+0000","last_unstale":"2024-09-22T08:54:38.926503+0000","last_undegraded":"2024-09-22T08:54:38.926503+0000","last_fullsized":"2024-09-22T08:54:38.926503+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:50:00.177977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3751,"num_read_kb":3364,"num_write":1047,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"263'200","reported_seq":912,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.508716+0000","last_change":"2024-09-22T08:15:04.962527+0000","last_active":"2024-09-22T08:56:16.508716+0000","last_peered":"2024-09-22T08:56:16.508716+0000","last_clean":"2024-09-22T08:56:16.508716+0000","last_became_active":"2024-09-22T08:15:04.962268+0000","last_became_peered":"2024-09-22T08:15:04.962268+0000","last_unstale":"2024-09-22T08:56:16.508716+0000","last_undegraded":"2024-09-22T08:56:16.508716+0000","last_fullsized":"2024-09-22T08:56:16.508716+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:54:23.748527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":783,"num_read_kb":150382,"num_write":906,"num_write_kb":51576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:41.263079+0000","last_change":"2024-09-22T08:15:08.977670+0000","last_active":"2024-09-22T08:52:41.263079+0000","last_peered":"2024-09-22T08:52:41.263079+0000","last_clean":"2024-09-22T08:52:41.263079+0000","last_became_active":"2024-09-22T08:15:08.977341+0000","last_became_peered":"2024-09-22T08:15:08.977341+0000","last_unstale":"2024-09-22T08:52:41.263079+0000","last_undegraded":"2024-09-22T08:52:41.263079+0000","last_fullsized":"2024-09-22T08:52:41.263079+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:18:39.684334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"263'127","reported_seq":692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.479118+0000","last_change":"2024-09-22T08:15:10.981034+0000","last_active":"2024-09-22T08:56:16.479118+0000","last_peered":"2024-09-22T08:56:16.479118+0000","last_clean":"2024-09-22T08:56:16.479118+0000","last_became_active":"2024-09-22T08:15:10.980015+0000","last_became_peered":"2024-09-22T08:15:10.980015+0000","last_unstale":"2024-09-22T08:56:16.479118+0000","last_undegraded":"2024-09-22T08:56:16.479118+0000","last_fullsized":"2024-09-22T08:56:16.479118+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:10:49.816903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20804,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":281,"num_write":88,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:58.396470+0000","last_change":"2024-09-22T08:15:13.012480+0000","last_active":"2024-09-22T08:53:58.396470+0000","last_peered":"2024-09-22T08:53:58.396470+0000","last_clean":"2024-09-22T08:53:58.396470+0000","last_became_active":"2024-09-22T08:15:13.011134+0000","last_became_peered":"2024-09-22T08:15:13.011134+0000","last_unstale":"2024-09-22T08:53:58.396470+0000","last_undegraded":"2024-09-22T08:53:58.396470+0000","last_fullsized":"2024-09-22T08:53:58.396470+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"263'150","reported_seq":671,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.477364+0000","last_change":"2024-09-22T08:15:15.013212+0000","last_active":"2024-09-22T08:54:41.477364+0000","last_peered":"2024-09-22T08:54:41.477364+0000","last_clean":"2024-09-22T08:54:41.477364+0000","last_became_active":"2024-09-22T08:15:15.012939+0000","last_became_peered":"2024-09-22T08:15:15.012939+0000","last_unstale":"2024-09-22T08:54:41.477364+0000","last_undegraded":"2024-09-22T08:54:41.477364+0000","last_fullsized":"2024-09-22T08:54:41.477364+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:08:40.354379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":256,"num_read_kb":247,"num_write":364,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"263'562","reported_seq":2356,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.480043+0000","last_change":"2024-09-22T08:15:06.960886+0000","last_active":"2024-09-22T08:54:41.480043+0000","last_peered":"2024-09-22T08:54:41.480043+0000","last_clean":"2024-09-22T08:54:41.480043+0000","last_became_active":"2024-09-22T08:15:06.960599+0000","last_became_peered":"2024-09-22T08:15:06.960599+0000","last_unstale":"2024-09-22T08:54:41.480043+0000","last_undegraded":"2024-09-22T08:54:41.480043+0000","last_fullsized":"2024-09-22T08:54:41.480043+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":500,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:27:19.885943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3136,"num_read_kb":2948,"num_write":673,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"263'210","reported_seq":837,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.548080+0000","last_change":"2024-09-22T08:15:04.963136+0000","last_active":"2024-09-22T08:56:16.548080+0000","last_peered":"2024-09-22T08:56:16.548080+0000","last_clean":"2024-09-22T08:56:16.548080+0000","last_became_active":"2024-09-22T08:15:04.962785+0000","last_became_peered":"2024-09-22T08:15:04.962785+0000","last_unstale":"2024-09-22T08:56:16.548080+0000","last_undegraded":"2024-09-22T08:56:16.548080+0000","last_fullsized":"2024-09-22T08:56:16.548080+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:29:11.602912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":497,"num_read_kb":22160,"num_write":848,"num_write_kb":45151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:48.394911+0000","last_change":"2024-09-22T08:15:08.979401+0000","last_active":"2024-09-22T08:53:48.394911+0000","last_peered":"2024-09-22T08:53:48.394911+0000","last_clean":"2024-09-22T08:53:48.394911+0000","last_became_active":"2024-09-22T08:15:08.978844+0000","last_became_peered":"2024-09-22T08:15:08.978844+0000","last_unstale":"2024-09-22T08:53:48.394911+0000","last_undegraded":"2024-09-22T08:53:48.394911+0000","last_fullsized":"2024-09-22T08:53:48.394911+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:07:22.042882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"263'128","reported_seq":678,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.407905+0000","last_change":"2024-09-22T08:15:10.983840+0000","last_active":"2024-09-22T08:56:16.407905+0000","last_peered":"2024-09-22T08:56:16.407905+0000","last_clean":"2024-09-22T08:56:16.407905+0000","last_became_active":"2024-09-22T08:15:10.983522+0000","last_became_peered":"2024-09-22T08:15:10.983522+0000","last_unstale":"2024-09-22T08:56:16.407905+0000","last_undegraded":"2024-09-22T08:56:16.407905+0000","last_fullsized":"2024-09-22T08:56:16.407905+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:05:15.621827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62130,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":173,"num_read_kb":427,"num_write":104,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:43.387370+0000","last_change":"2024-09-22T08:15:13.015794+0000","last_active":"2024-09-22T08:52:43.387370+0000","last_peered":"2024-09-22T08:52:43.387370+0000","last_clean":"2024-09-22T08:52:43.387370+0000","last_became_active":"2024-09-22T08:15:13.015473+0000","last_became_peered":"2024-09-22T08:15:13.015473+0000","last_unstale":"2024-09-22T08:52:43.387370+0000","last_undegraded":"2024-09-22T08:52:43.387370+0000","last_fullsized":"2024-09-22T08:52:43.387370+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:45:01.160499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"263'213","reported_seq":1672,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:39.366065+0000","last_change":"2024-09-22T08:15:15.018252+0000","last_active":"2024-09-22T08:54:39.366065+0000","last_peered":"2024-09-22T08:54:39.366065+0000","last_clean":"2024-09-22T08:54:39.366065+0000","last_became_active":"2024-09-22T08:15:15.017394+0000","last_became_peered":"2024-09-22T08:15:15.017394+0000","last_unstale":"2024-09-22T08:54:39.366065+0000","last_undegraded":"2024-09-22T08:54:39.366065+0000","last_fullsized":"2024-09-22T08:54:39.366065+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1186,"num_read_kb":1185,"num_write":465,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"263'821","reported_seq":2516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.926722+0000","last_change":"2024-09-22T08:15:06.967900+0000","last_active":"2024-09-22T08:54:38.926722+0000","last_peered":"2024-09-22T08:54:38.926722+0000","last_clean":"2024-09-22T08:54:38.926722+0000","last_became_active":"2024-09-22T08:15:06.967603+0000","last_became_peered":"2024-09-22T08:15:06.967603+0000","last_unstale":"2024-09-22T08:54:38.926722+0000","last_undegraded":"2024-09-22T08:54:38.926722+0000","last_fullsized":"2024-09-22T08:54:38.926722+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":800,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:44:20.031138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4151,"num_read_kb":3787,"num_write":1085,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"263'209","reported_seq":872,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.482922+0000","last_change":"2024-09-22T08:15:04.957997+0000","last_active":"2024-09-22T08:56:16.482922+0000","last_peered":"2024-09-22T08:56:16.482922+0000","last_clean":"2024-09-22T08:56:16.482922+0000","last_became_active":"2024-09-22T08:15:04.957654+0000","last_became_peered":"2024-09-22T08:15:04.957654+0000","last_unstale":"2024-09-22T08:56:16.482922+0000","last_undegraded":"2024-09-22T08:56:16.482922+0000","last_fullsized":"2024-09-22T08:56:16.482922+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:15:19.864352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":592,"num_read_kb":25705,"num_write":948,"num_write_kb":45275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:57.408461+0000","last_change":"2024-09-22T08:15:08.973107+0000","last_active":"2024-09-22T08:53:57.408461+0000","last_peered":"2024-09-22T08:53:57.408461+0000","last_clean":"2024-09-22T08:53:57.408461+0000","last_became_active":"2024-09-22T08:15:08.972733+0000","last_became_peered":"2024-09-22T08:15:08.972733+0000","last_unstale":"2024-09-22T08:53:57.408461+0000","last_undegraded":"2024-09-22T08:53:57.408461+0000","last_fullsized":"2024-09-22T08:53:57.408461+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:09:10.684801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"263'156","reported_seq":738,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.428241+0000","last_change":"2024-09-22T08:15:10.987881+0000","last_active":"2024-09-22T08:56:16.428241+0000","last_peered":"2024-09-22T08:56:16.428241+0000","last_clean":"2024-09-22T08:56:16.428241+0000","last_became_active":"2024-09-22T08:15:10.987610+0000","last_became_peered":"2024-09-22T08:15:10.987610+0000","last_unstale":"2024-09-22T08:56:16.428241+0000","last_undegraded":"2024-09-22T08:56:16.428241+0000","last_fullsized":"2024-09-22T08:56:16.428241+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:25:04.343680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6856,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":209,"num_read_kb":275,"num_write":118,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:42.398317+0000","last_change":"2024-09-22T08:15:13.003540+0000","last_active":"2024-09-22T08:52:42.398317+0000","last_peered":"2024-09-22T08:52:42.398317+0000","last_clean":"2024-09-22T08:52:42.398317+0000","last_became_active":"2024-09-22T08:15:13.003219+0000","last_became_peered":"2024-09-22T08:15:13.003219+0000","last_unstale":"2024-09-22T08:52:42.398317+0000","last_undegraded":"2024-09-22T08:52:42.398317+0000","last_fullsized":"2024-09-22T08:52:42.398317+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:50:35.499014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"263'159","reported_seq":639,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.030006+0000","last_change":"2024-09-22T08:15:15.018630+0000","last_active":"2024-09-22T08:56:02.030006+0000","last_peered":"2024-09-22T08:56:02.030006+0000","last_clean":"2024-09-22T08:56:02.030006+0000","last_became_active":"2024-09-22T08:15:15.018311+0000","last_became_peered":"2024-09-22T08:15:15.018311+0000","last_unstale":"2024-09-22T08:56:02.030006+0000","last_undegraded":"2024-09-22T08:56:02.030006+0000","last_fullsized":"2024-09-22T08:56:02.030006+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:45:03.170254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":160,"num_write":367,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"263'889","reported_seq":2468,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.961170+0000","last_change":"2024-09-22T08:15:06.965116+0000","last_active":"2024-09-22T08:54:27.961170+0000","last_peered":"2024-09-22T08:54:27.961170+0000","last_clean":"2024-09-22T08:54:27.961170+0000","last_became_active":"2024-09-22T08:15:06.964786+0000","last_became_peered":"2024-09-22T08:15:06.964786+0000","last_unstale":"2024-09-22T08:54:27.961170+0000","last_undegraded":"2024-09-22T08:54:27.961170+0000","last_fullsized":"2024-09-22T08:54:27.961170+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":800,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:33:01.235899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4058,"num_read_kb":3642,"num_write":1164,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"263'224","reported_seq":892,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:18.408563+0000","last_change":"2024-09-22T08:15:04.963081+0000","last_active":"2024-09-22T08:53:18.408563+0000","last_peered":"2024-09-22T08:53:18.408563+0000","last_clean":"2024-09-22T08:53:18.408563+0000","last_became_active":"2024-09-22T08:15:04.962774+0000","last_became_peered":"2024-09-22T08:15:04.962774+0000","last_unstale":"2024-09-22T08:53:18.408563+0000","last_undegraded":"2024-09-22T08:53:18.408563+0000","last_fullsized":"2024-09-22T08:53:18.408563+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:28:22.448316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":683,"num_read_kb":4749,"num_write":1115,"num_write_kb":28646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"263'862","reported_seq":2345,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:25.945638+0000","last_change":"2024-09-22T08:15:06.958712+0000","last_active":"2024-09-22T08:54:25.945638+0000","last_peered":"2024-09-22T08:54:25.945638+0000","last_clean":"2024-09-22T08:54:25.945638+0000","last_became_active":"2024-09-22T08:15:06.958389+0000","last_became_peered":"2024-09-22T08:15:06.958389+0000","last_unstale":"2024-09-22T08:54:25.945638+0000","last_undegraded":"2024-09-22T08:54:25.945638+0000","last_fullsized":"2024-09-22T08:54:25.945638+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":800,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:17:52.710339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3808,"num_read_kb":3398,"num_write":1097,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"263'363","reported_seq":1051,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.392172+0000","last_change":"2024-09-22T08:15:04.951222+0000","last_active":"2024-09-22T08:56:16.392172+0000","last_peered":"2024-09-22T08:56:16.392172+0000","last_clean":"2024-09-22T08:56:16.392172+0000","last_became_active":"2024-09-22T08:15:04.950922+0000","last_became_peered":"2024-09-22T08:15:04.950922+0000","last_unstale":"2024-09-22T08:56:16.392172+0000","last_undegraded":"2024-09-22T08:56:16.392172+0000","last_fullsized":"2024-09-22T08:56:16.392172+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:41:56.256814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1005,"num_read_kb":11417,"num_write":1356,"num_write_kb":38557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"263'414","reported_seq":1864,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:08.397671+0000","last_change":"2024-09-22T08:15:06.974074+0000","last_active":"2024-09-22T08:54:08.397671+0000","last_peered":"2024-09-22T08:54:08.397671+0000","last_clean":"2024-09-22T08:54:08.397671+0000","last_became_active":"2024-09-22T08:15:06.973749+0000","last_became_peered":"2024-09-22T08:15:06.973749+0000","last_unstale":"2024-09-22T08:54:08.397671+0000","last_undegraded":"2024-09-22T08:54:08.397671+0000","last_fullsized":"2024-09-22T08:54:08.397671+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:09:45.710062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2229,"num_read_kb":2093,"num_write":519,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"263'225","reported_seq":856,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:57.208061+0000","last_change":"2024-09-22T08:15:04.960573+0000","last_active":"2024-09-22T08:55:57.208061+0000","last_peered":"2024-09-22T08:55:57.208061+0000","last_clean":"2024-09-22T08:55:57.208061+0000","last_became_active":"2024-09-22T08:15:04.959501+0000","last_became_peered":"2024-09-22T08:15:04.959501+0000","last_unstale":"2024-09-22T08:55:57.208061+0000","last_undegraded":"2024-09-22T08:55:57.208061+0000","last_fullsized":"2024-09-22T08:55:57.208061+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:58:53.308481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":551,"num_read_kb":25081,"num_write":1074,"num_write_kb":19730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"263'880","reported_seq":2574,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.040269+0000","last_change":"2024-09-22T08:15:06.971393+0000","last_active":"2024-09-22T08:56:02.040269+0000","last_peered":"2024-09-22T08:56:02.040269+0000","last_clean":"2024-09-22T08:56:02.040269+0000","last_became_active":"2024-09-22T08:15:06.970991+0000","last_became_peered":"2024-09-22T08:15:06.970991+0000","last_unstale":"2024-09-22T08:56:02.040269+0000","last_undegraded":"2024-09-22T08:56:02.040269+0000","last_fullsized":"2024-09-22T08:56:02.040269+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":800,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:27:06.535070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4175,"num_read_kb":3774,"num_write":1132,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"263'195","reported_seq":826,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.292438+0000","last_change":"2024-09-22T08:15:04.954644+0000","last_active":"2024-09-22T08:56:16.292438+0000","last_peered":"2024-09-22T08:56:16.292438+0000","last_clean":"2024-09-22T08:56:16.292438+0000","last_became_active":"2024-09-22T08:15:04.954281+0000","last_became_peered":"2024-09-22T08:15:04.954281+0000","last_unstale":"2024-09-22T08:56:16.292438+0000","last_undegraded":"2024-09-22T08:56:16.292438+0000","last_fullsized":"2024-09-22T08:56:16.292438+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:43:06.650935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":578,"num_read_kb":4135,"num_write":927,"num_write_kb":8648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"263'1127","reported_seq":2681,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.961055+0000","last_change":"2024-09-22T08:15:06.968491+0000","last_active":"2024-09-22T08:54:27.961055+0000","last_peered":"2024-09-22T08:54:27.961055+0000","last_clean":"2024-09-22T08:54:27.961055+0000","last_became_active":"2024-09-22T08:15:06.967938+0000","last_became_peered":"2024-09-22T08:15:06.967938+0000","last_unstale":"2024-09-22T08:54:27.961055+0000","last_undegraded":"2024-09-22T08:54:27.961055+0000","last_fullsized":"2024-09-22T08:54:27.961055+0000","mapping_epoch":25,"log_start":"263'1100","ondisk_log_start":"263'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":1100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:05:32.099143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5297,"num_read_kb":4688,"num_write":1564,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"263'196","reported_seq":874,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:07.287692+0000","last_change":"2024-09-22T08:15:04.964365+0000","last_active":"2024-09-22T08:54:07.287692+0000","last_peered":"2024-09-22T08:54:07.287692+0000","last_clean":"2024-09-22T08:54:07.287692+0000","last_became_active":"2024-09-22T08:15:04.963992+0000","last_became_peered":"2024-09-22T08:15:04.963992+0000","last_unstale":"2024-09-22T08:54:07.287692+0000","last_undegraded":"2024-09-22T08:54:07.287692+0000","last_fullsized":"2024-09-22T08:54:07.287692+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:47:44.152954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":707,"num_read_kb":8108,"num_write":879,"num_write_kb":38701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"263'391","reported_seq":2065,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:25.944051+0000","last_change":"2024-09-22T08:15:06.964443+0000","last_active":"2024-09-22T08:54:25.944051+0000","last_peered":"2024-09-22T08:54:25.944051+0000","last_clean":"2024-09-22T08:54:25.944051+0000","last_became_active":"2024-09-22T08:15:06.964116+0000","last_became_peered":"2024-09-22T08:15:06.964116+0000","last_unstale":"2024-09-22T08:54:25.944051+0000","last_undegraded":"2024-09-22T08:54:25.944051+0000","last_fullsized":"2024-09-22T08:54:25.944051+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:11:34.518000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2347,"num_read_kb":2272,"num_write":440,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"263'229","reported_seq":911,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.490048+0000","last_change":"2024-09-22T08:15:04.951989+0000","last_active":"2024-09-22T08:56:16.490048+0000","last_peered":"2024-09-22T08:56:16.490048+0000","last_clean":"2024-09-22T08:56:16.490048+0000","last_became_active":"2024-09-22T08:15:04.951628+0000","last_became_peered":"2024-09-22T08:15:04.951628+0000","last_unstale":"2024-09-22T08:56:16.490048+0000","last_undegraded":"2024-09-22T08:56:16.490048+0000","last_fullsized":"2024-09-22T08:56:16.490048+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:10:52.618601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":736,"num_read_kb":9856,"num_write":1118,"num_write_kb":28547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"263'359","reported_seq":1832,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.361190+0000","last_change":"2024-09-22T08:15:06.973913+0000","last_active":"2024-09-22T08:54:27.361190+0000","last_peered":"2024-09-22T08:54:27.361190+0000","last_clean":"2024-09-22T08:54:27.361190+0000","last_became_active":"2024-09-22T08:15:06.973584+0000","last_became_peered":"2024-09-22T08:15:06.973584+0000","last_unstale":"2024-09-22T08:54:27.361190+0000","last_undegraded":"2024-09-22T08:54:27.361190+0000","last_fullsized":"2024-09-22T08:54:27.361190+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:45:47.505506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2011,"num_read_kb":1931,"num_write":399,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"263'216","reported_seq":883,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.451746+0000","last_change":"2024-09-22T08:15:04.969769+0000","last_active":"2024-09-22T08:56:16.451746+0000","last_peered":"2024-09-22T08:56:16.451746+0000","last_clean":"2024-09-22T08:56:16.451746+0000","last_became_active":"2024-09-22T08:15:04.968983+0000","last_became_peered":"2024-09-22T08:15:04.968983+0000","last_unstale":"2024-09-22T08:56:16.451746+0000","last_undegraded":"2024-09-22T08:56:16.451746+0000","last_fullsized":"2024-09-22T08:56:16.451746+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:18.808569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":615,"num_read_kb":66139,"num_write":1057,"num_write_kb":31816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"263'1262","reported_seq":3112,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.961464+0000","last_change":"2024-09-22T08:15:06.971511+0000","last_active":"2024-09-22T08:54:27.961464+0000","last_peered":"2024-09-22T08:54:27.961464+0000","last_clean":"2024-09-22T08:54:27.961464+0000","last_became_active":"2024-09-22T08:15:06.970055+0000","last_became_peered":"2024-09-22T08:15:06.970055+0000","last_unstale":"2024-09-22T08:54:27.961464+0000","last_undegraded":"2024-09-22T08:54:27.961464+0000","last_fullsized":"2024-09-22T08:54:27.961464+0000","mapping_epoch":25,"log_start":"263'1200","ondisk_log_start":"263'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":1200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:22:55.292514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6370,"num_read_kb":5597,"num_write":1961,"num_write_kb":987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"263'217","reported_seq":880,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.331777+0000","last_change":"2024-09-22T08:15:04.961957+0000","last_active":"2024-09-22T08:56:16.331777+0000","last_peered":"2024-09-22T08:56:16.331777+0000","last_clean":"2024-09-22T08:56:16.331777+0000","last_became_active":"2024-09-22T08:15:04.961545+0000","last_became_peered":"2024-09-22T08:15:04.961545+0000","last_unstale":"2024-09-22T08:56:16.331777+0000","last_undegraded":"2024-09-22T08:56:16.331777+0000","last_fullsized":"2024-09-22T08:56:16.331777+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:16:41.974072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":669,"num_read_kb":2609,"num_write":1038,"num_write_kb":23374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"263'491","reported_seq":1940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.926788+0000","last_change":"2024-09-22T08:15:06.959643+0000","last_active":"2024-09-22T08:54:38.926788+0000","last_peered":"2024-09-22T08:54:38.926788+0000","last_clean":"2024-09-22T08:54:38.926788+0000","last_became_active":"2024-09-22T08:15:06.959331+0000","last_became_peered":"2024-09-22T08:15:06.959331+0000","last_unstale":"2024-09-22T08:54:38.926788+0000","last_undegraded":"2024-09-22T08:54:38.926788+0000","last_fullsized":"2024-09-22T08:54:38.926788+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:46:47.067650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2542,"num_read_kb":2330,"num_write":651,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"263'193","reported_seq":784,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.549791+0000","last_change":"2024-09-22T08:15:04.959005+0000","last_active":"2024-09-22T08:56:16.549791+0000","last_peered":"2024-09-22T08:56:16.549791+0000","last_clean":"2024-09-22T08:56:16.549791+0000","last_became_active":"2024-09-22T08:15:04.958725+0000","last_became_peered":"2024-09-22T08:15:04.958725+0000","last_unstale":"2024-09-22T08:56:16.549791+0000","last_undegraded":"2024-09-22T08:56:16.549791+0000","last_fullsized":"2024-09-22T08:56:16.549791+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":392,"num_read_kb":18786,"num_write":900,"num_write_kb":46944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"263'798","reported_seq":2381,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:19.614771+0000","last_change":"2024-09-22T08:15:06.956815+0000","last_active":"2024-09-22T08:54:19.614771+0000","last_peered":"2024-09-22T08:54:19.614771+0000","last_clean":"2024-09-22T08:54:19.614771+0000","last_became_active":"2024-09-22T08:15:06.956485+0000","last_became_peered":"2024-09-22T08:15:06.956485+0000","last_unstale":"2024-09-22T08:54:19.614771+0000","last_undegraded":"2024-09-22T08:54:19.614771+0000","last_fullsized":"2024-09-22T08:54:19.614771+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:11:36.316290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3799,"num_read_kb":3445,"num_write":1066,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"263'218","reported_seq":891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.438588+0000","last_change":"2024-09-22T08:15:04.962465+0000","last_active":"2024-09-22T08:56:16.438588+0000","last_peered":"2024-09-22T08:56:16.438588+0000","last_clean":"2024-09-22T08:56:16.438588+0000","last_became_active":"2024-09-22T08:15:04.962165+0000","last_became_peered":"2024-09-22T08:15:04.962165+0000","last_unstale":"2024-09-22T08:56:16.438588+0000","last_undegraded":"2024-09-22T08:56:16.438588+0000","last_fullsized":"2024-09-22T08:56:16.438588+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:54.072073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":601,"num_read_kb":98488,"num_write":1035,"num_write_kb":53405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"263'774","reported_seq":2242,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.926395+0000","last_change":"2024-09-22T08:15:06.970487+0000","last_active":"2024-09-22T08:54:38.926395+0000","last_peered":"2024-09-22T08:54:38.926395+0000","last_clean":"2024-09-22T08:54:38.926395+0000","last_became_active":"2024-09-22T08:15:06.970111+0000","last_became_peered":"2024-09-22T08:15:06.970111+0000","last_unstale":"2024-09-22T08:54:38.926395+0000","last_undegraded":"2024-09-22T08:54:38.926395+0000","last_fullsized":"2024-09-22T08:54:38.926395+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:58.671223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3767,"num_read_kb":3405,"num_write":1035,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"263'192","reported_seq":902,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:21.922992+0000","last_change":"2024-09-22T08:56:21.922992+0000","last_active":"2024-09-22T08:56:21.922992+0000","last_peered":"2024-09-22T08:56:21.922992+0000","last_clean":"2024-09-22T08:56:21.922992+0000","last_became_active":"2024-09-22T08:15:04.963383+0000","last_became_peered":"2024-09-22T08:15:04.963383+0000","last_unstale":"2024-09-22T08:56:21.922992+0000","last_undegraded":"2024-09-22T08:56:21.922992+0000","last_fullsized":"2024-09-22T08:56:21.922992+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'192","last_scrub_stamp":"2024-09-22T08:56:21.922907+0000","last_deep_scrub":"263'192","last_deep_scrub_stamp":"2024-09-22T08:56:21.922907+0000","last_clean_scrub_stamp":"2024-09-22T08:56:21.922907+0000","objects_scrubbed":5,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:34:08.554670+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":846,"num_read_kb":15214,"num_write":846,"num_write_kb":25255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"263'748","reported_seq":2174,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.033948+0000","last_change":"2024-09-22T08:15:06.968144+0000","last_active":"2024-09-22T08:56:02.033948+0000","last_peered":"2024-09-22T08:56:02.033948+0000","last_clean":"2024-09-22T08:56:02.033948+0000","last_became_active":"2024-09-22T08:15:06.967819+0000","last_became_peered":"2024-09-22T08:15:06.967819+0000","last_unstale":"2024-09-22T08:56:02.033948+0000","last_undegraded":"2024-09-22T08:56:02.033948+0000","last_fullsized":"2024-09-22T08:56:02.033948+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:33:21.226600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3557,"num_read_kb":3203,"num_write":994,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"263'220","reported_seq":850,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.532155+0000","last_change":"2024-09-22T08:15:04.963531+0000","last_active":"2024-09-22T08:56:16.532155+0000","last_peered":"2024-09-22T08:56:16.532155+0000","last_clean":"2024-09-22T08:56:16.532155+0000","last_became_active":"2024-09-22T08:15:04.963035+0000","last_became_peered":"2024-09-22T08:15:04.963035+0000","last_unstale":"2024-09-22T08:56:16.532155+0000","last_undegraded":"2024-09-22T08:56:16.532155+0000","last_fullsized":"2024-09-22T08:56:16.532155+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:06:11.269656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":484,"num_read_kb":60036,"num_write":970,"num_write_kb":46477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"263'433","reported_seq":2054,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:24.609260+0000","last_change":"2024-09-22T08:15:06.973192+0000","last_active":"2024-09-22T08:54:24.609260+0000","last_peered":"2024-09-22T08:54:24.609260+0000","last_clean":"2024-09-22T08:54:24.609260+0000","last_became_active":"2024-09-22T08:15:06.972901+0000","last_became_peered":"2024-09-22T08:15:06.972901+0000","last_unstale":"2024-09-22T08:54:24.609260+0000","last_undegraded":"2024-09-22T08:54:24.609260+0000","last_fullsized":"2024-09-22T08:54:24.609260+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:05:44.213357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2630,"num_read_kb":2493,"num_write":497,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"263'191","reported_seq":794,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:38.492038+0000","last_change":"2024-09-22T08:15:04.955216+0000","last_active":"2024-09-22T08:55:38.492038+0000","last_peered":"2024-09-22T08:55:38.492038+0000","last_clean":"2024-09-22T08:55:38.492038+0000","last_became_active":"2024-09-22T08:15:04.954601+0000","last_became_peered":"2024-09-22T08:15:04.954601+0000","last_unstale":"2024-09-22T08:55:38.492038+0000","last_undegraded":"2024-09-22T08:55:38.492038+0000","last_fullsized":"2024-09-22T08:55:38.492038+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:09:17.404903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":488,"num_read_kb":10659,"num_write":871,"num_write_kb":26887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"263'435","reported_seq":1895,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:26.720211+0000","last_change":"2024-09-22T08:15:06.956049+0000","last_active":"2024-09-22T08:54:26.720211+0000","last_peered":"2024-09-22T08:54:26.720211+0000","last_clean":"2024-09-22T08:54:26.720211+0000","last_became_active":"2024-09-22T08:15:06.955721+0000","last_became_peered":"2024-09-22T08:15:06.955721+0000","last_unstale":"2024-09-22T08:54:26.720211+0000","last_undegraded":"2024-09-22T08:54:26.720211+0000","last_fullsized":"2024-09-22T08:54:26.720211+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:49:20.581915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2301,"num_read_kb":2146,"num_write":527,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"263'217","reported_seq":878,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.451910+0000","last_change":"2024-09-22T08:15:04.961490+0000","last_active":"2024-09-22T08:56:16.451910+0000","last_peered":"2024-09-22T08:56:16.451910+0000","last_clean":"2024-09-22T08:56:16.451910+0000","last_became_active":"2024-09-22T08:15:04.961217+0000","last_became_peered":"2024-09-22T08:15:04.961217+0000","last_unstale":"2024-09-22T08:56:16.451910+0000","last_undegraded":"2024-09-22T08:56:16.451910+0000","last_fullsized":"2024-09-22T08:56:16.451910+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:36:23.921216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":598,"num_read_kb":11776,"num_write":1062,"num_write_kb":6843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"263'549","reported_seq":2080,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.927363+0000","last_change":"2024-09-22T08:15:06.971069+0000","last_active":"2024-09-22T08:54:38.927363+0000","last_peered":"2024-09-22T08:54:38.927363+0000","last_clean":"2024-09-22T08:54:38.927363+0000","last_became_active":"2024-09-22T08:15:06.970735+0000","last_became_peered":"2024-09-22T08:15:06.970735+0000","last_unstale":"2024-09-22T08:54:38.927363+0000","last_undegraded":"2024-09-22T08:54:38.927363+0000","last_fullsized":"2024-09-22T08:54:38.927363+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":500,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:22:49.656390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2725,"num_read_kb":2496,"num_write":675,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"263'217","reported_seq":874,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.490267+0000","last_change":"2024-09-22T08:15:04.968447+0000","last_active":"2024-09-22T08:56:16.490267+0000","last_peered":"2024-09-22T08:56:16.490267+0000","last_clean":"2024-09-22T08:56:16.490267+0000","last_became_active":"2024-09-22T08:15:04.968172+0000","last_became_peered":"2024-09-22T08:15:04.968172+0000","last_unstale":"2024-09-22T08:56:16.490267+0000","last_undegraded":"2024-09-22T08:56:16.490267+0000","last_fullsized":"2024-09-22T08:56:16.490267+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:13:04.823684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":641,"num_read_kb":8608,"num_write":1007,"num_write_kb":17473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"263'756","reported_seq":2290,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:20.263707+0000","last_change":"2024-09-22T08:15:06.976244+0000","last_active":"2024-09-22T08:54:20.263707+0000","last_peered":"2024-09-22T08:54:20.263707+0000","last_clean":"2024-09-22T08:54:20.263707+0000","last_became_active":"2024-09-22T08:15:06.976019+0000","last_became_peered":"2024-09-22T08:15:06.976019+0000","last_unstale":"2024-09-22T08:54:20.263707+0000","last_undegraded":"2024-09-22T08:54:20.263707+0000","last_fullsized":"2024-09-22T08:54:20.263707+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3691,"num_read_kb":3360,"num_write":995,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"263'225","reported_seq":915,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.483773+0000","last_change":"2024-09-22T08:15:04.963673+0000","last_active":"2024-09-22T08:56:16.483773+0000","last_peered":"2024-09-22T08:56:16.483773+0000","last_clean":"2024-09-22T08:56:16.483773+0000","last_became_active":"2024-09-22T08:15:04.963391+0000","last_became_peered":"2024-09-22T08:15:04.963391+0000","last_unstale":"2024-09-22T08:56:16.483773+0000","last_undegraded":"2024-09-22T08:56:16.483773+0000","last_fullsized":"2024-09-22T08:56:16.483773+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:19:28.768330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":637,"num_read_kb":95067,"num_write":1060,"num_write_kb":43906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"263'266","reported_seq":921,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.482904+0000","last_change":"2024-09-22T08:15:04.966802+0000","last_active":"2024-09-22T08:56:16.482904+0000","last_peered":"2024-09-22T08:56:16.482904+0000","last_clean":"2024-09-22T08:56:16.482904+0000","last_became_active":"2024-09-22T08:15:04.965396+0000","last_became_peered":"2024-09-22T08:15:04.965396+0000","last_unstale":"2024-09-22T08:56:16.482904+0000","last_undegraded":"2024-09-22T08:56:16.482904+0000","last_fullsized":"2024-09-22T08:56:16.482904+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:33:44.025013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":744,"num_read_kb":7770,"num_write":1118,"num_write_kb":20319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"263'1208","reported_seq":2920,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.480223+0000","last_change":"2024-09-22T08:15:06.971024+0000","last_active":"2024-09-22T08:54:41.480223+0000","last_peered":"2024-09-22T08:54:41.480223+0000","last_clean":"2024-09-22T08:54:41.480223+0000","last_became_active":"2024-09-22T08:15:06.970717+0000","last_became_peered":"2024-09-22T08:15:06.970717+0000","last_unstale":"2024-09-22T08:54:41.480223+0000","last_undegraded":"2024-09-22T08:54:41.480223+0000","last_fullsized":"2024-09-22T08:54:41.480223+0000","mapping_epoch":25,"log_start":"263'1100","ondisk_log_start":"263'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":1100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:28:38.936914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5779,"num_read_kb":5147,"num_write":1662,"num_write_kb":686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"263'200","reported_seq":785,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.545519+0000","last_change":"2024-09-22T08:15:04.959358+0000","last_active":"2024-09-22T08:56:16.545519+0000","last_peered":"2024-09-22T08:56:16.545519+0000","last_clean":"2024-09-22T08:56:16.545519+0000","last_became_active":"2024-09-22T08:15:04.959102+0000","last_became_peered":"2024-09-22T08:15:04.959102+0000","last_unstale":"2024-09-22T08:56:16.545519+0000","last_undegraded":"2024-09-22T08:56:16.545519+0000","last_fullsized":"2024-09-22T08:56:16.545519+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.927534+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.927534+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:04:57.231333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":396,"num_read_kb":24955,"num_write":899,"num_write_kb":36551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"263'497","reported_seq":2107,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:23.395197+0000","last_change":"2024-09-22T08:15:06.969693+0000","last_active":"2024-09-22T08:54:23.395197+0000","last_peered":"2024-09-22T08:54:23.395197+0000","last_clean":"2024-09-22T08:54:23.395197+0000","last_became_active":"2024-09-22T08:15:06.968345+0000","last_became_peered":"2024-09-22T08:15:06.968345+0000","last_unstale":"2024-09-22T08:54:23.395197+0000","last_undegraded":"2024-09-22T08:54:23.395197+0000","last_fullsized":"2024-09-22T08:54:23.395197+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:19.848260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2601,"num_read_kb":2436,"num_write":597,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10844,"num_read_kb":8840,"num_write":3116,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":899,"ondisk_log_size":899,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15081,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":16349,"num_read_kb":16036,"num_write":17069,"num_write_kb":4981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":30162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1780,"ondisk_log_size":1780,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":677,"ondisk_log_size":677,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382382,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":8323,"num_read_kb":10644,"num_write":5603,"num_write_kb":2773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1816,"ondisk_log_size":1816,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2393,"num_read_kb":2857,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":219693,"num_read_kb":201308,"num_write":55750,"num_write_kb":18998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3980,"ondisk_log_size":3980,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":22399416,"num_objects":166,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":166,"num_whiteouts":0,"num_read":38892,"num_read_kb":2161027,"num_write":64127,"num_write_kb":2146956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45760512,"data_stored":44798832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3580,"ondisk_log_size":3580,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":194127,"num_write":186,"num_write_kb":125446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":186900,"num_write":186,"num_write_kb":125446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509943,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":198476,"kb_used_data":8972,"kb_used_omap":1,"kb_used_meta":189438,"kb_avail":94173364,"statfs":{"total":96636764160,"available":96433524736,"internally_reserved":0,"allocated":9187328,"data_stored":7502420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":193984968},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509944,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":261412,"kb_used_data":9492,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94110428,"statfs":{"total":96636764160,"available":96369078272,"internally_reserved":0,"allocated":9719808,"data_stored":8091734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257948101},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509944,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81944,"kb_used_data":10504,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94289896,"statfs":{"total":96636764160,"available":96552853504,"internally_reserved":0,"allocated":10756096,"data_stored":9074858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542647,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":209020,"kb_used_data":7100,"kb_used_omap":1,"kb_used_meta":201854,"kb_avail":94162820,"statfs":{"total":96636764160,"available":96422727680,"internally_reserved":0,"allocated":7270400,"data_stored":5649861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":206698954},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542646,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81800,"kb_used_data":10296,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94290040,"statfs":{"total":96636764160,"available":96553000960,"internally_reserved":0,"allocated":10543104,"data_stored":8890315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542647,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":248056,"kb_used_data":9988,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94123784,"statfs":{"total":96636764160,"available":96382754816,"internally_reserved":0,"allocated":10227712,"data_stored":8586347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243726789},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542649,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148352,"kb_used_data":8888,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94223488,"statfs":{"total":96636764160,"available":96484851712,"internally_reserved":0,"allocated":9101312,"data_stored":7502190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575349,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120720,"kb_used_data":8992,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94251120,"statfs":{"total":96636764160,"available":96513146880,"internally_reserved":0,"allocated":9207808,"data_stored":7504913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7127040,"data_stored":6973120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5500928,"data_stored":5399874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5558272,"data_stored":5400076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5541888,"data_stored":5400084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5492736,"data_stored":5399824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":6012928,"data_stored":5893124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6889472,"data_stored":6786226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3637248,"data_stored":3546504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":5633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":3876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":5455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T08:56:24.759 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.759 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.759 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.759 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.759 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.759 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.759 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.760 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.760 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.760 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.760 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.761 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.761 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.761 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.761 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.761 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.761 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.761 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.761 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.761 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.762 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.762 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.762 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.762 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.762 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.762 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.762 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.762 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.762 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.763 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.763 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.763 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.763 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.763 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.763 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.763 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.763 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.763 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.763 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.764 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.764 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.764 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.764 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.764 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.764 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.764 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.764 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.764 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.765 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.765 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.765 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.765 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.765 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.765 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.765 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.765 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.765 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.765 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.766 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.766 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.766 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.766 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.766 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.766 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.766 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.766 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.766 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.766 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.767 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.767 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.767 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.767 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.767 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.767 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.767 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.767 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.767 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.768 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.768 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.768 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.768 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.768 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.768 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.768 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.768 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.768 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.768 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.769 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.769 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.769 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.769 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.769 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.769 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.769 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.769 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.769 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.769 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.769 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.770 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.770 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.770 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.770 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.770 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.770 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.770 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.770 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.771 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.771 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.771 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.771 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.771 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.771 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.771 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.771 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.772 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.772 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.772 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.772 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.772 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.772 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.772 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.773 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.773 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.773 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.773 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.773 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.773 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.773 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.773 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.773 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.773 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.774 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.774 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.774 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.774 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.774 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.774 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.774 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.774 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.774 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.774 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.775 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.775 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.775 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.775 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.775 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.775 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.775 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.775 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.776 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.776 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.776 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.776 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.776 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.776 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.776 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.776 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.777 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.777 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.777 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.777 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.777 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.777 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.777 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.777 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.777 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.778 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.778 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.778 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.778 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.778 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.778 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.778 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.778 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.779 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.779 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.779 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.779 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.779 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.779 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.779 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.779 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.779 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.780 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.780 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.780 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.780 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.780 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.780 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.780 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.780 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.780 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.781 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.781 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.781 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.781 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.781 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.781 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.781 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.782 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.782 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.782 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.782 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.782 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.782 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.782 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.783 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.783 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.783 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.783 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.783 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.783 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.783 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.783 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.783 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.783 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.784 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.784 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.784 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.784 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.784 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.784 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.784 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.784 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.784 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.784 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.785 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-22T08:14:47.452169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.785 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-22T08:14:53.700271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=53, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.785 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.785 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.785 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.785 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.785 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.785 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.786 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.786 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.786 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.786 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.786 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.786 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.786 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-22T08:14:53.700271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=53, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.786 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.786 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.787 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.787 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.787 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.787 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.787 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-22T08:14:53.700271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=53, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.787 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.787 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.788 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.788 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.788 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.788 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.788 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-22T08:14:53.700271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=53, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.788 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.789 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.789 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.789 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.789 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.789 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.789 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-22T08:14:53.700271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=53, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.790 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.790 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.790 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.790 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.790 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.790 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.791 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-22T08:14:53.700271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=53, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.791 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.791 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.791 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.791 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.791 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.792 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.792 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-22T08:14:53.700271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=53, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.792 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.792 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.792 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.793 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.793 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.793 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.793 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.793 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.793 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.794 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.794 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.794 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.794 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.794 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.794 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.795 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.795 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.795 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.795 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.795 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.795 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.796 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.796 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.796 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.796 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.796 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.796 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.797 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.797 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.797 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.797 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.797 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.797 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.798 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.798 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.798 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.798 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.798 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.798 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.799 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.799 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.799 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.799 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.799 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.799 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.799 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.799 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.799 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.800 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.800 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.800 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.800 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.800 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.800 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.800 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.800 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.800 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.800 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.801 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.801 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.801 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.801 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.801 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.801 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.801 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.801 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.801 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.801 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.802 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.802 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.802 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.802 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.802 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.802 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.802 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.802 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.802 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.803 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.803 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.803 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.803 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.803 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.803 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.803 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.803 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.803 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.803 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.804 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.804 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.804 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.804 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.804 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.804 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.804 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.804 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.804 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.804 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.805 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.805 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.805 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.805 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.805 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.805 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.805 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.805 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.805 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.805 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.806 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.806 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.806 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-22T08:15:03.927534+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.806 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:24.806 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-22T08:56:44.807 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T08:56:45.165 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:56:45.177 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-09-22T08:56:45.179 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":1515,"stamp":"2024-09-22T08:56:43.641108+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23389059,"num_objects":621,"num_object_clones":0,"num_object_copies":1242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":621,"num_whiteouts":0,"num_read":296912,"num_read_kb":2781806,"num_write":146178,"num_write_kb":2427265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":189,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":595186,"num_omap_keys":1404,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13121,"ondisk_log_size":13121,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1357816,"kb_used_data":74232,"kb_used_omap":12,"kb_used_meta":1283443,"kb_avail":753616904,"statfs":{"total":773094113280,"available":771703709696,"internally_reserved":0,"allocated":76013568,"data_stored":62802638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1314246193},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":593183,"num_omap_keys":1396,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005074"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:18.466360+0000","last_change":"2024-09-22T08:42:17.435884+0000","last_active":"2024-09-22T08:52:18.466360+0000","last_peered":"2024-09-22T08:52:18.466360+0000","last_clean":"2024-09-22T08:52:18.466360+0000","last_became_active":"2024-09-22T08:42:17.435576+0000","last_became_peered":"2024-09-22T08:42:17.435576+0000","last_unstale":"2024-09-22T08:52:18.466360+0000","last_undegraded":"2024-09-22T08:52:18.466360+0000","last_fullsized":"2024-09-22T08:52:18.466360+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:18:12.399293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"263'7","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.464541+0000","last_change":"2024-09-22T08:31:14.254986+0000","last_active":"2024-09-22T08:56:16.464541+0000","last_peered":"2024-09-22T08:56:16.464541+0000","last_clean":"2024-09-22T08:56:16.464541+0000","last_became_active":"2024-09-22T08:31:14.254610+0000","last_became_peered":"2024-09-22T08:31:14.254610+0000","last_unstale":"2024-09-22T08:56:16.464541+0000","last_undegraded":"2024-09-22T08:56:16.464541+0000","last_fullsized":"2024-09-22T08:56:16.464541+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:29:54.524062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"263'4","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.314152+0000","last_change":"2024-09-22T08:31:11.216063+0000","last_active":"2024-09-22T08:56:16.314152+0000","last_peered":"2024-09-22T08:56:16.314152+0000","last_clean":"2024-09-22T08:56:16.314152+0000","last_became_active":"2024-09-22T08:31:11.215757+0000","last_became_peered":"2024-09-22T08:31:11.215757+0000","last_unstale":"2024-09-22T08:56:16.314152+0000","last_undegraded":"2024-09-22T08:56:16.314152+0000","last_fullsized":"2024-09-22T08:56:16.314152+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:30:49.027544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6203,"num_write":4,"num_write_kb":3131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"263'27","reported_seq":114,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.412862+0000","last_change":"2024-09-22T08:29:26.069972+0000","last_active":"2024-09-22T08:54:27.412862+0000","last_peered":"2024-09-22T08:54:27.412862+0000","last_clean":"2024-09-22T08:54:27.412862+0000","last_became_active":"2024-09-22T08:29:26.069635+0000","last_became_peered":"2024-09-22T08:29:26.069635+0000","last_unstale":"2024-09-22T08:54:27.412862+0000","last_undegraded":"2024-09-22T08:54:27.412862+0000","last_fullsized":"2024-09-22T08:54:27.412862+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":139,"num_write":76,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:17.271882+0000","last_change":"2024-09-22T08:42:17.433226+0000","last_active":"2024-09-22T08:52:17.271882+0000","last_peered":"2024-09-22T08:52:17.271882+0000","last_clean":"2024-09-22T08:52:17.271882+0000","last_became_active":"2024-09-22T08:42:17.432946+0000","last_became_peered":"2024-09-22T08:42:17.432946+0000","last_unstale":"2024-09-22T08:52:17.271882+0000","last_undegraded":"2024-09-22T08:52:17.271882+0000","last_fullsized":"2024-09-22T08:52:17.271882+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:57:47.463137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"263'5","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.380075+0000","last_change":"2024-09-22T08:31:14.256838+0000","last_active":"2024-09-22T08:56:16.380075+0000","last_peered":"2024-09-22T08:56:16.380075+0000","last_clean":"2024-09-22T08:56:16.380075+0000","last_became_active":"2024-09-22T08:31:14.256486+0000","last_became_peered":"2024-09-22T08:31:14.256486+0000","last_unstale":"2024-09-22T08:56:16.380075+0000","last_undegraded":"2024-09-22T08:56:16.380075+0000","last_fullsized":"2024-09-22T08:56:16.380075+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:05:48.401720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8240,"num_write":10,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"260'2","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:42.284418+0000","last_change":"2024-09-22T08:31:11.216967+0000","last_active":"2024-09-22T08:53:42.284418+0000","last_peered":"2024-09-22T08:53:42.284418+0000","last_clean":"2024-09-22T08:53:42.284418+0000","last_became_active":"2024-09-22T08:31:11.216515+0000","last_became_peered":"2024-09-22T08:31:11.216515+0000","last_unstale":"2024-09-22T08:53:42.284418+0000","last_undegraded":"2024-09-22T08:53:42.284418+0000","last_fullsized":"2024-09-22T08:53:42.284418+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:40:06.800121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"263'31","reported_seq":130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:32.404964+0000","last_change":"2024-09-22T08:29:26.074014+0000","last_active":"2024-09-22T08:53:32.404964+0000","last_peered":"2024-09-22T08:53:32.404964+0000","last_clean":"2024-09-22T08:53:32.404964+0000","last_became_active":"2024-09-22T08:29:26.073415+0000","last_became_peered":"2024-09-22T08:29:26.073415+0000","last_unstale":"2024-09-22T08:53:32.404964+0000","last_undegraded":"2024-09-22T08:53:32.404964+0000","last_fullsized":"2024-09-22T08:53:32.404964+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:07:10.743328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":176,"num_write":77,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:58.380840+0000","last_change":"2024-09-22T08:42:17.436629+0000","last_active":"2024-09-22T08:51:58.380840+0000","last_peered":"2024-09-22T08:51:58.380840+0000","last_clean":"2024-09-22T08:51:58.380840+0000","last_became_active":"2024-09-22T08:42:17.436334+0000","last_became_peered":"2024-09-22T08:42:17.436334+0000","last_unstale":"2024-09-22T08:51:58.380840+0000","last_undegraded":"2024-09-22T08:51:58.380840+0000","last_fullsized":"2024-09-22T08:51:58.380840+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:04:08.905608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"260'4","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:12.288779+0000","last_change":"2024-09-22T08:31:14.257057+0000","last_active":"2024-09-22T08:54:12.288779+0000","last_peered":"2024-09-22T08:54:12.288779+0000","last_clean":"2024-09-22T08:54:12.288779+0000","last_became_active":"2024-09-22T08:31:14.256769+0000","last_became_peered":"2024-09-22T08:31:14.256769+0000","last_unstale":"2024-09-22T08:54:12.288779+0000","last_undegraded":"2024-09-22T08:54:12.288779+0000","last_fullsized":"2024-09-22T08:54:12.288779+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:06:32.378399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:17.289881+0000","last_change":"2024-09-22T08:31:11.211351+0000","last_active":"2024-09-22T08:53:17.289881+0000","last_peered":"2024-09-22T08:53:17.289881+0000","last_clean":"2024-09-22T08:53:17.289881+0000","last_became_active":"2024-09-22T08:31:11.210892+0000","last_became_peered":"2024-09-22T08:31:11.210892+0000","last_unstale":"2024-09-22T08:53:17.289881+0000","last_undegraded":"2024-09-22T08:53:17.289881+0000","last_fullsized":"2024-09-22T08:53:17.289881+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:20:58.942888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"263'43","reported_seq":162,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:57.268885+0000","last_change":"2024-09-22T08:29:26.068513+0000","last_active":"2024-09-22T08:51:57.268885+0000","last_peered":"2024-09-22T08:51:57.268885+0000","last_clean":"2024-09-22T08:51:57.268885+0000","last_became_active":"2024-09-22T08:29:26.067963+0000","last_became_peered":"2024-09-22T08:29:26.067963+0000","last_unstale":"2024-09-22T08:51:57.268885+0000","last_undegraded":"2024-09-22T08:51:57.268885+0000","last_fullsized":"2024-09-22T08:51:57.268885+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:19:50.645315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":380,"num_read_kb":284,"num_write":99,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:02.269565+0000","last_change":"2024-09-22T08:42:17.431238+0000","last_active":"2024-09-22T08:52:02.269565+0000","last_peered":"2024-09-22T08:52:02.269565+0000","last_clean":"2024-09-22T08:52:02.269565+0000","last_became_active":"2024-09-22T08:42:17.430938+0000","last_became_peered":"2024-09-22T08:42:17.430938+0000","last_unstale":"2024-09-22T08:52:02.269565+0000","last_undegraded":"2024-09-22T08:52:02.269565+0000","last_fullsized":"2024-09-22T08:52:02.269565+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:34:21.108839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"263'5","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:22.299767+0000","last_change":"2024-09-22T08:31:14.257263+0000","last_active":"2024-09-22T08:55:22.299767+0000","last_peered":"2024-09-22T08:55:22.299767+0000","last_clean":"2024-09-22T08:55:22.299767+0000","last_became_active":"2024-09-22T08:31:14.255086+0000","last_became_peered":"2024-09-22T08:31:14.255086+0000","last_unstale":"2024-09-22T08:55:22.299767+0000","last_undegraded":"2024-09-22T08:55:22.299767+0000","last_fullsized":"2024-09-22T08:55:22.299767+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:28:49.743007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:08.397293+0000","last_change":"2024-09-22T08:31:11.207653+0000","last_active":"2024-09-22T08:54:08.397293+0000","last_peered":"2024-09-22T08:54:08.397293+0000","last_clean":"2024-09-22T08:54:08.397293+0000","last_became_active":"2024-09-22T08:31:11.207375+0000","last_became_peered":"2024-09-22T08:31:11.207375+0000","last_unstale":"2024-09-22T08:54:08.397293+0000","last_undegraded":"2024-09-22T08:54:08.397293+0000","last_fullsized":"2024-09-22T08:54:08.397293+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:55:26.229921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"263'31","reported_seq":122,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:57.268855+0000","last_change":"2024-09-22T08:29:26.072556+0000","last_active":"2024-09-22T08:51:57.268855+0000","last_peered":"2024-09-22T08:51:57.268855+0000","last_clean":"2024-09-22T08:51:57.268855+0000","last_became_active":"2024-09-22T08:29:26.072183+0000","last_became_peered":"2024-09-22T08:29:26.072183+0000","last_unstale":"2024-09-22T08:51:57.268855+0000","last_undegraded":"2024-09-22T08:51:57.268855+0000","last_fullsized":"2024-09-22T08:51:57.268855+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:30:12.756499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":233,"num_read_kb":155,"num_write":81,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:22.298701+0000","last_change":"2024-09-22T08:42:17.418516+0000","last_active":"2024-09-22T08:54:22.298701+0000","last_peered":"2024-09-22T08:54:22.298701+0000","last_clean":"2024-09-22T08:54:22.298701+0000","last_became_active":"2024-09-22T08:42:17.418224+0000","last_became_peered":"2024-09-22T08:42:17.418224+0000","last_unstale":"2024-09-22T08:54:22.298701+0000","last_undegraded":"2024-09-22T08:54:22.298701+0000","last_fullsized":"2024-09-22T08:54:22.298701+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:06:49.930134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"263'5","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.365270+0000","last_change":"2024-09-22T08:31:14.262084+0000","last_active":"2024-09-22T08:56:16.365270+0000","last_peered":"2024-09-22T08:56:16.365270+0000","last_clean":"2024-09-22T08:56:16.365270+0000","last_became_active":"2024-09-22T08:31:14.261753+0000","last_became_peered":"2024-09-22T08:31:14.261753+0000","last_unstale":"2024-09-22T08:56:16.365270+0000","last_undegraded":"2024-09-22T08:56:16.365270+0000","last_fullsized":"2024-09-22T08:56:16.365270+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:21:33.510246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"260'9","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:57.277829+0000","last_change":"2024-09-22T08:31:11.215327+0000","last_active":"2024-09-22T08:52:57.277829+0000","last_peered":"2024-09-22T08:52:57.277829+0000","last_clean":"2024-09-22T08:52:57.277829+0000","last_became_active":"2024-09-22T08:31:11.215024+0000","last_became_peered":"2024-09-22T08:31:11.215024+0000","last_unstale":"2024-09-22T08:52:57.277829+0000","last_undegraded":"2024-09-22T08:52:57.277829+0000","last_fullsized":"2024-09-22T08:52:57.277829+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:27:55.278924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":17455,"num_write":14,"num_write_kb":5165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"263'52","reported_seq":185,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:50.448372+0000","last_change":"2024-09-22T08:29:26.071185+0000","last_active":"2024-09-22T08:53:50.448372+0000","last_peered":"2024-09-22T08:53:50.448372+0000","last_clean":"2024-09-22T08:53:50.448372+0000","last_became_active":"2024-09-22T08:29:26.070913+0000","last_became_peered":"2024-09-22T08:29:26.070913+0000","last_unstale":"2024-09-22T08:53:50.448372+0000","last_undegraded":"2024-09-22T08:53:50.448372+0000","last_fullsized":"2024-09-22T08:53:50.448372+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:50:29.931826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":289,"num_write":128,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:42.398384+0000","last_change":"2024-09-22T08:42:17.428992+0000","last_active":"2024-09-22T08:52:42.398384+0000","last_peered":"2024-09-22T08:52:42.398384+0000","last_clean":"2024-09-22T08:52:42.398384+0000","last_became_active":"2024-09-22T08:42:17.428589+0000","last_became_peered":"2024-09-22T08:42:17.428589+0000","last_unstale":"2024-09-22T08:52:42.398384+0000","last_undegraded":"2024-09-22T08:52:42.398384+0000","last_fullsized":"2024-09-22T08:52:42.398384+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:34:40.543481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"263'6","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:28.407335+0000","last_change":"2024-09-22T08:31:14.256450+0000","last_active":"2024-09-22T08:55:28.407335+0000","last_peered":"2024-09-22T08:55:28.407335+0000","last_clean":"2024-09-22T08:55:28.407335+0000","last_became_active":"2024-09-22T08:31:14.256133+0000","last_became_peered":"2024-09-22T08:31:14.256133+0000","last_unstale":"2024-09-22T08:55:28.407335+0000","last_undegraded":"2024-09-22T08:55:28.407335+0000","last_fullsized":"2024-09-22T08:55:28.407335+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:35:53.157445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":16,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"263'2","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:23.406685+0000","last_change":"2024-09-22T08:31:11.214428+0000","last_active":"2024-09-22T08:55:23.406685+0000","last_peered":"2024-09-22T08:55:23.406685+0000","last_clean":"2024-09-22T08:55:23.406685+0000","last_became_active":"2024-09-22T08:31:11.214152+0000","last_became_peered":"2024-09-22T08:31:11.214152+0000","last_unstale":"2024-09-22T08:55:23.406685+0000","last_undegraded":"2024-09-22T08:55:23.406685+0000","last_fullsized":"2024-09-22T08:55:23.406685+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:24:25.711738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"263'41","reported_seq":155,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:56.954636+0000","last_change":"2024-09-22T08:29:26.073207+0000","last_active":"2024-09-22T08:52:56.954636+0000","last_peered":"2024-09-22T08:52:56.954636+0000","last_clean":"2024-09-22T08:52:56.954636+0000","last_became_active":"2024-09-22T08:29:26.072935+0000","last_became_peered":"2024-09-22T08:29:26.072935+0000","last_unstale":"2024-09-22T08:52:56.954636+0000","last_undegraded":"2024-09-22T08:52:56.954636+0000","last_fullsized":"2024-09-22T08:52:56.954636+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:08.214582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":341,"num_read_kb":226,"num_write":101,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:16.259851+0000","last_change":"2024-09-22T08:42:17.429598+0000","last_active":"2024-09-22T08:52:16.259851+0000","last_peered":"2024-09-22T08:52:16.259851+0000","last_clean":"2024-09-22T08:52:16.259851+0000","last_became_active":"2024-09-22T08:42:17.429298+0000","last_became_peered":"2024-09-22T08:42:17.429298+0000","last_unstale":"2024-09-22T08:52:16.259851+0000","last_undegraded":"2024-09-22T08:52:16.259851+0000","last_fullsized":"2024-09-22T08:52:16.259851+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:26:36.238407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"260'7","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:46.271089+0000","last_change":"2024-09-22T08:31:14.258062+0000","last_active":"2024-09-22T08:53:46.271089+0000","last_peered":"2024-09-22T08:53:46.271089+0000","last_clean":"2024-09-22T08:53:46.271089+0000","last_became_active":"2024-09-22T08:31:14.257659+0000","last_became_peered":"2024-09-22T08:31:14.257659+0000","last_unstale":"2024-09-22T08:53:46.271089+0000","last_undegraded":"2024-09-22T08:53:46.271089+0000","last_fullsized":"2024-09-22T08:53:46.271089+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:32:38.962644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4143,"num_write":12,"num_write_kb":1069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"263'2","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:13.496086+0000","last_change":"2024-09-22T08:31:11.216523+0000","last_active":"2024-09-22T08:56:13.496086+0000","last_peered":"2024-09-22T08:56:13.496086+0000","last_clean":"2024-09-22T08:56:13.496086+0000","last_became_active":"2024-09-22T08:31:11.216248+0000","last_became_peered":"2024-09-22T08:31:11.216248+0000","last_unstale":"2024-09-22T08:56:13.496086+0000","last_undegraded":"2024-09-22T08:56:13.496086+0000","last_fullsized":"2024-09-22T08:56:13.496086+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:46:16.857947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"263'16","reported_seq":84,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:47.294012+0000","last_change":"2024-09-22T08:29:26.076631+0000","last_active":"2024-09-22T08:53:47.294012+0000","last_peered":"2024-09-22T08:53:47.294012+0000","last_clean":"2024-09-22T08:53:47.294012+0000","last_became_active":"2024-09-22T08:29:26.076243+0000","last_became_peered":"2024-09-22T08:29:26.076243+0000","last_unstale":"2024-09-22T08:53:47.294012+0000","last_undegraded":"2024-09-22T08:53:47.294012+0000","last_fullsized":"2024-09-22T08:53:47.294012+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:02:16.942826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":86,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:18.466402+0000","last_change":"2024-09-22T08:42:17.433193+0000","last_active":"2024-09-22T08:52:18.466402+0000","last_peered":"2024-09-22T08:52:18.466402+0000","last_clean":"2024-09-22T08:52:18.466402+0000","last_became_active":"2024-09-22T08:42:17.432923+0000","last_became_peered":"2024-09-22T08:42:17.432923+0000","last_unstale":"2024-09-22T08:52:18.466402+0000","last_undegraded":"2024-09-22T08:52:18.466402+0000","last_fullsized":"2024-09-22T08:52:18.466402+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:17:35.794496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"263'8","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.426367+0000","last_change":"2024-09-22T08:31:14.256601+0000","last_active":"2024-09-22T08:56:16.426367+0000","last_peered":"2024-09-22T08:56:16.426367+0000","last_clean":"2024-09-22T08:56:16.426367+0000","last_became_active":"2024-09-22T08:31:14.256055+0000","last_became_peered":"2024-09-22T08:31:14.256055+0000","last_unstale":"2024-09-22T08:56:16.426367+0000","last_undegraded":"2024-09-22T08:56:16.426367+0000","last_fullsized":"2024-09-22T08:56:16.426367+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:48:31.013743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":18434,"num_write":18,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"263'8","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.321761+0000","last_change":"2024-09-22T08:31:11.215990+0000","last_active":"2024-09-22T08:56:16.321761+0000","last_peered":"2024-09-22T08:56:16.321761+0000","last_clean":"2024-09-22T08:56:16.321761+0000","last_became_active":"2024-09-22T08:31:11.215609+0000","last_became_peered":"2024-09-22T08:31:11.215609+0000","last_unstale":"2024-09-22T08:56:16.321761+0000","last_undegraded":"2024-09-22T08:56:16.321761+0000","last_fullsized":"2024-09-22T08:56:16.321761+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:52:29.022225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":18,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"263'42","reported_seq":155,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:37.283579+0000","last_change":"2024-09-22T08:29:26.067779+0000","last_active":"2024-09-22T08:53:37.283579+0000","last_peered":"2024-09-22T08:53:37.283579+0000","last_clean":"2024-09-22T08:53:37.283579+0000","last_became_active":"2024-09-22T08:29:26.066447+0000","last_became_peered":"2024-09-22T08:29:26.066447+0000","last_unstale":"2024-09-22T08:53:37.283579+0000","last_undegraded":"2024-09-22T08:53:37.283579+0000","last_fullsized":"2024-09-22T08:53:37.283579+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:16:11.771113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":325,"num_read_kb":214,"num_write":107,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:57.286263+0000","last_change":"2024-09-22T08:42:17.436182+0000","last_active":"2024-09-22T08:53:57.286263+0000","last_peered":"2024-09-22T08:53:57.286263+0000","last_clean":"2024-09-22T08:53:57.286263+0000","last_became_active":"2024-09-22T08:42:17.435842+0000","last_became_peered":"2024-09-22T08:42:17.435842+0000","last_unstale":"2024-09-22T08:53:57.286263+0000","last_undegraded":"2024-09-22T08:53:57.286263+0000","last_fullsized":"2024-09-22T08:53:57.286263+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:44:56.306198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"263'2","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:27.307511+0000","last_change":"2024-09-22T08:31:14.255793+0000","last_active":"2024-09-22T08:55:27.307511+0000","last_peered":"2024-09-22T08:55:27.307511+0000","last_clean":"2024-09-22T08:55:27.307511+0000","last_became_active":"2024-09-22T08:31:14.255497+0000","last_became_peered":"2024-09-22T08:31:14.255497+0000","last_unstale":"2024-09-22T08:55:27.307511+0000","last_undegraded":"2024-09-22T08:55:27.307511+0000","last_fullsized":"2024-09-22T08:55:27.307511+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:31.376498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"263'4","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:33.400382+0000","last_change":"2024-09-22T08:31:11.217315+0000","last_active":"2024-09-22T08:54:33.400382+0000","last_peered":"2024-09-22T08:54:33.400382+0000","last_clean":"2024-09-22T08:54:33.400382+0000","last_became_active":"2024-09-22T08:31:11.216997+0000","last_became_peered":"2024-09-22T08:31:11.216997+0000","last_unstale":"2024-09-22T08:54:33.400382+0000","last_undegraded":"2024-09-22T08:54:33.400382+0000","last_fullsized":"2024-09-22T08:54:33.400382+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:29.441399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"263'25","reported_seq":111,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:37.405734+0000","last_change":"2024-09-22T08:29:26.071169+0000","last_active":"2024-09-22T08:53:37.405734+0000","last_peered":"2024-09-22T08:53:37.405734+0000","last_clean":"2024-09-22T08:53:37.405734+0000","last_became_active":"2024-09-22T08:29:26.070906+0000","last_became_peered":"2024-09-22T08:29:26.070906+0000","last_unstale":"2024-09-22T08:53:37.405734+0000","last_undegraded":"2024-09-22T08:53:37.405734+0000","last_fullsized":"2024-09-22T08:53:37.405734+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:55:47.696276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":135,"num_write":63,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:57.286143+0000","last_change":"2024-09-22T08:42:17.430752+0000","last_active":"2024-09-22T08:53:57.286143+0000","last_peered":"2024-09-22T08:53:57.286143+0000","last_clean":"2024-09-22T08:53:57.286143+0000","last_became_active":"2024-09-22T08:42:17.430457+0000","last_became_peered":"2024-09-22T08:42:17.430457+0000","last_unstale":"2024-09-22T08:53:57.286143+0000","last_undegraded":"2024-09-22T08:53:57.286143+0000","last_fullsized":"2024-09-22T08:53:57.286143+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:57:22.012215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"263'9","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.464617+0000","last_change":"2024-09-22T08:31:14.256126+0000","last_active":"2024-09-22T08:56:16.464617+0000","last_peered":"2024-09-22T08:56:16.464617+0000","last_clean":"2024-09-22T08:56:16.464617+0000","last_became_active":"2024-09-22T08:31:14.255245+0000","last_became_peered":"2024-09-22T08:31:14.255245+0000","last_unstale":"2024-09-22T08:56:16.464617+0000","last_undegraded":"2024-09-22T08:56:16.464617+0000","last_fullsized":"2024-09-22T08:56:16.464617+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:45:50.399892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":20480,"num_write":14,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"260'6","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:58.472145+0000","last_change":"2024-09-22T08:31:11.211294+0000","last_active":"2024-09-22T08:52:58.472145+0000","last_peered":"2024-09-22T08:52:58.472145+0000","last_clean":"2024-09-22T08:52:58.472145+0000","last_became_active":"2024-09-22T08:31:11.211000+0000","last_became_peered":"2024-09-22T08:31:11.211000+0000","last_unstale":"2024-09-22T08:52:58.472145+0000","last_undegraded":"2024-09-22T08:52:58.472145+0000","last_fullsized":"2024-09-22T08:52:58.472145+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:34:47.341250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8192,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"263'32","reported_seq":130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:37.405687+0000","last_change":"2024-09-22T08:29:26.075955+0000","last_active":"2024-09-22T08:53:37.405687+0000","last_peered":"2024-09-22T08:53:37.405687+0000","last_clean":"2024-09-22T08:53:37.405687+0000","last_became_active":"2024-09-22T08:29:26.074151+0000","last_became_peered":"2024-09-22T08:29:26.074151+0000","last_unstale":"2024-09-22T08:53:37.405687+0000","last_undegraded":"2024-09-22T08:53:37.405687+0000","last_fullsized":"2024-09-22T08:53:37.405687+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:36:04.989650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":180,"num_write":78,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:56.272330+0000","last_change":"2024-09-22T08:42:17.432351+0000","last_active":"2024-09-22T08:53:56.272330+0000","last_peered":"2024-09-22T08:53:56.272330+0000","last_clean":"2024-09-22T08:53:56.272330+0000","last_became_active":"2024-09-22T08:42:17.432056+0000","last_became_peered":"2024-09-22T08:42:17.432056+0000","last_unstale":"2024-09-22T08:53:56.272330+0000","last_undegraded":"2024-09-22T08:53:56.272330+0000","last_fullsized":"2024-09-22T08:53:56.272330+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:19:22.863621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"263'6","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.434342+0000","last_change":"2024-09-22T08:31:14.259324+0000","last_active":"2024-09-22T08:56:16.434342+0000","last_peered":"2024-09-22T08:56:16.434342+0000","last_clean":"2024-09-22T08:56:16.434342+0000","last_became_active":"2024-09-22T08:31:14.259009+0000","last_became_peered":"2024-09-22T08:31:14.259009+0000","last_unstale":"2024-09-22T08:56:16.434342+0000","last_undegraded":"2024-09-22T08:56:16.434342+0000","last_fullsized":"2024-09-22T08:56:16.434342+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:19:27.710241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8192,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"263'5","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:22.306782+0000","last_change":"2024-09-22T08:31:11.216003+0000","last_active":"2024-09-22T08:55:22.306782+0000","last_peered":"2024-09-22T08:55:22.306782+0000","last_clean":"2024-09-22T08:55:22.306782+0000","last_became_active":"2024-09-22T08:31:11.215708+0000","last_became_peered":"2024-09-22T08:31:11.215708+0000","last_unstale":"2024-09-22T08:55:22.306782+0000","last_undegraded":"2024-09-22T08:55:22.306782+0000","last_fullsized":"2024-09-22T08:55:22.306782+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:19:30.880256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"263'26","reported_seq":110,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:37.292875+0000","last_change":"2024-09-22T08:29:26.069760+0000","last_active":"2024-09-22T08:53:37.292875+0000","last_peered":"2024-09-22T08:53:37.292875+0000","last_clean":"2024-09-22T08:53:37.292875+0000","last_became_active":"2024-09-22T08:29:26.069440+0000","last_became_peered":"2024-09-22T08:29:26.069440+0000","last_unstale":"2024-09-22T08:53:37.292875+0000","last_undegraded":"2024-09-22T08:53:37.292875+0000","last_fullsized":"2024-09-22T08:53:37.292875+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:48:41.597112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":134,"num_write":69,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:58.479676+0000","last_change":"2024-09-22T08:42:17.436175+0000","last_active":"2024-09-22T08:53:58.479676+0000","last_peered":"2024-09-22T08:53:58.479676+0000","last_clean":"2024-09-22T08:53:58.479676+0000","last_became_active":"2024-09-22T08:42:17.435825+0000","last_became_peered":"2024-09-22T08:42:17.435825+0000","last_unstale":"2024-09-22T08:53:58.479676+0000","last_undegraded":"2024-09-22T08:53:58.479676+0000","last_fullsized":"2024-09-22T08:53:58.479676+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:50:07.804836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"260'2","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:58.472161+0000","last_change":"2024-09-22T08:31:14.256513+0000","last_active":"2024-09-22T08:52:58.472161+0000","last_peered":"2024-09-22T08:52:58.472161+0000","last_clean":"2024-09-22T08:52:58.472161+0000","last_became_active":"2024-09-22T08:31:14.256218+0000","last_became_peered":"2024-09-22T08:31:14.256218+0000","last_unstale":"2024-09-22T08:52:58.472161+0000","last_undegraded":"2024-09-22T08:52:58.472161+0000","last_fullsized":"2024-09-22T08:52:58.472161+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:27:57.407928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:57.277949+0000","last_change":"2024-09-22T08:31:11.214383+0000","last_active":"2024-09-22T08:52:57.277949+0000","last_peered":"2024-09-22T08:52:57.277949+0000","last_clean":"2024-09-22T08:52:57.277949+0000","last_became_active":"2024-09-22T08:31:11.214111+0000","last_became_peered":"2024-09-22T08:31:11.214111+0000","last_unstale":"2024-09-22T08:52:57.277949+0000","last_undegraded":"2024-09-22T08:52:57.277949+0000","last_fullsized":"2024-09-22T08:52:57.277949+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:55:25.197395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"263'20","reported_seq":95,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:53.388471+0000","last_change":"2024-09-22T08:29:26.069573+0000","last_active":"2024-09-22T08:52:53.388471+0000","last_peered":"2024-09-22T08:52:53.388471+0000","last_clean":"2024-09-22T08:52:53.388471+0000","last_became_active":"2024-09-22T08:29:26.069293+0000","last_became_peered":"2024-09-22T08:29:26.069293+0000","last_unstale":"2024-09-22T08:52:53.388471+0000","last_undegraded":"2024-09-22T08:52:53.388471+0000","last_fullsized":"2024-09-22T08:52:53.388471+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:06:27.426634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":89,"num_write":52,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:57.268896+0000","last_change":"2024-09-22T08:42:17.429646+0000","last_active":"2024-09-22T08:51:57.268896+0000","last_peered":"2024-09-22T08:51:57.268896+0000","last_clean":"2024-09-22T08:51:57.268896+0000","last_became_active":"2024-09-22T08:42:17.429163+0000","last_became_peered":"2024-09-22T08:42:17.429163+0000","last_unstale":"2024-09-22T08:51:57.268896+0000","last_undegraded":"2024-09-22T08:51:57.268896+0000","last_fullsized":"2024-09-22T08:51:57.268896+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:52:58.326332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"263'2","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:37.292485+0000","last_change":"2024-09-22T08:31:14.259778+0000","last_active":"2024-09-22T08:54:37.292485+0000","last_peered":"2024-09-22T08:54:37.292485+0000","last_clean":"2024-09-22T08:54:37.292485+0000","last_became_active":"2024-09-22T08:31:14.259484+0000","last_became_peered":"2024-09-22T08:31:14.259484+0000","last_unstale":"2024-09-22T08:54:37.292485+0000","last_undegraded":"2024-09-22T08:54:37.292485+0000","last_fullsized":"2024-09-22T08:54:37.292485+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:10:58.591122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"263'6","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:33.399760+0000","last_change":"2024-09-22T08:31:11.203333+0000","last_active":"2024-09-22T08:54:33.399760+0000","last_peered":"2024-09-22T08:54:33.399760+0000","last_clean":"2024-09-22T08:54:33.399760+0000","last_became_active":"2024-09-22T08:31:11.203053+0000","last_became_peered":"2024-09-22T08:31:11.203053+0000","last_unstale":"2024-09-22T08:54:33.399760+0000","last_undegraded":"2024-09-22T08:54:33.399760+0000","last_fullsized":"2024-09-22T08:54:33.399760+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:29:11.633546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4146,"num_write":6,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"263'318","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:48.387936+0000","last_change":"2024-09-22T08:29:26.070758+0000","last_active":"2024-09-22T08:52:48.387936+0000","last_peered":"2024-09-22T08:52:48.387936+0000","last_clean":"2024-09-22T08:52:48.387936+0000","last_became_active":"2024-09-22T08:29:26.070475+0000","last_became_peered":"2024-09-22T08:29:26.070475+0000","last_unstale":"2024-09-22T08:52:48.387936+0000","last_undegraded":"2024-09-22T08:52:48.387936+0000","last_fullsized":"2024-09-22T08:52:48.387936+0000","mapping_epoch":252,"log_start":"263'300","ondisk_log_start":"263'300","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:21:22.076883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2975,"num_read_kb":3480,"num_write":654,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:57.268912+0000","last_change":"2024-09-22T08:42:17.431838+0000","last_active":"2024-09-22T08:51:57.268912+0000","last_peered":"2024-09-22T08:51:57.268912+0000","last_clean":"2024-09-22T08:51:57.268912+0000","last_became_active":"2024-09-22T08:42:17.431528+0000","last_became_peered":"2024-09-22T08:42:17.431528+0000","last_unstale":"2024-09-22T08:51:57.268912+0000","last_undegraded":"2024-09-22T08:51:57.268912+0000","last_fullsized":"2024-09-22T08:51:57.268912+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:29:19.259078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:17.271924+0000","last_change":"2024-09-22T08:31:14.256347+0000","last_active":"2024-09-22T08:52:17.271924+0000","last_peered":"2024-09-22T08:52:17.271924+0000","last_clean":"2024-09-22T08:52:17.271924+0000","last_became_active":"2024-09-22T08:31:14.256054+0000","last_became_peered":"2024-09-22T08:31:14.256054+0000","last_unstale":"2024-09-22T08:52:17.271924+0000","last_undegraded":"2024-09-22T08:52:17.271924+0000","last_fullsized":"2024-09-22T08:52:17.271924+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:02:08.137287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"263'8","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.323100+0000","last_change":"2024-09-22T08:31:11.213551+0000","last_active":"2024-09-22T08:56:16.323100+0000","last_peered":"2024-09-22T08:56:16.323100+0000","last_clean":"2024-09-22T08:56:16.323100+0000","last_became_active":"2024-09-22T08:31:11.212539+0000","last_became_peered":"2024-09-22T08:31:11.212539+0000","last_unstale":"2024-09-22T08:56:16.323100+0000","last_undegraded":"2024-09-22T08:56:16.323100+0000","last_fullsized":"2024-09-22T08:56:16.323100+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:38:43.370688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":18,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"263'51","reported_seq":176,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:47.088466+0000","last_change":"2024-09-22T08:29:26.070905+0000","last_active":"2024-09-22T08:53:47.088466+0000","last_peered":"2024-09-22T08:53:47.088466+0000","last_clean":"2024-09-22T08:53:47.088466+0000","last_became_active":"2024-09-22T08:29:26.070576+0000","last_became_peered":"2024-09-22T08:29:26.070576+0000","last_unstale":"2024-09-22T08:53:47.088466+0000","last_undegraded":"2024-09-22T08:53:47.088466+0000","last_fullsized":"2024-09-22T08:53:47.088466+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:55:10.934768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":389,"num_read_kb":252,"num_write":129,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:02.409119+0000","last_change":"2024-09-22T08:42:17.426058+0000","last_active":"2024-09-22T08:54:02.409119+0000","last_peered":"2024-09-22T08:54:02.409119+0000","last_clean":"2024-09-22T08:54:02.409119+0000","last_became_active":"2024-09-22T08:42:17.425759+0000","last_became_peered":"2024-09-22T08:42:17.425759+0000","last_unstale":"2024-09-22T08:54:02.409119+0000","last_undegraded":"2024-09-22T08:54:02.409119+0000","last_fullsized":"2024-09-22T08:54:02.409119+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:58:13.952750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"263'2","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:37.300796+0000","last_change":"2024-09-22T08:31:14.258185+0000","last_active":"2024-09-22T08:54:37.300796+0000","last_peered":"2024-09-22T08:54:37.300796+0000","last_clean":"2024-09-22T08:54:37.300796+0000","last_became_active":"2024-09-22T08:31:14.257900+0000","last_became_peered":"2024-09-22T08:31:14.257900+0000","last_unstale":"2024-09-22T08:54:37.300796+0000","last_undegraded":"2024-09-22T08:54:37.300796+0000","last_fullsized":"2024-09-22T08:54:37.300796+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:24:42.015943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":118,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"263'6","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:33.399798+0000","last_change":"2024-09-22T08:31:11.205171+0000","last_active":"2024-09-22T08:54:33.399798+0000","last_peered":"2024-09-22T08:54:33.399798+0000","last_clean":"2024-09-22T08:54:33.399798+0000","last_became_active":"2024-09-22T08:31:11.204846+0000","last_became_peered":"2024-09-22T08:31:11.204846+0000","last_unstale":"2024-09-22T08:54:33.399798+0000","last_undegraded":"2024-09-22T08:54:33.399798+0000","last_fullsized":"2024-09-22T08:54:33.399798+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:09:45.501944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":6146,"num_write":6,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"263'48","reported_seq":173,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:50.979504+0000","last_change":"2024-09-22T08:29:26.064230+0000","last_active":"2024-09-22T08:53:50.979504+0000","last_peered":"2024-09-22T08:53:50.979504+0000","last_clean":"2024-09-22T08:53:50.979504+0000","last_became_active":"2024-09-22T08:29:26.063914+0000","last_became_peered":"2024-09-22T08:29:26.063914+0000","last_unstale":"2024-09-22T08:53:50.979504+0000","last_undegraded":"2024-09-22T08:53:50.979504+0000","last_fullsized":"2024-09-22T08:53:50.979504+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:49.440925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":381,"num_read_kb":265,"num_write":119,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:51:57.268871+0000","last_change":"2024-09-22T08:42:17.431413+0000","last_active":"2024-09-22T08:51:57.268871+0000","last_peered":"2024-09-22T08:51:57.268871+0000","last_clean":"2024-09-22T08:51:57.268871+0000","last_became_active":"2024-09-22T08:42:17.429964+0000","last_became_peered":"2024-09-22T08:42:17.429964+0000","last_unstale":"2024-09-22T08:51:57.268871+0000","last_undegraded":"2024-09-22T08:51:57.268871+0000","last_fullsized":"2024-09-22T08:51:57.268871+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:20:04.762853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"260'4","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:18.383736+0000","last_change":"2024-09-22T08:31:14.260215+0000","last_active":"2024-09-22T08:52:18.383736+0000","last_peered":"2024-09-22T08:52:18.383736+0000","last_clean":"2024-09-22T08:52:18.383736+0000","last_became_active":"2024-09-22T08:31:14.259875+0000","last_became_peered":"2024-09-22T08:31:14.259875+0000","last_unstale":"2024-09-22T08:52:18.383736+0000","last_undegraded":"2024-09-22T08:52:18.383736+0000","last_fullsized":"2024-09-22T08:52:18.383736+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:27:56.369023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:13.382799+0000","last_change":"2024-09-22T08:31:11.210358+0000","last_active":"2024-09-22T08:52:13.382799+0000","last_peered":"2024-09-22T08:52:13.382799+0000","last_clean":"2024-09-22T08:52:13.382799+0000","last_became_active":"2024-09-22T08:31:11.210054+0000","last_became_peered":"2024-09-22T08:31:11.210054+0000","last_unstale":"2024-09-22T08:52:13.382799+0000","last_undegraded":"2024-09-22T08:52:13.382799+0000","last_fullsized":"2024-09-22T08:52:13.382799+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:51:41.210904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"263'31","reported_seq":129,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:47.285810+0000","last_change":"2024-09-22T08:29:26.070816+0000","last_active":"2024-09-22T08:52:47.285810+0000","last_peered":"2024-09-22T08:52:47.285810+0000","last_clean":"2024-09-22T08:52:47.285810+0000","last_became_active":"2024-09-22T08:29:26.070492+0000","last_became_peered":"2024-09-22T08:29:26.070492+0000","last_unstale":"2024-09-22T08:52:47.285810+0000","last_undegraded":"2024-09-22T08:52:47.285810+0000","last_fullsized":"2024-09-22T08:52:47.285810+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:33:45.551687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":169,"num_write":83,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:12.279928+0000","last_change":"2024-09-22T08:42:17.433621+0000","last_active":"2024-09-22T08:53:12.279928+0000","last_peered":"2024-09-22T08:53:12.279928+0000","last_clean":"2024-09-22T08:53:12.279928+0000","last_became_active":"2024-09-22T08:42:17.433193+0000","last_became_peered":"2024-09-22T08:42:17.433193+0000","last_unstale":"2024-09-22T08:53:12.279928+0000","last_undegraded":"2024-09-22T08:53:12.279928+0000","last_fullsized":"2024-09-22T08:53:12.279928+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:13.472859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:47.294076+0000","last_change":"2024-09-22T08:31:14.255077+0000","last_active":"2024-09-22T08:53:47.294076+0000","last_peered":"2024-09-22T08:53:47.294076+0000","last_clean":"2024-09-22T08:53:47.294076+0000","last_became_active":"2024-09-22T08:31:14.254710+0000","last_became_peered":"2024-09-22T08:31:14.254710+0000","last_unstale":"2024-09-22T08:53:47.294076+0000","last_undegraded":"2024-09-22T08:53:47.294076+0000","last_fullsized":"2024-09-22T08:53:47.294076+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:21:50.613490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:41.270510+0000","last_change":"2024-09-22T08:31:11.203734+0000","last_active":"2024-09-22T08:53:41.270510+0000","last_peered":"2024-09-22T08:53:41.270510+0000","last_clean":"2024-09-22T08:53:41.270510+0000","last_became_active":"2024-09-22T08:31:11.203413+0000","last_became_peered":"2024-09-22T08:31:11.203413+0000","last_unstale":"2024-09-22T08:53:41.270510+0000","last_undegraded":"2024-09-22T08:53:41.270510+0000","last_fullsized":"2024-09-22T08:53:41.270510+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:44:09.630276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:22.298743+0000","last_change":"2024-09-22T08:29:26.072040+0000","last_active":"2024-09-22T08:54:22.298743+0000","last_peered":"2024-09-22T08:54:22.298743+0000","last_clean":"2024-09-22T08:54:22.298743+0000","last_became_active":"2024-09-22T08:29:26.071742+0000","last_became_peered":"2024-09-22T08:29:26.071742+0000","last_unstale":"2024-09-22T08:54:22.298743+0000","last_undegraded":"2024-09-22T08:54:22.298743+0000","last_fullsized":"2024-09-22T08:54:22.298743+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:33.393176+0000","last_change":"2024-09-22T08:42:17.433663+0000","last_active":"2024-09-22T08:53:33.393176+0000","last_peered":"2024-09-22T08:53:33.393176+0000","last_clean":"2024-09-22T08:53:33.393176+0000","last_became_active":"2024-09-22T08:42:17.433346+0000","last_became_peered":"2024-09-22T08:42:17.433346+0000","last_unstale":"2024-09-22T08:53:33.393176+0000","last_undegraded":"2024-09-22T08:53:33.393176+0000","last_fullsized":"2024-09-22T08:53:33.393176+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:42:29.816828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"260'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:47.294055+0000","last_change":"2024-09-22T08:31:14.256186+0000","last_active":"2024-09-22T08:53:47.294055+0000","last_peered":"2024-09-22T08:53:47.294055+0000","last_clean":"2024-09-22T08:53:47.294055+0000","last_became_active":"2024-09-22T08:31:14.255243+0000","last_became_peered":"2024-09-22T08:31:14.255243+0000","last_unstale":"2024-09-22T08:53:47.294055+0000","last_undegraded":"2024-09-22T08:53:47.294055+0000","last_fullsized":"2024-09-22T08:53:47.294055+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:14:49.285058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"263'6","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.322059+0000","last_change":"2024-09-22T08:31:11.210583+0000","last_active":"2024-09-22T08:56:16.322059+0000","last_peered":"2024-09-22T08:56:16.322059+0000","last_clean":"2024-09-22T08:56:16.322059+0000","last_became_active":"2024-09-22T08:31:11.210266+0000","last_became_peered":"2024-09-22T08:31:11.210266+0000","last_unstale":"2024-09-22T08:56:16.322059+0000","last_undegraded":"2024-09-22T08:56:16.322059+0000","last_fullsized":"2024-09-22T08:56:16.322059+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:55:04.094565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":13312,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"263'39","reported_seq":149,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:13.398267+0000","last_change":"2024-09-22T08:29:26.076488+0000","last_active":"2024-09-22T08:54:13.398267+0000","last_peered":"2024-09-22T08:54:13.398267+0000","last_clean":"2024-09-22T08:54:13.398267+0000","last_became_active":"2024-09-22T08:29:26.076175+0000","last_became_peered":"2024-09-22T08:29:26.076175+0000","last_unstale":"2024-09-22T08:54:13.398267+0000","last_undegraded":"2024-09-22T08:54:13.398267+0000","last_fullsized":"2024-09-22T08:54:13.398267+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":317,"num_read_kb":219,"num_write":102,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:08.390223+0000","last_change":"2024-09-22T08:42:17.435167+0000","last_active":"2024-09-22T08:53:08.390223+0000","last_peered":"2024-09-22T08:53:08.390223+0000","last_clean":"2024-09-22T08:53:08.390223+0000","last_became_active":"2024-09-22T08:42:17.434909+0000","last_became_peered":"2024-09-22T08:42:17.434909+0000","last_unstale":"2024-09-22T08:53:08.390223+0000","last_undegraded":"2024-09-22T08:53:08.390223+0000","last_fullsized":"2024-09-22T08:53:08.390223+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:22.417079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"263'4","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:07.313078+0000","last_change":"2024-09-22T08:31:14.252478+0000","last_active":"2024-09-22T08:56:07.313078+0000","last_peered":"2024-09-22T08:56:07.313078+0000","last_clean":"2024-09-22T08:56:07.313078+0000","last_became_active":"2024-09-22T08:31:14.252184+0000","last_became_peered":"2024-09-22T08:31:14.252184+0000","last_unstale":"2024-09-22T08:56:07.313078+0000","last_undegraded":"2024-09-22T08:56:07.313078+0000","last_fullsized":"2024-09-22T08:56:07.313078+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:09.321417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":4,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"263'2","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:57.311651+0000","last_change":"2024-09-22T08:31:11.218103+0000","last_active":"2024-09-22T08:55:57.311651+0000","last_peered":"2024-09-22T08:55:57.311651+0000","last_clean":"2024-09-22T08:55:57.311651+0000","last_became_active":"2024-09-22T08:31:11.217115+0000","last_became_peered":"2024-09-22T08:31:11.217115+0000","last_unstale":"2024-09-22T08:55:57.311651+0000","last_undegraded":"2024-09-22T08:55:57.311651+0000","last_fullsized":"2024-09-22T08:55:57.311651+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:15:42.708378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"263'57","reported_seq":193,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:13.397781+0000","last_change":"2024-09-22T08:29:26.076353+0000","last_active":"2024-09-22T08:54:13.397781+0000","last_peered":"2024-09-22T08:54:13.397781+0000","last_clean":"2024-09-22T08:54:13.397781+0000","last_became_active":"2024-09-22T08:29:26.076048+0000","last_became_peered":"2024-09-22T08:29:26.076048+0000","last_unstale":"2024-09-22T08:54:13.397781+0000","last_undegraded":"2024-09-22T08:54:13.397781+0000","last_fullsized":"2024-09-22T08:54:13.397781+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":427,"num_read_kb":265,"num_write":151,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:08.389849+0000","last_change":"2024-09-22T08:42:17.431316+0000","last_active":"2024-09-22T08:53:08.389849+0000","last_peered":"2024-09-22T08:53:08.389849+0000","last_clean":"2024-09-22T08:53:08.389849+0000","last_became_active":"2024-09-22T08:42:17.430974+0000","last_became_peered":"2024-09-22T08:42:17.430974+0000","last_unstale":"2024-09-22T08:53:08.389849+0000","last_undegraded":"2024-09-22T08:53:08.389849+0000","last_fullsized":"2024-09-22T08:53:08.389849+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:40:42.175541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"260'3","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:47.284984+0000","last_change":"2024-09-22T08:31:14.258289+0000","last_active":"2024-09-22T08:53:47.284984+0000","last_peered":"2024-09-22T08:53:47.284984+0000","last_clean":"2024-09-22T08:53:47.284984+0000","last_became_active":"2024-09-22T08:31:14.257952+0000","last_became_peered":"2024-09-22T08:31:14.257952+0000","last_unstale":"2024-09-22T08:53:47.284984+0000","last_undegraded":"2024-09-22T08:53:47.284984+0000","last_fullsized":"2024-09-22T08:53:47.284984+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:26:33.079615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:47.294104+0000","last_change":"2024-09-22T08:31:11.214070+0000","last_active":"2024-09-22T08:53:47.294104+0000","last_peered":"2024-09-22T08:53:47.294104+0000","last_clean":"2024-09-22T08:53:47.294104+0000","last_became_active":"2024-09-22T08:31:11.213273+0000","last_became_peered":"2024-09-22T08:31:11.213273+0000","last_unstale":"2024-09-22T08:53:47.294104+0000","last_undegraded":"2024-09-22T08:53:47.294104+0000","last_fullsized":"2024-09-22T08:53:47.294104+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:48:59.089464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"263'16","reported_seq":84,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:12.288498+0000","last_change":"2024-09-22T08:29:26.074703+0000","last_active":"2024-09-22T08:54:12.288498+0000","last_peered":"2024-09-22T08:54:12.288498+0000","last_clean":"2024-09-22T08:54:12.288498+0000","last_became_active":"2024-09-22T08:29:26.074205+0000","last_became_peered":"2024-09-22T08:29:26.074205+0000","last_unstale":"2024-09-22T08:54:12.288498+0000","last_undegraded":"2024-09-22T08:54:12.288498+0000","last_fullsized":"2024-09-22T08:54:12.288498+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":71,"num_write":43,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:32.283041+0000","last_change":"2024-09-22T08:42:17.430839+0000","last_active":"2024-09-22T08:53:32.283041+0000","last_peered":"2024-09-22T08:53:32.283041+0000","last_clean":"2024-09-22T08:53:32.283041+0000","last_became_active":"2024-09-22T08:42:17.429927+0000","last_became_peered":"2024-09-22T08:42:17.429927+0000","last_unstale":"2024-09-22T08:53:32.283041+0000","last_undegraded":"2024-09-22T08:53:32.283041+0000","last_fullsized":"2024-09-22T08:53:32.283041+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:28:06.806210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"263'6","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:08.404715+0000","last_change":"2024-09-22T08:31:14.253906+0000","last_active":"2024-09-22T08:55:08.404715+0000","last_peered":"2024-09-22T08:55:08.404715+0000","last_clean":"2024-09-22T08:55:08.404715+0000","last_became_active":"2024-09-22T08:31:14.253610+0000","last_became_peered":"2024-09-22T08:31:14.253610+0000","last_unstale":"2024-09-22T08:55:08.404715+0000","last_undegraded":"2024-09-22T08:55:08.404715+0000","last_fullsized":"2024-09-22T08:55:08.404715+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:13:39.366489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13314,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"263'4","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.380507+0000","last_change":"2024-09-22T08:31:11.217832+0000","last_active":"2024-09-22T08:56:16.380507+0000","last_peered":"2024-09-22T08:56:16.380507+0000","last_clean":"2024-09-22T08:56:16.380507+0000","last_became_active":"2024-09-22T08:31:11.217553+0000","last_became_peered":"2024-09-22T08:31:11.217553+0000","last_unstale":"2024-09-22T08:56:16.380507+0000","last_undegraded":"2024-09-22T08:56:16.380507+0000","last_fullsized":"2024-09-22T08:56:16.380507+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:22:26.456715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"263'36","reported_seq":135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:12.288462+0000","last_change":"2024-09-22T08:29:26.070957+0000","last_active":"2024-09-22T08:54:12.288462+0000","last_peered":"2024-09-22T08:54:12.288462+0000","last_clean":"2024-09-22T08:54:12.288462+0000","last_became_active":"2024-09-22T08:29:26.070671+0000","last_became_peered":"2024-09-22T08:29:26.070671+0000","last_unstale":"2024-09-22T08:54:12.288462+0000","last_undegraded":"2024-09-22T08:54:12.288462+0000","last_fullsized":"2024-09-22T08:54:12.288462+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":255,"num_read_kb":155,"num_write":90,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:36.270019+0000","last_change":"2024-09-22T08:42:17.433684+0000","last_active":"2024-09-22T08:53:36.270019+0000","last_peered":"2024-09-22T08:53:36.270019+0000","last_clean":"2024-09-22T08:53:36.270019+0000","last_became_active":"2024-09-22T08:42:17.433331+0000","last_became_peered":"2024-09-22T08:42:17.433331+0000","last_unstale":"2024-09-22T08:53:36.270019+0000","last_undegraded":"2024-09-22T08:53:36.270019+0000","last_fullsized":"2024-09-22T08:53:36.270019+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:19:35.698543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"263'4","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:06.280498+0000","last_change":"2024-09-22T08:31:14.253520+0000","last_active":"2024-09-22T08:55:06.280498+0000","last_peered":"2024-09-22T08:55:06.280498+0000","last_clean":"2024-09-22T08:55:06.280498+0000","last_became_active":"2024-09-22T08:31:14.253118+0000","last_became_peered":"2024-09-22T08:31:14.253118+0000","last_unstale":"2024-09-22T08:55:06.280498+0000","last_undegraded":"2024-09-22T08:55:06.280498+0000","last_fullsized":"2024-09-22T08:55:06.280498+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:35:19.513521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"263'9","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:02.296482+0000","last_change":"2024-09-22T08:31:11.212852+0000","last_active":"2024-09-22T08:55:02.296482+0000","last_peered":"2024-09-22T08:55:02.296482+0000","last_clean":"2024-09-22T08:55:02.296482+0000","last_became_active":"2024-09-22T08:31:11.211939+0000","last_became_peered":"2024-09-22T08:31:11.211939+0000","last_unstale":"2024-09-22T08:55:02.296482+0000","last_undegraded":"2024-09-22T08:55:02.296482+0000","last_fullsized":"2024-09-22T08:55:02.296482+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:24:50.321996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":24578,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"263'43","reported_seq":155,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:21.268004+0000","last_change":"2024-09-22T08:29:26.069502+0000","last_active":"2024-09-22T08:53:21.268004+0000","last_peered":"2024-09-22T08:53:21.268004+0000","last_clean":"2024-09-22T08:53:21.268004+0000","last_became_active":"2024-09-22T08:29:26.069202+0000","last_became_peered":"2024-09-22T08:29:26.069202+0000","last_unstale":"2024-09-22T08:53:21.268004+0000","last_undegraded":"2024-09-22T08:53:21.268004+0000","last_fullsized":"2024-09-22T08:53:21.268004+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:00:21.857731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":316,"num_read_kb":207,"num_write":121,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:33.476466+0000","last_change":"2024-09-22T08:42:17.436971+0000","last_active":"2024-09-22T08:53:33.476466+0000","last_peered":"2024-09-22T08:53:33.476466+0000","last_clean":"2024-09-22T08:53:33.476466+0000","last_became_active":"2024-09-22T08:42:17.436036+0000","last_became_peered":"2024-09-22T08:42:17.436036+0000","last_unstale":"2024-09-22T08:53:33.476466+0000","last_undegraded":"2024-09-22T08:53:33.476466+0000","last_fullsized":"2024-09-22T08:53:33.476466+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:15:23.383676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"260'6","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:47.284803+0000","last_change":"2024-09-22T08:31:14.260840+0000","last_active":"2024-09-22T08:53:47.284803+0000","last_peered":"2024-09-22T08:53:47.284803+0000","last_clean":"2024-09-22T08:53:47.284803+0000","last_became_active":"2024-09-22T08:31:14.260111+0000","last_became_peered":"2024-09-22T08:31:14.260111+0000","last_unstale":"2024-09-22T08:53:47.284803+0000","last_undegraded":"2024-09-22T08:53:47.284803+0000","last_fullsized":"2024-09-22T08:53:47.284803+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:54:00.288860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"263'5","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.322290+0000","last_change":"2024-09-22T08:31:11.213758+0000","last_active":"2024-09-22T08:56:16.322290+0000","last_peered":"2024-09-22T08:56:16.322290+0000","last_clean":"2024-09-22T08:56:16.322290+0000","last_became_active":"2024-09-22T08:31:11.213121+0000","last_became_peered":"2024-09-22T08:31:11.213121+0000","last_unstale":"2024-09-22T08:56:16.322290+0000","last_undegraded":"2024-09-22T08:56:16.322290+0000","last_fullsized":"2024-09-22T08:56:16.322290+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:13:15.074520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"263'24","reported_seq":106,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:17.280800+0000","last_change":"2024-09-22T08:29:26.068711+0000","last_active":"2024-09-22T08:53:17.280800+0000","last_peered":"2024-09-22T08:53:17.280800+0000","last_clean":"2024-09-22T08:53:17.280800+0000","last_became_active":"2024-09-22T08:29:26.068397+0000","last_became_peered":"2024-09-22T08:29:26.068397+0000","last_unstale":"2024-09-22T08:53:17.280800+0000","last_undegraded":"2024-09-22T08:53:17.280800+0000","last_fullsized":"2024-09-22T08:53:17.280800+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:31:42.395480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":108,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:32.292011+0000","last_change":"2024-09-22T08:42:17.431775+0000","last_active":"2024-09-22T08:53:32.292011+0000","last_peered":"2024-09-22T08:53:32.292011+0000","last_clean":"2024-09-22T08:53:32.292011+0000","last_became_active":"2024-09-22T08:42:17.431476+0000","last_became_peered":"2024-09-22T08:42:17.431476+0000","last_unstale":"2024-09-22T08:53:32.292011+0000","last_undegraded":"2024-09-22T08:53:32.292011+0000","last_fullsized":"2024-09-22T08:53:32.292011+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:20.126935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"263'2","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:08.488263+0000","last_change":"2024-09-22T08:31:14.257816+0000","last_active":"2024-09-22T08:55:08.488263+0000","last_peered":"2024-09-22T08:55:08.488263+0000","last_clean":"2024-09-22T08:55:08.488263+0000","last_became_active":"2024-09-22T08:31:14.257508+0000","last_became_peered":"2024-09-22T08:31:14.257508+0000","last_unstale":"2024-09-22T08:55:08.488263+0000","last_undegraded":"2024-09-22T08:55:08.488263+0000","last_fullsized":"2024-09-22T08:55:08.488263+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:30.899995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:43.394740+0000","last_change":"2024-09-22T08:31:11.215332+0000","last_active":"2024-09-22T08:53:43.394740+0000","last_peered":"2024-09-22T08:53:43.394740+0000","last_clean":"2024-09-22T08:53:43.394740+0000","last_became_active":"2024-09-22T08:31:11.214953+0000","last_became_peered":"2024-09-22T08:31:11.214953+0000","last_unstale":"2024-09-22T08:53:43.394740+0000","last_undegraded":"2024-09-22T08:53:43.394740+0000","last_fullsized":"2024-09-22T08:53:43.394740+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:54:54.175587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"263'16","reported_seq":88,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:18.474308+0000","last_change":"2024-09-22T08:29:26.072747+0000","last_active":"2024-09-22T08:53:18.474308+0000","last_peered":"2024-09-22T08:53:18.474308+0000","last_clean":"2024-09-22T08:53:18.474308+0000","last_became_active":"2024-09-22T08:29:26.072473+0000","last_became_peered":"2024-09-22T08:29:26.072473+0000","last_unstale":"2024-09-22T08:53:18.474308+0000","last_undegraded":"2024-09-22T08:53:18.474308+0000","last_fullsized":"2024-09-22T08:53:18.474308+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:22.926382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":83,"num_write":41,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:43.469960+0000","last_change":"2024-09-22T08:42:17.431917+0000","last_active":"2024-09-22T08:52:43.469960+0000","last_peered":"2024-09-22T08:52:43.469960+0000","last_clean":"2024-09-22T08:52:43.469960+0000","last_became_active":"2024-09-22T08:42:17.431637+0000","last_became_peered":"2024-09-22T08:42:17.431637+0000","last_unstale":"2024-09-22T08:52:43.469960+0000","last_undegraded":"2024-09-22T08:52:43.469960+0000","last_fullsized":"2024-09-22T08:52:43.469960+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:33:12.811194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"263'4","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.543285+0000","last_change":"2024-09-22T08:31:14.261671+0000","last_active":"2024-09-22T08:56:16.543285+0000","last_peered":"2024-09-22T08:56:16.543285+0000","last_clean":"2024-09-22T08:56:16.543285+0000","last_became_active":"2024-09-22T08:31:14.261352+0000","last_became_peered":"2024-09-22T08:31:14.261352+0000","last_unstale":"2024-09-22T08:56:16.543285+0000","last_undegraded":"2024-09-22T08:56:16.543285+0000","last_fullsized":"2024-09-22T08:56:16.543285+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:19:15.325599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"263'6","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:13.412983+0000","last_change":"2024-09-22T08:31:11.216385+0000","last_active":"2024-09-22T08:56:13.412983+0000","last_peered":"2024-09-22T08:56:13.412983+0000","last_clean":"2024-09-22T08:56:13.412983+0000","last_became_active":"2024-09-22T08:31:11.216081+0000","last_became_peered":"2024-09-22T08:31:11.216081+0000","last_unstale":"2024-09-22T08:56:13.412983+0000","last_undegraded":"2024-09-22T08:56:13.412983+0000","last_fullsized":"2024-09-22T08:56:13.412983+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:17:40.729275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":6,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"253'4","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:17.402881+0000","last_change":"2024-09-22T08:29:26.073082+0000","last_active":"2024-09-22T08:53:17.402881+0000","last_peered":"2024-09-22T08:53:17.402881+0000","last_clean":"2024-09-22T08:53:17.402881+0000","last_became_active":"2024-09-22T08:29:26.072681+0000","last_became_peered":"2024-09-22T08:29:26.072681+0000","last_unstale":"2024-09-22T08:53:17.402881+0000","last_undegraded":"2024-09-22T08:53:17.402881+0000","last_fullsized":"2024-09-22T08:53:17.402881+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:10:40.106076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:43.469980+0000","last_change":"2024-09-22T08:42:17.432516+0000","last_active":"2024-09-22T08:52:43.469980+0000","last_peered":"2024-09-22T08:52:43.469980+0000","last_clean":"2024-09-22T08:52:43.469980+0000","last_became_active":"2024-09-22T08:42:17.430084+0000","last_became_peered":"2024-09-22T08:42:17.430084+0000","last_unstale":"2024-09-22T08:52:43.469980+0000","last_undegraded":"2024-09-22T08:52:43.469980+0000","last_fullsized":"2024-09-22T08:52:43.469980+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:34:54.878963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"260'2","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:12.288667+0000","last_change":"2024-09-22T08:31:14.259915+0000","last_active":"2024-09-22T08:54:12.288667+0000","last_peered":"2024-09-22T08:54:12.288667+0000","last_clean":"2024-09-22T08:54:12.288667+0000","last_became_active":"2024-09-22T08:31:14.259624+0000","last_became_peered":"2024-09-22T08:31:14.259624+0000","last_unstale":"2024-09-22T08:54:12.288667+0000","last_undegraded":"2024-09-22T08:54:12.288667+0000","last_fullsized":"2024-09-22T08:54:12.288667+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:44:39.512910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"263'5","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.510695+0000","last_change":"2024-09-22T08:31:11.214838+0000","last_active":"2024-09-22T08:56:16.510695+0000","last_peered":"2024-09-22T08:56:16.510695+0000","last_clean":"2024-09-22T08:56:16.510695+0000","last_became_active":"2024-09-22T08:31:11.214279+0000","last_became_peered":"2024-09-22T08:31:11.214279+0000","last_unstale":"2024-09-22T08:56:16.510695+0000","last_undegraded":"2024-09-22T08:56:16.510695+0000","last_fullsized":"2024-09-22T08:56:16.510695+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:50:49.253194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"263'2","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:18.391441+0000","last_change":"2024-09-22T08:29:26.075341+0000","last_active":"2024-09-22T08:53:18.391441+0000","last_peered":"2024-09-22T08:53:18.391441+0000","last_clean":"2024-09-22T08:53:18.391441+0000","last_became_active":"2024-09-22T08:29:26.074971+0000","last_became_peered":"2024-09-22T08:29:26.074971+0000","last_unstale":"2024-09-22T08:53:18.391441+0000","last_undegraded":"2024-09-22T08:53:18.391441+0000","last_fullsized":"2024-09-22T08:53:18.391441+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:38:15.699643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:22.290069+0000","last_change":"2024-09-22T08:42:17.433389+0000","last_active":"2024-09-22T08:54:22.290069+0000","last_peered":"2024-09-22T08:54:22.290069+0000","last_clean":"2024-09-22T08:54:22.290069+0000","last_became_active":"2024-09-22T08:42:17.433090+0000","last_became_peered":"2024-09-22T08:42:17.433090+0000","last_unstale":"2024-09-22T08:54:22.290069+0000","last_undegraded":"2024-09-22T08:54:22.290069+0000","last_fullsized":"2024-09-22T08:54:22.290069+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:05:15.147705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"260'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:53.471440+0000","last_change":"2024-09-22T08:31:14.257105+0000","last_active":"2024-09-22T08:52:53.471440+0000","last_peered":"2024-09-22T08:52:53.471440+0000","last_clean":"2024-09-22T08:52:53.471440+0000","last_became_active":"2024-09-22T08:31:14.256835+0000","last_became_peered":"2024-09-22T08:31:14.256835+0000","last_unstale":"2024-09-22T08:52:53.471440+0000","last_undegraded":"2024-09-22T08:52:53.471440+0000","last_fullsized":"2024-09-22T08:52:53.471440+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:01:16.187889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"263'5","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.321901+0000","last_change":"2024-09-22T08:31:11.212839+0000","last_active":"2024-09-22T08:56:16.321901+0000","last_peered":"2024-09-22T08:56:16.321901+0000","last_clean":"2024-09-22T08:56:16.321901+0000","last_became_active":"2024-09-22T08:31:11.212487+0000","last_became_peered":"2024-09-22T08:31:11.212487+0000","last_unstale":"2024-09-22T08:56:16.321901+0000","last_undegraded":"2024-09-22T08:56:16.321901+0000","last_fullsized":"2024-09-22T08:56:16.321901+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:30:25.357785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"263'131","reported_seq":432,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:31.276216+0000","last_change":"2024-09-22T08:29:26.067437+0000","last_active":"2024-09-22T08:54:31.276216+0000","last_peered":"2024-09-22T08:54:31.276216+0000","last_clean":"2024-09-22T08:54:31.276216+0000","last_became_active":"2024-09-22T08:29:26.067149+0000","last_became_peered":"2024-09-22T08:29:26.067149+0000","last_unstale":"2024-09-22T08:54:31.276216+0000","last_undegraded":"2024-09-22T08:54:31.276216+0000","last_fullsized":"2024-09-22T08:54:31.276216+0000","mapping_epoch":252,"log_start":"260'100","ondisk_log_start":"260'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1238,"num_read_kb":970,"num_write":283,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:43.387307+0000","last_change":"2024-09-22T08:42:17.435234+0000","last_active":"2024-09-22T08:52:43.387307+0000","last_peered":"2024-09-22T08:52:43.387307+0000","last_clean":"2024-09-22T08:52:43.387307+0000","last_became_active":"2024-09-22T08:42:17.434424+0000","last_became_peered":"2024-09-22T08:42:17.434424+0000","last_unstale":"2024-09-22T08:52:43.387307+0000","last_undegraded":"2024-09-22T08:52:43.387307+0000","last_fullsized":"2024-09-22T08:52:43.387307+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:58:01.260992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"260'9","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:58.389082+0000","last_change":"2024-09-22T08:31:14.255605+0000","last_active":"2024-09-22T08:52:58.389082+0000","last_peered":"2024-09-22T08:52:58.389082+0000","last_clean":"2024-09-22T08:52:58.389082+0000","last_became_active":"2024-09-22T08:31:14.255160+0000","last_became_peered":"2024-09-22T08:31:14.255160+0000","last_unstale":"2024-09-22T08:52:58.389082+0000","last_undegraded":"2024-09-22T08:52:58.389082+0000","last_fullsized":"2024-09-22T08:52:58.389082+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:32:19.999119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":23554,"num_write":14,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:53.388519+0000","last_change":"2024-09-22T08:31:11.216563+0000","last_active":"2024-09-22T08:52:53.388519+0000","last_peered":"2024-09-22T08:52:53.388519+0000","last_clean":"2024-09-22T08:52:53.388519+0000","last_became_active":"2024-09-22T08:31:11.216271+0000","last_became_peered":"2024-09-22T08:31:11.216271+0000","last_unstale":"2024-09-22T08:52:53.388519+0000","last_undegraded":"2024-09-22T08:52:53.388519+0000","last_fullsized":"2024-09-22T08:52:53.388519+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:55:11.448805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"263'19","reported_seq":98,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.299530+0000","last_change":"2024-09-22T08:29:26.070044+0000","last_active":"2024-09-22T08:54:27.299530+0000","last_peered":"2024-09-22T08:54:27.299530+0000","last_clean":"2024-09-22T08:54:27.299530+0000","last_became_active":"2024-09-22T08:29:26.069730+0000","last_became_peered":"2024-09-22T08:29:26.069730+0000","last_unstale":"2024-09-22T08:54:27.299530+0000","last_undegraded":"2024-09-22T08:54:27.299530+0000","last_fullsized":"2024-09-22T08:54:27.299530+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":95,"num_write":48,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:07.288626+0000","last_change":"2024-09-22T08:42:17.419131+0000","last_active":"2024-09-22T08:53:07.288626+0000","last_peered":"2024-09-22T08:53:07.288626+0000","last_clean":"2024-09-22T08:53:07.288626+0000","last_became_active":"2024-09-22T08:42:17.418864+0000","last_became_peered":"2024-09-22T08:42:17.418864+0000","last_unstale":"2024-09-22T08:53:07.288626+0000","last_undegraded":"2024-09-22T08:53:07.288626+0000","last_fullsized":"2024-09-22T08:53:07.288626+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:05:15.592372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"263'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.434270+0000","last_change":"2024-09-22T08:31:14.259787+0000","last_active":"2024-09-22T08:56:16.434270+0000","last_peered":"2024-09-22T08:56:16.434270+0000","last_clean":"2024-09-22T08:56:16.434270+0000","last_became_active":"2024-09-22T08:31:14.259485+0000","last_became_peered":"2024-09-22T08:31:14.259485+0000","last_unstale":"2024-09-22T08:56:16.434270+0000","last_undegraded":"2024-09-22T08:56:16.434270+0000","last_fullsized":"2024-09-22T08:56:16.434270+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:38:49.843585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"260'5","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:16.267265+0000","last_change":"2024-09-22T08:31:11.211139+0000","last_active":"2024-09-22T08:53:16.267265+0000","last_peered":"2024-09-22T08:53:16.267265+0000","last_clean":"2024-09-22T08:53:16.267265+0000","last_became_active":"2024-09-22T08:31:11.210835+0000","last_became_peered":"2024-09-22T08:31:11.210835+0000","last_unstale":"2024-09-22T08:53:16.267265+0000","last_undegraded":"2024-09-22T08:53:16.267265+0000","last_fullsized":"2024-09-22T08:53:16.267265+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:48:20.118083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"263'36","reported_seq":146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:26.275720+0000","last_change":"2024-09-22T08:29:26.068377+0000","last_active":"2024-09-22T08:54:26.275720+0000","last_peered":"2024-09-22T08:54:26.275720+0000","last_clean":"2024-09-22T08:54:26.275720+0000","last_became_active":"2024-09-22T08:29:26.068105+0000","last_became_peered":"2024-09-22T08:29:26.068105+0000","last_unstale":"2024-09-22T08:54:26.275720+0000","last_undegraded":"2024-09-22T08:54:26.275720+0000","last_fullsized":"2024-09-22T08:54:26.275720+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":308,"num_read_kb":184,"num_write":90,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:07.401463+0000","last_change":"2024-09-22T08:42:17.435288+0000","last_active":"2024-09-22T08:53:07.401463+0000","last_peered":"2024-09-22T08:53:07.401463+0000","last_clean":"2024-09-22T08:53:07.401463+0000","last_became_active":"2024-09-22T08:42:17.434953+0000","last_became_peered":"2024-09-22T08:42:17.434953+0000","last_unstale":"2024-09-22T08:53:07.401463+0000","last_undegraded":"2024-09-22T08:53:07.401463+0000","last_fullsized":"2024-09-22T08:53:07.401463+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:45:12.549260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"260'2","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:18.391339+0000","last_change":"2024-09-22T08:31:14.255977+0000","last_active":"2024-09-22T08:53:18.391339+0000","last_peered":"2024-09-22T08:53:18.391339+0000","last_clean":"2024-09-22T08:53:18.391339+0000","last_became_active":"2024-09-22T08:31:14.255534+0000","last_became_peered":"2024-09-22T08:31:14.255534+0000","last_unstale":"2024-09-22T08:53:18.391339+0000","last_undegraded":"2024-09-22T08:53:18.391339+0000","last_fullsized":"2024-09-22T08:53:18.391339+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:09:54.469702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"263'6","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:13.412902+0000","last_change":"2024-09-22T08:31:11.214320+0000","last_active":"2024-09-22T08:56:13.412902+0000","last_peered":"2024-09-22T08:56:13.412902+0000","last_clean":"2024-09-22T08:56:13.412902+0000","last_became_active":"2024-09-22T08:31:11.213851+0000","last_became_peered":"2024-09-22T08:31:11.213851+0000","last_unstale":"2024-09-22T08:56:13.412902+0000","last_undegraded":"2024-09-22T08:56:13.412902+0000","last_fullsized":"2024-09-22T08:56:13.412902+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:24:21.493458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":6146,"num_write":6,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"263'4","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:28.399787+0000","last_change":"2024-09-22T08:29:26.075210+0000","last_active":"2024-09-22T08:54:28.399787+0000","last_peered":"2024-09-22T08:54:28.399787+0000","last_clean":"2024-09-22T08:54:28.399787+0000","last_became_active":"2024-09-22T08:29:26.074907+0000","last_became_peered":"2024-09-22T08:29:26.074907+0000","last_unstale":"2024-09-22T08:54:28.399787+0000","last_undegraded":"2024-09-22T08:54:28.399787+0000","last_fullsized":"2024-09-22T08:54:28.399787+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:42.275910+0000","last_change":"2024-09-22T08:42:17.430325+0000","last_active":"2024-09-22T08:52:42.275910+0000","last_peered":"2024-09-22T08:52:42.275910+0000","last_clean":"2024-09-22T08:52:42.275910+0000","last_became_active":"2024-09-22T08:42:17.429341+0000","last_became_peered":"2024-09-22T08:42:17.429341+0000","last_unstale":"2024-09-22T08:52:42.275910+0000","last_undegraded":"2024-09-22T08:52:42.275910+0000","last_fullsized":"2024-09-22T08:52:42.275910+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:58:45.447447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"263'4","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.364149+0000","last_change":"2024-09-22T08:31:14.246719+0000","last_active":"2024-09-22T08:56:16.364149+0000","last_peered":"2024-09-22T08:56:16.364149+0000","last_clean":"2024-09-22T08:56:16.364149+0000","last_became_active":"2024-09-22T08:31:14.246417+0000","last_became_peered":"2024-09-22T08:31:14.246417+0000","last_unstale":"2024-09-22T08:56:16.364149+0000","last_undegraded":"2024-09-22T08:56:16.364149+0000","last_fullsized":"2024-09-22T08:56:16.364149+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:41:02.060530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"263'9","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.381511+0000","last_change":"2024-09-22T08:31:11.211394+0000","last_active":"2024-09-22T08:56:16.381511+0000","last_peered":"2024-09-22T08:56:16.381511+0000","last_clean":"2024-09-22T08:56:16.381511+0000","last_became_active":"2024-09-22T08:31:11.211079+0000","last_became_peered":"2024-09-22T08:31:11.211079+0000","last_unstale":"2024-09-22T08:56:16.381511+0000","last_undegraded":"2024-09-22T08:56:16.381511+0000","last_fullsized":"2024-09-22T08:56:16.381511+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:24:21.252446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10242,"num_write":14,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"263'18","reported_seq":89,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:28.399741+0000","last_change":"2024-09-22T08:29:26.068293+0000","last_active":"2024-09-22T08:54:28.399741+0000","last_peered":"2024-09-22T08:54:28.399741+0000","last_clean":"2024-09-22T08:54:28.399741+0000","last_became_active":"2024-09-22T08:29:26.067964+0000","last_became_peered":"2024-09-22T08:29:26.067964+0000","last_unstale":"2024-09-22T08:54:28.399741+0000","last_undegraded":"2024-09-22T08:54:28.399741+0000","last_fullsized":"2024-09-22T08:54:28.399741+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":85,"num_write":46,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:43.387400+0000","last_change":"2024-09-22T08:42:17.438619+0000","last_active":"2024-09-22T08:52:43.387400+0000","last_peered":"2024-09-22T08:52:43.387400+0000","last_clean":"2024-09-22T08:52:43.387400+0000","last_became_active":"2024-09-22T08:42:17.438318+0000","last_became_peered":"2024-09-22T08:42:17.438318+0000","last_unstale":"2024-09-22T08:52:43.387400+0000","last_undegraded":"2024-09-22T08:52:43.387400+0000","last_fullsized":"2024-09-22T08:52:43.387400+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:18:22.838300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:11.274093+0000","last_change":"2024-09-22T08:31:14.258446+0000","last_active":"2024-09-22T08:54:11.274093+0000","last_peered":"2024-09-22T08:54:11.274093+0000","last_clean":"2024-09-22T08:54:11.274093+0000","last_became_active":"2024-09-22T08:31:14.258136+0000","last_became_peered":"2024-09-22T08:31:14.258136+0000","last_unstale":"2024-09-22T08:54:11.274093+0000","last_undegraded":"2024-09-22T08:54:11.274093+0000","last_fullsized":"2024-09-22T08:54:11.274093+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:09:06.068754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"263'2","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:13.412427+0000","last_change":"2024-09-22T08:31:11.214416+0000","last_active":"2024-09-22T08:56:13.412427+0000","last_peered":"2024-09-22T08:56:13.412427+0000","last_clean":"2024-09-22T08:56:13.412427+0000","last_became_active":"2024-09-22T08:31:11.214112+0000","last_became_peered":"2024-09-22T08:31:11.214112+0000","last_unstale":"2024-09-22T08:56:13.412427+0000","last_undegraded":"2024-09-22T08:56:13.412427+0000","last_fullsized":"2024-09-22T08:56:13.412427+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:13:58.692971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"263'20","reported_seq":98,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:31.269276+0000","last_change":"2024-09-22T08:29:26.069691+0000","last_active":"2024-09-22T08:53:31.269276+0000","last_peered":"2024-09-22T08:53:31.269276+0000","last_clean":"2024-09-22T08:53:31.269276+0000","last_became_active":"2024-09-22T08:29:26.069407+0000","last_became_peered":"2024-09-22T08:29:26.069407+0000","last_unstale":"2024-09-22T08:53:31.269276+0000","last_undegraded":"2024-09-22T08:53:31.269276+0000","last_fullsized":"2024-09-22T08:53:31.269276+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:46:12.719810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":95,"num_write":53,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"263'230","reported_seq":875,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:29.491448+0000","last_change":"2024-09-22T08:56:29.491448+0000","last_active":"2024-09-22T08:56:29.491448+0000","last_peered":"2024-09-22T08:56:29.491448+0000","last_clean":"2024-09-22T08:56:29.491448+0000","last_became_active":"2024-09-22T08:15:04.957090+0000","last_became_peered":"2024-09-22T08:15:04.957090+0000","last_unstale":"2024-09-22T08:56:29.491448+0000","last_undegraded":"2024-09-22T08:56:29.491448+0000","last_fullsized":"2024-09-22T08:56:29.491448+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'230","last_scrub_stamp":"2024-09-22T08:56:29.491342+0000","last_deep_scrub":"263'230","last_deep_scrub_stamp":"2024-09-22T08:56:29.491342+0000","last_clean_scrub_stamp":"2024-09-22T08:56:29.491342+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:44:19.142689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":587,"num_read_kb":1123,"num_write":1117,"num_write_kb":27318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"263'478","reported_seq":2209,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:34.800274+0000","last_change":"2024-09-22T08:56:34.800274+0000","last_active":"2024-09-22T08:56:34.800274+0000","last_peered":"2024-09-22T08:56:34.800274+0000","last_clean":"2024-09-22T08:56:34.800274+0000","last_became_active":"2024-09-22T08:15:06.980616+0000","last_became_peered":"2024-09-22T08:15:06.980616+0000","last_unstale":"2024-09-22T08:56:34.800274+0000","last_undegraded":"2024-09-22T08:56:34.800274+0000","last_fullsized":"2024-09-22T08:56:34.800274+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'478","last_scrub_stamp":"2024-09-22T08:56:34.800168+0000","last_deep_scrub":"263'478","last_deep_scrub_stamp":"2024-09-22T08:56:34.800168+0000","last_clean_scrub_stamp":"2024-09-22T08:56:34.800168+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:41:01.961869+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2847,"num_read_kb":2707,"num_write":560,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"263'240","reported_seq":884,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:35.366911+0000","last_change":"2024-09-22T08:56:35.366911+0000","last_active":"2024-09-22T08:56:35.366911+0000","last_peered":"2024-09-22T08:56:35.366911+0000","last_clean":"2024-09-22T08:56:35.366911+0000","last_became_active":"2024-09-22T08:15:04.956643+0000","last_became_peered":"2024-09-22T08:15:04.956643+0000","last_unstale":"2024-09-22T08:56:35.366911+0000","last_undegraded":"2024-09-22T08:56:35.366911+0000","last_fullsized":"2024-09-22T08:56:35.366911+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'240","last_scrub_stamp":"2024-09-22T08:56:35.366815+0000","last_deep_scrub":"263'240","last_deep_scrub_stamp":"2024-09-22T08:56:35.366815+0000","last_clean_scrub_stamp":"2024-09-22T08:56:35.366815+0000","objects_scrubbed":1,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:47:44.936217+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":599,"num_read_kb":19417,"num_write":1105,"num_write_kb":24732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"263'386","reported_seq":1918,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:17.378056+0000","last_change":"2024-09-22T08:15:06.974580+0000","last_active":"2024-09-22T08:54:17.378056+0000","last_peered":"2024-09-22T08:54:17.378056+0000","last_clean":"2024-09-22T08:54:17.378056+0000","last_became_active":"2024-09-22T08:15:06.974127+0000","last_became_peered":"2024-09-22T08:15:06.974127+0000","last_unstale":"2024-09-22T08:54:17.378056+0000","last_undegraded":"2024-09-22T08:54:17.378056+0000","last_fullsized":"2024-09-22T08:54:17.378056+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:33:05.581133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2097,"num_read_kb":2016,"num_write":427,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"263'258","reported_seq":933,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:34.351393+0000","last_change":"2024-09-22T08:56:34.351393+0000","last_active":"2024-09-22T08:56:34.351393+0000","last_peered":"2024-09-22T08:56:34.351393+0000","last_clean":"2024-09-22T08:56:34.351393+0000","last_became_active":"2024-09-22T08:15:04.956659+0000","last_became_peered":"2024-09-22T08:15:04.956659+0000","last_unstale":"2024-09-22T08:56:34.351393+0000","last_undegraded":"2024-09-22T08:56:34.351393+0000","last_fullsized":"2024-09-22T08:56:34.351393+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'258","last_scrub_stamp":"2024-09-22T08:56:34.351295+0000","last_deep_scrub":"263'258","last_deep_scrub_stamp":"2024-09-22T08:56:34.351295+0000","last_clean_scrub_stamp":"2024-09-22T08:56:34.351295+0000","objects_scrubbed":4,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:09:46.701747+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":699,"num_read_kb":25466,"num_write":1131,"num_write_kb":27131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"263'898","reported_seq":2493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.960994+0000","last_change":"2024-09-22T08:15:06.969243+0000","last_active":"2024-09-22T08:54:27.960994+0000","last_peered":"2024-09-22T08:54:27.960994+0000","last_clean":"2024-09-22T08:54:27.960994+0000","last_became_active":"2024-09-22T08:15:06.968959+0000","last_became_peered":"2024-09-22T08:15:06.968959+0000","last_unstale":"2024-09-22T08:54:27.960994+0000","last_undegraded":"2024-09-22T08:54:27.960994+0000","last_fullsized":"2024-09-22T08:54:27.960994+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":800,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:30:18.722556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4516,"num_read_kb":4043,"num_write":1241,"num_write_kb":490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"263'241","reported_seq":886,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:28.308434+0000","last_change":"2024-09-22T08:56:28.308434+0000","last_active":"2024-09-22T08:56:28.308434+0000","last_peered":"2024-09-22T08:56:28.308434+0000","last_clean":"2024-09-22T08:56:28.308434+0000","last_became_active":"2024-09-22T08:15:04.961309+0000","last_became_peered":"2024-09-22T08:15:04.961309+0000","last_unstale":"2024-09-22T08:56:28.308434+0000","last_undegraded":"2024-09-22T08:56:28.308434+0000","last_fullsized":"2024-09-22T08:56:28.308434+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'241","last_scrub_stamp":"2024-09-22T08:56:28.308329+0000","last_deep_scrub":"263'241","last_deep_scrub_stamp":"2024-09-22T08:56:28.308329+0000","last_clean_scrub_stamp":"2024-09-22T08:56:28.308329+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:50:55.099697+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079903,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":558,"num_read_kb":61455,"num_write":1043,"num_write_kb":33072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"263'535","reported_seq":2240,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:37.704325+0000","last_change":"2024-09-22T08:56:37.704325+0000","last_active":"2024-09-22T08:56:37.704325+0000","last_peered":"2024-09-22T08:56:37.704325+0000","last_clean":"2024-09-22T08:56:37.704325+0000","last_became_active":"2024-09-22T08:15:06.969540+0000","last_became_peered":"2024-09-22T08:15:06.969540+0000","last_unstale":"2024-09-22T08:56:37.704325+0000","last_undegraded":"2024-09-22T08:56:37.704325+0000","last_fullsized":"2024-09-22T08:56:37.704325+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'535","last_scrub_stamp":"2024-09-22T08:56:37.704238+0000","last_deep_scrub":"263'535","last_deep_scrub_stamp":"2024-09-22T08:56:37.704238+0000","last_clean_scrub_stamp":"2024-09-22T08:56:37.704238+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:01:40.290775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2823,"num_read_kb":2637,"num_write":641,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"263'217","reported_seq":925,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:26.489027+0000","last_change":"2024-09-22T08:56:26.489027+0000","last_active":"2024-09-22T08:56:26.489027+0000","last_peered":"2024-09-22T08:56:26.489027+0000","last_clean":"2024-09-22T08:56:26.489027+0000","last_became_active":"2024-09-22T08:15:04.957717+0000","last_became_peered":"2024-09-22T08:15:04.957717+0000","last_unstale":"2024-09-22T08:56:26.489027+0000","last_undegraded":"2024-09-22T08:56:26.489027+0000","last_fullsized":"2024-09-22T08:56:26.489027+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'217","last_scrub_stamp":"2024-09-22T08:56:26.488928+0000","last_deep_scrub":"263'217","last_deep_scrub_stamp":"2024-09-22T08:56:26.488928+0000","last_clean_scrub_stamp":"2024-09-22T08:56:26.488928+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:37:50.212068+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1573037,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":720,"num_read_kb":166418,"num_write":955,"num_write_kb":57547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"263'607","reported_seq":2137,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:36.493433+0000","last_change":"2024-09-22T08:56:36.493433+0000","last_active":"2024-09-22T08:56:36.493433+0000","last_peered":"2024-09-22T08:56:36.493433+0000","last_clean":"2024-09-22T08:56:36.493433+0000","last_became_active":"2024-09-22T08:15:06.962605+0000","last_became_peered":"2024-09-22T08:15:06.962605+0000","last_unstale":"2024-09-22T08:56:36.493433+0000","last_undegraded":"2024-09-22T08:56:36.493433+0000","last_fullsized":"2024-09-22T08:56:36.493433+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'607","last_scrub_stamp":"2024-09-22T08:56:36.493326+0000","last_deep_scrub":"263'607","last_deep_scrub_stamp":"2024-09-22T08:56:36.493326+0000","last_clean_scrub_stamp":"2024-09-22T08:56:36.493326+0000","objects_scrubbed":4,"log_size":107,"log_dups_size":500,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:23:12.495770+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3087,"num_read_kb":2910,"num_write":853,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":486,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"263'257","reported_seq":944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:27.325351+0000","last_change":"2024-09-22T08:56:27.325351+0000","last_active":"2024-09-22T08:56:27.325351+0000","last_peered":"2024-09-22T08:56:27.325351+0000","last_clean":"2024-09-22T08:56:27.325351+0000","last_became_active":"2024-09-22T08:15:04.962128+0000","last_became_peered":"2024-09-22T08:15:04.962128+0000","last_unstale":"2024-09-22T08:56:27.325351+0000","last_undegraded":"2024-09-22T08:56:27.325351+0000","last_fullsized":"2024-09-22T08:56:27.325351+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'257","last_scrub_stamp":"2024-09-22T08:56:27.325259+0000","last_deep_scrub":"263'257","last_deep_scrub_stamp":"2024-09-22T08:56:27.325259+0000","last_clean_scrub_stamp":"2024-09-22T08:56:27.325259+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:48:56.416424+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":753,"num_read_kb":52063,"num_write":1239,"num_write_kb":44926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"263'872","reported_seq":2701,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:38.475719+0000","last_change":"2024-09-22T08:56:38.475719+0000","last_active":"2024-09-22T08:56:38.475719+0000","last_peered":"2024-09-22T08:56:38.475719+0000","last_clean":"2024-09-22T08:56:38.475719+0000","last_became_active":"2024-09-22T08:15:06.972756+0000","last_became_peered":"2024-09-22T08:15:06.972756+0000","last_unstale":"2024-09-22T08:56:38.475719+0000","last_undegraded":"2024-09-22T08:56:38.475719+0000","last_fullsized":"2024-09-22T08:56:38.475719+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'872","last_scrub_stamp":"2024-09-22T08:56:38.475633+0000","last_deep_scrub":"263'872","last_deep_scrub_stamp":"2024-09-22T08:56:38.475633+0000","last_clean_scrub_stamp":"2024-09-22T08:56:38.475633+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":800,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:27:33.543291+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4443,"num_read_kb":4056,"num_write":1153,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"263'251","reported_seq":925,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:31.486584+0000","last_change":"2024-09-22T08:56:31.486584+0000","last_active":"2024-09-22T08:56:31.486584+0000","last_peered":"2024-09-22T08:56:31.486584+0000","last_clean":"2024-09-22T08:56:31.486584+0000","last_became_active":"2024-09-22T08:15:04.944916+0000","last_became_peered":"2024-09-22T08:15:04.944916+0000","last_unstale":"2024-09-22T08:56:31.486584+0000","last_undegraded":"2024-09-22T08:56:31.486584+0000","last_fullsized":"2024-09-22T08:56:31.486584+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'251","last_scrub_stamp":"2024-09-22T08:56:31.486476+0000","last_deep_scrub":"263'251","last_deep_scrub_stamp":"2024-09-22T08:56:31.486476+0000","last_clean_scrub_stamp":"2024-09-22T08:56:31.486476+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:49:01.795181+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":805,"num_read_kb":10946,"num_write":1075,"num_write_kb":28039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"263'557","reported_seq":2089,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:37.452437+0000","last_change":"2024-09-22T08:56:37.452437+0000","last_active":"2024-09-22T08:56:37.452437+0000","last_peered":"2024-09-22T08:56:37.452437+0000","last_clean":"2024-09-22T08:56:37.452437+0000","last_became_active":"2024-09-22T08:15:06.968853+0000","last_became_peered":"2024-09-22T08:15:06.968853+0000","last_unstale":"2024-09-22T08:56:37.452437+0000","last_undegraded":"2024-09-22T08:56:37.452437+0000","last_fullsized":"2024-09-22T08:56:37.452437+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'557","last_scrub_stamp":"2024-09-22T08:56:37.452353+0000","last_deep_scrub":"263'557","last_deep_scrub_stamp":"2024-09-22T08:56:37.452353+0000","last_clean_scrub_stamp":"2024-09-22T08:56:37.452353+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:58:45.111881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2932,"num_read_kb":2656,"num_write":742,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":743,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"263'185","reported_seq":762,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:33.339657+0000","last_change":"2024-09-22T08:56:33.339657+0000","last_active":"2024-09-22T08:56:33.339657+0000","last_peered":"2024-09-22T08:56:33.339657+0000","last_clean":"2024-09-22T08:56:33.339657+0000","last_became_active":"2024-09-22T08:15:04.959395+0000","last_became_peered":"2024-09-22T08:15:04.959395+0000","last_unstale":"2024-09-22T08:56:33.339657+0000","last_undegraded":"2024-09-22T08:56:33.339657+0000","last_fullsized":"2024-09-22T08:56:33.339657+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'185","last_scrub_stamp":"2024-09-22T08:56:33.339559+0000","last_deep_scrub":"263'185","last_deep_scrub_stamp":"2024-09-22T08:56:33.339559+0000","last_clean_scrub_stamp":"2024-09-22T08:56:33.339559+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:26:10.173195+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":318,"num_read_kb":28967,"num_write":772,"num_write_kb":45290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"263'1560","reported_seq":3265,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:40.939260+0000","last_change":"2024-09-22T08:15:06.972382+0000","last_active":"2024-09-22T08:54:40.939260+0000","last_peered":"2024-09-22T08:54:40.939260+0000","last_clean":"2024-09-22T08:54:40.939260+0000","last_became_active":"2024-09-22T08:15:06.972074+0000","last_became_peered":"2024-09-22T08:15:06.972074+0000","last_unstale":"2024-09-22T08:54:40.939260+0000","last_undegraded":"2024-09-22T08:54:40.939260+0000","last_fullsized":"2024-09-22T08:54:40.939260+0000","mapping_epoch":25,"log_start":"263'1500","ondisk_log_start":"263'1500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":1500,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:28:04.310796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6961,"num_read_kb":6120,"num_write":2165,"num_write_kb":918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"263'483","reported_seq":2143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:40.939680+0000","last_change":"2024-09-22T08:15:06.966028+0000","last_active":"2024-09-22T08:54:40.939680+0000","last_peered":"2024-09-22T08:54:40.939680+0000","last_clean":"2024-09-22T08:54:40.939680+0000","last_became_active":"2024-09-22T08:15:06.965751+0000","last_became_peered":"2024-09-22T08:15:06.965751+0000","last_unstale":"2024-09-22T08:54:40.939680+0000","last_undegraded":"2024-09-22T08:54:40.939680+0000","last_fullsized":"2024-09-22T08:54:40.939680+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:49:12.402190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2631,"num_read_kb":2475,"num_write":578,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"263'220","reported_seq":872,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:24.868187+0000","last_change":"2024-09-22T08:56:24.868187+0000","last_active":"2024-09-22T08:56:24.868187+0000","last_peered":"2024-09-22T08:56:24.868187+0000","last_clean":"2024-09-22T08:56:24.868187+0000","last_became_active":"2024-09-22T08:15:04.953628+0000","last_became_peered":"2024-09-22T08:15:04.953628+0000","last_unstale":"2024-09-22T08:56:24.868187+0000","last_undegraded":"2024-09-22T08:56:24.868187+0000","last_fullsized":"2024-09-22T08:56:24.868187+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'220","last_scrub_stamp":"2024-09-22T08:56:24.868066+0000","last_deep_scrub":"263'220","last_deep_scrub_stamp":"2024-09-22T08:56:24.868066+0000","last_clean_scrub_stamp":"2024-09-22T08:56:24.868066+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:38:51.226129+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":538,"num_read_kb":68591,"num_write":878,"num_write_kb":34888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"263'360","reported_seq":1746,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:35.492973+0000","last_change":"2024-09-22T08:56:35.492973+0000","last_active":"2024-09-22T08:56:35.492973+0000","last_peered":"2024-09-22T08:56:35.492973+0000","last_clean":"2024-09-22T08:56:35.492973+0000","last_became_active":"2024-09-22T08:15:06.968970+0000","last_became_peered":"2024-09-22T08:15:06.968970+0000","last_unstale":"2024-09-22T08:56:35.492973+0000","last_undegraded":"2024-09-22T08:56:35.492973+0000","last_fullsized":"2024-09-22T08:56:35.492973+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'360","last_scrub_stamp":"2024-09-22T08:56:35.492871+0000","last_deep_scrub":"263'360","last_deep_scrub_stamp":"2024-09-22T08:56:35.492871+0000","last_clean_scrub_stamp":"2024-09-22T08:56:35.492871+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:05:00.671139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2053,"num_read_kb":1926,"num_write":427,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1365,"num_omap_keys":6,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"263'233","reported_seq":872,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:28.462228+0000","last_change":"2024-09-22T08:56:28.462228+0000","last_active":"2024-09-22T08:56:28.462228+0000","last_peered":"2024-09-22T08:56:28.462228+0000","last_clean":"2024-09-22T08:56:28.462228+0000","last_became_active":"2024-09-22T08:15:04.966769+0000","last_became_peered":"2024-09-22T08:15:04.966769+0000","last_unstale":"2024-09-22T08:56:28.462228+0000","last_undegraded":"2024-09-22T08:56:28.462228+0000","last_fullsized":"2024-09-22T08:56:28.462228+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'233","last_scrub_stamp":"2024-09-22T08:56:28.462117+0000","last_deep_scrub":"263'233","last_deep_scrub_stamp":"2024-09-22T08:56:28.462117+0000","last_clean_scrub_stamp":"2024-09-22T08:56:28.462117+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:40:13.623374+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":51014,"num_write":1104,"num_write_kb":43963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"263'469","reported_seq":1933,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:30.740245+0000","last_change":"2024-09-22T08:56:30.740245+0000","last_active":"2024-09-22T08:56:30.740245+0000","last_peered":"2024-09-22T08:56:30.740245+0000","last_clean":"2024-09-22T08:56:30.740245+0000","last_became_active":"2024-09-22T08:15:06.972821+0000","last_became_peered":"2024-09-22T08:15:06.972821+0000","last_unstale":"2024-09-22T08:56:30.740245+0000","last_undegraded":"2024-09-22T08:56:30.740245+0000","last_fullsized":"2024-09-22T08:56:30.740245+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'469","last_scrub_stamp":"2024-09-22T08:56:30.740153+0000","last_deep_scrub":"263'469","last_deep_scrub_stamp":"2024-09-22T08:56:30.740153+0000","last_clean_scrub_stamp":"2024-09-22T08:56:30.740153+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:47:33.203417+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2415,"num_read_kb":2238,"num_write":577,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"263'223","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:30.477162+0000","last_change":"2024-09-22T08:56:30.477162+0000","last_active":"2024-09-22T08:56:30.477162+0000","last_peered":"2024-09-22T08:56:30.477162+0000","last_clean":"2024-09-22T08:56:30.477162+0000","last_became_active":"2024-09-22T08:15:04.955972+0000","last_became_peered":"2024-09-22T08:15:04.955972+0000","last_unstale":"2024-09-22T08:56:30.477162+0000","last_undegraded":"2024-09-22T08:56:30.477162+0000","last_fullsized":"2024-09-22T08:56:30.477162+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'223","last_scrub_stamp":"2024-09-22T08:56:30.477065+0000","last_deep_scrub":"263'223","last_deep_scrub_stamp":"2024-09-22T08:56:30.477065+0000","last_clean_scrub_stamp":"2024-09-22T08:56:30.477065+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:48:00.158279+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":994,"num_read_kb":8164,"num_write":935,"num_write_kb":17459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"263'465","reported_seq":2089,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:37.484954+0000","last_change":"2024-09-22T08:56:37.484954+0000","last_active":"2024-09-22T08:56:37.484954+0000","last_peered":"2024-09-22T08:56:37.484954+0000","last_clean":"2024-09-22T08:56:37.484954+0000","last_became_active":"2024-09-22T08:15:06.972250+0000","last_became_peered":"2024-09-22T08:15:06.972250+0000","last_unstale":"2024-09-22T08:56:37.484954+0000","last_undegraded":"2024-09-22T08:56:37.484954+0000","last_fullsized":"2024-09-22T08:56:37.484954+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'465","last_scrub_stamp":"2024-09-22T08:56:37.484862+0000","last_deep_scrub":"263'465","last_deep_scrub_stamp":"2024-09-22T08:56:37.484862+0000","last_clean_scrub_stamp":"2024-09-22T08:56:37.484862+0000","objects_scrubbed":2,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:01:02.906297+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2654,"num_read_kb":2505,"num_write":533,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"263'252","reported_seq":902,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:25.507295+0000","last_change":"2024-09-22T08:56:25.507295+0000","last_active":"2024-09-22T08:56:25.507295+0000","last_peered":"2024-09-22T08:56:25.507295+0000","last_clean":"2024-09-22T08:56:25.507295+0000","last_became_active":"2024-09-22T08:15:04.954948+0000","last_became_peered":"2024-09-22T08:15:04.954948+0000","last_unstale":"2024-09-22T08:56:25.507295+0000","last_undegraded":"2024-09-22T08:56:25.507295+0000","last_fullsized":"2024-09-22T08:56:25.507295+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'252","last_scrub_stamp":"2024-09-22T08:56:25.507185+0000","last_deep_scrub":"263'252","last_deep_scrub_stamp":"2024-09-22T08:56:25.507185+0000","last_clean_scrub_stamp":"2024-09-22T08:56:25.507185+0000","objects_scrubbed":5,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:16.520968+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":551,"num_read_kb":6536,"num_write":1088,"num_write_kb":24915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"263'385","reported_seq":1845,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:40.939101+0000","last_change":"2024-09-22T08:15:06.970282+0000","last_active":"2024-09-22T08:54:40.939101+0000","last_peered":"2024-09-22T08:54:40.939101+0000","last_clean":"2024-09-22T08:54:40.939101+0000","last_became_active":"2024-09-22T08:15:06.968651+0000","last_became_peered":"2024-09-22T08:15:06.968651+0000","last_unstale":"2024-09-22T08:54:40.939101+0000","last_undegraded":"2024-09-22T08:54:40.939101+0000","last_fullsized":"2024-09-22T08:54:40.939101+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:24:42.424031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2079,"num_read_kb":1977,"num_write":435,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"263'239","reported_seq":862,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:30.460156+0000","last_change":"2024-09-22T08:56:30.460156+0000","last_active":"2024-09-22T08:56:30.460156+0000","last_peered":"2024-09-22T08:56:30.460156+0000","last_clean":"2024-09-22T08:56:30.460156+0000","last_became_active":"2024-09-22T08:15:04.958578+0000","last_became_peered":"2024-09-22T08:15:04.958578+0000","last_unstale":"2024-09-22T08:56:30.460156+0000","last_undegraded":"2024-09-22T08:56:30.460156+0000","last_fullsized":"2024-09-22T08:56:30.460156+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'239","last_scrub_stamp":"2024-09-22T08:56:30.460046+0000","last_deep_scrub":"263'239","last_deep_scrub_stamp":"2024-09-22T08:56:30.460046+0000","last_clean_scrub_stamp":"2024-09-22T08:56:30.460046+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:15:01.904411+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":554,"num_read_kb":7725,"num_write":1073,"num_write_kb":35221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"263'576","reported_seq":2266,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:31.779569+0000","last_change":"2024-09-22T08:56:31.779569+0000","last_active":"2024-09-22T08:56:31.779569+0000","last_peered":"2024-09-22T08:56:31.779569+0000","last_clean":"2024-09-22T08:56:31.779569+0000","last_became_active":"2024-09-22T08:15:06.980621+0000","last_became_peered":"2024-09-22T08:15:06.980621+0000","last_unstale":"2024-09-22T08:56:31.779569+0000","last_undegraded":"2024-09-22T08:56:31.779569+0000","last_fullsized":"2024-09-22T08:56:31.779569+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'576","last_scrub_stamp":"2024-09-22T08:56:31.779429+0000","last_deep_scrub":"263'576","last_deep_scrub_stamp":"2024-09-22T08:56:31.779429+0000","last_clean_scrub_stamp":"2024-09-22T08:56:31.779429+0000","objects_scrubbed":3,"log_size":76,"log_dups_size":500,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:22.389041+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3075,"num_read_kb":2832,"num_write":740,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"263'195","reported_seq":1003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:28.526760+0000","last_change":"2024-09-22T08:56:28.526760+0000","last_active":"2024-09-22T08:56:28.526760+0000","last_peered":"2024-09-22T08:56:28.526760+0000","last_clean":"2024-09-22T08:56:28.526760+0000","last_became_active":"2024-09-22T08:15:04.952203+0000","last_became_peered":"2024-09-22T08:15:04.952203+0000","last_unstale":"2024-09-22T08:56:28.526760+0000","last_undegraded":"2024-09-22T08:56:28.526760+0000","last_fullsized":"2024-09-22T08:56:28.526760+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'195","last_scrub_stamp":"2024-09-22T08:56:28.526665+0000","last_deep_scrub":"263'195","last_deep_scrub_stamp":"2024-09-22T08:56:28.526665+0000","last_clean_scrub_stamp":"2024-09-22T08:56:28.526665+0000","objects_scrubbed":2,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:04:59.175129+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1058,"num_read_kb":8867,"num_write":911,"num_write_kb":21916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"263'139","reported_seq":638,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.540408+0000","last_change":"2024-09-22T08:15:15.011843+0000","last_active":"2024-09-22T08:54:41.540408+0000","last_peered":"2024-09-22T08:54:41.540408+0000","last_clean":"2024-09-22T08:54:41.540408+0000","last_became_active":"2024-09-22T08:15:15.011529+0000","last_became_peered":"2024-09-22T08:15:15.011529+0000","last_unstale":"2024-09-22T08:54:41.540408+0000","last_undegraded":"2024-09-22T08:54:41.540408+0000","last_fullsized":"2024-09-22T08:54:41.540408+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":192,"num_read_kb":186,"num_write":338,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"263'505","reported_seq":2115,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:36.525663+0000","last_change":"2024-09-22T08:56:36.525663+0000","last_active":"2024-09-22T08:56:36.525663+0000","last_peered":"2024-09-22T08:56:36.525663+0000","last_clean":"2024-09-22T08:56:36.525663+0000","last_became_active":"2024-09-22T08:15:06.967794+0000","last_became_peered":"2024-09-22T08:15:06.967794+0000","last_unstale":"2024-09-22T08:56:36.525663+0000","last_undegraded":"2024-09-22T08:56:36.525663+0000","last_fullsized":"2024-09-22T08:56:36.525663+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'505","last_scrub_stamp":"2024-09-22T08:56:36.525567+0000","last_deep_scrub":"263'505","last_deep_scrub_stamp":"2024-09-22T08:56:36.525567+0000","last_clean_scrub_stamp":"2024-09-22T08:56:36.525567+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:20:04.782519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2789,"num_read_kb":2608,"num_write":647,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"263'226","reported_seq":879,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:31.855517+0000","last_change":"2024-09-22T08:56:31.855517+0000","last_active":"2024-09-22T08:56:31.855517+0000","last_peered":"2024-09-22T08:56:31.855517+0000","last_clean":"2024-09-22T08:56:31.855517+0000","last_became_active":"2024-09-22T08:15:04.963890+0000","last_became_peered":"2024-09-22T08:15:04.963890+0000","last_unstale":"2024-09-22T08:56:31.855517+0000","last_undegraded":"2024-09-22T08:56:31.855517+0000","last_fullsized":"2024-09-22T08:56:31.855517+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'226","last_scrub_stamp":"2024-09-22T08:56:31.855382+0000","last_deep_scrub":"263'226","last_deep_scrub_stamp":"2024-09-22T08:56:31.855382+0000","last_clean_scrub_stamp":"2024-09-22T08:56:31.855382+0000","objects_scrubbed":7,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:32:30.739490+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079944,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":535,"num_read_kb":15199,"num_write":1088,"num_write_kb":18954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:48.395352+0000","last_change":"2024-09-22T08:15:08.968916+0000","last_active":"2024-09-22T08:53:48.395352+0000","last_peered":"2024-09-22T08:53:48.395352+0000","last_clean":"2024-09-22T08:53:48.395352+0000","last_became_active":"2024-09-22T08:15:08.968482+0000","last_became_peered":"2024-09-22T08:15:08.968482+0000","last_unstale":"2024-09-22T08:53:48.395352+0000","last_undegraded":"2024-09-22T08:53:48.395352+0000","last_fullsized":"2024-09-22T08:53:48.395352+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:17:40.343334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"263'192","reported_seq":791,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.348297+0000","last_change":"2024-09-22T08:15:10.987896+0000","last_active":"2024-09-22T08:56:16.348297+0000","last_peered":"2024-09-22T08:56:16.348297+0000","last_clean":"2024-09-22T08:56:16.348297+0000","last_became_active":"2024-09-22T08:15:10.987539+0000","last_became_peered":"2024-09-22T08:15:10.987539+0000","last_unstale":"2024-09-22T08:56:16.348297+0000","last_undegraded":"2024-09-22T08:56:16.348297+0000","last_fullsized":"2024-09-22T08:56:16.348297+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:00:01.634988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7203,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":254,"num_read_kb":315,"num_write":148,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:53.395578+0000","last_change":"2024-09-22T08:15:13.019038+0000","last_active":"2024-09-22T08:53:53.395578+0000","last_peered":"2024-09-22T08:53:53.395578+0000","last_clean":"2024-09-22T08:53:53.395578+0000","last_became_active":"2024-09-22T08:15:13.018750+0000","last_became_peered":"2024-09-22T08:15:13.018750+0000","last_unstale":"2024-09-22T08:53:53.395578+0000","last_undegraded":"2024-09-22T08:53:53.395578+0000","last_fullsized":"2024-09-22T08:53:53.395578+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:37:28.422394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"263'150","reported_seq":641,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.475369+0000","last_change":"2024-09-22T08:15:15.020868+0000","last_active":"2024-09-22T08:54:41.475369+0000","last_peered":"2024-09-22T08:54:41.475369+0000","last_clean":"2024-09-22T08:54:41.475369+0000","last_became_active":"2024-09-22T08:15:15.020542+0000","last_became_peered":"2024-09-22T08:15:15.020542+0000","last_unstale":"2024-09-22T08:54:41.475369+0000","last_undegraded":"2024-09-22T08:54:41.475369+0000","last_fullsized":"2024-09-22T08:54:41.475369+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":183,"num_read_kb":175,"num_write":358,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"263'757","reported_seq":2368,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:42.879382+0000","last_change":"2024-09-22T08:56:42.879382+0000","last_active":"2024-09-22T08:56:42.879382+0000","last_peered":"2024-09-22T08:56:42.879382+0000","last_clean":"2024-09-22T08:56:42.879382+0000","last_became_active":"2024-09-22T08:15:06.980479+0000","last_became_peered":"2024-09-22T08:15:06.980479+0000","last_unstale":"2024-09-22T08:56:42.879382+0000","last_undegraded":"2024-09-22T08:56:42.879382+0000","last_fullsized":"2024-09-22T08:56:42.879382+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'757","last_scrub_stamp":"2024-09-22T08:56:42.879289+0000","last_deep_scrub":"263'757","last_deep_scrub_stamp":"2024-09-22T08:56:42.879289+0000","last_clean_scrub_stamp":"2024-09-22T08:56:42.879289+0000","objects_scrubbed":6,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:12:59.739632+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3625,"num_read_kb":3307,"num_write":963,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"263'258","reported_seq":934,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:25.458117+0000","last_change":"2024-09-22T08:56:25.458117+0000","last_active":"2024-09-22T08:56:25.458117+0000","last_peered":"2024-09-22T08:56:25.458117+0000","last_clean":"2024-09-22T08:56:25.458117+0000","last_became_active":"2024-09-22T08:15:04.951265+0000","last_became_peered":"2024-09-22T08:15:04.951265+0000","last_unstale":"2024-09-22T08:56:25.458117+0000","last_undegraded":"2024-09-22T08:56:25.458117+0000","last_fullsized":"2024-09-22T08:56:25.458117+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'258","last_scrub_stamp":"2024-09-22T08:56:25.457993+0000","last_deep_scrub":"263'258","last_deep_scrub_stamp":"2024-09-22T08:56:25.457993+0000","last_clean_scrub_stamp":"2024-09-22T08:56:25.457993+0000","objects_scrubbed":4,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:21:32.094740+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":764,"num_read_kb":7954,"num_write":1369,"num_write_kb":16798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:37.397545+0000","last_change":"2024-09-22T08:15:08.979213+0000","last_active":"2024-09-22T08:52:37.397545+0000","last_peered":"2024-09-22T08:52:37.397545+0000","last_clean":"2024-09-22T08:52:37.397545+0000","last_became_active":"2024-09-22T08:15:08.978832+0000","last_became_peered":"2024-09-22T08:15:08.978832+0000","last_unstale":"2024-09-22T08:52:37.397545+0000","last_undegraded":"2024-09-22T08:52:37.397545+0000","last_fullsized":"2024-09-22T08:52:37.397545+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:42:16.081624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"263'80","reported_seq":609,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:41.793143+0000","last_change":"2024-09-22T08:56:41.793143+0000","last_active":"2024-09-22T08:56:41.793143+0000","last_peered":"2024-09-22T08:56:41.793143+0000","last_clean":"2024-09-22T08:56:41.793143+0000","last_became_active":"2024-09-22T08:15:10.984027+0000","last_became_peered":"2024-09-22T08:15:10.984027+0000","last_unstale":"2024-09-22T08:56:41.793143+0000","last_undegraded":"2024-09-22T08:56:41.793143+0000","last_fullsized":"2024-09-22T08:56:41.793143+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'80","last_scrub_stamp":"2024-09-22T08:56:41.793036+0000","last_deep_scrub":"263'80","last_deep_scrub_stamp":"2024-09-22T08:56:41.793036+0000","last_clean_scrub_stamp":"2024-09-22T08:56:41.793036+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:29:56.743917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":87,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:53.395512+0000","last_change":"2024-09-22T08:15:13.013974+0000","last_active":"2024-09-22T08:53:53.395512+0000","last_peered":"2024-09-22T08:53:53.395512+0000","last_clean":"2024-09-22T08:53:53.395512+0000","last_became_active":"2024-09-22T08:15:13.013609+0000","last_became_peered":"2024-09-22T08:15:13.013609+0000","last_unstale":"2024-09-22T08:53:53.395512+0000","last_undegraded":"2024-09-22T08:53:53.395512+0000","last_fullsized":"2024-09-22T08:53:53.395512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:39:31.786695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"263'154","reported_seq":663,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:14.427460+0000","last_change":"2024-09-22T08:15:15.019318+0000","last_active":"2024-09-22T08:54:14.427460+0000","last_peered":"2024-09-22T08:54:14.427460+0000","last_clean":"2024-09-22T08:54:14.427460+0000","last_became_active":"2024-09-22T08:15:15.018984+0000","last_became_peered":"2024-09-22T08:15:15.018984+0000","last_unstale":"2024-09-22T08:54:14.427460+0000","last_undegraded":"2024-09-22T08:54:14.427460+0000","last_fullsized":"2024-09-22T08:54:14.427460+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:29:44.945052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":263,"num_read_kb":245,"num_write":379,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"263'1937","reported_seq":3656,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:38.397089+0000","last_change":"2024-09-22T08:56:38.397089+0000","last_active":"2024-09-22T08:56:38.397089+0000","last_peered":"2024-09-22T08:56:38.397089+0000","last_clean":"2024-09-22T08:56:38.397089+0000","last_became_active":"2024-09-22T08:15:06.967645+0000","last_became_peered":"2024-09-22T08:15:06.967645+0000","last_unstale":"2024-09-22T08:56:38.397089+0000","last_undegraded":"2024-09-22T08:56:38.397089+0000","last_fullsized":"2024-09-22T08:56:38.397089+0000","mapping_epoch":25,"log_start":"263'1900","ondisk_log_start":"263'1900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1937","last_scrub_stamp":"2024-09-22T08:56:38.396997+0000","last_deep_scrub":"263'1937","last_deep_scrub_stamp":"2024-09-22T08:56:38.396997+0000","last_clean_scrub_stamp":"2024-09-22T08:56:38.396997+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":1900,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:08:12.555868+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8532,"num_read_kb":7421,"num_write":2741,"num_write_kb":1214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"263'208","reported_seq":861,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:30.899610+0000","last_change":"2024-09-22T08:56:30.899610+0000","last_active":"2024-09-22T08:56:30.899610+0000","last_peered":"2024-09-22T08:56:30.899610+0000","last_clean":"2024-09-22T08:56:30.899610+0000","last_became_active":"2024-09-22T08:15:04.964798+0000","last_became_peered":"2024-09-22T08:15:04.964798+0000","last_unstale":"2024-09-22T08:56:30.899610+0000","last_undegraded":"2024-09-22T08:56:30.899610+0000","last_fullsized":"2024-09-22T08:56:30.899610+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'208","last_scrub_stamp":"2024-09-22T08:56:30.899515+0000","last_deep_scrub":"263'208","last_deep_scrub_stamp":"2024-09-22T08:56:30.899515+0000","last_clean_scrub_stamp":"2024-09-22T08:56:30.899515+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:30:20.275669+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":449,"num_read_kb":111223,"num_write":842,"num_write_kb":54102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:52.407838+0000","last_change":"2024-09-22T08:15:08.977351+0000","last_active":"2024-09-22T08:53:52.407838+0000","last_peered":"2024-09-22T08:53:52.407838+0000","last_clean":"2024-09-22T08:53:52.407838+0000","last_became_active":"2024-09-22T08:15:08.976950+0000","last_became_peered":"2024-09-22T08:15:08.976950+0000","last_unstale":"2024-09-22T08:53:52.407838+0000","last_undegraded":"2024-09-22T08:53:52.407838+0000","last_fullsized":"2024-09-22T08:53:52.407838+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:02:30.621484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"263'107","reported_seq":638,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.745947+0000","last_change":"2024-09-22T08:15:10.981219+0000","last_active":"2024-09-22T08:55:19.745947+0000","last_peered":"2024-09-22T08:55:19.745947+0000","last_clean":"2024-09-22T08:55:19.745947+0000","last_became_active":"2024-09-22T08:15:10.980879+0000","last_became_peered":"2024-09-22T08:15:10.980879+0000","last_unstale":"2024-09-22T08:55:19.745947+0000","last_undegraded":"2024-09-22T08:55:19.745947+0000","last_fullsized":"2024-09-22T08:55:19.745947+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:15:11.627561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":117,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"263'782","reported_seq":2379,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.569288+0000","last_change":"2024-09-22T08:15:13.012087+0000","last_active":"2024-09-22T08:56:16.569288+0000","last_peered":"2024-09-22T08:56:16.569288+0000","last_clean":"2024-09-22T08:56:16.569288+0000","last_became_active":"2024-09-22T08:15:13.011812+0000","last_became_peered":"2024-09-22T08:15:13.011812+0000","last_unstale":"2024-09-22T08:56:16.569288+0000","last_undegraded":"2024-09-22T08:56:16.569288+0000","last_fullsized":"2024-09-22T08:56:16.569288+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:23:51.018829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"263'178","reported_seq":999,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.583483+0000","last_change":"2024-09-22T08:15:15.016044+0000","last_active":"2024-09-22T08:54:41.583483+0000","last_peered":"2024-09-22T08:54:41.583483+0000","last_clean":"2024-09-22T08:54:41.583483+0000","last_became_active":"2024-09-22T08:15:15.015684+0000","last_became_peered":"2024-09-22T08:15:15.015684+0000","last_unstale":"2024-09-22T08:54:41.583483+0000","last_undegraded":"2024-09-22T08:54:41.583483+0000","last_fullsized":"2024-09-22T08:54:41.583483+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:38.991298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":616,"num_read_kb":611,"num_write":377,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"263'1260","reported_seq":2740,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:39.437610+0000","last_change":"2024-09-22T08:56:39.437610+0000","last_active":"2024-09-22T08:56:39.437610+0000","last_peered":"2024-09-22T08:56:39.437610+0000","last_clean":"2024-09-22T08:56:39.437610+0000","last_became_active":"2024-09-22T08:15:06.967323+0000","last_became_peered":"2024-09-22T08:15:06.967323+0000","last_unstale":"2024-09-22T08:56:39.437610+0000","last_undegraded":"2024-09-22T08:56:39.437610+0000","last_fullsized":"2024-09-22T08:56:39.437610+0000","mapping_epoch":25,"log_start":"263'1200","ondisk_log_start":"263'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1260","last_scrub_stamp":"2024-09-22T08:56:39.437522+0000","last_deep_scrub":"263'1260","last_deep_scrub_stamp":"2024-09-22T08:56:39.437522+0000","last_clean_scrub_stamp":"2024-09-22T08:56:39.437522+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":1200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:18:39.527856+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7857,"num_read_kb":7154,"num_write":1964,"num_write_kb":850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"263'250","reported_seq":926,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:22.920450+0000","last_change":"2024-09-22T08:56:22.920450+0000","last_active":"2024-09-22T08:56:22.920450+0000","last_peered":"2024-09-22T08:56:22.920450+0000","last_clean":"2024-09-22T08:56:22.920450+0000","last_became_active":"2024-09-22T08:15:04.959776+0000","last_became_peered":"2024-09-22T08:15:04.959776+0000","last_unstale":"2024-09-22T08:56:22.920450+0000","last_undegraded":"2024-09-22T08:56:22.920450+0000","last_fullsized":"2024-09-22T08:56:22.920450+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'250","last_scrub_stamp":"2024-09-22T08:56:22.920344+0000","last_deep_scrub":"263'250","last_deep_scrub_stamp":"2024-09-22T08:56:22.920344+0000","last_clean_scrub_stamp":"2024-09-22T08:56:22.920344+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:50:17.909839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079920,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":722,"num_read_kb":18781,"num_write":1155,"num_write_kb":38377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:48.395364+0000","last_change":"2024-09-22T08:15:08.973303+0000","last_active":"2024-09-22T08:53:48.395364+0000","last_peered":"2024-09-22T08:53:48.395364+0000","last_clean":"2024-09-22T08:53:48.395364+0000","last_became_active":"2024-09-22T08:15:08.973025+0000","last_became_peered":"2024-09-22T08:15:08.973025+0000","last_unstale":"2024-09-22T08:53:48.395364+0000","last_undegraded":"2024-09-22T08:53:48.395364+0000","last_fullsized":"2024-09-22T08:53:48.395364+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:04:18.829657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"263'133","reported_seq":697,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.297403+0000","last_change":"2024-09-22T08:15:10.985906+0000","last_active":"2024-09-22T08:56:16.297403+0000","last_peered":"2024-09-22T08:56:16.297403+0000","last_clean":"2024-09-22T08:56:16.297403+0000","last_became_active":"2024-09-22T08:15:10.985540+0000","last_became_peered":"2024-09-22T08:15:10.985540+0000","last_unstale":"2024-09-22T08:56:16.297403+0000","last_undegraded":"2024-09-22T08:56:16.297403+0000","last_fullsized":"2024-09-22T08:56:16.297403+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:26:23.397471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10933,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":231,"num_write":80,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"263'792","reported_seq":2267,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.235006+0000","last_change":"2024-09-22T08:15:13.005672+0000","last_active":"2024-09-22T08:56:16.235006+0000","last_peered":"2024-09-22T08:56:16.235006+0000","last_clean":"2024-09-22T08:56:16.235006+0000","last_became_active":"2024-09-22T08:15:13.004752+0000","last_became_peered":"2024-09-22T08:15:13.004752+0000","last_unstale":"2024-09-22T08:56:16.235006+0000","last_undegraded":"2024-09-22T08:56:16.235006+0000","last_fullsized":"2024-09-22T08:56:16.235006+0000","mapping_epoch":31,"log_start":"263'701","ondisk_log_start":"263'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":701,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:24:31.084429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"263'442","reported_seq":2078,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:41.865908+0000","last_change":"2024-09-22T08:56:41.865908+0000","last_active":"2024-09-22T08:56:41.865908+0000","last_peered":"2024-09-22T08:56:41.865908+0000","last_clean":"2024-09-22T08:56:41.865908+0000","last_became_active":"2024-09-22T08:15:06.965387+0000","last_became_peered":"2024-09-22T08:15:06.965387+0000","last_unstale":"2024-09-22T08:56:41.865908+0000","last_undegraded":"2024-09-22T08:56:41.865908+0000","last_fullsized":"2024-09-22T08:56:41.865908+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'442","last_scrub_stamp":"2024-09-22T08:56:41.865802+0000","last_deep_scrub":"263'442","last_deep_scrub_stamp":"2024-09-22T08:56:41.865802+0000","last_clean_scrub_stamp":"2024-09-22T08:56:41.865802+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:53:34.683831+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2432,"num_read_kb":2308,"num_write":489,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"263'281","reported_seq":931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:22.419125+0000","last_change":"2024-09-22T08:56:22.419125+0000","last_active":"2024-09-22T08:56:22.419125+0000","last_peered":"2024-09-22T08:56:22.419125+0000","last_clean":"2024-09-22T08:56:22.419125+0000","last_became_active":"2024-09-22T08:15:04.954015+0000","last_became_peered":"2024-09-22T08:15:04.954015+0000","last_unstale":"2024-09-22T08:56:22.419125+0000","last_undegraded":"2024-09-22T08:56:22.419125+0000","last_fullsized":"2024-09-22T08:56:22.419125+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'281","last_scrub_stamp":"2024-09-22T08:56:22.418992+0000","last_deep_scrub":"263'281","last_deep_scrub_stamp":"2024-09-22T08:56:22.418992+0000","last_clean_scrub_stamp":"2024-09-22T08:56:22.418992+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:44:11.997685+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079929,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":663,"num_read_kb":30289,"num_write":1087,"num_write_kb":39703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:35.772228+0000","last_change":"2024-09-22T08:56:35.772228+0000","last_active":"2024-09-22T08:56:35.772228+0000","last_peered":"2024-09-22T08:56:35.772228+0000","last_clean":"2024-09-22T08:56:35.772228+0000","last_became_active":"2024-09-22T08:15:08.982222+0000","last_became_peered":"2024-09-22T08:15:08.982222+0000","last_unstale":"2024-09-22T08:56:35.772228+0000","last_undegraded":"2024-09-22T08:56:35.772228+0000","last_fullsized":"2024-09-22T08:56:35.772228+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:35.772141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:35.772141+0000","last_clean_scrub_stamp":"2024-09-22T08:56:35.772141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:54:14.131567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"263'221","reported_seq":835,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:42.444491+0000","last_change":"2024-09-22T08:56:42.444491+0000","last_active":"2024-09-22T08:56:42.444491+0000","last_peered":"2024-09-22T08:56:42.444491+0000","last_clean":"2024-09-22T08:56:42.444491+0000","last_became_active":"2024-09-22T08:15:10.984769+0000","last_became_peered":"2024-09-22T08:15:10.984769+0000","last_unstale":"2024-09-22T08:56:42.444491+0000","last_undegraded":"2024-09-22T08:56:42.444491+0000","last_fullsized":"2024-09-22T08:56:42.444491+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'221","last_scrub_stamp":"2024-09-22T08:56:42.444370+0000","last_deep_scrub":"263'221","last_deep_scrub_stamp":"2024-09-22T08:56:42.444370+0000","last_clean_scrub_stamp":"2024-09-22T08:56:42.444370+0000","objects_scrubbed":9,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:11:33.514866+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11910,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":286,"num_read_kb":362,"num_write":166,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:27.282125+0000","last_change":"2024-09-22T08:15:13.012935+0000","last_active":"2024-09-22T08:53:27.282125+0000","last_peered":"2024-09-22T08:53:27.282125+0000","last_clean":"2024-09-22T08:53:27.282125+0000","last_became_active":"2024-09-22T08:15:13.012498+0000","last_became_peered":"2024-09-22T08:15:13.012498+0000","last_unstale":"2024-09-22T08:53:27.282125+0000","last_undegraded":"2024-09-22T08:53:27.282125+0000","last_fullsized":"2024-09-22T08:53:27.282125+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:45:11.434166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"263'554","reported_seq":1379,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:03.364987+0000","last_change":"2024-09-22T08:15:15.015237+0000","last_active":"2024-09-22T08:56:03.364987+0000","last_peered":"2024-09-22T08:56:03.364987+0000","last_clean":"2024-09-22T08:56:03.364987+0000","last_became_active":"2024-09-22T08:15:15.014801+0000","last_became_peered":"2024-09-22T08:15:15.014801+0000","last_unstale":"2024-09-22T08:56:03.364987+0000","last_undegraded":"2024-09-22T08:56:03.364987+0000","last_fullsized":"2024-09-22T08:56:03.364987+0000","mapping_epoch":33,"log_start":"263'500","ondisk_log_start":"263'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":500,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:46:54.702216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":467,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1367,"num_read_kb":1346,"num_write":1156,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"263'862","reported_seq":2456,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:25.844066+0000","last_change":"2024-09-22T08:56:25.844066+0000","last_active":"2024-09-22T08:56:25.844066+0000","last_peered":"2024-09-22T08:56:25.844066+0000","last_clean":"2024-09-22T08:56:25.844066+0000","last_became_active":"2024-09-22T08:15:06.972958+0000","last_became_peered":"2024-09-22T08:15:06.972958+0000","last_unstale":"2024-09-22T08:56:25.844066+0000","last_undegraded":"2024-09-22T08:56:25.844066+0000","last_fullsized":"2024-09-22T08:56:25.844066+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'862","last_scrub_stamp":"2024-09-22T08:56:25.843956+0000","last_deep_scrub":"263'862","last_deep_scrub_stamp":"2024-09-22T08:56:25.843956+0000","last_clean_scrub_stamp":"2024-09-22T08:56:25.843956+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":800,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:28:27.885227+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4079,"num_read_kb":3669,"num_write":1154,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"263'237","reported_seq":903,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:23.356062+0000","last_change":"2024-09-22T08:56:23.356062+0000","last_active":"2024-09-22T08:56:23.356062+0000","last_peered":"2024-09-22T08:56:23.356062+0000","last_clean":"2024-09-22T08:56:23.356062+0000","last_became_active":"2024-09-22T08:15:40.188251+0000","last_became_peered":"2024-09-22T08:15:40.188251+0000","last_unstale":"2024-09-22T08:56:23.356062+0000","last_undegraded":"2024-09-22T08:56:23.356062+0000","last_fullsized":"2024-09-22T08:56:23.356062+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'237","last_scrub_stamp":"2024-09-22T08:56:23.355989+0000","last_deep_scrub":"263'237","last_deep_scrub_stamp":"2024-09-22T08:56:23.355989+0000","last_clean_scrub_stamp":"2024-09-22T08:56:23.355989+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:24.497389+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":546,"num_read_kb":133824,"num_write":973,"num_write_kb":45053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:39.484034+0000","last_change":"2024-09-22T08:56:39.484034+0000","last_active":"2024-09-22T08:56:39.484034+0000","last_peered":"2024-09-22T08:56:39.484034+0000","last_clean":"2024-09-22T08:56:39.484034+0000","last_became_active":"2024-09-22T08:15:08.975435+0000","last_became_peered":"2024-09-22T08:15:08.975435+0000","last_unstale":"2024-09-22T08:56:39.484034+0000","last_undegraded":"2024-09-22T08:56:39.484034+0000","last_fullsized":"2024-09-22T08:56:39.484034+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:39.483931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:39.483931+0000","last_clean_scrub_stamp":"2024-09-22T08:56:39.483931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:17:40.133221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"263'126","reported_seq":692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.485217+0000","last_change":"2024-09-22T08:15:10.988940+0000","last_active":"2024-09-22T08:56:16.485217+0000","last_peered":"2024-09-22T08:56:16.485217+0000","last_clean":"2024-09-22T08:56:16.485217+0000","last_became_active":"2024-09-22T08:15:10.988458+0000","last_became_peered":"2024-09-22T08:15:10.988458+0000","last_unstale":"2024-09-22T08:56:16.485217+0000","last_undegraded":"2024-09-22T08:56:16.485217+0000","last_fullsized":"2024-09-22T08:56:16.485217+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:25.942851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8309,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":166,"num_read_kb":226,"num_write":90,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:17.411485+0000","last_change":"2024-09-22T08:15:13.003344+0000","last_active":"2024-09-22T08:54:17.411485+0000","last_peered":"2024-09-22T08:54:17.411485+0000","last_clean":"2024-09-22T08:54:17.411485+0000","last_became_active":"2024-09-22T08:15:13.002538+0000","last_became_peered":"2024-09-22T08:15:13.002538+0000","last_unstale":"2024-09-22T08:54:17.411485+0000","last_undegraded":"2024-09-22T08:54:17.411485+0000","last_fullsized":"2024-09-22T08:54:17.411485+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"263'2482","reported_seq":4310,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:58.403142+0000","last_change":"2024-09-22T08:15:15.020723+0000","last_active":"2024-09-22T08:54:58.403142+0000","last_peered":"2024-09-22T08:54:58.403142+0000","last_clean":"2024-09-22T08:54:58.403142+0000","last_became_active":"2024-09-22T08:15:15.020438+0000","last_became_peered":"2024-09-22T08:15:15.020438+0000","last_unstale":"2024-09-22T08:54:58.403142+0000","last_undegraded":"2024-09-22T08:54:58.403142+0000","last_fullsized":"2024-09-22T08:54:58.403142+0000","mapping_epoch":33,"log_start":"263'2400","ondisk_log_start":"263'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":2400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:19:48.770997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6235,"num_read_kb":6232,"num_write":5030,"num_write_kb":1847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"263'475","reported_seq":2005,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:29.346865+0000","last_change":"2024-09-22T08:56:29.346865+0000","last_active":"2024-09-22T08:56:29.346865+0000","last_peered":"2024-09-22T08:56:29.346865+0000","last_clean":"2024-09-22T08:56:29.346865+0000","last_became_active":"2024-09-22T08:15:06.970532+0000","last_became_peered":"2024-09-22T08:15:06.970532+0000","last_unstale":"2024-09-22T08:56:29.346865+0000","last_undegraded":"2024-09-22T08:56:29.346865+0000","last_fullsized":"2024-09-22T08:56:29.346865+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'475","last_scrub_stamp":"2024-09-22T08:56:29.346768+0000","last_deep_scrub":"263'475","last_deep_scrub_stamp":"2024-09-22T08:56:29.346768+0000","last_clean_scrub_stamp":"2024-09-22T08:56:29.346768+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:04:32.692649+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2482,"num_read_kb":2307,"num_write":574,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"263'221","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:29.913763+0000","last_change":"2024-09-22T08:56:29.913763+0000","last_active":"2024-09-22T08:56:29.913763+0000","last_peered":"2024-09-22T08:56:29.913763+0000","last_clean":"2024-09-22T08:56:29.913763+0000","last_became_active":"2024-09-22T08:15:04.963648+0000","last_became_peered":"2024-09-22T08:15:04.963648+0000","last_unstale":"2024-09-22T08:56:29.913763+0000","last_undegraded":"2024-09-22T08:56:29.913763+0000","last_fullsized":"2024-09-22T08:56:29.913763+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'221","last_scrub_stamp":"2024-09-22T08:56:29.913651+0000","last_deep_scrub":"263'221","last_deep_scrub_stamp":"2024-09-22T08:56:29.913651+0000","last_clean_scrub_stamp":"2024-09-22T08:56:29.913651+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:49:53.980326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":486,"num_read_kb":19400,"num_write":968,"num_write_kb":35249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"35'3","reported_seq":976,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:15.995729+0000","last_change":"2024-09-22T08:15:08.975603+0000","last_active":"2024-09-22T08:56:15.995729+0000","last_peered":"2024-09-22T08:56:15.995729+0000","last_clean":"2024-09-22T08:56:15.995729+0000","last_became_active":"2024-09-22T08:15:08.975260+0000","last_became_peered":"2024-09-22T08:15:08.975260+0000","last_unstale":"2024-09-22T08:56:15.995729+0000","last_undegraded":"2024-09-22T08:56:15.995729+0000","last_fullsized":"2024-09-22T08:56:15.995729+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:44:40.766275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":720,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"263'158","reported_seq":742,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.395540+0000","last_change":"2024-09-22T08:15:10.989559+0000","last_active":"2024-09-22T08:56:16.395540+0000","last_peered":"2024-09-22T08:56:16.395540+0000","last_clean":"2024-09-22T08:56:16.395540+0000","last_became_active":"2024-09-22T08:15:10.989211+0000","last_became_peered":"2024-09-22T08:15:10.989211+0000","last_unstale":"2024-09-22T08:56:16.395540+0000","last_undegraded":"2024-09-22T08:56:16.395540+0000","last_fullsized":"2024-09-22T08:56:16.395540+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9099,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":211,"num_read_kb":297,"num_write":118,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"263'792","reported_seq":2274,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.574500+0000","last_change":"2024-09-22T08:15:13.003152+0000","last_active":"2024-09-22T08:56:16.574500+0000","last_peered":"2024-09-22T08:56:16.574500+0000","last_clean":"2024-09-22T08:56:16.574500+0000","last_became_active":"2024-09-22T08:15:13.002828+0000","last_became_peered":"2024-09-22T08:15:13.002828+0000","last_unstale":"2024-09-22T08:56:16.574500+0000","last_undegraded":"2024-09-22T08:56:16.574500+0000","last_fullsized":"2024-09-22T08:56:16.574500+0000","mapping_epoch":31,"log_start":"263'701","ondisk_log_start":"263'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":701,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:50:06.133670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"263'130","reported_seq":618,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.035983+0000","last_change":"2024-09-22T08:15:15.019494+0000","last_active":"2024-09-22T08:56:02.035983+0000","last_peered":"2024-09-22T08:56:02.035983+0000","last_clean":"2024-09-22T08:56:02.035983+0000","last_became_active":"2024-09-22T08:15:15.019162+0000","last_became_peered":"2024-09-22T08:15:15.019162+0000","last_unstale":"2024-09-22T08:56:02.035983+0000","last_undegraded":"2024-09-22T08:56:02.035983+0000","last_fullsized":"2024-09-22T08:56:02.035983+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":846,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":147,"num_read_kb":143,"num_write":317,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"263'518","reported_seq":2272,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:37.386846+0000","last_change":"2024-09-22T08:56:37.386846+0000","last_active":"2024-09-22T08:56:37.386846+0000","last_peered":"2024-09-22T08:56:37.386846+0000","last_clean":"2024-09-22T08:56:37.386846+0000","last_became_active":"2024-09-22T08:15:06.962528+0000","last_became_peered":"2024-09-22T08:15:06.962528+0000","last_unstale":"2024-09-22T08:56:37.386846+0000","last_undegraded":"2024-09-22T08:56:37.386846+0000","last_fullsized":"2024-09-22T08:56:37.386846+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'518","last_scrub_stamp":"2024-09-22T08:56:37.386751+0000","last_deep_scrub":"263'518","last_deep_scrub_stamp":"2024-09-22T08:56:37.386751+0000","last_clean_scrub_stamp":"2024-09-22T08:56:37.386751+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:56:21.707533+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2917,"num_read_kb":2741,"num_write":627,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2295,"num_omap_keys":9,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"263'197","reported_seq":822,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:23.466120+0000","last_change":"2024-09-22T08:56:23.466120+0000","last_active":"2024-09-22T08:56:23.466120+0000","last_peered":"2024-09-22T08:56:23.466120+0000","last_clean":"2024-09-22T08:56:23.466120+0000","last_became_active":"2024-09-22T08:15:04.947739+0000","last_became_peered":"2024-09-22T08:15:04.947739+0000","last_unstale":"2024-09-22T08:56:23.466120+0000","last_undegraded":"2024-09-22T08:56:23.466120+0000","last_fullsized":"2024-09-22T08:56:23.466120+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'197","last_scrub_stamp":"2024-09-22T08:56:23.466035+0000","last_deep_scrub":"263'197","last_deep_scrub_stamp":"2024-09-22T08:56:23.466035+0000","last_clean_scrub_stamp":"2024-09-22T08:56:23.466035+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:03:56.435199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":453,"num_read_kb":50575,"num_write":904,"num_write_kb":23711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:38.470627+0000","last_change":"2024-09-22T08:56:38.470627+0000","last_active":"2024-09-22T08:56:38.470627+0000","last_peered":"2024-09-22T08:56:38.470627+0000","last_clean":"2024-09-22T08:56:38.470627+0000","last_became_active":"2024-09-22T08:15:08.974693+0000","last_became_peered":"2024-09-22T08:15:08.974693+0000","last_unstale":"2024-09-22T08:56:38.470627+0000","last_undegraded":"2024-09-22T08:56:38.470627+0000","last_fullsized":"2024-09-22T08:56:38.470627+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:38.470537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:38.470537+0000","last_clean_scrub_stamp":"2024-09-22T08:56:38.470537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:48:40.724650+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"263'193","reported_seq":820,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.504548+0000","last_change":"2024-09-22T08:15:10.984896+0000","last_active":"2024-09-22T08:56:16.504548+0000","last_peered":"2024-09-22T08:56:16.504548+0000","last_clean":"2024-09-22T08:56:16.504548+0000","last_became_active":"2024-09-22T08:15:10.984402+0000","last_became_peered":"2024-09-22T08:15:10.984402+0000","last_unstale":"2024-09-22T08:56:16.504548+0000","last_undegraded":"2024-09-22T08:56:16.504548+0000","last_fullsized":"2024-09-22T08:56:16.504548+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:10:18.043549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13027,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":258,"num_read_kb":332,"num_write":120,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:12.288559+0000","last_change":"2024-09-22T08:15:13.014853+0000","last_active":"2024-09-22T08:54:12.288559+0000","last_peered":"2024-09-22T08:54:12.288559+0000","last_clean":"2024-09-22T08:54:12.288559+0000","last_became_active":"2024-09-22T08:15:13.014612+0000","last_became_peered":"2024-09-22T08:15:13.014612+0000","last_unstale":"2024-09-22T08:54:12.288559+0000","last_undegraded":"2024-09-22T08:54:12.288559+0000","last_fullsized":"2024-09-22T08:54:12.288559+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:42:53.637961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"263'140","reported_seq":653,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:40.936290+0000","last_change":"2024-09-22T08:15:15.011646+0000","last_active":"2024-09-22T08:54:40.936290+0000","last_peered":"2024-09-22T08:54:40.936290+0000","last_clean":"2024-09-22T08:54:40.936290+0000","last_became_active":"2024-09-22T08:15:15.011332+0000","last_became_peered":"2024-09-22T08:15:15.011332+0000","last_unstale":"2024-09-22T08:54:40.936290+0000","last_undegraded":"2024-09-22T08:54:40.936290+0000","last_fullsized":"2024-09-22T08:54:40.936290+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":195,"num_read_kb":186,"num_write":318,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"263'477","reported_seq":2059,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:32.476096+0000","last_change":"2024-09-22T08:56:32.476096+0000","last_active":"2024-09-22T08:56:32.476096+0000","last_peered":"2024-09-22T08:56:32.476096+0000","last_clean":"2024-09-22T08:56:32.476096+0000","last_became_active":"2024-09-22T08:15:06.966708+0000","last_became_peered":"2024-09-22T08:15:06.966708+0000","last_unstale":"2024-09-22T08:56:32.476096+0000","last_undegraded":"2024-09-22T08:56:32.476096+0000","last_fullsized":"2024-09-22T08:56:32.476096+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'477","last_scrub_stamp":"2024-09-22T08:56:32.476005+0000","last_deep_scrub":"263'477","last_deep_scrub_stamp":"2024-09-22T08:56:32.476005+0000","last_clean_scrub_stamp":"2024-09-22T08:56:32.476005+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:28:16.584918+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2455,"num_read_kb":2308,"num_write":546,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"263'250","reported_seq":890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:25.088528+0000","last_change":"2024-09-22T08:56:25.088528+0000","last_active":"2024-09-22T08:56:25.088528+0000","last_peered":"2024-09-22T08:56:25.088528+0000","last_clean":"2024-09-22T08:56:25.088528+0000","last_became_active":"2024-09-22T08:15:04.949202+0000","last_became_peered":"2024-09-22T08:15:04.949202+0000","last_unstale":"2024-09-22T08:56:25.088528+0000","last_undegraded":"2024-09-22T08:56:25.088528+0000","last_fullsized":"2024-09-22T08:56:25.088528+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'250","last_scrub_stamp":"2024-09-22T08:56:25.088391+0000","last_deep_scrub":"263'250","last_deep_scrub_stamp":"2024-09-22T08:56:25.088391+0000","last_clean_scrub_stamp":"2024-09-22T08:56:25.088391+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:53.098601+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1386384,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":583,"num_read_kb":11398,"num_write":1166,"num_write_kb":28598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:38.128844+0000","last_change":"2024-09-22T08:56:38.128844+0000","last_active":"2024-09-22T08:56:38.128844+0000","last_peered":"2024-09-22T08:56:38.128844+0000","last_clean":"2024-09-22T08:56:38.128844+0000","last_became_active":"2024-09-22T08:15:08.978280+0000","last_became_peered":"2024-09-22T08:15:08.978280+0000","last_unstale":"2024-09-22T08:56:38.128844+0000","last_undegraded":"2024-09-22T08:56:38.128844+0000","last_fullsized":"2024-09-22T08:56:38.128844+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:38.128742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:38.128742+0000","last_clean_scrub_stamp":"2024-09-22T08:56:38.128742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:21:13.730058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"263'174","reported_seq":753,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:39.780381+0000","last_change":"2024-09-22T08:56:39.780381+0000","last_active":"2024-09-22T08:56:39.780381+0000","last_peered":"2024-09-22T08:56:39.780381+0000","last_clean":"2024-09-22T08:56:39.780381+0000","last_became_active":"2024-09-22T08:15:10.986433+0000","last_became_peered":"2024-09-22T08:15:10.986433+0000","last_unstale":"2024-09-22T08:56:39.780381+0000","last_undegraded":"2024-09-22T08:56:39.780381+0000","last_fullsized":"2024-09-22T08:56:39.780381+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'174","last_scrub_stamp":"2024-09-22T08:56:39.780268+0000","last_deep_scrub":"263'174","last_deep_scrub_stamp":"2024-09-22T08:56:39.780268+0000","last_clean_scrub_stamp":"2024-09-22T08:56:39.780268+0000","objects_scrubbed":6,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:46:14.302166+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8940,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":228,"num_read_kb":301,"num_write":186,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:42.207072+0000","last_change":"2024-09-22T08:56:42.207072+0000","last_active":"2024-09-22T08:56:42.207072+0000","last_peered":"2024-09-22T08:56:42.207072+0000","last_clean":"2024-09-22T08:56:42.207072+0000","last_became_active":"2024-09-22T08:15:12.999036+0000","last_became_peered":"2024-09-22T08:15:12.999036+0000","last_unstale":"2024-09-22T08:56:42.207072+0000","last_undegraded":"2024-09-22T08:56:42.207072+0000","last_fullsized":"2024-09-22T08:56:42.207072+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:42.206974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:42.206974+0000","last_clean_scrub_stamp":"2024-09-22T08:56:42.206974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:57:59.149011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"263'97","reported_seq":586,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:22.299581+0000","last_change":"2024-09-22T08:15:15.012235+0000","last_active":"2024-09-22T08:55:22.299581+0000","last_peered":"2024-09-22T08:55:22.299581+0000","last_clean":"2024-09-22T08:55:22.299581+0000","last_became_active":"2024-09-22T08:15:15.011949+0000","last_became_peered":"2024-09-22T08:15:15.011949+0000","last_unstale":"2024-09-22T08:55:22.299581+0000","last_undegraded":"2024-09-22T08:55:22.299581+0000","last_fullsized":"2024-09-22T08:55:22.299581+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:28.798518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":93,"num_read_kb":93,"num_write":223,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"263'829","reported_seq":2617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:40.852542+0000","last_change":"2024-09-22T08:56:40.852542+0000","last_active":"2024-09-22T08:56:40.852542+0000","last_peered":"2024-09-22T08:56:40.852542+0000","last_clean":"2024-09-22T08:56:40.852542+0000","last_became_active":"2024-09-22T08:15:06.966795+0000","last_became_peered":"2024-09-22T08:15:06.966795+0000","last_unstale":"2024-09-22T08:56:40.852542+0000","last_undegraded":"2024-09-22T08:56:40.852542+0000","last_fullsized":"2024-09-22T08:56:40.852542+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'829","last_scrub_stamp":"2024-09-22T08:56:40.852447+0000","last_deep_scrub":"263'829","last_deep_scrub_stamp":"2024-09-22T08:56:40.852447+0000","last_clean_scrub_stamp":"2024-09-22T08:56:40.852447+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:33:27.427428+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4273,"num_read_kb":3896,"num_write":1079,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3244,"num_omap_keys":13,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"263'222","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:27.930142+0000","last_change":"2024-09-22T08:56:27.930142+0000","last_active":"2024-09-22T08:56:27.930142+0000","last_peered":"2024-09-22T08:56:27.930142+0000","last_clean":"2024-09-22T08:56:27.930142+0000","last_became_active":"2024-09-22T08:15:04.954492+0000","last_became_peered":"2024-09-22T08:15:04.954492+0000","last_unstale":"2024-09-22T08:56:27.930142+0000","last_undegraded":"2024-09-22T08:56:27.930142+0000","last_fullsized":"2024-09-22T08:56:27.930142+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'222","last_scrub_stamp":"2024-09-22T08:56:27.930037+0000","last_deep_scrub":"263'222","last_deep_scrub_stamp":"2024-09-22T08:56:27.930037+0000","last_clean_scrub_stamp":"2024-09-22T08:56:27.930037+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:04:52.837489+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079919,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":477,"num_read_kb":44813,"num_write":947,"num_write_kb":39223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:27.282275+0000","last_change":"2024-09-22T08:15:08.977376+0000","last_active":"2024-09-22T08:53:27.282275+0000","last_peered":"2024-09-22T08:53:27.282275+0000","last_clean":"2024-09-22T08:53:27.282275+0000","last_became_active":"2024-09-22T08:15:08.976990+0000","last_became_peered":"2024-09-22T08:15:08.976990+0000","last_unstale":"2024-09-22T08:53:27.282275+0000","last_undegraded":"2024-09-22T08:53:27.282275+0000","last_fullsized":"2024-09-22T08:53:27.282275+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:28.364951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"263'149","reported_seq":732,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.458993+0000","last_change":"2024-09-22T08:15:10.979752+0000","last_active":"2024-09-22T08:56:16.458993+0000","last_peered":"2024-09-22T08:56:16.458993+0000","last_clean":"2024-09-22T08:56:16.458993+0000","last_became_active":"2024-09-22T08:15:10.979449+0000","last_became_peered":"2024-09-22T08:15:10.979449+0000","last_unstale":"2024-09-22T08:56:16.458993+0000","last_undegraded":"2024-09-22T08:56:16.458993+0000","last_fullsized":"2024-09-22T08:56:16.458993+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:04.362070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6421,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":192,"num_read_kb":205,"num_write":100,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"263'771","reported_seq":4259,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:40.149276+0000","last_change":"2024-09-22T08:56:40.149276+0000","last_active":"2024-09-22T08:56:40.149276+0000","last_peered":"2024-09-22T08:56:40.149276+0000","last_clean":"2024-09-22T08:56:40.149276+0000","last_became_active":"2024-09-22T08:15:13.015504+0000","last_became_peered":"2024-09-22T08:15:13.015504+0000","last_unstale":"2024-09-22T08:56:40.149276+0000","last_undegraded":"2024-09-22T08:56:40.149276+0000","last_fullsized":"2024-09-22T08:56:40.149276+0000","mapping_epoch":31,"log_start":"263'701","ondisk_log_start":"263'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'771","last_scrub_stamp":"2024-09-22T08:56:40.149185+0000","last_deep_scrub":"263'771","last_deep_scrub_stamp":"2024-09-22T08:56:40.149185+0000","last_clean_scrub_stamp":"2024-09-22T08:56:40.149185+0000","objects_scrubbed":1,"log_size":70,"log_dups_size":701,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:21.199547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"263'132","reported_seq":628,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:18.162485+0000","last_change":"2024-09-22T08:15:15.018247+0000","last_active":"2024-09-22T08:54:18.162485+0000","last_peered":"2024-09-22T08:54:18.162485+0000","last_clean":"2024-09-22T08:54:18.162485+0000","last_became_active":"2024-09-22T08:15:15.017584+0000","last_became_peered":"2024-09-22T08:15:15.017584+0000","last_unstale":"2024-09-22T08:54:18.162485+0000","last_undegraded":"2024-09-22T08:54:18.162485+0000","last_fullsized":"2024-09-22T08:54:18.162485+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:04:30.454178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":193,"num_read_kb":181,"num_write":318,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"263'746","reported_seq":2330,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:35.418814+0000","last_change":"2024-09-22T08:56:35.418814+0000","last_active":"2024-09-22T08:56:35.418814+0000","last_peered":"2024-09-22T08:56:35.418814+0000","last_clean":"2024-09-22T08:56:35.418814+0000","last_became_active":"2024-09-22T08:15:06.973918+0000","last_became_peered":"2024-09-22T08:15:06.973918+0000","last_unstale":"2024-09-22T08:56:35.418814+0000","last_undegraded":"2024-09-22T08:56:35.418814+0000","last_fullsized":"2024-09-22T08:56:35.418814+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'746","last_scrub_stamp":"2024-09-22T08:56:35.418722+0000","last_deep_scrub":"263'746","last_deep_scrub_stamp":"2024-09-22T08:56:35.418722+0000","last_clean_scrub_stamp":"2024-09-22T08:56:35.418722+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":700,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:24:01.261807+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3813,"num_read_kb":3478,"num_write":973,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"263'231","reported_seq":896,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:28.938830+0000","last_change":"2024-09-22T08:56:28.938830+0000","last_active":"2024-09-22T08:56:28.938830+0000","last_peered":"2024-09-22T08:56:28.938830+0000","last_clean":"2024-09-22T08:56:28.938830+0000","last_became_active":"2024-09-22T08:15:04.958336+0000","last_became_peered":"2024-09-22T08:15:04.958336+0000","last_unstale":"2024-09-22T08:56:28.938830+0000","last_undegraded":"2024-09-22T08:56:28.938830+0000","last_fullsized":"2024-09-22T08:56:28.938830+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'231","last_scrub_stamp":"2024-09-22T08:56:28.938691+0000","last_deep_scrub":"263'231","last_deep_scrub_stamp":"2024-09-22T08:56:28.938691+0000","last_clean_scrub_stamp":"2024-09-22T08:56:28.938691+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:30.008305+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":654,"num_read_kb":3596,"num_write":1077,"num_write_kb":27039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"263'4","reported_seq":1457,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:37.780914+0000","last_change":"2024-09-22T08:56:37.780914+0000","last_active":"2024-09-22T08:56:37.780914+0000","last_peered":"2024-09-22T08:56:37.780914+0000","last_clean":"2024-09-22T08:56:37.780914+0000","last_became_active":"2024-09-22T08:15:08.982221+0000","last_became_peered":"2024-09-22T08:15:08.982221+0000","last_unstale":"2024-09-22T08:56:37.780914+0000","last_undegraded":"2024-09-22T08:56:37.780914+0000","last_fullsized":"2024-09-22T08:56:37.780914+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-22T08:56:37.780814+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-22T08:56:37.780814+0000","last_clean_scrub_stamp":"2024-09-22T08:56:37.780814+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:28:47.547033+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":950,"num_read_kb":950,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"263'73","reported_seq":585,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:42.302697+0000","last_change":"2024-09-22T08:15:10.987583+0000","last_active":"2024-09-22T08:55:42.302697+0000","last_peered":"2024-09-22T08:55:42.302697+0000","last_clean":"2024-09-22T08:55:42.302697+0000","last_became_active":"2024-09-22T08:15:10.987273+0000","last_became_peered":"2024-09-22T08:15:10.987273+0000","last_unstale":"2024-09-22T08:55:42.302697+0000","last_undegraded":"2024-09-22T08:55:42.302697+0000","last_fullsized":"2024-09-22T08:55:42.302697+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:52:00.308800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"263'791","reported_seq":2312,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.232518+0000","last_change":"2024-09-22T08:15:13.010979+0000","last_active":"2024-09-22T08:56:16.232518+0000","last_peered":"2024-09-22T08:56:16.232518+0000","last_clean":"2024-09-22T08:56:16.232518+0000","last_became_active":"2024-09-22T08:15:13.010641+0000","last_became_peered":"2024-09-22T08:15:13.010641+0000","last_unstale":"2024-09-22T08:56:16.232518+0000","last_undegraded":"2024-09-22T08:56:16.232518+0000","last_fullsized":"2024-09-22T08:56:16.232518+0000","mapping_epoch":31,"log_start":"263'701","ondisk_log_start":"263'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":701,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:31:51.024056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"263'125","reported_seq":620,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:14.425045+0000","last_change":"2024-09-22T08:15:15.015212+0000","last_active":"2024-09-22T08:54:14.425045+0000","last_peered":"2024-09-22T08:54:14.425045+0000","last_clean":"2024-09-22T08:54:14.425045+0000","last_became_active":"2024-09-22T08:15:15.014775+0000","last_became_peered":"2024-09-22T08:15:15.014775+0000","last_unstale":"2024-09-22T08:54:14.425045+0000","last_undegraded":"2024-09-22T08:54:14.425045+0000","last_fullsized":"2024-09-22T08:54:14.425045+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:24:57.427955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":160,"num_write":304,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"263'416","reported_seq":1980,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:28.069522+0000","last_change":"2024-09-22T08:56:28.069522+0000","last_active":"2024-09-22T08:56:28.069522+0000","last_peered":"2024-09-22T08:56:28.069522+0000","last_clean":"2024-09-22T08:56:28.069522+0000","last_became_active":"2024-09-22T08:15:06.957239+0000","last_became_peered":"2024-09-22T08:15:06.957239+0000","last_unstale":"2024-09-22T08:56:28.069522+0000","last_undegraded":"2024-09-22T08:56:28.069522+0000","last_fullsized":"2024-09-22T08:56:28.069522+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'416","last_scrub_stamp":"2024-09-22T08:56:28.069427+0000","last_deep_scrub":"263'416","last_deep_scrub_stamp":"2024-09-22T08:56:28.069427+0000","last_clean_scrub_stamp":"2024-09-22T08:56:28.069427+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:11:54.954287+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2251,"num_read_kb":2145,"num_write":475,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"263'273","reported_seq":963,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:26.484287+0000","last_change":"2024-09-22T08:56:26.484287+0000","last_active":"2024-09-22T08:56:26.484287+0000","last_peered":"2024-09-22T08:56:26.484287+0000","last_clean":"2024-09-22T08:56:26.484287+0000","last_became_active":"2024-09-22T08:15:04.943906+0000","last_became_peered":"2024-09-22T08:15:04.943906+0000","last_unstale":"2024-09-22T08:56:26.484287+0000","last_undegraded":"2024-09-22T08:56:26.484287+0000","last_fullsized":"2024-09-22T08:56:26.484287+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'273","last_scrub_stamp":"2024-09-22T08:56:26.484114+0000","last_deep_scrub":"263'273","last_deep_scrub_stamp":"2024-09-22T08:56:26.484114+0000","last_clean_scrub_stamp":"2024-09-22T08:56:26.484114+0000","objects_scrubbed":3,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:37:56.831727+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079942,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":793,"num_read_kb":68557,"num_write":1190,"num_write_kb":29712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:23.392212+0000","last_change":"2024-09-22T08:15:08.969465+0000","last_active":"2024-09-22T08:53:23.392212+0000","last_peered":"2024-09-22T08:53:23.392212+0000","last_clean":"2024-09-22T08:53:23.392212+0000","last_became_active":"2024-09-22T08:15:08.969175+0000","last_became_peered":"2024-09-22T08:15:08.969175+0000","last_unstale":"2024-09-22T08:53:23.392212+0000","last_undegraded":"2024-09-22T08:53:23.392212+0000","last_fullsized":"2024-09-22T08:53:23.392212+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:02:12.589731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"263'201","reported_seq":811,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:40.829949+0000","last_change":"2024-09-22T08:56:40.829949+0000","last_active":"2024-09-22T08:56:40.829949+0000","last_peered":"2024-09-22T08:56:40.829949+0000","last_clean":"2024-09-22T08:56:40.829949+0000","last_became_active":"2024-09-22T08:15:10.987081+0000","last_became_peered":"2024-09-22T08:15:10.987081+0000","last_unstale":"2024-09-22T08:56:40.829949+0000","last_undegraded":"2024-09-22T08:56:40.829949+0000","last_fullsized":"2024-09-22T08:56:40.829949+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'201","last_scrub_stamp":"2024-09-22T08:56:40.829842+0000","last_deep_scrub":"263'201","last_deep_scrub_stamp":"2024-09-22T08:56:40.829842+0000","last_clean_scrub_stamp":"2024-09-22T08:56:40.829842+0000","objects_scrubbed":8,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:08:13.921355+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5409,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":251,"num_read_kb":285,"num_write":138,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:31.269342+0000","last_change":"2024-09-22T08:15:13.008391+0000","last_active":"2024-09-22T08:53:31.269342+0000","last_peered":"2024-09-22T08:53:31.269342+0000","last_clean":"2024-09-22T08:53:31.269342+0000","last_became_active":"2024-09-22T08:15:13.007735+0000","last_became_peered":"2024-09-22T08:15:13.007735+0000","last_unstale":"2024-09-22T08:53:31.269342+0000","last_undegraded":"2024-09-22T08:53:31.269342+0000","last_fullsized":"2024-09-22T08:53:31.269342+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:36:22.012503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"263'149","reported_seq":642,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:52.302863+0000","last_change":"2024-09-22T08:15:15.013532+0000","last_active":"2024-09-22T08:54:52.302863+0000","last_peered":"2024-09-22T08:54:52.302863+0000","last_clean":"2024-09-22T08:54:52.302863+0000","last_became_active":"2024-09-22T08:15:15.013216+0000","last_became_peered":"2024-09-22T08:15:15.013216+0000","last_unstale":"2024-09-22T08:54:52.302863+0000","last_undegraded":"2024-09-22T08:54:52.302863+0000","last_fullsized":"2024-09-22T08:54:52.302863+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:46:24.084971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1066,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":167,"num_read_kb":166,"num_write":339,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"263'394","reported_seq":1971,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:39.809824+0000","last_change":"2024-09-22T08:56:39.809824+0000","last_active":"2024-09-22T08:56:39.809824+0000","last_peered":"2024-09-22T08:56:39.809824+0000","last_clean":"2024-09-22T08:56:39.809824+0000","last_became_active":"2024-09-22T08:15:06.966710+0000","last_became_peered":"2024-09-22T08:15:06.966710+0000","last_unstale":"2024-09-22T08:56:39.809824+0000","last_undegraded":"2024-09-22T08:56:39.809824+0000","last_fullsized":"2024-09-22T08:56:39.809824+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'394","last_scrub_stamp":"2024-09-22T08:56:39.809723+0000","last_deep_scrub":"263'394","last_deep_scrub_stamp":"2024-09-22T08:56:39.809723+0000","last_clean_scrub_stamp":"2024-09-22T08:56:39.809723+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:25:17.819687+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2363,"num_read_kb":2266,"num_write":458,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"263'74","reported_seq":621,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:23.906168+0000","last_change":"2024-09-22T08:56:23.906168+0000","last_active":"2024-09-22T08:56:23.906168+0000","last_peered":"2024-09-22T08:56:23.906168+0000","last_clean":"2024-09-22T08:56:23.906168+0000","last_became_active":"2024-09-22T08:14:48.584210+0000","last_became_peered":"2024-09-22T08:14:48.584210+0000","last_unstale":"2024-09-22T08:56:23.906168+0000","last_undegraded":"2024-09-22T08:56:23.906168+0000","last_fullsized":"2024-09-22T08:56:23.906168+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'74","last_scrub_stamp":"2024-09-22T08:56:23.906086+0000","last_deep_scrub":"263'74","last_deep_scrub_stamp":"2024-09-22T08:56:23.906086+0000","last_clean_scrub_stamp":"2024-09-22T08:56:23.906086+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:41:31.894467+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"263'2","reported_seq":532,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:24.997667+0000","last_change":"2024-09-22T08:56:24.997623+0000","last_active":"2024-09-22T08:56:24.997667+0000","last_peered":"2024-09-22T08:56:24.997667+0000","last_clean":"2024-09-22T08:56:24.997667+0000","last_became_active":"2024-09-22T08:14:54.727501+0000","last_became_peered":"2024-09-22T08:14:54.727501+0000","last_unstale":"2024-09-22T08:56:24.997667+0000","last_undegraded":"2024-09-22T08:56:24.997667+0000","last_fullsized":"2024-09-22T08:56:24.997667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:56:24.997551+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:56:24.997551+0000","last_clean_scrub_stamp":"2024-09-22T08:56:24.997551+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:35:48.958613+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001065632,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"263'182","reported_seq":852,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:23.521494+0000","last_change":"2024-09-22T08:56:23.521494+0000","last_active":"2024-09-22T08:56:23.521494+0000","last_peered":"2024-09-22T08:56:23.521494+0000","last_clean":"2024-09-22T08:56:23.521494+0000","last_became_active":"2024-09-22T08:15:04.963447+0000","last_became_peered":"2024-09-22T08:15:04.963447+0000","last_unstale":"2024-09-22T08:56:23.521494+0000","last_undegraded":"2024-09-22T08:56:23.521494+0000","last_fullsized":"2024-09-22T08:56:23.521494+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'182","last_scrub_stamp":"2024-09-22T08:56:23.521376+0000","last_deep_scrub":"263'182","last_deep_scrub_stamp":"2024-09-22T08:56:23.521376+0000","last_clean_scrub_stamp":"2024-09-22T08:56:23.521376+0000","objects_scrubbed":3,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:36:09.902043+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":624,"num_read_kb":9185,"num_write":876,"num_write_kb":23340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:39.482217+0000","last_change":"2024-09-22T08:56:39.482217+0000","last_active":"2024-09-22T08:56:39.482217+0000","last_peered":"2024-09-22T08:56:39.482217+0000","last_clean":"2024-09-22T08:56:39.482217+0000","last_became_active":"2024-09-22T08:15:08.978755+0000","last_became_peered":"2024-09-22T08:15:08.978755+0000","last_unstale":"2024-09-22T08:56:39.482217+0000","last_undegraded":"2024-09-22T08:56:39.482217+0000","last_fullsized":"2024-09-22T08:56:39.482217+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:39.482129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:39.482129+0000","last_clean_scrub_stamp":"2024-09-22T08:56:39.482129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:10:09.797452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"263'279","reported_seq":979,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.447679+0000","last_change":"2024-09-22T08:15:10.991397+0000","last_active":"2024-09-22T08:56:16.447679+0000","last_peered":"2024-09-22T08:56:16.447679+0000","last_clean":"2024-09-22T08:56:16.447679+0000","last_became_active":"2024-09-22T08:15:10.991050+0000","last_became_peered":"2024-09-22T08:15:10.991050+0000","last_unstale":"2024-09-22T08:56:16.447679+0000","last_undegraded":"2024-09-22T08:56:16.447679+0000","last_fullsized":"2024-09-22T08:56:16.447679+0000","mapping_epoch":29,"log_start":"260'200","ondisk_log_start":"260'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27910,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":531,"num_read_kb":745,"num_write":430,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:12.288724+0000","last_change":"2024-09-22T08:15:13.018888+0000","last_active":"2024-09-22T08:54:12.288724+0000","last_peered":"2024-09-22T08:54:12.288724+0000","last_clean":"2024-09-22T08:54:12.288724+0000","last_became_active":"2024-09-22T08:15:13.018627+0000","last_became_peered":"2024-09-22T08:15:13.018627+0000","last_unstale":"2024-09-22T08:54:12.288724+0000","last_undegraded":"2024-09-22T08:54:12.288724+0000","last_fullsized":"2024-09-22T08:54:12.288724+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:34:15.340844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"263'226","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.486892+0000","last_change":"2024-09-22T08:15:15.017846+0000","last_active":"2024-09-22T08:54:41.486892+0000","last_peered":"2024-09-22T08:54:41.486892+0000","last_clean":"2024-09-22T08:54:41.486892+0000","last_became_active":"2024-09-22T08:15:15.017533+0000","last_became_peered":"2024-09-22T08:15:15.017533+0000","last_unstale":"2024-09-22T08:54:41.486892+0000","last_undegraded":"2024-09-22T08:54:41.486892+0000","last_fullsized":"2024-09-22T08:54:41.486892+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":616,"num_read_kb":580,"num_write":434,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"263'397","reported_seq":1968,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:36.374074+0000","last_change":"2024-09-22T08:56:36.374074+0000","last_active":"2024-09-22T08:56:36.374074+0000","last_peered":"2024-09-22T08:56:36.374074+0000","last_clean":"2024-09-22T08:56:36.374074+0000","last_became_active":"2024-09-22T08:15:06.966792+0000","last_became_peered":"2024-09-22T08:15:06.966792+0000","last_unstale":"2024-09-22T08:56:36.374074+0000","last_undegraded":"2024-09-22T08:56:36.374074+0000","last_fullsized":"2024-09-22T08:56:36.374074+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'397","last_scrub_stamp":"2024-09-22T08:56:36.373981+0000","last_deep_scrub":"263'397","last_deep_scrub_stamp":"2024-09-22T08:56:36.373981+0000","last_clean_scrub_stamp":"2024-09-22T08:56:36.373981+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:00:10.052430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2208,"num_read_kb":2116,"num_write":452,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":530,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:22.986343+0000","last_change":"2024-09-22T08:56:22.986343+0000","last_active":"2024-09-22T08:56:22.986343+0000","last_peered":"2024-09-22T08:56:22.986343+0000","last_clean":"2024-09-22T08:56:22.986343+0000","last_became_active":"2024-09-22T08:14:54.726875+0000","last_became_peered":"2024-09-22T08:14:54.726875+0000","last_unstale":"2024-09-22T08:56:22.986343+0000","last_undegraded":"2024-09-22T08:56:22.986343+0000","last_fullsized":"2024-09-22T08:56:22.986343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:22.986260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:22.986260+0000","last_clean_scrub_stamp":"2024-09-22T08:56:22.986260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:13:47.646650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000558433,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"263'182","reported_seq":795,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:31.472650+0000","last_change":"2024-09-22T08:56:31.472650+0000","last_active":"2024-09-22T08:56:31.472650+0000","last_peered":"2024-09-22T08:56:31.472650+0000","last_clean":"2024-09-22T08:56:31.472650+0000","last_became_active":"2024-09-22T08:15:04.963967+0000","last_became_peered":"2024-09-22T08:15:04.963967+0000","last_unstale":"2024-09-22T08:56:31.472650+0000","last_undegraded":"2024-09-22T08:56:31.472650+0000","last_fullsized":"2024-09-22T08:56:31.472650+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'182","last_scrub_stamp":"2024-09-22T08:56:31.472539+0000","last_deep_scrub":"263'182","last_deep_scrub_stamp":"2024-09-22T08:56:31.472539+0000","last_clean_scrub_stamp":"2024-09-22T08:56:31.472539+0000","objects_scrubbed":2,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:54:16.950622+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":424,"num_read_kb":76135,"num_write":811,"num_write_kb":37187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:08.397709+0000","last_change":"2024-09-22T08:15:08.969618+0000","last_active":"2024-09-22T08:54:08.397709+0000","last_peered":"2024-09-22T08:54:08.397709+0000","last_clean":"2024-09-22T08:54:08.397709+0000","last_became_active":"2024-09-22T08:15:08.969276+0000","last_became_peered":"2024-09-22T08:15:08.969276+0000","last_unstale":"2024-09-22T08:54:08.397709+0000","last_undegraded":"2024-09-22T08:54:08.397709+0000","last_fullsized":"2024-09-22T08:54:08.397709+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:45:38.728128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"263'869","reported_seq":2308,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:41.174984+0000","last_change":"2024-09-22T08:56:41.174984+0000","last_active":"2024-09-22T08:56:41.174984+0000","last_peered":"2024-09-22T08:56:41.174984+0000","last_clean":"2024-09-22T08:56:41.174984+0000","last_became_active":"2024-09-22T08:15:10.984157+0000","last_became_peered":"2024-09-22T08:15:10.984157+0000","last_unstale":"2024-09-22T08:56:41.174984+0000","last_undegraded":"2024-09-22T08:56:41.174984+0000","last_fullsized":"2024-09-22T08:56:41.174984+0000","mapping_epoch":29,"log_start":"263'800","ondisk_log_start":"263'800","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'869","last_scrub_stamp":"2024-09-22T08:56:41.174846+0000","last_deep_scrub":"263'869","last_deep_scrub_stamp":"2024-09-22T08:56:41.174846+0000","last_clean_scrub_stamp":"2024-09-22T08:56:41.174846+0000","objects_scrubbed":12,"log_size":69,"log_dups_size":800,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:25:27.321377+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49716,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1169,"num_read_kb":1404,"num_write":276,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:48.387989+0000","last_change":"2024-09-22T08:15:13.012134+0000","last_active":"2024-09-22T08:52:48.387989+0000","last_peered":"2024-09-22T08:52:48.387989+0000","last_clean":"2024-09-22T08:52:48.387989+0000","last_became_active":"2024-09-22T08:15:13.011864+0000","last_became_peered":"2024-09-22T08:15:13.011864+0000","last_unstale":"2024-09-22T08:52:48.387989+0000","last_undegraded":"2024-09-22T08:52:48.387989+0000","last_fullsized":"2024-09-22T08:52:48.387989+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:25:33.123487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"263'214","reported_seq":741,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:22.290127+0000","last_change":"2024-09-22T08:15:15.014316+0000","last_active":"2024-09-22T08:54:22.290127+0000","last_peered":"2024-09-22T08:54:22.290127+0000","last_clean":"2024-09-22T08:54:22.290127+0000","last_became_active":"2024-09-22T08:15:15.014003+0000","last_became_peered":"2024-09-22T08:15:15.014003+0000","last_unstale":"2024-09-22T08:54:22.290127+0000","last_undegraded":"2024-09-22T08:54:22.290127+0000","last_fullsized":"2024-09-22T08:54:22.290127+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":401,"num_read_kb":391,"num_write":491,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"263'700","reported_seq":2541,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:34.442254+0000","last_change":"2024-09-22T08:56:34.442254+0000","last_active":"2024-09-22T08:56:34.442254+0000","last_peered":"2024-09-22T08:56:34.442254+0000","last_clean":"2024-09-22T08:56:34.442254+0000","last_became_active":"2024-09-22T08:15:06.972591+0000","last_became_peered":"2024-09-22T08:15:06.972591+0000","last_unstale":"2024-09-22T08:56:34.442254+0000","last_undegraded":"2024-09-22T08:56:34.442254+0000","last_fullsized":"2024-09-22T08:56:34.442254+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'700","last_scrub_stamp":"2024-09-22T08:56:34.442140+0000","last_deep_scrub":"263'700","last_deep_scrub_stamp":"2024-09-22T08:56:34.442140+0000","last_clean_scrub_stamp":"2024-09-22T08:56:34.442140+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":600,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:12:11.424859+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3779,"num_read_kb":3472,"num_write":954,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":695,"num_omap_keys":3,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":532,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:27.077163+0000","last_change":"2024-09-22T08:56:27.077093+0000","last_active":"2024-09-22T08:56:27.077163+0000","last_peered":"2024-09-22T08:56:27.077163+0000","last_clean":"2024-09-22T08:56:27.077163+0000","last_became_active":"2024-09-22T08:14:54.718660+0000","last_became_peered":"2024-09-22T08:14:54.718660+0000","last_unstale":"2024-09-22T08:56:27.077163+0000","last_undegraded":"2024-09-22T08:56:27.077163+0000","last_fullsized":"2024-09-22T08:56:27.077163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:27.076990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:27.076990+0000","last_clean_scrub_stamp":"2024-09-22T08:56:27.076990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:51:42.150906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042448600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"263'261","reported_seq":954,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:26.431268+0000","last_change":"2024-09-22T08:56:26.431268+0000","last_active":"2024-09-22T08:56:26.431268+0000","last_peered":"2024-09-22T08:56:26.431268+0000","last_clean":"2024-09-22T08:56:26.431268+0000","last_became_active":"2024-09-22T08:15:04.954726+0000","last_became_peered":"2024-09-22T08:15:04.954726+0000","last_unstale":"2024-09-22T08:56:26.431268+0000","last_undegraded":"2024-09-22T08:56:26.431268+0000","last_fullsized":"2024-09-22T08:56:26.431268+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'261","last_scrub_stamp":"2024-09-22T08:56:26.431154+0000","last_deep_scrub":"263'261","last_deep_scrub_stamp":"2024-09-22T08:56:26.431154+0000","last_clean_scrub_stamp":"2024-09-22T08:56:26.431154+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:09:33.251754+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":813,"num_read_kb":7176,"num_write":1020,"num_write_kb":41627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:12.297346+0000","last_change":"2024-09-22T08:15:08.974770+0000","last_active":"2024-09-22T08:54:12.297346+0000","last_peered":"2024-09-22T08:54:12.297346+0000","last_clean":"2024-09-22T08:54:12.297346+0000","last_became_active":"2024-09-22T08:15:08.974419+0000","last_became_peered":"2024-09-22T08:15:08.974419+0000","last_unstale":"2024-09-22T08:54:12.297346+0000","last_undegraded":"2024-09-22T08:54:12.297346+0000","last_fullsized":"2024-09-22T08:54:12.297346+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:25:16.095099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"263'242","reported_seq":1286,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:40.526320+0000","last_change":"2024-09-22T08:56:40.526320+0000","last_active":"2024-09-22T08:56:40.526320+0000","last_peered":"2024-09-22T08:56:40.526320+0000","last_clean":"2024-09-22T08:56:40.526320+0000","last_became_active":"2024-09-22T08:15:10.987358+0000","last_became_peered":"2024-09-22T08:15:10.987358+0000","last_unstale":"2024-09-22T08:56:40.526320+0000","last_undegraded":"2024-09-22T08:56:40.526320+0000","last_fullsized":"2024-09-22T08:56:40.526320+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'242","last_scrub_stamp":"2024-09-22T08:56:40.526223+0000","last_deep_scrub":"263'242","last_deep_scrub_stamp":"2024-09-22T08:56:40.526223+0000","last_clean_scrub_stamp":"2024-09-22T08:56:40.526223+0000","objects_scrubbed":9,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:34:59.804804+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":174,"num_read_kb":166,"num_write":139,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5278,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:42.398346+0000","last_change":"2024-09-22T08:15:13.010215+0000","last_active":"2024-09-22T08:52:42.398346+0000","last_peered":"2024-09-22T08:52:42.398346+0000","last_clean":"2024-09-22T08:52:42.398346+0000","last_became_active":"2024-09-22T08:15:13.009891+0000","last_became_peered":"2024-09-22T08:15:13.009891+0000","last_unstale":"2024-09-22T08:52:42.398346+0000","last_undegraded":"2024-09-22T08:52:42.398346+0000","last_fullsized":"2024-09-22T08:52:42.398346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:10:10.890953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"263'244","reported_seq":839,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.629431+0000","last_change":"2024-09-22T08:15:15.018070+0000","last_active":"2024-09-22T08:54:41.629431+0000","last_peered":"2024-09-22T08:54:41.629431+0000","last_clean":"2024-09-22T08:54:41.629431+0000","last_became_active":"2024-09-22T08:15:15.017686+0000","last_became_peered":"2024-09-22T08:15:15.017686+0000","last_unstale":"2024-09-22T08:54:41.629431+0000","last_undegraded":"2024-09-22T08:54:41.629431+0000","last_fullsized":"2024-09-22T08:54:41.629431+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:59:24.235010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":504,"num_read_kb":528,"num_write":541,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"263'459","reported_seq":1993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:33.446543+0000","last_change":"2024-09-22T08:56:33.446543+0000","last_active":"2024-09-22T08:56:33.446543+0000","last_peered":"2024-09-22T08:56:33.446543+0000","last_clean":"2024-09-22T08:56:33.446543+0000","last_became_active":"2024-09-22T08:15:06.962486+0000","last_became_peered":"2024-09-22T08:15:06.962486+0000","last_unstale":"2024-09-22T08:56:33.446543+0000","last_undegraded":"2024-09-22T08:56:33.446543+0000","last_fullsized":"2024-09-22T08:56:33.446543+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'459","last_scrub_stamp":"2024-09-22T08:56:33.446433+0000","last_deep_scrub":"263'459","last_deep_scrub_stamp":"2024-09-22T08:56:33.446433+0000","last_clean_scrub_stamp":"2024-09-22T08:56:33.446433+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:03.195975+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2436,"num_read_kb":2281,"num_write":554,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"263'3","reported_seq":533,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:24.036583+0000","last_change":"2024-09-22T08:56:24.036494+0000","last_active":"2024-09-22T08:56:24.036583+0000","last_peered":"2024-09-22T08:56:24.036583+0000","last_clean":"2024-09-22T08:56:24.036583+0000","last_became_active":"2024-09-22T08:14:55.586088+0000","last_became_peered":"2024-09-22T08:14:55.586088+0000","last_unstale":"2024-09-22T08:56:24.036583+0000","last_undegraded":"2024-09-22T08:56:24.036583+0000","last_fullsized":"2024-09-22T08:56:24.036583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-22T08:56:24.036366+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-22T08:56:24.036366+0000","last_clean_scrub_stamp":"2024-09-22T08:56:24.036366+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:04:54.097829+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0010233219999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"263'164","reported_seq":760,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:21.464541+0000","last_change":"2024-09-22T08:56:21.464541+0000","last_active":"2024-09-22T08:56:21.464541+0000","last_peered":"2024-09-22T08:56:21.464541+0000","last_clean":"2024-09-22T08:56:21.464541+0000","last_became_active":"2024-09-22T08:15:04.963894+0000","last_became_peered":"2024-09-22T08:15:04.963894+0000","last_unstale":"2024-09-22T08:56:21.464541+0000","last_undegraded":"2024-09-22T08:56:21.464541+0000","last_fullsized":"2024-09-22T08:56:21.464541+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'164","last_scrub_stamp":"2024-09-22T08:56:21.464437+0000","last_deep_scrub":"263'164","last_deep_scrub_stamp":"2024-09-22T08:56:21.464437+0000","last_clean_scrub_stamp":"2024-09-22T08:56:21.464437+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:37:48.941982+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":412,"num_read_kb":11085,"num_write":748,"num_write_kb":14868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:36.134073+0000","last_change":"2024-09-22T08:56:36.134073+0000","last_active":"2024-09-22T08:56:36.134073+0000","last_peered":"2024-09-22T08:56:36.134073+0000","last_clean":"2024-09-22T08:56:36.134073+0000","last_became_active":"2024-09-22T08:15:08.968076+0000","last_became_peered":"2024-09-22T08:15:08.968076+0000","last_unstale":"2024-09-22T08:56:36.134073+0000","last_undegraded":"2024-09-22T08:56:36.134073+0000","last_fullsized":"2024-09-22T08:56:36.134073+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:36.133960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:36.133960+0000","last_clean_scrub_stamp":"2024-09-22T08:56:36.133960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:38:20.387449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"263'111","reported_seq":651,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:03.502269+0000","last_change":"2024-09-22T08:15:10.992735+0000","last_active":"2024-09-22T08:56:03.502269+0000","last_peered":"2024-09-22T08:56:03.502269+0000","last_clean":"2024-09-22T08:56:03.502269+0000","last_became_active":"2024-09-22T08:15:10.992450+0000","last_became_peered":"2024-09-22T08:15:10.992450+0000","last_unstale":"2024-09-22T08:56:03.502269+0000","last_undegraded":"2024-09-22T08:56:03.502269+0000","last_fullsized":"2024-09-22T08:56:03.502269+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:04:43.027150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":139,"num_read_kb":133,"num_write":98,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:13.398284+0000","last_change":"2024-09-22T08:15:13.012190+0000","last_active":"2024-09-22T08:54:13.398284+0000","last_peered":"2024-09-22T08:54:13.398284+0000","last_clean":"2024-09-22T08:54:13.398284+0000","last_became_active":"2024-09-22T08:15:13.011756+0000","last_became_peered":"2024-09-22T08:15:13.011756+0000","last_unstale":"2024-09-22T08:54:13.398284+0000","last_undegraded":"2024-09-22T08:54:13.398284+0000","last_fullsized":"2024-09-22T08:54:13.398284+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"263'109","reported_seq":660,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:24.604859+0000","last_change":"2024-09-22T08:15:15.017200+0000","last_active":"2024-09-22T08:54:24.604859+0000","last_peered":"2024-09-22T08:54:24.604859+0000","last_clean":"2024-09-22T08:54:24.604859+0000","last_became_active":"2024-09-22T08:15:15.016910+0000","last_became_peered":"2024-09-22T08:15:15.016910+0000","last_unstale":"2024-09-22T08:54:24.604859+0000","last_undegraded":"2024-09-22T08:54:24.604859+0000","last_fullsized":"2024-09-22T08:54:24.604859+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":271,"num_read_kb":261,"num_write":275,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"263'846","reported_seq":2461,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:29.493348+0000","last_change":"2024-09-22T08:56:29.493348+0000","last_active":"2024-09-22T08:56:29.493348+0000","last_peered":"2024-09-22T08:56:29.493348+0000","last_clean":"2024-09-22T08:56:29.493348+0000","last_became_active":"2024-09-22T08:15:06.965021+0000","last_became_peered":"2024-09-22T08:15:06.965021+0000","last_unstale":"2024-09-22T08:56:29.493348+0000","last_undegraded":"2024-09-22T08:56:29.493348+0000","last_fullsized":"2024-09-22T08:56:29.493348+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'846","last_scrub_stamp":"2024-09-22T08:56:29.493263+0000","last_deep_scrub":"263'846","last_deep_scrub_stamp":"2024-09-22T08:56:29.493263+0000","last_clean_scrub_stamp":"2024-09-22T08:56:29.493263+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":800,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:43:22.418910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4016,"num_read_kb":3619,"num_write":1120,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"263'175","reported_seq":789,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:22.390052+0000","last_change":"2024-09-22T08:56:22.390052+0000","last_active":"2024-09-22T08:56:22.390052+0000","last_peered":"2024-09-22T08:56:22.390052+0000","last_clean":"2024-09-22T08:56:22.390052+0000","last_became_active":"2024-09-22T08:15:04.958834+0000","last_became_peered":"2024-09-22T08:15:04.958834+0000","last_unstale":"2024-09-22T08:56:22.390052+0000","last_undegraded":"2024-09-22T08:56:22.390052+0000","last_fullsized":"2024-09-22T08:56:22.390052+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'175","last_scrub_stamp":"2024-09-22T08:56:22.389983+0000","last_deep_scrub":"263'175","last_deep_scrub_stamp":"2024-09-22T08:56:22.389983+0000","last_clean_scrub_stamp":"2024-09-22T08:56:22.389983+0000","objects_scrubbed":2,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:05:50.275750+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":466,"num_read_kb":15054,"num_write":837,"num_write_kb":27215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":528,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:23.482652+0000","last_change":"2024-09-22T08:56:23.482583+0000","last_active":"2024-09-22T08:56:23.482652+0000","last_peered":"2024-09-22T08:56:23.482652+0000","last_clean":"2024-09-22T08:56:23.482652+0000","last_became_active":"2024-09-22T08:14:55.585738+0000","last_became_peered":"2024-09-22T08:14:55.585738+0000","last_unstale":"2024-09-22T08:56:23.482652+0000","last_undegraded":"2024-09-22T08:56:23.482652+0000","last_fullsized":"2024-09-22T08:56:23.482652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:23.482501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:23.482501+0000","last_clean_scrub_stamp":"2024-09-22T08:56:23.482501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:54:46.131217+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00053802500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:39.742319+0000","last_change":"2024-09-22T08:56:39.742319+0000","last_active":"2024-09-22T08:56:39.742319+0000","last_peered":"2024-09-22T08:56:39.742319+0000","last_clean":"2024-09-22T08:56:39.742319+0000","last_became_active":"2024-09-22T08:15:08.975175+0000","last_became_peered":"2024-09-22T08:15:08.975175+0000","last_unstale":"2024-09-22T08:56:39.742319+0000","last_undegraded":"2024-09-22T08:56:39.742319+0000","last_fullsized":"2024-09-22T08:56:39.742319+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:39.742220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:39.742220+0000","last_clean_scrub_stamp":"2024-09-22T08:56:39.742220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:52:23.005245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"263'301","reported_seq":972,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:37.103768+0000","last_change":"2024-09-22T08:56:37.103768+0000","last_active":"2024-09-22T08:56:37.103768+0000","last_peered":"2024-09-22T08:56:37.103768+0000","last_clean":"2024-09-22T08:56:37.103768+0000","last_became_active":"2024-09-22T08:15:10.982147+0000","last_became_peered":"2024-09-22T08:15:10.982147+0000","last_unstale":"2024-09-22T08:56:37.103768+0000","last_undegraded":"2024-09-22T08:56:37.103768+0000","last_fullsized":"2024-09-22T08:56:37.103768+0000","mapping_epoch":29,"log_start":"260'200","ondisk_log_start":"260'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'301","last_scrub_stamp":"2024-09-22T08:56:37.103659+0000","last_deep_scrub":"263'301","last_deep_scrub_stamp":"2024-09-22T08:56:37.103659+0000","last_clean_scrub_stamp":"2024-09-22T08:56:37.103659+0000","objects_scrubbed":10,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:06:07.933674+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30730,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1060,"num_read_kb":1272,"num_write":1552,"num_write_kb":1410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":535730,"num_omap_keys":1208,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:46.263665+0000","last_change":"2024-09-22T08:15:13.014254+0000","last_active":"2024-09-22T08:52:46.263665+0000","last_peered":"2024-09-22T08:52:46.263665+0000","last_clean":"2024-09-22T08:52:46.263665+0000","last_became_active":"2024-09-22T08:15:13.013980+0000","last_became_peered":"2024-09-22T08:15:13.013980+0000","last_unstale":"2024-09-22T08:52:46.263665+0000","last_undegraded":"2024-09-22T08:52:46.263665+0000","last_fullsized":"2024-09-22T08:52:46.263665+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:43:47.566603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"263'169","reported_seq":721,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.923448+0000","last_change":"2024-09-22T08:15:15.012481+0000","last_active":"2024-09-22T08:54:38.923448+0000","last_peered":"2024-09-22T08:54:38.923448+0000","last_clean":"2024-09-22T08:54:38.923448+0000","last_became_active":"2024-09-22T08:15:15.012146+0000","last_became_peered":"2024-09-22T08:15:15.012146+0000","last_unstale":"2024-09-22T08:54:38.923448+0000","last_undegraded":"2024-09-22T08:54:38.923448+0000","last_fullsized":"2024-09-22T08:54:38.923448+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:12:50.086341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":420,"num_read_kb":363,"num_write":419,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"263'445","reported_seq":2047,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:32.437536+0000","last_change":"2024-09-22T08:56:32.437536+0000","last_active":"2024-09-22T08:56:32.437536+0000","last_peered":"2024-09-22T08:56:32.437536+0000","last_clean":"2024-09-22T08:56:32.437536+0000","last_became_active":"2024-09-22T08:15:06.973563+0000","last_became_peered":"2024-09-22T08:15:06.973563+0000","last_unstale":"2024-09-22T08:56:32.437536+0000","last_undegraded":"2024-09-22T08:56:32.437536+0000","last_fullsized":"2024-09-22T08:56:32.437536+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'445","last_scrub_stamp":"2024-09-22T08:56:32.437452+0000","last_deep_scrub":"263'445","last_deep_scrub_stamp":"2024-09-22T08:56:32.437452+0000","last_clean_scrub_stamp":"2024-09-22T08:56:32.437452+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:12:03.651331+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2370,"num_read_kb":2248,"num_write":498,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"263'190","reported_seq":819,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:24.448712+0000","last_change":"2024-09-22T08:56:24.448712+0000","last_active":"2024-09-22T08:56:24.448712+0000","last_peered":"2024-09-22T08:56:24.448712+0000","last_clean":"2024-09-22T08:56:24.448712+0000","last_became_active":"2024-09-22T08:15:04.956585+0000","last_became_peered":"2024-09-22T08:15:04.956585+0000","last_unstale":"2024-09-22T08:56:24.448712+0000","last_undegraded":"2024-09-22T08:56:24.448712+0000","last_fullsized":"2024-09-22T08:56:24.448712+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'190","last_scrub_stamp":"2024-09-22T08:56:24.448616+0000","last_deep_scrub":"263'190","last_deep_scrub_stamp":"2024-09-22T08:56:24.448616+0000","last_clean_scrub_stamp":"2024-09-22T08:56:24.448616+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:28:39.635896+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":533,"num_read_kb":28072,"num_write":815,"num_write_kb":27925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":530,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:25.950025+0000","last_change":"2024-09-22T08:56:25.949974+0000","last_active":"2024-09-22T08:56:25.950025+0000","last_peered":"2024-09-22T08:56:25.950025+0000","last_clean":"2024-09-22T08:56:25.950025+0000","last_became_active":"2024-09-22T08:14:54.727321+0000","last_became_peered":"2024-09-22T08:14:54.727321+0000","last_unstale":"2024-09-22T08:56:25.950025+0000","last_undegraded":"2024-09-22T08:56:25.950025+0000","last_fullsized":"2024-09-22T08:56:25.950025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:25.949885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:25.949885+0000","last_clean_scrub_stamp":"2024-09-22T08:56:25.949885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:04:26.428044+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00058148900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:37.488910+0000","last_change":"2024-09-22T08:56:37.488910+0000","last_active":"2024-09-22T08:56:37.488910+0000","last_peered":"2024-09-22T08:56:37.488910+0000","last_clean":"2024-09-22T08:56:37.488910+0000","last_became_active":"2024-09-22T08:15:08.974823+0000","last_became_peered":"2024-09-22T08:15:08.974823+0000","last_unstale":"2024-09-22T08:56:37.488910+0000","last_undegraded":"2024-09-22T08:56:37.488910+0000","last_fullsized":"2024-09-22T08:56:37.488910+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:37.488797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:37.488797+0000","last_clean_scrub_stamp":"2024-09-22T08:56:37.488797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:06:57.904560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"263'158","reported_seq":713,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.767668+0000","last_change":"2024-09-22T08:15:10.991721+0000","last_active":"2024-09-22T08:55:19.767668+0000","last_peered":"2024-09-22T08:55:19.767668+0000","last_clean":"2024-09-22T08:55:19.767668+0000","last_became_active":"2024-09-22T08:15:10.991426+0000","last_became_peered":"2024-09-22T08:15:10.991426+0000","last_unstale":"2024-09-22T08:55:19.767668+0000","last_undegraded":"2024-09-22T08:55:19.767668+0000","last_fullsized":"2024-09-22T08:55:19.767668+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:13:29.594926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":204,"num_read_kb":193,"num_write":140,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"263'790","reported_seq":4936,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.228586+0000","last_change":"2024-09-22T08:15:13.014146+0000","last_active":"2024-09-22T08:56:16.228586+0000","last_peered":"2024-09-22T08:56:16.228586+0000","last_clean":"2024-09-22T08:56:16.228586+0000","last_became_active":"2024-09-22T08:15:13.013828+0000","last_became_peered":"2024-09-22T08:15:13.013828+0000","last_unstale":"2024-09-22T08:56:16.228586+0000","last_undegraded":"2024-09-22T08:56:16.228586+0000","last_fullsized":"2024-09-22T08:56:16.228586+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:14:34.454135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"263'140","reported_seq":640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:57.311692+0000","last_change":"2024-09-22T08:15:15.014270+0000","last_active":"2024-09-22T08:55:57.311692+0000","last_peered":"2024-09-22T08:55:57.311692+0000","last_clean":"2024-09-22T08:55:57.311692+0000","last_became_active":"2024-09-22T08:15:15.013976+0000","last_became_peered":"2024-09-22T08:15:15.013976+0000","last_unstale":"2024-09-22T08:55:57.311692+0000","last_undegraded":"2024-09-22T08:55:57.311692+0000","last_fullsized":"2024-09-22T08:55:57.311692+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:36:15.356232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":177,"num_read_kb":172,"num_write":337,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"263'453","reported_seq":1959,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:31.604854+0000","last_change":"2024-09-22T08:56:31.604854+0000","last_active":"2024-09-22T08:56:31.604854+0000","last_peered":"2024-09-22T08:56:31.604854+0000","last_clean":"2024-09-22T08:56:31.604854+0000","last_became_active":"2024-09-22T08:15:06.966387+0000","last_became_peered":"2024-09-22T08:15:06.966387+0000","last_unstale":"2024-09-22T08:56:31.604854+0000","last_undegraded":"2024-09-22T08:56:31.604854+0000","last_fullsized":"2024-09-22T08:56:31.604854+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'453","last_scrub_stamp":"2024-09-22T08:56:31.604702+0000","last_deep_scrub":"263'453","last_deep_scrub_stamp":"2024-09-22T08:56:31.604702+0000","last_clean_scrub_stamp":"2024-09-22T08:56:31.604702+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:47:41.638747+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2402,"num_read_kb":2235,"num_write":539,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"263'208","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:27.494927+0000","last_change":"2024-09-22T08:56:27.494927+0000","last_active":"2024-09-22T08:56:27.494927+0000","last_peered":"2024-09-22T08:56:27.494927+0000","last_clean":"2024-09-22T08:56:27.494927+0000","last_became_active":"2024-09-22T08:15:04.951731+0000","last_became_peered":"2024-09-22T08:15:04.951731+0000","last_unstale":"2024-09-22T08:56:27.494927+0000","last_undegraded":"2024-09-22T08:56:27.494927+0000","last_fullsized":"2024-09-22T08:56:27.494927+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'208","last_scrub_stamp":"2024-09-22T08:56:27.494744+0000","last_deep_scrub":"263'208","last_deep_scrub_stamp":"2024-09-22T08:56:27.494744+0000","last_clean_scrub_stamp":"2024-09-22T08:56:27.494744+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:38:30.369670+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079922,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":440,"num_read_kb":57796,"num_write":879,"num_write_kb":62478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:25.510634+0000","last_change":"2024-09-22T08:56:25.510634+0000","last_active":"2024-09-22T08:56:25.510634+0000","last_peered":"2024-09-22T08:56:25.510634+0000","last_clean":"2024-09-22T08:56:25.510634+0000","last_became_active":"2024-09-22T08:14:55.585607+0000","last_became_peered":"2024-09-22T08:14:55.585607+0000","last_unstale":"2024-09-22T08:56:25.510634+0000","last_undegraded":"2024-09-22T08:56:25.510634+0000","last_fullsized":"2024-09-22T08:56:25.510634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:25.510529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:25.510529+0000","last_clean_scrub_stamp":"2024-09-22T08:56:25.510529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:13:03.897890+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00049298099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:38.386674+0000","last_change":"2024-09-22T08:15:08.969703+0000","last_active":"2024-09-22T08:52:38.386674+0000","last_peered":"2024-09-22T08:52:38.386674+0000","last_clean":"2024-09-22T08:52:38.386674+0000","last_became_active":"2024-09-22T08:15:08.969373+0000","last_became_peered":"2024-09-22T08:15:08.969373+0000","last_unstale":"2024-09-22T08:52:38.386674+0000","last_undegraded":"2024-09-22T08:52:38.386674+0000","last_fullsized":"2024-09-22T08:52:38.386674+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:47:22.188961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"263'106","reported_seq":641,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.751986+0000","last_change":"2024-09-22T08:15:10.986552+0000","last_active":"2024-09-22T08:55:19.751986+0000","last_peered":"2024-09-22T08:55:19.751986+0000","last_clean":"2024-09-22T08:55:19.751986+0000","last_became_active":"2024-09-22T08:15:10.984232+0000","last_became_peered":"2024-09-22T08:15:10.984232+0000","last_unstale":"2024-09-22T08:55:19.751986+0000","last_undegraded":"2024-09-22T08:55:19.751986+0000","last_fullsized":"2024-09-22T08:55:19.751986+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:21.636103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":116,"num_write":82,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"263'792","reported_seq":2214,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.233603+0000","last_change":"2024-09-22T08:15:13.008717+0000","last_active":"2024-09-22T08:56:16.233603+0000","last_peered":"2024-09-22T08:56:16.233603+0000","last_clean":"2024-09-22T08:56:16.233603+0000","last_became_active":"2024-09-22T08:15:13.008027+0000","last_became_peered":"2024-09-22T08:15:13.008027+0000","last_unstale":"2024-09-22T08:56:16.233603+0000","last_undegraded":"2024-09-22T08:56:16.233603+0000","last_fullsized":"2024-09-22T08:56:16.233603+0000","mapping_epoch":31,"log_start":"263'701","ondisk_log_start":"263'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":701,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:47:23.567624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"263'198","reported_seq":712,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:51.192463+0000","last_change":"2024-09-22T08:15:15.014730+0000","last_active":"2024-09-22T08:53:51.192463+0000","last_peered":"2024-09-22T08:53:51.192463+0000","last_clean":"2024-09-22T08:53:51.192463+0000","last_became_active":"2024-09-22T08:15:15.014423+0000","last_became_peered":"2024-09-22T08:15:15.014423+0000","last_unstale":"2024-09-22T08:53:51.192463+0000","last_undegraded":"2024-09-22T08:53:51.192463+0000","last_fullsized":"2024-09-22T08:53:51.192463+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:25:32.708147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":250,"num_read_kb":232,"num_write":460,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"263'500","reported_seq":2069,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:30.332020+0000","last_change":"2024-09-22T08:56:30.332020+0000","last_active":"2024-09-22T08:56:30.332020+0000","last_peered":"2024-09-22T08:56:30.332020+0000","last_clean":"2024-09-22T08:56:30.332020+0000","last_became_active":"2024-09-22T08:15:06.968153+0000","last_became_peered":"2024-09-22T08:15:06.968153+0000","last_unstale":"2024-09-22T08:56:30.332020+0000","last_undegraded":"2024-09-22T08:56:30.332020+0000","last_fullsized":"2024-09-22T08:56:30.332020+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'500","last_scrub_stamp":"2024-09-22T08:56:30.331876+0000","last_deep_scrub":"263'500","last_deep_scrub_stamp":"2024-09-22T08:56:30.331876+0000","last_clean_scrub_stamp":"2024-09-22T08:56:30.331876+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:12:28.407646+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2565,"num_read_kb":2386,"num_write":597,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"263'200","reported_seq":826,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:24.516850+0000","last_change":"2024-09-22T08:56:24.516850+0000","last_active":"2024-09-22T08:56:24.516850+0000","last_peered":"2024-09-22T08:56:24.516850+0000","last_clean":"2024-09-22T08:56:24.516850+0000","last_became_active":"2024-09-22T08:15:04.943901+0000","last_became_peered":"2024-09-22T08:15:04.943901+0000","last_unstale":"2024-09-22T08:56:24.516850+0000","last_undegraded":"2024-09-22T08:56:24.516850+0000","last_fullsized":"2024-09-22T08:56:24.516850+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'200","last_scrub_stamp":"2024-09-22T08:56:24.516736+0000","last_deep_scrub":"263'200","last_deep_scrub_stamp":"2024-09-22T08:56:24.516736+0000","last_clean_scrub_stamp":"2024-09-22T08:56:24.516736+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:25:37.932151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":512,"num_read_kb":4964,"num_write":959,"num_write_kb":21539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:26.935540+0000","last_change":"2024-09-22T08:56:26.935540+0000","last_active":"2024-09-22T08:56:26.935540+0000","last_peered":"2024-09-22T08:56:26.935540+0000","last_clean":"2024-09-22T08:56:26.935540+0000","last_became_active":"2024-09-22T08:14:55.585485+0000","last_became_peered":"2024-09-22T08:14:55.585485+0000","last_unstale":"2024-09-22T08:56:26.935540+0000","last_undegraded":"2024-09-22T08:56:26.935540+0000","last_fullsized":"2024-09-22T08:56:26.935540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:26.935425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:26.935425+0000","last_clean_scrub_stamp":"2024-09-22T08:56:26.935425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:24:27.484352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012642249999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:41.758786+0000","last_change":"2024-09-22T08:56:41.758786+0000","last_active":"2024-09-22T08:56:41.758786+0000","last_peered":"2024-09-22T08:56:41.758786+0000","last_clean":"2024-09-22T08:56:41.758786+0000","last_became_active":"2024-09-22T08:15:08.979291+0000","last_became_peered":"2024-09-22T08:15:08.979291+0000","last_unstale":"2024-09-22T08:56:41.758786+0000","last_undegraded":"2024-09-22T08:56:41.758786+0000","last_fullsized":"2024-09-22T08:56:41.758786+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:41.758704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:41.758704+0000","last_clean_scrub_stamp":"2024-09-22T08:56:41.758704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:27:55.044646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"263'326","reported_seq":1045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:41.481976+0000","last_change":"2024-09-22T08:56:41.481976+0000","last_active":"2024-09-22T08:56:41.481976+0000","last_peered":"2024-09-22T08:56:41.481976+0000","last_clean":"2024-09-22T08:56:41.481976+0000","last_became_active":"2024-09-22T08:15:10.979261+0000","last_became_peered":"2024-09-22T08:15:10.979261+0000","last_unstale":"2024-09-22T08:56:41.481976+0000","last_undegraded":"2024-09-22T08:56:41.481976+0000","last_fullsized":"2024-09-22T08:56:41.481976+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'326","last_scrub_stamp":"2024-09-22T08:56:41.481863+0000","last_deep_scrub":"263'326","last_deep_scrub_stamp":"2024-09-22T08:56:41.481863+0000","last_clean_scrub_stamp":"2024-09-22T08:56:41.481863+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:35:06.044679+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25829,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":462,"num_read_kb":686,"num_write":234,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:42.398292+0000","last_change":"2024-09-22T08:15:13.003662+0000","last_active":"2024-09-22T08:52:42.398292+0000","last_peered":"2024-09-22T08:52:42.398292+0000","last_clean":"2024-09-22T08:52:42.398292+0000","last_became_active":"2024-09-22T08:15:13.003041+0000","last_became_peered":"2024-09-22T08:15:13.003041+0000","last_unstale":"2024-09-22T08:52:42.398292+0000","last_undegraded":"2024-09-22T08:52:42.398292+0000","last_fullsized":"2024-09-22T08:52:42.398292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:43:46.552092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"263'126","reported_seq":624,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:09.125091+0000","last_change":"2024-09-22T08:15:15.015370+0000","last_active":"2024-09-22T08:54:09.125091+0000","last_peered":"2024-09-22T08:54:09.125091+0000","last_clean":"2024-09-22T08:54:09.125091+0000","last_became_active":"2024-09-22T08:15:15.014775+0000","last_became_peered":"2024-09-22T08:15:15.014775+0000","last_unstale":"2024-09-22T08:54:09.125091+0000","last_undegraded":"2024-09-22T08:54:09.125091+0000","last_fullsized":"2024-09-22T08:54:09.125091+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:42:57.977942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":162,"num_read_kb":158,"num_write":286,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"263'108","reported_seq":658,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.586531+0000","last_change":"2024-09-22T08:15:15.020963+0000","last_active":"2024-09-22T08:54:41.586531+0000","last_peered":"2024-09-22T08:54:41.586531+0000","last_clean":"2024-09-22T08:54:41.586531+0000","last_became_active":"2024-09-22T08:15:15.020653+0000","last_became_peered":"2024-09-22T08:15:15.020653+0000","last_unstale":"2024-09-22T08:54:41.586531+0000","last_undegraded":"2024-09-22T08:54:41.586531+0000","last_fullsized":"2024-09-22T08:54:41.586531+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:30:42.055327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":202,"num_read_kb":202,"num_write":258,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"263'491","reported_seq":2222,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:31.374754+0000","last_change":"2024-09-22T08:56:31.374754+0000","last_active":"2024-09-22T08:56:31.374754+0000","last_peered":"2024-09-22T08:56:31.374754+0000","last_clean":"2024-09-22T08:56:31.374754+0000","last_became_active":"2024-09-22T08:15:06.970382+0000","last_became_peered":"2024-09-22T08:15:06.970382+0000","last_unstale":"2024-09-22T08:56:31.374754+0000","last_undegraded":"2024-09-22T08:56:31.374754+0000","last_fullsized":"2024-09-22T08:56:31.374754+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'491","last_scrub_stamp":"2024-09-22T08:56:31.374652+0000","last_deep_scrub":"263'491","last_deep_scrub_stamp":"2024-09-22T08:56:31.374652+0000","last_clean_scrub_stamp":"2024-09-22T08:56:31.374652+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:29:57.099432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2792,"num_read_kb":2647,"num_write":560,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3043,"num_omap_keys":12,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"263'227","reported_seq":882,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:32.878958+0000","last_change":"2024-09-22T08:56:32.878958+0000","last_active":"2024-09-22T08:56:32.878958+0000","last_peered":"2024-09-22T08:56:32.878958+0000","last_clean":"2024-09-22T08:56:32.878958+0000","last_became_active":"2024-09-22T08:15:04.965572+0000","last_became_peered":"2024-09-22T08:15:04.965572+0000","last_unstale":"2024-09-22T08:56:32.878958+0000","last_undegraded":"2024-09-22T08:56:32.878958+0000","last_fullsized":"2024-09-22T08:56:32.878958+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'227","last_scrub_stamp":"2024-09-22T08:56:32.878823+0000","last_deep_scrub":"263'227","last_deep_scrub_stamp":"2024-09-22T08:56:32.878823+0000","last_clean_scrub_stamp":"2024-09-22T08:56:32.878823+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:10:43.868372+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":598,"num_read_kb":42984,"num_write":1013,"num_write_kb":35756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:40.519216+0000","last_change":"2024-09-22T08:56:40.519216+0000","last_active":"2024-09-22T08:56:40.519216+0000","last_peered":"2024-09-22T08:56:40.519216+0000","last_clean":"2024-09-22T08:56:40.519216+0000","last_became_active":"2024-09-22T08:15:08.976444+0000","last_became_peered":"2024-09-22T08:15:08.976444+0000","last_unstale":"2024-09-22T08:56:40.519216+0000","last_undegraded":"2024-09-22T08:56:40.519216+0000","last_fullsized":"2024-09-22T08:56:40.519216+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:40.519119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:40.519119+0000","last_clean_scrub_stamp":"2024-09-22T08:56:40.519119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:33:04.166853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"263'133","reported_seq":699,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.383600+0000","last_change":"2024-09-22T08:15:10.987944+0000","last_active":"2024-09-22T08:56:16.383600+0000","last_peered":"2024-09-22T08:56:16.383600+0000","last_clean":"2024-09-22T08:56:16.383600+0000","last_became_active":"2024-09-22T08:15:10.987623+0000","last_became_peered":"2024-09-22T08:15:10.987623+0000","last_unstale":"2024-09-22T08:56:16.383600+0000","last_undegraded":"2024-09-22T08:56:16.383600+0000","last_fullsized":"2024-09-22T08:56:16.383600+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:57:31.114053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8761,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":170,"num_read_kb":207,"num_write":88,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:32.283704+0000","last_change":"2024-09-22T08:15:12.997719+0000","last_active":"2024-09-22T08:52:32.283704+0000","last_peered":"2024-09-22T08:52:32.283704+0000","last_clean":"2024-09-22T08:52:32.283704+0000","last_became_active":"2024-09-22T08:15:12.997350+0000","last_became_peered":"2024-09-22T08:15:12.997350+0000","last_unstale":"2024-09-22T08:52:32.283704+0000","last_undegraded":"2024-09-22T08:52:32.283704+0000","last_fullsized":"2024-09-22T08:52:32.283704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:08:30.511917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"263'110","reported_seq":606,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.956370+0000","last_change":"2024-09-22T08:15:15.017170+0000","last_active":"2024-09-22T08:54:27.956370+0000","last_peered":"2024-09-22T08:54:27.956370+0000","last_clean":"2024-09-22T08:54:27.956370+0000","last_became_active":"2024-09-22T08:15:15.016918+0000","last_became_peered":"2024-09-22T08:15:15.016918+0000","last_unstale":"2024-09-22T08:54:27.956370+0000","last_undegraded":"2024-09-22T08:54:27.956370+0000","last_fullsized":"2024-09-22T08:54:27.956370+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:37:28.672486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":125,"num_write":254,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"263'1038","reported_seq":2829,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:33.664223+0000","last_change":"2024-09-22T08:56:33.664223+0000","last_active":"2024-09-22T08:56:33.664223+0000","last_peered":"2024-09-22T08:56:33.664223+0000","last_clean":"2024-09-22T08:56:33.664223+0000","last_became_active":"2024-09-22T08:15:06.965465+0000","last_became_peered":"2024-09-22T08:15:06.965465+0000","last_unstale":"2024-09-22T08:56:33.664223+0000","last_undegraded":"2024-09-22T08:56:33.664223+0000","last_fullsized":"2024-09-22T08:56:33.664223+0000","mapping_epoch":25,"log_start":"263'1000","ondisk_log_start":"263'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1038","last_scrub_stamp":"2024-09-22T08:56:33.664132+0000","last_deep_scrub":"263'1038","last_deep_scrub_stamp":"2024-09-22T08:56:33.664132+0000","last_clean_scrub_stamp":"2024-09-22T08:56:33.664132+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":1000,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:46:03.562471+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5105,"num_read_kb":4580,"num_write":1460,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"263'210","reported_seq":836,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:27.467279+0000","last_change":"2024-09-22T08:56:27.467279+0000","last_active":"2024-09-22T08:56:27.467279+0000","last_peered":"2024-09-22T08:56:27.467279+0000","last_clean":"2024-09-22T08:56:27.467279+0000","last_became_active":"2024-09-22T08:15:04.949181+0000","last_became_peered":"2024-09-22T08:15:04.949181+0000","last_unstale":"2024-09-22T08:56:27.467279+0000","last_undegraded":"2024-09-22T08:56:27.467279+0000","last_fullsized":"2024-09-22T08:56:27.467279+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'210","last_scrub_stamp":"2024-09-22T08:56:27.467159+0000","last_deep_scrub":"263'210","last_deep_scrub_stamp":"2024-09-22T08:56:27.467159+0000","last_clean_scrub_stamp":"2024-09-22T08:56:27.467159+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:15:11.987517+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":538,"num_read_kb":11766,"num_write":957,"num_write_kb":45959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:32.396743+0000","last_change":"2024-09-22T08:15:08.976023+0000","last_active":"2024-09-22T08:52:32.396743+0000","last_peered":"2024-09-22T08:52:32.396743+0000","last_clean":"2024-09-22T08:52:32.396743+0000","last_became_active":"2024-09-22T08:15:08.975704+0000","last_became_peered":"2024-09-22T08:15:08.975704+0000","last_unstale":"2024-09-22T08:52:32.396743+0000","last_undegraded":"2024-09-22T08:52:32.396743+0000","last_fullsized":"2024-09-22T08:52:32.396743+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:17:14.568660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"263'38","reported_seq":538,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.550720+0000","last_change":"2024-09-22T08:15:10.983890+0000","last_active":"2024-09-22T08:55:19.550720+0000","last_peered":"2024-09-22T08:55:19.550720+0000","last_clean":"2024-09-22T08:55:19.550720+0000","last_became_active":"2024-09-22T08:15:10.983593+0000","last_became_peered":"2024-09-22T08:15:10.983593+0000","last_unstale":"2024-09-22T08:55:19.550720+0000","last_undegraded":"2024-09-22T08:55:19.550720+0000","last_fullsized":"2024-09-22T08:55:19.550720+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:52:12.816398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:36.262497+0000","last_change":"2024-09-22T08:15:13.019365+0000","last_active":"2024-09-22T08:52:36.262497+0000","last_peered":"2024-09-22T08:52:36.262497+0000","last_clean":"2024-09-22T08:52:36.262497+0000","last_became_active":"2024-09-22T08:15:13.019020+0000","last_became_peered":"2024-09-22T08:15:13.019020+0000","last_unstale":"2024-09-22T08:52:36.262497+0000","last_undegraded":"2024-09-22T08:52:36.262497+0000","last_fullsized":"2024-09-22T08:52:36.262497+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:35:35.235215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"263'182","reported_seq":702,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:40.942611+0000","last_change":"2024-09-22T08:15:15.013674+0000","last_active":"2024-09-22T08:54:40.942611+0000","last_peered":"2024-09-22T08:54:40.942611+0000","last_clean":"2024-09-22T08:54:40.942611+0000","last_became_active":"2024-09-22T08:15:15.013300+0000","last_became_peered":"2024-09-22T08:15:15.013300+0000","last_unstale":"2024-09-22T08:54:40.942611+0000","last_undegraded":"2024-09-22T08:54:40.942611+0000","last_fullsized":"2024-09-22T08:54:40.942611+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:24:00.672977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":337,"num_read_kb":325,"num_write":401,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"263'1201","reported_seq":2848,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:32.645335+0000","last_change":"2024-09-22T08:56:32.645335+0000","last_active":"2024-09-22T08:56:32.645335+0000","last_peered":"2024-09-22T08:56:32.645335+0000","last_clean":"2024-09-22T08:56:32.645335+0000","last_became_active":"2024-09-22T08:15:06.957116+0000","last_became_peered":"2024-09-22T08:15:06.957116+0000","last_unstale":"2024-09-22T08:56:32.645335+0000","last_undegraded":"2024-09-22T08:56:32.645335+0000","last_fullsized":"2024-09-22T08:56:32.645335+0000","mapping_epoch":25,"log_start":"263'1100","ondisk_log_start":"263'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1201","last_scrub_stamp":"2024-09-22T08:56:32.645252+0000","last_deep_scrub":"263'1201","last_deep_scrub_stamp":"2024-09-22T08:56:32.645252+0000","last_clean_scrub_stamp":"2024-09-22T08:56:32.645252+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":1100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:00:07.106550+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5635,"num_read_kb":5002,"num_write":1685,"num_write_kb":733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":434,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"263'193","reported_seq":815,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:25.336972+0000","last_change":"2024-09-22T08:56:25.336972+0000","last_active":"2024-09-22T08:56:25.336972+0000","last_peered":"2024-09-22T08:56:25.336972+0000","last_clean":"2024-09-22T08:56:25.336972+0000","last_became_active":"2024-09-22T08:15:04.968557+0000","last_became_peered":"2024-09-22T08:15:04.968557+0000","last_unstale":"2024-09-22T08:56:25.336972+0000","last_undegraded":"2024-09-22T08:56:25.336972+0000","last_fullsized":"2024-09-22T08:56:25.336972+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'193","last_scrub_stamp":"2024-09-22T08:56:25.336860+0000","last_deep_scrub":"263'193","last_deep_scrub_stamp":"2024-09-22T08:56:25.336860+0000","last_clean_scrub_stamp":"2024-09-22T08:56:25.336860+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:20:48.349873+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079920,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":520,"num_read_kb":8164,"num_write":864,"num_write_kb":39531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:36.418210+0000","last_change":"2024-09-22T08:56:36.418210+0000","last_active":"2024-09-22T08:56:36.418210+0000","last_peered":"2024-09-22T08:56:36.418210+0000","last_clean":"2024-09-22T08:56:36.418210+0000","last_became_active":"2024-09-22T08:15:08.975001+0000","last_became_peered":"2024-09-22T08:15:08.975001+0000","last_unstale":"2024-09-22T08:56:36.418210+0000","last_undegraded":"2024-09-22T08:56:36.418210+0000","last_fullsized":"2024-09-22T08:56:36.418210+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:36.418114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:36.418114+0000","last_clean_scrub_stamp":"2024-09-22T08:56:36.418114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:03:22.345130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"263'173","reported_seq":771,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:39.158193+0000","last_change":"2024-09-22T08:56:39.158193+0000","last_active":"2024-09-22T08:56:39.158193+0000","last_peered":"2024-09-22T08:56:39.158193+0000","last_clean":"2024-09-22T08:56:39.158193+0000","last_became_active":"2024-09-22T08:15:10.980443+0000","last_became_peered":"2024-09-22T08:15:10.980443+0000","last_unstale":"2024-09-22T08:56:39.158193+0000","last_undegraded":"2024-09-22T08:56:39.158193+0000","last_fullsized":"2024-09-22T08:56:39.158193+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'173","last_scrub_stamp":"2024-09-22T08:56:39.158047+0000","last_deep_scrub":"263'173","last_deep_scrub_stamp":"2024-09-22T08:56:39.158047+0000","last_clean_scrub_stamp":"2024-09-22T08:56:39.158047+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:42:11.473386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":222,"num_read_kb":300,"num_write":124,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:33.385632+0000","last_change":"2024-09-22T08:15:13.010967+0000","last_active":"2024-09-22T08:52:33.385632+0000","last_peered":"2024-09-22T08:52:33.385632+0000","last_clean":"2024-09-22T08:52:33.385632+0000","last_became_active":"2024-09-22T08:15:13.010660+0000","last_became_peered":"2024-09-22T08:15:13.010660+0000","last_unstale":"2024-09-22T08:52:33.385632+0000","last_undegraded":"2024-09-22T08:52:33.385632+0000","last_fullsized":"2024-09-22T08:52:33.385632+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:04:33.172378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"263'141","reported_seq":674,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:23.390425+0000","last_change":"2024-09-22T08:15:15.015966+0000","last_active":"2024-09-22T08:54:23.390425+0000","last_peered":"2024-09-22T08:54:23.390425+0000","last_clean":"2024-09-22T08:54:23.390425+0000","last_became_active":"2024-09-22T08:15:15.015497+0000","last_became_peered":"2024-09-22T08:15:15.015497+0000","last_unstale":"2024-09-22T08:54:23.390425+0000","last_undegraded":"2024-09-22T08:54:23.390425+0000","last_fullsized":"2024-09-22T08:54:23.390425+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:19:47.834057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":885,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":300,"num_read_kb":272,"num_write":341,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"263'918","reported_seq":2772,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:29.082934+0000","last_change":"2024-09-22T08:56:29.082934+0000","last_active":"2024-09-22T08:56:29.082934+0000","last_peered":"2024-09-22T08:56:29.082934+0000","last_clean":"2024-09-22T08:56:29.082934+0000","last_became_active":"2024-09-22T08:15:06.964082+0000","last_became_peered":"2024-09-22T08:15:06.964082+0000","last_unstale":"2024-09-22T08:56:29.082934+0000","last_undegraded":"2024-09-22T08:56:29.082934+0000","last_fullsized":"2024-09-22T08:56:29.082934+0000","mapping_epoch":25,"log_start":"263'900","ondisk_log_start":"263'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'918","last_scrub_stamp":"2024-09-22T08:56:29.082837+0000","last_deep_scrub":"263'918","last_deep_scrub_stamp":"2024-09-22T08:56:29.082837+0000","last_clean_scrub_stamp":"2024-09-22T08:56:29.082837+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":900,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:49:15.428214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4594,"num_read_kb":4173,"num_write":1193,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2260,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"263'260","reported_seq":894,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:24.453691+0000","last_change":"2024-09-22T08:56:24.453691+0000","last_active":"2024-09-22T08:56:24.453691+0000","last_peered":"2024-09-22T08:56:24.453691+0000","last_clean":"2024-09-22T08:56:24.453691+0000","last_became_active":"2024-09-22T08:15:04.954431+0000","last_became_peered":"2024-09-22T08:15:04.954431+0000","last_unstale":"2024-09-22T08:56:24.453691+0000","last_undegraded":"2024-09-22T08:56:24.453691+0000","last_fullsized":"2024-09-22T08:56:24.453691+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'260","last_scrub_stamp":"2024-09-22T08:56:24.453598+0000","last_deep_scrub":"263'260","last_deep_scrub_stamp":"2024-09-22T08:56:24.453598+0000","last_clean_scrub_stamp":"2024-09-22T08:56:24.453598+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:11:53.936014+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":625,"num_read_kb":10749,"num_write":1043,"num_write_kb":36368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:28.385312+0000","last_change":"2024-09-22T08:15:08.978366+0000","last_active":"2024-09-22T08:52:28.385312+0000","last_peered":"2024-09-22T08:52:28.385312+0000","last_clean":"2024-09-22T08:52:28.385312+0000","last_became_active":"2024-09-22T08:15:08.978080+0000","last_became_peered":"2024-09-22T08:15:08.978080+0000","last_unstale":"2024-09-22T08:52:28.385312+0000","last_undegraded":"2024-09-22T08:52:28.385312+0000","last_fullsized":"2024-09-22T08:52:28.385312+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:58:42.395174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"263'139","reported_seq":710,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:43.442127+0000","last_change":"2024-09-22T08:56:43.442127+0000","last_active":"2024-09-22T08:56:43.442127+0000","last_peered":"2024-09-22T08:56:43.442127+0000","last_clean":"2024-09-22T08:56:43.442127+0000","last_became_active":"2024-09-22T08:15:10.975066+0000","last_became_peered":"2024-09-22T08:15:10.975066+0000","last_unstale":"2024-09-22T08:56:43.442127+0000","last_undegraded":"2024-09-22T08:56:43.442127+0000","last_fullsized":"2024-09-22T08:56:43.442127+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'139","last_scrub_stamp":"2024-09-22T08:56:43.442026+0000","last_deep_scrub":"263'139","last_deep_scrub_stamp":"2024-09-22T08:56:43.442026+0000","last_clean_scrub_stamp":"2024-09-22T08:56:43.442026+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:13:39.485401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4721,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":157,"num_read_kb":223,"num_write":80,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:32.283752+0000","last_change":"2024-09-22T08:15:13.008345+0000","last_active":"2024-09-22T08:52:32.283752+0000","last_peered":"2024-09-22T08:52:32.283752+0000","last_clean":"2024-09-22T08:52:32.283752+0000","last_became_active":"2024-09-22T08:15:13.008005+0000","last_became_peered":"2024-09-22T08:15:13.008005+0000","last_unstale":"2024-09-22T08:52:32.283752+0000","last_undegraded":"2024-09-22T08:52:32.283752+0000","last_fullsized":"2024-09-22T08:52:32.283752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:44:00.256968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"263'386","reported_seq":1910,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:19.614767+0000","last_change":"2024-09-22T08:15:06.974360+0000","last_active":"2024-09-22T08:54:19.614767+0000","last_peered":"2024-09-22T08:54:19.614767+0000","last_clean":"2024-09-22T08:54:19.614767+0000","last_became_active":"2024-09-22T08:15:06.974083+0000","last_became_peered":"2024-09-22T08:15:06.974083+0000","last_unstale":"2024-09-22T08:54:19.614767+0000","last_undegraded":"2024-09-22T08:54:19.614767+0000","last_fullsized":"2024-09-22T08:54:19.614767+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:42:23.068549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2095,"num_read_kb":2009,"num_write":415,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"263'220","reported_seq":862,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:30.421662+0000","last_change":"2024-09-22T08:56:30.421662+0000","last_active":"2024-09-22T08:56:30.421662+0000","last_peered":"2024-09-22T08:56:30.421662+0000","last_clean":"2024-09-22T08:56:30.421662+0000","last_became_active":"2024-09-22T08:15:04.953371+0000","last_became_peered":"2024-09-22T08:15:04.953371+0000","last_unstale":"2024-09-22T08:56:30.421662+0000","last_undegraded":"2024-09-22T08:56:30.421662+0000","last_fullsized":"2024-09-22T08:56:30.421662+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'220","last_scrub_stamp":"2024-09-22T08:56:30.421545+0000","last_deep_scrub":"263'220","last_deep_scrub_stamp":"2024-09-22T08:56:30.421545+0000","last_clean_scrub_stamp":"2024-09-22T08:56:30.421545+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:22:31.706556+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079956,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":551,"num_read_kb":20845,"num_write":984,"num_write_kb":34041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:41.502715+0000","last_change":"2024-09-22T08:56:41.502715+0000","last_active":"2024-09-22T08:56:41.502715+0000","last_peered":"2024-09-22T08:56:41.502715+0000","last_clean":"2024-09-22T08:56:41.502715+0000","last_became_active":"2024-09-22T08:15:08.977975+0000","last_became_peered":"2024-09-22T08:15:08.977975+0000","last_unstale":"2024-09-22T08:56:41.502715+0000","last_undegraded":"2024-09-22T08:56:41.502715+0000","last_fullsized":"2024-09-22T08:56:41.502715+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:41.502631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:41.502631+0000","last_clean_scrub_stamp":"2024-09-22T08:56:41.502631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:47:58.395562+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"263'212","reported_seq":832,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.526285+0000","last_change":"2024-09-22T08:15:10.985792+0000","last_active":"2024-09-22T08:56:16.526285+0000","last_peered":"2024-09-22T08:56:16.526285+0000","last_clean":"2024-09-22T08:56:16.526285+0000","last_became_active":"2024-09-22T08:15:10.985454+0000","last_became_peered":"2024-09-22T08:15:10.985454+0000","last_unstale":"2024-09-22T08:56:16.526285+0000","last_undegraded":"2024-09-22T08:56:16.526285+0000","last_fullsized":"2024-09-22T08:56:16.526285+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:42:16.011379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24540,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":311,"num_read_kb":482,"num_write":196,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:46.263744+0000","last_change":"2024-09-22T08:15:13.008746+0000","last_active":"2024-09-22T08:52:46.263744+0000","last_peered":"2024-09-22T08:52:46.263744+0000","last_clean":"2024-09-22T08:52:46.263744+0000","last_became_active":"2024-09-22T08:15:13.008080+0000","last_became_peered":"2024-09-22T08:15:13.008080+0000","last_unstale":"2024-09-22T08:52:46.263744+0000","last_undegraded":"2024-09-22T08:52:46.263744+0000","last_fullsized":"2024-09-22T08:52:46.263744+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:40:33.932227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"263'174","reported_seq":680,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.958769+0000","last_change":"2024-09-22T08:15:15.014411+0000","last_active":"2024-09-22T08:54:27.958769+0000","last_peered":"2024-09-22T08:54:27.958769+0000","last_clean":"2024-09-22T08:54:27.958769+0000","last_became_active":"2024-09-22T08:15:15.014112+0000","last_became_peered":"2024-09-22T08:15:15.014112+0000","last_unstale":"2024-09-22T08:54:27.958769+0000","last_undegraded":"2024-09-22T08:54:27.958769+0000","last_fullsized":"2024-09-22T08:54:27.958769+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:23:12.522068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":264,"num_read_kb":269,"num_write":416,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"263'433","reported_seq":2047,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:35.716040+0000","last_change":"2024-09-22T08:56:35.716040+0000","last_active":"2024-09-22T08:56:35.716040+0000","last_peered":"2024-09-22T08:56:35.716040+0000","last_clean":"2024-09-22T08:56:35.716040+0000","last_became_active":"2024-09-22T08:15:06.966715+0000","last_became_peered":"2024-09-22T08:15:06.966715+0000","last_unstale":"2024-09-22T08:56:35.716040+0000","last_undegraded":"2024-09-22T08:56:35.716040+0000","last_fullsized":"2024-09-22T08:56:35.716040+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'433","last_scrub_stamp":"2024-09-22T08:56:35.715956+0000","last_deep_scrub":"263'433","last_deep_scrub_stamp":"2024-09-22T08:56:35.715956+0000","last_clean_scrub_stamp":"2024-09-22T08:56:35.715956+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:36:50.835174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2445,"num_read_kb":2324,"num_write":493,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"263'214","reported_seq":886,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:28.519902+0000","last_change":"2024-09-22T08:56:28.519902+0000","last_active":"2024-09-22T08:56:28.519902+0000","last_peered":"2024-09-22T08:56:28.519902+0000","last_clean":"2024-09-22T08:56:28.519902+0000","last_became_active":"2024-09-22T08:15:04.950890+0000","last_became_peered":"2024-09-22T08:15:04.950890+0000","last_unstale":"2024-09-22T08:56:28.519902+0000","last_undegraded":"2024-09-22T08:56:28.519902+0000","last_fullsized":"2024-09-22T08:56:28.519902+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'214","last_scrub_stamp":"2024-09-22T08:56:28.519814+0000","last_deep_scrub":"263'214","last_deep_scrub_stamp":"2024-09-22T08:56:28.519814+0000","last_clean_scrub_stamp":"2024-09-22T08:56:28.519814+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:35:12.489475+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":625,"num_read_kb":94909,"num_write":959,"num_write_kb":40287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"263'5","reported_seq":982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:40.392284+0000","last_change":"2024-09-22T08:56:40.392284+0000","last_active":"2024-09-22T08:56:40.392284+0000","last_peered":"2024-09-22T08:56:40.392284+0000","last_clean":"2024-09-22T08:56:40.392284+0000","last_became_active":"2024-09-22T08:15:08.977250+0000","last_became_peered":"2024-09-22T08:15:08.977250+0000","last_unstale":"2024-09-22T08:56:40.392284+0000","last_undegraded":"2024-09-22T08:56:40.392284+0000","last_fullsized":"2024-09-22T08:56:40.392284+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-22T08:56:40.392200+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-22T08:56:40.392200+0000","last_clean_scrub_stamp":"2024-09-22T08:56:40.392200+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:58:39.531528+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":1187,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"263'169","reported_seq":750,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.552982+0000","last_change":"2024-09-22T08:15:10.988286+0000","last_active":"2024-09-22T08:56:16.552982+0000","last_peered":"2024-09-22T08:56:16.552982+0000","last_clean":"2024-09-22T08:56:16.552982+0000","last_became_active":"2024-09-22T08:15:10.987541+0000","last_became_peered":"2024-09-22T08:15:10.987541+0000","last_unstale":"2024-09-22T08:56:16.552982+0000","last_undegraded":"2024-09-22T08:56:16.552982+0000","last_fullsized":"2024-09-22T08:56:16.552982+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:03:59.129935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":217,"num_read_kb":244,"num_write":140,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:42.275936+0000","last_change":"2024-09-22T08:15:13.012164+0000","last_active":"2024-09-22T08:52:42.275936+0000","last_peered":"2024-09-22T08:52:42.275936+0000","last_clean":"2024-09-22T08:52:42.275936+0000","last_became_active":"2024-09-22T08:15:13.011781+0000","last_became_peered":"2024-09-22T08:15:13.011781+0000","last_unstale":"2024-09-22T08:52:42.275936+0000","last_undegraded":"2024-09-22T08:52:42.275936+0000","last_fullsized":"2024-09-22T08:52:42.275936+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:36:44.769092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"263'184","reported_seq":694,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:01.978766+0000","last_change":"2024-09-22T08:15:15.011928+0000","last_active":"2024-09-22T08:56:01.978766+0000","last_peered":"2024-09-22T08:56:01.978766+0000","last_clean":"2024-09-22T08:56:01.978766+0000","last_became_active":"2024-09-22T08:15:15.011648+0000","last_became_peered":"2024-09-22T08:15:15.011648+0000","last_unstale":"2024-09-22T08:56:01.978766+0000","last_undegraded":"2024-09-22T08:56:01.978766+0000","last_fullsized":"2024-09-22T08:56:01.978766+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:40:53.969713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":287,"num_read_kb":275,"num_write":539,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"263'439","reported_seq":1960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:30.084801+0000","last_change":"2024-09-22T08:56:30.084801+0000","last_active":"2024-09-22T08:56:30.084801+0000","last_peered":"2024-09-22T08:56:30.084801+0000","last_clean":"2024-09-22T08:56:30.084801+0000","last_became_active":"2024-09-22T08:15:06.972213+0000","last_became_peered":"2024-09-22T08:15:06.972213+0000","last_unstale":"2024-09-22T08:56:30.084801+0000","last_undegraded":"2024-09-22T08:56:30.084801+0000","last_fullsized":"2024-09-22T08:56:30.084801+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'439","last_scrub_stamp":"2024-09-22T08:56:30.084696+0000","last_deep_scrub":"263'439","last_deep_scrub_stamp":"2024-09-22T08:56:30.084696+0000","last_clean_scrub_stamp":"2024-09-22T08:56:30.084696+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:43:42.820968+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2524,"num_read_kb":2354,"num_write":541,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"263'246","reported_seq":887,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:28.829400+0000","last_change":"2024-09-22T08:56:28.829400+0000","last_active":"2024-09-22T08:56:28.829400+0000","last_peered":"2024-09-22T08:56:28.829400+0000","last_clean":"2024-09-22T08:56:28.829400+0000","last_became_active":"2024-09-22T08:15:04.959607+0000","last_became_peered":"2024-09-22T08:15:04.959607+0000","last_unstale":"2024-09-22T08:56:28.829400+0000","last_undegraded":"2024-09-22T08:56:28.829400+0000","last_fullsized":"2024-09-22T08:56:28.829400+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'246","last_scrub_stamp":"2024-09-22T08:56:28.829299+0000","last_deep_scrub":"263'246","last_deep_scrub_stamp":"2024-09-22T08:56:28.829299+0000","last_clean_scrub_stamp":"2024-09-22T08:56:28.829299+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:55:16.910471+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079903,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":565,"num_read_kb":22702,"num_write":1145,"num_write_kb":43754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:39.435951+0000","last_change":"2024-09-22T08:56:39.435951+0000","last_active":"2024-09-22T08:56:39.435951+0000","last_peered":"2024-09-22T08:56:39.435951+0000","last_clean":"2024-09-22T08:56:39.435951+0000","last_became_active":"2024-09-22T08:15:08.974925+0000","last_became_peered":"2024-09-22T08:15:08.974925+0000","last_unstale":"2024-09-22T08:56:39.435951+0000","last_undegraded":"2024-09-22T08:56:39.435951+0000","last_fullsized":"2024-09-22T08:56:39.435951+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:39.435856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:39.435856+0000","last_clean_scrub_stamp":"2024-09-22T08:56:39.435856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:57:01.098449+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"263'148","reported_seq":716,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.421615+0000","last_change":"2024-09-22T08:15:10.985655+0000","last_active":"2024-09-22T08:56:16.421615+0000","last_peered":"2024-09-22T08:56:16.421615+0000","last_clean":"2024-09-22T08:56:16.421615+0000","last_became_active":"2024-09-22T08:15:10.985312+0000","last_became_peered":"2024-09-22T08:15:10.985312+0000","last_unstale":"2024-09-22T08:56:16.421615+0000","last_undegraded":"2024-09-22T08:56:16.421615+0000","last_fullsized":"2024-09-22T08:56:16.421615+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:32:30.326830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9037,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":176,"num_read_kb":231,"num_write":94,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:22.290600+0000","last_change":"2024-09-22T08:15:12.998592+0000","last_active":"2024-09-22T08:53:22.290600+0000","last_peered":"2024-09-22T08:53:22.290600+0000","last_clean":"2024-09-22T08:53:22.290600+0000","last_became_active":"2024-09-22T08:15:12.998276+0000","last_became_peered":"2024-09-22T08:15:12.998276+0000","last_unstale":"2024-09-22T08:53:22.290600+0000","last_undegraded":"2024-09-22T08:53:22.290600+0000","last_fullsized":"2024-09-22T08:53:22.290600+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:45:18.409944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"263'129","reported_seq":634,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:03.364497+0000","last_change":"2024-09-22T08:15:15.022528+0000","last_active":"2024-09-22T08:56:03.364497+0000","last_peered":"2024-09-22T08:56:03.364497+0000","last_clean":"2024-09-22T08:56:03.364497+0000","last_became_active":"2024-09-22T08:15:15.022140+0000","last_became_peered":"2024-09-22T08:15:15.022140+0000","last_unstale":"2024-09-22T08:56:03.364497+0000","last_undegraded":"2024-09-22T08:56:03.364497+0000","last_fullsized":"2024-09-22T08:56:03.364497+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:19:15.143722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":810,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":211,"num_read_kb":192,"num_write":312,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"263'535","reported_seq":2412,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:34.686230+0000","last_change":"2024-09-22T08:56:34.686230+0000","last_active":"2024-09-22T08:56:34.686230+0000","last_peered":"2024-09-22T08:56:34.686230+0000","last_clean":"2024-09-22T08:56:34.686230+0000","last_became_active":"2024-09-22T08:15:06.963136+0000","last_became_peered":"2024-09-22T08:15:06.963136+0000","last_unstale":"2024-09-22T08:56:34.686230+0000","last_undegraded":"2024-09-22T08:56:34.686230+0000","last_fullsized":"2024-09-22T08:56:34.686230+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'535","last_scrub_stamp":"2024-09-22T08:56:34.686122+0000","last_deep_scrub":"263'535","last_deep_scrub_stamp":"2024-09-22T08:56:34.686122+0000","last_clean_scrub_stamp":"2024-09-22T08:56:34.686122+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:49:11.708710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3196,"num_read_kb":3015,"num_write":651,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4595,"num_omap_keys":18,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"263'229","reported_seq":859,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:29.569012+0000","last_change":"2024-09-22T08:56:29.569012+0000","last_active":"2024-09-22T08:56:29.569012+0000","last_peered":"2024-09-22T08:56:29.569012+0000","last_clean":"2024-09-22T08:56:29.569012+0000","last_became_active":"2024-09-22T08:15:04.961731+0000","last_became_peered":"2024-09-22T08:15:04.961731+0000","last_unstale":"2024-09-22T08:56:29.569012+0000","last_undegraded":"2024-09-22T08:56:29.569012+0000","last_fullsized":"2024-09-22T08:56:29.569012+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'229","last_scrub_stamp":"2024-09-22T08:56:29.568904+0000","last_deep_scrub":"263'229","last_deep_scrub_stamp":"2024-09-22T08:56:29.568904+0000","last_clean_scrub_stamp":"2024-09-22T08:56:29.568904+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:54:11.861870+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079902,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":556,"num_read_kb":16778,"num_write":1039,"num_write_kb":35959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:42.398363+0000","last_change":"2024-09-22T08:15:08.974366+0000","last_active":"2024-09-22T08:52:42.398363+0000","last_peered":"2024-09-22T08:52:42.398363+0000","last_clean":"2024-09-22T08:52:42.398363+0000","last_became_active":"2024-09-22T08:15:08.973985+0000","last_became_peered":"2024-09-22T08:15:08.973985+0000","last_unstale":"2024-09-22T08:52:42.398363+0000","last_undegraded":"2024-09-22T08:52:42.398363+0000","last_fullsized":"2024-09-22T08:52:42.398363+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:43:10.742833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"263'91","reported_seq":611,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:19.764889+0000","last_change":"2024-09-22T08:15:10.991408+0000","last_active":"2024-09-22T08:55:19.764889+0000","last_peered":"2024-09-22T08:55:19.764889+0000","last_clean":"2024-09-22T08:55:19.764889+0000","last_became_active":"2024-09-22T08:15:10.991099+0000","last_became_peered":"2024-09-22T08:15:10.991099+0000","last_unstale":"2024-09-22T08:55:19.764889+0000","last_undegraded":"2024-09-22T08:55:19.764889+0000","last_fullsized":"2024-09-22T08:55:19.764889+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:03.952941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":117,"num_read_kb":110,"num_write":130,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"263'772","reported_seq":2290,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.227168+0000","last_change":"2024-09-22T08:15:13.020129+0000","last_active":"2024-09-22T08:56:16.227168+0000","last_peered":"2024-09-22T08:56:16.227168+0000","last_clean":"2024-09-22T08:56:16.227168+0000","last_became_active":"2024-09-22T08:15:13.018826+0000","last_became_peered":"2024-09-22T08:15:13.018826+0000","last_unstale":"2024-09-22T08:56:16.227168+0000","last_undegraded":"2024-09-22T08:56:16.227168+0000","last_fullsized":"2024-09-22T08:56:16.227168+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:17:45.964569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"263'136","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:22.688867+0000","last_change":"2024-09-22T08:15:15.017866+0000","last_active":"2024-09-22T08:54:22.688867+0000","last_peered":"2024-09-22T08:54:22.688867+0000","last_clean":"2024-09-22T08:54:22.688867+0000","last_became_active":"2024-09-22T08:15:15.017568+0000","last_became_peered":"2024-09-22T08:15:15.017568+0000","last_unstale":"2024-09-22T08:54:22.688867+0000","last_undegraded":"2024-09-22T08:54:22.688867+0000","last_fullsized":"2024-09-22T08:54:22.688867+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:37:11.451571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":178,"num_write":322,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"263'423","reported_seq":1885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:34.401957+0000","last_change":"2024-09-22T08:56:34.401957+0000","last_active":"2024-09-22T08:56:34.401957+0000","last_peered":"2024-09-22T08:56:34.401957+0000","last_clean":"2024-09-22T08:56:34.401957+0000","last_became_active":"2024-09-22T08:15:06.973142+0000","last_became_peered":"2024-09-22T08:15:06.973142+0000","last_unstale":"2024-09-22T08:56:34.401957+0000","last_undegraded":"2024-09-22T08:56:34.401957+0000","last_fullsized":"2024-09-22T08:56:34.401957+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'423","last_scrub_stamp":"2024-09-22T08:56:34.401862+0000","last_deep_scrub":"263'423","last_deep_scrub_stamp":"2024-09-22T08:56:34.401862+0000","last_clean_scrub_stamp":"2024-09-22T08:56:34.401862+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:31.696050+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2325,"num_read_kb":2186,"num_write":496,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"263'205","reported_seq":811,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:26.829391+0000","last_change":"2024-09-22T08:56:26.829391+0000","last_active":"2024-09-22T08:56:26.829391+0000","last_peered":"2024-09-22T08:56:26.829391+0000","last_clean":"2024-09-22T08:56:26.829391+0000","last_became_active":"2024-09-22T08:15:04.954608+0000","last_became_peered":"2024-09-22T08:15:04.954608+0000","last_unstale":"2024-09-22T08:56:26.829391+0000","last_undegraded":"2024-09-22T08:56:26.829391+0000","last_fullsized":"2024-09-22T08:56:26.829391+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'205","last_scrub_stamp":"2024-09-22T08:56:26.829288+0000","last_deep_scrub":"263'205","last_deep_scrub_stamp":"2024-09-22T08:56:26.829288+0000","last_clean_scrub_stamp":"2024-09-22T08:56:26.829288+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:41:04.364320+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":469,"num_read_kb":8602,"num_write":952,"num_write_kb":32105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:42.741012+0000","last_change":"2024-09-22T08:56:42.741012+0000","last_active":"2024-09-22T08:56:42.741012+0000","last_peered":"2024-09-22T08:56:42.741012+0000","last_clean":"2024-09-22T08:56:42.741012+0000","last_became_active":"2024-09-22T08:15:08.980570+0000","last_became_peered":"2024-09-22T08:15:08.980570+0000","last_unstale":"2024-09-22T08:56:42.741012+0000","last_undegraded":"2024-09-22T08:56:42.741012+0000","last_fullsized":"2024-09-22T08:56:42.741012+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:42.740930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:42.740930+0000","last_clean_scrub_stamp":"2024-09-22T08:56:42.740930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:12:39.016936+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"263'163","reported_seq":741,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.468746+0000","last_change":"2024-09-22T08:15:10.979788+0000","last_active":"2024-09-22T08:56:16.468746+0000","last_peered":"2024-09-22T08:56:16.468746+0000","last_clean":"2024-09-22T08:56:16.468746+0000","last_became_active":"2024-09-22T08:15:10.979384+0000","last_became_peered":"2024-09-22T08:15:10.979384+0000","last_unstale":"2024-09-22T08:56:16.468746+0000","last_undegraded":"2024-09-22T08:56:16.468746+0000","last_fullsized":"2024-09-22T08:56:16.468746+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10195,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":216,"num_read_kb":291,"num_write":126,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:52.407725+0000","last_change":"2024-09-22T08:15:13.013531+0000","last_active":"2024-09-22T08:53:52.407725+0000","last_peered":"2024-09-22T08:53:52.407725+0000","last_clean":"2024-09-22T08:53:52.407725+0000","last_became_active":"2024-09-22T08:15:13.013160+0000","last_became_peered":"2024-09-22T08:15:13.013160+0000","last_unstale":"2024-09-22T08:53:52.407725+0000","last_undegraded":"2024-09-22T08:53:52.407725+0000","last_fullsized":"2024-09-22T08:53:52.407725+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:55:35.021615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"263'138","reported_seq":640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.356176+0000","last_change":"2024-09-22T08:15:15.021053+0000","last_active":"2024-09-22T08:54:27.356176+0000","last_peered":"2024-09-22T08:54:27.356176+0000","last_clean":"2024-09-22T08:54:27.356176+0000","last_became_active":"2024-09-22T08:15:15.020718+0000","last_became_peered":"2024-09-22T08:15:15.020718+0000","last_unstale":"2024-09-22T08:54:27.356176+0000","last_undegraded":"2024-09-22T08:54:27.356176+0000","last_fullsized":"2024-09-22T08:54:27.356176+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":211,"num_read_kb":197,"num_write":330,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"263'802","reported_seq":2286,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:33.408278+0000","last_change":"2024-09-22T08:56:33.408278+0000","last_active":"2024-09-22T08:56:33.408278+0000","last_peered":"2024-09-22T08:56:33.408278+0000","last_clean":"2024-09-22T08:56:33.408278+0000","last_became_active":"2024-09-22T08:15:06.970077+0000","last_became_peered":"2024-09-22T08:15:06.970077+0000","last_unstale":"2024-09-22T08:56:33.408278+0000","last_undegraded":"2024-09-22T08:56:33.408278+0000","last_fullsized":"2024-09-22T08:56:33.408278+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'802","last_scrub_stamp":"2024-09-22T08:56:33.408180+0000","last_deep_scrub":"263'802","last_deep_scrub_stamp":"2024-09-22T08:56:33.408180+0000","last_clean_scrub_stamp":"2024-09-22T08:56:33.408180+0000","objects_scrubbed":2,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:56:18.098515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3751,"num_read_kb":3364,"num_write":1047,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":246,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"263'201","reported_seq":921,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:33.835418+0000","last_change":"2024-09-22T08:56:33.835418+0000","last_active":"2024-09-22T08:56:33.835418+0000","last_peered":"2024-09-22T08:56:33.835418+0000","last_clean":"2024-09-22T08:56:33.835418+0000","last_became_active":"2024-09-22T08:15:04.962268+0000","last_became_peered":"2024-09-22T08:15:04.962268+0000","last_unstale":"2024-09-22T08:56:33.835418+0000","last_undegraded":"2024-09-22T08:56:33.835418+0000","last_fullsized":"2024-09-22T08:56:33.835418+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'201","last_scrub_stamp":"2024-09-22T08:56:33.835307+0000","last_deep_scrub":"263'201","last_deep_scrub_stamp":"2024-09-22T08:56:33.835307+0000","last_clean_scrub_stamp":"2024-09-22T08:56:33.835307+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:26:01.851194+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":783,"num_read_kb":150382,"num_write":906,"num_write_kb":51576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:38.418270+0000","last_change":"2024-09-22T08:56:38.418270+0000","last_active":"2024-09-22T08:56:38.418270+0000","last_peered":"2024-09-22T08:56:38.418270+0000","last_clean":"2024-09-22T08:56:38.418270+0000","last_became_active":"2024-09-22T08:15:08.977341+0000","last_became_peered":"2024-09-22T08:15:08.977341+0000","last_unstale":"2024-09-22T08:56:38.418270+0000","last_undegraded":"2024-09-22T08:56:38.418270+0000","last_fullsized":"2024-09-22T08:56:38.418270+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:38.418178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:38.418178+0000","last_clean_scrub_stamp":"2024-09-22T08:56:38.418178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:49:39.605640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"263'127","reported_seq":692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.479118+0000","last_change":"2024-09-22T08:15:10.981034+0000","last_active":"2024-09-22T08:56:16.479118+0000","last_peered":"2024-09-22T08:56:16.479118+0000","last_clean":"2024-09-22T08:56:16.479118+0000","last_became_active":"2024-09-22T08:15:10.980015+0000","last_became_peered":"2024-09-22T08:15:10.980015+0000","last_unstale":"2024-09-22T08:56:16.479118+0000","last_undegraded":"2024-09-22T08:56:16.479118+0000","last_fullsized":"2024-09-22T08:56:16.479118+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:10:49.816903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20804,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":281,"num_write":88,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:58.396470+0000","last_change":"2024-09-22T08:15:13.012480+0000","last_active":"2024-09-22T08:53:58.396470+0000","last_peered":"2024-09-22T08:53:58.396470+0000","last_clean":"2024-09-22T08:53:58.396470+0000","last_became_active":"2024-09-22T08:15:13.011134+0000","last_became_peered":"2024-09-22T08:15:13.011134+0000","last_unstale":"2024-09-22T08:53:58.396470+0000","last_undegraded":"2024-09-22T08:53:58.396470+0000","last_fullsized":"2024-09-22T08:53:58.396470+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"263'150","reported_seq":671,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:41.477364+0000","last_change":"2024-09-22T08:15:15.013212+0000","last_active":"2024-09-22T08:54:41.477364+0000","last_peered":"2024-09-22T08:54:41.477364+0000","last_clean":"2024-09-22T08:54:41.477364+0000","last_became_active":"2024-09-22T08:15:15.012939+0000","last_became_peered":"2024-09-22T08:15:15.012939+0000","last_unstale":"2024-09-22T08:54:41.477364+0000","last_undegraded":"2024-09-22T08:54:41.477364+0000","last_fullsized":"2024-09-22T08:54:41.477364+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:08:40.354379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":256,"num_read_kb":247,"num_write":364,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"263'566","reported_seq":2368,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:31.058431+0000","last_change":"2024-09-22T08:56:31.058431+0000","last_active":"2024-09-22T08:56:31.058431+0000","last_peered":"2024-09-22T08:56:31.058431+0000","last_clean":"2024-09-22T08:56:31.058431+0000","last_became_active":"2024-09-22T08:15:06.960599+0000","last_became_peered":"2024-09-22T08:15:06.960599+0000","last_unstale":"2024-09-22T08:56:31.058431+0000","last_undegraded":"2024-09-22T08:56:31.058431+0000","last_fullsized":"2024-09-22T08:56:31.058431+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'566","last_scrub_stamp":"2024-09-22T08:56:31.058322+0000","last_deep_scrub":"263'566","last_deep_scrub_stamp":"2024-09-22T08:56:31.058322+0000","last_clean_scrub_stamp":"2024-09-22T08:56:31.058322+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":500,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:44:02.799881+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3136,"num_read_kb":2948,"num_write":673,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1214,"num_omap_keys":5,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"263'213","reported_seq":848,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:25.463224+0000","last_change":"2024-09-22T08:56:25.463224+0000","last_active":"2024-09-22T08:56:25.463224+0000","last_peered":"2024-09-22T08:56:25.463224+0000","last_clean":"2024-09-22T08:56:25.463224+0000","last_became_active":"2024-09-22T08:15:04.962785+0000","last_became_peered":"2024-09-22T08:15:04.962785+0000","last_unstale":"2024-09-22T08:56:25.463224+0000","last_undegraded":"2024-09-22T08:56:25.463224+0000","last_fullsized":"2024-09-22T08:56:25.463224+0000","mapping_epoch":23,"log_start":"263'201","ondisk_log_start":"263'201","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'213","last_scrub_stamp":"2024-09-22T08:56:25.463105+0000","last_deep_scrub":"263'213","last_deep_scrub_stamp":"2024-09-22T08:56:25.463105+0000","last_clean_scrub_stamp":"2024-09-22T08:56:25.463105+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":201,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:25.834921+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":497,"num_read_kb":22160,"num_write":848,"num_write_kb":45151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:36.732273+0000","last_change":"2024-09-22T08:56:36.732273+0000","last_active":"2024-09-22T08:56:36.732273+0000","last_peered":"2024-09-22T08:56:36.732273+0000","last_clean":"2024-09-22T08:56:36.732273+0000","last_became_active":"2024-09-22T08:15:08.978844+0000","last_became_peered":"2024-09-22T08:15:08.978844+0000","last_unstale":"2024-09-22T08:56:36.732273+0000","last_undegraded":"2024-09-22T08:56:36.732273+0000","last_fullsized":"2024-09-22T08:56:36.732273+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:36.732185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:36.732185+0000","last_clean_scrub_stamp":"2024-09-22T08:56:36.732185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:09:03.793067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"263'128","reported_seq":678,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.407905+0000","last_change":"2024-09-22T08:15:10.983840+0000","last_active":"2024-09-22T08:56:16.407905+0000","last_peered":"2024-09-22T08:56:16.407905+0000","last_clean":"2024-09-22T08:56:16.407905+0000","last_became_active":"2024-09-22T08:15:10.983522+0000","last_became_peered":"2024-09-22T08:15:10.983522+0000","last_unstale":"2024-09-22T08:56:16.407905+0000","last_undegraded":"2024-09-22T08:56:16.407905+0000","last_fullsized":"2024-09-22T08:56:16.407905+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:05:15.621827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62130,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":173,"num_read_kb":427,"num_write":104,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:43.387370+0000","last_change":"2024-09-22T08:15:13.015794+0000","last_active":"2024-09-22T08:52:43.387370+0000","last_peered":"2024-09-22T08:52:43.387370+0000","last_clean":"2024-09-22T08:52:43.387370+0000","last_became_active":"2024-09-22T08:15:13.015473+0000","last_became_peered":"2024-09-22T08:15:13.015473+0000","last_unstale":"2024-09-22T08:52:43.387370+0000","last_undegraded":"2024-09-22T08:52:43.387370+0000","last_fullsized":"2024-09-22T08:52:43.387370+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:45:01.160499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"263'213","reported_seq":1672,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:39.366065+0000","last_change":"2024-09-22T08:15:15.018252+0000","last_active":"2024-09-22T08:54:39.366065+0000","last_peered":"2024-09-22T08:54:39.366065+0000","last_clean":"2024-09-22T08:54:39.366065+0000","last_became_active":"2024-09-22T08:15:15.017394+0000","last_became_peered":"2024-09-22T08:15:15.017394+0000","last_unstale":"2024-09-22T08:54:39.366065+0000","last_undegraded":"2024-09-22T08:54:39.366065+0000","last_fullsized":"2024-09-22T08:54:39.366065+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1186,"num_read_kb":1185,"num_write":465,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"263'824","reported_seq":2527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:32.421909+0000","last_change":"2024-09-22T08:56:32.421909+0000","last_active":"2024-09-22T08:56:32.421909+0000","last_peered":"2024-09-22T08:56:32.421909+0000","last_clean":"2024-09-22T08:56:32.421909+0000","last_became_active":"2024-09-22T08:15:06.967603+0000","last_became_peered":"2024-09-22T08:15:06.967603+0000","last_unstale":"2024-09-22T08:56:32.421909+0000","last_undegraded":"2024-09-22T08:56:32.421909+0000","last_fullsized":"2024-09-22T08:56:32.421909+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'824","last_scrub_stamp":"2024-09-22T08:56:32.421797+0000","last_deep_scrub":"263'824","last_deep_scrub_stamp":"2024-09-22T08:56:32.421797+0000","last_clean_scrub_stamp":"2024-09-22T08:56:32.421797+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:35:50.459397+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4151,"num_read_kb":3787,"num_write":1085,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":251,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"263'211","reported_seq":882,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:27.464857+0000","last_change":"2024-09-22T08:56:27.464857+0000","last_active":"2024-09-22T08:56:27.464857+0000","last_peered":"2024-09-22T08:56:27.464857+0000","last_clean":"2024-09-22T08:56:27.464857+0000","last_became_active":"2024-09-22T08:15:04.957654+0000","last_became_peered":"2024-09-22T08:15:04.957654+0000","last_unstale":"2024-09-22T08:56:27.464857+0000","last_undegraded":"2024-09-22T08:56:27.464857+0000","last_fullsized":"2024-09-22T08:56:27.464857+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'211","last_scrub_stamp":"2024-09-22T08:56:27.464696+0000","last_deep_scrub":"263'211","last_deep_scrub_stamp":"2024-09-22T08:56:27.464696+0000","last_clean_scrub_stamp":"2024-09-22T08:56:27.464696+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:19:35.401370+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":592,"num_read_kb":25705,"num_write":948,"num_write_kb":45275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:57.408461+0000","last_change":"2024-09-22T08:15:08.973107+0000","last_active":"2024-09-22T08:53:57.408461+0000","last_peered":"2024-09-22T08:53:57.408461+0000","last_clean":"2024-09-22T08:53:57.408461+0000","last_became_active":"2024-09-22T08:15:08.972733+0000","last_became_peered":"2024-09-22T08:15:08.972733+0000","last_unstale":"2024-09-22T08:53:57.408461+0000","last_undegraded":"2024-09-22T08:53:57.408461+0000","last_fullsized":"2024-09-22T08:53:57.408461+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:07.945525+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.945525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:09:10.684801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"263'156","reported_seq":738,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.428241+0000","last_change":"2024-09-22T08:15:10.987881+0000","last_active":"2024-09-22T08:56:16.428241+0000","last_peered":"2024-09-22T08:56:16.428241+0000","last_clean":"2024-09-22T08:56:16.428241+0000","last_became_active":"2024-09-22T08:15:10.987610+0000","last_became_peered":"2024-09-22T08:15:10.987610+0000","last_unstale":"2024-09-22T08:56:16.428241+0000","last_undegraded":"2024-09-22T08:56:16.428241+0000","last_fullsized":"2024-09-22T08:56:16.428241+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:09.958185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.958185+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:25:04.343680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6856,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":209,"num_read_kb":275,"num_write":118,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:42.398317+0000","last_change":"2024-09-22T08:15:13.003540+0000","last_active":"2024-09-22T08:52:42.398317+0000","last_peered":"2024-09-22T08:52:42.398317+0000","last_clean":"2024-09-22T08:52:42.398317+0000","last_became_active":"2024-09-22T08:15:13.003219+0000","last_became_peered":"2024-09-22T08:15:13.003219+0000","last_unstale":"2024-09-22T08:52:42.398317+0000","last_undegraded":"2024-09-22T08:52:42.398317+0000","last_fullsized":"2024-09-22T08:52:42.398317+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:50:35.499014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"263'159","reported_seq":639,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:02.030006+0000","last_change":"2024-09-22T08:15:15.018630+0000","last_active":"2024-09-22T08:56:02.030006+0000","last_peered":"2024-09-22T08:56:02.030006+0000","last_clean":"2024-09-22T08:56:02.030006+0000","last_became_active":"2024-09-22T08:15:15.018311+0000","last_became_peered":"2024-09-22T08:15:15.018311+0000","last_unstale":"2024-09-22T08:56:02.030006+0000","last_undegraded":"2024-09-22T08:56:02.030006+0000","last_fullsized":"2024-09-22T08:56:02.030006+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:45:03.170254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":160,"num_write":367,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"263'892","reported_seq":2479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:40.711673+0000","last_change":"2024-09-22T08:56:40.711673+0000","last_active":"2024-09-22T08:56:40.711673+0000","last_peered":"2024-09-22T08:56:40.711673+0000","last_clean":"2024-09-22T08:56:40.711673+0000","last_became_active":"2024-09-22T08:15:06.964786+0000","last_became_peered":"2024-09-22T08:15:06.964786+0000","last_unstale":"2024-09-22T08:56:40.711673+0000","last_undegraded":"2024-09-22T08:56:40.711673+0000","last_fullsized":"2024-09-22T08:56:40.711673+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'892","last_scrub_stamp":"2024-09-22T08:56:40.711582+0000","last_deep_scrub":"263'892","last_deep_scrub_stamp":"2024-09-22T08:56:40.711582+0000","last_clean_scrub_stamp":"2024-09-22T08:56:40.711582+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":800,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:45:38.702433+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4058,"num_read_kb":3642,"num_write":1164,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"263'229","reported_seq":905,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:24.354836+0000","last_change":"2024-09-22T08:56:24.354836+0000","last_active":"2024-09-22T08:56:24.354836+0000","last_peered":"2024-09-22T08:56:24.354836+0000","last_clean":"2024-09-22T08:56:24.354836+0000","last_became_active":"2024-09-22T08:15:04.962774+0000","last_became_peered":"2024-09-22T08:15:04.962774+0000","last_unstale":"2024-09-22T08:56:24.354836+0000","last_undegraded":"2024-09-22T08:56:24.354836+0000","last_fullsized":"2024-09-22T08:56:24.354836+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'229","last_scrub_stamp":"2024-09-22T08:56:24.354751+0000","last_deep_scrub":"263'229","last_deep_scrub_stamp":"2024-09-22T08:56:24.354751+0000","last_clean_scrub_stamp":"2024-09-22T08:56:24.354751+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:19:21.350986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":683,"num_read_kb":4749,"num_write":1115,"num_write_kb":28646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"263'864","reported_seq":2355,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:33.135511+0000","last_change":"2024-09-22T08:56:33.135511+0000","last_active":"2024-09-22T08:56:33.135511+0000","last_peered":"2024-09-22T08:56:33.135511+0000","last_clean":"2024-09-22T08:56:33.135511+0000","last_became_active":"2024-09-22T08:15:06.958389+0000","last_became_peered":"2024-09-22T08:15:06.958389+0000","last_unstale":"2024-09-22T08:56:33.135511+0000","last_undegraded":"2024-09-22T08:56:33.135511+0000","last_fullsized":"2024-09-22T08:56:33.135511+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'864","last_scrub_stamp":"2024-09-22T08:56:33.135421+0000","last_deep_scrub":"263'864","last_deep_scrub_stamp":"2024-09-22T08:56:33.135421+0000","last_clean_scrub_stamp":"2024-09-22T08:56:33.135421+0000","objects_scrubbed":2,"log_size":64,"log_dups_size":800,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:10:17.769140+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3808,"num_read_kb":3398,"num_write":1097,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"263'366","reported_seq":1062,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:26.084966+0000","last_change":"2024-09-22T08:56:26.084966+0000","last_active":"2024-09-22T08:56:26.084966+0000","last_peered":"2024-09-22T08:56:26.084966+0000","last_clean":"2024-09-22T08:56:26.084966+0000","last_became_active":"2024-09-22T08:15:04.950922+0000","last_became_peered":"2024-09-22T08:15:04.950922+0000","last_unstale":"2024-09-22T08:56:26.084966+0000","last_undegraded":"2024-09-22T08:56:26.084966+0000","last_fullsized":"2024-09-22T08:56:26.084966+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'366","last_scrub_stamp":"2024-09-22T08:56:26.084868+0000","last_deep_scrub":"263'366","last_deep_scrub_stamp":"2024-09-22T08:56:26.084868+0000","last_clean_scrub_stamp":"2024-09-22T08:56:26.084868+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:20:49.984873+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1005,"num_read_kb":11417,"num_write":1356,"num_write_kb":38557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"263'414","reported_seq":1864,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:08.397671+0000","last_change":"2024-09-22T08:15:06.974074+0000","last_active":"2024-09-22T08:54:08.397671+0000","last_peered":"2024-09-22T08:54:08.397671+0000","last_clean":"2024-09-22T08:54:08.397671+0000","last_became_active":"2024-09-22T08:15:06.973749+0000","last_became_peered":"2024-09-22T08:15:06.973749+0000","last_unstale":"2024-09-22T08:54:08.397671+0000","last_undegraded":"2024-09-22T08:54:08.397671+0000","last_fullsized":"2024-09-22T08:54:08.397671+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:09:45.710062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2229,"num_read_kb":2093,"num_write":519,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"263'230","reported_seq":869,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:34.824521+0000","last_change":"2024-09-22T08:56:34.824521+0000","last_active":"2024-09-22T08:56:34.824521+0000","last_peered":"2024-09-22T08:56:34.824521+0000","last_clean":"2024-09-22T08:56:34.824521+0000","last_became_active":"2024-09-22T08:15:04.959501+0000","last_became_peered":"2024-09-22T08:15:04.959501+0000","last_unstale":"2024-09-22T08:56:34.824521+0000","last_undegraded":"2024-09-22T08:56:34.824521+0000","last_fullsized":"2024-09-22T08:56:34.824521+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'230","last_scrub_stamp":"2024-09-22T08:56:34.824414+0000","last_deep_scrub":"263'230","last_deep_scrub_stamp":"2024-09-22T08:56:34.824414+0000","last_clean_scrub_stamp":"2024-09-22T08:56:34.824414+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:20:56.179522+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":551,"num_read_kb":25081,"num_write":1074,"num_write_kb":19730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"263'880","reported_seq":2582,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:41.441953+0000","last_change":"2024-09-22T08:56:41.441953+0000","last_active":"2024-09-22T08:56:41.441953+0000","last_peered":"2024-09-22T08:56:41.441953+0000","last_clean":"2024-09-22T08:56:41.441953+0000","last_became_active":"2024-09-22T08:15:06.970991+0000","last_became_peered":"2024-09-22T08:15:06.970991+0000","last_unstale":"2024-09-22T08:56:41.441953+0000","last_undegraded":"2024-09-22T08:56:41.441953+0000","last_fullsized":"2024-09-22T08:56:41.441953+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'880","last_scrub_stamp":"2024-09-22T08:56:41.441866+0000","last_deep_scrub":"263'880","last_deep_scrub_stamp":"2024-09-22T08:56:41.441866+0000","last_clean_scrub_stamp":"2024-09-22T08:56:41.441866+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":800,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:00:49.369182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4175,"num_read_kb":3774,"num_write":1132,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"263'196","reported_seq":835,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:28.437228+0000","last_change":"2024-09-22T08:56:28.437228+0000","last_active":"2024-09-22T08:56:28.437228+0000","last_peered":"2024-09-22T08:56:28.437228+0000","last_clean":"2024-09-22T08:56:28.437228+0000","last_became_active":"2024-09-22T08:15:04.954281+0000","last_became_peered":"2024-09-22T08:15:04.954281+0000","last_unstale":"2024-09-22T08:56:28.437228+0000","last_undegraded":"2024-09-22T08:56:28.437228+0000","last_fullsized":"2024-09-22T08:56:28.437228+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'196","last_scrub_stamp":"2024-09-22T08:56:28.437133+0000","last_deep_scrub":"263'196","last_deep_scrub_stamp":"2024-09-22T08:56:28.437133+0000","last_clean_scrub_stamp":"2024-09-22T08:56:28.437133+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:09:07.572237+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":578,"num_read_kb":4135,"num_write":927,"num_write_kb":8648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"263'1130","reported_seq":2692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:40.404490+0000","last_change":"2024-09-22T08:56:40.404490+0000","last_active":"2024-09-22T08:56:40.404490+0000","last_peered":"2024-09-22T08:56:40.404490+0000","last_clean":"2024-09-22T08:56:40.404490+0000","last_became_active":"2024-09-22T08:15:06.967938+0000","last_became_peered":"2024-09-22T08:15:06.967938+0000","last_unstale":"2024-09-22T08:56:40.404490+0000","last_undegraded":"2024-09-22T08:56:40.404490+0000","last_fullsized":"2024-09-22T08:56:40.404490+0000","mapping_epoch":25,"log_start":"263'1100","ondisk_log_start":"263'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1130","last_scrub_stamp":"2024-09-22T08:56:40.404388+0000","last_deep_scrub":"263'1130","last_deep_scrub_stamp":"2024-09-22T08:56:40.404388+0000","last_clean_scrub_stamp":"2024-09-22T08:56:40.404388+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":1100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:38:56.900661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5297,"num_read_kb":4688,"num_write":1564,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"263'199","reported_seq":885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:26.505368+0000","last_change":"2024-09-22T08:56:26.505368+0000","last_active":"2024-09-22T08:56:26.505368+0000","last_peered":"2024-09-22T08:56:26.505368+0000","last_clean":"2024-09-22T08:56:26.505368+0000","last_became_active":"2024-09-22T08:15:04.963992+0000","last_became_peered":"2024-09-22T08:15:04.963992+0000","last_unstale":"2024-09-22T08:56:26.505368+0000","last_undegraded":"2024-09-22T08:56:26.505368+0000","last_fullsized":"2024-09-22T08:56:26.505368+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'199","last_scrub_stamp":"2024-09-22T08:56:26.505257+0000","last_deep_scrub":"263'199","last_deep_scrub_stamp":"2024-09-22T08:56:26.505257+0000","last_clean_scrub_stamp":"2024-09-22T08:56:26.505257+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:32:39.305652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":707,"num_read_kb":8108,"num_write":879,"num_write_kb":38701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"263'392","reported_seq":2074,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:33.426299+0000","last_change":"2024-09-22T08:56:33.426299+0000","last_active":"2024-09-22T08:56:33.426299+0000","last_peered":"2024-09-22T08:56:33.426299+0000","last_clean":"2024-09-22T08:56:33.426299+0000","last_became_active":"2024-09-22T08:15:06.964116+0000","last_became_peered":"2024-09-22T08:15:06.964116+0000","last_unstale":"2024-09-22T08:56:33.426299+0000","last_undegraded":"2024-09-22T08:56:33.426299+0000","last_fullsized":"2024-09-22T08:56:33.426299+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'392","last_scrub_stamp":"2024-09-22T08:56:33.426207+0000","last_deep_scrub":"263'392","last_deep_scrub_stamp":"2024-09-22T08:56:33.426207+0000","last_clean_scrub_stamp":"2024-09-22T08:56:33.426207+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:49:41.669632+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2347,"num_read_kb":2272,"num_write":440,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"263'230","reported_seq":920,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:27.538446+0000","last_change":"2024-09-22T08:56:27.538446+0000","last_active":"2024-09-22T08:56:27.538446+0000","last_peered":"2024-09-22T08:56:27.538446+0000","last_clean":"2024-09-22T08:56:27.538446+0000","last_became_active":"2024-09-22T08:15:04.951628+0000","last_became_peered":"2024-09-22T08:15:04.951628+0000","last_unstale":"2024-09-22T08:56:27.538446+0000","last_undegraded":"2024-09-22T08:56:27.538446+0000","last_fullsized":"2024-09-22T08:56:27.538446+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'230","last_scrub_stamp":"2024-09-22T08:56:27.538344+0000","last_deep_scrub":"263'230","last_deep_scrub_stamp":"2024-09-22T08:56:27.538344+0000","last_clean_scrub_stamp":"2024-09-22T08:56:27.538344+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:55:52.381757+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":736,"num_read_kb":9856,"num_write":1118,"num_write_kb":28547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"263'359","reported_seq":1840,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:35.475586+0000","last_change":"2024-09-22T08:56:35.475586+0000","last_active":"2024-09-22T08:56:35.475586+0000","last_peered":"2024-09-22T08:56:35.475586+0000","last_clean":"2024-09-22T08:56:35.475586+0000","last_became_active":"2024-09-22T08:15:06.973584+0000","last_became_peered":"2024-09-22T08:15:06.973584+0000","last_unstale":"2024-09-22T08:56:35.475586+0000","last_undegraded":"2024-09-22T08:56:35.475586+0000","last_fullsized":"2024-09-22T08:56:35.475586+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-22T08:56:35.475501+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-22T08:56:35.475501+0000","last_clean_scrub_stamp":"2024-09-22T08:56:35.475501+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:33:22.764519+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2011,"num_read_kb":1931,"num_write":399,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"263'218","reported_seq":893,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:26.335055+0000","last_change":"2024-09-22T08:56:26.335055+0000","last_active":"2024-09-22T08:56:26.335055+0000","last_peered":"2024-09-22T08:56:26.335055+0000","last_clean":"2024-09-22T08:56:26.335055+0000","last_became_active":"2024-09-22T08:15:04.968983+0000","last_became_peered":"2024-09-22T08:15:04.968983+0000","last_unstale":"2024-09-22T08:56:26.335055+0000","last_undegraded":"2024-09-22T08:56:26.335055+0000","last_fullsized":"2024-09-22T08:56:26.335055+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'218","last_scrub_stamp":"2024-09-22T08:56:26.334945+0000","last_deep_scrub":"263'218","last_deep_scrub_stamp":"2024-09-22T08:56:26.334945+0000","last_clean_scrub_stamp":"2024-09-22T08:56:26.334945+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:49:29.445563+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":615,"num_read_kb":66139,"num_write":1057,"num_write_kb":31816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"263'1265","reported_seq":3123,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:27.877792+0000","last_change":"2024-09-22T08:56:27.877792+0000","last_active":"2024-09-22T08:56:27.877792+0000","last_peered":"2024-09-22T08:56:27.877792+0000","last_clean":"2024-09-22T08:56:27.877792+0000","last_became_active":"2024-09-22T08:15:06.970055+0000","last_became_peered":"2024-09-22T08:15:06.970055+0000","last_unstale":"2024-09-22T08:56:27.877792+0000","last_undegraded":"2024-09-22T08:56:27.877792+0000","last_fullsized":"2024-09-22T08:56:27.877792+0000","mapping_epoch":25,"log_start":"263'1200","ondisk_log_start":"263'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1265","last_scrub_stamp":"2024-09-22T08:56:27.877698+0000","last_deep_scrub":"263'1265","last_deep_scrub_stamp":"2024-09-22T08:56:27.877698+0000","last_clean_scrub_stamp":"2024-09-22T08:56:27.877698+0000","objects_scrubbed":3,"log_size":65,"log_dups_size":1200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:13:51.554575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6370,"num_read_kb":5597,"num_write":1961,"num_write_kb":987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1756,"num_omap_keys":7,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"263'219","reported_seq":890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:29.465649+0000","last_change":"2024-09-22T08:56:29.465649+0000","last_active":"2024-09-22T08:56:29.465649+0000","last_peered":"2024-09-22T08:56:29.465649+0000","last_clean":"2024-09-22T08:56:29.465649+0000","last_became_active":"2024-09-22T08:15:04.961545+0000","last_became_peered":"2024-09-22T08:15:04.961545+0000","last_unstale":"2024-09-22T08:56:29.465649+0000","last_undegraded":"2024-09-22T08:56:29.465649+0000","last_fullsized":"2024-09-22T08:56:29.465649+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'219","last_scrub_stamp":"2024-09-22T08:56:29.465544+0000","last_deep_scrub":"263'219","last_deep_scrub_stamp":"2024-09-22T08:56:29.465544+0000","last_clean_scrub_stamp":"2024-09-22T08:56:29.465544+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:08:30.829892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":669,"num_read_kb":2609,"num_write":1038,"num_write_kb":23374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"263'491","reported_seq":1948,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:35.144945+0000","last_change":"2024-09-22T08:56:35.144945+0000","last_active":"2024-09-22T08:56:35.144945+0000","last_peered":"2024-09-22T08:56:35.144945+0000","last_clean":"2024-09-22T08:56:35.144945+0000","last_became_active":"2024-09-22T08:15:06.959331+0000","last_became_peered":"2024-09-22T08:15:06.959331+0000","last_unstale":"2024-09-22T08:56:35.144945+0000","last_undegraded":"2024-09-22T08:56:35.144945+0000","last_fullsized":"2024-09-22T08:56:35.144945+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'491","last_scrub_stamp":"2024-09-22T08:56:35.144843+0000","last_deep_scrub":"263'491","last_deep_scrub_stamp":"2024-09-22T08:56:35.144843+0000","last_clean_scrub_stamp":"2024-09-22T08:56:35.144843+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:30:09.143732+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2542,"num_read_kb":2330,"num_write":651,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"263'196","reported_seq":795,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:35.803962+0000","last_change":"2024-09-22T08:56:35.803962+0000","last_active":"2024-09-22T08:56:35.803962+0000","last_peered":"2024-09-22T08:56:35.803962+0000","last_clean":"2024-09-22T08:56:35.803962+0000","last_became_active":"2024-09-22T08:15:04.958725+0000","last_became_peered":"2024-09-22T08:15:04.958725+0000","last_unstale":"2024-09-22T08:56:35.803962+0000","last_undegraded":"2024-09-22T08:56:35.803962+0000","last_fullsized":"2024-09-22T08:56:35.803962+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'196","last_scrub_stamp":"2024-09-22T08:56:35.803797+0000","last_deep_scrub":"263'196","last_deep_scrub_stamp":"2024-09-22T08:56:35.803797+0000","last_clean_scrub_stamp":"2024-09-22T08:56:35.803797+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:19:54.336476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":392,"num_read_kb":18786,"num_write":900,"num_write_kb":46944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"263'799","reported_seq":2390,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:34.449040+0000","last_change":"2024-09-22T08:56:34.449040+0000","last_active":"2024-09-22T08:56:34.449040+0000","last_peered":"2024-09-22T08:56:34.449040+0000","last_clean":"2024-09-22T08:56:34.449040+0000","last_became_active":"2024-09-22T08:15:06.956485+0000","last_became_peered":"2024-09-22T08:15:06.956485+0000","last_unstale":"2024-09-22T08:56:34.449040+0000","last_undegraded":"2024-09-22T08:56:34.449040+0000","last_fullsized":"2024-09-22T08:56:34.449040+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'799","last_scrub_stamp":"2024-09-22T08:56:34.448950+0000","last_deep_scrub":"263'799","last_deep_scrub_stamp":"2024-09-22T08:56:34.448950+0000","last_clean_scrub_stamp":"2024-09-22T08:56:34.448950+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:15.749892+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3799,"num_read_kb":3445,"num_write":1066,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"263'218","reported_seq":899,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:31.387996+0000","last_change":"2024-09-22T08:56:31.387996+0000","last_active":"2024-09-22T08:56:31.387996+0000","last_peered":"2024-09-22T08:56:31.387996+0000","last_clean":"2024-09-22T08:56:31.387996+0000","last_became_active":"2024-09-22T08:15:04.962165+0000","last_became_peered":"2024-09-22T08:15:04.962165+0000","last_unstale":"2024-09-22T08:56:31.387996+0000","last_undegraded":"2024-09-22T08:56:31.387996+0000","last_fullsized":"2024-09-22T08:56:31.387996+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'218","last_scrub_stamp":"2024-09-22T08:56:31.387900+0000","last_deep_scrub":"263'218","last_deep_scrub_stamp":"2024-09-22T08:56:31.387900+0000","last_clean_scrub_stamp":"2024-09-22T08:56:31.387900+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:42:29.087154+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":601,"num_read_kb":98488,"num_write":1035,"num_write_kb":53405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"263'774","reported_seq":2242,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.926395+0000","last_change":"2024-09-22T08:15:06.970487+0000","last_active":"2024-09-22T08:54:38.926395+0000","last_peered":"2024-09-22T08:54:38.926395+0000","last_clean":"2024-09-22T08:54:38.926395+0000","last_became_active":"2024-09-22T08:15:06.970111+0000","last_became_peered":"2024-09-22T08:15:06.970111+0000","last_unstale":"2024-09-22T08:54:38.926395+0000","last_undegraded":"2024-09-22T08:54:38.926395+0000","last_fullsized":"2024-09-22T08:54:38.926395+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:05.937384+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.937384+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:58.671223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3767,"num_read_kb":3405,"num_write":1035,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"263'192","reported_seq":902,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:21.922992+0000","last_change":"2024-09-22T08:56:21.922992+0000","last_active":"2024-09-22T08:56:21.922992+0000","last_peered":"2024-09-22T08:56:21.922992+0000","last_clean":"2024-09-22T08:56:21.922992+0000","last_became_active":"2024-09-22T08:15:04.963383+0000","last_became_peered":"2024-09-22T08:15:04.963383+0000","last_unstale":"2024-09-22T08:56:21.922992+0000","last_undegraded":"2024-09-22T08:56:21.922992+0000","last_fullsized":"2024-09-22T08:56:21.922992+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'192","last_scrub_stamp":"2024-09-22T08:56:21.922907+0000","last_deep_scrub":"263'192","last_deep_scrub_stamp":"2024-09-22T08:56:21.922907+0000","last_clean_scrub_stamp":"2024-09-22T08:56:21.922907+0000","objects_scrubbed":5,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:34:08.554670+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":846,"num_read_kb":15214,"num_write":846,"num_write_kb":25255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"263'750","reported_seq":2184,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:29.779798+0000","last_change":"2024-09-22T08:56:29.779798+0000","last_active":"2024-09-22T08:56:29.779798+0000","last_peered":"2024-09-22T08:56:29.779798+0000","last_clean":"2024-09-22T08:56:29.779798+0000","last_became_active":"2024-09-22T08:15:06.967819+0000","last_became_peered":"2024-09-22T08:15:06.967819+0000","last_unstale":"2024-09-22T08:56:29.779798+0000","last_undegraded":"2024-09-22T08:56:29.779798+0000","last_fullsized":"2024-09-22T08:56:29.779798+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'750","last_scrub_stamp":"2024-09-22T08:56:29.779699+0000","last_deep_scrub":"263'750","last_deep_scrub_stamp":"2024-09-22T08:56:29.779699+0000","last_clean_scrub_stamp":"2024-09-22T08:56:29.779699+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":700,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:42:36.409781+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3557,"num_read_kb":3203,"num_write":994,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"263'222","reported_seq":860,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:30.600999+0000","last_change":"2024-09-22T08:56:30.600999+0000","last_active":"2024-09-22T08:56:30.600999+0000","last_peered":"2024-09-22T08:56:30.600999+0000","last_clean":"2024-09-22T08:56:30.600999+0000","last_became_active":"2024-09-22T08:15:04.963035+0000","last_became_peered":"2024-09-22T08:15:04.963035+0000","last_unstale":"2024-09-22T08:56:30.600999+0000","last_undegraded":"2024-09-22T08:56:30.600999+0000","last_fullsized":"2024-09-22T08:56:30.600999+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'222","last_scrub_stamp":"2024-09-22T08:56:30.600894+0000","last_deep_scrub":"263'222","last_deep_scrub_stamp":"2024-09-22T08:56:30.600894+0000","last_clean_scrub_stamp":"2024-09-22T08:56:30.600894+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:34:32.074093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":484,"num_read_kb":60036,"num_write":970,"num_write_kb":46477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"263'435","reported_seq":2064,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:32.742512+0000","last_change":"2024-09-22T08:56:32.742512+0000","last_active":"2024-09-22T08:56:32.742512+0000","last_peered":"2024-09-22T08:56:32.742512+0000","last_clean":"2024-09-22T08:56:32.742512+0000","last_became_active":"2024-09-22T08:15:06.972901+0000","last_became_peered":"2024-09-22T08:15:06.972901+0000","last_unstale":"2024-09-22T08:56:32.742512+0000","last_undegraded":"2024-09-22T08:56:32.742512+0000","last_fullsized":"2024-09-22T08:56:32.742512+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'435","last_scrub_stamp":"2024-09-22T08:56:32.742406+0000","last_deep_scrub":"263'435","last_deep_scrub_stamp":"2024-09-22T08:56:32.742406+0000","last_clean_scrub_stamp":"2024-09-22T08:56:32.742406+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:25:24.212860+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2630,"num_read_kb":2493,"num_write":497,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2041,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"263'193","reported_seq":804,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:24.511017+0000","last_change":"2024-09-22T08:56:24.511017+0000","last_active":"2024-09-22T08:56:24.511017+0000","last_peered":"2024-09-22T08:56:24.511017+0000","last_clean":"2024-09-22T08:56:24.511017+0000","last_became_active":"2024-09-22T08:15:04.954601+0000","last_became_peered":"2024-09-22T08:15:04.954601+0000","last_unstale":"2024-09-22T08:56:24.511017+0000","last_undegraded":"2024-09-22T08:56:24.511017+0000","last_fullsized":"2024-09-22T08:56:24.511017+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'193","last_scrub_stamp":"2024-09-22T08:56:24.510944+0000","last_deep_scrub":"263'193","last_deep_scrub_stamp":"2024-09-22T08:56:24.510944+0000","last_clean_scrub_stamp":"2024-09-22T08:56:24.510944+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:11.452087+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":488,"num_read_kb":10659,"num_write":871,"num_write_kb":26887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"263'440","reported_seq":1908,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:34.118935+0000","last_change":"2024-09-22T08:56:34.118935+0000","last_active":"2024-09-22T08:56:34.118935+0000","last_peered":"2024-09-22T08:56:34.118935+0000","last_clean":"2024-09-22T08:56:34.118935+0000","last_became_active":"2024-09-22T08:15:06.955721+0000","last_became_peered":"2024-09-22T08:15:06.955721+0000","last_unstale":"2024-09-22T08:56:34.118935+0000","last_undegraded":"2024-09-22T08:56:34.118935+0000","last_fullsized":"2024-09-22T08:56:34.118935+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'440","last_scrub_stamp":"2024-09-22T08:56:34.118840+0000","last_deep_scrub":"263'440","last_deep_scrub_stamp":"2024-09-22T08:56:34.118840+0000","last_clean_scrub_stamp":"2024-09-22T08:56:34.118840+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:00:17.060498+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2301,"num_read_kb":2146,"num_write":527,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"263'218","reported_seq":887,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:36.784912+0000","last_change":"2024-09-22T08:56:36.784912+0000","last_active":"2024-09-22T08:56:36.784912+0000","last_peered":"2024-09-22T08:56:36.784912+0000","last_clean":"2024-09-22T08:56:36.784912+0000","last_became_active":"2024-09-22T08:15:04.961217+0000","last_became_peered":"2024-09-22T08:15:04.961217+0000","last_unstale":"2024-09-22T08:56:36.784912+0000","last_undegraded":"2024-09-22T08:56:36.784912+0000","last_fullsized":"2024-09-22T08:56:36.784912+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'218","last_scrub_stamp":"2024-09-22T08:56:36.784815+0000","last_deep_scrub":"263'218","last_deep_scrub_stamp":"2024-09-22T08:56:36.784815+0000","last_clean_scrub_stamp":"2024-09-22T08:56:36.784815+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:05:54.668509+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":598,"num_read_kb":11776,"num_write":1062,"num_write_kb":6843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"263'550","reported_seq":2089,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:36.669377+0000","last_change":"2024-09-22T08:56:36.669377+0000","last_active":"2024-09-22T08:56:36.669377+0000","last_peered":"2024-09-22T08:56:36.669377+0000","last_clean":"2024-09-22T08:56:36.669377+0000","last_became_active":"2024-09-22T08:15:06.970735+0000","last_became_peered":"2024-09-22T08:15:06.970735+0000","last_unstale":"2024-09-22T08:56:36.669377+0000","last_undegraded":"2024-09-22T08:56:36.669377+0000","last_fullsized":"2024-09-22T08:56:36.669377+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'550","last_scrub_stamp":"2024-09-22T08:56:36.669289+0000","last_deep_scrub":"263'550","last_deep_scrub_stamp":"2024-09-22T08:56:36.669289+0000","last_clean_scrub_stamp":"2024-09-22T08:56:36.669289+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":500,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:31:27.633080+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2725,"num_read_kb":2496,"num_write":675,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"263'221","reported_seq":886,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:32.099772+0000","last_change":"2024-09-22T08:56:32.099772+0000","last_active":"2024-09-22T08:56:32.099772+0000","last_peered":"2024-09-22T08:56:32.099772+0000","last_clean":"2024-09-22T08:56:32.099772+0000","last_became_active":"2024-09-22T08:15:04.968172+0000","last_became_peered":"2024-09-22T08:15:04.968172+0000","last_unstale":"2024-09-22T08:56:32.099772+0000","last_undegraded":"2024-09-22T08:56:32.099772+0000","last_fullsized":"2024-09-22T08:56:32.099772+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'221","last_scrub_stamp":"2024-09-22T08:56:32.099657+0000","last_deep_scrub":"263'221","last_deep_scrub_stamp":"2024-09-22T08:56:32.099657+0000","last_clean_scrub_stamp":"2024-09-22T08:56:32.099657+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:37:00.416721+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":641,"num_read_kb":8608,"num_write":1007,"num_write_kb":17473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"263'757","reported_seq":2299,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:38.811418+0000","last_change":"2024-09-22T08:56:38.811418+0000","last_active":"2024-09-22T08:56:38.811418+0000","last_peered":"2024-09-22T08:56:38.811418+0000","last_clean":"2024-09-22T08:56:38.811418+0000","last_became_active":"2024-09-22T08:15:06.976019+0000","last_became_peered":"2024-09-22T08:15:06.976019+0000","last_unstale":"2024-09-22T08:56:38.811418+0000","last_undegraded":"2024-09-22T08:56:38.811418+0000","last_fullsized":"2024-09-22T08:56:38.811418+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'757","last_scrub_stamp":"2024-09-22T08:56:38.811329+0000","last_deep_scrub":"263'757","last_deep_scrub_stamp":"2024-09-22T08:56:38.811329+0000","last_clean_scrub_stamp":"2024-09-22T08:56:38.811329+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:12:18.113138+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3691,"num_read_kb":3360,"num_write":995,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"263'226","reported_seq":924,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:37.743129+0000","last_change":"2024-09-22T08:56:37.743129+0000","last_active":"2024-09-22T08:56:37.743129+0000","last_peered":"2024-09-22T08:56:37.743129+0000","last_clean":"2024-09-22T08:56:37.743129+0000","last_became_active":"2024-09-22T08:15:04.963391+0000","last_became_peered":"2024-09-22T08:15:04.963391+0000","last_unstale":"2024-09-22T08:56:37.743129+0000","last_undegraded":"2024-09-22T08:56:37.743129+0000","last_fullsized":"2024-09-22T08:56:37.743129+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'226","last_scrub_stamp":"2024-09-22T08:56:37.743035+0000","last_deep_scrub":"263'226","last_deep_scrub_stamp":"2024-09-22T08:56:37.743035+0000","last_clean_scrub_stamp":"2024-09-22T08:56:37.743035+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:49:16.424122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":637,"num_read_kb":95067,"num_write":1060,"num_write_kb":43906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"263'269","reported_seq":932,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:38.770007+0000","last_change":"2024-09-22T08:56:38.770007+0000","last_active":"2024-09-22T08:56:38.770007+0000","last_peered":"2024-09-22T08:56:38.770007+0000","last_clean":"2024-09-22T08:56:38.770007+0000","last_became_active":"2024-09-22T08:15:04.965396+0000","last_became_peered":"2024-09-22T08:15:04.965396+0000","last_unstale":"2024-09-22T08:56:38.770007+0000","last_undegraded":"2024-09-22T08:56:38.770007+0000","last_fullsized":"2024-09-22T08:56:38.770007+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'269","last_scrub_stamp":"2024-09-22T08:56:38.769874+0000","last_deep_scrub":"263'269","last_deep_scrub_stamp":"2024-09-22T08:56:38.769874+0000","last_clean_scrub_stamp":"2024-09-22T08:56:38.769874+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:54.013054+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":744,"num_read_kb":7770,"num_write":1118,"num_write_kb":20319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"263'1212","reported_seq":2932,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:38.730878+0000","last_change":"2024-09-22T08:56:38.730878+0000","last_active":"2024-09-22T08:56:38.730878+0000","last_peered":"2024-09-22T08:56:38.730878+0000","last_clean":"2024-09-22T08:56:38.730878+0000","last_became_active":"2024-09-22T08:15:06.970717+0000","last_became_peered":"2024-09-22T08:15:06.970717+0000","last_unstale":"2024-09-22T08:56:38.730878+0000","last_undegraded":"2024-09-22T08:56:38.730878+0000","last_fullsized":"2024-09-22T08:56:38.730878+0000","mapping_epoch":25,"log_start":"263'1200","ondisk_log_start":"263'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1212","last_scrub_stamp":"2024-09-22T08:56:38.730771+0000","last_deep_scrub":"263'1212","last_deep_scrub_stamp":"2024-09-22T08:56:38.730771+0000","last_clean_scrub_stamp":"2024-09-22T08:56:38.730771+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":1200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:49:00.467574+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5779,"num_read_kb":5147,"num_write":1662,"num_write_kb":686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"263'203","reported_seq":796,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:32.373450+0000","last_change":"2024-09-22T08:56:32.373450+0000","last_active":"2024-09-22T08:56:32.373450+0000","last_peered":"2024-09-22T08:56:32.373450+0000","last_clean":"2024-09-22T08:56:32.373450+0000","last_became_active":"2024-09-22T08:15:04.959102+0000","last_became_peered":"2024-09-22T08:15:04.959102+0000","last_unstale":"2024-09-22T08:56:32.373450+0000","last_undegraded":"2024-09-22T08:56:32.373450+0000","last_fullsized":"2024-09-22T08:56:32.373450+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'203","last_scrub_stamp":"2024-09-22T08:56:32.373334+0000","last_deep_scrub":"263'203","last_deep_scrub_stamp":"2024-09-22T08:56:32.373334+0000","last_clean_scrub_stamp":"2024-09-22T08:56:32.373334+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:45:32.367319+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":396,"num_read_kb":24955,"num_write":899,"num_write_kb":36551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"263'499","reported_seq":2117,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:33.765206+0000","last_change":"2024-09-22T08:56:33.765206+0000","last_active":"2024-09-22T08:56:33.765206+0000","last_peered":"2024-09-22T08:56:33.765206+0000","last_clean":"2024-09-22T08:56:33.765206+0000","last_became_active":"2024-09-22T08:15:06.968345+0000","last_became_peered":"2024-09-22T08:15:06.968345+0000","last_unstale":"2024-09-22T08:56:33.765206+0000","last_undegraded":"2024-09-22T08:56:33.765206+0000","last_fullsized":"2024-09-22T08:56:33.765206+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'499","last_scrub_stamp":"2024-09-22T08:56:33.765098+0000","last_deep_scrub":"263'499","last_deep_scrub_stamp":"2024-09-22T08:56:33.765098+0000","last_clean_scrub_stamp":"2024-09-22T08:56:33.765098+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:28:36.072865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2601,"num_read_kb":2436,"num_write":597,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10844,"num_read_kb":8840,"num_write":3116,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":899,"ondisk_log_size":899,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15081,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":16349,"num_read_kb":16036,"num_write":17069,"num_write_kb":4981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":30162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1780,"ondisk_log_size":1780,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":677,"ondisk_log_size":677,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382382,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":8323,"num_read_kb":10644,"num_write":5603,"num_write_kb":2773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":562910,"num_omap_keys":1274,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1876,"ondisk_log_size":1876,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2393,"num_read_kb":2857,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":219693,"num_read_kb":201308,"num_write":55750,"num_write_kb":18998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":32276,"num_omap_keys":130,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4008,"ondisk_log_size":4008,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":22399416,"num_objects":166,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":166,"num_whiteouts":0,"num_read":38892,"num_read_kb":2161027,"num_write":64127,"num_write_kb":2146956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45760512,"data_stored":44798832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3530,"ondisk_log_size":3530,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":194127,"num_write":186,"num_write_kb":125446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":186900,"num_write":186,"num_write_kb":125446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509947,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":202588,"kb_used_data":8972,"kb_used_omap":1,"kb_used_meta":193598,"kb_avail":94169252,"statfs":{"total":96636764160,"available":96429314048,"internally_reserved":0,"allocated":9187328,"data_stored":7502420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":198244808},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509948,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":261412,"kb_used_data":9492,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94110428,"statfs":{"total":96636764160,"available":96369078272,"internally_reserved":0,"allocated":9719808,"data_stored":8091734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257948101},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509948,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":86104,"kb_used_data":10504,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94285736,"statfs":{"total":96636764160,"available":96548593664,"internally_reserved":0,"allocated":10756096,"data_stored":9074858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542651,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":208972,"kb_used_data":7100,"kb_used_omap":1,"kb_used_meta":201854,"kb_avail":94162868,"statfs":{"total":96636764160,"available":96422776832,"internally_reserved":0,"allocated":7270400,"data_stored":5649861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":206698954},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542650,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81736,"kb_used_data":10296,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94290104,"statfs":{"total":96636764160,"available":96553066496,"internally_reserved":0,"allocated":10543104,"data_stored":8890315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542651,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":248020,"kb_used_data":9988,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94123820,"statfs":{"total":96636764160,"available":96382791680,"internally_reserved":0,"allocated":10227712,"data_stored":8586347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243726789},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542653,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148296,"kb_used_data":8888,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94223544,"statfs":{"total":96636764160,"available":96484909056,"internally_reserved":0,"allocated":9101312,"data_stored":7502190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575353,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120688,"kb_used_data":8992,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94251152,"statfs":{"total":96636764160,"available":96513179648,"internally_reserved":0,"allocated":9207808,"data_stored":7504913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7127040,"data_stored":6973120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5500928,"data_stored":5399874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5558272,"data_stored":5400076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5541888,"data_stored":5400084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5492736,"data_stored":5399824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":6012928,"data_stored":5893124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6889472,"data_stored":6786226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3637248,"data_stored":3546504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":5633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":3876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":5455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T08:56:45.194 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.194 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.194 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.194 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.195 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.195 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.195 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.195 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.195 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.195 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.195 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.195 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.195 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.196 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.196 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.196 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.196 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.196 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.196 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.196 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.196 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.196 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.197 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.197 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.197 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.197 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.197 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.197 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.197 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.197 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.197 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.198 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.198 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.198 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.198 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.198 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.198 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.198 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.198 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.199 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.199 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.199 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.199 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.199 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.199 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.199 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.199 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.199 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.200 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.200 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.200 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.200 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.200 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.200 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.200 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.200 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.200 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.201 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.201 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.201 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.201 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.201 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.201 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.201 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.201 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.201 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.201 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.201 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.202 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.202 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.202 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.202 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.202 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.202 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.202 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.202 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.203 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.203 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.203 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.203 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.203 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.203 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.203 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.203 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.203 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.203 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.204 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.204 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.204 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.204 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.204 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.204 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.204 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.204 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.204 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.205 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.205 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.205 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.205 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.205 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.205 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.205 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.205 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.205 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.205 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.206 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.206 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.206 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.206 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.206 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.206 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.206 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.206 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.206 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.207 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.207 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.207 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.207 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.207 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.207 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.207 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.207 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.207 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.207 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.208 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.208 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.208 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.208 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.208 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.208 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.208 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.208 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.209 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.209 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.209 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.209 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.209 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.209 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.209 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.209 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.209 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.209 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.210 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.210 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.210 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.210 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.210 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.210 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.210 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.210 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.210 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.211 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.211 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.211 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.211 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.211 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.211 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.211 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.211 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.211 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.212 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.212 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.212 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.212 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.212 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.212 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.212 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.212 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.212 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.213 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.213 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.213 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.213 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.213 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.213 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.213 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.213 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.214 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.214 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.214 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.214 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.214 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.214 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.214 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.214 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.215 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.215 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.215 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.215 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.215 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.215 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.215 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.215 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.215 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.216 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.216 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.216 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.216 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.216 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.216 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.216 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.216 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.217 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.217 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.217 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.217 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.217 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.217 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.217 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.217 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.217 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.218 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.218 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.218 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.218 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.218 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.218 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.218 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.218 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.219 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.219 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.219 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.219 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.219 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.219 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.219 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.219 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.219 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.220 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-22T08:15:07.945525+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.220 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-22T08:15:09.958185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.220 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.220 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.220 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.220 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-22T08:15:05.937384+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:56:45.221 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-22T08:57:05.222 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T08:57:05.577 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:57:05.590 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-09-22T08:57:05.592 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":1525,"stamp":"2024-09-22T08:57:03.650727+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23389059,"num_objects":621,"num_object_clones":0,"num_object_copies":1242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":621,"num_whiteouts":0,"num_read":296912,"num_read_kb":2781806,"num_write":146178,"num_write_kb":2427265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":189,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":748181,"num_omap_keys":1776,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13033,"ondisk_log_size":13033,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1357816,"kb_used_data":74232,"kb_used_omap":12,"kb_used_meta":1283443,"kb_avail":753616904,"statfs":{"total":773094113280,"available":771703709696,"internally_reserved":0,"allocated":76013568,"data_stored":62802638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1314246193},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":124916,"num_omap_keys":310,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005439"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:59.283247+0000","last_change":"2024-09-22T08:56:59.283247+0000","last_active":"2024-09-22T08:56:59.283247+0000","last_peered":"2024-09-22T08:56:59.283247+0000","last_clean":"2024-09-22T08:56:59.283247+0000","last_became_active":"2024-09-22T08:42:17.435576+0000","last_became_peered":"2024-09-22T08:42:17.435576+0000","last_unstale":"2024-09-22T08:56:59.283247+0000","last_undegraded":"2024-09-22T08:56:59.283247+0000","last_fullsized":"2024-09-22T08:56:59.283247+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:59.283150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:59.283150+0000","last_clean_scrub_stamp":"2024-09-22T08:56:59.283150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:55:41.200537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"263'7","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:58.831205+0000","last_change":"2024-09-22T08:56:58.831205+0000","last_active":"2024-09-22T08:56:58.831205+0000","last_peered":"2024-09-22T08:56:58.831205+0000","last_clean":"2024-09-22T08:56:58.831205+0000","last_became_active":"2024-09-22T08:31:14.254610+0000","last_became_peered":"2024-09-22T08:31:14.254610+0000","last_unstale":"2024-09-22T08:56:58.831205+0000","last_undegraded":"2024-09-22T08:56:58.831205+0000","last_fullsized":"2024-09-22T08:56:58.831205+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-22T08:56:58.831111+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-22T08:56:58.831111+0000","last_clean_scrub_stamp":"2024-09-22T08:56:58.831111+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:32.357382+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"263'4","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.314152+0000","last_change":"2024-09-22T08:31:11.216063+0000","last_active":"2024-09-22T08:56:16.314152+0000","last_peered":"2024-09-22T08:56:16.314152+0000","last_clean":"2024-09-22T08:56:16.314152+0000","last_became_active":"2024-09-22T08:31:11.215757+0000","last_became_peered":"2024-09-22T08:31:11.215757+0000","last_unstale":"2024-09-22T08:56:16.314152+0000","last_undegraded":"2024-09-22T08:56:16.314152+0000","last_fullsized":"2024-09-22T08:56:16.314152+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:30:49.027544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6203,"num_write":4,"num_write_kb":3131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"263'27","reported_seq":114,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.412862+0000","last_change":"2024-09-22T08:29:26.069972+0000","last_active":"2024-09-22T08:54:27.412862+0000","last_peered":"2024-09-22T08:54:27.412862+0000","last_clean":"2024-09-22T08:54:27.412862+0000","last_became_active":"2024-09-22T08:29:26.069635+0000","last_became_peered":"2024-09-22T08:29:26.069635+0000","last_unstale":"2024-09-22T08:54:27.412862+0000","last_undegraded":"2024-09-22T08:54:27.412862+0000","last_fullsized":"2024-09-22T08:54:27.412862+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":139,"num_write":76,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:17.271882+0000","last_change":"2024-09-22T08:42:17.433226+0000","last_active":"2024-09-22T08:52:17.271882+0000","last_peered":"2024-09-22T08:52:17.271882+0000","last_clean":"2024-09-22T08:52:17.271882+0000","last_became_active":"2024-09-22T08:42:17.432946+0000","last_became_peered":"2024-09-22T08:42:17.432946+0000","last_unstale":"2024-09-22T08:52:17.271882+0000","last_undegraded":"2024-09-22T08:52:17.271882+0000","last_fullsized":"2024-09-22T08:52:17.271882+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:57:47.463137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"263'5","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.380075+0000","last_change":"2024-09-22T08:31:14.256838+0000","last_active":"2024-09-22T08:56:16.380075+0000","last_peered":"2024-09-22T08:56:16.380075+0000","last_clean":"2024-09-22T08:56:16.380075+0000","last_became_active":"2024-09-22T08:31:14.256486+0000","last_became_peered":"2024-09-22T08:31:14.256486+0000","last_unstale":"2024-09-22T08:56:16.380075+0000","last_undegraded":"2024-09-22T08:56:16.380075+0000","last_fullsized":"2024-09-22T08:56:16.380075+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:05:48.401720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8240,"num_write":10,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"260'2","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:42.284418+0000","last_change":"2024-09-22T08:31:11.216967+0000","last_active":"2024-09-22T08:53:42.284418+0000","last_peered":"2024-09-22T08:53:42.284418+0000","last_clean":"2024-09-22T08:53:42.284418+0000","last_became_active":"2024-09-22T08:31:11.216515+0000","last_became_peered":"2024-09-22T08:31:11.216515+0000","last_unstale":"2024-09-22T08:53:42.284418+0000","last_undegraded":"2024-09-22T08:53:42.284418+0000","last_fullsized":"2024-09-22T08:53:42.284418+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:40:06.800121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"263'31","reported_seq":130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:32.404964+0000","last_change":"2024-09-22T08:29:26.074014+0000","last_active":"2024-09-22T08:53:32.404964+0000","last_peered":"2024-09-22T08:53:32.404964+0000","last_clean":"2024-09-22T08:53:32.404964+0000","last_became_active":"2024-09-22T08:29:26.073415+0000","last_became_peered":"2024-09-22T08:29:26.073415+0000","last_unstale":"2024-09-22T08:53:32.404964+0000","last_undegraded":"2024-09-22T08:53:32.404964+0000","last_fullsized":"2024-09-22T08:53:32.404964+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:07:10.743328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":176,"num_write":77,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:00.821735+0000","last_change":"2024-09-22T08:57:00.821735+0000","last_active":"2024-09-22T08:57:00.821735+0000","last_peered":"2024-09-22T08:57:00.821735+0000","last_clean":"2024-09-22T08:57:00.821735+0000","last_became_active":"2024-09-22T08:42:17.436334+0000","last_became_peered":"2024-09-22T08:42:17.436334+0000","last_unstale":"2024-09-22T08:57:00.821735+0000","last_undegraded":"2024-09-22T08:57:00.821735+0000","last_fullsized":"2024-09-22T08:57:00.821735+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:00.821641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:00.821641+0000","last_clean_scrub_stamp":"2024-09-22T08:57:00.821641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:06:29.336666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"260'4","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:12.288779+0000","last_change":"2024-09-22T08:31:14.257057+0000","last_active":"2024-09-22T08:54:12.288779+0000","last_peered":"2024-09-22T08:54:12.288779+0000","last_clean":"2024-09-22T08:54:12.288779+0000","last_became_active":"2024-09-22T08:31:14.256769+0000","last_became_peered":"2024-09-22T08:31:14.256769+0000","last_unstale":"2024-09-22T08:54:12.288779+0000","last_undegraded":"2024-09-22T08:54:12.288779+0000","last_fullsized":"2024-09-22T08:54:12.288779+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:06:32.378399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:17.289881+0000","last_change":"2024-09-22T08:31:11.211351+0000","last_active":"2024-09-22T08:53:17.289881+0000","last_peered":"2024-09-22T08:53:17.289881+0000","last_clean":"2024-09-22T08:53:17.289881+0000","last_became_active":"2024-09-22T08:31:11.210892+0000","last_became_peered":"2024-09-22T08:31:11.210892+0000","last_unstale":"2024-09-22T08:53:17.289881+0000","last_undegraded":"2024-09-22T08:53:17.289881+0000","last_fullsized":"2024-09-22T08:53:17.289881+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:20:58.942888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"263'43","reported_seq":171,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:58.576106+0000","last_change":"2024-09-22T08:56:58.576106+0000","last_active":"2024-09-22T08:56:58.576106+0000","last_peered":"2024-09-22T08:56:58.576106+0000","last_clean":"2024-09-22T08:56:58.576106+0000","last_became_active":"2024-09-22T08:29:26.067963+0000","last_became_peered":"2024-09-22T08:29:26.067963+0000","last_unstale":"2024-09-22T08:56:58.576106+0000","last_undegraded":"2024-09-22T08:56:58.576106+0000","last_fullsized":"2024-09-22T08:56:58.576106+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'43","last_scrub_stamp":"2024-09-22T08:56:58.576017+0000","last_deep_scrub":"263'43","last_deep_scrub_stamp":"2024-09-22T08:56:58.576017+0000","last_clean_scrub_stamp":"2024-09-22T08:56:58.576017+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:24:10.505789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":380,"num_read_kb":284,"num_write":99,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:27.290799+0000","last_change":"2024-09-22T08:42:17.431238+0000","last_active":"2024-09-22T08:54:27.290799+0000","last_peered":"2024-09-22T08:54:27.290799+0000","last_clean":"2024-09-22T08:54:27.290799+0000","last_became_active":"2024-09-22T08:42:17.430938+0000","last_became_peered":"2024-09-22T08:42:17.430938+0000","last_unstale":"2024-09-22T08:54:27.290799+0000","last_undegraded":"2024-09-22T08:54:27.290799+0000","last_fullsized":"2024-09-22T08:54:27.290799+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"263'5","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:22.299767+0000","last_change":"2024-09-22T08:31:14.257263+0000","last_active":"2024-09-22T08:55:22.299767+0000","last_peered":"2024-09-22T08:55:22.299767+0000","last_clean":"2024-09-22T08:55:22.299767+0000","last_became_active":"2024-09-22T08:31:14.255086+0000","last_became_peered":"2024-09-22T08:31:14.255086+0000","last_unstale":"2024-09-22T08:55:22.299767+0000","last_undegraded":"2024-09-22T08:55:22.299767+0000","last_fullsized":"2024-09-22T08:55:22.299767+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:28:49.743007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:01.839072+0000","last_change":"2024-09-22T08:57:01.839072+0000","last_active":"2024-09-22T08:57:01.839072+0000","last_peered":"2024-09-22T08:57:01.839072+0000","last_clean":"2024-09-22T08:57:01.839072+0000","last_became_active":"2024-09-22T08:31:11.207375+0000","last_became_peered":"2024-09-22T08:31:11.207375+0000","last_unstale":"2024-09-22T08:57:01.839072+0000","last_undegraded":"2024-09-22T08:57:01.839072+0000","last_fullsized":"2024-09-22T08:57:01.839072+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:01.838970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:01.838970+0000","last_clean_scrub_stamp":"2024-09-22T08:57:01.838970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:53:22.179444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"263'31","reported_seq":131,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:56.555035+0000","last_change":"2024-09-22T08:56:56.554934+0000","last_active":"2024-09-22T08:56:56.555035+0000","last_peered":"2024-09-22T08:56:56.555035+0000","last_clean":"2024-09-22T08:56:56.555035+0000","last_became_active":"2024-09-22T08:29:26.072183+0000","last_became_peered":"2024-09-22T08:29:26.072183+0000","last_unstale":"2024-09-22T08:56:56.555035+0000","last_undegraded":"2024-09-22T08:56:56.555035+0000","last_fullsized":"2024-09-22T08:56:56.555035+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'31","last_scrub_stamp":"2024-09-22T08:56:56.554814+0000","last_deep_scrub":"263'31","last_deep_scrub_stamp":"2024-09-22T08:56:56.554814+0000","last_clean_scrub_stamp":"2024-09-22T08:56:56.554814+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:19:23.285923+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":233,"num_read_kb":155,"num_write":81,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:22.298701+0000","last_change":"2024-09-22T08:42:17.418516+0000","last_active":"2024-09-22T08:54:22.298701+0000","last_peered":"2024-09-22T08:54:22.298701+0000","last_clean":"2024-09-22T08:54:22.298701+0000","last_became_active":"2024-09-22T08:42:17.418224+0000","last_became_peered":"2024-09-22T08:42:17.418224+0000","last_unstale":"2024-09-22T08:54:22.298701+0000","last_undegraded":"2024-09-22T08:54:22.298701+0000","last_fullsized":"2024-09-22T08:54:22.298701+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:06:49.930134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"263'5","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:55.323168+0000","last_change":"2024-09-22T08:56:55.323168+0000","last_active":"2024-09-22T08:56:55.323168+0000","last_peered":"2024-09-22T08:56:55.323168+0000","last_clean":"2024-09-22T08:56:55.323168+0000","last_became_active":"2024-09-22T08:31:14.261753+0000","last_became_peered":"2024-09-22T08:31:14.261753+0000","last_unstale":"2024-09-22T08:56:55.323168+0000","last_undegraded":"2024-09-22T08:56:55.323168+0000","last_fullsized":"2024-09-22T08:56:55.323168+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-22T08:56:55.323025+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-22T08:56:55.323025+0000","last_clean_scrub_stamp":"2024-09-22T08:56:55.323025+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:44:08.081182+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"260'9","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:57.277829+0000","last_change":"2024-09-22T08:31:11.215327+0000","last_active":"2024-09-22T08:52:57.277829+0000","last_peered":"2024-09-22T08:52:57.277829+0000","last_clean":"2024-09-22T08:52:57.277829+0000","last_became_active":"2024-09-22T08:31:11.215024+0000","last_became_peered":"2024-09-22T08:31:11.215024+0000","last_unstale":"2024-09-22T08:52:57.277829+0000","last_undegraded":"2024-09-22T08:52:57.277829+0000","last_fullsized":"2024-09-22T08:52:57.277829+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:27:55.278924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":17455,"num_write":14,"num_write_kb":5165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"263'52","reported_seq":194,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:57.564120+0000","last_change":"2024-09-22T08:56:57.564120+0000","last_active":"2024-09-22T08:56:57.564120+0000","last_peered":"2024-09-22T08:56:57.564120+0000","last_clean":"2024-09-22T08:56:57.564120+0000","last_became_active":"2024-09-22T08:29:26.070913+0000","last_became_peered":"2024-09-22T08:29:26.070913+0000","last_unstale":"2024-09-22T08:56:57.564120+0000","last_undegraded":"2024-09-22T08:56:57.564120+0000","last_fullsized":"2024-09-22T08:56:57.564120+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'52","last_scrub_stamp":"2024-09-22T08:56:57.564032+0000","last_deep_scrub":"263'52","last_deep_scrub_stamp":"2024-09-22T08:56:57.564032+0000","last_clean_scrub_stamp":"2024-09-22T08:56:57.564032+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:23:29.347552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":289,"num_write":128,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:47.415834+0000","last_change":"2024-09-22T08:42:17.428992+0000","last_active":"2024-09-22T08:54:47.415834+0000","last_peered":"2024-09-22T08:54:47.415834+0000","last_clean":"2024-09-22T08:54:47.415834+0000","last_became_active":"2024-09-22T08:42:17.428589+0000","last_became_peered":"2024-09-22T08:42:17.428589+0000","last_unstale":"2024-09-22T08:54:47.415834+0000","last_undegraded":"2024-09-22T08:54:47.415834+0000","last_fullsized":"2024-09-22T08:54:47.415834+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"263'6","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:28.407335+0000","last_change":"2024-09-22T08:31:14.256450+0000","last_active":"2024-09-22T08:55:28.407335+0000","last_peered":"2024-09-22T08:55:28.407335+0000","last_clean":"2024-09-22T08:55:28.407335+0000","last_became_active":"2024-09-22T08:31:14.256133+0000","last_became_peered":"2024-09-22T08:31:14.256133+0000","last_unstale":"2024-09-22T08:55:28.407335+0000","last_undegraded":"2024-09-22T08:55:28.407335+0000","last_fullsized":"2024-09-22T08:55:28.407335+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:35:53.157445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":16,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"263'2","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:23.406685+0000","last_change":"2024-09-22T08:31:11.214428+0000","last_active":"2024-09-22T08:55:23.406685+0000","last_peered":"2024-09-22T08:55:23.406685+0000","last_clean":"2024-09-22T08:55:23.406685+0000","last_became_active":"2024-09-22T08:31:11.214152+0000","last_became_peered":"2024-09-22T08:31:11.214152+0000","last_unstale":"2024-09-22T08:55:23.406685+0000","last_undegraded":"2024-09-22T08:55:23.406685+0000","last_fullsized":"2024-09-22T08:55:23.406685+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:24:25.711738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"263'41","reported_seq":164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:56.153768+0000","last_change":"2024-09-22T08:56:56.153706+0000","last_active":"2024-09-22T08:56:56.153768+0000","last_peered":"2024-09-22T08:56:56.153768+0000","last_clean":"2024-09-22T08:56:56.153768+0000","last_became_active":"2024-09-22T08:29:26.072935+0000","last_became_peered":"2024-09-22T08:29:26.072935+0000","last_unstale":"2024-09-22T08:56:56.153768+0000","last_undegraded":"2024-09-22T08:56:56.153768+0000","last_fullsized":"2024-09-22T08:56:56.153768+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'41","last_scrub_stamp":"2024-09-22T08:56:56.153614+0000","last_deep_scrub":"263'41","last_deep_scrub_stamp":"2024-09-22T08:56:56.153614+0000","last_clean_scrub_stamp":"2024-09-22T08:56:56.153614+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:55:19.612927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":341,"num_read_kb":226,"num_write":101,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:16.259851+0000","last_change":"2024-09-22T08:42:17.429598+0000","last_active":"2024-09-22T08:52:16.259851+0000","last_peered":"2024-09-22T08:52:16.259851+0000","last_clean":"2024-09-22T08:52:16.259851+0000","last_became_active":"2024-09-22T08:42:17.429298+0000","last_became_peered":"2024-09-22T08:42:17.429298+0000","last_unstale":"2024-09-22T08:52:16.259851+0000","last_undegraded":"2024-09-22T08:52:16.259851+0000","last_fullsized":"2024-09-22T08:52:16.259851+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:26:36.238407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"260'7","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:46.271089+0000","last_change":"2024-09-22T08:31:14.258062+0000","last_active":"2024-09-22T08:53:46.271089+0000","last_peered":"2024-09-22T08:53:46.271089+0000","last_clean":"2024-09-22T08:53:46.271089+0000","last_became_active":"2024-09-22T08:31:14.257659+0000","last_became_peered":"2024-09-22T08:31:14.257659+0000","last_unstale":"2024-09-22T08:53:46.271089+0000","last_undegraded":"2024-09-22T08:53:46.271089+0000","last_fullsized":"2024-09-22T08:53:46.271089+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:32:38.962644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4143,"num_write":12,"num_write_kb":1069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"263'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:51.310546+0000","last_change":"2024-09-22T08:56:51.310546+0000","last_active":"2024-09-22T08:56:51.310546+0000","last_peered":"2024-09-22T08:56:51.310546+0000","last_clean":"2024-09-22T08:56:51.310546+0000","last_became_active":"2024-09-22T08:31:11.216248+0000","last_became_peered":"2024-09-22T08:31:11.216248+0000","last_unstale":"2024-09-22T08:56:51.310546+0000","last_undegraded":"2024-09-22T08:56:51.310546+0000","last_fullsized":"2024-09-22T08:56:51.310546+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:56:51.310456+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:56:51.310456+0000","last_clean_scrub_stamp":"2024-09-22T08:56:51.310456+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:52:43.461188+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"263'16","reported_seq":92,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:57.360607+0000","last_change":"2024-09-22T08:56:57.360607+0000","last_active":"2024-09-22T08:56:57.360607+0000","last_peered":"2024-09-22T08:56:57.360607+0000","last_clean":"2024-09-22T08:56:57.360607+0000","last_became_active":"2024-09-22T08:29:26.076243+0000","last_became_peered":"2024-09-22T08:29:26.076243+0000","last_unstale":"2024-09-22T08:56:57.360607+0000","last_undegraded":"2024-09-22T08:56:57.360607+0000","last_fullsized":"2024-09-22T08:56:57.360607+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'16","last_scrub_stamp":"2024-09-22T08:56:57.360508+0000","last_deep_scrub":"263'16","last_deep_scrub_stamp":"2024-09-22T08:56:57.360508+0000","last_clean_scrub_stamp":"2024-09-22T08:56:57.360508+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:24:23.856306+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":86,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:01.270387+0000","last_change":"2024-09-22T08:57:01.270387+0000","last_active":"2024-09-22T08:57:01.270387+0000","last_peered":"2024-09-22T08:57:01.270387+0000","last_clean":"2024-09-22T08:57:01.270387+0000","last_became_active":"2024-09-22T08:42:17.432923+0000","last_became_peered":"2024-09-22T08:42:17.432923+0000","last_unstale":"2024-09-22T08:57:01.270387+0000","last_undegraded":"2024-09-22T08:57:01.270387+0000","last_fullsized":"2024-09-22T08:57:01.270387+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:01.270301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:01.270301+0000","last_clean_scrub_stamp":"2024-09-22T08:57:01.270301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:14.894407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"263'8","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.426367+0000","last_change":"2024-09-22T08:31:14.256601+0000","last_active":"2024-09-22T08:56:16.426367+0000","last_peered":"2024-09-22T08:56:16.426367+0000","last_clean":"2024-09-22T08:56:16.426367+0000","last_became_active":"2024-09-22T08:31:14.256055+0000","last_became_peered":"2024-09-22T08:31:14.256055+0000","last_unstale":"2024-09-22T08:56:16.426367+0000","last_undegraded":"2024-09-22T08:56:16.426367+0000","last_fullsized":"2024-09-22T08:56:16.426367+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:48:31.013743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":18434,"num_write":18,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"263'8","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:01.594227+0000","last_change":"2024-09-22T08:57:01.594227+0000","last_active":"2024-09-22T08:57:01.594227+0000","last_peered":"2024-09-22T08:57:01.594227+0000","last_clean":"2024-09-22T08:57:01.594227+0000","last_became_active":"2024-09-22T08:31:11.215609+0000","last_became_peered":"2024-09-22T08:31:11.215609+0000","last_unstale":"2024-09-22T08:57:01.594227+0000","last_undegraded":"2024-09-22T08:57:01.594227+0000","last_fullsized":"2024-09-22T08:57:01.594227+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-22T08:57:01.594139+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-22T08:57:01.594139+0000","last_clean_scrub_stamp":"2024-09-22T08:57:01.594139+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:18:53.133329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":18,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"263'42","reported_seq":163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:55.575459+0000","last_change":"2024-09-22T08:56:55.575459+0000","last_active":"2024-09-22T08:56:55.575459+0000","last_peered":"2024-09-22T08:56:55.575459+0000","last_clean":"2024-09-22T08:56:55.575459+0000","last_became_active":"2024-09-22T08:29:26.066447+0000","last_became_peered":"2024-09-22T08:29:26.066447+0000","last_unstale":"2024-09-22T08:56:55.575459+0000","last_undegraded":"2024-09-22T08:56:55.575459+0000","last_fullsized":"2024-09-22T08:56:55.575459+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'42","last_scrub_stamp":"2024-09-22T08:56:55.575356+0000","last_deep_scrub":"263'42","last_deep_scrub_stamp":"2024-09-22T08:56:55.575356+0000","last_clean_scrub_stamp":"2024-09-22T08:56:55.575356+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:23:36.714020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":325,"num_read_kb":214,"num_write":107,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:57.286263+0000","last_change":"2024-09-22T08:42:17.436182+0000","last_active":"2024-09-22T08:53:57.286263+0000","last_peered":"2024-09-22T08:53:57.286263+0000","last_clean":"2024-09-22T08:53:57.286263+0000","last_became_active":"2024-09-22T08:42:17.435842+0000","last_became_peered":"2024-09-22T08:42:17.435842+0000","last_unstale":"2024-09-22T08:53:57.286263+0000","last_undegraded":"2024-09-22T08:53:57.286263+0000","last_fullsized":"2024-09-22T08:53:57.286263+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:44:56.306198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"263'2","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:27.307511+0000","last_change":"2024-09-22T08:31:14.255793+0000","last_active":"2024-09-22T08:55:27.307511+0000","last_peered":"2024-09-22T08:55:27.307511+0000","last_clean":"2024-09-22T08:55:27.307511+0000","last_became_active":"2024-09-22T08:31:14.255497+0000","last_became_peered":"2024-09-22T08:31:14.255497+0000","last_unstale":"2024-09-22T08:55:27.307511+0000","last_undegraded":"2024-09-22T08:55:27.307511+0000","last_fullsized":"2024-09-22T08:55:27.307511+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:31.376498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"263'4","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.379926+0000","last_change":"2024-09-22T08:31:11.217315+0000","last_active":"2024-09-22T08:56:16.379926+0000","last_peered":"2024-09-22T08:56:16.379926+0000","last_clean":"2024-09-22T08:56:16.379926+0000","last_became_active":"2024-09-22T08:31:11.216997+0000","last_became_peered":"2024-09-22T08:31:11.216997+0000","last_unstale":"2024-09-22T08:56:16.379926+0000","last_undegraded":"2024-09-22T08:56:16.379926+0000","last_fullsized":"2024-09-22T08:56:16.379926+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"263'25","reported_seq":119,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:01.949281+0000","last_change":"2024-09-22T08:57:01.949281+0000","last_active":"2024-09-22T08:57:01.949281+0000","last_peered":"2024-09-22T08:57:01.949281+0000","last_clean":"2024-09-22T08:57:01.949281+0000","last_became_active":"2024-09-22T08:29:26.070906+0000","last_became_peered":"2024-09-22T08:29:26.070906+0000","last_unstale":"2024-09-22T08:57:01.949281+0000","last_undegraded":"2024-09-22T08:57:01.949281+0000","last_fullsized":"2024-09-22T08:57:01.949281+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'25","last_scrub_stamp":"2024-09-22T08:57:01.949196+0000","last_deep_scrub":"263'25","last_deep_scrub_stamp":"2024-09-22T08:57:01.949196+0000","last_clean_scrub_stamp":"2024-09-22T08:57:01.949196+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:30.841330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":135,"num_write":63,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:57.286143+0000","last_change":"2024-09-22T08:42:17.430752+0000","last_active":"2024-09-22T08:53:57.286143+0000","last_peered":"2024-09-22T08:53:57.286143+0000","last_clean":"2024-09-22T08:53:57.286143+0000","last_became_active":"2024-09-22T08:42:17.430457+0000","last_became_peered":"2024-09-22T08:42:17.430457+0000","last_unstale":"2024-09-22T08:53:57.286143+0000","last_undegraded":"2024-09-22T08:53:57.286143+0000","last_fullsized":"2024-09-22T08:53:57.286143+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:57:22.012215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"263'9","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.543362+0000","last_change":"2024-09-22T08:31:14.256126+0000","last_active":"2024-09-22T08:56:16.543362+0000","last_peered":"2024-09-22T08:56:16.543362+0000","last_clean":"2024-09-22T08:56:16.543362+0000","last_became_active":"2024-09-22T08:31:14.255245+0000","last_became_peered":"2024-09-22T08:31:14.255245+0000","last_unstale":"2024-09-22T08:56:16.543362+0000","last_undegraded":"2024-09-22T08:56:16.543362+0000","last_fullsized":"2024-09-22T08:56:16.543362+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":20480,"num_write":14,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"260'6","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:49.347000+0000","last_change":"2024-09-22T08:56:49.347000+0000","last_active":"2024-09-22T08:56:49.347000+0000","last_peered":"2024-09-22T08:56:49.347000+0000","last_clean":"2024-09-22T08:56:49.347000+0000","last_became_active":"2024-09-22T08:31:11.211000+0000","last_became_peered":"2024-09-22T08:31:11.211000+0000","last_unstale":"2024-09-22T08:56:49.347000+0000","last_undegraded":"2024-09-22T08:56:49.347000+0000","last_fullsized":"2024-09-22T08:56:49.347000+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-22T08:56:49.346894+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-22T08:56:49.346894+0000","last_clean_scrub_stamp":"2024-09-22T08:56:49.346894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:18:23.984699+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8192,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"263'32","reported_seq":130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:37.405687+0000","last_change":"2024-09-22T08:29:26.075955+0000","last_active":"2024-09-22T08:53:37.405687+0000","last_peered":"2024-09-22T08:53:37.405687+0000","last_clean":"2024-09-22T08:53:37.405687+0000","last_became_active":"2024-09-22T08:29:26.074151+0000","last_became_peered":"2024-09-22T08:29:26.074151+0000","last_unstale":"2024-09-22T08:53:37.405687+0000","last_undegraded":"2024-09-22T08:53:37.405687+0000","last_fullsized":"2024-09-22T08:53:37.405687+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:36:04.989650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":180,"num_write":78,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:56.272330+0000","last_change":"2024-09-22T08:42:17.432351+0000","last_active":"2024-09-22T08:53:56.272330+0000","last_peered":"2024-09-22T08:53:56.272330+0000","last_clean":"2024-09-22T08:53:56.272330+0000","last_became_active":"2024-09-22T08:42:17.432056+0000","last_became_peered":"2024-09-22T08:42:17.432056+0000","last_unstale":"2024-09-22T08:53:56.272330+0000","last_undegraded":"2024-09-22T08:53:56.272330+0000","last_fullsized":"2024-09-22T08:53:56.272330+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:19:22.863621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"263'6","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.434342+0000","last_change":"2024-09-22T08:31:14.259324+0000","last_active":"2024-09-22T08:56:16.434342+0000","last_peered":"2024-09-22T08:56:16.434342+0000","last_clean":"2024-09-22T08:56:16.434342+0000","last_became_active":"2024-09-22T08:31:14.259009+0000","last_became_peered":"2024-09-22T08:31:14.259009+0000","last_unstale":"2024-09-22T08:56:16.434342+0000","last_undegraded":"2024-09-22T08:56:16.434342+0000","last_fullsized":"2024-09-22T08:56:16.434342+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:19:27.710241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8192,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"263'5","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:01.354578+0000","last_change":"2024-09-22T08:57:01.354578+0000","last_active":"2024-09-22T08:57:01.354578+0000","last_peered":"2024-09-22T08:57:01.354578+0000","last_clean":"2024-09-22T08:57:01.354578+0000","last_became_active":"2024-09-22T08:31:11.215708+0000","last_became_peered":"2024-09-22T08:31:11.215708+0000","last_unstale":"2024-09-22T08:57:01.354578+0000","last_undegraded":"2024-09-22T08:57:01.354578+0000","last_fullsized":"2024-09-22T08:57:01.354578+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-22T08:57:01.354488+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-22T08:57:01.354488+0000","last_clean_scrub_stamp":"2024-09-22T08:57:01.354488+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:22:05.998897+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"263'26","reported_seq":118,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:55.344605+0000","last_change":"2024-09-22T08:56:55.344605+0000","last_active":"2024-09-22T08:56:55.344605+0000","last_peered":"2024-09-22T08:56:55.344605+0000","last_clean":"2024-09-22T08:56:55.344605+0000","last_became_active":"2024-09-22T08:29:26.069440+0000","last_became_peered":"2024-09-22T08:29:26.069440+0000","last_unstale":"2024-09-22T08:56:55.344605+0000","last_undegraded":"2024-09-22T08:56:55.344605+0000","last_fullsized":"2024-09-22T08:56:55.344605+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'26","last_scrub_stamp":"2024-09-22T08:56:55.344513+0000","last_deep_scrub":"263'26","last_deep_scrub_stamp":"2024-09-22T08:56:55.344513+0000","last_clean_scrub_stamp":"2024-09-22T08:56:55.344513+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:01:29.040638+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":134,"num_write":69,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:58.276124+0000","last_change":"2024-09-22T08:56:58.276124+0000","last_active":"2024-09-22T08:56:58.276124+0000","last_peered":"2024-09-22T08:56:58.276124+0000","last_clean":"2024-09-22T08:56:58.276124+0000","last_became_active":"2024-09-22T08:42:17.435825+0000","last_became_peered":"2024-09-22T08:42:17.435825+0000","last_unstale":"2024-09-22T08:56:58.276124+0000","last_undegraded":"2024-09-22T08:56:58.276124+0000","last_fullsized":"2024-09-22T08:56:58.276124+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:58.276034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:58.276034+0000","last_clean_scrub_stamp":"2024-09-22T08:56:58.276034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:06:06.118719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"260'2","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:54.303367+0000","last_change":"2024-09-22T08:56:54.303367+0000","last_active":"2024-09-22T08:56:54.303367+0000","last_peered":"2024-09-22T08:56:54.303367+0000","last_clean":"2024-09-22T08:56:54.303367+0000","last_became_active":"2024-09-22T08:31:14.256218+0000","last_became_peered":"2024-09-22T08:31:14.256218+0000","last_unstale":"2024-09-22T08:56:54.303367+0000","last_undegraded":"2024-09-22T08:56:54.303367+0000","last_fullsized":"2024-09-22T08:56:54.303367+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-22T08:56:54.303281+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-22T08:56:54.303281+0000","last_clean_scrub_stamp":"2024-09-22T08:56:54.303281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:56:55.883067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:57.277949+0000","last_change":"2024-09-22T08:31:11.214383+0000","last_active":"2024-09-22T08:52:57.277949+0000","last_peered":"2024-09-22T08:52:57.277949+0000","last_clean":"2024-09-22T08:52:57.277949+0000","last_became_active":"2024-09-22T08:31:11.214111+0000","last_became_peered":"2024-09-22T08:31:11.214111+0000","last_unstale":"2024-09-22T08:52:57.277949+0000","last_undegraded":"2024-09-22T08:52:57.277949+0000","last_fullsized":"2024-09-22T08:52:57.277949+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:55:25.197395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"263'20","reported_seq":95,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:53.388471+0000","last_change":"2024-09-22T08:29:26.069573+0000","last_active":"2024-09-22T08:52:53.388471+0000","last_peered":"2024-09-22T08:52:53.388471+0000","last_clean":"2024-09-22T08:52:53.388471+0000","last_became_active":"2024-09-22T08:29:26.069293+0000","last_became_peered":"2024-09-22T08:29:26.069293+0000","last_unstale":"2024-09-22T08:52:53.388471+0000","last_undegraded":"2024-09-22T08:52:53.388471+0000","last_fullsized":"2024-09-22T08:52:53.388471+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:06:27.426634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":89,"num_write":52,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:22.290204+0000","last_change":"2024-09-22T08:42:17.429646+0000","last_active":"2024-09-22T08:54:22.290204+0000","last_peered":"2024-09-22T08:54:22.290204+0000","last_clean":"2024-09-22T08:54:22.290204+0000","last_became_active":"2024-09-22T08:42:17.429163+0000","last_became_peered":"2024-09-22T08:42:17.429163+0000","last_unstale":"2024-09-22T08:54:22.290204+0000","last_undegraded":"2024-09-22T08:54:22.290204+0000","last_fullsized":"2024-09-22T08:54:22.290204+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"263'2","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.302195+0000","last_change":"2024-09-22T08:31:14.259778+0000","last_active":"2024-09-22T08:56:16.302195+0000","last_peered":"2024-09-22T08:56:16.302195+0000","last_clean":"2024-09-22T08:56:16.302195+0000","last_became_active":"2024-09-22T08:31:14.259484+0000","last_became_peered":"2024-09-22T08:31:14.259484+0000","last_unstale":"2024-09-22T08:56:16.302195+0000","last_undegraded":"2024-09-22T08:56:16.302195+0000","last_fullsized":"2024-09-22T08:56:16.302195+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"263'6","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:53.777115+0000","last_change":"2024-09-22T08:56:53.777115+0000","last_active":"2024-09-22T08:56:53.777115+0000","last_peered":"2024-09-22T08:56:53.777115+0000","last_clean":"2024-09-22T08:56:53.777115+0000","last_became_active":"2024-09-22T08:31:11.203053+0000","last_became_peered":"2024-09-22T08:31:11.203053+0000","last_unstale":"2024-09-22T08:56:53.777115+0000","last_undegraded":"2024-09-22T08:56:53.777115+0000","last_fullsized":"2024-09-22T08:56:53.777115+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-22T08:56:53.777026+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-22T08:56:53.777026+0000","last_clean_scrub_stamp":"2024-09-22T08:56:53.777026+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:41:20.302287+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4146,"num_write":6,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"263'318","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:48.387936+0000","last_change":"2024-09-22T08:29:26.070758+0000","last_active":"2024-09-22T08:52:48.387936+0000","last_peered":"2024-09-22T08:52:48.387936+0000","last_clean":"2024-09-22T08:52:48.387936+0000","last_became_active":"2024-09-22T08:29:26.070475+0000","last_became_peered":"2024-09-22T08:29:26.070475+0000","last_unstale":"2024-09-22T08:52:48.387936+0000","last_undegraded":"2024-09-22T08:52:48.387936+0000","last_fullsized":"2024-09-22T08:52:48.387936+0000","mapping_epoch":252,"log_start":"263'300","ondisk_log_start":"263'300","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:21:22.076883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2975,"num_read_kb":3480,"num_write":654,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:22.290101+0000","last_change":"2024-09-22T08:42:17.431838+0000","last_active":"2024-09-22T08:54:22.290101+0000","last_peered":"2024-09-22T08:54:22.290101+0000","last_clean":"2024-09-22T08:54:22.290101+0000","last_became_active":"2024-09-22T08:42:17.431528+0000","last_became_peered":"2024-09-22T08:42:17.431528+0000","last_unstale":"2024-09-22T08:54:22.290101+0000","last_undegraded":"2024-09-22T08:54:22.290101+0000","last_fullsized":"2024-09-22T08:54:22.290101+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:37.292420+0000","last_change":"2024-09-22T08:31:14.256347+0000","last_active":"2024-09-22T08:54:37.292420+0000","last_peered":"2024-09-22T08:54:37.292420+0000","last_clean":"2024-09-22T08:54:37.292420+0000","last_became_active":"2024-09-22T08:31:14.256054+0000","last_became_peered":"2024-09-22T08:31:14.256054+0000","last_unstale":"2024-09-22T08:54:37.292420+0000","last_undegraded":"2024-09-22T08:54:37.292420+0000","last_fullsized":"2024-09-22T08:54:37.292420+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"263'8","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.557856+0000","last_change":"2024-09-22T08:31:11.213551+0000","last_active":"2024-09-22T08:56:16.557856+0000","last_peered":"2024-09-22T08:56:16.557856+0000","last_clean":"2024-09-22T08:56:16.557856+0000","last_became_active":"2024-09-22T08:31:11.212539+0000","last_became_peered":"2024-09-22T08:31:11.212539+0000","last_unstale":"2024-09-22T08:56:16.557856+0000","last_undegraded":"2024-09-22T08:56:16.557856+0000","last_fullsized":"2024-09-22T08:56:16.557856+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":18,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"263'51","reported_seq":184,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:54.324685+0000","last_change":"2024-09-22T08:56:54.324685+0000","last_active":"2024-09-22T08:56:54.324685+0000","last_peered":"2024-09-22T08:56:54.324685+0000","last_clean":"2024-09-22T08:56:54.324685+0000","last_became_active":"2024-09-22T08:29:26.070576+0000","last_became_peered":"2024-09-22T08:29:26.070576+0000","last_unstale":"2024-09-22T08:56:54.324685+0000","last_undegraded":"2024-09-22T08:56:54.324685+0000","last_fullsized":"2024-09-22T08:56:54.324685+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'51","last_scrub_stamp":"2024-09-22T08:56:54.324596+0000","last_deep_scrub":"263'51","last_deep_scrub_stamp":"2024-09-22T08:56:54.324596+0000","last_clean_scrub_stamp":"2024-09-22T08:56:54.324596+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:06:24.019713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":389,"num_read_kb":252,"num_write":129,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:02.409119+0000","last_change":"2024-09-22T08:42:17.426058+0000","last_active":"2024-09-22T08:54:02.409119+0000","last_peered":"2024-09-22T08:54:02.409119+0000","last_clean":"2024-09-22T08:54:02.409119+0000","last_became_active":"2024-09-22T08:42:17.425759+0000","last_became_peered":"2024-09-22T08:42:17.425759+0000","last_unstale":"2024-09-22T08:54:02.409119+0000","last_undegraded":"2024-09-22T08:54:02.409119+0000","last_fullsized":"2024-09-22T08:54:02.409119+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:58:13.952750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"263'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.542918+0000","last_change":"2024-09-22T08:31:14.258185+0000","last_active":"2024-09-22T08:56:16.542918+0000","last_peered":"2024-09-22T08:56:16.542918+0000","last_clean":"2024-09-22T08:56:16.542918+0000","last_became_active":"2024-09-22T08:31:14.257900+0000","last_became_peered":"2024-09-22T08:31:14.257900+0000","last_unstale":"2024-09-22T08:56:16.542918+0000","last_undegraded":"2024-09-22T08:56:16.542918+0000","last_fullsized":"2024-09-22T08:56:16.542918+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":118,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"263'6","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:56.829934+0000","last_change":"2024-09-22T08:56:56.829934+0000","last_active":"2024-09-22T08:56:56.829934+0000","last_peered":"2024-09-22T08:56:56.829934+0000","last_clean":"2024-09-22T08:56:56.829934+0000","last_became_active":"2024-09-22T08:31:11.204846+0000","last_became_peered":"2024-09-22T08:31:11.204846+0000","last_unstale":"2024-09-22T08:56:56.829934+0000","last_undegraded":"2024-09-22T08:56:56.829934+0000","last_fullsized":"2024-09-22T08:56:56.829934+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-22T08:56:56.829835+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-22T08:56:56.829835+0000","last_clean_scrub_stamp":"2024-09-22T08:56:56.829835+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:53:05.522110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":6146,"num_write":6,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"263'48","reported_seq":181,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:54.191877+0000","last_change":"2024-09-22T08:56:54.191877+0000","last_active":"2024-09-22T08:56:54.191877+0000","last_peered":"2024-09-22T08:56:54.191877+0000","last_clean":"2024-09-22T08:56:54.191877+0000","last_became_active":"2024-09-22T08:29:26.063914+0000","last_became_peered":"2024-09-22T08:29:26.063914+0000","last_unstale":"2024-09-22T08:56:54.191877+0000","last_undegraded":"2024-09-22T08:56:54.191877+0000","last_fullsized":"2024-09-22T08:56:54.191877+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'48","last_scrub_stamp":"2024-09-22T08:56:54.191755+0000","last_deep_scrub":"263'48","last_deep_scrub_stamp":"2024-09-22T08:56:54.191755+0000","last_clean_scrub_stamp":"2024-09-22T08:56:54.191755+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:50:24.201000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":381,"num_read_kb":265,"num_write":119,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:22.290062+0000","last_change":"2024-09-22T08:42:17.431413+0000","last_active":"2024-09-22T08:54:22.290062+0000","last_peered":"2024-09-22T08:54:22.290062+0000","last_clean":"2024-09-22T08:54:22.290062+0000","last_became_active":"2024-09-22T08:42:17.429964+0000","last_became_peered":"2024-09-22T08:42:17.429964+0000","last_unstale":"2024-09-22T08:54:22.290062+0000","last_undegraded":"2024-09-22T08:54:22.290062+0000","last_fullsized":"2024-09-22T08:54:22.290062+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"260'4","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.400927+0000","last_change":"2024-09-22T08:31:14.260215+0000","last_active":"2024-09-22T08:54:38.400927+0000","last_peered":"2024-09-22T08:54:38.400927+0000","last_clean":"2024-09-22T08:54:38.400927+0000","last_became_active":"2024-09-22T08:31:14.259875+0000","last_became_peered":"2024-09-22T08:31:14.259875+0000","last_unstale":"2024-09-22T08:54:38.400927+0000","last_undegraded":"2024-09-22T08:54:38.400927+0000","last_fullsized":"2024-09-22T08:54:38.400927+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:55.837436+0000","last_change":"2024-09-22T08:56:55.837436+0000","last_active":"2024-09-22T08:56:55.837436+0000","last_peered":"2024-09-22T08:56:55.837436+0000","last_clean":"2024-09-22T08:56:55.837436+0000","last_became_active":"2024-09-22T08:31:11.210054+0000","last_became_peered":"2024-09-22T08:31:11.210054+0000","last_unstale":"2024-09-22T08:56:55.837436+0000","last_undegraded":"2024-09-22T08:56:55.837436+0000","last_fullsized":"2024-09-22T08:56:55.837436+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:55.837344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:55.837344+0000","last_clean_scrub_stamp":"2024-09-22T08:56:55.837344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:33:30.300629+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"263'31","reported_seq":137,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:53.336910+0000","last_change":"2024-09-22T08:56:53.336910+0000","last_active":"2024-09-22T08:56:53.336910+0000","last_peered":"2024-09-22T08:56:53.336910+0000","last_clean":"2024-09-22T08:56:53.336910+0000","last_became_active":"2024-09-22T08:29:26.070492+0000","last_became_peered":"2024-09-22T08:29:26.070492+0000","last_unstale":"2024-09-22T08:56:53.336910+0000","last_undegraded":"2024-09-22T08:56:53.336910+0000","last_fullsized":"2024-09-22T08:56:53.336910+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'31","last_scrub_stamp":"2024-09-22T08:56:53.336820+0000","last_deep_scrub":"263'31","last_deep_scrub_stamp":"2024-09-22T08:56:53.336820+0000","last_clean_scrub_stamp":"2024-09-22T08:56:53.336820+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:57:38.542593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":169,"num_write":83,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:12.279928+0000","last_change":"2024-09-22T08:42:17.433621+0000","last_active":"2024-09-22T08:53:12.279928+0000","last_peered":"2024-09-22T08:53:12.279928+0000","last_clean":"2024-09-22T08:53:12.279928+0000","last_became_active":"2024-09-22T08:42:17.433193+0000","last_became_peered":"2024-09-22T08:42:17.433193+0000","last_unstale":"2024-09-22T08:53:12.279928+0000","last_undegraded":"2024-09-22T08:53:12.279928+0000","last_fullsized":"2024-09-22T08:53:12.279928+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:13.472859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:47.294076+0000","last_change":"2024-09-22T08:31:14.255077+0000","last_active":"2024-09-22T08:53:47.294076+0000","last_peered":"2024-09-22T08:53:47.294076+0000","last_clean":"2024-09-22T08:53:47.294076+0000","last_became_active":"2024-09-22T08:31:14.254710+0000","last_became_peered":"2024-09-22T08:31:14.254710+0000","last_unstale":"2024-09-22T08:53:47.294076+0000","last_undegraded":"2024-09-22T08:53:47.294076+0000","last_fullsized":"2024-09-22T08:53:47.294076+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:21:50.613490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:57.145740+0000","last_change":"2024-09-22T08:56:57.145740+0000","last_active":"2024-09-22T08:56:57.145740+0000","last_peered":"2024-09-22T08:56:57.145740+0000","last_clean":"2024-09-22T08:56:57.145740+0000","last_became_active":"2024-09-22T08:31:11.203413+0000","last_became_peered":"2024-09-22T08:31:11.203413+0000","last_unstale":"2024-09-22T08:56:57.145740+0000","last_undegraded":"2024-09-22T08:56:57.145740+0000","last_fullsized":"2024-09-22T08:56:57.145740+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:57.145641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:57.145641+0000","last_clean_scrub_stamp":"2024-09-22T08:56:57.145641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:33:10.096611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:52.322127+0000","last_change":"2024-09-22T08:56:52.322127+0000","last_active":"2024-09-22T08:56:52.322127+0000","last_peered":"2024-09-22T08:56:52.322127+0000","last_clean":"2024-09-22T08:56:52.322127+0000","last_became_active":"2024-09-22T08:29:26.071742+0000","last_became_peered":"2024-09-22T08:29:26.071742+0000","last_unstale":"2024-09-22T08:56:52.322127+0000","last_undegraded":"2024-09-22T08:56:52.322127+0000","last_fullsized":"2024-09-22T08:56:52.322127+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:52.322037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:52.322037+0000","last_clean_scrub_stamp":"2024-09-22T08:56:52.322037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:50:38.510198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:59.819076+0000","last_change":"2024-09-22T08:56:59.819076+0000","last_active":"2024-09-22T08:56:59.819076+0000","last_peered":"2024-09-22T08:56:59.819076+0000","last_clean":"2024-09-22T08:56:59.819076+0000","last_became_active":"2024-09-22T08:42:17.433346+0000","last_became_peered":"2024-09-22T08:42:17.433346+0000","last_unstale":"2024-09-22T08:56:59.819076+0000","last_undegraded":"2024-09-22T08:56:59.819076+0000","last_fullsized":"2024-09-22T08:56:59.819076+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:59.818974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:59.818974+0000","last_clean_scrub_stamp":"2024-09-22T08:56:59.818974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:48:10.703277+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"260'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:47.294055+0000","last_change":"2024-09-22T08:31:14.256186+0000","last_active":"2024-09-22T08:53:47.294055+0000","last_peered":"2024-09-22T08:53:47.294055+0000","last_clean":"2024-09-22T08:53:47.294055+0000","last_became_active":"2024-09-22T08:31:14.255243+0000","last_became_peered":"2024-09-22T08:31:14.255243+0000","last_unstale":"2024-09-22T08:53:47.294055+0000","last_undegraded":"2024-09-22T08:53:47.294055+0000","last_fullsized":"2024-09-22T08:53:47.294055+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:14:49.285058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"263'6","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:00.630131+0000","last_change":"2024-09-22T08:57:00.630131+0000","last_active":"2024-09-22T08:57:00.630131+0000","last_peered":"2024-09-22T08:57:00.630131+0000","last_clean":"2024-09-22T08:57:00.630131+0000","last_became_active":"2024-09-22T08:31:11.210266+0000","last_became_peered":"2024-09-22T08:31:11.210266+0000","last_unstale":"2024-09-22T08:57:00.630131+0000","last_undegraded":"2024-09-22T08:57:00.630131+0000","last_fullsized":"2024-09-22T08:57:00.630131+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-22T08:57:00.630042+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-22T08:57:00.630042+0000","last_clean_scrub_stamp":"2024-09-22T08:57:00.630042+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:33:15.019806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":13312,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"263'39","reported_seq":149,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:13.398267+0000","last_change":"2024-09-22T08:29:26.076488+0000","last_active":"2024-09-22T08:54:13.398267+0000","last_peered":"2024-09-22T08:54:13.398267+0000","last_clean":"2024-09-22T08:54:13.398267+0000","last_became_active":"2024-09-22T08:29:26.076175+0000","last_became_peered":"2024-09-22T08:29:26.076175+0000","last_unstale":"2024-09-22T08:54:13.398267+0000","last_undegraded":"2024-09-22T08:54:13.398267+0000","last_fullsized":"2024-09-22T08:54:13.398267+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":317,"num_read_kb":219,"num_write":102,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:08.390223+0000","last_change":"2024-09-22T08:42:17.435167+0000","last_active":"2024-09-22T08:53:08.390223+0000","last_peered":"2024-09-22T08:53:08.390223+0000","last_clean":"2024-09-22T08:53:08.390223+0000","last_became_active":"2024-09-22T08:42:17.434909+0000","last_became_peered":"2024-09-22T08:42:17.434909+0000","last_unstale":"2024-09-22T08:53:08.390223+0000","last_undegraded":"2024-09-22T08:53:08.390223+0000","last_fullsized":"2024-09-22T08:53:08.390223+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:22.417079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"263'4","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:07.313078+0000","last_change":"2024-09-22T08:31:14.252478+0000","last_active":"2024-09-22T08:56:07.313078+0000","last_peered":"2024-09-22T08:56:07.313078+0000","last_clean":"2024-09-22T08:56:07.313078+0000","last_became_active":"2024-09-22T08:31:14.252184+0000","last_became_peered":"2024-09-22T08:31:14.252184+0000","last_unstale":"2024-09-22T08:56:07.313078+0000","last_undegraded":"2024-09-22T08:56:07.313078+0000","last_fullsized":"2024-09-22T08:56:07.313078+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:09.321417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":4,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"263'2","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:59.322125+0000","last_change":"2024-09-22T08:56:59.322125+0000","last_active":"2024-09-22T08:56:59.322125+0000","last_peered":"2024-09-22T08:56:59.322125+0000","last_clean":"2024-09-22T08:56:59.322125+0000","last_became_active":"2024-09-22T08:31:11.217115+0000","last_became_peered":"2024-09-22T08:31:11.217115+0000","last_unstale":"2024-09-22T08:56:59.322125+0000","last_undegraded":"2024-09-22T08:56:59.322125+0000","last_fullsized":"2024-09-22T08:56:59.322125+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:56:59.322031+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:56:59.322031+0000","last_clean_scrub_stamp":"2024-09-22T08:56:59.322031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:45:40.706530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"263'57","reported_seq":201,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:51.745977+0000","last_change":"2024-09-22T08:56:51.745977+0000","last_active":"2024-09-22T08:56:51.745977+0000","last_peered":"2024-09-22T08:56:51.745977+0000","last_clean":"2024-09-22T08:56:51.745977+0000","last_became_active":"2024-09-22T08:29:26.076048+0000","last_became_peered":"2024-09-22T08:29:26.076048+0000","last_unstale":"2024-09-22T08:56:51.745977+0000","last_undegraded":"2024-09-22T08:56:51.745977+0000","last_fullsized":"2024-09-22T08:56:51.745977+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'57","last_scrub_stamp":"2024-09-22T08:56:51.745876+0000","last_deep_scrub":"263'57","last_deep_scrub_stamp":"2024-09-22T08:56:51.745876+0000","last_clean_scrub_stamp":"2024-09-22T08:56:51.745876+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:20:20.278906+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":427,"num_read_kb":265,"num_write":151,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:57.786599+0000","last_change":"2024-09-22T08:56:57.786599+0000","last_active":"2024-09-22T08:56:57.786599+0000","last_peered":"2024-09-22T08:56:57.786599+0000","last_clean":"2024-09-22T08:56:57.786599+0000","last_became_active":"2024-09-22T08:42:17.430974+0000","last_became_peered":"2024-09-22T08:42:17.430974+0000","last_unstale":"2024-09-22T08:56:57.786599+0000","last_undegraded":"2024-09-22T08:56:57.786599+0000","last_fullsized":"2024-09-22T08:56:57.786599+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:57.786504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:57.786504+0000","last_clean_scrub_stamp":"2024-09-22T08:56:57.786504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:22.256524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"260'3","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:47.284984+0000","last_change":"2024-09-22T08:31:14.258289+0000","last_active":"2024-09-22T08:53:47.284984+0000","last_peered":"2024-09-22T08:53:47.284984+0000","last_clean":"2024-09-22T08:53:47.284984+0000","last_became_active":"2024-09-22T08:31:14.257952+0000","last_became_peered":"2024-09-22T08:31:14.257952+0000","last_unstale":"2024-09-22T08:53:47.284984+0000","last_undegraded":"2024-09-22T08:53:47.284984+0000","last_fullsized":"2024-09-22T08:53:47.284984+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:26:33.079615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:00.354699+0000","last_change":"2024-09-22T08:57:00.354699+0000","last_active":"2024-09-22T08:57:00.354699+0000","last_peered":"2024-09-22T08:57:00.354699+0000","last_clean":"2024-09-22T08:57:00.354699+0000","last_became_active":"2024-09-22T08:31:11.213273+0000","last_became_peered":"2024-09-22T08:31:11.213273+0000","last_unstale":"2024-09-22T08:57:00.354699+0000","last_undegraded":"2024-09-22T08:57:00.354699+0000","last_fullsized":"2024-09-22T08:57:00.354699+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:00.354599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:00.354599+0000","last_clean_scrub_stamp":"2024-09-22T08:57:00.354599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:47:58.169764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"263'16","reported_seq":92,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:54.621356+0000","last_change":"2024-09-22T08:56:54.621356+0000","last_active":"2024-09-22T08:56:54.621356+0000","last_peered":"2024-09-22T08:56:54.621356+0000","last_clean":"2024-09-22T08:56:54.621356+0000","last_became_active":"2024-09-22T08:29:26.074205+0000","last_became_peered":"2024-09-22T08:29:26.074205+0000","last_unstale":"2024-09-22T08:56:54.621356+0000","last_undegraded":"2024-09-22T08:56:54.621356+0000","last_fullsized":"2024-09-22T08:56:54.621356+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'16","last_scrub_stamp":"2024-09-22T08:56:54.621263+0000","last_deep_scrub":"263'16","last_deep_scrub_stamp":"2024-09-22T08:56:54.621263+0000","last_clean_scrub_stamp":"2024-09-22T08:56:54.621263+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:57.139031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":71,"num_write":43,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:32.283041+0000","last_change":"2024-09-22T08:42:17.430839+0000","last_active":"2024-09-22T08:53:32.283041+0000","last_peered":"2024-09-22T08:53:32.283041+0000","last_clean":"2024-09-22T08:53:32.283041+0000","last_became_active":"2024-09-22T08:42:17.429927+0000","last_became_peered":"2024-09-22T08:42:17.429927+0000","last_unstale":"2024-09-22T08:53:32.283041+0000","last_undegraded":"2024-09-22T08:53:32.283041+0000","last_fullsized":"2024-09-22T08:53:32.283041+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:28:06.806210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"263'6","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:08.404715+0000","last_change":"2024-09-22T08:31:14.253906+0000","last_active":"2024-09-22T08:55:08.404715+0000","last_peered":"2024-09-22T08:55:08.404715+0000","last_clean":"2024-09-22T08:55:08.404715+0000","last_became_active":"2024-09-22T08:31:14.253610+0000","last_became_peered":"2024-09-22T08:31:14.253610+0000","last_unstale":"2024-09-22T08:55:08.404715+0000","last_undegraded":"2024-09-22T08:55:08.404715+0000","last_fullsized":"2024-09-22T08:55:08.404715+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:13:39.366489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13314,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"263'4","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:56.374086+0000","last_change":"2024-09-22T08:56:56.374086+0000","last_active":"2024-09-22T08:56:56.374086+0000","last_peered":"2024-09-22T08:56:56.374086+0000","last_clean":"2024-09-22T08:56:56.374086+0000","last_became_active":"2024-09-22T08:31:11.217553+0000","last_became_peered":"2024-09-22T08:31:11.217553+0000","last_unstale":"2024-09-22T08:56:56.374086+0000","last_undegraded":"2024-09-22T08:56:56.374086+0000","last_fullsized":"2024-09-22T08:56:56.374086+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-22T08:56:56.373995+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-22T08:56:56.373995+0000","last_clean_scrub_stamp":"2024-09-22T08:56:56.373995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:14:14.629754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"263'36","reported_seq":143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:53.575640+0000","last_change":"2024-09-22T08:56:53.575640+0000","last_active":"2024-09-22T08:56:53.575640+0000","last_peered":"2024-09-22T08:56:53.575640+0000","last_clean":"2024-09-22T08:56:53.575640+0000","last_became_active":"2024-09-22T08:29:26.070671+0000","last_became_peered":"2024-09-22T08:29:26.070671+0000","last_unstale":"2024-09-22T08:56:53.575640+0000","last_undegraded":"2024-09-22T08:56:53.575640+0000","last_fullsized":"2024-09-22T08:56:53.575640+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'36","last_scrub_stamp":"2024-09-22T08:56:53.575555+0000","last_deep_scrub":"263'36","last_deep_scrub_stamp":"2024-09-22T08:56:53.575555+0000","last_clean_scrub_stamp":"2024-09-22T08:56:53.575555+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:45:32.893922+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":255,"num_read_kb":155,"num_write":90,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:36.270019+0000","last_change":"2024-09-22T08:42:17.433684+0000","last_active":"2024-09-22T08:53:36.270019+0000","last_peered":"2024-09-22T08:53:36.270019+0000","last_clean":"2024-09-22T08:53:36.270019+0000","last_became_active":"2024-09-22T08:42:17.433331+0000","last_became_peered":"2024-09-22T08:42:17.433331+0000","last_unstale":"2024-09-22T08:53:36.270019+0000","last_undegraded":"2024-09-22T08:53:36.270019+0000","last_fullsized":"2024-09-22T08:53:36.270019+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:19:35.698543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"263'4","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:01.134811+0000","last_change":"2024-09-22T08:57:01.134811+0000","last_active":"2024-09-22T08:57:01.134811+0000","last_peered":"2024-09-22T08:57:01.134811+0000","last_clean":"2024-09-22T08:57:01.134811+0000","last_became_active":"2024-09-22T08:31:14.253118+0000","last_became_peered":"2024-09-22T08:31:14.253118+0000","last_unstale":"2024-09-22T08:57:01.134811+0000","last_undegraded":"2024-09-22T08:57:01.134811+0000","last_fullsized":"2024-09-22T08:57:01.134811+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-22T08:57:01.134699+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-22T08:57:01.134699+0000","last_clean_scrub_stamp":"2024-09-22T08:57:01.134699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:53:52.098956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"263'9","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:02.296482+0000","last_change":"2024-09-22T08:31:11.212852+0000","last_active":"2024-09-22T08:55:02.296482+0000","last_peered":"2024-09-22T08:55:02.296482+0000","last_clean":"2024-09-22T08:55:02.296482+0000","last_became_active":"2024-09-22T08:31:11.211939+0000","last_became_peered":"2024-09-22T08:31:11.211939+0000","last_unstale":"2024-09-22T08:55:02.296482+0000","last_undegraded":"2024-09-22T08:55:02.296482+0000","last_fullsized":"2024-09-22T08:55:02.296482+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:24:50.321996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":24578,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"263'43","reported_seq":163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:53.199125+0000","last_change":"2024-09-22T08:56:53.199125+0000","last_active":"2024-09-22T08:56:53.199125+0000","last_peered":"2024-09-22T08:56:53.199125+0000","last_clean":"2024-09-22T08:56:53.199125+0000","last_became_active":"2024-09-22T08:29:26.069202+0000","last_became_peered":"2024-09-22T08:29:26.069202+0000","last_unstale":"2024-09-22T08:56:53.199125+0000","last_undegraded":"2024-09-22T08:56:53.199125+0000","last_fullsized":"2024-09-22T08:56:53.199125+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'43","last_scrub_stamp":"2024-09-22T08:56:53.199033+0000","last_deep_scrub":"263'43","last_deep_scrub_stamp":"2024-09-22T08:56:53.199033+0000","last_clean_scrub_stamp":"2024-09-22T08:56:53.199033+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:07:35.698271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":316,"num_read_kb":207,"num_write":121,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"263'2","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:57.326140+0000","last_change":"2024-09-22T08:56:57.326140+0000","last_active":"2024-09-22T08:56:57.326140+0000","last_peered":"2024-09-22T08:56:57.326140+0000","last_clean":"2024-09-22T08:56:57.326140+0000","last_became_active":"2024-09-22T08:42:17.436036+0000","last_became_peered":"2024-09-22T08:42:17.436036+0000","last_unstale":"2024-09-22T08:56:57.326140+0000","last_undegraded":"2024-09-22T08:56:57.326140+0000","last_fullsized":"2024-09-22T08:56:57.326140+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:56:57.326045+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:56:57.326045+0000","last_clean_scrub_stamp":"2024-09-22T08:56:57.326045+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:40:52.083802+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"260'6","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:47.284803+0000","last_change":"2024-09-22T08:31:14.260840+0000","last_active":"2024-09-22T08:53:47.284803+0000","last_peered":"2024-09-22T08:53:47.284803+0000","last_clean":"2024-09-22T08:53:47.284803+0000","last_became_active":"2024-09-22T08:31:14.260111+0000","last_became_peered":"2024-09-22T08:31:14.260111+0000","last_unstale":"2024-09-22T08:53:47.284803+0000","last_undegraded":"2024-09-22T08:53:47.284803+0000","last_fullsized":"2024-09-22T08:53:47.284803+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:54:00.288860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"263'5","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:58.340811+0000","last_change":"2024-09-22T08:56:58.340811+0000","last_active":"2024-09-22T08:56:58.340811+0000","last_peered":"2024-09-22T08:56:58.340811+0000","last_clean":"2024-09-22T08:56:58.340811+0000","last_became_active":"2024-09-22T08:31:11.213121+0000","last_became_peered":"2024-09-22T08:31:11.213121+0000","last_unstale":"2024-09-22T08:56:58.340811+0000","last_undegraded":"2024-09-22T08:56:58.340811+0000","last_fullsized":"2024-09-22T08:56:58.340811+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-22T08:56:58.340717+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-22T08:56:58.340717+0000","last_clean_scrub_stamp":"2024-09-22T08:56:58.340717+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:54:56.570156+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"263'24","reported_seq":114,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:01.478185+0000","last_change":"2024-09-22T08:57:01.478185+0000","last_active":"2024-09-22T08:57:01.478185+0000","last_peered":"2024-09-22T08:57:01.478185+0000","last_clean":"2024-09-22T08:57:01.478185+0000","last_became_active":"2024-09-22T08:29:26.068397+0000","last_became_peered":"2024-09-22T08:29:26.068397+0000","last_unstale":"2024-09-22T08:57:01.478185+0000","last_undegraded":"2024-09-22T08:57:01.478185+0000","last_fullsized":"2024-09-22T08:57:01.478185+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'24","last_scrub_stamp":"2024-09-22T08:57:01.478102+0000","last_deep_scrub":"263'24","last_deep_scrub_stamp":"2024-09-22T08:57:01.478102+0000","last_clean_scrub_stamp":"2024-09-22T08:57:01.478102+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:43:15.925512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":108,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:32.292011+0000","last_change":"2024-09-22T08:42:17.431775+0000","last_active":"2024-09-22T08:53:32.292011+0000","last_peered":"2024-09-22T08:53:32.292011+0000","last_clean":"2024-09-22T08:53:32.292011+0000","last_became_active":"2024-09-22T08:42:17.431476+0000","last_became_peered":"2024-09-22T08:42:17.431476+0000","last_unstale":"2024-09-22T08:53:32.292011+0000","last_undegraded":"2024-09-22T08:53:32.292011+0000","last_fullsized":"2024-09-22T08:53:32.292011+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:20.126935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"263'2","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:53.336561+0000","last_change":"2024-09-22T08:56:53.336561+0000","last_active":"2024-09-22T08:56:53.336561+0000","last_peered":"2024-09-22T08:56:53.336561+0000","last_clean":"2024-09-22T08:56:53.336561+0000","last_became_active":"2024-09-22T08:31:14.257508+0000","last_became_peered":"2024-09-22T08:31:14.257508+0000","last_unstale":"2024-09-22T08:56:53.336561+0000","last_undegraded":"2024-09-22T08:56:53.336561+0000","last_fullsized":"2024-09-22T08:56:53.336561+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:56:53.336464+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:56:53.336464+0000","last_clean_scrub_stamp":"2024-09-22T08:56:53.336464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:16.822824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:43.394740+0000","last_change":"2024-09-22T08:31:11.215332+0000","last_active":"2024-09-22T08:53:43.394740+0000","last_peered":"2024-09-22T08:53:43.394740+0000","last_clean":"2024-09-22T08:53:43.394740+0000","last_became_active":"2024-09-22T08:31:11.214953+0000","last_became_peered":"2024-09-22T08:31:11.214953+0000","last_unstale":"2024-09-22T08:53:43.394740+0000","last_undegraded":"2024-09-22T08:53:43.394740+0000","last_fullsized":"2024-09-22T08:53:43.394740+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:54:54.175587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"263'16","reported_seq":96,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:50.335050+0000","last_change":"2024-09-22T08:56:50.335050+0000","last_active":"2024-09-22T08:56:50.335050+0000","last_peered":"2024-09-22T08:56:50.335050+0000","last_clean":"2024-09-22T08:56:50.335050+0000","last_became_active":"2024-09-22T08:29:26.072473+0000","last_became_peered":"2024-09-22T08:29:26.072473+0000","last_unstale":"2024-09-22T08:56:50.335050+0000","last_undegraded":"2024-09-22T08:56:50.335050+0000","last_fullsized":"2024-09-22T08:56:50.335050+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'16","last_scrub_stamp":"2024-09-22T08:56:50.334964+0000","last_deep_scrub":"263'16","last_deep_scrub_stamp":"2024-09-22T08:56:50.334964+0000","last_clean_scrub_stamp":"2024-09-22T08:56:50.334964+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:21:18.083176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":83,"num_write":41,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:56.327182+0000","last_change":"2024-09-22T08:56:56.327182+0000","last_active":"2024-09-22T08:56:56.327182+0000","last_peered":"2024-09-22T08:56:56.327182+0000","last_clean":"2024-09-22T08:56:56.327182+0000","last_became_active":"2024-09-22T08:42:17.431637+0000","last_became_peered":"2024-09-22T08:42:17.431637+0000","last_unstale":"2024-09-22T08:56:56.327182+0000","last_undegraded":"2024-09-22T08:56:56.327182+0000","last_fullsized":"2024-09-22T08:56:56.327182+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:56.327086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:56.327086+0000","last_clean_scrub_stamp":"2024-09-22T08:56:56.327086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:42:07.844288+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"263'4","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.543285+0000","last_change":"2024-09-22T08:31:14.261671+0000","last_active":"2024-09-22T08:56:16.543285+0000","last_peered":"2024-09-22T08:56:16.543285+0000","last_clean":"2024-09-22T08:56:16.543285+0000","last_became_active":"2024-09-22T08:31:14.261352+0000","last_became_peered":"2024-09-22T08:31:14.261352+0000","last_unstale":"2024-09-22T08:56:16.543285+0000","last_undegraded":"2024-09-22T08:56:16.543285+0000","last_fullsized":"2024-09-22T08:56:16.543285+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:19:15.325599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"263'6","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:13.412983+0000","last_change":"2024-09-22T08:31:11.216385+0000","last_active":"2024-09-22T08:56:13.412983+0000","last_peered":"2024-09-22T08:56:13.412983+0000","last_clean":"2024-09-22T08:56:13.412983+0000","last_became_active":"2024-09-22T08:31:11.216081+0000","last_became_peered":"2024-09-22T08:31:11.216081+0000","last_unstale":"2024-09-22T08:56:13.412983+0000","last_undegraded":"2024-09-22T08:56:13.412983+0000","last_fullsized":"2024-09-22T08:56:13.412983+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:17:40.729275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":6,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"253'4","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:59.869302+0000","last_change":"2024-09-22T08:56:59.869302+0000","last_active":"2024-09-22T08:56:59.869302+0000","last_peered":"2024-09-22T08:56:59.869302+0000","last_clean":"2024-09-22T08:56:59.869302+0000","last_became_active":"2024-09-22T08:29:26.072681+0000","last_became_peered":"2024-09-22T08:29:26.072681+0000","last_unstale":"2024-09-22T08:56:59.869302+0000","last_undegraded":"2024-09-22T08:56:59.869302+0000","last_fullsized":"2024-09-22T08:56:59.869302+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"253'4","last_scrub_stamp":"2024-09-22T08:56:59.869208+0000","last_deep_scrub":"253'4","last_deep_scrub_stamp":"2024-09-22T08:56:59.869208+0000","last_clean_scrub_stamp":"2024-09-22T08:56:59.869208+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:47:15.670371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:00.277533+0000","last_change":"2024-09-22T08:57:00.277533+0000","last_active":"2024-09-22T08:57:00.277533+0000","last_peered":"2024-09-22T08:57:00.277533+0000","last_clean":"2024-09-22T08:57:00.277533+0000","last_became_active":"2024-09-22T08:42:17.430084+0000","last_became_peered":"2024-09-22T08:42:17.430084+0000","last_unstale":"2024-09-22T08:57:00.277533+0000","last_undegraded":"2024-09-22T08:57:00.277533+0000","last_fullsized":"2024-09-22T08:57:00.277533+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:00.277439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:00.277439+0000","last_clean_scrub_stamp":"2024-09-22T08:57:00.277439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:21:36.717278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"260'2","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:12.288667+0000","last_change":"2024-09-22T08:31:14.259915+0000","last_active":"2024-09-22T08:54:12.288667+0000","last_peered":"2024-09-22T08:54:12.288667+0000","last_clean":"2024-09-22T08:54:12.288667+0000","last_became_active":"2024-09-22T08:31:14.259624+0000","last_became_peered":"2024-09-22T08:31:14.259624+0000","last_unstale":"2024-09-22T08:54:12.288667+0000","last_undegraded":"2024-09-22T08:54:12.288667+0000","last_fullsized":"2024-09-22T08:54:12.288667+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:44:39.512910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"263'5","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.510695+0000","last_change":"2024-09-22T08:31:11.214838+0000","last_active":"2024-09-22T08:56:16.510695+0000","last_peered":"2024-09-22T08:56:16.510695+0000","last_clean":"2024-09-22T08:56:16.510695+0000","last_became_active":"2024-09-22T08:31:11.214279+0000","last_became_peered":"2024-09-22T08:31:11.214279+0000","last_unstale":"2024-09-22T08:56:16.510695+0000","last_undegraded":"2024-09-22T08:56:16.510695+0000","last_fullsized":"2024-09-22T08:56:16.510695+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:50:49.253194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"263'2","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:18.391441+0000","last_change":"2024-09-22T08:29:26.075341+0000","last_active":"2024-09-22T08:53:18.391441+0000","last_peered":"2024-09-22T08:53:18.391441+0000","last_clean":"2024-09-22T08:53:18.391441+0000","last_became_active":"2024-09-22T08:29:26.074971+0000","last_became_peered":"2024-09-22T08:29:26.074971+0000","last_unstale":"2024-09-22T08:53:18.391441+0000","last_undegraded":"2024-09-22T08:53:18.391441+0000","last_fullsized":"2024-09-22T08:53:18.391441+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:38:15.699643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:22.290069+0000","last_change":"2024-09-22T08:42:17.433389+0000","last_active":"2024-09-22T08:54:22.290069+0000","last_peered":"2024-09-22T08:54:22.290069+0000","last_clean":"2024-09-22T08:54:22.290069+0000","last_became_active":"2024-09-22T08:42:17.433090+0000","last_became_peered":"2024-09-22T08:42:17.433090+0000","last_unstale":"2024-09-22T08:54:22.290069+0000","last_undegraded":"2024-09-22T08:54:22.290069+0000","last_fullsized":"2024-09-22T08:54:22.290069+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:05:15.147705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"260'2","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:52.357978+0000","last_change":"2024-09-22T08:56:52.357978+0000","last_active":"2024-09-22T08:56:52.357978+0000","last_peered":"2024-09-22T08:56:52.357978+0000","last_clean":"2024-09-22T08:56:52.357978+0000","last_became_active":"2024-09-22T08:31:14.256835+0000","last_became_peered":"2024-09-22T08:31:14.256835+0000","last_unstale":"2024-09-22T08:56:52.357978+0000","last_undegraded":"2024-09-22T08:56:52.357978+0000","last_fullsized":"2024-09-22T08:56:52.357978+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-22T08:56:52.357881+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-22T08:56:52.357881+0000","last_clean_scrub_stamp":"2024-09-22T08:56:52.357881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:07:30.389570+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"263'5","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:00.175527+0000","last_change":"2024-09-22T08:57:00.175527+0000","last_active":"2024-09-22T08:57:00.175527+0000","last_peered":"2024-09-22T08:57:00.175527+0000","last_clean":"2024-09-22T08:57:00.175527+0000","last_became_active":"2024-09-22T08:31:11.212487+0000","last_became_peered":"2024-09-22T08:31:11.212487+0000","last_unstale":"2024-09-22T08:57:00.175527+0000","last_undegraded":"2024-09-22T08:57:00.175527+0000","last_fullsized":"2024-09-22T08:57:00.175527+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-22T08:57:00.175434+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-22T08:57:00.175434+0000","last_clean_scrub_stamp":"2024-09-22T08:57:00.175434+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:20:34.588796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"263'131","reported_seq":440,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:52.231836+0000","last_change":"2024-09-22T08:56:52.231836+0000","last_active":"2024-09-22T08:56:52.231836+0000","last_peered":"2024-09-22T08:56:52.231836+0000","last_clean":"2024-09-22T08:56:52.231836+0000","last_became_active":"2024-09-22T08:29:26.067149+0000","last_became_peered":"2024-09-22T08:29:26.067149+0000","last_unstale":"2024-09-22T08:56:52.231836+0000","last_undegraded":"2024-09-22T08:56:52.231836+0000","last_fullsized":"2024-09-22T08:56:52.231836+0000","mapping_epoch":252,"log_start":"260'100","ondisk_log_start":"260'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'131","last_scrub_stamp":"2024-09-22T08:56:52.231731+0000","last_deep_scrub":"263'131","last_deep_scrub_stamp":"2024-09-22T08:56:52.231731+0000","last_clean_scrub_stamp":"2024-09-22T08:56:52.231731+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:22:59.688170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1238,"num_read_kb":970,"num_write":283,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:48.402193+0000","last_change":"2024-09-22T08:42:17.435234+0000","last_active":"2024-09-22T08:54:48.402193+0000","last_peered":"2024-09-22T08:54:48.402193+0000","last_clean":"2024-09-22T08:54:48.402193+0000","last_became_active":"2024-09-22T08:42:17.434424+0000","last_became_peered":"2024-09-22T08:42:17.434424+0000","last_unstale":"2024-09-22T08:54:48.402193+0000","last_undegraded":"2024-09-22T08:54:48.402193+0000","last_fullsized":"2024-09-22T08:54:48.402193+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"260'9","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:58.389082+0000","last_change":"2024-09-22T08:31:14.255605+0000","last_active":"2024-09-22T08:52:58.389082+0000","last_peered":"2024-09-22T08:52:58.389082+0000","last_clean":"2024-09-22T08:52:58.389082+0000","last_became_active":"2024-09-22T08:31:14.255160+0000","last_became_peered":"2024-09-22T08:31:14.255160+0000","last_unstale":"2024-09-22T08:52:58.389082+0000","last_undegraded":"2024-09-22T08:52:58.389082+0000","last_fullsized":"2024-09-22T08:52:58.389082+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:32:19.999119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":23554,"num_write":14,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:53.388519+0000","last_change":"2024-09-22T08:31:11.216563+0000","last_active":"2024-09-22T08:52:53.388519+0000","last_peered":"2024-09-22T08:52:53.388519+0000","last_clean":"2024-09-22T08:52:53.388519+0000","last_became_active":"2024-09-22T08:31:11.216271+0000","last_became_peered":"2024-09-22T08:31:11.216271+0000","last_unstale":"2024-09-22T08:52:53.388519+0000","last_undegraded":"2024-09-22T08:52:53.388519+0000","last_fullsized":"2024-09-22T08:52:53.388519+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:55:11.448805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"263'19","reported_seq":106,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:51.321427+0000","last_change":"2024-09-22T08:56:51.321427+0000","last_active":"2024-09-22T08:56:51.321427+0000","last_peered":"2024-09-22T08:56:51.321427+0000","last_clean":"2024-09-22T08:56:51.321427+0000","last_became_active":"2024-09-22T08:29:26.069730+0000","last_became_peered":"2024-09-22T08:29:26.069730+0000","last_unstale":"2024-09-22T08:56:51.321427+0000","last_undegraded":"2024-09-22T08:56:51.321427+0000","last_fullsized":"2024-09-22T08:56:51.321427+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'19","last_scrub_stamp":"2024-09-22T08:56:51.321334+0000","last_deep_scrub":"263'19","last_deep_scrub_stamp":"2024-09-22T08:56:51.321334+0000","last_clean_scrub_stamp":"2024-09-22T08:56:51.321334+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:10:54.081036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":95,"num_write":48,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:07.288626+0000","last_change":"2024-09-22T08:42:17.419131+0000","last_active":"2024-09-22T08:53:07.288626+0000","last_peered":"2024-09-22T08:53:07.288626+0000","last_clean":"2024-09-22T08:53:07.288626+0000","last_became_active":"2024-09-22T08:42:17.418864+0000","last_became_peered":"2024-09-22T08:42:17.418864+0000","last_unstale":"2024-09-22T08:53:07.288626+0000","last_undegraded":"2024-09-22T08:53:07.288626+0000","last_fullsized":"2024-09-22T08:53:07.288626+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:05:15.592372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"263'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.434270+0000","last_change":"2024-09-22T08:31:14.259787+0000","last_active":"2024-09-22T08:56:16.434270+0000","last_peered":"2024-09-22T08:56:16.434270+0000","last_clean":"2024-09-22T08:56:16.434270+0000","last_became_active":"2024-09-22T08:31:14.259485+0000","last_became_peered":"2024-09-22T08:31:14.259485+0000","last_unstale":"2024-09-22T08:56:16.434270+0000","last_undegraded":"2024-09-22T08:56:16.434270+0000","last_fullsized":"2024-09-22T08:56:16.434270+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:38:49.843585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"260'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:55.152766+0000","last_change":"2024-09-22T08:56:55.152766+0000","last_active":"2024-09-22T08:56:55.152766+0000","last_peered":"2024-09-22T08:56:55.152766+0000","last_clean":"2024-09-22T08:56:55.152766+0000","last_became_active":"2024-09-22T08:31:11.210835+0000","last_became_peered":"2024-09-22T08:31:11.210835+0000","last_unstale":"2024-09-22T08:56:55.152766+0000","last_undegraded":"2024-09-22T08:56:55.152766+0000","last_fullsized":"2024-09-22T08:56:55.152766+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-22T08:56:55.152666+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-22T08:56:55.152666+0000","last_clean_scrub_stamp":"2024-09-22T08:56:55.152666+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:18:21.293821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"263'36","reported_seq":154,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:51.253039+0000","last_change":"2024-09-22T08:56:51.253039+0000","last_active":"2024-09-22T08:56:51.253039+0000","last_peered":"2024-09-22T08:56:51.253039+0000","last_clean":"2024-09-22T08:56:51.253039+0000","last_became_active":"2024-09-22T08:29:26.068105+0000","last_became_peered":"2024-09-22T08:29:26.068105+0000","last_unstale":"2024-09-22T08:56:51.253039+0000","last_undegraded":"2024-09-22T08:56:51.253039+0000","last_fullsized":"2024-09-22T08:56:51.253039+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'36","last_scrub_stamp":"2024-09-22T08:56:51.252932+0000","last_deep_scrub":"263'36","last_deep_scrub_stamp":"2024-09-22T08:56:51.252932+0000","last_clean_scrub_stamp":"2024-09-22T08:56:51.252932+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:06:36.903602+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":308,"num_read_kb":184,"num_write":90,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:07.401463+0000","last_change":"2024-09-22T08:42:17.435288+0000","last_active":"2024-09-22T08:53:07.401463+0000","last_peered":"2024-09-22T08:53:07.401463+0000","last_clean":"2024-09-22T08:53:07.401463+0000","last_became_active":"2024-09-22T08:42:17.434953+0000","last_became_peered":"2024-09-22T08:42:17.434953+0000","last_unstale":"2024-09-22T08:53:07.401463+0000","last_undegraded":"2024-09-22T08:53:07.401463+0000","last_fullsized":"2024-09-22T08:53:07.401463+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:45:12.549260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"260'2","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:18.391339+0000","last_change":"2024-09-22T08:31:14.255977+0000","last_active":"2024-09-22T08:53:18.391339+0000","last_peered":"2024-09-22T08:53:18.391339+0000","last_clean":"2024-09-22T08:53:18.391339+0000","last_became_active":"2024-09-22T08:31:14.255534+0000","last_became_peered":"2024-09-22T08:31:14.255534+0000","last_unstale":"2024-09-22T08:53:18.391339+0000","last_undegraded":"2024-09-22T08:53:18.391339+0000","last_fullsized":"2024-09-22T08:53:18.391339+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:09:54.469702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"263'6","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:13.412902+0000","last_change":"2024-09-22T08:31:11.214320+0000","last_active":"2024-09-22T08:56:13.412902+0000","last_peered":"2024-09-22T08:56:13.412902+0000","last_clean":"2024-09-22T08:56:13.412902+0000","last_became_active":"2024-09-22T08:31:11.213851+0000","last_became_peered":"2024-09-22T08:31:11.213851+0000","last_unstale":"2024-09-22T08:56:13.412902+0000","last_undegraded":"2024-09-22T08:56:13.412902+0000","last_fullsized":"2024-09-22T08:56:13.412902+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:24:21.493458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":6146,"num_write":6,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"263'4","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:28.399787+0000","last_change":"2024-09-22T08:29:26.075210+0000","last_active":"2024-09-22T08:54:28.399787+0000","last_peered":"2024-09-22T08:54:28.399787+0000","last_clean":"2024-09-22T08:54:28.399787+0000","last_became_active":"2024-09-22T08:29:26.074907+0000","last_became_peered":"2024-09-22T08:29:26.074907+0000","last_unstale":"2024-09-22T08:54:28.399787+0000","last_undegraded":"2024-09-22T08:54:28.399787+0000","last_fullsized":"2024-09-22T08:54:28.399787+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:47.293958+0000","last_change":"2024-09-22T08:42:17.430325+0000","last_active":"2024-09-22T08:54:47.293958+0000","last_peered":"2024-09-22T08:54:47.293958+0000","last_clean":"2024-09-22T08:54:47.293958+0000","last_became_active":"2024-09-22T08:42:17.429341+0000","last_became_peered":"2024-09-22T08:42:17.429341+0000","last_unstale":"2024-09-22T08:54:47.293958+0000","last_undegraded":"2024-09-22T08:54:47.293958+0000","last_fullsized":"2024-09-22T08:54:47.293958+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"263'4","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:59.125351+0000","last_change":"2024-09-22T08:56:59.125351+0000","last_active":"2024-09-22T08:56:59.125351+0000","last_peered":"2024-09-22T08:56:59.125351+0000","last_clean":"2024-09-22T08:56:59.125351+0000","last_became_active":"2024-09-22T08:31:14.246417+0000","last_became_peered":"2024-09-22T08:31:14.246417+0000","last_unstale":"2024-09-22T08:56:59.125351+0000","last_undegraded":"2024-09-22T08:56:59.125351+0000","last_fullsized":"2024-09-22T08:56:59.125351+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-22T08:56:59.125228+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-22T08:56:59.125228+0000","last_clean_scrub_stamp":"2024-09-22T08:56:59.125228+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:48:30.229239+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"263'9","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:59.624592+0000","last_change":"2024-09-22T08:56:59.624592+0000","last_active":"2024-09-22T08:56:59.624592+0000","last_peered":"2024-09-22T08:56:59.624592+0000","last_clean":"2024-09-22T08:56:59.624592+0000","last_became_active":"2024-09-22T08:31:11.211079+0000","last_became_peered":"2024-09-22T08:31:11.211079+0000","last_unstale":"2024-09-22T08:56:59.624592+0000","last_undegraded":"2024-09-22T08:56:59.624592+0000","last_fullsized":"2024-09-22T08:56:59.624592+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-22T08:56:59.624511+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-22T08:56:59.624511+0000","last_clean_scrub_stamp":"2024-09-22T08:56:59.624511+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:56:41.363859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10242,"num_write":14,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"263'18","reported_seq":89,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:28.399741+0000","last_change":"2024-09-22T08:29:26.068293+0000","last_active":"2024-09-22T08:54:28.399741+0000","last_peered":"2024-09-22T08:54:28.399741+0000","last_clean":"2024-09-22T08:54:28.399741+0000","last_became_active":"2024-09-22T08:29:26.067964+0000","last_became_peered":"2024-09-22T08:29:26.067964+0000","last_unstale":"2024-09-22T08:54:28.399741+0000","last_undegraded":"2024-09-22T08:54:28.399741+0000","last_fullsized":"2024-09-22T08:54:28.399741+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:29:25.030054+0000","last_clean_scrub_stamp":"2024-09-22T08:29:25.030054+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":85,"num_write":46,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:48.402297+0000","last_change":"2024-09-22T08:42:17.438619+0000","last_active":"2024-09-22T08:54:48.402297+0000","last_peered":"2024-09-22T08:54:48.402297+0000","last_clean":"2024-09-22T08:54:48.402297+0000","last_became_active":"2024-09-22T08:42:17.438318+0000","last_became_peered":"2024-09-22T08:42:17.438318+0000","last_unstale":"2024-09-22T08:54:48.402297+0000","last_undegraded":"2024-09-22T08:54:48.402297+0000","last_fullsized":"2024-09-22T08:54:48.402297+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:58.162876+0000","last_change":"2024-09-22T08:56:58.162876+0000","last_active":"2024-09-22T08:56:58.162876+0000","last_peered":"2024-09-22T08:56:58.162876+0000","last_clean":"2024-09-22T08:56:58.162876+0000","last_became_active":"2024-09-22T08:31:14.258136+0000","last_became_peered":"2024-09-22T08:31:14.258136+0000","last_unstale":"2024-09-22T08:56:58.162876+0000","last_undegraded":"2024-09-22T08:56:58.162876+0000","last_fullsized":"2024-09-22T08:56:58.162876+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:58.162779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:58.162779+0000","last_clean_scrub_stamp":"2024-09-22T08:56:58.162779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:19:33.194641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"263'2","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:52.738896+0000","last_change":"2024-09-22T08:56:52.738896+0000","last_active":"2024-09-22T08:56:52.738896+0000","last_peered":"2024-09-22T08:56:52.738896+0000","last_clean":"2024-09-22T08:56:52.738896+0000","last_became_active":"2024-09-22T08:31:11.214112+0000","last_became_peered":"2024-09-22T08:31:11.214112+0000","last_unstale":"2024-09-22T08:56:52.738896+0000","last_undegraded":"2024-09-22T08:56:52.738896+0000","last_fullsized":"2024-09-22T08:56:52.738896+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:56:52.738794+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:56:52.738794+0000","last_clean_scrub_stamp":"2024-09-22T08:56:52.738794+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:28:40.076592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"263'20","reported_seq":106,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:50.257740+0000","last_change":"2024-09-22T08:56:50.257740+0000","last_active":"2024-09-22T08:56:50.257740+0000","last_peered":"2024-09-22T08:56:50.257740+0000","last_clean":"2024-09-22T08:56:50.257740+0000","last_became_active":"2024-09-22T08:29:26.069407+0000","last_became_peered":"2024-09-22T08:29:26.069407+0000","last_unstale":"2024-09-22T08:56:50.257740+0000","last_undegraded":"2024-09-22T08:56:50.257740+0000","last_fullsized":"2024-09-22T08:56:50.257740+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'20","last_scrub_stamp":"2024-09-22T08:56:50.257643+0000","last_deep_scrub":"263'20","last_deep_scrub_stamp":"2024-09-22T08:56:50.257643+0000","last_clean_scrub_stamp":"2024-09-22T08:56:50.257643+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:48:55.481743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":95,"num_write":53,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"263'230","reported_seq":876,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:29.491497+0000","last_change":"2024-09-22T08:56:29.491448+0000","last_active":"2024-09-22T08:56:29.491497+0000","last_peered":"2024-09-22T08:56:29.491497+0000","last_clean":"2024-09-22T08:56:29.491497+0000","last_became_active":"2024-09-22T08:15:04.957090+0000","last_became_peered":"2024-09-22T08:15:04.957090+0000","last_unstale":"2024-09-22T08:56:29.491497+0000","last_undegraded":"2024-09-22T08:56:29.491497+0000","last_fullsized":"2024-09-22T08:56:29.491497+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'230","last_scrub_stamp":"2024-09-22T08:56:29.491342+0000","last_deep_scrub":"263'230","last_deep_scrub_stamp":"2024-09-22T08:56:29.491342+0000","last_clean_scrub_stamp":"2024-09-22T08:56:29.491342+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:44:19.142689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":587,"num_read_kb":1123,"num_write":1117,"num_write_kb":27318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"263'478","reported_seq":2209,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:34.800274+0000","last_change":"2024-09-22T08:56:34.800274+0000","last_active":"2024-09-22T08:56:34.800274+0000","last_peered":"2024-09-22T08:56:34.800274+0000","last_clean":"2024-09-22T08:56:34.800274+0000","last_became_active":"2024-09-22T08:15:06.980616+0000","last_became_peered":"2024-09-22T08:15:06.980616+0000","last_unstale":"2024-09-22T08:56:34.800274+0000","last_undegraded":"2024-09-22T08:56:34.800274+0000","last_fullsized":"2024-09-22T08:56:34.800274+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'478","last_scrub_stamp":"2024-09-22T08:56:34.800168+0000","last_deep_scrub":"263'478","last_deep_scrub_stamp":"2024-09-22T08:56:34.800168+0000","last_clean_scrub_stamp":"2024-09-22T08:56:34.800168+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:41:01.961869+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2847,"num_read_kb":2707,"num_write":560,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"263'240","reported_seq":885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:35.366976+0000","last_change":"2024-09-22T08:56:35.366911+0000","last_active":"2024-09-22T08:56:35.366976+0000","last_peered":"2024-09-22T08:56:35.366976+0000","last_clean":"2024-09-22T08:56:35.366976+0000","last_became_active":"2024-09-22T08:15:04.956643+0000","last_became_peered":"2024-09-22T08:15:04.956643+0000","last_unstale":"2024-09-22T08:56:35.366976+0000","last_undegraded":"2024-09-22T08:56:35.366976+0000","last_fullsized":"2024-09-22T08:56:35.366976+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'240","last_scrub_stamp":"2024-09-22T08:56:35.366815+0000","last_deep_scrub":"263'240","last_deep_scrub_stamp":"2024-09-22T08:56:35.366815+0000","last_clean_scrub_stamp":"2024-09-22T08:56:35.366815+0000","objects_scrubbed":1,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:47:44.936217+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":599,"num_read_kb":19417,"num_write":1105,"num_write_kb":24732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"263'388","reported_seq":1928,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:46.870394+0000","last_change":"2024-09-22T08:56:46.870394+0000","last_active":"2024-09-22T08:56:46.870394+0000","last_peered":"2024-09-22T08:56:46.870394+0000","last_clean":"2024-09-22T08:56:46.870394+0000","last_became_active":"2024-09-22T08:15:06.974127+0000","last_became_peered":"2024-09-22T08:15:06.974127+0000","last_unstale":"2024-09-22T08:56:46.870394+0000","last_undegraded":"2024-09-22T08:56:46.870394+0000","last_fullsized":"2024-09-22T08:56:46.870394+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'388","last_scrub_stamp":"2024-09-22T08:56:46.870289+0000","last_deep_scrub":"263'388","last_deep_scrub_stamp":"2024-09-22T08:56:46.870289+0000","last_clean_scrub_stamp":"2024-09-22T08:56:46.870289+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:57:47.237420+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2097,"num_read_kb":2016,"num_write":427,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"263'258","reported_seq":934,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:34.351461+0000","last_change":"2024-09-22T08:56:34.351393+0000","last_active":"2024-09-22T08:56:34.351461+0000","last_peered":"2024-09-22T08:56:34.351461+0000","last_clean":"2024-09-22T08:56:34.351461+0000","last_became_active":"2024-09-22T08:15:04.956659+0000","last_became_peered":"2024-09-22T08:15:04.956659+0000","last_unstale":"2024-09-22T08:56:34.351461+0000","last_undegraded":"2024-09-22T08:56:34.351461+0000","last_fullsized":"2024-09-22T08:56:34.351461+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'258","last_scrub_stamp":"2024-09-22T08:56:34.351295+0000","last_deep_scrub":"263'258","last_deep_scrub_stamp":"2024-09-22T08:56:34.351295+0000","last_clean_scrub_stamp":"2024-09-22T08:56:34.351295+0000","objects_scrubbed":4,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:09:46.701747+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":699,"num_read_kb":25466,"num_write":1131,"num_write_kb":27131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"263'899","reported_seq":2502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:47.845221+0000","last_change":"2024-09-22T08:56:47.845221+0000","last_active":"2024-09-22T08:56:47.845221+0000","last_peered":"2024-09-22T08:56:47.845221+0000","last_clean":"2024-09-22T08:56:47.845221+0000","last_became_active":"2024-09-22T08:15:06.968959+0000","last_became_peered":"2024-09-22T08:15:06.968959+0000","last_unstale":"2024-09-22T08:56:47.845221+0000","last_undegraded":"2024-09-22T08:56:47.845221+0000","last_fullsized":"2024-09-22T08:56:47.845221+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'899","last_scrub_stamp":"2024-09-22T08:56:47.845138+0000","last_deep_scrub":"263'899","last_deep_scrub_stamp":"2024-09-22T08:56:47.845138+0000","last_clean_scrub_stamp":"2024-09-22T08:56:47.845138+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":800,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:01:09.164689+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4516,"num_read_kb":4043,"num_write":1241,"num_write_kb":490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2295,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"263'241","reported_seq":886,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:28.308434+0000","last_change":"2024-09-22T08:56:28.308434+0000","last_active":"2024-09-22T08:56:28.308434+0000","last_peered":"2024-09-22T08:56:28.308434+0000","last_clean":"2024-09-22T08:56:28.308434+0000","last_became_active":"2024-09-22T08:15:04.961309+0000","last_became_peered":"2024-09-22T08:15:04.961309+0000","last_unstale":"2024-09-22T08:56:28.308434+0000","last_undegraded":"2024-09-22T08:56:28.308434+0000","last_fullsized":"2024-09-22T08:56:28.308434+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'241","last_scrub_stamp":"2024-09-22T08:56:28.308329+0000","last_deep_scrub":"263'241","last_deep_scrub_stamp":"2024-09-22T08:56:28.308329+0000","last_clean_scrub_stamp":"2024-09-22T08:56:28.308329+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:50:55.099697+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079903,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":558,"num_read_kb":61455,"num_write":1043,"num_write_kb":33072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"263'535","reported_seq":2240,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:37.704325+0000","last_change":"2024-09-22T08:56:37.704325+0000","last_active":"2024-09-22T08:56:37.704325+0000","last_peered":"2024-09-22T08:56:37.704325+0000","last_clean":"2024-09-22T08:56:37.704325+0000","last_became_active":"2024-09-22T08:15:06.969540+0000","last_became_peered":"2024-09-22T08:15:06.969540+0000","last_unstale":"2024-09-22T08:56:37.704325+0000","last_undegraded":"2024-09-22T08:56:37.704325+0000","last_fullsized":"2024-09-22T08:56:37.704325+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'535","last_scrub_stamp":"2024-09-22T08:56:37.704238+0000","last_deep_scrub":"263'535","last_deep_scrub_stamp":"2024-09-22T08:56:37.704238+0000","last_clean_scrub_stamp":"2024-09-22T08:56:37.704238+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:01:40.290775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2823,"num_read_kb":2637,"num_write":641,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"263'217","reported_seq":925,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:26.489027+0000","last_change":"2024-09-22T08:56:26.489027+0000","last_active":"2024-09-22T08:56:26.489027+0000","last_peered":"2024-09-22T08:56:26.489027+0000","last_clean":"2024-09-22T08:56:26.489027+0000","last_became_active":"2024-09-22T08:15:04.957717+0000","last_became_peered":"2024-09-22T08:15:04.957717+0000","last_unstale":"2024-09-22T08:56:26.489027+0000","last_undegraded":"2024-09-22T08:56:26.489027+0000","last_fullsized":"2024-09-22T08:56:26.489027+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'217","last_scrub_stamp":"2024-09-22T08:56:26.488928+0000","last_deep_scrub":"263'217","last_deep_scrub_stamp":"2024-09-22T08:56:26.488928+0000","last_clean_scrub_stamp":"2024-09-22T08:56:26.488928+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:37:50.212068+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1573037,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":720,"num_read_kb":166418,"num_write":955,"num_write_kb":57547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"263'607","reported_seq":2137,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:36.493433+0000","last_change":"2024-09-22T08:56:36.493433+0000","last_active":"2024-09-22T08:56:36.493433+0000","last_peered":"2024-09-22T08:56:36.493433+0000","last_clean":"2024-09-22T08:56:36.493433+0000","last_became_active":"2024-09-22T08:15:06.962605+0000","last_became_peered":"2024-09-22T08:15:06.962605+0000","last_unstale":"2024-09-22T08:56:36.493433+0000","last_undegraded":"2024-09-22T08:56:36.493433+0000","last_fullsized":"2024-09-22T08:56:36.493433+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'607","last_scrub_stamp":"2024-09-22T08:56:36.493326+0000","last_deep_scrub":"263'607","last_deep_scrub_stamp":"2024-09-22T08:56:36.493326+0000","last_clean_scrub_stamp":"2024-09-22T08:56:36.493326+0000","objects_scrubbed":4,"log_size":107,"log_dups_size":500,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:23:12.495770+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3087,"num_read_kb":2910,"num_write":853,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":486,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"263'257","reported_seq":944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:27.325351+0000","last_change":"2024-09-22T08:56:27.325351+0000","last_active":"2024-09-22T08:56:27.325351+0000","last_peered":"2024-09-22T08:56:27.325351+0000","last_clean":"2024-09-22T08:56:27.325351+0000","last_became_active":"2024-09-22T08:15:04.962128+0000","last_became_peered":"2024-09-22T08:15:04.962128+0000","last_unstale":"2024-09-22T08:56:27.325351+0000","last_undegraded":"2024-09-22T08:56:27.325351+0000","last_fullsized":"2024-09-22T08:56:27.325351+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'257","last_scrub_stamp":"2024-09-22T08:56:27.325259+0000","last_deep_scrub":"263'257","last_deep_scrub_stamp":"2024-09-22T08:56:27.325259+0000","last_clean_scrub_stamp":"2024-09-22T08:56:27.325259+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:48:56.416424+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":753,"num_read_kb":52063,"num_write":1239,"num_write_kb":44926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"263'872","reported_seq":2702,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:38.475792+0000","last_change":"2024-09-22T08:56:38.475719+0000","last_active":"2024-09-22T08:56:38.475792+0000","last_peered":"2024-09-22T08:56:38.475792+0000","last_clean":"2024-09-22T08:56:38.475792+0000","last_became_active":"2024-09-22T08:15:06.972756+0000","last_became_peered":"2024-09-22T08:15:06.972756+0000","last_unstale":"2024-09-22T08:56:38.475792+0000","last_undegraded":"2024-09-22T08:56:38.475792+0000","last_fullsized":"2024-09-22T08:56:38.475792+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'872","last_scrub_stamp":"2024-09-22T08:56:38.475633+0000","last_deep_scrub":"263'872","last_deep_scrub_stamp":"2024-09-22T08:56:38.475633+0000","last_clean_scrub_stamp":"2024-09-22T08:56:38.475633+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":800,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:27:33.543291+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4443,"num_read_kb":4056,"num_write":1153,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"263'251","reported_seq":925,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:31.486584+0000","last_change":"2024-09-22T08:56:31.486584+0000","last_active":"2024-09-22T08:56:31.486584+0000","last_peered":"2024-09-22T08:56:31.486584+0000","last_clean":"2024-09-22T08:56:31.486584+0000","last_became_active":"2024-09-22T08:15:04.944916+0000","last_became_peered":"2024-09-22T08:15:04.944916+0000","last_unstale":"2024-09-22T08:56:31.486584+0000","last_undegraded":"2024-09-22T08:56:31.486584+0000","last_fullsized":"2024-09-22T08:56:31.486584+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'251","last_scrub_stamp":"2024-09-22T08:56:31.486476+0000","last_deep_scrub":"263'251","last_deep_scrub_stamp":"2024-09-22T08:56:31.486476+0000","last_clean_scrub_stamp":"2024-09-22T08:56:31.486476+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:49:01.795181+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":805,"num_read_kb":10946,"num_write":1075,"num_write_kb":28039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"263'557","reported_seq":2090,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:37.452503+0000","last_change":"2024-09-22T08:56:37.452437+0000","last_active":"2024-09-22T08:56:37.452503+0000","last_peered":"2024-09-22T08:56:37.452503+0000","last_clean":"2024-09-22T08:56:37.452503+0000","last_became_active":"2024-09-22T08:15:06.968853+0000","last_became_peered":"2024-09-22T08:15:06.968853+0000","last_unstale":"2024-09-22T08:56:37.452503+0000","last_undegraded":"2024-09-22T08:56:37.452503+0000","last_fullsized":"2024-09-22T08:56:37.452503+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'557","last_scrub_stamp":"2024-09-22T08:56:37.452353+0000","last_deep_scrub":"263'557","last_deep_scrub_stamp":"2024-09-22T08:56:37.452353+0000","last_clean_scrub_stamp":"2024-09-22T08:56:37.452353+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:58:45.111881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2932,"num_read_kb":2656,"num_write":742,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":743,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"263'185","reported_seq":762,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:33.339657+0000","last_change":"2024-09-22T08:56:33.339657+0000","last_active":"2024-09-22T08:56:33.339657+0000","last_peered":"2024-09-22T08:56:33.339657+0000","last_clean":"2024-09-22T08:56:33.339657+0000","last_became_active":"2024-09-22T08:15:04.959395+0000","last_became_peered":"2024-09-22T08:15:04.959395+0000","last_unstale":"2024-09-22T08:56:33.339657+0000","last_undegraded":"2024-09-22T08:56:33.339657+0000","last_fullsized":"2024-09-22T08:56:33.339657+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'185","last_scrub_stamp":"2024-09-22T08:56:33.339559+0000","last_deep_scrub":"263'185","last_deep_scrub_stamp":"2024-09-22T08:56:33.339559+0000","last_clean_scrub_stamp":"2024-09-22T08:56:33.339559+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:26:10.173195+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":318,"num_read_kb":28967,"num_write":772,"num_write_kb":45290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"263'1561","reported_seq":3275,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:44.417199+0000","last_change":"2024-09-22T08:56:44.417141+0000","last_active":"2024-09-22T08:56:44.417199+0000","last_peered":"2024-09-22T08:56:44.417199+0000","last_clean":"2024-09-22T08:56:44.417199+0000","last_became_active":"2024-09-22T08:15:06.972074+0000","last_became_peered":"2024-09-22T08:15:06.972074+0000","last_unstale":"2024-09-22T08:56:44.417199+0000","last_undegraded":"2024-09-22T08:56:44.417199+0000","last_fullsized":"2024-09-22T08:56:44.417199+0000","mapping_epoch":25,"log_start":"263'1500","ondisk_log_start":"263'1500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1561","last_scrub_stamp":"2024-09-22T08:56:44.417043+0000","last_deep_scrub":"263'1561","last_deep_scrub_stamp":"2024-09-22T08:56:44.417043+0000","last_clean_scrub_stamp":"2024-09-22T08:56:44.417043+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":1500,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:19:57.978889+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6961,"num_read_kb":6120,"num_write":2165,"num_write_kb":918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"263'489","reported_seq":2157,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:45.900269+0000","last_change":"2024-09-22T08:56:45.900269+0000","last_active":"2024-09-22T08:56:45.900269+0000","last_peered":"2024-09-22T08:56:45.900269+0000","last_clean":"2024-09-22T08:56:45.900269+0000","last_became_active":"2024-09-22T08:15:06.965751+0000","last_became_peered":"2024-09-22T08:15:06.965751+0000","last_unstale":"2024-09-22T08:56:45.900269+0000","last_undegraded":"2024-09-22T08:56:45.900269+0000","last_fullsized":"2024-09-22T08:56:45.900269+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'489","last_scrub_stamp":"2024-09-22T08:56:45.900152+0000","last_deep_scrub":"263'489","last_deep_scrub_stamp":"2024-09-22T08:56:45.900152+0000","last_clean_scrub_stamp":"2024-09-22T08:56:45.900152+0000","objects_scrubbed":6,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:58:42.393419+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2631,"num_read_kb":2475,"num_write":578,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":468,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"263'220","reported_seq":872,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:24.868187+0000","last_change":"2024-09-22T08:56:24.868187+0000","last_active":"2024-09-22T08:56:24.868187+0000","last_peered":"2024-09-22T08:56:24.868187+0000","last_clean":"2024-09-22T08:56:24.868187+0000","last_became_active":"2024-09-22T08:15:04.953628+0000","last_became_peered":"2024-09-22T08:15:04.953628+0000","last_unstale":"2024-09-22T08:56:24.868187+0000","last_undegraded":"2024-09-22T08:56:24.868187+0000","last_fullsized":"2024-09-22T08:56:24.868187+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'220","last_scrub_stamp":"2024-09-22T08:56:24.868066+0000","last_deep_scrub":"263'220","last_deep_scrub_stamp":"2024-09-22T08:56:24.868066+0000","last_clean_scrub_stamp":"2024-09-22T08:56:24.868066+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:38:51.226129+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":538,"num_read_kb":68591,"num_write":878,"num_write_kb":34888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"263'360","reported_seq":1746,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:35.492973+0000","last_change":"2024-09-22T08:56:35.492973+0000","last_active":"2024-09-22T08:56:35.492973+0000","last_peered":"2024-09-22T08:56:35.492973+0000","last_clean":"2024-09-22T08:56:35.492973+0000","last_became_active":"2024-09-22T08:15:06.968970+0000","last_became_peered":"2024-09-22T08:15:06.968970+0000","last_unstale":"2024-09-22T08:56:35.492973+0000","last_undegraded":"2024-09-22T08:56:35.492973+0000","last_fullsized":"2024-09-22T08:56:35.492973+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'360","last_scrub_stamp":"2024-09-22T08:56:35.492871+0000","last_deep_scrub":"263'360","last_deep_scrub_stamp":"2024-09-22T08:56:35.492871+0000","last_clean_scrub_stamp":"2024-09-22T08:56:35.492871+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:05:00.671139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2053,"num_read_kb":1926,"num_write":427,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1365,"num_omap_keys":6,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"263'233","reported_seq":872,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:28.462228+0000","last_change":"2024-09-22T08:56:28.462228+0000","last_active":"2024-09-22T08:56:28.462228+0000","last_peered":"2024-09-22T08:56:28.462228+0000","last_clean":"2024-09-22T08:56:28.462228+0000","last_became_active":"2024-09-22T08:15:04.966769+0000","last_became_peered":"2024-09-22T08:15:04.966769+0000","last_unstale":"2024-09-22T08:56:28.462228+0000","last_undegraded":"2024-09-22T08:56:28.462228+0000","last_fullsized":"2024-09-22T08:56:28.462228+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'233","last_scrub_stamp":"2024-09-22T08:56:28.462117+0000","last_deep_scrub":"263'233","last_deep_scrub_stamp":"2024-09-22T08:56:28.462117+0000","last_clean_scrub_stamp":"2024-09-22T08:56:28.462117+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:40:13.623374+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":51014,"num_write":1104,"num_write_kb":43963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"263'469","reported_seq":1933,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:30.740245+0000","last_change":"2024-09-22T08:56:30.740245+0000","last_active":"2024-09-22T08:56:30.740245+0000","last_peered":"2024-09-22T08:56:30.740245+0000","last_clean":"2024-09-22T08:56:30.740245+0000","last_became_active":"2024-09-22T08:15:06.972821+0000","last_became_peered":"2024-09-22T08:15:06.972821+0000","last_unstale":"2024-09-22T08:56:30.740245+0000","last_undegraded":"2024-09-22T08:56:30.740245+0000","last_fullsized":"2024-09-22T08:56:30.740245+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'469","last_scrub_stamp":"2024-09-22T08:56:30.740153+0000","last_deep_scrub":"263'469","last_deep_scrub_stamp":"2024-09-22T08:56:30.740153+0000","last_clean_scrub_stamp":"2024-09-22T08:56:30.740153+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:47:33.203417+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2415,"num_read_kb":2238,"num_write":577,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"263'223","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:30.477162+0000","last_change":"2024-09-22T08:56:30.477162+0000","last_active":"2024-09-22T08:56:30.477162+0000","last_peered":"2024-09-22T08:56:30.477162+0000","last_clean":"2024-09-22T08:56:30.477162+0000","last_became_active":"2024-09-22T08:15:04.955972+0000","last_became_peered":"2024-09-22T08:15:04.955972+0000","last_unstale":"2024-09-22T08:56:30.477162+0000","last_undegraded":"2024-09-22T08:56:30.477162+0000","last_fullsized":"2024-09-22T08:56:30.477162+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'223","last_scrub_stamp":"2024-09-22T08:56:30.477065+0000","last_deep_scrub":"263'223","last_deep_scrub_stamp":"2024-09-22T08:56:30.477065+0000","last_clean_scrub_stamp":"2024-09-22T08:56:30.477065+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:48:00.158279+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":994,"num_read_kb":8164,"num_write":935,"num_write_kb":17459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"263'465","reported_seq":2089,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:37.484954+0000","last_change":"2024-09-22T08:56:37.484954+0000","last_active":"2024-09-22T08:56:37.484954+0000","last_peered":"2024-09-22T08:56:37.484954+0000","last_clean":"2024-09-22T08:56:37.484954+0000","last_became_active":"2024-09-22T08:15:06.972250+0000","last_became_peered":"2024-09-22T08:15:06.972250+0000","last_unstale":"2024-09-22T08:56:37.484954+0000","last_undegraded":"2024-09-22T08:56:37.484954+0000","last_fullsized":"2024-09-22T08:56:37.484954+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'465","last_scrub_stamp":"2024-09-22T08:56:37.484862+0000","last_deep_scrub":"263'465","last_deep_scrub_stamp":"2024-09-22T08:56:37.484862+0000","last_clean_scrub_stamp":"2024-09-22T08:56:37.484862+0000","objects_scrubbed":2,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:01:02.906297+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2654,"num_read_kb":2505,"num_write":533,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"263'252","reported_seq":902,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:25.507295+0000","last_change":"2024-09-22T08:56:25.507295+0000","last_active":"2024-09-22T08:56:25.507295+0000","last_peered":"2024-09-22T08:56:25.507295+0000","last_clean":"2024-09-22T08:56:25.507295+0000","last_became_active":"2024-09-22T08:15:04.954948+0000","last_became_peered":"2024-09-22T08:15:04.954948+0000","last_unstale":"2024-09-22T08:56:25.507295+0000","last_undegraded":"2024-09-22T08:56:25.507295+0000","last_fullsized":"2024-09-22T08:56:25.507295+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'252","last_scrub_stamp":"2024-09-22T08:56:25.507185+0000","last_deep_scrub":"263'252","last_deep_scrub_stamp":"2024-09-22T08:56:25.507185+0000","last_clean_scrub_stamp":"2024-09-22T08:56:25.507185+0000","objects_scrubbed":5,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:16.520968+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":551,"num_read_kb":6536,"num_write":1088,"num_write_kb":24915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"263'386","reported_seq":1854,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:43.447560+0000","last_change":"2024-09-22T08:56:43.447560+0000","last_active":"2024-09-22T08:56:43.447560+0000","last_peered":"2024-09-22T08:56:43.447560+0000","last_clean":"2024-09-22T08:56:43.447560+0000","last_became_active":"2024-09-22T08:15:06.968651+0000","last_became_peered":"2024-09-22T08:15:06.968651+0000","last_unstale":"2024-09-22T08:56:43.447560+0000","last_undegraded":"2024-09-22T08:56:43.447560+0000","last_fullsized":"2024-09-22T08:56:43.447560+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'386","last_scrub_stamp":"2024-09-22T08:56:43.447462+0000","last_deep_scrub":"263'386","last_deep_scrub_stamp":"2024-09-22T08:56:43.447462+0000","last_clean_scrub_stamp":"2024-09-22T08:56:43.447462+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:31:19.300619+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2079,"num_read_kb":1977,"num_write":435,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"263'239","reported_seq":862,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:30.460156+0000","last_change":"2024-09-22T08:56:30.460156+0000","last_active":"2024-09-22T08:56:30.460156+0000","last_peered":"2024-09-22T08:56:30.460156+0000","last_clean":"2024-09-22T08:56:30.460156+0000","last_became_active":"2024-09-22T08:15:04.958578+0000","last_became_peered":"2024-09-22T08:15:04.958578+0000","last_unstale":"2024-09-22T08:56:30.460156+0000","last_undegraded":"2024-09-22T08:56:30.460156+0000","last_fullsized":"2024-09-22T08:56:30.460156+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'239","last_scrub_stamp":"2024-09-22T08:56:30.460046+0000","last_deep_scrub":"263'239","last_deep_scrub_stamp":"2024-09-22T08:56:30.460046+0000","last_clean_scrub_stamp":"2024-09-22T08:56:30.460046+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:15:01.904411+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":554,"num_read_kb":7725,"num_write":1073,"num_write_kb":35221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"263'576","reported_seq":2266,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:31.779569+0000","last_change":"2024-09-22T08:56:31.779569+0000","last_active":"2024-09-22T08:56:31.779569+0000","last_peered":"2024-09-22T08:56:31.779569+0000","last_clean":"2024-09-22T08:56:31.779569+0000","last_became_active":"2024-09-22T08:15:06.980621+0000","last_became_peered":"2024-09-22T08:15:06.980621+0000","last_unstale":"2024-09-22T08:56:31.779569+0000","last_undegraded":"2024-09-22T08:56:31.779569+0000","last_fullsized":"2024-09-22T08:56:31.779569+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'576","last_scrub_stamp":"2024-09-22T08:56:31.779429+0000","last_deep_scrub":"263'576","last_deep_scrub_stamp":"2024-09-22T08:56:31.779429+0000","last_clean_scrub_stamp":"2024-09-22T08:56:31.779429+0000","objects_scrubbed":3,"log_size":76,"log_dups_size":500,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:22.389041+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3075,"num_read_kb":2832,"num_write":740,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"263'195","reported_seq":1003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:28.526760+0000","last_change":"2024-09-22T08:56:28.526760+0000","last_active":"2024-09-22T08:56:28.526760+0000","last_peered":"2024-09-22T08:56:28.526760+0000","last_clean":"2024-09-22T08:56:28.526760+0000","last_became_active":"2024-09-22T08:15:04.952203+0000","last_became_peered":"2024-09-22T08:15:04.952203+0000","last_unstale":"2024-09-22T08:56:28.526760+0000","last_undegraded":"2024-09-22T08:56:28.526760+0000","last_fullsized":"2024-09-22T08:56:28.526760+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'195","last_scrub_stamp":"2024-09-22T08:56:28.526665+0000","last_deep_scrub":"263'195","last_deep_scrub_stamp":"2024-09-22T08:56:28.526665+0000","last_clean_scrub_stamp":"2024-09-22T08:56:28.526665+0000","objects_scrubbed":2,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:04:59.175129+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1058,"num_read_kb":8867,"num_write":911,"num_write_kb":21916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"263'140","reported_seq":647,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:48.379821+0000","last_change":"2024-09-22T08:56:48.379821+0000","last_active":"2024-09-22T08:56:48.379821+0000","last_peered":"2024-09-22T08:56:48.379821+0000","last_clean":"2024-09-22T08:56:48.379821+0000","last_became_active":"2024-09-22T08:15:15.011529+0000","last_became_peered":"2024-09-22T08:15:15.011529+0000","last_unstale":"2024-09-22T08:56:48.379821+0000","last_undegraded":"2024-09-22T08:56:48.379821+0000","last_fullsized":"2024-09-22T08:56:48.379821+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'140","last_scrub_stamp":"2024-09-22T08:56:48.379718+0000","last_deep_scrub":"263'140","last_deep_scrub_stamp":"2024-09-22T08:56:48.379718+0000","last_clean_scrub_stamp":"2024-09-22T08:56:48.379718+0000","objects_scrubbed":1,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:29:35.640358+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":192,"num_read_kb":186,"num_write":338,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"263'505","reported_seq":2115,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:36.525663+0000","last_change":"2024-09-22T08:56:36.525663+0000","last_active":"2024-09-22T08:56:36.525663+0000","last_peered":"2024-09-22T08:56:36.525663+0000","last_clean":"2024-09-22T08:56:36.525663+0000","last_became_active":"2024-09-22T08:15:06.967794+0000","last_became_peered":"2024-09-22T08:15:06.967794+0000","last_unstale":"2024-09-22T08:56:36.525663+0000","last_undegraded":"2024-09-22T08:56:36.525663+0000","last_fullsized":"2024-09-22T08:56:36.525663+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'505","last_scrub_stamp":"2024-09-22T08:56:36.525567+0000","last_deep_scrub":"263'505","last_deep_scrub_stamp":"2024-09-22T08:56:36.525567+0000","last_clean_scrub_stamp":"2024-09-22T08:56:36.525567+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:20:04.782519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2789,"num_read_kb":2608,"num_write":647,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"263'226","reported_seq":879,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:31.855517+0000","last_change":"2024-09-22T08:56:31.855517+0000","last_active":"2024-09-22T08:56:31.855517+0000","last_peered":"2024-09-22T08:56:31.855517+0000","last_clean":"2024-09-22T08:56:31.855517+0000","last_became_active":"2024-09-22T08:15:04.963890+0000","last_became_peered":"2024-09-22T08:15:04.963890+0000","last_unstale":"2024-09-22T08:56:31.855517+0000","last_undegraded":"2024-09-22T08:56:31.855517+0000","last_fullsized":"2024-09-22T08:56:31.855517+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'226","last_scrub_stamp":"2024-09-22T08:56:31.855382+0000","last_deep_scrub":"263'226","last_deep_scrub_stamp":"2024-09-22T08:56:31.855382+0000","last_clean_scrub_stamp":"2024-09-22T08:56:31.855382+0000","objects_scrubbed":7,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:32:30.739490+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079944,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":535,"num_read_kb":15199,"num_write":1088,"num_write_kb":18954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:52.870153+0000","last_change":"2024-09-22T08:56:52.870153+0000","last_active":"2024-09-22T08:56:52.870153+0000","last_peered":"2024-09-22T08:56:52.870153+0000","last_clean":"2024-09-22T08:56:52.870153+0000","last_became_active":"2024-09-22T08:15:08.968482+0000","last_became_peered":"2024-09-22T08:15:08.968482+0000","last_unstale":"2024-09-22T08:56:52.870153+0000","last_undegraded":"2024-09-22T08:56:52.870153+0000","last_fullsized":"2024-09-22T08:56:52.870153+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:52.870067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:52.870067+0000","last_clean_scrub_stamp":"2024-09-22T08:56:52.870067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:59:27.029495+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"263'197","reported_seq":804,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:51.821033+0000","last_change":"2024-09-22T08:56:51.821033+0000","last_active":"2024-09-22T08:56:51.821033+0000","last_peered":"2024-09-22T08:56:51.821033+0000","last_clean":"2024-09-22T08:56:51.821033+0000","last_became_active":"2024-09-22T08:15:10.987539+0000","last_became_peered":"2024-09-22T08:15:10.987539+0000","last_unstale":"2024-09-22T08:56:51.821033+0000","last_undegraded":"2024-09-22T08:56:51.821033+0000","last_fullsized":"2024-09-22T08:56:51.821033+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'197","last_scrub_stamp":"2024-09-22T08:56:51.820915+0000","last_deep_scrub":"263'197","last_deep_scrub_stamp":"2024-09-22T08:56:51.820915+0000","last_clean_scrub_stamp":"2024-09-22T08:56:51.820915+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:48:30.546821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7203,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":254,"num_read_kb":315,"num_write":148,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:46.734966+0000","last_change":"2024-09-22T08:56:46.734966+0000","last_active":"2024-09-22T08:56:46.734966+0000","last_peered":"2024-09-22T08:56:46.734966+0000","last_clean":"2024-09-22T08:56:46.734966+0000","last_became_active":"2024-09-22T08:15:13.018750+0000","last_became_peered":"2024-09-22T08:15:13.018750+0000","last_unstale":"2024-09-22T08:56:46.734966+0000","last_undegraded":"2024-09-22T08:56:46.734966+0000","last_fullsized":"2024-09-22T08:56:46.734966+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:46.734883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:46.734883+0000","last_clean_scrub_stamp":"2024-09-22T08:56:46.734883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:03:09.348530+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"263'153","reported_seq":652,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:54.819283+0000","last_change":"2024-09-22T08:56:54.819283+0000","last_active":"2024-09-22T08:56:54.819283+0000","last_peered":"2024-09-22T08:56:54.819283+0000","last_clean":"2024-09-22T08:56:54.819283+0000","last_became_active":"2024-09-22T08:15:15.020542+0000","last_became_peered":"2024-09-22T08:15:15.020542+0000","last_unstale":"2024-09-22T08:56:54.819283+0000","last_undegraded":"2024-09-22T08:56:54.819283+0000","last_fullsized":"2024-09-22T08:56:54.819283+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'153","last_scrub_stamp":"2024-09-22T08:56:54.819185+0000","last_deep_scrub":"263'153","last_deep_scrub_stamp":"2024-09-22T08:56:54.819185+0000","last_clean_scrub_stamp":"2024-09-22T08:56:54.819185+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:13:03.005110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":183,"num_read_kb":175,"num_write":358,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"263'757","reported_seq":2368,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:42.879382+0000","last_change":"2024-09-22T08:56:42.879382+0000","last_active":"2024-09-22T08:56:42.879382+0000","last_peered":"2024-09-22T08:56:42.879382+0000","last_clean":"2024-09-22T08:56:42.879382+0000","last_became_active":"2024-09-22T08:15:06.980479+0000","last_became_peered":"2024-09-22T08:15:06.980479+0000","last_unstale":"2024-09-22T08:56:42.879382+0000","last_undegraded":"2024-09-22T08:56:42.879382+0000","last_fullsized":"2024-09-22T08:56:42.879382+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'757","last_scrub_stamp":"2024-09-22T08:56:42.879289+0000","last_deep_scrub":"263'757","last_deep_scrub_stamp":"2024-09-22T08:56:42.879289+0000","last_clean_scrub_stamp":"2024-09-22T08:56:42.879289+0000","objects_scrubbed":6,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:12:59.739632+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3625,"num_read_kb":3307,"num_write":963,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"263'258","reported_seq":934,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:25.458117+0000","last_change":"2024-09-22T08:56:25.458117+0000","last_active":"2024-09-22T08:56:25.458117+0000","last_peered":"2024-09-22T08:56:25.458117+0000","last_clean":"2024-09-22T08:56:25.458117+0000","last_became_active":"2024-09-22T08:15:04.951265+0000","last_became_peered":"2024-09-22T08:15:04.951265+0000","last_unstale":"2024-09-22T08:56:25.458117+0000","last_undegraded":"2024-09-22T08:56:25.458117+0000","last_fullsized":"2024-09-22T08:56:25.458117+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'258","last_scrub_stamp":"2024-09-22T08:56:25.457993+0000","last_deep_scrub":"263'258","last_deep_scrub_stamp":"2024-09-22T08:56:25.457993+0000","last_clean_scrub_stamp":"2024-09-22T08:56:25.457993+0000","objects_scrubbed":4,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:21:32.094740+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":764,"num_read_kb":7954,"num_write":1369,"num_write_kb":16798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:44.783668+0000","last_change":"2024-09-22T08:56:44.783668+0000","last_active":"2024-09-22T08:56:44.783668+0000","last_peered":"2024-09-22T08:56:44.783668+0000","last_clean":"2024-09-22T08:56:44.783668+0000","last_became_active":"2024-09-22T08:15:08.978832+0000","last_became_peered":"2024-09-22T08:15:08.978832+0000","last_unstale":"2024-09-22T08:56:44.783668+0000","last_undegraded":"2024-09-22T08:56:44.783668+0000","last_fullsized":"2024-09-22T08:56:44.783668+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:44.783581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:44.783581+0000","last_clean_scrub_stamp":"2024-09-22T08:56:44.783581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:13:58.465427+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"263'80","reported_seq":609,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:41.793143+0000","last_change":"2024-09-22T08:56:41.793143+0000","last_active":"2024-09-22T08:56:41.793143+0000","last_peered":"2024-09-22T08:56:41.793143+0000","last_clean":"2024-09-22T08:56:41.793143+0000","last_became_active":"2024-09-22T08:15:10.984027+0000","last_became_peered":"2024-09-22T08:15:10.984027+0000","last_unstale":"2024-09-22T08:56:41.793143+0000","last_undegraded":"2024-09-22T08:56:41.793143+0000","last_fullsized":"2024-09-22T08:56:41.793143+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'80","last_scrub_stamp":"2024-09-22T08:56:41.793036+0000","last_deep_scrub":"263'80","last_deep_scrub_stamp":"2024-09-22T08:56:41.793036+0000","last_clean_scrub_stamp":"2024-09-22T08:56:41.793036+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:29:56.743917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":87,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:47.698556+0000","last_change":"2024-09-22T08:56:47.698556+0000","last_active":"2024-09-22T08:56:47.698556+0000","last_peered":"2024-09-22T08:56:47.698556+0000","last_clean":"2024-09-22T08:56:47.698556+0000","last_became_active":"2024-09-22T08:15:13.013609+0000","last_became_peered":"2024-09-22T08:15:13.013609+0000","last_unstale":"2024-09-22T08:56:47.698556+0000","last_undegraded":"2024-09-22T08:56:47.698556+0000","last_fullsized":"2024-09-22T08:56:47.698556+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:47.698456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:47.698456+0000","last_clean_scrub_stamp":"2024-09-22T08:56:47.698456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:02:08.771934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"263'159","reported_seq":676,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:51.577389+0000","last_change":"2024-09-22T08:56:51.577389+0000","last_active":"2024-09-22T08:56:51.577389+0000","last_peered":"2024-09-22T08:56:51.577389+0000","last_clean":"2024-09-22T08:56:51.577389+0000","last_became_active":"2024-09-22T08:15:15.018984+0000","last_became_peered":"2024-09-22T08:15:15.018984+0000","last_unstale":"2024-09-22T08:56:51.577389+0000","last_undegraded":"2024-09-22T08:56:51.577389+0000","last_fullsized":"2024-09-22T08:56:51.577389+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'159","last_scrub_stamp":"2024-09-22T08:56:51.577281+0000","last_deep_scrub":"263'159","last_deep_scrub_stamp":"2024-09-22T08:56:51.577281+0000","last_clean_scrub_stamp":"2024-09-22T08:56:51.577281+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:27:42.431060+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":263,"num_read_kb":245,"num_write":379,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"263'1937","reported_seq":3656,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:38.397089+0000","last_change":"2024-09-22T08:56:38.397089+0000","last_active":"2024-09-22T08:56:38.397089+0000","last_peered":"2024-09-22T08:56:38.397089+0000","last_clean":"2024-09-22T08:56:38.397089+0000","last_became_active":"2024-09-22T08:15:06.967645+0000","last_became_peered":"2024-09-22T08:15:06.967645+0000","last_unstale":"2024-09-22T08:56:38.397089+0000","last_undegraded":"2024-09-22T08:56:38.397089+0000","last_fullsized":"2024-09-22T08:56:38.397089+0000","mapping_epoch":25,"log_start":"263'1900","ondisk_log_start":"263'1900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1937","last_scrub_stamp":"2024-09-22T08:56:38.396997+0000","last_deep_scrub":"263'1937","last_deep_scrub_stamp":"2024-09-22T08:56:38.396997+0000","last_clean_scrub_stamp":"2024-09-22T08:56:38.396997+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":1900,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:08:12.555868+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8532,"num_read_kb":7421,"num_write":2741,"num_write_kb":1214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"263'208","reported_seq":861,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:30.899610+0000","last_change":"2024-09-22T08:56:30.899610+0000","last_active":"2024-09-22T08:56:30.899610+0000","last_peered":"2024-09-22T08:56:30.899610+0000","last_clean":"2024-09-22T08:56:30.899610+0000","last_became_active":"2024-09-22T08:15:04.964798+0000","last_became_peered":"2024-09-22T08:15:04.964798+0000","last_unstale":"2024-09-22T08:56:30.899610+0000","last_undegraded":"2024-09-22T08:56:30.899610+0000","last_fullsized":"2024-09-22T08:56:30.899610+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'208","last_scrub_stamp":"2024-09-22T08:56:30.899515+0000","last_deep_scrub":"263'208","last_deep_scrub_stamp":"2024-09-22T08:56:30.899515+0000","last_clean_scrub_stamp":"2024-09-22T08:56:30.899515+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:30:20.275669+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":449,"num_read_kb":111223,"num_write":842,"num_write_kb":54102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:43.763781+0000","last_change":"2024-09-22T08:56:43.763781+0000","last_active":"2024-09-22T08:56:43.763781+0000","last_peered":"2024-09-22T08:56:43.763781+0000","last_clean":"2024-09-22T08:56:43.763781+0000","last_became_active":"2024-09-22T08:15:08.976950+0000","last_became_peered":"2024-09-22T08:15:08.976950+0000","last_unstale":"2024-09-22T08:56:43.763781+0000","last_undegraded":"2024-09-22T08:56:43.763781+0000","last_fullsized":"2024-09-22T08:56:43.763781+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:43.763686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:43.763686+0000","last_clean_scrub_stamp":"2024-09-22T08:56:43.763686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:17:48.248629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"263'112","reported_seq":651,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:50.835562+0000","last_change":"2024-09-22T08:56:50.835562+0000","last_active":"2024-09-22T08:56:50.835562+0000","last_peered":"2024-09-22T08:56:50.835562+0000","last_clean":"2024-09-22T08:56:50.835562+0000","last_became_active":"2024-09-22T08:15:10.980879+0000","last_became_peered":"2024-09-22T08:15:10.980879+0000","last_unstale":"2024-09-22T08:56:50.835562+0000","last_undegraded":"2024-09-22T08:56:50.835562+0000","last_fullsized":"2024-09-22T08:56:50.835562+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'112","last_scrub_stamp":"2024-09-22T08:56:50.835450+0000","last_deep_scrub":"263'112","last_deep_scrub_stamp":"2024-09-22T08:56:50.835450+0000","last_clean_scrub_stamp":"2024-09-22T08:56:50.835450+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:29:55.805287+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":117,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"263'782","reported_seq":2379,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.569288+0000","last_change":"2024-09-22T08:15:13.012087+0000","last_active":"2024-09-22T08:56:16.569288+0000","last_peered":"2024-09-22T08:56:16.569288+0000","last_clean":"2024-09-22T08:56:16.569288+0000","last_became_active":"2024-09-22T08:15:13.011812+0000","last_became_peered":"2024-09-22T08:15:13.011812+0000","last_unstale":"2024-09-22T08:56:16.569288+0000","last_undegraded":"2024-09-22T08:56:16.569288+0000","last_fullsized":"2024-09-22T08:56:16.569288+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:23:51.018829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"263'181","reported_seq":1010,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:49.286697+0000","last_change":"2024-09-22T08:56:49.286697+0000","last_active":"2024-09-22T08:56:49.286697+0000","last_peered":"2024-09-22T08:56:49.286697+0000","last_clean":"2024-09-22T08:56:49.286697+0000","last_became_active":"2024-09-22T08:15:15.015684+0000","last_became_peered":"2024-09-22T08:15:15.015684+0000","last_unstale":"2024-09-22T08:56:49.286697+0000","last_undegraded":"2024-09-22T08:56:49.286697+0000","last_fullsized":"2024-09-22T08:56:49.286697+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'181","last_scrub_stamp":"2024-09-22T08:56:49.286599+0000","last_deep_scrub":"263'181","last_deep_scrub_stamp":"2024-09-22T08:56:49.286599+0000","last_clean_scrub_stamp":"2024-09-22T08:56:49.286599+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:14:12.947006+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":616,"num_read_kb":611,"num_write":377,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"263'1260","reported_seq":2740,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:39.437610+0000","last_change":"2024-09-22T08:56:39.437610+0000","last_active":"2024-09-22T08:56:39.437610+0000","last_peered":"2024-09-22T08:56:39.437610+0000","last_clean":"2024-09-22T08:56:39.437610+0000","last_became_active":"2024-09-22T08:15:06.967323+0000","last_became_peered":"2024-09-22T08:15:06.967323+0000","last_unstale":"2024-09-22T08:56:39.437610+0000","last_undegraded":"2024-09-22T08:56:39.437610+0000","last_fullsized":"2024-09-22T08:56:39.437610+0000","mapping_epoch":25,"log_start":"263'1200","ondisk_log_start":"263'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1260","last_scrub_stamp":"2024-09-22T08:56:39.437522+0000","last_deep_scrub":"263'1260","last_deep_scrub_stamp":"2024-09-22T08:56:39.437522+0000","last_clean_scrub_stamp":"2024-09-22T08:56:39.437522+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":1200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:18:39.527856+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7857,"num_read_kb":7154,"num_write":1964,"num_write_kb":850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"263'250","reported_seq":926,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:22.920450+0000","last_change":"2024-09-22T08:56:22.920450+0000","last_active":"2024-09-22T08:56:22.920450+0000","last_peered":"2024-09-22T08:56:22.920450+0000","last_clean":"2024-09-22T08:56:22.920450+0000","last_became_active":"2024-09-22T08:15:04.959776+0000","last_became_peered":"2024-09-22T08:15:04.959776+0000","last_unstale":"2024-09-22T08:56:22.920450+0000","last_undegraded":"2024-09-22T08:56:22.920450+0000","last_fullsized":"2024-09-22T08:56:22.920450+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'250","last_scrub_stamp":"2024-09-22T08:56:22.920344+0000","last_deep_scrub":"263'250","last_deep_scrub_stamp":"2024-09-22T08:56:22.920344+0000","last_clean_scrub_stamp":"2024-09-22T08:56:22.920344+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:50:17.909839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079920,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":722,"num_read_kb":18781,"num_write":1155,"num_write_kb":38377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:53.859174+0000","last_change":"2024-09-22T08:56:53.859174+0000","last_active":"2024-09-22T08:56:53.859174+0000","last_peered":"2024-09-22T08:56:53.859174+0000","last_clean":"2024-09-22T08:56:53.859174+0000","last_became_active":"2024-09-22T08:15:08.973025+0000","last_became_peered":"2024-09-22T08:15:08.973025+0000","last_unstale":"2024-09-22T08:56:53.859174+0000","last_undegraded":"2024-09-22T08:56:53.859174+0000","last_fullsized":"2024-09-22T08:56:53.859174+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:53.859087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:53.859087+0000","last_clean_scrub_stamp":"2024-09-22T08:56:53.859087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:19:48.952735+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"263'136","reported_seq":708,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:41.416563+0000","last_change":"2024-09-22T08:56:41.416563+0000","last_active":"2024-09-22T08:56:41.416563+0000","last_peered":"2024-09-22T08:56:41.416563+0000","last_clean":"2024-09-22T08:56:41.416563+0000","last_became_active":"2024-09-22T08:15:10.985540+0000","last_became_peered":"2024-09-22T08:15:10.985540+0000","last_unstale":"2024-09-22T08:56:41.416563+0000","last_undegraded":"2024-09-22T08:56:41.416563+0000","last_fullsized":"2024-09-22T08:56:41.416563+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'136","last_scrub_stamp":"2024-09-22T08:56:41.416466+0000","last_deep_scrub":"263'136","last_deep_scrub_stamp":"2024-09-22T08:56:41.416466+0000","last_clean_scrub_stamp":"2024-09-22T08:56:41.416466+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:53:46.875429+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10933,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":231,"num_write":80,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"263'793","reported_seq":2276,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:52.381686+0000","last_change":"2024-09-22T08:56:52.381686+0000","last_active":"2024-09-22T08:56:52.381686+0000","last_peered":"2024-09-22T08:56:52.381686+0000","last_clean":"2024-09-22T08:56:52.381686+0000","last_became_active":"2024-09-22T08:15:13.004752+0000","last_became_peered":"2024-09-22T08:15:13.004752+0000","last_unstale":"2024-09-22T08:56:52.381686+0000","last_undegraded":"2024-09-22T08:56:52.381686+0000","last_fullsized":"2024-09-22T08:56:52.381686+0000","mapping_epoch":31,"log_start":"263'701","ondisk_log_start":"263'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'793","last_scrub_stamp":"2024-09-22T08:56:52.381599+0000","last_deep_scrub":"263'793","last_deep_scrub_stamp":"2024-09-22T08:56:52.381599+0000","last_clean_scrub_stamp":"2024-09-22T08:56:52.381599+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":701,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:48:13.046558+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"263'442","reported_seq":2078,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:41.865908+0000","last_change":"2024-09-22T08:56:41.865908+0000","last_active":"2024-09-22T08:56:41.865908+0000","last_peered":"2024-09-22T08:56:41.865908+0000","last_clean":"2024-09-22T08:56:41.865908+0000","last_became_active":"2024-09-22T08:15:06.965387+0000","last_became_peered":"2024-09-22T08:15:06.965387+0000","last_unstale":"2024-09-22T08:56:41.865908+0000","last_undegraded":"2024-09-22T08:56:41.865908+0000","last_fullsized":"2024-09-22T08:56:41.865908+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'442","last_scrub_stamp":"2024-09-22T08:56:41.865802+0000","last_deep_scrub":"263'442","last_deep_scrub_stamp":"2024-09-22T08:56:41.865802+0000","last_clean_scrub_stamp":"2024-09-22T08:56:41.865802+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:53:34.683831+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2432,"num_read_kb":2308,"num_write":489,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"263'281","reported_seq":931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:22.419125+0000","last_change":"2024-09-22T08:56:22.419125+0000","last_active":"2024-09-22T08:56:22.419125+0000","last_peered":"2024-09-22T08:56:22.419125+0000","last_clean":"2024-09-22T08:56:22.419125+0000","last_became_active":"2024-09-22T08:15:04.954015+0000","last_became_peered":"2024-09-22T08:15:04.954015+0000","last_unstale":"2024-09-22T08:56:22.419125+0000","last_undegraded":"2024-09-22T08:56:22.419125+0000","last_fullsized":"2024-09-22T08:56:22.419125+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'281","last_scrub_stamp":"2024-09-22T08:56:22.418992+0000","last_deep_scrub":"263'281","last_deep_scrub_stamp":"2024-09-22T08:56:22.418992+0000","last_clean_scrub_stamp":"2024-09-22T08:56:22.418992+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:44:11.997685+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079929,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":663,"num_read_kb":30289,"num_write":1087,"num_write_kb":39703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:35.772228+0000","last_change":"2024-09-22T08:56:35.772228+0000","last_active":"2024-09-22T08:56:35.772228+0000","last_peered":"2024-09-22T08:56:35.772228+0000","last_clean":"2024-09-22T08:56:35.772228+0000","last_became_active":"2024-09-22T08:15:08.982222+0000","last_became_peered":"2024-09-22T08:15:08.982222+0000","last_unstale":"2024-09-22T08:56:35.772228+0000","last_undegraded":"2024-09-22T08:56:35.772228+0000","last_fullsized":"2024-09-22T08:56:35.772228+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:35.772141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:35.772141+0000","last_clean_scrub_stamp":"2024-09-22T08:56:35.772141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:54:14.131567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"263'221","reported_seq":835,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:42.444491+0000","last_change":"2024-09-22T08:56:42.444491+0000","last_active":"2024-09-22T08:56:42.444491+0000","last_peered":"2024-09-22T08:56:42.444491+0000","last_clean":"2024-09-22T08:56:42.444491+0000","last_became_active":"2024-09-22T08:15:10.984769+0000","last_became_peered":"2024-09-22T08:15:10.984769+0000","last_unstale":"2024-09-22T08:56:42.444491+0000","last_undegraded":"2024-09-22T08:56:42.444491+0000","last_fullsized":"2024-09-22T08:56:42.444491+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'221","last_scrub_stamp":"2024-09-22T08:56:42.444370+0000","last_deep_scrub":"263'221","last_deep_scrub_stamp":"2024-09-22T08:56:42.444370+0000","last_clean_scrub_stamp":"2024-09-22T08:56:42.444370+0000","objects_scrubbed":9,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:11:33.514866+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11910,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":286,"num_read_kb":362,"num_write":166,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:47.559785+0000","last_change":"2024-09-22T08:56:47.559785+0000","last_active":"2024-09-22T08:56:47.559785+0000","last_peered":"2024-09-22T08:56:47.559785+0000","last_clean":"2024-09-22T08:56:47.559785+0000","last_became_active":"2024-09-22T08:15:13.012498+0000","last_became_peered":"2024-09-22T08:15:13.012498+0000","last_unstale":"2024-09-22T08:56:47.559785+0000","last_undegraded":"2024-09-22T08:56:47.559785+0000","last_fullsized":"2024-09-22T08:56:47.559785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:47.559700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:47.559700+0000","last_clean_scrub_stamp":"2024-09-22T08:56:47.559700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:11:39.035630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"263'559","reported_seq":1393,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:46.302312+0000","last_change":"2024-09-22T08:56:46.302205+0000","last_active":"2024-09-22T08:56:46.302312+0000","last_peered":"2024-09-22T08:56:46.302312+0000","last_clean":"2024-09-22T08:56:46.302312+0000","last_became_active":"2024-09-22T08:15:15.014801+0000","last_became_peered":"2024-09-22T08:15:15.014801+0000","last_unstale":"2024-09-22T08:56:46.302312+0000","last_undegraded":"2024-09-22T08:56:46.302312+0000","last_fullsized":"2024-09-22T08:56:46.302312+0000","mapping_epoch":33,"log_start":"263'500","ondisk_log_start":"263'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'559","last_scrub_stamp":"2024-09-22T08:56:46.302094+0000","last_deep_scrub":"263'559","last_deep_scrub_stamp":"2024-09-22T08:56:46.302094+0000","last_clean_scrub_stamp":"2024-09-22T08:56:46.302094+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":500,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:04:02.051380+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":467,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1367,"num_read_kb":1346,"num_write":1156,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"263'862","reported_seq":2456,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:25.844066+0000","last_change":"2024-09-22T08:56:25.844066+0000","last_active":"2024-09-22T08:56:25.844066+0000","last_peered":"2024-09-22T08:56:25.844066+0000","last_clean":"2024-09-22T08:56:25.844066+0000","last_became_active":"2024-09-22T08:15:06.972958+0000","last_became_peered":"2024-09-22T08:15:06.972958+0000","last_unstale":"2024-09-22T08:56:25.844066+0000","last_undegraded":"2024-09-22T08:56:25.844066+0000","last_fullsized":"2024-09-22T08:56:25.844066+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'862","last_scrub_stamp":"2024-09-22T08:56:25.843956+0000","last_deep_scrub":"263'862","last_deep_scrub_stamp":"2024-09-22T08:56:25.843956+0000","last_clean_scrub_stamp":"2024-09-22T08:56:25.843956+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":800,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:28:27.885227+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4079,"num_read_kb":3669,"num_write":1154,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"263'237","reported_seq":903,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:23.356062+0000","last_change":"2024-09-22T08:56:23.356062+0000","last_active":"2024-09-22T08:56:23.356062+0000","last_peered":"2024-09-22T08:56:23.356062+0000","last_clean":"2024-09-22T08:56:23.356062+0000","last_became_active":"2024-09-22T08:15:40.188251+0000","last_became_peered":"2024-09-22T08:15:40.188251+0000","last_unstale":"2024-09-22T08:56:23.356062+0000","last_undegraded":"2024-09-22T08:56:23.356062+0000","last_fullsized":"2024-09-22T08:56:23.356062+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'237","last_scrub_stamp":"2024-09-22T08:56:23.355989+0000","last_deep_scrub":"263'237","last_deep_scrub_stamp":"2024-09-22T08:56:23.355989+0000","last_clean_scrub_stamp":"2024-09-22T08:56:23.355989+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:24.497389+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":546,"num_read_kb":133824,"num_write":973,"num_write_kb":45053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:39.484034+0000","last_change":"2024-09-22T08:56:39.484034+0000","last_active":"2024-09-22T08:56:39.484034+0000","last_peered":"2024-09-22T08:56:39.484034+0000","last_clean":"2024-09-22T08:56:39.484034+0000","last_became_active":"2024-09-22T08:15:08.975435+0000","last_became_peered":"2024-09-22T08:15:08.975435+0000","last_unstale":"2024-09-22T08:56:39.484034+0000","last_undegraded":"2024-09-22T08:56:39.484034+0000","last_fullsized":"2024-09-22T08:56:39.484034+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:39.483931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:39.483931+0000","last_clean_scrub_stamp":"2024-09-22T08:56:39.483931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:17:40.133221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"263'131","reported_seq":705,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:47.830381+0000","last_change":"2024-09-22T08:56:47.830381+0000","last_active":"2024-09-22T08:56:47.830381+0000","last_peered":"2024-09-22T08:56:47.830381+0000","last_clean":"2024-09-22T08:56:47.830381+0000","last_became_active":"2024-09-22T08:15:10.988458+0000","last_became_peered":"2024-09-22T08:15:10.988458+0000","last_unstale":"2024-09-22T08:56:47.830381+0000","last_undegraded":"2024-09-22T08:56:47.830381+0000","last_fullsized":"2024-09-22T08:56:47.830381+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'131","last_scrub_stamp":"2024-09-22T08:56:47.830275+0000","last_deep_scrub":"263'131","last_deep_scrub_stamp":"2024-09-22T08:56:47.830275+0000","last_clean_scrub_stamp":"2024-09-22T08:56:47.830275+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:25:35.421232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8309,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":166,"num_read_kb":226,"num_write":90,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:55.818068+0000","last_change":"2024-09-22T08:56:55.818068+0000","last_active":"2024-09-22T08:56:55.818068+0000","last_peered":"2024-09-22T08:56:55.818068+0000","last_clean":"2024-09-22T08:56:55.818068+0000","last_became_active":"2024-09-22T08:15:13.002538+0000","last_became_peered":"2024-09-22T08:15:13.002538+0000","last_unstale":"2024-09-22T08:56:55.818068+0000","last_undegraded":"2024-09-22T08:56:55.818068+0000","last_fullsized":"2024-09-22T08:56:55.818068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:55.817977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:55.817977+0000","last_clean_scrub_stamp":"2024-09-22T08:56:55.817977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:59:06.947668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"263'2484","reported_seq":4321,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:48.732835+0000","last_change":"2024-09-22T08:56:48.732758+0000","last_active":"2024-09-22T08:56:48.732835+0000","last_peered":"2024-09-22T08:56:48.732835+0000","last_clean":"2024-09-22T08:56:48.732835+0000","last_became_active":"2024-09-22T08:15:15.020438+0000","last_became_peered":"2024-09-22T08:15:15.020438+0000","last_unstale":"2024-09-22T08:56:48.732835+0000","last_undegraded":"2024-09-22T08:56:48.732835+0000","last_fullsized":"2024-09-22T08:56:48.732835+0000","mapping_epoch":33,"log_start":"263'2400","ondisk_log_start":"263'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2484","last_scrub_stamp":"2024-09-22T08:56:48.732662+0000","last_deep_scrub":"263'2484","last_deep_scrub_stamp":"2024-09-22T08:56:48.732662+0000","last_clean_scrub_stamp":"2024-09-22T08:56:48.732662+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":2400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:27:02.772680+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6235,"num_read_kb":6232,"num_write":5030,"num_write_kb":1847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"263'475","reported_seq":2005,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:29.346865+0000","last_change":"2024-09-22T08:56:29.346865+0000","last_active":"2024-09-22T08:56:29.346865+0000","last_peered":"2024-09-22T08:56:29.346865+0000","last_clean":"2024-09-22T08:56:29.346865+0000","last_became_active":"2024-09-22T08:15:06.970532+0000","last_became_peered":"2024-09-22T08:15:06.970532+0000","last_unstale":"2024-09-22T08:56:29.346865+0000","last_undegraded":"2024-09-22T08:56:29.346865+0000","last_fullsized":"2024-09-22T08:56:29.346865+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'475","last_scrub_stamp":"2024-09-22T08:56:29.346768+0000","last_deep_scrub":"263'475","last_deep_scrub_stamp":"2024-09-22T08:56:29.346768+0000","last_clean_scrub_stamp":"2024-09-22T08:56:29.346768+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:04:32.692649+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2482,"num_read_kb":2307,"num_write":574,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"263'221","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:29.913763+0000","last_change":"2024-09-22T08:56:29.913763+0000","last_active":"2024-09-22T08:56:29.913763+0000","last_peered":"2024-09-22T08:56:29.913763+0000","last_clean":"2024-09-22T08:56:29.913763+0000","last_became_active":"2024-09-22T08:15:04.963648+0000","last_became_peered":"2024-09-22T08:15:04.963648+0000","last_unstale":"2024-09-22T08:56:29.913763+0000","last_undegraded":"2024-09-22T08:56:29.913763+0000","last_fullsized":"2024-09-22T08:56:29.913763+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'221","last_scrub_stamp":"2024-09-22T08:56:29.913651+0000","last_deep_scrub":"263'221","last_deep_scrub_stamp":"2024-09-22T08:56:29.913651+0000","last_clean_scrub_stamp":"2024-09-22T08:56:29.913651+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:49:53.980326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":486,"num_read_kb":19400,"num_write":968,"num_write_kb":35249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"263'4","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:45.413606+0000","last_change":"2024-09-22T08:56:45.413606+0000","last_active":"2024-09-22T08:56:45.413606+0000","last_peered":"2024-09-22T08:56:45.413606+0000","last_clean":"2024-09-22T08:56:45.413606+0000","last_became_active":"2024-09-22T08:15:08.975260+0000","last_became_peered":"2024-09-22T08:15:08.975260+0000","last_unstale":"2024-09-22T08:56:45.413606+0000","last_undegraded":"2024-09-22T08:56:45.413606+0000","last_fullsized":"2024-09-22T08:56:45.413606+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-22T08:56:45.413512+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-22T08:56:45.413512+0000","last_clean_scrub_stamp":"2024-09-22T08:56:45.413512+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:45:14.054216+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":720,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"263'165","reported_seq":757,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:56.864640+0000","last_change":"2024-09-22T08:56:56.864640+0000","last_active":"2024-09-22T08:56:56.864640+0000","last_peered":"2024-09-22T08:56:56.864640+0000","last_clean":"2024-09-22T08:56:56.864640+0000","last_became_active":"2024-09-22T08:15:10.989211+0000","last_became_peered":"2024-09-22T08:15:10.989211+0000","last_unstale":"2024-09-22T08:56:56.864640+0000","last_undegraded":"2024-09-22T08:56:56.864640+0000","last_fullsized":"2024-09-22T08:56:56.864640+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'165","last_scrub_stamp":"2024-09-22T08:56:56.864530+0000","last_deep_scrub":"263'165","last_deep_scrub_stamp":"2024-09-22T08:56:56.864530+0000","last_clean_scrub_stamp":"2024-09-22T08:56:56.864530+0000","objects_scrubbed":7,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:57:58.807869+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9099,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":211,"num_read_kb":297,"num_write":118,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"263'793","reported_seq":2283,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:55.438783+0000","last_change":"2024-09-22T08:56:55.438783+0000","last_active":"2024-09-22T08:56:55.438783+0000","last_peered":"2024-09-22T08:56:55.438783+0000","last_clean":"2024-09-22T08:56:55.438783+0000","last_became_active":"2024-09-22T08:15:13.002828+0000","last_became_peered":"2024-09-22T08:15:13.002828+0000","last_unstale":"2024-09-22T08:56:55.438783+0000","last_undegraded":"2024-09-22T08:56:55.438783+0000","last_fullsized":"2024-09-22T08:56:55.438783+0000","mapping_epoch":31,"log_start":"263'701","ondisk_log_start":"263'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'793","last_scrub_stamp":"2024-09-22T08:56:55.438696+0000","last_deep_scrub":"263'793","last_deep_scrub_stamp":"2024-09-22T08:56:55.438696+0000","last_clean_scrub_stamp":"2024-09-22T08:56:55.438696+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":701,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:41:58.568426+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"263'133","reported_seq":629,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:50.555868+0000","last_change":"2024-09-22T08:56:50.555868+0000","last_active":"2024-09-22T08:56:50.555868+0000","last_peered":"2024-09-22T08:56:50.555868+0000","last_clean":"2024-09-22T08:56:50.555868+0000","last_became_active":"2024-09-22T08:15:15.019162+0000","last_became_peered":"2024-09-22T08:15:15.019162+0000","last_unstale":"2024-09-22T08:56:50.555868+0000","last_undegraded":"2024-09-22T08:56:50.555868+0000","last_fullsized":"2024-09-22T08:56:50.555868+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'133","last_scrub_stamp":"2024-09-22T08:56:50.555734+0000","last_deep_scrub":"263'133","last_deep_scrub_stamp":"2024-09-22T08:56:50.555734+0000","last_clean_scrub_stamp":"2024-09-22T08:56:50.555734+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:43:12.119609+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":846,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":147,"num_read_kb":143,"num_write":317,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"263'518","reported_seq":2272,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:37.386846+0000","last_change":"2024-09-22T08:56:37.386846+0000","last_active":"2024-09-22T08:56:37.386846+0000","last_peered":"2024-09-22T08:56:37.386846+0000","last_clean":"2024-09-22T08:56:37.386846+0000","last_became_active":"2024-09-22T08:15:06.962528+0000","last_became_peered":"2024-09-22T08:15:06.962528+0000","last_unstale":"2024-09-22T08:56:37.386846+0000","last_undegraded":"2024-09-22T08:56:37.386846+0000","last_fullsized":"2024-09-22T08:56:37.386846+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'518","last_scrub_stamp":"2024-09-22T08:56:37.386751+0000","last_deep_scrub":"263'518","last_deep_scrub_stamp":"2024-09-22T08:56:37.386751+0000","last_clean_scrub_stamp":"2024-09-22T08:56:37.386751+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:56:21.707533+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2917,"num_read_kb":2741,"num_write":627,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2295,"num_omap_keys":9,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"263'197","reported_seq":822,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:23.466120+0000","last_change":"2024-09-22T08:56:23.466120+0000","last_active":"2024-09-22T08:56:23.466120+0000","last_peered":"2024-09-22T08:56:23.466120+0000","last_clean":"2024-09-22T08:56:23.466120+0000","last_became_active":"2024-09-22T08:15:04.947739+0000","last_became_peered":"2024-09-22T08:15:04.947739+0000","last_unstale":"2024-09-22T08:56:23.466120+0000","last_undegraded":"2024-09-22T08:56:23.466120+0000","last_fullsized":"2024-09-22T08:56:23.466120+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'197","last_scrub_stamp":"2024-09-22T08:56:23.466035+0000","last_deep_scrub":"263'197","last_deep_scrub_stamp":"2024-09-22T08:56:23.466035+0000","last_clean_scrub_stamp":"2024-09-22T08:56:23.466035+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:03:56.435199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":453,"num_read_kb":50575,"num_write":904,"num_write_kb":23711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:38.470627+0000","last_change":"2024-09-22T08:56:38.470627+0000","last_active":"2024-09-22T08:56:38.470627+0000","last_peered":"2024-09-22T08:56:38.470627+0000","last_clean":"2024-09-22T08:56:38.470627+0000","last_became_active":"2024-09-22T08:15:08.974693+0000","last_became_peered":"2024-09-22T08:15:08.974693+0000","last_unstale":"2024-09-22T08:56:38.470627+0000","last_undegraded":"2024-09-22T08:56:38.470627+0000","last_fullsized":"2024-09-22T08:56:38.470627+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:38.470537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:38.470537+0000","last_clean_scrub_stamp":"2024-09-22T08:56:38.470537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:48:40.724650+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"263'199","reported_seq":834,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:49.810754+0000","last_change":"2024-09-22T08:56:49.810754+0000","last_active":"2024-09-22T08:56:49.810754+0000","last_peered":"2024-09-22T08:56:49.810754+0000","last_clean":"2024-09-22T08:56:49.810754+0000","last_became_active":"2024-09-22T08:15:10.984402+0000","last_became_peered":"2024-09-22T08:15:10.984402+0000","last_unstale":"2024-09-22T08:56:49.810754+0000","last_undegraded":"2024-09-22T08:56:49.810754+0000","last_fullsized":"2024-09-22T08:56:49.810754+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'199","last_scrub_stamp":"2024-09-22T08:56:49.810653+0000","last_deep_scrub":"263'199","last_deep_scrub_stamp":"2024-09-22T08:56:49.810653+0000","last_clean_scrub_stamp":"2024-09-22T08:56:49.810653+0000","objects_scrubbed":6,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:07:41.914863+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13027,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":258,"num_read_kb":332,"num_write":120,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:51.387247+0000","last_change":"2024-09-22T08:56:51.387247+0000","last_active":"2024-09-22T08:56:51.387247+0000","last_peered":"2024-09-22T08:56:51.387247+0000","last_clean":"2024-09-22T08:56:51.387247+0000","last_became_active":"2024-09-22T08:15:13.014612+0000","last_became_peered":"2024-09-22T08:15:13.014612+0000","last_unstale":"2024-09-22T08:56:51.387247+0000","last_undegraded":"2024-09-22T08:56:51.387247+0000","last_fullsized":"2024-09-22T08:56:51.387247+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:51.387155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:51.387155+0000","last_clean_scrub_stamp":"2024-09-22T08:56:51.387155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:53:08.036240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"263'141","reported_seq":662,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:49.317205+0000","last_change":"2024-09-22T08:56:49.317205+0000","last_active":"2024-09-22T08:56:49.317205+0000","last_peered":"2024-09-22T08:56:49.317205+0000","last_clean":"2024-09-22T08:56:49.317205+0000","last_became_active":"2024-09-22T08:15:15.011332+0000","last_became_peered":"2024-09-22T08:15:15.011332+0000","last_unstale":"2024-09-22T08:56:49.317205+0000","last_undegraded":"2024-09-22T08:56:49.317205+0000","last_fullsized":"2024-09-22T08:56:49.317205+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'141","last_scrub_stamp":"2024-09-22T08:56:49.317109+0000","last_deep_scrub":"263'141","last_deep_scrub_stamp":"2024-09-22T08:56:49.317109+0000","last_clean_scrub_stamp":"2024-09-22T08:56:49.317109+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:22.198803+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":195,"num_read_kb":186,"num_write":318,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"263'477","reported_seq":2059,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:32.476096+0000","last_change":"2024-09-22T08:56:32.476096+0000","last_active":"2024-09-22T08:56:32.476096+0000","last_peered":"2024-09-22T08:56:32.476096+0000","last_clean":"2024-09-22T08:56:32.476096+0000","last_became_active":"2024-09-22T08:15:06.966708+0000","last_became_peered":"2024-09-22T08:15:06.966708+0000","last_unstale":"2024-09-22T08:56:32.476096+0000","last_undegraded":"2024-09-22T08:56:32.476096+0000","last_fullsized":"2024-09-22T08:56:32.476096+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'477","last_scrub_stamp":"2024-09-22T08:56:32.476005+0000","last_deep_scrub":"263'477","last_deep_scrub_stamp":"2024-09-22T08:56:32.476005+0000","last_clean_scrub_stamp":"2024-09-22T08:56:32.476005+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:28:16.584918+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2455,"num_read_kb":2308,"num_write":546,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"263'250","reported_seq":890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:25.088528+0000","last_change":"2024-09-22T08:56:25.088528+0000","last_active":"2024-09-22T08:56:25.088528+0000","last_peered":"2024-09-22T08:56:25.088528+0000","last_clean":"2024-09-22T08:56:25.088528+0000","last_became_active":"2024-09-22T08:15:04.949202+0000","last_became_peered":"2024-09-22T08:15:04.949202+0000","last_unstale":"2024-09-22T08:56:25.088528+0000","last_undegraded":"2024-09-22T08:56:25.088528+0000","last_fullsized":"2024-09-22T08:56:25.088528+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'250","last_scrub_stamp":"2024-09-22T08:56:25.088391+0000","last_deep_scrub":"263'250","last_deep_scrub_stamp":"2024-09-22T08:56:25.088391+0000","last_clean_scrub_stamp":"2024-09-22T08:56:25.088391+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:53.098601+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1386384,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":583,"num_read_kb":11398,"num_write":1166,"num_write_kb":28598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:38.128844+0000","last_change":"2024-09-22T08:56:38.128844+0000","last_active":"2024-09-22T08:56:38.128844+0000","last_peered":"2024-09-22T08:56:38.128844+0000","last_clean":"2024-09-22T08:56:38.128844+0000","last_became_active":"2024-09-22T08:15:08.978280+0000","last_became_peered":"2024-09-22T08:15:08.978280+0000","last_unstale":"2024-09-22T08:56:38.128844+0000","last_undegraded":"2024-09-22T08:56:38.128844+0000","last_fullsized":"2024-09-22T08:56:38.128844+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:38.128742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:38.128742+0000","last_clean_scrub_stamp":"2024-09-22T08:56:38.128742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:21:13.730058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"263'174","reported_seq":753,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:39.780381+0000","last_change":"2024-09-22T08:56:39.780381+0000","last_active":"2024-09-22T08:56:39.780381+0000","last_peered":"2024-09-22T08:56:39.780381+0000","last_clean":"2024-09-22T08:56:39.780381+0000","last_became_active":"2024-09-22T08:15:10.986433+0000","last_became_peered":"2024-09-22T08:15:10.986433+0000","last_unstale":"2024-09-22T08:56:39.780381+0000","last_undegraded":"2024-09-22T08:56:39.780381+0000","last_fullsized":"2024-09-22T08:56:39.780381+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'174","last_scrub_stamp":"2024-09-22T08:56:39.780268+0000","last_deep_scrub":"263'174","last_deep_scrub_stamp":"2024-09-22T08:56:39.780268+0000","last_clean_scrub_stamp":"2024-09-22T08:56:39.780268+0000","objects_scrubbed":6,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:46:14.302166+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8940,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":228,"num_read_kb":301,"num_write":186,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:42.207072+0000","last_change":"2024-09-22T08:56:42.207072+0000","last_active":"2024-09-22T08:56:42.207072+0000","last_peered":"2024-09-22T08:56:42.207072+0000","last_clean":"2024-09-22T08:56:42.207072+0000","last_became_active":"2024-09-22T08:15:12.999036+0000","last_became_peered":"2024-09-22T08:15:12.999036+0000","last_unstale":"2024-09-22T08:56:42.207072+0000","last_undegraded":"2024-09-22T08:56:42.207072+0000","last_fullsized":"2024-09-22T08:56:42.207072+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:42.206974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:42.206974+0000","last_clean_scrub_stamp":"2024-09-22T08:56:42.206974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:57:59.149011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"263'100","reported_seq":597,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:53.433256+0000","last_change":"2024-09-22T08:56:53.433256+0000","last_active":"2024-09-22T08:56:53.433256+0000","last_peered":"2024-09-22T08:56:53.433256+0000","last_clean":"2024-09-22T08:56:53.433256+0000","last_became_active":"2024-09-22T08:15:15.011949+0000","last_became_peered":"2024-09-22T08:15:15.011949+0000","last_unstale":"2024-09-22T08:56:53.433256+0000","last_undegraded":"2024-09-22T08:56:53.433256+0000","last_fullsized":"2024-09-22T08:56:53.433256+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'100","last_scrub_stamp":"2024-09-22T08:56:53.433157+0000","last_deep_scrub":"263'100","last_deep_scrub_stamp":"2024-09-22T08:56:53.433157+0000","last_clean_scrub_stamp":"2024-09-22T08:56:53.433157+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:31:51.822201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":93,"num_read_kb":93,"num_write":223,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"263'829","reported_seq":2617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:40.852542+0000","last_change":"2024-09-22T08:56:40.852542+0000","last_active":"2024-09-22T08:56:40.852542+0000","last_peered":"2024-09-22T08:56:40.852542+0000","last_clean":"2024-09-22T08:56:40.852542+0000","last_became_active":"2024-09-22T08:15:06.966795+0000","last_became_peered":"2024-09-22T08:15:06.966795+0000","last_unstale":"2024-09-22T08:56:40.852542+0000","last_undegraded":"2024-09-22T08:56:40.852542+0000","last_fullsized":"2024-09-22T08:56:40.852542+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'829","last_scrub_stamp":"2024-09-22T08:56:40.852447+0000","last_deep_scrub":"263'829","last_deep_scrub_stamp":"2024-09-22T08:56:40.852447+0000","last_clean_scrub_stamp":"2024-09-22T08:56:40.852447+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:33:27.427428+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4273,"num_read_kb":3896,"num_write":1079,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3244,"num_omap_keys":13,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"263'222","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:27.930142+0000","last_change":"2024-09-22T08:56:27.930142+0000","last_active":"2024-09-22T08:56:27.930142+0000","last_peered":"2024-09-22T08:56:27.930142+0000","last_clean":"2024-09-22T08:56:27.930142+0000","last_became_active":"2024-09-22T08:15:04.954492+0000","last_became_peered":"2024-09-22T08:15:04.954492+0000","last_unstale":"2024-09-22T08:56:27.930142+0000","last_undegraded":"2024-09-22T08:56:27.930142+0000","last_fullsized":"2024-09-22T08:56:27.930142+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'222","last_scrub_stamp":"2024-09-22T08:56:27.930037+0000","last_deep_scrub":"263'222","last_deep_scrub_stamp":"2024-09-22T08:56:27.930037+0000","last_clean_scrub_stamp":"2024-09-22T08:56:27.930037+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:04:52.837489+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079919,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":477,"num_read_kb":44813,"num_write":947,"num_write_kb":39223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:46.438084+0000","last_change":"2024-09-22T08:56:46.438084+0000","last_active":"2024-09-22T08:56:46.438084+0000","last_peered":"2024-09-22T08:56:46.438084+0000","last_clean":"2024-09-22T08:56:46.438084+0000","last_became_active":"2024-09-22T08:15:08.976990+0000","last_became_peered":"2024-09-22T08:15:08.976990+0000","last_unstale":"2024-09-22T08:56:46.438084+0000","last_undegraded":"2024-09-22T08:56:46.438084+0000","last_fullsized":"2024-09-22T08:56:46.438084+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:46.437993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:46.437993+0000","last_clean_scrub_stamp":"2024-09-22T08:56:46.437993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:36:06.743042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"263'156","reported_seq":747,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:48.405014+0000","last_change":"2024-09-22T08:56:48.405014+0000","last_active":"2024-09-22T08:56:48.405014+0000","last_peered":"2024-09-22T08:56:48.405014+0000","last_clean":"2024-09-22T08:56:48.405014+0000","last_became_active":"2024-09-22T08:15:10.979449+0000","last_became_peered":"2024-09-22T08:15:10.979449+0000","last_unstale":"2024-09-22T08:56:48.405014+0000","last_undegraded":"2024-09-22T08:56:48.405014+0000","last_fullsized":"2024-09-22T08:56:48.405014+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'156","last_scrub_stamp":"2024-09-22T08:56:48.404914+0000","last_deep_scrub":"263'156","last_deep_scrub_stamp":"2024-09-22T08:56:48.404914+0000","last_clean_scrub_stamp":"2024-09-22T08:56:48.404914+0000","objects_scrubbed":7,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:26:48.853422+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6421,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":192,"num_read_kb":205,"num_write":100,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"263'771","reported_seq":4259,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:40.149276+0000","last_change":"2024-09-22T08:56:40.149276+0000","last_active":"2024-09-22T08:56:40.149276+0000","last_peered":"2024-09-22T08:56:40.149276+0000","last_clean":"2024-09-22T08:56:40.149276+0000","last_became_active":"2024-09-22T08:15:13.015504+0000","last_became_peered":"2024-09-22T08:15:13.015504+0000","last_unstale":"2024-09-22T08:56:40.149276+0000","last_undegraded":"2024-09-22T08:56:40.149276+0000","last_fullsized":"2024-09-22T08:56:40.149276+0000","mapping_epoch":31,"log_start":"263'701","ondisk_log_start":"263'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'771","last_scrub_stamp":"2024-09-22T08:56:40.149185+0000","last_deep_scrub":"263'771","last_deep_scrub_stamp":"2024-09-22T08:56:40.149185+0000","last_clean_scrub_stamp":"2024-09-22T08:56:40.149185+0000","objects_scrubbed":1,"log_size":70,"log_dups_size":701,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:21.199547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"263'135","reported_seq":640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:49.589765+0000","last_change":"2024-09-22T08:56:49.589694+0000","last_active":"2024-09-22T08:56:49.589765+0000","last_peered":"2024-09-22T08:56:49.589765+0000","last_clean":"2024-09-22T08:56:49.589765+0000","last_became_active":"2024-09-22T08:15:15.017584+0000","last_became_peered":"2024-09-22T08:15:15.017584+0000","last_unstale":"2024-09-22T08:56:49.589765+0000","last_undegraded":"2024-09-22T08:56:49.589765+0000","last_fullsized":"2024-09-22T08:56:49.589765+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'135","last_scrub_stamp":"2024-09-22T08:56:49.589600+0000","last_deep_scrub":"263'135","last_deep_scrub_stamp":"2024-09-22T08:56:49.589600+0000","last_clean_scrub_stamp":"2024-09-22T08:56:49.589600+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:37:33.886633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":193,"num_read_kb":181,"num_write":318,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"263'746","reported_seq":2330,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:35.418814+0000","last_change":"2024-09-22T08:56:35.418814+0000","last_active":"2024-09-22T08:56:35.418814+0000","last_peered":"2024-09-22T08:56:35.418814+0000","last_clean":"2024-09-22T08:56:35.418814+0000","last_became_active":"2024-09-22T08:15:06.973918+0000","last_became_peered":"2024-09-22T08:15:06.973918+0000","last_unstale":"2024-09-22T08:56:35.418814+0000","last_undegraded":"2024-09-22T08:56:35.418814+0000","last_fullsized":"2024-09-22T08:56:35.418814+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'746","last_scrub_stamp":"2024-09-22T08:56:35.418722+0000","last_deep_scrub":"263'746","last_deep_scrub_stamp":"2024-09-22T08:56:35.418722+0000","last_clean_scrub_stamp":"2024-09-22T08:56:35.418722+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":700,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:24:01.261807+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3813,"num_read_kb":3478,"num_write":973,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"263'231","reported_seq":896,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:28.938830+0000","last_change":"2024-09-22T08:56:28.938830+0000","last_active":"2024-09-22T08:56:28.938830+0000","last_peered":"2024-09-22T08:56:28.938830+0000","last_clean":"2024-09-22T08:56:28.938830+0000","last_became_active":"2024-09-22T08:15:04.958336+0000","last_became_peered":"2024-09-22T08:15:04.958336+0000","last_unstale":"2024-09-22T08:56:28.938830+0000","last_undegraded":"2024-09-22T08:56:28.938830+0000","last_fullsized":"2024-09-22T08:56:28.938830+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'231","last_scrub_stamp":"2024-09-22T08:56:28.938691+0000","last_deep_scrub":"263'231","last_deep_scrub_stamp":"2024-09-22T08:56:28.938691+0000","last_clean_scrub_stamp":"2024-09-22T08:56:28.938691+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:30.008305+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":654,"num_read_kb":3596,"num_write":1077,"num_write_kb":27039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"263'4","reported_seq":1457,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:37.780914+0000","last_change":"2024-09-22T08:56:37.780914+0000","last_active":"2024-09-22T08:56:37.780914+0000","last_peered":"2024-09-22T08:56:37.780914+0000","last_clean":"2024-09-22T08:56:37.780914+0000","last_became_active":"2024-09-22T08:15:08.982221+0000","last_became_peered":"2024-09-22T08:15:08.982221+0000","last_unstale":"2024-09-22T08:56:37.780914+0000","last_undegraded":"2024-09-22T08:56:37.780914+0000","last_fullsized":"2024-09-22T08:56:37.780914+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-22T08:56:37.780814+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-22T08:56:37.780814+0000","last_clean_scrub_stamp":"2024-09-22T08:56:37.780814+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:28:47.547033+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":950,"num_read_kb":950,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"263'78","reported_seq":598,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:43.533476+0000","last_change":"2024-09-22T08:56:43.533476+0000","last_active":"2024-09-22T08:56:43.533476+0000","last_peered":"2024-09-22T08:56:43.533476+0000","last_clean":"2024-09-22T08:56:43.533476+0000","last_became_active":"2024-09-22T08:15:10.987273+0000","last_became_peered":"2024-09-22T08:15:10.987273+0000","last_unstale":"2024-09-22T08:56:43.533476+0000","last_undegraded":"2024-09-22T08:56:43.533476+0000","last_fullsized":"2024-09-22T08:56:43.533476+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'78","last_scrub_stamp":"2024-09-22T08:56:43.533371+0000","last_deep_scrub":"263'78","last_deep_scrub_stamp":"2024-09-22T08:56:43.533371+0000","last_clean_scrub_stamp":"2024-09-22T08:56:43.533371+0000","objects_scrubbed":5,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:01:13.534183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"263'791","reported_seq":2320,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:45.734603+0000","last_change":"2024-09-22T08:56:45.734603+0000","last_active":"2024-09-22T08:56:45.734603+0000","last_peered":"2024-09-22T08:56:45.734603+0000","last_clean":"2024-09-22T08:56:45.734603+0000","last_became_active":"2024-09-22T08:15:13.010641+0000","last_became_peered":"2024-09-22T08:15:13.010641+0000","last_unstale":"2024-09-22T08:56:45.734603+0000","last_undegraded":"2024-09-22T08:56:45.734603+0000","last_fullsized":"2024-09-22T08:56:45.734603+0000","mapping_epoch":31,"log_start":"263'701","ondisk_log_start":"263'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'791","last_scrub_stamp":"2024-09-22T08:56:45.734525+0000","last_deep_scrub":"263'791","last_deep_scrub_stamp":"2024-09-22T08:56:45.734525+0000","last_clean_scrub_stamp":"2024-09-22T08:56:45.734525+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":701,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:51:11.341773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"263'125","reported_seq":629,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:47.296418+0000","last_change":"2024-09-22T08:56:47.296344+0000","last_active":"2024-09-22T08:56:47.296418+0000","last_peered":"2024-09-22T08:56:47.296418+0000","last_clean":"2024-09-22T08:56:47.296418+0000","last_became_active":"2024-09-22T08:15:15.014775+0000","last_became_peered":"2024-09-22T08:15:15.014775+0000","last_unstale":"2024-09-22T08:56:47.296418+0000","last_undegraded":"2024-09-22T08:56:47.296418+0000","last_fullsized":"2024-09-22T08:56:47.296418+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'125","last_scrub_stamp":"2024-09-22T08:56:47.296257+0000","last_deep_scrub":"263'125","last_deep_scrub_stamp":"2024-09-22T08:56:47.296257+0000","last_clean_scrub_stamp":"2024-09-22T08:56:47.296257+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:25:15.152835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":160,"num_write":304,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"263'416","reported_seq":1980,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:28.069522+0000","last_change":"2024-09-22T08:56:28.069522+0000","last_active":"2024-09-22T08:56:28.069522+0000","last_peered":"2024-09-22T08:56:28.069522+0000","last_clean":"2024-09-22T08:56:28.069522+0000","last_became_active":"2024-09-22T08:15:06.957239+0000","last_became_peered":"2024-09-22T08:15:06.957239+0000","last_unstale":"2024-09-22T08:56:28.069522+0000","last_undegraded":"2024-09-22T08:56:28.069522+0000","last_fullsized":"2024-09-22T08:56:28.069522+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'416","last_scrub_stamp":"2024-09-22T08:56:28.069427+0000","last_deep_scrub":"263'416","last_deep_scrub_stamp":"2024-09-22T08:56:28.069427+0000","last_clean_scrub_stamp":"2024-09-22T08:56:28.069427+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:11:54.954287+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2251,"num_read_kb":2145,"num_write":475,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"263'273","reported_seq":963,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:26.484287+0000","last_change":"2024-09-22T08:56:26.484287+0000","last_active":"2024-09-22T08:56:26.484287+0000","last_peered":"2024-09-22T08:56:26.484287+0000","last_clean":"2024-09-22T08:56:26.484287+0000","last_became_active":"2024-09-22T08:15:04.943906+0000","last_became_peered":"2024-09-22T08:15:04.943906+0000","last_unstale":"2024-09-22T08:56:26.484287+0000","last_undegraded":"2024-09-22T08:56:26.484287+0000","last_fullsized":"2024-09-22T08:56:26.484287+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'273","last_scrub_stamp":"2024-09-22T08:56:26.484114+0000","last_deep_scrub":"263'273","last_deep_scrub_stamp":"2024-09-22T08:56:26.484114+0000","last_clean_scrub_stamp":"2024-09-22T08:56:26.484114+0000","objects_scrubbed":3,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:37:56.831727+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079942,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":793,"num_read_kb":68557,"num_write":1190,"num_write_kb":29712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:50.883370+0000","last_change":"2024-09-22T08:56:50.883370+0000","last_active":"2024-09-22T08:56:50.883370+0000","last_peered":"2024-09-22T08:56:50.883370+0000","last_clean":"2024-09-22T08:56:50.883370+0000","last_became_active":"2024-09-22T08:15:08.969175+0000","last_became_peered":"2024-09-22T08:15:08.969175+0000","last_unstale":"2024-09-22T08:56:50.883370+0000","last_undegraded":"2024-09-22T08:56:50.883370+0000","last_fullsized":"2024-09-22T08:56:50.883370+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:50.883288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:50.883288+0000","last_clean_scrub_stamp":"2024-09-22T08:56:50.883288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:44:13.341062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"263'201","reported_seq":811,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:40.829949+0000","last_change":"2024-09-22T08:56:40.829949+0000","last_active":"2024-09-22T08:56:40.829949+0000","last_peered":"2024-09-22T08:56:40.829949+0000","last_clean":"2024-09-22T08:56:40.829949+0000","last_became_active":"2024-09-22T08:15:10.987081+0000","last_became_peered":"2024-09-22T08:15:10.987081+0000","last_unstale":"2024-09-22T08:56:40.829949+0000","last_undegraded":"2024-09-22T08:56:40.829949+0000","last_fullsized":"2024-09-22T08:56:40.829949+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'201","last_scrub_stamp":"2024-09-22T08:56:40.829842+0000","last_deep_scrub":"263'201","last_deep_scrub_stamp":"2024-09-22T08:56:40.829842+0000","last_clean_scrub_stamp":"2024-09-22T08:56:40.829842+0000","objects_scrubbed":8,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:08:13.921355+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5409,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":251,"num_read_kb":285,"num_write":138,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:43.325337+0000","last_change":"2024-09-22T08:56:43.325337+0000","last_active":"2024-09-22T08:56:43.325337+0000","last_peered":"2024-09-22T08:56:43.325337+0000","last_clean":"2024-09-22T08:56:43.325337+0000","last_became_active":"2024-09-22T08:15:13.007735+0000","last_became_peered":"2024-09-22T08:15:13.007735+0000","last_unstale":"2024-09-22T08:56:43.325337+0000","last_undegraded":"2024-09-22T08:56:43.325337+0000","last_fullsized":"2024-09-22T08:56:43.325337+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:43.325244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:43.325244+0000","last_clean_scrub_stamp":"2024-09-22T08:56:43.325244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:36:29.351234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"263'155","reported_seq":657,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:47.265631+0000","last_change":"2024-09-22T08:56:47.265578+0000","last_active":"2024-09-22T08:56:47.265631+0000","last_peered":"2024-09-22T08:56:47.265631+0000","last_clean":"2024-09-22T08:56:47.265631+0000","last_became_active":"2024-09-22T08:15:15.013216+0000","last_became_peered":"2024-09-22T08:15:15.013216+0000","last_unstale":"2024-09-22T08:56:47.265631+0000","last_undegraded":"2024-09-22T08:56:47.265631+0000","last_fullsized":"2024-09-22T08:56:47.265631+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'155","last_scrub_stamp":"2024-09-22T08:56:47.265466+0000","last_deep_scrub":"263'155","last_deep_scrub_stamp":"2024-09-22T08:56:47.265466+0000","last_clean_scrub_stamp":"2024-09-22T08:56:47.265466+0000","objects_scrubbed":6,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:25:17.464430+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1066,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":167,"num_read_kb":166,"num_write":339,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"263'394","reported_seq":1972,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:39.809906+0000","last_change":"2024-09-22T08:56:39.809824+0000","last_active":"2024-09-22T08:56:39.809906+0000","last_peered":"2024-09-22T08:56:39.809906+0000","last_clean":"2024-09-22T08:56:39.809906+0000","last_became_active":"2024-09-22T08:15:06.966710+0000","last_became_peered":"2024-09-22T08:15:06.966710+0000","last_unstale":"2024-09-22T08:56:39.809906+0000","last_undegraded":"2024-09-22T08:56:39.809906+0000","last_fullsized":"2024-09-22T08:56:39.809906+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'394","last_scrub_stamp":"2024-09-22T08:56:39.809723+0000","last_deep_scrub":"263'394","last_deep_scrub_stamp":"2024-09-22T08:56:39.809723+0000","last_clean_scrub_stamp":"2024-09-22T08:56:39.809723+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:25:17.819687+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2363,"num_read_kb":2266,"num_write":458,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"263'74","reported_seq":622,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:23.906239+0000","last_change":"2024-09-22T08:56:23.906168+0000","last_active":"2024-09-22T08:56:23.906239+0000","last_peered":"2024-09-22T08:56:23.906239+0000","last_clean":"2024-09-22T08:56:23.906239+0000","last_became_active":"2024-09-22T08:14:48.584210+0000","last_became_peered":"2024-09-22T08:14:48.584210+0000","last_unstale":"2024-09-22T08:56:23.906239+0000","last_undegraded":"2024-09-22T08:56:23.906239+0000","last_fullsized":"2024-09-22T08:56:23.906239+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'74","last_scrub_stamp":"2024-09-22T08:56:23.906086+0000","last_deep_scrub":"263'74","last_deep_scrub_stamp":"2024-09-22T08:56:23.906086+0000","last_clean_scrub_stamp":"2024-09-22T08:56:23.906086+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:41:31.894467+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"263'2","reported_seq":532,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:24.997667+0000","last_change":"2024-09-22T08:56:24.997623+0000","last_active":"2024-09-22T08:56:24.997667+0000","last_peered":"2024-09-22T08:56:24.997667+0000","last_clean":"2024-09-22T08:56:24.997667+0000","last_became_active":"2024-09-22T08:14:54.727501+0000","last_became_peered":"2024-09-22T08:14:54.727501+0000","last_unstale":"2024-09-22T08:56:24.997667+0000","last_undegraded":"2024-09-22T08:56:24.997667+0000","last_fullsized":"2024-09-22T08:56:24.997667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:56:24.997551+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:56:24.997551+0000","last_clean_scrub_stamp":"2024-09-22T08:56:24.997551+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:35:48.958613+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001065632,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"263'182","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:23.521553+0000","last_change":"2024-09-22T08:56:23.521494+0000","last_active":"2024-09-22T08:56:23.521553+0000","last_peered":"2024-09-22T08:56:23.521553+0000","last_clean":"2024-09-22T08:56:23.521553+0000","last_became_active":"2024-09-22T08:15:04.963447+0000","last_became_peered":"2024-09-22T08:15:04.963447+0000","last_unstale":"2024-09-22T08:56:23.521553+0000","last_undegraded":"2024-09-22T08:56:23.521553+0000","last_fullsized":"2024-09-22T08:56:23.521553+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'182","last_scrub_stamp":"2024-09-22T08:56:23.521376+0000","last_deep_scrub":"263'182","last_deep_scrub_stamp":"2024-09-22T08:56:23.521376+0000","last_clean_scrub_stamp":"2024-09-22T08:56:23.521376+0000","objects_scrubbed":3,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:36:09.902043+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":624,"num_read_kb":9185,"num_write":876,"num_write_kb":23340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:39.482287+0000","last_change":"2024-09-22T08:56:39.482217+0000","last_active":"2024-09-22T08:56:39.482287+0000","last_peered":"2024-09-22T08:56:39.482287+0000","last_clean":"2024-09-22T08:56:39.482287+0000","last_became_active":"2024-09-22T08:15:08.978755+0000","last_became_peered":"2024-09-22T08:15:08.978755+0000","last_unstale":"2024-09-22T08:56:39.482287+0000","last_undegraded":"2024-09-22T08:56:39.482287+0000","last_fullsized":"2024-09-22T08:56:39.482287+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:39.482129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:39.482129+0000","last_clean_scrub_stamp":"2024-09-22T08:56:39.482129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:10:09.797452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"263'285","reported_seq":993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:55.855685+0000","last_change":"2024-09-22T08:56:55.855685+0000","last_active":"2024-09-22T08:56:55.855685+0000","last_peered":"2024-09-22T08:56:55.855685+0000","last_clean":"2024-09-22T08:56:55.855685+0000","last_became_active":"2024-09-22T08:15:10.991050+0000","last_became_peered":"2024-09-22T08:15:10.991050+0000","last_unstale":"2024-09-22T08:56:55.855685+0000","last_undegraded":"2024-09-22T08:56:55.855685+0000","last_fullsized":"2024-09-22T08:56:55.855685+0000","mapping_epoch":29,"log_start":"260'200","ondisk_log_start":"260'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'285","last_scrub_stamp":"2024-09-22T08:56:55.855582+0000","last_deep_scrub":"263'285","last_deep_scrub_stamp":"2024-09-22T08:56:55.855582+0000","last_clean_scrub_stamp":"2024-09-22T08:56:55.855582+0000","objects_scrubbed":6,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:35:16.766711+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27910,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":531,"num_read_kb":745,"num_write":430,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89604,"num_omap_keys":214,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:50.371545+0000","last_change":"2024-09-22T08:56:50.371545+0000","last_active":"2024-09-22T08:56:50.371545+0000","last_peered":"2024-09-22T08:56:50.371545+0000","last_clean":"2024-09-22T08:56:50.371545+0000","last_became_active":"2024-09-22T08:15:13.018627+0000","last_became_peered":"2024-09-22T08:15:13.018627+0000","last_unstale":"2024-09-22T08:56:50.371545+0000","last_undegraded":"2024-09-22T08:56:50.371545+0000","last_fullsized":"2024-09-22T08:56:50.371545+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:50.371455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:50.371455+0000","last_clean_scrub_stamp":"2024-09-22T08:56:50.371455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:29:20.855982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"263'228","reported_seq":962,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:45.423312+0000","last_change":"2024-09-22T08:56:45.423312+0000","last_active":"2024-09-22T08:56:45.423312+0000","last_peered":"2024-09-22T08:56:45.423312+0000","last_clean":"2024-09-22T08:56:45.423312+0000","last_became_active":"2024-09-22T08:15:15.017533+0000","last_became_peered":"2024-09-22T08:15:15.017533+0000","last_unstale":"2024-09-22T08:56:45.423312+0000","last_undegraded":"2024-09-22T08:56:45.423312+0000","last_fullsized":"2024-09-22T08:56:45.423312+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'228","last_scrub_stamp":"2024-09-22T08:56:45.423222+0000","last_deep_scrub":"263'228","last_deep_scrub_stamp":"2024-09-22T08:56:45.423222+0000","last_clean_scrub_stamp":"2024-09-22T08:56:45.423222+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:57:26.111196+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":616,"num_read_kb":580,"num_write":434,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"263'397","reported_seq":1968,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:36.374074+0000","last_change":"2024-09-22T08:56:36.374074+0000","last_active":"2024-09-22T08:56:36.374074+0000","last_peered":"2024-09-22T08:56:36.374074+0000","last_clean":"2024-09-22T08:56:36.374074+0000","last_became_active":"2024-09-22T08:15:06.966792+0000","last_became_peered":"2024-09-22T08:15:06.966792+0000","last_unstale":"2024-09-22T08:56:36.374074+0000","last_undegraded":"2024-09-22T08:56:36.374074+0000","last_fullsized":"2024-09-22T08:56:36.374074+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'397","last_scrub_stamp":"2024-09-22T08:56:36.373981+0000","last_deep_scrub":"263'397","last_deep_scrub_stamp":"2024-09-22T08:56:36.373981+0000","last_clean_scrub_stamp":"2024-09-22T08:56:36.373981+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:00:10.052430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2208,"num_read_kb":2116,"num_write":452,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":531,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:22.986425+0000","last_change":"2024-09-22T08:56:22.986343+0000","last_active":"2024-09-22T08:56:22.986425+0000","last_peered":"2024-09-22T08:56:22.986425+0000","last_clean":"2024-09-22T08:56:22.986425+0000","last_became_active":"2024-09-22T08:14:54.726875+0000","last_became_peered":"2024-09-22T08:14:54.726875+0000","last_unstale":"2024-09-22T08:56:22.986425+0000","last_undegraded":"2024-09-22T08:56:22.986425+0000","last_fullsized":"2024-09-22T08:56:22.986425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:22.986260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:22.986260+0000","last_clean_scrub_stamp":"2024-09-22T08:56:22.986260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:13:47.646650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000558433,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"263'182","reported_seq":796,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:31.472701+0000","last_change":"2024-09-22T08:56:31.472650+0000","last_active":"2024-09-22T08:56:31.472701+0000","last_peered":"2024-09-22T08:56:31.472701+0000","last_clean":"2024-09-22T08:56:31.472701+0000","last_became_active":"2024-09-22T08:15:04.963967+0000","last_became_peered":"2024-09-22T08:15:04.963967+0000","last_unstale":"2024-09-22T08:56:31.472701+0000","last_undegraded":"2024-09-22T08:56:31.472701+0000","last_fullsized":"2024-09-22T08:56:31.472701+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'182","last_scrub_stamp":"2024-09-22T08:56:31.472539+0000","last_deep_scrub":"263'182","last_deep_scrub_stamp":"2024-09-22T08:56:31.472539+0000","last_clean_scrub_stamp":"2024-09-22T08:56:31.472539+0000","objects_scrubbed":2,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:54:16.950622+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":424,"num_read_kb":76135,"num_write":811,"num_write_kb":37187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:49.864291+0000","last_change":"2024-09-22T08:56:49.864291+0000","last_active":"2024-09-22T08:56:49.864291+0000","last_peered":"2024-09-22T08:56:49.864291+0000","last_clean":"2024-09-22T08:56:49.864291+0000","last_became_active":"2024-09-22T08:15:08.969276+0000","last_became_peered":"2024-09-22T08:15:08.969276+0000","last_unstale":"2024-09-22T08:56:49.864291+0000","last_undegraded":"2024-09-22T08:56:49.864291+0000","last_fullsized":"2024-09-22T08:56:49.864291+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:49.864205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:49.864205+0000","last_clean_scrub_stamp":"2024-09-22T08:56:49.864205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:04:18.212089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"263'869","reported_seq":2309,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:41.175097+0000","last_change":"2024-09-22T08:56:41.174984+0000","last_active":"2024-09-22T08:56:41.175097+0000","last_peered":"2024-09-22T08:56:41.175097+0000","last_clean":"2024-09-22T08:56:41.175097+0000","last_became_active":"2024-09-22T08:15:10.984157+0000","last_became_peered":"2024-09-22T08:15:10.984157+0000","last_unstale":"2024-09-22T08:56:41.175097+0000","last_undegraded":"2024-09-22T08:56:41.175097+0000","last_fullsized":"2024-09-22T08:56:41.175097+0000","mapping_epoch":29,"log_start":"263'800","ondisk_log_start":"263'800","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'869","last_scrub_stamp":"2024-09-22T08:56:41.174846+0000","last_deep_scrub":"263'869","last_deep_scrub_stamp":"2024-09-22T08:56:41.174846+0000","last_clean_scrub_stamp":"2024-09-22T08:56:41.174846+0000","objects_scrubbed":12,"log_size":69,"log_dups_size":800,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:25:27.321377+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49716,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1169,"num_read_kb":1404,"num_write":276,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:00.918613+0000","last_change":"2024-09-22T08:57:00.918613+0000","last_active":"2024-09-22T08:57:00.918613+0000","last_peered":"2024-09-22T08:57:00.918613+0000","last_clean":"2024-09-22T08:57:00.918613+0000","last_became_active":"2024-09-22T08:15:13.011864+0000","last_became_peered":"2024-09-22T08:15:13.011864+0000","last_unstale":"2024-09-22T08:57:00.918613+0000","last_undegraded":"2024-09-22T08:57:00.918613+0000","last_fullsized":"2024-09-22T08:57:00.918613+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:00.918518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:00.918518+0000","last_clean_scrub_stamp":"2024-09-22T08:57:00.918518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:50:43.992471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"263'216","reported_seq":751,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:54.478201+0000","last_change":"2024-09-22T08:56:54.478201+0000","last_active":"2024-09-22T08:56:54.478201+0000","last_peered":"2024-09-22T08:56:54.478201+0000","last_clean":"2024-09-22T08:56:54.478201+0000","last_became_active":"2024-09-22T08:15:15.014003+0000","last_became_peered":"2024-09-22T08:15:15.014003+0000","last_unstale":"2024-09-22T08:56:54.478201+0000","last_undegraded":"2024-09-22T08:56:54.478201+0000","last_fullsized":"2024-09-22T08:56:54.478201+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'216","last_scrub_stamp":"2024-09-22T08:56:54.478109+0000","last_deep_scrub":"263'216","last_deep_scrub_stamp":"2024-09-22T08:56:54.478109+0000","last_clean_scrub_stamp":"2024-09-22T08:56:54.478109+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:20:35.254434+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":401,"num_read_kb":391,"num_write":491,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"263'700","reported_seq":2541,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:34.442254+0000","last_change":"2024-09-22T08:56:34.442254+0000","last_active":"2024-09-22T08:56:34.442254+0000","last_peered":"2024-09-22T08:56:34.442254+0000","last_clean":"2024-09-22T08:56:34.442254+0000","last_became_active":"2024-09-22T08:15:06.972591+0000","last_became_peered":"2024-09-22T08:15:06.972591+0000","last_unstale":"2024-09-22T08:56:34.442254+0000","last_undegraded":"2024-09-22T08:56:34.442254+0000","last_fullsized":"2024-09-22T08:56:34.442254+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'700","last_scrub_stamp":"2024-09-22T08:56:34.442140+0000","last_deep_scrub":"263'700","last_deep_scrub_stamp":"2024-09-22T08:56:34.442140+0000","last_clean_scrub_stamp":"2024-09-22T08:56:34.442140+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":600,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:12:11.424859+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3779,"num_read_kb":3472,"num_write":954,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":695,"num_omap_keys":3,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":532,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:27.077163+0000","last_change":"2024-09-22T08:56:27.077093+0000","last_active":"2024-09-22T08:56:27.077163+0000","last_peered":"2024-09-22T08:56:27.077163+0000","last_clean":"2024-09-22T08:56:27.077163+0000","last_became_active":"2024-09-22T08:14:54.718660+0000","last_became_peered":"2024-09-22T08:14:54.718660+0000","last_unstale":"2024-09-22T08:56:27.077163+0000","last_undegraded":"2024-09-22T08:56:27.077163+0000","last_fullsized":"2024-09-22T08:56:27.077163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:27.076990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:27.076990+0000","last_clean_scrub_stamp":"2024-09-22T08:56:27.076990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:51:42.150906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042448600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"263'261","reported_seq":954,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:26.431268+0000","last_change":"2024-09-22T08:56:26.431268+0000","last_active":"2024-09-22T08:56:26.431268+0000","last_peered":"2024-09-22T08:56:26.431268+0000","last_clean":"2024-09-22T08:56:26.431268+0000","last_became_active":"2024-09-22T08:15:04.954726+0000","last_became_peered":"2024-09-22T08:15:04.954726+0000","last_unstale":"2024-09-22T08:56:26.431268+0000","last_undegraded":"2024-09-22T08:56:26.431268+0000","last_fullsized":"2024-09-22T08:56:26.431268+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'261","last_scrub_stamp":"2024-09-22T08:56:26.431154+0000","last_deep_scrub":"263'261","last_deep_scrub_stamp":"2024-09-22T08:56:26.431154+0000","last_clean_scrub_stamp":"2024-09-22T08:56:26.431154+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:09:33.251754+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":813,"num_read_kb":7176,"num_write":1020,"num_write_kb":41627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"263'2","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:46.234731+0000","last_change":"2024-09-22T08:56:46.234731+0000","last_active":"2024-09-22T08:56:46.234731+0000","last_peered":"2024-09-22T08:56:46.234731+0000","last_clean":"2024-09-22T08:56:46.234731+0000","last_became_active":"2024-09-22T08:15:08.974419+0000","last_became_peered":"2024-09-22T08:15:08.974419+0000","last_unstale":"2024-09-22T08:56:46.234731+0000","last_undegraded":"2024-09-22T08:56:46.234731+0000","last_fullsized":"2024-09-22T08:56:46.234731+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:56:46.234640+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:56:46.234640+0000","last_clean_scrub_stamp":"2024-09-22T08:56:46.234640+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:32:06.632320+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"263'242","reported_seq":1287,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:40.526383+0000","last_change":"2024-09-22T08:56:40.526320+0000","last_active":"2024-09-22T08:56:40.526383+0000","last_peered":"2024-09-22T08:56:40.526383+0000","last_clean":"2024-09-22T08:56:40.526383+0000","last_became_active":"2024-09-22T08:15:10.987358+0000","last_became_peered":"2024-09-22T08:15:10.987358+0000","last_unstale":"2024-09-22T08:56:40.526383+0000","last_undegraded":"2024-09-22T08:56:40.526383+0000","last_fullsized":"2024-09-22T08:56:40.526383+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'242","last_scrub_stamp":"2024-09-22T08:56:40.526223+0000","last_deep_scrub":"263'242","last_deep_scrub_stamp":"2024-09-22T08:56:40.526223+0000","last_clean_scrub_stamp":"2024-09-22T08:56:40.526223+0000","objects_scrubbed":9,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:34:59.804804+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":174,"num_read_kb":166,"num_write":139,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5278,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:54.784267+0000","last_change":"2024-09-22T08:56:54.784267+0000","last_active":"2024-09-22T08:56:54.784267+0000","last_peered":"2024-09-22T08:56:54.784267+0000","last_clean":"2024-09-22T08:56:54.784267+0000","last_became_active":"2024-09-22T08:15:13.009891+0000","last_became_peered":"2024-09-22T08:15:13.009891+0000","last_unstale":"2024-09-22T08:56:54.784267+0000","last_undegraded":"2024-09-22T08:56:54.784267+0000","last_fullsized":"2024-09-22T08:56:54.784267+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:54.784180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:54.784180+0000","last_clean_scrub_stamp":"2024-09-22T08:56:54.784180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:18:34.727660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"263'247","reported_seq":850,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:00.922028+0000","last_change":"2024-09-22T08:57:00.922028+0000","last_active":"2024-09-22T08:57:00.922028+0000","last_peered":"2024-09-22T08:57:00.922028+0000","last_clean":"2024-09-22T08:57:00.922028+0000","last_became_active":"2024-09-22T08:15:15.017686+0000","last_became_peered":"2024-09-22T08:15:15.017686+0000","last_unstale":"2024-09-22T08:57:00.922028+0000","last_undegraded":"2024-09-22T08:57:00.922028+0000","last_fullsized":"2024-09-22T08:57:00.922028+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'247","last_scrub_stamp":"2024-09-22T08:57:00.921937+0000","last_deep_scrub":"263'247","last_deep_scrub_stamp":"2024-09-22T08:57:00.921937+0000","last_clean_scrub_stamp":"2024-09-22T08:57:00.921937+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:34:22.123361+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":504,"num_read_kb":528,"num_write":541,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"263'459","reported_seq":1994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:33.446661+0000","last_change":"2024-09-22T08:56:33.446543+0000","last_active":"2024-09-22T08:56:33.446661+0000","last_peered":"2024-09-22T08:56:33.446661+0000","last_clean":"2024-09-22T08:56:33.446661+0000","last_became_active":"2024-09-22T08:15:06.962486+0000","last_became_peered":"2024-09-22T08:15:06.962486+0000","last_unstale":"2024-09-22T08:56:33.446661+0000","last_undegraded":"2024-09-22T08:56:33.446661+0000","last_fullsized":"2024-09-22T08:56:33.446661+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'459","last_scrub_stamp":"2024-09-22T08:56:33.446433+0000","last_deep_scrub":"263'459","last_deep_scrub_stamp":"2024-09-22T08:56:33.446433+0000","last_clean_scrub_stamp":"2024-09-22T08:56:33.446433+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:03.195975+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2436,"num_read_kb":2281,"num_write":554,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"263'3","reported_seq":533,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:24.036583+0000","last_change":"2024-09-22T08:56:24.036494+0000","last_active":"2024-09-22T08:56:24.036583+0000","last_peered":"2024-09-22T08:56:24.036583+0000","last_clean":"2024-09-22T08:56:24.036583+0000","last_became_active":"2024-09-22T08:14:55.586088+0000","last_became_peered":"2024-09-22T08:14:55.586088+0000","last_unstale":"2024-09-22T08:56:24.036583+0000","last_undegraded":"2024-09-22T08:56:24.036583+0000","last_fullsized":"2024-09-22T08:56:24.036583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-22T08:56:24.036366+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-22T08:56:24.036366+0000","last_clean_scrub_stamp":"2024-09-22T08:56:24.036366+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:04:54.097829+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0010233219999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"263'164","reported_seq":761,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:21.464594+0000","last_change":"2024-09-22T08:56:21.464541+0000","last_active":"2024-09-22T08:56:21.464594+0000","last_peered":"2024-09-22T08:56:21.464594+0000","last_clean":"2024-09-22T08:56:21.464594+0000","last_became_active":"2024-09-22T08:15:04.963894+0000","last_became_peered":"2024-09-22T08:15:04.963894+0000","last_unstale":"2024-09-22T08:56:21.464594+0000","last_undegraded":"2024-09-22T08:56:21.464594+0000","last_fullsized":"2024-09-22T08:56:21.464594+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'164","last_scrub_stamp":"2024-09-22T08:56:21.464437+0000","last_deep_scrub":"263'164","last_deep_scrub_stamp":"2024-09-22T08:56:21.464437+0000","last_clean_scrub_stamp":"2024-09-22T08:56:21.464437+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:37:48.941982+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":412,"num_read_kb":11085,"num_write":748,"num_write_kb":14868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:36.134128+0000","last_change":"2024-09-22T08:56:36.134073+0000","last_active":"2024-09-22T08:56:36.134128+0000","last_peered":"2024-09-22T08:56:36.134128+0000","last_clean":"2024-09-22T08:56:36.134128+0000","last_became_active":"2024-09-22T08:15:08.968076+0000","last_became_peered":"2024-09-22T08:15:08.968076+0000","last_unstale":"2024-09-22T08:56:36.134128+0000","last_undegraded":"2024-09-22T08:56:36.134128+0000","last_fullsized":"2024-09-22T08:56:36.134128+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:36.133960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:36.133960+0000","last_clean_scrub_stamp":"2024-09-22T08:56:36.133960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:38:20.387449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"263'118","reported_seq":666,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:47.396848+0000","last_change":"2024-09-22T08:56:47.396848+0000","last_active":"2024-09-22T08:56:47.396848+0000","last_peered":"2024-09-22T08:56:47.396848+0000","last_clean":"2024-09-22T08:56:47.396848+0000","last_became_active":"2024-09-22T08:15:10.992450+0000","last_became_peered":"2024-09-22T08:15:10.992450+0000","last_unstale":"2024-09-22T08:56:47.396848+0000","last_undegraded":"2024-09-22T08:56:47.396848+0000","last_fullsized":"2024-09-22T08:56:47.396848+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'118","last_scrub_stamp":"2024-09-22T08:56:47.396740+0000","last_deep_scrub":"263'118","last_deep_scrub_stamp":"2024-09-22T08:56:47.396740+0000","last_clean_scrub_stamp":"2024-09-22T08:56:47.396740+0000","objects_scrubbed":7,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:03:40.352125+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":139,"num_read_kb":133,"num_write":98,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3226,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:01.879916+0000","last_change":"2024-09-22T08:57:01.879916+0000","last_active":"2024-09-22T08:57:01.879916+0000","last_peered":"2024-09-22T08:57:01.879916+0000","last_clean":"2024-09-22T08:57:01.879916+0000","last_became_active":"2024-09-22T08:15:13.011756+0000","last_became_peered":"2024-09-22T08:15:13.011756+0000","last_unstale":"2024-09-22T08:57:01.879916+0000","last_undegraded":"2024-09-22T08:57:01.879916+0000","last_fullsized":"2024-09-22T08:57:01.879916+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:01.879820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:01.879820+0000","last_clean_scrub_stamp":"2024-09-22T08:57:01.879820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:27:28.177102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"263'110","reported_seq":669,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:49.763305+0000","last_change":"2024-09-22T08:56:49.763305+0000","last_active":"2024-09-22T08:56:49.763305+0000","last_peered":"2024-09-22T08:56:49.763305+0000","last_clean":"2024-09-22T08:56:49.763305+0000","last_became_active":"2024-09-22T08:15:15.016910+0000","last_became_peered":"2024-09-22T08:15:15.016910+0000","last_unstale":"2024-09-22T08:56:49.763305+0000","last_undegraded":"2024-09-22T08:56:49.763305+0000","last_fullsized":"2024-09-22T08:56:49.763305+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'110","last_scrub_stamp":"2024-09-22T08:56:49.763207+0000","last_deep_scrub":"263'110","last_deep_scrub_stamp":"2024-09-22T08:56:49.763207+0000","last_clean_scrub_stamp":"2024-09-22T08:56:49.763207+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:32:23.563653+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":271,"num_read_kb":261,"num_write":275,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"263'846","reported_seq":2462,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:29.493402+0000","last_change":"2024-09-22T08:56:29.493348+0000","last_active":"2024-09-22T08:56:29.493402+0000","last_peered":"2024-09-22T08:56:29.493402+0000","last_clean":"2024-09-22T08:56:29.493402+0000","last_became_active":"2024-09-22T08:15:06.965021+0000","last_became_peered":"2024-09-22T08:15:06.965021+0000","last_unstale":"2024-09-22T08:56:29.493402+0000","last_undegraded":"2024-09-22T08:56:29.493402+0000","last_fullsized":"2024-09-22T08:56:29.493402+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'846","last_scrub_stamp":"2024-09-22T08:56:29.493263+0000","last_deep_scrub":"263'846","last_deep_scrub_stamp":"2024-09-22T08:56:29.493263+0000","last_clean_scrub_stamp":"2024-09-22T08:56:29.493263+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":800,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:43:22.418910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4016,"num_read_kb":3619,"num_write":1120,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"263'175","reported_seq":790,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:22.390102+0000","last_change":"2024-09-22T08:56:22.390052+0000","last_active":"2024-09-22T08:56:22.390102+0000","last_peered":"2024-09-22T08:56:22.390102+0000","last_clean":"2024-09-22T08:56:22.390102+0000","last_became_active":"2024-09-22T08:15:04.958834+0000","last_became_peered":"2024-09-22T08:15:04.958834+0000","last_unstale":"2024-09-22T08:56:22.390102+0000","last_undegraded":"2024-09-22T08:56:22.390102+0000","last_fullsized":"2024-09-22T08:56:22.390102+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'175","last_scrub_stamp":"2024-09-22T08:56:22.389983+0000","last_deep_scrub":"263'175","last_deep_scrub_stamp":"2024-09-22T08:56:22.389983+0000","last_clean_scrub_stamp":"2024-09-22T08:56:22.389983+0000","objects_scrubbed":2,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:05:50.275750+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":466,"num_read_kb":15054,"num_write":837,"num_write_kb":27215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":528,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:23.482652+0000","last_change":"2024-09-22T08:56:23.482583+0000","last_active":"2024-09-22T08:56:23.482652+0000","last_peered":"2024-09-22T08:56:23.482652+0000","last_clean":"2024-09-22T08:56:23.482652+0000","last_became_active":"2024-09-22T08:14:55.585738+0000","last_became_peered":"2024-09-22T08:14:55.585738+0000","last_unstale":"2024-09-22T08:56:23.482652+0000","last_undegraded":"2024-09-22T08:56:23.482652+0000","last_fullsized":"2024-09-22T08:56:23.482652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:23.482501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:23.482501+0000","last_clean_scrub_stamp":"2024-09-22T08:56:23.482501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:54:46.131217+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00053802500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:39.742436+0000","last_change":"2024-09-22T08:56:39.742319+0000","last_active":"2024-09-22T08:56:39.742436+0000","last_peered":"2024-09-22T08:56:39.742436+0000","last_clean":"2024-09-22T08:56:39.742436+0000","last_became_active":"2024-09-22T08:15:08.975175+0000","last_became_peered":"2024-09-22T08:15:08.975175+0000","last_unstale":"2024-09-22T08:56:39.742436+0000","last_undegraded":"2024-09-22T08:56:39.742436+0000","last_fullsized":"2024-09-22T08:56:39.742436+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:39.742220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:39.742220+0000","last_clean_scrub_stamp":"2024-09-22T08:56:39.742220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:52:23.005245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"263'301","reported_seq":972,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:37.103768+0000","last_change":"2024-09-22T08:56:37.103768+0000","last_active":"2024-09-22T08:56:37.103768+0000","last_peered":"2024-09-22T08:56:37.103768+0000","last_clean":"2024-09-22T08:56:37.103768+0000","last_became_active":"2024-09-22T08:15:10.982147+0000","last_became_peered":"2024-09-22T08:15:10.982147+0000","last_unstale":"2024-09-22T08:56:37.103768+0000","last_undegraded":"2024-09-22T08:56:37.103768+0000","last_fullsized":"2024-09-22T08:56:37.103768+0000","mapping_epoch":29,"log_start":"260'200","ondisk_log_start":"260'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'301","last_scrub_stamp":"2024-09-22T08:56:37.103659+0000","last_deep_scrub":"263'301","last_deep_scrub_stamp":"2024-09-22T08:56:37.103659+0000","last_clean_scrub_stamp":"2024-09-22T08:56:37.103659+0000","objects_scrubbed":10,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:06:07.933674+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30730,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1060,"num_read_kb":1272,"num_write":1552,"num_write_kb":1410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":535730,"num_omap_keys":1208,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:42.371497+0000","last_change":"2024-09-22T08:56:42.371394+0000","last_active":"2024-09-22T08:56:42.371497+0000","last_peered":"2024-09-22T08:56:42.371497+0000","last_clean":"2024-09-22T08:56:42.371497+0000","last_became_active":"2024-09-22T08:15:13.013980+0000","last_became_peered":"2024-09-22T08:15:13.013980+0000","last_unstale":"2024-09-22T08:56:42.371497+0000","last_undegraded":"2024-09-22T08:56:42.371497+0000","last_fullsized":"2024-09-22T08:56:42.371497+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:42.371291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:42.371291+0000","last_clean_scrub_stamp":"2024-09-22T08:56:42.371291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:04:21.990339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"263'173","reported_seq":733,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:58.512070+0000","last_change":"2024-09-22T08:56:58.512070+0000","last_active":"2024-09-22T08:56:58.512070+0000","last_peered":"2024-09-22T08:56:58.512070+0000","last_clean":"2024-09-22T08:56:58.512070+0000","last_became_active":"2024-09-22T08:15:15.012146+0000","last_became_peered":"2024-09-22T08:15:15.012146+0000","last_unstale":"2024-09-22T08:56:58.512070+0000","last_undegraded":"2024-09-22T08:56:58.512070+0000","last_fullsized":"2024-09-22T08:56:58.512070+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'173","last_scrub_stamp":"2024-09-22T08:56:58.511972+0000","last_deep_scrub":"263'173","last_deep_scrub_stamp":"2024-09-22T08:56:58.511972+0000","last_clean_scrub_stamp":"2024-09-22T08:56:58.511972+0000","objects_scrubbed":4,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:36:15.035865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":420,"num_read_kb":363,"num_write":419,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"263'445","reported_seq":2048,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:32.437594+0000","last_change":"2024-09-22T08:56:32.437536+0000","last_active":"2024-09-22T08:56:32.437594+0000","last_peered":"2024-09-22T08:56:32.437594+0000","last_clean":"2024-09-22T08:56:32.437594+0000","last_became_active":"2024-09-22T08:15:06.973563+0000","last_became_peered":"2024-09-22T08:15:06.973563+0000","last_unstale":"2024-09-22T08:56:32.437594+0000","last_undegraded":"2024-09-22T08:56:32.437594+0000","last_fullsized":"2024-09-22T08:56:32.437594+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'445","last_scrub_stamp":"2024-09-22T08:56:32.437452+0000","last_deep_scrub":"263'445","last_deep_scrub_stamp":"2024-09-22T08:56:32.437452+0000","last_clean_scrub_stamp":"2024-09-22T08:56:32.437452+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:12:03.651331+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2370,"num_read_kb":2248,"num_write":498,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"263'190","reported_seq":820,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:24.448779+0000","last_change":"2024-09-22T08:56:24.448712+0000","last_active":"2024-09-22T08:56:24.448779+0000","last_peered":"2024-09-22T08:56:24.448779+0000","last_clean":"2024-09-22T08:56:24.448779+0000","last_became_active":"2024-09-22T08:15:04.956585+0000","last_became_peered":"2024-09-22T08:15:04.956585+0000","last_unstale":"2024-09-22T08:56:24.448779+0000","last_undegraded":"2024-09-22T08:56:24.448779+0000","last_fullsized":"2024-09-22T08:56:24.448779+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'190","last_scrub_stamp":"2024-09-22T08:56:24.448616+0000","last_deep_scrub":"263'190","last_deep_scrub_stamp":"2024-09-22T08:56:24.448616+0000","last_clean_scrub_stamp":"2024-09-22T08:56:24.448616+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:28:39.635896+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":533,"num_read_kb":28072,"num_write":815,"num_write_kb":27925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":530,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:25.950025+0000","last_change":"2024-09-22T08:56:25.949974+0000","last_active":"2024-09-22T08:56:25.950025+0000","last_peered":"2024-09-22T08:56:25.950025+0000","last_clean":"2024-09-22T08:56:25.950025+0000","last_became_active":"2024-09-22T08:14:54.727321+0000","last_became_peered":"2024-09-22T08:14:54.727321+0000","last_unstale":"2024-09-22T08:56:25.950025+0000","last_undegraded":"2024-09-22T08:56:25.950025+0000","last_fullsized":"2024-09-22T08:56:25.950025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:25.949885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:25.949885+0000","last_clean_scrub_stamp":"2024-09-22T08:56:25.949885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:04:26.428044+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00058148900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:37.488967+0000","last_change":"2024-09-22T08:56:37.488910+0000","last_active":"2024-09-22T08:56:37.488967+0000","last_peered":"2024-09-22T08:56:37.488967+0000","last_clean":"2024-09-22T08:56:37.488967+0000","last_became_active":"2024-09-22T08:15:08.974823+0000","last_became_peered":"2024-09-22T08:15:08.974823+0000","last_unstale":"2024-09-22T08:56:37.488967+0000","last_undegraded":"2024-09-22T08:56:37.488967+0000","last_fullsized":"2024-09-22T08:56:37.488967+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:37.488797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:37.488797+0000","last_clean_scrub_stamp":"2024-09-22T08:56:37.488797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:06:57.904560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"263'166","reported_seq":730,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:42.518299+0000","last_change":"2024-09-22T08:56:42.518232+0000","last_active":"2024-09-22T08:56:42.518299+0000","last_peered":"2024-09-22T08:56:42.518299+0000","last_clean":"2024-09-22T08:56:42.518299+0000","last_became_active":"2024-09-22T08:15:10.991426+0000","last_became_peered":"2024-09-22T08:15:10.991426+0000","last_unstale":"2024-09-22T08:56:42.518299+0000","last_undegraded":"2024-09-22T08:56:42.518299+0000","last_fullsized":"2024-09-22T08:56:42.518299+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'166","last_scrub_stamp":"2024-09-22T08:56:42.518128+0000","last_deep_scrub":"263'166","last_deep_scrub_stamp":"2024-09-22T08:56:42.518128+0000","last_clean_scrub_stamp":"2024-09-22T08:56:42.518128+0000","objects_scrubbed":8,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:43:46.934148+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":204,"num_read_kb":193,"num_write":140,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"263'790","reported_seq":4944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:43.715300+0000","last_change":"2024-09-22T08:56:43.715300+0000","last_active":"2024-09-22T08:56:43.715300+0000","last_peered":"2024-09-22T08:56:43.715300+0000","last_clean":"2024-09-22T08:56:43.715300+0000","last_became_active":"2024-09-22T08:15:13.013828+0000","last_became_peered":"2024-09-22T08:15:13.013828+0000","last_unstale":"2024-09-22T08:56:43.715300+0000","last_undegraded":"2024-09-22T08:56:43.715300+0000","last_fullsized":"2024-09-22T08:56:43.715300+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'790","last_scrub_stamp":"2024-09-22T08:56:43.715184+0000","last_deep_scrub":"263'790","last_deep_scrub_stamp":"2024-09-22T08:56:43.715184+0000","last_clean_scrub_stamp":"2024-09-22T08:56:43.715184+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:50:19.357092+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"263'144","reported_seq":652,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:50.354891+0000","last_change":"2024-09-22T08:56:50.354891+0000","last_active":"2024-09-22T08:56:50.354891+0000","last_peered":"2024-09-22T08:56:50.354891+0000","last_clean":"2024-09-22T08:56:50.354891+0000","last_became_active":"2024-09-22T08:15:15.013976+0000","last_became_peered":"2024-09-22T08:15:15.013976+0000","last_unstale":"2024-09-22T08:56:50.354891+0000","last_undegraded":"2024-09-22T08:56:50.354891+0000","last_fullsized":"2024-09-22T08:56:50.354891+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'144","last_scrub_stamp":"2024-09-22T08:56:50.354798+0000","last_deep_scrub":"263'144","last_deep_scrub_stamp":"2024-09-22T08:56:50.354798+0000","last_clean_scrub_stamp":"2024-09-22T08:56:50.354798+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:52.505999+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":177,"num_read_kb":172,"num_write":337,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"263'453","reported_seq":1959,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:31.604854+0000","last_change":"2024-09-22T08:56:31.604854+0000","last_active":"2024-09-22T08:56:31.604854+0000","last_peered":"2024-09-22T08:56:31.604854+0000","last_clean":"2024-09-22T08:56:31.604854+0000","last_became_active":"2024-09-22T08:15:06.966387+0000","last_became_peered":"2024-09-22T08:15:06.966387+0000","last_unstale":"2024-09-22T08:56:31.604854+0000","last_undegraded":"2024-09-22T08:56:31.604854+0000","last_fullsized":"2024-09-22T08:56:31.604854+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'453","last_scrub_stamp":"2024-09-22T08:56:31.604702+0000","last_deep_scrub":"263'453","last_deep_scrub_stamp":"2024-09-22T08:56:31.604702+0000","last_clean_scrub_stamp":"2024-09-22T08:56:31.604702+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:47:41.638747+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2402,"num_read_kb":2235,"num_write":539,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"263'208","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:27.494927+0000","last_change":"2024-09-22T08:56:27.494927+0000","last_active":"2024-09-22T08:56:27.494927+0000","last_peered":"2024-09-22T08:56:27.494927+0000","last_clean":"2024-09-22T08:56:27.494927+0000","last_became_active":"2024-09-22T08:15:04.951731+0000","last_became_peered":"2024-09-22T08:15:04.951731+0000","last_unstale":"2024-09-22T08:56:27.494927+0000","last_undegraded":"2024-09-22T08:56:27.494927+0000","last_fullsized":"2024-09-22T08:56:27.494927+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'208","last_scrub_stamp":"2024-09-22T08:56:27.494744+0000","last_deep_scrub":"263'208","last_deep_scrub_stamp":"2024-09-22T08:56:27.494744+0000","last_clean_scrub_stamp":"2024-09-22T08:56:27.494744+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:38:30.369670+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079922,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":440,"num_read_kb":57796,"num_write":879,"num_write_kb":62478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:25.510634+0000","last_change":"2024-09-22T08:56:25.510634+0000","last_active":"2024-09-22T08:56:25.510634+0000","last_peered":"2024-09-22T08:56:25.510634+0000","last_clean":"2024-09-22T08:56:25.510634+0000","last_became_active":"2024-09-22T08:14:55.585607+0000","last_became_peered":"2024-09-22T08:14:55.585607+0000","last_unstale":"2024-09-22T08:56:25.510634+0000","last_undegraded":"2024-09-22T08:56:25.510634+0000","last_fullsized":"2024-09-22T08:56:25.510634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:25.510529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:25.510529+0000","last_clean_scrub_stamp":"2024-09-22T08:56:25.510529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:13:03.897890+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00049298099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:48.865761+0000","last_change":"2024-09-22T08:56:48.865761+0000","last_active":"2024-09-22T08:56:48.865761+0000","last_peered":"2024-09-22T08:56:48.865761+0000","last_clean":"2024-09-22T08:56:48.865761+0000","last_became_active":"2024-09-22T08:15:08.969373+0000","last_became_peered":"2024-09-22T08:15:08.969373+0000","last_unstale":"2024-09-22T08:56:48.865761+0000","last_undegraded":"2024-09-22T08:56:48.865761+0000","last_fullsized":"2024-09-22T08:56:48.865761+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:48.865660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:48.865660+0000","last_clean_scrub_stamp":"2024-09-22T08:56:48.865660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:09:09.886307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"263'111","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:54.862235+0000","last_change":"2024-09-22T08:56:54.862235+0000","last_active":"2024-09-22T08:56:54.862235+0000","last_peered":"2024-09-22T08:56:54.862235+0000","last_clean":"2024-09-22T08:56:54.862235+0000","last_became_active":"2024-09-22T08:15:10.984232+0000","last_became_peered":"2024-09-22T08:15:10.984232+0000","last_unstale":"2024-09-22T08:56:54.862235+0000","last_undegraded":"2024-09-22T08:56:54.862235+0000","last_fullsized":"2024-09-22T08:56:54.862235+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'111","last_scrub_stamp":"2024-09-22T08:56:54.862146+0000","last_deep_scrub":"263'111","last_deep_scrub_stamp":"2024-09-22T08:56:54.862146+0000","last_clean_scrub_stamp":"2024-09-22T08:56:54.862146+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:10:40.543230+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":116,"num_write":82,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"263'793","reported_seq":2224,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:49.399364+0000","last_change":"2024-09-22T08:56:49.399303+0000","last_active":"2024-09-22T08:56:49.399364+0000","last_peered":"2024-09-22T08:56:49.399364+0000","last_clean":"2024-09-22T08:56:49.399364+0000","last_became_active":"2024-09-22T08:15:13.008027+0000","last_became_peered":"2024-09-22T08:15:13.008027+0000","last_unstale":"2024-09-22T08:56:49.399364+0000","last_undegraded":"2024-09-22T08:56:49.399364+0000","last_fullsized":"2024-09-22T08:56:49.399364+0000","mapping_epoch":31,"log_start":"263'701","ondisk_log_start":"263'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'793","last_scrub_stamp":"2024-09-22T08:56:49.399221+0000","last_deep_scrub":"263'793","last_deep_scrub_stamp":"2024-09-22T08:56:49.399221+0000","last_clean_scrub_stamp":"2024-09-22T08:56:49.399221+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":701,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:13:29.095907+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"263'201","reported_seq":723,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:56.460386+0000","last_change":"2024-09-22T08:56:56.460386+0000","last_active":"2024-09-22T08:56:56.460386+0000","last_peered":"2024-09-22T08:56:56.460386+0000","last_clean":"2024-09-22T08:56:56.460386+0000","last_became_active":"2024-09-22T08:15:15.014423+0000","last_became_peered":"2024-09-22T08:15:15.014423+0000","last_unstale":"2024-09-22T08:56:56.460386+0000","last_undegraded":"2024-09-22T08:56:56.460386+0000","last_fullsized":"2024-09-22T08:56:56.460386+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'201","last_scrub_stamp":"2024-09-22T08:56:56.460303+0000","last_deep_scrub":"263'201","last_deep_scrub_stamp":"2024-09-22T08:56:56.460303+0000","last_clean_scrub_stamp":"2024-09-22T08:56:56.460303+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:28:29.986558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":250,"num_read_kb":232,"num_write":460,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"263'500","reported_seq":2070,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:30.332108+0000","last_change":"2024-09-22T08:56:30.332020+0000","last_active":"2024-09-22T08:56:30.332108+0000","last_peered":"2024-09-22T08:56:30.332108+0000","last_clean":"2024-09-22T08:56:30.332108+0000","last_became_active":"2024-09-22T08:15:06.968153+0000","last_became_peered":"2024-09-22T08:15:06.968153+0000","last_unstale":"2024-09-22T08:56:30.332108+0000","last_undegraded":"2024-09-22T08:56:30.332108+0000","last_fullsized":"2024-09-22T08:56:30.332108+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'500","last_scrub_stamp":"2024-09-22T08:56:30.331876+0000","last_deep_scrub":"263'500","last_deep_scrub_stamp":"2024-09-22T08:56:30.331876+0000","last_clean_scrub_stamp":"2024-09-22T08:56:30.331876+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:12:28.407646+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2565,"num_read_kb":2386,"num_write":597,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"263'200","reported_seq":826,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:24.516850+0000","last_change":"2024-09-22T08:56:24.516850+0000","last_active":"2024-09-22T08:56:24.516850+0000","last_peered":"2024-09-22T08:56:24.516850+0000","last_clean":"2024-09-22T08:56:24.516850+0000","last_became_active":"2024-09-22T08:15:04.943901+0000","last_became_peered":"2024-09-22T08:15:04.943901+0000","last_unstale":"2024-09-22T08:56:24.516850+0000","last_undegraded":"2024-09-22T08:56:24.516850+0000","last_fullsized":"2024-09-22T08:56:24.516850+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'200","last_scrub_stamp":"2024-09-22T08:56:24.516736+0000","last_deep_scrub":"263'200","last_deep_scrub_stamp":"2024-09-22T08:56:24.516736+0000","last_clean_scrub_stamp":"2024-09-22T08:56:24.516736+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:25:37.932151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":512,"num_read_kb":4964,"num_write":959,"num_write_kb":21539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:26.935540+0000","last_change":"2024-09-22T08:56:26.935540+0000","last_active":"2024-09-22T08:56:26.935540+0000","last_peered":"2024-09-22T08:56:26.935540+0000","last_clean":"2024-09-22T08:56:26.935540+0000","last_became_active":"2024-09-22T08:14:55.585485+0000","last_became_peered":"2024-09-22T08:14:55.585485+0000","last_unstale":"2024-09-22T08:56:26.935540+0000","last_undegraded":"2024-09-22T08:56:26.935540+0000","last_fullsized":"2024-09-22T08:56:26.935540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:26.935425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:26.935425+0000","last_clean_scrub_stamp":"2024-09-22T08:56:26.935425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:24:27.484352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012642249999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:41.758786+0000","last_change":"2024-09-22T08:56:41.758786+0000","last_active":"2024-09-22T08:56:41.758786+0000","last_peered":"2024-09-22T08:56:41.758786+0000","last_clean":"2024-09-22T08:56:41.758786+0000","last_became_active":"2024-09-22T08:15:08.979291+0000","last_became_peered":"2024-09-22T08:15:08.979291+0000","last_unstale":"2024-09-22T08:56:41.758786+0000","last_undegraded":"2024-09-22T08:56:41.758786+0000","last_fullsized":"2024-09-22T08:56:41.758786+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:41.758704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:41.758704+0000","last_clean_scrub_stamp":"2024-09-22T08:56:41.758704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:27:55.044646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"263'326","reported_seq":1046,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:41.482031+0000","last_change":"2024-09-22T08:56:41.481976+0000","last_active":"2024-09-22T08:56:41.482031+0000","last_peered":"2024-09-22T08:56:41.482031+0000","last_clean":"2024-09-22T08:56:41.482031+0000","last_became_active":"2024-09-22T08:15:10.979261+0000","last_became_peered":"2024-09-22T08:15:10.979261+0000","last_unstale":"2024-09-22T08:56:41.482031+0000","last_undegraded":"2024-09-22T08:56:41.482031+0000","last_fullsized":"2024-09-22T08:56:41.482031+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'326","last_scrub_stamp":"2024-09-22T08:56:41.481863+0000","last_deep_scrub":"263'326","last_deep_scrub_stamp":"2024-09-22T08:56:41.481863+0000","last_clean_scrub_stamp":"2024-09-22T08:56:41.481863+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:35:06.044679+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25829,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":462,"num_read_kb":686,"num_write":234,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:53.790947+0000","last_change":"2024-09-22T08:56:53.790947+0000","last_active":"2024-09-22T08:56:53.790947+0000","last_peered":"2024-09-22T08:56:53.790947+0000","last_clean":"2024-09-22T08:56:53.790947+0000","last_became_active":"2024-09-22T08:15:13.003041+0000","last_became_peered":"2024-09-22T08:15:13.003041+0000","last_unstale":"2024-09-22T08:56:53.790947+0000","last_undegraded":"2024-09-22T08:56:53.790947+0000","last_fullsized":"2024-09-22T08:56:53.790947+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:53.790859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:53.790859+0000","last_clean_scrub_stamp":"2024-09-22T08:56:53.790859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:27:05.715455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"263'130","reported_seq":636,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:48.323891+0000","last_change":"2024-09-22T08:56:48.323891+0000","last_active":"2024-09-22T08:56:48.323891+0000","last_peered":"2024-09-22T08:56:48.323891+0000","last_clean":"2024-09-22T08:56:48.323891+0000","last_became_active":"2024-09-22T08:15:15.014775+0000","last_became_peered":"2024-09-22T08:15:15.014775+0000","last_unstale":"2024-09-22T08:56:48.323891+0000","last_undegraded":"2024-09-22T08:56:48.323891+0000","last_fullsized":"2024-09-22T08:56:48.323891+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'130","last_scrub_stamp":"2024-09-22T08:56:48.323737+0000","last_deep_scrub":"263'130","last_deep_scrub_stamp":"2024-09-22T08:56:48.323737+0000","last_clean_scrub_stamp":"2024-09-22T08:56:48.323737+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:15:30.889666+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":162,"num_read_kb":158,"num_write":286,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"263'109","reported_seq":668,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:57.834349+0000","last_change":"2024-09-22T08:56:57.834349+0000","last_active":"2024-09-22T08:56:57.834349+0000","last_peered":"2024-09-22T08:56:57.834349+0000","last_clean":"2024-09-22T08:56:57.834349+0000","last_became_active":"2024-09-22T08:15:15.020653+0000","last_became_peered":"2024-09-22T08:15:15.020653+0000","last_unstale":"2024-09-22T08:56:57.834349+0000","last_undegraded":"2024-09-22T08:56:57.834349+0000","last_fullsized":"2024-09-22T08:56:57.834349+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'109","last_scrub_stamp":"2024-09-22T08:56:57.834260+0000","last_deep_scrub":"263'109","last_deep_scrub_stamp":"2024-09-22T08:56:57.834260+0000","last_clean_scrub_stamp":"2024-09-22T08:56:57.834260+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:23:10.854519+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":202,"num_read_kb":202,"num_write":258,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"263'491","reported_seq":2222,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:31.374754+0000","last_change":"2024-09-22T08:56:31.374754+0000","last_active":"2024-09-22T08:56:31.374754+0000","last_peered":"2024-09-22T08:56:31.374754+0000","last_clean":"2024-09-22T08:56:31.374754+0000","last_became_active":"2024-09-22T08:15:06.970382+0000","last_became_peered":"2024-09-22T08:15:06.970382+0000","last_unstale":"2024-09-22T08:56:31.374754+0000","last_undegraded":"2024-09-22T08:56:31.374754+0000","last_fullsized":"2024-09-22T08:56:31.374754+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'491","last_scrub_stamp":"2024-09-22T08:56:31.374652+0000","last_deep_scrub":"263'491","last_deep_scrub_stamp":"2024-09-22T08:56:31.374652+0000","last_clean_scrub_stamp":"2024-09-22T08:56:31.374652+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:29:57.099432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2792,"num_read_kb":2647,"num_write":560,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3043,"num_omap_keys":12,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"263'227","reported_seq":882,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:32.878958+0000","last_change":"2024-09-22T08:56:32.878958+0000","last_active":"2024-09-22T08:56:32.878958+0000","last_peered":"2024-09-22T08:56:32.878958+0000","last_clean":"2024-09-22T08:56:32.878958+0000","last_became_active":"2024-09-22T08:15:04.965572+0000","last_became_peered":"2024-09-22T08:15:04.965572+0000","last_unstale":"2024-09-22T08:56:32.878958+0000","last_undegraded":"2024-09-22T08:56:32.878958+0000","last_fullsized":"2024-09-22T08:56:32.878958+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'227","last_scrub_stamp":"2024-09-22T08:56:32.878823+0000","last_deep_scrub":"263'227","last_deep_scrub_stamp":"2024-09-22T08:56:32.878823+0000","last_clean_scrub_stamp":"2024-09-22T08:56:32.878823+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:10:43.868372+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":598,"num_read_kb":42984,"num_write":1013,"num_write_kb":35756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:40.519216+0000","last_change":"2024-09-22T08:56:40.519216+0000","last_active":"2024-09-22T08:56:40.519216+0000","last_peered":"2024-09-22T08:56:40.519216+0000","last_clean":"2024-09-22T08:56:40.519216+0000","last_became_active":"2024-09-22T08:15:08.976444+0000","last_became_peered":"2024-09-22T08:15:08.976444+0000","last_unstale":"2024-09-22T08:56:40.519216+0000","last_undegraded":"2024-09-22T08:56:40.519216+0000","last_fullsized":"2024-09-22T08:56:40.519216+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:40.519119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:40.519119+0000","last_clean_scrub_stamp":"2024-09-22T08:56:40.519119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:33:04.166853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"263'137","reported_seq":711,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:44.556082+0000","last_change":"2024-09-22T08:56:44.556082+0000","last_active":"2024-09-22T08:56:44.556082+0000","last_peered":"2024-09-22T08:56:44.556082+0000","last_clean":"2024-09-22T08:56:44.556082+0000","last_became_active":"2024-09-22T08:15:10.987623+0000","last_became_peered":"2024-09-22T08:15:10.987623+0000","last_unstale":"2024-09-22T08:56:44.556082+0000","last_undegraded":"2024-09-22T08:56:44.556082+0000","last_fullsized":"2024-09-22T08:56:44.556082+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'137","last_scrub_stamp":"2024-09-22T08:56:44.555992+0000","last_deep_scrub":"263'137","last_deep_scrub_stamp":"2024-09-22T08:56:44.555992+0000","last_clean_scrub_stamp":"2024-09-22T08:56:44.555992+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:46:15.194164+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8761,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":170,"num_read_kb":207,"num_write":88,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:43.234096+0000","last_change":"2024-09-22T08:56:43.234096+0000","last_active":"2024-09-22T08:56:43.234096+0000","last_peered":"2024-09-22T08:56:43.234096+0000","last_clean":"2024-09-22T08:56:43.234096+0000","last_became_active":"2024-09-22T08:15:12.997350+0000","last_became_peered":"2024-09-22T08:15:12.997350+0000","last_unstale":"2024-09-22T08:56:43.234096+0000","last_undegraded":"2024-09-22T08:56:43.234096+0000","last_fullsized":"2024-09-22T08:56:43.234096+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:43.234008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:43.234008+0000","last_clean_scrub_stamp":"2024-09-22T08:56:43.234008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:14:46.102555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"263'112","reported_seq":616,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:48.305333+0000","last_change":"2024-09-22T08:56:48.305333+0000","last_active":"2024-09-22T08:56:48.305333+0000","last_peered":"2024-09-22T08:56:48.305333+0000","last_clean":"2024-09-22T08:56:48.305333+0000","last_became_active":"2024-09-22T08:15:15.016918+0000","last_became_peered":"2024-09-22T08:15:15.016918+0000","last_unstale":"2024-09-22T08:56:48.305333+0000","last_undegraded":"2024-09-22T08:56:48.305333+0000","last_fullsized":"2024-09-22T08:56:48.305333+0000","mapping_epoch":33,"log_start":"263'101","ondisk_log_start":"263'101","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'112","last_scrub_stamp":"2024-09-22T08:56:48.305233+0000","last_deep_scrub":"263'112","last_deep_scrub_stamp":"2024-09-22T08:56:48.305233+0000","last_clean_scrub_stamp":"2024-09-22T08:56:48.305233+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":101,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:46:52.130848+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":125,"num_write":254,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"263'1038","reported_seq":2829,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:33.664223+0000","last_change":"2024-09-22T08:56:33.664223+0000","last_active":"2024-09-22T08:56:33.664223+0000","last_peered":"2024-09-22T08:56:33.664223+0000","last_clean":"2024-09-22T08:56:33.664223+0000","last_became_active":"2024-09-22T08:15:06.965465+0000","last_became_peered":"2024-09-22T08:15:06.965465+0000","last_unstale":"2024-09-22T08:56:33.664223+0000","last_undegraded":"2024-09-22T08:56:33.664223+0000","last_fullsized":"2024-09-22T08:56:33.664223+0000","mapping_epoch":25,"log_start":"263'1000","ondisk_log_start":"263'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1038","last_scrub_stamp":"2024-09-22T08:56:33.664132+0000","last_deep_scrub":"263'1038","last_deep_scrub_stamp":"2024-09-22T08:56:33.664132+0000","last_clean_scrub_stamp":"2024-09-22T08:56:33.664132+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":1000,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:46:03.562471+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5105,"num_read_kb":4580,"num_write":1460,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"263'210","reported_seq":836,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:27.467279+0000","last_change":"2024-09-22T08:56:27.467279+0000","last_active":"2024-09-22T08:56:27.467279+0000","last_peered":"2024-09-22T08:56:27.467279+0000","last_clean":"2024-09-22T08:56:27.467279+0000","last_became_active":"2024-09-22T08:15:04.949181+0000","last_became_peered":"2024-09-22T08:15:04.949181+0000","last_unstale":"2024-09-22T08:56:27.467279+0000","last_undegraded":"2024-09-22T08:56:27.467279+0000","last_fullsized":"2024-09-22T08:56:27.467279+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'210","last_scrub_stamp":"2024-09-22T08:56:27.467159+0000","last_deep_scrub":"263'210","last_deep_scrub_stamp":"2024-09-22T08:56:27.467159+0000","last_clean_scrub_stamp":"2024-09-22T08:56:27.467159+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:15:11.987517+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":538,"num_read_kb":11766,"num_write":957,"num_write_kb":45959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:42.725152+0000","last_change":"2024-09-22T08:56:42.725152+0000","last_active":"2024-09-22T08:56:42.725152+0000","last_peered":"2024-09-22T08:56:42.725152+0000","last_clean":"2024-09-22T08:56:42.725152+0000","last_became_active":"2024-09-22T08:15:08.975704+0000","last_became_peered":"2024-09-22T08:15:08.975704+0000","last_unstale":"2024-09-22T08:56:42.725152+0000","last_undegraded":"2024-09-22T08:56:42.725152+0000","last_fullsized":"2024-09-22T08:56:42.725152+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:42.725054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:42.725054+0000","last_clean_scrub_stamp":"2024-09-22T08:56:42.725054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:53:10.767578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"263'41","reported_seq":549,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:48.817379+0000","last_change":"2024-09-22T08:56:48.817379+0000","last_active":"2024-09-22T08:56:48.817379+0000","last_peered":"2024-09-22T08:56:48.817379+0000","last_clean":"2024-09-22T08:56:48.817379+0000","last_became_active":"2024-09-22T08:15:10.983593+0000","last_became_peered":"2024-09-22T08:15:10.983593+0000","last_unstale":"2024-09-22T08:56:48.817379+0000","last_undegraded":"2024-09-22T08:56:48.817379+0000","last_fullsized":"2024-09-22T08:56:48.817379+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'41","last_scrub_stamp":"2024-09-22T08:56:48.817295+0000","last_deep_scrub":"263'41","last_deep_scrub_stamp":"2024-09-22T08:56:48.817295+0000","last_clean_scrub_stamp":"2024-09-22T08:56:48.817295+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:46:42.574241+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:44.280797+0000","last_change":"2024-09-22T08:56:44.280797+0000","last_active":"2024-09-22T08:56:44.280797+0000","last_peered":"2024-09-22T08:56:44.280797+0000","last_clean":"2024-09-22T08:56:44.280797+0000","last_became_active":"2024-09-22T08:15:13.019020+0000","last_became_peered":"2024-09-22T08:15:13.019020+0000","last_unstale":"2024-09-22T08:56:44.280797+0000","last_undegraded":"2024-09-22T08:56:44.280797+0000","last_fullsized":"2024-09-22T08:56:44.280797+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:44.280680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:44.280680+0000","last_clean_scrub_stamp":"2024-09-22T08:56:44.280680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:02:29.842179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"263'184","reported_seq":712,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:52.585551+0000","last_change":"2024-09-22T08:56:52.585551+0000","last_active":"2024-09-22T08:56:52.585551+0000","last_peered":"2024-09-22T08:56:52.585551+0000","last_clean":"2024-09-22T08:56:52.585551+0000","last_became_active":"2024-09-22T08:15:15.013300+0000","last_became_peered":"2024-09-22T08:15:15.013300+0000","last_unstale":"2024-09-22T08:56:52.585551+0000","last_undegraded":"2024-09-22T08:56:52.585551+0000","last_fullsized":"2024-09-22T08:56:52.585551+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'184","last_scrub_stamp":"2024-09-22T08:56:52.585437+0000","last_deep_scrub":"263'184","last_deep_scrub_stamp":"2024-09-22T08:56:52.585437+0000","last_clean_scrub_stamp":"2024-09-22T08:56:52.585437+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:20:42.367609+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":337,"num_read_kb":325,"num_write":401,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"263'1201","reported_seq":2848,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:32.645335+0000","last_change":"2024-09-22T08:56:32.645335+0000","last_active":"2024-09-22T08:56:32.645335+0000","last_peered":"2024-09-22T08:56:32.645335+0000","last_clean":"2024-09-22T08:56:32.645335+0000","last_became_active":"2024-09-22T08:15:06.957116+0000","last_became_peered":"2024-09-22T08:15:06.957116+0000","last_unstale":"2024-09-22T08:56:32.645335+0000","last_undegraded":"2024-09-22T08:56:32.645335+0000","last_fullsized":"2024-09-22T08:56:32.645335+0000","mapping_epoch":25,"log_start":"263'1100","ondisk_log_start":"263'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1201","last_scrub_stamp":"2024-09-22T08:56:32.645252+0000","last_deep_scrub":"263'1201","last_deep_scrub_stamp":"2024-09-22T08:56:32.645252+0000","last_clean_scrub_stamp":"2024-09-22T08:56:32.645252+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":1100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:00:07.106550+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5635,"num_read_kb":5002,"num_write":1685,"num_write_kb":733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":434,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"263'193","reported_seq":815,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:25.336972+0000","last_change":"2024-09-22T08:56:25.336972+0000","last_active":"2024-09-22T08:56:25.336972+0000","last_peered":"2024-09-22T08:56:25.336972+0000","last_clean":"2024-09-22T08:56:25.336972+0000","last_became_active":"2024-09-22T08:15:04.968557+0000","last_became_peered":"2024-09-22T08:15:04.968557+0000","last_unstale":"2024-09-22T08:56:25.336972+0000","last_undegraded":"2024-09-22T08:56:25.336972+0000","last_fullsized":"2024-09-22T08:56:25.336972+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'193","last_scrub_stamp":"2024-09-22T08:56:25.336860+0000","last_deep_scrub":"263'193","last_deep_scrub_stamp":"2024-09-22T08:56:25.336860+0000","last_clean_scrub_stamp":"2024-09-22T08:56:25.336860+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:20:48.349873+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079920,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":520,"num_read_kb":8164,"num_write":864,"num_write_kb":39531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:36.418210+0000","last_change":"2024-09-22T08:56:36.418210+0000","last_active":"2024-09-22T08:56:36.418210+0000","last_peered":"2024-09-22T08:56:36.418210+0000","last_clean":"2024-09-22T08:56:36.418210+0000","last_became_active":"2024-09-22T08:15:08.975001+0000","last_became_peered":"2024-09-22T08:15:08.975001+0000","last_unstale":"2024-09-22T08:56:36.418210+0000","last_undegraded":"2024-09-22T08:56:36.418210+0000","last_fullsized":"2024-09-22T08:56:36.418210+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:36.418114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:36.418114+0000","last_clean_scrub_stamp":"2024-09-22T08:56:36.418114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:03:22.345130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"263'173","reported_seq":771,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:39.158193+0000","last_change":"2024-09-22T08:56:39.158193+0000","last_active":"2024-09-22T08:56:39.158193+0000","last_peered":"2024-09-22T08:56:39.158193+0000","last_clean":"2024-09-22T08:56:39.158193+0000","last_became_active":"2024-09-22T08:15:10.980443+0000","last_became_peered":"2024-09-22T08:15:10.980443+0000","last_unstale":"2024-09-22T08:56:39.158193+0000","last_undegraded":"2024-09-22T08:56:39.158193+0000","last_fullsized":"2024-09-22T08:56:39.158193+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'173","last_scrub_stamp":"2024-09-22T08:56:39.158047+0000","last_deep_scrub":"263'173","last_deep_scrub_stamp":"2024-09-22T08:56:39.158047+0000","last_clean_scrub_stamp":"2024-09-22T08:56:39.158047+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:42:11.473386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":222,"num_read_kb":300,"num_write":124,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:44.753619+0000","last_change":"2024-09-22T08:56:44.753619+0000","last_active":"2024-09-22T08:56:44.753619+0000","last_peered":"2024-09-22T08:56:44.753619+0000","last_clean":"2024-09-22T08:56:44.753619+0000","last_became_active":"2024-09-22T08:15:13.010660+0000","last_became_peered":"2024-09-22T08:15:13.010660+0000","last_unstale":"2024-09-22T08:56:44.753619+0000","last_undegraded":"2024-09-22T08:56:44.753619+0000","last_fullsized":"2024-09-22T08:56:44.753619+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:44.753528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:44.753528+0000","last_clean_scrub_stamp":"2024-09-22T08:56:44.753528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:53:25.427397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"263'141","reported_seq":674,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:23.390425+0000","last_change":"2024-09-22T08:15:15.015966+0000","last_active":"2024-09-22T08:54:23.390425+0000","last_peered":"2024-09-22T08:54:23.390425+0000","last_clean":"2024-09-22T08:54:23.390425+0000","last_became_active":"2024-09-22T08:15:15.015497+0000","last_became_peered":"2024-09-22T08:15:15.015497+0000","last_unstale":"2024-09-22T08:54:23.390425+0000","last_undegraded":"2024-09-22T08:54:23.390425+0000","last_fullsized":"2024-09-22T08:54:23.390425+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:19:47.834057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":885,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":300,"num_read_kb":272,"num_write":341,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"263'918","reported_seq":2772,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:29.082934+0000","last_change":"2024-09-22T08:56:29.082934+0000","last_active":"2024-09-22T08:56:29.082934+0000","last_peered":"2024-09-22T08:56:29.082934+0000","last_clean":"2024-09-22T08:56:29.082934+0000","last_became_active":"2024-09-22T08:15:06.964082+0000","last_became_peered":"2024-09-22T08:15:06.964082+0000","last_unstale":"2024-09-22T08:56:29.082934+0000","last_undegraded":"2024-09-22T08:56:29.082934+0000","last_fullsized":"2024-09-22T08:56:29.082934+0000","mapping_epoch":25,"log_start":"263'900","ondisk_log_start":"263'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'918","last_scrub_stamp":"2024-09-22T08:56:29.082837+0000","last_deep_scrub":"263'918","last_deep_scrub_stamp":"2024-09-22T08:56:29.082837+0000","last_clean_scrub_stamp":"2024-09-22T08:56:29.082837+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":900,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:49:15.428214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4594,"num_read_kb":4173,"num_write":1193,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2260,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"263'260","reported_seq":894,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:24.453691+0000","last_change":"2024-09-22T08:56:24.453691+0000","last_active":"2024-09-22T08:56:24.453691+0000","last_peered":"2024-09-22T08:56:24.453691+0000","last_clean":"2024-09-22T08:56:24.453691+0000","last_became_active":"2024-09-22T08:15:04.954431+0000","last_became_peered":"2024-09-22T08:15:04.954431+0000","last_unstale":"2024-09-22T08:56:24.453691+0000","last_undegraded":"2024-09-22T08:56:24.453691+0000","last_fullsized":"2024-09-22T08:56:24.453691+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'260","last_scrub_stamp":"2024-09-22T08:56:24.453598+0000","last_deep_scrub":"263'260","last_deep_scrub_stamp":"2024-09-22T08:56:24.453598+0000","last_clean_scrub_stamp":"2024-09-22T08:56:24.453598+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:11:53.936014+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":625,"num_read_kb":10749,"num_write":1043,"num_write_kb":36368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:51.899288+0000","last_change":"2024-09-22T08:56:51.899288+0000","last_active":"2024-09-22T08:56:51.899288+0000","last_peered":"2024-09-22T08:56:51.899288+0000","last_clean":"2024-09-22T08:56:51.899288+0000","last_became_active":"2024-09-22T08:15:08.978080+0000","last_became_peered":"2024-09-22T08:15:08.978080+0000","last_unstale":"2024-09-22T08:56:51.899288+0000","last_undegraded":"2024-09-22T08:56:51.899288+0000","last_fullsized":"2024-09-22T08:56:51.899288+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:51.899200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:51.899200+0000","last_clean_scrub_stamp":"2024-09-22T08:56:51.899200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:44:03.626002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"263'139","reported_seq":710,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:43.442127+0000","last_change":"2024-09-22T08:56:43.442127+0000","last_active":"2024-09-22T08:56:43.442127+0000","last_peered":"2024-09-22T08:56:43.442127+0000","last_clean":"2024-09-22T08:56:43.442127+0000","last_became_active":"2024-09-22T08:15:10.975066+0000","last_became_peered":"2024-09-22T08:15:10.975066+0000","last_unstale":"2024-09-22T08:56:43.442127+0000","last_undegraded":"2024-09-22T08:56:43.442127+0000","last_fullsized":"2024-09-22T08:56:43.442127+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'139","last_scrub_stamp":"2024-09-22T08:56:43.442026+0000","last_deep_scrub":"263'139","last_deep_scrub_stamp":"2024-09-22T08:56:43.442026+0000","last_clean_scrub_stamp":"2024-09-22T08:56:43.442026+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:13:39.485401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4721,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":157,"num_read_kb":223,"num_write":80,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:44.216632+0000","last_change":"2024-09-22T08:56:44.216632+0000","last_active":"2024-09-22T08:56:44.216632+0000","last_peered":"2024-09-22T08:56:44.216632+0000","last_clean":"2024-09-22T08:56:44.216632+0000","last_became_active":"2024-09-22T08:15:13.008005+0000","last_became_peered":"2024-09-22T08:15:13.008005+0000","last_unstale":"2024-09-22T08:56:44.216632+0000","last_undegraded":"2024-09-22T08:56:44.216632+0000","last_fullsized":"2024-09-22T08:56:44.216632+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:44.216543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:44.216543+0000","last_clean_scrub_stamp":"2024-09-22T08:56:44.216543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:31:37.425715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"263'387","reported_seq":1920,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:43.895675+0000","last_change":"2024-09-22T08:56:43.895609+0000","last_active":"2024-09-22T08:56:43.895675+0000","last_peered":"2024-09-22T08:56:43.895675+0000","last_clean":"2024-09-22T08:56:43.895675+0000","last_became_active":"2024-09-22T08:15:06.974083+0000","last_became_peered":"2024-09-22T08:15:06.974083+0000","last_unstale":"2024-09-22T08:56:43.895675+0000","last_undegraded":"2024-09-22T08:56:43.895675+0000","last_fullsized":"2024-09-22T08:56:43.895675+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'387","last_scrub_stamp":"2024-09-22T08:56:43.895521+0000","last_deep_scrub":"263'387","last_deep_scrub_stamp":"2024-09-22T08:56:43.895521+0000","last_clean_scrub_stamp":"2024-09-22T08:56:43.895521+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:38:10.001396+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2095,"num_read_kb":2009,"num_write":415,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"263'220","reported_seq":862,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:30.421662+0000","last_change":"2024-09-22T08:56:30.421662+0000","last_active":"2024-09-22T08:56:30.421662+0000","last_peered":"2024-09-22T08:56:30.421662+0000","last_clean":"2024-09-22T08:56:30.421662+0000","last_became_active":"2024-09-22T08:15:04.953371+0000","last_became_peered":"2024-09-22T08:15:04.953371+0000","last_unstale":"2024-09-22T08:56:30.421662+0000","last_undegraded":"2024-09-22T08:56:30.421662+0000","last_fullsized":"2024-09-22T08:56:30.421662+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'220","last_scrub_stamp":"2024-09-22T08:56:30.421545+0000","last_deep_scrub":"263'220","last_deep_scrub_stamp":"2024-09-22T08:56:30.421545+0000","last_clean_scrub_stamp":"2024-09-22T08:56:30.421545+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:22:31.706556+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079956,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":551,"num_read_kb":20845,"num_write":984,"num_write_kb":34041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:41.502715+0000","last_change":"2024-09-22T08:56:41.502715+0000","last_active":"2024-09-22T08:56:41.502715+0000","last_peered":"2024-09-22T08:56:41.502715+0000","last_clean":"2024-09-22T08:56:41.502715+0000","last_became_active":"2024-09-22T08:15:08.977975+0000","last_became_peered":"2024-09-22T08:15:08.977975+0000","last_unstale":"2024-09-22T08:56:41.502715+0000","last_undegraded":"2024-09-22T08:56:41.502715+0000","last_fullsized":"2024-09-22T08:56:41.502715+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:41.502631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:41.502631+0000","last_clean_scrub_stamp":"2024-09-22T08:56:41.502631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:47:58.395562+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"263'218","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:46.543724+0000","last_change":"2024-09-22T08:56:46.543724+0000","last_active":"2024-09-22T08:56:46.543724+0000","last_peered":"2024-09-22T08:56:46.543724+0000","last_clean":"2024-09-22T08:56:46.543724+0000","last_became_active":"2024-09-22T08:15:10.985454+0000","last_became_peered":"2024-09-22T08:15:10.985454+0000","last_unstale":"2024-09-22T08:56:46.543724+0000","last_undegraded":"2024-09-22T08:56:46.543724+0000","last_fullsized":"2024-09-22T08:56:46.543724+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'218","last_scrub_stamp":"2024-09-22T08:56:46.543626+0000","last_deep_scrub":"263'218","last_deep_scrub_stamp":"2024-09-22T08:56:46.543626+0000","last_clean_scrub_stamp":"2024-09-22T08:56:46.543626+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:35:26.113720+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24540,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":311,"num_read_kb":482,"num_write":196,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:45.264495+0000","last_change":"2024-09-22T08:56:45.264495+0000","last_active":"2024-09-22T08:56:45.264495+0000","last_peered":"2024-09-22T08:56:45.264495+0000","last_clean":"2024-09-22T08:56:45.264495+0000","last_became_active":"2024-09-22T08:15:13.008080+0000","last_became_peered":"2024-09-22T08:15:13.008080+0000","last_unstale":"2024-09-22T08:56:45.264495+0000","last_undegraded":"2024-09-22T08:56:45.264495+0000","last_fullsized":"2024-09-22T08:56:45.264495+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:45.264424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:45.264424+0000","last_clean_scrub_stamp":"2024-09-22T08:56:45.264424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:22:52.072394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"263'176","reported_seq":690,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:00.431365+0000","last_change":"2024-09-22T08:57:00.431365+0000","last_active":"2024-09-22T08:57:00.431365+0000","last_peered":"2024-09-22T08:57:00.431365+0000","last_clean":"2024-09-22T08:57:00.431365+0000","last_became_active":"2024-09-22T08:15:15.014112+0000","last_became_peered":"2024-09-22T08:15:15.014112+0000","last_unstale":"2024-09-22T08:57:00.431365+0000","last_undegraded":"2024-09-22T08:57:00.431365+0000","last_fullsized":"2024-09-22T08:57:00.431365+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'176","last_scrub_stamp":"2024-09-22T08:57:00.431270+0000","last_deep_scrub":"263'176","last_deep_scrub_stamp":"2024-09-22T08:57:00.431270+0000","last_clean_scrub_stamp":"2024-09-22T08:57:00.431270+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:41:55.748221+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":264,"num_read_kb":269,"num_write":416,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"263'433","reported_seq":2047,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:35.716040+0000","last_change":"2024-09-22T08:56:35.716040+0000","last_active":"2024-09-22T08:56:35.716040+0000","last_peered":"2024-09-22T08:56:35.716040+0000","last_clean":"2024-09-22T08:56:35.716040+0000","last_became_active":"2024-09-22T08:15:06.966715+0000","last_became_peered":"2024-09-22T08:15:06.966715+0000","last_unstale":"2024-09-22T08:56:35.716040+0000","last_undegraded":"2024-09-22T08:56:35.716040+0000","last_fullsized":"2024-09-22T08:56:35.716040+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'433","last_scrub_stamp":"2024-09-22T08:56:35.715956+0000","last_deep_scrub":"263'433","last_deep_scrub_stamp":"2024-09-22T08:56:35.715956+0000","last_clean_scrub_stamp":"2024-09-22T08:56:35.715956+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:36:50.835174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2445,"num_read_kb":2324,"num_write":493,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"263'214","reported_seq":886,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:28.519902+0000","last_change":"2024-09-22T08:56:28.519902+0000","last_active":"2024-09-22T08:56:28.519902+0000","last_peered":"2024-09-22T08:56:28.519902+0000","last_clean":"2024-09-22T08:56:28.519902+0000","last_became_active":"2024-09-22T08:15:04.950890+0000","last_became_peered":"2024-09-22T08:15:04.950890+0000","last_unstale":"2024-09-22T08:56:28.519902+0000","last_undegraded":"2024-09-22T08:56:28.519902+0000","last_fullsized":"2024-09-22T08:56:28.519902+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'214","last_scrub_stamp":"2024-09-22T08:56:28.519814+0000","last_deep_scrub":"263'214","last_deep_scrub_stamp":"2024-09-22T08:56:28.519814+0000","last_clean_scrub_stamp":"2024-09-22T08:56:28.519814+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:35:12.489475+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":625,"num_read_kb":94909,"num_write":959,"num_write_kb":40287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"263'5","reported_seq":983,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:40.392356+0000","last_change":"2024-09-22T08:56:40.392284+0000","last_active":"2024-09-22T08:56:40.392356+0000","last_peered":"2024-09-22T08:56:40.392356+0000","last_clean":"2024-09-22T08:56:40.392356+0000","last_became_active":"2024-09-22T08:15:08.977250+0000","last_became_peered":"2024-09-22T08:15:08.977250+0000","last_unstale":"2024-09-22T08:56:40.392356+0000","last_undegraded":"2024-09-22T08:56:40.392356+0000","last_fullsized":"2024-09-22T08:56:40.392356+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-22T08:56:40.392200+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-22T08:56:40.392200+0000","last_clean_scrub_stamp":"2024-09-22T08:56:40.392200+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:58:39.531528+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":1187,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"263'177","reported_seq":766,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:58.877517+0000","last_change":"2024-09-22T08:56:58.877517+0000","last_active":"2024-09-22T08:56:58.877517+0000","last_peered":"2024-09-22T08:56:58.877517+0000","last_clean":"2024-09-22T08:56:58.877517+0000","last_became_active":"2024-09-22T08:15:10.987541+0000","last_became_peered":"2024-09-22T08:15:10.987541+0000","last_unstale":"2024-09-22T08:56:58.877517+0000","last_undegraded":"2024-09-22T08:56:58.877517+0000","last_fullsized":"2024-09-22T08:56:58.877517+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'177","last_scrub_stamp":"2024-09-22T08:56:58.877406+0000","last_deep_scrub":"263'177","last_deep_scrub_stamp":"2024-09-22T08:56:58.877406+0000","last_clean_scrub_stamp":"2024-09-22T08:56:58.877406+0000","objects_scrubbed":8,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:01:01.399059+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":217,"num_read_kb":244,"num_write":140,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:57.504819+0000","last_change":"2024-09-22T08:56:57.504819+0000","last_active":"2024-09-22T08:56:57.504819+0000","last_peered":"2024-09-22T08:56:57.504819+0000","last_clean":"2024-09-22T08:56:57.504819+0000","last_became_active":"2024-09-22T08:15:13.011781+0000","last_became_peered":"2024-09-22T08:15:13.011781+0000","last_unstale":"2024-09-22T08:56:57.504819+0000","last_undegraded":"2024-09-22T08:56:57.504819+0000","last_fullsized":"2024-09-22T08:56:57.504819+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:57.504724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:57.504724+0000","last_clean_scrub_stamp":"2024-09-22T08:56:57.504724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:19:18.602651+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"263'184","reported_seq":694,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:01.978766+0000","last_change":"2024-09-22T08:15:15.011928+0000","last_active":"2024-09-22T08:56:01.978766+0000","last_peered":"2024-09-22T08:56:01.978766+0000","last_clean":"2024-09-22T08:56:01.978766+0000","last_became_active":"2024-09-22T08:15:15.011648+0000","last_became_peered":"2024-09-22T08:15:15.011648+0000","last_unstale":"2024-09-22T08:56:01.978766+0000","last_undegraded":"2024-09-22T08:56:01.978766+0000","last_fullsized":"2024-09-22T08:56:01.978766+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:40:53.969713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":287,"num_read_kb":275,"num_write":539,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"263'439","reported_seq":1960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:30.084801+0000","last_change":"2024-09-22T08:56:30.084801+0000","last_active":"2024-09-22T08:56:30.084801+0000","last_peered":"2024-09-22T08:56:30.084801+0000","last_clean":"2024-09-22T08:56:30.084801+0000","last_became_active":"2024-09-22T08:15:06.972213+0000","last_became_peered":"2024-09-22T08:15:06.972213+0000","last_unstale":"2024-09-22T08:56:30.084801+0000","last_undegraded":"2024-09-22T08:56:30.084801+0000","last_fullsized":"2024-09-22T08:56:30.084801+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'439","last_scrub_stamp":"2024-09-22T08:56:30.084696+0000","last_deep_scrub":"263'439","last_deep_scrub_stamp":"2024-09-22T08:56:30.084696+0000","last_clean_scrub_stamp":"2024-09-22T08:56:30.084696+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:43:42.820968+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2524,"num_read_kb":2354,"num_write":541,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"263'246","reported_seq":887,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:28.829400+0000","last_change":"2024-09-22T08:56:28.829400+0000","last_active":"2024-09-22T08:56:28.829400+0000","last_peered":"2024-09-22T08:56:28.829400+0000","last_clean":"2024-09-22T08:56:28.829400+0000","last_became_active":"2024-09-22T08:15:04.959607+0000","last_became_peered":"2024-09-22T08:15:04.959607+0000","last_unstale":"2024-09-22T08:56:28.829400+0000","last_undegraded":"2024-09-22T08:56:28.829400+0000","last_fullsized":"2024-09-22T08:56:28.829400+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'246","last_scrub_stamp":"2024-09-22T08:56:28.829299+0000","last_deep_scrub":"263'246","last_deep_scrub_stamp":"2024-09-22T08:56:28.829299+0000","last_clean_scrub_stamp":"2024-09-22T08:56:28.829299+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:55:16.910471+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079903,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":565,"num_read_kb":22702,"num_write":1145,"num_write_kb":43754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:39.435951+0000","last_change":"2024-09-22T08:56:39.435951+0000","last_active":"2024-09-22T08:56:39.435951+0000","last_peered":"2024-09-22T08:56:39.435951+0000","last_clean":"2024-09-22T08:56:39.435951+0000","last_became_active":"2024-09-22T08:15:08.974925+0000","last_became_peered":"2024-09-22T08:15:08.974925+0000","last_unstale":"2024-09-22T08:56:39.435951+0000","last_undegraded":"2024-09-22T08:56:39.435951+0000","last_fullsized":"2024-09-22T08:56:39.435951+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:39.435856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:39.435856+0000","last_clean_scrub_stamp":"2024-09-22T08:56:39.435856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:57:01.098449+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"263'153","reported_seq":730,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:48.587326+0000","last_change":"2024-09-22T08:56:48.587274+0000","last_active":"2024-09-22T08:56:48.587326+0000","last_peered":"2024-09-22T08:56:48.587326+0000","last_clean":"2024-09-22T08:56:48.587326+0000","last_became_active":"2024-09-22T08:15:10.985312+0000","last_became_peered":"2024-09-22T08:15:10.985312+0000","last_unstale":"2024-09-22T08:56:48.587326+0000","last_undegraded":"2024-09-22T08:56:48.587326+0000","last_fullsized":"2024-09-22T08:56:48.587326+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'153","last_scrub_stamp":"2024-09-22T08:56:48.587185+0000","last_deep_scrub":"263'153","last_deep_scrub_stamp":"2024-09-22T08:56:48.587185+0000","last_clean_scrub_stamp":"2024-09-22T08:56:48.587185+0000","objects_scrubbed":5,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:52:46.336740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9037,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":176,"num_read_kb":231,"num_write":94,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:45.247761+0000","last_change":"2024-09-22T08:56:45.247761+0000","last_active":"2024-09-22T08:56:45.247761+0000","last_peered":"2024-09-22T08:56:45.247761+0000","last_clean":"2024-09-22T08:56:45.247761+0000","last_became_active":"2024-09-22T08:15:12.998276+0000","last_became_peered":"2024-09-22T08:15:12.998276+0000","last_unstale":"2024-09-22T08:56:45.247761+0000","last_undegraded":"2024-09-22T08:56:45.247761+0000","last_fullsized":"2024-09-22T08:56:45.247761+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:45.247668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:45.247668+0000","last_clean_scrub_stamp":"2024-09-22T08:56:45.247668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:39:59.660562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"263'129","reported_seq":634,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:03.364497+0000","last_change":"2024-09-22T08:15:15.022528+0000","last_active":"2024-09-22T08:56:03.364497+0000","last_peered":"2024-09-22T08:56:03.364497+0000","last_clean":"2024-09-22T08:56:03.364497+0000","last_became_active":"2024-09-22T08:15:15.022140+0000","last_became_peered":"2024-09-22T08:15:15.022140+0000","last_unstale":"2024-09-22T08:56:03.364497+0000","last_undegraded":"2024-09-22T08:56:03.364497+0000","last_fullsized":"2024-09-22T08:56:03.364497+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:19:15.143722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":810,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":211,"num_read_kb":192,"num_write":312,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"263'535","reported_seq":2412,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:34.686230+0000","last_change":"2024-09-22T08:56:34.686230+0000","last_active":"2024-09-22T08:56:34.686230+0000","last_peered":"2024-09-22T08:56:34.686230+0000","last_clean":"2024-09-22T08:56:34.686230+0000","last_became_active":"2024-09-22T08:15:06.963136+0000","last_became_peered":"2024-09-22T08:15:06.963136+0000","last_unstale":"2024-09-22T08:56:34.686230+0000","last_undegraded":"2024-09-22T08:56:34.686230+0000","last_fullsized":"2024-09-22T08:56:34.686230+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'535","last_scrub_stamp":"2024-09-22T08:56:34.686122+0000","last_deep_scrub":"263'535","last_deep_scrub_stamp":"2024-09-22T08:56:34.686122+0000","last_clean_scrub_stamp":"2024-09-22T08:56:34.686122+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:49:11.708710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3196,"num_read_kb":3015,"num_write":651,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4595,"num_omap_keys":18,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"263'229","reported_seq":859,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:29.569012+0000","last_change":"2024-09-22T08:56:29.569012+0000","last_active":"2024-09-22T08:56:29.569012+0000","last_peered":"2024-09-22T08:56:29.569012+0000","last_clean":"2024-09-22T08:56:29.569012+0000","last_became_active":"2024-09-22T08:15:04.961731+0000","last_became_peered":"2024-09-22T08:15:04.961731+0000","last_unstale":"2024-09-22T08:56:29.569012+0000","last_undegraded":"2024-09-22T08:56:29.569012+0000","last_fullsized":"2024-09-22T08:56:29.569012+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'229","last_scrub_stamp":"2024-09-22T08:56:29.568904+0000","last_deep_scrub":"263'229","last_deep_scrub_stamp":"2024-09-22T08:56:29.568904+0000","last_clean_scrub_stamp":"2024-09-22T08:56:29.568904+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:54:11.861870+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079902,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":556,"num_read_kb":16778,"num_write":1039,"num_write_kb":35959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:45.813634+0000","last_change":"2024-09-22T08:56:45.813634+0000","last_active":"2024-09-22T08:56:45.813634+0000","last_peered":"2024-09-22T08:56:45.813634+0000","last_clean":"2024-09-22T08:56:45.813634+0000","last_became_active":"2024-09-22T08:15:08.973985+0000","last_became_peered":"2024-09-22T08:15:08.973985+0000","last_unstale":"2024-09-22T08:56:45.813634+0000","last_undegraded":"2024-09-22T08:56:45.813634+0000","last_fullsized":"2024-09-22T08:56:45.813634+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:45.813551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:45.813551+0000","last_clean_scrub_stamp":"2024-09-22T08:56:45.813551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:09:23.744767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"263'98","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:59.904269+0000","last_change":"2024-09-22T08:56:59.904269+0000","last_active":"2024-09-22T08:56:59.904269+0000","last_peered":"2024-09-22T08:56:59.904269+0000","last_clean":"2024-09-22T08:56:59.904269+0000","last_became_active":"2024-09-22T08:15:10.991099+0000","last_became_peered":"2024-09-22T08:15:10.991099+0000","last_unstale":"2024-09-22T08:56:59.904269+0000","last_undegraded":"2024-09-22T08:56:59.904269+0000","last_fullsized":"2024-09-22T08:56:59.904269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'98","last_scrub_stamp":"2024-09-22T08:56:59.904149+0000","last_deep_scrub":"263'98","last_deep_scrub_stamp":"2024-09-22T08:56:59.904149+0000","last_clean_scrub_stamp":"2024-09-22T08:56:59.904149+0000","objects_scrubbed":7,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:05:26.253262+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":117,"num_read_kb":110,"num_write":130,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"263'772","reported_seq":2299,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:46.422592+0000","last_change":"2024-09-22T08:56:46.422523+0000","last_active":"2024-09-22T08:56:46.422592+0000","last_peered":"2024-09-22T08:56:46.422592+0000","last_clean":"2024-09-22T08:56:46.422592+0000","last_became_active":"2024-09-22T08:15:13.018826+0000","last_became_peered":"2024-09-22T08:15:13.018826+0000","last_unstale":"2024-09-22T08:56:46.422592+0000","last_undegraded":"2024-09-22T08:56:46.422592+0000","last_fullsized":"2024-09-22T08:56:46.422592+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'772","last_scrub_stamp":"2024-09-22T08:56:46.422436+0000","last_deep_scrub":"263'772","last_deep_scrub_stamp":"2024-09-22T08:56:46.422436+0000","last_clean_scrub_stamp":"2024-09-22T08:56:46.422436+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:15:34.934804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"263'136","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:22.688867+0000","last_change":"2024-09-22T08:15:15.017866+0000","last_active":"2024-09-22T08:54:22.688867+0000","last_peered":"2024-09-22T08:54:22.688867+0000","last_clean":"2024-09-22T08:54:22.688867+0000","last_became_active":"2024-09-22T08:15:15.017568+0000","last_became_peered":"2024-09-22T08:15:15.017568+0000","last_unstale":"2024-09-22T08:54:22.688867+0000","last_undegraded":"2024-09-22T08:54:22.688867+0000","last_fullsized":"2024-09-22T08:54:22.688867+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:37:11.451571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":178,"num_write":322,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"263'423","reported_seq":1885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:34.401957+0000","last_change":"2024-09-22T08:56:34.401957+0000","last_active":"2024-09-22T08:56:34.401957+0000","last_peered":"2024-09-22T08:56:34.401957+0000","last_clean":"2024-09-22T08:56:34.401957+0000","last_became_active":"2024-09-22T08:15:06.973142+0000","last_became_peered":"2024-09-22T08:15:06.973142+0000","last_unstale":"2024-09-22T08:56:34.401957+0000","last_undegraded":"2024-09-22T08:56:34.401957+0000","last_fullsized":"2024-09-22T08:56:34.401957+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'423","last_scrub_stamp":"2024-09-22T08:56:34.401862+0000","last_deep_scrub":"263'423","last_deep_scrub_stamp":"2024-09-22T08:56:34.401862+0000","last_clean_scrub_stamp":"2024-09-22T08:56:34.401862+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:31.696050+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2325,"num_read_kb":2186,"num_write":496,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"263'205","reported_seq":811,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:26.829391+0000","last_change":"2024-09-22T08:56:26.829391+0000","last_active":"2024-09-22T08:56:26.829391+0000","last_peered":"2024-09-22T08:56:26.829391+0000","last_clean":"2024-09-22T08:56:26.829391+0000","last_became_active":"2024-09-22T08:15:04.954608+0000","last_became_peered":"2024-09-22T08:15:04.954608+0000","last_unstale":"2024-09-22T08:56:26.829391+0000","last_undegraded":"2024-09-22T08:56:26.829391+0000","last_fullsized":"2024-09-22T08:56:26.829391+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'205","last_scrub_stamp":"2024-09-22T08:56:26.829288+0000","last_deep_scrub":"263'205","last_deep_scrub_stamp":"2024-09-22T08:56:26.829288+0000","last_clean_scrub_stamp":"2024-09-22T08:56:26.829288+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:41:04.364320+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":469,"num_read_kb":8602,"num_write":952,"num_write_kb":32105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:42.741012+0000","last_change":"2024-09-22T08:56:42.741012+0000","last_active":"2024-09-22T08:56:42.741012+0000","last_peered":"2024-09-22T08:56:42.741012+0000","last_clean":"2024-09-22T08:56:42.741012+0000","last_became_active":"2024-09-22T08:15:08.980570+0000","last_became_peered":"2024-09-22T08:15:08.980570+0000","last_unstale":"2024-09-22T08:56:42.741012+0000","last_undegraded":"2024-09-22T08:56:42.741012+0000","last_fullsized":"2024-09-22T08:56:42.741012+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:42.740930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:42.740930+0000","last_clean_scrub_stamp":"2024-09-22T08:56:42.740930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:12:39.016936+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"263'170","reported_seq":756,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:44.411274+0000","last_change":"2024-09-22T08:56:44.411274+0000","last_active":"2024-09-22T08:56:44.411274+0000","last_peered":"2024-09-22T08:56:44.411274+0000","last_clean":"2024-09-22T08:56:44.411274+0000","last_became_active":"2024-09-22T08:15:10.979384+0000","last_became_peered":"2024-09-22T08:15:10.979384+0000","last_unstale":"2024-09-22T08:56:44.411274+0000","last_undegraded":"2024-09-22T08:56:44.411274+0000","last_fullsized":"2024-09-22T08:56:44.411274+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'170","last_scrub_stamp":"2024-09-22T08:56:44.411179+0000","last_deep_scrub":"263'170","last_deep_scrub_stamp":"2024-09-22T08:56:44.411179+0000","last_clean_scrub_stamp":"2024-09-22T08:56:44.411179+0000","objects_scrubbed":8,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:34:16.990164+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10195,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":216,"num_read_kb":291,"num_write":126,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:56.842267+0000","last_change":"2024-09-22T08:56:56.842267+0000","last_active":"2024-09-22T08:56:56.842267+0000","last_peered":"2024-09-22T08:56:56.842267+0000","last_clean":"2024-09-22T08:56:56.842267+0000","last_became_active":"2024-09-22T08:15:13.013160+0000","last_became_peered":"2024-09-22T08:15:13.013160+0000","last_unstale":"2024-09-22T08:56:56.842267+0000","last_undegraded":"2024-09-22T08:56:56.842267+0000","last_fullsized":"2024-09-22T08:56:56.842267+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:56.842180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:56.842180+0000","last_clean_scrub_stamp":"2024-09-22T08:56:56.842180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:23:00.661794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"263'141","reported_seq":651,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:50.744675+0000","last_change":"2024-09-22T08:56:50.744675+0000","last_active":"2024-09-22T08:56:50.744675+0000","last_peered":"2024-09-22T08:56:50.744675+0000","last_clean":"2024-09-22T08:56:50.744675+0000","last_became_active":"2024-09-22T08:15:15.020718+0000","last_became_peered":"2024-09-22T08:15:15.020718+0000","last_unstale":"2024-09-22T08:56:50.744675+0000","last_undegraded":"2024-09-22T08:56:50.744675+0000","last_fullsized":"2024-09-22T08:56:50.744675+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'141","last_scrub_stamp":"2024-09-22T08:56:50.744588+0000","last_deep_scrub":"263'141","last_deep_scrub_stamp":"2024-09-22T08:56:50.744588+0000","last_clean_scrub_stamp":"2024-09-22T08:56:50.744588+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:35:11.558076+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":211,"num_read_kb":197,"num_write":330,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"263'802","reported_seq":2286,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:33.408278+0000","last_change":"2024-09-22T08:56:33.408278+0000","last_active":"2024-09-22T08:56:33.408278+0000","last_peered":"2024-09-22T08:56:33.408278+0000","last_clean":"2024-09-22T08:56:33.408278+0000","last_became_active":"2024-09-22T08:15:06.970077+0000","last_became_peered":"2024-09-22T08:15:06.970077+0000","last_unstale":"2024-09-22T08:56:33.408278+0000","last_undegraded":"2024-09-22T08:56:33.408278+0000","last_fullsized":"2024-09-22T08:56:33.408278+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'802","last_scrub_stamp":"2024-09-22T08:56:33.408180+0000","last_deep_scrub":"263'802","last_deep_scrub_stamp":"2024-09-22T08:56:33.408180+0000","last_clean_scrub_stamp":"2024-09-22T08:56:33.408180+0000","objects_scrubbed":2,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:56:18.098515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3751,"num_read_kb":3364,"num_write":1047,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":246,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"263'201","reported_seq":921,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:33.835418+0000","last_change":"2024-09-22T08:56:33.835418+0000","last_active":"2024-09-22T08:56:33.835418+0000","last_peered":"2024-09-22T08:56:33.835418+0000","last_clean":"2024-09-22T08:56:33.835418+0000","last_became_active":"2024-09-22T08:15:04.962268+0000","last_became_peered":"2024-09-22T08:15:04.962268+0000","last_unstale":"2024-09-22T08:56:33.835418+0000","last_undegraded":"2024-09-22T08:56:33.835418+0000","last_fullsized":"2024-09-22T08:56:33.835418+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'201","last_scrub_stamp":"2024-09-22T08:56:33.835307+0000","last_deep_scrub":"263'201","last_deep_scrub_stamp":"2024-09-22T08:56:33.835307+0000","last_clean_scrub_stamp":"2024-09-22T08:56:33.835307+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:26:01.851194+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":783,"num_read_kb":150382,"num_write":906,"num_write_kb":51576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:38.418270+0000","last_change":"2024-09-22T08:56:38.418270+0000","last_active":"2024-09-22T08:56:38.418270+0000","last_peered":"2024-09-22T08:56:38.418270+0000","last_clean":"2024-09-22T08:56:38.418270+0000","last_became_active":"2024-09-22T08:15:08.977341+0000","last_became_peered":"2024-09-22T08:15:08.977341+0000","last_unstale":"2024-09-22T08:56:38.418270+0000","last_undegraded":"2024-09-22T08:56:38.418270+0000","last_fullsized":"2024-09-22T08:56:38.418270+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:38.418178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:38.418178+0000","last_clean_scrub_stamp":"2024-09-22T08:56:38.418178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:49:39.605640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"263'131","reported_seq":704,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:52.812563+0000","last_change":"2024-09-22T08:56:52.812563+0000","last_active":"2024-09-22T08:56:52.812563+0000","last_peered":"2024-09-22T08:56:52.812563+0000","last_clean":"2024-09-22T08:56:52.812563+0000","last_became_active":"2024-09-22T08:15:10.980015+0000","last_became_peered":"2024-09-22T08:15:10.980015+0000","last_unstale":"2024-09-22T08:56:52.812563+0000","last_undegraded":"2024-09-22T08:56:52.812563+0000","last_fullsized":"2024-09-22T08:56:52.812563+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'131","last_scrub_stamp":"2024-09-22T08:56:52.812468+0000","last_deep_scrub":"263'131","last_deep_scrub_stamp":"2024-09-22T08:56:52.812468+0000","last_clean_scrub_stamp":"2024-09-22T08:56:52.812468+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:56:16.632729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20804,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":281,"num_write":88,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:02.858821+0000","last_change":"2024-09-22T08:57:02.858821+0000","last_active":"2024-09-22T08:57:02.858821+0000","last_peered":"2024-09-22T08:57:02.858821+0000","last_clean":"2024-09-22T08:57:02.858821+0000","last_became_active":"2024-09-22T08:15:13.011134+0000","last_became_peered":"2024-09-22T08:15:13.011134+0000","last_unstale":"2024-09-22T08:57:02.858821+0000","last_undegraded":"2024-09-22T08:57:02.858821+0000","last_fullsized":"2024-09-22T08:57:02.858821+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:02.858723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:02.858723+0000","last_clean_scrub_stamp":"2024-09-22T08:57:02.858723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:51:50.606460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"263'151","reported_seq":680,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:59.480205+0000","last_change":"2024-09-22T08:56:59.480205+0000","last_active":"2024-09-22T08:56:59.480205+0000","last_peered":"2024-09-22T08:56:59.480205+0000","last_clean":"2024-09-22T08:56:59.480205+0000","last_became_active":"2024-09-22T08:15:15.012939+0000","last_became_peered":"2024-09-22T08:15:15.012939+0000","last_unstale":"2024-09-22T08:56:59.480205+0000","last_undegraded":"2024-09-22T08:56:59.480205+0000","last_fullsized":"2024-09-22T08:56:59.480205+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'151","last_scrub_stamp":"2024-09-22T08:56:59.480121+0000","last_deep_scrub":"263'151","last_deep_scrub_stamp":"2024-09-22T08:56:59.480121+0000","last_clean_scrub_stamp":"2024-09-22T08:56:59.480121+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:49:39.921046+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":256,"num_read_kb":247,"num_write":364,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"263'566","reported_seq":2368,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:31.058431+0000","last_change":"2024-09-22T08:56:31.058431+0000","last_active":"2024-09-22T08:56:31.058431+0000","last_peered":"2024-09-22T08:56:31.058431+0000","last_clean":"2024-09-22T08:56:31.058431+0000","last_became_active":"2024-09-22T08:15:06.960599+0000","last_became_peered":"2024-09-22T08:15:06.960599+0000","last_unstale":"2024-09-22T08:56:31.058431+0000","last_undegraded":"2024-09-22T08:56:31.058431+0000","last_fullsized":"2024-09-22T08:56:31.058431+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'566","last_scrub_stamp":"2024-09-22T08:56:31.058322+0000","last_deep_scrub":"263'566","last_deep_scrub_stamp":"2024-09-22T08:56:31.058322+0000","last_clean_scrub_stamp":"2024-09-22T08:56:31.058322+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":500,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:44:02.799881+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3136,"num_read_kb":2948,"num_write":673,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1214,"num_omap_keys":5,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"263'213","reported_seq":848,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:25.463224+0000","last_change":"2024-09-22T08:56:25.463224+0000","last_active":"2024-09-22T08:56:25.463224+0000","last_peered":"2024-09-22T08:56:25.463224+0000","last_clean":"2024-09-22T08:56:25.463224+0000","last_became_active":"2024-09-22T08:15:04.962785+0000","last_became_peered":"2024-09-22T08:15:04.962785+0000","last_unstale":"2024-09-22T08:56:25.463224+0000","last_undegraded":"2024-09-22T08:56:25.463224+0000","last_fullsized":"2024-09-22T08:56:25.463224+0000","mapping_epoch":23,"log_start":"263'201","ondisk_log_start":"263'201","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'213","last_scrub_stamp":"2024-09-22T08:56:25.463105+0000","last_deep_scrub":"263'213","last_deep_scrub_stamp":"2024-09-22T08:56:25.463105+0000","last_clean_scrub_stamp":"2024-09-22T08:56:25.463105+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":201,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:25.834921+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":497,"num_read_kb":22160,"num_write":848,"num_write_kb":45151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:36.732273+0000","last_change":"2024-09-22T08:56:36.732273+0000","last_active":"2024-09-22T08:56:36.732273+0000","last_peered":"2024-09-22T08:56:36.732273+0000","last_clean":"2024-09-22T08:56:36.732273+0000","last_became_active":"2024-09-22T08:15:08.978844+0000","last_became_peered":"2024-09-22T08:15:08.978844+0000","last_unstale":"2024-09-22T08:56:36.732273+0000","last_undegraded":"2024-09-22T08:56:36.732273+0000","last_fullsized":"2024-09-22T08:56:36.732273+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:36.732185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:36.732185+0000","last_clean_scrub_stamp":"2024-09-22T08:56:36.732185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:09:03.793067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"263'129","reported_seq":687,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:45.550783+0000","last_change":"2024-09-22T08:56:45.550783+0000","last_active":"2024-09-22T08:56:45.550783+0000","last_peered":"2024-09-22T08:56:45.550783+0000","last_clean":"2024-09-22T08:56:45.550783+0000","last_became_active":"2024-09-22T08:15:10.983522+0000","last_became_peered":"2024-09-22T08:15:10.983522+0000","last_unstale":"2024-09-22T08:56:45.550783+0000","last_undegraded":"2024-09-22T08:56:45.550783+0000","last_fullsized":"2024-09-22T08:56:45.550783+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'129","last_scrub_stamp":"2024-09-22T08:56:45.550692+0000","last_deep_scrub":"263'129","last_deep_scrub_stamp":"2024-09-22T08:56:45.550692+0000","last_clean_scrub_stamp":"2024-09-22T08:56:45.550692+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:16:26.075081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62130,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":173,"num_read_kb":427,"num_write":104,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:52:43.387370+0000","last_change":"2024-09-22T08:15:13.015794+0000","last_active":"2024-09-22T08:52:43.387370+0000","last_peered":"2024-09-22T08:52:43.387370+0000","last_clean":"2024-09-22T08:52:43.387370+0000","last_became_active":"2024-09-22T08:15:13.015473+0000","last_became_peered":"2024-09-22T08:15:13.015473+0000","last_unstale":"2024-09-22T08:52:43.387370+0000","last_undegraded":"2024-09-22T08:52:43.387370+0000","last_fullsized":"2024-09-22T08:52:43.387370+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:11.977429+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.977429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:45:01.160499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"263'213","reported_seq":1672,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:39.366065+0000","last_change":"2024-09-22T08:15:15.018252+0000","last_active":"2024-09-22T08:54:39.366065+0000","last_peered":"2024-09-22T08:54:39.366065+0000","last_clean":"2024-09-22T08:54:39.366065+0000","last_became_active":"2024-09-22T08:15:15.017394+0000","last_became_peered":"2024-09-22T08:15:15.017394+0000","last_unstale":"2024-09-22T08:54:39.366065+0000","last_undegraded":"2024-09-22T08:54:39.366065+0000","last_fullsized":"2024-09-22T08:54:39.366065+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.987185+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.987185+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1186,"num_read_kb":1185,"num_write":465,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"263'824","reported_seq":2527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:32.421909+0000","last_change":"2024-09-22T08:56:32.421909+0000","last_active":"2024-09-22T08:56:32.421909+0000","last_peered":"2024-09-22T08:56:32.421909+0000","last_clean":"2024-09-22T08:56:32.421909+0000","last_became_active":"2024-09-22T08:15:06.967603+0000","last_became_peered":"2024-09-22T08:15:06.967603+0000","last_unstale":"2024-09-22T08:56:32.421909+0000","last_undegraded":"2024-09-22T08:56:32.421909+0000","last_fullsized":"2024-09-22T08:56:32.421909+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'824","last_scrub_stamp":"2024-09-22T08:56:32.421797+0000","last_deep_scrub":"263'824","last_deep_scrub_stamp":"2024-09-22T08:56:32.421797+0000","last_clean_scrub_stamp":"2024-09-22T08:56:32.421797+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:35:50.459397+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4151,"num_read_kb":3787,"num_write":1085,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":251,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"263'211","reported_seq":883,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:27.464964+0000","last_change":"2024-09-22T08:56:27.464857+0000","last_active":"2024-09-22T08:56:27.464964+0000","last_peered":"2024-09-22T08:56:27.464964+0000","last_clean":"2024-09-22T08:56:27.464964+0000","last_became_active":"2024-09-22T08:15:04.957654+0000","last_became_peered":"2024-09-22T08:15:04.957654+0000","last_unstale":"2024-09-22T08:56:27.464964+0000","last_undegraded":"2024-09-22T08:56:27.464964+0000","last_fullsized":"2024-09-22T08:56:27.464964+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'211","last_scrub_stamp":"2024-09-22T08:56:27.464696+0000","last_deep_scrub":"263'211","last_deep_scrub_stamp":"2024-09-22T08:56:27.464696+0000","last_clean_scrub_stamp":"2024-09-22T08:56:27.464696+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:19:35.401370+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":592,"num_read_kb":25705,"num_write":948,"num_write_kb":45275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"263'2","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:46.806569+0000","last_change":"2024-09-22T08:56:46.806569+0000","last_active":"2024-09-22T08:56:46.806569+0000","last_peered":"2024-09-22T08:56:46.806569+0000","last_clean":"2024-09-22T08:56:46.806569+0000","last_became_active":"2024-09-22T08:15:08.972733+0000","last_became_peered":"2024-09-22T08:15:08.972733+0000","last_unstale":"2024-09-22T08:56:46.806569+0000","last_undegraded":"2024-09-22T08:56:46.806569+0000","last_fullsized":"2024-09-22T08:56:46.806569+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:56:46.806482+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:56:46.806482+0000","last_clean_scrub_stamp":"2024-09-22T08:56:46.806482+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:45:57.005123+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"263'161","reported_seq":751,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:57.902666+0000","last_change":"2024-09-22T08:56:57.902666+0000","last_active":"2024-09-22T08:56:57.902666+0000","last_peered":"2024-09-22T08:56:57.902666+0000","last_clean":"2024-09-22T08:56:57.902666+0000","last_became_active":"2024-09-22T08:15:10.987610+0000","last_became_peered":"2024-09-22T08:15:10.987610+0000","last_unstale":"2024-09-22T08:56:57.902666+0000","last_undegraded":"2024-09-22T08:56:57.902666+0000","last_fullsized":"2024-09-22T08:56:57.902666+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'161","last_scrub_stamp":"2024-09-22T08:56:57.902566+0000","last_deep_scrub":"263'161","last_deep_scrub_stamp":"2024-09-22T08:56:57.902566+0000","last_clean_scrub_stamp":"2024-09-22T08:56:57.902566+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:24:01.099997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6856,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":209,"num_read_kb":275,"num_write":118,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:58.863927+0000","last_change":"2024-09-22T08:56:58.863927+0000","last_active":"2024-09-22T08:56:58.863927+0000","last_peered":"2024-09-22T08:56:58.863927+0000","last_clean":"2024-09-22T08:56:58.863927+0000","last_became_active":"2024-09-22T08:15:13.003219+0000","last_became_peered":"2024-09-22T08:15:13.003219+0000","last_unstale":"2024-09-22T08:56:58.863927+0000","last_undegraded":"2024-09-22T08:56:58.863927+0000","last_fullsized":"2024-09-22T08:56:58.863927+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:58.863840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:58.863840+0000","last_clean_scrub_stamp":"2024-09-22T08:56:58.863840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:04:32.976325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"263'162","reported_seq":650,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:47.375743+0000","last_change":"2024-09-22T08:56:47.375743+0000","last_active":"2024-09-22T08:56:47.375743+0000","last_peered":"2024-09-22T08:56:47.375743+0000","last_clean":"2024-09-22T08:56:47.375743+0000","last_became_active":"2024-09-22T08:15:15.018311+0000","last_became_peered":"2024-09-22T08:15:15.018311+0000","last_unstale":"2024-09-22T08:56:47.375743+0000","last_undegraded":"2024-09-22T08:56:47.375743+0000","last_fullsized":"2024-09-22T08:56:47.375743+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'162","last_scrub_stamp":"2024-09-22T08:56:47.375645+0000","last_deep_scrub":"263'162","last_deep_scrub_stamp":"2024-09-22T08:56:47.375645+0000","last_clean_scrub_stamp":"2024-09-22T08:56:47.375645+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:55:47.154243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":160,"num_write":367,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"263'892","reported_seq":2479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:40.711673+0000","last_change":"2024-09-22T08:56:40.711673+0000","last_active":"2024-09-22T08:56:40.711673+0000","last_peered":"2024-09-22T08:56:40.711673+0000","last_clean":"2024-09-22T08:56:40.711673+0000","last_became_active":"2024-09-22T08:15:06.964786+0000","last_became_peered":"2024-09-22T08:15:06.964786+0000","last_unstale":"2024-09-22T08:56:40.711673+0000","last_undegraded":"2024-09-22T08:56:40.711673+0000","last_fullsized":"2024-09-22T08:56:40.711673+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'892","last_scrub_stamp":"2024-09-22T08:56:40.711582+0000","last_deep_scrub":"263'892","last_deep_scrub_stamp":"2024-09-22T08:56:40.711582+0000","last_clean_scrub_stamp":"2024-09-22T08:56:40.711582+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":800,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:45:38.702433+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4058,"num_read_kb":3642,"num_write":1164,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"263'229","reported_seq":906,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:24.354882+0000","last_change":"2024-09-22T08:56:24.354836+0000","last_active":"2024-09-22T08:56:24.354882+0000","last_peered":"2024-09-22T08:56:24.354882+0000","last_clean":"2024-09-22T08:56:24.354882+0000","last_became_active":"2024-09-22T08:15:04.962774+0000","last_became_peered":"2024-09-22T08:15:04.962774+0000","last_unstale":"2024-09-22T08:56:24.354882+0000","last_undegraded":"2024-09-22T08:56:24.354882+0000","last_fullsized":"2024-09-22T08:56:24.354882+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'229","last_scrub_stamp":"2024-09-22T08:56:24.354751+0000","last_deep_scrub":"263'229","last_deep_scrub_stamp":"2024-09-22T08:56:24.354751+0000","last_clean_scrub_stamp":"2024-09-22T08:56:24.354751+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:19:21.350986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":683,"num_read_kb":4749,"num_write":1115,"num_write_kb":28646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"263'864","reported_seq":2355,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:33.135511+0000","last_change":"2024-09-22T08:56:33.135511+0000","last_active":"2024-09-22T08:56:33.135511+0000","last_peered":"2024-09-22T08:56:33.135511+0000","last_clean":"2024-09-22T08:56:33.135511+0000","last_became_active":"2024-09-22T08:15:06.958389+0000","last_became_peered":"2024-09-22T08:15:06.958389+0000","last_unstale":"2024-09-22T08:56:33.135511+0000","last_undegraded":"2024-09-22T08:56:33.135511+0000","last_fullsized":"2024-09-22T08:56:33.135511+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'864","last_scrub_stamp":"2024-09-22T08:56:33.135421+0000","last_deep_scrub":"263'864","last_deep_scrub_stamp":"2024-09-22T08:56:33.135421+0000","last_clean_scrub_stamp":"2024-09-22T08:56:33.135421+0000","objects_scrubbed":2,"log_size":64,"log_dups_size":800,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:10:17.769140+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3808,"num_read_kb":3398,"num_write":1097,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"263'366","reported_seq":1063,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:26.085025+0000","last_change":"2024-09-22T08:56:26.084966+0000","last_active":"2024-09-22T08:56:26.085025+0000","last_peered":"2024-09-22T08:56:26.085025+0000","last_clean":"2024-09-22T08:56:26.085025+0000","last_became_active":"2024-09-22T08:15:04.950922+0000","last_became_peered":"2024-09-22T08:15:04.950922+0000","last_unstale":"2024-09-22T08:56:26.085025+0000","last_undegraded":"2024-09-22T08:56:26.085025+0000","last_fullsized":"2024-09-22T08:56:26.085025+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'366","last_scrub_stamp":"2024-09-22T08:56:26.084868+0000","last_deep_scrub":"263'366","last_deep_scrub_stamp":"2024-09-22T08:56:26.084868+0000","last_clean_scrub_stamp":"2024-09-22T08:56:26.084868+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:20:49.984873+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1005,"num_read_kb":11417,"num_write":1356,"num_write_kb":38557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"263'417","reported_seq":1875,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:44.891717+0000","last_change":"2024-09-22T08:56:44.891717+0000","last_active":"2024-09-22T08:56:44.891717+0000","last_peered":"2024-09-22T08:56:44.891717+0000","last_clean":"2024-09-22T08:56:44.891717+0000","last_became_active":"2024-09-22T08:15:06.973749+0000","last_became_peered":"2024-09-22T08:15:06.973749+0000","last_unstale":"2024-09-22T08:56:44.891717+0000","last_undegraded":"2024-09-22T08:56:44.891717+0000","last_fullsized":"2024-09-22T08:56:44.891717+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'417","last_scrub_stamp":"2024-09-22T08:56:44.891634+0000","last_deep_scrub":"263'417","last_deep_scrub_stamp":"2024-09-22T08:56:44.891634+0000","last_clean_scrub_stamp":"2024-09-22T08:56:44.891634+0000","objects_scrubbed":3,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:02:30.214518+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2229,"num_read_kb":2093,"num_write":519,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"263'230","reported_seq":870,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:34.824572+0000","last_change":"2024-09-22T08:56:34.824521+0000","last_active":"2024-09-22T08:56:34.824572+0000","last_peered":"2024-09-22T08:56:34.824572+0000","last_clean":"2024-09-22T08:56:34.824572+0000","last_became_active":"2024-09-22T08:15:04.959501+0000","last_became_peered":"2024-09-22T08:15:04.959501+0000","last_unstale":"2024-09-22T08:56:34.824572+0000","last_undegraded":"2024-09-22T08:56:34.824572+0000","last_fullsized":"2024-09-22T08:56:34.824572+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'230","last_scrub_stamp":"2024-09-22T08:56:34.824414+0000","last_deep_scrub":"263'230","last_deep_scrub_stamp":"2024-09-22T08:56:34.824414+0000","last_clean_scrub_stamp":"2024-09-22T08:56:34.824414+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:20:56.179522+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":551,"num_read_kb":25081,"num_write":1074,"num_write_kb":19730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"263'880","reported_seq":2582,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:41.441953+0000","last_change":"2024-09-22T08:56:41.441953+0000","last_active":"2024-09-22T08:56:41.441953+0000","last_peered":"2024-09-22T08:56:41.441953+0000","last_clean":"2024-09-22T08:56:41.441953+0000","last_became_active":"2024-09-22T08:15:06.970991+0000","last_became_peered":"2024-09-22T08:15:06.970991+0000","last_unstale":"2024-09-22T08:56:41.441953+0000","last_undegraded":"2024-09-22T08:56:41.441953+0000","last_fullsized":"2024-09-22T08:56:41.441953+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'880","last_scrub_stamp":"2024-09-22T08:56:41.441866+0000","last_deep_scrub":"263'880","last_deep_scrub_stamp":"2024-09-22T08:56:41.441866+0000","last_clean_scrub_stamp":"2024-09-22T08:56:41.441866+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":800,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:00:49.369182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4175,"num_read_kb":3774,"num_write":1132,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"263'196","reported_seq":836,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:28.437284+0000","last_change":"2024-09-22T08:56:28.437228+0000","last_active":"2024-09-22T08:56:28.437284+0000","last_peered":"2024-09-22T08:56:28.437284+0000","last_clean":"2024-09-22T08:56:28.437284+0000","last_became_active":"2024-09-22T08:15:04.954281+0000","last_became_peered":"2024-09-22T08:15:04.954281+0000","last_unstale":"2024-09-22T08:56:28.437284+0000","last_undegraded":"2024-09-22T08:56:28.437284+0000","last_fullsized":"2024-09-22T08:56:28.437284+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'196","last_scrub_stamp":"2024-09-22T08:56:28.437133+0000","last_deep_scrub":"263'196","last_deep_scrub_stamp":"2024-09-22T08:56:28.437133+0000","last_clean_scrub_stamp":"2024-09-22T08:56:28.437133+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:09:07.572237+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":578,"num_read_kb":4135,"num_write":927,"num_write_kb":8648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"263'1130","reported_seq":2693,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:40.404544+0000","last_change":"2024-09-22T08:56:40.404490+0000","last_active":"2024-09-22T08:56:40.404544+0000","last_peered":"2024-09-22T08:56:40.404544+0000","last_clean":"2024-09-22T08:56:40.404544+0000","last_became_active":"2024-09-22T08:15:06.967938+0000","last_became_peered":"2024-09-22T08:15:06.967938+0000","last_unstale":"2024-09-22T08:56:40.404544+0000","last_undegraded":"2024-09-22T08:56:40.404544+0000","last_fullsized":"2024-09-22T08:56:40.404544+0000","mapping_epoch":25,"log_start":"263'1100","ondisk_log_start":"263'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1130","last_scrub_stamp":"2024-09-22T08:56:40.404388+0000","last_deep_scrub":"263'1130","last_deep_scrub_stamp":"2024-09-22T08:56:40.404388+0000","last_clean_scrub_stamp":"2024-09-22T08:56:40.404388+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":1100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:38:56.900661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5297,"num_read_kb":4688,"num_write":1564,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"263'199","reported_seq":885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:26.505368+0000","last_change":"2024-09-22T08:56:26.505368+0000","last_active":"2024-09-22T08:56:26.505368+0000","last_peered":"2024-09-22T08:56:26.505368+0000","last_clean":"2024-09-22T08:56:26.505368+0000","last_became_active":"2024-09-22T08:15:04.963992+0000","last_became_peered":"2024-09-22T08:15:04.963992+0000","last_unstale":"2024-09-22T08:56:26.505368+0000","last_undegraded":"2024-09-22T08:56:26.505368+0000","last_fullsized":"2024-09-22T08:56:26.505368+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'199","last_scrub_stamp":"2024-09-22T08:56:26.505257+0000","last_deep_scrub":"263'199","last_deep_scrub_stamp":"2024-09-22T08:56:26.505257+0000","last_clean_scrub_stamp":"2024-09-22T08:56:26.505257+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:32:39.305652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":707,"num_read_kb":8108,"num_write":879,"num_write_kb":38701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"263'392","reported_seq":2075,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:33.426368+0000","last_change":"2024-09-22T08:56:33.426299+0000","last_active":"2024-09-22T08:56:33.426368+0000","last_peered":"2024-09-22T08:56:33.426368+0000","last_clean":"2024-09-22T08:56:33.426368+0000","last_became_active":"2024-09-22T08:15:06.964116+0000","last_became_peered":"2024-09-22T08:15:06.964116+0000","last_unstale":"2024-09-22T08:56:33.426368+0000","last_undegraded":"2024-09-22T08:56:33.426368+0000","last_fullsized":"2024-09-22T08:56:33.426368+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'392","last_scrub_stamp":"2024-09-22T08:56:33.426207+0000","last_deep_scrub":"263'392","last_deep_scrub_stamp":"2024-09-22T08:56:33.426207+0000","last_clean_scrub_stamp":"2024-09-22T08:56:33.426207+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:49:41.669632+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2347,"num_read_kb":2272,"num_write":440,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"263'230","reported_seq":920,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:27.538446+0000","last_change":"2024-09-22T08:56:27.538446+0000","last_active":"2024-09-22T08:56:27.538446+0000","last_peered":"2024-09-22T08:56:27.538446+0000","last_clean":"2024-09-22T08:56:27.538446+0000","last_became_active":"2024-09-22T08:15:04.951628+0000","last_became_peered":"2024-09-22T08:15:04.951628+0000","last_unstale":"2024-09-22T08:56:27.538446+0000","last_undegraded":"2024-09-22T08:56:27.538446+0000","last_fullsized":"2024-09-22T08:56:27.538446+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'230","last_scrub_stamp":"2024-09-22T08:56:27.538344+0000","last_deep_scrub":"263'230","last_deep_scrub_stamp":"2024-09-22T08:56:27.538344+0000","last_clean_scrub_stamp":"2024-09-22T08:56:27.538344+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:55:52.381757+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":736,"num_read_kb":9856,"num_write":1118,"num_write_kb":28547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"263'359","reported_seq":1841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:35.475638+0000","last_change":"2024-09-22T08:56:35.475586+0000","last_active":"2024-09-22T08:56:35.475638+0000","last_peered":"2024-09-22T08:56:35.475638+0000","last_clean":"2024-09-22T08:56:35.475638+0000","last_became_active":"2024-09-22T08:15:06.973584+0000","last_became_peered":"2024-09-22T08:15:06.973584+0000","last_unstale":"2024-09-22T08:56:35.475638+0000","last_undegraded":"2024-09-22T08:56:35.475638+0000","last_fullsized":"2024-09-22T08:56:35.475638+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-22T08:56:35.475501+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-22T08:56:35.475501+0000","last_clean_scrub_stamp":"2024-09-22T08:56:35.475501+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:33:22.764519+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2011,"num_read_kb":1931,"num_write":399,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"263'218","reported_seq":893,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:26.335055+0000","last_change":"2024-09-22T08:56:26.335055+0000","last_active":"2024-09-22T08:56:26.335055+0000","last_peered":"2024-09-22T08:56:26.335055+0000","last_clean":"2024-09-22T08:56:26.335055+0000","last_became_active":"2024-09-22T08:15:04.968983+0000","last_became_peered":"2024-09-22T08:15:04.968983+0000","last_unstale":"2024-09-22T08:56:26.335055+0000","last_undegraded":"2024-09-22T08:56:26.335055+0000","last_fullsized":"2024-09-22T08:56:26.335055+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'218","last_scrub_stamp":"2024-09-22T08:56:26.334945+0000","last_deep_scrub":"263'218","last_deep_scrub_stamp":"2024-09-22T08:56:26.334945+0000","last_clean_scrub_stamp":"2024-09-22T08:56:26.334945+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:49:29.445563+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":615,"num_read_kb":66139,"num_write":1057,"num_write_kb":31816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"263'1265","reported_seq":3124,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:27.877868+0000","last_change":"2024-09-22T08:56:27.877792+0000","last_active":"2024-09-22T08:56:27.877868+0000","last_peered":"2024-09-22T08:56:27.877868+0000","last_clean":"2024-09-22T08:56:27.877868+0000","last_became_active":"2024-09-22T08:15:06.970055+0000","last_became_peered":"2024-09-22T08:15:06.970055+0000","last_unstale":"2024-09-22T08:56:27.877868+0000","last_undegraded":"2024-09-22T08:56:27.877868+0000","last_fullsized":"2024-09-22T08:56:27.877868+0000","mapping_epoch":25,"log_start":"263'1200","ondisk_log_start":"263'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1265","last_scrub_stamp":"2024-09-22T08:56:27.877698+0000","last_deep_scrub":"263'1265","last_deep_scrub_stamp":"2024-09-22T08:56:27.877698+0000","last_clean_scrub_stamp":"2024-09-22T08:56:27.877698+0000","objects_scrubbed":3,"log_size":65,"log_dups_size":1200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:13:51.554575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6370,"num_read_kb":5597,"num_write":1961,"num_write_kb":987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1756,"num_omap_keys":7,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"263'219","reported_seq":890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:29.465649+0000","last_change":"2024-09-22T08:56:29.465649+0000","last_active":"2024-09-22T08:56:29.465649+0000","last_peered":"2024-09-22T08:56:29.465649+0000","last_clean":"2024-09-22T08:56:29.465649+0000","last_became_active":"2024-09-22T08:15:04.961545+0000","last_became_peered":"2024-09-22T08:15:04.961545+0000","last_unstale":"2024-09-22T08:56:29.465649+0000","last_undegraded":"2024-09-22T08:56:29.465649+0000","last_fullsized":"2024-09-22T08:56:29.465649+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'219","last_scrub_stamp":"2024-09-22T08:56:29.465544+0000","last_deep_scrub":"263'219","last_deep_scrub_stamp":"2024-09-22T08:56:29.465544+0000","last_clean_scrub_stamp":"2024-09-22T08:56:29.465544+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:08:30.829892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":669,"num_read_kb":2609,"num_write":1038,"num_write_kb":23374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"263'491","reported_seq":1948,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:35.144945+0000","last_change":"2024-09-22T08:56:35.144945+0000","last_active":"2024-09-22T08:56:35.144945+0000","last_peered":"2024-09-22T08:56:35.144945+0000","last_clean":"2024-09-22T08:56:35.144945+0000","last_became_active":"2024-09-22T08:15:06.959331+0000","last_became_peered":"2024-09-22T08:15:06.959331+0000","last_unstale":"2024-09-22T08:56:35.144945+0000","last_undegraded":"2024-09-22T08:56:35.144945+0000","last_fullsized":"2024-09-22T08:56:35.144945+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'491","last_scrub_stamp":"2024-09-22T08:56:35.144843+0000","last_deep_scrub":"263'491","last_deep_scrub_stamp":"2024-09-22T08:56:35.144843+0000","last_clean_scrub_stamp":"2024-09-22T08:56:35.144843+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:30:09.143732+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2542,"num_read_kb":2330,"num_write":651,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"263'196","reported_seq":795,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:35.803962+0000","last_change":"2024-09-22T08:56:35.803962+0000","last_active":"2024-09-22T08:56:35.803962+0000","last_peered":"2024-09-22T08:56:35.803962+0000","last_clean":"2024-09-22T08:56:35.803962+0000","last_became_active":"2024-09-22T08:15:04.958725+0000","last_became_peered":"2024-09-22T08:15:04.958725+0000","last_unstale":"2024-09-22T08:56:35.803962+0000","last_undegraded":"2024-09-22T08:56:35.803962+0000","last_fullsized":"2024-09-22T08:56:35.803962+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'196","last_scrub_stamp":"2024-09-22T08:56:35.803797+0000","last_deep_scrub":"263'196","last_deep_scrub_stamp":"2024-09-22T08:56:35.803797+0000","last_clean_scrub_stamp":"2024-09-22T08:56:35.803797+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:19:54.336476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":392,"num_read_kb":18786,"num_write":900,"num_write_kb":46944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"263'799","reported_seq":2390,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:34.449040+0000","last_change":"2024-09-22T08:56:34.449040+0000","last_active":"2024-09-22T08:56:34.449040+0000","last_peered":"2024-09-22T08:56:34.449040+0000","last_clean":"2024-09-22T08:56:34.449040+0000","last_became_active":"2024-09-22T08:15:06.956485+0000","last_became_peered":"2024-09-22T08:15:06.956485+0000","last_unstale":"2024-09-22T08:56:34.449040+0000","last_undegraded":"2024-09-22T08:56:34.449040+0000","last_fullsized":"2024-09-22T08:56:34.449040+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'799","last_scrub_stamp":"2024-09-22T08:56:34.448950+0000","last_deep_scrub":"263'799","last_deep_scrub_stamp":"2024-09-22T08:56:34.448950+0000","last_clean_scrub_stamp":"2024-09-22T08:56:34.448950+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:15.749892+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3799,"num_read_kb":3445,"num_write":1066,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"263'218","reported_seq":899,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:31.387996+0000","last_change":"2024-09-22T08:56:31.387996+0000","last_active":"2024-09-22T08:56:31.387996+0000","last_peered":"2024-09-22T08:56:31.387996+0000","last_clean":"2024-09-22T08:56:31.387996+0000","last_became_active":"2024-09-22T08:15:04.962165+0000","last_became_peered":"2024-09-22T08:15:04.962165+0000","last_unstale":"2024-09-22T08:56:31.387996+0000","last_undegraded":"2024-09-22T08:56:31.387996+0000","last_fullsized":"2024-09-22T08:56:31.387996+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'218","last_scrub_stamp":"2024-09-22T08:56:31.387900+0000","last_deep_scrub":"263'218","last_deep_scrub_stamp":"2024-09-22T08:56:31.387900+0000","last_clean_scrub_stamp":"2024-09-22T08:56:31.387900+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:42:29.087154+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":601,"num_read_kb":98488,"num_write":1035,"num_write_kb":53405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"263'774","reported_seq":2250,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:42.455820+0000","last_change":"2024-09-22T08:56:42.455820+0000","last_active":"2024-09-22T08:56:42.455820+0000","last_peered":"2024-09-22T08:56:42.455820+0000","last_clean":"2024-09-22T08:56:42.455820+0000","last_became_active":"2024-09-22T08:15:06.970111+0000","last_became_peered":"2024-09-22T08:15:06.970111+0000","last_unstale":"2024-09-22T08:56:42.455820+0000","last_undegraded":"2024-09-22T08:56:42.455820+0000","last_fullsized":"2024-09-22T08:56:42.455820+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'774","last_scrub_stamp":"2024-09-22T08:56:42.455718+0000","last_deep_scrub":"263'774","last_deep_scrub_stamp":"2024-09-22T08:56:42.455718+0000","last_clean_scrub_stamp":"2024-09-22T08:56:42.455718+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:58:53.024040+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3767,"num_read_kb":3405,"num_write":1035,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"263'192","reported_seq":902,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:21.922992+0000","last_change":"2024-09-22T08:56:21.922992+0000","last_active":"2024-09-22T08:56:21.922992+0000","last_peered":"2024-09-22T08:56:21.922992+0000","last_clean":"2024-09-22T08:56:21.922992+0000","last_became_active":"2024-09-22T08:15:04.963383+0000","last_became_peered":"2024-09-22T08:15:04.963383+0000","last_unstale":"2024-09-22T08:56:21.922992+0000","last_undegraded":"2024-09-22T08:56:21.922992+0000","last_fullsized":"2024-09-22T08:56:21.922992+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'192","last_scrub_stamp":"2024-09-22T08:56:21.922907+0000","last_deep_scrub":"263'192","last_deep_scrub_stamp":"2024-09-22T08:56:21.922907+0000","last_clean_scrub_stamp":"2024-09-22T08:56:21.922907+0000","objects_scrubbed":5,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:34:08.554670+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":846,"num_read_kb":15214,"num_write":846,"num_write_kb":25255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"263'750","reported_seq":2184,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:29.779798+0000","last_change":"2024-09-22T08:56:29.779798+0000","last_active":"2024-09-22T08:56:29.779798+0000","last_peered":"2024-09-22T08:56:29.779798+0000","last_clean":"2024-09-22T08:56:29.779798+0000","last_became_active":"2024-09-22T08:15:06.967819+0000","last_became_peered":"2024-09-22T08:15:06.967819+0000","last_unstale":"2024-09-22T08:56:29.779798+0000","last_undegraded":"2024-09-22T08:56:29.779798+0000","last_fullsized":"2024-09-22T08:56:29.779798+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'750","last_scrub_stamp":"2024-09-22T08:56:29.779699+0000","last_deep_scrub":"263'750","last_deep_scrub_stamp":"2024-09-22T08:56:29.779699+0000","last_clean_scrub_stamp":"2024-09-22T08:56:29.779699+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":700,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:42:36.409781+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3557,"num_read_kb":3203,"num_write":994,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"263'222","reported_seq":860,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:30.600999+0000","last_change":"2024-09-22T08:56:30.600999+0000","last_active":"2024-09-22T08:56:30.600999+0000","last_peered":"2024-09-22T08:56:30.600999+0000","last_clean":"2024-09-22T08:56:30.600999+0000","last_became_active":"2024-09-22T08:15:04.963035+0000","last_became_peered":"2024-09-22T08:15:04.963035+0000","last_unstale":"2024-09-22T08:56:30.600999+0000","last_undegraded":"2024-09-22T08:56:30.600999+0000","last_fullsized":"2024-09-22T08:56:30.600999+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'222","last_scrub_stamp":"2024-09-22T08:56:30.600894+0000","last_deep_scrub":"263'222","last_deep_scrub_stamp":"2024-09-22T08:56:30.600894+0000","last_clean_scrub_stamp":"2024-09-22T08:56:30.600894+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:34:32.074093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":484,"num_read_kb":60036,"num_write":970,"num_write_kb":46477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"263'435","reported_seq":2064,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:32.742512+0000","last_change":"2024-09-22T08:56:32.742512+0000","last_active":"2024-09-22T08:56:32.742512+0000","last_peered":"2024-09-22T08:56:32.742512+0000","last_clean":"2024-09-22T08:56:32.742512+0000","last_became_active":"2024-09-22T08:15:06.972901+0000","last_became_peered":"2024-09-22T08:15:06.972901+0000","last_unstale":"2024-09-22T08:56:32.742512+0000","last_undegraded":"2024-09-22T08:56:32.742512+0000","last_fullsized":"2024-09-22T08:56:32.742512+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'435","last_scrub_stamp":"2024-09-22T08:56:32.742406+0000","last_deep_scrub":"263'435","last_deep_scrub_stamp":"2024-09-22T08:56:32.742406+0000","last_clean_scrub_stamp":"2024-09-22T08:56:32.742406+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:25:24.212860+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2630,"num_read_kb":2493,"num_write":497,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2041,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"263'193","reported_seq":804,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:24.511017+0000","last_change":"2024-09-22T08:56:24.511017+0000","last_active":"2024-09-22T08:56:24.511017+0000","last_peered":"2024-09-22T08:56:24.511017+0000","last_clean":"2024-09-22T08:56:24.511017+0000","last_became_active":"2024-09-22T08:15:04.954601+0000","last_became_peered":"2024-09-22T08:15:04.954601+0000","last_unstale":"2024-09-22T08:56:24.511017+0000","last_undegraded":"2024-09-22T08:56:24.511017+0000","last_fullsized":"2024-09-22T08:56:24.511017+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'193","last_scrub_stamp":"2024-09-22T08:56:24.510944+0000","last_deep_scrub":"263'193","last_deep_scrub_stamp":"2024-09-22T08:56:24.510944+0000","last_clean_scrub_stamp":"2024-09-22T08:56:24.510944+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:11.452087+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":488,"num_read_kb":10659,"num_write":871,"num_write_kb":26887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"263'440","reported_seq":1908,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:34.118935+0000","last_change":"2024-09-22T08:56:34.118935+0000","last_active":"2024-09-22T08:56:34.118935+0000","last_peered":"2024-09-22T08:56:34.118935+0000","last_clean":"2024-09-22T08:56:34.118935+0000","last_became_active":"2024-09-22T08:15:06.955721+0000","last_became_peered":"2024-09-22T08:15:06.955721+0000","last_unstale":"2024-09-22T08:56:34.118935+0000","last_undegraded":"2024-09-22T08:56:34.118935+0000","last_fullsized":"2024-09-22T08:56:34.118935+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'440","last_scrub_stamp":"2024-09-22T08:56:34.118840+0000","last_deep_scrub":"263'440","last_deep_scrub_stamp":"2024-09-22T08:56:34.118840+0000","last_clean_scrub_stamp":"2024-09-22T08:56:34.118840+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:00:17.060498+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2301,"num_read_kb":2146,"num_write":527,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"263'218","reported_seq":887,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:36.784912+0000","last_change":"2024-09-22T08:56:36.784912+0000","last_active":"2024-09-22T08:56:36.784912+0000","last_peered":"2024-09-22T08:56:36.784912+0000","last_clean":"2024-09-22T08:56:36.784912+0000","last_became_active":"2024-09-22T08:15:04.961217+0000","last_became_peered":"2024-09-22T08:15:04.961217+0000","last_unstale":"2024-09-22T08:56:36.784912+0000","last_undegraded":"2024-09-22T08:56:36.784912+0000","last_fullsized":"2024-09-22T08:56:36.784912+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'218","last_scrub_stamp":"2024-09-22T08:56:36.784815+0000","last_deep_scrub":"263'218","last_deep_scrub_stamp":"2024-09-22T08:56:36.784815+0000","last_clean_scrub_stamp":"2024-09-22T08:56:36.784815+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:05:54.668509+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":598,"num_read_kb":11776,"num_write":1062,"num_write_kb":6843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"263'550","reported_seq":2089,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:36.669377+0000","last_change":"2024-09-22T08:56:36.669377+0000","last_active":"2024-09-22T08:56:36.669377+0000","last_peered":"2024-09-22T08:56:36.669377+0000","last_clean":"2024-09-22T08:56:36.669377+0000","last_became_active":"2024-09-22T08:15:06.970735+0000","last_became_peered":"2024-09-22T08:15:06.970735+0000","last_unstale":"2024-09-22T08:56:36.669377+0000","last_undegraded":"2024-09-22T08:56:36.669377+0000","last_fullsized":"2024-09-22T08:56:36.669377+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'550","last_scrub_stamp":"2024-09-22T08:56:36.669289+0000","last_deep_scrub":"263'550","last_deep_scrub_stamp":"2024-09-22T08:56:36.669289+0000","last_clean_scrub_stamp":"2024-09-22T08:56:36.669289+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":500,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:31:27.633080+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2725,"num_read_kb":2496,"num_write":675,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"263'221","reported_seq":886,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:32.099772+0000","last_change":"2024-09-22T08:56:32.099772+0000","last_active":"2024-09-22T08:56:32.099772+0000","last_peered":"2024-09-22T08:56:32.099772+0000","last_clean":"2024-09-22T08:56:32.099772+0000","last_became_active":"2024-09-22T08:15:04.968172+0000","last_became_peered":"2024-09-22T08:15:04.968172+0000","last_unstale":"2024-09-22T08:56:32.099772+0000","last_undegraded":"2024-09-22T08:56:32.099772+0000","last_fullsized":"2024-09-22T08:56:32.099772+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'221","last_scrub_stamp":"2024-09-22T08:56:32.099657+0000","last_deep_scrub":"263'221","last_deep_scrub_stamp":"2024-09-22T08:56:32.099657+0000","last_clean_scrub_stamp":"2024-09-22T08:56:32.099657+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:37:00.416721+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":641,"num_read_kb":8608,"num_write":1007,"num_write_kb":17473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"263'757","reported_seq":2299,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:38.811418+0000","last_change":"2024-09-22T08:56:38.811418+0000","last_active":"2024-09-22T08:56:38.811418+0000","last_peered":"2024-09-22T08:56:38.811418+0000","last_clean":"2024-09-22T08:56:38.811418+0000","last_became_active":"2024-09-22T08:15:06.976019+0000","last_became_peered":"2024-09-22T08:15:06.976019+0000","last_unstale":"2024-09-22T08:56:38.811418+0000","last_undegraded":"2024-09-22T08:56:38.811418+0000","last_fullsized":"2024-09-22T08:56:38.811418+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'757","last_scrub_stamp":"2024-09-22T08:56:38.811329+0000","last_deep_scrub":"263'757","last_deep_scrub_stamp":"2024-09-22T08:56:38.811329+0000","last_clean_scrub_stamp":"2024-09-22T08:56:38.811329+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:12:18.113138+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3691,"num_read_kb":3360,"num_write":995,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"263'226","reported_seq":924,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:37.743129+0000","last_change":"2024-09-22T08:56:37.743129+0000","last_active":"2024-09-22T08:56:37.743129+0000","last_peered":"2024-09-22T08:56:37.743129+0000","last_clean":"2024-09-22T08:56:37.743129+0000","last_became_active":"2024-09-22T08:15:04.963391+0000","last_became_peered":"2024-09-22T08:15:04.963391+0000","last_unstale":"2024-09-22T08:56:37.743129+0000","last_undegraded":"2024-09-22T08:56:37.743129+0000","last_fullsized":"2024-09-22T08:56:37.743129+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'226","last_scrub_stamp":"2024-09-22T08:56:37.743035+0000","last_deep_scrub":"263'226","last_deep_scrub_stamp":"2024-09-22T08:56:37.743035+0000","last_clean_scrub_stamp":"2024-09-22T08:56:37.743035+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:49:16.424122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":637,"num_read_kb":95067,"num_write":1060,"num_write_kb":43906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"263'269","reported_seq":932,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:38.770007+0000","last_change":"2024-09-22T08:56:38.770007+0000","last_active":"2024-09-22T08:56:38.770007+0000","last_peered":"2024-09-22T08:56:38.770007+0000","last_clean":"2024-09-22T08:56:38.770007+0000","last_became_active":"2024-09-22T08:15:04.965396+0000","last_became_peered":"2024-09-22T08:15:04.965396+0000","last_unstale":"2024-09-22T08:56:38.770007+0000","last_undegraded":"2024-09-22T08:56:38.770007+0000","last_fullsized":"2024-09-22T08:56:38.770007+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'269","last_scrub_stamp":"2024-09-22T08:56:38.769874+0000","last_deep_scrub":"263'269","last_deep_scrub_stamp":"2024-09-22T08:56:38.769874+0000","last_clean_scrub_stamp":"2024-09-22T08:56:38.769874+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:54.013054+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":744,"num_read_kb":7770,"num_write":1118,"num_write_kb":20319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"263'1212","reported_seq":2932,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:38.730878+0000","last_change":"2024-09-22T08:56:38.730878+0000","last_active":"2024-09-22T08:56:38.730878+0000","last_peered":"2024-09-22T08:56:38.730878+0000","last_clean":"2024-09-22T08:56:38.730878+0000","last_became_active":"2024-09-22T08:15:06.970717+0000","last_became_peered":"2024-09-22T08:15:06.970717+0000","last_unstale":"2024-09-22T08:56:38.730878+0000","last_undegraded":"2024-09-22T08:56:38.730878+0000","last_fullsized":"2024-09-22T08:56:38.730878+0000","mapping_epoch":25,"log_start":"263'1200","ondisk_log_start":"263'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1212","last_scrub_stamp":"2024-09-22T08:56:38.730771+0000","last_deep_scrub":"263'1212","last_deep_scrub_stamp":"2024-09-22T08:56:38.730771+0000","last_clean_scrub_stamp":"2024-09-22T08:56:38.730771+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":1200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:49:00.467574+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5779,"num_read_kb":5147,"num_write":1662,"num_write_kb":686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"263'203","reported_seq":796,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:32.373450+0000","last_change":"2024-09-22T08:56:32.373450+0000","last_active":"2024-09-22T08:56:32.373450+0000","last_peered":"2024-09-22T08:56:32.373450+0000","last_clean":"2024-09-22T08:56:32.373450+0000","last_became_active":"2024-09-22T08:15:04.959102+0000","last_became_peered":"2024-09-22T08:15:04.959102+0000","last_unstale":"2024-09-22T08:56:32.373450+0000","last_undegraded":"2024-09-22T08:56:32.373450+0000","last_fullsized":"2024-09-22T08:56:32.373450+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'203","last_scrub_stamp":"2024-09-22T08:56:32.373334+0000","last_deep_scrub":"263'203","last_deep_scrub_stamp":"2024-09-22T08:56:32.373334+0000","last_clean_scrub_stamp":"2024-09-22T08:56:32.373334+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:45:32.367319+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":396,"num_read_kb":24955,"num_write":899,"num_write_kb":36551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"263'499","reported_seq":2117,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:33.765206+0000","last_change":"2024-09-22T08:56:33.765206+0000","last_active":"2024-09-22T08:56:33.765206+0000","last_peered":"2024-09-22T08:56:33.765206+0000","last_clean":"2024-09-22T08:56:33.765206+0000","last_became_active":"2024-09-22T08:15:06.968345+0000","last_became_peered":"2024-09-22T08:15:06.968345+0000","last_unstale":"2024-09-22T08:56:33.765206+0000","last_undegraded":"2024-09-22T08:56:33.765206+0000","last_fullsized":"2024-09-22T08:56:33.765206+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'499","last_scrub_stamp":"2024-09-22T08:56:33.765098+0000","last_deep_scrub":"263'499","last_deep_scrub_stamp":"2024-09-22T08:56:33.765098+0000","last_clean_scrub_stamp":"2024-09-22T08:56:33.765098+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:28:36.072865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2601,"num_read_kb":2436,"num_write":597,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10844,"num_read_kb":8840,"num_write":3116,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":899,"ondisk_log_size":899,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15081,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":16349,"num_read_kb":16036,"num_write":17069,"num_write_kb":4981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2585,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":30162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1751,"ondisk_log_size":1751,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":680,"ondisk_log_size":680,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382382,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":8323,"num_read_kb":10644,"num_write":5603,"num_write_kb":2773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":709928,"num_omap_keys":1614,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1795,"ondisk_log_size":1795,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2393,"num_read_kb":2857,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":219693,"num_read_kb":201308,"num_write":55750,"num_write_kb":18998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35480,"num_omap_keys":143,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4023,"ondisk_log_size":4023,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":22399416,"num_objects":166,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":166,"num_whiteouts":0,"num_read":38892,"num_read_kb":2161027,"num_write":64127,"num_write_kb":2146956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45760512,"data_stored":44798832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3530,"ondisk_log_size":3530,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":194127,"num_write":186,"num_write_kb":125446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":186900,"num_write":186,"num_write_kb":125446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509951,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":202588,"kb_used_data":8972,"kb_used_omap":1,"kb_used_meta":193598,"kb_avail":94169252,"statfs":{"total":96636764160,"available":96429314048,"internally_reserved":0,"allocated":9187328,"data_stored":7502420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":198244808},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509952,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":261412,"kb_used_data":9492,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94110428,"statfs":{"total":96636764160,"available":96369078272,"internally_reserved":0,"allocated":9719808,"data_stored":8091734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257948101},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509952,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":86104,"kb_used_data":10504,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94285736,"statfs":{"total":96636764160,"available":96548593664,"internally_reserved":0,"allocated":10756096,"data_stored":9074858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542655,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":208972,"kb_used_data":7100,"kb_used_omap":1,"kb_used_meta":201854,"kb_avail":94162868,"statfs":{"total":96636764160,"available":96422776832,"internally_reserved":0,"allocated":7270400,"data_stored":5649861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":206698954},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542654,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81736,"kb_used_data":10296,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94290104,"statfs":{"total":96636764160,"available":96553066496,"internally_reserved":0,"allocated":10543104,"data_stored":8890315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542655,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":248020,"kb_used_data":9988,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94123820,"statfs":{"total":96636764160,"available":96382791680,"internally_reserved":0,"allocated":10227712,"data_stored":8586347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243726789},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542657,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148296,"kb_used_data":8888,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94223544,"statfs":{"total":96636764160,"available":96484909056,"internally_reserved":0,"allocated":9101312,"data_stored":7502190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575357,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120688,"kb_used_data":8992,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94251152,"statfs":{"total":96636764160,"available":96513179648,"internally_reserved":0,"allocated":9207808,"data_stored":7504913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7127040,"data_stored":6973120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5500928,"data_stored":5399874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5558272,"data_stored":5400076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5541888,"data_stored":5400084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5492736,"data_stored":5399824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":6012928,"data_stored":5893124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6889472,"data_stored":6786226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3637248,"data_stored":3546504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":5633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":3876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":5455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T08:57:05.647 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.648 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.648 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.648 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.648 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.648 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.648 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.648 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.648 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.649 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.649 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.649 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.649 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.649 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.649 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.649 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.649 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.650 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.650 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.650 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.650 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.650 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.650 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.650 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.650 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.651 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.651 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.651 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.651 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.651 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.651 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.651 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.651 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.651 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.651 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.652 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.652 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.652 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.652 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.652 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.652 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.652 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.652 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.653 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.653 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.653 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.653 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.653 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.653 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.653 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.654 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.654 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.654 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.654 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.654 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.654 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.654 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.654 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.654 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.655 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.655 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.655 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.655 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.655 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.655 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.655 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.655 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.655 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.656 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-22T08:29:25.030054+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.656 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.657 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.658 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.658 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.659 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.659 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.659 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-22T08:15:11.977429+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.659 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-22T08:15:13.987185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=15, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:05.660 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-22T08:57:25.660 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T08:57:26.015 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:57:26.026 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-09-22T08:57:26.029 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":1536,"stamp":"2024-09-22T08:57:25.661143+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23389059,"num_objects":621,"num_object_clones":0,"num_object_copies":1242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":621,"num_whiteouts":0,"num_read":296912,"num_read_kb":2781806,"num_write":146178,"num_write_kb":2427265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":189,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":749121,"num_omap_keys":1786,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13058,"ondisk_log_size":13058,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1357816,"kb_used_data":74232,"kb_used_omap":12,"kb_used_meta":1283443,"kb_avail":753616904,"statfs":{"total":773094113280,"available":771703709696,"internally_reserved":0,"allocated":76013568,"data_stored":62802638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1314246193},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005754"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:59.283337+0000","last_change":"2024-09-22T08:56:59.283247+0000","last_active":"2024-09-22T08:56:59.283337+0000","last_peered":"2024-09-22T08:56:59.283337+0000","last_clean":"2024-09-22T08:56:59.283337+0000","last_became_active":"2024-09-22T08:42:17.435576+0000","last_became_peered":"2024-09-22T08:42:17.435576+0000","last_unstale":"2024-09-22T08:56:59.283337+0000","last_undegraded":"2024-09-22T08:56:59.283337+0000","last_fullsized":"2024-09-22T08:56:59.283337+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:59.283150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:59.283150+0000","last_clean_scrub_stamp":"2024-09-22T08:56:59.283150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:55:41.200537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"263'7","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:58.831205+0000","last_change":"2024-09-22T08:56:58.831205+0000","last_active":"2024-09-22T08:56:58.831205+0000","last_peered":"2024-09-22T08:56:58.831205+0000","last_clean":"2024-09-22T08:56:58.831205+0000","last_became_active":"2024-09-22T08:31:14.254610+0000","last_became_peered":"2024-09-22T08:31:14.254610+0000","last_unstale":"2024-09-22T08:56:58.831205+0000","last_undegraded":"2024-09-22T08:56:58.831205+0000","last_fullsized":"2024-09-22T08:56:58.831205+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-22T08:56:58.831111+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-22T08:56:58.831111+0000","last_clean_scrub_stamp":"2024-09-22T08:56:58.831111+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:32.357382+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"263'4","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:02.386863+0000","last_change":"2024-09-22T08:57:02.386863+0000","last_active":"2024-09-22T08:57:02.386863+0000","last_peered":"2024-09-22T08:57:02.386863+0000","last_clean":"2024-09-22T08:57:02.386863+0000","last_became_active":"2024-09-22T08:31:11.215757+0000","last_became_peered":"2024-09-22T08:31:11.215757+0000","last_unstale":"2024-09-22T08:57:02.386863+0000","last_undegraded":"2024-09-22T08:57:02.386863+0000","last_fullsized":"2024-09-22T08:57:02.386863+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-22T08:57:02.386770+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-22T08:57:02.386770+0000","last_clean_scrub_stamp":"2024-09-22T08:57:02.386770+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:24.038513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6203,"num_write":4,"num_write_kb":3131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"263'27","reported_seq":122,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:04.920622+0000","last_change":"2024-09-22T08:57:04.920622+0000","last_active":"2024-09-22T08:57:04.920622+0000","last_peered":"2024-09-22T08:57:04.920622+0000","last_clean":"2024-09-22T08:57:04.920622+0000","last_became_active":"2024-09-22T08:29:26.069635+0000","last_became_peered":"2024-09-22T08:29:26.069635+0000","last_unstale":"2024-09-22T08:57:04.920622+0000","last_undegraded":"2024-09-22T08:57:04.920622+0000","last_fullsized":"2024-09-22T08:57:04.920622+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'27","last_scrub_stamp":"2024-09-22T08:57:04.920534+0000","last_deep_scrub":"263'27","last_deep_scrub_stamp":"2024-09-22T08:57:04.920534+0000","last_clean_scrub_stamp":"2024-09-22T08:57:04.920534+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:34:21.103516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":139,"num_write":76,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:06.619220+0000","last_change":"2024-09-22T08:57:06.619154+0000","last_active":"2024-09-22T08:57:06.619220+0000","last_peered":"2024-09-22T08:57:06.619220+0000","last_clean":"2024-09-22T08:57:06.619220+0000","last_became_active":"2024-09-22T08:42:17.432946+0000","last_became_peered":"2024-09-22T08:42:17.432946+0000","last_unstale":"2024-09-22T08:57:06.619220+0000","last_undegraded":"2024-09-22T08:57:06.619220+0000","last_fullsized":"2024-09-22T08:57:06.619220+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:06.619063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:06.619063+0000","last_clean_scrub_stamp":"2024-09-22T08:57:06.619063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:32:25.387146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"263'5","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:03.091401+0000","last_change":"2024-09-22T08:57:03.091401+0000","last_active":"2024-09-22T08:57:03.091401+0000","last_peered":"2024-09-22T08:57:03.091401+0000","last_clean":"2024-09-22T08:57:03.091401+0000","last_became_active":"2024-09-22T08:31:14.256486+0000","last_became_peered":"2024-09-22T08:31:14.256486+0000","last_unstale":"2024-09-22T08:57:03.091401+0000","last_undegraded":"2024-09-22T08:57:03.091401+0000","last_fullsized":"2024-09-22T08:57:03.091401+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-22T08:57:03.091313+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-22T08:57:03.091313+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.091313+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:22:04.485658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8240,"num_write":10,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"260'2","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:06.500264+0000","last_change":"2024-09-22T08:57:06.500264+0000","last_active":"2024-09-22T08:57:06.500264+0000","last_peered":"2024-09-22T08:57:06.500264+0000","last_clean":"2024-09-22T08:57:06.500264+0000","last_became_active":"2024-09-22T08:31:11.216515+0000","last_became_peered":"2024-09-22T08:31:11.216515+0000","last_unstale":"2024-09-22T08:57:06.500264+0000","last_undegraded":"2024-09-22T08:57:06.500264+0000","last_fullsized":"2024-09-22T08:57:06.500264+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-22T08:57:06.500167+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-22T08:57:06.500167+0000","last_clean_scrub_stamp":"2024-09-22T08:57:06.500167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:31:02.617065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"263'31","reported_seq":138,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:03.946083+0000","last_change":"2024-09-22T08:57:03.946083+0000","last_active":"2024-09-22T08:57:03.946083+0000","last_peered":"2024-09-22T08:57:03.946083+0000","last_clean":"2024-09-22T08:57:03.946083+0000","last_became_active":"2024-09-22T08:29:26.073415+0000","last_became_peered":"2024-09-22T08:29:26.073415+0000","last_unstale":"2024-09-22T08:57:03.946083+0000","last_undegraded":"2024-09-22T08:57:03.946083+0000","last_fullsized":"2024-09-22T08:57:03.946083+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'31","last_scrub_stamp":"2024-09-22T08:57:03.945981+0000","last_deep_scrub":"263'31","last_deep_scrub_stamp":"2024-09-22T08:57:03.945981+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.945981+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:16:03.932770+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":176,"num_write":77,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:00.821735+0000","last_change":"2024-09-22T08:57:00.821735+0000","last_active":"2024-09-22T08:57:00.821735+0000","last_peered":"2024-09-22T08:57:00.821735+0000","last_clean":"2024-09-22T08:57:00.821735+0000","last_became_active":"2024-09-22T08:42:17.436334+0000","last_became_peered":"2024-09-22T08:42:17.436334+0000","last_unstale":"2024-09-22T08:57:00.821735+0000","last_undegraded":"2024-09-22T08:57:00.821735+0000","last_fullsized":"2024-09-22T08:57:00.821735+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:00.821641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:00.821641+0000","last_clean_scrub_stamp":"2024-09-22T08:57:00.821641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:06:29.336666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"260'4","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:15.385328+0000","last_change":"2024-09-22T08:57:15.385328+0000","last_active":"2024-09-22T08:57:15.385328+0000","last_peered":"2024-09-22T08:57:15.385328+0000","last_clean":"2024-09-22T08:57:15.385328+0000","last_became_active":"2024-09-22T08:31:14.256769+0000","last_became_peered":"2024-09-22T08:31:14.256769+0000","last_unstale":"2024-09-22T08:57:15.385328+0000","last_undegraded":"2024-09-22T08:57:15.385328+0000","last_fullsized":"2024-09-22T08:57:15.385328+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-22T08:57:15.385233+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-22T08:57:15.385233+0000","last_clean_scrub_stamp":"2024-09-22T08:57:15.385233+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:22:12.896634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:03.406493+0000","last_change":"2024-09-22T08:57:03.406401+0000","last_active":"2024-09-22T08:57:03.406493+0000","last_peered":"2024-09-22T08:57:03.406493+0000","last_clean":"2024-09-22T08:57:03.406493+0000","last_became_active":"2024-09-22T08:31:11.210892+0000","last_became_peered":"2024-09-22T08:31:11.210892+0000","last_unstale":"2024-09-22T08:57:03.406493+0000","last_undegraded":"2024-09-22T08:57:03.406493+0000","last_fullsized":"2024-09-22T08:57:03.406493+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.406314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.406314+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.406314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:09:14.829007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"263'43","reported_seq":171,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:58.576106+0000","last_change":"2024-09-22T08:56:58.576106+0000","last_active":"2024-09-22T08:56:58.576106+0000","last_peered":"2024-09-22T08:56:58.576106+0000","last_clean":"2024-09-22T08:56:58.576106+0000","last_became_active":"2024-09-22T08:29:26.067963+0000","last_became_peered":"2024-09-22T08:29:26.067963+0000","last_unstale":"2024-09-22T08:56:58.576106+0000","last_undegraded":"2024-09-22T08:56:58.576106+0000","last_fullsized":"2024-09-22T08:56:58.576106+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'43","last_scrub_stamp":"2024-09-22T08:56:58.576017+0000","last_deep_scrub":"263'43","last_deep_scrub_stamp":"2024-09-22T08:56:58.576017+0000","last_clean_scrub_stamp":"2024-09-22T08:56:58.576017+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:24:10.505789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":380,"num_read_kb":284,"num_write":99,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:21.562430+0000","last_change":"2024-09-22T08:57:21.562430+0000","last_active":"2024-09-22T08:57:21.562430+0000","last_peered":"2024-09-22T08:57:21.562430+0000","last_clean":"2024-09-22T08:57:21.562430+0000","last_became_active":"2024-09-22T08:42:17.430938+0000","last_became_peered":"2024-09-22T08:42:17.430938+0000","last_unstale":"2024-09-22T08:57:21.562430+0000","last_undegraded":"2024-09-22T08:57:21.562430+0000","last_fullsized":"2024-09-22T08:57:21.562430+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:21.562324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:21.562324+0000","last_clean_scrub_stamp":"2024-09-22T08:57:21.562324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:32:15.743471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"263'5","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:12.405275+0000","last_change":"2024-09-22T08:57:12.405213+0000","last_active":"2024-09-22T08:57:12.405275+0000","last_peered":"2024-09-22T08:57:12.405275+0000","last_clean":"2024-09-22T08:57:12.405275+0000","last_became_active":"2024-09-22T08:31:14.255086+0000","last_became_peered":"2024-09-22T08:31:14.255086+0000","last_unstale":"2024-09-22T08:57:12.405275+0000","last_undegraded":"2024-09-22T08:57:12.405275+0000","last_fullsized":"2024-09-22T08:57:12.405275+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-22T08:57:12.405124+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-22T08:57:12.405124+0000","last_clean_scrub_stamp":"2024-09-22T08:57:12.405124+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:19:09.172107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:01.839072+0000","last_change":"2024-09-22T08:57:01.839072+0000","last_active":"2024-09-22T08:57:01.839072+0000","last_peered":"2024-09-22T08:57:01.839072+0000","last_clean":"2024-09-22T08:57:01.839072+0000","last_became_active":"2024-09-22T08:31:11.207375+0000","last_became_peered":"2024-09-22T08:31:11.207375+0000","last_unstale":"2024-09-22T08:57:01.839072+0000","last_undegraded":"2024-09-22T08:57:01.839072+0000","last_fullsized":"2024-09-22T08:57:01.839072+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:01.838970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:01.838970+0000","last_clean_scrub_stamp":"2024-09-22T08:57:01.838970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:53:22.179444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"263'31","reported_seq":131,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:56.555035+0000","last_change":"2024-09-22T08:56:56.554934+0000","last_active":"2024-09-22T08:56:56.555035+0000","last_peered":"2024-09-22T08:56:56.555035+0000","last_clean":"2024-09-22T08:56:56.555035+0000","last_became_active":"2024-09-22T08:29:26.072183+0000","last_became_peered":"2024-09-22T08:29:26.072183+0000","last_unstale":"2024-09-22T08:56:56.555035+0000","last_undegraded":"2024-09-22T08:56:56.555035+0000","last_fullsized":"2024-09-22T08:56:56.555035+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'31","last_scrub_stamp":"2024-09-22T08:56:56.554814+0000","last_deep_scrub":"263'31","last_deep_scrub_stamp":"2024-09-22T08:56:56.554814+0000","last_clean_scrub_stamp":"2024-09-22T08:56:56.554814+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:19:23.285923+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":233,"num_read_kb":155,"num_write":81,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:13.361779+0000","last_change":"2024-09-22T08:57:13.361779+0000","last_active":"2024-09-22T08:57:13.361779+0000","last_peered":"2024-09-22T08:57:13.361779+0000","last_clean":"2024-09-22T08:57:13.361779+0000","last_became_active":"2024-09-22T08:42:17.418224+0000","last_became_peered":"2024-09-22T08:42:17.418224+0000","last_unstale":"2024-09-22T08:57:13.361779+0000","last_undegraded":"2024-09-22T08:57:13.361779+0000","last_fullsized":"2024-09-22T08:57:13.361779+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:13.361683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:13.361683+0000","last_clean_scrub_stamp":"2024-09-22T08:57:13.361683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:33:09.495984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"263'5","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:55.323168+0000","last_change":"2024-09-22T08:56:55.323168+0000","last_active":"2024-09-22T08:56:55.323168+0000","last_peered":"2024-09-22T08:56:55.323168+0000","last_clean":"2024-09-22T08:56:55.323168+0000","last_became_active":"2024-09-22T08:31:14.261753+0000","last_became_peered":"2024-09-22T08:31:14.261753+0000","last_unstale":"2024-09-22T08:56:55.323168+0000","last_undegraded":"2024-09-22T08:56:55.323168+0000","last_fullsized":"2024-09-22T08:56:55.323168+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-22T08:56:55.323025+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-22T08:56:55.323025+0000","last_clean_scrub_stamp":"2024-09-22T08:56:55.323025+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:44:08.081182+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"260'9","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:05.469026+0000","last_change":"2024-09-22T08:57:05.469026+0000","last_active":"2024-09-22T08:57:05.469026+0000","last_peered":"2024-09-22T08:57:05.469026+0000","last_clean":"2024-09-22T08:57:05.469026+0000","last_became_active":"2024-09-22T08:31:11.215024+0000","last_became_peered":"2024-09-22T08:31:11.215024+0000","last_unstale":"2024-09-22T08:57:05.469026+0000","last_undegraded":"2024-09-22T08:57:05.469026+0000","last_fullsized":"2024-09-22T08:57:05.469026+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'9","last_scrub_stamp":"2024-09-22T08:57:05.468931+0000","last_deep_scrub":"260'9","last_deep_scrub_stamp":"2024-09-22T08:57:05.468931+0000","last_clean_scrub_stamp":"2024-09-22T08:57:05.468931+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:49.840728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":17455,"num_write":14,"num_write_kb":5165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"263'52","reported_seq":194,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:57.564120+0000","last_change":"2024-09-22T08:56:57.564120+0000","last_active":"2024-09-22T08:56:57.564120+0000","last_peered":"2024-09-22T08:56:57.564120+0000","last_clean":"2024-09-22T08:56:57.564120+0000","last_became_active":"2024-09-22T08:29:26.070913+0000","last_became_peered":"2024-09-22T08:29:26.070913+0000","last_unstale":"2024-09-22T08:56:57.564120+0000","last_undegraded":"2024-09-22T08:56:57.564120+0000","last_fullsized":"2024-09-22T08:56:57.564120+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'52","last_scrub_stamp":"2024-09-22T08:56:57.564032+0000","last_deep_scrub":"263'52","last_deep_scrub_stamp":"2024-09-22T08:56:57.564032+0000","last_clean_scrub_stamp":"2024-09-22T08:56:57.564032+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:23:29.347552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":289,"num_write":128,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:09.802712+0000","last_change":"2024-09-22T08:57:09.802712+0000","last_active":"2024-09-22T08:57:09.802712+0000","last_peered":"2024-09-22T08:57:09.802712+0000","last_clean":"2024-09-22T08:57:09.802712+0000","last_became_active":"2024-09-22T08:42:17.428589+0000","last_became_peered":"2024-09-22T08:42:17.428589+0000","last_unstale":"2024-09-22T08:57:09.802712+0000","last_undegraded":"2024-09-22T08:57:09.802712+0000","last_fullsized":"2024-09-22T08:57:09.802712+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:09.802620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:09.802620+0000","last_clean_scrub_stamp":"2024-09-22T08:57:09.802620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:51:26.775756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"263'6","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:28.407335+0000","last_change":"2024-09-22T08:31:14.256450+0000","last_active":"2024-09-22T08:55:28.407335+0000","last_peered":"2024-09-22T08:55:28.407335+0000","last_clean":"2024-09-22T08:55:28.407335+0000","last_became_active":"2024-09-22T08:31:14.256133+0000","last_became_peered":"2024-09-22T08:31:14.256133+0000","last_unstale":"2024-09-22T08:55:28.407335+0000","last_undegraded":"2024-09-22T08:55:28.407335+0000","last_fullsized":"2024-09-22T08:55:28.407335+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:35:53.157445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":16,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"263'2","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:55:23.406685+0000","last_change":"2024-09-22T08:31:11.214428+0000","last_active":"2024-09-22T08:55:23.406685+0000","last_peered":"2024-09-22T08:55:23.406685+0000","last_clean":"2024-09-22T08:55:23.406685+0000","last_became_active":"2024-09-22T08:31:11.214152+0000","last_became_peered":"2024-09-22T08:31:11.214152+0000","last_unstale":"2024-09-22T08:55:23.406685+0000","last_undegraded":"2024-09-22T08:55:23.406685+0000","last_fullsized":"2024-09-22T08:55:23.406685+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:10.185283+0000","last_clean_scrub_stamp":"2024-09-22T08:31:10.185283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:24:25.711738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"263'41","reported_seq":164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:56.153768+0000","last_change":"2024-09-22T08:56:56.153706+0000","last_active":"2024-09-22T08:56:56.153768+0000","last_peered":"2024-09-22T08:56:56.153768+0000","last_clean":"2024-09-22T08:56:56.153768+0000","last_became_active":"2024-09-22T08:29:26.072935+0000","last_became_peered":"2024-09-22T08:29:26.072935+0000","last_unstale":"2024-09-22T08:56:56.153768+0000","last_undegraded":"2024-09-22T08:56:56.153768+0000","last_fullsized":"2024-09-22T08:56:56.153768+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'41","last_scrub_stamp":"2024-09-22T08:56:56.153614+0000","last_deep_scrub":"263'41","last_deep_scrub_stamp":"2024-09-22T08:56:56.153614+0000","last_clean_scrub_stamp":"2024-09-22T08:56:56.153614+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:55:19.612927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":341,"num_read_kb":226,"num_write":101,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"263'2","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:06.003619+0000","last_change":"2024-09-22T08:57:06.003560+0000","last_active":"2024-09-22T08:57:06.003619+0000","last_peered":"2024-09-22T08:57:06.003619+0000","last_clean":"2024-09-22T08:57:06.003619+0000","last_became_active":"2024-09-22T08:42:17.429298+0000","last_became_peered":"2024-09-22T08:42:17.429298+0000","last_unstale":"2024-09-22T08:57:06.003619+0000","last_undegraded":"2024-09-22T08:57:06.003619+0000","last_fullsized":"2024-09-22T08:57:06.003619+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:57:06.003480+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:57:06.003480+0000","last_clean_scrub_stamp":"2024-09-22T08:57:06.003480+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:11:37.165876+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"260'7","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:02.139912+0000","last_change":"2024-09-22T08:57:02.139912+0000","last_active":"2024-09-22T08:57:02.139912+0000","last_peered":"2024-09-22T08:57:02.139912+0000","last_clean":"2024-09-22T08:57:02.139912+0000","last_became_active":"2024-09-22T08:31:14.257659+0000","last_became_peered":"2024-09-22T08:31:14.257659+0000","last_unstale":"2024-09-22T08:57:02.139912+0000","last_undegraded":"2024-09-22T08:57:02.139912+0000","last_fullsized":"2024-09-22T08:57:02.139912+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'7","last_scrub_stamp":"2024-09-22T08:57:02.139812+0000","last_deep_scrub":"260'7","last_deep_scrub_stamp":"2024-09-22T08:57:02.139812+0000","last_clean_scrub_stamp":"2024-09-22T08:57:02.139812+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:43:02.418334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4143,"num_write":12,"num_write_kb":1069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"263'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:51.310546+0000","last_change":"2024-09-22T08:56:51.310546+0000","last_active":"2024-09-22T08:56:51.310546+0000","last_peered":"2024-09-22T08:56:51.310546+0000","last_clean":"2024-09-22T08:56:51.310546+0000","last_became_active":"2024-09-22T08:31:11.216248+0000","last_became_peered":"2024-09-22T08:31:11.216248+0000","last_unstale":"2024-09-22T08:56:51.310546+0000","last_undegraded":"2024-09-22T08:56:51.310546+0000","last_fullsized":"2024-09-22T08:56:51.310546+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:56:51.310456+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:56:51.310456+0000","last_clean_scrub_stamp":"2024-09-22T08:56:51.310456+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:52:43.461188+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"263'16","reported_seq":92,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:57.360607+0000","last_change":"2024-09-22T08:56:57.360607+0000","last_active":"2024-09-22T08:56:57.360607+0000","last_peered":"2024-09-22T08:56:57.360607+0000","last_clean":"2024-09-22T08:56:57.360607+0000","last_became_active":"2024-09-22T08:29:26.076243+0000","last_became_peered":"2024-09-22T08:29:26.076243+0000","last_unstale":"2024-09-22T08:56:57.360607+0000","last_undegraded":"2024-09-22T08:56:57.360607+0000","last_fullsized":"2024-09-22T08:56:57.360607+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'16","last_scrub_stamp":"2024-09-22T08:56:57.360508+0000","last_deep_scrub":"263'16","last_deep_scrub_stamp":"2024-09-22T08:56:57.360508+0000","last_clean_scrub_stamp":"2024-09-22T08:56:57.360508+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:24:23.856306+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":86,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:01.270443+0000","last_change":"2024-09-22T08:57:01.270387+0000","last_active":"2024-09-22T08:57:01.270443+0000","last_peered":"2024-09-22T08:57:01.270443+0000","last_clean":"2024-09-22T08:57:01.270443+0000","last_became_active":"2024-09-22T08:42:17.432923+0000","last_became_peered":"2024-09-22T08:42:17.432923+0000","last_unstale":"2024-09-22T08:57:01.270443+0000","last_undegraded":"2024-09-22T08:57:01.270443+0000","last_fullsized":"2024-09-22T08:57:01.270443+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:01.270301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:01.270301+0000","last_clean_scrub_stamp":"2024-09-22T08:57:01.270301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:14.894407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"263'8","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:09.474563+0000","last_change":"2024-09-22T08:57:09.474563+0000","last_active":"2024-09-22T08:57:09.474563+0000","last_peered":"2024-09-22T08:57:09.474563+0000","last_clean":"2024-09-22T08:57:09.474563+0000","last_became_active":"2024-09-22T08:31:14.256055+0000","last_became_peered":"2024-09-22T08:31:14.256055+0000","last_unstale":"2024-09-22T08:57:09.474563+0000","last_undegraded":"2024-09-22T08:57:09.474563+0000","last_fullsized":"2024-09-22T08:57:09.474563+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-22T08:57:09.474462+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-22T08:57:09.474462+0000","last_clean_scrub_stamp":"2024-09-22T08:57:09.474462+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:40:11.556082+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":18434,"num_write":18,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"263'8","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:01.594227+0000","last_change":"2024-09-22T08:57:01.594227+0000","last_active":"2024-09-22T08:57:01.594227+0000","last_peered":"2024-09-22T08:57:01.594227+0000","last_clean":"2024-09-22T08:57:01.594227+0000","last_became_active":"2024-09-22T08:31:11.215609+0000","last_became_peered":"2024-09-22T08:31:11.215609+0000","last_unstale":"2024-09-22T08:57:01.594227+0000","last_undegraded":"2024-09-22T08:57:01.594227+0000","last_fullsized":"2024-09-22T08:57:01.594227+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-22T08:57:01.594139+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-22T08:57:01.594139+0000","last_clean_scrub_stamp":"2024-09-22T08:57:01.594139+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:18:53.133329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":18,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"263'42","reported_seq":163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:55.575459+0000","last_change":"2024-09-22T08:56:55.575459+0000","last_active":"2024-09-22T08:56:55.575459+0000","last_peered":"2024-09-22T08:56:55.575459+0000","last_clean":"2024-09-22T08:56:55.575459+0000","last_became_active":"2024-09-22T08:29:26.066447+0000","last_became_peered":"2024-09-22T08:29:26.066447+0000","last_unstale":"2024-09-22T08:56:55.575459+0000","last_undegraded":"2024-09-22T08:56:55.575459+0000","last_fullsized":"2024-09-22T08:56:55.575459+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'42","last_scrub_stamp":"2024-09-22T08:56:55.575356+0000","last_deep_scrub":"263'42","last_deep_scrub_stamp":"2024-09-22T08:56:55.575356+0000","last_clean_scrub_stamp":"2024-09-22T08:56:55.575356+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:23:36.714020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":325,"num_read_kb":214,"num_write":107,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:19.516368+0000","last_change":"2024-09-22T08:57:19.516368+0000","last_active":"2024-09-22T08:57:19.516368+0000","last_peered":"2024-09-22T08:57:19.516368+0000","last_clean":"2024-09-22T08:57:19.516368+0000","last_became_active":"2024-09-22T08:42:17.435842+0000","last_became_peered":"2024-09-22T08:42:17.435842+0000","last_unstale":"2024-09-22T08:57:19.516368+0000","last_undegraded":"2024-09-22T08:57:19.516368+0000","last_fullsized":"2024-09-22T08:57:19.516368+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:19.516276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:19.516276+0000","last_clean_scrub_stamp":"2024-09-22T08:57:19.516276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:17:07.435469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"263'2","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:08.472253+0000","last_change":"2024-09-22T08:57:08.472253+0000","last_active":"2024-09-22T08:57:08.472253+0000","last_peered":"2024-09-22T08:57:08.472253+0000","last_clean":"2024-09-22T08:57:08.472253+0000","last_became_active":"2024-09-22T08:31:14.255497+0000","last_became_peered":"2024-09-22T08:31:14.255497+0000","last_unstale":"2024-09-22T08:57:08.472253+0000","last_undegraded":"2024-09-22T08:57:08.472253+0000","last_fullsized":"2024-09-22T08:57:08.472253+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:57:08.472162+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:57:08.472162+0000","last_clean_scrub_stamp":"2024-09-22T08:57:08.472162+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:16:39.254367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"263'4","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:20.616166+0000","last_change":"2024-09-22T08:57:20.616166+0000","last_active":"2024-09-22T08:57:20.616166+0000","last_peered":"2024-09-22T08:57:20.616166+0000","last_clean":"2024-09-22T08:57:20.616166+0000","last_became_active":"2024-09-22T08:31:11.216997+0000","last_became_peered":"2024-09-22T08:31:11.216997+0000","last_unstale":"2024-09-22T08:57:20.616166+0000","last_undegraded":"2024-09-22T08:57:20.616166+0000","last_fullsized":"2024-09-22T08:57:20.616166+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-22T08:57:20.616059+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-22T08:57:20.616059+0000","last_clean_scrub_stamp":"2024-09-22T08:57:20.616059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:30:01.338284+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"263'25","reported_seq":119,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:01.949281+0000","last_change":"2024-09-22T08:57:01.949281+0000","last_active":"2024-09-22T08:57:01.949281+0000","last_peered":"2024-09-22T08:57:01.949281+0000","last_clean":"2024-09-22T08:57:01.949281+0000","last_became_active":"2024-09-22T08:29:26.070906+0000","last_became_peered":"2024-09-22T08:29:26.070906+0000","last_unstale":"2024-09-22T08:57:01.949281+0000","last_undegraded":"2024-09-22T08:57:01.949281+0000","last_fullsized":"2024-09-22T08:57:01.949281+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'25","last_scrub_stamp":"2024-09-22T08:57:01.949196+0000","last_deep_scrub":"263'25","last_deep_scrub_stamp":"2024-09-22T08:57:01.949196+0000","last_clean_scrub_stamp":"2024-09-22T08:57:01.949196+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:30.841330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":135,"num_write":63,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"263'2","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:03.657704+0000","last_change":"2024-09-22T08:57:03.657704+0000","last_active":"2024-09-22T08:57:03.657704+0000","last_peered":"2024-09-22T08:57:03.657704+0000","last_clean":"2024-09-22T08:57:03.657704+0000","last_became_active":"2024-09-22T08:42:17.430457+0000","last_became_peered":"2024-09-22T08:42:17.430457+0000","last_unstale":"2024-09-22T08:57:03.657704+0000","last_undegraded":"2024-09-22T08:57:03.657704+0000","last_fullsized":"2024-09-22T08:57:03.657704+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:57:03.657623+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:57:03.657623+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.657623+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:43:31.788007+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"263'9","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:13.435071+0000","last_change":"2024-09-22T08:57:13.435071+0000","last_active":"2024-09-22T08:57:13.435071+0000","last_peered":"2024-09-22T08:57:13.435071+0000","last_clean":"2024-09-22T08:57:13.435071+0000","last_became_active":"2024-09-22T08:31:14.255245+0000","last_became_peered":"2024-09-22T08:31:14.255245+0000","last_unstale":"2024-09-22T08:57:13.435071+0000","last_undegraded":"2024-09-22T08:57:13.435071+0000","last_fullsized":"2024-09-22T08:57:13.435071+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-22T08:57:13.434970+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-22T08:57:13.434970+0000","last_clean_scrub_stamp":"2024-09-22T08:57:13.434970+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:51:51.797154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":20480,"num_write":14,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"260'6","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:49.347000+0000","last_change":"2024-09-22T08:56:49.347000+0000","last_active":"2024-09-22T08:56:49.347000+0000","last_peered":"2024-09-22T08:56:49.347000+0000","last_clean":"2024-09-22T08:56:49.347000+0000","last_became_active":"2024-09-22T08:31:11.211000+0000","last_became_peered":"2024-09-22T08:31:11.211000+0000","last_unstale":"2024-09-22T08:56:49.347000+0000","last_undegraded":"2024-09-22T08:56:49.347000+0000","last_fullsized":"2024-09-22T08:56:49.347000+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-22T08:56:49.346894+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-22T08:56:49.346894+0000","last_clean_scrub_stamp":"2024-09-22T08:56:49.346894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:18:23.984699+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8192,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"263'32","reported_seq":138,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:02.974212+0000","last_change":"2024-09-22T08:57:02.974212+0000","last_active":"2024-09-22T08:57:02.974212+0000","last_peered":"2024-09-22T08:57:02.974212+0000","last_clean":"2024-09-22T08:57:02.974212+0000","last_became_active":"2024-09-22T08:29:26.074151+0000","last_became_peered":"2024-09-22T08:29:26.074151+0000","last_unstale":"2024-09-22T08:57:02.974212+0000","last_undegraded":"2024-09-22T08:57:02.974212+0000","last_fullsized":"2024-09-22T08:57:02.974212+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'32","last_scrub_stamp":"2024-09-22T08:57:02.974126+0000","last_deep_scrub":"263'32","last_deep_scrub_stamp":"2024-09-22T08:57:02.974126+0000","last_clean_scrub_stamp":"2024-09-22T08:57:02.974126+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:53:39.118893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":180,"num_write":78,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:05.033730+0000","last_change":"2024-09-22T08:57:05.033730+0000","last_active":"2024-09-22T08:57:05.033730+0000","last_peered":"2024-09-22T08:57:05.033730+0000","last_clean":"2024-09-22T08:57:05.033730+0000","last_became_active":"2024-09-22T08:42:17.432056+0000","last_became_peered":"2024-09-22T08:42:17.432056+0000","last_unstale":"2024-09-22T08:57:05.033730+0000","last_undegraded":"2024-09-22T08:57:05.033730+0000","last_fullsized":"2024-09-22T08:57:05.033730+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:05.033597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:05.033597+0000","last_clean_scrub_stamp":"2024-09-22T08:57:05.033597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:29:11.519722+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"263'6","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:10.435533+0000","last_change":"2024-09-22T08:57:10.435533+0000","last_active":"2024-09-22T08:57:10.435533+0000","last_peered":"2024-09-22T08:57:10.435533+0000","last_clean":"2024-09-22T08:57:10.435533+0000","last_became_active":"2024-09-22T08:31:14.259009+0000","last_became_peered":"2024-09-22T08:31:14.259009+0000","last_unstale":"2024-09-22T08:57:10.435533+0000","last_undegraded":"2024-09-22T08:57:10.435533+0000","last_fullsized":"2024-09-22T08:57:10.435533+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-22T08:57:10.435437+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-22T08:57:10.435437+0000","last_clean_scrub_stamp":"2024-09-22T08:57:10.435437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:40:19.974861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8192,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"263'5","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:01.354578+0000","last_change":"2024-09-22T08:57:01.354578+0000","last_active":"2024-09-22T08:57:01.354578+0000","last_peered":"2024-09-22T08:57:01.354578+0000","last_clean":"2024-09-22T08:57:01.354578+0000","last_became_active":"2024-09-22T08:31:11.215708+0000","last_became_peered":"2024-09-22T08:31:11.215708+0000","last_unstale":"2024-09-22T08:57:01.354578+0000","last_undegraded":"2024-09-22T08:57:01.354578+0000","last_fullsized":"2024-09-22T08:57:01.354578+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-22T08:57:01.354488+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-22T08:57:01.354488+0000","last_clean_scrub_stamp":"2024-09-22T08:57:01.354488+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:22:05.998897+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"263'26","reported_seq":118,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:55.344605+0000","last_change":"2024-09-22T08:56:55.344605+0000","last_active":"2024-09-22T08:56:55.344605+0000","last_peered":"2024-09-22T08:56:55.344605+0000","last_clean":"2024-09-22T08:56:55.344605+0000","last_became_active":"2024-09-22T08:29:26.069440+0000","last_became_peered":"2024-09-22T08:29:26.069440+0000","last_unstale":"2024-09-22T08:56:55.344605+0000","last_undegraded":"2024-09-22T08:56:55.344605+0000","last_fullsized":"2024-09-22T08:56:55.344605+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'26","last_scrub_stamp":"2024-09-22T08:56:55.344513+0000","last_deep_scrub":"263'26","last_deep_scrub_stamp":"2024-09-22T08:56:55.344513+0000","last_clean_scrub_stamp":"2024-09-22T08:56:55.344513+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:01:29.040638+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":134,"num_write":69,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:58.276124+0000","last_change":"2024-09-22T08:56:58.276124+0000","last_active":"2024-09-22T08:56:58.276124+0000","last_peered":"2024-09-22T08:56:58.276124+0000","last_clean":"2024-09-22T08:56:58.276124+0000","last_became_active":"2024-09-22T08:42:17.435825+0000","last_became_peered":"2024-09-22T08:42:17.435825+0000","last_unstale":"2024-09-22T08:56:58.276124+0000","last_undegraded":"2024-09-22T08:56:58.276124+0000","last_fullsized":"2024-09-22T08:56:58.276124+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:58.276034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:58.276034+0000","last_clean_scrub_stamp":"2024-09-22T08:56:58.276034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:06:06.118719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"260'2","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:54.303367+0000","last_change":"2024-09-22T08:56:54.303367+0000","last_active":"2024-09-22T08:56:54.303367+0000","last_peered":"2024-09-22T08:56:54.303367+0000","last_clean":"2024-09-22T08:56:54.303367+0000","last_became_active":"2024-09-22T08:31:14.256218+0000","last_became_peered":"2024-09-22T08:31:14.256218+0000","last_unstale":"2024-09-22T08:56:54.303367+0000","last_undegraded":"2024-09-22T08:56:54.303367+0000","last_fullsized":"2024-09-22T08:56:54.303367+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-22T08:56:54.303281+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-22T08:56:54.303281+0000","last_clean_scrub_stamp":"2024-09-22T08:56:54.303281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:56:55.883067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:04.468989+0000","last_change":"2024-09-22T08:57:04.468989+0000","last_active":"2024-09-22T08:57:04.468989+0000","last_peered":"2024-09-22T08:57:04.468989+0000","last_clean":"2024-09-22T08:57:04.468989+0000","last_became_active":"2024-09-22T08:31:11.214111+0000","last_became_peered":"2024-09-22T08:31:11.214111+0000","last_unstale":"2024-09-22T08:57:04.468989+0000","last_undegraded":"2024-09-22T08:57:04.468989+0000","last_fullsized":"2024-09-22T08:57:04.468989+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:04.468907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:04.468907+0000","last_clean_scrub_stamp":"2024-09-22T08:57:04.468907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:20:18.475949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"263'20","reported_seq":103,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:15.695045+0000","last_change":"2024-09-22T08:57:15.695045+0000","last_active":"2024-09-22T08:57:15.695045+0000","last_peered":"2024-09-22T08:57:15.695045+0000","last_clean":"2024-09-22T08:57:15.695045+0000","last_became_active":"2024-09-22T08:29:26.069293+0000","last_became_peered":"2024-09-22T08:29:26.069293+0000","last_unstale":"2024-09-22T08:57:15.695045+0000","last_undegraded":"2024-09-22T08:57:15.695045+0000","last_fullsized":"2024-09-22T08:57:15.695045+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'20","last_scrub_stamp":"2024-09-22T08:57:15.694937+0000","last_deep_scrub":"263'20","last_deep_scrub_stamp":"2024-09-22T08:57:15.694937+0000","last_clean_scrub_stamp":"2024-09-22T08:57:15.694937+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:25.407669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":89,"num_write":52,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:20.550129+0000","last_change":"2024-09-22T08:57:20.550129+0000","last_active":"2024-09-22T08:57:20.550129+0000","last_peered":"2024-09-22T08:57:20.550129+0000","last_clean":"2024-09-22T08:57:20.550129+0000","last_became_active":"2024-09-22T08:42:17.429163+0000","last_became_peered":"2024-09-22T08:42:17.429163+0000","last_unstale":"2024-09-22T08:57:20.550129+0000","last_undegraded":"2024-09-22T08:57:20.550129+0000","last_fullsized":"2024-09-22T08:57:20.550129+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:20.550012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:20.550012+0000","last_clean_scrub_stamp":"2024-09-22T08:57:20.550012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:27:52.793372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"263'2","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:11.386860+0000","last_change":"2024-09-22T08:57:11.386860+0000","last_active":"2024-09-22T08:57:11.386860+0000","last_peered":"2024-09-22T08:57:11.386860+0000","last_clean":"2024-09-22T08:57:11.386860+0000","last_became_active":"2024-09-22T08:31:14.259484+0000","last_became_peered":"2024-09-22T08:31:14.259484+0000","last_unstale":"2024-09-22T08:57:11.386860+0000","last_undegraded":"2024-09-22T08:57:11.386860+0000","last_fullsized":"2024-09-22T08:57:11.386860+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:57:11.386761+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:57:11.386761+0000","last_clean_scrub_stamp":"2024-09-22T08:57:11.386761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:13:59.807135+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"263'6","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:53.777115+0000","last_change":"2024-09-22T08:56:53.777115+0000","last_active":"2024-09-22T08:56:53.777115+0000","last_peered":"2024-09-22T08:56:53.777115+0000","last_clean":"2024-09-22T08:56:53.777115+0000","last_became_active":"2024-09-22T08:31:11.203053+0000","last_became_peered":"2024-09-22T08:31:11.203053+0000","last_unstale":"2024-09-22T08:56:53.777115+0000","last_undegraded":"2024-09-22T08:56:53.777115+0000","last_fullsized":"2024-09-22T08:56:53.777115+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-22T08:56:53.777026+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-22T08:56:53.777026+0000","last_clean_scrub_stamp":"2024-09-22T08:56:53.777026+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:41:20.302287+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4146,"num_write":6,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"263'318","reported_seq":993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:14.682116+0000","last_change":"2024-09-22T08:57:14.682116+0000","last_active":"2024-09-22T08:57:14.682116+0000","last_peered":"2024-09-22T08:57:14.682116+0000","last_clean":"2024-09-22T08:57:14.682116+0000","last_became_active":"2024-09-22T08:29:26.070475+0000","last_became_peered":"2024-09-22T08:29:26.070475+0000","last_unstale":"2024-09-22T08:57:14.682116+0000","last_undegraded":"2024-09-22T08:57:14.682116+0000","last_fullsized":"2024-09-22T08:57:14.682116+0000","mapping_epoch":252,"log_start":"263'300","ondisk_log_start":"263'300","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'318","last_scrub_stamp":"2024-09-22T08:57:14.682019+0000","last_deep_scrub":"263'318","last_deep_scrub_stamp":"2024-09-22T08:57:14.682019+0000","last_clean_scrub_stamp":"2024-09-22T08:57:14.682019+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:52:59.670094+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2975,"num_read_kb":3480,"num_write":654,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:05.615289+0000","last_change":"2024-09-22T08:57:05.615289+0000","last_active":"2024-09-22T08:57:05.615289+0000","last_peered":"2024-09-22T08:57:05.615289+0000","last_clean":"2024-09-22T08:57:05.615289+0000","last_became_active":"2024-09-22T08:42:17.431528+0000","last_became_peered":"2024-09-22T08:42:17.431528+0000","last_unstale":"2024-09-22T08:57:05.615289+0000","last_undegraded":"2024-09-22T08:57:05.615289+0000","last_fullsized":"2024-09-22T08:57:05.615289+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:05.615189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:05.615189+0000","last_clean_scrub_stamp":"2024-09-22T08:57:05.615189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:53:07.861528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:10.372944+0000","last_change":"2024-09-22T08:57:10.372944+0000","last_active":"2024-09-22T08:57:10.372944+0000","last_peered":"2024-09-22T08:57:10.372944+0000","last_clean":"2024-09-22T08:57:10.372944+0000","last_became_active":"2024-09-22T08:31:14.256054+0000","last_became_peered":"2024-09-22T08:31:14.256054+0000","last_unstale":"2024-09-22T08:57:10.372944+0000","last_undegraded":"2024-09-22T08:57:10.372944+0000","last_fullsized":"2024-09-22T08:57:10.372944+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:10.372849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:10.372849+0000","last_clean_scrub_stamp":"2024-09-22T08:57:10.372849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:42:32.025189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"263'8","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:03.499422+0000","last_change":"2024-09-22T08:57:03.499422+0000","last_active":"2024-09-22T08:57:03.499422+0000","last_peered":"2024-09-22T08:57:03.499422+0000","last_clean":"2024-09-22T08:57:03.499422+0000","last_became_active":"2024-09-22T08:31:11.212539+0000","last_became_peered":"2024-09-22T08:31:11.212539+0000","last_unstale":"2024-09-22T08:57:03.499422+0000","last_undegraded":"2024-09-22T08:57:03.499422+0000","last_fullsized":"2024-09-22T08:57:03.499422+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-22T08:57:03.499309+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-22T08:57:03.499309+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.499309+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:09:12.613433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":18,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"263'51","reported_seq":184,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:54.324685+0000","last_change":"2024-09-22T08:56:54.324685+0000","last_active":"2024-09-22T08:56:54.324685+0000","last_peered":"2024-09-22T08:56:54.324685+0000","last_clean":"2024-09-22T08:56:54.324685+0000","last_became_active":"2024-09-22T08:29:26.070576+0000","last_became_peered":"2024-09-22T08:29:26.070576+0000","last_unstale":"2024-09-22T08:56:54.324685+0000","last_undegraded":"2024-09-22T08:56:54.324685+0000","last_fullsized":"2024-09-22T08:56:54.324685+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'51","last_scrub_stamp":"2024-09-22T08:56:54.324596+0000","last_deep_scrub":"263'51","last_deep_scrub_stamp":"2024-09-22T08:56:54.324596+0000","last_clean_scrub_stamp":"2024-09-22T08:56:54.324596+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:06:24.019713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":389,"num_read_kb":252,"num_write":129,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"263'2","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:08.835858+0000","last_change":"2024-09-22T08:57:08.835858+0000","last_active":"2024-09-22T08:57:08.835858+0000","last_peered":"2024-09-22T08:57:08.835858+0000","last_clean":"2024-09-22T08:57:08.835858+0000","last_became_active":"2024-09-22T08:42:17.425759+0000","last_became_peered":"2024-09-22T08:42:17.425759+0000","last_unstale":"2024-09-22T08:57:08.835858+0000","last_undegraded":"2024-09-22T08:57:08.835858+0000","last_fullsized":"2024-09-22T08:57:08.835858+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:57:08.835762+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:57:08.835762+0000","last_clean_scrub_stamp":"2024-09-22T08:57:08.835762+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:18:38.343098+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"263'2","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:07.482305+0000","last_change":"2024-09-22T08:57:07.482305+0000","last_active":"2024-09-22T08:57:07.482305+0000","last_peered":"2024-09-22T08:57:07.482305+0000","last_clean":"2024-09-22T08:57:07.482305+0000","last_became_active":"2024-09-22T08:31:14.257900+0000","last_became_peered":"2024-09-22T08:31:14.257900+0000","last_unstale":"2024-09-22T08:57:07.482305+0000","last_undegraded":"2024-09-22T08:57:07.482305+0000","last_fullsized":"2024-09-22T08:57:07.482305+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:57:07.482211+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:57:07.482211+0000","last_clean_scrub_stamp":"2024-09-22T08:57:07.482211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:07:07.987794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":118,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"263'6","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:56.829934+0000","last_change":"2024-09-22T08:56:56.829934+0000","last_active":"2024-09-22T08:56:56.829934+0000","last_peered":"2024-09-22T08:56:56.829934+0000","last_clean":"2024-09-22T08:56:56.829934+0000","last_became_active":"2024-09-22T08:31:11.204846+0000","last_became_peered":"2024-09-22T08:31:11.204846+0000","last_unstale":"2024-09-22T08:56:56.829934+0000","last_undegraded":"2024-09-22T08:56:56.829934+0000","last_fullsized":"2024-09-22T08:56:56.829934+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-22T08:56:56.829835+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-22T08:56:56.829835+0000","last_clean_scrub_stamp":"2024-09-22T08:56:56.829835+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:53:05.522110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":6146,"num_write":6,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"263'48","reported_seq":181,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:54.191877+0000","last_change":"2024-09-22T08:56:54.191877+0000","last_active":"2024-09-22T08:56:54.191877+0000","last_peered":"2024-09-22T08:56:54.191877+0000","last_clean":"2024-09-22T08:56:54.191877+0000","last_became_active":"2024-09-22T08:29:26.063914+0000","last_became_peered":"2024-09-22T08:29:26.063914+0000","last_unstale":"2024-09-22T08:56:54.191877+0000","last_undegraded":"2024-09-22T08:56:54.191877+0000","last_fullsized":"2024-09-22T08:56:54.191877+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'48","last_scrub_stamp":"2024-09-22T08:56:54.191755+0000","last_deep_scrub":"263'48","last_deep_scrub_stamp":"2024-09-22T08:56:54.191755+0000","last_clean_scrub_stamp":"2024-09-22T08:56:54.191755+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:50:24.201000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":381,"num_read_kb":265,"num_write":119,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"263'2","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:04.635558+0000","last_change":"2024-09-22T08:57:04.635558+0000","last_active":"2024-09-22T08:57:04.635558+0000","last_peered":"2024-09-22T08:57:04.635558+0000","last_clean":"2024-09-22T08:57:04.635558+0000","last_became_active":"2024-09-22T08:42:17.429964+0000","last_became_peered":"2024-09-22T08:42:17.429964+0000","last_unstale":"2024-09-22T08:57:04.635558+0000","last_undegraded":"2024-09-22T08:57:04.635558+0000","last_fullsized":"2024-09-22T08:57:04.635558+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:57:04.635465+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:57:04.635465+0000","last_clean_scrub_stamp":"2024-09-22T08:57:04.635465+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:39:04.380128+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"260'4","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:38.400927+0000","last_change":"2024-09-22T08:31:14.260215+0000","last_active":"2024-09-22T08:54:38.400927+0000","last_peered":"2024-09-22T08:54:38.400927+0000","last_clean":"2024-09-22T08:54:38.400927+0000","last_became_active":"2024-09-22T08:31:14.259875+0000","last_became_peered":"2024-09-22T08:31:14.259875+0000","last_unstale":"2024-09-22T08:54:38.400927+0000","last_undegraded":"2024-09-22T08:54:38.400927+0000","last_fullsized":"2024-09-22T08:54:38.400927+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:55.837436+0000","last_change":"2024-09-22T08:56:55.837436+0000","last_active":"2024-09-22T08:56:55.837436+0000","last_peered":"2024-09-22T08:56:55.837436+0000","last_clean":"2024-09-22T08:56:55.837436+0000","last_became_active":"2024-09-22T08:31:11.210054+0000","last_became_peered":"2024-09-22T08:31:11.210054+0000","last_unstale":"2024-09-22T08:56:55.837436+0000","last_undegraded":"2024-09-22T08:56:55.837436+0000","last_fullsized":"2024-09-22T08:56:55.837436+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:55.837344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:55.837344+0000","last_clean_scrub_stamp":"2024-09-22T08:56:55.837344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:33:30.300629+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"263'31","reported_seq":137,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:53.336910+0000","last_change":"2024-09-22T08:56:53.336910+0000","last_active":"2024-09-22T08:56:53.336910+0000","last_peered":"2024-09-22T08:56:53.336910+0000","last_clean":"2024-09-22T08:56:53.336910+0000","last_became_active":"2024-09-22T08:29:26.070492+0000","last_became_peered":"2024-09-22T08:29:26.070492+0000","last_unstale":"2024-09-22T08:56:53.336910+0000","last_undegraded":"2024-09-22T08:56:53.336910+0000","last_fullsized":"2024-09-22T08:56:53.336910+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'31","last_scrub_stamp":"2024-09-22T08:56:53.336820+0000","last_deep_scrub":"263'31","last_deep_scrub_stamp":"2024-09-22T08:56:53.336820+0000","last_clean_scrub_stamp":"2024-09-22T08:56:53.336820+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:57:38.542593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":169,"num_write":83,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:17.421258+0000","last_change":"2024-09-22T08:57:17.421258+0000","last_active":"2024-09-22T08:57:17.421258+0000","last_peered":"2024-09-22T08:57:17.421258+0000","last_clean":"2024-09-22T08:57:17.421258+0000","last_became_active":"2024-09-22T08:42:17.433193+0000","last_became_peered":"2024-09-22T08:42:17.433193+0000","last_unstale":"2024-09-22T08:57:17.421258+0000","last_undegraded":"2024-09-22T08:57:17.421258+0000","last_fullsized":"2024-09-22T08:57:17.421258+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:17.421127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:17.421127+0000","last_clean_scrub_stamp":"2024-09-22T08:57:17.421127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:14:22.468511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:05.465479+0000","last_change":"2024-09-22T08:57:05.465479+0000","last_active":"2024-09-22T08:57:05.465479+0000","last_peered":"2024-09-22T08:57:05.465479+0000","last_clean":"2024-09-22T08:57:05.465479+0000","last_became_active":"2024-09-22T08:31:14.254710+0000","last_became_peered":"2024-09-22T08:31:14.254710+0000","last_unstale":"2024-09-22T08:57:05.465479+0000","last_undegraded":"2024-09-22T08:57:05.465479+0000","last_fullsized":"2024-09-22T08:57:05.465479+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:05.465361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:05.465361+0000","last_clean_scrub_stamp":"2024-09-22T08:57:05.465361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:44:01.943067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:57.145740+0000","last_change":"2024-09-22T08:56:57.145740+0000","last_active":"2024-09-22T08:56:57.145740+0000","last_peered":"2024-09-22T08:56:57.145740+0000","last_clean":"2024-09-22T08:56:57.145740+0000","last_became_active":"2024-09-22T08:31:11.203413+0000","last_became_peered":"2024-09-22T08:31:11.203413+0000","last_unstale":"2024-09-22T08:56:57.145740+0000","last_undegraded":"2024-09-22T08:56:57.145740+0000","last_fullsized":"2024-09-22T08:56:57.145740+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:57.145641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:57.145641+0000","last_clean_scrub_stamp":"2024-09-22T08:56:57.145641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:33:10.096611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:52.322127+0000","last_change":"2024-09-22T08:56:52.322127+0000","last_active":"2024-09-22T08:56:52.322127+0000","last_peered":"2024-09-22T08:56:52.322127+0000","last_clean":"2024-09-22T08:56:52.322127+0000","last_became_active":"2024-09-22T08:29:26.071742+0000","last_became_peered":"2024-09-22T08:29:26.071742+0000","last_unstale":"2024-09-22T08:56:52.322127+0000","last_undegraded":"2024-09-22T08:56:52.322127+0000","last_fullsized":"2024-09-22T08:56:52.322127+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:52.322037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:52.322037+0000","last_clean_scrub_stamp":"2024-09-22T08:56:52.322037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:50:38.510198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:59.819076+0000","last_change":"2024-09-22T08:56:59.819076+0000","last_active":"2024-09-22T08:56:59.819076+0000","last_peered":"2024-09-22T08:56:59.819076+0000","last_clean":"2024-09-22T08:56:59.819076+0000","last_became_active":"2024-09-22T08:42:17.433346+0000","last_became_peered":"2024-09-22T08:42:17.433346+0000","last_unstale":"2024-09-22T08:56:59.819076+0000","last_undegraded":"2024-09-22T08:56:59.819076+0000","last_fullsized":"2024-09-22T08:56:59.819076+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:59.818974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:59.818974+0000","last_clean_scrub_stamp":"2024-09-22T08:56:59.818974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:48:10.703277+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"260'2","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:04.456491+0000","last_change":"2024-09-22T08:57:04.456491+0000","last_active":"2024-09-22T08:57:04.456491+0000","last_peered":"2024-09-22T08:57:04.456491+0000","last_clean":"2024-09-22T08:57:04.456491+0000","last_became_active":"2024-09-22T08:31:14.255243+0000","last_became_peered":"2024-09-22T08:31:14.255243+0000","last_unstale":"2024-09-22T08:57:04.456491+0000","last_undegraded":"2024-09-22T08:57:04.456491+0000","last_fullsized":"2024-09-22T08:57:04.456491+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-22T08:57:04.456386+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-22T08:57:04.456386+0000","last_clean_scrub_stamp":"2024-09-22T08:57:04.456386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:45:35.022993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"263'6","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:00.630131+0000","last_change":"2024-09-22T08:57:00.630131+0000","last_active":"2024-09-22T08:57:00.630131+0000","last_peered":"2024-09-22T08:57:00.630131+0000","last_clean":"2024-09-22T08:57:00.630131+0000","last_became_active":"2024-09-22T08:31:11.210266+0000","last_became_peered":"2024-09-22T08:31:11.210266+0000","last_unstale":"2024-09-22T08:57:00.630131+0000","last_undegraded":"2024-09-22T08:57:00.630131+0000","last_fullsized":"2024-09-22T08:57:00.630131+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-22T08:57:00.630042+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-22T08:57:00.630042+0000","last_clean_scrub_stamp":"2024-09-22T08:57:00.630042+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:33:15.019806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":13312,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"263'39","reported_seq":157,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:13.642786+0000","last_change":"2024-09-22T08:57:13.642786+0000","last_active":"2024-09-22T08:57:13.642786+0000","last_peered":"2024-09-22T08:57:13.642786+0000","last_clean":"2024-09-22T08:57:13.642786+0000","last_became_active":"2024-09-22T08:29:26.076175+0000","last_became_peered":"2024-09-22T08:29:26.076175+0000","last_unstale":"2024-09-22T08:57:13.642786+0000","last_undegraded":"2024-09-22T08:57:13.642786+0000","last_fullsized":"2024-09-22T08:57:13.642786+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'39","last_scrub_stamp":"2024-09-22T08:57:13.642694+0000","last_deep_scrub":"263'39","last_deep_scrub_stamp":"2024-09-22T08:57:13.642694+0000","last_clean_scrub_stamp":"2024-09-22T08:57:13.642694+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:01.748304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":317,"num_read_kb":219,"num_write":102,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:53:08.390223+0000","last_change":"2024-09-22T08:42:17.435167+0000","last_active":"2024-09-22T08:53:08.390223+0000","last_peered":"2024-09-22T08:53:08.390223+0000","last_clean":"2024-09-22T08:53:08.390223+0000","last_became_active":"2024-09-22T08:42:17.434909+0000","last_became_peered":"2024-09-22T08:42:17.434909+0000","last_unstale":"2024-09-22T08:53:08.390223+0000","last_undegraded":"2024-09-22T08:53:08.390223+0000","last_fullsized":"2024-09-22T08:53:08.390223+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:22.417079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"263'4","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:06.485825+0000","last_change":"2024-09-22T08:57:06.485825+0000","last_active":"2024-09-22T08:57:06.485825+0000","last_peered":"2024-09-22T08:57:06.485825+0000","last_clean":"2024-09-22T08:57:06.485825+0000","last_became_active":"2024-09-22T08:31:14.252184+0000","last_became_peered":"2024-09-22T08:31:14.252184+0000","last_unstale":"2024-09-22T08:57:06.485825+0000","last_undegraded":"2024-09-22T08:57:06.485825+0000","last_fullsized":"2024-09-22T08:57:06.485825+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-22T08:57:06.485718+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-22T08:57:06.485718+0000","last_clean_scrub_stamp":"2024-09-22T08:57:06.485718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:26:53.429257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":4,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"263'2","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:59.322125+0000","last_change":"2024-09-22T08:56:59.322125+0000","last_active":"2024-09-22T08:56:59.322125+0000","last_peered":"2024-09-22T08:56:59.322125+0000","last_clean":"2024-09-22T08:56:59.322125+0000","last_became_active":"2024-09-22T08:31:11.217115+0000","last_became_peered":"2024-09-22T08:31:11.217115+0000","last_unstale":"2024-09-22T08:56:59.322125+0000","last_undegraded":"2024-09-22T08:56:59.322125+0000","last_fullsized":"2024-09-22T08:56:59.322125+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:56:59.322031+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:56:59.322031+0000","last_clean_scrub_stamp":"2024-09-22T08:56:59.322031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:45:40.706530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"263'57","reported_seq":201,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:51.745977+0000","last_change":"2024-09-22T08:56:51.745977+0000","last_active":"2024-09-22T08:56:51.745977+0000","last_peered":"2024-09-22T08:56:51.745977+0000","last_clean":"2024-09-22T08:56:51.745977+0000","last_became_active":"2024-09-22T08:29:26.076048+0000","last_became_peered":"2024-09-22T08:29:26.076048+0000","last_unstale":"2024-09-22T08:56:51.745977+0000","last_undegraded":"2024-09-22T08:56:51.745977+0000","last_fullsized":"2024-09-22T08:56:51.745977+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'57","last_scrub_stamp":"2024-09-22T08:56:51.745876+0000","last_deep_scrub":"263'57","last_deep_scrub_stamp":"2024-09-22T08:56:51.745876+0000","last_clean_scrub_stamp":"2024-09-22T08:56:51.745876+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:20:20.278906+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":427,"num_read_kb":265,"num_write":151,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:57.786599+0000","last_change":"2024-09-22T08:56:57.786599+0000","last_active":"2024-09-22T08:56:57.786599+0000","last_peered":"2024-09-22T08:56:57.786599+0000","last_clean":"2024-09-22T08:56:57.786599+0000","last_became_active":"2024-09-22T08:42:17.430974+0000","last_became_peered":"2024-09-22T08:42:17.430974+0000","last_unstale":"2024-09-22T08:56:57.786599+0000","last_undegraded":"2024-09-22T08:56:57.786599+0000","last_fullsized":"2024-09-22T08:56:57.786599+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:57.786504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:57.786504+0000","last_clean_scrub_stamp":"2024-09-22T08:56:57.786504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:22.256524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"260'3","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:09.399381+0000","last_change":"2024-09-22T08:57:09.399381+0000","last_active":"2024-09-22T08:57:09.399381+0000","last_peered":"2024-09-22T08:57:09.399381+0000","last_clean":"2024-09-22T08:57:09.399381+0000","last_became_active":"2024-09-22T08:31:14.257952+0000","last_became_peered":"2024-09-22T08:31:14.257952+0000","last_unstale":"2024-09-22T08:57:09.399381+0000","last_undegraded":"2024-09-22T08:57:09.399381+0000","last_fullsized":"2024-09-22T08:57:09.399381+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-22T08:57:09.399284+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-22T08:57:09.399284+0000","last_clean_scrub_stamp":"2024-09-22T08:57:09.399284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:38:52.021390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:00.354699+0000","last_change":"2024-09-22T08:57:00.354699+0000","last_active":"2024-09-22T08:57:00.354699+0000","last_peered":"2024-09-22T08:57:00.354699+0000","last_clean":"2024-09-22T08:57:00.354699+0000","last_became_active":"2024-09-22T08:31:11.213273+0000","last_became_peered":"2024-09-22T08:31:11.213273+0000","last_unstale":"2024-09-22T08:57:00.354699+0000","last_undegraded":"2024-09-22T08:57:00.354699+0000","last_fullsized":"2024-09-22T08:57:00.354699+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:00.354599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:00.354599+0000","last_clean_scrub_stamp":"2024-09-22T08:57:00.354599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:47:58.169764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"263'16","reported_seq":92,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:54.621356+0000","last_change":"2024-09-22T08:56:54.621356+0000","last_active":"2024-09-22T08:56:54.621356+0000","last_peered":"2024-09-22T08:56:54.621356+0000","last_clean":"2024-09-22T08:56:54.621356+0000","last_became_active":"2024-09-22T08:29:26.074205+0000","last_became_peered":"2024-09-22T08:29:26.074205+0000","last_unstale":"2024-09-22T08:56:54.621356+0000","last_undegraded":"2024-09-22T08:56:54.621356+0000","last_fullsized":"2024-09-22T08:56:54.621356+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'16","last_scrub_stamp":"2024-09-22T08:56:54.621263+0000","last_deep_scrub":"263'16","last_deep_scrub_stamp":"2024-09-22T08:56:54.621263+0000","last_clean_scrub_stamp":"2024-09-22T08:56:54.621263+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:57.139031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":71,"num_write":43,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:18.465765+0000","last_change":"2024-09-22T08:57:18.465765+0000","last_active":"2024-09-22T08:57:18.465765+0000","last_peered":"2024-09-22T08:57:18.465765+0000","last_clean":"2024-09-22T08:57:18.465765+0000","last_became_active":"2024-09-22T08:42:17.429927+0000","last_became_peered":"2024-09-22T08:42:17.429927+0000","last_unstale":"2024-09-22T08:57:18.465765+0000","last_undegraded":"2024-09-22T08:57:18.465765+0000","last_fullsized":"2024-09-22T08:57:18.465765+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:18.465670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:18.465670+0000","last_clean_scrub_stamp":"2024-09-22T08:57:18.465670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:41:22.824981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"263'6","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:16.364592+0000","last_change":"2024-09-22T08:31:14.253906+0000","last_active":"2024-09-22T08:56:16.364592+0000","last_peered":"2024-09-22T08:56:16.364592+0000","last_clean":"2024-09-22T08:56:16.364592+0000","last_became_active":"2024-09-22T08:31:14.253610+0000","last_became_peered":"2024-09-22T08:31:14.253610+0000","last_unstale":"2024-09-22T08:56:16.364592+0000","last_undegraded":"2024-09-22T08:56:16.364592+0000","last_fullsized":"2024-09-22T08:56:16.364592+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:31:13.222595+0000","last_clean_scrub_stamp":"2024-09-22T08:31:13.222595+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13314,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"263'4","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:56.374144+0000","last_change":"2024-09-22T08:56:56.374086+0000","last_active":"2024-09-22T08:56:56.374144+0000","last_peered":"2024-09-22T08:56:56.374144+0000","last_clean":"2024-09-22T08:56:56.374144+0000","last_became_active":"2024-09-22T08:31:11.217553+0000","last_became_peered":"2024-09-22T08:31:11.217553+0000","last_unstale":"2024-09-22T08:56:56.374144+0000","last_undegraded":"2024-09-22T08:56:56.374144+0000","last_fullsized":"2024-09-22T08:56:56.374144+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-22T08:56:56.373995+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-22T08:56:56.373995+0000","last_clean_scrub_stamp":"2024-09-22T08:56:56.373995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:14:14.629754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"263'36","reported_seq":143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:53.575640+0000","last_change":"2024-09-22T08:56:53.575640+0000","last_active":"2024-09-22T08:56:53.575640+0000","last_peered":"2024-09-22T08:56:53.575640+0000","last_clean":"2024-09-22T08:56:53.575640+0000","last_became_active":"2024-09-22T08:29:26.070671+0000","last_became_peered":"2024-09-22T08:29:26.070671+0000","last_unstale":"2024-09-22T08:56:53.575640+0000","last_undegraded":"2024-09-22T08:56:53.575640+0000","last_fullsized":"2024-09-22T08:56:53.575640+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'36","last_scrub_stamp":"2024-09-22T08:56:53.575555+0000","last_deep_scrub":"263'36","last_deep_scrub_stamp":"2024-09-22T08:56:53.575555+0000","last_clean_scrub_stamp":"2024-09-22T08:56:53.575555+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:45:32.893922+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":255,"num_read_kb":155,"num_write":90,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:04.080658+0000","last_change":"2024-09-22T08:57:04.080658+0000","last_active":"2024-09-22T08:57:04.080658+0000","last_peered":"2024-09-22T08:57:04.080658+0000","last_clean":"2024-09-22T08:57:04.080658+0000","last_became_active":"2024-09-22T08:42:17.433331+0000","last_became_peered":"2024-09-22T08:42:17.433331+0000","last_unstale":"2024-09-22T08:57:04.080658+0000","last_undegraded":"2024-09-22T08:57:04.080658+0000","last_fullsized":"2024-09-22T08:57:04.080658+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:04.080551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:04.080551+0000","last_clean_scrub_stamp":"2024-09-22T08:57:04.080551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:32:25.556797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"263'4","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:01.134878+0000","last_change":"2024-09-22T08:57:01.134811+0000","last_active":"2024-09-22T08:57:01.134878+0000","last_peered":"2024-09-22T08:57:01.134878+0000","last_clean":"2024-09-22T08:57:01.134878+0000","last_became_active":"2024-09-22T08:31:14.253118+0000","last_became_peered":"2024-09-22T08:31:14.253118+0000","last_unstale":"2024-09-22T08:57:01.134878+0000","last_undegraded":"2024-09-22T08:57:01.134878+0000","last_fullsized":"2024-09-22T08:57:01.134878+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-22T08:57:01.134699+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-22T08:57:01.134699+0000","last_clean_scrub_stamp":"2024-09-22T08:57:01.134699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:53:52.098956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"263'9","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:02.518745+0000","last_change":"2024-09-22T08:57:02.518684+0000","last_active":"2024-09-22T08:57:02.518745+0000","last_peered":"2024-09-22T08:57:02.518745+0000","last_clean":"2024-09-22T08:57:02.518745+0000","last_became_active":"2024-09-22T08:31:11.211939+0000","last_became_peered":"2024-09-22T08:31:11.211939+0000","last_unstale":"2024-09-22T08:57:02.518745+0000","last_undegraded":"2024-09-22T08:57:02.518745+0000","last_fullsized":"2024-09-22T08:57:02.518745+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-22T08:57:02.518579+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-22T08:57:02.518579+0000","last_clean_scrub_stamp":"2024-09-22T08:57:02.518579+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:55:33.787552+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":24578,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"263'43","reported_seq":163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:53.199125+0000","last_change":"2024-09-22T08:56:53.199125+0000","last_active":"2024-09-22T08:56:53.199125+0000","last_peered":"2024-09-22T08:56:53.199125+0000","last_clean":"2024-09-22T08:56:53.199125+0000","last_became_active":"2024-09-22T08:29:26.069202+0000","last_became_peered":"2024-09-22T08:29:26.069202+0000","last_unstale":"2024-09-22T08:56:53.199125+0000","last_undegraded":"2024-09-22T08:56:53.199125+0000","last_fullsized":"2024-09-22T08:56:53.199125+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'43","last_scrub_stamp":"2024-09-22T08:56:53.199033+0000","last_deep_scrub":"263'43","last_deep_scrub_stamp":"2024-09-22T08:56:53.199033+0000","last_clean_scrub_stamp":"2024-09-22T08:56:53.199033+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:07:35.698271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":316,"num_read_kb":207,"num_write":121,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"263'2","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:57.326140+0000","last_change":"2024-09-22T08:56:57.326140+0000","last_active":"2024-09-22T08:56:57.326140+0000","last_peered":"2024-09-22T08:56:57.326140+0000","last_clean":"2024-09-22T08:56:57.326140+0000","last_became_active":"2024-09-22T08:42:17.436036+0000","last_became_peered":"2024-09-22T08:42:17.436036+0000","last_unstale":"2024-09-22T08:56:57.326140+0000","last_undegraded":"2024-09-22T08:56:57.326140+0000","last_fullsized":"2024-09-22T08:56:57.326140+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:56:57.326045+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:56:57.326045+0000","last_clean_scrub_stamp":"2024-09-22T08:56:57.326045+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:40:52.083802+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"260'6","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:02.631822+0000","last_change":"2024-09-22T08:57:02.631822+0000","last_active":"2024-09-22T08:57:02.631822+0000","last_peered":"2024-09-22T08:57:02.631822+0000","last_clean":"2024-09-22T08:57:02.631822+0000","last_became_active":"2024-09-22T08:31:14.260111+0000","last_became_peered":"2024-09-22T08:31:14.260111+0000","last_unstale":"2024-09-22T08:57:02.631822+0000","last_undegraded":"2024-09-22T08:57:02.631822+0000","last_fullsized":"2024-09-22T08:57:02.631822+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-22T08:57:02.631731+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-22T08:57:02.631731+0000","last_clean_scrub_stamp":"2024-09-22T08:57:02.631731+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:07:42.980728+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"263'5","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:58.340876+0000","last_change":"2024-09-22T08:56:58.340811+0000","last_active":"2024-09-22T08:56:58.340876+0000","last_peered":"2024-09-22T08:56:58.340876+0000","last_clean":"2024-09-22T08:56:58.340876+0000","last_became_active":"2024-09-22T08:31:11.213121+0000","last_became_peered":"2024-09-22T08:31:11.213121+0000","last_unstale":"2024-09-22T08:56:58.340876+0000","last_undegraded":"2024-09-22T08:56:58.340876+0000","last_fullsized":"2024-09-22T08:56:58.340876+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-22T08:56:58.340717+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-22T08:56:58.340717+0000","last_clean_scrub_stamp":"2024-09-22T08:56:58.340717+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:54:56.570156+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"263'24","reported_seq":114,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:01.478185+0000","last_change":"2024-09-22T08:57:01.478185+0000","last_active":"2024-09-22T08:57:01.478185+0000","last_peered":"2024-09-22T08:57:01.478185+0000","last_clean":"2024-09-22T08:57:01.478185+0000","last_became_active":"2024-09-22T08:29:26.068397+0000","last_became_peered":"2024-09-22T08:29:26.068397+0000","last_unstale":"2024-09-22T08:57:01.478185+0000","last_undegraded":"2024-09-22T08:57:01.478185+0000","last_fullsized":"2024-09-22T08:57:01.478185+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'24","last_scrub_stamp":"2024-09-22T08:57:01.478102+0000","last_deep_scrub":"263'24","last_deep_scrub_stamp":"2024-09-22T08:57:01.478102+0000","last_clean_scrub_stamp":"2024-09-22T08:57:01.478102+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:43:15.925512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":108,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:12.381769+0000","last_change":"2024-09-22T08:57:12.381769+0000","last_active":"2024-09-22T08:57:12.381769+0000","last_peered":"2024-09-22T08:57:12.381769+0000","last_clean":"2024-09-22T08:57:12.381769+0000","last_became_active":"2024-09-22T08:42:17.431476+0000","last_became_peered":"2024-09-22T08:42:17.431476+0000","last_unstale":"2024-09-22T08:57:12.381769+0000","last_undegraded":"2024-09-22T08:57:12.381769+0000","last_fullsized":"2024-09-22T08:57:12.381769+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:12.381678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:12.381678+0000","last_clean_scrub_stamp":"2024-09-22T08:57:12.381678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:43:18.220962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"263'2","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:53.336621+0000","last_change":"2024-09-22T08:56:53.336561+0000","last_active":"2024-09-22T08:56:53.336621+0000","last_peered":"2024-09-22T08:56:53.336621+0000","last_clean":"2024-09-22T08:56:53.336621+0000","last_became_active":"2024-09-22T08:31:14.257508+0000","last_became_peered":"2024-09-22T08:31:14.257508+0000","last_unstale":"2024-09-22T08:56:53.336621+0000","last_undegraded":"2024-09-22T08:56:53.336621+0000","last_fullsized":"2024-09-22T08:56:53.336621+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:56:53.336464+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:56:53.336464+0000","last_clean_scrub_stamp":"2024-09-22T08:56:53.336464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:16.822824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:19.588020+0000","last_change":"2024-09-22T08:57:19.588020+0000","last_active":"2024-09-22T08:57:19.588020+0000","last_peered":"2024-09-22T08:57:19.588020+0000","last_clean":"2024-09-22T08:57:19.588020+0000","last_became_active":"2024-09-22T08:31:11.214953+0000","last_became_peered":"2024-09-22T08:31:11.214953+0000","last_unstale":"2024-09-22T08:57:19.588020+0000","last_undegraded":"2024-09-22T08:57:19.588020+0000","last_fullsized":"2024-09-22T08:57:19.588020+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:19.587925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:19.587925+0000","last_clean_scrub_stamp":"2024-09-22T08:57:19.587925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:04:36.492621+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"263'16","reported_seq":96,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:50.335050+0000","last_change":"2024-09-22T08:56:50.335050+0000","last_active":"2024-09-22T08:56:50.335050+0000","last_peered":"2024-09-22T08:56:50.335050+0000","last_clean":"2024-09-22T08:56:50.335050+0000","last_became_active":"2024-09-22T08:29:26.072473+0000","last_became_peered":"2024-09-22T08:29:26.072473+0000","last_unstale":"2024-09-22T08:56:50.335050+0000","last_undegraded":"2024-09-22T08:56:50.335050+0000","last_fullsized":"2024-09-22T08:56:50.335050+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'16","last_scrub_stamp":"2024-09-22T08:56:50.334964+0000","last_deep_scrub":"263'16","last_deep_scrub_stamp":"2024-09-22T08:56:50.334964+0000","last_clean_scrub_stamp":"2024-09-22T08:56:50.334964+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:21:18.083176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":83,"num_write":41,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:56.327182+0000","last_change":"2024-09-22T08:56:56.327182+0000","last_active":"2024-09-22T08:56:56.327182+0000","last_peered":"2024-09-22T08:56:56.327182+0000","last_clean":"2024-09-22T08:56:56.327182+0000","last_became_active":"2024-09-22T08:42:17.431637+0000","last_became_peered":"2024-09-22T08:42:17.431637+0000","last_unstale":"2024-09-22T08:56:56.327182+0000","last_undegraded":"2024-09-22T08:56:56.327182+0000","last_fullsized":"2024-09-22T08:56:56.327182+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:56.327086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:56.327086+0000","last_clean_scrub_stamp":"2024-09-22T08:56:56.327086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:42:07.844288+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"263'4","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:08.443053+0000","last_change":"2024-09-22T08:57:08.443053+0000","last_active":"2024-09-22T08:57:08.443053+0000","last_peered":"2024-09-22T08:57:08.443053+0000","last_clean":"2024-09-22T08:57:08.443053+0000","last_became_active":"2024-09-22T08:31:14.261352+0000","last_became_peered":"2024-09-22T08:31:14.261352+0000","last_unstale":"2024-09-22T08:57:08.443053+0000","last_undegraded":"2024-09-22T08:57:08.443053+0000","last_fullsized":"2024-09-22T08:57:08.443053+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-22T08:57:08.442935+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-22T08:57:08.442935+0000","last_clean_scrub_stamp":"2024-09-22T08:57:08.442935+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:47:50.418843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"263'6","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:17.643351+0000","last_change":"2024-09-22T08:57:17.643351+0000","last_active":"2024-09-22T08:57:17.643351+0000","last_peered":"2024-09-22T08:57:17.643351+0000","last_clean":"2024-09-22T08:57:17.643351+0000","last_became_active":"2024-09-22T08:31:11.216081+0000","last_became_peered":"2024-09-22T08:31:11.216081+0000","last_unstale":"2024-09-22T08:57:17.643351+0000","last_undegraded":"2024-09-22T08:57:17.643351+0000","last_fullsized":"2024-09-22T08:57:17.643351+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-22T08:57:17.643268+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-22T08:57:17.643268+0000","last_clean_scrub_stamp":"2024-09-22T08:57:17.643268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:09:27.959072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":6,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"253'4","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:59.869302+0000","last_change":"2024-09-22T08:56:59.869302+0000","last_active":"2024-09-22T08:56:59.869302+0000","last_peered":"2024-09-22T08:56:59.869302+0000","last_clean":"2024-09-22T08:56:59.869302+0000","last_became_active":"2024-09-22T08:29:26.072681+0000","last_became_peered":"2024-09-22T08:29:26.072681+0000","last_unstale":"2024-09-22T08:56:59.869302+0000","last_undegraded":"2024-09-22T08:56:59.869302+0000","last_fullsized":"2024-09-22T08:56:59.869302+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"253'4","last_scrub_stamp":"2024-09-22T08:56:59.869208+0000","last_deep_scrub":"253'4","last_deep_scrub_stamp":"2024-09-22T08:56:59.869208+0000","last_clean_scrub_stamp":"2024-09-22T08:56:59.869208+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:47:15.670371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:00.277533+0000","last_change":"2024-09-22T08:57:00.277533+0000","last_active":"2024-09-22T08:57:00.277533+0000","last_peered":"2024-09-22T08:57:00.277533+0000","last_clean":"2024-09-22T08:57:00.277533+0000","last_became_active":"2024-09-22T08:42:17.430084+0000","last_became_peered":"2024-09-22T08:42:17.430084+0000","last_unstale":"2024-09-22T08:57:00.277533+0000","last_undegraded":"2024-09-22T08:57:00.277533+0000","last_fullsized":"2024-09-22T08:57:00.277533+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:00.277439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:00.277439+0000","last_clean_scrub_stamp":"2024-09-22T08:57:00.277439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:21:36.717278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"260'2","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:07.472734+0000","last_change":"2024-09-22T08:57:07.472734+0000","last_active":"2024-09-22T08:57:07.472734+0000","last_peered":"2024-09-22T08:57:07.472734+0000","last_clean":"2024-09-22T08:57:07.472734+0000","last_became_active":"2024-09-22T08:31:14.259624+0000","last_became_peered":"2024-09-22T08:31:14.259624+0000","last_unstale":"2024-09-22T08:57:07.472734+0000","last_undegraded":"2024-09-22T08:57:07.472734+0000","last_fullsized":"2024-09-22T08:57:07.472734+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-22T08:57:07.472626+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-22T08:57:07.472626+0000","last_clean_scrub_stamp":"2024-09-22T08:57:07.472626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:21:35.883154+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"263'5","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:05.877024+0000","last_change":"2024-09-22T08:57:05.877024+0000","last_active":"2024-09-22T08:57:05.877024+0000","last_peered":"2024-09-22T08:57:05.877024+0000","last_clean":"2024-09-22T08:57:05.877024+0000","last_became_active":"2024-09-22T08:31:11.214279+0000","last_became_peered":"2024-09-22T08:31:11.214279+0000","last_unstale":"2024-09-22T08:57:05.877024+0000","last_undegraded":"2024-09-22T08:57:05.877024+0000","last_fullsized":"2024-09-22T08:57:05.877024+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-22T08:57:05.876938+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-22T08:57:05.876938+0000","last_clean_scrub_stamp":"2024-09-22T08:57:05.876938+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:40:53.992557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"263'2","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:12.675201+0000","last_change":"2024-09-22T08:57:12.675201+0000","last_active":"2024-09-22T08:57:12.675201+0000","last_peered":"2024-09-22T08:57:12.675201+0000","last_clean":"2024-09-22T08:57:12.675201+0000","last_became_active":"2024-09-22T08:29:26.074971+0000","last_became_peered":"2024-09-22T08:29:26.074971+0000","last_unstale":"2024-09-22T08:57:12.675201+0000","last_undegraded":"2024-09-22T08:57:12.675201+0000","last_fullsized":"2024-09-22T08:57:12.675201+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:57:12.675110+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:57:12.675110+0000","last_clean_scrub_stamp":"2024-09-22T08:57:12.675110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:10:02.467119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:14.394509+0000","last_change":"2024-09-22T08:57:14.394509+0000","last_active":"2024-09-22T08:57:14.394509+0000","last_peered":"2024-09-22T08:57:14.394509+0000","last_clean":"2024-09-22T08:57:14.394509+0000","last_became_active":"2024-09-22T08:42:17.433090+0000","last_became_peered":"2024-09-22T08:42:17.433090+0000","last_unstale":"2024-09-22T08:57:14.394509+0000","last_undegraded":"2024-09-22T08:57:14.394509+0000","last_fullsized":"2024-09-22T08:57:14.394509+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:14.394393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:14.394393+0000","last_clean_scrub_stamp":"2024-09-22T08:57:14.394393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:09:59.955451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"260'2","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:52.358045+0000","last_change":"2024-09-22T08:56:52.357978+0000","last_active":"2024-09-22T08:56:52.358045+0000","last_peered":"2024-09-22T08:56:52.358045+0000","last_clean":"2024-09-22T08:56:52.358045+0000","last_became_active":"2024-09-22T08:31:14.256835+0000","last_became_peered":"2024-09-22T08:31:14.256835+0000","last_unstale":"2024-09-22T08:56:52.358045+0000","last_undegraded":"2024-09-22T08:56:52.358045+0000","last_fullsized":"2024-09-22T08:56:52.358045+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-22T08:56:52.357881+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-22T08:56:52.357881+0000","last_clean_scrub_stamp":"2024-09-22T08:56:52.357881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:07:30.389570+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"263'5","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:00.175600+0000","last_change":"2024-09-22T08:57:00.175527+0000","last_active":"2024-09-22T08:57:00.175600+0000","last_peered":"2024-09-22T08:57:00.175600+0000","last_clean":"2024-09-22T08:57:00.175600+0000","last_became_active":"2024-09-22T08:31:11.212487+0000","last_became_peered":"2024-09-22T08:31:11.212487+0000","last_unstale":"2024-09-22T08:57:00.175600+0000","last_undegraded":"2024-09-22T08:57:00.175600+0000","last_fullsized":"2024-09-22T08:57:00.175600+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-22T08:57:00.175434+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-22T08:57:00.175434+0000","last_clean_scrub_stamp":"2024-09-22T08:57:00.175434+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:20:34.588796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"263'131","reported_seq":440,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:52.231836+0000","last_change":"2024-09-22T08:56:52.231836+0000","last_active":"2024-09-22T08:56:52.231836+0000","last_peered":"2024-09-22T08:56:52.231836+0000","last_clean":"2024-09-22T08:56:52.231836+0000","last_became_active":"2024-09-22T08:29:26.067149+0000","last_became_peered":"2024-09-22T08:29:26.067149+0000","last_unstale":"2024-09-22T08:56:52.231836+0000","last_undegraded":"2024-09-22T08:56:52.231836+0000","last_fullsized":"2024-09-22T08:56:52.231836+0000","mapping_epoch":252,"log_start":"260'100","ondisk_log_start":"260'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'131","last_scrub_stamp":"2024-09-22T08:56:52.231731+0000","last_deep_scrub":"263'131","last_deep_scrub_stamp":"2024-09-22T08:56:52.231731+0000","last_clean_scrub_stamp":"2024-09-22T08:56:52.231731+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:22:59.688170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1238,"num_read_kb":970,"num_write":283,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:48.402193+0000","last_change":"2024-09-22T08:42:17.435234+0000","last_active":"2024-09-22T08:54:48.402193+0000","last_peered":"2024-09-22T08:54:48.402193+0000","last_clean":"2024-09-22T08:54:48.402193+0000","last_became_active":"2024-09-22T08:42:17.434424+0000","last_became_peered":"2024-09-22T08:42:17.434424+0000","last_unstale":"2024-09-22T08:54:48.402193+0000","last_undegraded":"2024-09-22T08:54:48.402193+0000","last_fullsized":"2024-09-22T08:54:48.402193+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"260'9","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:22.580345+0000","last_change":"2024-09-22T08:57:22.580345+0000","last_active":"2024-09-22T08:57:22.580345+0000","last_peered":"2024-09-22T08:57:22.580345+0000","last_clean":"2024-09-22T08:57:22.580345+0000","last_became_active":"2024-09-22T08:31:14.255160+0000","last_became_peered":"2024-09-22T08:31:14.255160+0000","last_unstale":"2024-09-22T08:57:22.580345+0000","last_undegraded":"2024-09-22T08:57:22.580345+0000","last_fullsized":"2024-09-22T08:57:22.580345+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'9","last_scrub_stamp":"2024-09-22T08:57:22.580248+0000","last_deep_scrub":"260'9","last_deep_scrub_stamp":"2024-09-22T08:57:22.580248+0000","last_clean_scrub_stamp":"2024-09-22T08:57:22.580248+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:47:07.425920+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":23554,"num_write":14,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:18.603287+0000","last_change":"2024-09-22T08:57:18.603287+0000","last_active":"2024-09-22T08:57:18.603287+0000","last_peered":"2024-09-22T08:57:18.603287+0000","last_clean":"2024-09-22T08:57:18.603287+0000","last_became_active":"2024-09-22T08:31:11.216271+0000","last_became_peered":"2024-09-22T08:31:11.216271+0000","last_unstale":"2024-09-22T08:57:18.603287+0000","last_undegraded":"2024-09-22T08:57:18.603287+0000","last_fullsized":"2024-09-22T08:57:18.603287+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:18.603183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:18.603183+0000","last_clean_scrub_stamp":"2024-09-22T08:57:18.603183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:13:16.049401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"263'19","reported_seq":106,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:51.321427+0000","last_change":"2024-09-22T08:56:51.321427+0000","last_active":"2024-09-22T08:56:51.321427+0000","last_peered":"2024-09-22T08:56:51.321427+0000","last_clean":"2024-09-22T08:56:51.321427+0000","last_became_active":"2024-09-22T08:29:26.069730+0000","last_became_peered":"2024-09-22T08:29:26.069730+0000","last_unstale":"2024-09-22T08:56:51.321427+0000","last_undegraded":"2024-09-22T08:56:51.321427+0000","last_fullsized":"2024-09-22T08:56:51.321427+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'19","last_scrub_stamp":"2024-09-22T08:56:51.321334+0000","last_deep_scrub":"263'19","last_deep_scrub_stamp":"2024-09-22T08:56:51.321334+0000","last_clean_scrub_stamp":"2024-09-22T08:56:51.321334+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:10:54.081036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":95,"num_write":48,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"263'2","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:11.403610+0000","last_change":"2024-09-22T08:57:11.403610+0000","last_active":"2024-09-22T08:57:11.403610+0000","last_peered":"2024-09-22T08:57:11.403610+0000","last_clean":"2024-09-22T08:57:11.403610+0000","last_became_active":"2024-09-22T08:42:17.418864+0000","last_became_peered":"2024-09-22T08:42:17.418864+0000","last_unstale":"2024-09-22T08:57:11.403610+0000","last_undegraded":"2024-09-22T08:57:11.403610+0000","last_fullsized":"2024-09-22T08:57:11.403610+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:57:11.403514+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:57:11.403514+0000","last_clean_scrub_stamp":"2024-09-22T08:57:11.403514+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:49:55.655869+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"263'2","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:07.855544+0000","last_change":"2024-09-22T08:57:07.855544+0000","last_active":"2024-09-22T08:57:07.855544+0000","last_peered":"2024-09-22T08:57:07.855544+0000","last_clean":"2024-09-22T08:57:07.855544+0000","last_became_active":"2024-09-22T08:31:14.259485+0000","last_became_peered":"2024-09-22T08:31:14.259485+0000","last_unstale":"2024-09-22T08:57:07.855544+0000","last_undegraded":"2024-09-22T08:57:07.855544+0000","last_fullsized":"2024-09-22T08:57:07.855544+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:57:07.855458+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:57:07.855458+0000","last_clean_scrub_stamp":"2024-09-22T08:57:07.855458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:08:06.125139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"260'5","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:55.152843+0000","last_change":"2024-09-22T08:56:55.152766+0000","last_active":"2024-09-22T08:56:55.152843+0000","last_peered":"2024-09-22T08:56:55.152843+0000","last_clean":"2024-09-22T08:56:55.152843+0000","last_became_active":"2024-09-22T08:31:11.210835+0000","last_became_peered":"2024-09-22T08:31:11.210835+0000","last_unstale":"2024-09-22T08:56:55.152843+0000","last_undegraded":"2024-09-22T08:56:55.152843+0000","last_fullsized":"2024-09-22T08:56:55.152843+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-22T08:56:55.152666+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-22T08:56:55.152666+0000","last_clean_scrub_stamp":"2024-09-22T08:56:55.152666+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:18:21.293821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"263'36","reported_seq":154,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:51.253039+0000","last_change":"2024-09-22T08:56:51.253039+0000","last_active":"2024-09-22T08:56:51.253039+0000","last_peered":"2024-09-22T08:56:51.253039+0000","last_clean":"2024-09-22T08:56:51.253039+0000","last_became_active":"2024-09-22T08:29:26.068105+0000","last_became_peered":"2024-09-22T08:29:26.068105+0000","last_unstale":"2024-09-22T08:56:51.253039+0000","last_undegraded":"2024-09-22T08:56:51.253039+0000","last_fullsized":"2024-09-22T08:56:51.253039+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'36","last_scrub_stamp":"2024-09-22T08:56:51.252932+0000","last_deep_scrub":"263'36","last_deep_scrub_stamp":"2024-09-22T08:56:51.252932+0000","last_clean_scrub_stamp":"2024-09-22T08:56:51.252932+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:06:36.903602+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":308,"num_read_kb":184,"num_write":90,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:06.868023+0000","last_change":"2024-09-22T08:57:06.868023+0000","last_active":"2024-09-22T08:57:06.868023+0000","last_peered":"2024-09-22T08:57:06.868023+0000","last_clean":"2024-09-22T08:57:06.868023+0000","last_became_active":"2024-09-22T08:42:17.434953+0000","last_became_peered":"2024-09-22T08:42:17.434953+0000","last_unstale":"2024-09-22T08:57:06.868023+0000","last_undegraded":"2024-09-22T08:57:06.868023+0000","last_fullsized":"2024-09-22T08:57:06.868023+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:06.867940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:06.867940+0000","last_clean_scrub_stamp":"2024-09-22T08:57:06.867940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:26:44.548797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"260'2","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:21.623022+0000","last_change":"2024-09-22T08:57:21.623022+0000","last_active":"2024-09-22T08:57:21.623022+0000","last_peered":"2024-09-22T08:57:21.623022+0000","last_clean":"2024-09-22T08:57:21.623022+0000","last_became_active":"2024-09-22T08:31:14.255534+0000","last_became_peered":"2024-09-22T08:31:14.255534+0000","last_unstale":"2024-09-22T08:57:21.623022+0000","last_undegraded":"2024-09-22T08:57:21.623022+0000","last_fullsized":"2024-09-22T08:57:21.623022+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-22T08:57:21.622920+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-22T08:57:21.622920+0000","last_clean_scrub_stamp":"2024-09-22T08:57:21.622920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:52:31.300959+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"263'6","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:16.689080+0000","last_change":"2024-09-22T08:57:16.689080+0000","last_active":"2024-09-22T08:57:16.689080+0000","last_peered":"2024-09-22T08:57:16.689080+0000","last_clean":"2024-09-22T08:57:16.689080+0000","last_became_active":"2024-09-22T08:31:11.213851+0000","last_became_peered":"2024-09-22T08:31:11.213851+0000","last_unstale":"2024-09-22T08:57:16.689080+0000","last_undegraded":"2024-09-22T08:57:16.689080+0000","last_fullsized":"2024-09-22T08:57:16.689080+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-22T08:57:16.688984+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-22T08:57:16.688984+0000","last_clean_scrub_stamp":"2024-09-22T08:57:16.688984+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:56:11.404884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":6146,"num_write":6,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"263'4","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:11.659171+0000","last_change":"2024-09-22T08:57:11.659171+0000","last_active":"2024-09-22T08:57:11.659171+0000","last_peered":"2024-09-22T08:57:11.659171+0000","last_clean":"2024-09-22T08:57:11.659171+0000","last_became_active":"2024-09-22T08:29:26.074907+0000","last_became_peered":"2024-09-22T08:29:26.074907+0000","last_unstale":"2024-09-22T08:57:11.659171+0000","last_undegraded":"2024-09-22T08:57:11.659171+0000","last_fullsized":"2024-09-22T08:57:11.659171+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-22T08:57:11.659074+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-22T08:57:11.659074+0000","last_clean_scrub_stamp":"2024-09-22T08:57:11.659074+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:32:30.977349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:16.399600+0000","last_change":"2024-09-22T08:57:16.399600+0000","last_active":"2024-09-22T08:57:16.399600+0000","last_peered":"2024-09-22T08:57:16.399600+0000","last_clean":"2024-09-22T08:57:16.399600+0000","last_became_active":"2024-09-22T08:42:17.429341+0000","last_became_peered":"2024-09-22T08:42:17.429341+0000","last_unstale":"2024-09-22T08:57:16.399600+0000","last_undegraded":"2024-09-22T08:57:16.399600+0000","last_fullsized":"2024-09-22T08:57:16.399600+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:16.399505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:16.399505+0000","last_clean_scrub_stamp":"2024-09-22T08:57:16.399505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:50:19.065776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"263'4","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:59.125351+0000","last_change":"2024-09-22T08:56:59.125351+0000","last_active":"2024-09-22T08:56:59.125351+0000","last_peered":"2024-09-22T08:56:59.125351+0000","last_clean":"2024-09-22T08:56:59.125351+0000","last_became_active":"2024-09-22T08:31:14.246417+0000","last_became_peered":"2024-09-22T08:31:14.246417+0000","last_unstale":"2024-09-22T08:56:59.125351+0000","last_undegraded":"2024-09-22T08:56:59.125351+0000","last_fullsized":"2024-09-22T08:56:59.125351+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-22T08:56:59.125228+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-22T08:56:59.125228+0000","last_clean_scrub_stamp":"2024-09-22T08:56:59.125228+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:48:30.229239+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"263'9","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:59.624592+0000","last_change":"2024-09-22T08:56:59.624592+0000","last_active":"2024-09-22T08:56:59.624592+0000","last_peered":"2024-09-22T08:56:59.624592+0000","last_clean":"2024-09-22T08:56:59.624592+0000","last_became_active":"2024-09-22T08:31:11.211079+0000","last_became_peered":"2024-09-22T08:31:11.211079+0000","last_unstale":"2024-09-22T08:56:59.624592+0000","last_undegraded":"2024-09-22T08:56:59.624592+0000","last_fullsized":"2024-09-22T08:56:59.624592+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-22T08:56:59.624511+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-22T08:56:59.624511+0000","last_clean_scrub_stamp":"2024-09-22T08:56:59.624511+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:56:41.363859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10242,"num_write":14,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"263'18","reported_seq":97,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:10.690878+0000","last_change":"2024-09-22T08:57:10.690878+0000","last_active":"2024-09-22T08:57:10.690878+0000","last_peered":"2024-09-22T08:57:10.690878+0000","last_clean":"2024-09-22T08:57:10.690878+0000","last_became_active":"2024-09-22T08:29:26.067964+0000","last_became_peered":"2024-09-22T08:29:26.067964+0000","last_unstale":"2024-09-22T08:57:10.690878+0000","last_undegraded":"2024-09-22T08:57:10.690878+0000","last_fullsized":"2024-09-22T08:57:10.690878+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'18","last_scrub_stamp":"2024-09-22T08:57:10.690741+0000","last_deep_scrub":"263'18","last_deep_scrub_stamp":"2024-09-22T08:57:10.690741+0000","last_clean_scrub_stamp":"2024-09-22T08:57:10.690741+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:50:36.471847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":85,"num_write":46,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:54:48.402297+0000","last_change":"2024-09-22T08:42:17.438619+0000","last_active":"2024-09-22T08:54:48.402297+0000","last_peered":"2024-09-22T08:54:48.402297+0000","last_clean":"2024-09-22T08:54:48.402297+0000","last_became_active":"2024-09-22T08:42:17.438318+0000","last_became_peered":"2024-09-22T08:42:17.438318+0000","last_unstale":"2024-09-22T08:54:48.402297+0000","last_undegraded":"2024-09-22T08:54:48.402297+0000","last_fullsized":"2024-09-22T08:54:48.402297+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.388151+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.388151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:58.162876+0000","last_change":"2024-09-22T08:56:58.162876+0000","last_active":"2024-09-22T08:56:58.162876+0000","last_peered":"2024-09-22T08:56:58.162876+0000","last_clean":"2024-09-22T08:56:58.162876+0000","last_became_active":"2024-09-22T08:31:14.258136+0000","last_became_peered":"2024-09-22T08:31:14.258136+0000","last_unstale":"2024-09-22T08:56:58.162876+0000","last_undegraded":"2024-09-22T08:56:58.162876+0000","last_fullsized":"2024-09-22T08:56:58.162876+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:58.162779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:58.162779+0000","last_clean_scrub_stamp":"2024-09-22T08:56:58.162779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:19:33.194641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"263'2","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:52.738896+0000","last_change":"2024-09-22T08:56:52.738896+0000","last_active":"2024-09-22T08:56:52.738896+0000","last_peered":"2024-09-22T08:56:52.738896+0000","last_clean":"2024-09-22T08:56:52.738896+0000","last_became_active":"2024-09-22T08:31:11.214112+0000","last_became_peered":"2024-09-22T08:31:11.214112+0000","last_unstale":"2024-09-22T08:56:52.738896+0000","last_undegraded":"2024-09-22T08:56:52.738896+0000","last_fullsized":"2024-09-22T08:56:52.738896+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:56:52.738794+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:56:52.738794+0000","last_clean_scrub_stamp":"2024-09-22T08:56:52.738794+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:28:40.076592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"263'20","reported_seq":106,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:50.257740+0000","last_change":"2024-09-22T08:56:50.257740+0000","last_active":"2024-09-22T08:56:50.257740+0000","last_peered":"2024-09-22T08:56:50.257740+0000","last_clean":"2024-09-22T08:56:50.257740+0000","last_became_active":"2024-09-22T08:29:26.069407+0000","last_became_peered":"2024-09-22T08:29:26.069407+0000","last_unstale":"2024-09-22T08:56:50.257740+0000","last_undegraded":"2024-09-22T08:56:50.257740+0000","last_fullsized":"2024-09-22T08:56:50.257740+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'20","last_scrub_stamp":"2024-09-22T08:56:50.257643+0000","last_deep_scrub":"263'20","last_deep_scrub_stamp":"2024-09-22T08:56:50.257643+0000","last_clean_scrub_stamp":"2024-09-22T08:56:50.257643+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:48:55.481743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":95,"num_write":53,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"263'230","reported_seq":876,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:29.491497+0000","last_change":"2024-09-22T08:56:29.491448+0000","last_active":"2024-09-22T08:56:29.491497+0000","last_peered":"2024-09-22T08:56:29.491497+0000","last_clean":"2024-09-22T08:56:29.491497+0000","last_became_active":"2024-09-22T08:15:04.957090+0000","last_became_peered":"2024-09-22T08:15:04.957090+0000","last_unstale":"2024-09-22T08:56:29.491497+0000","last_undegraded":"2024-09-22T08:56:29.491497+0000","last_fullsized":"2024-09-22T08:56:29.491497+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'230","last_scrub_stamp":"2024-09-22T08:56:29.491342+0000","last_deep_scrub":"263'230","last_deep_scrub_stamp":"2024-09-22T08:56:29.491342+0000","last_clean_scrub_stamp":"2024-09-22T08:56:29.491342+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:44:19.142689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":587,"num_read_kb":1123,"num_write":1117,"num_write_kb":27318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"263'478","reported_seq":2209,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:34.800274+0000","last_change":"2024-09-22T08:56:34.800274+0000","last_active":"2024-09-22T08:56:34.800274+0000","last_peered":"2024-09-22T08:56:34.800274+0000","last_clean":"2024-09-22T08:56:34.800274+0000","last_became_active":"2024-09-22T08:15:06.980616+0000","last_became_peered":"2024-09-22T08:15:06.980616+0000","last_unstale":"2024-09-22T08:56:34.800274+0000","last_undegraded":"2024-09-22T08:56:34.800274+0000","last_fullsized":"2024-09-22T08:56:34.800274+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'478","last_scrub_stamp":"2024-09-22T08:56:34.800168+0000","last_deep_scrub":"263'478","last_deep_scrub_stamp":"2024-09-22T08:56:34.800168+0000","last_clean_scrub_stamp":"2024-09-22T08:56:34.800168+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:41:01.961869+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2847,"num_read_kb":2707,"num_write":560,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"263'240","reported_seq":885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:35.366976+0000","last_change":"2024-09-22T08:56:35.366911+0000","last_active":"2024-09-22T08:56:35.366976+0000","last_peered":"2024-09-22T08:56:35.366976+0000","last_clean":"2024-09-22T08:56:35.366976+0000","last_became_active":"2024-09-22T08:15:04.956643+0000","last_became_peered":"2024-09-22T08:15:04.956643+0000","last_unstale":"2024-09-22T08:56:35.366976+0000","last_undegraded":"2024-09-22T08:56:35.366976+0000","last_fullsized":"2024-09-22T08:56:35.366976+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'240","last_scrub_stamp":"2024-09-22T08:56:35.366815+0000","last_deep_scrub":"263'240","last_deep_scrub_stamp":"2024-09-22T08:56:35.366815+0000","last_clean_scrub_stamp":"2024-09-22T08:56:35.366815+0000","objects_scrubbed":1,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:47:44.936217+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":599,"num_read_kb":19417,"num_write":1105,"num_write_kb":24732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"263'388","reported_seq":1928,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:46.870394+0000","last_change":"2024-09-22T08:56:46.870394+0000","last_active":"2024-09-22T08:56:46.870394+0000","last_peered":"2024-09-22T08:56:46.870394+0000","last_clean":"2024-09-22T08:56:46.870394+0000","last_became_active":"2024-09-22T08:15:06.974127+0000","last_became_peered":"2024-09-22T08:15:06.974127+0000","last_unstale":"2024-09-22T08:56:46.870394+0000","last_undegraded":"2024-09-22T08:56:46.870394+0000","last_fullsized":"2024-09-22T08:56:46.870394+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'388","last_scrub_stamp":"2024-09-22T08:56:46.870289+0000","last_deep_scrub":"263'388","last_deep_scrub_stamp":"2024-09-22T08:56:46.870289+0000","last_clean_scrub_stamp":"2024-09-22T08:56:46.870289+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:57:47.237420+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2097,"num_read_kb":2016,"num_write":427,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"263'258","reported_seq":934,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:34.351461+0000","last_change":"2024-09-22T08:56:34.351393+0000","last_active":"2024-09-22T08:56:34.351461+0000","last_peered":"2024-09-22T08:56:34.351461+0000","last_clean":"2024-09-22T08:56:34.351461+0000","last_became_active":"2024-09-22T08:15:04.956659+0000","last_became_peered":"2024-09-22T08:15:04.956659+0000","last_unstale":"2024-09-22T08:56:34.351461+0000","last_undegraded":"2024-09-22T08:56:34.351461+0000","last_fullsized":"2024-09-22T08:56:34.351461+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'258","last_scrub_stamp":"2024-09-22T08:56:34.351295+0000","last_deep_scrub":"263'258","last_deep_scrub_stamp":"2024-09-22T08:56:34.351295+0000","last_clean_scrub_stamp":"2024-09-22T08:56:34.351295+0000","objects_scrubbed":4,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:09:46.701747+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":699,"num_read_kb":25466,"num_write":1131,"num_write_kb":27131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"263'899","reported_seq":2502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:47.845221+0000","last_change":"2024-09-22T08:56:47.845221+0000","last_active":"2024-09-22T08:56:47.845221+0000","last_peered":"2024-09-22T08:56:47.845221+0000","last_clean":"2024-09-22T08:56:47.845221+0000","last_became_active":"2024-09-22T08:15:06.968959+0000","last_became_peered":"2024-09-22T08:15:06.968959+0000","last_unstale":"2024-09-22T08:56:47.845221+0000","last_undegraded":"2024-09-22T08:56:47.845221+0000","last_fullsized":"2024-09-22T08:56:47.845221+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'899","last_scrub_stamp":"2024-09-22T08:56:47.845138+0000","last_deep_scrub":"263'899","last_deep_scrub_stamp":"2024-09-22T08:56:47.845138+0000","last_clean_scrub_stamp":"2024-09-22T08:56:47.845138+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":800,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:01:09.164689+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4516,"num_read_kb":4043,"num_write":1241,"num_write_kb":490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2295,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"263'241","reported_seq":887,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:28.308489+0000","last_change":"2024-09-22T08:56:28.308434+0000","last_active":"2024-09-22T08:56:28.308489+0000","last_peered":"2024-09-22T08:56:28.308489+0000","last_clean":"2024-09-22T08:56:28.308489+0000","last_became_active":"2024-09-22T08:15:04.961309+0000","last_became_peered":"2024-09-22T08:15:04.961309+0000","last_unstale":"2024-09-22T08:56:28.308489+0000","last_undegraded":"2024-09-22T08:56:28.308489+0000","last_fullsized":"2024-09-22T08:56:28.308489+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'241","last_scrub_stamp":"2024-09-22T08:56:28.308329+0000","last_deep_scrub":"263'241","last_deep_scrub_stamp":"2024-09-22T08:56:28.308329+0000","last_clean_scrub_stamp":"2024-09-22T08:56:28.308329+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:50:55.099697+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079903,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":558,"num_read_kb":61455,"num_write":1043,"num_write_kb":33072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"263'535","reported_seq":2240,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:37.704325+0000","last_change":"2024-09-22T08:56:37.704325+0000","last_active":"2024-09-22T08:56:37.704325+0000","last_peered":"2024-09-22T08:56:37.704325+0000","last_clean":"2024-09-22T08:56:37.704325+0000","last_became_active":"2024-09-22T08:15:06.969540+0000","last_became_peered":"2024-09-22T08:15:06.969540+0000","last_unstale":"2024-09-22T08:56:37.704325+0000","last_undegraded":"2024-09-22T08:56:37.704325+0000","last_fullsized":"2024-09-22T08:56:37.704325+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'535","last_scrub_stamp":"2024-09-22T08:56:37.704238+0000","last_deep_scrub":"263'535","last_deep_scrub_stamp":"2024-09-22T08:56:37.704238+0000","last_clean_scrub_stamp":"2024-09-22T08:56:37.704238+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:01:40.290775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2823,"num_read_kb":2637,"num_write":641,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"263'217","reported_seq":925,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:26.489027+0000","last_change":"2024-09-22T08:56:26.489027+0000","last_active":"2024-09-22T08:56:26.489027+0000","last_peered":"2024-09-22T08:56:26.489027+0000","last_clean":"2024-09-22T08:56:26.489027+0000","last_became_active":"2024-09-22T08:15:04.957717+0000","last_became_peered":"2024-09-22T08:15:04.957717+0000","last_unstale":"2024-09-22T08:56:26.489027+0000","last_undegraded":"2024-09-22T08:56:26.489027+0000","last_fullsized":"2024-09-22T08:56:26.489027+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'217","last_scrub_stamp":"2024-09-22T08:56:26.488928+0000","last_deep_scrub":"263'217","last_deep_scrub_stamp":"2024-09-22T08:56:26.488928+0000","last_clean_scrub_stamp":"2024-09-22T08:56:26.488928+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:37:50.212068+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1573037,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":720,"num_read_kb":166418,"num_write":955,"num_write_kb":57547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"263'607","reported_seq":2138,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:36.493498+0000","last_change":"2024-09-22T08:56:36.493433+0000","last_active":"2024-09-22T08:56:36.493498+0000","last_peered":"2024-09-22T08:56:36.493498+0000","last_clean":"2024-09-22T08:56:36.493498+0000","last_became_active":"2024-09-22T08:15:06.962605+0000","last_became_peered":"2024-09-22T08:15:06.962605+0000","last_unstale":"2024-09-22T08:56:36.493498+0000","last_undegraded":"2024-09-22T08:56:36.493498+0000","last_fullsized":"2024-09-22T08:56:36.493498+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'607","last_scrub_stamp":"2024-09-22T08:56:36.493326+0000","last_deep_scrub":"263'607","last_deep_scrub_stamp":"2024-09-22T08:56:36.493326+0000","last_clean_scrub_stamp":"2024-09-22T08:56:36.493326+0000","objects_scrubbed":4,"log_size":107,"log_dups_size":500,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:23:12.495770+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3087,"num_read_kb":2910,"num_write":853,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":486,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"263'257","reported_seq":944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:27.325351+0000","last_change":"2024-09-22T08:56:27.325351+0000","last_active":"2024-09-22T08:56:27.325351+0000","last_peered":"2024-09-22T08:56:27.325351+0000","last_clean":"2024-09-22T08:56:27.325351+0000","last_became_active":"2024-09-22T08:15:04.962128+0000","last_became_peered":"2024-09-22T08:15:04.962128+0000","last_unstale":"2024-09-22T08:56:27.325351+0000","last_undegraded":"2024-09-22T08:56:27.325351+0000","last_fullsized":"2024-09-22T08:56:27.325351+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'257","last_scrub_stamp":"2024-09-22T08:56:27.325259+0000","last_deep_scrub":"263'257","last_deep_scrub_stamp":"2024-09-22T08:56:27.325259+0000","last_clean_scrub_stamp":"2024-09-22T08:56:27.325259+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:48:56.416424+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":753,"num_read_kb":52063,"num_write":1239,"num_write_kb":44926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"263'872","reported_seq":2702,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:38.475792+0000","last_change":"2024-09-22T08:56:38.475719+0000","last_active":"2024-09-22T08:56:38.475792+0000","last_peered":"2024-09-22T08:56:38.475792+0000","last_clean":"2024-09-22T08:56:38.475792+0000","last_became_active":"2024-09-22T08:15:06.972756+0000","last_became_peered":"2024-09-22T08:15:06.972756+0000","last_unstale":"2024-09-22T08:56:38.475792+0000","last_undegraded":"2024-09-22T08:56:38.475792+0000","last_fullsized":"2024-09-22T08:56:38.475792+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'872","last_scrub_stamp":"2024-09-22T08:56:38.475633+0000","last_deep_scrub":"263'872","last_deep_scrub_stamp":"2024-09-22T08:56:38.475633+0000","last_clean_scrub_stamp":"2024-09-22T08:56:38.475633+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":800,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:27:33.543291+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4443,"num_read_kb":4056,"num_write":1153,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"263'251","reported_seq":925,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:31.486584+0000","last_change":"2024-09-22T08:56:31.486584+0000","last_active":"2024-09-22T08:56:31.486584+0000","last_peered":"2024-09-22T08:56:31.486584+0000","last_clean":"2024-09-22T08:56:31.486584+0000","last_became_active":"2024-09-22T08:15:04.944916+0000","last_became_peered":"2024-09-22T08:15:04.944916+0000","last_unstale":"2024-09-22T08:56:31.486584+0000","last_undegraded":"2024-09-22T08:56:31.486584+0000","last_fullsized":"2024-09-22T08:56:31.486584+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'251","last_scrub_stamp":"2024-09-22T08:56:31.486476+0000","last_deep_scrub":"263'251","last_deep_scrub_stamp":"2024-09-22T08:56:31.486476+0000","last_clean_scrub_stamp":"2024-09-22T08:56:31.486476+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:49:01.795181+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":805,"num_read_kb":10946,"num_write":1075,"num_write_kb":28039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"263'557","reported_seq":2090,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:37.452503+0000","last_change":"2024-09-22T08:56:37.452437+0000","last_active":"2024-09-22T08:56:37.452503+0000","last_peered":"2024-09-22T08:56:37.452503+0000","last_clean":"2024-09-22T08:56:37.452503+0000","last_became_active":"2024-09-22T08:15:06.968853+0000","last_became_peered":"2024-09-22T08:15:06.968853+0000","last_unstale":"2024-09-22T08:56:37.452503+0000","last_undegraded":"2024-09-22T08:56:37.452503+0000","last_fullsized":"2024-09-22T08:56:37.452503+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'557","last_scrub_stamp":"2024-09-22T08:56:37.452353+0000","last_deep_scrub":"263'557","last_deep_scrub_stamp":"2024-09-22T08:56:37.452353+0000","last_clean_scrub_stamp":"2024-09-22T08:56:37.452353+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:58:45.111881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2932,"num_read_kb":2656,"num_write":742,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":743,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"263'185","reported_seq":762,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:33.339657+0000","last_change":"2024-09-22T08:56:33.339657+0000","last_active":"2024-09-22T08:56:33.339657+0000","last_peered":"2024-09-22T08:56:33.339657+0000","last_clean":"2024-09-22T08:56:33.339657+0000","last_became_active":"2024-09-22T08:15:04.959395+0000","last_became_peered":"2024-09-22T08:15:04.959395+0000","last_unstale":"2024-09-22T08:56:33.339657+0000","last_undegraded":"2024-09-22T08:56:33.339657+0000","last_fullsized":"2024-09-22T08:56:33.339657+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'185","last_scrub_stamp":"2024-09-22T08:56:33.339559+0000","last_deep_scrub":"263'185","last_deep_scrub_stamp":"2024-09-22T08:56:33.339559+0000","last_clean_scrub_stamp":"2024-09-22T08:56:33.339559+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:26:10.173195+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":318,"num_read_kb":28967,"num_write":772,"num_write_kb":45290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"263'1561","reported_seq":3275,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:44.417199+0000","last_change":"2024-09-22T08:56:44.417141+0000","last_active":"2024-09-22T08:56:44.417199+0000","last_peered":"2024-09-22T08:56:44.417199+0000","last_clean":"2024-09-22T08:56:44.417199+0000","last_became_active":"2024-09-22T08:15:06.972074+0000","last_became_peered":"2024-09-22T08:15:06.972074+0000","last_unstale":"2024-09-22T08:56:44.417199+0000","last_undegraded":"2024-09-22T08:56:44.417199+0000","last_fullsized":"2024-09-22T08:56:44.417199+0000","mapping_epoch":25,"log_start":"263'1500","ondisk_log_start":"263'1500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1561","last_scrub_stamp":"2024-09-22T08:56:44.417043+0000","last_deep_scrub":"263'1561","last_deep_scrub_stamp":"2024-09-22T08:56:44.417043+0000","last_clean_scrub_stamp":"2024-09-22T08:56:44.417043+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":1500,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:19:57.978889+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6961,"num_read_kb":6120,"num_write":2165,"num_write_kb":918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"263'489","reported_seq":2158,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:45.900323+0000","last_change":"2024-09-22T08:56:45.900269+0000","last_active":"2024-09-22T08:56:45.900323+0000","last_peered":"2024-09-22T08:56:45.900323+0000","last_clean":"2024-09-22T08:56:45.900323+0000","last_became_active":"2024-09-22T08:15:06.965751+0000","last_became_peered":"2024-09-22T08:15:06.965751+0000","last_unstale":"2024-09-22T08:56:45.900323+0000","last_undegraded":"2024-09-22T08:56:45.900323+0000","last_fullsized":"2024-09-22T08:56:45.900323+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'489","last_scrub_stamp":"2024-09-22T08:56:45.900152+0000","last_deep_scrub":"263'489","last_deep_scrub_stamp":"2024-09-22T08:56:45.900152+0000","last_clean_scrub_stamp":"2024-09-22T08:56:45.900152+0000","objects_scrubbed":6,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:58:42.393419+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2631,"num_read_kb":2475,"num_write":578,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":468,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"263'220","reported_seq":872,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:24.868187+0000","last_change":"2024-09-22T08:56:24.868187+0000","last_active":"2024-09-22T08:56:24.868187+0000","last_peered":"2024-09-22T08:56:24.868187+0000","last_clean":"2024-09-22T08:56:24.868187+0000","last_became_active":"2024-09-22T08:15:04.953628+0000","last_became_peered":"2024-09-22T08:15:04.953628+0000","last_unstale":"2024-09-22T08:56:24.868187+0000","last_undegraded":"2024-09-22T08:56:24.868187+0000","last_fullsized":"2024-09-22T08:56:24.868187+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'220","last_scrub_stamp":"2024-09-22T08:56:24.868066+0000","last_deep_scrub":"263'220","last_deep_scrub_stamp":"2024-09-22T08:56:24.868066+0000","last_clean_scrub_stamp":"2024-09-22T08:56:24.868066+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:38:51.226129+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":538,"num_read_kb":68591,"num_write":878,"num_write_kb":34888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"263'360","reported_seq":1747,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:35.493024+0000","last_change":"2024-09-22T08:56:35.492973+0000","last_active":"2024-09-22T08:56:35.493024+0000","last_peered":"2024-09-22T08:56:35.493024+0000","last_clean":"2024-09-22T08:56:35.493024+0000","last_became_active":"2024-09-22T08:15:06.968970+0000","last_became_peered":"2024-09-22T08:15:06.968970+0000","last_unstale":"2024-09-22T08:56:35.493024+0000","last_undegraded":"2024-09-22T08:56:35.493024+0000","last_fullsized":"2024-09-22T08:56:35.493024+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'360","last_scrub_stamp":"2024-09-22T08:56:35.492871+0000","last_deep_scrub":"263'360","last_deep_scrub_stamp":"2024-09-22T08:56:35.492871+0000","last_clean_scrub_stamp":"2024-09-22T08:56:35.492871+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:05:00.671139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2053,"num_read_kb":1926,"num_write":427,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1365,"num_omap_keys":6,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"263'233","reported_seq":872,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:28.462228+0000","last_change":"2024-09-22T08:56:28.462228+0000","last_active":"2024-09-22T08:56:28.462228+0000","last_peered":"2024-09-22T08:56:28.462228+0000","last_clean":"2024-09-22T08:56:28.462228+0000","last_became_active":"2024-09-22T08:15:04.966769+0000","last_became_peered":"2024-09-22T08:15:04.966769+0000","last_unstale":"2024-09-22T08:56:28.462228+0000","last_undegraded":"2024-09-22T08:56:28.462228+0000","last_fullsized":"2024-09-22T08:56:28.462228+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'233","last_scrub_stamp":"2024-09-22T08:56:28.462117+0000","last_deep_scrub":"263'233","last_deep_scrub_stamp":"2024-09-22T08:56:28.462117+0000","last_clean_scrub_stamp":"2024-09-22T08:56:28.462117+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:40:13.623374+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":51014,"num_write":1104,"num_write_kb":43963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"263'469","reported_seq":1934,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:30.740306+0000","last_change":"2024-09-22T08:56:30.740245+0000","last_active":"2024-09-22T08:56:30.740306+0000","last_peered":"2024-09-22T08:56:30.740306+0000","last_clean":"2024-09-22T08:56:30.740306+0000","last_became_active":"2024-09-22T08:15:06.972821+0000","last_became_peered":"2024-09-22T08:15:06.972821+0000","last_unstale":"2024-09-22T08:56:30.740306+0000","last_undegraded":"2024-09-22T08:56:30.740306+0000","last_fullsized":"2024-09-22T08:56:30.740306+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'469","last_scrub_stamp":"2024-09-22T08:56:30.740153+0000","last_deep_scrub":"263'469","last_deep_scrub_stamp":"2024-09-22T08:56:30.740153+0000","last_clean_scrub_stamp":"2024-09-22T08:56:30.740153+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:47:33.203417+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2415,"num_read_kb":2238,"num_write":577,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"263'223","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:30.477162+0000","last_change":"2024-09-22T08:56:30.477162+0000","last_active":"2024-09-22T08:56:30.477162+0000","last_peered":"2024-09-22T08:56:30.477162+0000","last_clean":"2024-09-22T08:56:30.477162+0000","last_became_active":"2024-09-22T08:15:04.955972+0000","last_became_peered":"2024-09-22T08:15:04.955972+0000","last_unstale":"2024-09-22T08:56:30.477162+0000","last_undegraded":"2024-09-22T08:56:30.477162+0000","last_fullsized":"2024-09-22T08:56:30.477162+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'223","last_scrub_stamp":"2024-09-22T08:56:30.477065+0000","last_deep_scrub":"263'223","last_deep_scrub_stamp":"2024-09-22T08:56:30.477065+0000","last_clean_scrub_stamp":"2024-09-22T08:56:30.477065+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:48:00.158279+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":994,"num_read_kb":8164,"num_write":935,"num_write_kb":17459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"263'465","reported_seq":2089,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:37.484954+0000","last_change":"2024-09-22T08:56:37.484954+0000","last_active":"2024-09-22T08:56:37.484954+0000","last_peered":"2024-09-22T08:56:37.484954+0000","last_clean":"2024-09-22T08:56:37.484954+0000","last_became_active":"2024-09-22T08:15:06.972250+0000","last_became_peered":"2024-09-22T08:15:06.972250+0000","last_unstale":"2024-09-22T08:56:37.484954+0000","last_undegraded":"2024-09-22T08:56:37.484954+0000","last_fullsized":"2024-09-22T08:56:37.484954+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'465","last_scrub_stamp":"2024-09-22T08:56:37.484862+0000","last_deep_scrub":"263'465","last_deep_scrub_stamp":"2024-09-22T08:56:37.484862+0000","last_clean_scrub_stamp":"2024-09-22T08:56:37.484862+0000","objects_scrubbed":2,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:01:02.906297+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2654,"num_read_kb":2505,"num_write":533,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"263'252","reported_seq":902,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:25.507295+0000","last_change":"2024-09-22T08:56:25.507295+0000","last_active":"2024-09-22T08:56:25.507295+0000","last_peered":"2024-09-22T08:56:25.507295+0000","last_clean":"2024-09-22T08:56:25.507295+0000","last_became_active":"2024-09-22T08:15:04.954948+0000","last_became_peered":"2024-09-22T08:15:04.954948+0000","last_unstale":"2024-09-22T08:56:25.507295+0000","last_undegraded":"2024-09-22T08:56:25.507295+0000","last_fullsized":"2024-09-22T08:56:25.507295+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'252","last_scrub_stamp":"2024-09-22T08:56:25.507185+0000","last_deep_scrub":"263'252","last_deep_scrub_stamp":"2024-09-22T08:56:25.507185+0000","last_clean_scrub_stamp":"2024-09-22T08:56:25.507185+0000","objects_scrubbed":5,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:16.520968+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":551,"num_read_kb":6536,"num_write":1088,"num_write_kb":24915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"263'386","reported_seq":1854,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:43.447560+0000","last_change":"2024-09-22T08:56:43.447560+0000","last_active":"2024-09-22T08:56:43.447560+0000","last_peered":"2024-09-22T08:56:43.447560+0000","last_clean":"2024-09-22T08:56:43.447560+0000","last_became_active":"2024-09-22T08:15:06.968651+0000","last_became_peered":"2024-09-22T08:15:06.968651+0000","last_unstale":"2024-09-22T08:56:43.447560+0000","last_undegraded":"2024-09-22T08:56:43.447560+0000","last_fullsized":"2024-09-22T08:56:43.447560+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'386","last_scrub_stamp":"2024-09-22T08:56:43.447462+0000","last_deep_scrub":"263'386","last_deep_scrub_stamp":"2024-09-22T08:56:43.447462+0000","last_clean_scrub_stamp":"2024-09-22T08:56:43.447462+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:31:19.300619+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2079,"num_read_kb":1977,"num_write":435,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"263'239","reported_seq":862,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:30.460156+0000","last_change":"2024-09-22T08:56:30.460156+0000","last_active":"2024-09-22T08:56:30.460156+0000","last_peered":"2024-09-22T08:56:30.460156+0000","last_clean":"2024-09-22T08:56:30.460156+0000","last_became_active":"2024-09-22T08:15:04.958578+0000","last_became_peered":"2024-09-22T08:15:04.958578+0000","last_unstale":"2024-09-22T08:56:30.460156+0000","last_undegraded":"2024-09-22T08:56:30.460156+0000","last_fullsized":"2024-09-22T08:56:30.460156+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'239","last_scrub_stamp":"2024-09-22T08:56:30.460046+0000","last_deep_scrub":"263'239","last_deep_scrub_stamp":"2024-09-22T08:56:30.460046+0000","last_clean_scrub_stamp":"2024-09-22T08:56:30.460046+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:15:01.904411+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":554,"num_read_kb":7725,"num_write":1073,"num_write_kb":35221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"263'576","reported_seq":2266,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:31.779569+0000","last_change":"2024-09-22T08:56:31.779569+0000","last_active":"2024-09-22T08:56:31.779569+0000","last_peered":"2024-09-22T08:56:31.779569+0000","last_clean":"2024-09-22T08:56:31.779569+0000","last_became_active":"2024-09-22T08:15:06.980621+0000","last_became_peered":"2024-09-22T08:15:06.980621+0000","last_unstale":"2024-09-22T08:56:31.779569+0000","last_undegraded":"2024-09-22T08:56:31.779569+0000","last_fullsized":"2024-09-22T08:56:31.779569+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'576","last_scrub_stamp":"2024-09-22T08:56:31.779429+0000","last_deep_scrub":"263'576","last_deep_scrub_stamp":"2024-09-22T08:56:31.779429+0000","last_clean_scrub_stamp":"2024-09-22T08:56:31.779429+0000","objects_scrubbed":3,"log_size":76,"log_dups_size":500,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:22.389041+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3075,"num_read_kb":2832,"num_write":740,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"263'195","reported_seq":1004,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:28.526828+0000","last_change":"2024-09-22T08:56:28.526760+0000","last_active":"2024-09-22T08:56:28.526828+0000","last_peered":"2024-09-22T08:56:28.526828+0000","last_clean":"2024-09-22T08:56:28.526828+0000","last_became_active":"2024-09-22T08:15:04.952203+0000","last_became_peered":"2024-09-22T08:15:04.952203+0000","last_unstale":"2024-09-22T08:56:28.526828+0000","last_undegraded":"2024-09-22T08:56:28.526828+0000","last_fullsized":"2024-09-22T08:56:28.526828+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'195","last_scrub_stamp":"2024-09-22T08:56:28.526665+0000","last_deep_scrub":"263'195","last_deep_scrub_stamp":"2024-09-22T08:56:28.526665+0000","last_clean_scrub_stamp":"2024-09-22T08:56:28.526665+0000","objects_scrubbed":2,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:04:59.175129+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1058,"num_read_kb":8867,"num_write":911,"num_write_kb":21916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"263'140","reported_seq":647,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:48.379821+0000","last_change":"2024-09-22T08:56:48.379821+0000","last_active":"2024-09-22T08:56:48.379821+0000","last_peered":"2024-09-22T08:56:48.379821+0000","last_clean":"2024-09-22T08:56:48.379821+0000","last_became_active":"2024-09-22T08:15:15.011529+0000","last_became_peered":"2024-09-22T08:15:15.011529+0000","last_unstale":"2024-09-22T08:56:48.379821+0000","last_undegraded":"2024-09-22T08:56:48.379821+0000","last_fullsized":"2024-09-22T08:56:48.379821+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'140","last_scrub_stamp":"2024-09-22T08:56:48.379718+0000","last_deep_scrub":"263'140","last_deep_scrub_stamp":"2024-09-22T08:56:48.379718+0000","last_clean_scrub_stamp":"2024-09-22T08:56:48.379718+0000","objects_scrubbed":1,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:29:35.640358+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":192,"num_read_kb":186,"num_write":338,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"263'505","reported_seq":2116,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:36.525732+0000","last_change":"2024-09-22T08:56:36.525663+0000","last_active":"2024-09-22T08:56:36.525732+0000","last_peered":"2024-09-22T08:56:36.525732+0000","last_clean":"2024-09-22T08:56:36.525732+0000","last_became_active":"2024-09-22T08:15:06.967794+0000","last_became_peered":"2024-09-22T08:15:06.967794+0000","last_unstale":"2024-09-22T08:56:36.525732+0000","last_undegraded":"2024-09-22T08:56:36.525732+0000","last_fullsized":"2024-09-22T08:56:36.525732+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'505","last_scrub_stamp":"2024-09-22T08:56:36.525567+0000","last_deep_scrub":"263'505","last_deep_scrub_stamp":"2024-09-22T08:56:36.525567+0000","last_clean_scrub_stamp":"2024-09-22T08:56:36.525567+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:20:04.782519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2789,"num_read_kb":2608,"num_write":647,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"263'226","reported_seq":880,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:31.855600+0000","last_change":"2024-09-22T08:56:31.855517+0000","last_active":"2024-09-22T08:56:31.855600+0000","last_peered":"2024-09-22T08:56:31.855600+0000","last_clean":"2024-09-22T08:56:31.855600+0000","last_became_active":"2024-09-22T08:15:04.963890+0000","last_became_peered":"2024-09-22T08:15:04.963890+0000","last_unstale":"2024-09-22T08:56:31.855600+0000","last_undegraded":"2024-09-22T08:56:31.855600+0000","last_fullsized":"2024-09-22T08:56:31.855600+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'226","last_scrub_stamp":"2024-09-22T08:56:31.855382+0000","last_deep_scrub":"263'226","last_deep_scrub_stamp":"2024-09-22T08:56:31.855382+0000","last_clean_scrub_stamp":"2024-09-22T08:56:31.855382+0000","objects_scrubbed":7,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:32:30.739490+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079944,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":535,"num_read_kb":15199,"num_write":1088,"num_write_kb":18954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:52.870153+0000","last_change":"2024-09-22T08:56:52.870153+0000","last_active":"2024-09-22T08:56:52.870153+0000","last_peered":"2024-09-22T08:56:52.870153+0000","last_clean":"2024-09-22T08:56:52.870153+0000","last_became_active":"2024-09-22T08:15:08.968482+0000","last_became_peered":"2024-09-22T08:15:08.968482+0000","last_unstale":"2024-09-22T08:56:52.870153+0000","last_undegraded":"2024-09-22T08:56:52.870153+0000","last_fullsized":"2024-09-22T08:56:52.870153+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:52.870067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:52.870067+0000","last_clean_scrub_stamp":"2024-09-22T08:56:52.870067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:59:27.029495+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"263'197","reported_seq":804,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:51.821033+0000","last_change":"2024-09-22T08:56:51.821033+0000","last_active":"2024-09-22T08:56:51.821033+0000","last_peered":"2024-09-22T08:56:51.821033+0000","last_clean":"2024-09-22T08:56:51.821033+0000","last_became_active":"2024-09-22T08:15:10.987539+0000","last_became_peered":"2024-09-22T08:15:10.987539+0000","last_unstale":"2024-09-22T08:56:51.821033+0000","last_undegraded":"2024-09-22T08:56:51.821033+0000","last_fullsized":"2024-09-22T08:56:51.821033+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'197","last_scrub_stamp":"2024-09-22T08:56:51.820915+0000","last_deep_scrub":"263'197","last_deep_scrub_stamp":"2024-09-22T08:56:51.820915+0000","last_clean_scrub_stamp":"2024-09-22T08:56:51.820915+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:48:30.546821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7203,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":254,"num_read_kb":315,"num_write":148,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:46.734966+0000","last_change":"2024-09-22T08:56:46.734966+0000","last_active":"2024-09-22T08:56:46.734966+0000","last_peered":"2024-09-22T08:56:46.734966+0000","last_clean":"2024-09-22T08:56:46.734966+0000","last_became_active":"2024-09-22T08:15:13.018750+0000","last_became_peered":"2024-09-22T08:15:13.018750+0000","last_unstale":"2024-09-22T08:56:46.734966+0000","last_undegraded":"2024-09-22T08:56:46.734966+0000","last_fullsized":"2024-09-22T08:56:46.734966+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:46.734883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:46.734883+0000","last_clean_scrub_stamp":"2024-09-22T08:56:46.734883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:03:09.348530+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"263'153","reported_seq":652,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:54.819283+0000","last_change":"2024-09-22T08:56:54.819283+0000","last_active":"2024-09-22T08:56:54.819283+0000","last_peered":"2024-09-22T08:56:54.819283+0000","last_clean":"2024-09-22T08:56:54.819283+0000","last_became_active":"2024-09-22T08:15:15.020542+0000","last_became_peered":"2024-09-22T08:15:15.020542+0000","last_unstale":"2024-09-22T08:56:54.819283+0000","last_undegraded":"2024-09-22T08:56:54.819283+0000","last_fullsized":"2024-09-22T08:56:54.819283+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'153","last_scrub_stamp":"2024-09-22T08:56:54.819185+0000","last_deep_scrub":"263'153","last_deep_scrub_stamp":"2024-09-22T08:56:54.819185+0000","last_clean_scrub_stamp":"2024-09-22T08:56:54.819185+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:13:03.005110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":183,"num_read_kb":175,"num_write":358,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"263'757","reported_seq":2368,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:42.879382+0000","last_change":"2024-09-22T08:56:42.879382+0000","last_active":"2024-09-22T08:56:42.879382+0000","last_peered":"2024-09-22T08:56:42.879382+0000","last_clean":"2024-09-22T08:56:42.879382+0000","last_became_active":"2024-09-22T08:15:06.980479+0000","last_became_peered":"2024-09-22T08:15:06.980479+0000","last_unstale":"2024-09-22T08:56:42.879382+0000","last_undegraded":"2024-09-22T08:56:42.879382+0000","last_fullsized":"2024-09-22T08:56:42.879382+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'757","last_scrub_stamp":"2024-09-22T08:56:42.879289+0000","last_deep_scrub":"263'757","last_deep_scrub_stamp":"2024-09-22T08:56:42.879289+0000","last_clean_scrub_stamp":"2024-09-22T08:56:42.879289+0000","objects_scrubbed":6,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:12:59.739632+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3625,"num_read_kb":3307,"num_write":963,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"263'258","reported_seq":935,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:25.458175+0000","last_change":"2024-09-22T08:56:25.458117+0000","last_active":"2024-09-22T08:56:25.458175+0000","last_peered":"2024-09-22T08:56:25.458175+0000","last_clean":"2024-09-22T08:56:25.458175+0000","last_became_active":"2024-09-22T08:15:04.951265+0000","last_became_peered":"2024-09-22T08:15:04.951265+0000","last_unstale":"2024-09-22T08:56:25.458175+0000","last_undegraded":"2024-09-22T08:56:25.458175+0000","last_fullsized":"2024-09-22T08:56:25.458175+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'258","last_scrub_stamp":"2024-09-22T08:56:25.457993+0000","last_deep_scrub":"263'258","last_deep_scrub_stamp":"2024-09-22T08:56:25.457993+0000","last_clean_scrub_stamp":"2024-09-22T08:56:25.457993+0000","objects_scrubbed":4,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:21:32.094740+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":764,"num_read_kb":7954,"num_write":1369,"num_write_kb":16798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:44.783723+0000","last_change":"2024-09-22T08:56:44.783668+0000","last_active":"2024-09-22T08:56:44.783723+0000","last_peered":"2024-09-22T08:56:44.783723+0000","last_clean":"2024-09-22T08:56:44.783723+0000","last_became_active":"2024-09-22T08:15:08.978832+0000","last_became_peered":"2024-09-22T08:15:08.978832+0000","last_unstale":"2024-09-22T08:56:44.783723+0000","last_undegraded":"2024-09-22T08:56:44.783723+0000","last_fullsized":"2024-09-22T08:56:44.783723+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:44.783581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:44.783581+0000","last_clean_scrub_stamp":"2024-09-22T08:56:44.783581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:13:58.465427+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"263'80","reported_seq":609,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:41.793143+0000","last_change":"2024-09-22T08:56:41.793143+0000","last_active":"2024-09-22T08:56:41.793143+0000","last_peered":"2024-09-22T08:56:41.793143+0000","last_clean":"2024-09-22T08:56:41.793143+0000","last_became_active":"2024-09-22T08:15:10.984027+0000","last_became_peered":"2024-09-22T08:15:10.984027+0000","last_unstale":"2024-09-22T08:56:41.793143+0000","last_undegraded":"2024-09-22T08:56:41.793143+0000","last_fullsized":"2024-09-22T08:56:41.793143+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'80","last_scrub_stamp":"2024-09-22T08:56:41.793036+0000","last_deep_scrub":"263'80","last_deep_scrub_stamp":"2024-09-22T08:56:41.793036+0000","last_clean_scrub_stamp":"2024-09-22T08:56:41.793036+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:29:56.743917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":87,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:47.698556+0000","last_change":"2024-09-22T08:56:47.698556+0000","last_active":"2024-09-22T08:56:47.698556+0000","last_peered":"2024-09-22T08:56:47.698556+0000","last_clean":"2024-09-22T08:56:47.698556+0000","last_became_active":"2024-09-22T08:15:13.013609+0000","last_became_peered":"2024-09-22T08:15:13.013609+0000","last_unstale":"2024-09-22T08:56:47.698556+0000","last_undegraded":"2024-09-22T08:56:47.698556+0000","last_fullsized":"2024-09-22T08:56:47.698556+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:47.698456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:47.698456+0000","last_clean_scrub_stamp":"2024-09-22T08:56:47.698456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:02:08.771934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"263'159","reported_seq":676,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:51.577389+0000","last_change":"2024-09-22T08:56:51.577389+0000","last_active":"2024-09-22T08:56:51.577389+0000","last_peered":"2024-09-22T08:56:51.577389+0000","last_clean":"2024-09-22T08:56:51.577389+0000","last_became_active":"2024-09-22T08:15:15.018984+0000","last_became_peered":"2024-09-22T08:15:15.018984+0000","last_unstale":"2024-09-22T08:56:51.577389+0000","last_undegraded":"2024-09-22T08:56:51.577389+0000","last_fullsized":"2024-09-22T08:56:51.577389+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'159","last_scrub_stamp":"2024-09-22T08:56:51.577281+0000","last_deep_scrub":"263'159","last_deep_scrub_stamp":"2024-09-22T08:56:51.577281+0000","last_clean_scrub_stamp":"2024-09-22T08:56:51.577281+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:27:42.431060+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":263,"num_read_kb":245,"num_write":379,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"263'1937","reported_seq":3656,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:38.397089+0000","last_change":"2024-09-22T08:56:38.397089+0000","last_active":"2024-09-22T08:56:38.397089+0000","last_peered":"2024-09-22T08:56:38.397089+0000","last_clean":"2024-09-22T08:56:38.397089+0000","last_became_active":"2024-09-22T08:15:06.967645+0000","last_became_peered":"2024-09-22T08:15:06.967645+0000","last_unstale":"2024-09-22T08:56:38.397089+0000","last_undegraded":"2024-09-22T08:56:38.397089+0000","last_fullsized":"2024-09-22T08:56:38.397089+0000","mapping_epoch":25,"log_start":"263'1900","ondisk_log_start":"263'1900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1937","last_scrub_stamp":"2024-09-22T08:56:38.396997+0000","last_deep_scrub":"263'1937","last_deep_scrub_stamp":"2024-09-22T08:56:38.396997+0000","last_clean_scrub_stamp":"2024-09-22T08:56:38.396997+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":1900,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:08:12.555868+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8532,"num_read_kb":7421,"num_write":2741,"num_write_kb":1214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"263'208","reported_seq":862,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:30.899665+0000","last_change":"2024-09-22T08:56:30.899610+0000","last_active":"2024-09-22T08:56:30.899665+0000","last_peered":"2024-09-22T08:56:30.899665+0000","last_clean":"2024-09-22T08:56:30.899665+0000","last_became_active":"2024-09-22T08:15:04.964798+0000","last_became_peered":"2024-09-22T08:15:04.964798+0000","last_unstale":"2024-09-22T08:56:30.899665+0000","last_undegraded":"2024-09-22T08:56:30.899665+0000","last_fullsized":"2024-09-22T08:56:30.899665+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'208","last_scrub_stamp":"2024-09-22T08:56:30.899515+0000","last_deep_scrub":"263'208","last_deep_scrub_stamp":"2024-09-22T08:56:30.899515+0000","last_clean_scrub_stamp":"2024-09-22T08:56:30.899515+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:30:20.275669+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":449,"num_read_kb":111223,"num_write":842,"num_write_kb":54102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:43.763781+0000","last_change":"2024-09-22T08:56:43.763781+0000","last_active":"2024-09-22T08:56:43.763781+0000","last_peered":"2024-09-22T08:56:43.763781+0000","last_clean":"2024-09-22T08:56:43.763781+0000","last_became_active":"2024-09-22T08:15:08.976950+0000","last_became_peered":"2024-09-22T08:15:08.976950+0000","last_unstale":"2024-09-22T08:56:43.763781+0000","last_undegraded":"2024-09-22T08:56:43.763781+0000","last_fullsized":"2024-09-22T08:56:43.763781+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:43.763686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:43.763686+0000","last_clean_scrub_stamp":"2024-09-22T08:56:43.763686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:17:48.248629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"263'112","reported_seq":652,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:50.835628+0000","last_change":"2024-09-22T08:56:50.835562+0000","last_active":"2024-09-22T08:56:50.835628+0000","last_peered":"2024-09-22T08:56:50.835628+0000","last_clean":"2024-09-22T08:56:50.835628+0000","last_became_active":"2024-09-22T08:15:10.980879+0000","last_became_peered":"2024-09-22T08:15:10.980879+0000","last_unstale":"2024-09-22T08:56:50.835628+0000","last_undegraded":"2024-09-22T08:56:50.835628+0000","last_fullsized":"2024-09-22T08:56:50.835628+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'112","last_scrub_stamp":"2024-09-22T08:56:50.835450+0000","last_deep_scrub":"263'112","last_deep_scrub_stamp":"2024-09-22T08:56:50.835450+0000","last_clean_scrub_stamp":"2024-09-22T08:56:50.835450+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:29:55.805287+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":117,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"263'783","reported_seq":2388,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:05.777234+0000","last_change":"2024-09-22T08:57:05.777234+0000","last_active":"2024-09-22T08:57:05.777234+0000","last_peered":"2024-09-22T08:57:05.777234+0000","last_clean":"2024-09-22T08:57:05.777234+0000","last_became_active":"2024-09-22T08:15:13.011812+0000","last_became_peered":"2024-09-22T08:15:13.011812+0000","last_unstale":"2024-09-22T08:57:05.777234+0000","last_undegraded":"2024-09-22T08:57:05.777234+0000","last_fullsized":"2024-09-22T08:57:05.777234+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'783","last_scrub_stamp":"2024-09-22T08:57:05.777172+0000","last_deep_scrub":"263'783","last_deep_scrub_stamp":"2024-09-22T08:57:05.777172+0000","last_clean_scrub_stamp":"2024-09-22T08:57:05.777172+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:04:10.273483+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"263'181","reported_seq":1010,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:49.286697+0000","last_change":"2024-09-22T08:56:49.286697+0000","last_active":"2024-09-22T08:56:49.286697+0000","last_peered":"2024-09-22T08:56:49.286697+0000","last_clean":"2024-09-22T08:56:49.286697+0000","last_became_active":"2024-09-22T08:15:15.015684+0000","last_became_peered":"2024-09-22T08:15:15.015684+0000","last_unstale":"2024-09-22T08:56:49.286697+0000","last_undegraded":"2024-09-22T08:56:49.286697+0000","last_fullsized":"2024-09-22T08:56:49.286697+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'181","last_scrub_stamp":"2024-09-22T08:56:49.286599+0000","last_deep_scrub":"263'181","last_deep_scrub_stamp":"2024-09-22T08:56:49.286599+0000","last_clean_scrub_stamp":"2024-09-22T08:56:49.286599+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:14:12.947006+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":616,"num_read_kb":611,"num_write":377,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"263'1260","reported_seq":2740,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:39.437610+0000","last_change":"2024-09-22T08:56:39.437610+0000","last_active":"2024-09-22T08:56:39.437610+0000","last_peered":"2024-09-22T08:56:39.437610+0000","last_clean":"2024-09-22T08:56:39.437610+0000","last_became_active":"2024-09-22T08:15:06.967323+0000","last_became_peered":"2024-09-22T08:15:06.967323+0000","last_unstale":"2024-09-22T08:56:39.437610+0000","last_undegraded":"2024-09-22T08:56:39.437610+0000","last_fullsized":"2024-09-22T08:56:39.437610+0000","mapping_epoch":25,"log_start":"263'1200","ondisk_log_start":"263'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1260","last_scrub_stamp":"2024-09-22T08:56:39.437522+0000","last_deep_scrub":"263'1260","last_deep_scrub_stamp":"2024-09-22T08:56:39.437522+0000","last_clean_scrub_stamp":"2024-09-22T08:56:39.437522+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":1200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:18:39.527856+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7857,"num_read_kb":7154,"num_write":1964,"num_write_kb":850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"263'250","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:22.920526+0000","last_change":"2024-09-22T08:56:22.920450+0000","last_active":"2024-09-22T08:56:22.920526+0000","last_peered":"2024-09-22T08:56:22.920526+0000","last_clean":"2024-09-22T08:56:22.920526+0000","last_became_active":"2024-09-22T08:15:04.959776+0000","last_became_peered":"2024-09-22T08:15:04.959776+0000","last_unstale":"2024-09-22T08:56:22.920526+0000","last_undegraded":"2024-09-22T08:56:22.920526+0000","last_fullsized":"2024-09-22T08:56:22.920526+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'250","last_scrub_stamp":"2024-09-22T08:56:22.920344+0000","last_deep_scrub":"263'250","last_deep_scrub_stamp":"2024-09-22T08:56:22.920344+0000","last_clean_scrub_stamp":"2024-09-22T08:56:22.920344+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:50:17.909839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079920,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":722,"num_read_kb":18781,"num_write":1155,"num_write_kb":38377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:53.859174+0000","last_change":"2024-09-22T08:56:53.859174+0000","last_active":"2024-09-22T08:56:53.859174+0000","last_peered":"2024-09-22T08:56:53.859174+0000","last_clean":"2024-09-22T08:56:53.859174+0000","last_became_active":"2024-09-22T08:15:08.973025+0000","last_became_peered":"2024-09-22T08:15:08.973025+0000","last_unstale":"2024-09-22T08:56:53.859174+0000","last_undegraded":"2024-09-22T08:56:53.859174+0000","last_fullsized":"2024-09-22T08:56:53.859174+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:53.859087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:53.859087+0000","last_clean_scrub_stamp":"2024-09-22T08:56:53.859087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:19:48.952735+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"263'136","reported_seq":708,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:41.416563+0000","last_change":"2024-09-22T08:56:41.416563+0000","last_active":"2024-09-22T08:56:41.416563+0000","last_peered":"2024-09-22T08:56:41.416563+0000","last_clean":"2024-09-22T08:56:41.416563+0000","last_became_active":"2024-09-22T08:15:10.985540+0000","last_became_peered":"2024-09-22T08:15:10.985540+0000","last_unstale":"2024-09-22T08:56:41.416563+0000","last_undegraded":"2024-09-22T08:56:41.416563+0000","last_fullsized":"2024-09-22T08:56:41.416563+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'136","last_scrub_stamp":"2024-09-22T08:56:41.416466+0000","last_deep_scrub":"263'136","last_deep_scrub_stamp":"2024-09-22T08:56:41.416466+0000","last_clean_scrub_stamp":"2024-09-22T08:56:41.416466+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:53:46.875429+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10933,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":231,"num_write":80,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"263'793","reported_seq":2277,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:52.381763+0000","last_change":"2024-09-22T08:56:52.381686+0000","last_active":"2024-09-22T08:56:52.381763+0000","last_peered":"2024-09-22T08:56:52.381763+0000","last_clean":"2024-09-22T08:56:52.381763+0000","last_became_active":"2024-09-22T08:15:13.004752+0000","last_became_peered":"2024-09-22T08:15:13.004752+0000","last_unstale":"2024-09-22T08:56:52.381763+0000","last_undegraded":"2024-09-22T08:56:52.381763+0000","last_fullsized":"2024-09-22T08:56:52.381763+0000","mapping_epoch":31,"log_start":"263'701","ondisk_log_start":"263'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'793","last_scrub_stamp":"2024-09-22T08:56:52.381599+0000","last_deep_scrub":"263'793","last_deep_scrub_stamp":"2024-09-22T08:56:52.381599+0000","last_clean_scrub_stamp":"2024-09-22T08:56:52.381599+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":701,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:48:13.046558+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"263'442","reported_seq":2078,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:41.865908+0000","last_change":"2024-09-22T08:56:41.865908+0000","last_active":"2024-09-22T08:56:41.865908+0000","last_peered":"2024-09-22T08:56:41.865908+0000","last_clean":"2024-09-22T08:56:41.865908+0000","last_became_active":"2024-09-22T08:15:06.965387+0000","last_became_peered":"2024-09-22T08:15:06.965387+0000","last_unstale":"2024-09-22T08:56:41.865908+0000","last_undegraded":"2024-09-22T08:56:41.865908+0000","last_fullsized":"2024-09-22T08:56:41.865908+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'442","last_scrub_stamp":"2024-09-22T08:56:41.865802+0000","last_deep_scrub":"263'442","last_deep_scrub_stamp":"2024-09-22T08:56:41.865802+0000","last_clean_scrub_stamp":"2024-09-22T08:56:41.865802+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:53:34.683831+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2432,"num_read_kb":2308,"num_write":489,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"263'281","reported_seq":931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:22.419125+0000","last_change":"2024-09-22T08:56:22.419125+0000","last_active":"2024-09-22T08:56:22.419125+0000","last_peered":"2024-09-22T08:56:22.419125+0000","last_clean":"2024-09-22T08:56:22.419125+0000","last_became_active":"2024-09-22T08:15:04.954015+0000","last_became_peered":"2024-09-22T08:15:04.954015+0000","last_unstale":"2024-09-22T08:56:22.419125+0000","last_undegraded":"2024-09-22T08:56:22.419125+0000","last_fullsized":"2024-09-22T08:56:22.419125+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'281","last_scrub_stamp":"2024-09-22T08:56:22.418992+0000","last_deep_scrub":"263'281","last_deep_scrub_stamp":"2024-09-22T08:56:22.418992+0000","last_clean_scrub_stamp":"2024-09-22T08:56:22.418992+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:44:11.997685+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079929,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":663,"num_read_kb":30289,"num_write":1087,"num_write_kb":39703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:35.772228+0000","last_change":"2024-09-22T08:56:35.772228+0000","last_active":"2024-09-22T08:56:35.772228+0000","last_peered":"2024-09-22T08:56:35.772228+0000","last_clean":"2024-09-22T08:56:35.772228+0000","last_became_active":"2024-09-22T08:15:08.982222+0000","last_became_peered":"2024-09-22T08:15:08.982222+0000","last_unstale":"2024-09-22T08:56:35.772228+0000","last_undegraded":"2024-09-22T08:56:35.772228+0000","last_fullsized":"2024-09-22T08:56:35.772228+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:35.772141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:35.772141+0000","last_clean_scrub_stamp":"2024-09-22T08:56:35.772141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:54:14.131567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"263'221","reported_seq":835,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:42.444491+0000","last_change":"2024-09-22T08:56:42.444491+0000","last_active":"2024-09-22T08:56:42.444491+0000","last_peered":"2024-09-22T08:56:42.444491+0000","last_clean":"2024-09-22T08:56:42.444491+0000","last_became_active":"2024-09-22T08:15:10.984769+0000","last_became_peered":"2024-09-22T08:15:10.984769+0000","last_unstale":"2024-09-22T08:56:42.444491+0000","last_undegraded":"2024-09-22T08:56:42.444491+0000","last_fullsized":"2024-09-22T08:56:42.444491+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'221","last_scrub_stamp":"2024-09-22T08:56:42.444370+0000","last_deep_scrub":"263'221","last_deep_scrub_stamp":"2024-09-22T08:56:42.444370+0000","last_clean_scrub_stamp":"2024-09-22T08:56:42.444370+0000","objects_scrubbed":9,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:11:33.514866+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11910,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":286,"num_read_kb":362,"num_write":166,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:47.559785+0000","last_change":"2024-09-22T08:56:47.559785+0000","last_active":"2024-09-22T08:56:47.559785+0000","last_peered":"2024-09-22T08:56:47.559785+0000","last_clean":"2024-09-22T08:56:47.559785+0000","last_became_active":"2024-09-22T08:15:13.012498+0000","last_became_peered":"2024-09-22T08:15:13.012498+0000","last_unstale":"2024-09-22T08:56:47.559785+0000","last_undegraded":"2024-09-22T08:56:47.559785+0000","last_fullsized":"2024-09-22T08:56:47.559785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:47.559700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:47.559700+0000","last_clean_scrub_stamp":"2024-09-22T08:56:47.559700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:11:39.035630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"263'559","reported_seq":1393,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:46.302312+0000","last_change":"2024-09-22T08:56:46.302205+0000","last_active":"2024-09-22T08:56:46.302312+0000","last_peered":"2024-09-22T08:56:46.302312+0000","last_clean":"2024-09-22T08:56:46.302312+0000","last_became_active":"2024-09-22T08:15:15.014801+0000","last_became_peered":"2024-09-22T08:15:15.014801+0000","last_unstale":"2024-09-22T08:56:46.302312+0000","last_undegraded":"2024-09-22T08:56:46.302312+0000","last_fullsized":"2024-09-22T08:56:46.302312+0000","mapping_epoch":33,"log_start":"263'500","ondisk_log_start":"263'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'559","last_scrub_stamp":"2024-09-22T08:56:46.302094+0000","last_deep_scrub":"263'559","last_deep_scrub_stamp":"2024-09-22T08:56:46.302094+0000","last_clean_scrub_stamp":"2024-09-22T08:56:46.302094+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":500,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:04:02.051380+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":467,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1367,"num_read_kb":1346,"num_write":1156,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"263'862","reported_seq":2456,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:25.844066+0000","last_change":"2024-09-22T08:56:25.844066+0000","last_active":"2024-09-22T08:56:25.844066+0000","last_peered":"2024-09-22T08:56:25.844066+0000","last_clean":"2024-09-22T08:56:25.844066+0000","last_became_active":"2024-09-22T08:15:06.972958+0000","last_became_peered":"2024-09-22T08:15:06.972958+0000","last_unstale":"2024-09-22T08:56:25.844066+0000","last_undegraded":"2024-09-22T08:56:25.844066+0000","last_fullsized":"2024-09-22T08:56:25.844066+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'862","last_scrub_stamp":"2024-09-22T08:56:25.843956+0000","last_deep_scrub":"263'862","last_deep_scrub_stamp":"2024-09-22T08:56:25.843956+0000","last_clean_scrub_stamp":"2024-09-22T08:56:25.843956+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":800,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:28:27.885227+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4079,"num_read_kb":3669,"num_write":1154,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"263'237","reported_seq":903,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:23.356062+0000","last_change":"2024-09-22T08:56:23.356062+0000","last_active":"2024-09-22T08:56:23.356062+0000","last_peered":"2024-09-22T08:56:23.356062+0000","last_clean":"2024-09-22T08:56:23.356062+0000","last_became_active":"2024-09-22T08:15:40.188251+0000","last_became_peered":"2024-09-22T08:15:40.188251+0000","last_unstale":"2024-09-22T08:56:23.356062+0000","last_undegraded":"2024-09-22T08:56:23.356062+0000","last_fullsized":"2024-09-22T08:56:23.356062+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'237","last_scrub_stamp":"2024-09-22T08:56:23.355989+0000","last_deep_scrub":"263'237","last_deep_scrub_stamp":"2024-09-22T08:56:23.355989+0000","last_clean_scrub_stamp":"2024-09-22T08:56:23.355989+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:24.497389+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":546,"num_read_kb":133824,"num_write":973,"num_write_kb":45053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:39.484034+0000","last_change":"2024-09-22T08:56:39.484034+0000","last_active":"2024-09-22T08:56:39.484034+0000","last_peered":"2024-09-22T08:56:39.484034+0000","last_clean":"2024-09-22T08:56:39.484034+0000","last_became_active":"2024-09-22T08:15:08.975435+0000","last_became_peered":"2024-09-22T08:15:08.975435+0000","last_unstale":"2024-09-22T08:56:39.484034+0000","last_undegraded":"2024-09-22T08:56:39.484034+0000","last_fullsized":"2024-09-22T08:56:39.484034+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:39.483931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:39.483931+0000","last_clean_scrub_stamp":"2024-09-22T08:56:39.483931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:17:40.133221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"263'131","reported_seq":705,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:47.830381+0000","last_change":"2024-09-22T08:56:47.830381+0000","last_active":"2024-09-22T08:56:47.830381+0000","last_peered":"2024-09-22T08:56:47.830381+0000","last_clean":"2024-09-22T08:56:47.830381+0000","last_became_active":"2024-09-22T08:15:10.988458+0000","last_became_peered":"2024-09-22T08:15:10.988458+0000","last_unstale":"2024-09-22T08:56:47.830381+0000","last_undegraded":"2024-09-22T08:56:47.830381+0000","last_fullsized":"2024-09-22T08:56:47.830381+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'131","last_scrub_stamp":"2024-09-22T08:56:47.830275+0000","last_deep_scrub":"263'131","last_deep_scrub_stamp":"2024-09-22T08:56:47.830275+0000","last_clean_scrub_stamp":"2024-09-22T08:56:47.830275+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:25:35.421232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8309,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":166,"num_read_kb":226,"num_write":90,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:55.818068+0000","last_change":"2024-09-22T08:56:55.818068+0000","last_active":"2024-09-22T08:56:55.818068+0000","last_peered":"2024-09-22T08:56:55.818068+0000","last_clean":"2024-09-22T08:56:55.818068+0000","last_became_active":"2024-09-22T08:15:13.002538+0000","last_became_peered":"2024-09-22T08:15:13.002538+0000","last_unstale":"2024-09-22T08:56:55.818068+0000","last_undegraded":"2024-09-22T08:56:55.818068+0000","last_fullsized":"2024-09-22T08:56:55.818068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:55.817977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:55.817977+0000","last_clean_scrub_stamp":"2024-09-22T08:56:55.817977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:59:06.947668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"263'2484","reported_seq":4321,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:48.732835+0000","last_change":"2024-09-22T08:56:48.732758+0000","last_active":"2024-09-22T08:56:48.732835+0000","last_peered":"2024-09-22T08:56:48.732835+0000","last_clean":"2024-09-22T08:56:48.732835+0000","last_became_active":"2024-09-22T08:15:15.020438+0000","last_became_peered":"2024-09-22T08:15:15.020438+0000","last_unstale":"2024-09-22T08:56:48.732835+0000","last_undegraded":"2024-09-22T08:56:48.732835+0000","last_fullsized":"2024-09-22T08:56:48.732835+0000","mapping_epoch":33,"log_start":"263'2400","ondisk_log_start":"263'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2484","last_scrub_stamp":"2024-09-22T08:56:48.732662+0000","last_deep_scrub":"263'2484","last_deep_scrub_stamp":"2024-09-22T08:56:48.732662+0000","last_clean_scrub_stamp":"2024-09-22T08:56:48.732662+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":2400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:27:02.772680+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6235,"num_read_kb":6232,"num_write":5030,"num_write_kb":1847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"263'475","reported_seq":2005,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:29.346865+0000","last_change":"2024-09-22T08:56:29.346865+0000","last_active":"2024-09-22T08:56:29.346865+0000","last_peered":"2024-09-22T08:56:29.346865+0000","last_clean":"2024-09-22T08:56:29.346865+0000","last_became_active":"2024-09-22T08:15:06.970532+0000","last_became_peered":"2024-09-22T08:15:06.970532+0000","last_unstale":"2024-09-22T08:56:29.346865+0000","last_undegraded":"2024-09-22T08:56:29.346865+0000","last_fullsized":"2024-09-22T08:56:29.346865+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'475","last_scrub_stamp":"2024-09-22T08:56:29.346768+0000","last_deep_scrub":"263'475","last_deep_scrub_stamp":"2024-09-22T08:56:29.346768+0000","last_clean_scrub_stamp":"2024-09-22T08:56:29.346768+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:04:32.692649+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2482,"num_read_kb":2307,"num_write":574,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"263'221","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:29.913763+0000","last_change":"2024-09-22T08:56:29.913763+0000","last_active":"2024-09-22T08:56:29.913763+0000","last_peered":"2024-09-22T08:56:29.913763+0000","last_clean":"2024-09-22T08:56:29.913763+0000","last_became_active":"2024-09-22T08:15:04.963648+0000","last_became_peered":"2024-09-22T08:15:04.963648+0000","last_unstale":"2024-09-22T08:56:29.913763+0000","last_undegraded":"2024-09-22T08:56:29.913763+0000","last_fullsized":"2024-09-22T08:56:29.913763+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'221","last_scrub_stamp":"2024-09-22T08:56:29.913651+0000","last_deep_scrub":"263'221","last_deep_scrub_stamp":"2024-09-22T08:56:29.913651+0000","last_clean_scrub_stamp":"2024-09-22T08:56:29.913651+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:49:53.980326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":486,"num_read_kb":19400,"num_write":968,"num_write_kb":35249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"263'4","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:45.413606+0000","last_change":"2024-09-22T08:56:45.413606+0000","last_active":"2024-09-22T08:56:45.413606+0000","last_peered":"2024-09-22T08:56:45.413606+0000","last_clean":"2024-09-22T08:56:45.413606+0000","last_became_active":"2024-09-22T08:15:08.975260+0000","last_became_peered":"2024-09-22T08:15:08.975260+0000","last_unstale":"2024-09-22T08:56:45.413606+0000","last_undegraded":"2024-09-22T08:56:45.413606+0000","last_fullsized":"2024-09-22T08:56:45.413606+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-22T08:56:45.413512+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-22T08:56:45.413512+0000","last_clean_scrub_stamp":"2024-09-22T08:56:45.413512+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:45:14.054216+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":720,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"263'165","reported_seq":757,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:56.864640+0000","last_change":"2024-09-22T08:56:56.864640+0000","last_active":"2024-09-22T08:56:56.864640+0000","last_peered":"2024-09-22T08:56:56.864640+0000","last_clean":"2024-09-22T08:56:56.864640+0000","last_became_active":"2024-09-22T08:15:10.989211+0000","last_became_peered":"2024-09-22T08:15:10.989211+0000","last_unstale":"2024-09-22T08:56:56.864640+0000","last_undegraded":"2024-09-22T08:56:56.864640+0000","last_fullsized":"2024-09-22T08:56:56.864640+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'165","last_scrub_stamp":"2024-09-22T08:56:56.864530+0000","last_deep_scrub":"263'165","last_deep_scrub_stamp":"2024-09-22T08:56:56.864530+0000","last_clean_scrub_stamp":"2024-09-22T08:56:56.864530+0000","objects_scrubbed":7,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:57:58.807869+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9099,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":211,"num_read_kb":297,"num_write":118,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"263'793","reported_seq":2283,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:55.438783+0000","last_change":"2024-09-22T08:56:55.438783+0000","last_active":"2024-09-22T08:56:55.438783+0000","last_peered":"2024-09-22T08:56:55.438783+0000","last_clean":"2024-09-22T08:56:55.438783+0000","last_became_active":"2024-09-22T08:15:13.002828+0000","last_became_peered":"2024-09-22T08:15:13.002828+0000","last_unstale":"2024-09-22T08:56:55.438783+0000","last_undegraded":"2024-09-22T08:56:55.438783+0000","last_fullsized":"2024-09-22T08:56:55.438783+0000","mapping_epoch":31,"log_start":"263'701","ondisk_log_start":"263'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'793","last_scrub_stamp":"2024-09-22T08:56:55.438696+0000","last_deep_scrub":"263'793","last_deep_scrub_stamp":"2024-09-22T08:56:55.438696+0000","last_clean_scrub_stamp":"2024-09-22T08:56:55.438696+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":701,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:41:58.568426+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"263'133","reported_seq":629,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:50.555868+0000","last_change":"2024-09-22T08:56:50.555868+0000","last_active":"2024-09-22T08:56:50.555868+0000","last_peered":"2024-09-22T08:56:50.555868+0000","last_clean":"2024-09-22T08:56:50.555868+0000","last_became_active":"2024-09-22T08:15:15.019162+0000","last_became_peered":"2024-09-22T08:15:15.019162+0000","last_unstale":"2024-09-22T08:56:50.555868+0000","last_undegraded":"2024-09-22T08:56:50.555868+0000","last_fullsized":"2024-09-22T08:56:50.555868+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'133","last_scrub_stamp":"2024-09-22T08:56:50.555734+0000","last_deep_scrub":"263'133","last_deep_scrub_stamp":"2024-09-22T08:56:50.555734+0000","last_clean_scrub_stamp":"2024-09-22T08:56:50.555734+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:43:12.119609+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":846,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":147,"num_read_kb":143,"num_write":317,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"263'518","reported_seq":2272,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:37.386846+0000","last_change":"2024-09-22T08:56:37.386846+0000","last_active":"2024-09-22T08:56:37.386846+0000","last_peered":"2024-09-22T08:56:37.386846+0000","last_clean":"2024-09-22T08:56:37.386846+0000","last_became_active":"2024-09-22T08:15:06.962528+0000","last_became_peered":"2024-09-22T08:15:06.962528+0000","last_unstale":"2024-09-22T08:56:37.386846+0000","last_undegraded":"2024-09-22T08:56:37.386846+0000","last_fullsized":"2024-09-22T08:56:37.386846+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'518","last_scrub_stamp":"2024-09-22T08:56:37.386751+0000","last_deep_scrub":"263'518","last_deep_scrub_stamp":"2024-09-22T08:56:37.386751+0000","last_clean_scrub_stamp":"2024-09-22T08:56:37.386751+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:56:21.707533+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2917,"num_read_kb":2741,"num_write":627,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2295,"num_omap_keys":9,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"263'197","reported_seq":822,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:23.466120+0000","last_change":"2024-09-22T08:56:23.466120+0000","last_active":"2024-09-22T08:56:23.466120+0000","last_peered":"2024-09-22T08:56:23.466120+0000","last_clean":"2024-09-22T08:56:23.466120+0000","last_became_active":"2024-09-22T08:15:04.947739+0000","last_became_peered":"2024-09-22T08:15:04.947739+0000","last_unstale":"2024-09-22T08:56:23.466120+0000","last_undegraded":"2024-09-22T08:56:23.466120+0000","last_fullsized":"2024-09-22T08:56:23.466120+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'197","last_scrub_stamp":"2024-09-22T08:56:23.466035+0000","last_deep_scrub":"263'197","last_deep_scrub_stamp":"2024-09-22T08:56:23.466035+0000","last_clean_scrub_stamp":"2024-09-22T08:56:23.466035+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:03:56.435199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":453,"num_read_kb":50575,"num_write":904,"num_write_kb":23711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:38.470627+0000","last_change":"2024-09-22T08:56:38.470627+0000","last_active":"2024-09-22T08:56:38.470627+0000","last_peered":"2024-09-22T08:56:38.470627+0000","last_clean":"2024-09-22T08:56:38.470627+0000","last_became_active":"2024-09-22T08:15:08.974693+0000","last_became_peered":"2024-09-22T08:15:08.974693+0000","last_unstale":"2024-09-22T08:56:38.470627+0000","last_undegraded":"2024-09-22T08:56:38.470627+0000","last_fullsized":"2024-09-22T08:56:38.470627+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:38.470537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:38.470537+0000","last_clean_scrub_stamp":"2024-09-22T08:56:38.470537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:48:40.724650+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"263'199","reported_seq":834,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:49.810754+0000","last_change":"2024-09-22T08:56:49.810754+0000","last_active":"2024-09-22T08:56:49.810754+0000","last_peered":"2024-09-22T08:56:49.810754+0000","last_clean":"2024-09-22T08:56:49.810754+0000","last_became_active":"2024-09-22T08:15:10.984402+0000","last_became_peered":"2024-09-22T08:15:10.984402+0000","last_unstale":"2024-09-22T08:56:49.810754+0000","last_undegraded":"2024-09-22T08:56:49.810754+0000","last_fullsized":"2024-09-22T08:56:49.810754+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'199","last_scrub_stamp":"2024-09-22T08:56:49.810653+0000","last_deep_scrub":"263'199","last_deep_scrub_stamp":"2024-09-22T08:56:49.810653+0000","last_clean_scrub_stamp":"2024-09-22T08:56:49.810653+0000","objects_scrubbed":6,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:07:41.914863+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13027,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":258,"num_read_kb":332,"num_write":120,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:51.387247+0000","last_change":"2024-09-22T08:56:51.387247+0000","last_active":"2024-09-22T08:56:51.387247+0000","last_peered":"2024-09-22T08:56:51.387247+0000","last_clean":"2024-09-22T08:56:51.387247+0000","last_became_active":"2024-09-22T08:15:13.014612+0000","last_became_peered":"2024-09-22T08:15:13.014612+0000","last_unstale":"2024-09-22T08:56:51.387247+0000","last_undegraded":"2024-09-22T08:56:51.387247+0000","last_fullsized":"2024-09-22T08:56:51.387247+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:51.387155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:51.387155+0000","last_clean_scrub_stamp":"2024-09-22T08:56:51.387155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:53:08.036240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"263'141","reported_seq":662,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:49.317205+0000","last_change":"2024-09-22T08:56:49.317205+0000","last_active":"2024-09-22T08:56:49.317205+0000","last_peered":"2024-09-22T08:56:49.317205+0000","last_clean":"2024-09-22T08:56:49.317205+0000","last_became_active":"2024-09-22T08:15:15.011332+0000","last_became_peered":"2024-09-22T08:15:15.011332+0000","last_unstale":"2024-09-22T08:56:49.317205+0000","last_undegraded":"2024-09-22T08:56:49.317205+0000","last_fullsized":"2024-09-22T08:56:49.317205+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'141","last_scrub_stamp":"2024-09-22T08:56:49.317109+0000","last_deep_scrub":"263'141","last_deep_scrub_stamp":"2024-09-22T08:56:49.317109+0000","last_clean_scrub_stamp":"2024-09-22T08:56:49.317109+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:22.198803+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":195,"num_read_kb":186,"num_write":318,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"263'477","reported_seq":2059,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:32.476096+0000","last_change":"2024-09-22T08:56:32.476096+0000","last_active":"2024-09-22T08:56:32.476096+0000","last_peered":"2024-09-22T08:56:32.476096+0000","last_clean":"2024-09-22T08:56:32.476096+0000","last_became_active":"2024-09-22T08:15:06.966708+0000","last_became_peered":"2024-09-22T08:15:06.966708+0000","last_unstale":"2024-09-22T08:56:32.476096+0000","last_undegraded":"2024-09-22T08:56:32.476096+0000","last_fullsized":"2024-09-22T08:56:32.476096+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'477","last_scrub_stamp":"2024-09-22T08:56:32.476005+0000","last_deep_scrub":"263'477","last_deep_scrub_stamp":"2024-09-22T08:56:32.476005+0000","last_clean_scrub_stamp":"2024-09-22T08:56:32.476005+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:28:16.584918+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2455,"num_read_kb":2308,"num_write":546,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"263'250","reported_seq":890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:25.088528+0000","last_change":"2024-09-22T08:56:25.088528+0000","last_active":"2024-09-22T08:56:25.088528+0000","last_peered":"2024-09-22T08:56:25.088528+0000","last_clean":"2024-09-22T08:56:25.088528+0000","last_became_active":"2024-09-22T08:15:04.949202+0000","last_became_peered":"2024-09-22T08:15:04.949202+0000","last_unstale":"2024-09-22T08:56:25.088528+0000","last_undegraded":"2024-09-22T08:56:25.088528+0000","last_fullsized":"2024-09-22T08:56:25.088528+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'250","last_scrub_stamp":"2024-09-22T08:56:25.088391+0000","last_deep_scrub":"263'250","last_deep_scrub_stamp":"2024-09-22T08:56:25.088391+0000","last_clean_scrub_stamp":"2024-09-22T08:56:25.088391+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:53.098601+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1386384,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":583,"num_read_kb":11398,"num_write":1166,"num_write_kb":28598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:38.128844+0000","last_change":"2024-09-22T08:56:38.128844+0000","last_active":"2024-09-22T08:56:38.128844+0000","last_peered":"2024-09-22T08:56:38.128844+0000","last_clean":"2024-09-22T08:56:38.128844+0000","last_became_active":"2024-09-22T08:15:08.978280+0000","last_became_peered":"2024-09-22T08:15:08.978280+0000","last_unstale":"2024-09-22T08:56:38.128844+0000","last_undegraded":"2024-09-22T08:56:38.128844+0000","last_fullsized":"2024-09-22T08:56:38.128844+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:38.128742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:38.128742+0000","last_clean_scrub_stamp":"2024-09-22T08:56:38.128742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:21:13.730058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"263'174","reported_seq":753,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:39.780381+0000","last_change":"2024-09-22T08:56:39.780381+0000","last_active":"2024-09-22T08:56:39.780381+0000","last_peered":"2024-09-22T08:56:39.780381+0000","last_clean":"2024-09-22T08:56:39.780381+0000","last_became_active":"2024-09-22T08:15:10.986433+0000","last_became_peered":"2024-09-22T08:15:10.986433+0000","last_unstale":"2024-09-22T08:56:39.780381+0000","last_undegraded":"2024-09-22T08:56:39.780381+0000","last_fullsized":"2024-09-22T08:56:39.780381+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'174","last_scrub_stamp":"2024-09-22T08:56:39.780268+0000","last_deep_scrub":"263'174","last_deep_scrub_stamp":"2024-09-22T08:56:39.780268+0000","last_clean_scrub_stamp":"2024-09-22T08:56:39.780268+0000","objects_scrubbed":6,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:46:14.302166+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8940,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":228,"num_read_kb":301,"num_write":186,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:42.207072+0000","last_change":"2024-09-22T08:56:42.207072+0000","last_active":"2024-09-22T08:56:42.207072+0000","last_peered":"2024-09-22T08:56:42.207072+0000","last_clean":"2024-09-22T08:56:42.207072+0000","last_became_active":"2024-09-22T08:15:12.999036+0000","last_became_peered":"2024-09-22T08:15:12.999036+0000","last_unstale":"2024-09-22T08:56:42.207072+0000","last_undegraded":"2024-09-22T08:56:42.207072+0000","last_fullsized":"2024-09-22T08:56:42.207072+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:42.206974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:42.206974+0000","last_clean_scrub_stamp":"2024-09-22T08:56:42.206974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:57:59.149011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"263'100","reported_seq":598,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:53.433310+0000","last_change":"2024-09-22T08:56:53.433256+0000","last_active":"2024-09-22T08:56:53.433310+0000","last_peered":"2024-09-22T08:56:53.433310+0000","last_clean":"2024-09-22T08:56:53.433310+0000","last_became_active":"2024-09-22T08:15:15.011949+0000","last_became_peered":"2024-09-22T08:15:15.011949+0000","last_unstale":"2024-09-22T08:56:53.433310+0000","last_undegraded":"2024-09-22T08:56:53.433310+0000","last_fullsized":"2024-09-22T08:56:53.433310+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'100","last_scrub_stamp":"2024-09-22T08:56:53.433157+0000","last_deep_scrub":"263'100","last_deep_scrub_stamp":"2024-09-22T08:56:53.433157+0000","last_clean_scrub_stamp":"2024-09-22T08:56:53.433157+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:31:51.822201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":93,"num_read_kb":93,"num_write":223,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"263'829","reported_seq":2617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:40.852542+0000","last_change":"2024-09-22T08:56:40.852542+0000","last_active":"2024-09-22T08:56:40.852542+0000","last_peered":"2024-09-22T08:56:40.852542+0000","last_clean":"2024-09-22T08:56:40.852542+0000","last_became_active":"2024-09-22T08:15:06.966795+0000","last_became_peered":"2024-09-22T08:15:06.966795+0000","last_unstale":"2024-09-22T08:56:40.852542+0000","last_undegraded":"2024-09-22T08:56:40.852542+0000","last_fullsized":"2024-09-22T08:56:40.852542+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'829","last_scrub_stamp":"2024-09-22T08:56:40.852447+0000","last_deep_scrub":"263'829","last_deep_scrub_stamp":"2024-09-22T08:56:40.852447+0000","last_clean_scrub_stamp":"2024-09-22T08:56:40.852447+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:33:27.427428+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4273,"num_read_kb":3896,"num_write":1079,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3244,"num_omap_keys":13,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"263'222","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:27.930142+0000","last_change":"2024-09-22T08:56:27.930142+0000","last_active":"2024-09-22T08:56:27.930142+0000","last_peered":"2024-09-22T08:56:27.930142+0000","last_clean":"2024-09-22T08:56:27.930142+0000","last_became_active":"2024-09-22T08:15:04.954492+0000","last_became_peered":"2024-09-22T08:15:04.954492+0000","last_unstale":"2024-09-22T08:56:27.930142+0000","last_undegraded":"2024-09-22T08:56:27.930142+0000","last_fullsized":"2024-09-22T08:56:27.930142+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'222","last_scrub_stamp":"2024-09-22T08:56:27.930037+0000","last_deep_scrub":"263'222","last_deep_scrub_stamp":"2024-09-22T08:56:27.930037+0000","last_clean_scrub_stamp":"2024-09-22T08:56:27.930037+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:04:52.837489+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079919,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":477,"num_read_kb":44813,"num_write":947,"num_write_kb":39223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:46.438084+0000","last_change":"2024-09-22T08:56:46.438084+0000","last_active":"2024-09-22T08:56:46.438084+0000","last_peered":"2024-09-22T08:56:46.438084+0000","last_clean":"2024-09-22T08:56:46.438084+0000","last_became_active":"2024-09-22T08:15:08.976990+0000","last_became_peered":"2024-09-22T08:15:08.976990+0000","last_unstale":"2024-09-22T08:56:46.438084+0000","last_undegraded":"2024-09-22T08:56:46.438084+0000","last_fullsized":"2024-09-22T08:56:46.438084+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:46.437993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:46.437993+0000","last_clean_scrub_stamp":"2024-09-22T08:56:46.437993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:36:06.743042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"263'156","reported_seq":747,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:48.405014+0000","last_change":"2024-09-22T08:56:48.405014+0000","last_active":"2024-09-22T08:56:48.405014+0000","last_peered":"2024-09-22T08:56:48.405014+0000","last_clean":"2024-09-22T08:56:48.405014+0000","last_became_active":"2024-09-22T08:15:10.979449+0000","last_became_peered":"2024-09-22T08:15:10.979449+0000","last_unstale":"2024-09-22T08:56:48.405014+0000","last_undegraded":"2024-09-22T08:56:48.405014+0000","last_fullsized":"2024-09-22T08:56:48.405014+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'156","last_scrub_stamp":"2024-09-22T08:56:48.404914+0000","last_deep_scrub":"263'156","last_deep_scrub_stamp":"2024-09-22T08:56:48.404914+0000","last_clean_scrub_stamp":"2024-09-22T08:56:48.404914+0000","objects_scrubbed":7,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:26:48.853422+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6421,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":192,"num_read_kb":205,"num_write":100,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"263'771","reported_seq":4259,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:40.149276+0000","last_change":"2024-09-22T08:56:40.149276+0000","last_active":"2024-09-22T08:56:40.149276+0000","last_peered":"2024-09-22T08:56:40.149276+0000","last_clean":"2024-09-22T08:56:40.149276+0000","last_became_active":"2024-09-22T08:15:13.015504+0000","last_became_peered":"2024-09-22T08:15:13.015504+0000","last_unstale":"2024-09-22T08:56:40.149276+0000","last_undegraded":"2024-09-22T08:56:40.149276+0000","last_fullsized":"2024-09-22T08:56:40.149276+0000","mapping_epoch":31,"log_start":"263'701","ondisk_log_start":"263'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'771","last_scrub_stamp":"2024-09-22T08:56:40.149185+0000","last_deep_scrub":"263'771","last_deep_scrub_stamp":"2024-09-22T08:56:40.149185+0000","last_clean_scrub_stamp":"2024-09-22T08:56:40.149185+0000","objects_scrubbed":1,"log_size":70,"log_dups_size":701,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:21.199547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"263'135","reported_seq":640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:49.589765+0000","last_change":"2024-09-22T08:56:49.589694+0000","last_active":"2024-09-22T08:56:49.589765+0000","last_peered":"2024-09-22T08:56:49.589765+0000","last_clean":"2024-09-22T08:56:49.589765+0000","last_became_active":"2024-09-22T08:15:15.017584+0000","last_became_peered":"2024-09-22T08:15:15.017584+0000","last_unstale":"2024-09-22T08:56:49.589765+0000","last_undegraded":"2024-09-22T08:56:49.589765+0000","last_fullsized":"2024-09-22T08:56:49.589765+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'135","last_scrub_stamp":"2024-09-22T08:56:49.589600+0000","last_deep_scrub":"263'135","last_deep_scrub_stamp":"2024-09-22T08:56:49.589600+0000","last_clean_scrub_stamp":"2024-09-22T08:56:49.589600+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:37:33.886633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":193,"num_read_kb":181,"num_write":318,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"263'746","reported_seq":2330,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:35.418814+0000","last_change":"2024-09-22T08:56:35.418814+0000","last_active":"2024-09-22T08:56:35.418814+0000","last_peered":"2024-09-22T08:56:35.418814+0000","last_clean":"2024-09-22T08:56:35.418814+0000","last_became_active":"2024-09-22T08:15:06.973918+0000","last_became_peered":"2024-09-22T08:15:06.973918+0000","last_unstale":"2024-09-22T08:56:35.418814+0000","last_undegraded":"2024-09-22T08:56:35.418814+0000","last_fullsized":"2024-09-22T08:56:35.418814+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'746","last_scrub_stamp":"2024-09-22T08:56:35.418722+0000","last_deep_scrub":"263'746","last_deep_scrub_stamp":"2024-09-22T08:56:35.418722+0000","last_clean_scrub_stamp":"2024-09-22T08:56:35.418722+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":700,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:24:01.261807+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3813,"num_read_kb":3478,"num_write":973,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"263'231","reported_seq":896,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:28.938830+0000","last_change":"2024-09-22T08:56:28.938830+0000","last_active":"2024-09-22T08:56:28.938830+0000","last_peered":"2024-09-22T08:56:28.938830+0000","last_clean":"2024-09-22T08:56:28.938830+0000","last_became_active":"2024-09-22T08:15:04.958336+0000","last_became_peered":"2024-09-22T08:15:04.958336+0000","last_unstale":"2024-09-22T08:56:28.938830+0000","last_undegraded":"2024-09-22T08:56:28.938830+0000","last_fullsized":"2024-09-22T08:56:28.938830+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'231","last_scrub_stamp":"2024-09-22T08:56:28.938691+0000","last_deep_scrub":"263'231","last_deep_scrub_stamp":"2024-09-22T08:56:28.938691+0000","last_clean_scrub_stamp":"2024-09-22T08:56:28.938691+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:30.008305+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":654,"num_read_kb":3596,"num_write":1077,"num_write_kb":27039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"263'4","reported_seq":1457,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:37.780914+0000","last_change":"2024-09-22T08:56:37.780914+0000","last_active":"2024-09-22T08:56:37.780914+0000","last_peered":"2024-09-22T08:56:37.780914+0000","last_clean":"2024-09-22T08:56:37.780914+0000","last_became_active":"2024-09-22T08:15:08.982221+0000","last_became_peered":"2024-09-22T08:15:08.982221+0000","last_unstale":"2024-09-22T08:56:37.780914+0000","last_undegraded":"2024-09-22T08:56:37.780914+0000","last_fullsized":"2024-09-22T08:56:37.780914+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-22T08:56:37.780814+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-22T08:56:37.780814+0000","last_clean_scrub_stamp":"2024-09-22T08:56:37.780814+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:28:47.547033+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":950,"num_read_kb":950,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"263'78","reported_seq":598,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:43.533476+0000","last_change":"2024-09-22T08:56:43.533476+0000","last_active":"2024-09-22T08:56:43.533476+0000","last_peered":"2024-09-22T08:56:43.533476+0000","last_clean":"2024-09-22T08:56:43.533476+0000","last_became_active":"2024-09-22T08:15:10.987273+0000","last_became_peered":"2024-09-22T08:15:10.987273+0000","last_unstale":"2024-09-22T08:56:43.533476+0000","last_undegraded":"2024-09-22T08:56:43.533476+0000","last_fullsized":"2024-09-22T08:56:43.533476+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'78","last_scrub_stamp":"2024-09-22T08:56:43.533371+0000","last_deep_scrub":"263'78","last_deep_scrub_stamp":"2024-09-22T08:56:43.533371+0000","last_clean_scrub_stamp":"2024-09-22T08:56:43.533371+0000","objects_scrubbed":5,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:01:13.534183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"263'791","reported_seq":2320,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:45.734603+0000","last_change":"2024-09-22T08:56:45.734603+0000","last_active":"2024-09-22T08:56:45.734603+0000","last_peered":"2024-09-22T08:56:45.734603+0000","last_clean":"2024-09-22T08:56:45.734603+0000","last_became_active":"2024-09-22T08:15:13.010641+0000","last_became_peered":"2024-09-22T08:15:13.010641+0000","last_unstale":"2024-09-22T08:56:45.734603+0000","last_undegraded":"2024-09-22T08:56:45.734603+0000","last_fullsized":"2024-09-22T08:56:45.734603+0000","mapping_epoch":31,"log_start":"263'701","ondisk_log_start":"263'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'791","last_scrub_stamp":"2024-09-22T08:56:45.734525+0000","last_deep_scrub":"263'791","last_deep_scrub_stamp":"2024-09-22T08:56:45.734525+0000","last_clean_scrub_stamp":"2024-09-22T08:56:45.734525+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":701,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:51:11.341773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"263'125","reported_seq":629,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:47.296418+0000","last_change":"2024-09-22T08:56:47.296344+0000","last_active":"2024-09-22T08:56:47.296418+0000","last_peered":"2024-09-22T08:56:47.296418+0000","last_clean":"2024-09-22T08:56:47.296418+0000","last_became_active":"2024-09-22T08:15:15.014775+0000","last_became_peered":"2024-09-22T08:15:15.014775+0000","last_unstale":"2024-09-22T08:56:47.296418+0000","last_undegraded":"2024-09-22T08:56:47.296418+0000","last_fullsized":"2024-09-22T08:56:47.296418+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'125","last_scrub_stamp":"2024-09-22T08:56:47.296257+0000","last_deep_scrub":"263'125","last_deep_scrub_stamp":"2024-09-22T08:56:47.296257+0000","last_clean_scrub_stamp":"2024-09-22T08:56:47.296257+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:25:15.152835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":160,"num_write":304,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"263'416","reported_seq":1980,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:28.069522+0000","last_change":"2024-09-22T08:56:28.069522+0000","last_active":"2024-09-22T08:56:28.069522+0000","last_peered":"2024-09-22T08:56:28.069522+0000","last_clean":"2024-09-22T08:56:28.069522+0000","last_became_active":"2024-09-22T08:15:06.957239+0000","last_became_peered":"2024-09-22T08:15:06.957239+0000","last_unstale":"2024-09-22T08:56:28.069522+0000","last_undegraded":"2024-09-22T08:56:28.069522+0000","last_fullsized":"2024-09-22T08:56:28.069522+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'416","last_scrub_stamp":"2024-09-22T08:56:28.069427+0000","last_deep_scrub":"263'416","last_deep_scrub_stamp":"2024-09-22T08:56:28.069427+0000","last_clean_scrub_stamp":"2024-09-22T08:56:28.069427+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:11:54.954287+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2251,"num_read_kb":2145,"num_write":475,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"263'273","reported_seq":963,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:26.484287+0000","last_change":"2024-09-22T08:56:26.484287+0000","last_active":"2024-09-22T08:56:26.484287+0000","last_peered":"2024-09-22T08:56:26.484287+0000","last_clean":"2024-09-22T08:56:26.484287+0000","last_became_active":"2024-09-22T08:15:04.943906+0000","last_became_peered":"2024-09-22T08:15:04.943906+0000","last_unstale":"2024-09-22T08:56:26.484287+0000","last_undegraded":"2024-09-22T08:56:26.484287+0000","last_fullsized":"2024-09-22T08:56:26.484287+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'273","last_scrub_stamp":"2024-09-22T08:56:26.484114+0000","last_deep_scrub":"263'273","last_deep_scrub_stamp":"2024-09-22T08:56:26.484114+0000","last_clean_scrub_stamp":"2024-09-22T08:56:26.484114+0000","objects_scrubbed":3,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:37:56.831727+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079942,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":793,"num_read_kb":68557,"num_write":1190,"num_write_kb":29712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:50.883370+0000","last_change":"2024-09-22T08:56:50.883370+0000","last_active":"2024-09-22T08:56:50.883370+0000","last_peered":"2024-09-22T08:56:50.883370+0000","last_clean":"2024-09-22T08:56:50.883370+0000","last_became_active":"2024-09-22T08:15:08.969175+0000","last_became_peered":"2024-09-22T08:15:08.969175+0000","last_unstale":"2024-09-22T08:56:50.883370+0000","last_undegraded":"2024-09-22T08:56:50.883370+0000","last_fullsized":"2024-09-22T08:56:50.883370+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:50.883288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:50.883288+0000","last_clean_scrub_stamp":"2024-09-22T08:56:50.883288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:44:13.341062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"263'201","reported_seq":811,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:40.829949+0000","last_change":"2024-09-22T08:56:40.829949+0000","last_active":"2024-09-22T08:56:40.829949+0000","last_peered":"2024-09-22T08:56:40.829949+0000","last_clean":"2024-09-22T08:56:40.829949+0000","last_became_active":"2024-09-22T08:15:10.987081+0000","last_became_peered":"2024-09-22T08:15:10.987081+0000","last_unstale":"2024-09-22T08:56:40.829949+0000","last_undegraded":"2024-09-22T08:56:40.829949+0000","last_fullsized":"2024-09-22T08:56:40.829949+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'201","last_scrub_stamp":"2024-09-22T08:56:40.829842+0000","last_deep_scrub":"263'201","last_deep_scrub_stamp":"2024-09-22T08:56:40.829842+0000","last_clean_scrub_stamp":"2024-09-22T08:56:40.829842+0000","objects_scrubbed":8,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:08:13.921355+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5409,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":251,"num_read_kb":285,"num_write":138,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:43.325337+0000","last_change":"2024-09-22T08:56:43.325337+0000","last_active":"2024-09-22T08:56:43.325337+0000","last_peered":"2024-09-22T08:56:43.325337+0000","last_clean":"2024-09-22T08:56:43.325337+0000","last_became_active":"2024-09-22T08:15:13.007735+0000","last_became_peered":"2024-09-22T08:15:13.007735+0000","last_unstale":"2024-09-22T08:56:43.325337+0000","last_undegraded":"2024-09-22T08:56:43.325337+0000","last_fullsized":"2024-09-22T08:56:43.325337+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:43.325244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:43.325244+0000","last_clean_scrub_stamp":"2024-09-22T08:56:43.325244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:36:29.351234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"263'155","reported_seq":657,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:47.265631+0000","last_change":"2024-09-22T08:56:47.265578+0000","last_active":"2024-09-22T08:56:47.265631+0000","last_peered":"2024-09-22T08:56:47.265631+0000","last_clean":"2024-09-22T08:56:47.265631+0000","last_became_active":"2024-09-22T08:15:15.013216+0000","last_became_peered":"2024-09-22T08:15:15.013216+0000","last_unstale":"2024-09-22T08:56:47.265631+0000","last_undegraded":"2024-09-22T08:56:47.265631+0000","last_fullsized":"2024-09-22T08:56:47.265631+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'155","last_scrub_stamp":"2024-09-22T08:56:47.265466+0000","last_deep_scrub":"263'155","last_deep_scrub_stamp":"2024-09-22T08:56:47.265466+0000","last_clean_scrub_stamp":"2024-09-22T08:56:47.265466+0000","objects_scrubbed":6,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:25:17.464430+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1066,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":167,"num_read_kb":166,"num_write":339,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"263'394","reported_seq":1972,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:39.809906+0000","last_change":"2024-09-22T08:56:39.809824+0000","last_active":"2024-09-22T08:56:39.809906+0000","last_peered":"2024-09-22T08:56:39.809906+0000","last_clean":"2024-09-22T08:56:39.809906+0000","last_became_active":"2024-09-22T08:15:06.966710+0000","last_became_peered":"2024-09-22T08:15:06.966710+0000","last_unstale":"2024-09-22T08:56:39.809906+0000","last_undegraded":"2024-09-22T08:56:39.809906+0000","last_fullsized":"2024-09-22T08:56:39.809906+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'394","last_scrub_stamp":"2024-09-22T08:56:39.809723+0000","last_deep_scrub":"263'394","last_deep_scrub_stamp":"2024-09-22T08:56:39.809723+0000","last_clean_scrub_stamp":"2024-09-22T08:56:39.809723+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:25:17.819687+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2363,"num_read_kb":2266,"num_write":458,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"263'74","reported_seq":622,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:23.906239+0000","last_change":"2024-09-22T08:56:23.906168+0000","last_active":"2024-09-22T08:56:23.906239+0000","last_peered":"2024-09-22T08:56:23.906239+0000","last_clean":"2024-09-22T08:56:23.906239+0000","last_became_active":"2024-09-22T08:14:48.584210+0000","last_became_peered":"2024-09-22T08:14:48.584210+0000","last_unstale":"2024-09-22T08:56:23.906239+0000","last_undegraded":"2024-09-22T08:56:23.906239+0000","last_fullsized":"2024-09-22T08:56:23.906239+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'74","last_scrub_stamp":"2024-09-22T08:56:23.906086+0000","last_deep_scrub":"263'74","last_deep_scrub_stamp":"2024-09-22T08:56:23.906086+0000","last_clean_scrub_stamp":"2024-09-22T08:56:23.906086+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:41:31.894467+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"263'2","reported_seq":532,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:24.997667+0000","last_change":"2024-09-22T08:56:24.997623+0000","last_active":"2024-09-22T08:56:24.997667+0000","last_peered":"2024-09-22T08:56:24.997667+0000","last_clean":"2024-09-22T08:56:24.997667+0000","last_became_active":"2024-09-22T08:14:54.727501+0000","last_became_peered":"2024-09-22T08:14:54.727501+0000","last_unstale":"2024-09-22T08:56:24.997667+0000","last_undegraded":"2024-09-22T08:56:24.997667+0000","last_fullsized":"2024-09-22T08:56:24.997667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:56:24.997551+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:56:24.997551+0000","last_clean_scrub_stamp":"2024-09-22T08:56:24.997551+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:35:48.958613+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001065632,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"263'182","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:23.521553+0000","last_change":"2024-09-22T08:56:23.521494+0000","last_active":"2024-09-22T08:56:23.521553+0000","last_peered":"2024-09-22T08:56:23.521553+0000","last_clean":"2024-09-22T08:56:23.521553+0000","last_became_active":"2024-09-22T08:15:04.963447+0000","last_became_peered":"2024-09-22T08:15:04.963447+0000","last_unstale":"2024-09-22T08:56:23.521553+0000","last_undegraded":"2024-09-22T08:56:23.521553+0000","last_fullsized":"2024-09-22T08:56:23.521553+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'182","last_scrub_stamp":"2024-09-22T08:56:23.521376+0000","last_deep_scrub":"263'182","last_deep_scrub_stamp":"2024-09-22T08:56:23.521376+0000","last_clean_scrub_stamp":"2024-09-22T08:56:23.521376+0000","objects_scrubbed":3,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:36:09.902043+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":624,"num_read_kb":9185,"num_write":876,"num_write_kb":23340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:39.482287+0000","last_change":"2024-09-22T08:56:39.482217+0000","last_active":"2024-09-22T08:56:39.482287+0000","last_peered":"2024-09-22T08:56:39.482287+0000","last_clean":"2024-09-22T08:56:39.482287+0000","last_became_active":"2024-09-22T08:15:08.978755+0000","last_became_peered":"2024-09-22T08:15:08.978755+0000","last_unstale":"2024-09-22T08:56:39.482287+0000","last_undegraded":"2024-09-22T08:56:39.482287+0000","last_fullsized":"2024-09-22T08:56:39.482287+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:39.482129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:39.482129+0000","last_clean_scrub_stamp":"2024-09-22T08:56:39.482129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:10:09.797452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"263'285","reported_seq":993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:55.855685+0000","last_change":"2024-09-22T08:56:55.855685+0000","last_active":"2024-09-22T08:56:55.855685+0000","last_peered":"2024-09-22T08:56:55.855685+0000","last_clean":"2024-09-22T08:56:55.855685+0000","last_became_active":"2024-09-22T08:15:10.991050+0000","last_became_peered":"2024-09-22T08:15:10.991050+0000","last_unstale":"2024-09-22T08:56:55.855685+0000","last_undegraded":"2024-09-22T08:56:55.855685+0000","last_fullsized":"2024-09-22T08:56:55.855685+0000","mapping_epoch":29,"log_start":"260'200","ondisk_log_start":"260'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'285","last_scrub_stamp":"2024-09-22T08:56:55.855582+0000","last_deep_scrub":"263'285","last_deep_scrub_stamp":"2024-09-22T08:56:55.855582+0000","last_clean_scrub_stamp":"2024-09-22T08:56:55.855582+0000","objects_scrubbed":6,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:35:16.766711+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27910,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":531,"num_read_kb":745,"num_write":430,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89604,"num_omap_keys":214,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:50.371545+0000","last_change":"2024-09-22T08:56:50.371545+0000","last_active":"2024-09-22T08:56:50.371545+0000","last_peered":"2024-09-22T08:56:50.371545+0000","last_clean":"2024-09-22T08:56:50.371545+0000","last_became_active":"2024-09-22T08:15:13.018627+0000","last_became_peered":"2024-09-22T08:15:13.018627+0000","last_unstale":"2024-09-22T08:56:50.371545+0000","last_undegraded":"2024-09-22T08:56:50.371545+0000","last_fullsized":"2024-09-22T08:56:50.371545+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:50.371455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:50.371455+0000","last_clean_scrub_stamp":"2024-09-22T08:56:50.371455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:29:20.855982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"263'228","reported_seq":962,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:45.423312+0000","last_change":"2024-09-22T08:56:45.423312+0000","last_active":"2024-09-22T08:56:45.423312+0000","last_peered":"2024-09-22T08:56:45.423312+0000","last_clean":"2024-09-22T08:56:45.423312+0000","last_became_active":"2024-09-22T08:15:15.017533+0000","last_became_peered":"2024-09-22T08:15:15.017533+0000","last_unstale":"2024-09-22T08:56:45.423312+0000","last_undegraded":"2024-09-22T08:56:45.423312+0000","last_fullsized":"2024-09-22T08:56:45.423312+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'228","last_scrub_stamp":"2024-09-22T08:56:45.423222+0000","last_deep_scrub":"263'228","last_deep_scrub_stamp":"2024-09-22T08:56:45.423222+0000","last_clean_scrub_stamp":"2024-09-22T08:56:45.423222+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:57:26.111196+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":616,"num_read_kb":580,"num_write":434,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"263'397","reported_seq":1968,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:36.374074+0000","last_change":"2024-09-22T08:56:36.374074+0000","last_active":"2024-09-22T08:56:36.374074+0000","last_peered":"2024-09-22T08:56:36.374074+0000","last_clean":"2024-09-22T08:56:36.374074+0000","last_became_active":"2024-09-22T08:15:06.966792+0000","last_became_peered":"2024-09-22T08:15:06.966792+0000","last_unstale":"2024-09-22T08:56:36.374074+0000","last_undegraded":"2024-09-22T08:56:36.374074+0000","last_fullsized":"2024-09-22T08:56:36.374074+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'397","last_scrub_stamp":"2024-09-22T08:56:36.373981+0000","last_deep_scrub":"263'397","last_deep_scrub_stamp":"2024-09-22T08:56:36.373981+0000","last_clean_scrub_stamp":"2024-09-22T08:56:36.373981+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:00:10.052430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2208,"num_read_kb":2116,"num_write":452,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":531,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:22.986425+0000","last_change":"2024-09-22T08:56:22.986343+0000","last_active":"2024-09-22T08:56:22.986425+0000","last_peered":"2024-09-22T08:56:22.986425+0000","last_clean":"2024-09-22T08:56:22.986425+0000","last_became_active":"2024-09-22T08:14:54.726875+0000","last_became_peered":"2024-09-22T08:14:54.726875+0000","last_unstale":"2024-09-22T08:56:22.986425+0000","last_undegraded":"2024-09-22T08:56:22.986425+0000","last_fullsized":"2024-09-22T08:56:22.986425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:22.986260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:22.986260+0000","last_clean_scrub_stamp":"2024-09-22T08:56:22.986260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:13:47.646650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000558433,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"263'182","reported_seq":796,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:31.472701+0000","last_change":"2024-09-22T08:56:31.472650+0000","last_active":"2024-09-22T08:56:31.472701+0000","last_peered":"2024-09-22T08:56:31.472701+0000","last_clean":"2024-09-22T08:56:31.472701+0000","last_became_active":"2024-09-22T08:15:04.963967+0000","last_became_peered":"2024-09-22T08:15:04.963967+0000","last_unstale":"2024-09-22T08:56:31.472701+0000","last_undegraded":"2024-09-22T08:56:31.472701+0000","last_fullsized":"2024-09-22T08:56:31.472701+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'182","last_scrub_stamp":"2024-09-22T08:56:31.472539+0000","last_deep_scrub":"263'182","last_deep_scrub_stamp":"2024-09-22T08:56:31.472539+0000","last_clean_scrub_stamp":"2024-09-22T08:56:31.472539+0000","objects_scrubbed":2,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:54:16.950622+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":424,"num_read_kb":76135,"num_write":811,"num_write_kb":37187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:49.864291+0000","last_change":"2024-09-22T08:56:49.864291+0000","last_active":"2024-09-22T08:56:49.864291+0000","last_peered":"2024-09-22T08:56:49.864291+0000","last_clean":"2024-09-22T08:56:49.864291+0000","last_became_active":"2024-09-22T08:15:08.969276+0000","last_became_peered":"2024-09-22T08:15:08.969276+0000","last_unstale":"2024-09-22T08:56:49.864291+0000","last_undegraded":"2024-09-22T08:56:49.864291+0000","last_fullsized":"2024-09-22T08:56:49.864291+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:49.864205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:49.864205+0000","last_clean_scrub_stamp":"2024-09-22T08:56:49.864205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:04:18.212089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"263'869","reported_seq":2309,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:41.175097+0000","last_change":"2024-09-22T08:56:41.174984+0000","last_active":"2024-09-22T08:56:41.175097+0000","last_peered":"2024-09-22T08:56:41.175097+0000","last_clean":"2024-09-22T08:56:41.175097+0000","last_became_active":"2024-09-22T08:15:10.984157+0000","last_became_peered":"2024-09-22T08:15:10.984157+0000","last_unstale":"2024-09-22T08:56:41.175097+0000","last_undegraded":"2024-09-22T08:56:41.175097+0000","last_fullsized":"2024-09-22T08:56:41.175097+0000","mapping_epoch":29,"log_start":"263'800","ondisk_log_start":"263'800","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'869","last_scrub_stamp":"2024-09-22T08:56:41.174846+0000","last_deep_scrub":"263'869","last_deep_scrub_stamp":"2024-09-22T08:56:41.174846+0000","last_clean_scrub_stamp":"2024-09-22T08:56:41.174846+0000","objects_scrubbed":12,"log_size":69,"log_dups_size":800,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:25:27.321377+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49716,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1169,"num_read_kb":1404,"num_write":276,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:00.918613+0000","last_change":"2024-09-22T08:57:00.918613+0000","last_active":"2024-09-22T08:57:00.918613+0000","last_peered":"2024-09-22T08:57:00.918613+0000","last_clean":"2024-09-22T08:57:00.918613+0000","last_became_active":"2024-09-22T08:15:13.011864+0000","last_became_peered":"2024-09-22T08:15:13.011864+0000","last_unstale":"2024-09-22T08:57:00.918613+0000","last_undegraded":"2024-09-22T08:57:00.918613+0000","last_fullsized":"2024-09-22T08:57:00.918613+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:00.918518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:00.918518+0000","last_clean_scrub_stamp":"2024-09-22T08:57:00.918518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:50:43.992471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"263'216","reported_seq":751,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:54.478201+0000","last_change":"2024-09-22T08:56:54.478201+0000","last_active":"2024-09-22T08:56:54.478201+0000","last_peered":"2024-09-22T08:56:54.478201+0000","last_clean":"2024-09-22T08:56:54.478201+0000","last_became_active":"2024-09-22T08:15:15.014003+0000","last_became_peered":"2024-09-22T08:15:15.014003+0000","last_unstale":"2024-09-22T08:56:54.478201+0000","last_undegraded":"2024-09-22T08:56:54.478201+0000","last_fullsized":"2024-09-22T08:56:54.478201+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'216","last_scrub_stamp":"2024-09-22T08:56:54.478109+0000","last_deep_scrub":"263'216","last_deep_scrub_stamp":"2024-09-22T08:56:54.478109+0000","last_clean_scrub_stamp":"2024-09-22T08:56:54.478109+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:20:35.254434+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":401,"num_read_kb":391,"num_write":491,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"263'700","reported_seq":2541,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:34.442254+0000","last_change":"2024-09-22T08:56:34.442254+0000","last_active":"2024-09-22T08:56:34.442254+0000","last_peered":"2024-09-22T08:56:34.442254+0000","last_clean":"2024-09-22T08:56:34.442254+0000","last_became_active":"2024-09-22T08:15:06.972591+0000","last_became_peered":"2024-09-22T08:15:06.972591+0000","last_unstale":"2024-09-22T08:56:34.442254+0000","last_undegraded":"2024-09-22T08:56:34.442254+0000","last_fullsized":"2024-09-22T08:56:34.442254+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'700","last_scrub_stamp":"2024-09-22T08:56:34.442140+0000","last_deep_scrub":"263'700","last_deep_scrub_stamp":"2024-09-22T08:56:34.442140+0000","last_clean_scrub_stamp":"2024-09-22T08:56:34.442140+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":600,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:12:11.424859+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3779,"num_read_kb":3472,"num_write":954,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":695,"num_omap_keys":3,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":532,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:27.077163+0000","last_change":"2024-09-22T08:56:27.077093+0000","last_active":"2024-09-22T08:56:27.077163+0000","last_peered":"2024-09-22T08:56:27.077163+0000","last_clean":"2024-09-22T08:56:27.077163+0000","last_became_active":"2024-09-22T08:14:54.718660+0000","last_became_peered":"2024-09-22T08:14:54.718660+0000","last_unstale":"2024-09-22T08:56:27.077163+0000","last_undegraded":"2024-09-22T08:56:27.077163+0000","last_fullsized":"2024-09-22T08:56:27.077163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:27.076990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:27.076990+0000","last_clean_scrub_stamp":"2024-09-22T08:56:27.076990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:51:42.150906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042448600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"263'261","reported_seq":955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:26.431326+0000","last_change":"2024-09-22T08:56:26.431268+0000","last_active":"2024-09-22T08:56:26.431326+0000","last_peered":"2024-09-22T08:56:26.431326+0000","last_clean":"2024-09-22T08:56:26.431326+0000","last_became_active":"2024-09-22T08:15:04.954726+0000","last_became_peered":"2024-09-22T08:15:04.954726+0000","last_unstale":"2024-09-22T08:56:26.431326+0000","last_undegraded":"2024-09-22T08:56:26.431326+0000","last_fullsized":"2024-09-22T08:56:26.431326+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'261","last_scrub_stamp":"2024-09-22T08:56:26.431154+0000","last_deep_scrub":"263'261","last_deep_scrub_stamp":"2024-09-22T08:56:26.431154+0000","last_clean_scrub_stamp":"2024-09-22T08:56:26.431154+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:09:33.251754+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":813,"num_read_kb":7176,"num_write":1020,"num_write_kb":41627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"263'2","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:46.234731+0000","last_change":"2024-09-22T08:56:46.234731+0000","last_active":"2024-09-22T08:56:46.234731+0000","last_peered":"2024-09-22T08:56:46.234731+0000","last_clean":"2024-09-22T08:56:46.234731+0000","last_became_active":"2024-09-22T08:15:08.974419+0000","last_became_peered":"2024-09-22T08:15:08.974419+0000","last_unstale":"2024-09-22T08:56:46.234731+0000","last_undegraded":"2024-09-22T08:56:46.234731+0000","last_fullsized":"2024-09-22T08:56:46.234731+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:56:46.234640+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:56:46.234640+0000","last_clean_scrub_stamp":"2024-09-22T08:56:46.234640+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:32:06.632320+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"263'242","reported_seq":1287,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:40.526383+0000","last_change":"2024-09-22T08:56:40.526320+0000","last_active":"2024-09-22T08:56:40.526383+0000","last_peered":"2024-09-22T08:56:40.526383+0000","last_clean":"2024-09-22T08:56:40.526383+0000","last_became_active":"2024-09-22T08:15:10.987358+0000","last_became_peered":"2024-09-22T08:15:10.987358+0000","last_unstale":"2024-09-22T08:56:40.526383+0000","last_undegraded":"2024-09-22T08:56:40.526383+0000","last_fullsized":"2024-09-22T08:56:40.526383+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'242","last_scrub_stamp":"2024-09-22T08:56:40.526223+0000","last_deep_scrub":"263'242","last_deep_scrub_stamp":"2024-09-22T08:56:40.526223+0000","last_clean_scrub_stamp":"2024-09-22T08:56:40.526223+0000","objects_scrubbed":9,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:34:59.804804+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":174,"num_read_kb":166,"num_write":139,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5278,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:54.784267+0000","last_change":"2024-09-22T08:56:54.784267+0000","last_active":"2024-09-22T08:56:54.784267+0000","last_peered":"2024-09-22T08:56:54.784267+0000","last_clean":"2024-09-22T08:56:54.784267+0000","last_became_active":"2024-09-22T08:15:13.009891+0000","last_became_peered":"2024-09-22T08:15:13.009891+0000","last_unstale":"2024-09-22T08:56:54.784267+0000","last_undegraded":"2024-09-22T08:56:54.784267+0000","last_fullsized":"2024-09-22T08:56:54.784267+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:54.784180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:54.784180+0000","last_clean_scrub_stamp":"2024-09-22T08:56:54.784180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:18:34.727660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"263'247","reported_seq":850,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:00.922028+0000","last_change":"2024-09-22T08:57:00.922028+0000","last_active":"2024-09-22T08:57:00.922028+0000","last_peered":"2024-09-22T08:57:00.922028+0000","last_clean":"2024-09-22T08:57:00.922028+0000","last_became_active":"2024-09-22T08:15:15.017686+0000","last_became_peered":"2024-09-22T08:15:15.017686+0000","last_unstale":"2024-09-22T08:57:00.922028+0000","last_undegraded":"2024-09-22T08:57:00.922028+0000","last_fullsized":"2024-09-22T08:57:00.922028+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'247","last_scrub_stamp":"2024-09-22T08:57:00.921937+0000","last_deep_scrub":"263'247","last_deep_scrub_stamp":"2024-09-22T08:57:00.921937+0000","last_clean_scrub_stamp":"2024-09-22T08:57:00.921937+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:34:22.123361+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":504,"num_read_kb":528,"num_write":541,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"263'459","reported_seq":1994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:33.446661+0000","last_change":"2024-09-22T08:56:33.446543+0000","last_active":"2024-09-22T08:56:33.446661+0000","last_peered":"2024-09-22T08:56:33.446661+0000","last_clean":"2024-09-22T08:56:33.446661+0000","last_became_active":"2024-09-22T08:15:06.962486+0000","last_became_peered":"2024-09-22T08:15:06.962486+0000","last_unstale":"2024-09-22T08:56:33.446661+0000","last_undegraded":"2024-09-22T08:56:33.446661+0000","last_fullsized":"2024-09-22T08:56:33.446661+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'459","last_scrub_stamp":"2024-09-22T08:56:33.446433+0000","last_deep_scrub":"263'459","last_deep_scrub_stamp":"2024-09-22T08:56:33.446433+0000","last_clean_scrub_stamp":"2024-09-22T08:56:33.446433+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:03.195975+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2436,"num_read_kb":2281,"num_write":554,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"263'3","reported_seq":533,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:24.036583+0000","last_change":"2024-09-22T08:56:24.036494+0000","last_active":"2024-09-22T08:56:24.036583+0000","last_peered":"2024-09-22T08:56:24.036583+0000","last_clean":"2024-09-22T08:56:24.036583+0000","last_became_active":"2024-09-22T08:14:55.586088+0000","last_became_peered":"2024-09-22T08:14:55.586088+0000","last_unstale":"2024-09-22T08:56:24.036583+0000","last_undegraded":"2024-09-22T08:56:24.036583+0000","last_fullsized":"2024-09-22T08:56:24.036583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-22T08:56:24.036366+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-22T08:56:24.036366+0000","last_clean_scrub_stamp":"2024-09-22T08:56:24.036366+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:04:54.097829+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0010233219999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"263'164","reported_seq":761,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:21.464594+0000","last_change":"2024-09-22T08:56:21.464541+0000","last_active":"2024-09-22T08:56:21.464594+0000","last_peered":"2024-09-22T08:56:21.464594+0000","last_clean":"2024-09-22T08:56:21.464594+0000","last_became_active":"2024-09-22T08:15:04.963894+0000","last_became_peered":"2024-09-22T08:15:04.963894+0000","last_unstale":"2024-09-22T08:56:21.464594+0000","last_undegraded":"2024-09-22T08:56:21.464594+0000","last_fullsized":"2024-09-22T08:56:21.464594+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'164","last_scrub_stamp":"2024-09-22T08:56:21.464437+0000","last_deep_scrub":"263'164","last_deep_scrub_stamp":"2024-09-22T08:56:21.464437+0000","last_clean_scrub_stamp":"2024-09-22T08:56:21.464437+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:37:48.941982+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":412,"num_read_kb":11085,"num_write":748,"num_write_kb":14868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:36.134128+0000","last_change":"2024-09-22T08:56:36.134073+0000","last_active":"2024-09-22T08:56:36.134128+0000","last_peered":"2024-09-22T08:56:36.134128+0000","last_clean":"2024-09-22T08:56:36.134128+0000","last_became_active":"2024-09-22T08:15:08.968076+0000","last_became_peered":"2024-09-22T08:15:08.968076+0000","last_unstale":"2024-09-22T08:56:36.134128+0000","last_undegraded":"2024-09-22T08:56:36.134128+0000","last_fullsized":"2024-09-22T08:56:36.134128+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:36.133960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:36.133960+0000","last_clean_scrub_stamp":"2024-09-22T08:56:36.133960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:38:20.387449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"263'118","reported_seq":666,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:47.396848+0000","last_change":"2024-09-22T08:56:47.396848+0000","last_active":"2024-09-22T08:56:47.396848+0000","last_peered":"2024-09-22T08:56:47.396848+0000","last_clean":"2024-09-22T08:56:47.396848+0000","last_became_active":"2024-09-22T08:15:10.992450+0000","last_became_peered":"2024-09-22T08:15:10.992450+0000","last_unstale":"2024-09-22T08:56:47.396848+0000","last_undegraded":"2024-09-22T08:56:47.396848+0000","last_fullsized":"2024-09-22T08:56:47.396848+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'118","last_scrub_stamp":"2024-09-22T08:56:47.396740+0000","last_deep_scrub":"263'118","last_deep_scrub_stamp":"2024-09-22T08:56:47.396740+0000","last_clean_scrub_stamp":"2024-09-22T08:56:47.396740+0000","objects_scrubbed":7,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:03:40.352125+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":139,"num_read_kb":133,"num_write":98,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3226,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:01.879916+0000","last_change":"2024-09-22T08:57:01.879916+0000","last_active":"2024-09-22T08:57:01.879916+0000","last_peered":"2024-09-22T08:57:01.879916+0000","last_clean":"2024-09-22T08:57:01.879916+0000","last_became_active":"2024-09-22T08:15:13.011756+0000","last_became_peered":"2024-09-22T08:15:13.011756+0000","last_unstale":"2024-09-22T08:57:01.879916+0000","last_undegraded":"2024-09-22T08:57:01.879916+0000","last_fullsized":"2024-09-22T08:57:01.879916+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:01.879820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:01.879820+0000","last_clean_scrub_stamp":"2024-09-22T08:57:01.879820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:27:28.177102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"263'110","reported_seq":669,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:49.763305+0000","last_change":"2024-09-22T08:56:49.763305+0000","last_active":"2024-09-22T08:56:49.763305+0000","last_peered":"2024-09-22T08:56:49.763305+0000","last_clean":"2024-09-22T08:56:49.763305+0000","last_became_active":"2024-09-22T08:15:15.016910+0000","last_became_peered":"2024-09-22T08:15:15.016910+0000","last_unstale":"2024-09-22T08:56:49.763305+0000","last_undegraded":"2024-09-22T08:56:49.763305+0000","last_fullsized":"2024-09-22T08:56:49.763305+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'110","last_scrub_stamp":"2024-09-22T08:56:49.763207+0000","last_deep_scrub":"263'110","last_deep_scrub_stamp":"2024-09-22T08:56:49.763207+0000","last_clean_scrub_stamp":"2024-09-22T08:56:49.763207+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:32:23.563653+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":271,"num_read_kb":261,"num_write":275,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"263'846","reported_seq":2462,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:29.493402+0000","last_change":"2024-09-22T08:56:29.493348+0000","last_active":"2024-09-22T08:56:29.493402+0000","last_peered":"2024-09-22T08:56:29.493402+0000","last_clean":"2024-09-22T08:56:29.493402+0000","last_became_active":"2024-09-22T08:15:06.965021+0000","last_became_peered":"2024-09-22T08:15:06.965021+0000","last_unstale":"2024-09-22T08:56:29.493402+0000","last_undegraded":"2024-09-22T08:56:29.493402+0000","last_fullsized":"2024-09-22T08:56:29.493402+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'846","last_scrub_stamp":"2024-09-22T08:56:29.493263+0000","last_deep_scrub":"263'846","last_deep_scrub_stamp":"2024-09-22T08:56:29.493263+0000","last_clean_scrub_stamp":"2024-09-22T08:56:29.493263+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":800,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:43:22.418910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4016,"num_read_kb":3619,"num_write":1120,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"263'175","reported_seq":790,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:22.390102+0000","last_change":"2024-09-22T08:56:22.390052+0000","last_active":"2024-09-22T08:56:22.390102+0000","last_peered":"2024-09-22T08:56:22.390102+0000","last_clean":"2024-09-22T08:56:22.390102+0000","last_became_active":"2024-09-22T08:15:04.958834+0000","last_became_peered":"2024-09-22T08:15:04.958834+0000","last_unstale":"2024-09-22T08:56:22.390102+0000","last_undegraded":"2024-09-22T08:56:22.390102+0000","last_fullsized":"2024-09-22T08:56:22.390102+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'175","last_scrub_stamp":"2024-09-22T08:56:22.389983+0000","last_deep_scrub":"263'175","last_deep_scrub_stamp":"2024-09-22T08:56:22.389983+0000","last_clean_scrub_stamp":"2024-09-22T08:56:22.389983+0000","objects_scrubbed":2,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:05:50.275750+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":466,"num_read_kb":15054,"num_write":837,"num_write_kb":27215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":528,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:23.482652+0000","last_change":"2024-09-22T08:56:23.482583+0000","last_active":"2024-09-22T08:56:23.482652+0000","last_peered":"2024-09-22T08:56:23.482652+0000","last_clean":"2024-09-22T08:56:23.482652+0000","last_became_active":"2024-09-22T08:14:55.585738+0000","last_became_peered":"2024-09-22T08:14:55.585738+0000","last_unstale":"2024-09-22T08:56:23.482652+0000","last_undegraded":"2024-09-22T08:56:23.482652+0000","last_fullsized":"2024-09-22T08:56:23.482652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:23.482501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:23.482501+0000","last_clean_scrub_stamp":"2024-09-22T08:56:23.482501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:54:46.131217+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00053802500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:39.742436+0000","last_change":"2024-09-22T08:56:39.742319+0000","last_active":"2024-09-22T08:56:39.742436+0000","last_peered":"2024-09-22T08:56:39.742436+0000","last_clean":"2024-09-22T08:56:39.742436+0000","last_became_active":"2024-09-22T08:15:08.975175+0000","last_became_peered":"2024-09-22T08:15:08.975175+0000","last_unstale":"2024-09-22T08:56:39.742436+0000","last_undegraded":"2024-09-22T08:56:39.742436+0000","last_fullsized":"2024-09-22T08:56:39.742436+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:39.742220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:39.742220+0000","last_clean_scrub_stamp":"2024-09-22T08:56:39.742220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:52:23.005245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"263'301","reported_seq":973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:37.103823+0000","last_change":"2024-09-22T08:56:37.103768+0000","last_active":"2024-09-22T08:56:37.103823+0000","last_peered":"2024-09-22T08:56:37.103823+0000","last_clean":"2024-09-22T08:56:37.103823+0000","last_became_active":"2024-09-22T08:15:10.982147+0000","last_became_peered":"2024-09-22T08:15:10.982147+0000","last_unstale":"2024-09-22T08:56:37.103823+0000","last_undegraded":"2024-09-22T08:56:37.103823+0000","last_fullsized":"2024-09-22T08:56:37.103823+0000","mapping_epoch":29,"log_start":"260'200","ondisk_log_start":"260'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'301","last_scrub_stamp":"2024-09-22T08:56:37.103659+0000","last_deep_scrub":"263'301","last_deep_scrub_stamp":"2024-09-22T08:56:37.103659+0000","last_clean_scrub_stamp":"2024-09-22T08:56:37.103659+0000","objects_scrubbed":10,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:06:07.933674+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30730,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1060,"num_read_kb":1272,"num_write":1552,"num_write_kb":1410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":535730,"num_omap_keys":1208,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:42.371497+0000","last_change":"2024-09-22T08:56:42.371394+0000","last_active":"2024-09-22T08:56:42.371497+0000","last_peered":"2024-09-22T08:56:42.371497+0000","last_clean":"2024-09-22T08:56:42.371497+0000","last_became_active":"2024-09-22T08:15:13.013980+0000","last_became_peered":"2024-09-22T08:15:13.013980+0000","last_unstale":"2024-09-22T08:56:42.371497+0000","last_undegraded":"2024-09-22T08:56:42.371497+0000","last_fullsized":"2024-09-22T08:56:42.371497+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:42.371291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:42.371291+0000","last_clean_scrub_stamp":"2024-09-22T08:56:42.371291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:04:21.990339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"263'173","reported_seq":733,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:58.512070+0000","last_change":"2024-09-22T08:56:58.512070+0000","last_active":"2024-09-22T08:56:58.512070+0000","last_peered":"2024-09-22T08:56:58.512070+0000","last_clean":"2024-09-22T08:56:58.512070+0000","last_became_active":"2024-09-22T08:15:15.012146+0000","last_became_peered":"2024-09-22T08:15:15.012146+0000","last_unstale":"2024-09-22T08:56:58.512070+0000","last_undegraded":"2024-09-22T08:56:58.512070+0000","last_fullsized":"2024-09-22T08:56:58.512070+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'173","last_scrub_stamp":"2024-09-22T08:56:58.511972+0000","last_deep_scrub":"263'173","last_deep_scrub_stamp":"2024-09-22T08:56:58.511972+0000","last_clean_scrub_stamp":"2024-09-22T08:56:58.511972+0000","objects_scrubbed":4,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:36:15.035865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":420,"num_read_kb":363,"num_write":419,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"263'445","reported_seq":2048,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:32.437594+0000","last_change":"2024-09-22T08:56:32.437536+0000","last_active":"2024-09-22T08:56:32.437594+0000","last_peered":"2024-09-22T08:56:32.437594+0000","last_clean":"2024-09-22T08:56:32.437594+0000","last_became_active":"2024-09-22T08:15:06.973563+0000","last_became_peered":"2024-09-22T08:15:06.973563+0000","last_unstale":"2024-09-22T08:56:32.437594+0000","last_undegraded":"2024-09-22T08:56:32.437594+0000","last_fullsized":"2024-09-22T08:56:32.437594+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'445","last_scrub_stamp":"2024-09-22T08:56:32.437452+0000","last_deep_scrub":"263'445","last_deep_scrub_stamp":"2024-09-22T08:56:32.437452+0000","last_clean_scrub_stamp":"2024-09-22T08:56:32.437452+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:12:03.651331+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2370,"num_read_kb":2248,"num_write":498,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"263'190","reported_seq":820,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:24.448779+0000","last_change":"2024-09-22T08:56:24.448712+0000","last_active":"2024-09-22T08:56:24.448779+0000","last_peered":"2024-09-22T08:56:24.448779+0000","last_clean":"2024-09-22T08:56:24.448779+0000","last_became_active":"2024-09-22T08:15:04.956585+0000","last_became_peered":"2024-09-22T08:15:04.956585+0000","last_unstale":"2024-09-22T08:56:24.448779+0000","last_undegraded":"2024-09-22T08:56:24.448779+0000","last_fullsized":"2024-09-22T08:56:24.448779+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'190","last_scrub_stamp":"2024-09-22T08:56:24.448616+0000","last_deep_scrub":"263'190","last_deep_scrub_stamp":"2024-09-22T08:56:24.448616+0000","last_clean_scrub_stamp":"2024-09-22T08:56:24.448616+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:28:39.635896+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":533,"num_read_kb":28072,"num_write":815,"num_write_kb":27925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":530,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:25.950025+0000","last_change":"2024-09-22T08:56:25.949974+0000","last_active":"2024-09-22T08:56:25.950025+0000","last_peered":"2024-09-22T08:56:25.950025+0000","last_clean":"2024-09-22T08:56:25.950025+0000","last_became_active":"2024-09-22T08:14:54.727321+0000","last_became_peered":"2024-09-22T08:14:54.727321+0000","last_unstale":"2024-09-22T08:56:25.950025+0000","last_undegraded":"2024-09-22T08:56:25.950025+0000","last_fullsized":"2024-09-22T08:56:25.950025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:25.949885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:25.949885+0000","last_clean_scrub_stamp":"2024-09-22T08:56:25.949885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:04:26.428044+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00058148900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:37.488967+0000","last_change":"2024-09-22T08:56:37.488910+0000","last_active":"2024-09-22T08:56:37.488967+0000","last_peered":"2024-09-22T08:56:37.488967+0000","last_clean":"2024-09-22T08:56:37.488967+0000","last_became_active":"2024-09-22T08:15:08.974823+0000","last_became_peered":"2024-09-22T08:15:08.974823+0000","last_unstale":"2024-09-22T08:56:37.488967+0000","last_undegraded":"2024-09-22T08:56:37.488967+0000","last_fullsized":"2024-09-22T08:56:37.488967+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:37.488797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:37.488797+0000","last_clean_scrub_stamp":"2024-09-22T08:56:37.488797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:06:57.904560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"263'166","reported_seq":730,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:42.518299+0000","last_change":"2024-09-22T08:56:42.518232+0000","last_active":"2024-09-22T08:56:42.518299+0000","last_peered":"2024-09-22T08:56:42.518299+0000","last_clean":"2024-09-22T08:56:42.518299+0000","last_became_active":"2024-09-22T08:15:10.991426+0000","last_became_peered":"2024-09-22T08:15:10.991426+0000","last_unstale":"2024-09-22T08:56:42.518299+0000","last_undegraded":"2024-09-22T08:56:42.518299+0000","last_fullsized":"2024-09-22T08:56:42.518299+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'166","last_scrub_stamp":"2024-09-22T08:56:42.518128+0000","last_deep_scrub":"263'166","last_deep_scrub_stamp":"2024-09-22T08:56:42.518128+0000","last_clean_scrub_stamp":"2024-09-22T08:56:42.518128+0000","objects_scrubbed":8,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:43:46.934148+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":204,"num_read_kb":193,"num_write":140,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"263'790","reported_seq":4945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:43.715391+0000","last_change":"2024-09-22T08:56:43.715300+0000","last_active":"2024-09-22T08:56:43.715391+0000","last_peered":"2024-09-22T08:56:43.715391+0000","last_clean":"2024-09-22T08:56:43.715391+0000","last_became_active":"2024-09-22T08:15:13.013828+0000","last_became_peered":"2024-09-22T08:15:13.013828+0000","last_unstale":"2024-09-22T08:56:43.715391+0000","last_undegraded":"2024-09-22T08:56:43.715391+0000","last_fullsized":"2024-09-22T08:56:43.715391+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'790","last_scrub_stamp":"2024-09-22T08:56:43.715184+0000","last_deep_scrub":"263'790","last_deep_scrub_stamp":"2024-09-22T08:56:43.715184+0000","last_clean_scrub_stamp":"2024-09-22T08:56:43.715184+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:50:19.357092+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"263'144","reported_seq":652,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:50.354891+0000","last_change":"2024-09-22T08:56:50.354891+0000","last_active":"2024-09-22T08:56:50.354891+0000","last_peered":"2024-09-22T08:56:50.354891+0000","last_clean":"2024-09-22T08:56:50.354891+0000","last_became_active":"2024-09-22T08:15:15.013976+0000","last_became_peered":"2024-09-22T08:15:15.013976+0000","last_unstale":"2024-09-22T08:56:50.354891+0000","last_undegraded":"2024-09-22T08:56:50.354891+0000","last_fullsized":"2024-09-22T08:56:50.354891+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'144","last_scrub_stamp":"2024-09-22T08:56:50.354798+0000","last_deep_scrub":"263'144","last_deep_scrub_stamp":"2024-09-22T08:56:50.354798+0000","last_clean_scrub_stamp":"2024-09-22T08:56:50.354798+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:52.505999+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":177,"num_read_kb":172,"num_write":337,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"263'453","reported_seq":1960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:31.604903+0000","last_change":"2024-09-22T08:56:31.604854+0000","last_active":"2024-09-22T08:56:31.604903+0000","last_peered":"2024-09-22T08:56:31.604903+0000","last_clean":"2024-09-22T08:56:31.604903+0000","last_became_active":"2024-09-22T08:15:06.966387+0000","last_became_peered":"2024-09-22T08:15:06.966387+0000","last_unstale":"2024-09-22T08:56:31.604903+0000","last_undegraded":"2024-09-22T08:56:31.604903+0000","last_fullsized":"2024-09-22T08:56:31.604903+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'453","last_scrub_stamp":"2024-09-22T08:56:31.604702+0000","last_deep_scrub":"263'453","last_deep_scrub_stamp":"2024-09-22T08:56:31.604702+0000","last_clean_scrub_stamp":"2024-09-22T08:56:31.604702+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:47:41.638747+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2402,"num_read_kb":2235,"num_write":539,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"263'208","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:27.494927+0000","last_change":"2024-09-22T08:56:27.494927+0000","last_active":"2024-09-22T08:56:27.494927+0000","last_peered":"2024-09-22T08:56:27.494927+0000","last_clean":"2024-09-22T08:56:27.494927+0000","last_became_active":"2024-09-22T08:15:04.951731+0000","last_became_peered":"2024-09-22T08:15:04.951731+0000","last_unstale":"2024-09-22T08:56:27.494927+0000","last_undegraded":"2024-09-22T08:56:27.494927+0000","last_fullsized":"2024-09-22T08:56:27.494927+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'208","last_scrub_stamp":"2024-09-22T08:56:27.494744+0000","last_deep_scrub":"263'208","last_deep_scrub_stamp":"2024-09-22T08:56:27.494744+0000","last_clean_scrub_stamp":"2024-09-22T08:56:27.494744+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:38:30.369670+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079922,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":440,"num_read_kb":57796,"num_write":879,"num_write_kb":62478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:25.510634+0000","last_change":"2024-09-22T08:56:25.510634+0000","last_active":"2024-09-22T08:56:25.510634+0000","last_peered":"2024-09-22T08:56:25.510634+0000","last_clean":"2024-09-22T08:56:25.510634+0000","last_became_active":"2024-09-22T08:14:55.585607+0000","last_became_peered":"2024-09-22T08:14:55.585607+0000","last_unstale":"2024-09-22T08:56:25.510634+0000","last_undegraded":"2024-09-22T08:56:25.510634+0000","last_fullsized":"2024-09-22T08:56:25.510634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:25.510529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:25.510529+0000","last_clean_scrub_stamp":"2024-09-22T08:56:25.510529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:13:03.897890+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00049298099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:48.865761+0000","last_change":"2024-09-22T08:56:48.865761+0000","last_active":"2024-09-22T08:56:48.865761+0000","last_peered":"2024-09-22T08:56:48.865761+0000","last_clean":"2024-09-22T08:56:48.865761+0000","last_became_active":"2024-09-22T08:15:08.969373+0000","last_became_peered":"2024-09-22T08:15:08.969373+0000","last_unstale":"2024-09-22T08:56:48.865761+0000","last_undegraded":"2024-09-22T08:56:48.865761+0000","last_fullsized":"2024-09-22T08:56:48.865761+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:48.865660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:48.865660+0000","last_clean_scrub_stamp":"2024-09-22T08:56:48.865660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:09:09.886307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"263'111","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:54.862235+0000","last_change":"2024-09-22T08:56:54.862235+0000","last_active":"2024-09-22T08:56:54.862235+0000","last_peered":"2024-09-22T08:56:54.862235+0000","last_clean":"2024-09-22T08:56:54.862235+0000","last_became_active":"2024-09-22T08:15:10.984232+0000","last_became_peered":"2024-09-22T08:15:10.984232+0000","last_unstale":"2024-09-22T08:56:54.862235+0000","last_undegraded":"2024-09-22T08:56:54.862235+0000","last_fullsized":"2024-09-22T08:56:54.862235+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'111","last_scrub_stamp":"2024-09-22T08:56:54.862146+0000","last_deep_scrub":"263'111","last_deep_scrub_stamp":"2024-09-22T08:56:54.862146+0000","last_clean_scrub_stamp":"2024-09-22T08:56:54.862146+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:10:40.543230+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":116,"num_write":82,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"263'793","reported_seq":2224,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:49.399364+0000","last_change":"2024-09-22T08:56:49.399303+0000","last_active":"2024-09-22T08:56:49.399364+0000","last_peered":"2024-09-22T08:56:49.399364+0000","last_clean":"2024-09-22T08:56:49.399364+0000","last_became_active":"2024-09-22T08:15:13.008027+0000","last_became_peered":"2024-09-22T08:15:13.008027+0000","last_unstale":"2024-09-22T08:56:49.399364+0000","last_undegraded":"2024-09-22T08:56:49.399364+0000","last_fullsized":"2024-09-22T08:56:49.399364+0000","mapping_epoch":31,"log_start":"263'701","ondisk_log_start":"263'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'793","last_scrub_stamp":"2024-09-22T08:56:49.399221+0000","last_deep_scrub":"263'793","last_deep_scrub_stamp":"2024-09-22T08:56:49.399221+0000","last_clean_scrub_stamp":"2024-09-22T08:56:49.399221+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":701,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:13:29.095907+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"263'201","reported_seq":723,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:56.460386+0000","last_change":"2024-09-22T08:56:56.460386+0000","last_active":"2024-09-22T08:56:56.460386+0000","last_peered":"2024-09-22T08:56:56.460386+0000","last_clean":"2024-09-22T08:56:56.460386+0000","last_became_active":"2024-09-22T08:15:15.014423+0000","last_became_peered":"2024-09-22T08:15:15.014423+0000","last_unstale":"2024-09-22T08:56:56.460386+0000","last_undegraded":"2024-09-22T08:56:56.460386+0000","last_fullsized":"2024-09-22T08:56:56.460386+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'201","last_scrub_stamp":"2024-09-22T08:56:56.460303+0000","last_deep_scrub":"263'201","last_deep_scrub_stamp":"2024-09-22T08:56:56.460303+0000","last_clean_scrub_stamp":"2024-09-22T08:56:56.460303+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:28:29.986558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":250,"num_read_kb":232,"num_write":460,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"263'500","reported_seq":2070,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:30.332108+0000","last_change":"2024-09-22T08:56:30.332020+0000","last_active":"2024-09-22T08:56:30.332108+0000","last_peered":"2024-09-22T08:56:30.332108+0000","last_clean":"2024-09-22T08:56:30.332108+0000","last_became_active":"2024-09-22T08:15:06.968153+0000","last_became_peered":"2024-09-22T08:15:06.968153+0000","last_unstale":"2024-09-22T08:56:30.332108+0000","last_undegraded":"2024-09-22T08:56:30.332108+0000","last_fullsized":"2024-09-22T08:56:30.332108+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'500","last_scrub_stamp":"2024-09-22T08:56:30.331876+0000","last_deep_scrub":"263'500","last_deep_scrub_stamp":"2024-09-22T08:56:30.331876+0000","last_clean_scrub_stamp":"2024-09-22T08:56:30.331876+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:12:28.407646+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2565,"num_read_kb":2386,"num_write":597,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"263'200","reported_seq":826,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:24.516850+0000","last_change":"2024-09-22T08:56:24.516850+0000","last_active":"2024-09-22T08:56:24.516850+0000","last_peered":"2024-09-22T08:56:24.516850+0000","last_clean":"2024-09-22T08:56:24.516850+0000","last_became_active":"2024-09-22T08:15:04.943901+0000","last_became_peered":"2024-09-22T08:15:04.943901+0000","last_unstale":"2024-09-22T08:56:24.516850+0000","last_undegraded":"2024-09-22T08:56:24.516850+0000","last_fullsized":"2024-09-22T08:56:24.516850+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'200","last_scrub_stamp":"2024-09-22T08:56:24.516736+0000","last_deep_scrub":"263'200","last_deep_scrub_stamp":"2024-09-22T08:56:24.516736+0000","last_clean_scrub_stamp":"2024-09-22T08:56:24.516736+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:25:37.932151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":512,"num_read_kb":4964,"num_write":959,"num_write_kb":21539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:26.935540+0000","last_change":"2024-09-22T08:56:26.935540+0000","last_active":"2024-09-22T08:56:26.935540+0000","last_peered":"2024-09-22T08:56:26.935540+0000","last_clean":"2024-09-22T08:56:26.935540+0000","last_became_active":"2024-09-22T08:14:55.585485+0000","last_became_peered":"2024-09-22T08:14:55.585485+0000","last_unstale":"2024-09-22T08:56:26.935540+0000","last_undegraded":"2024-09-22T08:56:26.935540+0000","last_fullsized":"2024-09-22T08:56:26.935540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:26.935425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:26.935425+0000","last_clean_scrub_stamp":"2024-09-22T08:56:26.935425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:24:27.484352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012642249999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:41.758864+0000","last_change":"2024-09-22T08:56:41.758786+0000","last_active":"2024-09-22T08:56:41.758864+0000","last_peered":"2024-09-22T08:56:41.758864+0000","last_clean":"2024-09-22T08:56:41.758864+0000","last_became_active":"2024-09-22T08:15:08.979291+0000","last_became_peered":"2024-09-22T08:15:08.979291+0000","last_unstale":"2024-09-22T08:56:41.758864+0000","last_undegraded":"2024-09-22T08:56:41.758864+0000","last_fullsized":"2024-09-22T08:56:41.758864+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:41.758704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:41.758704+0000","last_clean_scrub_stamp":"2024-09-22T08:56:41.758704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:27:55.044646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"263'326","reported_seq":1046,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:41.482031+0000","last_change":"2024-09-22T08:56:41.481976+0000","last_active":"2024-09-22T08:56:41.482031+0000","last_peered":"2024-09-22T08:56:41.482031+0000","last_clean":"2024-09-22T08:56:41.482031+0000","last_became_active":"2024-09-22T08:15:10.979261+0000","last_became_peered":"2024-09-22T08:15:10.979261+0000","last_unstale":"2024-09-22T08:56:41.482031+0000","last_undegraded":"2024-09-22T08:56:41.482031+0000","last_fullsized":"2024-09-22T08:56:41.482031+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'326","last_scrub_stamp":"2024-09-22T08:56:41.481863+0000","last_deep_scrub":"263'326","last_deep_scrub_stamp":"2024-09-22T08:56:41.481863+0000","last_clean_scrub_stamp":"2024-09-22T08:56:41.481863+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:35:06.044679+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25829,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":462,"num_read_kb":686,"num_write":234,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:53.790947+0000","last_change":"2024-09-22T08:56:53.790947+0000","last_active":"2024-09-22T08:56:53.790947+0000","last_peered":"2024-09-22T08:56:53.790947+0000","last_clean":"2024-09-22T08:56:53.790947+0000","last_became_active":"2024-09-22T08:15:13.003041+0000","last_became_peered":"2024-09-22T08:15:13.003041+0000","last_unstale":"2024-09-22T08:56:53.790947+0000","last_undegraded":"2024-09-22T08:56:53.790947+0000","last_fullsized":"2024-09-22T08:56:53.790947+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:53.790859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:53.790859+0000","last_clean_scrub_stamp":"2024-09-22T08:56:53.790859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:27:05.715455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"263'130","reported_seq":636,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:48.323891+0000","last_change":"2024-09-22T08:56:48.323891+0000","last_active":"2024-09-22T08:56:48.323891+0000","last_peered":"2024-09-22T08:56:48.323891+0000","last_clean":"2024-09-22T08:56:48.323891+0000","last_became_active":"2024-09-22T08:15:15.014775+0000","last_became_peered":"2024-09-22T08:15:15.014775+0000","last_unstale":"2024-09-22T08:56:48.323891+0000","last_undegraded":"2024-09-22T08:56:48.323891+0000","last_fullsized":"2024-09-22T08:56:48.323891+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'130","last_scrub_stamp":"2024-09-22T08:56:48.323737+0000","last_deep_scrub":"263'130","last_deep_scrub_stamp":"2024-09-22T08:56:48.323737+0000","last_clean_scrub_stamp":"2024-09-22T08:56:48.323737+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:15:30.889666+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":162,"num_read_kb":158,"num_write":286,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"263'109","reported_seq":668,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:57.834349+0000","last_change":"2024-09-22T08:56:57.834349+0000","last_active":"2024-09-22T08:56:57.834349+0000","last_peered":"2024-09-22T08:56:57.834349+0000","last_clean":"2024-09-22T08:56:57.834349+0000","last_became_active":"2024-09-22T08:15:15.020653+0000","last_became_peered":"2024-09-22T08:15:15.020653+0000","last_unstale":"2024-09-22T08:56:57.834349+0000","last_undegraded":"2024-09-22T08:56:57.834349+0000","last_fullsized":"2024-09-22T08:56:57.834349+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'109","last_scrub_stamp":"2024-09-22T08:56:57.834260+0000","last_deep_scrub":"263'109","last_deep_scrub_stamp":"2024-09-22T08:56:57.834260+0000","last_clean_scrub_stamp":"2024-09-22T08:56:57.834260+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:23:10.854519+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":202,"num_read_kb":202,"num_write":258,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"263'491","reported_seq":2223,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:31.374825+0000","last_change":"2024-09-22T08:56:31.374754+0000","last_active":"2024-09-22T08:56:31.374825+0000","last_peered":"2024-09-22T08:56:31.374825+0000","last_clean":"2024-09-22T08:56:31.374825+0000","last_became_active":"2024-09-22T08:15:06.970382+0000","last_became_peered":"2024-09-22T08:15:06.970382+0000","last_unstale":"2024-09-22T08:56:31.374825+0000","last_undegraded":"2024-09-22T08:56:31.374825+0000","last_fullsized":"2024-09-22T08:56:31.374825+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'491","last_scrub_stamp":"2024-09-22T08:56:31.374652+0000","last_deep_scrub":"263'491","last_deep_scrub_stamp":"2024-09-22T08:56:31.374652+0000","last_clean_scrub_stamp":"2024-09-22T08:56:31.374652+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:29:57.099432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2792,"num_read_kb":2647,"num_write":560,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3043,"num_omap_keys":12,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"263'227","reported_seq":883,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:32.879014+0000","last_change":"2024-09-22T08:56:32.878958+0000","last_active":"2024-09-22T08:56:32.879014+0000","last_peered":"2024-09-22T08:56:32.879014+0000","last_clean":"2024-09-22T08:56:32.879014+0000","last_became_active":"2024-09-22T08:15:04.965572+0000","last_became_peered":"2024-09-22T08:15:04.965572+0000","last_unstale":"2024-09-22T08:56:32.879014+0000","last_undegraded":"2024-09-22T08:56:32.879014+0000","last_fullsized":"2024-09-22T08:56:32.879014+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'227","last_scrub_stamp":"2024-09-22T08:56:32.878823+0000","last_deep_scrub":"263'227","last_deep_scrub_stamp":"2024-09-22T08:56:32.878823+0000","last_clean_scrub_stamp":"2024-09-22T08:56:32.878823+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:10:43.868372+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":598,"num_read_kb":42984,"num_write":1013,"num_write_kb":35756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:40.519311+0000","last_change":"2024-09-22T08:56:40.519216+0000","last_active":"2024-09-22T08:56:40.519311+0000","last_peered":"2024-09-22T08:56:40.519311+0000","last_clean":"2024-09-22T08:56:40.519311+0000","last_became_active":"2024-09-22T08:15:08.976444+0000","last_became_peered":"2024-09-22T08:15:08.976444+0000","last_unstale":"2024-09-22T08:56:40.519311+0000","last_undegraded":"2024-09-22T08:56:40.519311+0000","last_fullsized":"2024-09-22T08:56:40.519311+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:40.519119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:40.519119+0000","last_clean_scrub_stamp":"2024-09-22T08:56:40.519119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:33:04.166853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"263'137","reported_seq":712,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:44.556153+0000","last_change":"2024-09-22T08:56:44.556082+0000","last_active":"2024-09-22T08:56:44.556153+0000","last_peered":"2024-09-22T08:56:44.556153+0000","last_clean":"2024-09-22T08:56:44.556153+0000","last_became_active":"2024-09-22T08:15:10.987623+0000","last_became_peered":"2024-09-22T08:15:10.987623+0000","last_unstale":"2024-09-22T08:56:44.556153+0000","last_undegraded":"2024-09-22T08:56:44.556153+0000","last_fullsized":"2024-09-22T08:56:44.556153+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'137","last_scrub_stamp":"2024-09-22T08:56:44.555992+0000","last_deep_scrub":"263'137","last_deep_scrub_stamp":"2024-09-22T08:56:44.555992+0000","last_clean_scrub_stamp":"2024-09-22T08:56:44.555992+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:46:15.194164+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8761,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":170,"num_read_kb":207,"num_write":88,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:43.234153+0000","last_change":"2024-09-22T08:56:43.234096+0000","last_active":"2024-09-22T08:56:43.234153+0000","last_peered":"2024-09-22T08:56:43.234153+0000","last_clean":"2024-09-22T08:56:43.234153+0000","last_became_active":"2024-09-22T08:15:12.997350+0000","last_became_peered":"2024-09-22T08:15:12.997350+0000","last_unstale":"2024-09-22T08:56:43.234153+0000","last_undegraded":"2024-09-22T08:56:43.234153+0000","last_fullsized":"2024-09-22T08:56:43.234153+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:43.234008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:43.234008+0000","last_clean_scrub_stamp":"2024-09-22T08:56:43.234008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:14:46.102555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"263'112","reported_seq":616,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:48.305333+0000","last_change":"2024-09-22T08:56:48.305333+0000","last_active":"2024-09-22T08:56:48.305333+0000","last_peered":"2024-09-22T08:56:48.305333+0000","last_clean":"2024-09-22T08:56:48.305333+0000","last_became_active":"2024-09-22T08:15:15.016918+0000","last_became_peered":"2024-09-22T08:15:15.016918+0000","last_unstale":"2024-09-22T08:56:48.305333+0000","last_undegraded":"2024-09-22T08:56:48.305333+0000","last_fullsized":"2024-09-22T08:56:48.305333+0000","mapping_epoch":33,"log_start":"263'101","ondisk_log_start":"263'101","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'112","last_scrub_stamp":"2024-09-22T08:56:48.305233+0000","last_deep_scrub":"263'112","last_deep_scrub_stamp":"2024-09-22T08:56:48.305233+0000","last_clean_scrub_stamp":"2024-09-22T08:56:48.305233+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":101,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:46:52.130848+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":125,"num_write":254,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"263'1038","reported_seq":2830,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:33.664286+0000","last_change":"2024-09-22T08:56:33.664223+0000","last_active":"2024-09-22T08:56:33.664286+0000","last_peered":"2024-09-22T08:56:33.664286+0000","last_clean":"2024-09-22T08:56:33.664286+0000","last_became_active":"2024-09-22T08:15:06.965465+0000","last_became_peered":"2024-09-22T08:15:06.965465+0000","last_unstale":"2024-09-22T08:56:33.664286+0000","last_undegraded":"2024-09-22T08:56:33.664286+0000","last_fullsized":"2024-09-22T08:56:33.664286+0000","mapping_epoch":25,"log_start":"263'1000","ondisk_log_start":"263'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1038","last_scrub_stamp":"2024-09-22T08:56:33.664132+0000","last_deep_scrub":"263'1038","last_deep_scrub_stamp":"2024-09-22T08:56:33.664132+0000","last_clean_scrub_stamp":"2024-09-22T08:56:33.664132+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":1000,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:46:03.562471+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5105,"num_read_kb":4580,"num_write":1460,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"263'210","reported_seq":836,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:27.467279+0000","last_change":"2024-09-22T08:56:27.467279+0000","last_active":"2024-09-22T08:56:27.467279+0000","last_peered":"2024-09-22T08:56:27.467279+0000","last_clean":"2024-09-22T08:56:27.467279+0000","last_became_active":"2024-09-22T08:15:04.949181+0000","last_became_peered":"2024-09-22T08:15:04.949181+0000","last_unstale":"2024-09-22T08:56:27.467279+0000","last_undegraded":"2024-09-22T08:56:27.467279+0000","last_fullsized":"2024-09-22T08:56:27.467279+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'210","last_scrub_stamp":"2024-09-22T08:56:27.467159+0000","last_deep_scrub":"263'210","last_deep_scrub_stamp":"2024-09-22T08:56:27.467159+0000","last_clean_scrub_stamp":"2024-09-22T08:56:27.467159+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:15:11.987517+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":538,"num_read_kb":11766,"num_write":957,"num_write_kb":45959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:42.725220+0000","last_change":"2024-09-22T08:56:42.725152+0000","last_active":"2024-09-22T08:56:42.725220+0000","last_peered":"2024-09-22T08:56:42.725220+0000","last_clean":"2024-09-22T08:56:42.725220+0000","last_became_active":"2024-09-22T08:15:08.975704+0000","last_became_peered":"2024-09-22T08:15:08.975704+0000","last_unstale":"2024-09-22T08:56:42.725220+0000","last_undegraded":"2024-09-22T08:56:42.725220+0000","last_fullsized":"2024-09-22T08:56:42.725220+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:42.725054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:42.725054+0000","last_clean_scrub_stamp":"2024-09-22T08:56:42.725054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:53:10.767578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"263'41","reported_seq":550,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:48.817448+0000","last_change":"2024-09-22T08:56:48.817379+0000","last_active":"2024-09-22T08:56:48.817448+0000","last_peered":"2024-09-22T08:56:48.817448+0000","last_clean":"2024-09-22T08:56:48.817448+0000","last_became_active":"2024-09-22T08:15:10.983593+0000","last_became_peered":"2024-09-22T08:15:10.983593+0000","last_unstale":"2024-09-22T08:56:48.817448+0000","last_undegraded":"2024-09-22T08:56:48.817448+0000","last_fullsized":"2024-09-22T08:56:48.817448+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'41","last_scrub_stamp":"2024-09-22T08:56:48.817295+0000","last_deep_scrub":"263'41","last_deep_scrub_stamp":"2024-09-22T08:56:48.817295+0000","last_clean_scrub_stamp":"2024-09-22T08:56:48.817295+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:46:42.574241+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:44.280906+0000","last_change":"2024-09-22T08:56:44.280797+0000","last_active":"2024-09-22T08:56:44.280906+0000","last_peered":"2024-09-22T08:56:44.280906+0000","last_clean":"2024-09-22T08:56:44.280906+0000","last_became_active":"2024-09-22T08:15:13.019020+0000","last_became_peered":"2024-09-22T08:15:13.019020+0000","last_unstale":"2024-09-22T08:56:44.280906+0000","last_undegraded":"2024-09-22T08:56:44.280906+0000","last_fullsized":"2024-09-22T08:56:44.280906+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:44.280680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:44.280680+0000","last_clean_scrub_stamp":"2024-09-22T08:56:44.280680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:02:29.842179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"263'184","reported_seq":712,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:52.585551+0000","last_change":"2024-09-22T08:56:52.585551+0000","last_active":"2024-09-22T08:56:52.585551+0000","last_peered":"2024-09-22T08:56:52.585551+0000","last_clean":"2024-09-22T08:56:52.585551+0000","last_became_active":"2024-09-22T08:15:15.013300+0000","last_became_peered":"2024-09-22T08:15:15.013300+0000","last_unstale":"2024-09-22T08:56:52.585551+0000","last_undegraded":"2024-09-22T08:56:52.585551+0000","last_fullsized":"2024-09-22T08:56:52.585551+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'184","last_scrub_stamp":"2024-09-22T08:56:52.585437+0000","last_deep_scrub":"263'184","last_deep_scrub_stamp":"2024-09-22T08:56:52.585437+0000","last_clean_scrub_stamp":"2024-09-22T08:56:52.585437+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:20:42.367609+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":337,"num_read_kb":325,"num_write":401,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"263'1201","reported_seq":2849,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:32.645387+0000","last_change":"2024-09-22T08:56:32.645335+0000","last_active":"2024-09-22T08:56:32.645387+0000","last_peered":"2024-09-22T08:56:32.645387+0000","last_clean":"2024-09-22T08:56:32.645387+0000","last_became_active":"2024-09-22T08:15:06.957116+0000","last_became_peered":"2024-09-22T08:15:06.957116+0000","last_unstale":"2024-09-22T08:56:32.645387+0000","last_undegraded":"2024-09-22T08:56:32.645387+0000","last_fullsized":"2024-09-22T08:56:32.645387+0000","mapping_epoch":25,"log_start":"263'1100","ondisk_log_start":"263'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1201","last_scrub_stamp":"2024-09-22T08:56:32.645252+0000","last_deep_scrub":"263'1201","last_deep_scrub_stamp":"2024-09-22T08:56:32.645252+0000","last_clean_scrub_stamp":"2024-09-22T08:56:32.645252+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":1100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:00:07.106550+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5635,"num_read_kb":5002,"num_write":1685,"num_write_kb":733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":434,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"263'193","reported_seq":815,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:25.336972+0000","last_change":"2024-09-22T08:56:25.336972+0000","last_active":"2024-09-22T08:56:25.336972+0000","last_peered":"2024-09-22T08:56:25.336972+0000","last_clean":"2024-09-22T08:56:25.336972+0000","last_became_active":"2024-09-22T08:15:04.968557+0000","last_became_peered":"2024-09-22T08:15:04.968557+0000","last_unstale":"2024-09-22T08:56:25.336972+0000","last_undegraded":"2024-09-22T08:56:25.336972+0000","last_fullsized":"2024-09-22T08:56:25.336972+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'193","last_scrub_stamp":"2024-09-22T08:56:25.336860+0000","last_deep_scrub":"263'193","last_deep_scrub_stamp":"2024-09-22T08:56:25.336860+0000","last_clean_scrub_stamp":"2024-09-22T08:56:25.336860+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:20:48.349873+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079920,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":520,"num_read_kb":8164,"num_write":864,"num_write_kb":39531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:36.418277+0000","last_change":"2024-09-22T08:56:36.418210+0000","last_active":"2024-09-22T08:56:36.418277+0000","last_peered":"2024-09-22T08:56:36.418277+0000","last_clean":"2024-09-22T08:56:36.418277+0000","last_became_active":"2024-09-22T08:15:08.975001+0000","last_became_peered":"2024-09-22T08:15:08.975001+0000","last_unstale":"2024-09-22T08:56:36.418277+0000","last_undegraded":"2024-09-22T08:56:36.418277+0000","last_fullsized":"2024-09-22T08:56:36.418277+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:36.418114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:36.418114+0000","last_clean_scrub_stamp":"2024-09-22T08:56:36.418114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:03:22.345130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"263'173","reported_seq":772,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:39.158251+0000","last_change":"2024-09-22T08:56:39.158193+0000","last_active":"2024-09-22T08:56:39.158251+0000","last_peered":"2024-09-22T08:56:39.158251+0000","last_clean":"2024-09-22T08:56:39.158251+0000","last_became_active":"2024-09-22T08:15:10.980443+0000","last_became_peered":"2024-09-22T08:15:10.980443+0000","last_unstale":"2024-09-22T08:56:39.158251+0000","last_undegraded":"2024-09-22T08:56:39.158251+0000","last_fullsized":"2024-09-22T08:56:39.158251+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'173","last_scrub_stamp":"2024-09-22T08:56:39.158047+0000","last_deep_scrub":"263'173","last_deep_scrub_stamp":"2024-09-22T08:56:39.158047+0000","last_clean_scrub_stamp":"2024-09-22T08:56:39.158047+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:42:11.473386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":222,"num_read_kb":300,"num_write":124,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:44.753676+0000","last_change":"2024-09-22T08:56:44.753619+0000","last_active":"2024-09-22T08:56:44.753676+0000","last_peered":"2024-09-22T08:56:44.753676+0000","last_clean":"2024-09-22T08:56:44.753676+0000","last_became_active":"2024-09-22T08:15:13.010660+0000","last_became_peered":"2024-09-22T08:15:13.010660+0000","last_unstale":"2024-09-22T08:56:44.753676+0000","last_undegraded":"2024-09-22T08:56:44.753676+0000","last_fullsized":"2024-09-22T08:56:44.753676+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:44.753528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:44.753528+0000","last_clean_scrub_stamp":"2024-09-22T08:56:44.753528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:53:25.427397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"263'145","reported_seq":686,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:08.739402+0000","last_change":"2024-09-22T08:57:08.739402+0000","last_active":"2024-09-22T08:57:08.739402+0000","last_peered":"2024-09-22T08:57:08.739402+0000","last_clean":"2024-09-22T08:57:08.739402+0000","last_became_active":"2024-09-22T08:15:15.015497+0000","last_became_peered":"2024-09-22T08:15:15.015497+0000","last_unstale":"2024-09-22T08:57:08.739402+0000","last_undegraded":"2024-09-22T08:57:08.739402+0000","last_fullsized":"2024-09-22T08:57:08.739402+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'145","last_scrub_stamp":"2024-09-22T08:57:08.739305+0000","last_deep_scrub":"263'145","last_deep_scrub_stamp":"2024-09-22T08:57:08.739305+0000","last_clean_scrub_stamp":"2024-09-22T08:57:08.739305+0000","objects_scrubbed":4,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:34:06.050548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":885,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":300,"num_read_kb":272,"num_write":341,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"263'918","reported_seq":2773,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:29.083006+0000","last_change":"2024-09-22T08:56:29.082934+0000","last_active":"2024-09-22T08:56:29.083006+0000","last_peered":"2024-09-22T08:56:29.083006+0000","last_clean":"2024-09-22T08:56:29.083006+0000","last_became_active":"2024-09-22T08:15:06.964082+0000","last_became_peered":"2024-09-22T08:15:06.964082+0000","last_unstale":"2024-09-22T08:56:29.083006+0000","last_undegraded":"2024-09-22T08:56:29.083006+0000","last_fullsized":"2024-09-22T08:56:29.083006+0000","mapping_epoch":25,"log_start":"263'900","ondisk_log_start":"263'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'918","last_scrub_stamp":"2024-09-22T08:56:29.082837+0000","last_deep_scrub":"263'918","last_deep_scrub_stamp":"2024-09-22T08:56:29.082837+0000","last_clean_scrub_stamp":"2024-09-22T08:56:29.082837+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":900,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:49:15.428214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4594,"num_read_kb":4173,"num_write":1193,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2260,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"263'260","reported_seq":894,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:24.453691+0000","last_change":"2024-09-22T08:56:24.453691+0000","last_active":"2024-09-22T08:56:24.453691+0000","last_peered":"2024-09-22T08:56:24.453691+0000","last_clean":"2024-09-22T08:56:24.453691+0000","last_became_active":"2024-09-22T08:15:04.954431+0000","last_became_peered":"2024-09-22T08:15:04.954431+0000","last_unstale":"2024-09-22T08:56:24.453691+0000","last_undegraded":"2024-09-22T08:56:24.453691+0000","last_fullsized":"2024-09-22T08:56:24.453691+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'260","last_scrub_stamp":"2024-09-22T08:56:24.453598+0000","last_deep_scrub":"263'260","last_deep_scrub_stamp":"2024-09-22T08:56:24.453598+0000","last_clean_scrub_stamp":"2024-09-22T08:56:24.453598+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:11:53.936014+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":625,"num_read_kb":10749,"num_write":1043,"num_write_kb":36368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:51.899338+0000","last_change":"2024-09-22T08:56:51.899288+0000","last_active":"2024-09-22T08:56:51.899338+0000","last_peered":"2024-09-22T08:56:51.899338+0000","last_clean":"2024-09-22T08:56:51.899338+0000","last_became_active":"2024-09-22T08:15:08.978080+0000","last_became_peered":"2024-09-22T08:15:08.978080+0000","last_unstale":"2024-09-22T08:56:51.899338+0000","last_undegraded":"2024-09-22T08:56:51.899338+0000","last_fullsized":"2024-09-22T08:56:51.899338+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:51.899200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:51.899200+0000","last_clean_scrub_stamp":"2024-09-22T08:56:51.899200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:44:03.626002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"263'139","reported_seq":711,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:43.442229+0000","last_change":"2024-09-22T08:56:43.442127+0000","last_active":"2024-09-22T08:56:43.442229+0000","last_peered":"2024-09-22T08:56:43.442229+0000","last_clean":"2024-09-22T08:56:43.442229+0000","last_became_active":"2024-09-22T08:15:10.975066+0000","last_became_peered":"2024-09-22T08:15:10.975066+0000","last_unstale":"2024-09-22T08:56:43.442229+0000","last_undegraded":"2024-09-22T08:56:43.442229+0000","last_fullsized":"2024-09-22T08:56:43.442229+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'139","last_scrub_stamp":"2024-09-22T08:56:43.442026+0000","last_deep_scrub":"263'139","last_deep_scrub_stamp":"2024-09-22T08:56:43.442026+0000","last_clean_scrub_stamp":"2024-09-22T08:56:43.442026+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:13:39.485401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4721,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":157,"num_read_kb":223,"num_write":80,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:44.216707+0000","last_change":"2024-09-22T08:56:44.216632+0000","last_active":"2024-09-22T08:56:44.216707+0000","last_peered":"2024-09-22T08:56:44.216707+0000","last_clean":"2024-09-22T08:56:44.216707+0000","last_became_active":"2024-09-22T08:15:13.008005+0000","last_became_peered":"2024-09-22T08:15:13.008005+0000","last_unstale":"2024-09-22T08:56:44.216707+0000","last_undegraded":"2024-09-22T08:56:44.216707+0000","last_fullsized":"2024-09-22T08:56:44.216707+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:44.216543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:44.216543+0000","last_clean_scrub_stamp":"2024-09-22T08:56:44.216543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:31:37.425715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"263'387","reported_seq":1920,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:43.895675+0000","last_change":"2024-09-22T08:56:43.895609+0000","last_active":"2024-09-22T08:56:43.895675+0000","last_peered":"2024-09-22T08:56:43.895675+0000","last_clean":"2024-09-22T08:56:43.895675+0000","last_became_active":"2024-09-22T08:15:06.974083+0000","last_became_peered":"2024-09-22T08:15:06.974083+0000","last_unstale":"2024-09-22T08:56:43.895675+0000","last_undegraded":"2024-09-22T08:56:43.895675+0000","last_fullsized":"2024-09-22T08:56:43.895675+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'387","last_scrub_stamp":"2024-09-22T08:56:43.895521+0000","last_deep_scrub":"263'387","last_deep_scrub_stamp":"2024-09-22T08:56:43.895521+0000","last_clean_scrub_stamp":"2024-09-22T08:56:43.895521+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:38:10.001396+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2095,"num_read_kb":2009,"num_write":415,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"263'220","reported_seq":862,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:30.421662+0000","last_change":"2024-09-22T08:56:30.421662+0000","last_active":"2024-09-22T08:56:30.421662+0000","last_peered":"2024-09-22T08:56:30.421662+0000","last_clean":"2024-09-22T08:56:30.421662+0000","last_became_active":"2024-09-22T08:15:04.953371+0000","last_became_peered":"2024-09-22T08:15:04.953371+0000","last_unstale":"2024-09-22T08:56:30.421662+0000","last_undegraded":"2024-09-22T08:56:30.421662+0000","last_fullsized":"2024-09-22T08:56:30.421662+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'220","last_scrub_stamp":"2024-09-22T08:56:30.421545+0000","last_deep_scrub":"263'220","last_deep_scrub_stamp":"2024-09-22T08:56:30.421545+0000","last_clean_scrub_stamp":"2024-09-22T08:56:30.421545+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:22:31.706556+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079956,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":551,"num_read_kb":20845,"num_write":984,"num_write_kb":34041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:41.502765+0000","last_change":"2024-09-22T08:56:41.502715+0000","last_active":"2024-09-22T08:56:41.502765+0000","last_peered":"2024-09-22T08:56:41.502765+0000","last_clean":"2024-09-22T08:56:41.502765+0000","last_became_active":"2024-09-22T08:15:08.977975+0000","last_became_peered":"2024-09-22T08:15:08.977975+0000","last_unstale":"2024-09-22T08:56:41.502765+0000","last_undegraded":"2024-09-22T08:56:41.502765+0000","last_fullsized":"2024-09-22T08:56:41.502765+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:41.502631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:41.502631+0000","last_clean_scrub_stamp":"2024-09-22T08:56:41.502631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:47:58.395562+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"263'218","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:46.543724+0000","last_change":"2024-09-22T08:56:46.543724+0000","last_active":"2024-09-22T08:56:46.543724+0000","last_peered":"2024-09-22T08:56:46.543724+0000","last_clean":"2024-09-22T08:56:46.543724+0000","last_became_active":"2024-09-22T08:15:10.985454+0000","last_became_peered":"2024-09-22T08:15:10.985454+0000","last_unstale":"2024-09-22T08:56:46.543724+0000","last_undegraded":"2024-09-22T08:56:46.543724+0000","last_fullsized":"2024-09-22T08:56:46.543724+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'218","last_scrub_stamp":"2024-09-22T08:56:46.543626+0000","last_deep_scrub":"263'218","last_deep_scrub_stamp":"2024-09-22T08:56:46.543626+0000","last_clean_scrub_stamp":"2024-09-22T08:56:46.543626+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:35:26.113720+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24540,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":311,"num_read_kb":482,"num_write":196,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:45.264495+0000","last_change":"2024-09-22T08:56:45.264495+0000","last_active":"2024-09-22T08:56:45.264495+0000","last_peered":"2024-09-22T08:56:45.264495+0000","last_clean":"2024-09-22T08:56:45.264495+0000","last_became_active":"2024-09-22T08:15:13.008080+0000","last_became_peered":"2024-09-22T08:15:13.008080+0000","last_unstale":"2024-09-22T08:56:45.264495+0000","last_undegraded":"2024-09-22T08:56:45.264495+0000","last_fullsized":"2024-09-22T08:56:45.264495+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:45.264424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:45.264424+0000","last_clean_scrub_stamp":"2024-09-22T08:56:45.264424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:22:52.072394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"263'176","reported_seq":691,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:00.431448+0000","last_change":"2024-09-22T08:57:00.431365+0000","last_active":"2024-09-22T08:57:00.431448+0000","last_peered":"2024-09-22T08:57:00.431448+0000","last_clean":"2024-09-22T08:57:00.431448+0000","last_became_active":"2024-09-22T08:15:15.014112+0000","last_became_peered":"2024-09-22T08:15:15.014112+0000","last_unstale":"2024-09-22T08:57:00.431448+0000","last_undegraded":"2024-09-22T08:57:00.431448+0000","last_fullsized":"2024-09-22T08:57:00.431448+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'176","last_scrub_stamp":"2024-09-22T08:57:00.431270+0000","last_deep_scrub":"263'176","last_deep_scrub_stamp":"2024-09-22T08:57:00.431270+0000","last_clean_scrub_stamp":"2024-09-22T08:57:00.431270+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:41:55.748221+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":264,"num_read_kb":269,"num_write":416,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"263'433","reported_seq":2048,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:35.716124+0000","last_change":"2024-09-22T08:56:35.716040+0000","last_active":"2024-09-22T08:56:35.716124+0000","last_peered":"2024-09-22T08:56:35.716124+0000","last_clean":"2024-09-22T08:56:35.716124+0000","last_became_active":"2024-09-22T08:15:06.966715+0000","last_became_peered":"2024-09-22T08:15:06.966715+0000","last_unstale":"2024-09-22T08:56:35.716124+0000","last_undegraded":"2024-09-22T08:56:35.716124+0000","last_fullsized":"2024-09-22T08:56:35.716124+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'433","last_scrub_stamp":"2024-09-22T08:56:35.715956+0000","last_deep_scrub":"263'433","last_deep_scrub_stamp":"2024-09-22T08:56:35.715956+0000","last_clean_scrub_stamp":"2024-09-22T08:56:35.715956+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:36:50.835174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2445,"num_read_kb":2324,"num_write":493,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"263'214","reported_seq":886,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:28.519902+0000","last_change":"2024-09-22T08:56:28.519902+0000","last_active":"2024-09-22T08:56:28.519902+0000","last_peered":"2024-09-22T08:56:28.519902+0000","last_clean":"2024-09-22T08:56:28.519902+0000","last_became_active":"2024-09-22T08:15:04.950890+0000","last_became_peered":"2024-09-22T08:15:04.950890+0000","last_unstale":"2024-09-22T08:56:28.519902+0000","last_undegraded":"2024-09-22T08:56:28.519902+0000","last_fullsized":"2024-09-22T08:56:28.519902+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'214","last_scrub_stamp":"2024-09-22T08:56:28.519814+0000","last_deep_scrub":"263'214","last_deep_scrub_stamp":"2024-09-22T08:56:28.519814+0000","last_clean_scrub_stamp":"2024-09-22T08:56:28.519814+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:35:12.489475+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":625,"num_read_kb":94909,"num_write":959,"num_write_kb":40287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"263'5","reported_seq":983,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:40.392356+0000","last_change":"2024-09-22T08:56:40.392284+0000","last_active":"2024-09-22T08:56:40.392356+0000","last_peered":"2024-09-22T08:56:40.392356+0000","last_clean":"2024-09-22T08:56:40.392356+0000","last_became_active":"2024-09-22T08:15:08.977250+0000","last_became_peered":"2024-09-22T08:15:08.977250+0000","last_unstale":"2024-09-22T08:56:40.392356+0000","last_undegraded":"2024-09-22T08:56:40.392356+0000","last_fullsized":"2024-09-22T08:56:40.392356+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-22T08:56:40.392200+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-22T08:56:40.392200+0000","last_clean_scrub_stamp":"2024-09-22T08:56:40.392200+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:58:39.531528+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":1187,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"263'177","reported_seq":766,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:58.877517+0000","last_change":"2024-09-22T08:56:58.877517+0000","last_active":"2024-09-22T08:56:58.877517+0000","last_peered":"2024-09-22T08:56:58.877517+0000","last_clean":"2024-09-22T08:56:58.877517+0000","last_became_active":"2024-09-22T08:15:10.987541+0000","last_became_peered":"2024-09-22T08:15:10.987541+0000","last_unstale":"2024-09-22T08:56:58.877517+0000","last_undegraded":"2024-09-22T08:56:58.877517+0000","last_fullsized":"2024-09-22T08:56:58.877517+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'177","last_scrub_stamp":"2024-09-22T08:56:58.877406+0000","last_deep_scrub":"263'177","last_deep_scrub_stamp":"2024-09-22T08:56:58.877406+0000","last_clean_scrub_stamp":"2024-09-22T08:56:58.877406+0000","objects_scrubbed":8,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:01:01.399059+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":217,"num_read_kb":244,"num_write":140,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:57.504819+0000","last_change":"2024-09-22T08:56:57.504819+0000","last_active":"2024-09-22T08:56:57.504819+0000","last_peered":"2024-09-22T08:56:57.504819+0000","last_clean":"2024-09-22T08:56:57.504819+0000","last_became_active":"2024-09-22T08:15:13.011781+0000","last_became_peered":"2024-09-22T08:15:13.011781+0000","last_unstale":"2024-09-22T08:56:57.504819+0000","last_undegraded":"2024-09-22T08:56:57.504819+0000","last_fullsized":"2024-09-22T08:56:57.504819+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:57.504724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:57.504724+0000","last_clean_scrub_stamp":"2024-09-22T08:56:57.504724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:19:18.602651+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"263'188","reported_seq":707,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:06.784369+0000","last_change":"2024-09-22T08:57:06.784299+0000","last_active":"2024-09-22T08:57:06.784369+0000","last_peered":"2024-09-22T08:57:06.784369+0000","last_clean":"2024-09-22T08:57:06.784369+0000","last_became_active":"2024-09-22T08:15:15.011648+0000","last_became_peered":"2024-09-22T08:15:15.011648+0000","last_unstale":"2024-09-22T08:57:06.784369+0000","last_undegraded":"2024-09-22T08:57:06.784369+0000","last_fullsized":"2024-09-22T08:57:06.784369+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'188","last_scrub_stamp":"2024-09-22T08:57:06.784206+0000","last_deep_scrub":"263'188","last_deep_scrub_stamp":"2024-09-22T08:57:06.784206+0000","last_clean_scrub_stamp":"2024-09-22T08:57:06.784206+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:05:15.993819+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":287,"num_read_kb":275,"num_write":539,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"263'439","reported_seq":1960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:30.084801+0000","last_change":"2024-09-22T08:56:30.084801+0000","last_active":"2024-09-22T08:56:30.084801+0000","last_peered":"2024-09-22T08:56:30.084801+0000","last_clean":"2024-09-22T08:56:30.084801+0000","last_became_active":"2024-09-22T08:15:06.972213+0000","last_became_peered":"2024-09-22T08:15:06.972213+0000","last_unstale":"2024-09-22T08:56:30.084801+0000","last_undegraded":"2024-09-22T08:56:30.084801+0000","last_fullsized":"2024-09-22T08:56:30.084801+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'439","last_scrub_stamp":"2024-09-22T08:56:30.084696+0000","last_deep_scrub":"263'439","last_deep_scrub_stamp":"2024-09-22T08:56:30.084696+0000","last_clean_scrub_stamp":"2024-09-22T08:56:30.084696+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:43:42.820968+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2524,"num_read_kb":2354,"num_write":541,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"263'246","reported_seq":887,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:28.829400+0000","last_change":"2024-09-22T08:56:28.829400+0000","last_active":"2024-09-22T08:56:28.829400+0000","last_peered":"2024-09-22T08:56:28.829400+0000","last_clean":"2024-09-22T08:56:28.829400+0000","last_became_active":"2024-09-22T08:15:04.959607+0000","last_became_peered":"2024-09-22T08:15:04.959607+0000","last_unstale":"2024-09-22T08:56:28.829400+0000","last_undegraded":"2024-09-22T08:56:28.829400+0000","last_fullsized":"2024-09-22T08:56:28.829400+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'246","last_scrub_stamp":"2024-09-22T08:56:28.829299+0000","last_deep_scrub":"263'246","last_deep_scrub_stamp":"2024-09-22T08:56:28.829299+0000","last_clean_scrub_stamp":"2024-09-22T08:56:28.829299+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:55:16.910471+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079903,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":565,"num_read_kb":22702,"num_write":1145,"num_write_kb":43754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:39.435951+0000","last_change":"2024-09-22T08:56:39.435951+0000","last_active":"2024-09-22T08:56:39.435951+0000","last_peered":"2024-09-22T08:56:39.435951+0000","last_clean":"2024-09-22T08:56:39.435951+0000","last_became_active":"2024-09-22T08:15:08.974925+0000","last_became_peered":"2024-09-22T08:15:08.974925+0000","last_unstale":"2024-09-22T08:56:39.435951+0000","last_undegraded":"2024-09-22T08:56:39.435951+0000","last_fullsized":"2024-09-22T08:56:39.435951+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:39.435856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:39.435856+0000","last_clean_scrub_stamp":"2024-09-22T08:56:39.435856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:57:01.098449+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"263'153","reported_seq":730,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:48.587326+0000","last_change":"2024-09-22T08:56:48.587274+0000","last_active":"2024-09-22T08:56:48.587326+0000","last_peered":"2024-09-22T08:56:48.587326+0000","last_clean":"2024-09-22T08:56:48.587326+0000","last_became_active":"2024-09-22T08:15:10.985312+0000","last_became_peered":"2024-09-22T08:15:10.985312+0000","last_unstale":"2024-09-22T08:56:48.587326+0000","last_undegraded":"2024-09-22T08:56:48.587326+0000","last_fullsized":"2024-09-22T08:56:48.587326+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'153","last_scrub_stamp":"2024-09-22T08:56:48.587185+0000","last_deep_scrub":"263'153","last_deep_scrub_stamp":"2024-09-22T08:56:48.587185+0000","last_clean_scrub_stamp":"2024-09-22T08:56:48.587185+0000","objects_scrubbed":5,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:52:46.336740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9037,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":176,"num_read_kb":231,"num_write":94,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:45.247826+0000","last_change":"2024-09-22T08:56:45.247761+0000","last_active":"2024-09-22T08:56:45.247826+0000","last_peered":"2024-09-22T08:56:45.247826+0000","last_clean":"2024-09-22T08:56:45.247826+0000","last_became_active":"2024-09-22T08:15:12.998276+0000","last_became_peered":"2024-09-22T08:15:12.998276+0000","last_unstale":"2024-09-22T08:56:45.247826+0000","last_undegraded":"2024-09-22T08:56:45.247826+0000","last_fullsized":"2024-09-22T08:56:45.247826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:45.247668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:45.247668+0000","last_clean_scrub_stamp":"2024-09-22T08:56:45.247668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:39:59.660562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"263'133","reported_seq":647,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:09.719510+0000","last_change":"2024-09-22T08:57:09.719419+0000","last_active":"2024-09-22T08:57:09.719510+0000","last_peered":"2024-09-22T08:57:09.719510+0000","last_clean":"2024-09-22T08:57:09.719510+0000","last_became_active":"2024-09-22T08:15:15.022140+0000","last_became_peered":"2024-09-22T08:15:15.022140+0000","last_unstale":"2024-09-22T08:57:09.719510+0000","last_undegraded":"2024-09-22T08:57:09.719510+0000","last_fullsized":"2024-09-22T08:57:09.719510+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'133","last_scrub_stamp":"2024-09-22T08:57:09.719265+0000","last_deep_scrub":"263'133","last_deep_scrub_stamp":"2024-09-22T08:57:09.719265+0000","last_clean_scrub_stamp":"2024-09-22T08:57:09.719265+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:26:20.156023+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":810,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":211,"num_read_kb":192,"num_write":312,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"263'535","reported_seq":2412,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:34.686230+0000","last_change":"2024-09-22T08:56:34.686230+0000","last_active":"2024-09-22T08:56:34.686230+0000","last_peered":"2024-09-22T08:56:34.686230+0000","last_clean":"2024-09-22T08:56:34.686230+0000","last_became_active":"2024-09-22T08:15:06.963136+0000","last_became_peered":"2024-09-22T08:15:06.963136+0000","last_unstale":"2024-09-22T08:56:34.686230+0000","last_undegraded":"2024-09-22T08:56:34.686230+0000","last_fullsized":"2024-09-22T08:56:34.686230+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'535","last_scrub_stamp":"2024-09-22T08:56:34.686122+0000","last_deep_scrub":"263'535","last_deep_scrub_stamp":"2024-09-22T08:56:34.686122+0000","last_clean_scrub_stamp":"2024-09-22T08:56:34.686122+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:49:11.708710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3196,"num_read_kb":3015,"num_write":651,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4595,"num_omap_keys":18,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"263'229","reported_seq":859,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:29.569012+0000","last_change":"2024-09-22T08:56:29.569012+0000","last_active":"2024-09-22T08:56:29.569012+0000","last_peered":"2024-09-22T08:56:29.569012+0000","last_clean":"2024-09-22T08:56:29.569012+0000","last_became_active":"2024-09-22T08:15:04.961731+0000","last_became_peered":"2024-09-22T08:15:04.961731+0000","last_unstale":"2024-09-22T08:56:29.569012+0000","last_undegraded":"2024-09-22T08:56:29.569012+0000","last_fullsized":"2024-09-22T08:56:29.569012+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'229","last_scrub_stamp":"2024-09-22T08:56:29.568904+0000","last_deep_scrub":"263'229","last_deep_scrub_stamp":"2024-09-22T08:56:29.568904+0000","last_clean_scrub_stamp":"2024-09-22T08:56:29.568904+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:54:11.861870+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079902,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":556,"num_read_kb":16778,"num_write":1039,"num_write_kb":35959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:45.813634+0000","last_change":"2024-09-22T08:56:45.813634+0000","last_active":"2024-09-22T08:56:45.813634+0000","last_peered":"2024-09-22T08:56:45.813634+0000","last_clean":"2024-09-22T08:56:45.813634+0000","last_became_active":"2024-09-22T08:15:08.973985+0000","last_became_peered":"2024-09-22T08:15:08.973985+0000","last_unstale":"2024-09-22T08:56:45.813634+0000","last_undegraded":"2024-09-22T08:56:45.813634+0000","last_fullsized":"2024-09-22T08:56:45.813634+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:45.813551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:45.813551+0000","last_clean_scrub_stamp":"2024-09-22T08:56:45.813551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:09:23.744767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"263'98","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:59.904375+0000","last_change":"2024-09-22T08:56:59.904269+0000","last_active":"2024-09-22T08:56:59.904375+0000","last_peered":"2024-09-22T08:56:59.904375+0000","last_clean":"2024-09-22T08:56:59.904375+0000","last_became_active":"2024-09-22T08:15:10.991099+0000","last_became_peered":"2024-09-22T08:15:10.991099+0000","last_unstale":"2024-09-22T08:56:59.904375+0000","last_undegraded":"2024-09-22T08:56:59.904375+0000","last_fullsized":"2024-09-22T08:56:59.904375+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'98","last_scrub_stamp":"2024-09-22T08:56:59.904149+0000","last_deep_scrub":"263'98","last_deep_scrub_stamp":"2024-09-22T08:56:59.904149+0000","last_clean_scrub_stamp":"2024-09-22T08:56:59.904149+0000","objects_scrubbed":7,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:05:26.253262+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":117,"num_read_kb":110,"num_write":130,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"263'772","reported_seq":2299,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:46.422592+0000","last_change":"2024-09-22T08:56:46.422523+0000","last_active":"2024-09-22T08:56:46.422592+0000","last_peered":"2024-09-22T08:56:46.422592+0000","last_clean":"2024-09-22T08:56:46.422592+0000","last_became_active":"2024-09-22T08:15:13.018826+0000","last_became_peered":"2024-09-22T08:15:13.018826+0000","last_unstale":"2024-09-22T08:56:46.422592+0000","last_undegraded":"2024-09-22T08:56:46.422592+0000","last_fullsized":"2024-09-22T08:56:46.422592+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'772","last_scrub_stamp":"2024-09-22T08:56:46.422436+0000","last_deep_scrub":"263'772","last_deep_scrub_stamp":"2024-09-22T08:56:46.422436+0000","last_clean_scrub_stamp":"2024-09-22T08:56:46.422436+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:15:34.934804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"263'136","reported_seq":646,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:04.783670+0000","last_change":"2024-09-22T08:57:04.783617+0000","last_active":"2024-09-22T08:57:04.783670+0000","last_peered":"2024-09-22T08:57:04.783670+0000","last_clean":"2024-09-22T08:57:04.783670+0000","last_became_active":"2024-09-22T08:15:15.017568+0000","last_became_peered":"2024-09-22T08:15:15.017568+0000","last_unstale":"2024-09-22T08:57:04.783670+0000","last_undegraded":"2024-09-22T08:57:04.783670+0000","last_fullsized":"2024-09-22T08:57:04.783670+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'136","last_scrub_stamp":"2024-09-22T08:57:04.783514+0000","last_deep_scrub":"263'136","last_deep_scrub_stamp":"2024-09-22T08:57:04.783514+0000","last_clean_scrub_stamp":"2024-09-22T08:57:04.783514+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:11:30.508043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":178,"num_write":322,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"263'423","reported_seq":1885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:34.401957+0000","last_change":"2024-09-22T08:56:34.401957+0000","last_active":"2024-09-22T08:56:34.401957+0000","last_peered":"2024-09-22T08:56:34.401957+0000","last_clean":"2024-09-22T08:56:34.401957+0000","last_became_active":"2024-09-22T08:15:06.973142+0000","last_became_peered":"2024-09-22T08:15:06.973142+0000","last_unstale":"2024-09-22T08:56:34.401957+0000","last_undegraded":"2024-09-22T08:56:34.401957+0000","last_fullsized":"2024-09-22T08:56:34.401957+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'423","last_scrub_stamp":"2024-09-22T08:56:34.401862+0000","last_deep_scrub":"263'423","last_deep_scrub_stamp":"2024-09-22T08:56:34.401862+0000","last_clean_scrub_stamp":"2024-09-22T08:56:34.401862+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:31.696050+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2325,"num_read_kb":2186,"num_write":496,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"263'205","reported_seq":811,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:26.829391+0000","last_change":"2024-09-22T08:56:26.829391+0000","last_active":"2024-09-22T08:56:26.829391+0000","last_peered":"2024-09-22T08:56:26.829391+0000","last_clean":"2024-09-22T08:56:26.829391+0000","last_became_active":"2024-09-22T08:15:04.954608+0000","last_became_peered":"2024-09-22T08:15:04.954608+0000","last_unstale":"2024-09-22T08:56:26.829391+0000","last_undegraded":"2024-09-22T08:56:26.829391+0000","last_fullsized":"2024-09-22T08:56:26.829391+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'205","last_scrub_stamp":"2024-09-22T08:56:26.829288+0000","last_deep_scrub":"263'205","last_deep_scrub_stamp":"2024-09-22T08:56:26.829288+0000","last_clean_scrub_stamp":"2024-09-22T08:56:26.829288+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:41:04.364320+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":469,"num_read_kb":8602,"num_write":952,"num_write_kb":32105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:42.741012+0000","last_change":"2024-09-22T08:56:42.741012+0000","last_active":"2024-09-22T08:56:42.741012+0000","last_peered":"2024-09-22T08:56:42.741012+0000","last_clean":"2024-09-22T08:56:42.741012+0000","last_became_active":"2024-09-22T08:15:08.980570+0000","last_became_peered":"2024-09-22T08:15:08.980570+0000","last_unstale":"2024-09-22T08:56:42.741012+0000","last_undegraded":"2024-09-22T08:56:42.741012+0000","last_fullsized":"2024-09-22T08:56:42.741012+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:42.740930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:42.740930+0000","last_clean_scrub_stamp":"2024-09-22T08:56:42.740930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:12:39.016936+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"263'170","reported_seq":756,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:44.411274+0000","last_change":"2024-09-22T08:56:44.411274+0000","last_active":"2024-09-22T08:56:44.411274+0000","last_peered":"2024-09-22T08:56:44.411274+0000","last_clean":"2024-09-22T08:56:44.411274+0000","last_became_active":"2024-09-22T08:15:10.979384+0000","last_became_peered":"2024-09-22T08:15:10.979384+0000","last_unstale":"2024-09-22T08:56:44.411274+0000","last_undegraded":"2024-09-22T08:56:44.411274+0000","last_fullsized":"2024-09-22T08:56:44.411274+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'170","last_scrub_stamp":"2024-09-22T08:56:44.411179+0000","last_deep_scrub":"263'170","last_deep_scrub_stamp":"2024-09-22T08:56:44.411179+0000","last_clean_scrub_stamp":"2024-09-22T08:56:44.411179+0000","objects_scrubbed":8,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:34:16.990164+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10195,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":216,"num_read_kb":291,"num_write":126,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:56.842267+0000","last_change":"2024-09-22T08:56:56.842267+0000","last_active":"2024-09-22T08:56:56.842267+0000","last_peered":"2024-09-22T08:56:56.842267+0000","last_clean":"2024-09-22T08:56:56.842267+0000","last_became_active":"2024-09-22T08:15:13.013160+0000","last_became_peered":"2024-09-22T08:15:13.013160+0000","last_unstale":"2024-09-22T08:56:56.842267+0000","last_undegraded":"2024-09-22T08:56:56.842267+0000","last_fullsized":"2024-09-22T08:56:56.842267+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:56.842180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:56.842180+0000","last_clean_scrub_stamp":"2024-09-22T08:56:56.842180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:23:00.661794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"263'141","reported_seq":651,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:50.744675+0000","last_change":"2024-09-22T08:56:50.744675+0000","last_active":"2024-09-22T08:56:50.744675+0000","last_peered":"2024-09-22T08:56:50.744675+0000","last_clean":"2024-09-22T08:56:50.744675+0000","last_became_active":"2024-09-22T08:15:15.020718+0000","last_became_peered":"2024-09-22T08:15:15.020718+0000","last_unstale":"2024-09-22T08:56:50.744675+0000","last_undegraded":"2024-09-22T08:56:50.744675+0000","last_fullsized":"2024-09-22T08:56:50.744675+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'141","last_scrub_stamp":"2024-09-22T08:56:50.744588+0000","last_deep_scrub":"263'141","last_deep_scrub_stamp":"2024-09-22T08:56:50.744588+0000","last_clean_scrub_stamp":"2024-09-22T08:56:50.744588+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:35:11.558076+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":211,"num_read_kb":197,"num_write":330,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"263'802","reported_seq":2286,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:33.408278+0000","last_change":"2024-09-22T08:56:33.408278+0000","last_active":"2024-09-22T08:56:33.408278+0000","last_peered":"2024-09-22T08:56:33.408278+0000","last_clean":"2024-09-22T08:56:33.408278+0000","last_became_active":"2024-09-22T08:15:06.970077+0000","last_became_peered":"2024-09-22T08:15:06.970077+0000","last_unstale":"2024-09-22T08:56:33.408278+0000","last_undegraded":"2024-09-22T08:56:33.408278+0000","last_fullsized":"2024-09-22T08:56:33.408278+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'802","last_scrub_stamp":"2024-09-22T08:56:33.408180+0000","last_deep_scrub":"263'802","last_deep_scrub_stamp":"2024-09-22T08:56:33.408180+0000","last_clean_scrub_stamp":"2024-09-22T08:56:33.408180+0000","objects_scrubbed":2,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:56:18.098515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3751,"num_read_kb":3364,"num_write":1047,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":246,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"263'201","reported_seq":921,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:33.835418+0000","last_change":"2024-09-22T08:56:33.835418+0000","last_active":"2024-09-22T08:56:33.835418+0000","last_peered":"2024-09-22T08:56:33.835418+0000","last_clean":"2024-09-22T08:56:33.835418+0000","last_became_active":"2024-09-22T08:15:04.962268+0000","last_became_peered":"2024-09-22T08:15:04.962268+0000","last_unstale":"2024-09-22T08:56:33.835418+0000","last_undegraded":"2024-09-22T08:56:33.835418+0000","last_fullsized":"2024-09-22T08:56:33.835418+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'201","last_scrub_stamp":"2024-09-22T08:56:33.835307+0000","last_deep_scrub":"263'201","last_deep_scrub_stamp":"2024-09-22T08:56:33.835307+0000","last_clean_scrub_stamp":"2024-09-22T08:56:33.835307+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:26:01.851194+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":783,"num_read_kb":150382,"num_write":906,"num_write_kb":51576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:38.418270+0000","last_change":"2024-09-22T08:56:38.418270+0000","last_active":"2024-09-22T08:56:38.418270+0000","last_peered":"2024-09-22T08:56:38.418270+0000","last_clean":"2024-09-22T08:56:38.418270+0000","last_became_active":"2024-09-22T08:15:08.977341+0000","last_became_peered":"2024-09-22T08:15:08.977341+0000","last_unstale":"2024-09-22T08:56:38.418270+0000","last_undegraded":"2024-09-22T08:56:38.418270+0000","last_fullsized":"2024-09-22T08:56:38.418270+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:38.418178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:38.418178+0000","last_clean_scrub_stamp":"2024-09-22T08:56:38.418178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:49:39.605640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"263'131","reported_seq":704,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:52.812563+0000","last_change":"2024-09-22T08:56:52.812563+0000","last_active":"2024-09-22T08:56:52.812563+0000","last_peered":"2024-09-22T08:56:52.812563+0000","last_clean":"2024-09-22T08:56:52.812563+0000","last_became_active":"2024-09-22T08:15:10.980015+0000","last_became_peered":"2024-09-22T08:15:10.980015+0000","last_unstale":"2024-09-22T08:56:52.812563+0000","last_undegraded":"2024-09-22T08:56:52.812563+0000","last_fullsized":"2024-09-22T08:56:52.812563+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'131","last_scrub_stamp":"2024-09-22T08:56:52.812468+0000","last_deep_scrub":"263'131","last_deep_scrub_stamp":"2024-09-22T08:56:52.812468+0000","last_clean_scrub_stamp":"2024-09-22T08:56:52.812468+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:56:16.632729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20804,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":281,"num_write":88,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:02.858821+0000","last_change":"2024-09-22T08:57:02.858821+0000","last_active":"2024-09-22T08:57:02.858821+0000","last_peered":"2024-09-22T08:57:02.858821+0000","last_clean":"2024-09-22T08:57:02.858821+0000","last_became_active":"2024-09-22T08:15:13.011134+0000","last_became_peered":"2024-09-22T08:15:13.011134+0000","last_unstale":"2024-09-22T08:57:02.858821+0000","last_undegraded":"2024-09-22T08:57:02.858821+0000","last_fullsized":"2024-09-22T08:57:02.858821+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:02.858723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:02.858723+0000","last_clean_scrub_stamp":"2024-09-22T08:57:02.858723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:51:50.606460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"263'151","reported_seq":680,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:59.480205+0000","last_change":"2024-09-22T08:56:59.480205+0000","last_active":"2024-09-22T08:56:59.480205+0000","last_peered":"2024-09-22T08:56:59.480205+0000","last_clean":"2024-09-22T08:56:59.480205+0000","last_became_active":"2024-09-22T08:15:15.012939+0000","last_became_peered":"2024-09-22T08:15:15.012939+0000","last_unstale":"2024-09-22T08:56:59.480205+0000","last_undegraded":"2024-09-22T08:56:59.480205+0000","last_fullsized":"2024-09-22T08:56:59.480205+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'151","last_scrub_stamp":"2024-09-22T08:56:59.480121+0000","last_deep_scrub":"263'151","last_deep_scrub_stamp":"2024-09-22T08:56:59.480121+0000","last_clean_scrub_stamp":"2024-09-22T08:56:59.480121+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:49:39.921046+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":256,"num_read_kb":247,"num_write":364,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"263'566","reported_seq":2368,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:31.058431+0000","last_change":"2024-09-22T08:56:31.058431+0000","last_active":"2024-09-22T08:56:31.058431+0000","last_peered":"2024-09-22T08:56:31.058431+0000","last_clean":"2024-09-22T08:56:31.058431+0000","last_became_active":"2024-09-22T08:15:06.960599+0000","last_became_peered":"2024-09-22T08:15:06.960599+0000","last_unstale":"2024-09-22T08:56:31.058431+0000","last_undegraded":"2024-09-22T08:56:31.058431+0000","last_fullsized":"2024-09-22T08:56:31.058431+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'566","last_scrub_stamp":"2024-09-22T08:56:31.058322+0000","last_deep_scrub":"263'566","last_deep_scrub_stamp":"2024-09-22T08:56:31.058322+0000","last_clean_scrub_stamp":"2024-09-22T08:56:31.058322+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":500,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:44:02.799881+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3136,"num_read_kb":2948,"num_write":673,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1214,"num_omap_keys":5,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"263'213","reported_seq":849,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:25.463333+0000","last_change":"2024-09-22T08:56:25.463224+0000","last_active":"2024-09-22T08:56:25.463333+0000","last_peered":"2024-09-22T08:56:25.463333+0000","last_clean":"2024-09-22T08:56:25.463333+0000","last_became_active":"2024-09-22T08:15:04.962785+0000","last_became_peered":"2024-09-22T08:15:04.962785+0000","last_unstale":"2024-09-22T08:56:25.463333+0000","last_undegraded":"2024-09-22T08:56:25.463333+0000","last_fullsized":"2024-09-22T08:56:25.463333+0000","mapping_epoch":23,"log_start":"263'201","ondisk_log_start":"263'201","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'213","last_scrub_stamp":"2024-09-22T08:56:25.463105+0000","last_deep_scrub":"263'213","last_deep_scrub_stamp":"2024-09-22T08:56:25.463105+0000","last_clean_scrub_stamp":"2024-09-22T08:56:25.463105+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":201,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:25.834921+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":497,"num_read_kb":22160,"num_write":848,"num_write_kb":45151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:36.732273+0000","last_change":"2024-09-22T08:56:36.732273+0000","last_active":"2024-09-22T08:56:36.732273+0000","last_peered":"2024-09-22T08:56:36.732273+0000","last_clean":"2024-09-22T08:56:36.732273+0000","last_became_active":"2024-09-22T08:15:08.978844+0000","last_became_peered":"2024-09-22T08:15:08.978844+0000","last_unstale":"2024-09-22T08:56:36.732273+0000","last_undegraded":"2024-09-22T08:56:36.732273+0000","last_fullsized":"2024-09-22T08:56:36.732273+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:36.732185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:36.732185+0000","last_clean_scrub_stamp":"2024-09-22T08:56:36.732185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:09:03.793067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"263'129","reported_seq":687,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:45.550783+0000","last_change":"2024-09-22T08:56:45.550783+0000","last_active":"2024-09-22T08:56:45.550783+0000","last_peered":"2024-09-22T08:56:45.550783+0000","last_clean":"2024-09-22T08:56:45.550783+0000","last_became_active":"2024-09-22T08:15:10.983522+0000","last_became_peered":"2024-09-22T08:15:10.983522+0000","last_unstale":"2024-09-22T08:56:45.550783+0000","last_undegraded":"2024-09-22T08:56:45.550783+0000","last_fullsized":"2024-09-22T08:56:45.550783+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'129","last_scrub_stamp":"2024-09-22T08:56:45.550692+0000","last_deep_scrub":"263'129","last_deep_scrub_stamp":"2024-09-22T08:56:45.550692+0000","last_clean_scrub_stamp":"2024-09-22T08:56:45.550692+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:16:26.075081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62130,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":173,"num_read_kb":427,"num_write":104,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:03.822194+0000","last_change":"2024-09-22T08:57:03.822194+0000","last_active":"2024-09-22T08:57:03.822194+0000","last_peered":"2024-09-22T08:57:03.822194+0000","last_clean":"2024-09-22T08:57:03.822194+0000","last_became_active":"2024-09-22T08:15:13.015473+0000","last_became_peered":"2024-09-22T08:15:13.015473+0000","last_unstale":"2024-09-22T08:57:03.822194+0000","last_undegraded":"2024-09-22T08:57:03.822194+0000","last_fullsized":"2024-09-22T08:57:03.822194+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.822091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.822091+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.822091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:56:05.966711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"263'220","reported_seq":1687,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:07.746784+0000","last_change":"2024-09-22T08:57:07.746784+0000","last_active":"2024-09-22T08:57:07.746784+0000","last_peered":"2024-09-22T08:57:07.746784+0000","last_clean":"2024-09-22T08:57:07.746784+0000","last_became_active":"2024-09-22T08:15:15.017394+0000","last_became_peered":"2024-09-22T08:15:15.017394+0000","last_unstale":"2024-09-22T08:57:07.746784+0000","last_undegraded":"2024-09-22T08:57:07.746784+0000","last_fullsized":"2024-09-22T08:57:07.746784+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'220","last_scrub_stamp":"2024-09-22T08:57:07.746678+0000","last_deep_scrub":"263'220","last_deep_scrub_stamp":"2024-09-22T08:57:07.746678+0000","last_clean_scrub_stamp":"2024-09-22T08:57:07.746678+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:57:44.914976+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1186,"num_read_kb":1185,"num_write":465,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"263'824","reported_seq":2527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:32.421909+0000","last_change":"2024-09-22T08:56:32.421909+0000","last_active":"2024-09-22T08:56:32.421909+0000","last_peered":"2024-09-22T08:56:32.421909+0000","last_clean":"2024-09-22T08:56:32.421909+0000","last_became_active":"2024-09-22T08:15:06.967603+0000","last_became_peered":"2024-09-22T08:15:06.967603+0000","last_unstale":"2024-09-22T08:56:32.421909+0000","last_undegraded":"2024-09-22T08:56:32.421909+0000","last_fullsized":"2024-09-22T08:56:32.421909+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'824","last_scrub_stamp":"2024-09-22T08:56:32.421797+0000","last_deep_scrub":"263'824","last_deep_scrub_stamp":"2024-09-22T08:56:32.421797+0000","last_clean_scrub_stamp":"2024-09-22T08:56:32.421797+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:35:50.459397+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4151,"num_read_kb":3787,"num_write":1085,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":251,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"263'211","reported_seq":883,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:27.464964+0000","last_change":"2024-09-22T08:56:27.464857+0000","last_active":"2024-09-22T08:56:27.464964+0000","last_peered":"2024-09-22T08:56:27.464964+0000","last_clean":"2024-09-22T08:56:27.464964+0000","last_became_active":"2024-09-22T08:15:04.957654+0000","last_became_peered":"2024-09-22T08:15:04.957654+0000","last_unstale":"2024-09-22T08:56:27.464964+0000","last_undegraded":"2024-09-22T08:56:27.464964+0000","last_fullsized":"2024-09-22T08:56:27.464964+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'211","last_scrub_stamp":"2024-09-22T08:56:27.464696+0000","last_deep_scrub":"263'211","last_deep_scrub_stamp":"2024-09-22T08:56:27.464696+0000","last_clean_scrub_stamp":"2024-09-22T08:56:27.464696+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:19:35.401370+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":592,"num_read_kb":25705,"num_write":948,"num_write_kb":45275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"263'2","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:46.806569+0000","last_change":"2024-09-22T08:56:46.806569+0000","last_active":"2024-09-22T08:56:46.806569+0000","last_peered":"2024-09-22T08:56:46.806569+0000","last_clean":"2024-09-22T08:56:46.806569+0000","last_became_active":"2024-09-22T08:15:08.972733+0000","last_became_peered":"2024-09-22T08:15:08.972733+0000","last_unstale":"2024-09-22T08:56:46.806569+0000","last_undegraded":"2024-09-22T08:56:46.806569+0000","last_fullsized":"2024-09-22T08:56:46.806569+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:56:46.806482+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:56:46.806482+0000","last_clean_scrub_stamp":"2024-09-22T08:56:46.806482+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:45:57.005123+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"263'161","reported_seq":751,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:57.902666+0000","last_change":"2024-09-22T08:56:57.902666+0000","last_active":"2024-09-22T08:56:57.902666+0000","last_peered":"2024-09-22T08:56:57.902666+0000","last_clean":"2024-09-22T08:56:57.902666+0000","last_became_active":"2024-09-22T08:15:10.987610+0000","last_became_peered":"2024-09-22T08:15:10.987610+0000","last_unstale":"2024-09-22T08:56:57.902666+0000","last_undegraded":"2024-09-22T08:56:57.902666+0000","last_fullsized":"2024-09-22T08:56:57.902666+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'161","last_scrub_stamp":"2024-09-22T08:56:57.902566+0000","last_deep_scrub":"263'161","last_deep_scrub_stamp":"2024-09-22T08:56:57.902566+0000","last_clean_scrub_stamp":"2024-09-22T08:56:57.902566+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:24:01.099997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6856,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":209,"num_read_kb":275,"num_write":118,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:58.863927+0000","last_change":"2024-09-22T08:56:58.863927+0000","last_active":"2024-09-22T08:56:58.863927+0000","last_peered":"2024-09-22T08:56:58.863927+0000","last_clean":"2024-09-22T08:56:58.863927+0000","last_became_active":"2024-09-22T08:15:13.003219+0000","last_became_peered":"2024-09-22T08:15:13.003219+0000","last_unstale":"2024-09-22T08:56:58.863927+0000","last_undegraded":"2024-09-22T08:56:58.863927+0000","last_fullsized":"2024-09-22T08:56:58.863927+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:58.863840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:58.863840+0000","last_clean_scrub_stamp":"2024-09-22T08:56:58.863840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:04:32.976325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"263'162","reported_seq":651,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:47.375795+0000","last_change":"2024-09-22T08:56:47.375743+0000","last_active":"2024-09-22T08:56:47.375795+0000","last_peered":"2024-09-22T08:56:47.375795+0000","last_clean":"2024-09-22T08:56:47.375795+0000","last_became_active":"2024-09-22T08:15:15.018311+0000","last_became_peered":"2024-09-22T08:15:15.018311+0000","last_unstale":"2024-09-22T08:56:47.375795+0000","last_undegraded":"2024-09-22T08:56:47.375795+0000","last_fullsized":"2024-09-22T08:56:47.375795+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'162","last_scrub_stamp":"2024-09-22T08:56:47.375645+0000","last_deep_scrub":"263'162","last_deep_scrub_stamp":"2024-09-22T08:56:47.375645+0000","last_clean_scrub_stamp":"2024-09-22T08:56:47.375645+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:55:47.154243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":160,"num_write":367,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"263'892","reported_seq":2479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:40.711673+0000","last_change":"2024-09-22T08:56:40.711673+0000","last_active":"2024-09-22T08:56:40.711673+0000","last_peered":"2024-09-22T08:56:40.711673+0000","last_clean":"2024-09-22T08:56:40.711673+0000","last_became_active":"2024-09-22T08:15:06.964786+0000","last_became_peered":"2024-09-22T08:15:06.964786+0000","last_unstale":"2024-09-22T08:56:40.711673+0000","last_undegraded":"2024-09-22T08:56:40.711673+0000","last_fullsized":"2024-09-22T08:56:40.711673+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'892","last_scrub_stamp":"2024-09-22T08:56:40.711582+0000","last_deep_scrub":"263'892","last_deep_scrub_stamp":"2024-09-22T08:56:40.711582+0000","last_clean_scrub_stamp":"2024-09-22T08:56:40.711582+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":800,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:45:38.702433+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4058,"num_read_kb":3642,"num_write":1164,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"263'229","reported_seq":906,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:24.354882+0000","last_change":"2024-09-22T08:56:24.354836+0000","last_active":"2024-09-22T08:56:24.354882+0000","last_peered":"2024-09-22T08:56:24.354882+0000","last_clean":"2024-09-22T08:56:24.354882+0000","last_became_active":"2024-09-22T08:15:04.962774+0000","last_became_peered":"2024-09-22T08:15:04.962774+0000","last_unstale":"2024-09-22T08:56:24.354882+0000","last_undegraded":"2024-09-22T08:56:24.354882+0000","last_fullsized":"2024-09-22T08:56:24.354882+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'229","last_scrub_stamp":"2024-09-22T08:56:24.354751+0000","last_deep_scrub":"263'229","last_deep_scrub_stamp":"2024-09-22T08:56:24.354751+0000","last_clean_scrub_stamp":"2024-09-22T08:56:24.354751+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:19:21.350986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":683,"num_read_kb":4749,"num_write":1115,"num_write_kb":28646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"263'864","reported_seq":2355,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:33.135511+0000","last_change":"2024-09-22T08:56:33.135511+0000","last_active":"2024-09-22T08:56:33.135511+0000","last_peered":"2024-09-22T08:56:33.135511+0000","last_clean":"2024-09-22T08:56:33.135511+0000","last_became_active":"2024-09-22T08:15:06.958389+0000","last_became_peered":"2024-09-22T08:15:06.958389+0000","last_unstale":"2024-09-22T08:56:33.135511+0000","last_undegraded":"2024-09-22T08:56:33.135511+0000","last_fullsized":"2024-09-22T08:56:33.135511+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'864","last_scrub_stamp":"2024-09-22T08:56:33.135421+0000","last_deep_scrub":"263'864","last_deep_scrub_stamp":"2024-09-22T08:56:33.135421+0000","last_clean_scrub_stamp":"2024-09-22T08:56:33.135421+0000","objects_scrubbed":2,"log_size":64,"log_dups_size":800,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:10:17.769140+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3808,"num_read_kb":3398,"num_write":1097,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"263'366","reported_seq":1063,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:26.085025+0000","last_change":"2024-09-22T08:56:26.084966+0000","last_active":"2024-09-22T08:56:26.085025+0000","last_peered":"2024-09-22T08:56:26.085025+0000","last_clean":"2024-09-22T08:56:26.085025+0000","last_became_active":"2024-09-22T08:15:04.950922+0000","last_became_peered":"2024-09-22T08:15:04.950922+0000","last_unstale":"2024-09-22T08:56:26.085025+0000","last_undegraded":"2024-09-22T08:56:26.085025+0000","last_fullsized":"2024-09-22T08:56:26.085025+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'366","last_scrub_stamp":"2024-09-22T08:56:26.084868+0000","last_deep_scrub":"263'366","last_deep_scrub_stamp":"2024-09-22T08:56:26.084868+0000","last_clean_scrub_stamp":"2024-09-22T08:56:26.084868+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:20:49.984873+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1005,"num_read_kb":11417,"num_write":1356,"num_write_kb":38557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"263'417","reported_seq":1875,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:44.891717+0000","last_change":"2024-09-22T08:56:44.891717+0000","last_active":"2024-09-22T08:56:44.891717+0000","last_peered":"2024-09-22T08:56:44.891717+0000","last_clean":"2024-09-22T08:56:44.891717+0000","last_became_active":"2024-09-22T08:15:06.973749+0000","last_became_peered":"2024-09-22T08:15:06.973749+0000","last_unstale":"2024-09-22T08:56:44.891717+0000","last_undegraded":"2024-09-22T08:56:44.891717+0000","last_fullsized":"2024-09-22T08:56:44.891717+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'417","last_scrub_stamp":"2024-09-22T08:56:44.891634+0000","last_deep_scrub":"263'417","last_deep_scrub_stamp":"2024-09-22T08:56:44.891634+0000","last_clean_scrub_stamp":"2024-09-22T08:56:44.891634+0000","objects_scrubbed":3,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:02:30.214518+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2229,"num_read_kb":2093,"num_write":519,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"263'230","reported_seq":870,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:34.824572+0000","last_change":"2024-09-22T08:56:34.824521+0000","last_active":"2024-09-22T08:56:34.824572+0000","last_peered":"2024-09-22T08:56:34.824572+0000","last_clean":"2024-09-22T08:56:34.824572+0000","last_became_active":"2024-09-22T08:15:04.959501+0000","last_became_peered":"2024-09-22T08:15:04.959501+0000","last_unstale":"2024-09-22T08:56:34.824572+0000","last_undegraded":"2024-09-22T08:56:34.824572+0000","last_fullsized":"2024-09-22T08:56:34.824572+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'230","last_scrub_stamp":"2024-09-22T08:56:34.824414+0000","last_deep_scrub":"263'230","last_deep_scrub_stamp":"2024-09-22T08:56:34.824414+0000","last_clean_scrub_stamp":"2024-09-22T08:56:34.824414+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:20:56.179522+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":551,"num_read_kb":25081,"num_write":1074,"num_write_kb":19730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"263'880","reported_seq":2582,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:41.441953+0000","last_change":"2024-09-22T08:56:41.441953+0000","last_active":"2024-09-22T08:56:41.441953+0000","last_peered":"2024-09-22T08:56:41.441953+0000","last_clean":"2024-09-22T08:56:41.441953+0000","last_became_active":"2024-09-22T08:15:06.970991+0000","last_became_peered":"2024-09-22T08:15:06.970991+0000","last_unstale":"2024-09-22T08:56:41.441953+0000","last_undegraded":"2024-09-22T08:56:41.441953+0000","last_fullsized":"2024-09-22T08:56:41.441953+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'880","last_scrub_stamp":"2024-09-22T08:56:41.441866+0000","last_deep_scrub":"263'880","last_deep_scrub_stamp":"2024-09-22T08:56:41.441866+0000","last_clean_scrub_stamp":"2024-09-22T08:56:41.441866+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":800,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:00:49.369182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4175,"num_read_kb":3774,"num_write":1132,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"263'196","reported_seq":836,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:28.437284+0000","last_change":"2024-09-22T08:56:28.437228+0000","last_active":"2024-09-22T08:56:28.437284+0000","last_peered":"2024-09-22T08:56:28.437284+0000","last_clean":"2024-09-22T08:56:28.437284+0000","last_became_active":"2024-09-22T08:15:04.954281+0000","last_became_peered":"2024-09-22T08:15:04.954281+0000","last_unstale":"2024-09-22T08:56:28.437284+0000","last_undegraded":"2024-09-22T08:56:28.437284+0000","last_fullsized":"2024-09-22T08:56:28.437284+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'196","last_scrub_stamp":"2024-09-22T08:56:28.437133+0000","last_deep_scrub":"263'196","last_deep_scrub_stamp":"2024-09-22T08:56:28.437133+0000","last_clean_scrub_stamp":"2024-09-22T08:56:28.437133+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:09:07.572237+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":578,"num_read_kb":4135,"num_write":927,"num_write_kb":8648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"263'1130","reported_seq":2693,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:40.404544+0000","last_change":"2024-09-22T08:56:40.404490+0000","last_active":"2024-09-22T08:56:40.404544+0000","last_peered":"2024-09-22T08:56:40.404544+0000","last_clean":"2024-09-22T08:56:40.404544+0000","last_became_active":"2024-09-22T08:15:06.967938+0000","last_became_peered":"2024-09-22T08:15:06.967938+0000","last_unstale":"2024-09-22T08:56:40.404544+0000","last_undegraded":"2024-09-22T08:56:40.404544+0000","last_fullsized":"2024-09-22T08:56:40.404544+0000","mapping_epoch":25,"log_start":"263'1100","ondisk_log_start":"263'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1130","last_scrub_stamp":"2024-09-22T08:56:40.404388+0000","last_deep_scrub":"263'1130","last_deep_scrub_stamp":"2024-09-22T08:56:40.404388+0000","last_clean_scrub_stamp":"2024-09-22T08:56:40.404388+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":1100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:38:56.900661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5297,"num_read_kb":4688,"num_write":1564,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"263'199","reported_seq":885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:26.505368+0000","last_change":"2024-09-22T08:56:26.505368+0000","last_active":"2024-09-22T08:56:26.505368+0000","last_peered":"2024-09-22T08:56:26.505368+0000","last_clean":"2024-09-22T08:56:26.505368+0000","last_became_active":"2024-09-22T08:15:04.963992+0000","last_became_peered":"2024-09-22T08:15:04.963992+0000","last_unstale":"2024-09-22T08:56:26.505368+0000","last_undegraded":"2024-09-22T08:56:26.505368+0000","last_fullsized":"2024-09-22T08:56:26.505368+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'199","last_scrub_stamp":"2024-09-22T08:56:26.505257+0000","last_deep_scrub":"263'199","last_deep_scrub_stamp":"2024-09-22T08:56:26.505257+0000","last_clean_scrub_stamp":"2024-09-22T08:56:26.505257+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:32:39.305652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":707,"num_read_kb":8108,"num_write":879,"num_write_kb":38701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"263'392","reported_seq":2075,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:33.426368+0000","last_change":"2024-09-22T08:56:33.426299+0000","last_active":"2024-09-22T08:56:33.426368+0000","last_peered":"2024-09-22T08:56:33.426368+0000","last_clean":"2024-09-22T08:56:33.426368+0000","last_became_active":"2024-09-22T08:15:06.964116+0000","last_became_peered":"2024-09-22T08:15:06.964116+0000","last_unstale":"2024-09-22T08:56:33.426368+0000","last_undegraded":"2024-09-22T08:56:33.426368+0000","last_fullsized":"2024-09-22T08:56:33.426368+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'392","last_scrub_stamp":"2024-09-22T08:56:33.426207+0000","last_deep_scrub":"263'392","last_deep_scrub_stamp":"2024-09-22T08:56:33.426207+0000","last_clean_scrub_stamp":"2024-09-22T08:56:33.426207+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:49:41.669632+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2347,"num_read_kb":2272,"num_write":440,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"263'230","reported_seq":920,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:27.538446+0000","last_change":"2024-09-22T08:56:27.538446+0000","last_active":"2024-09-22T08:56:27.538446+0000","last_peered":"2024-09-22T08:56:27.538446+0000","last_clean":"2024-09-22T08:56:27.538446+0000","last_became_active":"2024-09-22T08:15:04.951628+0000","last_became_peered":"2024-09-22T08:15:04.951628+0000","last_unstale":"2024-09-22T08:56:27.538446+0000","last_undegraded":"2024-09-22T08:56:27.538446+0000","last_fullsized":"2024-09-22T08:56:27.538446+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'230","last_scrub_stamp":"2024-09-22T08:56:27.538344+0000","last_deep_scrub":"263'230","last_deep_scrub_stamp":"2024-09-22T08:56:27.538344+0000","last_clean_scrub_stamp":"2024-09-22T08:56:27.538344+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:55:52.381757+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":736,"num_read_kb":9856,"num_write":1118,"num_write_kb":28547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"263'359","reported_seq":1841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:35.475638+0000","last_change":"2024-09-22T08:56:35.475586+0000","last_active":"2024-09-22T08:56:35.475638+0000","last_peered":"2024-09-22T08:56:35.475638+0000","last_clean":"2024-09-22T08:56:35.475638+0000","last_became_active":"2024-09-22T08:15:06.973584+0000","last_became_peered":"2024-09-22T08:15:06.973584+0000","last_unstale":"2024-09-22T08:56:35.475638+0000","last_undegraded":"2024-09-22T08:56:35.475638+0000","last_fullsized":"2024-09-22T08:56:35.475638+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-22T08:56:35.475501+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-22T08:56:35.475501+0000","last_clean_scrub_stamp":"2024-09-22T08:56:35.475501+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:33:22.764519+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2011,"num_read_kb":1931,"num_write":399,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"263'218","reported_seq":893,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:26.335055+0000","last_change":"2024-09-22T08:56:26.335055+0000","last_active":"2024-09-22T08:56:26.335055+0000","last_peered":"2024-09-22T08:56:26.335055+0000","last_clean":"2024-09-22T08:56:26.335055+0000","last_became_active":"2024-09-22T08:15:04.968983+0000","last_became_peered":"2024-09-22T08:15:04.968983+0000","last_unstale":"2024-09-22T08:56:26.335055+0000","last_undegraded":"2024-09-22T08:56:26.335055+0000","last_fullsized":"2024-09-22T08:56:26.335055+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'218","last_scrub_stamp":"2024-09-22T08:56:26.334945+0000","last_deep_scrub":"263'218","last_deep_scrub_stamp":"2024-09-22T08:56:26.334945+0000","last_clean_scrub_stamp":"2024-09-22T08:56:26.334945+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:49:29.445563+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":615,"num_read_kb":66139,"num_write":1057,"num_write_kb":31816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"263'1265","reported_seq":3124,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:27.877868+0000","last_change":"2024-09-22T08:56:27.877792+0000","last_active":"2024-09-22T08:56:27.877868+0000","last_peered":"2024-09-22T08:56:27.877868+0000","last_clean":"2024-09-22T08:56:27.877868+0000","last_became_active":"2024-09-22T08:15:06.970055+0000","last_became_peered":"2024-09-22T08:15:06.970055+0000","last_unstale":"2024-09-22T08:56:27.877868+0000","last_undegraded":"2024-09-22T08:56:27.877868+0000","last_fullsized":"2024-09-22T08:56:27.877868+0000","mapping_epoch":25,"log_start":"263'1200","ondisk_log_start":"263'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1265","last_scrub_stamp":"2024-09-22T08:56:27.877698+0000","last_deep_scrub":"263'1265","last_deep_scrub_stamp":"2024-09-22T08:56:27.877698+0000","last_clean_scrub_stamp":"2024-09-22T08:56:27.877698+0000","objects_scrubbed":3,"log_size":65,"log_dups_size":1200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:13:51.554575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6370,"num_read_kb":5597,"num_write":1961,"num_write_kb":987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1756,"num_omap_keys":7,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"263'219","reported_seq":890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:29.465649+0000","last_change":"2024-09-22T08:56:29.465649+0000","last_active":"2024-09-22T08:56:29.465649+0000","last_peered":"2024-09-22T08:56:29.465649+0000","last_clean":"2024-09-22T08:56:29.465649+0000","last_became_active":"2024-09-22T08:15:04.961545+0000","last_became_peered":"2024-09-22T08:15:04.961545+0000","last_unstale":"2024-09-22T08:56:29.465649+0000","last_undegraded":"2024-09-22T08:56:29.465649+0000","last_fullsized":"2024-09-22T08:56:29.465649+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'219","last_scrub_stamp":"2024-09-22T08:56:29.465544+0000","last_deep_scrub":"263'219","last_deep_scrub_stamp":"2024-09-22T08:56:29.465544+0000","last_clean_scrub_stamp":"2024-09-22T08:56:29.465544+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:08:30.829892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":669,"num_read_kb":2609,"num_write":1038,"num_write_kb":23374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"263'491","reported_seq":1949,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:35.144999+0000","last_change":"2024-09-22T08:56:35.144945+0000","last_active":"2024-09-22T08:56:35.144999+0000","last_peered":"2024-09-22T08:56:35.144999+0000","last_clean":"2024-09-22T08:56:35.144999+0000","last_became_active":"2024-09-22T08:15:06.959331+0000","last_became_peered":"2024-09-22T08:15:06.959331+0000","last_unstale":"2024-09-22T08:56:35.144999+0000","last_undegraded":"2024-09-22T08:56:35.144999+0000","last_fullsized":"2024-09-22T08:56:35.144999+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'491","last_scrub_stamp":"2024-09-22T08:56:35.144843+0000","last_deep_scrub":"263'491","last_deep_scrub_stamp":"2024-09-22T08:56:35.144843+0000","last_clean_scrub_stamp":"2024-09-22T08:56:35.144843+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:30:09.143732+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2542,"num_read_kb":2330,"num_write":651,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"263'196","reported_seq":795,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:35.803962+0000","last_change":"2024-09-22T08:56:35.803962+0000","last_active":"2024-09-22T08:56:35.803962+0000","last_peered":"2024-09-22T08:56:35.803962+0000","last_clean":"2024-09-22T08:56:35.803962+0000","last_became_active":"2024-09-22T08:15:04.958725+0000","last_became_peered":"2024-09-22T08:15:04.958725+0000","last_unstale":"2024-09-22T08:56:35.803962+0000","last_undegraded":"2024-09-22T08:56:35.803962+0000","last_fullsized":"2024-09-22T08:56:35.803962+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'196","last_scrub_stamp":"2024-09-22T08:56:35.803797+0000","last_deep_scrub":"263'196","last_deep_scrub_stamp":"2024-09-22T08:56:35.803797+0000","last_clean_scrub_stamp":"2024-09-22T08:56:35.803797+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:19:54.336476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":392,"num_read_kb":18786,"num_write":900,"num_write_kb":46944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"263'799","reported_seq":2391,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:34.449105+0000","last_change":"2024-09-22T08:56:34.449040+0000","last_active":"2024-09-22T08:56:34.449105+0000","last_peered":"2024-09-22T08:56:34.449105+0000","last_clean":"2024-09-22T08:56:34.449105+0000","last_became_active":"2024-09-22T08:15:06.956485+0000","last_became_peered":"2024-09-22T08:15:06.956485+0000","last_unstale":"2024-09-22T08:56:34.449105+0000","last_undegraded":"2024-09-22T08:56:34.449105+0000","last_fullsized":"2024-09-22T08:56:34.449105+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'799","last_scrub_stamp":"2024-09-22T08:56:34.448950+0000","last_deep_scrub":"263'799","last_deep_scrub_stamp":"2024-09-22T08:56:34.448950+0000","last_clean_scrub_stamp":"2024-09-22T08:56:34.448950+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:15.749892+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3799,"num_read_kb":3445,"num_write":1066,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"263'218","reported_seq":899,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:31.387996+0000","last_change":"2024-09-22T08:56:31.387996+0000","last_active":"2024-09-22T08:56:31.387996+0000","last_peered":"2024-09-22T08:56:31.387996+0000","last_clean":"2024-09-22T08:56:31.387996+0000","last_became_active":"2024-09-22T08:15:04.962165+0000","last_became_peered":"2024-09-22T08:15:04.962165+0000","last_unstale":"2024-09-22T08:56:31.387996+0000","last_undegraded":"2024-09-22T08:56:31.387996+0000","last_fullsized":"2024-09-22T08:56:31.387996+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'218","last_scrub_stamp":"2024-09-22T08:56:31.387900+0000","last_deep_scrub":"263'218","last_deep_scrub_stamp":"2024-09-22T08:56:31.387900+0000","last_clean_scrub_stamp":"2024-09-22T08:56:31.387900+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:42:29.087154+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":601,"num_read_kb":98488,"num_write":1035,"num_write_kb":53405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"263'774","reported_seq":2250,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:42.455820+0000","last_change":"2024-09-22T08:56:42.455820+0000","last_active":"2024-09-22T08:56:42.455820+0000","last_peered":"2024-09-22T08:56:42.455820+0000","last_clean":"2024-09-22T08:56:42.455820+0000","last_became_active":"2024-09-22T08:15:06.970111+0000","last_became_peered":"2024-09-22T08:15:06.970111+0000","last_unstale":"2024-09-22T08:56:42.455820+0000","last_undegraded":"2024-09-22T08:56:42.455820+0000","last_fullsized":"2024-09-22T08:56:42.455820+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'774","last_scrub_stamp":"2024-09-22T08:56:42.455718+0000","last_deep_scrub":"263'774","last_deep_scrub_stamp":"2024-09-22T08:56:42.455718+0000","last_clean_scrub_stamp":"2024-09-22T08:56:42.455718+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:58:53.024040+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3767,"num_read_kb":3405,"num_write":1035,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"263'192","reported_seq":902,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:21.922992+0000","last_change":"2024-09-22T08:56:21.922992+0000","last_active":"2024-09-22T08:56:21.922992+0000","last_peered":"2024-09-22T08:56:21.922992+0000","last_clean":"2024-09-22T08:56:21.922992+0000","last_became_active":"2024-09-22T08:15:04.963383+0000","last_became_peered":"2024-09-22T08:15:04.963383+0000","last_unstale":"2024-09-22T08:56:21.922992+0000","last_undegraded":"2024-09-22T08:56:21.922992+0000","last_fullsized":"2024-09-22T08:56:21.922992+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'192","last_scrub_stamp":"2024-09-22T08:56:21.922907+0000","last_deep_scrub":"263'192","last_deep_scrub_stamp":"2024-09-22T08:56:21.922907+0000","last_clean_scrub_stamp":"2024-09-22T08:56:21.922907+0000","objects_scrubbed":5,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:34:08.554670+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":846,"num_read_kb":15214,"num_write":846,"num_write_kb":25255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"263'750","reported_seq":2184,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:29.779798+0000","last_change":"2024-09-22T08:56:29.779798+0000","last_active":"2024-09-22T08:56:29.779798+0000","last_peered":"2024-09-22T08:56:29.779798+0000","last_clean":"2024-09-22T08:56:29.779798+0000","last_became_active":"2024-09-22T08:15:06.967819+0000","last_became_peered":"2024-09-22T08:15:06.967819+0000","last_unstale":"2024-09-22T08:56:29.779798+0000","last_undegraded":"2024-09-22T08:56:29.779798+0000","last_fullsized":"2024-09-22T08:56:29.779798+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'750","last_scrub_stamp":"2024-09-22T08:56:29.779699+0000","last_deep_scrub":"263'750","last_deep_scrub_stamp":"2024-09-22T08:56:29.779699+0000","last_clean_scrub_stamp":"2024-09-22T08:56:29.779699+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":700,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:42:36.409781+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3557,"num_read_kb":3203,"num_write":994,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"263'222","reported_seq":860,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:30.600999+0000","last_change":"2024-09-22T08:56:30.600999+0000","last_active":"2024-09-22T08:56:30.600999+0000","last_peered":"2024-09-22T08:56:30.600999+0000","last_clean":"2024-09-22T08:56:30.600999+0000","last_became_active":"2024-09-22T08:15:04.963035+0000","last_became_peered":"2024-09-22T08:15:04.963035+0000","last_unstale":"2024-09-22T08:56:30.600999+0000","last_undegraded":"2024-09-22T08:56:30.600999+0000","last_fullsized":"2024-09-22T08:56:30.600999+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'222","last_scrub_stamp":"2024-09-22T08:56:30.600894+0000","last_deep_scrub":"263'222","last_deep_scrub_stamp":"2024-09-22T08:56:30.600894+0000","last_clean_scrub_stamp":"2024-09-22T08:56:30.600894+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:34:32.074093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":484,"num_read_kb":60036,"num_write":970,"num_write_kb":46477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"263'435","reported_seq":2064,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:32.742512+0000","last_change":"2024-09-22T08:56:32.742512+0000","last_active":"2024-09-22T08:56:32.742512+0000","last_peered":"2024-09-22T08:56:32.742512+0000","last_clean":"2024-09-22T08:56:32.742512+0000","last_became_active":"2024-09-22T08:15:06.972901+0000","last_became_peered":"2024-09-22T08:15:06.972901+0000","last_unstale":"2024-09-22T08:56:32.742512+0000","last_undegraded":"2024-09-22T08:56:32.742512+0000","last_fullsized":"2024-09-22T08:56:32.742512+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'435","last_scrub_stamp":"2024-09-22T08:56:32.742406+0000","last_deep_scrub":"263'435","last_deep_scrub_stamp":"2024-09-22T08:56:32.742406+0000","last_clean_scrub_stamp":"2024-09-22T08:56:32.742406+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:25:24.212860+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2630,"num_read_kb":2493,"num_write":497,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2041,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"263'193","reported_seq":804,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:24.511017+0000","last_change":"2024-09-22T08:56:24.511017+0000","last_active":"2024-09-22T08:56:24.511017+0000","last_peered":"2024-09-22T08:56:24.511017+0000","last_clean":"2024-09-22T08:56:24.511017+0000","last_became_active":"2024-09-22T08:15:04.954601+0000","last_became_peered":"2024-09-22T08:15:04.954601+0000","last_unstale":"2024-09-22T08:56:24.511017+0000","last_undegraded":"2024-09-22T08:56:24.511017+0000","last_fullsized":"2024-09-22T08:56:24.511017+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'193","last_scrub_stamp":"2024-09-22T08:56:24.510944+0000","last_deep_scrub":"263'193","last_deep_scrub_stamp":"2024-09-22T08:56:24.510944+0000","last_clean_scrub_stamp":"2024-09-22T08:56:24.510944+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:11.452087+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":488,"num_read_kb":10659,"num_write":871,"num_write_kb":26887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"263'440","reported_seq":1908,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:34.118935+0000","last_change":"2024-09-22T08:56:34.118935+0000","last_active":"2024-09-22T08:56:34.118935+0000","last_peered":"2024-09-22T08:56:34.118935+0000","last_clean":"2024-09-22T08:56:34.118935+0000","last_became_active":"2024-09-22T08:15:06.955721+0000","last_became_peered":"2024-09-22T08:15:06.955721+0000","last_unstale":"2024-09-22T08:56:34.118935+0000","last_undegraded":"2024-09-22T08:56:34.118935+0000","last_fullsized":"2024-09-22T08:56:34.118935+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'440","last_scrub_stamp":"2024-09-22T08:56:34.118840+0000","last_deep_scrub":"263'440","last_deep_scrub_stamp":"2024-09-22T08:56:34.118840+0000","last_clean_scrub_stamp":"2024-09-22T08:56:34.118840+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:00:17.060498+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2301,"num_read_kb":2146,"num_write":527,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"263'218","reported_seq":887,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:36.784912+0000","last_change":"2024-09-22T08:56:36.784912+0000","last_active":"2024-09-22T08:56:36.784912+0000","last_peered":"2024-09-22T08:56:36.784912+0000","last_clean":"2024-09-22T08:56:36.784912+0000","last_became_active":"2024-09-22T08:15:04.961217+0000","last_became_peered":"2024-09-22T08:15:04.961217+0000","last_unstale":"2024-09-22T08:56:36.784912+0000","last_undegraded":"2024-09-22T08:56:36.784912+0000","last_fullsized":"2024-09-22T08:56:36.784912+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'218","last_scrub_stamp":"2024-09-22T08:56:36.784815+0000","last_deep_scrub":"263'218","last_deep_scrub_stamp":"2024-09-22T08:56:36.784815+0000","last_clean_scrub_stamp":"2024-09-22T08:56:36.784815+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:05:54.668509+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":598,"num_read_kb":11776,"num_write":1062,"num_write_kb":6843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"263'550","reported_seq":2089,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:36.669377+0000","last_change":"2024-09-22T08:56:36.669377+0000","last_active":"2024-09-22T08:56:36.669377+0000","last_peered":"2024-09-22T08:56:36.669377+0000","last_clean":"2024-09-22T08:56:36.669377+0000","last_became_active":"2024-09-22T08:15:06.970735+0000","last_became_peered":"2024-09-22T08:15:06.970735+0000","last_unstale":"2024-09-22T08:56:36.669377+0000","last_undegraded":"2024-09-22T08:56:36.669377+0000","last_fullsized":"2024-09-22T08:56:36.669377+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'550","last_scrub_stamp":"2024-09-22T08:56:36.669289+0000","last_deep_scrub":"263'550","last_deep_scrub_stamp":"2024-09-22T08:56:36.669289+0000","last_clean_scrub_stamp":"2024-09-22T08:56:36.669289+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":500,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:31:27.633080+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2725,"num_read_kb":2496,"num_write":675,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"263'221","reported_seq":887,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:32.099826+0000","last_change":"2024-09-22T08:56:32.099772+0000","last_active":"2024-09-22T08:56:32.099826+0000","last_peered":"2024-09-22T08:56:32.099826+0000","last_clean":"2024-09-22T08:56:32.099826+0000","last_became_active":"2024-09-22T08:15:04.968172+0000","last_became_peered":"2024-09-22T08:15:04.968172+0000","last_unstale":"2024-09-22T08:56:32.099826+0000","last_undegraded":"2024-09-22T08:56:32.099826+0000","last_fullsized":"2024-09-22T08:56:32.099826+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'221","last_scrub_stamp":"2024-09-22T08:56:32.099657+0000","last_deep_scrub":"263'221","last_deep_scrub_stamp":"2024-09-22T08:56:32.099657+0000","last_clean_scrub_stamp":"2024-09-22T08:56:32.099657+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:37:00.416721+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":641,"num_read_kb":8608,"num_write":1007,"num_write_kb":17473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"263'757","reported_seq":2299,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:38.811418+0000","last_change":"2024-09-22T08:56:38.811418+0000","last_active":"2024-09-22T08:56:38.811418+0000","last_peered":"2024-09-22T08:56:38.811418+0000","last_clean":"2024-09-22T08:56:38.811418+0000","last_became_active":"2024-09-22T08:15:06.976019+0000","last_became_peered":"2024-09-22T08:15:06.976019+0000","last_unstale":"2024-09-22T08:56:38.811418+0000","last_undegraded":"2024-09-22T08:56:38.811418+0000","last_fullsized":"2024-09-22T08:56:38.811418+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'757","last_scrub_stamp":"2024-09-22T08:56:38.811329+0000","last_deep_scrub":"263'757","last_deep_scrub_stamp":"2024-09-22T08:56:38.811329+0000","last_clean_scrub_stamp":"2024-09-22T08:56:38.811329+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:12:18.113138+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3691,"num_read_kb":3360,"num_write":995,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"263'226","reported_seq":925,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:37.743182+0000","last_change":"2024-09-22T08:56:37.743129+0000","last_active":"2024-09-22T08:56:37.743182+0000","last_peered":"2024-09-22T08:56:37.743182+0000","last_clean":"2024-09-22T08:56:37.743182+0000","last_became_active":"2024-09-22T08:15:04.963391+0000","last_became_peered":"2024-09-22T08:15:04.963391+0000","last_unstale":"2024-09-22T08:56:37.743182+0000","last_undegraded":"2024-09-22T08:56:37.743182+0000","last_fullsized":"2024-09-22T08:56:37.743182+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'226","last_scrub_stamp":"2024-09-22T08:56:37.743035+0000","last_deep_scrub":"263'226","last_deep_scrub_stamp":"2024-09-22T08:56:37.743035+0000","last_clean_scrub_stamp":"2024-09-22T08:56:37.743035+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:49:16.424122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":637,"num_read_kb":95067,"num_write":1060,"num_write_kb":43906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"263'269","reported_seq":933,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:38.770086+0000","last_change":"2024-09-22T08:56:38.770007+0000","last_active":"2024-09-22T08:56:38.770086+0000","last_peered":"2024-09-22T08:56:38.770086+0000","last_clean":"2024-09-22T08:56:38.770086+0000","last_became_active":"2024-09-22T08:15:04.965396+0000","last_became_peered":"2024-09-22T08:15:04.965396+0000","last_unstale":"2024-09-22T08:56:38.770086+0000","last_undegraded":"2024-09-22T08:56:38.770086+0000","last_fullsized":"2024-09-22T08:56:38.770086+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'269","last_scrub_stamp":"2024-09-22T08:56:38.769874+0000","last_deep_scrub":"263'269","last_deep_scrub_stamp":"2024-09-22T08:56:38.769874+0000","last_clean_scrub_stamp":"2024-09-22T08:56:38.769874+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:54.013054+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":744,"num_read_kb":7770,"num_write":1118,"num_write_kb":20319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"263'1212","reported_seq":2932,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:38.730878+0000","last_change":"2024-09-22T08:56:38.730878+0000","last_active":"2024-09-22T08:56:38.730878+0000","last_peered":"2024-09-22T08:56:38.730878+0000","last_clean":"2024-09-22T08:56:38.730878+0000","last_became_active":"2024-09-22T08:15:06.970717+0000","last_became_peered":"2024-09-22T08:15:06.970717+0000","last_unstale":"2024-09-22T08:56:38.730878+0000","last_undegraded":"2024-09-22T08:56:38.730878+0000","last_fullsized":"2024-09-22T08:56:38.730878+0000","mapping_epoch":25,"log_start":"263'1200","ondisk_log_start":"263'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1212","last_scrub_stamp":"2024-09-22T08:56:38.730771+0000","last_deep_scrub":"263'1212","last_deep_scrub_stamp":"2024-09-22T08:56:38.730771+0000","last_clean_scrub_stamp":"2024-09-22T08:56:38.730771+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":1200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:49:00.467574+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5779,"num_read_kb":5147,"num_write":1662,"num_write_kb":686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"263'203","reported_seq":797,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:32.373515+0000","last_change":"2024-09-22T08:56:32.373450+0000","last_active":"2024-09-22T08:56:32.373515+0000","last_peered":"2024-09-22T08:56:32.373515+0000","last_clean":"2024-09-22T08:56:32.373515+0000","last_became_active":"2024-09-22T08:15:04.959102+0000","last_became_peered":"2024-09-22T08:15:04.959102+0000","last_unstale":"2024-09-22T08:56:32.373515+0000","last_undegraded":"2024-09-22T08:56:32.373515+0000","last_fullsized":"2024-09-22T08:56:32.373515+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'203","last_scrub_stamp":"2024-09-22T08:56:32.373334+0000","last_deep_scrub":"263'203","last_deep_scrub_stamp":"2024-09-22T08:56:32.373334+0000","last_clean_scrub_stamp":"2024-09-22T08:56:32.373334+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:45:32.367319+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":396,"num_read_kb":24955,"num_write":899,"num_write_kb":36551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"263'499","reported_seq":2117,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:33.765206+0000","last_change":"2024-09-22T08:56:33.765206+0000","last_active":"2024-09-22T08:56:33.765206+0000","last_peered":"2024-09-22T08:56:33.765206+0000","last_clean":"2024-09-22T08:56:33.765206+0000","last_became_active":"2024-09-22T08:15:06.968345+0000","last_became_peered":"2024-09-22T08:15:06.968345+0000","last_unstale":"2024-09-22T08:56:33.765206+0000","last_undegraded":"2024-09-22T08:56:33.765206+0000","last_fullsized":"2024-09-22T08:56:33.765206+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'499","last_scrub_stamp":"2024-09-22T08:56:33.765098+0000","last_deep_scrub":"263'499","last_deep_scrub_stamp":"2024-09-22T08:56:33.765098+0000","last_clean_scrub_stamp":"2024-09-22T08:56:33.765098+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:28:36.072865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2601,"num_read_kb":2436,"num_write":597,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10844,"num_read_kb":8840,"num_write":3116,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":899,"ondisk_log_size":899,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15081,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":16349,"num_read_kb":16036,"num_write":17069,"num_write_kb":4981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2585,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":30162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1770,"ondisk_log_size":1770,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":681,"ondisk_log_size":681,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382382,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":8323,"num_read_kb":10644,"num_write":5603,"num_write_kb":2773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":709928,"num_omap_keys":1614,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1795,"ondisk_log_size":1795,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2393,"num_read_kb":2857,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":219693,"num_read_kb":201308,"num_write":55750,"num_write_kb":18998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35480,"num_omap_keys":143,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4023,"ondisk_log_size":4023,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":22399416,"num_objects":166,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":166,"num_whiteouts":0,"num_read":38892,"num_read_kb":2161027,"num_write":64127,"num_write_kb":2146956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45760512,"data_stored":44798832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3530,"ondisk_log_size":3530,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":194127,"num_write":186,"num_write_kb":125446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":186900,"num_write":186,"num_write_kb":125446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509955,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":202588,"kb_used_data":8972,"kb_used_omap":1,"kb_used_meta":193598,"kb_avail":94169252,"statfs":{"total":96636764160,"available":96429314048,"internally_reserved":0,"allocated":9187328,"data_stored":7502420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":198244808},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509956,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":261412,"kb_used_data":9492,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94110428,"statfs":{"total":96636764160,"available":96369078272,"internally_reserved":0,"allocated":9719808,"data_stored":8091734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257948101},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509956,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":86104,"kb_used_data":10504,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94285736,"statfs":{"total":96636764160,"available":96548593664,"internally_reserved":0,"allocated":10756096,"data_stored":9074858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542659,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":208972,"kb_used_data":7100,"kb_used_omap":1,"kb_used_meta":201854,"kb_avail":94162868,"statfs":{"total":96636764160,"available":96422776832,"internally_reserved":0,"allocated":7270400,"data_stored":5649861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":206698954},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542658,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81736,"kb_used_data":10296,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94290104,"statfs":{"total":96636764160,"available":96553066496,"internally_reserved":0,"allocated":10543104,"data_stored":8890315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542659,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":248020,"kb_used_data":9988,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94123820,"statfs":{"total":96636764160,"available":96382791680,"internally_reserved":0,"allocated":10227712,"data_stored":8586347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243726789},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542661,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148296,"kb_used_data":8888,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94223544,"statfs":{"total":96636764160,"available":96484909056,"internally_reserved":0,"allocated":9101312,"data_stored":7502190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575361,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120688,"kb_used_data":8992,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94251152,"statfs":{"total":96636764160,"available":96513179648,"internally_reserved":0,"allocated":9207808,"data_stored":7504913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7127040,"data_stored":6973120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5500928,"data_stored":5399874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5558272,"data_stored":5400076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5541888,"data_stored":5400084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5492736,"data_stored":5399824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":6012928,"data_stored":5893124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6889472,"data_stored":6786226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3637248,"data_stored":3546504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":5633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":3876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":5455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T08:57:26.046 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:26.046 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-22T08:31:10.185283+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:26.047 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:26.047 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:26.047 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-22T08:31:13.222595+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=31, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:26.047 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:26.048 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-22T08:42:16.388151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=56, tm_sec=19, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:57:26.051 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-22T08:57:46.052 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T08:57:46.412 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-22T08:57:46.426 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-09-22T08:57:46.428 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":1546,"stamp":"2024-09-22T08:57:45.669988+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23389059,"num_objects":621,"num_object_clones":0,"num_object_copies":1242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":621,"num_whiteouts":0,"num_read":296912,"num_read_kb":2781806,"num_write":146178,"num_write_kb":2427265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":189,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":749121,"num_omap_keys":1786,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13058,"ondisk_log_size":13058,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1357816,"kb_used_data":74232,"kb_used_omap":12,"kb_used_meta":1283443,"kb_avail":753616904,"statfs":{"total":773094113280,"available":771703709696,"internally_reserved":0,"allocated":76013568,"data_stored":62802638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1314246193},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005652"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:59.283337+0000","last_change":"2024-09-22T08:56:59.283247+0000","last_active":"2024-09-22T08:56:59.283337+0000","last_peered":"2024-09-22T08:56:59.283337+0000","last_clean":"2024-09-22T08:56:59.283337+0000","last_became_active":"2024-09-22T08:42:17.435576+0000","last_became_peered":"2024-09-22T08:42:17.435576+0000","last_unstale":"2024-09-22T08:56:59.283337+0000","last_undegraded":"2024-09-22T08:56:59.283337+0000","last_fullsized":"2024-09-22T08:56:59.283337+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:59.283150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:59.283150+0000","last_clean_scrub_stamp":"2024-09-22T08:56:59.283150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:55:41.200537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"263'7","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:58.831205+0000","last_change":"2024-09-22T08:56:58.831205+0000","last_active":"2024-09-22T08:56:58.831205+0000","last_peered":"2024-09-22T08:56:58.831205+0000","last_clean":"2024-09-22T08:56:58.831205+0000","last_became_active":"2024-09-22T08:31:14.254610+0000","last_became_peered":"2024-09-22T08:31:14.254610+0000","last_unstale":"2024-09-22T08:56:58.831205+0000","last_undegraded":"2024-09-22T08:56:58.831205+0000","last_fullsized":"2024-09-22T08:56:58.831205+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-22T08:56:58.831111+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-22T08:56:58.831111+0000","last_clean_scrub_stamp":"2024-09-22T08:56:58.831111+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:32.357382+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"263'4","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:02.386863+0000","last_change":"2024-09-22T08:57:02.386863+0000","last_active":"2024-09-22T08:57:02.386863+0000","last_peered":"2024-09-22T08:57:02.386863+0000","last_clean":"2024-09-22T08:57:02.386863+0000","last_became_active":"2024-09-22T08:31:11.215757+0000","last_became_peered":"2024-09-22T08:31:11.215757+0000","last_unstale":"2024-09-22T08:57:02.386863+0000","last_undegraded":"2024-09-22T08:57:02.386863+0000","last_fullsized":"2024-09-22T08:57:02.386863+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-22T08:57:02.386770+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-22T08:57:02.386770+0000","last_clean_scrub_stamp":"2024-09-22T08:57:02.386770+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:24.038513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6203,"num_write":4,"num_write_kb":3131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"263'27","reported_seq":122,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:04.920622+0000","last_change":"2024-09-22T08:57:04.920622+0000","last_active":"2024-09-22T08:57:04.920622+0000","last_peered":"2024-09-22T08:57:04.920622+0000","last_clean":"2024-09-22T08:57:04.920622+0000","last_became_active":"2024-09-22T08:29:26.069635+0000","last_became_peered":"2024-09-22T08:29:26.069635+0000","last_unstale":"2024-09-22T08:57:04.920622+0000","last_undegraded":"2024-09-22T08:57:04.920622+0000","last_fullsized":"2024-09-22T08:57:04.920622+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'27","last_scrub_stamp":"2024-09-22T08:57:04.920534+0000","last_deep_scrub":"263'27","last_deep_scrub_stamp":"2024-09-22T08:57:04.920534+0000","last_clean_scrub_stamp":"2024-09-22T08:57:04.920534+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:34:21.103516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":139,"num_write":76,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:06.619220+0000","last_change":"2024-09-22T08:57:06.619154+0000","last_active":"2024-09-22T08:57:06.619220+0000","last_peered":"2024-09-22T08:57:06.619220+0000","last_clean":"2024-09-22T08:57:06.619220+0000","last_became_active":"2024-09-22T08:42:17.432946+0000","last_became_peered":"2024-09-22T08:42:17.432946+0000","last_unstale":"2024-09-22T08:57:06.619220+0000","last_undegraded":"2024-09-22T08:57:06.619220+0000","last_fullsized":"2024-09-22T08:57:06.619220+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:06.619063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:06.619063+0000","last_clean_scrub_stamp":"2024-09-22T08:57:06.619063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:32:25.387146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"263'5","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:03.091401+0000","last_change":"2024-09-22T08:57:03.091401+0000","last_active":"2024-09-22T08:57:03.091401+0000","last_peered":"2024-09-22T08:57:03.091401+0000","last_clean":"2024-09-22T08:57:03.091401+0000","last_became_active":"2024-09-22T08:31:14.256486+0000","last_became_peered":"2024-09-22T08:31:14.256486+0000","last_unstale":"2024-09-22T08:57:03.091401+0000","last_undegraded":"2024-09-22T08:57:03.091401+0000","last_fullsized":"2024-09-22T08:57:03.091401+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-22T08:57:03.091313+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-22T08:57:03.091313+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.091313+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:22:04.485658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8240,"num_write":10,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"260'2","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:06.500264+0000","last_change":"2024-09-22T08:57:06.500264+0000","last_active":"2024-09-22T08:57:06.500264+0000","last_peered":"2024-09-22T08:57:06.500264+0000","last_clean":"2024-09-22T08:57:06.500264+0000","last_became_active":"2024-09-22T08:31:11.216515+0000","last_became_peered":"2024-09-22T08:31:11.216515+0000","last_unstale":"2024-09-22T08:57:06.500264+0000","last_undegraded":"2024-09-22T08:57:06.500264+0000","last_fullsized":"2024-09-22T08:57:06.500264+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-22T08:57:06.500167+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-22T08:57:06.500167+0000","last_clean_scrub_stamp":"2024-09-22T08:57:06.500167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:31:02.617065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"263'31","reported_seq":139,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:03.946183+0000","last_change":"2024-09-22T08:57:03.946083+0000","last_active":"2024-09-22T08:57:03.946183+0000","last_peered":"2024-09-22T08:57:03.946183+0000","last_clean":"2024-09-22T08:57:03.946183+0000","last_became_active":"2024-09-22T08:29:26.073415+0000","last_became_peered":"2024-09-22T08:29:26.073415+0000","last_unstale":"2024-09-22T08:57:03.946183+0000","last_undegraded":"2024-09-22T08:57:03.946183+0000","last_fullsized":"2024-09-22T08:57:03.946183+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'31","last_scrub_stamp":"2024-09-22T08:57:03.945981+0000","last_deep_scrub":"263'31","last_deep_scrub_stamp":"2024-09-22T08:57:03.945981+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.945981+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:16:03.932770+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":176,"num_write":77,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:00.821735+0000","last_change":"2024-09-22T08:57:00.821735+0000","last_active":"2024-09-22T08:57:00.821735+0000","last_peered":"2024-09-22T08:57:00.821735+0000","last_clean":"2024-09-22T08:57:00.821735+0000","last_became_active":"2024-09-22T08:42:17.436334+0000","last_became_peered":"2024-09-22T08:42:17.436334+0000","last_unstale":"2024-09-22T08:57:00.821735+0000","last_undegraded":"2024-09-22T08:57:00.821735+0000","last_fullsized":"2024-09-22T08:57:00.821735+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:00.821641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:00.821641+0000","last_clean_scrub_stamp":"2024-09-22T08:57:00.821641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:06:29.336666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"260'4","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:15.385328+0000","last_change":"2024-09-22T08:57:15.385328+0000","last_active":"2024-09-22T08:57:15.385328+0000","last_peered":"2024-09-22T08:57:15.385328+0000","last_clean":"2024-09-22T08:57:15.385328+0000","last_became_active":"2024-09-22T08:31:14.256769+0000","last_became_peered":"2024-09-22T08:31:14.256769+0000","last_unstale":"2024-09-22T08:57:15.385328+0000","last_undegraded":"2024-09-22T08:57:15.385328+0000","last_fullsized":"2024-09-22T08:57:15.385328+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-22T08:57:15.385233+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-22T08:57:15.385233+0000","last_clean_scrub_stamp":"2024-09-22T08:57:15.385233+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:22:12.896634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:03.406493+0000","last_change":"2024-09-22T08:57:03.406401+0000","last_active":"2024-09-22T08:57:03.406493+0000","last_peered":"2024-09-22T08:57:03.406493+0000","last_clean":"2024-09-22T08:57:03.406493+0000","last_became_active":"2024-09-22T08:31:11.210892+0000","last_became_peered":"2024-09-22T08:31:11.210892+0000","last_unstale":"2024-09-22T08:57:03.406493+0000","last_undegraded":"2024-09-22T08:57:03.406493+0000","last_fullsized":"2024-09-22T08:57:03.406493+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.406314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.406314+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.406314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:09:14.829007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"263'43","reported_seq":171,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:58.576106+0000","last_change":"2024-09-22T08:56:58.576106+0000","last_active":"2024-09-22T08:56:58.576106+0000","last_peered":"2024-09-22T08:56:58.576106+0000","last_clean":"2024-09-22T08:56:58.576106+0000","last_became_active":"2024-09-22T08:29:26.067963+0000","last_became_peered":"2024-09-22T08:29:26.067963+0000","last_unstale":"2024-09-22T08:56:58.576106+0000","last_undegraded":"2024-09-22T08:56:58.576106+0000","last_fullsized":"2024-09-22T08:56:58.576106+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'43","last_scrub_stamp":"2024-09-22T08:56:58.576017+0000","last_deep_scrub":"263'43","last_deep_scrub_stamp":"2024-09-22T08:56:58.576017+0000","last_clean_scrub_stamp":"2024-09-22T08:56:58.576017+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:24:10.505789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":380,"num_read_kb":284,"num_write":99,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:21.562430+0000","last_change":"2024-09-22T08:57:21.562430+0000","last_active":"2024-09-22T08:57:21.562430+0000","last_peered":"2024-09-22T08:57:21.562430+0000","last_clean":"2024-09-22T08:57:21.562430+0000","last_became_active":"2024-09-22T08:42:17.430938+0000","last_became_peered":"2024-09-22T08:42:17.430938+0000","last_unstale":"2024-09-22T08:57:21.562430+0000","last_undegraded":"2024-09-22T08:57:21.562430+0000","last_fullsized":"2024-09-22T08:57:21.562430+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:21.562324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:21.562324+0000","last_clean_scrub_stamp":"2024-09-22T08:57:21.562324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:32:15.743471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"263'5","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:12.405275+0000","last_change":"2024-09-22T08:57:12.405213+0000","last_active":"2024-09-22T08:57:12.405275+0000","last_peered":"2024-09-22T08:57:12.405275+0000","last_clean":"2024-09-22T08:57:12.405275+0000","last_became_active":"2024-09-22T08:31:14.255086+0000","last_became_peered":"2024-09-22T08:31:14.255086+0000","last_unstale":"2024-09-22T08:57:12.405275+0000","last_undegraded":"2024-09-22T08:57:12.405275+0000","last_fullsized":"2024-09-22T08:57:12.405275+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-22T08:57:12.405124+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-22T08:57:12.405124+0000","last_clean_scrub_stamp":"2024-09-22T08:57:12.405124+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:19:09.172107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:01.839072+0000","last_change":"2024-09-22T08:57:01.839072+0000","last_active":"2024-09-22T08:57:01.839072+0000","last_peered":"2024-09-22T08:57:01.839072+0000","last_clean":"2024-09-22T08:57:01.839072+0000","last_became_active":"2024-09-22T08:31:11.207375+0000","last_became_peered":"2024-09-22T08:31:11.207375+0000","last_unstale":"2024-09-22T08:57:01.839072+0000","last_undegraded":"2024-09-22T08:57:01.839072+0000","last_fullsized":"2024-09-22T08:57:01.839072+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:01.838970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:01.838970+0000","last_clean_scrub_stamp":"2024-09-22T08:57:01.838970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:53:22.179444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"263'31","reported_seq":131,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:56.555035+0000","last_change":"2024-09-22T08:56:56.554934+0000","last_active":"2024-09-22T08:56:56.555035+0000","last_peered":"2024-09-22T08:56:56.555035+0000","last_clean":"2024-09-22T08:56:56.555035+0000","last_became_active":"2024-09-22T08:29:26.072183+0000","last_became_peered":"2024-09-22T08:29:26.072183+0000","last_unstale":"2024-09-22T08:56:56.555035+0000","last_undegraded":"2024-09-22T08:56:56.555035+0000","last_fullsized":"2024-09-22T08:56:56.555035+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'31","last_scrub_stamp":"2024-09-22T08:56:56.554814+0000","last_deep_scrub":"263'31","last_deep_scrub_stamp":"2024-09-22T08:56:56.554814+0000","last_clean_scrub_stamp":"2024-09-22T08:56:56.554814+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:19:23.285923+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":233,"num_read_kb":155,"num_write":81,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:13.361779+0000","last_change":"2024-09-22T08:57:13.361779+0000","last_active":"2024-09-22T08:57:13.361779+0000","last_peered":"2024-09-22T08:57:13.361779+0000","last_clean":"2024-09-22T08:57:13.361779+0000","last_became_active":"2024-09-22T08:42:17.418224+0000","last_became_peered":"2024-09-22T08:42:17.418224+0000","last_unstale":"2024-09-22T08:57:13.361779+0000","last_undegraded":"2024-09-22T08:57:13.361779+0000","last_fullsized":"2024-09-22T08:57:13.361779+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:13.361683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:13.361683+0000","last_clean_scrub_stamp":"2024-09-22T08:57:13.361683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:33:09.495984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"263'5","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:55.323168+0000","last_change":"2024-09-22T08:56:55.323168+0000","last_active":"2024-09-22T08:56:55.323168+0000","last_peered":"2024-09-22T08:56:55.323168+0000","last_clean":"2024-09-22T08:56:55.323168+0000","last_became_active":"2024-09-22T08:31:14.261753+0000","last_became_peered":"2024-09-22T08:31:14.261753+0000","last_unstale":"2024-09-22T08:56:55.323168+0000","last_undegraded":"2024-09-22T08:56:55.323168+0000","last_fullsized":"2024-09-22T08:56:55.323168+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-22T08:56:55.323025+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-22T08:56:55.323025+0000","last_clean_scrub_stamp":"2024-09-22T08:56:55.323025+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:44:08.081182+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"260'9","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:05.469026+0000","last_change":"2024-09-22T08:57:05.469026+0000","last_active":"2024-09-22T08:57:05.469026+0000","last_peered":"2024-09-22T08:57:05.469026+0000","last_clean":"2024-09-22T08:57:05.469026+0000","last_became_active":"2024-09-22T08:31:11.215024+0000","last_became_peered":"2024-09-22T08:31:11.215024+0000","last_unstale":"2024-09-22T08:57:05.469026+0000","last_undegraded":"2024-09-22T08:57:05.469026+0000","last_fullsized":"2024-09-22T08:57:05.469026+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'9","last_scrub_stamp":"2024-09-22T08:57:05.468931+0000","last_deep_scrub":"260'9","last_deep_scrub_stamp":"2024-09-22T08:57:05.468931+0000","last_clean_scrub_stamp":"2024-09-22T08:57:05.468931+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:49.840728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":17455,"num_write":14,"num_write_kb":5165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"263'52","reported_seq":194,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:57.564120+0000","last_change":"2024-09-22T08:56:57.564120+0000","last_active":"2024-09-22T08:56:57.564120+0000","last_peered":"2024-09-22T08:56:57.564120+0000","last_clean":"2024-09-22T08:56:57.564120+0000","last_became_active":"2024-09-22T08:29:26.070913+0000","last_became_peered":"2024-09-22T08:29:26.070913+0000","last_unstale":"2024-09-22T08:56:57.564120+0000","last_undegraded":"2024-09-22T08:56:57.564120+0000","last_fullsized":"2024-09-22T08:56:57.564120+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'52","last_scrub_stamp":"2024-09-22T08:56:57.564032+0000","last_deep_scrub":"263'52","last_deep_scrub_stamp":"2024-09-22T08:56:57.564032+0000","last_clean_scrub_stamp":"2024-09-22T08:56:57.564032+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:23:29.347552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":289,"num_write":128,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:09.802712+0000","last_change":"2024-09-22T08:57:09.802712+0000","last_active":"2024-09-22T08:57:09.802712+0000","last_peered":"2024-09-22T08:57:09.802712+0000","last_clean":"2024-09-22T08:57:09.802712+0000","last_became_active":"2024-09-22T08:42:17.428589+0000","last_became_peered":"2024-09-22T08:42:17.428589+0000","last_unstale":"2024-09-22T08:57:09.802712+0000","last_undegraded":"2024-09-22T08:57:09.802712+0000","last_fullsized":"2024-09-22T08:57:09.802712+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:09.802620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:09.802620+0000","last_clean_scrub_stamp":"2024-09-22T08:57:09.802620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:51:26.775756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"263'6","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:26.650640+0000","last_change":"2024-09-22T08:57:26.650640+0000","last_active":"2024-09-22T08:57:26.650640+0000","last_peered":"2024-09-22T08:57:26.650640+0000","last_clean":"2024-09-22T08:57:26.650640+0000","last_became_active":"2024-09-22T08:31:14.256133+0000","last_became_peered":"2024-09-22T08:31:14.256133+0000","last_unstale":"2024-09-22T08:57:26.650640+0000","last_undegraded":"2024-09-22T08:57:26.650640+0000","last_fullsized":"2024-09-22T08:57:26.650640+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-22T08:57:26.650539+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-22T08:57:26.650539+0000","last_clean_scrub_stamp":"2024-09-22T08:57:26.650539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:22:12.468763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":16,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"263'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:23.603832+0000","last_change":"2024-09-22T08:57:23.603832+0000","last_active":"2024-09-22T08:57:23.603832+0000","last_peered":"2024-09-22T08:57:23.603832+0000","last_clean":"2024-09-22T08:57:23.603832+0000","last_became_active":"2024-09-22T08:31:11.214152+0000","last_became_peered":"2024-09-22T08:31:11.214152+0000","last_unstale":"2024-09-22T08:57:23.603832+0000","last_undegraded":"2024-09-22T08:57:23.603832+0000","last_fullsized":"2024-09-22T08:57:23.603832+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:57:23.603673+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:57:23.603673+0000","last_clean_scrub_stamp":"2024-09-22T08:57:23.603673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:15:39.476161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"263'41","reported_seq":164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:56.153768+0000","last_change":"2024-09-22T08:56:56.153706+0000","last_active":"2024-09-22T08:56:56.153768+0000","last_peered":"2024-09-22T08:56:56.153768+0000","last_clean":"2024-09-22T08:56:56.153768+0000","last_became_active":"2024-09-22T08:29:26.072935+0000","last_became_peered":"2024-09-22T08:29:26.072935+0000","last_unstale":"2024-09-22T08:56:56.153768+0000","last_undegraded":"2024-09-22T08:56:56.153768+0000","last_fullsized":"2024-09-22T08:56:56.153768+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'41","last_scrub_stamp":"2024-09-22T08:56:56.153614+0000","last_deep_scrub":"263'41","last_deep_scrub_stamp":"2024-09-22T08:56:56.153614+0000","last_clean_scrub_stamp":"2024-09-22T08:56:56.153614+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:55:19.612927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":341,"num_read_kb":226,"num_write":101,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"263'2","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:06.003619+0000","last_change":"2024-09-22T08:57:06.003560+0000","last_active":"2024-09-22T08:57:06.003619+0000","last_peered":"2024-09-22T08:57:06.003619+0000","last_clean":"2024-09-22T08:57:06.003619+0000","last_became_active":"2024-09-22T08:42:17.429298+0000","last_became_peered":"2024-09-22T08:42:17.429298+0000","last_unstale":"2024-09-22T08:57:06.003619+0000","last_undegraded":"2024-09-22T08:57:06.003619+0000","last_fullsized":"2024-09-22T08:57:06.003619+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:57:06.003480+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:57:06.003480+0000","last_clean_scrub_stamp":"2024-09-22T08:57:06.003480+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:11:37.165876+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"260'7","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:02.139912+0000","last_change":"2024-09-22T08:57:02.139912+0000","last_active":"2024-09-22T08:57:02.139912+0000","last_peered":"2024-09-22T08:57:02.139912+0000","last_clean":"2024-09-22T08:57:02.139912+0000","last_became_active":"2024-09-22T08:31:14.257659+0000","last_became_peered":"2024-09-22T08:31:14.257659+0000","last_unstale":"2024-09-22T08:57:02.139912+0000","last_undegraded":"2024-09-22T08:57:02.139912+0000","last_fullsized":"2024-09-22T08:57:02.139912+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'7","last_scrub_stamp":"2024-09-22T08:57:02.139812+0000","last_deep_scrub":"260'7","last_deep_scrub_stamp":"2024-09-22T08:57:02.139812+0000","last_clean_scrub_stamp":"2024-09-22T08:57:02.139812+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:43:02.418334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4143,"num_write":12,"num_write_kb":1069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"263'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:51.310546+0000","last_change":"2024-09-22T08:56:51.310546+0000","last_active":"2024-09-22T08:56:51.310546+0000","last_peered":"2024-09-22T08:56:51.310546+0000","last_clean":"2024-09-22T08:56:51.310546+0000","last_became_active":"2024-09-22T08:31:11.216248+0000","last_became_peered":"2024-09-22T08:31:11.216248+0000","last_unstale":"2024-09-22T08:56:51.310546+0000","last_undegraded":"2024-09-22T08:56:51.310546+0000","last_fullsized":"2024-09-22T08:56:51.310546+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:56:51.310456+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:56:51.310456+0000","last_clean_scrub_stamp":"2024-09-22T08:56:51.310456+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:52:43.461188+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"263'16","reported_seq":92,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:57.360607+0000","last_change":"2024-09-22T08:56:57.360607+0000","last_active":"2024-09-22T08:56:57.360607+0000","last_peered":"2024-09-22T08:56:57.360607+0000","last_clean":"2024-09-22T08:56:57.360607+0000","last_became_active":"2024-09-22T08:29:26.076243+0000","last_became_peered":"2024-09-22T08:29:26.076243+0000","last_unstale":"2024-09-22T08:56:57.360607+0000","last_undegraded":"2024-09-22T08:56:57.360607+0000","last_fullsized":"2024-09-22T08:56:57.360607+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'16","last_scrub_stamp":"2024-09-22T08:56:57.360508+0000","last_deep_scrub":"263'16","last_deep_scrub_stamp":"2024-09-22T08:56:57.360508+0000","last_clean_scrub_stamp":"2024-09-22T08:56:57.360508+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:24:23.856306+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":86,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:01.270443+0000","last_change":"2024-09-22T08:57:01.270387+0000","last_active":"2024-09-22T08:57:01.270443+0000","last_peered":"2024-09-22T08:57:01.270443+0000","last_clean":"2024-09-22T08:57:01.270443+0000","last_became_active":"2024-09-22T08:42:17.432923+0000","last_became_peered":"2024-09-22T08:42:17.432923+0000","last_unstale":"2024-09-22T08:57:01.270443+0000","last_undegraded":"2024-09-22T08:57:01.270443+0000","last_fullsized":"2024-09-22T08:57:01.270443+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:01.270301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:01.270301+0000","last_clean_scrub_stamp":"2024-09-22T08:57:01.270301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:14.894407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"263'8","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:09.474563+0000","last_change":"2024-09-22T08:57:09.474563+0000","last_active":"2024-09-22T08:57:09.474563+0000","last_peered":"2024-09-22T08:57:09.474563+0000","last_clean":"2024-09-22T08:57:09.474563+0000","last_became_active":"2024-09-22T08:31:14.256055+0000","last_became_peered":"2024-09-22T08:31:14.256055+0000","last_unstale":"2024-09-22T08:57:09.474563+0000","last_undegraded":"2024-09-22T08:57:09.474563+0000","last_fullsized":"2024-09-22T08:57:09.474563+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-22T08:57:09.474462+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-22T08:57:09.474462+0000","last_clean_scrub_stamp":"2024-09-22T08:57:09.474462+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:40:11.556082+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":18434,"num_write":18,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"263'8","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:01.594227+0000","last_change":"2024-09-22T08:57:01.594227+0000","last_active":"2024-09-22T08:57:01.594227+0000","last_peered":"2024-09-22T08:57:01.594227+0000","last_clean":"2024-09-22T08:57:01.594227+0000","last_became_active":"2024-09-22T08:31:11.215609+0000","last_became_peered":"2024-09-22T08:31:11.215609+0000","last_unstale":"2024-09-22T08:57:01.594227+0000","last_undegraded":"2024-09-22T08:57:01.594227+0000","last_fullsized":"2024-09-22T08:57:01.594227+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-22T08:57:01.594139+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-22T08:57:01.594139+0000","last_clean_scrub_stamp":"2024-09-22T08:57:01.594139+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:18:53.133329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":18,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"263'42","reported_seq":163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:55.575459+0000","last_change":"2024-09-22T08:56:55.575459+0000","last_active":"2024-09-22T08:56:55.575459+0000","last_peered":"2024-09-22T08:56:55.575459+0000","last_clean":"2024-09-22T08:56:55.575459+0000","last_became_active":"2024-09-22T08:29:26.066447+0000","last_became_peered":"2024-09-22T08:29:26.066447+0000","last_unstale":"2024-09-22T08:56:55.575459+0000","last_undegraded":"2024-09-22T08:56:55.575459+0000","last_fullsized":"2024-09-22T08:56:55.575459+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'42","last_scrub_stamp":"2024-09-22T08:56:55.575356+0000","last_deep_scrub":"263'42","last_deep_scrub_stamp":"2024-09-22T08:56:55.575356+0000","last_clean_scrub_stamp":"2024-09-22T08:56:55.575356+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:23:36.714020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":325,"num_read_kb":214,"num_write":107,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:19.516368+0000","last_change":"2024-09-22T08:57:19.516368+0000","last_active":"2024-09-22T08:57:19.516368+0000","last_peered":"2024-09-22T08:57:19.516368+0000","last_clean":"2024-09-22T08:57:19.516368+0000","last_became_active":"2024-09-22T08:42:17.435842+0000","last_became_peered":"2024-09-22T08:42:17.435842+0000","last_unstale":"2024-09-22T08:57:19.516368+0000","last_undegraded":"2024-09-22T08:57:19.516368+0000","last_fullsized":"2024-09-22T08:57:19.516368+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:19.516276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:19.516276+0000","last_clean_scrub_stamp":"2024-09-22T08:57:19.516276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:17:07.435469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"263'2","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:08.472253+0000","last_change":"2024-09-22T08:57:08.472253+0000","last_active":"2024-09-22T08:57:08.472253+0000","last_peered":"2024-09-22T08:57:08.472253+0000","last_clean":"2024-09-22T08:57:08.472253+0000","last_became_active":"2024-09-22T08:31:14.255497+0000","last_became_peered":"2024-09-22T08:31:14.255497+0000","last_unstale":"2024-09-22T08:57:08.472253+0000","last_undegraded":"2024-09-22T08:57:08.472253+0000","last_fullsized":"2024-09-22T08:57:08.472253+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:57:08.472162+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:57:08.472162+0000","last_clean_scrub_stamp":"2024-09-22T08:57:08.472162+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:16:39.254367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"263'4","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:20.616166+0000","last_change":"2024-09-22T08:57:20.616166+0000","last_active":"2024-09-22T08:57:20.616166+0000","last_peered":"2024-09-22T08:57:20.616166+0000","last_clean":"2024-09-22T08:57:20.616166+0000","last_became_active":"2024-09-22T08:31:11.216997+0000","last_became_peered":"2024-09-22T08:31:11.216997+0000","last_unstale":"2024-09-22T08:57:20.616166+0000","last_undegraded":"2024-09-22T08:57:20.616166+0000","last_fullsized":"2024-09-22T08:57:20.616166+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-22T08:57:20.616059+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-22T08:57:20.616059+0000","last_clean_scrub_stamp":"2024-09-22T08:57:20.616059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:30:01.338284+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"263'25","reported_seq":119,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:01.949281+0000","last_change":"2024-09-22T08:57:01.949281+0000","last_active":"2024-09-22T08:57:01.949281+0000","last_peered":"2024-09-22T08:57:01.949281+0000","last_clean":"2024-09-22T08:57:01.949281+0000","last_became_active":"2024-09-22T08:29:26.070906+0000","last_became_peered":"2024-09-22T08:29:26.070906+0000","last_unstale":"2024-09-22T08:57:01.949281+0000","last_undegraded":"2024-09-22T08:57:01.949281+0000","last_fullsized":"2024-09-22T08:57:01.949281+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'25","last_scrub_stamp":"2024-09-22T08:57:01.949196+0000","last_deep_scrub":"263'25","last_deep_scrub_stamp":"2024-09-22T08:57:01.949196+0000","last_clean_scrub_stamp":"2024-09-22T08:57:01.949196+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:30.841330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":135,"num_write":63,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"263'2","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:03.657704+0000","last_change":"2024-09-22T08:57:03.657704+0000","last_active":"2024-09-22T08:57:03.657704+0000","last_peered":"2024-09-22T08:57:03.657704+0000","last_clean":"2024-09-22T08:57:03.657704+0000","last_became_active":"2024-09-22T08:42:17.430457+0000","last_became_peered":"2024-09-22T08:42:17.430457+0000","last_unstale":"2024-09-22T08:57:03.657704+0000","last_undegraded":"2024-09-22T08:57:03.657704+0000","last_fullsized":"2024-09-22T08:57:03.657704+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:57:03.657623+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:57:03.657623+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.657623+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:43:31.788007+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"263'9","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:13.435071+0000","last_change":"2024-09-22T08:57:13.435071+0000","last_active":"2024-09-22T08:57:13.435071+0000","last_peered":"2024-09-22T08:57:13.435071+0000","last_clean":"2024-09-22T08:57:13.435071+0000","last_became_active":"2024-09-22T08:31:14.255245+0000","last_became_peered":"2024-09-22T08:31:14.255245+0000","last_unstale":"2024-09-22T08:57:13.435071+0000","last_undegraded":"2024-09-22T08:57:13.435071+0000","last_fullsized":"2024-09-22T08:57:13.435071+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-22T08:57:13.434970+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-22T08:57:13.434970+0000","last_clean_scrub_stamp":"2024-09-22T08:57:13.434970+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:51:51.797154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":20480,"num_write":14,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"260'6","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:49.347000+0000","last_change":"2024-09-22T08:56:49.347000+0000","last_active":"2024-09-22T08:56:49.347000+0000","last_peered":"2024-09-22T08:56:49.347000+0000","last_clean":"2024-09-22T08:56:49.347000+0000","last_became_active":"2024-09-22T08:31:11.211000+0000","last_became_peered":"2024-09-22T08:31:11.211000+0000","last_unstale":"2024-09-22T08:56:49.347000+0000","last_undegraded":"2024-09-22T08:56:49.347000+0000","last_fullsized":"2024-09-22T08:56:49.347000+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-22T08:56:49.346894+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-22T08:56:49.346894+0000","last_clean_scrub_stamp":"2024-09-22T08:56:49.346894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:18:23.984699+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8192,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"263'32","reported_seq":138,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:02.974212+0000","last_change":"2024-09-22T08:57:02.974212+0000","last_active":"2024-09-22T08:57:02.974212+0000","last_peered":"2024-09-22T08:57:02.974212+0000","last_clean":"2024-09-22T08:57:02.974212+0000","last_became_active":"2024-09-22T08:29:26.074151+0000","last_became_peered":"2024-09-22T08:29:26.074151+0000","last_unstale":"2024-09-22T08:57:02.974212+0000","last_undegraded":"2024-09-22T08:57:02.974212+0000","last_fullsized":"2024-09-22T08:57:02.974212+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'32","last_scrub_stamp":"2024-09-22T08:57:02.974126+0000","last_deep_scrub":"263'32","last_deep_scrub_stamp":"2024-09-22T08:57:02.974126+0000","last_clean_scrub_stamp":"2024-09-22T08:57:02.974126+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:53:39.118893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":180,"num_write":78,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:05.033730+0000","last_change":"2024-09-22T08:57:05.033730+0000","last_active":"2024-09-22T08:57:05.033730+0000","last_peered":"2024-09-22T08:57:05.033730+0000","last_clean":"2024-09-22T08:57:05.033730+0000","last_became_active":"2024-09-22T08:42:17.432056+0000","last_became_peered":"2024-09-22T08:42:17.432056+0000","last_unstale":"2024-09-22T08:57:05.033730+0000","last_undegraded":"2024-09-22T08:57:05.033730+0000","last_fullsized":"2024-09-22T08:57:05.033730+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:05.033597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:05.033597+0000","last_clean_scrub_stamp":"2024-09-22T08:57:05.033597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:29:11.519722+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"263'6","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:10.435533+0000","last_change":"2024-09-22T08:57:10.435533+0000","last_active":"2024-09-22T08:57:10.435533+0000","last_peered":"2024-09-22T08:57:10.435533+0000","last_clean":"2024-09-22T08:57:10.435533+0000","last_became_active":"2024-09-22T08:31:14.259009+0000","last_became_peered":"2024-09-22T08:31:14.259009+0000","last_unstale":"2024-09-22T08:57:10.435533+0000","last_undegraded":"2024-09-22T08:57:10.435533+0000","last_fullsized":"2024-09-22T08:57:10.435533+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-22T08:57:10.435437+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-22T08:57:10.435437+0000","last_clean_scrub_stamp":"2024-09-22T08:57:10.435437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:40:19.974861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8192,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"263'5","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:01.354578+0000","last_change":"2024-09-22T08:57:01.354578+0000","last_active":"2024-09-22T08:57:01.354578+0000","last_peered":"2024-09-22T08:57:01.354578+0000","last_clean":"2024-09-22T08:57:01.354578+0000","last_became_active":"2024-09-22T08:31:11.215708+0000","last_became_peered":"2024-09-22T08:31:11.215708+0000","last_unstale":"2024-09-22T08:57:01.354578+0000","last_undegraded":"2024-09-22T08:57:01.354578+0000","last_fullsized":"2024-09-22T08:57:01.354578+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-22T08:57:01.354488+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-22T08:57:01.354488+0000","last_clean_scrub_stamp":"2024-09-22T08:57:01.354488+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:22:05.998897+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"263'26","reported_seq":118,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:55.344605+0000","last_change":"2024-09-22T08:56:55.344605+0000","last_active":"2024-09-22T08:56:55.344605+0000","last_peered":"2024-09-22T08:56:55.344605+0000","last_clean":"2024-09-22T08:56:55.344605+0000","last_became_active":"2024-09-22T08:29:26.069440+0000","last_became_peered":"2024-09-22T08:29:26.069440+0000","last_unstale":"2024-09-22T08:56:55.344605+0000","last_undegraded":"2024-09-22T08:56:55.344605+0000","last_fullsized":"2024-09-22T08:56:55.344605+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'26","last_scrub_stamp":"2024-09-22T08:56:55.344513+0000","last_deep_scrub":"263'26","last_deep_scrub_stamp":"2024-09-22T08:56:55.344513+0000","last_clean_scrub_stamp":"2024-09-22T08:56:55.344513+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:01:29.040638+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":134,"num_write":69,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:58.276124+0000","last_change":"2024-09-22T08:56:58.276124+0000","last_active":"2024-09-22T08:56:58.276124+0000","last_peered":"2024-09-22T08:56:58.276124+0000","last_clean":"2024-09-22T08:56:58.276124+0000","last_became_active":"2024-09-22T08:42:17.435825+0000","last_became_peered":"2024-09-22T08:42:17.435825+0000","last_unstale":"2024-09-22T08:56:58.276124+0000","last_undegraded":"2024-09-22T08:56:58.276124+0000","last_fullsized":"2024-09-22T08:56:58.276124+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:58.276034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:58.276034+0000","last_clean_scrub_stamp":"2024-09-22T08:56:58.276034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:06:06.118719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"260'2","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:54.303367+0000","last_change":"2024-09-22T08:56:54.303367+0000","last_active":"2024-09-22T08:56:54.303367+0000","last_peered":"2024-09-22T08:56:54.303367+0000","last_clean":"2024-09-22T08:56:54.303367+0000","last_became_active":"2024-09-22T08:31:14.256218+0000","last_became_peered":"2024-09-22T08:31:14.256218+0000","last_unstale":"2024-09-22T08:56:54.303367+0000","last_undegraded":"2024-09-22T08:56:54.303367+0000","last_fullsized":"2024-09-22T08:56:54.303367+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-22T08:56:54.303281+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-22T08:56:54.303281+0000","last_clean_scrub_stamp":"2024-09-22T08:56:54.303281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:56:55.883067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:04.468989+0000","last_change":"2024-09-22T08:57:04.468989+0000","last_active":"2024-09-22T08:57:04.468989+0000","last_peered":"2024-09-22T08:57:04.468989+0000","last_clean":"2024-09-22T08:57:04.468989+0000","last_became_active":"2024-09-22T08:31:11.214111+0000","last_became_peered":"2024-09-22T08:31:11.214111+0000","last_unstale":"2024-09-22T08:57:04.468989+0000","last_undegraded":"2024-09-22T08:57:04.468989+0000","last_fullsized":"2024-09-22T08:57:04.468989+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:04.468907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:04.468907+0000","last_clean_scrub_stamp":"2024-09-22T08:57:04.468907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:20:18.475949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"263'20","reported_seq":104,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:15.695152+0000","last_change":"2024-09-22T08:57:15.695045+0000","last_active":"2024-09-22T08:57:15.695152+0000","last_peered":"2024-09-22T08:57:15.695152+0000","last_clean":"2024-09-22T08:57:15.695152+0000","last_became_active":"2024-09-22T08:29:26.069293+0000","last_became_peered":"2024-09-22T08:29:26.069293+0000","last_unstale":"2024-09-22T08:57:15.695152+0000","last_undegraded":"2024-09-22T08:57:15.695152+0000","last_fullsized":"2024-09-22T08:57:15.695152+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'20","last_scrub_stamp":"2024-09-22T08:57:15.694937+0000","last_deep_scrub":"263'20","last_deep_scrub_stamp":"2024-09-22T08:57:15.694937+0000","last_clean_scrub_stamp":"2024-09-22T08:57:15.694937+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:25.407669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":89,"num_write":52,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:20.550129+0000","last_change":"2024-09-22T08:57:20.550129+0000","last_active":"2024-09-22T08:57:20.550129+0000","last_peered":"2024-09-22T08:57:20.550129+0000","last_clean":"2024-09-22T08:57:20.550129+0000","last_became_active":"2024-09-22T08:42:17.429163+0000","last_became_peered":"2024-09-22T08:42:17.429163+0000","last_unstale":"2024-09-22T08:57:20.550129+0000","last_undegraded":"2024-09-22T08:57:20.550129+0000","last_fullsized":"2024-09-22T08:57:20.550129+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:20.550012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:20.550012+0000","last_clean_scrub_stamp":"2024-09-22T08:57:20.550012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:27:52.793372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"263'2","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:11.386860+0000","last_change":"2024-09-22T08:57:11.386860+0000","last_active":"2024-09-22T08:57:11.386860+0000","last_peered":"2024-09-22T08:57:11.386860+0000","last_clean":"2024-09-22T08:57:11.386860+0000","last_became_active":"2024-09-22T08:31:14.259484+0000","last_became_peered":"2024-09-22T08:31:14.259484+0000","last_unstale":"2024-09-22T08:57:11.386860+0000","last_undegraded":"2024-09-22T08:57:11.386860+0000","last_fullsized":"2024-09-22T08:57:11.386860+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:57:11.386761+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:57:11.386761+0000","last_clean_scrub_stamp":"2024-09-22T08:57:11.386761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:13:59.807135+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"263'6","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:53.777115+0000","last_change":"2024-09-22T08:56:53.777115+0000","last_active":"2024-09-22T08:56:53.777115+0000","last_peered":"2024-09-22T08:56:53.777115+0000","last_clean":"2024-09-22T08:56:53.777115+0000","last_became_active":"2024-09-22T08:31:11.203053+0000","last_became_peered":"2024-09-22T08:31:11.203053+0000","last_unstale":"2024-09-22T08:56:53.777115+0000","last_undegraded":"2024-09-22T08:56:53.777115+0000","last_fullsized":"2024-09-22T08:56:53.777115+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-22T08:56:53.777026+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-22T08:56:53.777026+0000","last_clean_scrub_stamp":"2024-09-22T08:56:53.777026+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:41:20.302287+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4146,"num_write":6,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"263'318","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:14.682181+0000","last_change":"2024-09-22T08:57:14.682116+0000","last_active":"2024-09-22T08:57:14.682181+0000","last_peered":"2024-09-22T08:57:14.682181+0000","last_clean":"2024-09-22T08:57:14.682181+0000","last_became_active":"2024-09-22T08:29:26.070475+0000","last_became_peered":"2024-09-22T08:29:26.070475+0000","last_unstale":"2024-09-22T08:57:14.682181+0000","last_undegraded":"2024-09-22T08:57:14.682181+0000","last_fullsized":"2024-09-22T08:57:14.682181+0000","mapping_epoch":252,"log_start":"263'300","ondisk_log_start":"263'300","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'318","last_scrub_stamp":"2024-09-22T08:57:14.682019+0000","last_deep_scrub":"263'318","last_deep_scrub_stamp":"2024-09-22T08:57:14.682019+0000","last_clean_scrub_stamp":"2024-09-22T08:57:14.682019+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:52:59.670094+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2975,"num_read_kb":3480,"num_write":654,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:05.615289+0000","last_change":"2024-09-22T08:57:05.615289+0000","last_active":"2024-09-22T08:57:05.615289+0000","last_peered":"2024-09-22T08:57:05.615289+0000","last_clean":"2024-09-22T08:57:05.615289+0000","last_became_active":"2024-09-22T08:42:17.431528+0000","last_became_peered":"2024-09-22T08:42:17.431528+0000","last_unstale":"2024-09-22T08:57:05.615289+0000","last_undegraded":"2024-09-22T08:57:05.615289+0000","last_fullsized":"2024-09-22T08:57:05.615289+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:05.615189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:05.615189+0000","last_clean_scrub_stamp":"2024-09-22T08:57:05.615189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:53:07.861528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:10.372944+0000","last_change":"2024-09-22T08:57:10.372944+0000","last_active":"2024-09-22T08:57:10.372944+0000","last_peered":"2024-09-22T08:57:10.372944+0000","last_clean":"2024-09-22T08:57:10.372944+0000","last_became_active":"2024-09-22T08:31:14.256054+0000","last_became_peered":"2024-09-22T08:31:14.256054+0000","last_unstale":"2024-09-22T08:57:10.372944+0000","last_undegraded":"2024-09-22T08:57:10.372944+0000","last_fullsized":"2024-09-22T08:57:10.372944+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:10.372849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:10.372849+0000","last_clean_scrub_stamp":"2024-09-22T08:57:10.372849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:42:32.025189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"263'8","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:03.499422+0000","last_change":"2024-09-22T08:57:03.499422+0000","last_active":"2024-09-22T08:57:03.499422+0000","last_peered":"2024-09-22T08:57:03.499422+0000","last_clean":"2024-09-22T08:57:03.499422+0000","last_became_active":"2024-09-22T08:31:11.212539+0000","last_became_peered":"2024-09-22T08:31:11.212539+0000","last_unstale":"2024-09-22T08:57:03.499422+0000","last_undegraded":"2024-09-22T08:57:03.499422+0000","last_fullsized":"2024-09-22T08:57:03.499422+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-22T08:57:03.499309+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-22T08:57:03.499309+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.499309+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:09:12.613433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":18,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"263'51","reported_seq":185,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:54.324760+0000","last_change":"2024-09-22T08:56:54.324685+0000","last_active":"2024-09-22T08:56:54.324760+0000","last_peered":"2024-09-22T08:56:54.324760+0000","last_clean":"2024-09-22T08:56:54.324760+0000","last_became_active":"2024-09-22T08:29:26.070576+0000","last_became_peered":"2024-09-22T08:29:26.070576+0000","last_unstale":"2024-09-22T08:56:54.324760+0000","last_undegraded":"2024-09-22T08:56:54.324760+0000","last_fullsized":"2024-09-22T08:56:54.324760+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'51","last_scrub_stamp":"2024-09-22T08:56:54.324596+0000","last_deep_scrub":"263'51","last_deep_scrub_stamp":"2024-09-22T08:56:54.324596+0000","last_clean_scrub_stamp":"2024-09-22T08:56:54.324596+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:06:24.019713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":389,"num_read_kb":252,"num_write":129,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"263'2","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:08.835858+0000","last_change":"2024-09-22T08:57:08.835858+0000","last_active":"2024-09-22T08:57:08.835858+0000","last_peered":"2024-09-22T08:57:08.835858+0000","last_clean":"2024-09-22T08:57:08.835858+0000","last_became_active":"2024-09-22T08:42:17.425759+0000","last_became_peered":"2024-09-22T08:42:17.425759+0000","last_unstale":"2024-09-22T08:57:08.835858+0000","last_undegraded":"2024-09-22T08:57:08.835858+0000","last_fullsized":"2024-09-22T08:57:08.835858+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:57:08.835762+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:57:08.835762+0000","last_clean_scrub_stamp":"2024-09-22T08:57:08.835762+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:18:38.343098+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"263'2","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:07.482305+0000","last_change":"2024-09-22T08:57:07.482305+0000","last_active":"2024-09-22T08:57:07.482305+0000","last_peered":"2024-09-22T08:57:07.482305+0000","last_clean":"2024-09-22T08:57:07.482305+0000","last_became_active":"2024-09-22T08:31:14.257900+0000","last_became_peered":"2024-09-22T08:31:14.257900+0000","last_unstale":"2024-09-22T08:57:07.482305+0000","last_undegraded":"2024-09-22T08:57:07.482305+0000","last_fullsized":"2024-09-22T08:57:07.482305+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:57:07.482211+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:57:07.482211+0000","last_clean_scrub_stamp":"2024-09-22T08:57:07.482211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:07:07.987794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":118,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"263'6","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:56.829934+0000","last_change":"2024-09-22T08:56:56.829934+0000","last_active":"2024-09-22T08:56:56.829934+0000","last_peered":"2024-09-22T08:56:56.829934+0000","last_clean":"2024-09-22T08:56:56.829934+0000","last_became_active":"2024-09-22T08:31:11.204846+0000","last_became_peered":"2024-09-22T08:31:11.204846+0000","last_unstale":"2024-09-22T08:56:56.829934+0000","last_undegraded":"2024-09-22T08:56:56.829934+0000","last_fullsized":"2024-09-22T08:56:56.829934+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-22T08:56:56.829835+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-22T08:56:56.829835+0000","last_clean_scrub_stamp":"2024-09-22T08:56:56.829835+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:53:05.522110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":6146,"num_write":6,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"263'48","reported_seq":182,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:54.191951+0000","last_change":"2024-09-22T08:56:54.191877+0000","last_active":"2024-09-22T08:56:54.191951+0000","last_peered":"2024-09-22T08:56:54.191951+0000","last_clean":"2024-09-22T08:56:54.191951+0000","last_became_active":"2024-09-22T08:29:26.063914+0000","last_became_peered":"2024-09-22T08:29:26.063914+0000","last_unstale":"2024-09-22T08:56:54.191951+0000","last_undegraded":"2024-09-22T08:56:54.191951+0000","last_fullsized":"2024-09-22T08:56:54.191951+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'48","last_scrub_stamp":"2024-09-22T08:56:54.191755+0000","last_deep_scrub":"263'48","last_deep_scrub_stamp":"2024-09-22T08:56:54.191755+0000","last_clean_scrub_stamp":"2024-09-22T08:56:54.191755+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:50:24.201000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":381,"num_read_kb":265,"num_write":119,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"263'2","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:04.635558+0000","last_change":"2024-09-22T08:57:04.635558+0000","last_active":"2024-09-22T08:57:04.635558+0000","last_peered":"2024-09-22T08:57:04.635558+0000","last_clean":"2024-09-22T08:57:04.635558+0000","last_became_active":"2024-09-22T08:42:17.429964+0000","last_became_peered":"2024-09-22T08:42:17.429964+0000","last_unstale":"2024-09-22T08:57:04.635558+0000","last_undegraded":"2024-09-22T08:57:04.635558+0000","last_fullsized":"2024-09-22T08:57:04.635558+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:57:04.635465+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:57:04.635465+0000","last_clean_scrub_stamp":"2024-09-22T08:57:04.635465+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:39:04.380128+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"260'4","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:25.601398+0000","last_change":"2024-09-22T08:57:25.601398+0000","last_active":"2024-09-22T08:57:25.601398+0000","last_peered":"2024-09-22T08:57:25.601398+0000","last_clean":"2024-09-22T08:57:25.601398+0000","last_became_active":"2024-09-22T08:31:14.259875+0000","last_became_peered":"2024-09-22T08:31:14.259875+0000","last_unstale":"2024-09-22T08:57:25.601398+0000","last_undegraded":"2024-09-22T08:57:25.601398+0000","last_fullsized":"2024-09-22T08:57:25.601398+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-22T08:57:25.601297+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-22T08:57:25.601297+0000","last_clean_scrub_stamp":"2024-09-22T08:57:25.601297+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:37:40.766256+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:55.837436+0000","last_change":"2024-09-22T08:56:55.837436+0000","last_active":"2024-09-22T08:56:55.837436+0000","last_peered":"2024-09-22T08:56:55.837436+0000","last_clean":"2024-09-22T08:56:55.837436+0000","last_became_active":"2024-09-22T08:31:11.210054+0000","last_became_peered":"2024-09-22T08:31:11.210054+0000","last_unstale":"2024-09-22T08:56:55.837436+0000","last_undegraded":"2024-09-22T08:56:55.837436+0000","last_fullsized":"2024-09-22T08:56:55.837436+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:55.837344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:55.837344+0000","last_clean_scrub_stamp":"2024-09-22T08:56:55.837344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:33:30.300629+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"263'31","reported_seq":138,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:53.336970+0000","last_change":"2024-09-22T08:56:53.336910+0000","last_active":"2024-09-22T08:56:53.336970+0000","last_peered":"2024-09-22T08:56:53.336970+0000","last_clean":"2024-09-22T08:56:53.336970+0000","last_became_active":"2024-09-22T08:29:26.070492+0000","last_became_peered":"2024-09-22T08:29:26.070492+0000","last_unstale":"2024-09-22T08:56:53.336970+0000","last_undegraded":"2024-09-22T08:56:53.336970+0000","last_fullsized":"2024-09-22T08:56:53.336970+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'31","last_scrub_stamp":"2024-09-22T08:56:53.336820+0000","last_deep_scrub":"263'31","last_deep_scrub_stamp":"2024-09-22T08:56:53.336820+0000","last_clean_scrub_stamp":"2024-09-22T08:56:53.336820+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:57:38.542593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":169,"num_write":83,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:17.421360+0000","last_change":"2024-09-22T08:57:17.421258+0000","last_active":"2024-09-22T08:57:17.421360+0000","last_peered":"2024-09-22T08:57:17.421360+0000","last_clean":"2024-09-22T08:57:17.421360+0000","last_became_active":"2024-09-22T08:42:17.433193+0000","last_became_peered":"2024-09-22T08:42:17.433193+0000","last_unstale":"2024-09-22T08:57:17.421360+0000","last_undegraded":"2024-09-22T08:57:17.421360+0000","last_fullsized":"2024-09-22T08:57:17.421360+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:17.421127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:17.421127+0000","last_clean_scrub_stamp":"2024-09-22T08:57:17.421127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:14:22.468511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:05.465479+0000","last_change":"2024-09-22T08:57:05.465479+0000","last_active":"2024-09-22T08:57:05.465479+0000","last_peered":"2024-09-22T08:57:05.465479+0000","last_clean":"2024-09-22T08:57:05.465479+0000","last_became_active":"2024-09-22T08:31:14.254710+0000","last_became_peered":"2024-09-22T08:31:14.254710+0000","last_unstale":"2024-09-22T08:57:05.465479+0000","last_undegraded":"2024-09-22T08:57:05.465479+0000","last_fullsized":"2024-09-22T08:57:05.465479+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:05.465361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:05.465361+0000","last_clean_scrub_stamp":"2024-09-22T08:57:05.465361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:44:01.943067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:57.145740+0000","last_change":"2024-09-22T08:56:57.145740+0000","last_active":"2024-09-22T08:56:57.145740+0000","last_peered":"2024-09-22T08:56:57.145740+0000","last_clean":"2024-09-22T08:56:57.145740+0000","last_became_active":"2024-09-22T08:31:11.203413+0000","last_became_peered":"2024-09-22T08:31:11.203413+0000","last_unstale":"2024-09-22T08:56:57.145740+0000","last_undegraded":"2024-09-22T08:56:57.145740+0000","last_fullsized":"2024-09-22T08:56:57.145740+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:57.145641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:57.145641+0000","last_clean_scrub_stamp":"2024-09-22T08:56:57.145641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:33:10.096611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:52.322127+0000","last_change":"2024-09-22T08:56:52.322127+0000","last_active":"2024-09-22T08:56:52.322127+0000","last_peered":"2024-09-22T08:56:52.322127+0000","last_clean":"2024-09-22T08:56:52.322127+0000","last_became_active":"2024-09-22T08:29:26.071742+0000","last_became_peered":"2024-09-22T08:29:26.071742+0000","last_unstale":"2024-09-22T08:56:52.322127+0000","last_undegraded":"2024-09-22T08:56:52.322127+0000","last_fullsized":"2024-09-22T08:56:52.322127+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:52.322037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:52.322037+0000","last_clean_scrub_stamp":"2024-09-22T08:56:52.322037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:50:38.510198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:59.819076+0000","last_change":"2024-09-22T08:56:59.819076+0000","last_active":"2024-09-22T08:56:59.819076+0000","last_peered":"2024-09-22T08:56:59.819076+0000","last_clean":"2024-09-22T08:56:59.819076+0000","last_became_active":"2024-09-22T08:42:17.433346+0000","last_became_peered":"2024-09-22T08:42:17.433346+0000","last_unstale":"2024-09-22T08:56:59.819076+0000","last_undegraded":"2024-09-22T08:56:59.819076+0000","last_fullsized":"2024-09-22T08:56:59.819076+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:59.818974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:59.818974+0000","last_clean_scrub_stamp":"2024-09-22T08:56:59.818974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:48:10.703277+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"260'2","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:04.456491+0000","last_change":"2024-09-22T08:57:04.456491+0000","last_active":"2024-09-22T08:57:04.456491+0000","last_peered":"2024-09-22T08:57:04.456491+0000","last_clean":"2024-09-22T08:57:04.456491+0000","last_became_active":"2024-09-22T08:31:14.255243+0000","last_became_peered":"2024-09-22T08:31:14.255243+0000","last_unstale":"2024-09-22T08:57:04.456491+0000","last_undegraded":"2024-09-22T08:57:04.456491+0000","last_fullsized":"2024-09-22T08:57:04.456491+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-22T08:57:04.456386+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-22T08:57:04.456386+0000","last_clean_scrub_stamp":"2024-09-22T08:57:04.456386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:45:35.022993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"263'6","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:00.630131+0000","last_change":"2024-09-22T08:57:00.630131+0000","last_active":"2024-09-22T08:57:00.630131+0000","last_peered":"2024-09-22T08:57:00.630131+0000","last_clean":"2024-09-22T08:57:00.630131+0000","last_became_active":"2024-09-22T08:31:11.210266+0000","last_became_peered":"2024-09-22T08:31:11.210266+0000","last_unstale":"2024-09-22T08:57:00.630131+0000","last_undegraded":"2024-09-22T08:57:00.630131+0000","last_fullsized":"2024-09-22T08:57:00.630131+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-22T08:57:00.630042+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-22T08:57:00.630042+0000","last_clean_scrub_stamp":"2024-09-22T08:57:00.630042+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:33:15.019806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":13312,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"263'39","reported_seq":157,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:13.642786+0000","last_change":"2024-09-22T08:57:13.642786+0000","last_active":"2024-09-22T08:57:13.642786+0000","last_peered":"2024-09-22T08:57:13.642786+0000","last_clean":"2024-09-22T08:57:13.642786+0000","last_became_active":"2024-09-22T08:29:26.076175+0000","last_became_peered":"2024-09-22T08:29:26.076175+0000","last_unstale":"2024-09-22T08:57:13.642786+0000","last_undegraded":"2024-09-22T08:57:13.642786+0000","last_fullsized":"2024-09-22T08:57:13.642786+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'39","last_scrub_stamp":"2024-09-22T08:57:13.642694+0000","last_deep_scrub":"263'39","last_deep_scrub_stamp":"2024-09-22T08:57:13.642694+0000","last_clean_scrub_stamp":"2024-09-22T08:57:13.642694+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:01.748304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":317,"num_read_kb":219,"num_write":102,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:29.570999+0000","last_change":"2024-09-22T08:57:29.570999+0000","last_active":"2024-09-22T08:57:29.570999+0000","last_peered":"2024-09-22T08:57:29.570999+0000","last_clean":"2024-09-22T08:57:29.570999+0000","last_became_active":"2024-09-22T08:42:17.434909+0000","last_became_peered":"2024-09-22T08:42:17.434909+0000","last_unstale":"2024-09-22T08:57:29.570999+0000","last_undegraded":"2024-09-22T08:57:29.570999+0000","last_fullsized":"2024-09-22T08:57:29.570999+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:29.570905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:29.570905+0000","last_clean_scrub_stamp":"2024-09-22T08:57:29.570905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:12:01.700091+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"263'4","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:06.485825+0000","last_change":"2024-09-22T08:57:06.485825+0000","last_active":"2024-09-22T08:57:06.485825+0000","last_peered":"2024-09-22T08:57:06.485825+0000","last_clean":"2024-09-22T08:57:06.485825+0000","last_became_active":"2024-09-22T08:31:14.252184+0000","last_became_peered":"2024-09-22T08:31:14.252184+0000","last_unstale":"2024-09-22T08:57:06.485825+0000","last_undegraded":"2024-09-22T08:57:06.485825+0000","last_fullsized":"2024-09-22T08:57:06.485825+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-22T08:57:06.485718+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-22T08:57:06.485718+0000","last_clean_scrub_stamp":"2024-09-22T08:57:06.485718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:26:53.429257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":4,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"263'2","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:59.322125+0000","last_change":"2024-09-22T08:56:59.322125+0000","last_active":"2024-09-22T08:56:59.322125+0000","last_peered":"2024-09-22T08:56:59.322125+0000","last_clean":"2024-09-22T08:56:59.322125+0000","last_became_active":"2024-09-22T08:31:11.217115+0000","last_became_peered":"2024-09-22T08:31:11.217115+0000","last_unstale":"2024-09-22T08:56:59.322125+0000","last_undegraded":"2024-09-22T08:56:59.322125+0000","last_fullsized":"2024-09-22T08:56:59.322125+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:56:59.322031+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:56:59.322031+0000","last_clean_scrub_stamp":"2024-09-22T08:56:59.322031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:45:40.706530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"263'57","reported_seq":201,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:51.745977+0000","last_change":"2024-09-22T08:56:51.745977+0000","last_active":"2024-09-22T08:56:51.745977+0000","last_peered":"2024-09-22T08:56:51.745977+0000","last_clean":"2024-09-22T08:56:51.745977+0000","last_became_active":"2024-09-22T08:29:26.076048+0000","last_became_peered":"2024-09-22T08:29:26.076048+0000","last_unstale":"2024-09-22T08:56:51.745977+0000","last_undegraded":"2024-09-22T08:56:51.745977+0000","last_fullsized":"2024-09-22T08:56:51.745977+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'57","last_scrub_stamp":"2024-09-22T08:56:51.745876+0000","last_deep_scrub":"263'57","last_deep_scrub_stamp":"2024-09-22T08:56:51.745876+0000","last_clean_scrub_stamp":"2024-09-22T08:56:51.745876+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:20:20.278906+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":427,"num_read_kb":265,"num_write":151,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:57.786662+0000","last_change":"2024-09-22T08:56:57.786599+0000","last_active":"2024-09-22T08:56:57.786662+0000","last_peered":"2024-09-22T08:56:57.786662+0000","last_clean":"2024-09-22T08:56:57.786662+0000","last_became_active":"2024-09-22T08:42:17.430974+0000","last_became_peered":"2024-09-22T08:42:17.430974+0000","last_unstale":"2024-09-22T08:56:57.786662+0000","last_undegraded":"2024-09-22T08:56:57.786662+0000","last_fullsized":"2024-09-22T08:56:57.786662+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:57.786504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:57.786504+0000","last_clean_scrub_stamp":"2024-09-22T08:56:57.786504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:22.256524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"260'3","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:09.399381+0000","last_change":"2024-09-22T08:57:09.399381+0000","last_active":"2024-09-22T08:57:09.399381+0000","last_peered":"2024-09-22T08:57:09.399381+0000","last_clean":"2024-09-22T08:57:09.399381+0000","last_became_active":"2024-09-22T08:31:14.257952+0000","last_became_peered":"2024-09-22T08:31:14.257952+0000","last_unstale":"2024-09-22T08:57:09.399381+0000","last_undegraded":"2024-09-22T08:57:09.399381+0000","last_fullsized":"2024-09-22T08:57:09.399381+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-22T08:57:09.399284+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-22T08:57:09.399284+0000","last_clean_scrub_stamp":"2024-09-22T08:57:09.399284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:38:52.021390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:00.354699+0000","last_change":"2024-09-22T08:57:00.354699+0000","last_active":"2024-09-22T08:57:00.354699+0000","last_peered":"2024-09-22T08:57:00.354699+0000","last_clean":"2024-09-22T08:57:00.354699+0000","last_became_active":"2024-09-22T08:31:11.213273+0000","last_became_peered":"2024-09-22T08:31:11.213273+0000","last_unstale":"2024-09-22T08:57:00.354699+0000","last_undegraded":"2024-09-22T08:57:00.354699+0000","last_fullsized":"2024-09-22T08:57:00.354699+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:00.354599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:00.354599+0000","last_clean_scrub_stamp":"2024-09-22T08:57:00.354599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:47:58.169764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"263'16","reported_seq":92,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:54.621356+0000","last_change":"2024-09-22T08:56:54.621356+0000","last_active":"2024-09-22T08:56:54.621356+0000","last_peered":"2024-09-22T08:56:54.621356+0000","last_clean":"2024-09-22T08:56:54.621356+0000","last_became_active":"2024-09-22T08:29:26.074205+0000","last_became_peered":"2024-09-22T08:29:26.074205+0000","last_unstale":"2024-09-22T08:56:54.621356+0000","last_undegraded":"2024-09-22T08:56:54.621356+0000","last_fullsized":"2024-09-22T08:56:54.621356+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'16","last_scrub_stamp":"2024-09-22T08:56:54.621263+0000","last_deep_scrub":"263'16","last_deep_scrub_stamp":"2024-09-22T08:56:54.621263+0000","last_clean_scrub_stamp":"2024-09-22T08:56:54.621263+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:57.139031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":71,"num_write":43,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:18.465765+0000","last_change":"2024-09-22T08:57:18.465765+0000","last_active":"2024-09-22T08:57:18.465765+0000","last_peered":"2024-09-22T08:57:18.465765+0000","last_clean":"2024-09-22T08:57:18.465765+0000","last_became_active":"2024-09-22T08:42:17.429927+0000","last_became_peered":"2024-09-22T08:42:17.429927+0000","last_unstale":"2024-09-22T08:57:18.465765+0000","last_undegraded":"2024-09-22T08:57:18.465765+0000","last_fullsized":"2024-09-22T08:57:18.465765+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:18.465670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:18.465670+0000","last_clean_scrub_stamp":"2024-09-22T08:57:18.465670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:41:22.824981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"263'6","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:24.641712+0000","last_change":"2024-09-22T08:57:24.641712+0000","last_active":"2024-09-22T08:57:24.641712+0000","last_peered":"2024-09-22T08:57:24.641712+0000","last_clean":"2024-09-22T08:57:24.641712+0000","last_became_active":"2024-09-22T08:31:14.253610+0000","last_became_peered":"2024-09-22T08:31:14.253610+0000","last_unstale":"2024-09-22T08:57:24.641712+0000","last_undegraded":"2024-09-22T08:57:24.641712+0000","last_fullsized":"2024-09-22T08:57:24.641712+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-22T08:57:24.641616+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-22T08:57:24.641616+0000","last_clean_scrub_stamp":"2024-09-22T08:57:24.641616+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:29:54.769515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13314,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"263'4","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:56.374144+0000","last_change":"2024-09-22T08:56:56.374086+0000","last_active":"2024-09-22T08:56:56.374144+0000","last_peered":"2024-09-22T08:56:56.374144+0000","last_clean":"2024-09-22T08:56:56.374144+0000","last_became_active":"2024-09-22T08:31:11.217553+0000","last_became_peered":"2024-09-22T08:31:11.217553+0000","last_unstale":"2024-09-22T08:56:56.374144+0000","last_undegraded":"2024-09-22T08:56:56.374144+0000","last_fullsized":"2024-09-22T08:56:56.374144+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-22T08:56:56.373995+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-22T08:56:56.373995+0000","last_clean_scrub_stamp":"2024-09-22T08:56:56.373995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:14:14.629754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"263'36","reported_seq":143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:53.575640+0000","last_change":"2024-09-22T08:56:53.575640+0000","last_active":"2024-09-22T08:56:53.575640+0000","last_peered":"2024-09-22T08:56:53.575640+0000","last_clean":"2024-09-22T08:56:53.575640+0000","last_became_active":"2024-09-22T08:29:26.070671+0000","last_became_peered":"2024-09-22T08:29:26.070671+0000","last_unstale":"2024-09-22T08:56:53.575640+0000","last_undegraded":"2024-09-22T08:56:53.575640+0000","last_fullsized":"2024-09-22T08:56:53.575640+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'36","last_scrub_stamp":"2024-09-22T08:56:53.575555+0000","last_deep_scrub":"263'36","last_deep_scrub_stamp":"2024-09-22T08:56:53.575555+0000","last_clean_scrub_stamp":"2024-09-22T08:56:53.575555+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:45:32.893922+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":255,"num_read_kb":155,"num_write":90,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:04.080658+0000","last_change":"2024-09-22T08:57:04.080658+0000","last_active":"2024-09-22T08:57:04.080658+0000","last_peered":"2024-09-22T08:57:04.080658+0000","last_clean":"2024-09-22T08:57:04.080658+0000","last_became_active":"2024-09-22T08:42:17.433331+0000","last_became_peered":"2024-09-22T08:42:17.433331+0000","last_unstale":"2024-09-22T08:57:04.080658+0000","last_undegraded":"2024-09-22T08:57:04.080658+0000","last_fullsized":"2024-09-22T08:57:04.080658+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:04.080551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:04.080551+0000","last_clean_scrub_stamp":"2024-09-22T08:57:04.080551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:32:25.556797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"263'4","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:01.134878+0000","last_change":"2024-09-22T08:57:01.134811+0000","last_active":"2024-09-22T08:57:01.134878+0000","last_peered":"2024-09-22T08:57:01.134878+0000","last_clean":"2024-09-22T08:57:01.134878+0000","last_became_active":"2024-09-22T08:31:14.253118+0000","last_became_peered":"2024-09-22T08:31:14.253118+0000","last_unstale":"2024-09-22T08:57:01.134878+0000","last_undegraded":"2024-09-22T08:57:01.134878+0000","last_fullsized":"2024-09-22T08:57:01.134878+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-22T08:57:01.134699+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-22T08:57:01.134699+0000","last_clean_scrub_stamp":"2024-09-22T08:57:01.134699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:53:52.098956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"263'9","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:02.518745+0000","last_change":"2024-09-22T08:57:02.518684+0000","last_active":"2024-09-22T08:57:02.518745+0000","last_peered":"2024-09-22T08:57:02.518745+0000","last_clean":"2024-09-22T08:57:02.518745+0000","last_became_active":"2024-09-22T08:31:11.211939+0000","last_became_peered":"2024-09-22T08:31:11.211939+0000","last_unstale":"2024-09-22T08:57:02.518745+0000","last_undegraded":"2024-09-22T08:57:02.518745+0000","last_fullsized":"2024-09-22T08:57:02.518745+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-22T08:57:02.518579+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-22T08:57:02.518579+0000","last_clean_scrub_stamp":"2024-09-22T08:57:02.518579+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:55:33.787552+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":24578,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"263'43","reported_seq":164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:53.199184+0000","last_change":"2024-09-22T08:56:53.199125+0000","last_active":"2024-09-22T08:56:53.199184+0000","last_peered":"2024-09-22T08:56:53.199184+0000","last_clean":"2024-09-22T08:56:53.199184+0000","last_became_active":"2024-09-22T08:29:26.069202+0000","last_became_peered":"2024-09-22T08:29:26.069202+0000","last_unstale":"2024-09-22T08:56:53.199184+0000","last_undegraded":"2024-09-22T08:56:53.199184+0000","last_fullsized":"2024-09-22T08:56:53.199184+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'43","last_scrub_stamp":"2024-09-22T08:56:53.199033+0000","last_deep_scrub":"263'43","last_deep_scrub_stamp":"2024-09-22T08:56:53.199033+0000","last_clean_scrub_stamp":"2024-09-22T08:56:53.199033+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:07:35.698271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":316,"num_read_kb":207,"num_write":121,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"263'2","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:57.326140+0000","last_change":"2024-09-22T08:56:57.326140+0000","last_active":"2024-09-22T08:56:57.326140+0000","last_peered":"2024-09-22T08:56:57.326140+0000","last_clean":"2024-09-22T08:56:57.326140+0000","last_became_active":"2024-09-22T08:42:17.436036+0000","last_became_peered":"2024-09-22T08:42:17.436036+0000","last_unstale":"2024-09-22T08:56:57.326140+0000","last_undegraded":"2024-09-22T08:56:57.326140+0000","last_fullsized":"2024-09-22T08:56:57.326140+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:56:57.326045+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:56:57.326045+0000","last_clean_scrub_stamp":"2024-09-22T08:56:57.326045+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:40:52.083802+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"260'6","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:02.631822+0000","last_change":"2024-09-22T08:57:02.631822+0000","last_active":"2024-09-22T08:57:02.631822+0000","last_peered":"2024-09-22T08:57:02.631822+0000","last_clean":"2024-09-22T08:57:02.631822+0000","last_became_active":"2024-09-22T08:31:14.260111+0000","last_became_peered":"2024-09-22T08:31:14.260111+0000","last_unstale":"2024-09-22T08:57:02.631822+0000","last_undegraded":"2024-09-22T08:57:02.631822+0000","last_fullsized":"2024-09-22T08:57:02.631822+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-22T08:57:02.631731+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-22T08:57:02.631731+0000","last_clean_scrub_stamp":"2024-09-22T08:57:02.631731+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:07:42.980728+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"263'5","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:58.340876+0000","last_change":"2024-09-22T08:56:58.340811+0000","last_active":"2024-09-22T08:56:58.340876+0000","last_peered":"2024-09-22T08:56:58.340876+0000","last_clean":"2024-09-22T08:56:58.340876+0000","last_became_active":"2024-09-22T08:31:11.213121+0000","last_became_peered":"2024-09-22T08:31:11.213121+0000","last_unstale":"2024-09-22T08:56:58.340876+0000","last_undegraded":"2024-09-22T08:56:58.340876+0000","last_fullsized":"2024-09-22T08:56:58.340876+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-22T08:56:58.340717+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-22T08:56:58.340717+0000","last_clean_scrub_stamp":"2024-09-22T08:56:58.340717+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:54:56.570156+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"263'24","reported_seq":115,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:01.478243+0000","last_change":"2024-09-22T08:57:01.478185+0000","last_active":"2024-09-22T08:57:01.478243+0000","last_peered":"2024-09-22T08:57:01.478243+0000","last_clean":"2024-09-22T08:57:01.478243+0000","last_became_active":"2024-09-22T08:29:26.068397+0000","last_became_peered":"2024-09-22T08:29:26.068397+0000","last_unstale":"2024-09-22T08:57:01.478243+0000","last_undegraded":"2024-09-22T08:57:01.478243+0000","last_fullsized":"2024-09-22T08:57:01.478243+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'24","last_scrub_stamp":"2024-09-22T08:57:01.478102+0000","last_deep_scrub":"263'24","last_deep_scrub_stamp":"2024-09-22T08:57:01.478102+0000","last_clean_scrub_stamp":"2024-09-22T08:57:01.478102+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:43:15.925512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":108,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:12.381769+0000","last_change":"2024-09-22T08:57:12.381769+0000","last_active":"2024-09-22T08:57:12.381769+0000","last_peered":"2024-09-22T08:57:12.381769+0000","last_clean":"2024-09-22T08:57:12.381769+0000","last_became_active":"2024-09-22T08:42:17.431476+0000","last_became_peered":"2024-09-22T08:42:17.431476+0000","last_unstale":"2024-09-22T08:57:12.381769+0000","last_undegraded":"2024-09-22T08:57:12.381769+0000","last_fullsized":"2024-09-22T08:57:12.381769+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:12.381678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:12.381678+0000","last_clean_scrub_stamp":"2024-09-22T08:57:12.381678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:43:18.220962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"263'2","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:53.336621+0000","last_change":"2024-09-22T08:56:53.336561+0000","last_active":"2024-09-22T08:56:53.336621+0000","last_peered":"2024-09-22T08:56:53.336621+0000","last_clean":"2024-09-22T08:56:53.336621+0000","last_became_active":"2024-09-22T08:31:14.257508+0000","last_became_peered":"2024-09-22T08:31:14.257508+0000","last_unstale":"2024-09-22T08:56:53.336621+0000","last_undegraded":"2024-09-22T08:56:53.336621+0000","last_fullsized":"2024-09-22T08:56:53.336621+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:56:53.336464+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:56:53.336464+0000","last_clean_scrub_stamp":"2024-09-22T08:56:53.336464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:16.822824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:19.588020+0000","last_change":"2024-09-22T08:57:19.588020+0000","last_active":"2024-09-22T08:57:19.588020+0000","last_peered":"2024-09-22T08:57:19.588020+0000","last_clean":"2024-09-22T08:57:19.588020+0000","last_became_active":"2024-09-22T08:31:11.214953+0000","last_became_peered":"2024-09-22T08:31:11.214953+0000","last_unstale":"2024-09-22T08:57:19.588020+0000","last_undegraded":"2024-09-22T08:57:19.588020+0000","last_fullsized":"2024-09-22T08:57:19.588020+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:19.587925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:19.587925+0000","last_clean_scrub_stamp":"2024-09-22T08:57:19.587925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:04:36.492621+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"263'16","reported_seq":97,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:50.335122+0000","last_change":"2024-09-22T08:56:50.335050+0000","last_active":"2024-09-22T08:56:50.335122+0000","last_peered":"2024-09-22T08:56:50.335122+0000","last_clean":"2024-09-22T08:56:50.335122+0000","last_became_active":"2024-09-22T08:29:26.072473+0000","last_became_peered":"2024-09-22T08:29:26.072473+0000","last_unstale":"2024-09-22T08:56:50.335122+0000","last_undegraded":"2024-09-22T08:56:50.335122+0000","last_fullsized":"2024-09-22T08:56:50.335122+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'16","last_scrub_stamp":"2024-09-22T08:56:50.334964+0000","last_deep_scrub":"263'16","last_deep_scrub_stamp":"2024-09-22T08:56:50.334964+0000","last_clean_scrub_stamp":"2024-09-22T08:56:50.334964+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:21:18.083176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":83,"num_write":41,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:56.327182+0000","last_change":"2024-09-22T08:56:56.327182+0000","last_active":"2024-09-22T08:56:56.327182+0000","last_peered":"2024-09-22T08:56:56.327182+0000","last_clean":"2024-09-22T08:56:56.327182+0000","last_became_active":"2024-09-22T08:42:17.431637+0000","last_became_peered":"2024-09-22T08:42:17.431637+0000","last_unstale":"2024-09-22T08:56:56.327182+0000","last_undegraded":"2024-09-22T08:56:56.327182+0000","last_fullsized":"2024-09-22T08:56:56.327182+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:56.327086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:56.327086+0000","last_clean_scrub_stamp":"2024-09-22T08:56:56.327086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:42:07.844288+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"263'4","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:08.443053+0000","last_change":"2024-09-22T08:57:08.443053+0000","last_active":"2024-09-22T08:57:08.443053+0000","last_peered":"2024-09-22T08:57:08.443053+0000","last_clean":"2024-09-22T08:57:08.443053+0000","last_became_active":"2024-09-22T08:31:14.261352+0000","last_became_peered":"2024-09-22T08:31:14.261352+0000","last_unstale":"2024-09-22T08:57:08.443053+0000","last_undegraded":"2024-09-22T08:57:08.443053+0000","last_fullsized":"2024-09-22T08:57:08.443053+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-22T08:57:08.442935+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-22T08:57:08.442935+0000","last_clean_scrub_stamp":"2024-09-22T08:57:08.442935+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:47:50.418843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"263'6","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:17.643351+0000","last_change":"2024-09-22T08:57:17.643351+0000","last_active":"2024-09-22T08:57:17.643351+0000","last_peered":"2024-09-22T08:57:17.643351+0000","last_clean":"2024-09-22T08:57:17.643351+0000","last_became_active":"2024-09-22T08:31:11.216081+0000","last_became_peered":"2024-09-22T08:31:11.216081+0000","last_unstale":"2024-09-22T08:57:17.643351+0000","last_undegraded":"2024-09-22T08:57:17.643351+0000","last_fullsized":"2024-09-22T08:57:17.643351+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-22T08:57:17.643268+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-22T08:57:17.643268+0000","last_clean_scrub_stamp":"2024-09-22T08:57:17.643268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:09:27.959072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":6,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"253'4","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:59.869354+0000","last_change":"2024-09-22T08:56:59.869302+0000","last_active":"2024-09-22T08:56:59.869354+0000","last_peered":"2024-09-22T08:56:59.869354+0000","last_clean":"2024-09-22T08:56:59.869354+0000","last_became_active":"2024-09-22T08:29:26.072681+0000","last_became_peered":"2024-09-22T08:29:26.072681+0000","last_unstale":"2024-09-22T08:56:59.869354+0000","last_undegraded":"2024-09-22T08:56:59.869354+0000","last_fullsized":"2024-09-22T08:56:59.869354+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"253'4","last_scrub_stamp":"2024-09-22T08:56:59.869208+0000","last_deep_scrub":"253'4","last_deep_scrub_stamp":"2024-09-22T08:56:59.869208+0000","last_clean_scrub_stamp":"2024-09-22T08:56:59.869208+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:47:15.670371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:00.277533+0000","last_change":"2024-09-22T08:57:00.277533+0000","last_active":"2024-09-22T08:57:00.277533+0000","last_peered":"2024-09-22T08:57:00.277533+0000","last_clean":"2024-09-22T08:57:00.277533+0000","last_became_active":"2024-09-22T08:42:17.430084+0000","last_became_peered":"2024-09-22T08:42:17.430084+0000","last_unstale":"2024-09-22T08:57:00.277533+0000","last_undegraded":"2024-09-22T08:57:00.277533+0000","last_fullsized":"2024-09-22T08:57:00.277533+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:00.277439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:00.277439+0000","last_clean_scrub_stamp":"2024-09-22T08:57:00.277439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:21:36.717278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"260'2","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:07.472734+0000","last_change":"2024-09-22T08:57:07.472734+0000","last_active":"2024-09-22T08:57:07.472734+0000","last_peered":"2024-09-22T08:57:07.472734+0000","last_clean":"2024-09-22T08:57:07.472734+0000","last_became_active":"2024-09-22T08:31:14.259624+0000","last_became_peered":"2024-09-22T08:31:14.259624+0000","last_unstale":"2024-09-22T08:57:07.472734+0000","last_undegraded":"2024-09-22T08:57:07.472734+0000","last_fullsized":"2024-09-22T08:57:07.472734+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-22T08:57:07.472626+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-22T08:57:07.472626+0000","last_clean_scrub_stamp":"2024-09-22T08:57:07.472626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:21:35.883154+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"263'5","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:05.877024+0000","last_change":"2024-09-22T08:57:05.877024+0000","last_active":"2024-09-22T08:57:05.877024+0000","last_peered":"2024-09-22T08:57:05.877024+0000","last_clean":"2024-09-22T08:57:05.877024+0000","last_became_active":"2024-09-22T08:31:11.214279+0000","last_became_peered":"2024-09-22T08:31:11.214279+0000","last_unstale":"2024-09-22T08:57:05.877024+0000","last_undegraded":"2024-09-22T08:57:05.877024+0000","last_fullsized":"2024-09-22T08:57:05.877024+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-22T08:57:05.876938+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-22T08:57:05.876938+0000","last_clean_scrub_stamp":"2024-09-22T08:57:05.876938+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:40:53.992557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"263'2","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:12.675252+0000","last_change":"2024-09-22T08:57:12.675201+0000","last_active":"2024-09-22T08:57:12.675252+0000","last_peered":"2024-09-22T08:57:12.675252+0000","last_clean":"2024-09-22T08:57:12.675252+0000","last_became_active":"2024-09-22T08:29:26.074971+0000","last_became_peered":"2024-09-22T08:29:26.074971+0000","last_unstale":"2024-09-22T08:57:12.675252+0000","last_undegraded":"2024-09-22T08:57:12.675252+0000","last_fullsized":"2024-09-22T08:57:12.675252+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:57:12.675110+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:57:12.675110+0000","last_clean_scrub_stamp":"2024-09-22T08:57:12.675110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:10:02.467119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:14.394509+0000","last_change":"2024-09-22T08:57:14.394509+0000","last_active":"2024-09-22T08:57:14.394509+0000","last_peered":"2024-09-22T08:57:14.394509+0000","last_clean":"2024-09-22T08:57:14.394509+0000","last_became_active":"2024-09-22T08:42:17.433090+0000","last_became_peered":"2024-09-22T08:42:17.433090+0000","last_unstale":"2024-09-22T08:57:14.394509+0000","last_undegraded":"2024-09-22T08:57:14.394509+0000","last_fullsized":"2024-09-22T08:57:14.394509+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:14.394393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:14.394393+0000","last_clean_scrub_stamp":"2024-09-22T08:57:14.394393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:09:59.955451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"260'2","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:52.358045+0000","last_change":"2024-09-22T08:56:52.357978+0000","last_active":"2024-09-22T08:56:52.358045+0000","last_peered":"2024-09-22T08:56:52.358045+0000","last_clean":"2024-09-22T08:56:52.358045+0000","last_became_active":"2024-09-22T08:31:14.256835+0000","last_became_peered":"2024-09-22T08:31:14.256835+0000","last_unstale":"2024-09-22T08:56:52.358045+0000","last_undegraded":"2024-09-22T08:56:52.358045+0000","last_fullsized":"2024-09-22T08:56:52.358045+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-22T08:56:52.357881+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-22T08:56:52.357881+0000","last_clean_scrub_stamp":"2024-09-22T08:56:52.357881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:07:30.389570+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"263'5","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:00.175600+0000","last_change":"2024-09-22T08:57:00.175527+0000","last_active":"2024-09-22T08:57:00.175600+0000","last_peered":"2024-09-22T08:57:00.175600+0000","last_clean":"2024-09-22T08:57:00.175600+0000","last_became_active":"2024-09-22T08:31:11.212487+0000","last_became_peered":"2024-09-22T08:31:11.212487+0000","last_unstale":"2024-09-22T08:57:00.175600+0000","last_undegraded":"2024-09-22T08:57:00.175600+0000","last_fullsized":"2024-09-22T08:57:00.175600+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-22T08:57:00.175434+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-22T08:57:00.175434+0000","last_clean_scrub_stamp":"2024-09-22T08:57:00.175434+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:20:34.588796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"263'131","reported_seq":440,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:52.231836+0000","last_change":"2024-09-22T08:56:52.231836+0000","last_active":"2024-09-22T08:56:52.231836+0000","last_peered":"2024-09-22T08:56:52.231836+0000","last_clean":"2024-09-22T08:56:52.231836+0000","last_became_active":"2024-09-22T08:29:26.067149+0000","last_became_peered":"2024-09-22T08:29:26.067149+0000","last_unstale":"2024-09-22T08:56:52.231836+0000","last_undegraded":"2024-09-22T08:56:52.231836+0000","last_fullsized":"2024-09-22T08:56:52.231836+0000","mapping_epoch":252,"log_start":"260'100","ondisk_log_start":"260'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'131","last_scrub_stamp":"2024-09-22T08:56:52.231731+0000","last_deep_scrub":"263'131","last_deep_scrub_stamp":"2024-09-22T08:56:52.231731+0000","last_clean_scrub_stamp":"2024-09-22T08:56:52.231731+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:22:59.688170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1238,"num_read_kb":970,"num_write":283,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:27.618394+0000","last_change":"2024-09-22T08:57:27.618394+0000","last_active":"2024-09-22T08:57:27.618394+0000","last_peered":"2024-09-22T08:57:27.618394+0000","last_clean":"2024-09-22T08:57:27.618394+0000","last_became_active":"2024-09-22T08:42:17.434424+0000","last_became_peered":"2024-09-22T08:42:17.434424+0000","last_unstale":"2024-09-22T08:57:27.618394+0000","last_undegraded":"2024-09-22T08:57:27.618394+0000","last_fullsized":"2024-09-22T08:57:27.618394+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:27.618292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:27.618292+0000","last_clean_scrub_stamp":"2024-09-22T08:57:27.618292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:23:28.628910+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"260'9","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:22.580345+0000","last_change":"2024-09-22T08:57:22.580345+0000","last_active":"2024-09-22T08:57:22.580345+0000","last_peered":"2024-09-22T08:57:22.580345+0000","last_clean":"2024-09-22T08:57:22.580345+0000","last_became_active":"2024-09-22T08:31:14.255160+0000","last_became_peered":"2024-09-22T08:31:14.255160+0000","last_unstale":"2024-09-22T08:57:22.580345+0000","last_undegraded":"2024-09-22T08:57:22.580345+0000","last_fullsized":"2024-09-22T08:57:22.580345+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'9","last_scrub_stamp":"2024-09-22T08:57:22.580248+0000","last_deep_scrub":"260'9","last_deep_scrub_stamp":"2024-09-22T08:57:22.580248+0000","last_clean_scrub_stamp":"2024-09-22T08:57:22.580248+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:47:07.425920+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":23554,"num_write":14,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:18.603287+0000","last_change":"2024-09-22T08:57:18.603287+0000","last_active":"2024-09-22T08:57:18.603287+0000","last_peered":"2024-09-22T08:57:18.603287+0000","last_clean":"2024-09-22T08:57:18.603287+0000","last_became_active":"2024-09-22T08:31:11.216271+0000","last_became_peered":"2024-09-22T08:31:11.216271+0000","last_unstale":"2024-09-22T08:57:18.603287+0000","last_undegraded":"2024-09-22T08:57:18.603287+0000","last_fullsized":"2024-09-22T08:57:18.603287+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:18.603183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:18.603183+0000","last_clean_scrub_stamp":"2024-09-22T08:57:18.603183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:13:16.049401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"263'19","reported_seq":106,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:51.321427+0000","last_change":"2024-09-22T08:56:51.321427+0000","last_active":"2024-09-22T08:56:51.321427+0000","last_peered":"2024-09-22T08:56:51.321427+0000","last_clean":"2024-09-22T08:56:51.321427+0000","last_became_active":"2024-09-22T08:29:26.069730+0000","last_became_peered":"2024-09-22T08:29:26.069730+0000","last_unstale":"2024-09-22T08:56:51.321427+0000","last_undegraded":"2024-09-22T08:56:51.321427+0000","last_fullsized":"2024-09-22T08:56:51.321427+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'19","last_scrub_stamp":"2024-09-22T08:56:51.321334+0000","last_deep_scrub":"263'19","last_deep_scrub_stamp":"2024-09-22T08:56:51.321334+0000","last_clean_scrub_stamp":"2024-09-22T08:56:51.321334+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:10:54.081036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":95,"num_write":48,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"263'2","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:11.403678+0000","last_change":"2024-09-22T08:57:11.403610+0000","last_active":"2024-09-22T08:57:11.403678+0000","last_peered":"2024-09-22T08:57:11.403678+0000","last_clean":"2024-09-22T08:57:11.403678+0000","last_became_active":"2024-09-22T08:42:17.418864+0000","last_became_peered":"2024-09-22T08:42:17.418864+0000","last_unstale":"2024-09-22T08:57:11.403678+0000","last_undegraded":"2024-09-22T08:57:11.403678+0000","last_fullsized":"2024-09-22T08:57:11.403678+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:57:11.403514+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:57:11.403514+0000","last_clean_scrub_stamp":"2024-09-22T08:57:11.403514+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:49:55.655869+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"263'2","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:07.855544+0000","last_change":"2024-09-22T08:57:07.855544+0000","last_active":"2024-09-22T08:57:07.855544+0000","last_peered":"2024-09-22T08:57:07.855544+0000","last_clean":"2024-09-22T08:57:07.855544+0000","last_became_active":"2024-09-22T08:31:14.259485+0000","last_became_peered":"2024-09-22T08:31:14.259485+0000","last_unstale":"2024-09-22T08:57:07.855544+0000","last_undegraded":"2024-09-22T08:57:07.855544+0000","last_fullsized":"2024-09-22T08:57:07.855544+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:57:07.855458+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:57:07.855458+0000","last_clean_scrub_stamp":"2024-09-22T08:57:07.855458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:08:06.125139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"260'5","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:55.152843+0000","last_change":"2024-09-22T08:56:55.152766+0000","last_active":"2024-09-22T08:56:55.152843+0000","last_peered":"2024-09-22T08:56:55.152843+0000","last_clean":"2024-09-22T08:56:55.152843+0000","last_became_active":"2024-09-22T08:31:11.210835+0000","last_became_peered":"2024-09-22T08:31:11.210835+0000","last_unstale":"2024-09-22T08:56:55.152843+0000","last_undegraded":"2024-09-22T08:56:55.152843+0000","last_fullsized":"2024-09-22T08:56:55.152843+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-22T08:56:55.152666+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-22T08:56:55.152666+0000","last_clean_scrub_stamp":"2024-09-22T08:56:55.152666+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:18:21.293821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"263'36","reported_seq":154,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:51.253039+0000","last_change":"2024-09-22T08:56:51.253039+0000","last_active":"2024-09-22T08:56:51.253039+0000","last_peered":"2024-09-22T08:56:51.253039+0000","last_clean":"2024-09-22T08:56:51.253039+0000","last_became_active":"2024-09-22T08:29:26.068105+0000","last_became_peered":"2024-09-22T08:29:26.068105+0000","last_unstale":"2024-09-22T08:56:51.253039+0000","last_undegraded":"2024-09-22T08:56:51.253039+0000","last_fullsized":"2024-09-22T08:56:51.253039+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'36","last_scrub_stamp":"2024-09-22T08:56:51.252932+0000","last_deep_scrub":"263'36","last_deep_scrub_stamp":"2024-09-22T08:56:51.252932+0000","last_clean_scrub_stamp":"2024-09-22T08:56:51.252932+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:06:36.903602+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":308,"num_read_kb":184,"num_write":90,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:06.868070+0000","last_change":"2024-09-22T08:57:06.868023+0000","last_active":"2024-09-22T08:57:06.868070+0000","last_peered":"2024-09-22T08:57:06.868070+0000","last_clean":"2024-09-22T08:57:06.868070+0000","last_became_active":"2024-09-22T08:42:17.434953+0000","last_became_peered":"2024-09-22T08:42:17.434953+0000","last_unstale":"2024-09-22T08:57:06.868070+0000","last_undegraded":"2024-09-22T08:57:06.868070+0000","last_fullsized":"2024-09-22T08:57:06.868070+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:06.867940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:06.867940+0000","last_clean_scrub_stamp":"2024-09-22T08:57:06.867940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:26:44.548797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"260'2","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:21.623022+0000","last_change":"2024-09-22T08:57:21.623022+0000","last_active":"2024-09-22T08:57:21.623022+0000","last_peered":"2024-09-22T08:57:21.623022+0000","last_clean":"2024-09-22T08:57:21.623022+0000","last_became_active":"2024-09-22T08:31:14.255534+0000","last_became_peered":"2024-09-22T08:31:14.255534+0000","last_unstale":"2024-09-22T08:57:21.623022+0000","last_undegraded":"2024-09-22T08:57:21.623022+0000","last_fullsized":"2024-09-22T08:57:21.623022+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-22T08:57:21.622920+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-22T08:57:21.622920+0000","last_clean_scrub_stamp":"2024-09-22T08:57:21.622920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:52:31.300959+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"263'6","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:16.689080+0000","last_change":"2024-09-22T08:57:16.689080+0000","last_active":"2024-09-22T08:57:16.689080+0000","last_peered":"2024-09-22T08:57:16.689080+0000","last_clean":"2024-09-22T08:57:16.689080+0000","last_became_active":"2024-09-22T08:31:11.213851+0000","last_became_peered":"2024-09-22T08:31:11.213851+0000","last_unstale":"2024-09-22T08:57:16.689080+0000","last_undegraded":"2024-09-22T08:57:16.689080+0000","last_fullsized":"2024-09-22T08:57:16.689080+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-22T08:57:16.688984+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-22T08:57:16.688984+0000","last_clean_scrub_stamp":"2024-09-22T08:57:16.688984+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:56:11.404884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":6146,"num_write":6,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"263'4","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:11.659171+0000","last_change":"2024-09-22T08:57:11.659171+0000","last_active":"2024-09-22T08:57:11.659171+0000","last_peered":"2024-09-22T08:57:11.659171+0000","last_clean":"2024-09-22T08:57:11.659171+0000","last_became_active":"2024-09-22T08:29:26.074907+0000","last_became_peered":"2024-09-22T08:29:26.074907+0000","last_unstale":"2024-09-22T08:57:11.659171+0000","last_undegraded":"2024-09-22T08:57:11.659171+0000","last_fullsized":"2024-09-22T08:57:11.659171+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-22T08:57:11.659074+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-22T08:57:11.659074+0000","last_clean_scrub_stamp":"2024-09-22T08:57:11.659074+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:32:30.977349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:16.399600+0000","last_change":"2024-09-22T08:57:16.399600+0000","last_active":"2024-09-22T08:57:16.399600+0000","last_peered":"2024-09-22T08:57:16.399600+0000","last_clean":"2024-09-22T08:57:16.399600+0000","last_became_active":"2024-09-22T08:42:17.429341+0000","last_became_peered":"2024-09-22T08:42:17.429341+0000","last_unstale":"2024-09-22T08:57:16.399600+0000","last_undegraded":"2024-09-22T08:57:16.399600+0000","last_fullsized":"2024-09-22T08:57:16.399600+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:16.399505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:16.399505+0000","last_clean_scrub_stamp":"2024-09-22T08:57:16.399505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:50:19.065776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"263'4","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:59.125351+0000","last_change":"2024-09-22T08:56:59.125351+0000","last_active":"2024-09-22T08:56:59.125351+0000","last_peered":"2024-09-22T08:56:59.125351+0000","last_clean":"2024-09-22T08:56:59.125351+0000","last_became_active":"2024-09-22T08:31:14.246417+0000","last_became_peered":"2024-09-22T08:31:14.246417+0000","last_unstale":"2024-09-22T08:56:59.125351+0000","last_undegraded":"2024-09-22T08:56:59.125351+0000","last_fullsized":"2024-09-22T08:56:59.125351+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-22T08:56:59.125228+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-22T08:56:59.125228+0000","last_clean_scrub_stamp":"2024-09-22T08:56:59.125228+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:48:30.229239+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"263'9","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:59.624592+0000","last_change":"2024-09-22T08:56:59.624592+0000","last_active":"2024-09-22T08:56:59.624592+0000","last_peered":"2024-09-22T08:56:59.624592+0000","last_clean":"2024-09-22T08:56:59.624592+0000","last_became_active":"2024-09-22T08:31:11.211079+0000","last_became_peered":"2024-09-22T08:31:11.211079+0000","last_unstale":"2024-09-22T08:56:59.624592+0000","last_undegraded":"2024-09-22T08:56:59.624592+0000","last_fullsized":"2024-09-22T08:56:59.624592+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-22T08:56:59.624511+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-22T08:56:59.624511+0000","last_clean_scrub_stamp":"2024-09-22T08:56:59.624511+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:56:41.363859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10242,"num_write":14,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"263'18","reported_seq":97,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:10.690878+0000","last_change":"2024-09-22T08:57:10.690878+0000","last_active":"2024-09-22T08:57:10.690878+0000","last_peered":"2024-09-22T08:57:10.690878+0000","last_clean":"2024-09-22T08:57:10.690878+0000","last_became_active":"2024-09-22T08:29:26.067964+0000","last_became_peered":"2024-09-22T08:29:26.067964+0000","last_unstale":"2024-09-22T08:57:10.690878+0000","last_undegraded":"2024-09-22T08:57:10.690878+0000","last_fullsized":"2024-09-22T08:57:10.690878+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'18","last_scrub_stamp":"2024-09-22T08:57:10.690741+0000","last_deep_scrub":"263'18","last_deep_scrub_stamp":"2024-09-22T08:57:10.690741+0000","last_clean_scrub_stamp":"2024-09-22T08:57:10.690741+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:50:36.471847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":85,"num_write":46,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:28.611322+0000","last_change":"2024-09-22T08:57:28.611322+0000","last_active":"2024-09-22T08:57:28.611322+0000","last_peered":"2024-09-22T08:57:28.611322+0000","last_clean":"2024-09-22T08:57:28.611322+0000","last_became_active":"2024-09-22T08:42:17.438318+0000","last_became_peered":"2024-09-22T08:42:17.438318+0000","last_unstale":"2024-09-22T08:57:28.611322+0000","last_undegraded":"2024-09-22T08:57:28.611322+0000","last_fullsized":"2024-09-22T08:57:28.611322+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:28.611225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:28.611225+0000","last_clean_scrub_stamp":"2024-09-22T08:57:28.611225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:55.511105+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:58.162876+0000","last_change":"2024-09-22T08:56:58.162876+0000","last_active":"2024-09-22T08:56:58.162876+0000","last_peered":"2024-09-22T08:56:58.162876+0000","last_clean":"2024-09-22T08:56:58.162876+0000","last_became_active":"2024-09-22T08:31:14.258136+0000","last_became_peered":"2024-09-22T08:31:14.258136+0000","last_unstale":"2024-09-22T08:56:58.162876+0000","last_undegraded":"2024-09-22T08:56:58.162876+0000","last_fullsized":"2024-09-22T08:56:58.162876+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:58.162779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:58.162779+0000","last_clean_scrub_stamp":"2024-09-22T08:56:58.162779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:19:33.194641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"263'2","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:52.738896+0000","last_change":"2024-09-22T08:56:52.738896+0000","last_active":"2024-09-22T08:56:52.738896+0000","last_peered":"2024-09-22T08:56:52.738896+0000","last_clean":"2024-09-22T08:56:52.738896+0000","last_became_active":"2024-09-22T08:31:11.214112+0000","last_became_peered":"2024-09-22T08:31:11.214112+0000","last_unstale":"2024-09-22T08:56:52.738896+0000","last_undegraded":"2024-09-22T08:56:52.738896+0000","last_fullsized":"2024-09-22T08:56:52.738896+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:56:52.738794+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:56:52.738794+0000","last_clean_scrub_stamp":"2024-09-22T08:56:52.738794+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:28:40.076592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"263'20","reported_seq":107,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:50.257834+0000","last_change":"2024-09-22T08:56:50.257740+0000","last_active":"2024-09-22T08:56:50.257834+0000","last_peered":"2024-09-22T08:56:50.257834+0000","last_clean":"2024-09-22T08:56:50.257834+0000","last_became_active":"2024-09-22T08:29:26.069407+0000","last_became_peered":"2024-09-22T08:29:26.069407+0000","last_unstale":"2024-09-22T08:56:50.257834+0000","last_undegraded":"2024-09-22T08:56:50.257834+0000","last_fullsized":"2024-09-22T08:56:50.257834+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'20","last_scrub_stamp":"2024-09-22T08:56:50.257643+0000","last_deep_scrub":"263'20","last_deep_scrub_stamp":"2024-09-22T08:56:50.257643+0000","last_clean_scrub_stamp":"2024-09-22T08:56:50.257643+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:48:55.481743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":95,"num_write":53,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"263'230","reported_seq":876,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:29.491497+0000","last_change":"2024-09-22T08:56:29.491448+0000","last_active":"2024-09-22T08:56:29.491497+0000","last_peered":"2024-09-22T08:56:29.491497+0000","last_clean":"2024-09-22T08:56:29.491497+0000","last_became_active":"2024-09-22T08:15:04.957090+0000","last_became_peered":"2024-09-22T08:15:04.957090+0000","last_unstale":"2024-09-22T08:56:29.491497+0000","last_undegraded":"2024-09-22T08:56:29.491497+0000","last_fullsized":"2024-09-22T08:56:29.491497+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'230","last_scrub_stamp":"2024-09-22T08:56:29.491342+0000","last_deep_scrub":"263'230","last_deep_scrub_stamp":"2024-09-22T08:56:29.491342+0000","last_clean_scrub_stamp":"2024-09-22T08:56:29.491342+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:44:19.142689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":587,"num_read_kb":1123,"num_write":1117,"num_write_kb":27318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"263'478","reported_seq":2210,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:34.800329+0000","last_change":"2024-09-22T08:56:34.800274+0000","last_active":"2024-09-22T08:56:34.800329+0000","last_peered":"2024-09-22T08:56:34.800329+0000","last_clean":"2024-09-22T08:56:34.800329+0000","last_became_active":"2024-09-22T08:15:06.980616+0000","last_became_peered":"2024-09-22T08:15:06.980616+0000","last_unstale":"2024-09-22T08:56:34.800329+0000","last_undegraded":"2024-09-22T08:56:34.800329+0000","last_fullsized":"2024-09-22T08:56:34.800329+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'478","last_scrub_stamp":"2024-09-22T08:56:34.800168+0000","last_deep_scrub":"263'478","last_deep_scrub_stamp":"2024-09-22T08:56:34.800168+0000","last_clean_scrub_stamp":"2024-09-22T08:56:34.800168+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:41:01.961869+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2847,"num_read_kb":2707,"num_write":560,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"263'240","reported_seq":885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:35.366976+0000","last_change":"2024-09-22T08:56:35.366911+0000","last_active":"2024-09-22T08:56:35.366976+0000","last_peered":"2024-09-22T08:56:35.366976+0000","last_clean":"2024-09-22T08:56:35.366976+0000","last_became_active":"2024-09-22T08:15:04.956643+0000","last_became_peered":"2024-09-22T08:15:04.956643+0000","last_unstale":"2024-09-22T08:56:35.366976+0000","last_undegraded":"2024-09-22T08:56:35.366976+0000","last_fullsized":"2024-09-22T08:56:35.366976+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'240","last_scrub_stamp":"2024-09-22T08:56:35.366815+0000","last_deep_scrub":"263'240","last_deep_scrub_stamp":"2024-09-22T08:56:35.366815+0000","last_clean_scrub_stamp":"2024-09-22T08:56:35.366815+0000","objects_scrubbed":1,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:47:44.936217+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":599,"num_read_kb":19417,"num_write":1105,"num_write_kb":24732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"263'388","reported_seq":1929,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:46.870499+0000","last_change":"2024-09-22T08:56:46.870394+0000","last_active":"2024-09-22T08:56:46.870499+0000","last_peered":"2024-09-22T08:56:46.870499+0000","last_clean":"2024-09-22T08:56:46.870499+0000","last_became_active":"2024-09-22T08:15:06.974127+0000","last_became_peered":"2024-09-22T08:15:06.974127+0000","last_unstale":"2024-09-22T08:56:46.870499+0000","last_undegraded":"2024-09-22T08:56:46.870499+0000","last_fullsized":"2024-09-22T08:56:46.870499+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'388","last_scrub_stamp":"2024-09-22T08:56:46.870289+0000","last_deep_scrub":"263'388","last_deep_scrub_stamp":"2024-09-22T08:56:46.870289+0000","last_clean_scrub_stamp":"2024-09-22T08:56:46.870289+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:57:47.237420+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2097,"num_read_kb":2016,"num_write":427,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"263'258","reported_seq":934,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:34.351461+0000","last_change":"2024-09-22T08:56:34.351393+0000","last_active":"2024-09-22T08:56:34.351461+0000","last_peered":"2024-09-22T08:56:34.351461+0000","last_clean":"2024-09-22T08:56:34.351461+0000","last_became_active":"2024-09-22T08:15:04.956659+0000","last_became_peered":"2024-09-22T08:15:04.956659+0000","last_unstale":"2024-09-22T08:56:34.351461+0000","last_undegraded":"2024-09-22T08:56:34.351461+0000","last_fullsized":"2024-09-22T08:56:34.351461+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'258","last_scrub_stamp":"2024-09-22T08:56:34.351295+0000","last_deep_scrub":"263'258","last_deep_scrub_stamp":"2024-09-22T08:56:34.351295+0000","last_clean_scrub_stamp":"2024-09-22T08:56:34.351295+0000","objects_scrubbed":4,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:09:46.701747+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":699,"num_read_kb":25466,"num_write":1131,"num_write_kb":27131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"263'899","reported_seq":2503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:47.845273+0000","last_change":"2024-09-22T08:56:47.845221+0000","last_active":"2024-09-22T08:56:47.845273+0000","last_peered":"2024-09-22T08:56:47.845273+0000","last_clean":"2024-09-22T08:56:47.845273+0000","last_became_active":"2024-09-22T08:15:06.968959+0000","last_became_peered":"2024-09-22T08:15:06.968959+0000","last_unstale":"2024-09-22T08:56:47.845273+0000","last_undegraded":"2024-09-22T08:56:47.845273+0000","last_fullsized":"2024-09-22T08:56:47.845273+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'899","last_scrub_stamp":"2024-09-22T08:56:47.845138+0000","last_deep_scrub":"263'899","last_deep_scrub_stamp":"2024-09-22T08:56:47.845138+0000","last_clean_scrub_stamp":"2024-09-22T08:56:47.845138+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":800,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:01:09.164689+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4516,"num_read_kb":4043,"num_write":1241,"num_write_kb":490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2295,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"263'241","reported_seq":887,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:28.308489+0000","last_change":"2024-09-22T08:56:28.308434+0000","last_active":"2024-09-22T08:56:28.308489+0000","last_peered":"2024-09-22T08:56:28.308489+0000","last_clean":"2024-09-22T08:56:28.308489+0000","last_became_active":"2024-09-22T08:15:04.961309+0000","last_became_peered":"2024-09-22T08:15:04.961309+0000","last_unstale":"2024-09-22T08:56:28.308489+0000","last_undegraded":"2024-09-22T08:56:28.308489+0000","last_fullsized":"2024-09-22T08:56:28.308489+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'241","last_scrub_stamp":"2024-09-22T08:56:28.308329+0000","last_deep_scrub":"263'241","last_deep_scrub_stamp":"2024-09-22T08:56:28.308329+0000","last_clean_scrub_stamp":"2024-09-22T08:56:28.308329+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:50:55.099697+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079903,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":558,"num_read_kb":61455,"num_write":1043,"num_write_kb":33072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"263'535","reported_seq":2241,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:37.704377+0000","last_change":"2024-09-22T08:56:37.704325+0000","last_active":"2024-09-22T08:56:37.704377+0000","last_peered":"2024-09-22T08:56:37.704377+0000","last_clean":"2024-09-22T08:56:37.704377+0000","last_became_active":"2024-09-22T08:15:06.969540+0000","last_became_peered":"2024-09-22T08:15:06.969540+0000","last_unstale":"2024-09-22T08:56:37.704377+0000","last_undegraded":"2024-09-22T08:56:37.704377+0000","last_fullsized":"2024-09-22T08:56:37.704377+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'535","last_scrub_stamp":"2024-09-22T08:56:37.704238+0000","last_deep_scrub":"263'535","last_deep_scrub_stamp":"2024-09-22T08:56:37.704238+0000","last_clean_scrub_stamp":"2024-09-22T08:56:37.704238+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:01:40.290775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2823,"num_read_kb":2637,"num_write":641,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"263'217","reported_seq":926,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:26.489083+0000","last_change":"2024-09-22T08:56:26.489027+0000","last_active":"2024-09-22T08:56:26.489083+0000","last_peered":"2024-09-22T08:56:26.489083+0000","last_clean":"2024-09-22T08:56:26.489083+0000","last_became_active":"2024-09-22T08:15:04.957717+0000","last_became_peered":"2024-09-22T08:15:04.957717+0000","last_unstale":"2024-09-22T08:56:26.489083+0000","last_undegraded":"2024-09-22T08:56:26.489083+0000","last_fullsized":"2024-09-22T08:56:26.489083+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'217","last_scrub_stamp":"2024-09-22T08:56:26.488928+0000","last_deep_scrub":"263'217","last_deep_scrub_stamp":"2024-09-22T08:56:26.488928+0000","last_clean_scrub_stamp":"2024-09-22T08:56:26.488928+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:37:50.212068+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1573037,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":720,"num_read_kb":166418,"num_write":955,"num_write_kb":57547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"263'607","reported_seq":2138,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:36.493498+0000","last_change":"2024-09-22T08:56:36.493433+0000","last_active":"2024-09-22T08:56:36.493498+0000","last_peered":"2024-09-22T08:56:36.493498+0000","last_clean":"2024-09-22T08:56:36.493498+0000","last_became_active":"2024-09-22T08:15:06.962605+0000","last_became_peered":"2024-09-22T08:15:06.962605+0000","last_unstale":"2024-09-22T08:56:36.493498+0000","last_undegraded":"2024-09-22T08:56:36.493498+0000","last_fullsized":"2024-09-22T08:56:36.493498+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'607","last_scrub_stamp":"2024-09-22T08:56:36.493326+0000","last_deep_scrub":"263'607","last_deep_scrub_stamp":"2024-09-22T08:56:36.493326+0000","last_clean_scrub_stamp":"2024-09-22T08:56:36.493326+0000","objects_scrubbed":4,"log_size":107,"log_dups_size":500,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:23:12.495770+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3087,"num_read_kb":2910,"num_write":853,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":486,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"263'257","reported_seq":945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:27.325417+0000","last_change":"2024-09-22T08:56:27.325351+0000","last_active":"2024-09-22T08:56:27.325417+0000","last_peered":"2024-09-22T08:56:27.325417+0000","last_clean":"2024-09-22T08:56:27.325417+0000","last_became_active":"2024-09-22T08:15:04.962128+0000","last_became_peered":"2024-09-22T08:15:04.962128+0000","last_unstale":"2024-09-22T08:56:27.325417+0000","last_undegraded":"2024-09-22T08:56:27.325417+0000","last_fullsized":"2024-09-22T08:56:27.325417+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'257","last_scrub_stamp":"2024-09-22T08:56:27.325259+0000","last_deep_scrub":"263'257","last_deep_scrub_stamp":"2024-09-22T08:56:27.325259+0000","last_clean_scrub_stamp":"2024-09-22T08:56:27.325259+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:48:56.416424+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":753,"num_read_kb":52063,"num_write":1239,"num_write_kb":44926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"263'872","reported_seq":2702,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:38.475792+0000","last_change":"2024-09-22T08:56:38.475719+0000","last_active":"2024-09-22T08:56:38.475792+0000","last_peered":"2024-09-22T08:56:38.475792+0000","last_clean":"2024-09-22T08:56:38.475792+0000","last_became_active":"2024-09-22T08:15:06.972756+0000","last_became_peered":"2024-09-22T08:15:06.972756+0000","last_unstale":"2024-09-22T08:56:38.475792+0000","last_undegraded":"2024-09-22T08:56:38.475792+0000","last_fullsized":"2024-09-22T08:56:38.475792+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'872","last_scrub_stamp":"2024-09-22T08:56:38.475633+0000","last_deep_scrub":"263'872","last_deep_scrub_stamp":"2024-09-22T08:56:38.475633+0000","last_clean_scrub_stamp":"2024-09-22T08:56:38.475633+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":800,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:27:33.543291+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4443,"num_read_kb":4056,"num_write":1153,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"263'251","reported_seq":926,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:31.486645+0000","last_change":"2024-09-22T08:56:31.486584+0000","last_active":"2024-09-22T08:56:31.486645+0000","last_peered":"2024-09-22T08:56:31.486645+0000","last_clean":"2024-09-22T08:56:31.486645+0000","last_became_active":"2024-09-22T08:15:04.944916+0000","last_became_peered":"2024-09-22T08:15:04.944916+0000","last_unstale":"2024-09-22T08:56:31.486645+0000","last_undegraded":"2024-09-22T08:56:31.486645+0000","last_fullsized":"2024-09-22T08:56:31.486645+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'251","last_scrub_stamp":"2024-09-22T08:56:31.486476+0000","last_deep_scrub":"263'251","last_deep_scrub_stamp":"2024-09-22T08:56:31.486476+0000","last_clean_scrub_stamp":"2024-09-22T08:56:31.486476+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:49:01.795181+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":805,"num_read_kb":10946,"num_write":1075,"num_write_kb":28039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"263'557","reported_seq":2090,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:37.452503+0000","last_change":"2024-09-22T08:56:37.452437+0000","last_active":"2024-09-22T08:56:37.452503+0000","last_peered":"2024-09-22T08:56:37.452503+0000","last_clean":"2024-09-22T08:56:37.452503+0000","last_became_active":"2024-09-22T08:15:06.968853+0000","last_became_peered":"2024-09-22T08:15:06.968853+0000","last_unstale":"2024-09-22T08:56:37.452503+0000","last_undegraded":"2024-09-22T08:56:37.452503+0000","last_fullsized":"2024-09-22T08:56:37.452503+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'557","last_scrub_stamp":"2024-09-22T08:56:37.452353+0000","last_deep_scrub":"263'557","last_deep_scrub_stamp":"2024-09-22T08:56:37.452353+0000","last_clean_scrub_stamp":"2024-09-22T08:56:37.452353+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:58:45.111881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2932,"num_read_kb":2656,"num_write":742,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":743,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"263'185","reported_seq":763,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:33.339711+0000","last_change":"2024-09-22T08:56:33.339657+0000","last_active":"2024-09-22T08:56:33.339711+0000","last_peered":"2024-09-22T08:56:33.339711+0000","last_clean":"2024-09-22T08:56:33.339711+0000","last_became_active":"2024-09-22T08:15:04.959395+0000","last_became_peered":"2024-09-22T08:15:04.959395+0000","last_unstale":"2024-09-22T08:56:33.339711+0000","last_undegraded":"2024-09-22T08:56:33.339711+0000","last_fullsized":"2024-09-22T08:56:33.339711+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'185","last_scrub_stamp":"2024-09-22T08:56:33.339559+0000","last_deep_scrub":"263'185","last_deep_scrub_stamp":"2024-09-22T08:56:33.339559+0000","last_clean_scrub_stamp":"2024-09-22T08:56:33.339559+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:26:10.173195+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":318,"num_read_kb":28967,"num_write":772,"num_write_kb":45290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"263'1561","reported_seq":3275,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:44.417199+0000","last_change":"2024-09-22T08:56:44.417141+0000","last_active":"2024-09-22T08:56:44.417199+0000","last_peered":"2024-09-22T08:56:44.417199+0000","last_clean":"2024-09-22T08:56:44.417199+0000","last_became_active":"2024-09-22T08:15:06.972074+0000","last_became_peered":"2024-09-22T08:15:06.972074+0000","last_unstale":"2024-09-22T08:56:44.417199+0000","last_undegraded":"2024-09-22T08:56:44.417199+0000","last_fullsized":"2024-09-22T08:56:44.417199+0000","mapping_epoch":25,"log_start":"263'1500","ondisk_log_start":"263'1500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1561","last_scrub_stamp":"2024-09-22T08:56:44.417043+0000","last_deep_scrub":"263'1561","last_deep_scrub_stamp":"2024-09-22T08:56:44.417043+0000","last_clean_scrub_stamp":"2024-09-22T08:56:44.417043+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":1500,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:19:57.978889+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6961,"num_read_kb":6120,"num_write":2165,"num_write_kb":918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"263'489","reported_seq":2158,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:45.900323+0000","last_change":"2024-09-22T08:56:45.900269+0000","last_active":"2024-09-22T08:56:45.900323+0000","last_peered":"2024-09-22T08:56:45.900323+0000","last_clean":"2024-09-22T08:56:45.900323+0000","last_became_active":"2024-09-22T08:15:06.965751+0000","last_became_peered":"2024-09-22T08:15:06.965751+0000","last_unstale":"2024-09-22T08:56:45.900323+0000","last_undegraded":"2024-09-22T08:56:45.900323+0000","last_fullsized":"2024-09-22T08:56:45.900323+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'489","last_scrub_stamp":"2024-09-22T08:56:45.900152+0000","last_deep_scrub":"263'489","last_deep_scrub_stamp":"2024-09-22T08:56:45.900152+0000","last_clean_scrub_stamp":"2024-09-22T08:56:45.900152+0000","objects_scrubbed":6,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:58:42.393419+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2631,"num_read_kb":2475,"num_write":578,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":468,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"263'220","reported_seq":872,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:24.868187+0000","last_change":"2024-09-22T08:56:24.868187+0000","last_active":"2024-09-22T08:56:24.868187+0000","last_peered":"2024-09-22T08:56:24.868187+0000","last_clean":"2024-09-22T08:56:24.868187+0000","last_became_active":"2024-09-22T08:15:04.953628+0000","last_became_peered":"2024-09-22T08:15:04.953628+0000","last_unstale":"2024-09-22T08:56:24.868187+0000","last_undegraded":"2024-09-22T08:56:24.868187+0000","last_fullsized":"2024-09-22T08:56:24.868187+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'220","last_scrub_stamp":"2024-09-22T08:56:24.868066+0000","last_deep_scrub":"263'220","last_deep_scrub_stamp":"2024-09-22T08:56:24.868066+0000","last_clean_scrub_stamp":"2024-09-22T08:56:24.868066+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:38:51.226129+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":538,"num_read_kb":68591,"num_write":878,"num_write_kb":34888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"263'360","reported_seq":1747,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:35.493024+0000","last_change":"2024-09-22T08:56:35.492973+0000","last_active":"2024-09-22T08:56:35.493024+0000","last_peered":"2024-09-22T08:56:35.493024+0000","last_clean":"2024-09-22T08:56:35.493024+0000","last_became_active":"2024-09-22T08:15:06.968970+0000","last_became_peered":"2024-09-22T08:15:06.968970+0000","last_unstale":"2024-09-22T08:56:35.493024+0000","last_undegraded":"2024-09-22T08:56:35.493024+0000","last_fullsized":"2024-09-22T08:56:35.493024+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'360","last_scrub_stamp":"2024-09-22T08:56:35.492871+0000","last_deep_scrub":"263'360","last_deep_scrub_stamp":"2024-09-22T08:56:35.492871+0000","last_clean_scrub_stamp":"2024-09-22T08:56:35.492871+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:05:00.671139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2053,"num_read_kb":1926,"num_write":427,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1365,"num_omap_keys":6,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"263'233","reported_seq":872,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:28.462228+0000","last_change":"2024-09-22T08:56:28.462228+0000","last_active":"2024-09-22T08:56:28.462228+0000","last_peered":"2024-09-22T08:56:28.462228+0000","last_clean":"2024-09-22T08:56:28.462228+0000","last_became_active":"2024-09-22T08:15:04.966769+0000","last_became_peered":"2024-09-22T08:15:04.966769+0000","last_unstale":"2024-09-22T08:56:28.462228+0000","last_undegraded":"2024-09-22T08:56:28.462228+0000","last_fullsized":"2024-09-22T08:56:28.462228+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'233","last_scrub_stamp":"2024-09-22T08:56:28.462117+0000","last_deep_scrub":"263'233","last_deep_scrub_stamp":"2024-09-22T08:56:28.462117+0000","last_clean_scrub_stamp":"2024-09-22T08:56:28.462117+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:40:13.623374+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":51014,"num_write":1104,"num_write_kb":43963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"263'469","reported_seq":1934,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:30.740306+0000","last_change":"2024-09-22T08:56:30.740245+0000","last_active":"2024-09-22T08:56:30.740306+0000","last_peered":"2024-09-22T08:56:30.740306+0000","last_clean":"2024-09-22T08:56:30.740306+0000","last_became_active":"2024-09-22T08:15:06.972821+0000","last_became_peered":"2024-09-22T08:15:06.972821+0000","last_unstale":"2024-09-22T08:56:30.740306+0000","last_undegraded":"2024-09-22T08:56:30.740306+0000","last_fullsized":"2024-09-22T08:56:30.740306+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'469","last_scrub_stamp":"2024-09-22T08:56:30.740153+0000","last_deep_scrub":"263'469","last_deep_scrub_stamp":"2024-09-22T08:56:30.740153+0000","last_clean_scrub_stamp":"2024-09-22T08:56:30.740153+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:47:33.203417+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2415,"num_read_kb":2238,"num_write":577,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"263'223","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:30.477162+0000","last_change":"2024-09-22T08:56:30.477162+0000","last_active":"2024-09-22T08:56:30.477162+0000","last_peered":"2024-09-22T08:56:30.477162+0000","last_clean":"2024-09-22T08:56:30.477162+0000","last_became_active":"2024-09-22T08:15:04.955972+0000","last_became_peered":"2024-09-22T08:15:04.955972+0000","last_unstale":"2024-09-22T08:56:30.477162+0000","last_undegraded":"2024-09-22T08:56:30.477162+0000","last_fullsized":"2024-09-22T08:56:30.477162+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'223","last_scrub_stamp":"2024-09-22T08:56:30.477065+0000","last_deep_scrub":"263'223","last_deep_scrub_stamp":"2024-09-22T08:56:30.477065+0000","last_clean_scrub_stamp":"2024-09-22T08:56:30.477065+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:48:00.158279+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":994,"num_read_kb":8164,"num_write":935,"num_write_kb":17459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"263'465","reported_seq":2089,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:37.484954+0000","last_change":"2024-09-22T08:56:37.484954+0000","last_active":"2024-09-22T08:56:37.484954+0000","last_peered":"2024-09-22T08:56:37.484954+0000","last_clean":"2024-09-22T08:56:37.484954+0000","last_became_active":"2024-09-22T08:15:06.972250+0000","last_became_peered":"2024-09-22T08:15:06.972250+0000","last_unstale":"2024-09-22T08:56:37.484954+0000","last_undegraded":"2024-09-22T08:56:37.484954+0000","last_fullsized":"2024-09-22T08:56:37.484954+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'465","last_scrub_stamp":"2024-09-22T08:56:37.484862+0000","last_deep_scrub":"263'465","last_deep_scrub_stamp":"2024-09-22T08:56:37.484862+0000","last_clean_scrub_stamp":"2024-09-22T08:56:37.484862+0000","objects_scrubbed":2,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:01:02.906297+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2654,"num_read_kb":2505,"num_write":533,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"263'252","reported_seq":902,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:25.507295+0000","last_change":"2024-09-22T08:56:25.507295+0000","last_active":"2024-09-22T08:56:25.507295+0000","last_peered":"2024-09-22T08:56:25.507295+0000","last_clean":"2024-09-22T08:56:25.507295+0000","last_became_active":"2024-09-22T08:15:04.954948+0000","last_became_peered":"2024-09-22T08:15:04.954948+0000","last_unstale":"2024-09-22T08:56:25.507295+0000","last_undegraded":"2024-09-22T08:56:25.507295+0000","last_fullsized":"2024-09-22T08:56:25.507295+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'252","last_scrub_stamp":"2024-09-22T08:56:25.507185+0000","last_deep_scrub":"263'252","last_deep_scrub_stamp":"2024-09-22T08:56:25.507185+0000","last_clean_scrub_stamp":"2024-09-22T08:56:25.507185+0000","objects_scrubbed":5,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:16.520968+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":551,"num_read_kb":6536,"num_write":1088,"num_write_kb":24915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"263'386","reported_seq":1854,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:43.447560+0000","last_change":"2024-09-22T08:56:43.447560+0000","last_active":"2024-09-22T08:56:43.447560+0000","last_peered":"2024-09-22T08:56:43.447560+0000","last_clean":"2024-09-22T08:56:43.447560+0000","last_became_active":"2024-09-22T08:15:06.968651+0000","last_became_peered":"2024-09-22T08:15:06.968651+0000","last_unstale":"2024-09-22T08:56:43.447560+0000","last_undegraded":"2024-09-22T08:56:43.447560+0000","last_fullsized":"2024-09-22T08:56:43.447560+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'386","last_scrub_stamp":"2024-09-22T08:56:43.447462+0000","last_deep_scrub":"263'386","last_deep_scrub_stamp":"2024-09-22T08:56:43.447462+0000","last_clean_scrub_stamp":"2024-09-22T08:56:43.447462+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:31:19.300619+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2079,"num_read_kb":1977,"num_write":435,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"263'239","reported_seq":862,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:30.460156+0000","last_change":"2024-09-22T08:56:30.460156+0000","last_active":"2024-09-22T08:56:30.460156+0000","last_peered":"2024-09-22T08:56:30.460156+0000","last_clean":"2024-09-22T08:56:30.460156+0000","last_became_active":"2024-09-22T08:15:04.958578+0000","last_became_peered":"2024-09-22T08:15:04.958578+0000","last_unstale":"2024-09-22T08:56:30.460156+0000","last_undegraded":"2024-09-22T08:56:30.460156+0000","last_fullsized":"2024-09-22T08:56:30.460156+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'239","last_scrub_stamp":"2024-09-22T08:56:30.460046+0000","last_deep_scrub":"263'239","last_deep_scrub_stamp":"2024-09-22T08:56:30.460046+0000","last_clean_scrub_stamp":"2024-09-22T08:56:30.460046+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:15:01.904411+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":554,"num_read_kb":7725,"num_write":1073,"num_write_kb":35221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"263'576","reported_seq":2266,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:31.779569+0000","last_change":"2024-09-22T08:56:31.779569+0000","last_active":"2024-09-22T08:56:31.779569+0000","last_peered":"2024-09-22T08:56:31.779569+0000","last_clean":"2024-09-22T08:56:31.779569+0000","last_became_active":"2024-09-22T08:15:06.980621+0000","last_became_peered":"2024-09-22T08:15:06.980621+0000","last_unstale":"2024-09-22T08:56:31.779569+0000","last_undegraded":"2024-09-22T08:56:31.779569+0000","last_fullsized":"2024-09-22T08:56:31.779569+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'576","last_scrub_stamp":"2024-09-22T08:56:31.779429+0000","last_deep_scrub":"263'576","last_deep_scrub_stamp":"2024-09-22T08:56:31.779429+0000","last_clean_scrub_stamp":"2024-09-22T08:56:31.779429+0000","objects_scrubbed":3,"log_size":76,"log_dups_size":500,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:22.389041+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3075,"num_read_kb":2832,"num_write":740,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"263'195","reported_seq":1004,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:28.526828+0000","last_change":"2024-09-22T08:56:28.526760+0000","last_active":"2024-09-22T08:56:28.526828+0000","last_peered":"2024-09-22T08:56:28.526828+0000","last_clean":"2024-09-22T08:56:28.526828+0000","last_became_active":"2024-09-22T08:15:04.952203+0000","last_became_peered":"2024-09-22T08:15:04.952203+0000","last_unstale":"2024-09-22T08:56:28.526828+0000","last_undegraded":"2024-09-22T08:56:28.526828+0000","last_fullsized":"2024-09-22T08:56:28.526828+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'195","last_scrub_stamp":"2024-09-22T08:56:28.526665+0000","last_deep_scrub":"263'195","last_deep_scrub_stamp":"2024-09-22T08:56:28.526665+0000","last_clean_scrub_stamp":"2024-09-22T08:56:28.526665+0000","objects_scrubbed":2,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:04:59.175129+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1058,"num_read_kb":8867,"num_write":911,"num_write_kb":21916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"263'140","reported_seq":647,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:48.379821+0000","last_change":"2024-09-22T08:56:48.379821+0000","last_active":"2024-09-22T08:56:48.379821+0000","last_peered":"2024-09-22T08:56:48.379821+0000","last_clean":"2024-09-22T08:56:48.379821+0000","last_became_active":"2024-09-22T08:15:15.011529+0000","last_became_peered":"2024-09-22T08:15:15.011529+0000","last_unstale":"2024-09-22T08:56:48.379821+0000","last_undegraded":"2024-09-22T08:56:48.379821+0000","last_fullsized":"2024-09-22T08:56:48.379821+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'140","last_scrub_stamp":"2024-09-22T08:56:48.379718+0000","last_deep_scrub":"263'140","last_deep_scrub_stamp":"2024-09-22T08:56:48.379718+0000","last_clean_scrub_stamp":"2024-09-22T08:56:48.379718+0000","objects_scrubbed":1,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:29:35.640358+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":192,"num_read_kb":186,"num_write":338,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"263'505","reported_seq":2116,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:36.525732+0000","last_change":"2024-09-22T08:56:36.525663+0000","last_active":"2024-09-22T08:56:36.525732+0000","last_peered":"2024-09-22T08:56:36.525732+0000","last_clean":"2024-09-22T08:56:36.525732+0000","last_became_active":"2024-09-22T08:15:06.967794+0000","last_became_peered":"2024-09-22T08:15:06.967794+0000","last_unstale":"2024-09-22T08:56:36.525732+0000","last_undegraded":"2024-09-22T08:56:36.525732+0000","last_fullsized":"2024-09-22T08:56:36.525732+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'505","last_scrub_stamp":"2024-09-22T08:56:36.525567+0000","last_deep_scrub":"263'505","last_deep_scrub_stamp":"2024-09-22T08:56:36.525567+0000","last_clean_scrub_stamp":"2024-09-22T08:56:36.525567+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:20:04.782519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2789,"num_read_kb":2608,"num_write":647,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"263'226","reported_seq":880,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:31.855600+0000","last_change":"2024-09-22T08:56:31.855517+0000","last_active":"2024-09-22T08:56:31.855600+0000","last_peered":"2024-09-22T08:56:31.855600+0000","last_clean":"2024-09-22T08:56:31.855600+0000","last_became_active":"2024-09-22T08:15:04.963890+0000","last_became_peered":"2024-09-22T08:15:04.963890+0000","last_unstale":"2024-09-22T08:56:31.855600+0000","last_undegraded":"2024-09-22T08:56:31.855600+0000","last_fullsized":"2024-09-22T08:56:31.855600+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'226","last_scrub_stamp":"2024-09-22T08:56:31.855382+0000","last_deep_scrub":"263'226","last_deep_scrub_stamp":"2024-09-22T08:56:31.855382+0000","last_clean_scrub_stamp":"2024-09-22T08:56:31.855382+0000","objects_scrubbed":7,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:32:30.739490+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079944,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":535,"num_read_kb":15199,"num_write":1088,"num_write_kb":18954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:52.870153+0000","last_change":"2024-09-22T08:56:52.870153+0000","last_active":"2024-09-22T08:56:52.870153+0000","last_peered":"2024-09-22T08:56:52.870153+0000","last_clean":"2024-09-22T08:56:52.870153+0000","last_became_active":"2024-09-22T08:15:08.968482+0000","last_became_peered":"2024-09-22T08:15:08.968482+0000","last_unstale":"2024-09-22T08:56:52.870153+0000","last_undegraded":"2024-09-22T08:56:52.870153+0000","last_fullsized":"2024-09-22T08:56:52.870153+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:52.870067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:52.870067+0000","last_clean_scrub_stamp":"2024-09-22T08:56:52.870067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:59:27.029495+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"263'197","reported_seq":804,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:51.821033+0000","last_change":"2024-09-22T08:56:51.821033+0000","last_active":"2024-09-22T08:56:51.821033+0000","last_peered":"2024-09-22T08:56:51.821033+0000","last_clean":"2024-09-22T08:56:51.821033+0000","last_became_active":"2024-09-22T08:15:10.987539+0000","last_became_peered":"2024-09-22T08:15:10.987539+0000","last_unstale":"2024-09-22T08:56:51.821033+0000","last_undegraded":"2024-09-22T08:56:51.821033+0000","last_fullsized":"2024-09-22T08:56:51.821033+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'197","last_scrub_stamp":"2024-09-22T08:56:51.820915+0000","last_deep_scrub":"263'197","last_deep_scrub_stamp":"2024-09-22T08:56:51.820915+0000","last_clean_scrub_stamp":"2024-09-22T08:56:51.820915+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:48:30.546821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7203,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":254,"num_read_kb":315,"num_write":148,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:46.734966+0000","last_change":"2024-09-22T08:56:46.734966+0000","last_active":"2024-09-22T08:56:46.734966+0000","last_peered":"2024-09-22T08:56:46.734966+0000","last_clean":"2024-09-22T08:56:46.734966+0000","last_became_active":"2024-09-22T08:15:13.018750+0000","last_became_peered":"2024-09-22T08:15:13.018750+0000","last_unstale":"2024-09-22T08:56:46.734966+0000","last_undegraded":"2024-09-22T08:56:46.734966+0000","last_fullsized":"2024-09-22T08:56:46.734966+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:46.734883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:46.734883+0000","last_clean_scrub_stamp":"2024-09-22T08:56:46.734883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:03:09.348530+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"263'153","reported_seq":652,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:54.819283+0000","last_change":"2024-09-22T08:56:54.819283+0000","last_active":"2024-09-22T08:56:54.819283+0000","last_peered":"2024-09-22T08:56:54.819283+0000","last_clean":"2024-09-22T08:56:54.819283+0000","last_became_active":"2024-09-22T08:15:15.020542+0000","last_became_peered":"2024-09-22T08:15:15.020542+0000","last_unstale":"2024-09-22T08:56:54.819283+0000","last_undegraded":"2024-09-22T08:56:54.819283+0000","last_fullsized":"2024-09-22T08:56:54.819283+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'153","last_scrub_stamp":"2024-09-22T08:56:54.819185+0000","last_deep_scrub":"263'153","last_deep_scrub_stamp":"2024-09-22T08:56:54.819185+0000","last_clean_scrub_stamp":"2024-09-22T08:56:54.819185+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:13:03.005110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":183,"num_read_kb":175,"num_write":358,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"263'757","reported_seq":2368,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:42.879382+0000","last_change":"2024-09-22T08:56:42.879382+0000","last_active":"2024-09-22T08:56:42.879382+0000","last_peered":"2024-09-22T08:56:42.879382+0000","last_clean":"2024-09-22T08:56:42.879382+0000","last_became_active":"2024-09-22T08:15:06.980479+0000","last_became_peered":"2024-09-22T08:15:06.980479+0000","last_unstale":"2024-09-22T08:56:42.879382+0000","last_undegraded":"2024-09-22T08:56:42.879382+0000","last_fullsized":"2024-09-22T08:56:42.879382+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'757","last_scrub_stamp":"2024-09-22T08:56:42.879289+0000","last_deep_scrub":"263'757","last_deep_scrub_stamp":"2024-09-22T08:56:42.879289+0000","last_clean_scrub_stamp":"2024-09-22T08:56:42.879289+0000","objects_scrubbed":6,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:12:59.739632+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3625,"num_read_kb":3307,"num_write":963,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"263'258","reported_seq":935,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:25.458175+0000","last_change":"2024-09-22T08:56:25.458117+0000","last_active":"2024-09-22T08:56:25.458175+0000","last_peered":"2024-09-22T08:56:25.458175+0000","last_clean":"2024-09-22T08:56:25.458175+0000","last_became_active":"2024-09-22T08:15:04.951265+0000","last_became_peered":"2024-09-22T08:15:04.951265+0000","last_unstale":"2024-09-22T08:56:25.458175+0000","last_undegraded":"2024-09-22T08:56:25.458175+0000","last_fullsized":"2024-09-22T08:56:25.458175+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'258","last_scrub_stamp":"2024-09-22T08:56:25.457993+0000","last_deep_scrub":"263'258","last_deep_scrub_stamp":"2024-09-22T08:56:25.457993+0000","last_clean_scrub_stamp":"2024-09-22T08:56:25.457993+0000","objects_scrubbed":4,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:21:32.094740+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":764,"num_read_kb":7954,"num_write":1369,"num_write_kb":16798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:44.783723+0000","last_change":"2024-09-22T08:56:44.783668+0000","last_active":"2024-09-22T08:56:44.783723+0000","last_peered":"2024-09-22T08:56:44.783723+0000","last_clean":"2024-09-22T08:56:44.783723+0000","last_became_active":"2024-09-22T08:15:08.978832+0000","last_became_peered":"2024-09-22T08:15:08.978832+0000","last_unstale":"2024-09-22T08:56:44.783723+0000","last_undegraded":"2024-09-22T08:56:44.783723+0000","last_fullsized":"2024-09-22T08:56:44.783723+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:44.783581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:44.783581+0000","last_clean_scrub_stamp":"2024-09-22T08:56:44.783581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:13:58.465427+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"263'80","reported_seq":609,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:41.793143+0000","last_change":"2024-09-22T08:56:41.793143+0000","last_active":"2024-09-22T08:56:41.793143+0000","last_peered":"2024-09-22T08:56:41.793143+0000","last_clean":"2024-09-22T08:56:41.793143+0000","last_became_active":"2024-09-22T08:15:10.984027+0000","last_became_peered":"2024-09-22T08:15:10.984027+0000","last_unstale":"2024-09-22T08:56:41.793143+0000","last_undegraded":"2024-09-22T08:56:41.793143+0000","last_fullsized":"2024-09-22T08:56:41.793143+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'80","last_scrub_stamp":"2024-09-22T08:56:41.793036+0000","last_deep_scrub":"263'80","last_deep_scrub_stamp":"2024-09-22T08:56:41.793036+0000","last_clean_scrub_stamp":"2024-09-22T08:56:41.793036+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:29:56.743917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":87,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:47.698556+0000","last_change":"2024-09-22T08:56:47.698556+0000","last_active":"2024-09-22T08:56:47.698556+0000","last_peered":"2024-09-22T08:56:47.698556+0000","last_clean":"2024-09-22T08:56:47.698556+0000","last_became_active":"2024-09-22T08:15:13.013609+0000","last_became_peered":"2024-09-22T08:15:13.013609+0000","last_unstale":"2024-09-22T08:56:47.698556+0000","last_undegraded":"2024-09-22T08:56:47.698556+0000","last_fullsized":"2024-09-22T08:56:47.698556+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:47.698456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:47.698456+0000","last_clean_scrub_stamp":"2024-09-22T08:56:47.698456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:02:08.771934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"263'159","reported_seq":676,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:51.577389+0000","last_change":"2024-09-22T08:56:51.577389+0000","last_active":"2024-09-22T08:56:51.577389+0000","last_peered":"2024-09-22T08:56:51.577389+0000","last_clean":"2024-09-22T08:56:51.577389+0000","last_became_active":"2024-09-22T08:15:15.018984+0000","last_became_peered":"2024-09-22T08:15:15.018984+0000","last_unstale":"2024-09-22T08:56:51.577389+0000","last_undegraded":"2024-09-22T08:56:51.577389+0000","last_fullsized":"2024-09-22T08:56:51.577389+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'159","last_scrub_stamp":"2024-09-22T08:56:51.577281+0000","last_deep_scrub":"263'159","last_deep_scrub_stamp":"2024-09-22T08:56:51.577281+0000","last_clean_scrub_stamp":"2024-09-22T08:56:51.577281+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:27:42.431060+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":263,"num_read_kb":245,"num_write":379,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"263'1937","reported_seq":3656,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:38.397089+0000","last_change":"2024-09-22T08:56:38.397089+0000","last_active":"2024-09-22T08:56:38.397089+0000","last_peered":"2024-09-22T08:56:38.397089+0000","last_clean":"2024-09-22T08:56:38.397089+0000","last_became_active":"2024-09-22T08:15:06.967645+0000","last_became_peered":"2024-09-22T08:15:06.967645+0000","last_unstale":"2024-09-22T08:56:38.397089+0000","last_undegraded":"2024-09-22T08:56:38.397089+0000","last_fullsized":"2024-09-22T08:56:38.397089+0000","mapping_epoch":25,"log_start":"263'1900","ondisk_log_start":"263'1900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1937","last_scrub_stamp":"2024-09-22T08:56:38.396997+0000","last_deep_scrub":"263'1937","last_deep_scrub_stamp":"2024-09-22T08:56:38.396997+0000","last_clean_scrub_stamp":"2024-09-22T08:56:38.396997+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":1900,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:08:12.555868+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8532,"num_read_kb":7421,"num_write":2741,"num_write_kb":1214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"263'208","reported_seq":862,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:30.899665+0000","last_change":"2024-09-22T08:56:30.899610+0000","last_active":"2024-09-22T08:56:30.899665+0000","last_peered":"2024-09-22T08:56:30.899665+0000","last_clean":"2024-09-22T08:56:30.899665+0000","last_became_active":"2024-09-22T08:15:04.964798+0000","last_became_peered":"2024-09-22T08:15:04.964798+0000","last_unstale":"2024-09-22T08:56:30.899665+0000","last_undegraded":"2024-09-22T08:56:30.899665+0000","last_fullsized":"2024-09-22T08:56:30.899665+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'208","last_scrub_stamp":"2024-09-22T08:56:30.899515+0000","last_deep_scrub":"263'208","last_deep_scrub_stamp":"2024-09-22T08:56:30.899515+0000","last_clean_scrub_stamp":"2024-09-22T08:56:30.899515+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:30:20.275669+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":449,"num_read_kb":111223,"num_write":842,"num_write_kb":54102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:43.763781+0000","last_change":"2024-09-22T08:56:43.763781+0000","last_active":"2024-09-22T08:56:43.763781+0000","last_peered":"2024-09-22T08:56:43.763781+0000","last_clean":"2024-09-22T08:56:43.763781+0000","last_became_active":"2024-09-22T08:15:08.976950+0000","last_became_peered":"2024-09-22T08:15:08.976950+0000","last_unstale":"2024-09-22T08:56:43.763781+0000","last_undegraded":"2024-09-22T08:56:43.763781+0000","last_fullsized":"2024-09-22T08:56:43.763781+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:43.763686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:43.763686+0000","last_clean_scrub_stamp":"2024-09-22T08:56:43.763686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:17:48.248629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"263'112","reported_seq":652,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:50.835628+0000","last_change":"2024-09-22T08:56:50.835562+0000","last_active":"2024-09-22T08:56:50.835628+0000","last_peered":"2024-09-22T08:56:50.835628+0000","last_clean":"2024-09-22T08:56:50.835628+0000","last_became_active":"2024-09-22T08:15:10.980879+0000","last_became_peered":"2024-09-22T08:15:10.980879+0000","last_unstale":"2024-09-22T08:56:50.835628+0000","last_undegraded":"2024-09-22T08:56:50.835628+0000","last_fullsized":"2024-09-22T08:56:50.835628+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'112","last_scrub_stamp":"2024-09-22T08:56:50.835450+0000","last_deep_scrub":"263'112","last_deep_scrub_stamp":"2024-09-22T08:56:50.835450+0000","last_clean_scrub_stamp":"2024-09-22T08:56:50.835450+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:29:55.805287+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":117,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"263'783","reported_seq":2388,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:05.777234+0000","last_change":"2024-09-22T08:57:05.777234+0000","last_active":"2024-09-22T08:57:05.777234+0000","last_peered":"2024-09-22T08:57:05.777234+0000","last_clean":"2024-09-22T08:57:05.777234+0000","last_became_active":"2024-09-22T08:15:13.011812+0000","last_became_peered":"2024-09-22T08:15:13.011812+0000","last_unstale":"2024-09-22T08:57:05.777234+0000","last_undegraded":"2024-09-22T08:57:05.777234+0000","last_fullsized":"2024-09-22T08:57:05.777234+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'783","last_scrub_stamp":"2024-09-22T08:57:05.777172+0000","last_deep_scrub":"263'783","last_deep_scrub_stamp":"2024-09-22T08:57:05.777172+0000","last_clean_scrub_stamp":"2024-09-22T08:57:05.777172+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:04:10.273483+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"263'181","reported_seq":1010,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:49.286697+0000","last_change":"2024-09-22T08:56:49.286697+0000","last_active":"2024-09-22T08:56:49.286697+0000","last_peered":"2024-09-22T08:56:49.286697+0000","last_clean":"2024-09-22T08:56:49.286697+0000","last_became_active":"2024-09-22T08:15:15.015684+0000","last_became_peered":"2024-09-22T08:15:15.015684+0000","last_unstale":"2024-09-22T08:56:49.286697+0000","last_undegraded":"2024-09-22T08:56:49.286697+0000","last_fullsized":"2024-09-22T08:56:49.286697+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'181","last_scrub_stamp":"2024-09-22T08:56:49.286599+0000","last_deep_scrub":"263'181","last_deep_scrub_stamp":"2024-09-22T08:56:49.286599+0000","last_clean_scrub_stamp":"2024-09-22T08:56:49.286599+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:14:12.947006+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":616,"num_read_kb":611,"num_write":377,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"263'1260","reported_seq":2740,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:39.437610+0000","last_change":"2024-09-22T08:56:39.437610+0000","last_active":"2024-09-22T08:56:39.437610+0000","last_peered":"2024-09-22T08:56:39.437610+0000","last_clean":"2024-09-22T08:56:39.437610+0000","last_became_active":"2024-09-22T08:15:06.967323+0000","last_became_peered":"2024-09-22T08:15:06.967323+0000","last_unstale":"2024-09-22T08:56:39.437610+0000","last_undegraded":"2024-09-22T08:56:39.437610+0000","last_fullsized":"2024-09-22T08:56:39.437610+0000","mapping_epoch":25,"log_start":"263'1200","ondisk_log_start":"263'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1260","last_scrub_stamp":"2024-09-22T08:56:39.437522+0000","last_deep_scrub":"263'1260","last_deep_scrub_stamp":"2024-09-22T08:56:39.437522+0000","last_clean_scrub_stamp":"2024-09-22T08:56:39.437522+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":1200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:18:39.527856+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7857,"num_read_kb":7154,"num_write":1964,"num_write_kb":850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"263'250","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:22.920526+0000","last_change":"2024-09-22T08:56:22.920450+0000","last_active":"2024-09-22T08:56:22.920526+0000","last_peered":"2024-09-22T08:56:22.920526+0000","last_clean":"2024-09-22T08:56:22.920526+0000","last_became_active":"2024-09-22T08:15:04.959776+0000","last_became_peered":"2024-09-22T08:15:04.959776+0000","last_unstale":"2024-09-22T08:56:22.920526+0000","last_undegraded":"2024-09-22T08:56:22.920526+0000","last_fullsized":"2024-09-22T08:56:22.920526+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'250","last_scrub_stamp":"2024-09-22T08:56:22.920344+0000","last_deep_scrub":"263'250","last_deep_scrub_stamp":"2024-09-22T08:56:22.920344+0000","last_clean_scrub_stamp":"2024-09-22T08:56:22.920344+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:50:17.909839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079920,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":722,"num_read_kb":18781,"num_write":1155,"num_write_kb":38377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:53.859174+0000","last_change":"2024-09-22T08:56:53.859174+0000","last_active":"2024-09-22T08:56:53.859174+0000","last_peered":"2024-09-22T08:56:53.859174+0000","last_clean":"2024-09-22T08:56:53.859174+0000","last_became_active":"2024-09-22T08:15:08.973025+0000","last_became_peered":"2024-09-22T08:15:08.973025+0000","last_unstale":"2024-09-22T08:56:53.859174+0000","last_undegraded":"2024-09-22T08:56:53.859174+0000","last_fullsized":"2024-09-22T08:56:53.859174+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:53.859087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:53.859087+0000","last_clean_scrub_stamp":"2024-09-22T08:56:53.859087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:19:48.952735+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"263'136","reported_seq":708,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:41.416563+0000","last_change":"2024-09-22T08:56:41.416563+0000","last_active":"2024-09-22T08:56:41.416563+0000","last_peered":"2024-09-22T08:56:41.416563+0000","last_clean":"2024-09-22T08:56:41.416563+0000","last_became_active":"2024-09-22T08:15:10.985540+0000","last_became_peered":"2024-09-22T08:15:10.985540+0000","last_unstale":"2024-09-22T08:56:41.416563+0000","last_undegraded":"2024-09-22T08:56:41.416563+0000","last_fullsized":"2024-09-22T08:56:41.416563+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'136","last_scrub_stamp":"2024-09-22T08:56:41.416466+0000","last_deep_scrub":"263'136","last_deep_scrub_stamp":"2024-09-22T08:56:41.416466+0000","last_clean_scrub_stamp":"2024-09-22T08:56:41.416466+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:53:46.875429+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10933,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":231,"num_write":80,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"263'793","reported_seq":2277,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:52.381763+0000","last_change":"2024-09-22T08:56:52.381686+0000","last_active":"2024-09-22T08:56:52.381763+0000","last_peered":"2024-09-22T08:56:52.381763+0000","last_clean":"2024-09-22T08:56:52.381763+0000","last_became_active":"2024-09-22T08:15:13.004752+0000","last_became_peered":"2024-09-22T08:15:13.004752+0000","last_unstale":"2024-09-22T08:56:52.381763+0000","last_undegraded":"2024-09-22T08:56:52.381763+0000","last_fullsized":"2024-09-22T08:56:52.381763+0000","mapping_epoch":31,"log_start":"263'701","ondisk_log_start":"263'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'793","last_scrub_stamp":"2024-09-22T08:56:52.381599+0000","last_deep_scrub":"263'793","last_deep_scrub_stamp":"2024-09-22T08:56:52.381599+0000","last_clean_scrub_stamp":"2024-09-22T08:56:52.381599+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":701,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:48:13.046558+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"263'442","reported_seq":2078,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:41.865908+0000","last_change":"2024-09-22T08:56:41.865908+0000","last_active":"2024-09-22T08:56:41.865908+0000","last_peered":"2024-09-22T08:56:41.865908+0000","last_clean":"2024-09-22T08:56:41.865908+0000","last_became_active":"2024-09-22T08:15:06.965387+0000","last_became_peered":"2024-09-22T08:15:06.965387+0000","last_unstale":"2024-09-22T08:56:41.865908+0000","last_undegraded":"2024-09-22T08:56:41.865908+0000","last_fullsized":"2024-09-22T08:56:41.865908+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'442","last_scrub_stamp":"2024-09-22T08:56:41.865802+0000","last_deep_scrub":"263'442","last_deep_scrub_stamp":"2024-09-22T08:56:41.865802+0000","last_clean_scrub_stamp":"2024-09-22T08:56:41.865802+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:53:34.683831+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2432,"num_read_kb":2308,"num_write":489,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"263'281","reported_seq":931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:22.419125+0000","last_change":"2024-09-22T08:56:22.419125+0000","last_active":"2024-09-22T08:56:22.419125+0000","last_peered":"2024-09-22T08:56:22.419125+0000","last_clean":"2024-09-22T08:56:22.419125+0000","last_became_active":"2024-09-22T08:15:04.954015+0000","last_became_peered":"2024-09-22T08:15:04.954015+0000","last_unstale":"2024-09-22T08:56:22.419125+0000","last_undegraded":"2024-09-22T08:56:22.419125+0000","last_fullsized":"2024-09-22T08:56:22.419125+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'281","last_scrub_stamp":"2024-09-22T08:56:22.418992+0000","last_deep_scrub":"263'281","last_deep_scrub_stamp":"2024-09-22T08:56:22.418992+0000","last_clean_scrub_stamp":"2024-09-22T08:56:22.418992+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:44:11.997685+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079929,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":663,"num_read_kb":30289,"num_write":1087,"num_write_kb":39703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:35.772228+0000","last_change":"2024-09-22T08:56:35.772228+0000","last_active":"2024-09-22T08:56:35.772228+0000","last_peered":"2024-09-22T08:56:35.772228+0000","last_clean":"2024-09-22T08:56:35.772228+0000","last_became_active":"2024-09-22T08:15:08.982222+0000","last_became_peered":"2024-09-22T08:15:08.982222+0000","last_unstale":"2024-09-22T08:56:35.772228+0000","last_undegraded":"2024-09-22T08:56:35.772228+0000","last_fullsized":"2024-09-22T08:56:35.772228+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:35.772141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:35.772141+0000","last_clean_scrub_stamp":"2024-09-22T08:56:35.772141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:54:14.131567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"263'221","reported_seq":835,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:42.444491+0000","last_change":"2024-09-22T08:56:42.444491+0000","last_active":"2024-09-22T08:56:42.444491+0000","last_peered":"2024-09-22T08:56:42.444491+0000","last_clean":"2024-09-22T08:56:42.444491+0000","last_became_active":"2024-09-22T08:15:10.984769+0000","last_became_peered":"2024-09-22T08:15:10.984769+0000","last_unstale":"2024-09-22T08:56:42.444491+0000","last_undegraded":"2024-09-22T08:56:42.444491+0000","last_fullsized":"2024-09-22T08:56:42.444491+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'221","last_scrub_stamp":"2024-09-22T08:56:42.444370+0000","last_deep_scrub":"263'221","last_deep_scrub_stamp":"2024-09-22T08:56:42.444370+0000","last_clean_scrub_stamp":"2024-09-22T08:56:42.444370+0000","objects_scrubbed":9,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:11:33.514866+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11910,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":286,"num_read_kb":362,"num_write":166,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:47.559785+0000","last_change":"2024-09-22T08:56:47.559785+0000","last_active":"2024-09-22T08:56:47.559785+0000","last_peered":"2024-09-22T08:56:47.559785+0000","last_clean":"2024-09-22T08:56:47.559785+0000","last_became_active":"2024-09-22T08:15:13.012498+0000","last_became_peered":"2024-09-22T08:15:13.012498+0000","last_unstale":"2024-09-22T08:56:47.559785+0000","last_undegraded":"2024-09-22T08:56:47.559785+0000","last_fullsized":"2024-09-22T08:56:47.559785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:47.559700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:47.559700+0000","last_clean_scrub_stamp":"2024-09-22T08:56:47.559700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:11:39.035630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"263'559","reported_seq":1393,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:46.302312+0000","last_change":"2024-09-22T08:56:46.302205+0000","last_active":"2024-09-22T08:56:46.302312+0000","last_peered":"2024-09-22T08:56:46.302312+0000","last_clean":"2024-09-22T08:56:46.302312+0000","last_became_active":"2024-09-22T08:15:15.014801+0000","last_became_peered":"2024-09-22T08:15:15.014801+0000","last_unstale":"2024-09-22T08:56:46.302312+0000","last_undegraded":"2024-09-22T08:56:46.302312+0000","last_fullsized":"2024-09-22T08:56:46.302312+0000","mapping_epoch":33,"log_start":"263'500","ondisk_log_start":"263'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'559","last_scrub_stamp":"2024-09-22T08:56:46.302094+0000","last_deep_scrub":"263'559","last_deep_scrub_stamp":"2024-09-22T08:56:46.302094+0000","last_clean_scrub_stamp":"2024-09-22T08:56:46.302094+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":500,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:04:02.051380+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":467,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1367,"num_read_kb":1346,"num_write":1156,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"263'862","reported_seq":2456,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:25.844066+0000","last_change":"2024-09-22T08:56:25.844066+0000","last_active":"2024-09-22T08:56:25.844066+0000","last_peered":"2024-09-22T08:56:25.844066+0000","last_clean":"2024-09-22T08:56:25.844066+0000","last_became_active":"2024-09-22T08:15:06.972958+0000","last_became_peered":"2024-09-22T08:15:06.972958+0000","last_unstale":"2024-09-22T08:56:25.844066+0000","last_undegraded":"2024-09-22T08:56:25.844066+0000","last_fullsized":"2024-09-22T08:56:25.844066+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'862","last_scrub_stamp":"2024-09-22T08:56:25.843956+0000","last_deep_scrub":"263'862","last_deep_scrub_stamp":"2024-09-22T08:56:25.843956+0000","last_clean_scrub_stamp":"2024-09-22T08:56:25.843956+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":800,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:28:27.885227+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4079,"num_read_kb":3669,"num_write":1154,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"263'237","reported_seq":903,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:23.356062+0000","last_change":"2024-09-22T08:56:23.356062+0000","last_active":"2024-09-22T08:56:23.356062+0000","last_peered":"2024-09-22T08:56:23.356062+0000","last_clean":"2024-09-22T08:56:23.356062+0000","last_became_active":"2024-09-22T08:15:40.188251+0000","last_became_peered":"2024-09-22T08:15:40.188251+0000","last_unstale":"2024-09-22T08:56:23.356062+0000","last_undegraded":"2024-09-22T08:56:23.356062+0000","last_fullsized":"2024-09-22T08:56:23.356062+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'237","last_scrub_stamp":"2024-09-22T08:56:23.355989+0000","last_deep_scrub":"263'237","last_deep_scrub_stamp":"2024-09-22T08:56:23.355989+0000","last_clean_scrub_stamp":"2024-09-22T08:56:23.355989+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:24.497389+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":546,"num_read_kb":133824,"num_write":973,"num_write_kb":45053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:39.484034+0000","last_change":"2024-09-22T08:56:39.484034+0000","last_active":"2024-09-22T08:56:39.484034+0000","last_peered":"2024-09-22T08:56:39.484034+0000","last_clean":"2024-09-22T08:56:39.484034+0000","last_became_active":"2024-09-22T08:15:08.975435+0000","last_became_peered":"2024-09-22T08:15:08.975435+0000","last_unstale":"2024-09-22T08:56:39.484034+0000","last_undegraded":"2024-09-22T08:56:39.484034+0000","last_fullsized":"2024-09-22T08:56:39.484034+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:39.483931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:39.483931+0000","last_clean_scrub_stamp":"2024-09-22T08:56:39.483931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:17:40.133221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"263'131","reported_seq":705,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:47.830381+0000","last_change":"2024-09-22T08:56:47.830381+0000","last_active":"2024-09-22T08:56:47.830381+0000","last_peered":"2024-09-22T08:56:47.830381+0000","last_clean":"2024-09-22T08:56:47.830381+0000","last_became_active":"2024-09-22T08:15:10.988458+0000","last_became_peered":"2024-09-22T08:15:10.988458+0000","last_unstale":"2024-09-22T08:56:47.830381+0000","last_undegraded":"2024-09-22T08:56:47.830381+0000","last_fullsized":"2024-09-22T08:56:47.830381+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'131","last_scrub_stamp":"2024-09-22T08:56:47.830275+0000","last_deep_scrub":"263'131","last_deep_scrub_stamp":"2024-09-22T08:56:47.830275+0000","last_clean_scrub_stamp":"2024-09-22T08:56:47.830275+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:25:35.421232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8309,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":166,"num_read_kb":226,"num_write":90,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:55.818068+0000","last_change":"2024-09-22T08:56:55.818068+0000","last_active":"2024-09-22T08:56:55.818068+0000","last_peered":"2024-09-22T08:56:55.818068+0000","last_clean":"2024-09-22T08:56:55.818068+0000","last_became_active":"2024-09-22T08:15:13.002538+0000","last_became_peered":"2024-09-22T08:15:13.002538+0000","last_unstale":"2024-09-22T08:56:55.818068+0000","last_undegraded":"2024-09-22T08:56:55.818068+0000","last_fullsized":"2024-09-22T08:56:55.818068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:55.817977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:55.817977+0000","last_clean_scrub_stamp":"2024-09-22T08:56:55.817977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:59:06.947668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"263'2484","reported_seq":4321,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:48.732835+0000","last_change":"2024-09-22T08:56:48.732758+0000","last_active":"2024-09-22T08:56:48.732835+0000","last_peered":"2024-09-22T08:56:48.732835+0000","last_clean":"2024-09-22T08:56:48.732835+0000","last_became_active":"2024-09-22T08:15:15.020438+0000","last_became_peered":"2024-09-22T08:15:15.020438+0000","last_unstale":"2024-09-22T08:56:48.732835+0000","last_undegraded":"2024-09-22T08:56:48.732835+0000","last_fullsized":"2024-09-22T08:56:48.732835+0000","mapping_epoch":33,"log_start":"263'2400","ondisk_log_start":"263'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2484","last_scrub_stamp":"2024-09-22T08:56:48.732662+0000","last_deep_scrub":"263'2484","last_deep_scrub_stamp":"2024-09-22T08:56:48.732662+0000","last_clean_scrub_stamp":"2024-09-22T08:56:48.732662+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":2400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:27:02.772680+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6235,"num_read_kb":6232,"num_write":5030,"num_write_kb":1847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"263'475","reported_seq":2005,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:29.346865+0000","last_change":"2024-09-22T08:56:29.346865+0000","last_active":"2024-09-22T08:56:29.346865+0000","last_peered":"2024-09-22T08:56:29.346865+0000","last_clean":"2024-09-22T08:56:29.346865+0000","last_became_active":"2024-09-22T08:15:06.970532+0000","last_became_peered":"2024-09-22T08:15:06.970532+0000","last_unstale":"2024-09-22T08:56:29.346865+0000","last_undegraded":"2024-09-22T08:56:29.346865+0000","last_fullsized":"2024-09-22T08:56:29.346865+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'475","last_scrub_stamp":"2024-09-22T08:56:29.346768+0000","last_deep_scrub":"263'475","last_deep_scrub_stamp":"2024-09-22T08:56:29.346768+0000","last_clean_scrub_stamp":"2024-09-22T08:56:29.346768+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:04:32.692649+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2482,"num_read_kb":2307,"num_write":574,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"263'221","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:29.913763+0000","last_change":"2024-09-22T08:56:29.913763+0000","last_active":"2024-09-22T08:56:29.913763+0000","last_peered":"2024-09-22T08:56:29.913763+0000","last_clean":"2024-09-22T08:56:29.913763+0000","last_became_active":"2024-09-22T08:15:04.963648+0000","last_became_peered":"2024-09-22T08:15:04.963648+0000","last_unstale":"2024-09-22T08:56:29.913763+0000","last_undegraded":"2024-09-22T08:56:29.913763+0000","last_fullsized":"2024-09-22T08:56:29.913763+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'221","last_scrub_stamp":"2024-09-22T08:56:29.913651+0000","last_deep_scrub":"263'221","last_deep_scrub_stamp":"2024-09-22T08:56:29.913651+0000","last_clean_scrub_stamp":"2024-09-22T08:56:29.913651+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:49:53.980326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":486,"num_read_kb":19400,"num_write":968,"num_write_kb":35249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"263'4","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:45.413606+0000","last_change":"2024-09-22T08:56:45.413606+0000","last_active":"2024-09-22T08:56:45.413606+0000","last_peered":"2024-09-22T08:56:45.413606+0000","last_clean":"2024-09-22T08:56:45.413606+0000","last_became_active":"2024-09-22T08:15:08.975260+0000","last_became_peered":"2024-09-22T08:15:08.975260+0000","last_unstale":"2024-09-22T08:56:45.413606+0000","last_undegraded":"2024-09-22T08:56:45.413606+0000","last_fullsized":"2024-09-22T08:56:45.413606+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-22T08:56:45.413512+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-22T08:56:45.413512+0000","last_clean_scrub_stamp":"2024-09-22T08:56:45.413512+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:45:14.054216+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":720,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"263'165","reported_seq":757,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:56.864640+0000","last_change":"2024-09-22T08:56:56.864640+0000","last_active":"2024-09-22T08:56:56.864640+0000","last_peered":"2024-09-22T08:56:56.864640+0000","last_clean":"2024-09-22T08:56:56.864640+0000","last_became_active":"2024-09-22T08:15:10.989211+0000","last_became_peered":"2024-09-22T08:15:10.989211+0000","last_unstale":"2024-09-22T08:56:56.864640+0000","last_undegraded":"2024-09-22T08:56:56.864640+0000","last_fullsized":"2024-09-22T08:56:56.864640+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'165","last_scrub_stamp":"2024-09-22T08:56:56.864530+0000","last_deep_scrub":"263'165","last_deep_scrub_stamp":"2024-09-22T08:56:56.864530+0000","last_clean_scrub_stamp":"2024-09-22T08:56:56.864530+0000","objects_scrubbed":7,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:57:58.807869+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9099,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":211,"num_read_kb":297,"num_write":118,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"263'793","reported_seq":2283,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:55.438783+0000","last_change":"2024-09-22T08:56:55.438783+0000","last_active":"2024-09-22T08:56:55.438783+0000","last_peered":"2024-09-22T08:56:55.438783+0000","last_clean":"2024-09-22T08:56:55.438783+0000","last_became_active":"2024-09-22T08:15:13.002828+0000","last_became_peered":"2024-09-22T08:15:13.002828+0000","last_unstale":"2024-09-22T08:56:55.438783+0000","last_undegraded":"2024-09-22T08:56:55.438783+0000","last_fullsized":"2024-09-22T08:56:55.438783+0000","mapping_epoch":31,"log_start":"263'701","ondisk_log_start":"263'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'793","last_scrub_stamp":"2024-09-22T08:56:55.438696+0000","last_deep_scrub":"263'793","last_deep_scrub_stamp":"2024-09-22T08:56:55.438696+0000","last_clean_scrub_stamp":"2024-09-22T08:56:55.438696+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":701,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:41:58.568426+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"263'133","reported_seq":629,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:50.555868+0000","last_change":"2024-09-22T08:56:50.555868+0000","last_active":"2024-09-22T08:56:50.555868+0000","last_peered":"2024-09-22T08:56:50.555868+0000","last_clean":"2024-09-22T08:56:50.555868+0000","last_became_active":"2024-09-22T08:15:15.019162+0000","last_became_peered":"2024-09-22T08:15:15.019162+0000","last_unstale":"2024-09-22T08:56:50.555868+0000","last_undegraded":"2024-09-22T08:56:50.555868+0000","last_fullsized":"2024-09-22T08:56:50.555868+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'133","last_scrub_stamp":"2024-09-22T08:56:50.555734+0000","last_deep_scrub":"263'133","last_deep_scrub_stamp":"2024-09-22T08:56:50.555734+0000","last_clean_scrub_stamp":"2024-09-22T08:56:50.555734+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:43:12.119609+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":846,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":147,"num_read_kb":143,"num_write":317,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"263'518","reported_seq":2272,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:37.386846+0000","last_change":"2024-09-22T08:56:37.386846+0000","last_active":"2024-09-22T08:56:37.386846+0000","last_peered":"2024-09-22T08:56:37.386846+0000","last_clean":"2024-09-22T08:56:37.386846+0000","last_became_active":"2024-09-22T08:15:06.962528+0000","last_became_peered":"2024-09-22T08:15:06.962528+0000","last_unstale":"2024-09-22T08:56:37.386846+0000","last_undegraded":"2024-09-22T08:56:37.386846+0000","last_fullsized":"2024-09-22T08:56:37.386846+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'518","last_scrub_stamp":"2024-09-22T08:56:37.386751+0000","last_deep_scrub":"263'518","last_deep_scrub_stamp":"2024-09-22T08:56:37.386751+0000","last_clean_scrub_stamp":"2024-09-22T08:56:37.386751+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:56:21.707533+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2917,"num_read_kb":2741,"num_write":627,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2295,"num_omap_keys":9,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"263'197","reported_seq":822,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:23.466120+0000","last_change":"2024-09-22T08:56:23.466120+0000","last_active":"2024-09-22T08:56:23.466120+0000","last_peered":"2024-09-22T08:56:23.466120+0000","last_clean":"2024-09-22T08:56:23.466120+0000","last_became_active":"2024-09-22T08:15:04.947739+0000","last_became_peered":"2024-09-22T08:15:04.947739+0000","last_unstale":"2024-09-22T08:56:23.466120+0000","last_undegraded":"2024-09-22T08:56:23.466120+0000","last_fullsized":"2024-09-22T08:56:23.466120+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'197","last_scrub_stamp":"2024-09-22T08:56:23.466035+0000","last_deep_scrub":"263'197","last_deep_scrub_stamp":"2024-09-22T08:56:23.466035+0000","last_clean_scrub_stamp":"2024-09-22T08:56:23.466035+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:03:56.435199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":453,"num_read_kb":50575,"num_write":904,"num_write_kb":23711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:38.470627+0000","last_change":"2024-09-22T08:56:38.470627+0000","last_active":"2024-09-22T08:56:38.470627+0000","last_peered":"2024-09-22T08:56:38.470627+0000","last_clean":"2024-09-22T08:56:38.470627+0000","last_became_active":"2024-09-22T08:15:08.974693+0000","last_became_peered":"2024-09-22T08:15:08.974693+0000","last_unstale":"2024-09-22T08:56:38.470627+0000","last_undegraded":"2024-09-22T08:56:38.470627+0000","last_fullsized":"2024-09-22T08:56:38.470627+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:38.470537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:38.470537+0000","last_clean_scrub_stamp":"2024-09-22T08:56:38.470537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:48:40.724650+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"263'199","reported_seq":834,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:49.810754+0000","last_change":"2024-09-22T08:56:49.810754+0000","last_active":"2024-09-22T08:56:49.810754+0000","last_peered":"2024-09-22T08:56:49.810754+0000","last_clean":"2024-09-22T08:56:49.810754+0000","last_became_active":"2024-09-22T08:15:10.984402+0000","last_became_peered":"2024-09-22T08:15:10.984402+0000","last_unstale":"2024-09-22T08:56:49.810754+0000","last_undegraded":"2024-09-22T08:56:49.810754+0000","last_fullsized":"2024-09-22T08:56:49.810754+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'199","last_scrub_stamp":"2024-09-22T08:56:49.810653+0000","last_deep_scrub":"263'199","last_deep_scrub_stamp":"2024-09-22T08:56:49.810653+0000","last_clean_scrub_stamp":"2024-09-22T08:56:49.810653+0000","objects_scrubbed":6,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:07:41.914863+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13027,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":258,"num_read_kb":332,"num_write":120,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:51.387247+0000","last_change":"2024-09-22T08:56:51.387247+0000","last_active":"2024-09-22T08:56:51.387247+0000","last_peered":"2024-09-22T08:56:51.387247+0000","last_clean":"2024-09-22T08:56:51.387247+0000","last_became_active":"2024-09-22T08:15:13.014612+0000","last_became_peered":"2024-09-22T08:15:13.014612+0000","last_unstale":"2024-09-22T08:56:51.387247+0000","last_undegraded":"2024-09-22T08:56:51.387247+0000","last_fullsized":"2024-09-22T08:56:51.387247+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:51.387155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:51.387155+0000","last_clean_scrub_stamp":"2024-09-22T08:56:51.387155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:53:08.036240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"263'141","reported_seq":662,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:49.317205+0000","last_change":"2024-09-22T08:56:49.317205+0000","last_active":"2024-09-22T08:56:49.317205+0000","last_peered":"2024-09-22T08:56:49.317205+0000","last_clean":"2024-09-22T08:56:49.317205+0000","last_became_active":"2024-09-22T08:15:15.011332+0000","last_became_peered":"2024-09-22T08:15:15.011332+0000","last_unstale":"2024-09-22T08:56:49.317205+0000","last_undegraded":"2024-09-22T08:56:49.317205+0000","last_fullsized":"2024-09-22T08:56:49.317205+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'141","last_scrub_stamp":"2024-09-22T08:56:49.317109+0000","last_deep_scrub":"263'141","last_deep_scrub_stamp":"2024-09-22T08:56:49.317109+0000","last_clean_scrub_stamp":"2024-09-22T08:56:49.317109+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:22.198803+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":195,"num_read_kb":186,"num_write":318,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"263'477","reported_seq":2059,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:32.476096+0000","last_change":"2024-09-22T08:56:32.476096+0000","last_active":"2024-09-22T08:56:32.476096+0000","last_peered":"2024-09-22T08:56:32.476096+0000","last_clean":"2024-09-22T08:56:32.476096+0000","last_became_active":"2024-09-22T08:15:06.966708+0000","last_became_peered":"2024-09-22T08:15:06.966708+0000","last_unstale":"2024-09-22T08:56:32.476096+0000","last_undegraded":"2024-09-22T08:56:32.476096+0000","last_fullsized":"2024-09-22T08:56:32.476096+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'477","last_scrub_stamp":"2024-09-22T08:56:32.476005+0000","last_deep_scrub":"263'477","last_deep_scrub_stamp":"2024-09-22T08:56:32.476005+0000","last_clean_scrub_stamp":"2024-09-22T08:56:32.476005+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:28:16.584918+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2455,"num_read_kb":2308,"num_write":546,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"263'250","reported_seq":890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:25.088528+0000","last_change":"2024-09-22T08:56:25.088528+0000","last_active":"2024-09-22T08:56:25.088528+0000","last_peered":"2024-09-22T08:56:25.088528+0000","last_clean":"2024-09-22T08:56:25.088528+0000","last_became_active":"2024-09-22T08:15:04.949202+0000","last_became_peered":"2024-09-22T08:15:04.949202+0000","last_unstale":"2024-09-22T08:56:25.088528+0000","last_undegraded":"2024-09-22T08:56:25.088528+0000","last_fullsized":"2024-09-22T08:56:25.088528+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'250","last_scrub_stamp":"2024-09-22T08:56:25.088391+0000","last_deep_scrub":"263'250","last_deep_scrub_stamp":"2024-09-22T08:56:25.088391+0000","last_clean_scrub_stamp":"2024-09-22T08:56:25.088391+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:53.098601+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1386384,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":583,"num_read_kb":11398,"num_write":1166,"num_write_kb":28598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:38.128844+0000","last_change":"2024-09-22T08:56:38.128844+0000","last_active":"2024-09-22T08:56:38.128844+0000","last_peered":"2024-09-22T08:56:38.128844+0000","last_clean":"2024-09-22T08:56:38.128844+0000","last_became_active":"2024-09-22T08:15:08.978280+0000","last_became_peered":"2024-09-22T08:15:08.978280+0000","last_unstale":"2024-09-22T08:56:38.128844+0000","last_undegraded":"2024-09-22T08:56:38.128844+0000","last_fullsized":"2024-09-22T08:56:38.128844+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:38.128742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:38.128742+0000","last_clean_scrub_stamp":"2024-09-22T08:56:38.128742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:21:13.730058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"263'174","reported_seq":753,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:39.780381+0000","last_change":"2024-09-22T08:56:39.780381+0000","last_active":"2024-09-22T08:56:39.780381+0000","last_peered":"2024-09-22T08:56:39.780381+0000","last_clean":"2024-09-22T08:56:39.780381+0000","last_became_active":"2024-09-22T08:15:10.986433+0000","last_became_peered":"2024-09-22T08:15:10.986433+0000","last_unstale":"2024-09-22T08:56:39.780381+0000","last_undegraded":"2024-09-22T08:56:39.780381+0000","last_fullsized":"2024-09-22T08:56:39.780381+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'174","last_scrub_stamp":"2024-09-22T08:56:39.780268+0000","last_deep_scrub":"263'174","last_deep_scrub_stamp":"2024-09-22T08:56:39.780268+0000","last_clean_scrub_stamp":"2024-09-22T08:56:39.780268+0000","objects_scrubbed":6,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:46:14.302166+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8940,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":228,"num_read_kb":301,"num_write":186,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:42.207072+0000","last_change":"2024-09-22T08:56:42.207072+0000","last_active":"2024-09-22T08:56:42.207072+0000","last_peered":"2024-09-22T08:56:42.207072+0000","last_clean":"2024-09-22T08:56:42.207072+0000","last_became_active":"2024-09-22T08:15:12.999036+0000","last_became_peered":"2024-09-22T08:15:12.999036+0000","last_unstale":"2024-09-22T08:56:42.207072+0000","last_undegraded":"2024-09-22T08:56:42.207072+0000","last_fullsized":"2024-09-22T08:56:42.207072+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:42.206974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:42.206974+0000","last_clean_scrub_stamp":"2024-09-22T08:56:42.206974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:57:59.149011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"263'100","reported_seq":598,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:53.433310+0000","last_change":"2024-09-22T08:56:53.433256+0000","last_active":"2024-09-22T08:56:53.433310+0000","last_peered":"2024-09-22T08:56:53.433310+0000","last_clean":"2024-09-22T08:56:53.433310+0000","last_became_active":"2024-09-22T08:15:15.011949+0000","last_became_peered":"2024-09-22T08:15:15.011949+0000","last_unstale":"2024-09-22T08:56:53.433310+0000","last_undegraded":"2024-09-22T08:56:53.433310+0000","last_fullsized":"2024-09-22T08:56:53.433310+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'100","last_scrub_stamp":"2024-09-22T08:56:53.433157+0000","last_deep_scrub":"263'100","last_deep_scrub_stamp":"2024-09-22T08:56:53.433157+0000","last_clean_scrub_stamp":"2024-09-22T08:56:53.433157+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:31:51.822201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":93,"num_read_kb":93,"num_write":223,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"263'829","reported_seq":2617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:40.852542+0000","last_change":"2024-09-22T08:56:40.852542+0000","last_active":"2024-09-22T08:56:40.852542+0000","last_peered":"2024-09-22T08:56:40.852542+0000","last_clean":"2024-09-22T08:56:40.852542+0000","last_became_active":"2024-09-22T08:15:06.966795+0000","last_became_peered":"2024-09-22T08:15:06.966795+0000","last_unstale":"2024-09-22T08:56:40.852542+0000","last_undegraded":"2024-09-22T08:56:40.852542+0000","last_fullsized":"2024-09-22T08:56:40.852542+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'829","last_scrub_stamp":"2024-09-22T08:56:40.852447+0000","last_deep_scrub":"263'829","last_deep_scrub_stamp":"2024-09-22T08:56:40.852447+0000","last_clean_scrub_stamp":"2024-09-22T08:56:40.852447+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:33:27.427428+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4273,"num_read_kb":3896,"num_write":1079,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3244,"num_omap_keys":13,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"263'222","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:27.930142+0000","last_change":"2024-09-22T08:56:27.930142+0000","last_active":"2024-09-22T08:56:27.930142+0000","last_peered":"2024-09-22T08:56:27.930142+0000","last_clean":"2024-09-22T08:56:27.930142+0000","last_became_active":"2024-09-22T08:15:04.954492+0000","last_became_peered":"2024-09-22T08:15:04.954492+0000","last_unstale":"2024-09-22T08:56:27.930142+0000","last_undegraded":"2024-09-22T08:56:27.930142+0000","last_fullsized":"2024-09-22T08:56:27.930142+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'222","last_scrub_stamp":"2024-09-22T08:56:27.930037+0000","last_deep_scrub":"263'222","last_deep_scrub_stamp":"2024-09-22T08:56:27.930037+0000","last_clean_scrub_stamp":"2024-09-22T08:56:27.930037+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:04:52.837489+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079919,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":477,"num_read_kb":44813,"num_write":947,"num_write_kb":39223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:46.438084+0000","last_change":"2024-09-22T08:56:46.438084+0000","last_active":"2024-09-22T08:56:46.438084+0000","last_peered":"2024-09-22T08:56:46.438084+0000","last_clean":"2024-09-22T08:56:46.438084+0000","last_became_active":"2024-09-22T08:15:08.976990+0000","last_became_peered":"2024-09-22T08:15:08.976990+0000","last_unstale":"2024-09-22T08:56:46.438084+0000","last_undegraded":"2024-09-22T08:56:46.438084+0000","last_fullsized":"2024-09-22T08:56:46.438084+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:46.437993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:46.437993+0000","last_clean_scrub_stamp":"2024-09-22T08:56:46.437993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:36:06.743042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"263'156","reported_seq":747,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:48.405014+0000","last_change":"2024-09-22T08:56:48.405014+0000","last_active":"2024-09-22T08:56:48.405014+0000","last_peered":"2024-09-22T08:56:48.405014+0000","last_clean":"2024-09-22T08:56:48.405014+0000","last_became_active":"2024-09-22T08:15:10.979449+0000","last_became_peered":"2024-09-22T08:15:10.979449+0000","last_unstale":"2024-09-22T08:56:48.405014+0000","last_undegraded":"2024-09-22T08:56:48.405014+0000","last_fullsized":"2024-09-22T08:56:48.405014+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'156","last_scrub_stamp":"2024-09-22T08:56:48.404914+0000","last_deep_scrub":"263'156","last_deep_scrub_stamp":"2024-09-22T08:56:48.404914+0000","last_clean_scrub_stamp":"2024-09-22T08:56:48.404914+0000","objects_scrubbed":7,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:26:48.853422+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6421,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":192,"num_read_kb":205,"num_write":100,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"263'771","reported_seq":4259,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:40.149276+0000","last_change":"2024-09-22T08:56:40.149276+0000","last_active":"2024-09-22T08:56:40.149276+0000","last_peered":"2024-09-22T08:56:40.149276+0000","last_clean":"2024-09-22T08:56:40.149276+0000","last_became_active":"2024-09-22T08:15:13.015504+0000","last_became_peered":"2024-09-22T08:15:13.015504+0000","last_unstale":"2024-09-22T08:56:40.149276+0000","last_undegraded":"2024-09-22T08:56:40.149276+0000","last_fullsized":"2024-09-22T08:56:40.149276+0000","mapping_epoch":31,"log_start":"263'701","ondisk_log_start":"263'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'771","last_scrub_stamp":"2024-09-22T08:56:40.149185+0000","last_deep_scrub":"263'771","last_deep_scrub_stamp":"2024-09-22T08:56:40.149185+0000","last_clean_scrub_stamp":"2024-09-22T08:56:40.149185+0000","objects_scrubbed":1,"log_size":70,"log_dups_size":701,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:21.199547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"263'135","reported_seq":640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:49.589765+0000","last_change":"2024-09-22T08:56:49.589694+0000","last_active":"2024-09-22T08:56:49.589765+0000","last_peered":"2024-09-22T08:56:49.589765+0000","last_clean":"2024-09-22T08:56:49.589765+0000","last_became_active":"2024-09-22T08:15:15.017584+0000","last_became_peered":"2024-09-22T08:15:15.017584+0000","last_unstale":"2024-09-22T08:56:49.589765+0000","last_undegraded":"2024-09-22T08:56:49.589765+0000","last_fullsized":"2024-09-22T08:56:49.589765+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'135","last_scrub_stamp":"2024-09-22T08:56:49.589600+0000","last_deep_scrub":"263'135","last_deep_scrub_stamp":"2024-09-22T08:56:49.589600+0000","last_clean_scrub_stamp":"2024-09-22T08:56:49.589600+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:37:33.886633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":193,"num_read_kb":181,"num_write":318,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"263'746","reported_seq":2330,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:35.418814+0000","last_change":"2024-09-22T08:56:35.418814+0000","last_active":"2024-09-22T08:56:35.418814+0000","last_peered":"2024-09-22T08:56:35.418814+0000","last_clean":"2024-09-22T08:56:35.418814+0000","last_became_active":"2024-09-22T08:15:06.973918+0000","last_became_peered":"2024-09-22T08:15:06.973918+0000","last_unstale":"2024-09-22T08:56:35.418814+0000","last_undegraded":"2024-09-22T08:56:35.418814+0000","last_fullsized":"2024-09-22T08:56:35.418814+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'746","last_scrub_stamp":"2024-09-22T08:56:35.418722+0000","last_deep_scrub":"263'746","last_deep_scrub_stamp":"2024-09-22T08:56:35.418722+0000","last_clean_scrub_stamp":"2024-09-22T08:56:35.418722+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":700,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:24:01.261807+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3813,"num_read_kb":3478,"num_write":973,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"263'231","reported_seq":896,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:28.938830+0000","last_change":"2024-09-22T08:56:28.938830+0000","last_active":"2024-09-22T08:56:28.938830+0000","last_peered":"2024-09-22T08:56:28.938830+0000","last_clean":"2024-09-22T08:56:28.938830+0000","last_became_active":"2024-09-22T08:15:04.958336+0000","last_became_peered":"2024-09-22T08:15:04.958336+0000","last_unstale":"2024-09-22T08:56:28.938830+0000","last_undegraded":"2024-09-22T08:56:28.938830+0000","last_fullsized":"2024-09-22T08:56:28.938830+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'231","last_scrub_stamp":"2024-09-22T08:56:28.938691+0000","last_deep_scrub":"263'231","last_deep_scrub_stamp":"2024-09-22T08:56:28.938691+0000","last_clean_scrub_stamp":"2024-09-22T08:56:28.938691+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:30.008305+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":654,"num_read_kb":3596,"num_write":1077,"num_write_kb":27039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"263'4","reported_seq":1457,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:37.780914+0000","last_change":"2024-09-22T08:56:37.780914+0000","last_active":"2024-09-22T08:56:37.780914+0000","last_peered":"2024-09-22T08:56:37.780914+0000","last_clean":"2024-09-22T08:56:37.780914+0000","last_became_active":"2024-09-22T08:15:08.982221+0000","last_became_peered":"2024-09-22T08:15:08.982221+0000","last_unstale":"2024-09-22T08:56:37.780914+0000","last_undegraded":"2024-09-22T08:56:37.780914+0000","last_fullsized":"2024-09-22T08:56:37.780914+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-22T08:56:37.780814+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-22T08:56:37.780814+0000","last_clean_scrub_stamp":"2024-09-22T08:56:37.780814+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:28:47.547033+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":950,"num_read_kb":950,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"263'78","reported_seq":598,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:43.533476+0000","last_change":"2024-09-22T08:56:43.533476+0000","last_active":"2024-09-22T08:56:43.533476+0000","last_peered":"2024-09-22T08:56:43.533476+0000","last_clean":"2024-09-22T08:56:43.533476+0000","last_became_active":"2024-09-22T08:15:10.987273+0000","last_became_peered":"2024-09-22T08:15:10.987273+0000","last_unstale":"2024-09-22T08:56:43.533476+0000","last_undegraded":"2024-09-22T08:56:43.533476+0000","last_fullsized":"2024-09-22T08:56:43.533476+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'78","last_scrub_stamp":"2024-09-22T08:56:43.533371+0000","last_deep_scrub":"263'78","last_deep_scrub_stamp":"2024-09-22T08:56:43.533371+0000","last_clean_scrub_stamp":"2024-09-22T08:56:43.533371+0000","objects_scrubbed":5,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:01:13.534183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"263'791","reported_seq":2320,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:45.734603+0000","last_change":"2024-09-22T08:56:45.734603+0000","last_active":"2024-09-22T08:56:45.734603+0000","last_peered":"2024-09-22T08:56:45.734603+0000","last_clean":"2024-09-22T08:56:45.734603+0000","last_became_active":"2024-09-22T08:15:13.010641+0000","last_became_peered":"2024-09-22T08:15:13.010641+0000","last_unstale":"2024-09-22T08:56:45.734603+0000","last_undegraded":"2024-09-22T08:56:45.734603+0000","last_fullsized":"2024-09-22T08:56:45.734603+0000","mapping_epoch":31,"log_start":"263'701","ondisk_log_start":"263'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'791","last_scrub_stamp":"2024-09-22T08:56:45.734525+0000","last_deep_scrub":"263'791","last_deep_scrub_stamp":"2024-09-22T08:56:45.734525+0000","last_clean_scrub_stamp":"2024-09-22T08:56:45.734525+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":701,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:51:11.341773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"263'125","reported_seq":629,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:47.296418+0000","last_change":"2024-09-22T08:56:47.296344+0000","last_active":"2024-09-22T08:56:47.296418+0000","last_peered":"2024-09-22T08:56:47.296418+0000","last_clean":"2024-09-22T08:56:47.296418+0000","last_became_active":"2024-09-22T08:15:15.014775+0000","last_became_peered":"2024-09-22T08:15:15.014775+0000","last_unstale":"2024-09-22T08:56:47.296418+0000","last_undegraded":"2024-09-22T08:56:47.296418+0000","last_fullsized":"2024-09-22T08:56:47.296418+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'125","last_scrub_stamp":"2024-09-22T08:56:47.296257+0000","last_deep_scrub":"263'125","last_deep_scrub_stamp":"2024-09-22T08:56:47.296257+0000","last_clean_scrub_stamp":"2024-09-22T08:56:47.296257+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:25:15.152835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":160,"num_write":304,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"263'416","reported_seq":1980,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:28.069522+0000","last_change":"2024-09-22T08:56:28.069522+0000","last_active":"2024-09-22T08:56:28.069522+0000","last_peered":"2024-09-22T08:56:28.069522+0000","last_clean":"2024-09-22T08:56:28.069522+0000","last_became_active":"2024-09-22T08:15:06.957239+0000","last_became_peered":"2024-09-22T08:15:06.957239+0000","last_unstale":"2024-09-22T08:56:28.069522+0000","last_undegraded":"2024-09-22T08:56:28.069522+0000","last_fullsized":"2024-09-22T08:56:28.069522+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'416","last_scrub_stamp":"2024-09-22T08:56:28.069427+0000","last_deep_scrub":"263'416","last_deep_scrub_stamp":"2024-09-22T08:56:28.069427+0000","last_clean_scrub_stamp":"2024-09-22T08:56:28.069427+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:11:54.954287+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2251,"num_read_kb":2145,"num_write":475,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"263'273","reported_seq":963,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:26.484287+0000","last_change":"2024-09-22T08:56:26.484287+0000","last_active":"2024-09-22T08:56:26.484287+0000","last_peered":"2024-09-22T08:56:26.484287+0000","last_clean":"2024-09-22T08:56:26.484287+0000","last_became_active":"2024-09-22T08:15:04.943906+0000","last_became_peered":"2024-09-22T08:15:04.943906+0000","last_unstale":"2024-09-22T08:56:26.484287+0000","last_undegraded":"2024-09-22T08:56:26.484287+0000","last_fullsized":"2024-09-22T08:56:26.484287+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'273","last_scrub_stamp":"2024-09-22T08:56:26.484114+0000","last_deep_scrub":"263'273","last_deep_scrub_stamp":"2024-09-22T08:56:26.484114+0000","last_clean_scrub_stamp":"2024-09-22T08:56:26.484114+0000","objects_scrubbed":3,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:37:56.831727+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079942,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":793,"num_read_kb":68557,"num_write":1190,"num_write_kb":29712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:50.883370+0000","last_change":"2024-09-22T08:56:50.883370+0000","last_active":"2024-09-22T08:56:50.883370+0000","last_peered":"2024-09-22T08:56:50.883370+0000","last_clean":"2024-09-22T08:56:50.883370+0000","last_became_active":"2024-09-22T08:15:08.969175+0000","last_became_peered":"2024-09-22T08:15:08.969175+0000","last_unstale":"2024-09-22T08:56:50.883370+0000","last_undegraded":"2024-09-22T08:56:50.883370+0000","last_fullsized":"2024-09-22T08:56:50.883370+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:50.883288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:50.883288+0000","last_clean_scrub_stamp":"2024-09-22T08:56:50.883288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:44:13.341062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"263'201","reported_seq":811,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:40.829949+0000","last_change":"2024-09-22T08:56:40.829949+0000","last_active":"2024-09-22T08:56:40.829949+0000","last_peered":"2024-09-22T08:56:40.829949+0000","last_clean":"2024-09-22T08:56:40.829949+0000","last_became_active":"2024-09-22T08:15:10.987081+0000","last_became_peered":"2024-09-22T08:15:10.987081+0000","last_unstale":"2024-09-22T08:56:40.829949+0000","last_undegraded":"2024-09-22T08:56:40.829949+0000","last_fullsized":"2024-09-22T08:56:40.829949+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'201","last_scrub_stamp":"2024-09-22T08:56:40.829842+0000","last_deep_scrub":"263'201","last_deep_scrub_stamp":"2024-09-22T08:56:40.829842+0000","last_clean_scrub_stamp":"2024-09-22T08:56:40.829842+0000","objects_scrubbed":8,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:08:13.921355+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5409,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":251,"num_read_kb":285,"num_write":138,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:43.325337+0000","last_change":"2024-09-22T08:56:43.325337+0000","last_active":"2024-09-22T08:56:43.325337+0000","last_peered":"2024-09-22T08:56:43.325337+0000","last_clean":"2024-09-22T08:56:43.325337+0000","last_became_active":"2024-09-22T08:15:13.007735+0000","last_became_peered":"2024-09-22T08:15:13.007735+0000","last_unstale":"2024-09-22T08:56:43.325337+0000","last_undegraded":"2024-09-22T08:56:43.325337+0000","last_fullsized":"2024-09-22T08:56:43.325337+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:43.325244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:43.325244+0000","last_clean_scrub_stamp":"2024-09-22T08:56:43.325244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:36:29.351234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"263'155","reported_seq":657,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:47.265631+0000","last_change":"2024-09-22T08:56:47.265578+0000","last_active":"2024-09-22T08:56:47.265631+0000","last_peered":"2024-09-22T08:56:47.265631+0000","last_clean":"2024-09-22T08:56:47.265631+0000","last_became_active":"2024-09-22T08:15:15.013216+0000","last_became_peered":"2024-09-22T08:15:15.013216+0000","last_unstale":"2024-09-22T08:56:47.265631+0000","last_undegraded":"2024-09-22T08:56:47.265631+0000","last_fullsized":"2024-09-22T08:56:47.265631+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'155","last_scrub_stamp":"2024-09-22T08:56:47.265466+0000","last_deep_scrub":"263'155","last_deep_scrub_stamp":"2024-09-22T08:56:47.265466+0000","last_clean_scrub_stamp":"2024-09-22T08:56:47.265466+0000","objects_scrubbed":6,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:25:17.464430+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1066,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":167,"num_read_kb":166,"num_write":339,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"263'394","reported_seq":1972,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:39.809906+0000","last_change":"2024-09-22T08:56:39.809824+0000","last_active":"2024-09-22T08:56:39.809906+0000","last_peered":"2024-09-22T08:56:39.809906+0000","last_clean":"2024-09-22T08:56:39.809906+0000","last_became_active":"2024-09-22T08:15:06.966710+0000","last_became_peered":"2024-09-22T08:15:06.966710+0000","last_unstale":"2024-09-22T08:56:39.809906+0000","last_undegraded":"2024-09-22T08:56:39.809906+0000","last_fullsized":"2024-09-22T08:56:39.809906+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'394","last_scrub_stamp":"2024-09-22T08:56:39.809723+0000","last_deep_scrub":"263'394","last_deep_scrub_stamp":"2024-09-22T08:56:39.809723+0000","last_clean_scrub_stamp":"2024-09-22T08:56:39.809723+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:25:17.819687+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2363,"num_read_kb":2266,"num_write":458,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"263'74","reported_seq":622,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:23.906239+0000","last_change":"2024-09-22T08:56:23.906168+0000","last_active":"2024-09-22T08:56:23.906239+0000","last_peered":"2024-09-22T08:56:23.906239+0000","last_clean":"2024-09-22T08:56:23.906239+0000","last_became_active":"2024-09-22T08:14:48.584210+0000","last_became_peered":"2024-09-22T08:14:48.584210+0000","last_unstale":"2024-09-22T08:56:23.906239+0000","last_undegraded":"2024-09-22T08:56:23.906239+0000","last_fullsized":"2024-09-22T08:56:23.906239+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'74","last_scrub_stamp":"2024-09-22T08:56:23.906086+0000","last_deep_scrub":"263'74","last_deep_scrub_stamp":"2024-09-22T08:56:23.906086+0000","last_clean_scrub_stamp":"2024-09-22T08:56:23.906086+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:41:31.894467+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"263'2","reported_seq":532,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:24.997667+0000","last_change":"2024-09-22T08:56:24.997623+0000","last_active":"2024-09-22T08:56:24.997667+0000","last_peered":"2024-09-22T08:56:24.997667+0000","last_clean":"2024-09-22T08:56:24.997667+0000","last_became_active":"2024-09-22T08:14:54.727501+0000","last_became_peered":"2024-09-22T08:14:54.727501+0000","last_unstale":"2024-09-22T08:56:24.997667+0000","last_undegraded":"2024-09-22T08:56:24.997667+0000","last_fullsized":"2024-09-22T08:56:24.997667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:56:24.997551+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:56:24.997551+0000","last_clean_scrub_stamp":"2024-09-22T08:56:24.997551+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:35:48.958613+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001065632,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"263'182","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:23.521553+0000","last_change":"2024-09-22T08:56:23.521494+0000","last_active":"2024-09-22T08:56:23.521553+0000","last_peered":"2024-09-22T08:56:23.521553+0000","last_clean":"2024-09-22T08:56:23.521553+0000","last_became_active":"2024-09-22T08:15:04.963447+0000","last_became_peered":"2024-09-22T08:15:04.963447+0000","last_unstale":"2024-09-22T08:56:23.521553+0000","last_undegraded":"2024-09-22T08:56:23.521553+0000","last_fullsized":"2024-09-22T08:56:23.521553+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'182","last_scrub_stamp":"2024-09-22T08:56:23.521376+0000","last_deep_scrub":"263'182","last_deep_scrub_stamp":"2024-09-22T08:56:23.521376+0000","last_clean_scrub_stamp":"2024-09-22T08:56:23.521376+0000","objects_scrubbed":3,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:36:09.902043+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":624,"num_read_kb":9185,"num_write":876,"num_write_kb":23340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:39.482287+0000","last_change":"2024-09-22T08:56:39.482217+0000","last_active":"2024-09-22T08:56:39.482287+0000","last_peered":"2024-09-22T08:56:39.482287+0000","last_clean":"2024-09-22T08:56:39.482287+0000","last_became_active":"2024-09-22T08:15:08.978755+0000","last_became_peered":"2024-09-22T08:15:08.978755+0000","last_unstale":"2024-09-22T08:56:39.482287+0000","last_undegraded":"2024-09-22T08:56:39.482287+0000","last_fullsized":"2024-09-22T08:56:39.482287+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:39.482129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:39.482129+0000","last_clean_scrub_stamp":"2024-09-22T08:56:39.482129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:10:09.797452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"263'285","reported_seq":993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:55.855685+0000","last_change":"2024-09-22T08:56:55.855685+0000","last_active":"2024-09-22T08:56:55.855685+0000","last_peered":"2024-09-22T08:56:55.855685+0000","last_clean":"2024-09-22T08:56:55.855685+0000","last_became_active":"2024-09-22T08:15:10.991050+0000","last_became_peered":"2024-09-22T08:15:10.991050+0000","last_unstale":"2024-09-22T08:56:55.855685+0000","last_undegraded":"2024-09-22T08:56:55.855685+0000","last_fullsized":"2024-09-22T08:56:55.855685+0000","mapping_epoch":29,"log_start":"260'200","ondisk_log_start":"260'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'285","last_scrub_stamp":"2024-09-22T08:56:55.855582+0000","last_deep_scrub":"263'285","last_deep_scrub_stamp":"2024-09-22T08:56:55.855582+0000","last_clean_scrub_stamp":"2024-09-22T08:56:55.855582+0000","objects_scrubbed":6,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:35:16.766711+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27910,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":531,"num_read_kb":745,"num_write":430,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89604,"num_omap_keys":214,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:50.371545+0000","last_change":"2024-09-22T08:56:50.371545+0000","last_active":"2024-09-22T08:56:50.371545+0000","last_peered":"2024-09-22T08:56:50.371545+0000","last_clean":"2024-09-22T08:56:50.371545+0000","last_became_active":"2024-09-22T08:15:13.018627+0000","last_became_peered":"2024-09-22T08:15:13.018627+0000","last_unstale":"2024-09-22T08:56:50.371545+0000","last_undegraded":"2024-09-22T08:56:50.371545+0000","last_fullsized":"2024-09-22T08:56:50.371545+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:50.371455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:50.371455+0000","last_clean_scrub_stamp":"2024-09-22T08:56:50.371455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:29:20.855982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"263'228","reported_seq":962,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:45.423312+0000","last_change":"2024-09-22T08:56:45.423312+0000","last_active":"2024-09-22T08:56:45.423312+0000","last_peered":"2024-09-22T08:56:45.423312+0000","last_clean":"2024-09-22T08:56:45.423312+0000","last_became_active":"2024-09-22T08:15:15.017533+0000","last_became_peered":"2024-09-22T08:15:15.017533+0000","last_unstale":"2024-09-22T08:56:45.423312+0000","last_undegraded":"2024-09-22T08:56:45.423312+0000","last_fullsized":"2024-09-22T08:56:45.423312+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'228","last_scrub_stamp":"2024-09-22T08:56:45.423222+0000","last_deep_scrub":"263'228","last_deep_scrub_stamp":"2024-09-22T08:56:45.423222+0000","last_clean_scrub_stamp":"2024-09-22T08:56:45.423222+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:57:26.111196+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":616,"num_read_kb":580,"num_write":434,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"263'397","reported_seq":1968,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:36.374074+0000","last_change":"2024-09-22T08:56:36.374074+0000","last_active":"2024-09-22T08:56:36.374074+0000","last_peered":"2024-09-22T08:56:36.374074+0000","last_clean":"2024-09-22T08:56:36.374074+0000","last_became_active":"2024-09-22T08:15:06.966792+0000","last_became_peered":"2024-09-22T08:15:06.966792+0000","last_unstale":"2024-09-22T08:56:36.374074+0000","last_undegraded":"2024-09-22T08:56:36.374074+0000","last_fullsized":"2024-09-22T08:56:36.374074+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'397","last_scrub_stamp":"2024-09-22T08:56:36.373981+0000","last_deep_scrub":"263'397","last_deep_scrub_stamp":"2024-09-22T08:56:36.373981+0000","last_clean_scrub_stamp":"2024-09-22T08:56:36.373981+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:00:10.052430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2208,"num_read_kb":2116,"num_write":452,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":531,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:22.986425+0000","last_change":"2024-09-22T08:56:22.986343+0000","last_active":"2024-09-22T08:56:22.986425+0000","last_peered":"2024-09-22T08:56:22.986425+0000","last_clean":"2024-09-22T08:56:22.986425+0000","last_became_active":"2024-09-22T08:14:54.726875+0000","last_became_peered":"2024-09-22T08:14:54.726875+0000","last_unstale":"2024-09-22T08:56:22.986425+0000","last_undegraded":"2024-09-22T08:56:22.986425+0000","last_fullsized":"2024-09-22T08:56:22.986425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:22.986260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:22.986260+0000","last_clean_scrub_stamp":"2024-09-22T08:56:22.986260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:13:47.646650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000558433,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"263'182","reported_seq":796,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:31.472701+0000","last_change":"2024-09-22T08:56:31.472650+0000","last_active":"2024-09-22T08:56:31.472701+0000","last_peered":"2024-09-22T08:56:31.472701+0000","last_clean":"2024-09-22T08:56:31.472701+0000","last_became_active":"2024-09-22T08:15:04.963967+0000","last_became_peered":"2024-09-22T08:15:04.963967+0000","last_unstale":"2024-09-22T08:56:31.472701+0000","last_undegraded":"2024-09-22T08:56:31.472701+0000","last_fullsized":"2024-09-22T08:56:31.472701+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'182","last_scrub_stamp":"2024-09-22T08:56:31.472539+0000","last_deep_scrub":"263'182","last_deep_scrub_stamp":"2024-09-22T08:56:31.472539+0000","last_clean_scrub_stamp":"2024-09-22T08:56:31.472539+0000","objects_scrubbed":2,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:54:16.950622+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":424,"num_read_kb":76135,"num_write":811,"num_write_kb":37187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:49.864291+0000","last_change":"2024-09-22T08:56:49.864291+0000","last_active":"2024-09-22T08:56:49.864291+0000","last_peered":"2024-09-22T08:56:49.864291+0000","last_clean":"2024-09-22T08:56:49.864291+0000","last_became_active":"2024-09-22T08:15:08.969276+0000","last_became_peered":"2024-09-22T08:15:08.969276+0000","last_unstale":"2024-09-22T08:56:49.864291+0000","last_undegraded":"2024-09-22T08:56:49.864291+0000","last_fullsized":"2024-09-22T08:56:49.864291+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:49.864205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:49.864205+0000","last_clean_scrub_stamp":"2024-09-22T08:56:49.864205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:04:18.212089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"263'869","reported_seq":2309,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:41.175097+0000","last_change":"2024-09-22T08:56:41.174984+0000","last_active":"2024-09-22T08:56:41.175097+0000","last_peered":"2024-09-22T08:56:41.175097+0000","last_clean":"2024-09-22T08:56:41.175097+0000","last_became_active":"2024-09-22T08:15:10.984157+0000","last_became_peered":"2024-09-22T08:15:10.984157+0000","last_unstale":"2024-09-22T08:56:41.175097+0000","last_undegraded":"2024-09-22T08:56:41.175097+0000","last_fullsized":"2024-09-22T08:56:41.175097+0000","mapping_epoch":29,"log_start":"263'800","ondisk_log_start":"263'800","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'869","last_scrub_stamp":"2024-09-22T08:56:41.174846+0000","last_deep_scrub":"263'869","last_deep_scrub_stamp":"2024-09-22T08:56:41.174846+0000","last_clean_scrub_stamp":"2024-09-22T08:56:41.174846+0000","objects_scrubbed":12,"log_size":69,"log_dups_size":800,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:25:27.321377+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49716,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1169,"num_read_kb":1404,"num_write":276,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:00.918613+0000","last_change":"2024-09-22T08:57:00.918613+0000","last_active":"2024-09-22T08:57:00.918613+0000","last_peered":"2024-09-22T08:57:00.918613+0000","last_clean":"2024-09-22T08:57:00.918613+0000","last_became_active":"2024-09-22T08:15:13.011864+0000","last_became_peered":"2024-09-22T08:15:13.011864+0000","last_unstale":"2024-09-22T08:57:00.918613+0000","last_undegraded":"2024-09-22T08:57:00.918613+0000","last_fullsized":"2024-09-22T08:57:00.918613+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:00.918518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:00.918518+0000","last_clean_scrub_stamp":"2024-09-22T08:57:00.918518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:50:43.992471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"263'216","reported_seq":751,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:54.478201+0000","last_change":"2024-09-22T08:56:54.478201+0000","last_active":"2024-09-22T08:56:54.478201+0000","last_peered":"2024-09-22T08:56:54.478201+0000","last_clean":"2024-09-22T08:56:54.478201+0000","last_became_active":"2024-09-22T08:15:15.014003+0000","last_became_peered":"2024-09-22T08:15:15.014003+0000","last_unstale":"2024-09-22T08:56:54.478201+0000","last_undegraded":"2024-09-22T08:56:54.478201+0000","last_fullsized":"2024-09-22T08:56:54.478201+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'216","last_scrub_stamp":"2024-09-22T08:56:54.478109+0000","last_deep_scrub":"263'216","last_deep_scrub_stamp":"2024-09-22T08:56:54.478109+0000","last_clean_scrub_stamp":"2024-09-22T08:56:54.478109+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:20:35.254434+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":401,"num_read_kb":391,"num_write":491,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"263'700","reported_seq":2541,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:34.442254+0000","last_change":"2024-09-22T08:56:34.442254+0000","last_active":"2024-09-22T08:56:34.442254+0000","last_peered":"2024-09-22T08:56:34.442254+0000","last_clean":"2024-09-22T08:56:34.442254+0000","last_became_active":"2024-09-22T08:15:06.972591+0000","last_became_peered":"2024-09-22T08:15:06.972591+0000","last_unstale":"2024-09-22T08:56:34.442254+0000","last_undegraded":"2024-09-22T08:56:34.442254+0000","last_fullsized":"2024-09-22T08:56:34.442254+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'700","last_scrub_stamp":"2024-09-22T08:56:34.442140+0000","last_deep_scrub":"263'700","last_deep_scrub_stamp":"2024-09-22T08:56:34.442140+0000","last_clean_scrub_stamp":"2024-09-22T08:56:34.442140+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":600,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:12:11.424859+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3779,"num_read_kb":3472,"num_write":954,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":695,"num_omap_keys":3,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":532,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:27.077163+0000","last_change":"2024-09-22T08:56:27.077093+0000","last_active":"2024-09-22T08:56:27.077163+0000","last_peered":"2024-09-22T08:56:27.077163+0000","last_clean":"2024-09-22T08:56:27.077163+0000","last_became_active":"2024-09-22T08:14:54.718660+0000","last_became_peered":"2024-09-22T08:14:54.718660+0000","last_unstale":"2024-09-22T08:56:27.077163+0000","last_undegraded":"2024-09-22T08:56:27.077163+0000","last_fullsized":"2024-09-22T08:56:27.077163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:27.076990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:27.076990+0000","last_clean_scrub_stamp":"2024-09-22T08:56:27.076990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:51:42.150906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042448600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"263'261","reported_seq":955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:26.431326+0000","last_change":"2024-09-22T08:56:26.431268+0000","last_active":"2024-09-22T08:56:26.431326+0000","last_peered":"2024-09-22T08:56:26.431326+0000","last_clean":"2024-09-22T08:56:26.431326+0000","last_became_active":"2024-09-22T08:15:04.954726+0000","last_became_peered":"2024-09-22T08:15:04.954726+0000","last_unstale":"2024-09-22T08:56:26.431326+0000","last_undegraded":"2024-09-22T08:56:26.431326+0000","last_fullsized":"2024-09-22T08:56:26.431326+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'261","last_scrub_stamp":"2024-09-22T08:56:26.431154+0000","last_deep_scrub":"263'261","last_deep_scrub_stamp":"2024-09-22T08:56:26.431154+0000","last_clean_scrub_stamp":"2024-09-22T08:56:26.431154+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:09:33.251754+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":813,"num_read_kb":7176,"num_write":1020,"num_write_kb":41627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"263'2","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:46.234731+0000","last_change":"2024-09-22T08:56:46.234731+0000","last_active":"2024-09-22T08:56:46.234731+0000","last_peered":"2024-09-22T08:56:46.234731+0000","last_clean":"2024-09-22T08:56:46.234731+0000","last_became_active":"2024-09-22T08:15:08.974419+0000","last_became_peered":"2024-09-22T08:15:08.974419+0000","last_unstale":"2024-09-22T08:56:46.234731+0000","last_undegraded":"2024-09-22T08:56:46.234731+0000","last_fullsized":"2024-09-22T08:56:46.234731+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:56:46.234640+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:56:46.234640+0000","last_clean_scrub_stamp":"2024-09-22T08:56:46.234640+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:32:06.632320+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"263'242","reported_seq":1287,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:40.526383+0000","last_change":"2024-09-22T08:56:40.526320+0000","last_active":"2024-09-22T08:56:40.526383+0000","last_peered":"2024-09-22T08:56:40.526383+0000","last_clean":"2024-09-22T08:56:40.526383+0000","last_became_active":"2024-09-22T08:15:10.987358+0000","last_became_peered":"2024-09-22T08:15:10.987358+0000","last_unstale":"2024-09-22T08:56:40.526383+0000","last_undegraded":"2024-09-22T08:56:40.526383+0000","last_fullsized":"2024-09-22T08:56:40.526383+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'242","last_scrub_stamp":"2024-09-22T08:56:40.526223+0000","last_deep_scrub":"263'242","last_deep_scrub_stamp":"2024-09-22T08:56:40.526223+0000","last_clean_scrub_stamp":"2024-09-22T08:56:40.526223+0000","objects_scrubbed":9,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:34:59.804804+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":174,"num_read_kb":166,"num_write":139,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5278,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:54.784267+0000","last_change":"2024-09-22T08:56:54.784267+0000","last_active":"2024-09-22T08:56:54.784267+0000","last_peered":"2024-09-22T08:56:54.784267+0000","last_clean":"2024-09-22T08:56:54.784267+0000","last_became_active":"2024-09-22T08:15:13.009891+0000","last_became_peered":"2024-09-22T08:15:13.009891+0000","last_unstale":"2024-09-22T08:56:54.784267+0000","last_undegraded":"2024-09-22T08:56:54.784267+0000","last_fullsized":"2024-09-22T08:56:54.784267+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:54.784180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:54.784180+0000","last_clean_scrub_stamp":"2024-09-22T08:56:54.784180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:18:34.727660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"263'247","reported_seq":850,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:00.922028+0000","last_change":"2024-09-22T08:57:00.922028+0000","last_active":"2024-09-22T08:57:00.922028+0000","last_peered":"2024-09-22T08:57:00.922028+0000","last_clean":"2024-09-22T08:57:00.922028+0000","last_became_active":"2024-09-22T08:15:15.017686+0000","last_became_peered":"2024-09-22T08:15:15.017686+0000","last_unstale":"2024-09-22T08:57:00.922028+0000","last_undegraded":"2024-09-22T08:57:00.922028+0000","last_fullsized":"2024-09-22T08:57:00.922028+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'247","last_scrub_stamp":"2024-09-22T08:57:00.921937+0000","last_deep_scrub":"263'247","last_deep_scrub_stamp":"2024-09-22T08:57:00.921937+0000","last_clean_scrub_stamp":"2024-09-22T08:57:00.921937+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:34:22.123361+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":504,"num_read_kb":528,"num_write":541,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"263'459","reported_seq":1994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:33.446661+0000","last_change":"2024-09-22T08:56:33.446543+0000","last_active":"2024-09-22T08:56:33.446661+0000","last_peered":"2024-09-22T08:56:33.446661+0000","last_clean":"2024-09-22T08:56:33.446661+0000","last_became_active":"2024-09-22T08:15:06.962486+0000","last_became_peered":"2024-09-22T08:15:06.962486+0000","last_unstale":"2024-09-22T08:56:33.446661+0000","last_undegraded":"2024-09-22T08:56:33.446661+0000","last_fullsized":"2024-09-22T08:56:33.446661+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'459","last_scrub_stamp":"2024-09-22T08:56:33.446433+0000","last_deep_scrub":"263'459","last_deep_scrub_stamp":"2024-09-22T08:56:33.446433+0000","last_clean_scrub_stamp":"2024-09-22T08:56:33.446433+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:03.195975+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2436,"num_read_kb":2281,"num_write":554,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"263'3","reported_seq":533,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:24.036583+0000","last_change":"2024-09-22T08:56:24.036494+0000","last_active":"2024-09-22T08:56:24.036583+0000","last_peered":"2024-09-22T08:56:24.036583+0000","last_clean":"2024-09-22T08:56:24.036583+0000","last_became_active":"2024-09-22T08:14:55.586088+0000","last_became_peered":"2024-09-22T08:14:55.586088+0000","last_unstale":"2024-09-22T08:56:24.036583+0000","last_undegraded":"2024-09-22T08:56:24.036583+0000","last_fullsized":"2024-09-22T08:56:24.036583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-22T08:56:24.036366+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-22T08:56:24.036366+0000","last_clean_scrub_stamp":"2024-09-22T08:56:24.036366+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:04:54.097829+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0010233219999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"263'164","reported_seq":761,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:21.464594+0000","last_change":"2024-09-22T08:56:21.464541+0000","last_active":"2024-09-22T08:56:21.464594+0000","last_peered":"2024-09-22T08:56:21.464594+0000","last_clean":"2024-09-22T08:56:21.464594+0000","last_became_active":"2024-09-22T08:15:04.963894+0000","last_became_peered":"2024-09-22T08:15:04.963894+0000","last_unstale":"2024-09-22T08:56:21.464594+0000","last_undegraded":"2024-09-22T08:56:21.464594+0000","last_fullsized":"2024-09-22T08:56:21.464594+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'164","last_scrub_stamp":"2024-09-22T08:56:21.464437+0000","last_deep_scrub":"263'164","last_deep_scrub_stamp":"2024-09-22T08:56:21.464437+0000","last_clean_scrub_stamp":"2024-09-22T08:56:21.464437+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:37:48.941982+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":412,"num_read_kb":11085,"num_write":748,"num_write_kb":14868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:36.134128+0000","last_change":"2024-09-22T08:56:36.134073+0000","last_active":"2024-09-22T08:56:36.134128+0000","last_peered":"2024-09-22T08:56:36.134128+0000","last_clean":"2024-09-22T08:56:36.134128+0000","last_became_active":"2024-09-22T08:15:08.968076+0000","last_became_peered":"2024-09-22T08:15:08.968076+0000","last_unstale":"2024-09-22T08:56:36.134128+0000","last_undegraded":"2024-09-22T08:56:36.134128+0000","last_fullsized":"2024-09-22T08:56:36.134128+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:36.133960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:36.133960+0000","last_clean_scrub_stamp":"2024-09-22T08:56:36.133960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:38:20.387449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"263'118","reported_seq":666,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:47.396848+0000","last_change":"2024-09-22T08:56:47.396848+0000","last_active":"2024-09-22T08:56:47.396848+0000","last_peered":"2024-09-22T08:56:47.396848+0000","last_clean":"2024-09-22T08:56:47.396848+0000","last_became_active":"2024-09-22T08:15:10.992450+0000","last_became_peered":"2024-09-22T08:15:10.992450+0000","last_unstale":"2024-09-22T08:56:47.396848+0000","last_undegraded":"2024-09-22T08:56:47.396848+0000","last_fullsized":"2024-09-22T08:56:47.396848+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'118","last_scrub_stamp":"2024-09-22T08:56:47.396740+0000","last_deep_scrub":"263'118","last_deep_scrub_stamp":"2024-09-22T08:56:47.396740+0000","last_clean_scrub_stamp":"2024-09-22T08:56:47.396740+0000","objects_scrubbed":7,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:03:40.352125+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":139,"num_read_kb":133,"num_write":98,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3226,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:01.879916+0000","last_change":"2024-09-22T08:57:01.879916+0000","last_active":"2024-09-22T08:57:01.879916+0000","last_peered":"2024-09-22T08:57:01.879916+0000","last_clean":"2024-09-22T08:57:01.879916+0000","last_became_active":"2024-09-22T08:15:13.011756+0000","last_became_peered":"2024-09-22T08:15:13.011756+0000","last_unstale":"2024-09-22T08:57:01.879916+0000","last_undegraded":"2024-09-22T08:57:01.879916+0000","last_fullsized":"2024-09-22T08:57:01.879916+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:01.879820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:01.879820+0000","last_clean_scrub_stamp":"2024-09-22T08:57:01.879820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:27:28.177102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"263'110","reported_seq":669,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:49.763305+0000","last_change":"2024-09-22T08:56:49.763305+0000","last_active":"2024-09-22T08:56:49.763305+0000","last_peered":"2024-09-22T08:56:49.763305+0000","last_clean":"2024-09-22T08:56:49.763305+0000","last_became_active":"2024-09-22T08:15:15.016910+0000","last_became_peered":"2024-09-22T08:15:15.016910+0000","last_unstale":"2024-09-22T08:56:49.763305+0000","last_undegraded":"2024-09-22T08:56:49.763305+0000","last_fullsized":"2024-09-22T08:56:49.763305+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'110","last_scrub_stamp":"2024-09-22T08:56:49.763207+0000","last_deep_scrub":"263'110","last_deep_scrub_stamp":"2024-09-22T08:56:49.763207+0000","last_clean_scrub_stamp":"2024-09-22T08:56:49.763207+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:32:23.563653+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":271,"num_read_kb":261,"num_write":275,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"263'846","reported_seq":2462,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:29.493402+0000","last_change":"2024-09-22T08:56:29.493348+0000","last_active":"2024-09-22T08:56:29.493402+0000","last_peered":"2024-09-22T08:56:29.493402+0000","last_clean":"2024-09-22T08:56:29.493402+0000","last_became_active":"2024-09-22T08:15:06.965021+0000","last_became_peered":"2024-09-22T08:15:06.965021+0000","last_unstale":"2024-09-22T08:56:29.493402+0000","last_undegraded":"2024-09-22T08:56:29.493402+0000","last_fullsized":"2024-09-22T08:56:29.493402+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'846","last_scrub_stamp":"2024-09-22T08:56:29.493263+0000","last_deep_scrub":"263'846","last_deep_scrub_stamp":"2024-09-22T08:56:29.493263+0000","last_clean_scrub_stamp":"2024-09-22T08:56:29.493263+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":800,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:43:22.418910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4016,"num_read_kb":3619,"num_write":1120,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"263'175","reported_seq":790,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:22.390102+0000","last_change":"2024-09-22T08:56:22.390052+0000","last_active":"2024-09-22T08:56:22.390102+0000","last_peered":"2024-09-22T08:56:22.390102+0000","last_clean":"2024-09-22T08:56:22.390102+0000","last_became_active":"2024-09-22T08:15:04.958834+0000","last_became_peered":"2024-09-22T08:15:04.958834+0000","last_unstale":"2024-09-22T08:56:22.390102+0000","last_undegraded":"2024-09-22T08:56:22.390102+0000","last_fullsized":"2024-09-22T08:56:22.390102+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'175","last_scrub_stamp":"2024-09-22T08:56:22.389983+0000","last_deep_scrub":"263'175","last_deep_scrub_stamp":"2024-09-22T08:56:22.389983+0000","last_clean_scrub_stamp":"2024-09-22T08:56:22.389983+0000","objects_scrubbed":2,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:05:50.275750+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":466,"num_read_kb":15054,"num_write":837,"num_write_kb":27215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":528,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:23.482652+0000","last_change":"2024-09-22T08:56:23.482583+0000","last_active":"2024-09-22T08:56:23.482652+0000","last_peered":"2024-09-22T08:56:23.482652+0000","last_clean":"2024-09-22T08:56:23.482652+0000","last_became_active":"2024-09-22T08:14:55.585738+0000","last_became_peered":"2024-09-22T08:14:55.585738+0000","last_unstale":"2024-09-22T08:56:23.482652+0000","last_undegraded":"2024-09-22T08:56:23.482652+0000","last_fullsized":"2024-09-22T08:56:23.482652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:23.482501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:23.482501+0000","last_clean_scrub_stamp":"2024-09-22T08:56:23.482501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:54:46.131217+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00053802500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:39.742436+0000","last_change":"2024-09-22T08:56:39.742319+0000","last_active":"2024-09-22T08:56:39.742436+0000","last_peered":"2024-09-22T08:56:39.742436+0000","last_clean":"2024-09-22T08:56:39.742436+0000","last_became_active":"2024-09-22T08:15:08.975175+0000","last_became_peered":"2024-09-22T08:15:08.975175+0000","last_unstale":"2024-09-22T08:56:39.742436+0000","last_undegraded":"2024-09-22T08:56:39.742436+0000","last_fullsized":"2024-09-22T08:56:39.742436+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:39.742220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:39.742220+0000","last_clean_scrub_stamp":"2024-09-22T08:56:39.742220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:52:23.005245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"263'301","reported_seq":973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:37.103823+0000","last_change":"2024-09-22T08:56:37.103768+0000","last_active":"2024-09-22T08:56:37.103823+0000","last_peered":"2024-09-22T08:56:37.103823+0000","last_clean":"2024-09-22T08:56:37.103823+0000","last_became_active":"2024-09-22T08:15:10.982147+0000","last_became_peered":"2024-09-22T08:15:10.982147+0000","last_unstale":"2024-09-22T08:56:37.103823+0000","last_undegraded":"2024-09-22T08:56:37.103823+0000","last_fullsized":"2024-09-22T08:56:37.103823+0000","mapping_epoch":29,"log_start":"260'200","ondisk_log_start":"260'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'301","last_scrub_stamp":"2024-09-22T08:56:37.103659+0000","last_deep_scrub":"263'301","last_deep_scrub_stamp":"2024-09-22T08:56:37.103659+0000","last_clean_scrub_stamp":"2024-09-22T08:56:37.103659+0000","objects_scrubbed":10,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:06:07.933674+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30730,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1060,"num_read_kb":1272,"num_write":1552,"num_write_kb":1410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":535730,"num_omap_keys":1208,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:42.371497+0000","last_change":"2024-09-22T08:56:42.371394+0000","last_active":"2024-09-22T08:56:42.371497+0000","last_peered":"2024-09-22T08:56:42.371497+0000","last_clean":"2024-09-22T08:56:42.371497+0000","last_became_active":"2024-09-22T08:15:13.013980+0000","last_became_peered":"2024-09-22T08:15:13.013980+0000","last_unstale":"2024-09-22T08:56:42.371497+0000","last_undegraded":"2024-09-22T08:56:42.371497+0000","last_fullsized":"2024-09-22T08:56:42.371497+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:42.371291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:42.371291+0000","last_clean_scrub_stamp":"2024-09-22T08:56:42.371291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:04:21.990339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"263'173","reported_seq":733,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:58.512070+0000","last_change":"2024-09-22T08:56:58.512070+0000","last_active":"2024-09-22T08:56:58.512070+0000","last_peered":"2024-09-22T08:56:58.512070+0000","last_clean":"2024-09-22T08:56:58.512070+0000","last_became_active":"2024-09-22T08:15:15.012146+0000","last_became_peered":"2024-09-22T08:15:15.012146+0000","last_unstale":"2024-09-22T08:56:58.512070+0000","last_undegraded":"2024-09-22T08:56:58.512070+0000","last_fullsized":"2024-09-22T08:56:58.512070+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'173","last_scrub_stamp":"2024-09-22T08:56:58.511972+0000","last_deep_scrub":"263'173","last_deep_scrub_stamp":"2024-09-22T08:56:58.511972+0000","last_clean_scrub_stamp":"2024-09-22T08:56:58.511972+0000","objects_scrubbed":4,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:36:15.035865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":420,"num_read_kb":363,"num_write":419,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"263'445","reported_seq":2048,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:32.437594+0000","last_change":"2024-09-22T08:56:32.437536+0000","last_active":"2024-09-22T08:56:32.437594+0000","last_peered":"2024-09-22T08:56:32.437594+0000","last_clean":"2024-09-22T08:56:32.437594+0000","last_became_active":"2024-09-22T08:15:06.973563+0000","last_became_peered":"2024-09-22T08:15:06.973563+0000","last_unstale":"2024-09-22T08:56:32.437594+0000","last_undegraded":"2024-09-22T08:56:32.437594+0000","last_fullsized":"2024-09-22T08:56:32.437594+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'445","last_scrub_stamp":"2024-09-22T08:56:32.437452+0000","last_deep_scrub":"263'445","last_deep_scrub_stamp":"2024-09-22T08:56:32.437452+0000","last_clean_scrub_stamp":"2024-09-22T08:56:32.437452+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:12:03.651331+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2370,"num_read_kb":2248,"num_write":498,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"263'190","reported_seq":820,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:24.448779+0000","last_change":"2024-09-22T08:56:24.448712+0000","last_active":"2024-09-22T08:56:24.448779+0000","last_peered":"2024-09-22T08:56:24.448779+0000","last_clean":"2024-09-22T08:56:24.448779+0000","last_became_active":"2024-09-22T08:15:04.956585+0000","last_became_peered":"2024-09-22T08:15:04.956585+0000","last_unstale":"2024-09-22T08:56:24.448779+0000","last_undegraded":"2024-09-22T08:56:24.448779+0000","last_fullsized":"2024-09-22T08:56:24.448779+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'190","last_scrub_stamp":"2024-09-22T08:56:24.448616+0000","last_deep_scrub":"263'190","last_deep_scrub_stamp":"2024-09-22T08:56:24.448616+0000","last_clean_scrub_stamp":"2024-09-22T08:56:24.448616+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:28:39.635896+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":533,"num_read_kb":28072,"num_write":815,"num_write_kb":27925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":530,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:25.950025+0000","last_change":"2024-09-22T08:56:25.949974+0000","last_active":"2024-09-22T08:56:25.950025+0000","last_peered":"2024-09-22T08:56:25.950025+0000","last_clean":"2024-09-22T08:56:25.950025+0000","last_became_active":"2024-09-22T08:14:54.727321+0000","last_became_peered":"2024-09-22T08:14:54.727321+0000","last_unstale":"2024-09-22T08:56:25.950025+0000","last_undegraded":"2024-09-22T08:56:25.950025+0000","last_fullsized":"2024-09-22T08:56:25.950025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:25.949885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:25.949885+0000","last_clean_scrub_stamp":"2024-09-22T08:56:25.949885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:04:26.428044+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00058148900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:37.488967+0000","last_change":"2024-09-22T08:56:37.488910+0000","last_active":"2024-09-22T08:56:37.488967+0000","last_peered":"2024-09-22T08:56:37.488967+0000","last_clean":"2024-09-22T08:56:37.488967+0000","last_became_active":"2024-09-22T08:15:08.974823+0000","last_became_peered":"2024-09-22T08:15:08.974823+0000","last_unstale":"2024-09-22T08:56:37.488967+0000","last_undegraded":"2024-09-22T08:56:37.488967+0000","last_fullsized":"2024-09-22T08:56:37.488967+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:37.488797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:37.488797+0000","last_clean_scrub_stamp":"2024-09-22T08:56:37.488797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:06:57.904560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"263'166","reported_seq":730,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:42.518299+0000","last_change":"2024-09-22T08:56:42.518232+0000","last_active":"2024-09-22T08:56:42.518299+0000","last_peered":"2024-09-22T08:56:42.518299+0000","last_clean":"2024-09-22T08:56:42.518299+0000","last_became_active":"2024-09-22T08:15:10.991426+0000","last_became_peered":"2024-09-22T08:15:10.991426+0000","last_unstale":"2024-09-22T08:56:42.518299+0000","last_undegraded":"2024-09-22T08:56:42.518299+0000","last_fullsized":"2024-09-22T08:56:42.518299+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'166","last_scrub_stamp":"2024-09-22T08:56:42.518128+0000","last_deep_scrub":"263'166","last_deep_scrub_stamp":"2024-09-22T08:56:42.518128+0000","last_clean_scrub_stamp":"2024-09-22T08:56:42.518128+0000","objects_scrubbed":8,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:43:46.934148+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":204,"num_read_kb":193,"num_write":140,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"263'790","reported_seq":4945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:43.715391+0000","last_change":"2024-09-22T08:56:43.715300+0000","last_active":"2024-09-22T08:56:43.715391+0000","last_peered":"2024-09-22T08:56:43.715391+0000","last_clean":"2024-09-22T08:56:43.715391+0000","last_became_active":"2024-09-22T08:15:13.013828+0000","last_became_peered":"2024-09-22T08:15:13.013828+0000","last_unstale":"2024-09-22T08:56:43.715391+0000","last_undegraded":"2024-09-22T08:56:43.715391+0000","last_fullsized":"2024-09-22T08:56:43.715391+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'790","last_scrub_stamp":"2024-09-22T08:56:43.715184+0000","last_deep_scrub":"263'790","last_deep_scrub_stamp":"2024-09-22T08:56:43.715184+0000","last_clean_scrub_stamp":"2024-09-22T08:56:43.715184+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:50:19.357092+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"263'144","reported_seq":652,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:50.354891+0000","last_change":"2024-09-22T08:56:50.354891+0000","last_active":"2024-09-22T08:56:50.354891+0000","last_peered":"2024-09-22T08:56:50.354891+0000","last_clean":"2024-09-22T08:56:50.354891+0000","last_became_active":"2024-09-22T08:15:15.013976+0000","last_became_peered":"2024-09-22T08:15:15.013976+0000","last_unstale":"2024-09-22T08:56:50.354891+0000","last_undegraded":"2024-09-22T08:56:50.354891+0000","last_fullsized":"2024-09-22T08:56:50.354891+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'144","last_scrub_stamp":"2024-09-22T08:56:50.354798+0000","last_deep_scrub":"263'144","last_deep_scrub_stamp":"2024-09-22T08:56:50.354798+0000","last_clean_scrub_stamp":"2024-09-22T08:56:50.354798+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:52.505999+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":177,"num_read_kb":172,"num_write":337,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"263'453","reported_seq":1960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:31.604903+0000","last_change":"2024-09-22T08:56:31.604854+0000","last_active":"2024-09-22T08:56:31.604903+0000","last_peered":"2024-09-22T08:56:31.604903+0000","last_clean":"2024-09-22T08:56:31.604903+0000","last_became_active":"2024-09-22T08:15:06.966387+0000","last_became_peered":"2024-09-22T08:15:06.966387+0000","last_unstale":"2024-09-22T08:56:31.604903+0000","last_undegraded":"2024-09-22T08:56:31.604903+0000","last_fullsized":"2024-09-22T08:56:31.604903+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'453","last_scrub_stamp":"2024-09-22T08:56:31.604702+0000","last_deep_scrub":"263'453","last_deep_scrub_stamp":"2024-09-22T08:56:31.604702+0000","last_clean_scrub_stamp":"2024-09-22T08:56:31.604702+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:47:41.638747+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2402,"num_read_kb":2235,"num_write":539,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"263'208","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:27.494927+0000","last_change":"2024-09-22T08:56:27.494927+0000","last_active":"2024-09-22T08:56:27.494927+0000","last_peered":"2024-09-22T08:56:27.494927+0000","last_clean":"2024-09-22T08:56:27.494927+0000","last_became_active":"2024-09-22T08:15:04.951731+0000","last_became_peered":"2024-09-22T08:15:04.951731+0000","last_unstale":"2024-09-22T08:56:27.494927+0000","last_undegraded":"2024-09-22T08:56:27.494927+0000","last_fullsized":"2024-09-22T08:56:27.494927+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'208","last_scrub_stamp":"2024-09-22T08:56:27.494744+0000","last_deep_scrub":"263'208","last_deep_scrub_stamp":"2024-09-22T08:56:27.494744+0000","last_clean_scrub_stamp":"2024-09-22T08:56:27.494744+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:38:30.369670+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079922,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":440,"num_read_kb":57796,"num_write":879,"num_write_kb":62478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:25.510634+0000","last_change":"2024-09-22T08:56:25.510634+0000","last_active":"2024-09-22T08:56:25.510634+0000","last_peered":"2024-09-22T08:56:25.510634+0000","last_clean":"2024-09-22T08:56:25.510634+0000","last_became_active":"2024-09-22T08:14:55.585607+0000","last_became_peered":"2024-09-22T08:14:55.585607+0000","last_unstale":"2024-09-22T08:56:25.510634+0000","last_undegraded":"2024-09-22T08:56:25.510634+0000","last_fullsized":"2024-09-22T08:56:25.510634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:25.510529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:25.510529+0000","last_clean_scrub_stamp":"2024-09-22T08:56:25.510529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:13:03.897890+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00049298099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:48.865761+0000","last_change":"2024-09-22T08:56:48.865761+0000","last_active":"2024-09-22T08:56:48.865761+0000","last_peered":"2024-09-22T08:56:48.865761+0000","last_clean":"2024-09-22T08:56:48.865761+0000","last_became_active":"2024-09-22T08:15:08.969373+0000","last_became_peered":"2024-09-22T08:15:08.969373+0000","last_unstale":"2024-09-22T08:56:48.865761+0000","last_undegraded":"2024-09-22T08:56:48.865761+0000","last_fullsized":"2024-09-22T08:56:48.865761+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:48.865660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:48.865660+0000","last_clean_scrub_stamp":"2024-09-22T08:56:48.865660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:09:09.886307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"263'111","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:54.862235+0000","last_change":"2024-09-22T08:56:54.862235+0000","last_active":"2024-09-22T08:56:54.862235+0000","last_peered":"2024-09-22T08:56:54.862235+0000","last_clean":"2024-09-22T08:56:54.862235+0000","last_became_active":"2024-09-22T08:15:10.984232+0000","last_became_peered":"2024-09-22T08:15:10.984232+0000","last_unstale":"2024-09-22T08:56:54.862235+0000","last_undegraded":"2024-09-22T08:56:54.862235+0000","last_fullsized":"2024-09-22T08:56:54.862235+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'111","last_scrub_stamp":"2024-09-22T08:56:54.862146+0000","last_deep_scrub":"263'111","last_deep_scrub_stamp":"2024-09-22T08:56:54.862146+0000","last_clean_scrub_stamp":"2024-09-22T08:56:54.862146+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:10:40.543230+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":116,"num_write":82,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"263'793","reported_seq":2224,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:49.399364+0000","last_change":"2024-09-22T08:56:49.399303+0000","last_active":"2024-09-22T08:56:49.399364+0000","last_peered":"2024-09-22T08:56:49.399364+0000","last_clean":"2024-09-22T08:56:49.399364+0000","last_became_active":"2024-09-22T08:15:13.008027+0000","last_became_peered":"2024-09-22T08:15:13.008027+0000","last_unstale":"2024-09-22T08:56:49.399364+0000","last_undegraded":"2024-09-22T08:56:49.399364+0000","last_fullsized":"2024-09-22T08:56:49.399364+0000","mapping_epoch":31,"log_start":"263'701","ondisk_log_start":"263'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'793","last_scrub_stamp":"2024-09-22T08:56:49.399221+0000","last_deep_scrub":"263'793","last_deep_scrub_stamp":"2024-09-22T08:56:49.399221+0000","last_clean_scrub_stamp":"2024-09-22T08:56:49.399221+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":701,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:13:29.095907+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"263'201","reported_seq":723,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:56.460386+0000","last_change":"2024-09-22T08:56:56.460386+0000","last_active":"2024-09-22T08:56:56.460386+0000","last_peered":"2024-09-22T08:56:56.460386+0000","last_clean":"2024-09-22T08:56:56.460386+0000","last_became_active":"2024-09-22T08:15:15.014423+0000","last_became_peered":"2024-09-22T08:15:15.014423+0000","last_unstale":"2024-09-22T08:56:56.460386+0000","last_undegraded":"2024-09-22T08:56:56.460386+0000","last_fullsized":"2024-09-22T08:56:56.460386+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'201","last_scrub_stamp":"2024-09-22T08:56:56.460303+0000","last_deep_scrub":"263'201","last_deep_scrub_stamp":"2024-09-22T08:56:56.460303+0000","last_clean_scrub_stamp":"2024-09-22T08:56:56.460303+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:28:29.986558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":250,"num_read_kb":232,"num_write":460,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"263'500","reported_seq":2070,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:30.332108+0000","last_change":"2024-09-22T08:56:30.332020+0000","last_active":"2024-09-22T08:56:30.332108+0000","last_peered":"2024-09-22T08:56:30.332108+0000","last_clean":"2024-09-22T08:56:30.332108+0000","last_became_active":"2024-09-22T08:15:06.968153+0000","last_became_peered":"2024-09-22T08:15:06.968153+0000","last_unstale":"2024-09-22T08:56:30.332108+0000","last_undegraded":"2024-09-22T08:56:30.332108+0000","last_fullsized":"2024-09-22T08:56:30.332108+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'500","last_scrub_stamp":"2024-09-22T08:56:30.331876+0000","last_deep_scrub":"263'500","last_deep_scrub_stamp":"2024-09-22T08:56:30.331876+0000","last_clean_scrub_stamp":"2024-09-22T08:56:30.331876+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:12:28.407646+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2565,"num_read_kb":2386,"num_write":597,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"263'200","reported_seq":826,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:24.516850+0000","last_change":"2024-09-22T08:56:24.516850+0000","last_active":"2024-09-22T08:56:24.516850+0000","last_peered":"2024-09-22T08:56:24.516850+0000","last_clean":"2024-09-22T08:56:24.516850+0000","last_became_active":"2024-09-22T08:15:04.943901+0000","last_became_peered":"2024-09-22T08:15:04.943901+0000","last_unstale":"2024-09-22T08:56:24.516850+0000","last_undegraded":"2024-09-22T08:56:24.516850+0000","last_fullsized":"2024-09-22T08:56:24.516850+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'200","last_scrub_stamp":"2024-09-22T08:56:24.516736+0000","last_deep_scrub":"263'200","last_deep_scrub_stamp":"2024-09-22T08:56:24.516736+0000","last_clean_scrub_stamp":"2024-09-22T08:56:24.516736+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:25:37.932151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":512,"num_read_kb":4964,"num_write":959,"num_write_kb":21539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:26.935540+0000","last_change":"2024-09-22T08:56:26.935540+0000","last_active":"2024-09-22T08:56:26.935540+0000","last_peered":"2024-09-22T08:56:26.935540+0000","last_clean":"2024-09-22T08:56:26.935540+0000","last_became_active":"2024-09-22T08:14:55.585485+0000","last_became_peered":"2024-09-22T08:14:55.585485+0000","last_unstale":"2024-09-22T08:56:26.935540+0000","last_undegraded":"2024-09-22T08:56:26.935540+0000","last_fullsized":"2024-09-22T08:56:26.935540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:26.935425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:26.935425+0000","last_clean_scrub_stamp":"2024-09-22T08:56:26.935425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:24:27.484352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012642249999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:41.758864+0000","last_change":"2024-09-22T08:56:41.758786+0000","last_active":"2024-09-22T08:56:41.758864+0000","last_peered":"2024-09-22T08:56:41.758864+0000","last_clean":"2024-09-22T08:56:41.758864+0000","last_became_active":"2024-09-22T08:15:08.979291+0000","last_became_peered":"2024-09-22T08:15:08.979291+0000","last_unstale":"2024-09-22T08:56:41.758864+0000","last_undegraded":"2024-09-22T08:56:41.758864+0000","last_fullsized":"2024-09-22T08:56:41.758864+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:41.758704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:41.758704+0000","last_clean_scrub_stamp":"2024-09-22T08:56:41.758704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:27:55.044646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"263'326","reported_seq":1046,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:41.482031+0000","last_change":"2024-09-22T08:56:41.481976+0000","last_active":"2024-09-22T08:56:41.482031+0000","last_peered":"2024-09-22T08:56:41.482031+0000","last_clean":"2024-09-22T08:56:41.482031+0000","last_became_active":"2024-09-22T08:15:10.979261+0000","last_became_peered":"2024-09-22T08:15:10.979261+0000","last_unstale":"2024-09-22T08:56:41.482031+0000","last_undegraded":"2024-09-22T08:56:41.482031+0000","last_fullsized":"2024-09-22T08:56:41.482031+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'326","last_scrub_stamp":"2024-09-22T08:56:41.481863+0000","last_deep_scrub":"263'326","last_deep_scrub_stamp":"2024-09-22T08:56:41.481863+0000","last_clean_scrub_stamp":"2024-09-22T08:56:41.481863+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:35:06.044679+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25829,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":462,"num_read_kb":686,"num_write":234,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:53.790947+0000","last_change":"2024-09-22T08:56:53.790947+0000","last_active":"2024-09-22T08:56:53.790947+0000","last_peered":"2024-09-22T08:56:53.790947+0000","last_clean":"2024-09-22T08:56:53.790947+0000","last_became_active":"2024-09-22T08:15:13.003041+0000","last_became_peered":"2024-09-22T08:15:13.003041+0000","last_unstale":"2024-09-22T08:56:53.790947+0000","last_undegraded":"2024-09-22T08:56:53.790947+0000","last_fullsized":"2024-09-22T08:56:53.790947+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:53.790859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:53.790859+0000","last_clean_scrub_stamp":"2024-09-22T08:56:53.790859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:27:05.715455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"263'130","reported_seq":636,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:48.323891+0000","last_change":"2024-09-22T08:56:48.323891+0000","last_active":"2024-09-22T08:56:48.323891+0000","last_peered":"2024-09-22T08:56:48.323891+0000","last_clean":"2024-09-22T08:56:48.323891+0000","last_became_active":"2024-09-22T08:15:15.014775+0000","last_became_peered":"2024-09-22T08:15:15.014775+0000","last_unstale":"2024-09-22T08:56:48.323891+0000","last_undegraded":"2024-09-22T08:56:48.323891+0000","last_fullsized":"2024-09-22T08:56:48.323891+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'130","last_scrub_stamp":"2024-09-22T08:56:48.323737+0000","last_deep_scrub":"263'130","last_deep_scrub_stamp":"2024-09-22T08:56:48.323737+0000","last_clean_scrub_stamp":"2024-09-22T08:56:48.323737+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:15:30.889666+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":162,"num_read_kb":158,"num_write":286,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"263'109","reported_seq":668,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:57.834349+0000","last_change":"2024-09-22T08:56:57.834349+0000","last_active":"2024-09-22T08:56:57.834349+0000","last_peered":"2024-09-22T08:56:57.834349+0000","last_clean":"2024-09-22T08:56:57.834349+0000","last_became_active":"2024-09-22T08:15:15.020653+0000","last_became_peered":"2024-09-22T08:15:15.020653+0000","last_unstale":"2024-09-22T08:56:57.834349+0000","last_undegraded":"2024-09-22T08:56:57.834349+0000","last_fullsized":"2024-09-22T08:56:57.834349+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'109","last_scrub_stamp":"2024-09-22T08:56:57.834260+0000","last_deep_scrub":"263'109","last_deep_scrub_stamp":"2024-09-22T08:56:57.834260+0000","last_clean_scrub_stamp":"2024-09-22T08:56:57.834260+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:23:10.854519+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":202,"num_read_kb":202,"num_write":258,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"263'491","reported_seq":2223,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:31.374825+0000","last_change":"2024-09-22T08:56:31.374754+0000","last_active":"2024-09-22T08:56:31.374825+0000","last_peered":"2024-09-22T08:56:31.374825+0000","last_clean":"2024-09-22T08:56:31.374825+0000","last_became_active":"2024-09-22T08:15:06.970382+0000","last_became_peered":"2024-09-22T08:15:06.970382+0000","last_unstale":"2024-09-22T08:56:31.374825+0000","last_undegraded":"2024-09-22T08:56:31.374825+0000","last_fullsized":"2024-09-22T08:56:31.374825+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'491","last_scrub_stamp":"2024-09-22T08:56:31.374652+0000","last_deep_scrub":"263'491","last_deep_scrub_stamp":"2024-09-22T08:56:31.374652+0000","last_clean_scrub_stamp":"2024-09-22T08:56:31.374652+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:29:57.099432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2792,"num_read_kb":2647,"num_write":560,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3043,"num_omap_keys":12,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"263'227","reported_seq":883,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:32.879014+0000","last_change":"2024-09-22T08:56:32.878958+0000","last_active":"2024-09-22T08:56:32.879014+0000","last_peered":"2024-09-22T08:56:32.879014+0000","last_clean":"2024-09-22T08:56:32.879014+0000","last_became_active":"2024-09-22T08:15:04.965572+0000","last_became_peered":"2024-09-22T08:15:04.965572+0000","last_unstale":"2024-09-22T08:56:32.879014+0000","last_undegraded":"2024-09-22T08:56:32.879014+0000","last_fullsized":"2024-09-22T08:56:32.879014+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'227","last_scrub_stamp":"2024-09-22T08:56:32.878823+0000","last_deep_scrub":"263'227","last_deep_scrub_stamp":"2024-09-22T08:56:32.878823+0000","last_clean_scrub_stamp":"2024-09-22T08:56:32.878823+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:10:43.868372+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":598,"num_read_kb":42984,"num_write":1013,"num_write_kb":35756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:40.519311+0000","last_change":"2024-09-22T08:56:40.519216+0000","last_active":"2024-09-22T08:56:40.519311+0000","last_peered":"2024-09-22T08:56:40.519311+0000","last_clean":"2024-09-22T08:56:40.519311+0000","last_became_active":"2024-09-22T08:15:08.976444+0000","last_became_peered":"2024-09-22T08:15:08.976444+0000","last_unstale":"2024-09-22T08:56:40.519311+0000","last_undegraded":"2024-09-22T08:56:40.519311+0000","last_fullsized":"2024-09-22T08:56:40.519311+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:40.519119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:40.519119+0000","last_clean_scrub_stamp":"2024-09-22T08:56:40.519119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:33:04.166853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"263'137","reported_seq":712,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:44.556153+0000","last_change":"2024-09-22T08:56:44.556082+0000","last_active":"2024-09-22T08:56:44.556153+0000","last_peered":"2024-09-22T08:56:44.556153+0000","last_clean":"2024-09-22T08:56:44.556153+0000","last_became_active":"2024-09-22T08:15:10.987623+0000","last_became_peered":"2024-09-22T08:15:10.987623+0000","last_unstale":"2024-09-22T08:56:44.556153+0000","last_undegraded":"2024-09-22T08:56:44.556153+0000","last_fullsized":"2024-09-22T08:56:44.556153+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'137","last_scrub_stamp":"2024-09-22T08:56:44.555992+0000","last_deep_scrub":"263'137","last_deep_scrub_stamp":"2024-09-22T08:56:44.555992+0000","last_clean_scrub_stamp":"2024-09-22T08:56:44.555992+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:46:15.194164+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8761,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":170,"num_read_kb":207,"num_write":88,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:43.234153+0000","last_change":"2024-09-22T08:56:43.234096+0000","last_active":"2024-09-22T08:56:43.234153+0000","last_peered":"2024-09-22T08:56:43.234153+0000","last_clean":"2024-09-22T08:56:43.234153+0000","last_became_active":"2024-09-22T08:15:12.997350+0000","last_became_peered":"2024-09-22T08:15:12.997350+0000","last_unstale":"2024-09-22T08:56:43.234153+0000","last_undegraded":"2024-09-22T08:56:43.234153+0000","last_fullsized":"2024-09-22T08:56:43.234153+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:43.234008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:43.234008+0000","last_clean_scrub_stamp":"2024-09-22T08:56:43.234008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:14:46.102555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"263'112","reported_seq":617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:48.305389+0000","last_change":"2024-09-22T08:56:48.305333+0000","last_active":"2024-09-22T08:56:48.305389+0000","last_peered":"2024-09-22T08:56:48.305389+0000","last_clean":"2024-09-22T08:56:48.305389+0000","last_became_active":"2024-09-22T08:15:15.016918+0000","last_became_peered":"2024-09-22T08:15:15.016918+0000","last_unstale":"2024-09-22T08:56:48.305389+0000","last_undegraded":"2024-09-22T08:56:48.305389+0000","last_fullsized":"2024-09-22T08:56:48.305389+0000","mapping_epoch":33,"log_start":"263'101","ondisk_log_start":"263'101","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'112","last_scrub_stamp":"2024-09-22T08:56:48.305233+0000","last_deep_scrub":"263'112","last_deep_scrub_stamp":"2024-09-22T08:56:48.305233+0000","last_clean_scrub_stamp":"2024-09-22T08:56:48.305233+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":101,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:46:52.130848+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":125,"num_write":254,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"263'1038","reported_seq":2830,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:33.664286+0000","last_change":"2024-09-22T08:56:33.664223+0000","last_active":"2024-09-22T08:56:33.664286+0000","last_peered":"2024-09-22T08:56:33.664286+0000","last_clean":"2024-09-22T08:56:33.664286+0000","last_became_active":"2024-09-22T08:15:06.965465+0000","last_became_peered":"2024-09-22T08:15:06.965465+0000","last_unstale":"2024-09-22T08:56:33.664286+0000","last_undegraded":"2024-09-22T08:56:33.664286+0000","last_fullsized":"2024-09-22T08:56:33.664286+0000","mapping_epoch":25,"log_start":"263'1000","ondisk_log_start":"263'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1038","last_scrub_stamp":"2024-09-22T08:56:33.664132+0000","last_deep_scrub":"263'1038","last_deep_scrub_stamp":"2024-09-22T08:56:33.664132+0000","last_clean_scrub_stamp":"2024-09-22T08:56:33.664132+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":1000,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:46:03.562471+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5105,"num_read_kb":4580,"num_write":1460,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"263'210","reported_seq":836,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:27.467279+0000","last_change":"2024-09-22T08:56:27.467279+0000","last_active":"2024-09-22T08:56:27.467279+0000","last_peered":"2024-09-22T08:56:27.467279+0000","last_clean":"2024-09-22T08:56:27.467279+0000","last_became_active":"2024-09-22T08:15:04.949181+0000","last_became_peered":"2024-09-22T08:15:04.949181+0000","last_unstale":"2024-09-22T08:56:27.467279+0000","last_undegraded":"2024-09-22T08:56:27.467279+0000","last_fullsized":"2024-09-22T08:56:27.467279+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'210","last_scrub_stamp":"2024-09-22T08:56:27.467159+0000","last_deep_scrub":"263'210","last_deep_scrub_stamp":"2024-09-22T08:56:27.467159+0000","last_clean_scrub_stamp":"2024-09-22T08:56:27.467159+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:15:11.987517+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":538,"num_read_kb":11766,"num_write":957,"num_write_kb":45959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:42.725220+0000","last_change":"2024-09-22T08:56:42.725152+0000","last_active":"2024-09-22T08:56:42.725220+0000","last_peered":"2024-09-22T08:56:42.725220+0000","last_clean":"2024-09-22T08:56:42.725220+0000","last_became_active":"2024-09-22T08:15:08.975704+0000","last_became_peered":"2024-09-22T08:15:08.975704+0000","last_unstale":"2024-09-22T08:56:42.725220+0000","last_undegraded":"2024-09-22T08:56:42.725220+0000","last_fullsized":"2024-09-22T08:56:42.725220+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:42.725054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:42.725054+0000","last_clean_scrub_stamp":"2024-09-22T08:56:42.725054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:53:10.767578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"263'41","reported_seq":550,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:48.817448+0000","last_change":"2024-09-22T08:56:48.817379+0000","last_active":"2024-09-22T08:56:48.817448+0000","last_peered":"2024-09-22T08:56:48.817448+0000","last_clean":"2024-09-22T08:56:48.817448+0000","last_became_active":"2024-09-22T08:15:10.983593+0000","last_became_peered":"2024-09-22T08:15:10.983593+0000","last_unstale":"2024-09-22T08:56:48.817448+0000","last_undegraded":"2024-09-22T08:56:48.817448+0000","last_fullsized":"2024-09-22T08:56:48.817448+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'41","last_scrub_stamp":"2024-09-22T08:56:48.817295+0000","last_deep_scrub":"263'41","last_deep_scrub_stamp":"2024-09-22T08:56:48.817295+0000","last_clean_scrub_stamp":"2024-09-22T08:56:48.817295+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:46:42.574241+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:44.280906+0000","last_change":"2024-09-22T08:56:44.280797+0000","last_active":"2024-09-22T08:56:44.280906+0000","last_peered":"2024-09-22T08:56:44.280906+0000","last_clean":"2024-09-22T08:56:44.280906+0000","last_became_active":"2024-09-22T08:15:13.019020+0000","last_became_peered":"2024-09-22T08:15:13.019020+0000","last_unstale":"2024-09-22T08:56:44.280906+0000","last_undegraded":"2024-09-22T08:56:44.280906+0000","last_fullsized":"2024-09-22T08:56:44.280906+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:44.280680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:44.280680+0000","last_clean_scrub_stamp":"2024-09-22T08:56:44.280680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:02:29.842179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"263'184","reported_seq":712,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:52.585551+0000","last_change":"2024-09-22T08:56:52.585551+0000","last_active":"2024-09-22T08:56:52.585551+0000","last_peered":"2024-09-22T08:56:52.585551+0000","last_clean":"2024-09-22T08:56:52.585551+0000","last_became_active":"2024-09-22T08:15:15.013300+0000","last_became_peered":"2024-09-22T08:15:15.013300+0000","last_unstale":"2024-09-22T08:56:52.585551+0000","last_undegraded":"2024-09-22T08:56:52.585551+0000","last_fullsized":"2024-09-22T08:56:52.585551+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'184","last_scrub_stamp":"2024-09-22T08:56:52.585437+0000","last_deep_scrub":"263'184","last_deep_scrub_stamp":"2024-09-22T08:56:52.585437+0000","last_clean_scrub_stamp":"2024-09-22T08:56:52.585437+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:20:42.367609+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":337,"num_read_kb":325,"num_write":401,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"263'1201","reported_seq":2849,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:32.645387+0000","last_change":"2024-09-22T08:56:32.645335+0000","last_active":"2024-09-22T08:56:32.645387+0000","last_peered":"2024-09-22T08:56:32.645387+0000","last_clean":"2024-09-22T08:56:32.645387+0000","last_became_active":"2024-09-22T08:15:06.957116+0000","last_became_peered":"2024-09-22T08:15:06.957116+0000","last_unstale":"2024-09-22T08:56:32.645387+0000","last_undegraded":"2024-09-22T08:56:32.645387+0000","last_fullsized":"2024-09-22T08:56:32.645387+0000","mapping_epoch":25,"log_start":"263'1100","ondisk_log_start":"263'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1201","last_scrub_stamp":"2024-09-22T08:56:32.645252+0000","last_deep_scrub":"263'1201","last_deep_scrub_stamp":"2024-09-22T08:56:32.645252+0000","last_clean_scrub_stamp":"2024-09-22T08:56:32.645252+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":1100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:00:07.106550+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5635,"num_read_kb":5002,"num_write":1685,"num_write_kb":733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":434,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"263'193","reported_seq":815,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:25.336972+0000","last_change":"2024-09-22T08:56:25.336972+0000","last_active":"2024-09-22T08:56:25.336972+0000","last_peered":"2024-09-22T08:56:25.336972+0000","last_clean":"2024-09-22T08:56:25.336972+0000","last_became_active":"2024-09-22T08:15:04.968557+0000","last_became_peered":"2024-09-22T08:15:04.968557+0000","last_unstale":"2024-09-22T08:56:25.336972+0000","last_undegraded":"2024-09-22T08:56:25.336972+0000","last_fullsized":"2024-09-22T08:56:25.336972+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'193","last_scrub_stamp":"2024-09-22T08:56:25.336860+0000","last_deep_scrub":"263'193","last_deep_scrub_stamp":"2024-09-22T08:56:25.336860+0000","last_clean_scrub_stamp":"2024-09-22T08:56:25.336860+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:20:48.349873+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079920,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":520,"num_read_kb":8164,"num_write":864,"num_write_kb":39531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:36.418277+0000","last_change":"2024-09-22T08:56:36.418210+0000","last_active":"2024-09-22T08:56:36.418277+0000","last_peered":"2024-09-22T08:56:36.418277+0000","last_clean":"2024-09-22T08:56:36.418277+0000","last_became_active":"2024-09-22T08:15:08.975001+0000","last_became_peered":"2024-09-22T08:15:08.975001+0000","last_unstale":"2024-09-22T08:56:36.418277+0000","last_undegraded":"2024-09-22T08:56:36.418277+0000","last_fullsized":"2024-09-22T08:56:36.418277+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:36.418114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:36.418114+0000","last_clean_scrub_stamp":"2024-09-22T08:56:36.418114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:03:22.345130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"263'173","reported_seq":772,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:39.158251+0000","last_change":"2024-09-22T08:56:39.158193+0000","last_active":"2024-09-22T08:56:39.158251+0000","last_peered":"2024-09-22T08:56:39.158251+0000","last_clean":"2024-09-22T08:56:39.158251+0000","last_became_active":"2024-09-22T08:15:10.980443+0000","last_became_peered":"2024-09-22T08:15:10.980443+0000","last_unstale":"2024-09-22T08:56:39.158251+0000","last_undegraded":"2024-09-22T08:56:39.158251+0000","last_fullsized":"2024-09-22T08:56:39.158251+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'173","last_scrub_stamp":"2024-09-22T08:56:39.158047+0000","last_deep_scrub":"263'173","last_deep_scrub_stamp":"2024-09-22T08:56:39.158047+0000","last_clean_scrub_stamp":"2024-09-22T08:56:39.158047+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:42:11.473386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":222,"num_read_kb":300,"num_write":124,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:44.753676+0000","last_change":"2024-09-22T08:56:44.753619+0000","last_active":"2024-09-22T08:56:44.753676+0000","last_peered":"2024-09-22T08:56:44.753676+0000","last_clean":"2024-09-22T08:56:44.753676+0000","last_became_active":"2024-09-22T08:15:13.010660+0000","last_became_peered":"2024-09-22T08:15:13.010660+0000","last_unstale":"2024-09-22T08:56:44.753676+0000","last_undegraded":"2024-09-22T08:56:44.753676+0000","last_fullsized":"2024-09-22T08:56:44.753676+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:44.753528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:44.753528+0000","last_clean_scrub_stamp":"2024-09-22T08:56:44.753528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:53:25.427397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"263'145","reported_seq":686,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:08.739402+0000","last_change":"2024-09-22T08:57:08.739402+0000","last_active":"2024-09-22T08:57:08.739402+0000","last_peered":"2024-09-22T08:57:08.739402+0000","last_clean":"2024-09-22T08:57:08.739402+0000","last_became_active":"2024-09-22T08:15:15.015497+0000","last_became_peered":"2024-09-22T08:15:15.015497+0000","last_unstale":"2024-09-22T08:57:08.739402+0000","last_undegraded":"2024-09-22T08:57:08.739402+0000","last_fullsized":"2024-09-22T08:57:08.739402+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'145","last_scrub_stamp":"2024-09-22T08:57:08.739305+0000","last_deep_scrub":"263'145","last_deep_scrub_stamp":"2024-09-22T08:57:08.739305+0000","last_clean_scrub_stamp":"2024-09-22T08:57:08.739305+0000","objects_scrubbed":4,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:34:06.050548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":885,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":300,"num_read_kb":272,"num_write":341,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"263'918","reported_seq":2773,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:29.083006+0000","last_change":"2024-09-22T08:56:29.082934+0000","last_active":"2024-09-22T08:56:29.083006+0000","last_peered":"2024-09-22T08:56:29.083006+0000","last_clean":"2024-09-22T08:56:29.083006+0000","last_became_active":"2024-09-22T08:15:06.964082+0000","last_became_peered":"2024-09-22T08:15:06.964082+0000","last_unstale":"2024-09-22T08:56:29.083006+0000","last_undegraded":"2024-09-22T08:56:29.083006+0000","last_fullsized":"2024-09-22T08:56:29.083006+0000","mapping_epoch":25,"log_start":"263'900","ondisk_log_start":"263'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'918","last_scrub_stamp":"2024-09-22T08:56:29.082837+0000","last_deep_scrub":"263'918","last_deep_scrub_stamp":"2024-09-22T08:56:29.082837+0000","last_clean_scrub_stamp":"2024-09-22T08:56:29.082837+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":900,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:49:15.428214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4594,"num_read_kb":4173,"num_write":1193,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2260,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"263'260","reported_seq":894,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:24.453691+0000","last_change":"2024-09-22T08:56:24.453691+0000","last_active":"2024-09-22T08:56:24.453691+0000","last_peered":"2024-09-22T08:56:24.453691+0000","last_clean":"2024-09-22T08:56:24.453691+0000","last_became_active":"2024-09-22T08:15:04.954431+0000","last_became_peered":"2024-09-22T08:15:04.954431+0000","last_unstale":"2024-09-22T08:56:24.453691+0000","last_undegraded":"2024-09-22T08:56:24.453691+0000","last_fullsized":"2024-09-22T08:56:24.453691+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'260","last_scrub_stamp":"2024-09-22T08:56:24.453598+0000","last_deep_scrub":"263'260","last_deep_scrub_stamp":"2024-09-22T08:56:24.453598+0000","last_clean_scrub_stamp":"2024-09-22T08:56:24.453598+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:11:53.936014+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":625,"num_read_kb":10749,"num_write":1043,"num_write_kb":36368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:51.899338+0000","last_change":"2024-09-22T08:56:51.899288+0000","last_active":"2024-09-22T08:56:51.899338+0000","last_peered":"2024-09-22T08:56:51.899338+0000","last_clean":"2024-09-22T08:56:51.899338+0000","last_became_active":"2024-09-22T08:15:08.978080+0000","last_became_peered":"2024-09-22T08:15:08.978080+0000","last_unstale":"2024-09-22T08:56:51.899338+0000","last_undegraded":"2024-09-22T08:56:51.899338+0000","last_fullsized":"2024-09-22T08:56:51.899338+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:51.899200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:51.899200+0000","last_clean_scrub_stamp":"2024-09-22T08:56:51.899200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:44:03.626002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"263'139","reported_seq":711,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:43.442229+0000","last_change":"2024-09-22T08:56:43.442127+0000","last_active":"2024-09-22T08:56:43.442229+0000","last_peered":"2024-09-22T08:56:43.442229+0000","last_clean":"2024-09-22T08:56:43.442229+0000","last_became_active":"2024-09-22T08:15:10.975066+0000","last_became_peered":"2024-09-22T08:15:10.975066+0000","last_unstale":"2024-09-22T08:56:43.442229+0000","last_undegraded":"2024-09-22T08:56:43.442229+0000","last_fullsized":"2024-09-22T08:56:43.442229+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'139","last_scrub_stamp":"2024-09-22T08:56:43.442026+0000","last_deep_scrub":"263'139","last_deep_scrub_stamp":"2024-09-22T08:56:43.442026+0000","last_clean_scrub_stamp":"2024-09-22T08:56:43.442026+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:13:39.485401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4721,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":157,"num_read_kb":223,"num_write":80,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:44.216707+0000","last_change":"2024-09-22T08:56:44.216632+0000","last_active":"2024-09-22T08:56:44.216707+0000","last_peered":"2024-09-22T08:56:44.216707+0000","last_clean":"2024-09-22T08:56:44.216707+0000","last_became_active":"2024-09-22T08:15:13.008005+0000","last_became_peered":"2024-09-22T08:15:13.008005+0000","last_unstale":"2024-09-22T08:56:44.216707+0000","last_undegraded":"2024-09-22T08:56:44.216707+0000","last_fullsized":"2024-09-22T08:56:44.216707+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:44.216543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:44.216543+0000","last_clean_scrub_stamp":"2024-09-22T08:56:44.216543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:31:37.425715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"263'387","reported_seq":1920,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:43.895675+0000","last_change":"2024-09-22T08:56:43.895609+0000","last_active":"2024-09-22T08:56:43.895675+0000","last_peered":"2024-09-22T08:56:43.895675+0000","last_clean":"2024-09-22T08:56:43.895675+0000","last_became_active":"2024-09-22T08:15:06.974083+0000","last_became_peered":"2024-09-22T08:15:06.974083+0000","last_unstale":"2024-09-22T08:56:43.895675+0000","last_undegraded":"2024-09-22T08:56:43.895675+0000","last_fullsized":"2024-09-22T08:56:43.895675+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'387","last_scrub_stamp":"2024-09-22T08:56:43.895521+0000","last_deep_scrub":"263'387","last_deep_scrub_stamp":"2024-09-22T08:56:43.895521+0000","last_clean_scrub_stamp":"2024-09-22T08:56:43.895521+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:38:10.001396+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2095,"num_read_kb":2009,"num_write":415,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"263'220","reported_seq":862,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:30.421662+0000","last_change":"2024-09-22T08:56:30.421662+0000","last_active":"2024-09-22T08:56:30.421662+0000","last_peered":"2024-09-22T08:56:30.421662+0000","last_clean":"2024-09-22T08:56:30.421662+0000","last_became_active":"2024-09-22T08:15:04.953371+0000","last_became_peered":"2024-09-22T08:15:04.953371+0000","last_unstale":"2024-09-22T08:56:30.421662+0000","last_undegraded":"2024-09-22T08:56:30.421662+0000","last_fullsized":"2024-09-22T08:56:30.421662+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'220","last_scrub_stamp":"2024-09-22T08:56:30.421545+0000","last_deep_scrub":"263'220","last_deep_scrub_stamp":"2024-09-22T08:56:30.421545+0000","last_clean_scrub_stamp":"2024-09-22T08:56:30.421545+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:22:31.706556+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079956,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":551,"num_read_kb":20845,"num_write":984,"num_write_kb":34041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:41.502765+0000","last_change":"2024-09-22T08:56:41.502715+0000","last_active":"2024-09-22T08:56:41.502765+0000","last_peered":"2024-09-22T08:56:41.502765+0000","last_clean":"2024-09-22T08:56:41.502765+0000","last_became_active":"2024-09-22T08:15:08.977975+0000","last_became_peered":"2024-09-22T08:15:08.977975+0000","last_unstale":"2024-09-22T08:56:41.502765+0000","last_undegraded":"2024-09-22T08:56:41.502765+0000","last_fullsized":"2024-09-22T08:56:41.502765+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:41.502631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:41.502631+0000","last_clean_scrub_stamp":"2024-09-22T08:56:41.502631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:47:58.395562+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"263'218","reported_seq":847,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:46.543775+0000","last_change":"2024-09-22T08:56:46.543724+0000","last_active":"2024-09-22T08:56:46.543775+0000","last_peered":"2024-09-22T08:56:46.543775+0000","last_clean":"2024-09-22T08:56:46.543775+0000","last_became_active":"2024-09-22T08:15:10.985454+0000","last_became_peered":"2024-09-22T08:15:10.985454+0000","last_unstale":"2024-09-22T08:56:46.543775+0000","last_undegraded":"2024-09-22T08:56:46.543775+0000","last_fullsized":"2024-09-22T08:56:46.543775+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'218","last_scrub_stamp":"2024-09-22T08:56:46.543626+0000","last_deep_scrub":"263'218","last_deep_scrub_stamp":"2024-09-22T08:56:46.543626+0000","last_clean_scrub_stamp":"2024-09-22T08:56:46.543626+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:35:26.113720+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24540,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":311,"num_read_kb":482,"num_write":196,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:45.264495+0000","last_change":"2024-09-22T08:56:45.264495+0000","last_active":"2024-09-22T08:56:45.264495+0000","last_peered":"2024-09-22T08:56:45.264495+0000","last_clean":"2024-09-22T08:56:45.264495+0000","last_became_active":"2024-09-22T08:15:13.008080+0000","last_became_peered":"2024-09-22T08:15:13.008080+0000","last_unstale":"2024-09-22T08:56:45.264495+0000","last_undegraded":"2024-09-22T08:56:45.264495+0000","last_fullsized":"2024-09-22T08:56:45.264495+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:45.264424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:45.264424+0000","last_clean_scrub_stamp":"2024-09-22T08:56:45.264424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:22:52.072394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"263'176","reported_seq":691,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:00.431448+0000","last_change":"2024-09-22T08:57:00.431365+0000","last_active":"2024-09-22T08:57:00.431448+0000","last_peered":"2024-09-22T08:57:00.431448+0000","last_clean":"2024-09-22T08:57:00.431448+0000","last_became_active":"2024-09-22T08:15:15.014112+0000","last_became_peered":"2024-09-22T08:15:15.014112+0000","last_unstale":"2024-09-22T08:57:00.431448+0000","last_undegraded":"2024-09-22T08:57:00.431448+0000","last_fullsized":"2024-09-22T08:57:00.431448+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'176","last_scrub_stamp":"2024-09-22T08:57:00.431270+0000","last_deep_scrub":"263'176","last_deep_scrub_stamp":"2024-09-22T08:57:00.431270+0000","last_clean_scrub_stamp":"2024-09-22T08:57:00.431270+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:41:55.748221+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":264,"num_read_kb":269,"num_write":416,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"263'433","reported_seq":2048,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:35.716124+0000","last_change":"2024-09-22T08:56:35.716040+0000","last_active":"2024-09-22T08:56:35.716124+0000","last_peered":"2024-09-22T08:56:35.716124+0000","last_clean":"2024-09-22T08:56:35.716124+0000","last_became_active":"2024-09-22T08:15:06.966715+0000","last_became_peered":"2024-09-22T08:15:06.966715+0000","last_unstale":"2024-09-22T08:56:35.716124+0000","last_undegraded":"2024-09-22T08:56:35.716124+0000","last_fullsized":"2024-09-22T08:56:35.716124+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'433","last_scrub_stamp":"2024-09-22T08:56:35.715956+0000","last_deep_scrub":"263'433","last_deep_scrub_stamp":"2024-09-22T08:56:35.715956+0000","last_clean_scrub_stamp":"2024-09-22T08:56:35.715956+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:36:50.835174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2445,"num_read_kb":2324,"num_write":493,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"263'214","reported_seq":886,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:28.519902+0000","last_change":"2024-09-22T08:56:28.519902+0000","last_active":"2024-09-22T08:56:28.519902+0000","last_peered":"2024-09-22T08:56:28.519902+0000","last_clean":"2024-09-22T08:56:28.519902+0000","last_became_active":"2024-09-22T08:15:04.950890+0000","last_became_peered":"2024-09-22T08:15:04.950890+0000","last_unstale":"2024-09-22T08:56:28.519902+0000","last_undegraded":"2024-09-22T08:56:28.519902+0000","last_fullsized":"2024-09-22T08:56:28.519902+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'214","last_scrub_stamp":"2024-09-22T08:56:28.519814+0000","last_deep_scrub":"263'214","last_deep_scrub_stamp":"2024-09-22T08:56:28.519814+0000","last_clean_scrub_stamp":"2024-09-22T08:56:28.519814+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:35:12.489475+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":625,"num_read_kb":94909,"num_write":959,"num_write_kb":40287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"263'5","reported_seq":983,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:40.392356+0000","last_change":"2024-09-22T08:56:40.392284+0000","last_active":"2024-09-22T08:56:40.392356+0000","last_peered":"2024-09-22T08:56:40.392356+0000","last_clean":"2024-09-22T08:56:40.392356+0000","last_became_active":"2024-09-22T08:15:08.977250+0000","last_became_peered":"2024-09-22T08:15:08.977250+0000","last_unstale":"2024-09-22T08:56:40.392356+0000","last_undegraded":"2024-09-22T08:56:40.392356+0000","last_fullsized":"2024-09-22T08:56:40.392356+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-22T08:56:40.392200+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-22T08:56:40.392200+0000","last_clean_scrub_stamp":"2024-09-22T08:56:40.392200+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:58:39.531528+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":1187,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"263'177","reported_seq":767,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:58.877576+0000","last_change":"2024-09-22T08:56:58.877517+0000","last_active":"2024-09-22T08:56:58.877576+0000","last_peered":"2024-09-22T08:56:58.877576+0000","last_clean":"2024-09-22T08:56:58.877576+0000","last_became_active":"2024-09-22T08:15:10.987541+0000","last_became_peered":"2024-09-22T08:15:10.987541+0000","last_unstale":"2024-09-22T08:56:58.877576+0000","last_undegraded":"2024-09-22T08:56:58.877576+0000","last_fullsized":"2024-09-22T08:56:58.877576+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'177","last_scrub_stamp":"2024-09-22T08:56:58.877406+0000","last_deep_scrub":"263'177","last_deep_scrub_stamp":"2024-09-22T08:56:58.877406+0000","last_clean_scrub_stamp":"2024-09-22T08:56:58.877406+0000","objects_scrubbed":8,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:01:01.399059+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":217,"num_read_kb":244,"num_write":140,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:57.504885+0000","last_change":"2024-09-22T08:56:57.504819+0000","last_active":"2024-09-22T08:56:57.504885+0000","last_peered":"2024-09-22T08:56:57.504885+0000","last_clean":"2024-09-22T08:56:57.504885+0000","last_became_active":"2024-09-22T08:15:13.011781+0000","last_became_peered":"2024-09-22T08:15:13.011781+0000","last_unstale":"2024-09-22T08:56:57.504885+0000","last_undegraded":"2024-09-22T08:56:57.504885+0000","last_fullsized":"2024-09-22T08:56:57.504885+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:57.504724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:57.504724+0000","last_clean_scrub_stamp":"2024-09-22T08:56:57.504724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:19:18.602651+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"263'188","reported_seq":707,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:06.784369+0000","last_change":"2024-09-22T08:57:06.784299+0000","last_active":"2024-09-22T08:57:06.784369+0000","last_peered":"2024-09-22T08:57:06.784369+0000","last_clean":"2024-09-22T08:57:06.784369+0000","last_became_active":"2024-09-22T08:15:15.011648+0000","last_became_peered":"2024-09-22T08:15:15.011648+0000","last_unstale":"2024-09-22T08:57:06.784369+0000","last_undegraded":"2024-09-22T08:57:06.784369+0000","last_fullsized":"2024-09-22T08:57:06.784369+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'188","last_scrub_stamp":"2024-09-22T08:57:06.784206+0000","last_deep_scrub":"263'188","last_deep_scrub_stamp":"2024-09-22T08:57:06.784206+0000","last_clean_scrub_stamp":"2024-09-22T08:57:06.784206+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:05:15.993819+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":287,"num_read_kb":275,"num_write":539,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"263'439","reported_seq":1961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:30.084852+0000","last_change":"2024-09-22T08:56:30.084801+0000","last_active":"2024-09-22T08:56:30.084852+0000","last_peered":"2024-09-22T08:56:30.084852+0000","last_clean":"2024-09-22T08:56:30.084852+0000","last_became_active":"2024-09-22T08:15:06.972213+0000","last_became_peered":"2024-09-22T08:15:06.972213+0000","last_unstale":"2024-09-22T08:56:30.084852+0000","last_undegraded":"2024-09-22T08:56:30.084852+0000","last_fullsized":"2024-09-22T08:56:30.084852+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'439","last_scrub_stamp":"2024-09-22T08:56:30.084696+0000","last_deep_scrub":"263'439","last_deep_scrub_stamp":"2024-09-22T08:56:30.084696+0000","last_clean_scrub_stamp":"2024-09-22T08:56:30.084696+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:43:42.820968+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2524,"num_read_kb":2354,"num_write":541,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"263'246","reported_seq":888,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:28.829489+0000","last_change":"2024-09-22T08:56:28.829400+0000","last_active":"2024-09-22T08:56:28.829489+0000","last_peered":"2024-09-22T08:56:28.829489+0000","last_clean":"2024-09-22T08:56:28.829489+0000","last_became_active":"2024-09-22T08:15:04.959607+0000","last_became_peered":"2024-09-22T08:15:04.959607+0000","last_unstale":"2024-09-22T08:56:28.829489+0000","last_undegraded":"2024-09-22T08:56:28.829489+0000","last_fullsized":"2024-09-22T08:56:28.829489+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'246","last_scrub_stamp":"2024-09-22T08:56:28.829299+0000","last_deep_scrub":"263'246","last_deep_scrub_stamp":"2024-09-22T08:56:28.829299+0000","last_clean_scrub_stamp":"2024-09-22T08:56:28.829299+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:55:16.910471+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079903,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":565,"num_read_kb":22702,"num_write":1145,"num_write_kb":43754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:39.436024+0000","last_change":"2024-09-22T08:56:39.435951+0000","last_active":"2024-09-22T08:56:39.436024+0000","last_peered":"2024-09-22T08:56:39.436024+0000","last_clean":"2024-09-22T08:56:39.436024+0000","last_became_active":"2024-09-22T08:15:08.974925+0000","last_became_peered":"2024-09-22T08:15:08.974925+0000","last_unstale":"2024-09-22T08:56:39.436024+0000","last_undegraded":"2024-09-22T08:56:39.436024+0000","last_fullsized":"2024-09-22T08:56:39.436024+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:39.435856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:39.435856+0000","last_clean_scrub_stamp":"2024-09-22T08:56:39.435856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:57:01.098449+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"263'153","reported_seq":730,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:48.587326+0000","last_change":"2024-09-22T08:56:48.587274+0000","last_active":"2024-09-22T08:56:48.587326+0000","last_peered":"2024-09-22T08:56:48.587326+0000","last_clean":"2024-09-22T08:56:48.587326+0000","last_became_active":"2024-09-22T08:15:10.985312+0000","last_became_peered":"2024-09-22T08:15:10.985312+0000","last_unstale":"2024-09-22T08:56:48.587326+0000","last_undegraded":"2024-09-22T08:56:48.587326+0000","last_fullsized":"2024-09-22T08:56:48.587326+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'153","last_scrub_stamp":"2024-09-22T08:56:48.587185+0000","last_deep_scrub":"263'153","last_deep_scrub_stamp":"2024-09-22T08:56:48.587185+0000","last_clean_scrub_stamp":"2024-09-22T08:56:48.587185+0000","objects_scrubbed":5,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:52:46.336740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9037,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":176,"num_read_kb":231,"num_write":94,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:45.247826+0000","last_change":"2024-09-22T08:56:45.247761+0000","last_active":"2024-09-22T08:56:45.247826+0000","last_peered":"2024-09-22T08:56:45.247826+0000","last_clean":"2024-09-22T08:56:45.247826+0000","last_became_active":"2024-09-22T08:15:12.998276+0000","last_became_peered":"2024-09-22T08:15:12.998276+0000","last_unstale":"2024-09-22T08:56:45.247826+0000","last_undegraded":"2024-09-22T08:56:45.247826+0000","last_fullsized":"2024-09-22T08:56:45.247826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:45.247668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:45.247668+0000","last_clean_scrub_stamp":"2024-09-22T08:56:45.247668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:39:59.660562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"263'133","reported_seq":647,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:09.719510+0000","last_change":"2024-09-22T08:57:09.719419+0000","last_active":"2024-09-22T08:57:09.719510+0000","last_peered":"2024-09-22T08:57:09.719510+0000","last_clean":"2024-09-22T08:57:09.719510+0000","last_became_active":"2024-09-22T08:15:15.022140+0000","last_became_peered":"2024-09-22T08:15:15.022140+0000","last_unstale":"2024-09-22T08:57:09.719510+0000","last_undegraded":"2024-09-22T08:57:09.719510+0000","last_fullsized":"2024-09-22T08:57:09.719510+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'133","last_scrub_stamp":"2024-09-22T08:57:09.719265+0000","last_deep_scrub":"263'133","last_deep_scrub_stamp":"2024-09-22T08:57:09.719265+0000","last_clean_scrub_stamp":"2024-09-22T08:57:09.719265+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:26:20.156023+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":810,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":211,"num_read_kb":192,"num_write":312,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"263'535","reported_seq":2413,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:34.686288+0000","last_change":"2024-09-22T08:56:34.686230+0000","last_active":"2024-09-22T08:56:34.686288+0000","last_peered":"2024-09-22T08:56:34.686288+0000","last_clean":"2024-09-22T08:56:34.686288+0000","last_became_active":"2024-09-22T08:15:06.963136+0000","last_became_peered":"2024-09-22T08:15:06.963136+0000","last_unstale":"2024-09-22T08:56:34.686288+0000","last_undegraded":"2024-09-22T08:56:34.686288+0000","last_fullsized":"2024-09-22T08:56:34.686288+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'535","last_scrub_stamp":"2024-09-22T08:56:34.686122+0000","last_deep_scrub":"263'535","last_deep_scrub_stamp":"2024-09-22T08:56:34.686122+0000","last_clean_scrub_stamp":"2024-09-22T08:56:34.686122+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:49:11.708710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3196,"num_read_kb":3015,"num_write":651,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4595,"num_omap_keys":18,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"263'229","reported_seq":860,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:29.569109+0000","last_change":"2024-09-22T08:56:29.569012+0000","last_active":"2024-09-22T08:56:29.569109+0000","last_peered":"2024-09-22T08:56:29.569109+0000","last_clean":"2024-09-22T08:56:29.569109+0000","last_became_active":"2024-09-22T08:15:04.961731+0000","last_became_peered":"2024-09-22T08:15:04.961731+0000","last_unstale":"2024-09-22T08:56:29.569109+0000","last_undegraded":"2024-09-22T08:56:29.569109+0000","last_fullsized":"2024-09-22T08:56:29.569109+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'229","last_scrub_stamp":"2024-09-22T08:56:29.568904+0000","last_deep_scrub":"263'229","last_deep_scrub_stamp":"2024-09-22T08:56:29.568904+0000","last_clean_scrub_stamp":"2024-09-22T08:56:29.568904+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:54:11.861870+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079902,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":556,"num_read_kb":16778,"num_write":1039,"num_write_kb":35959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:45.813686+0000","last_change":"2024-09-22T08:56:45.813634+0000","last_active":"2024-09-22T08:56:45.813686+0000","last_peered":"2024-09-22T08:56:45.813686+0000","last_clean":"2024-09-22T08:56:45.813686+0000","last_became_active":"2024-09-22T08:15:08.973985+0000","last_became_peered":"2024-09-22T08:15:08.973985+0000","last_unstale":"2024-09-22T08:56:45.813686+0000","last_undegraded":"2024-09-22T08:56:45.813686+0000","last_fullsized":"2024-09-22T08:56:45.813686+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:45.813551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:45.813551+0000","last_clean_scrub_stamp":"2024-09-22T08:56:45.813551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:09:23.744767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"263'98","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:59.904375+0000","last_change":"2024-09-22T08:56:59.904269+0000","last_active":"2024-09-22T08:56:59.904375+0000","last_peered":"2024-09-22T08:56:59.904375+0000","last_clean":"2024-09-22T08:56:59.904375+0000","last_became_active":"2024-09-22T08:15:10.991099+0000","last_became_peered":"2024-09-22T08:15:10.991099+0000","last_unstale":"2024-09-22T08:56:59.904375+0000","last_undegraded":"2024-09-22T08:56:59.904375+0000","last_fullsized":"2024-09-22T08:56:59.904375+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'98","last_scrub_stamp":"2024-09-22T08:56:59.904149+0000","last_deep_scrub":"263'98","last_deep_scrub_stamp":"2024-09-22T08:56:59.904149+0000","last_clean_scrub_stamp":"2024-09-22T08:56:59.904149+0000","objects_scrubbed":7,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:05:26.253262+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":117,"num_read_kb":110,"num_write":130,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"263'772","reported_seq":2299,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:46.422592+0000","last_change":"2024-09-22T08:56:46.422523+0000","last_active":"2024-09-22T08:56:46.422592+0000","last_peered":"2024-09-22T08:56:46.422592+0000","last_clean":"2024-09-22T08:56:46.422592+0000","last_became_active":"2024-09-22T08:15:13.018826+0000","last_became_peered":"2024-09-22T08:15:13.018826+0000","last_unstale":"2024-09-22T08:56:46.422592+0000","last_undegraded":"2024-09-22T08:56:46.422592+0000","last_fullsized":"2024-09-22T08:56:46.422592+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'772","last_scrub_stamp":"2024-09-22T08:56:46.422436+0000","last_deep_scrub":"263'772","last_deep_scrub_stamp":"2024-09-22T08:56:46.422436+0000","last_clean_scrub_stamp":"2024-09-22T08:56:46.422436+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:15:34.934804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"263'136","reported_seq":646,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:04.783670+0000","last_change":"2024-09-22T08:57:04.783617+0000","last_active":"2024-09-22T08:57:04.783670+0000","last_peered":"2024-09-22T08:57:04.783670+0000","last_clean":"2024-09-22T08:57:04.783670+0000","last_became_active":"2024-09-22T08:15:15.017568+0000","last_became_peered":"2024-09-22T08:15:15.017568+0000","last_unstale":"2024-09-22T08:57:04.783670+0000","last_undegraded":"2024-09-22T08:57:04.783670+0000","last_fullsized":"2024-09-22T08:57:04.783670+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'136","last_scrub_stamp":"2024-09-22T08:57:04.783514+0000","last_deep_scrub":"263'136","last_deep_scrub_stamp":"2024-09-22T08:57:04.783514+0000","last_clean_scrub_stamp":"2024-09-22T08:57:04.783514+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:11:30.508043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":178,"num_write":322,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"263'423","reported_seq":1886,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:34.402062+0000","last_change":"2024-09-22T08:56:34.401957+0000","last_active":"2024-09-22T08:56:34.402062+0000","last_peered":"2024-09-22T08:56:34.402062+0000","last_clean":"2024-09-22T08:56:34.402062+0000","last_became_active":"2024-09-22T08:15:06.973142+0000","last_became_peered":"2024-09-22T08:15:06.973142+0000","last_unstale":"2024-09-22T08:56:34.402062+0000","last_undegraded":"2024-09-22T08:56:34.402062+0000","last_fullsized":"2024-09-22T08:56:34.402062+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'423","last_scrub_stamp":"2024-09-22T08:56:34.401862+0000","last_deep_scrub":"263'423","last_deep_scrub_stamp":"2024-09-22T08:56:34.401862+0000","last_clean_scrub_stamp":"2024-09-22T08:56:34.401862+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:31.696050+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2325,"num_read_kb":2186,"num_write":496,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"263'205","reported_seq":812,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:26.829468+0000","last_change":"2024-09-22T08:56:26.829391+0000","last_active":"2024-09-22T08:56:26.829468+0000","last_peered":"2024-09-22T08:56:26.829468+0000","last_clean":"2024-09-22T08:56:26.829468+0000","last_became_active":"2024-09-22T08:15:04.954608+0000","last_became_peered":"2024-09-22T08:15:04.954608+0000","last_unstale":"2024-09-22T08:56:26.829468+0000","last_undegraded":"2024-09-22T08:56:26.829468+0000","last_fullsized":"2024-09-22T08:56:26.829468+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'205","last_scrub_stamp":"2024-09-22T08:56:26.829288+0000","last_deep_scrub":"263'205","last_deep_scrub_stamp":"2024-09-22T08:56:26.829288+0000","last_clean_scrub_stamp":"2024-09-22T08:56:26.829288+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:41:04.364320+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":469,"num_read_kb":8602,"num_write":952,"num_write_kb":32105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:42.741093+0000","last_change":"2024-09-22T08:56:42.741012+0000","last_active":"2024-09-22T08:56:42.741093+0000","last_peered":"2024-09-22T08:56:42.741093+0000","last_clean":"2024-09-22T08:56:42.741093+0000","last_became_active":"2024-09-22T08:15:08.980570+0000","last_became_peered":"2024-09-22T08:15:08.980570+0000","last_unstale":"2024-09-22T08:56:42.741093+0000","last_undegraded":"2024-09-22T08:56:42.741093+0000","last_fullsized":"2024-09-22T08:56:42.741093+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:42.740930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:42.740930+0000","last_clean_scrub_stamp":"2024-09-22T08:56:42.740930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:12:39.016936+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"263'170","reported_seq":756,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:44.411274+0000","last_change":"2024-09-22T08:56:44.411274+0000","last_active":"2024-09-22T08:56:44.411274+0000","last_peered":"2024-09-22T08:56:44.411274+0000","last_clean":"2024-09-22T08:56:44.411274+0000","last_became_active":"2024-09-22T08:15:10.979384+0000","last_became_peered":"2024-09-22T08:15:10.979384+0000","last_unstale":"2024-09-22T08:56:44.411274+0000","last_undegraded":"2024-09-22T08:56:44.411274+0000","last_fullsized":"2024-09-22T08:56:44.411274+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'170","last_scrub_stamp":"2024-09-22T08:56:44.411179+0000","last_deep_scrub":"263'170","last_deep_scrub_stamp":"2024-09-22T08:56:44.411179+0000","last_clean_scrub_stamp":"2024-09-22T08:56:44.411179+0000","objects_scrubbed":8,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:34:16.990164+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10195,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":216,"num_read_kb":291,"num_write":126,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:56.842267+0000","last_change":"2024-09-22T08:56:56.842267+0000","last_active":"2024-09-22T08:56:56.842267+0000","last_peered":"2024-09-22T08:56:56.842267+0000","last_clean":"2024-09-22T08:56:56.842267+0000","last_became_active":"2024-09-22T08:15:13.013160+0000","last_became_peered":"2024-09-22T08:15:13.013160+0000","last_unstale":"2024-09-22T08:56:56.842267+0000","last_undegraded":"2024-09-22T08:56:56.842267+0000","last_fullsized":"2024-09-22T08:56:56.842267+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:56.842180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:56.842180+0000","last_clean_scrub_stamp":"2024-09-22T08:56:56.842180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:23:00.661794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"263'141","reported_seq":651,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:50.744675+0000","last_change":"2024-09-22T08:56:50.744675+0000","last_active":"2024-09-22T08:56:50.744675+0000","last_peered":"2024-09-22T08:56:50.744675+0000","last_clean":"2024-09-22T08:56:50.744675+0000","last_became_active":"2024-09-22T08:15:15.020718+0000","last_became_peered":"2024-09-22T08:15:15.020718+0000","last_unstale":"2024-09-22T08:56:50.744675+0000","last_undegraded":"2024-09-22T08:56:50.744675+0000","last_fullsized":"2024-09-22T08:56:50.744675+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'141","last_scrub_stamp":"2024-09-22T08:56:50.744588+0000","last_deep_scrub":"263'141","last_deep_scrub_stamp":"2024-09-22T08:56:50.744588+0000","last_clean_scrub_stamp":"2024-09-22T08:56:50.744588+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:35:11.558076+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":211,"num_read_kb":197,"num_write":330,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"263'802","reported_seq":2287,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:33.408370+0000","last_change":"2024-09-22T08:56:33.408278+0000","last_active":"2024-09-22T08:56:33.408370+0000","last_peered":"2024-09-22T08:56:33.408370+0000","last_clean":"2024-09-22T08:56:33.408370+0000","last_became_active":"2024-09-22T08:15:06.970077+0000","last_became_peered":"2024-09-22T08:15:06.970077+0000","last_unstale":"2024-09-22T08:56:33.408370+0000","last_undegraded":"2024-09-22T08:56:33.408370+0000","last_fullsized":"2024-09-22T08:56:33.408370+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'802","last_scrub_stamp":"2024-09-22T08:56:33.408180+0000","last_deep_scrub":"263'802","last_deep_scrub_stamp":"2024-09-22T08:56:33.408180+0000","last_clean_scrub_stamp":"2024-09-22T08:56:33.408180+0000","objects_scrubbed":2,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:56:18.098515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3751,"num_read_kb":3364,"num_write":1047,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":246,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"263'201","reported_seq":922,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:33.835515+0000","last_change":"2024-09-22T08:56:33.835418+0000","last_active":"2024-09-22T08:56:33.835515+0000","last_peered":"2024-09-22T08:56:33.835515+0000","last_clean":"2024-09-22T08:56:33.835515+0000","last_became_active":"2024-09-22T08:15:04.962268+0000","last_became_peered":"2024-09-22T08:15:04.962268+0000","last_unstale":"2024-09-22T08:56:33.835515+0000","last_undegraded":"2024-09-22T08:56:33.835515+0000","last_fullsized":"2024-09-22T08:56:33.835515+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'201","last_scrub_stamp":"2024-09-22T08:56:33.835307+0000","last_deep_scrub":"263'201","last_deep_scrub_stamp":"2024-09-22T08:56:33.835307+0000","last_clean_scrub_stamp":"2024-09-22T08:56:33.835307+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:26:01.851194+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":783,"num_read_kb":150382,"num_write":906,"num_write_kb":51576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:38.418334+0000","last_change":"2024-09-22T08:56:38.418270+0000","last_active":"2024-09-22T08:56:38.418334+0000","last_peered":"2024-09-22T08:56:38.418334+0000","last_clean":"2024-09-22T08:56:38.418334+0000","last_became_active":"2024-09-22T08:15:08.977341+0000","last_became_peered":"2024-09-22T08:15:08.977341+0000","last_unstale":"2024-09-22T08:56:38.418334+0000","last_undegraded":"2024-09-22T08:56:38.418334+0000","last_fullsized":"2024-09-22T08:56:38.418334+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:38.418178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:38.418178+0000","last_clean_scrub_stamp":"2024-09-22T08:56:38.418178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:49:39.605640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"263'131","reported_seq":704,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:52.812563+0000","last_change":"2024-09-22T08:56:52.812563+0000","last_active":"2024-09-22T08:56:52.812563+0000","last_peered":"2024-09-22T08:56:52.812563+0000","last_clean":"2024-09-22T08:56:52.812563+0000","last_became_active":"2024-09-22T08:15:10.980015+0000","last_became_peered":"2024-09-22T08:15:10.980015+0000","last_unstale":"2024-09-22T08:56:52.812563+0000","last_undegraded":"2024-09-22T08:56:52.812563+0000","last_fullsized":"2024-09-22T08:56:52.812563+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'131","last_scrub_stamp":"2024-09-22T08:56:52.812468+0000","last_deep_scrub":"263'131","last_deep_scrub_stamp":"2024-09-22T08:56:52.812468+0000","last_clean_scrub_stamp":"2024-09-22T08:56:52.812468+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:56:16.632729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20804,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":281,"num_write":88,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:02.858821+0000","last_change":"2024-09-22T08:57:02.858821+0000","last_active":"2024-09-22T08:57:02.858821+0000","last_peered":"2024-09-22T08:57:02.858821+0000","last_clean":"2024-09-22T08:57:02.858821+0000","last_became_active":"2024-09-22T08:15:13.011134+0000","last_became_peered":"2024-09-22T08:15:13.011134+0000","last_unstale":"2024-09-22T08:57:02.858821+0000","last_undegraded":"2024-09-22T08:57:02.858821+0000","last_fullsized":"2024-09-22T08:57:02.858821+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:02.858723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:02.858723+0000","last_clean_scrub_stamp":"2024-09-22T08:57:02.858723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:51:50.606460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"263'151","reported_seq":680,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:59.480205+0000","last_change":"2024-09-22T08:56:59.480205+0000","last_active":"2024-09-22T08:56:59.480205+0000","last_peered":"2024-09-22T08:56:59.480205+0000","last_clean":"2024-09-22T08:56:59.480205+0000","last_became_active":"2024-09-22T08:15:15.012939+0000","last_became_peered":"2024-09-22T08:15:15.012939+0000","last_unstale":"2024-09-22T08:56:59.480205+0000","last_undegraded":"2024-09-22T08:56:59.480205+0000","last_fullsized":"2024-09-22T08:56:59.480205+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'151","last_scrub_stamp":"2024-09-22T08:56:59.480121+0000","last_deep_scrub":"263'151","last_deep_scrub_stamp":"2024-09-22T08:56:59.480121+0000","last_clean_scrub_stamp":"2024-09-22T08:56:59.480121+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:49:39.921046+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":256,"num_read_kb":247,"num_write":364,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"263'566","reported_seq":2368,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:31.058431+0000","last_change":"2024-09-22T08:56:31.058431+0000","last_active":"2024-09-22T08:56:31.058431+0000","last_peered":"2024-09-22T08:56:31.058431+0000","last_clean":"2024-09-22T08:56:31.058431+0000","last_became_active":"2024-09-22T08:15:06.960599+0000","last_became_peered":"2024-09-22T08:15:06.960599+0000","last_unstale":"2024-09-22T08:56:31.058431+0000","last_undegraded":"2024-09-22T08:56:31.058431+0000","last_fullsized":"2024-09-22T08:56:31.058431+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'566","last_scrub_stamp":"2024-09-22T08:56:31.058322+0000","last_deep_scrub":"263'566","last_deep_scrub_stamp":"2024-09-22T08:56:31.058322+0000","last_clean_scrub_stamp":"2024-09-22T08:56:31.058322+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":500,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:44:02.799881+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3136,"num_read_kb":2948,"num_write":673,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1214,"num_omap_keys":5,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"263'213","reported_seq":849,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:25.463333+0000","last_change":"2024-09-22T08:56:25.463224+0000","last_active":"2024-09-22T08:56:25.463333+0000","last_peered":"2024-09-22T08:56:25.463333+0000","last_clean":"2024-09-22T08:56:25.463333+0000","last_became_active":"2024-09-22T08:15:04.962785+0000","last_became_peered":"2024-09-22T08:15:04.962785+0000","last_unstale":"2024-09-22T08:56:25.463333+0000","last_undegraded":"2024-09-22T08:56:25.463333+0000","last_fullsized":"2024-09-22T08:56:25.463333+0000","mapping_epoch":23,"log_start":"263'201","ondisk_log_start":"263'201","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'213","last_scrub_stamp":"2024-09-22T08:56:25.463105+0000","last_deep_scrub":"263'213","last_deep_scrub_stamp":"2024-09-22T08:56:25.463105+0000","last_clean_scrub_stamp":"2024-09-22T08:56:25.463105+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":201,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:25.834921+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":497,"num_read_kb":22160,"num_write":848,"num_write_kb":45151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:36.732273+0000","last_change":"2024-09-22T08:56:36.732273+0000","last_active":"2024-09-22T08:56:36.732273+0000","last_peered":"2024-09-22T08:56:36.732273+0000","last_clean":"2024-09-22T08:56:36.732273+0000","last_became_active":"2024-09-22T08:15:08.978844+0000","last_became_peered":"2024-09-22T08:15:08.978844+0000","last_unstale":"2024-09-22T08:56:36.732273+0000","last_undegraded":"2024-09-22T08:56:36.732273+0000","last_fullsized":"2024-09-22T08:56:36.732273+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:36.732185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:36.732185+0000","last_clean_scrub_stamp":"2024-09-22T08:56:36.732185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:09:03.793067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"263'129","reported_seq":688,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:45.550853+0000","last_change":"2024-09-22T08:56:45.550783+0000","last_active":"2024-09-22T08:56:45.550853+0000","last_peered":"2024-09-22T08:56:45.550853+0000","last_clean":"2024-09-22T08:56:45.550853+0000","last_became_active":"2024-09-22T08:15:10.983522+0000","last_became_peered":"2024-09-22T08:15:10.983522+0000","last_unstale":"2024-09-22T08:56:45.550853+0000","last_undegraded":"2024-09-22T08:56:45.550853+0000","last_fullsized":"2024-09-22T08:56:45.550853+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'129","last_scrub_stamp":"2024-09-22T08:56:45.550692+0000","last_deep_scrub":"263'129","last_deep_scrub_stamp":"2024-09-22T08:56:45.550692+0000","last_clean_scrub_stamp":"2024-09-22T08:56:45.550692+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:16:26.075081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62130,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":173,"num_read_kb":427,"num_write":104,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:03.822287+0000","last_change":"2024-09-22T08:57:03.822194+0000","last_active":"2024-09-22T08:57:03.822287+0000","last_peered":"2024-09-22T08:57:03.822287+0000","last_clean":"2024-09-22T08:57:03.822287+0000","last_became_active":"2024-09-22T08:15:13.015473+0000","last_became_peered":"2024-09-22T08:15:13.015473+0000","last_unstale":"2024-09-22T08:57:03.822287+0000","last_undegraded":"2024-09-22T08:57:03.822287+0000","last_fullsized":"2024-09-22T08:57:03.822287+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.822091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.822091+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.822091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:56:05.966711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"263'220","reported_seq":1687,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:57:07.746784+0000","last_change":"2024-09-22T08:57:07.746784+0000","last_active":"2024-09-22T08:57:07.746784+0000","last_peered":"2024-09-22T08:57:07.746784+0000","last_clean":"2024-09-22T08:57:07.746784+0000","last_became_active":"2024-09-22T08:15:15.017394+0000","last_became_peered":"2024-09-22T08:15:15.017394+0000","last_unstale":"2024-09-22T08:57:07.746784+0000","last_undegraded":"2024-09-22T08:57:07.746784+0000","last_fullsized":"2024-09-22T08:57:07.746784+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'220","last_scrub_stamp":"2024-09-22T08:57:07.746678+0000","last_deep_scrub":"263'220","last_deep_scrub_stamp":"2024-09-22T08:57:07.746678+0000","last_clean_scrub_stamp":"2024-09-22T08:57:07.746678+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:57:44.914976+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1186,"num_read_kb":1185,"num_write":465,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"263'824","reported_seq":2527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:32.421909+0000","last_change":"2024-09-22T08:56:32.421909+0000","last_active":"2024-09-22T08:56:32.421909+0000","last_peered":"2024-09-22T08:56:32.421909+0000","last_clean":"2024-09-22T08:56:32.421909+0000","last_became_active":"2024-09-22T08:15:06.967603+0000","last_became_peered":"2024-09-22T08:15:06.967603+0000","last_unstale":"2024-09-22T08:56:32.421909+0000","last_undegraded":"2024-09-22T08:56:32.421909+0000","last_fullsized":"2024-09-22T08:56:32.421909+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'824","last_scrub_stamp":"2024-09-22T08:56:32.421797+0000","last_deep_scrub":"263'824","last_deep_scrub_stamp":"2024-09-22T08:56:32.421797+0000","last_clean_scrub_stamp":"2024-09-22T08:56:32.421797+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:35:50.459397+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4151,"num_read_kb":3787,"num_write":1085,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":251,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"263'211","reported_seq":883,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:27.464964+0000","last_change":"2024-09-22T08:56:27.464857+0000","last_active":"2024-09-22T08:56:27.464964+0000","last_peered":"2024-09-22T08:56:27.464964+0000","last_clean":"2024-09-22T08:56:27.464964+0000","last_became_active":"2024-09-22T08:15:04.957654+0000","last_became_peered":"2024-09-22T08:15:04.957654+0000","last_unstale":"2024-09-22T08:56:27.464964+0000","last_undegraded":"2024-09-22T08:56:27.464964+0000","last_fullsized":"2024-09-22T08:56:27.464964+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'211","last_scrub_stamp":"2024-09-22T08:56:27.464696+0000","last_deep_scrub":"263'211","last_deep_scrub_stamp":"2024-09-22T08:56:27.464696+0000","last_clean_scrub_stamp":"2024-09-22T08:56:27.464696+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:19:35.401370+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":592,"num_read_kb":25705,"num_write":948,"num_write_kb":45275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"263'2","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:46.806569+0000","last_change":"2024-09-22T08:56:46.806569+0000","last_active":"2024-09-22T08:56:46.806569+0000","last_peered":"2024-09-22T08:56:46.806569+0000","last_clean":"2024-09-22T08:56:46.806569+0000","last_became_active":"2024-09-22T08:15:08.972733+0000","last_became_peered":"2024-09-22T08:15:08.972733+0000","last_unstale":"2024-09-22T08:56:46.806569+0000","last_undegraded":"2024-09-22T08:56:46.806569+0000","last_fullsized":"2024-09-22T08:56:46.806569+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-22T08:56:46.806482+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-22T08:56:46.806482+0000","last_clean_scrub_stamp":"2024-09-22T08:56:46.806482+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:45:57.005123+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"263'161","reported_seq":752,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:57.902731+0000","last_change":"2024-09-22T08:56:57.902666+0000","last_active":"2024-09-22T08:56:57.902731+0000","last_peered":"2024-09-22T08:56:57.902731+0000","last_clean":"2024-09-22T08:56:57.902731+0000","last_became_active":"2024-09-22T08:15:10.987610+0000","last_became_peered":"2024-09-22T08:15:10.987610+0000","last_unstale":"2024-09-22T08:56:57.902731+0000","last_undegraded":"2024-09-22T08:56:57.902731+0000","last_fullsized":"2024-09-22T08:56:57.902731+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'161","last_scrub_stamp":"2024-09-22T08:56:57.902566+0000","last_deep_scrub":"263'161","last_deep_scrub_stamp":"2024-09-22T08:56:57.902566+0000","last_clean_scrub_stamp":"2024-09-22T08:56:57.902566+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:24:01.099997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6856,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":209,"num_read_kb":275,"num_write":118,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:58.863988+0000","last_change":"2024-09-22T08:56:58.863927+0000","last_active":"2024-09-22T08:56:58.863988+0000","last_peered":"2024-09-22T08:56:58.863988+0000","last_clean":"2024-09-22T08:56:58.863988+0000","last_became_active":"2024-09-22T08:15:13.003219+0000","last_became_peered":"2024-09-22T08:15:13.003219+0000","last_unstale":"2024-09-22T08:56:58.863988+0000","last_undegraded":"2024-09-22T08:56:58.863988+0000","last_fullsized":"2024-09-22T08:56:58.863988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:56:58.863840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:56:58.863840+0000","last_clean_scrub_stamp":"2024-09-22T08:56:58.863840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:04:32.976325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"263'162","reported_seq":651,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:47.375795+0000","last_change":"2024-09-22T08:56:47.375743+0000","last_active":"2024-09-22T08:56:47.375795+0000","last_peered":"2024-09-22T08:56:47.375795+0000","last_clean":"2024-09-22T08:56:47.375795+0000","last_became_active":"2024-09-22T08:15:15.018311+0000","last_became_peered":"2024-09-22T08:15:15.018311+0000","last_unstale":"2024-09-22T08:56:47.375795+0000","last_undegraded":"2024-09-22T08:56:47.375795+0000","last_fullsized":"2024-09-22T08:56:47.375795+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'162","last_scrub_stamp":"2024-09-22T08:56:47.375645+0000","last_deep_scrub":"263'162","last_deep_scrub_stamp":"2024-09-22T08:56:47.375645+0000","last_clean_scrub_stamp":"2024-09-22T08:56:47.375645+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:55:47.154243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":160,"num_write":367,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"263'892","reported_seq":2479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:40.711673+0000","last_change":"2024-09-22T08:56:40.711673+0000","last_active":"2024-09-22T08:56:40.711673+0000","last_peered":"2024-09-22T08:56:40.711673+0000","last_clean":"2024-09-22T08:56:40.711673+0000","last_became_active":"2024-09-22T08:15:06.964786+0000","last_became_peered":"2024-09-22T08:15:06.964786+0000","last_unstale":"2024-09-22T08:56:40.711673+0000","last_undegraded":"2024-09-22T08:56:40.711673+0000","last_fullsized":"2024-09-22T08:56:40.711673+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'892","last_scrub_stamp":"2024-09-22T08:56:40.711582+0000","last_deep_scrub":"263'892","last_deep_scrub_stamp":"2024-09-22T08:56:40.711582+0000","last_clean_scrub_stamp":"2024-09-22T08:56:40.711582+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":800,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:45:38.702433+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4058,"num_read_kb":3642,"num_write":1164,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"263'229","reported_seq":906,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:24.354882+0000","last_change":"2024-09-22T08:56:24.354836+0000","last_active":"2024-09-22T08:56:24.354882+0000","last_peered":"2024-09-22T08:56:24.354882+0000","last_clean":"2024-09-22T08:56:24.354882+0000","last_became_active":"2024-09-22T08:15:04.962774+0000","last_became_peered":"2024-09-22T08:15:04.962774+0000","last_unstale":"2024-09-22T08:56:24.354882+0000","last_undegraded":"2024-09-22T08:56:24.354882+0000","last_fullsized":"2024-09-22T08:56:24.354882+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'229","last_scrub_stamp":"2024-09-22T08:56:24.354751+0000","last_deep_scrub":"263'229","last_deep_scrub_stamp":"2024-09-22T08:56:24.354751+0000","last_clean_scrub_stamp":"2024-09-22T08:56:24.354751+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:19:21.350986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":683,"num_read_kb":4749,"num_write":1115,"num_write_kb":28646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"263'864","reported_seq":2355,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:33.135511+0000","last_change":"2024-09-22T08:56:33.135511+0000","last_active":"2024-09-22T08:56:33.135511+0000","last_peered":"2024-09-22T08:56:33.135511+0000","last_clean":"2024-09-22T08:56:33.135511+0000","last_became_active":"2024-09-22T08:15:06.958389+0000","last_became_peered":"2024-09-22T08:15:06.958389+0000","last_unstale":"2024-09-22T08:56:33.135511+0000","last_undegraded":"2024-09-22T08:56:33.135511+0000","last_fullsized":"2024-09-22T08:56:33.135511+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'864","last_scrub_stamp":"2024-09-22T08:56:33.135421+0000","last_deep_scrub":"263'864","last_deep_scrub_stamp":"2024-09-22T08:56:33.135421+0000","last_clean_scrub_stamp":"2024-09-22T08:56:33.135421+0000","objects_scrubbed":2,"log_size":64,"log_dups_size":800,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:10:17.769140+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3808,"num_read_kb":3398,"num_write":1097,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"263'366","reported_seq":1063,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:26.085025+0000","last_change":"2024-09-22T08:56:26.084966+0000","last_active":"2024-09-22T08:56:26.085025+0000","last_peered":"2024-09-22T08:56:26.085025+0000","last_clean":"2024-09-22T08:56:26.085025+0000","last_became_active":"2024-09-22T08:15:04.950922+0000","last_became_peered":"2024-09-22T08:15:04.950922+0000","last_unstale":"2024-09-22T08:56:26.085025+0000","last_undegraded":"2024-09-22T08:56:26.085025+0000","last_fullsized":"2024-09-22T08:56:26.085025+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'366","last_scrub_stamp":"2024-09-22T08:56:26.084868+0000","last_deep_scrub":"263'366","last_deep_scrub_stamp":"2024-09-22T08:56:26.084868+0000","last_clean_scrub_stamp":"2024-09-22T08:56:26.084868+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:20:49.984873+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1005,"num_read_kb":11417,"num_write":1356,"num_write_kb":38557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"263'417","reported_seq":1875,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:44.891717+0000","last_change":"2024-09-22T08:56:44.891717+0000","last_active":"2024-09-22T08:56:44.891717+0000","last_peered":"2024-09-22T08:56:44.891717+0000","last_clean":"2024-09-22T08:56:44.891717+0000","last_became_active":"2024-09-22T08:15:06.973749+0000","last_became_peered":"2024-09-22T08:15:06.973749+0000","last_unstale":"2024-09-22T08:56:44.891717+0000","last_undegraded":"2024-09-22T08:56:44.891717+0000","last_fullsized":"2024-09-22T08:56:44.891717+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'417","last_scrub_stamp":"2024-09-22T08:56:44.891634+0000","last_deep_scrub":"263'417","last_deep_scrub_stamp":"2024-09-22T08:56:44.891634+0000","last_clean_scrub_stamp":"2024-09-22T08:56:44.891634+0000","objects_scrubbed":3,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:02:30.214518+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2229,"num_read_kb":2093,"num_write":519,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"263'230","reported_seq":870,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:34.824572+0000","last_change":"2024-09-22T08:56:34.824521+0000","last_active":"2024-09-22T08:56:34.824572+0000","last_peered":"2024-09-22T08:56:34.824572+0000","last_clean":"2024-09-22T08:56:34.824572+0000","last_became_active":"2024-09-22T08:15:04.959501+0000","last_became_peered":"2024-09-22T08:15:04.959501+0000","last_unstale":"2024-09-22T08:56:34.824572+0000","last_undegraded":"2024-09-22T08:56:34.824572+0000","last_fullsized":"2024-09-22T08:56:34.824572+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'230","last_scrub_stamp":"2024-09-22T08:56:34.824414+0000","last_deep_scrub":"263'230","last_deep_scrub_stamp":"2024-09-22T08:56:34.824414+0000","last_clean_scrub_stamp":"2024-09-22T08:56:34.824414+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:20:56.179522+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":551,"num_read_kb":25081,"num_write":1074,"num_write_kb":19730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"263'880","reported_seq":2582,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:41.441953+0000","last_change":"2024-09-22T08:56:41.441953+0000","last_active":"2024-09-22T08:56:41.441953+0000","last_peered":"2024-09-22T08:56:41.441953+0000","last_clean":"2024-09-22T08:56:41.441953+0000","last_became_active":"2024-09-22T08:15:06.970991+0000","last_became_peered":"2024-09-22T08:15:06.970991+0000","last_unstale":"2024-09-22T08:56:41.441953+0000","last_undegraded":"2024-09-22T08:56:41.441953+0000","last_fullsized":"2024-09-22T08:56:41.441953+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'880","last_scrub_stamp":"2024-09-22T08:56:41.441866+0000","last_deep_scrub":"263'880","last_deep_scrub_stamp":"2024-09-22T08:56:41.441866+0000","last_clean_scrub_stamp":"2024-09-22T08:56:41.441866+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":800,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:00:49.369182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4175,"num_read_kb":3774,"num_write":1132,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"263'196","reported_seq":836,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:28.437284+0000","last_change":"2024-09-22T08:56:28.437228+0000","last_active":"2024-09-22T08:56:28.437284+0000","last_peered":"2024-09-22T08:56:28.437284+0000","last_clean":"2024-09-22T08:56:28.437284+0000","last_became_active":"2024-09-22T08:15:04.954281+0000","last_became_peered":"2024-09-22T08:15:04.954281+0000","last_unstale":"2024-09-22T08:56:28.437284+0000","last_undegraded":"2024-09-22T08:56:28.437284+0000","last_fullsized":"2024-09-22T08:56:28.437284+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'196","last_scrub_stamp":"2024-09-22T08:56:28.437133+0000","last_deep_scrub":"263'196","last_deep_scrub_stamp":"2024-09-22T08:56:28.437133+0000","last_clean_scrub_stamp":"2024-09-22T08:56:28.437133+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:09:07.572237+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":578,"num_read_kb":4135,"num_write":927,"num_write_kb":8648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"263'1130","reported_seq":2693,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:40.404544+0000","last_change":"2024-09-22T08:56:40.404490+0000","last_active":"2024-09-22T08:56:40.404544+0000","last_peered":"2024-09-22T08:56:40.404544+0000","last_clean":"2024-09-22T08:56:40.404544+0000","last_became_active":"2024-09-22T08:15:06.967938+0000","last_became_peered":"2024-09-22T08:15:06.967938+0000","last_unstale":"2024-09-22T08:56:40.404544+0000","last_undegraded":"2024-09-22T08:56:40.404544+0000","last_fullsized":"2024-09-22T08:56:40.404544+0000","mapping_epoch":25,"log_start":"263'1100","ondisk_log_start":"263'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1130","last_scrub_stamp":"2024-09-22T08:56:40.404388+0000","last_deep_scrub":"263'1130","last_deep_scrub_stamp":"2024-09-22T08:56:40.404388+0000","last_clean_scrub_stamp":"2024-09-22T08:56:40.404388+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":1100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:38:56.900661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5297,"num_read_kb":4688,"num_write":1564,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"263'199","reported_seq":885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:26.505368+0000","last_change":"2024-09-22T08:56:26.505368+0000","last_active":"2024-09-22T08:56:26.505368+0000","last_peered":"2024-09-22T08:56:26.505368+0000","last_clean":"2024-09-22T08:56:26.505368+0000","last_became_active":"2024-09-22T08:15:04.963992+0000","last_became_peered":"2024-09-22T08:15:04.963992+0000","last_unstale":"2024-09-22T08:56:26.505368+0000","last_undegraded":"2024-09-22T08:56:26.505368+0000","last_fullsized":"2024-09-22T08:56:26.505368+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'199","last_scrub_stamp":"2024-09-22T08:56:26.505257+0000","last_deep_scrub":"263'199","last_deep_scrub_stamp":"2024-09-22T08:56:26.505257+0000","last_clean_scrub_stamp":"2024-09-22T08:56:26.505257+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:32:39.305652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":707,"num_read_kb":8108,"num_write":879,"num_write_kb":38701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"263'392","reported_seq":2075,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:33.426368+0000","last_change":"2024-09-22T08:56:33.426299+0000","last_active":"2024-09-22T08:56:33.426368+0000","last_peered":"2024-09-22T08:56:33.426368+0000","last_clean":"2024-09-22T08:56:33.426368+0000","last_became_active":"2024-09-22T08:15:06.964116+0000","last_became_peered":"2024-09-22T08:15:06.964116+0000","last_unstale":"2024-09-22T08:56:33.426368+0000","last_undegraded":"2024-09-22T08:56:33.426368+0000","last_fullsized":"2024-09-22T08:56:33.426368+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'392","last_scrub_stamp":"2024-09-22T08:56:33.426207+0000","last_deep_scrub":"263'392","last_deep_scrub_stamp":"2024-09-22T08:56:33.426207+0000","last_clean_scrub_stamp":"2024-09-22T08:56:33.426207+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:49:41.669632+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2347,"num_read_kb":2272,"num_write":440,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"263'230","reported_seq":920,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:27.538446+0000","last_change":"2024-09-22T08:56:27.538446+0000","last_active":"2024-09-22T08:56:27.538446+0000","last_peered":"2024-09-22T08:56:27.538446+0000","last_clean":"2024-09-22T08:56:27.538446+0000","last_became_active":"2024-09-22T08:15:04.951628+0000","last_became_peered":"2024-09-22T08:15:04.951628+0000","last_unstale":"2024-09-22T08:56:27.538446+0000","last_undegraded":"2024-09-22T08:56:27.538446+0000","last_fullsized":"2024-09-22T08:56:27.538446+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'230","last_scrub_stamp":"2024-09-22T08:56:27.538344+0000","last_deep_scrub":"263'230","last_deep_scrub_stamp":"2024-09-22T08:56:27.538344+0000","last_clean_scrub_stamp":"2024-09-22T08:56:27.538344+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:55:52.381757+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":736,"num_read_kb":9856,"num_write":1118,"num_write_kb":28547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"263'359","reported_seq":1841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:35.475638+0000","last_change":"2024-09-22T08:56:35.475586+0000","last_active":"2024-09-22T08:56:35.475638+0000","last_peered":"2024-09-22T08:56:35.475638+0000","last_clean":"2024-09-22T08:56:35.475638+0000","last_became_active":"2024-09-22T08:15:06.973584+0000","last_became_peered":"2024-09-22T08:15:06.973584+0000","last_unstale":"2024-09-22T08:56:35.475638+0000","last_undegraded":"2024-09-22T08:56:35.475638+0000","last_fullsized":"2024-09-22T08:56:35.475638+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-22T08:56:35.475501+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-22T08:56:35.475501+0000","last_clean_scrub_stamp":"2024-09-22T08:56:35.475501+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:33:22.764519+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2011,"num_read_kb":1931,"num_write":399,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"263'218","reported_seq":893,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:26.335055+0000","last_change":"2024-09-22T08:56:26.335055+0000","last_active":"2024-09-22T08:56:26.335055+0000","last_peered":"2024-09-22T08:56:26.335055+0000","last_clean":"2024-09-22T08:56:26.335055+0000","last_became_active":"2024-09-22T08:15:04.968983+0000","last_became_peered":"2024-09-22T08:15:04.968983+0000","last_unstale":"2024-09-22T08:56:26.335055+0000","last_undegraded":"2024-09-22T08:56:26.335055+0000","last_fullsized":"2024-09-22T08:56:26.335055+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'218","last_scrub_stamp":"2024-09-22T08:56:26.334945+0000","last_deep_scrub":"263'218","last_deep_scrub_stamp":"2024-09-22T08:56:26.334945+0000","last_clean_scrub_stamp":"2024-09-22T08:56:26.334945+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:49:29.445563+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":615,"num_read_kb":66139,"num_write":1057,"num_write_kb":31816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"263'1265","reported_seq":3124,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:27.877868+0000","last_change":"2024-09-22T08:56:27.877792+0000","last_active":"2024-09-22T08:56:27.877868+0000","last_peered":"2024-09-22T08:56:27.877868+0000","last_clean":"2024-09-22T08:56:27.877868+0000","last_became_active":"2024-09-22T08:15:06.970055+0000","last_became_peered":"2024-09-22T08:15:06.970055+0000","last_unstale":"2024-09-22T08:56:27.877868+0000","last_undegraded":"2024-09-22T08:56:27.877868+0000","last_fullsized":"2024-09-22T08:56:27.877868+0000","mapping_epoch":25,"log_start":"263'1200","ondisk_log_start":"263'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1265","last_scrub_stamp":"2024-09-22T08:56:27.877698+0000","last_deep_scrub":"263'1265","last_deep_scrub_stamp":"2024-09-22T08:56:27.877698+0000","last_clean_scrub_stamp":"2024-09-22T08:56:27.877698+0000","objects_scrubbed":3,"log_size":65,"log_dups_size":1200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:13:51.554575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6370,"num_read_kb":5597,"num_write":1961,"num_write_kb":987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1756,"num_omap_keys":7,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"263'219","reported_seq":890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:29.465649+0000","last_change":"2024-09-22T08:56:29.465649+0000","last_active":"2024-09-22T08:56:29.465649+0000","last_peered":"2024-09-22T08:56:29.465649+0000","last_clean":"2024-09-22T08:56:29.465649+0000","last_became_active":"2024-09-22T08:15:04.961545+0000","last_became_peered":"2024-09-22T08:15:04.961545+0000","last_unstale":"2024-09-22T08:56:29.465649+0000","last_undegraded":"2024-09-22T08:56:29.465649+0000","last_fullsized":"2024-09-22T08:56:29.465649+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'219","last_scrub_stamp":"2024-09-22T08:56:29.465544+0000","last_deep_scrub":"263'219","last_deep_scrub_stamp":"2024-09-22T08:56:29.465544+0000","last_clean_scrub_stamp":"2024-09-22T08:56:29.465544+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:08:30.829892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":669,"num_read_kb":2609,"num_write":1038,"num_write_kb":23374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"263'491","reported_seq":1949,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:35.144999+0000","last_change":"2024-09-22T08:56:35.144945+0000","last_active":"2024-09-22T08:56:35.144999+0000","last_peered":"2024-09-22T08:56:35.144999+0000","last_clean":"2024-09-22T08:56:35.144999+0000","last_became_active":"2024-09-22T08:15:06.959331+0000","last_became_peered":"2024-09-22T08:15:06.959331+0000","last_unstale":"2024-09-22T08:56:35.144999+0000","last_undegraded":"2024-09-22T08:56:35.144999+0000","last_fullsized":"2024-09-22T08:56:35.144999+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'491","last_scrub_stamp":"2024-09-22T08:56:35.144843+0000","last_deep_scrub":"263'491","last_deep_scrub_stamp":"2024-09-22T08:56:35.144843+0000","last_clean_scrub_stamp":"2024-09-22T08:56:35.144843+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:30:09.143732+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2542,"num_read_kb":2330,"num_write":651,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"263'196","reported_seq":795,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:35.803962+0000","last_change":"2024-09-22T08:56:35.803962+0000","last_active":"2024-09-22T08:56:35.803962+0000","last_peered":"2024-09-22T08:56:35.803962+0000","last_clean":"2024-09-22T08:56:35.803962+0000","last_became_active":"2024-09-22T08:15:04.958725+0000","last_became_peered":"2024-09-22T08:15:04.958725+0000","last_unstale":"2024-09-22T08:56:35.803962+0000","last_undegraded":"2024-09-22T08:56:35.803962+0000","last_fullsized":"2024-09-22T08:56:35.803962+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'196","last_scrub_stamp":"2024-09-22T08:56:35.803797+0000","last_deep_scrub":"263'196","last_deep_scrub_stamp":"2024-09-22T08:56:35.803797+0000","last_clean_scrub_stamp":"2024-09-22T08:56:35.803797+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:19:54.336476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":392,"num_read_kb":18786,"num_write":900,"num_write_kb":46944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"263'799","reported_seq":2391,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:34.449105+0000","last_change":"2024-09-22T08:56:34.449040+0000","last_active":"2024-09-22T08:56:34.449105+0000","last_peered":"2024-09-22T08:56:34.449105+0000","last_clean":"2024-09-22T08:56:34.449105+0000","last_became_active":"2024-09-22T08:15:06.956485+0000","last_became_peered":"2024-09-22T08:15:06.956485+0000","last_unstale":"2024-09-22T08:56:34.449105+0000","last_undegraded":"2024-09-22T08:56:34.449105+0000","last_fullsized":"2024-09-22T08:56:34.449105+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'799","last_scrub_stamp":"2024-09-22T08:56:34.448950+0000","last_deep_scrub":"263'799","last_deep_scrub_stamp":"2024-09-22T08:56:34.448950+0000","last_clean_scrub_stamp":"2024-09-22T08:56:34.448950+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:15.749892+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3799,"num_read_kb":3445,"num_write":1066,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"263'218","reported_seq":899,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:31.387996+0000","last_change":"2024-09-22T08:56:31.387996+0000","last_active":"2024-09-22T08:56:31.387996+0000","last_peered":"2024-09-22T08:56:31.387996+0000","last_clean":"2024-09-22T08:56:31.387996+0000","last_became_active":"2024-09-22T08:15:04.962165+0000","last_became_peered":"2024-09-22T08:15:04.962165+0000","last_unstale":"2024-09-22T08:56:31.387996+0000","last_undegraded":"2024-09-22T08:56:31.387996+0000","last_fullsized":"2024-09-22T08:56:31.387996+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'218","last_scrub_stamp":"2024-09-22T08:56:31.387900+0000","last_deep_scrub":"263'218","last_deep_scrub_stamp":"2024-09-22T08:56:31.387900+0000","last_clean_scrub_stamp":"2024-09-22T08:56:31.387900+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:42:29.087154+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":601,"num_read_kb":98488,"num_write":1035,"num_write_kb":53405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"263'774","reported_seq":2250,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:42.455820+0000","last_change":"2024-09-22T08:56:42.455820+0000","last_active":"2024-09-22T08:56:42.455820+0000","last_peered":"2024-09-22T08:56:42.455820+0000","last_clean":"2024-09-22T08:56:42.455820+0000","last_became_active":"2024-09-22T08:15:06.970111+0000","last_became_peered":"2024-09-22T08:15:06.970111+0000","last_unstale":"2024-09-22T08:56:42.455820+0000","last_undegraded":"2024-09-22T08:56:42.455820+0000","last_fullsized":"2024-09-22T08:56:42.455820+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'774","last_scrub_stamp":"2024-09-22T08:56:42.455718+0000","last_deep_scrub":"263'774","last_deep_scrub_stamp":"2024-09-22T08:56:42.455718+0000","last_clean_scrub_stamp":"2024-09-22T08:56:42.455718+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:58:53.024040+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3767,"num_read_kb":3405,"num_write":1035,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"263'192","reported_seq":902,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:21.922992+0000","last_change":"2024-09-22T08:56:21.922992+0000","last_active":"2024-09-22T08:56:21.922992+0000","last_peered":"2024-09-22T08:56:21.922992+0000","last_clean":"2024-09-22T08:56:21.922992+0000","last_became_active":"2024-09-22T08:15:04.963383+0000","last_became_peered":"2024-09-22T08:15:04.963383+0000","last_unstale":"2024-09-22T08:56:21.922992+0000","last_undegraded":"2024-09-22T08:56:21.922992+0000","last_fullsized":"2024-09-22T08:56:21.922992+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'192","last_scrub_stamp":"2024-09-22T08:56:21.922907+0000","last_deep_scrub":"263'192","last_deep_scrub_stamp":"2024-09-22T08:56:21.922907+0000","last_clean_scrub_stamp":"2024-09-22T08:56:21.922907+0000","objects_scrubbed":5,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:34:08.554670+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":846,"num_read_kb":15214,"num_write":846,"num_write_kb":25255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"263'750","reported_seq":2184,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:29.779798+0000","last_change":"2024-09-22T08:56:29.779798+0000","last_active":"2024-09-22T08:56:29.779798+0000","last_peered":"2024-09-22T08:56:29.779798+0000","last_clean":"2024-09-22T08:56:29.779798+0000","last_became_active":"2024-09-22T08:15:06.967819+0000","last_became_peered":"2024-09-22T08:15:06.967819+0000","last_unstale":"2024-09-22T08:56:29.779798+0000","last_undegraded":"2024-09-22T08:56:29.779798+0000","last_fullsized":"2024-09-22T08:56:29.779798+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'750","last_scrub_stamp":"2024-09-22T08:56:29.779699+0000","last_deep_scrub":"263'750","last_deep_scrub_stamp":"2024-09-22T08:56:29.779699+0000","last_clean_scrub_stamp":"2024-09-22T08:56:29.779699+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":700,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:42:36.409781+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3557,"num_read_kb":3203,"num_write":994,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"263'222","reported_seq":860,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:30.600999+0000","last_change":"2024-09-22T08:56:30.600999+0000","last_active":"2024-09-22T08:56:30.600999+0000","last_peered":"2024-09-22T08:56:30.600999+0000","last_clean":"2024-09-22T08:56:30.600999+0000","last_became_active":"2024-09-22T08:15:04.963035+0000","last_became_peered":"2024-09-22T08:15:04.963035+0000","last_unstale":"2024-09-22T08:56:30.600999+0000","last_undegraded":"2024-09-22T08:56:30.600999+0000","last_fullsized":"2024-09-22T08:56:30.600999+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'222","last_scrub_stamp":"2024-09-22T08:56:30.600894+0000","last_deep_scrub":"263'222","last_deep_scrub_stamp":"2024-09-22T08:56:30.600894+0000","last_clean_scrub_stamp":"2024-09-22T08:56:30.600894+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:34:32.074093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":484,"num_read_kb":60036,"num_write":970,"num_write_kb":46477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"263'435","reported_seq":2064,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:32.742512+0000","last_change":"2024-09-22T08:56:32.742512+0000","last_active":"2024-09-22T08:56:32.742512+0000","last_peered":"2024-09-22T08:56:32.742512+0000","last_clean":"2024-09-22T08:56:32.742512+0000","last_became_active":"2024-09-22T08:15:06.972901+0000","last_became_peered":"2024-09-22T08:15:06.972901+0000","last_unstale":"2024-09-22T08:56:32.742512+0000","last_undegraded":"2024-09-22T08:56:32.742512+0000","last_fullsized":"2024-09-22T08:56:32.742512+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'435","last_scrub_stamp":"2024-09-22T08:56:32.742406+0000","last_deep_scrub":"263'435","last_deep_scrub_stamp":"2024-09-22T08:56:32.742406+0000","last_clean_scrub_stamp":"2024-09-22T08:56:32.742406+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:25:24.212860+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2630,"num_read_kb":2493,"num_write":497,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2041,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"263'193","reported_seq":804,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:24.511017+0000","last_change":"2024-09-22T08:56:24.511017+0000","last_active":"2024-09-22T08:56:24.511017+0000","last_peered":"2024-09-22T08:56:24.511017+0000","last_clean":"2024-09-22T08:56:24.511017+0000","last_became_active":"2024-09-22T08:15:04.954601+0000","last_became_peered":"2024-09-22T08:15:04.954601+0000","last_unstale":"2024-09-22T08:56:24.511017+0000","last_undegraded":"2024-09-22T08:56:24.511017+0000","last_fullsized":"2024-09-22T08:56:24.511017+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'193","last_scrub_stamp":"2024-09-22T08:56:24.510944+0000","last_deep_scrub":"263'193","last_deep_scrub_stamp":"2024-09-22T08:56:24.510944+0000","last_clean_scrub_stamp":"2024-09-22T08:56:24.510944+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:11.452087+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":488,"num_read_kb":10659,"num_write":871,"num_write_kb":26887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"263'440","reported_seq":1908,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:34.118935+0000","last_change":"2024-09-22T08:56:34.118935+0000","last_active":"2024-09-22T08:56:34.118935+0000","last_peered":"2024-09-22T08:56:34.118935+0000","last_clean":"2024-09-22T08:56:34.118935+0000","last_became_active":"2024-09-22T08:15:06.955721+0000","last_became_peered":"2024-09-22T08:15:06.955721+0000","last_unstale":"2024-09-22T08:56:34.118935+0000","last_undegraded":"2024-09-22T08:56:34.118935+0000","last_fullsized":"2024-09-22T08:56:34.118935+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'440","last_scrub_stamp":"2024-09-22T08:56:34.118840+0000","last_deep_scrub":"263'440","last_deep_scrub_stamp":"2024-09-22T08:56:34.118840+0000","last_clean_scrub_stamp":"2024-09-22T08:56:34.118840+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:00:17.060498+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2301,"num_read_kb":2146,"num_write":527,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"263'218","reported_seq":887,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:36.784912+0000","last_change":"2024-09-22T08:56:36.784912+0000","last_active":"2024-09-22T08:56:36.784912+0000","last_peered":"2024-09-22T08:56:36.784912+0000","last_clean":"2024-09-22T08:56:36.784912+0000","last_became_active":"2024-09-22T08:15:04.961217+0000","last_became_peered":"2024-09-22T08:15:04.961217+0000","last_unstale":"2024-09-22T08:56:36.784912+0000","last_undegraded":"2024-09-22T08:56:36.784912+0000","last_fullsized":"2024-09-22T08:56:36.784912+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'218","last_scrub_stamp":"2024-09-22T08:56:36.784815+0000","last_deep_scrub":"263'218","last_deep_scrub_stamp":"2024-09-22T08:56:36.784815+0000","last_clean_scrub_stamp":"2024-09-22T08:56:36.784815+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:05:54.668509+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":598,"num_read_kb":11776,"num_write":1062,"num_write_kb":6843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"263'550","reported_seq":2089,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:36.669377+0000","last_change":"2024-09-22T08:56:36.669377+0000","last_active":"2024-09-22T08:56:36.669377+0000","last_peered":"2024-09-22T08:56:36.669377+0000","last_clean":"2024-09-22T08:56:36.669377+0000","last_became_active":"2024-09-22T08:15:06.970735+0000","last_became_peered":"2024-09-22T08:15:06.970735+0000","last_unstale":"2024-09-22T08:56:36.669377+0000","last_undegraded":"2024-09-22T08:56:36.669377+0000","last_fullsized":"2024-09-22T08:56:36.669377+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'550","last_scrub_stamp":"2024-09-22T08:56:36.669289+0000","last_deep_scrub":"263'550","last_deep_scrub_stamp":"2024-09-22T08:56:36.669289+0000","last_clean_scrub_stamp":"2024-09-22T08:56:36.669289+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":500,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:31:27.633080+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2725,"num_read_kb":2496,"num_write":675,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"263'221","reported_seq":887,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:32.099826+0000","last_change":"2024-09-22T08:56:32.099772+0000","last_active":"2024-09-22T08:56:32.099826+0000","last_peered":"2024-09-22T08:56:32.099826+0000","last_clean":"2024-09-22T08:56:32.099826+0000","last_became_active":"2024-09-22T08:15:04.968172+0000","last_became_peered":"2024-09-22T08:15:04.968172+0000","last_unstale":"2024-09-22T08:56:32.099826+0000","last_undegraded":"2024-09-22T08:56:32.099826+0000","last_fullsized":"2024-09-22T08:56:32.099826+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'221","last_scrub_stamp":"2024-09-22T08:56:32.099657+0000","last_deep_scrub":"263'221","last_deep_scrub_stamp":"2024-09-22T08:56:32.099657+0000","last_clean_scrub_stamp":"2024-09-22T08:56:32.099657+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:37:00.416721+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":641,"num_read_kb":8608,"num_write":1007,"num_write_kb":17473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"263'757","reported_seq":2299,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:38.811418+0000","last_change":"2024-09-22T08:56:38.811418+0000","last_active":"2024-09-22T08:56:38.811418+0000","last_peered":"2024-09-22T08:56:38.811418+0000","last_clean":"2024-09-22T08:56:38.811418+0000","last_became_active":"2024-09-22T08:15:06.976019+0000","last_became_peered":"2024-09-22T08:15:06.976019+0000","last_unstale":"2024-09-22T08:56:38.811418+0000","last_undegraded":"2024-09-22T08:56:38.811418+0000","last_fullsized":"2024-09-22T08:56:38.811418+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'757","last_scrub_stamp":"2024-09-22T08:56:38.811329+0000","last_deep_scrub":"263'757","last_deep_scrub_stamp":"2024-09-22T08:56:38.811329+0000","last_clean_scrub_stamp":"2024-09-22T08:56:38.811329+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:12:18.113138+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3691,"num_read_kb":3360,"num_write":995,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"263'226","reported_seq":925,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:37.743182+0000","last_change":"2024-09-22T08:56:37.743129+0000","last_active":"2024-09-22T08:56:37.743182+0000","last_peered":"2024-09-22T08:56:37.743182+0000","last_clean":"2024-09-22T08:56:37.743182+0000","last_became_active":"2024-09-22T08:15:04.963391+0000","last_became_peered":"2024-09-22T08:15:04.963391+0000","last_unstale":"2024-09-22T08:56:37.743182+0000","last_undegraded":"2024-09-22T08:56:37.743182+0000","last_fullsized":"2024-09-22T08:56:37.743182+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'226","last_scrub_stamp":"2024-09-22T08:56:37.743035+0000","last_deep_scrub":"263'226","last_deep_scrub_stamp":"2024-09-22T08:56:37.743035+0000","last_clean_scrub_stamp":"2024-09-22T08:56:37.743035+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:49:16.424122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":637,"num_read_kb":95067,"num_write":1060,"num_write_kb":43906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"263'269","reported_seq":933,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:38.770086+0000","last_change":"2024-09-22T08:56:38.770007+0000","last_active":"2024-09-22T08:56:38.770086+0000","last_peered":"2024-09-22T08:56:38.770086+0000","last_clean":"2024-09-22T08:56:38.770086+0000","last_became_active":"2024-09-22T08:15:04.965396+0000","last_became_peered":"2024-09-22T08:15:04.965396+0000","last_unstale":"2024-09-22T08:56:38.770086+0000","last_undegraded":"2024-09-22T08:56:38.770086+0000","last_fullsized":"2024-09-22T08:56:38.770086+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'269","last_scrub_stamp":"2024-09-22T08:56:38.769874+0000","last_deep_scrub":"263'269","last_deep_scrub_stamp":"2024-09-22T08:56:38.769874+0000","last_clean_scrub_stamp":"2024-09-22T08:56:38.769874+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:54.013054+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":744,"num_read_kb":7770,"num_write":1118,"num_write_kb":20319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"263'1212","reported_seq":2932,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:38.730878+0000","last_change":"2024-09-22T08:56:38.730878+0000","last_active":"2024-09-22T08:56:38.730878+0000","last_peered":"2024-09-22T08:56:38.730878+0000","last_clean":"2024-09-22T08:56:38.730878+0000","last_became_active":"2024-09-22T08:15:06.970717+0000","last_became_peered":"2024-09-22T08:15:06.970717+0000","last_unstale":"2024-09-22T08:56:38.730878+0000","last_undegraded":"2024-09-22T08:56:38.730878+0000","last_fullsized":"2024-09-22T08:56:38.730878+0000","mapping_epoch":25,"log_start":"263'1200","ondisk_log_start":"263'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1212","last_scrub_stamp":"2024-09-22T08:56:38.730771+0000","last_deep_scrub":"263'1212","last_deep_scrub_stamp":"2024-09-22T08:56:38.730771+0000","last_clean_scrub_stamp":"2024-09-22T08:56:38.730771+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":1200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:49:00.467574+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5779,"num_read_kb":5147,"num_write":1662,"num_write_kb":686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"263'203","reported_seq":797,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:32.373515+0000","last_change":"2024-09-22T08:56:32.373450+0000","last_active":"2024-09-22T08:56:32.373515+0000","last_peered":"2024-09-22T08:56:32.373515+0000","last_clean":"2024-09-22T08:56:32.373515+0000","last_became_active":"2024-09-22T08:15:04.959102+0000","last_became_peered":"2024-09-22T08:15:04.959102+0000","last_unstale":"2024-09-22T08:56:32.373515+0000","last_undegraded":"2024-09-22T08:56:32.373515+0000","last_fullsized":"2024-09-22T08:56:32.373515+0000","mapping_epoch":23,"log_start":"263'100","ondisk_log_start":"263'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'203","last_scrub_stamp":"2024-09-22T08:56:32.373334+0000","last_deep_scrub":"263'203","last_deep_scrub_stamp":"2024-09-22T08:56:32.373334+0000","last_clean_scrub_stamp":"2024-09-22T08:56:32.373334+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:45:32.367319+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":396,"num_read_kb":24955,"num_write":899,"num_write_kb":36551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"263'499","reported_seq":2117,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-22T08:56:33.765206+0000","last_change":"2024-09-22T08:56:33.765206+0000","last_active":"2024-09-22T08:56:33.765206+0000","last_peered":"2024-09-22T08:56:33.765206+0000","last_clean":"2024-09-22T08:56:33.765206+0000","last_became_active":"2024-09-22T08:15:06.968345+0000","last_became_peered":"2024-09-22T08:15:06.968345+0000","last_unstale":"2024-09-22T08:56:33.765206+0000","last_undegraded":"2024-09-22T08:56:33.765206+0000","last_fullsized":"2024-09-22T08:56:33.765206+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'499","last_scrub_stamp":"2024-09-22T08:56:33.765098+0000","last_deep_scrub":"263'499","last_deep_scrub_stamp":"2024-09-22T08:56:33.765098+0000","last_clean_scrub_stamp":"2024-09-22T08:56:33.765098+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:28:36.072865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2601,"num_read_kb":2436,"num_write":597,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10844,"num_read_kb":8840,"num_write":3116,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":899,"ondisk_log_size":899,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15081,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":16349,"num_read_kb":16036,"num_write":17069,"num_write_kb":4981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2585,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":30162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1770,"ondisk_log_size":1770,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":681,"ondisk_log_size":681,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382382,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":8323,"num_read_kb":10644,"num_write":5603,"num_write_kb":2773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":709928,"num_omap_keys":1614,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1795,"ondisk_log_size":1795,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2393,"num_read_kb":2857,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":219693,"num_read_kb":201308,"num_write":55750,"num_write_kb":18998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35480,"num_omap_keys":143,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4023,"ondisk_log_size":4023,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":22399416,"num_objects":166,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":166,"num_whiteouts":0,"num_read":38892,"num_read_kb":2161027,"num_write":64127,"num_write_kb":2146956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45760512,"data_stored":44798832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3530,"ondisk_log_size":3530,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":194127,"num_write":186,"num_write_kb":125446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":186900,"num_write":186,"num_write_kb":125446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509959,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":202588,"kb_used_data":8972,"kb_used_omap":1,"kb_used_meta":193598,"kb_avail":94169252,"statfs":{"total":96636764160,"available":96429314048,"internally_reserved":0,"allocated":9187328,"data_stored":7502420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":198244808},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509960,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":261412,"kb_used_data":9492,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94110428,"statfs":{"total":96636764160,"available":96369078272,"internally_reserved":0,"allocated":9719808,"data_stored":8091734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257948101},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509960,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":86104,"kb_used_data":10504,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94285736,"statfs":{"total":96636764160,"available":96548593664,"internally_reserved":0,"allocated":10756096,"data_stored":9074858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542663,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":208972,"kb_used_data":7100,"kb_used_omap":1,"kb_used_meta":201854,"kb_avail":94162868,"statfs":{"total":96636764160,"available":96422776832,"internally_reserved":0,"allocated":7270400,"data_stored":5649861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":206698954},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542662,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81736,"kb_used_data":10296,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94290104,"statfs":{"total":96636764160,"available":96553066496,"internally_reserved":0,"allocated":10543104,"data_stored":8890315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542663,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":248020,"kb_used_data":9988,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94123820,"statfs":{"total":96636764160,"available":96382791680,"internally_reserved":0,"allocated":10227712,"data_stored":8586347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243726789},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542665,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148296,"kb_used_data":8888,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94223544,"statfs":{"total":96636764160,"available":96484909056,"internally_reserved":0,"allocated":9101312,"data_stored":7502190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575365,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120688,"kb_used_data":8992,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94251152,"statfs":{"total":96636764160,"available":96513179648,"internally_reserved":0,"allocated":9207808,"data_stored":7504913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7127040,"data_stored":6973120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5500928,"data_stored":5399874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5558272,"data_stored":5400076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5541888,"data_stored":5400084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5492736,"data_stored":5399824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":6012928,"data_stored":5893124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6889472,"data_stored":6786226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3637248,"data_stored":3546504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":5633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":3876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":5455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T08:57:46.449 DEBUG:teuthology.orchestra.run.smithi038:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-22T08:57:46.782 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-22T08:57:46.782 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-22T08:57:46.783 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-22T08:57:46.783 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T08:57:46.830 INFO:tasks.ceph.osd.0:Stopped 2024-09-22T08:57:46.830 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-22T08:57:46.830 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T08:57:46.880 INFO:tasks.ceph.osd.1:Stopped 2024-09-22T08:57:46.881 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-22T08:57:46.881 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T08:57:46.936 INFO:tasks.ceph.osd.2:Stopped 2024-09-22T08:57:46.936 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-22T08:57:46.936 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T08:57:46.983 INFO:tasks.ceph.osd.3:Stopped 2024-09-22T08:57:46.983 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-22T08:57:46.983 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T08:57:47.037 INFO:tasks.ceph.osd.4:Stopped 2024-09-22T08:57:47.037 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-22T08:57:47.037 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T08:57:47.091 INFO:tasks.ceph.osd.5:Stopped 2024-09-22T08:57:47.092 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-22T08:57:47.092 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T08:57:47.132 INFO:tasks.ceph.osd.6:Stopped 2024-09-22T08:57:47.132 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-22T08:57:47.132 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T08:57:47.214 INFO:tasks.ceph.osd.7:Stopped 2024-09-22T08:57:47.214 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-22T08:57:47.214 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-22T08:57:47.215 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T08:57:47.241 INFO:tasks.ceph.mgr.y:Stopped 2024-09-22T08:57:47.241 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-22T08:57:47.241 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T08:57:47.273 INFO:tasks.ceph.mgr.x:Stopped 2024-09-22T08:57:47.274 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-22T08:57:47.274 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-22T08:57:47.274 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T08:57:47.297 INFO:tasks.ceph.mon.a:Stopped 2024-09-22T08:57:47.297 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-22T08:57:47.297 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T08:57:47.350 INFO:tasks.ceph.mon.c:Stopped 2024-09-22T08:57:47.350 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-22T08:57:47.350 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T08:57:47.364 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-22T08:57:47.364 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-22T08:57:47.364 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-09-22T08:57:47.364 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-09-22T08:57:47.364 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-09-22T08:57:47.364 INFO:tasks.ceph.mon.b:Stopped 2024-09-22T08:57:47.365 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-22T08:57:47.365 DEBUG:teuthology.orchestra.run.smithi038:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-22T08:57:47.437 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi038.front.sepia.ceph.com 2024-09-22T08:57:47.437 DEBUG:teuthology.orchestra.run.smithi038:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-22T08:57:47.646 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi038.front.sepia.ceph.com 2024-09-22T08:57:47.646 DEBUG:teuthology.orchestra.run.smithi038:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-22T08:57:47.755 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi038.front.sepia.ceph.com 2024-09-22T08:57:47.755 DEBUG:teuthology.orchestra.run.smithi038:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-22T08:57:47.855 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi038.front.sepia.ceph.com 2024-09-22T08:57:47.855 DEBUG:teuthology.orchestra.run.smithi038:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-22T08:57:47.942 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi042.front.sepia.ceph.com 2024-09-22T08:57:47.943 DEBUG:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-22T08:57:48.134 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi042.front.sepia.ceph.com 2024-09-22T08:57:48.134 DEBUG:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-22T08:57:48.223 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi042.front.sepia.ceph.com 2024-09-22T08:57:48.223 DEBUG:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-22T08:57:48.297 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi042.front.sepia.ceph.com 2024-09-22T08:57:48.297 DEBUG:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-22T08:57:48.376 INFO:tasks.ceph:Archiving mon data... 2024-09-22T08:57:48.378 DEBUG:teuthology.misc:Transferring archived files from smithi038:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915040/data/mon.a.tgz 2024-09-22T08:57:48.378 DEBUG:teuthology.orchestra.run.smithi038:> mktemp 2024-09-22T08:57:48.411 INFO:teuthology.orchestra.run.smithi038.stdout:/tmp/tmp.QktQiX10Yv 2024-09-22T08:57:48.412 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.QktQiX10Yv 2024-09-22T08:57:48.616 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 0666 /tmp/tmp.QktQiX10Yv 2024-09-22T08:57:48.730 DEBUG:teuthology.orchestra.remote:smithi038:/tmp/tmp.QktQiX10Yv is 488KB 2024-09-22T08:57:48.828 DEBUG:teuthology.orchestra.run.smithi038:> rm -fr /tmp/tmp.QktQiX10Yv 2024-09-22T08:57:48.859 DEBUG:teuthology.misc:Transferring archived files from smithi038:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915040/data/mon.c.tgz 2024-09-22T08:57:48.859 DEBUG:teuthology.orchestra.run.smithi038:> mktemp 2024-09-22T08:57:48.928 INFO:teuthology.orchestra.run.smithi038.stdout:/tmp/tmp.LC2iovzXJf 2024-09-22T08:57:48.929 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.LC2iovzXJf 2024-09-22T08:57:49.123 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 0666 /tmp/tmp.LC2iovzXJf 2024-09-22T08:57:49.235 DEBUG:teuthology.orchestra.remote:smithi038:/tmp/tmp.LC2iovzXJf is 506KB 2024-09-22T08:57:49.336 DEBUG:teuthology.orchestra.run.smithi038:> rm -fr /tmp/tmp.LC2iovzXJf 2024-09-22T08:57:49.366 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915040/data/mon.b.tgz 2024-09-22T08:57:49.366 DEBUG:teuthology.orchestra.run.smithi042:> mktemp 2024-09-22T08:57:49.402 INFO:teuthology.orchestra.run.smithi042.stdout:/tmp/tmp.xFfmzpwGKE 2024-09-22T08:57:49.402 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.xFfmzpwGKE 2024-09-22T08:57:49.619 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0666 /tmp/tmp.xFfmzpwGKE 2024-09-22T08:57:49.731 DEBUG:teuthology.orchestra.remote:smithi042:/tmp/tmp.xFfmzpwGKE is 506KB 2024-09-22T08:57:49.834 DEBUG:teuthology.orchestra.run.smithi042:> rm -fr /tmp/tmp.xFfmzpwGKE 2024-09-22T08:57:49.863 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-22T08:57:49.863 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-22T08:57:49.866 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-22T08:57:49.979 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-22T08:57:50.013 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-22T08:57:50.014 INFO:tasks.ceph:Archiving crash dumps... 2024-09-22T08:57:50.016 DEBUG:teuthology.misc:Transferring archived files from smithi038:/var/lib/ceph/crash to /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915040/remote/smithi038/crash 2024-09-22T08:57:50.017 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-22T08:57:50.062 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/lib/ceph/crash to /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915040/remote/smithi042/crash 2024-09-22T08:57:50.063 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-22T08:57:50.101 INFO:tasks.ceph:Compressing logs... 2024-09-22T08:57:50.102 DEBUG:teuthology.orchestra.run.smithi038:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-22T08:57:50.106 DEBUG:teuthology.orchestra.run.smithi042:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-22T08:57:50.144 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-22T08:57:50.151 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189841.log 2024-09-22T08:57:50.151 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135741.log 2024-09-22T08:57:50.151 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.189841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121014.log 2024-09-22T08:57:50.152 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189841.log.gz 2024-09-22T08:57:50.152 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.135741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39351.log 2024-09-22T08:57:50.152 INFO:teuthology.orchestra.run.smithi038.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.135741.log.gz 2024-09-22T08:57:50.152 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.121014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180171.log 2024-09-22T08:57:50.152 INFO:teuthology.orchestra.run.smithi038.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.121014.log.gz 2024-09-22T08:57:50.152 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.39351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50200.log 2024-09-22T08:57:50.152 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39351.log.gz 2024-09-22T08:57:50.152 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.180171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59131.log 2024-09-22T08:57:50.152 INFO:teuthology.orchestra.run.smithi038.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.0.180171.log.gz 2024-09-22T08:57:50.152 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.50200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40081.log 2024-09-22T08:57:50.152 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.59131.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.50200.log.gz 2024-09-22T08:57:50.152 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186817.log 2024-09-22T08:57:50.152 INFO:teuthology.orchestra.run.smithi038.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.59131.log.gz 2024-09-22T08:57:50.152 INFO:teuthology.orchestra.run.smithi038.stderr:gzip/var/log/ceph/ceph-client.0.40081.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.103343.log 2024-09-22T08:57:50.153 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.186817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78604.log 2024-09-22T08:57:50.153 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.186817.log.gz 2024-09-22T08:57:50.153 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.103343.log: 95.9% -- replaced with /var/log/ceph/ceph-client.0.40081.log.gz 2024-09-22T08:57:50.153 INFO:teuthology.orchestra.run.smithi038.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.103343.log.gz 2024-09-22T08:57:50.153 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98042.log 2024-09-22T08:57:50.153 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.78604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148110.log 2024-09-22T08:57:50.153 INFO:teuthology.orchestra.run.smithi038.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.78604.log.gz 2024-09-22T08:57:50.153 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.98042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190670.log 2024-09-22T08:57:50.153 INFO:teuthology.orchestra.run.smithi038.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.98042.log.gz 2024-09-22T08:57:50.153 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.148110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.165950.log 2024-09-22T08:57:50.153 INFO:teuthology.orchestra.run.smithi038.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.148110.log.gz 2024-09-22T08:57:50.153 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.190670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39343.log 2024-09-22T08:57:50.153 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190670.log.gz 2024-09-22T08:57:50.153 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.165950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61466.log 2024-09-22T08:57:50.154 INFO:teuthology.orchestra.run.smithi038.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.165950.log.gz 2024-09-22T08:57:50.154 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.39343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158715.log 2024-09-22T08:57:50.154 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39343.log.gz 2024-09-22T08:57:50.154 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.61466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109822.log 2024-09-22T08:57:50.154 INFO:teuthology.orchestra.run.smithi038.stderr: 54.0% -- replaced with /var/log/ceph/ceph-client.admin.61466.log.gz 2024-09-22T08:57:50.154 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.158715.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.26688.log 2024-09-22T08:57:50.154 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158715.log.gz 2024-09-22T08:57:50.154 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.109822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177126.log 2024-09-22T08:57:50.154 INFO:teuthology.orchestra.run.smithi038.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.109822.log.gz 2024-09-22T08:57:50.154 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph.tmp-client.admin.26688.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph.tmp-client.admin.26688.log.gz /var/log/ceph/ceph-client.admin.160503.log 2024-09-22T08:57:50.154 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-09-22T08:57:50.172 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.177126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136919.log 2024-09-22T08:57:50.172 INFO:teuthology.orchestra.run.smithi038.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.0.177126.log.gz 2024-09-22T08:57:50.172 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.160503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74405.log 2024-09-22T08:57:50.172 INFO:teuthology.orchestra.run.smithi038.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.160503.log.gz 2024-09-22T08:57:50.172 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.136919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43719.log 2024-09-22T08:57:50.172 INFO:teuthology.orchestra.run.smithi038.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.136919.log.gz 2024-09-22T08:57:50.172 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.74405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148699.log 2024-09-22T08:57:50.173 INFO:teuthology.orchestra.run.smithi038.stderr: 25.5% -- replaced with /var/log/ceph/ceph-client.admin.74405.log.gz 2024-09-22T08:57:50.173 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.43719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190117.log 2024-09-22T08:57:50.173 INFO:teuthology.orchestra.run.smithi038.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.43719.log.gz 2024-09-22T08:57:50.173 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.148699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189933.log 2024-09-22T08:57:50.173 INFO:teuthology.orchestra.run.smithi038.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.148699.log.gz 2024-09-22T08:57:50.173 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.190117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95686.log 2024-09-22T08:57:50.173 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190117.log.gz 2024-09-22T08:57:50.173 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.189933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61010.log 2024-09-22T08:57:50.173 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189933.log.gz 2024-09-22T08:57:50.173 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.95686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133384.log 2024-09-22T08:57:50.173 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.61010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185592.log 2024-09-22T08:57:50.173 INFO:teuthology.orchestra.run.smithi038.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.95686.log.gz 2024-09-22T08:57:50.173 INFO:teuthology.orchestra.run.smithi038.stderr: 46.8% -- replaced with /var/log/ceph/ceph-client.admin.61010.log.gz 2024-09-22T08:57:50.173 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.133384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41910.log 2024-09-22T08:57:50.174 INFO:teuthology.orchestra.run.smithi038.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.133384.log.gz 2024-09-22T08:57:50.174 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.185592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119836.log 2024-09-22T08:57:50.174 INFO:teuthology.orchestra.run.smithi038.stderr: 82.8%/var/log/ceph/ceph-client.0.41910.log: -- replaced with /var/log/ceph/ceph-client.admin.185592.log.gz 2024-09-22T08:57:50.174 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118658.log 2024-09-22T08:57:50.174 INFO:teuthology.orchestra.run.smithi038.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.41910.log.gz 2024-09-22T08:57:50.174 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.119836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100987.log 2024-09-22T08:57:50.174 INFO:teuthology.orchestra.run.smithi038.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.119836.log.gz 2024-09-22T08:57:50.174 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.118658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71452.log 2024-09-22T08:57:50.174 INFO:teuthology.orchestra.run.smithi038.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.118658.log.gz 2024-09-22T08:57:50.174 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.100987.log: /var/log/ceph/ceph-client.admin.58542.log 2024-09-22T08:57:50.174 INFO:teuthology.orchestra.run.smithi038.stderr: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.100987.log.gz 2024-09-22T08:57:50.174 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.71452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190348.log 2024-09-22T08:57:50.174 INFO:teuthology.orchestra.run.smithi038.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.71452.log.gz 2024-09-22T08:57:50.174 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.58542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51378.log 2024-09-22T08:57:50.175 INFO:teuthology.orchestra.run.smithi038.stderr: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.58542.log.gz 2024-09-22T08:57:50.175 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.190348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181389.log 2024-09-22T08:57:50.175 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190348.log.gz 2024-09-22T08:57:50.175 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.51378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38977.log 2024-09-22T08:57:50.175 INFO:teuthology.orchestra.run.smithi038.stderr: 84.2%/var/log/ceph/ceph-client.0.181389.log: -- replaced with /var/log/ceph/ceph-client.admin.51378.log.gz 2024-09-22T08:57:50.175 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-22T08:57:50.175 INFO:teuthology.orchestra.run.smithi038.stderr: 83.7% -- replaced with /var/log/ceph/ceph-client.0.181389.log.gz 2024-09-22T08:57:50.175 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.38977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99220.log 2024-09-22T08:57:50.175 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38977.log.gz 2024-09-22T08:57:50.175 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115124.log 2024-09-22T08:57:50.175 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.99220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159325.log 2024-09-22T08:57:50.175 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.115124.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.99220.log.gz 2024-09-22T08:57:50.175 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72633.log 2024-09-22T08:57:50.175 INFO:teuthology.orchestra.run.smithi038.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.115124.log.gz 2024-09-22T08:57:50.175 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.159325.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-22T08:57:50.176 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.72633.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.159325.log.gz 2024-09-22T08:57:50.176 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122782.log 2024-09-22T08:57:50.176 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80960.log 2024-09-22T08:57:50.176 INFO:teuthology.orchestra.run.smithi038.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.72633.log.gz 2024-09-22T08:57:50.176 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.122782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187550.log 2024-09-22T08:57:50.176 INFO:teuthology.orchestra.run.smithi038.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.122782.log.gz 2024-09-22T08:57:50.176 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105110.log 2024-09-22T08:57:50.176 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.80960.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.80960.log.gz 2024-09-22T08:57:50.176 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.187550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106877.log 2024-09-22T08:57:50.176 INFO:teuthology.orchestra.run.smithi038.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.187550.log.gz 2024-09-22T08:57:50.176 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.105110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39345.log 2024-09-22T08:57:50.176 INFO:teuthology.orchestra.run.smithi038.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.105110.log.gz 2024-09-22T08:57:50.176 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.106877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186181.log 2024-09-22T08:57:50.176 INFO:teuthology.orchestra.run.smithi038.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.106877.log.gz 2024-09-22T08:57:50.176 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.39345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115713.log 2024-09-22T08:57:50.177 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39345.log.gz 2024-09-22T08:57:50.177 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.186181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129850.log 2024-09-22T08:57:50.177 INFO:teuthology.orchestra.run.smithi038.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.186181.log.gz 2024-09-22T08:57:50.177 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84494.log 2024-09-22T08:57:50.177 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.115713.log: /var/log/ceph/ceph-client.admin.129850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56138.log 2024-09-22T08:57:50.177 INFO:teuthology.orchestra.run.smithi038.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.115713.log.gz 2024-09-22T08:57:50.177 INFO:teuthology.orchestra.run.smithi038.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.129850.log.gz 2024-09-22T08:57:50.177 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.84494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166599.log 2024-09-22T08:57:50.177 INFO:teuthology.orchestra.run.smithi038.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.84494.log.gz 2024-09-22T08:57:50.177 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.56138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60892.log 2024-09-22T08:57:50.177 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.166599.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.56138.log.gz 2024-09-22T08:57:50.177 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116891.log 2024-09-22T08:57:50.177 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.60892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62113.log 2024-09-22T08:57:50.177 INFO:teuthology.orchestra.run.smithi038.stderr: 55.1% -- replaced with /var/log/ceph/ceph-client.admin.60892.log.gz 2024-09-22T08:57:50.178 INFO:teuthology.orchestra.run.smithi038.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.166599.log.gz 2024-09-22T08:57:50.178 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.116891.log: -- /var/log/ceph/ceph-client.0.188938.log 2024-09-22T08:57:50.178 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.62113.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.116891.log.gz 2024-09-22T08:57:50.178 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70359.log 2024-09-22T08:57:50.178 INFO:teuthology.orchestra.run.smithi038.stderr: 21.6% -- replaced with /var/log/ceph/ceph-client.admin.62113.log.gz 2024-09-22T08:57:50.178 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100398.log 2024-09-22T08:57:50.178 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.188938.log: /var/log/ceph/ceph-client.admin.70359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139275.log 2024-09-22T08:57:50.178 INFO:teuthology.orchestra.run.smithi038.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.70359.log.gz 2024-09-22T08:57:50.178 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.100398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39349.log 2024-09-22T08:57:50.178 INFO:teuthology.orchestra.run.smithi038.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.100398.log.gz 2024-09-22T08:57:50.178 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.139275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143398.log 2024-09-22T08:57:50.178 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.39349.log: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141631.log 2024-09-22T08:57:50.178 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39349.log.gz 2024-09-22T08:57:50.178 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.139275.log.gz 2024-09-22T08:57:50.178 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54323.log 2024-09-22T08:57:50.179 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.143398.log: /var/log/ceph/ceph-client.admin.141631.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.188938.log.gz 2024-09-22T08:57:50.179 INFO:teuthology.orchestra.run.smithi038.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.143398.log.gz 2024-09-22T08:57:50.179 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54912.log 2024-09-22T08:57:50.179 INFO:teuthology.orchestra.run.smithi038.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.141631.log.gz 2024-09-22T08:57:50.179 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.54323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152234.log 2024-09-22T08:57:50.179 INFO:teuthology.orchestra.run.smithi038.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.54323.log.gz 2024-09-22T08:57:50.179 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.54912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151644.log 2024-09-22T08:57:50.179 INFO:teuthology.orchestra.run.smithi038.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.54912.log.gz 2024-09-22T08:57:50.179 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.152234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116302.log 2024-09-22T08:57:50.179 INFO:teuthology.orchestra.run.smithi038.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.152234.log.gz 2024-09-22T08:57:50.179 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112767.log 2024-09-22T08:57:50.179 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.151644.log: /var/log/ceph/ceph-client.admin.116302.log: gzip 85.2% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.151644.log.gz -- 2024-09-22T08:57:50.179 INFO:teuthology.orchestra.run.smithi038.stderr: /var/log/ceph/ceph-client.admin.63501.log 2024-09-22T08:57:50.179 INFO:teuthology.orchestra.run.smithi038.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.116302.log.gz 2024-09-22T08:57:50.179 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.112767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92152.log 2024-09-22T08:57:50.180 INFO:teuthology.orchestra.run.smithi038.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.112767.log.gz 2024-09-22T08:57:50.180 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86262.log 2024-09-22T08:57:50.180 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.63501.log: /var/log/ceph/ceph-client.admin.92152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189887.log 2024-09-22T08:57:50.180 INFO:teuthology.orchestra.run.smithi038.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.92152.log.gz 2024-09-22T08:57:50.180 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.86262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88618.log 2024-09-22T08:57:50.180 INFO:teuthology.orchestra.run.smithi038.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.63501.log.gz 2024-09-22T08:57:50.180 INFO:teuthology.orchestra.run.smithi038.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.86262.log.gz 2024-09-22T08:57:50.180 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.189887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134562.log 2024-09-22T08:57:50.180 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189887.log.gz 2024-09-22T08:57:50.180 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.88618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.175297.log 2024-09-22T08:57:50.180 INFO:teuthology.orchestra.run.smithi038.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.88618.log.gz 2024-09-22T08:57:50.180 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.134562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145165.log 2024-09-22T08:57:50.190 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32941.log 2024-09-22T08:57:50.191 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32677.log 2024-09-22T08:57:50.191 INFO:teuthology.orchestra.run.smithi042.stderr:gzip/var/log/ceph/ceph-client.admin.32941.log: -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-22T08:57:50.191 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32941.log.gz 2024-09-22T08:57:50.191 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32853.log 2024-09-22T08:57:50.191 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32677.log.gz 2024-09-22T08:57:50.191 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32809.log 2024-09-22T08:57:50.191 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32853.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-22T08:57:50.191 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32853.log.gz 2024-09-22T08:57:50.191 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32721.log 2024-09-22T08:57:50.191 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32809.log.gz 2024-09-22T08:57:50.191 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-22T08:57:50.191 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32633.log 2024-09-22T08:57:50.191 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32721.log.gz 2024-09-22T08:57:50.192 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32765.log 2024-09-22T08:57:50.192 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32633.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-22T08:57:50.192 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32633.log.gz 2024-09-22T08:57:50.192 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32765.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-22T08:57:50.192 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32765.log.gz 2024-09-22T08:57:50.192 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-22T08:57:50.192 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-22T08:57:50.192 INFO:teuthology.orchestra.run.smithi042.stderr: 90.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-22T08:57:50.192 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-22T08:57:50.192 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32897.log/var/log/ceph/ceph-mgr.x.log: 2024-09-22T08:57:50.192 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.32897.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32897.log.gz 2024-09-22T08:57:50.194 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-22T08:57:50.263 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.175297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33205.log 2024-09-22T08:57:50.264 INFO:teuthology.orchestra.run.smithi038.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.134562.log.gz 2024-09-22T08:57:50.264 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.145165.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.175297.log.gz 2024-09-22T08:57:50.264 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142220.log 2024-09-22T08:57:50.264 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.33205.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33205.log.gz 2024-09-22T08:57:50.264 INFO:teuthology.orchestra.run.smithi038.stderr: --verbose -- /var/log/ceph/ceph-client.admin.126316.log 2024-09-22T08:57:50.264 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.142220.log: gzip -5 --verbose -- 81.3% -- replaced with /var/log/ceph/ceph-client.admin.142220.log.gz 2024-09-22T08:57:50.264 INFO:teuthology.orchestra.run.smithi038.stderr: /var/log/ceph/ceph-client.admin.38976.log 2024-09-22T08:57:50.264 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.126316.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.145165.log.gz 2024-09-22T08:57:50.264 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112178.log 2024-09-22T08:57:50.264 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176517.log 2024-09-22T08:57:50.264 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.38976.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38976.log.gz 2024-09-22T08:57:50.264 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.112178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190578.log 2024-09-22T08:57:50.264 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.176517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162321.log 2024-09-22T08:57:50.264 INFO:teuthology.orchestra.run.smithi038.stderr: 83.7% -- replaced with /var/log/ceph/ceph-client.0.176517.log.gz 86.0% -- replaced with /var/log/ceph/ceph-client.admin.126316.log.gz 2024-09-22T08:57:50.265 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.190578.log: 2024-09-22T08:57:50.265 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190578.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61399.log 2024-09-22T08:57:50.265 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-09-22T08:57:50.265 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50176.log 2024-09-22T08:57:50.265 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.162321.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.112178.log.gz 2024-09-22T08:57:50.265 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.61399.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.162321.log.gz 2024-09-22T08:57:50.265 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79782.log 2024-09-22T08:57:50.265 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167207.log 2024-09-22T08:57:50.265 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.50176.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50176.log.gz 2024-09-22T08:57:50.265 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.79782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40012.log 2024-09-22T08:57:50.265 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.167207.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.79782.log.gz 2024-09-22T08:57:50.265 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39208.log 2024-09-22T08:57:50.265 INFO:teuthology.orchestra.run.smithi038.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.167207.log.gz 2024-09-22T08:57:50.265 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.40012.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40012.log.gz 2024-09-22T08:57:50.266 INFO:teuthology.orchestra.run.smithi038.stderr: --verbose -- /var/log/ceph/ceph-client.admin.119247.log 2024-09-22T08:57:50.266 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.39208.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39208.log.gz 2024-09-22T08:57:50.266 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168145.log 2024-09-22T08:57:50.266 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.119247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158736.log 2024-09-22T08:57:50.266 INFO:teuthology.orchestra.run.smithi038.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.119247.log.gz 2024-09-22T08:57:50.266 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.168145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65358.log 2024-09-22T08:57:50.266 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.158736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47159.log 2024-09-22T08:57:50.266 INFO:teuthology.orchestra.run.smithi038.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.158736.log.gz 2024-09-22T08:57:50.266 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.65358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89207.log 2024-09-22T08:57:50.266 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38981.log 2024-09-22T08:57:50.266 INFO:teuthology.orchestra.run.smithi038.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.168145.log.gz 2024-09-22T08:57:50.266 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.47159.log: /var/log/ceph/ceph-client.admin.89207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92741.log 2024-09-22T08:57:50.266 INFO:teuthology.orchestra.run.smithi038.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.47159.log.gz 2024-09-22T08:57:50.266 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.38981.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38981.log.gz 2024-09-22T08:57:50.267 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125138.log 2024-09-22T08:57:50.267 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.92741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190255.log 2024-09-22T08:57:50.267 INFO:teuthology.orchestra.run.smithi038.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.92741.log.gz 2024-09-22T08:57:50.267 INFO:teuthology.orchestra.run.smithi038.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.89207.log.gz 2024-09-22T08:57:50.267 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.125138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39968.log 2024-09-22T08:57:50.267 INFO:teuthology.orchestra.run.smithi038.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.125138.log.gz 2024-09-22T08:57:50.267 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.190255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39205.log 2024-09-22T08:57:50.267 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190255.log.gz 2024-09-22T08:57:50.267 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.39968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190301.log 2024-09-22T08:57:50.267 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39968.log.gz 2024-09-22T08:57:50.267 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.39205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94508.log 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39205.log.gz 2024-09-22T08:57:50.267 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-09-22T08:57:50.267 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.190301.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190301.log.gz 2024-09-22T08:57:50.267 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190071.log 2024-09-22T08:57:50.268 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.94508.log: gzip -5 --verbose 81.6% -- replaced with /var/log/ceph/ceph-client.admin.94508.log.gz 2024-09-22T08:57:50.268 INFO:teuthology.orchestra.run.smithi038.stderr: -- /var/log/ceph/ceph-client.admin.69075.log 2024-09-22T08:57:50.268 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.190071.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190071.log.gz 2024-09-22T08:57:50.268 INFO:teuthology.orchestra.run.smithi038.stderr:gzip 93.0% -- replaced with /var/log/ceph/ceph-client.admin.65358.log.gz 2024-09-22T08:57:50.268 INFO:teuthology.orchestra.run.smithi038.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.91563.log 2024-09-22T08:57:50.268 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.69075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46570.log 2024-09-22T08:57:50.268 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.91563.log: gzip -5 --verbose 81.5% -- replaced with /var/log/ceph/ceph-client.admin.91563.log.gz 2024-09-22T08:57:50.268 INFO:teuthology.orchestra.run.smithi038.stderr: -- /var/log/ceph/ceph-client.admin.150466.log 2024-09-22T08:57:50.268 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.46570.log: gzip -5 --verbose -- 88.9% -- replaced with /var/log/ceph/ceph-client.admin.69075.log.gz 2024-09-22T08:57:50.268 INFO:teuthology.orchestra.run.smithi038.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.46570.log.gz 2024-09-22T08:57:50.268 INFO:teuthology.orchestra.run.smithi038.stderr: /var/log/ceph/ceph-client.admin.170724.log 2024-09-22T08:57:50.268 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.150466.log: gzip -5 --verbose -- 85.3% -- replaced with /var/log/ceph/ceph-client.admin.150466.log.gz 2024-09-22T08:57:50.268 INFO:teuthology.orchestra.run.smithi038.stderr: /var/log/ceph/ceph-client.0.75183.log 2024-09-22T08:57:50.268 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.170724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137508.log 2024-09-22T08:57:50.268 INFO:teuthology.orchestra.run.smithi038.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.170724.log.gz 2024-09-22T08:57:50.269 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.75183.log: gzip -5 84.2% -- replaced with /var/log/ceph/ceph-client.0.75183.log.gz 2024-09-22T08:57:50.269 INFO:teuthology.orchestra.run.smithi038.stderr: --verbose -- /var/log/ceph/ceph.audit.log 2024-09-22T08:57:50.269 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.137508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53145.log 2024-09-22T08:57:50.269 INFO:teuthology.orchestra.run.smithi038.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.137508.log.gz 2024-09-22T08:57:50.269 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98631.log 2024-09-22T08:57:50.269 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.53145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67837.log 2024-09-22T08:57:50.269 INFO:teuthology.orchestra.run.smithi038.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.53145.log.gz 2024-09-22T08:57:50.269 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.98631.log: gzip -5 --verbose -- 81.4% -- replaced with /var/log/ceph/ceph-client.admin.98631.log.gz 2024-09-22T08:57:50.269 INFO:teuthology.orchestra.run.smithi038.stderr: /var/log/ceph/ceph-client.admin.189795.log 2024-09-22T08:57:50.269 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.67837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39352.log 2024-09-22T08:57:50.269 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.189795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190624.log 2024-09-22T08:57:50.269 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189795.log.gz 2024-09-22T08:57:50.269 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.39352.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39352.log.gz 2024-09-22T08:57:50.269 INFO:teuthology.orchestra.run.smithi038.stderr: 94.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-22T08:57:50.270 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142809.log 2024-09-22T08:57:50.270 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.190624.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190624.log.gz 2024-09-22T08:57:50.270 INFO:teuthology.orchestra.run.smithi038.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.118069.log 2024-09-22T08:57:50.270 INFO:teuthology.orchestra.run.smithi038.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.67837.log.gz 2024-09-22T08:57:50.270 INFO:teuthology.orchestra.run.smithi038.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61399.log.gz 2024-09-22T08:57:50.270 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.142809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120425.log 2024-09-22T08:57:50.270 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.118069.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.142809.log.gz 2024-09-22T08:57:50.270 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90974.log 2024-09-22T08:57:50.270 INFO:teuthology.orchestra.run.smithi038.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.118069.log.gz 2024-09-22T08:57:50.270 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.120425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181998.log 2024-09-22T08:57:50.270 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.90974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74574.log 2024-09-22T08:57:50.270 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.181998.log: gzip -5 --verbose 89.0% -- /var/log/ceph/ceph-client.admin.102754.log -- replaced with /var/log/ceph/ceph-client.admin.90974.log.gz 2024-09-22T08:57:50.270 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-09-22T08:57:50.270 INFO:teuthology.orchestra.run.smithi038.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.0.181998.log.gz 2024-09-22T08:57:50.271 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.74574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.174688.log 2024-09-22T08:57:50.271 INFO:teuthology.orchestra.run.smithi038.stderr: 83.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187431.log 2024-09-22T08:57:50.271 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.0.74574.log.gz 2024-09-22T08:57:50.271 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.102754.log: /var/log/ceph/ceph-client.0.174688.log: gzip 81.7% -5 --verbose -- /var/log/ceph/ceph-client.admin.80371.log 2024-09-22T08:57:50.271 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.102754.log.gz 2024-09-22T08:57:50.271 INFO:teuthology.orchestra.run.smithi038.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.0.174688.log.gz 2024-09-22T08:57:50.271 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.187431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141042.log 2024-09-22T08:57:50.271 INFO:teuthology.orchestra.run.smithi038.stderr: 24.2% -- replaced with /var/log/ceph/ceph-client.admin.187431.log.gz 2024-09-22T08:57:50.271 INFO:teuthology.orchestra.run.smithi038.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.120425.log.gz 2024-09-22T08:57:50.271 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.80371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147521.log 2024-09-22T08:57:50.271 INFO:teuthology.orchestra.run.smithi038.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.80371.log.gz 2024-09-22T08:57:50.271 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.141042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183825.log 2024-09-22T08:57:50.271 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.147521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140453.log 2024-09-22T08:57:50.272 INFO:teuthology.orchestra.run.smithi038.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.147521.log.gz 2024-09-22T08:57:50.272 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.183825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190716.log 2024-09-22T08:57:50.272 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.140453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51967.log 2024-09-22T08:57:50.272 INFO:teuthology.orchestra.run.smithi038.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.0.183825.log.gz 2024-09-22T08:57:50.272 INFO:teuthology.orchestra.run.smithi038.stderr: 81.8%/var/log/ceph/ceph-client.admin.190716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190853.log 2024-09-22T08:57:50.272 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.140453.log.gz 2024-09-22T08:57:50.272 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190716.log.gz 2024-09-22T08:57:50.272 INFO:teuthology.orchestra.run.smithi038.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.141042.log.gz 2024-09-22T08:57:50.272 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.51967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56090.log 2024-09-22T08:57:50.272 INFO:teuthology.orchestra.run.smithi038.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.51967.log.gz 2024-09-22T08:57:50.272 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38978.log 2024-09-22T08:57:50.272 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.190853.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190853.log.gz 2024-09-22T08:57:50.272 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.56090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163523.log 2024-09-22T08:57:50.272 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56090.log.gz 2024-09-22T08:57:50.273 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.38978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38573.log 2024-09-22T08:57:50.273 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38978.log.gz 2024-09-22T08:57:50.273 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.163523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38983.log 2024-09-22T08:57:50.273 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163523.log.gz 2024-09-22T08:57:50.273 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.38573.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38573.log.gz 2024-09-22T08:57:50.273 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151055.log 2024-09-22T08:57:50.273 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.38983.log: /var/log/ceph/ceph-client.admin.88029.log 2024-09-22T08:57:50.273 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38983.log.gz 2024-09-22T08:57:50.273 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.151055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39644.log 2024-09-22T08:57:50.273 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.88029.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-22T08:57:50.273 INFO:teuthology.orchestra.run.smithi038.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.88029.log.gz 2024-09-22T08:57:50.273 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.39644.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39644.log.gz 2024-09-22T08:57:50.273 INFO:teuthology.orchestra.run.smithi038.stderr: --verbose -- /var/log/ceph/ceph-client.admin.73223.log 2024-09-22T08:57:50.273 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: gzip -5 --verbose 85.8% -- replaced with /var/log/ceph/ceph-client.admin.151055.log.gz 2024-09-22T08:57:50.273 INFO:teuthology.orchestra.run.smithi038.stderr: -- /var/log/ceph/ceph-client.admin.149288.log 2024-09-22T08:57:50.274 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.73223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75893.log 2024-09-22T08:57:50.274 INFO:teuthology.orchestra.run.smithi038.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.73223.log.gz 2024-09-22T08:57:50.274 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.149288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90385.log 2024-09-22T08:57:50.274 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.75893.log: gzip -5 --verbose -- 52.8% -- replaced with /var/log/ceph/ceph-client.admin.75893.log.gz 2024-09-22T08:57:50.274 INFO:teuthology.orchestra.run.smithi038.stderr: /var/log/ceph/ceph-client.admin.157536.log 2024-09-22T08:57:50.274 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.90385.log: gzip -5 --verbose -- 81.2% /var/log/ceph/ceph-client.0.75949.log 2024-09-22T08:57:50.274 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.90385.log.gz 2024-09-22T08:57:50.274 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.157536.log: 86.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183216.log 2024-09-22T08:57:50.274 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.149288.log.gz 2024-09-22T08:57:50.274 INFO:teuthology.orchestra.run.smithi038.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.157536.log.gz 2024-09-22T08:57:50.274 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.75949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110411.log 2024-09-22T08:57:50.274 INFO:teuthology.orchestra.run.smithi038.stderr:gzip/var/log/ceph/ceph-client.0.183216.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.67217.log 2024-09-22T08:57:50.274 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.110411.log: 83.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48385.log 2024-09-22T08:57:50.274 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.0.183216.log.gz 2024-09-22T08:57:50.275 INFO:teuthology.orchestra.run.smithi038.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.110411.log.gz 2024-09-22T08:57:50.275 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.67217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178953.log 2024-09-22T08:57:50.275 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.48385.log: 94.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38770.log 2024-09-22T08:57:50.275 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-09-22T08:57:50.275 INFO:teuthology.orchestra.run.smithi038.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.48385.log.gz 2024-09-22T08:57:50.275 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.178953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68456.log 2024-09-22T08:57:50.275 INFO:teuthology.orchestra.run.smithi038.stderr: 92.0%/var/log/ceph/ceph-client.admin.38770.log: -- replaced with /var/log/ceph/ceph-client.0.75949.log.gz 2024-09-22T08:57:50.275 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39552.log 2024-09-22T08:57:50.275 INFO:teuthology.orchestra.run.smithi038.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.0.178953.log.gz 2024-09-22T08:57:50.275 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38770.log.gz 2024-09-22T08:57:50.275 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.68456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64120.log 2024-09-22T08:57:50.275 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.39552.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39552.log.gz 2024-09-22T08:57:50.275 INFO:teuthology.orchestra.run.smithi038.stderr: --verbose -- /var/log/ceph/ceph-client.admin.164136.log 2024-09-22T08:57:50.275 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.64120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83905.log 2024-09-22T08:57:50.276 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.164136.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.68456.log.gzgzip 2024-09-22T08:57:50.276 INFO:teuthology.orchestra.run.smithi038.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.131028.log 2024-09-22T08:57:50.276 INFO:teuthology.orchestra.run.smithi038.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.164136.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186841.log 2024-09-22T08:57:50.276 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-09-22T08:57:50.276 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.83905.log: /var/log/ceph/ceph-client.admin.131028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149877.log 2024-09-22T08:57:50.276 INFO:teuthology.orchestra.run.smithi038.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.83905.log.gz 2024-09-22T08:57:50.276 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.186841.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.131028.log.gz 2024-09-22T08:57:50.276 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57316.log 2024-09-22T08:57:50.276 INFO:teuthology.orchestra.run.smithi038.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.186841.log.gz 2024-09-22T08:57:50.276 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62293.log 2024-09-22T08:57:50.276 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.149877.log: /var/log/ceph/ceph-client.admin.57316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154001.log 2024-09-22T08:57:50.276 INFO:teuthology.orchestra.run.smithi038.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.149877.log.gz 2024-09-22T08:57:50.276 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.62293.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.57316.log.gz 2024-09-22T08:57:50.276 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 84.0% -- replaced with /var/log/ceph/ceph-client.admin.62293.log.gz 2024-09-22T08:57:50.276 INFO:teuthology.orchestra.run.smithi038.stderr: --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-22T08:57:50.277 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.154001.log: gzip -5 --verbose -- 85.2% /var/log/ceph/ceph-client.admin.58518.log 2024-09-22T08:57:50.277 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.154001.log.gz 2024-09-22T08:57:50.277 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128672.log 2024-09-22T08:57:50.277 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.58518.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159914.log 2024-09-22T08:57:50.277 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58518.log.gz 2024-09-22T08:57:50.277 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186793.log 2024-09-22T08:57:50.277 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.128672.log: /var/log/ceph/ceph-client.admin.159914.log: 80.4% 81.6% -- replaced with /var/log/ceph/ceph-client.admin.128672.log.gz 2024-09-22T08:57:50.277 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.159914.log.gz 2024-09-22T08:57:50.277 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.175906.log 2024-09-22T08:57:50.277 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.186793.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41301.log 2024-09-22T08:57:50.277 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.186793.log.gz 2024-09-22T08:57:50.277 INFO:teuthology.orchestra.run.smithi038.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.64120.log.gz 2024-09-22T08:57:50.277 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.175906.log: 80.1% -- replaced with /var/log/ceph/ceph-client.0.175906.log.gz 2024-09-22T08:57:50.278 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146343.log 2024-09-22T08:57:50.278 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.41301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61530.log 2024-09-22T08:57:50.278 INFO:teuthology.orchestra.run.smithi038.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.0.41301.log.gz 2024-09-22T08:57:50.278 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.146343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56727.log 2024-09-22T08:57:50.278 INFO:teuthology.orchestra.run.smithi038.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.146343.log.gz 2024-09-22T08:57:50.278 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182607.log 2024-09-22T08:57:50.278 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.61530.log: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.61530.log.gz 2024-09-22T08:57:50.278 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.56727.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.56727.log.gz 2024-09-22T08:57:50.278 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190532.log 2024-09-22T08:57:50.278 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.182607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108644.log 2024-09-22T08:57:50.278 INFO:teuthology.orchestra.run.smithi038.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.0.182607.log.gz 2024-09-22T08:57:50.278 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.190532.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190532.log.gz 2024-09-22T08:57:50.278 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161681.log 2024-09-22T08:57:50.278 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.108644.log: -- /var/log/ceph/ceph-client.admin.62882.log 2024-09-22T08:57:50.279 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.161681.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.108644.log.gz 2024-09-22T08:57:50.279 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161681.log.gz 2024-09-22T08:57:50.279 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105699.log 2024-09-22T08:57:50.279 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189749.log 2024-09-22T08:57:50.279 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.62882.log: /var/log/ceph/ceph-client.admin.105699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81549.log 2024-09-22T08:57:50.279 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.189749.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189749.log.gz 2024-09-22T08:57:50.279 INFO:teuthology.orchestra.run.smithi038.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.105699.log.gz 2024-09-22T08:57:50.279 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109233.log 2024-09-22T08:57:50.279 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.81549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186771.log 2024-09-22T08:57:50.279 INFO:teuthology.orchestra.run.smithi038.stderr: 81.5%/var/log/ceph/ceph-client.admin.109233.log: -- replaced with /var/log/ceph/ceph-client.admin.81549.log.gz 2024-09-22T08:57:50.279 INFO:teuthology.orchestra.run.smithi038.stderr: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38724.log 2024-09-22T08:57:50.279 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.109233.log.gz 2024-09-22T08:57:50.279 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.186771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59720.log 2024-09-22T08:57:50.279 INFO:teuthology.orchestra.run.smithi038.stderr: 54.9% -- replaced with /var/log/ceph/ceph-client.admin.186771.log.gz 2024-09-22T08:57:50.280 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.38724.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174049.log 2024-09-22T08:57:50.280 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38724.log.gz 2024-09-22T08:57:50.280 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.59720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133973.log 2024-09-22T08:57:50.280 INFO:teuthology.orchestra.run.smithi038.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.59720.log.gz 2024-09-22T08:57:50.280 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.174049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122193.log 2024-09-22T08:57:50.280 INFO:teuthology.orchestra.run.smithi038.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.174049.log.gz 2024-09-22T08:57:50.280 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.133973.log: 81.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38984.log 2024-09-22T08:57:50.280 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.133973.log.gz 2024-09-22T08:57:50.280 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.122193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143987.log 2024-09-22T08:57:50.281 INFO:teuthology.orchestra.run.smithi038.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.122193.log.gz/var/log/ceph/ceph-client.admin.38984.log: 2024-09-22T08:57:50.281 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38984.log.gz 2024-09-22T08:57:50.281 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189979.log 2024-09-22T08:57:50.281 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.143987.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-22T08:57:50.281 INFO:teuthology.orchestra.run.smithi038.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.143987.log.gz 2024-09-22T08:57:50.281 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.189979.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189979.log.gz 2024-09-22T08:57:50.281 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156358.log 2024-09-22T08:57:50.281 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161732.log 2024-09-22T08:57:50.281 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.156358.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.156358.log.gz 2024-09-22T08:57:50.281 INFO:teuthology.orchestra.run.smithi038.stderr: 95.0% -- replaced with /var/log/ceph/ceph-client.admin.67217.log.gz 2024-09-22T08:57:50.282 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37995.log 2024-09-22T08:57:50.282 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.161732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130439.log 2024-09-22T08:57:50.282 INFO:teuthology.orchestra.run.smithi038.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.161732.log.gz 2024-09-22T08:57:50.282 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.37995.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37995.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56114.log 2024-09-22T08:57:50.282 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-09-22T08:57:50.282 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.130439.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.130439.log.gz 2024-09-22T08:57:50.282 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125727.log 2024-09-22T08:57:50.283 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50152.log 2024-09-22T08:57:50.283 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.56114.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56114.log.gz 2024-09-22T08:57:50.283 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.125727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190809.log 2024-09-22T08:57:50.283 INFO:teuthology.orchestra.run.smithi038.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.125727.log.gz 2024-09-22T08:57:50.283 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.50152.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50152.log.gz 2024-09-22T08:57:50.283 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33118.log 2024-09-22T08:57:50.283 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49563.log 2024-09-22T08:57:50.283 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.190809.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190809.log.gz 2024-09-22T08:57:50.283 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.33118.log: 0.0% 93.8% -- replaced with /var/log/ceph/ceph-client.admin.33118.log.gz 2024-09-22T08:57:50.284 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-22T08:57:50.284 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62882.log.gz 2024-09-22T08:57:50.284 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.49563.log: -- /var/log/ceph/ceph-client.admin.171940.log 2024-09-22T08:57:50.284 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-osd.2.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.49563.log.gz 2024-09-22T08:57:50.284 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145754.log 2024-09-22T08:57:50.284 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172548.log 2024-09-22T08:57:50.284 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.171940.log: /var/log/ceph/ceph-client.admin.145754.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.171940.log.gz 2024-09-22T08:57:50.284 INFO:teuthology.orchestra.run.smithi038.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.145754.log.gz 2024-09-22T08:57:50.284 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47772.log 2024-09-22T08:57:50.284 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190486.log 2024-09-22T08:57:50.284 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.172548.log: /var/log/ceph/ceph-client.admin.47772.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47772.log.gz 2024-09-22T08:57:50.285 INFO:teuthology.orchestra.run.smithi038.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.172548.log.gz 2024-09-22T08:57:50.285 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93919.log 2024-09-22T08:57:50.285 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38980.log 2024-09-22T08:57:50.285 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.190486.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190486.log.gz 2024-09-22T08:57:50.285 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.93919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47796.log 2024-09-22T08:57:50.285 INFO:teuthology.orchestra.run.smithi038.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.93919.log.gz 2024-09-22T08:57:50.285 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.38980.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38980.log.gz 2024-09-22T08:57:50.285 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47748.log 2024-09-22T08:57:50.285 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161092.log 2024-09-22T08:57:50.285 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.47796.log: /var/log/ceph/ceph-client.admin.47748.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.47796.log.gz 2024-09-22T08:57:50.285 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47748.log.gz 2024-09-22T08:57:50.285 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57905.log 2024-09-22T08:57:50.285 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.161092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61253.log 2024-09-22T08:57:50.285 INFO:teuthology.orchestra.run.smithi038.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.161092.log.gz 2024-09-22T08:57:50.286 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.57905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135151.log 2024-09-22T08:57:50.286 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.61253.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.57905.log.gz 2024-09-22T08:57:50.286 INFO:teuthology.orchestra.run.smithi038.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.61253.log.gz 2024-09-22T08:57:50.286 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156947.log 2024-09-22T08:57:50.286 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.135151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106288.log 2024-09-22T08:57:50.286 INFO:teuthology.orchestra.run.smithi038.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.135151.log.gz 2024-09-22T08:57:50.286 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.156947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168753.log 2024-09-22T08:57:50.286 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.106288.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.156947.log.gz 2024-09-22T08:57:50.286 INFO:teuthology.orchestra.run.smithi038.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.106288.log.gz 2024-09-22T08:57:50.286 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-22T08:57:50.286 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.168753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138686.log 2024-09-22T08:57:50.286 INFO:teuthology.orchestra.run.smithi038.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.168753.log.gz 2024-09-22T08:57:50.286 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111000.log 2024-09-22T08:57:50.286 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.138686.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.138686.log.gz 2024-09-22T08:57:50.287 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38548.log 2024-09-22T08:57:50.287 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.111000.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.111000.log.gz 2024-09-22T08:57:50.287 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113946.log 2024-09-22T08:57:50.287 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.38548.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38548.log.gz 2024-09-22T08:57:50.287 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40058.log 2024-09-22T08:57:50.287 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.113946.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.113946.log.gz 2024-09-22T08:57:50.287 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136330.log 2024-09-22T08:57:50.287 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.40058.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40058.log.gz 2024-09-22T08:57:50.287 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152823.log 2024-09-22T08:57:50.287 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.136330.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.136330.log.gz 2024-09-22T08:57:50.287 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117480.log 2024-09-22T08:57:50.287 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.152823.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.152823.log.gz 2024-09-22T08:57:50.287 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-22T08:57:50.287 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.117480.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.117480.log.gz 2024-09-22T08:57:50.287 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.188245.log 2024-09-22T08:57:50.344 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101576.log 2024-09-22T08:57:50.345 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.188245.log: 93.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-22T08:57:50.345 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189703.log 2024-09-22T08:57:50.345 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.101576.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.101576.log.gz 2024-09-22T08:57:50.345 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129261.log 2024-09-22T08:57:50.345 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.189703.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189703.log.gz 2024-09-22T08:57:50.345 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86851.log 2024-09-22T08:57:50.345 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.129261.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.129261.log.gz 2024-09-22T08:57:50.345 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144576.log 2024-09-22T08:57:50.345 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.86851.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.86851.log.gz 2024-09-22T08:57:50.345 INFO:teuthology.orchestra.run.smithi038.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.0.188245.log.gz 2024-09-22T08:57:50.345 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162910.log 2024-09-22T08:57:50.345 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.144576.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.144576.log.gz 2024-09-22T08:57:50.346 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124549.log 2024-09-22T08:57:50.346 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.162910.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.162910.log.gz 2024-09-22T08:57:50.346 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190440.log 2024-09-22T08:57:50.346 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.124549.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.124549.log.gz 2024-09-22T08:57:50.346 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83316.log 2024-09-22T08:57:50.346 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.190440.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190440.log.gz 2024-09-22T08:57:50.346 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89796.log 2024-09-22T08:57:50.346 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.83316.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.83316.log.gz 2024-09-22T08:57:50.346 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39922.log 2024-09-22T08:57:50.346 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.89796.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.89796.log.gz 2024-09-22T08:57:50.346 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155180.log 2024-09-22T08:57:50.346 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.39922.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39922.log.gz 2024-09-22T08:57:50.346 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103932.log 2024-09-22T08:57:50.347 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.155180.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.155180.log.gz 2024-09-22T08:57:50.347 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187526.log 2024-09-22T08:57:50.347 INFO:teuthology.orchestra.run.smithi038.stderr: 94.7% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-22T08:57:50.347 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.103932.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.103932.log.gz 2024-09-22T08:57:50.347 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38484.log 2024-09-22T08:57:50.347 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.187526.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187526.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187453.log 2024-09-22T08:57:50.347 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-09-22T08:57:50.347 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.38484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73814.log 2024-09-22T08:57:50.347 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38484.log.gz 2024-09-22T08:57:50.347 INFO:teuthology.orchestra.run.smithi038.stderr: 94.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-22T08:57:50.347 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.187453.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187453.log.gz 2024-09-22T08:57:50.347 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43116.log 2024-09-22T08:57:50.347 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.73814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77425.log 2024-09-22T08:57:50.347 INFO:teuthology.orchestra.run.smithi038.stderr: 81.6%/var/log/ceph/ceph-client.0.43116.log: -- replaced with /var/log/ceph/ceph-client.admin.73814.log.gz 2024-09-22T08:57:50.347 INFO:teuthology.orchestra.run.smithi038.stderr:gzip 43.5% -- replaced with /var/log/ceph/ceph-client.0.43116.log.gz 2024-09-22T08:57:50.348 INFO:teuthology.orchestra.run.smithi038.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.177735.log 2024-09-22T08:57:50.348 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.77425.log: /var/log/ceph/ceph-client.admin.173441.log 2024-09-22T08:57:50.348 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.177735.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.77425.log.gz 2024-09-22T08:57:50.348 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190209.log 2024-09-22T08:57:50.348 INFO:teuthology.orchestra.run.smithi038.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.0.177735.log.gz 2024-09-22T08:57:50.348 INFO:teuthology.orchestra.run.smithi038.stderr:gzip/var/log/ceph/ceph-client.admin.173441.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.154591.log 2024-09-22T08:57:50.348 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.190209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132795.log 2024-09-22T08:57:50.348 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190209.log.gz 2024-09-22T08:57:50.348 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.154591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48974.log 2024-09-22T08:57:50.348 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.132795.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.154591.log.gz 2024-09-22T08:57:50.348 INFO:teuthology.orchestra.run.smithi038.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.173441.log.gz 2024-09-22T08:57:50.348 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95097.log 2024-09-22T08:57:50.348 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5/var/log/ceph/ceph-client.admin.48974.log: --verbose -- /var/log/ceph/ceph-client.0.76558.log 2024-09-22T08:57:50.348 INFO:teuthology.orchestra.run.smithi038.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.48974.log.gz 2024-09-22T08:57:50.348 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.95097.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.132795.log.gz 2024-09-22T08:57:50.349 INFO:teuthology.orchestra.run.smithi038.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.95097.log.gz 2024-09-22T08:57:50.349 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58494.log 2024-09-22T08:57:50.349 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.76558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126905.log 2024-09-22T08:57:50.349 INFO:teuthology.orchestra.run.smithi038.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.0.76558.log.gz 2024-09-22T08:57:50.349 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.58494.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58494.log.gz 2024-09-22T08:57:50.349 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82727.log 2024-09-22T08:57:50.349 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.126905.log: 81.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190394.log 2024-09-22T08:57:50.349 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.126905.log.gz 2024-09-22T08:57:50.349 INFO:teuthology.orchestra.run.smithi038.stderr:gzip/var/log/ceph/ceph-client.admin.82727.log: -5 --verbose -- /var/log/ceph/ceph-client.0.40698.log 2024-09-22T08:57:50.349 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.190394.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.82727.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190394.log.gz 2024-09-22T08:57:50.349 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113356.log 2024-09-22T08:57:50.349 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-09-22T08:57:50.349 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79193.log 2024-09-22T08:57:50.349 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.40698.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.40698.log.gz 2024-09-22T08:57:50.350 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69695.log 2024-09-22T08:57:50.350 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.113356.log: 81.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32780.log 2024-09-22T08:57:50.350 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.113356.log.gz 2024-09-22T08:57:50.350 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.79193.log: /var/log/ceph/ceph-client.admin.69695.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.79193.log.gz 2024-09-22T08:57:50.350 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45392.log 2024-09-22T08:57:50.350 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42513.log 2024-09-22T08:57:50.350 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.32780.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32780.log.gz 2024-09-22T08:57:50.350 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.45392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50789.log 2024-09-22T08:57:50.350 INFO:teuthology.orchestra.run.smithi038.stderr: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.45392.log.gz 2024-09-22T08:57:50.350 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.42513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128083.log 2024-09-22T08:57:50.350 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.50789.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.42513.log.gz 2024-09-22T08:57:50.350 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127494.log 2024-09-22T08:57:50.350 INFO:teuthology.orchestra.run.smithi038.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.50789.log.gz 2024-09-22T08:57:50.350 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.128083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38982.log 2024-09-22T08:57:50.350 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.127494.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.128083.log.gz 2024-09-22T08:57:50.351 INFO:teuthology.orchestra.run.smithi038.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.127494.log.gz 2024-09-22T08:57:50.351 INFO:teuthology.orchestra.run.smithi038.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.69695.log.gz 2024-09-22T08:57:50.351 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96275.log 2024-09-22T08:57:50.351 INFO:teuthology.orchestra.run.smithi038.stderr:gzip/var/log/ceph/ceph-client.admin.38982.log: -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38982.log.gz 2024-09-22T08:57:50.351 INFO:teuthology.orchestra.run.smithi038.stderr: -- /var/log/ceph/ceph-client.0.179562.log 2024-09-22T08:57:50.351 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.96275.log: gzip -5 81.7% -- replaced with /var/log/ceph/ceph-client.admin.96275.log.gz 2024-09-22T08:57:50.351 INFO:teuthology.orchestra.run.smithi038.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39598.log 2024-09-22T08:57:50.351 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.179562.log: 83.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45981.log 2024-09-22T08:57:50.351 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.0.179562.log.gz 2024-09-22T08:57:50.351 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.39598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178344.log 2024-09-22T08:57:50.351 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39598.log.gz 2024-09-22T08:57:50.351 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.45981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93330.log 2024-09-22T08:57:50.351 INFO:teuthology.orchestra.run.smithi038.stderr: 83.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85673.log 2024-09-22T08:57:50.351 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45981.log.gz 2024-09-22T08:57:50.352 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.178344.log: /var/log/ceph/ceph-client.admin.93330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66598.log 2024-09-22T08:57:50.352 INFO:teuthology.orchestra.run.smithi038.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.93330.log.gz 2024-09-22T08:57:50.352 INFO:teuthology.orchestra.run.smithi038.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.0.178344.log.gz 2024-09-22T08:57:50.352 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.85673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104521.log 2024-09-22T08:57:50.352 INFO:teuthology.orchestra.run.smithi038.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.85673.log.gz 2024-09-22T08:57:50.352 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-22T08:57:50.352 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.66598.log: /var/log/ceph/ceph-client.admin.104521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123960.log 2024-09-22T08:57:50.352 INFO:teuthology.orchestra.run.smithi038.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.104521.log.gz 2024-09-22T08:57:50.352 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180780.log 2024-09-22T08:57:50.352 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.123960.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.123960.log.gz 2024-09-22T08:57:50.352 INFO:teuthology.orchestra.run.smithi038.stderr: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146932.log 2024-09-22T08:57:50.352 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66598.log.gz 2024-09-22T08:57:50.352 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.180780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61335.log 2024-09-22T08:57:50.352 INFO:teuthology.orchestra.run.smithi038.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.0.180780.log.gz 2024-09-22T08:57:50.353 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.146932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108055.log 2024-09-22T08:57:50.353 INFO:teuthology.orchestra.run.smithi038.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.146932.log.gz 2024-09-22T08:57:50.353 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.61335.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61335.log.gz 2024-09-22T08:57:50.353 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102165.log 2024-09-22T08:57:50.353 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.108055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39348.log 2024-09-22T08:57:50.353 INFO:teuthology.orchestra.run.smithi038.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.108055.log.gz/var/log/ceph/ceph-client.admin.102165.log: 2024-09-22T08:57:50.353 INFO:teuthology.orchestra.run.smithi038.stderr:gzip 89.0% -- replaced with /var/log/ceph/ceph-client.admin.102165.log.gz 2024-09-22T08:57:50.353 INFO:teuthology.orchestra.run.smithi038.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.190163.log 2024-09-22T08:57:50.353 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.39348.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39348.log.gz 2024-09-22T08:57:50.353 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138097.log 2024-09-22T08:57:50.353 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163499.log 2024-09-22T08:57:50.353 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.138097.log: /var/log/ceph/ceph-client.admin.190163.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190163.log.gz 2024-09-22T08:57:50.353 INFO:teuthology.orchestra.run.smithi038.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.138097.log.gz 2024-09-22T08:57:50.353 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123371.log 2024-09-22T08:57:50.353 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.163499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163499.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99809.log 2024-09-22T08:57:50.354 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-09-22T08:57:50.354 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96864.log 2024-09-22T08:57:50.354 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.123371.log: /var/log/ceph/ceph-client.admin.99809.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.99809.log.gz 2024-09-22T08:57:50.354 INFO:teuthology.orchestra.run.smithi038.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.123371.log.gz 2024-09-22T08:57:50.354 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190025.log 2024-09-22T08:57:50.354 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107466.log 2024-09-22T08:57:50.354 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.96864.log: /var/log/ceph/ceph-client.admin.190025.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.96864.log.gz 2024-09-22T08:57:50.354 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190025.log.gz 2024-09-22T08:57:50.354 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52556.log 2024-09-22T08:57:50.354 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121604.log 2024-09-22T08:57:50.354 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.107466.log: /var/log/ceph/ceph-client.admin.52556.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.107466.log.gz 2024-09-22T08:57:50.354 INFO:teuthology.orchestra.run.smithi038.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.52556.log.gz 2024-09-22T08:57:50.354 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87440.log 2024-09-22T08:57:50.354 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62179.log 2024-09-22T08:57:50.355 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.121604.log: /var/log/ceph/ceph-client.admin.87440.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.121604.log.gz 2024-09-22T08:57:50.355 INFO:teuthology.orchestra.run.smithi038.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.87440.log.gz 2024-09-22T08:57:50.355 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171332.log 2024-09-22T08:57:50.355 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132206.log 2024-09-22T08:57:50.355 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.171332.log: /var/log/ceph/ceph-client.admin.62179.log: 20.3% -- replaced with /var/log/ceph/ceph-client.admin.62179.log.gz 2024-09-22T08:57:50.355 INFO:teuthology.orchestra.run.smithi038.stderr: 92.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131617.log 2024-09-22T08:57:50.355 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.171332.log.gz 2024-09-22T08:57:50.355 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.184434.log 2024-09-22T08:57:50.355 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.132206.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.132206.log.gz 2024-09-22T08:57:50.355 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.131617.log: 81.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161705.log 2024-09-22T08:57:50.355 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.131617.log.gz 2024-09-22T08:57:50.355 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187501.log 2024-09-22T08:57:50.355 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.184434.log: /var/log/ceph/ceph-client.admin.161705.log: 80.2% -- replaced with /var/log/ceph/ceph-client.0.184434.log.gz 2024-09-22T08:57:50.355 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161705.log.gz 2024-09-22T08:57:50.356 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187477.log 2024-09-22T08:57:50.356 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.187501.log: /var/log/ceph/ceph-client.admin.38632.log 2024-09-22T08:57:50.356 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187501.log.gz 2024-09-22T08:57:50.356 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.187477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169969.log 2024-09-22T08:57:50.356 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.38632.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187477.log.gz 2024-09-22T08:57:50.356 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38632.log.gz 2024-09-22T08:57:50.356 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158125.log 2024-09-22T08:57:50.356 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65977.log 2024-09-22T08:57:50.356 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.169969.log: /var/log/ceph/ceph-client.admin.158125.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.169969.log.gz 2024-09-22T08:57:50.356 INFO:teuthology.orchestra.run.smithi038.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.158125.log.gz 2024-09-22T08:57:50.356 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72041.log 2024-09-22T08:57:50.356 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.65977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60618.log 2024-09-22T08:57:50.356 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.72041.log: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.72041.log.gz 2024-09-22T08:57:50.356 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111589.log 2024-09-22T08:57:50.356 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.60618.log: 59.8% -- replaced with /var/log/ceph/ceph-client.admin.60618.log.gz 2024-09-22T08:57:50.357 INFO:teuthology.orchestra.run.smithi038.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.65977.log.gz 2024-09-22T08:57:50.357 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164725.log 2024-09-22T08:57:50.357 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169361.log 2024-09-22T08:57:50.357 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.164725.log: /var/log/ceph/ceph-client.admin.111589.log: 81.4% 81.7% -- replaced with /var/log/ceph/ceph-client.admin.111589.log.gz 2024-09-22T08:57:50.357 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.164725.log.gz 2024-09-22T08:57:50.357 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78015.log 2024-09-22T08:57:50.357 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139864.log 2024-09-22T08:57:50.357 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.169361.log: /var/log/ceph/ceph-client.admin.78015.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.169361.log.gz 2024-09-22T08:57:50.357 INFO:teuthology.orchestra.run.smithi038.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.78015.log.gz 2024-09-22T08:57:50.357 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53734.log 2024-09-22T08:57:50.357 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-22T08:57:50.357 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.139864.log: /var/log/ceph/ceph-client.admin.53734.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.139864.log.gz 2024-09-22T08:57:50.357 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38678.log 2024-09-22T08:57:50.357 INFO:teuthology.orchestra.run.smithi038.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.53734.log.gz 2024-09-22T08:57:50.357 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153412.log 2024-09-22T08:57:50.358 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.38678.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38678.log.gz 2024-09-22T08:57:50.358 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190763.log 2024-09-22T08:57:50.358 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.153412.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.153412.log.gz 2024-09-22T08:57:50.358 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85083.log 2024-09-22T08:57:50.358 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.190763.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190763.log.gz 2024-09-22T08:57:50.358 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114535.log 2024-09-22T08:57:50.358 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.85083.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.85083.log.gz 2024-09-22T08:57:50.358 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163547.log 2024-09-22T08:57:50.358 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.114535.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.114535.log.gz 2024-09-22T08:57:50.358 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155769.log 2024-09-22T08:57:50.358 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.163547.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.163547.log.gz 2024-09-22T08:57:50.358 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55501.log 2024-09-22T08:57:50.358 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.155769.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.155769.log.gz 2024-09-22T08:57:50.358 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82138.log 2024-09-22T08:57:50.359 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.55501.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.55501.log.gz 2024-09-22T08:57:50.359 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64739.log 2024-09-22T08:57:50.359 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.82138.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.82138.log.gz 2024-09-22T08:57:50.359 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97453.log 2024-09-22T08:57:50.359 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.64739.log: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.64739.log.gz 2024-09-22T08:57:50.359 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.97453.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.97453.log.gz 2024-09-22T08:57:50.625 INFO:teuthology.orchestra.run.smithi042.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-22T08:57:51.028 INFO:teuthology.orchestra.run.smithi042.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-22T08:57:51.102 INFO:teuthology.orchestra.run.smithi038.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-22T08:57:51.804 INFO:teuthology.orchestra.run.smithi038.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-22T08:57:52.365 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-22T08:57:52.365 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-22T08:57:52.365 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-09-22T08:57:52.365 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-09-22T08:57:52.365 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-09-22T08:57:53.373 INFO:teuthology.orchestra.run.smithi038.stderr: 93.5% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-22T08:57:57.163 INFO:teuthology.orchestra.run.smithi038.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-22T08:57:57.802 INFO:teuthology.orchestra.run.smithi042.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-22T08:57:58.725 INFO:teuthology.orchestra.run.smithi042.stderr: 94.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-22T08:57:59.036 INFO:teuthology.orchestra.run.smithi038.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-22T08:58:02.126 INFO:teuthology.orchestra.run.smithi038.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-22T08:58:02.668 INFO:teuthology.orchestra.run.smithi042.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-22T08:58:09.119 INFO:teuthology.orchestra.run.smithi038.stderr: 95.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-22T08:58:09.121 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-09-22T08:58:09.121 INFO:teuthology.orchestra.run.smithi038.stderr:real 0m18.987s 2024-09-22T08:58:09.121 INFO:teuthology.orchestra.run.smithi038.stderr:user 0m50.753s 2024-09-22T08:58:09.121 INFO:teuthology.orchestra.run.smithi038.stderr:sys 0m1.882s 2024-09-22T08:58:09.757 INFO:teuthology.orchestra.run.smithi042.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-22T08:58:09.759 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-09-22T08:58:09.759 INFO:teuthology.orchestra.run.smithi042.stderr:real 0m19.588s 2024-09-22T08:58:09.759 INFO:teuthology.orchestra.run.smithi042.stderr:user 0m47.867s 2024-09-22T08:58:09.759 INFO:teuthology.orchestra.run.smithi042.stderr:sys 0m1.576s 2024-09-22T08:58:09.759 INFO:tasks.ceph:Archiving logs... 2024-09-22T08:58:09.760 DEBUG:teuthology.misc:Transferring archived files from smithi038:/var/log/ceph to /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915040/remote/smithi038/log 2024-09-22T08:58:09.761 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-22T08:58:16.375 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/log/ceph to /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915040/remote/smithi042/log 2024-09-22T08:58:16.376 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-22T08:58:22.606 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-22T08:58:22.617 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-22T08:58:22.617 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-22T08:58:22.620 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-22T08:58:22.727 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-22T08:58:22.742 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-22T08:58:22.743 DEBUG:teuthology.orchestra.run.smithi038:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-22T08:58:22.745 DEBUG:teuthology.orchestra.run.smithi042:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-22T08:58:22.775 INFO:teuthology.orchestra.run.smithi038.stderr:bash: line 1: ntpq: command not found 2024-09-22T08:58:22.780 INFO:teuthology.orchestra.run.smithi038.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-22T08:58:22.780 INFO:teuthology.orchestra.run.smithi038.stdout:=============================================================================== 2024-09-22T08:58:22.780 INFO:teuthology.orchestra.run.smithi038.stdout:^* hv01.front.sepia.ceph.com 3 6 377 21 +261us[ +311us] +/- 36ms 2024-09-22T08:58:22.780 INFO:teuthology.orchestra.run.smithi038.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 29 -322us[ -272us] +/- 63ms 2024-09-22T08:58:22.780 INFO:teuthology.orchestra.run.smithi038.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 22 -111us[ -62us] +/- 67ms 2024-09-22T08:58:22.780 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:58:22.780 INFO:teuthology.orchestra.run.smithi042.stderr:bash: line 1: ntpq: command not found 2024-09-22T08:58:22.784 INFO:teuthology.orchestra.run.smithi042.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-22T08:58:22.784 INFO:teuthology.orchestra.run.smithi042.stdout:=============================================================================== 2024-09-22T08:58:22.784 INFO:teuthology.orchestra.run.smithi042.stdout:^* hv01.front.sepia.ceph.com 3 8 377 93 +299us[ +293us] +/- 67ms 2024-09-22T08:58:22.784 INFO:teuthology.orchestra.run.smithi042.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 28 -316us[ -316us] +/- 63ms 2024-09-22T08:58:22.784 INFO:teuthology.orchestra.run.smithi042.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 86 -95us[ -95us] +/- 66ms 2024-09-22T08:58:22.784 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:58:22.785 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-22T08:58:22.796 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-22T08:58:22.796 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-22T08:58:22.806 DEBUG:teuthology.orchestra.run.smithi038:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-22T08:58:22.907 DEBUG:teuthology.orchestra.run.smithi042:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-22T08:58:22.993 DEBUG:teuthology.orchestra.run.smithi038:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-22T08:58:23.036 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:58:23.037 DEBUG:teuthology.orchestra.run.smithi042:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-22T08:58:23.081 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:58:23.082 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-22T08:58:23.092 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-22T08:58:23.159 INFO:teuthology.task.internal:Duration was 3055.413483 seconds 2024-09-22T08:58:23.159 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-22T08:58:23.169 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-22T08:58:23.169 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-22T08:58:23.172 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-22T08:58:23.226 INFO:teuthology.orchestra.run.smithi038.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-22T08:58:23.230 INFO:teuthology.orchestra.run.smithi042.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-22T08:58:23.737 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-22T08:58:23.737 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi038.front.sepia.ceph.com 2024-09-22T08:58:23.738 DEBUG:teuthology.orchestra.run.smithi038:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-22T08:58:23.777 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi042.front.sepia.ceph.com 2024-09-22T08:58:23.777 DEBUG:teuthology.orchestra.run.smithi042:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-22T08:58:23.825 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-22T08:58:23.825 DEBUG:teuthology.orchestra.run.smithi038:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-22T08:58:23.828 DEBUG:teuthology.orchestra.run.smithi042:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-22T08:58:23.874 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-22T08:58:23.874 DEBUG:teuthology.orchestra.run.smithi038:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-22T08:58:23.913 DEBUG:teuthology.orchestra.run.smithi042:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-22T08:58:24.033 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-22T08:58:24.045 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-22T08:58:24.045 DEBUG:teuthology.orchestra.run.smithi038:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-22T08:58:24.084 DEBUG:teuthology.orchestra.run.smithi042:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-22T08:58:24.125 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-22T08:58:24.137 DEBUG:teuthology.orchestra.run.smithi038:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-22T08:58:24.142 DEBUG:teuthology.orchestra.run.smithi042:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-22T08:58:24.175 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern = core 2024-09-22T08:58:24.203 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern = core 2024-09-22T08:58:24.232 DEBUG:teuthology.orchestra.run.smithi038:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-22T08:58:24.260 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:58:24.261 DEBUG:teuthology.orchestra.run.smithi042:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-22T08:58:24.300 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:58:24.300 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-22T08:58:24.314 INFO:teuthology.task.internal:Transferring archived files... 2024-09-22T08:58:24.314 DEBUG:teuthology.misc:Transferring archived files from smithi038:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915040/remote/smithi038 2024-09-22T08:58:24.315 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-22T08:58:24.366 DEBUG:teuthology.misc:Transferring archived files from smithi042:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915040/remote/smithi042 2024-09-22T08:58:24.366 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-22T08:58:24.591 INFO:teuthology.task.internal:Removing archive directory... 2024-09-22T08:58:24.591 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-22T08:58:24.594 DEBUG:teuthology.orchestra.run.smithi042:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-22T08:58:24.625 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-22T08:58:24.644 INFO:teuthology.task.internal:Not uploading archives. 2024-09-22T08:58:24.644 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-22T08:58:24.658 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-22T08:58:24.658 DEBUG:teuthology.orchestra.run.smithi038:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-22T08:58:24.663 DEBUG:teuthology.orchestra.run.smithi042:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-22T08:58:24.690 INFO:teuthology.orchestra.run.smithi038.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 22 08:58 /home/ubuntu/cephtest 2024-09-22T08:58:24.695 INFO:teuthology.orchestra.run.smithi042.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 22 08:58 /home/ubuntu/cephtest 2024-09-22T08:58:24.697 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-22T08:58:24.711 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-22T08:58:24.744 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} duration: 3055.4134826660156 flavor: default owner: scheduled_soumyakoduri@teuthology success: true 2024-09-22T08:58:24.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-22T08:58:24.821 INFO:teuthology.run:pass